Task 11115624

Name ParityModified-1639946515-17737-3-0_0
Workunit 8397381
Created 27 Jan 2022, 19:17:23 UTC
Sent 13 Feb 2022, 10:54:02 UTC
Report deadline 21 Feb 2022, 10:54:02 UTC
Received 13 Feb 2022, 12:57:21 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID 571
Run time 59 min 32 sec
CPU time 57 min 59 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 5,441.63 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 2.09 GB
Peak swap size 4.33 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.14.2</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code -1073741819 (0xc0000005)</message>
<stderr_txt>
1275 | Time: 2618.71 ms
[2022-02-13 12:47:53	                main:574]	:	INFO	:	Epoch 1163 | loss: 0.0311188 | val_loss: 0.0311274 | Time: 2604.8 ms
[2022-02-13 12:47:56	                main:574]	:	INFO	:	Epoch 1164 | loss: 0.0311139 | val_loss: 0.0311215 | Time: 2418.36 ms
[2022-02-13 12:47:58	                main:574]	:	INFO	:	Epoch 1165 | loss: 0.031111 | val_loss: 0.0311265 | Time: 2454.64 ms
[2022-02-13 12:48:00	                main:574]	:	INFO	:	Epoch 1166 | loss: 0.0311115 | val_loss: 0.0311168 | Time: 2356.37 ms
[2022-02-13 12:48:03	                main:574]	:	INFO	:	Epoch 1167 | loss: 0.0311069 | val_loss: 0.0311162 | Time: 2449.67 ms
[2022-02-13 12:48:05	                main:574]	:	INFO	:	Epoch 1168 | loss: 0.0311038 | val_loss: 0.0311177 | Time: 2430.13 ms
[2022-02-13 12:48:08	                main:574]	:	INFO	:	Epoch 1169 | loss: 0.0311027 | val_loss: 0.0311185 | Time: 2347.85 ms
[2022-02-13 12:48:10	                main:574]	:	INFO	:	Epoch 1170 | loss: 0.0311033 | val_loss: 0.0311168 | Time: 2600.58 ms
[2022-02-13 12:48:13	                main:574]	:	INFO	:	Epoch 1171 | loss: 0.0311006 | val_loss: 0.0311181 | Time: 2625.54 ms
[2022-02-13 12:48:16	                main:574]	:	INFO	:	Epoch 1172 | loss: 0.0311041 | val_loss: 0.0311222 | Time: 2625.14 ms
[2022-02-13 12:48:19	                main:574]	:	INFO	:	Epoch 1173 | loss: 0.0311082 | val_loss: 0.0311199 | Time: 2688.73 ms
[2022-02-13 12:48:21	                main:574]	:	INFO	:	Epoch 1174 | loss: 0.0310995 | val_loss: 0.0311145 | Time: 2590.48 ms
[2022-02-13 12:48:24	                main:574]	:	INFO	:	Epoch 1175 | loss: 0.0310967 | val_loss: 0.031113 | Time: 3034.71 ms
[2022-02-13 12:48:27	                main:574]	:	INFO	:	Epoch 1176 | loss: 0.0310971 | val_loss: 0.0311197 | Time: 2542.37 ms
[2022-02-13 12:48:29	                main:574]	:	INFO	:	Epoch 1177 | loss: 0.0311006 | val_loss: 0.0311215 | Time: 2376.92 ms
[2022-02-13 12:48:32	                main:574]	:	INFO	:	Epoch 1178 | loss: 0.031097 | val_loss: 0.0311168 | Time: 2354.66 ms
[2022-02-13 12:48:34	                main:574]	:	INFO	:	Epoch 1179 | loss: 0.0311005 | val_loss: 0.031121 | Time: 2480.82 ms
[2022-02-13 12:48:37	                main:574]	:	INFO	:	Epoch 1180 | loss: 0.031093 | val_loss: 0.0311174 | Time: 2629.79 ms
[2022-02-13 12:48:39	                main:574]	:	INFO	:	Epoch 1181 | loss: 0.0310953 | val_loss: 0.0311156 | Time: 2366.73 ms
[2022-02-13 12:48:42	                main:574]	:	INFO	:	Epoch 1182 | loss: 0.0310915 | val_loss: 0.0311217 | Time: 2390.75 ms
[2022-02-13 12:48:44	                main:574]	:	INFO	:	Epoch 1183 | loss: 0.0310899 | val_loss: 0.0311176 | Time: 2556.15 ms
[2022-02-13 12:48:47	                main:574]	:	INFO	:	Epoch 1184 | loss: 0.0310891 | val_loss: 0.0311166 | Time: 2790.62 ms
[2022-02-13 12:48:50	                main:574]	:	INFO	:	Epoch 1185 | loss: 0.0310887 | val_loss: 0.0311165 | Time: 2524.71 ms
[2022-02-13 12:48:52	                main:574]	:	INFO	:	Epoch 1186 | loss: 0.0310877 | val_loss: 0.0311149 | Time: 2549.74 ms
[2022-02-13 12:48:55	                main:574]	:	INFO	:	Epoch 1187 | loss: 0.0310872 | val_loss: 0.0311212 | Time: 2507.57 ms
[2022-02-13 12:48:57	                main:574]	:	INFO	:	Epoch 1188 | loss: 0.0310911 | val_loss: 0.0311205 | Time: 2420.79 ms
[2022-02-13 12:49:00	                main:574]	:	INFO	:	Epoch 1189 | loss: 0.0310876 | val_loss: 0.0311115 | Time: 2366.8 ms
[2022-02-13 12:49:02	                main:574]	:	INFO	:	Epoch 1190 | loss: 0.0310864 | val_loss: 0.0311165 | Time: 2357.86 ms
[2022-02-13 12:49:05	                main:574]	:	INFO	:	Epoch 1191 | loss: 0.0310909 | val_loss: 0.0311225 | Time: 2607.9 ms
[2022-02-13 12:49:07	                main:574]	:	INFO	:	Epoch 1192 | loss: 0.0310874 | val_loss: 0.0311152 | Time: 2592.95 ms
[2022-02-13 12:49:10	                main:574]	:	INFO	:	Epoch 1193 | loss: 0.0310877 | val_loss: 0.0311165 | Time: 2549.05 ms
[2022-02-13 12:49:12	                main:574]	:	INFO	:	Epoch 1194 | loss: 0.0310895 | val_loss: 0.0311224 | Time: 2340.87 ms
[2022-02-13 12:49:15	                main:574]	:	INFO	:	Epoch 1195 | loss: 0.031087 | val_loss: 0.0311198 | Time: 2792.59 ms
[2022-02-13 12:49:18	                main:574]	:	INFO	:	Epoch 1196 | loss: 0.0310892 | val_loss: 0.0311214 | Time: 2592.87 ms
[2022-02-13 12:49:20	                main:574]	:	INFO	:	Epoch 1197 | loss: 0.0310978 | val_loss: 0.0311349 | Time: 2564.01 ms
[2022-02-13 12:49:23	                main:574]	:	INFO	:	Epoch 1198 | loss: 0.0310868 | val_loss: 0.0311239 | Time: 2410.01 ms
[2022-02-13 12:49:25	                main:574]	:	INFO	:	Epoch 1199 | loss: 0.0310881 | val_loss: 0.0311211 | Time: 2402.83 ms
[2022-02-13 12:49:28	                main:574]	:	INFO	:	Epoch 1200 | loss: 0.0310874 | val_loss: 0.0311191 | Time: 2383.67 ms
[2022-02-13 12:49:30	                main:574]	:	INFO	:	Epoch 1201 | loss: 0.0310888 | val_loss: 0.0311237 | Time: 2419.3 ms
[2022-02-13 12:49:33	                main:574]	:	INFO	:	Epoch 1202 | loss: 0.031092 | val_loss: 0.0311263 | Time: 2580.88 ms
[2022-02-13 12:49:35	                main:574]	:	INFO	:	Epoch 1203 | loss: 0.031087 | val_loss: 0.0311141 | Time: 2556.76 ms
[2022-02-13 12:49:38	                main:574]	:	INFO	:	Epoch 1204 | loss: 0.031082 | val_loss: 0.0311159 | Time: 2620.63 ms
[2022-02-13 12:49:41	                main:574]	:	INFO	:	Epoch 1205 | loss: 0.0310832 | val_loss: 0.0311306 | Time: 2529.87 ms
[2022-02-13 12:49:43	                main:574]	:	INFO	:	Epoch 1206 | loss: 0.0310856 | val_loss: 0.031117 | Time: 2332.43 ms
[2022-02-13 12:49:46	                main:574]	:	INFO	:	Epoch 1207 | loss: 0.0310855 | val_loss: 0.0311147 | Time: 2520.83 ms
[2022-02-13 12:49:48	                main:574]	:	INFO	:	Epoch 1208 | loss: 0.031084 | val_loss: 0.0311158 | Time: 2505.54 ms
[2022-02-13 12:49:50	                main:574]	:	INFO	:	Epoch 1209 | loss: 0.0310852 | val_loss: 0.031121 | Time: 2343.66 ms
[2022-02-13 12:49:53	                main:574]	:	INFO	:	Epoch 1210 | loss: 0.0310847 | val_loss: 0.0311155 | Time: 2406.09 ms
[2022-02-13 12:49:55	                main:574]	:	INFO	:	Epoch 1211 | loss: 0.0310846 | val_loss: 0.0311138 | Time: 2342.37 ms
[2022-02-13 12:49:58	                main:574]	:	INFO	:	Epoch 1212 | loss: 0.0310822 | val_loss: 0.0311161 | Time: 2337.46 ms
[2022-02-13 12:50:00	                main:574]	:	INFO	:	Epoch 1213 | loss: 0.0310817 | val_loss: 0.0311168 | Time: 2511.84 ms
[2022-02-13 12:50:03	                main:574]	:	INFO	:	Epoch 1214 | loss: 0.0310821 | val_loss: 0.0311179 | Time: 2602.02 ms
[2022-02-13 12:50:05	                main:574]	:	INFO	:	Epoch 1215 | loss: 0.0310796 | val_loss: 0.0311214 | Time: 2575.82 ms
[2022-02-13 12:50:08	                main:574]	:	INFO	:	Epoch 1216 | loss: 0.0310821 | val_loss: 0.0311159 | Time: 2675.08 ms
[2022-02-13 12:50:11	                main:574]	:	INFO	:	Epoch 1217 | loss: 0.0310802 | val_loss: 0.031117 | Time: 2674.76 ms
[2022-02-13 12:50:13	                main:574]	:	INFO	:	Epoch 1218 | loss: 0.0310803 | val_loss: 0.0311142 | Time: 2419.33 ms
[2022-02-13 12:50:16	                main:574]	:	INFO	:	Epoch 1219 | loss: 0.0310855 | val_loss: 0.0311158 | Time: 2360.7 ms
[2022-02-13 12:50:18	                main:574]	:	INFO	:	Epoch 1220 | loss: 0.0310914 | val_loss: 0.031137 | Time: 2408.72 ms
[2022-02-13 12:50:21	                main:574]	:	INFO	:	Epoch 1221 | loss: 0.0310928 | val_loss: 0.0311227 | Time: 2369.02 ms
[2022-02-13 12:50:23	                main:574]	:	INFO	:	Epoch 1222 | loss: 0.0310844 | val_loss: 0.0311111 | Time: 2339.85 ms
[2022-02-13 12:50:25	                main:574]	:	INFO	:	Epoch 1223 | loss: 0.0310862 | val_loss: 0.0311194 | Time: 2427.91 ms
[2022-02-13 12:50:28	                main:574]	:	INFO	:	Epoch 1224 | loss: 0.0310829 | val_loss: 0.0311143 | Time: 2375.47 ms
[2022-02-13 12:50:30	                main:574]	:	INFO	:	Epoch 1225 | loss: 0.0310858 | val_loss: 0.0311146 | Time: 2433.72 ms
[2022-02-13 12:50:33	                main:574]	:	INFO	:	Epoch 1226 | loss: 0.0310897 | val_loss: 0.0311228 | Time: 2654.1 ms
[2022-02-13 12:50:36	                main:574]	:	INFO	:	Epoch 1227 | loss: 0.0310951 | val_loss: 0.031115 | Time: 2669.79 ms
[2022-02-13 12:50:39	                main:574]	:	INFO	:	Epoch 1228 | loss: 0.0310904 | val_loss: 0.0311141 | Time: 2698.92 ms
[2022-02-13 12:50:41	                main:574]	:	INFO	:	Epoch 1229 | loss: 0.0310875 | val_loss: 0.0311098 | Time: 2667.5 ms
[2022-02-13 12:50:44	                main:574]	:	INFO	:	Epoch 1230 | loss: 0.0310867 | val_loss: 0.0311137 | Time: 2462.55 ms
[2022-02-13 12:50:46	                main:574]	:	INFO	:	Epoch 1231 | loss: 0.0310837 | val_loss: 0.0311121 | Time: 2386.69 ms
[2022-02-13 12:50:49	                main:574]	:	INFO	:	Epoch 1232 | loss: 0.0310871 | val_loss: 0.0311105 | Time: 2448.88 ms
[2022-02-13 12:50:51	                main:574]	:	INFO	:	Epoch 1233 | loss: 0.0310848 | val_loss: 0.0311163 | Time: 2409.39 ms
[2022-02-13 12:50:54	                main:574]	:	INFO	:	Epoch 1234 | loss: 0.0310857 | val_loss: 0.0311112 | Time: 2517.04 ms
[2022-02-13 12:50:56	                main:574]	:	INFO	:	Epoch 1235 | loss: 0.0310837 | val_loss: 0.0311114 | Time: 2321.64 ms
[2022-02-13 12:50:58	                main:574]	:	INFO	:	Epoch 1236 | loss: 0.0310816 | val_loss: 0.0311145 | Time: 2320.97 ms
[2022-02-13 12:51:01	                main:574]	:	INFO	:	Epoch 1237 | loss: 0.0310819 | val_loss: 0.0311072 | Time: 2804.22 ms
[2022-02-13 12:51:04	                main:574]	:	INFO	:	Epoch 1238 | loss: 0.0310818 | val_loss: 0.0311072 | Time: 2539.52 ms
[2022-02-13 12:51:06	                main:574]	:	INFO	:	Epoch 1239 | loss: 0.0310815 | val_loss: 0.0311128 | Time: 2647.28 ms
[2022-02-13 12:51:09	                main:574]	:	INFO	:	Epoch 1240 | loss: 0.0310809 | val_loss: 0.0311084 | Time: 2601.62 ms
[2022-02-13 12:51:12	                main:574]	:	INFO	:	Epoch 1241 | loss: 0.031084 | val_loss: 0.0311168 | Time: 2571.5 ms
[2022-02-13 12:51:14	                main:574]	:	INFO	:	Epoch 1242 | loss: 0.0310824 | val_loss: 0.0311074 | Time: 2390.22 ms
[2022-02-13 12:51:17	                main:574]	:	INFO	:	Epoch 1243 | loss: 0.0310813 | val_loss: 0.0311174 | Time: 2431.79 ms
[2022-02-13 12:51:19	                main:574]	:	INFO	:	Epoch 1244 | loss: 0.0310943 | val_loss: 0.0311215 | Time: 2357.67 ms
[2022-02-13 12:51:22	                main:574]	:	INFO	:	Epoch 1245 | loss: 0.0311026 | val_loss: 0.0311228 | Time: 2420.29 ms
[2022-02-13 12:51:24	                main:574]	:	INFO	:	Epoch 1246 | loss: 0.0311085 | val_loss: 0.0311211 | Time: 2655.47 ms
[2022-02-13 12:51:27	                main:574]	:	INFO	:	Epoch 1247 | loss: 0.0311002 | val_loss: 0.0311273 | Time: 2598.61 ms
[2022-02-13 12:51:29	                main:574]	:	INFO	:	Epoch 1248 | loss: 0.0310976 | val_loss: 0.0311266 | Time: 2359.75 ms
[2022-02-13 12:51:32	                main:574]	:	INFO	:	Epoch 1249 | loss: 0.0310953 | val_loss: 0.0311148 | Time: 2539.73 ms
[2022-02-13 12:51:35	                main:574]	:	INFO	:	Epoch 1250 | loss: 0.0310921 | val_loss: 0.0311249 | Time: 2640.87 ms
[2022-02-13 12:51:37	                main:574]	:	INFO	:	Epoch 1251 | loss: 0.031092 | val_loss: 0.0311107 | Time: 2661.44 ms
[2022-02-13 12:51:40	                main:574]	:	INFO	:	Epoch 1252 | loss: 0.0310877 | val_loss: 0.0311144 | Time: 2726.94 ms
[2022-02-13 12:51:43	                main:574]	:	INFO	:	Epoch 1253 | loss: 0.0310884 | val_loss: 0.0311246 | Time: 3190.55 ms
[2022-02-13 12:51:46	                main:574]	:	INFO	:	Epoch 1254 | loss: 0.0310899 | val_loss: 0.031114 | Time: 2487.37 ms
[2022-02-13 12:51:48	                main:574]	:	INFO	:	Epoch 1255 | loss: 0.0310878 | val_loss: 0.0311141 | Time: 2413.73 ms
[2022-02-13 12:51:51	                main:574]	:	INFO	:	Epoch 1256 | loss: 0.0310853 | val_loss: 0.0311123 | Time: 2449.64 ms
[2022-02-13 12:51:54	                main:574]	:	INFO	:	Epoch 1257 | loss: 0.0310824 | val_loss: 0.0311142 | Time: 2841.53 ms
[2022-02-13 12:51:56	                main:574]	:	INFO	:	Epoch 1258 | loss: 0.0310822 | val_loss: 0.0311168 | Time: 2639.03 ms
[2022-02-13 12:51:59	                main:574]	:	INFO	:	Epoch 1259 | loss: 0.0310868 | val_loss: 0.0311161 | Time: 2422.61 ms
[2022-02-13 12:52:01	                main:574]	:	INFO	:	Epoch 1260 | loss: 0.0310886 | val_loss: 0.0311148 | Time: 2417.59 ms
[2022-02-13 12:52:04	                main:574]	:	INFO	:	Epoch 1261 | loss: 0.0310861 | val_loss: 0.0311097 | Time: 2407.08 ms
[2022-02-13 12:52:06	                main:574]	:	INFO	:	Epoch 1262 | loss: 0.0310878 | val_loss: 0.0311079 | Time: 2696.31 ms
[2022-02-13 12:52:09	                main:574]	:	INFO	:	Epoch 1263 | loss: 0.0310838 | val_loss: 0.0311154 | Time: 2620.1 ms
[2022-02-13 12:52:12	                main:574]	:	INFO	:	Epoch 1264 | loss: 0.0310812 | val_loss: 0.0311103 | Time: 2380.23 ms
[2022-02-13 12:52:14	                main:574]	:	INFO	:	Epoch 1265 | loss: 0.0310817 | val_loss: 0.0311106 | Time: 2424.97 ms
[2022-02-13 12:52:16	                main:574]	:	INFO	:	Epoch 1266 | loss: 0.0310799 | val_loss: 0.0311058 | Time: 2358.25 ms
[2022-02-13 12:52:19	                main:574]	:	INFO	:	Epoch 1267 | loss: 0.0310788 | val_loss: 0.0311079 | Time: 2377.59 ms
[2022-02-13 12:52:22	                main:574]	:	INFO	:	Epoch 1268 | loss: 0.0310783 | val_loss: 0.0311052 | Time: 2605.26 ms
[2022-02-13 12:52:24	                main:574]	:	INFO	:	Epoch 1269 | loss: 0.0310825 | val_loss: 0.0311116 | Time: 2570.16 ms
[2022-02-13 12:52:27	                main:574]	:	INFO	:	Epoch 1270 | loss: 0.0310834 | val_loss: 0.031107 | Time: 2609.25 ms
[2022-02-13 12:52:29	                main:574]	:	INFO	:	Epoch 1271 | loss: 0.0310776 | val_loss: 0.0311118 | Time: 2595.19 ms
[2022-02-13 12:52:32	                main:574]	:	INFO	:	Epoch 1272 | loss: 0.0310777 | val_loss: 0.031109 | Time: 2918.61 ms
[2022-02-13 12:52:35	                main:574]	:	INFO	:	Epoch 1273 | loss: 0.031078 | val_loss: 0.0311103 | Time: 2478.84 ms
[2022-02-13 12:52:38	                main:574]	:	INFO	:	Epoch 1274 | loss: 0.0310776 | val_loss: 0.0311139 | Time: 2659.95 ms
[2022-02-13 12:52:40	                main:574]	:	INFO	:	Epoch 1275 | loss: 0.031085 | val_loss: 0.0311203 | Time: 2611.18 ms
[2022-02-13 12:52:43	                main:574]	:	INFO	:	Epoch 1276 | loss: 0.0310807 | val_loss: 0.0311123 | Time: 2495.51 ms
[2022-02-13 12:52:45	                main:574]	:	INFO	:	Epoch 1277 | loss: 0.0310762 | val_loss: 0.0311069 | Time: 2432.49 ms
[2022-02-13 12:52:49	                main:574]	:	INFO	:	Epoch 1278 | loss: 0.0310799 | val_loss: 0.0311084 | Time: 3217.79 ms
[2022-02-13 12:52:52	                main:574]	:	INFO	:	Epoch 1279 | loss: 0.0310782 | val_loss: 0.0311089 | Time: 3341.04 ms
[2022-02-13 12:52:55	                main:574]	:	INFO	:	Epoch 1280 | loss: 0.0310794 | val_loss: 0.0311029 | Time: 2601.61 ms
[2022-02-13 12:52:58	                main:574]	:	INFO	:	Epoch 1281 | loss: 0.0310807 | val_loss: 0.0311063 | Time: 2672.85 ms
[2022-02-13 12:53:00	                main:574]	:	INFO	:	Epoch 1282 | loss: 0.0310787 | val_loss: 0.0311023 | Time: 2576.28 ms
[2022-02-13 12:53:03	                main:574]	:	INFO	:	Epoch 1283 | loss: 0.0310771 | val_loss: 0.0311067 | Time: 2403.33 ms
[2022-02-13 12:53:05	                main:574]	:	INFO	:	Epoch 1284 | loss: 0.031078 | val_loss: 0.0311073 | Time: 2451.88 ms
[2022-02-13 12:53:08	                main:574]	:	INFO	:	Epoch 1285 | loss: 0.0310766 | val_loss: 0.0311275 | Time: 2355.9 ms
[2022-02-13 12:53:10	                main:574]	:	INFO	:	Epoch 1286 | loss: 0.0310901 | val_loss: 0.031115 | Time: 2409.35 ms
[2022-02-13 12:53:13	                main:574]	:	INFO	:	Epoch 1287 | loss: 0.0310761 | val_loss: 0.0311078 | Time: 2431.68 ms
[2022-02-13 12:53:15	                main:574]	:	INFO	:	Epoch 1288 | loss: 0.0310721 | val_loss: 0.0311056 | Time: 2641.28 ms
[2022-02-13 12:53:18	                main:574]	:	INFO	:	Epoch 1289 | loss: 0.0310757 | val_loss: 0.0311083 | Time: 2602.35 ms
[2022-02-13 12:53:21	                main:574]	:	INFO	:	Epoch 1290 | loss: 0.0310734 | val_loss: 0.0311046 | Time: 2656.06 ms
[2022-02-13 12:53:23	                main:574]	:	INFO	:	Epoch 1291 | loss: 0.0310817 | val_loss: 0.0311053 | Time: 2616.4 ms
[2022-02-13 12:53:26	                main:574]	:	INFO	:	Epoch 1292 | loss: 0.0310765 | val_loss: 0.0311057 | Time: 2570.36 ms
[2022-02-13 12:53:29	                main:574]	:	INFO	:	Epoch 1293 | loss: 0.0310768 | val_loss: 0.0311067 | Time: 2864.75 ms
[2022-02-13 12:53:31	                main:574]	:	INFO	:	Epoch 1294 | loss: 0.0310784 | val_loss: 0.0311107 | Time: 2408.7 ms
[2022-02-13 12:53:34	                main:574]	:	INFO	:	Epoch 1295 | loss: 0.0310779 | val_loss: 0.0311098 | Time: 2400.07 ms
[2022-02-13 12:53:36	                main:574]	:	INFO	:	Epoch 1296 | loss: 0.0310738 | val_loss: 0.0311112 | Time: 2431.31 ms
[2022-02-13 12:53:39	                main:574]	:	INFO	:	Epoch 1297 | loss: 0.0310721 | val_loss: 0.0311086 | Time: 2362.37 ms
[2022-02-13 12:53:41	                main:574]	:	INFO	:	Epoch 1298 | loss: 0.0310735 | val_loss: 0.0311098 | Time: 2561.53 ms
[2022-02-13 12:53:44	                main:574]	:	INFO	:	Epoch 1299 | loss: 0.0310731 | val_loss: 0.0311058 | Time: 2413.39 ms
[2022-02-13 12:53:46	                main:574]	:	INFO	:	Epoch 1300 | loss: 0.0310732 | val_loss: 0.0311146 | Time: 2597.95 ms
[2022-02-13 12:53:50	                main:574]	:	INFO	:	Epoch 1301 | loss: 0.031075 | val_loss: 0.0311144 | Time: 3693.64 ms
[2022-02-13 12:53:53	                main:574]	:	INFO	:	Epoch 1302 | loss: 0.0310765 | val_loss: 0.0311068 | Time: 2605.94 ms
[2022-02-13 12:53:55	                main:574]	:	INFO	:	Epoch 1303 | loss: 0.0310746 | val_loss: 0.0311036 | Time: 2539.61 ms
[2022-02-13 12:53:58	                main:574]	:	INFO	:	Epoch 1304 | loss: 0.0310732 | val_loss: 0.0311105 | Time: 2629.3 ms
[2022-02-13 12:54:01	                main:574]	:	INFO	:	Epoch 1305 | loss: 0.031073 | val_loss: 0.0311189 | Time: 2476.91 ms
[2022-02-13 12:54:03	                main:574]	:	INFO	:	Epoch 1306 | loss: 0.0310718 | val_loss: 0.0311067 | Time: 2401.98 ms
[2022-02-13 12:54:05	                main:574]	:	INFO	:	Epoch 1307 | loss: 0.0310714 | val_loss: 0.0311058 | Time: 2449.89 ms
[2022-02-13 12:54:08	                main:574]	:	INFO	:	Epoch 1308 | loss: 0.0310726 | val_loss: 0.0311037 | Time: 2398.55 ms
[2022-02-13 12:54:11	                main:574]	:	INFO	:	Epoch 1309 | loss: 0.0310713 | val_loss: 0.0311096 | Time: 2609.45 ms
[2022-02-13 12:54:13	                main:574]	:	INFO	:	Epoch 1310 | loss: 0.0310709 | val_loss: 0.0311056 | Time: 2596.08 ms
[2022-02-13 12:54:16	                main:574]	:	INFO	:	Epoch 1311 | loss: 0.0310688 | val_loss: 0.0311063 | Time: 2384.98 ms
[2022-02-13 12:54:18	                main:574]	:	INFO	:	Epoch 1312 | loss: 0.031069 | val_loss: 0.0311088 | Time: 2463.59 ms
[2022-02-13 12:54:21	                main:574]	:	INFO	:	Epoch 1313 | loss: 0.0310686 | val_loss: 0.0311066 | Time: 2696.43 ms
[2022-02-13 12:54:24	                main:574]	:	INFO	:	Epoch 1314 | loss: 0.031068 | val_loss: 0.0311082 | Time: 2607.51 ms
[2022-02-13 12:54:26	                main:574]	:	INFO	:	Epoch 1315 | loss: 0.0310713 | val_loss: 0.0311298 | Time: 2759.82 ms
[2022-02-13 12:54:29	                main:574]	:	INFO	:	Epoch 1316 | loss: 0.0310904 | val_loss: 0.0311098 | Time: 2472.07 ms
[2022-02-13 12:54:31	                main:574]	:	INFO	:	Epoch 1317 | loss: 0.0310812 | val_loss: 0.0311066 | Time: 2443.07 ms
[2022-02-13 12:54:34	                main:574]	:	INFO	:	Epoch 1318 | loss: 0.0310766 | val_loss: 0.0311058 | Time: 2369.64 ms
[2022-02-13 12:54:36	                main:574]	:	INFO	:	Epoch 1319 | loss: 0.031075 | val_loss: 0.0311063 | Time: 2381.23 ms
[2022-02-13 12:54:39	                main:574]	:	INFO	:	Epoch 1320 | loss: 0.0310724 | val_loss: 0.0311073 | Time: 2562.65 ms
[2022-02-13 12:54:42	                main:574]	:	INFO	:	Epoch 1321 | loss: 0.0310785 | val_loss: 0.0311043 | Time: 2683.99 ms
[2022-02-13 12:54:44	                main:574]	:	INFO	:	Epoch 1322 | loss: 0.0310732 | val_loss: 0.0311034 | Time: 2410.17 ms
[2022-02-13 12:54:46	                main:574]	:	INFO	:	Epoch 1323 | loss: 0.0310733 | val_loss: 0.0311058 | Time: 2421.81 ms
[2022-02-13 12:54:49	                main:574]	:	INFO	:	Epoch 1324 | loss: 0.0310726 | val_loss: 0.0311085 | Time: 2536.66 ms
[2022-02-13 12:54:52	                main:574]	:	INFO	:	Epoch 1325 | loss: 0.0310726 | val_loss: 0.0311128 | Time: 2617.98 ms
[2022-02-13 12:54:54	                main:574]	:	INFO	:	Epoch 1326 | loss: 0.0310734 | val_loss: 0.0311077 | Time: 2602.37 ms
[2022-02-13 12:54:57	                main:574]	:	INFO	:	Epoch 1327 | loss: 0.0310702 | val_loss: 0.0311066 | Time: 2418.01 ms
[2022-02-13 12:54:59	                main:574]	:	INFO	:	Epoch 1328 | loss: 0.0310691 | val_loss: 0.0311062 | Time: 2468.6 ms
[2022-02-13 12:55:02	                main:574]	:	INFO	:	Epoch 1329 | loss: 0.0310757 | val_loss: 0.0311077 | Time: 2663.92 ms
[2022-02-13 12:55:04	                main:574]	:	INFO	:	Epoch 1330 | loss: 0.0310739 | val_loss: 0.0311076 | Time: 2388.46 ms
[2022-02-13 12:55:07	                main:574]	:	INFO	:	Epoch 1331 | loss: 0.0310723 | val_loss: 0.0311086 | Time: 2560.48 ms
[2022-02-13 12:55:10	                main:574]	:	INFO	:	Epoch 1332 | loss: 0.031074 | val_loss: 0.0311079 | Time: 2554.03 ms
[2022-02-13 12:55:13	                main:574]	:	INFO	:	Epoch 1333 | loss: 0.0311013 | val_loss: 0.0311215 | Time: 2957.63 ms
[2022-02-13 12:55:15	                main:574]	:	INFO	:	Epoch 1334 | loss: 0.0310987 | val_loss: 0.0311113 | Time: 2720.52 ms
[2022-02-13 12:55:18	                main:574]	:	INFO	:	Epoch 1335 | loss: 0.0310889 | val_loss: 0.0311014 | Time: 2532.77 ms
[2022-02-13 12:55:21	                main:574]	:	INFO	:	Epoch 1336 | loss: 0.0310837 | val_loss: 0.0311035 | Time: 2969.72 ms
[2022-02-13 12:55:23	                main:574]	:	INFO	:	Epoch 1337 | loss: 0.0310835 | val_loss: 0.0311044 | Time: 2561.21 ms
[2022-02-13 12:55:26	                main:574]	:	INFO	:	Epoch 1338 | loss: 0.0310806 | val_loss: 0.0311066 | Time: 2552.88 ms
[2022-02-13 12:55:28	                main:574]	:	INFO	:	Epoch 1339 | loss: 0.0310777 | val_loss: 0.0311006 | Time: 2352.58 ms
[2022-02-13 12:55:31	                main:574]	:	INFO	:	Epoch 1340 | loss: 0.0310756 | val_loss: 0.031113 | Time: 2395.13 ms
[2022-02-13 12:55:33	                main:574]	:	INFO	:	Epoch 1341 | loss: 0.0310798 | val_loss: 0.0311025 | Time: 2381.56 ms
[2022-02-13 12:55:36	                main:574]	:	INFO	:	Epoch 1342 | loss: 0.0310786 | val_loss: 0.0311059 | Time: 2380.38 ms
[2022-02-13 12:55:38	                main:574]	:	INFO	:	Epoch 1343 | loss: 0.0310716 | val_loss: 0.0311082 | Time: 2615.5 ms
[2022-02-13 12:55:41	                main:574]	:	INFO	:	Epoch 1344 | loss: 0.031076 | val_loss: 0.0311042 | Time: 2627.77 ms
[2022-02-13 12:55:44	                main:574]	:	INFO	:	Epoch 1345 | loss: 0.0310729 | val_loss: 0.0311056 | Time: 2537.15 ms
[2022-02-13 12:55:46	                main:574]	:	INFO	:	Epoch 1346 | loss: 0.0310691 | val_loss: 0.0311089 | Time: 2642.67 ms
[2022-02-13 12:55:49	                main:574]	:	INFO	:	Epoch 1347 | loss: 0.0310729 | val_loss: 0.0311044 | Time: 2608.15 ms
[2022-02-13 12:55:51	                main:574]	:	INFO	:	Epoch 1348 | loss: 0.03107 | val_loss: 0.0311076 | Time: 2373.93 ms
[2022-02-13 12:55:54	                main:574]	:	INFO	:	Epoch 1349 | loss: 0.03107 | val_loss: 0.031104 | Time: 2379.55 ms
[2022-02-13 12:55:56	                main:574]	:	INFO	:	Epoch 1350 | loss: 0.0310713 | val_loss: 0.0311018 | Time: 2422.82 ms
[2022-02-13 12:55:59	                main:574]	:	INFO	:	Epoch 1351 | loss: 0.0310717 | val_loss: 0.0311041 | Time: 2591.77 ms
[2022-02-13 12:56:01	                main:574]	:	INFO	:	Epoch 1352 | loss: 0.0310704 | val_loss: 0.031108 | Time: 2454.58 ms
[2022-02-13 12:56:04	                main:574]	:	INFO	:	Epoch 1353 | loss: 0.0310685 | val_loss: 0.031111 | Time: 2365.29 ms
[2022-02-13 12:56:07	                main:574]	:	INFO	:	Epoch 1354 | loss: 0.03107 | val_loss: 0.0311051 | Time: 2721.28 ms
[2022-02-13 12:56:09	                main:574]	:	INFO	:	Epoch 1355 | loss: 0.0310703 | val_loss: 0.0311085 | Time: 2502.31 ms
[2022-02-13 12:56:12	                main:574]	:	INFO	:	Epoch 1356 | loss: 0.0310694 | val_loss: 0.0311055 | Time: 2665.76 ms
[2022-02-13 12:56:14	                main:574]	:	INFO	:	Epoch 1357 | loss: 0.0310683 | val_loss: 0.0311124 | Time: 2628.15 ms
[2022-02-13 12:56:17	                main:574]	:	INFO	:	Epoch 1358 | loss: 0.031073 | val_loss: 0.031118 | Time: 2470.36 ms
[2022-02-13 12:56:20	                main:574]	:	INFO	:	Epoch 1359 | loss: 0.0310796 | val_loss: 0.0311079 | Time: 2464.85 ms
[2022-02-13 12:56:22	                main:574]	:	INFO	:	Epoch 1360 | loss: 0.03107 | val_loss: 0.031108 | Time: 2356.54 ms
[2022-02-13 12:56:24	                main:574]	:	INFO	:	Epoch 1361 | loss: 0.0310687 | val_loss: 0.0311155 | Time: 2465.11 ms
[2022-02-13 12:56:27	                main:574]	:	INFO	:	Epoch 1362 | loss: 0.031068 | val_loss: 0.0311098 | Time: 2384.39 ms
[2022-02-13 12:56:30	                main:574]	:	INFO	:	Epoch 1363 | loss: 0.0310665 | val_loss: 0.0311108 | Time: 2714.9 ms
[2022-02-13 12:56:32	                main:574]	:	INFO	:	Epoch 1364 | loss: 0.0310691 | val_loss: 0.0311079 | Time: 2452.21 ms
[2022-02-13 12:56:34	                main:574]	:	INFO	:	Epoch 1365 | loss: 0.0310671 | val_loss: 0.0311117 | Time: 2371.31 ms
[2022-02-13 12:56:37	                main:574]	:	INFO	:	Epoch 1366 | loss: 0.0310702 | val_loss: 0.031106 | Time: 2509.48 ms
[2022-02-13 12:56:40	                main:574]	:	INFO	:	Epoch 1367 | loss: 0.0310723 | val_loss: 0.0311098 | Time: 2492.22 ms
[2022-02-13 12:56:42	                main:574]	:	INFO	:	Epoch 1368 | loss: 0.0310679 | val_loss: 0.0311063 | Time: 2598.02 ms
[2022-02-13 12:56:45	                main:574]	:	INFO	:	Epoch 1369 | loss: 0.0310693 | val_loss: 0.0311024 | Time: 2585.31 ms
[2022-02-13 12:56:47	                main:574]	:	INFO	:	Epoch 1370 | loss: 0.0310696 | val_loss: 0.0311132 | Time: 2471.28 ms
[2022-02-13 12:56:50	                main:574]	:	INFO	:	Epoch 1371 | loss: 0.0310696 | val_loss: 0.0311045 | Time: 2491.87 ms
[2022-02-13 12:56:52	                main:574]	:	INFO	:	Epoch 1372 | loss: 0.0310745 | val_loss: 0.0311103 | Time: 2363.23 ms
[2022-02-13 12:56:55	                main:574]	:	INFO	:	Epoch 1373 | loss: 0.0310697 | val_loss: 0.0311058 | Time: 2461.98 ms
[2022-02-13 12:56:57	                main:574]	:	INFO	:	Epoch 1374 | loss: 0.0310734 | val_loss: 0.0311055 | Time: 2342.31 ms
[2022-02-13 12:57:00	                main:574]	:	INFO	:	Epoch 1375 | loss: 0.0310702 | val_loss: 0.0311147 | Time: 2513.15 ms
[2022-02-13 12:57:02	                main:574]	:	INFO	:	Epoch 1376 | loss: 0.0310688 | val_loss: 0.0311158 | Time: 2537.64 ms
[2022-02-13 12:57:05	                main:574]	:	INFO	:	Epoch 1377 | loss: 0.0310686 | val_loss: 0.0311091 | Time: 2432.7 ms
[2022-02-13 12:57:07	                main:574]	:	INFO	:	Epoch 1378 | loss: 0.0310722 | val_loss: 0.0311099 | Time: 2371.84 ms
[2022-02-13 12:57:10	                main:574]	:	INFO	:	Epoch 1379 | loss: 0.0310695 | val_loss: 0.0311057 | Time: 2550.72 ms


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x00007FF9F2CEE7F5 read attempt to address 0xFFFFFFFF

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 02/13/22 12:57:11
Install Directory : H:\Program Files\BOINC\
Data Directory    : H:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( H:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( H:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( H:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( H:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: H:\ProgramData\BOINC\slots\102;H:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 000000006fa30000 00000000003df000 H:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000342c0000 00000000001f0000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.18362.815) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000032670000 00000000000b2000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.18362.959 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.959

ModLoad: 0000000031d60000 00000000002a4000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.18362.959 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.959

ModLoad: 00000000324b0000 0000000000194000 C:\WINDOWS\System32\USER32.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000032070000 0000000000021000 C:\WINDOWS\System32\win32u.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.18362.959 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.959

ModLoad: 0000000032840000 0000000000026000 C:\WINDOWS\System32\GDI32.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000320a0000 0000000000196000 C:\WINDOWS\System32\gdi32full.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.18362.959 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.959

ModLoad: 0000000031b70000 000000000009e000 C:\WINDOWS\System32\msvcp_win.dll (6.2.18362.815) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.18362.815 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.815

ModLoad: 00000000319f0000 00000000000fa000 C:\WINDOWS\System32\ucrtbase.dll (6.2.18362.815) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.18362.815 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.815

ModLoad: 0000000033b20000 00000000000a3000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.18362.752) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000032740000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.18362.1

ModLoad: 0000000033be0000 0000000000097000 C:\WINDOWS\System32\sechost.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000032aa0000 0000000000120000 C:\WINDOWS\System32\RPCRT4.dll (6.2.18362.628) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 00000000f0f30000 0000000000058000 H:\ProgramData\BOINC\slots\102\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000eb020000 0000000000091000 H:\ProgramData\BOINC\slots\102\MSVCP140.dll (14.27.29112.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.27.29112.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.27.29112.0

ModLoad: 000000001e700000 00000000001f4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000f4cd0000 0000000000019000 H:\ProgramData\BOINC\slots\102\VCRUNTIME140.dll (14.27.29112.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.27.29112.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.27.29112.0

ModLoad: 0000000005980000 000000000000c000 H:\ProgramData\BOINC\slots\102\VCRUNTIME140_1.dll (14.27.29112.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.27.29112.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.27.29112.0

ModLoad: 00000000d6a20000 000000000abe7000 H:\ProgramData\BOINC\slots\102\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000eac40000 00000000002db000 H:\ProgramData\BOINC\slots\102\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000eb750000 0000000000040000 H:\ProgramData\BOINC\slots\102\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000eaa30000 000000000020d000 H:\ProgramData\BOINC\slots\102\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 00000000a4bd0000 0000000024b49000 H:\ProgramData\BOINC\slots\102\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000ea4b0000 0000000000045000 H:\ProgramData\BOINC\slots\102\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000e2380000 00000000030a5000 H:\ProgramData\BOINC\slots\102\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 00000000a1710000 00000000034b2000 H:\ProgramData\BOINC\slots\102\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 0000000001650000 0000000000010000 H:\ProgramData\BOINC\slots\102\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 0000000098570000 000000000919f000 H:\ProgramData\BOINC\slots\102\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 0000000094810000 0000000003d5b000 H:\ProgramData\BOINC\slots\102\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 0000000092940000 0000000001eca000 H:\ProgramData\BOINC\slots\102\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 0000000077590000 000000001b3a4000 H:\ProgramData\BOINC\slots\102\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 0000000032240000 0000000000080000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.18362.836) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.18362.836 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.836

ModLoad: 0000000033de0000 000000000002e000 C:\WINDOWS\System32\IMM32.DLL (6.2.18362.387) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.18362.387 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.387

ModLoad: 0000000031180000 0000000000011000 C:\WINDOWS\System32\kernel.appcore.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 000000002fe10000 0000000000020000 C:\WINDOWS\SYSTEM32\dxcore.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : DXCore.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000031b20000 000000000004a000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.18362.387) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.18362.387 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.387

ModLoad: 00000000334b0000 0000000000335000 C:\WINDOWS\System32\combase.dll (6.2.18362.900) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000033e10000 0000000000470000 C:\WINDOWS\System32\Setupapi.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000031af0000 0000000000026000 C:\WINDOWS\System32\bcrypt.dll (6.2.18362.267) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000030f10000 000000000002a000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.18362.387) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.18362.387 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.387

ModLoad: 0000000032010000 000000000005c000 C:\WINDOWS\System32\WINTRUST.dll (6.2.18362.387) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.18362.387 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.387

ModLoad: 00000000311a0000 0000000000012000 C:\WINDOWS\System32\MSASN1.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000031c10000 0000000000149000 C:\WINDOWS\System32\CRYPT32.dll (6.2.18362.592) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000032bc0000 00000000006e6000 C:\WINDOWS\System32\Shell32.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.18362.900 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.900

ModLoad: 00000000332b0000 00000000000a9000 C:\WINDOWS\System32\shcore.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000031260000 0000000000782000 C:\WINDOWS\System32\windows.storage.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 00000000311c0000 0000000000023000 C:\WINDOWS\System32\profapi.dll (6.2.18362.693) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : profapi.pdb
    File Version          : 10.0.18362.693 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.693

ModLoad: 00000000311f0000 000000000004a000 C:\WINDOWS\System32\powrprof.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : powrprof.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000031170000 0000000000010000 C:\WINDOWS\System32\UMPDC.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : UMPDC.pdb

ModLoad: 00000000327e0000 0000000000052000 C:\WINDOWS\System32\shlwapi.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000031240000 0000000000017000 C:\WINDOWS\System32\cryptsp.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptsp.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000017a30000 0000000000267000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.5730) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 27.21.14.5730
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.1.114 driver
    Product Version       : 27.21.14.5730

ModLoad: 000000002f150000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000f2b80000 000000000152c000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_5dcb5bbf5c3edcf2\nvcuda64.dll (27.21.14.5730) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 27.21.14.5730
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.1.114 driver
    Product Version       : 27.21.14.5730

ModLoad: 00000000338d0000 000000000006f000 C:\WINDOWS\System32\WS2_32.dll (6.2.18362.387) (-exported- Symbols Loaded)
    Linked PDB Filename   : ws2_32.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 000000002f120000 000000000002f000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000030ab0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 000000002f4a0000 0000000000099000 C:\WINDOWS\system32\uxtheme.dll (6.2.18362.449) (-exported- Symbols Loaded)
    Linked PDB Filename   : UxTheme.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 00000000295b0000 00000000006d6000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.5730) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 27.21.14.5730
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 27.21.14.5730

ModLoad: 0000000033c80000 0000000000157000 C:\WINDOWS\System32\OLE32.DLL (6.2.18362.693) (-exported- Symbols Loaded)
    Linked PDB Filename   : ole32.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 00000000fe5c0000 0000000000009000 H:\ProgramData\BOINC\slots\102\caffe2_nvrtc.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000021380000 0000000000fca000 H:\ProgramData\BOINC\slots\102\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6.14.11.9000
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.89 NVRTC Library
    Product Version       : 6.14.11.9000



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 5002, Write: 5147, Other 17552

- I/O Transfers Counters -
Read: 12194223, Write: 733828, Other 125822

- Paged Pool Usage -
QuotaPagedPoolUsage: 3535464, QuotaPeakPagedPoolUsage: 3535464
QuotaNonPagedPoolUsage: 59288, QuotaPeakNonPagedPoolUsage: 59760

- Virtual Memory Usage -
VirtualSize: 357904384, PeakVirtualSize: 975642624

- Pagefile Usage -
PagefileUsage: 357904384, PeakPagefileUsage: 357904384

- Working Set Size -
WorkingSetSize: -2127622144, PeakWorkingSetSize: -2038210560, PageFaultCount: 883259

*** Dump of thread ID 28408 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 778750016.000000, User Time: 14044062720.000000, Wait Time: 353825728.000000

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x00007FF9F2CEE7F5 read attempt to address 0xFFFFFFFF

- Registers -
rax=0000000000000000 rbx=00000000b772f730 rcx=000000001c9f97d0 rdx=00000000b772f730 rsi=00000000c4859620 rdi=000000001c9f97d0
r8=0000000000000080 r9=0000000000000001 r10=0000000000000018 r11=0000000000000094 r12=0000000000000001 r13=0000000000000001
r14=00000000b772f730 r15=0000000000000003 rip=00000000f2cee7f5 rsp=000000001c9f9668 rbp=000000001c9f97c0
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00010246

- Callstack -
ChildEBP RetAddr  Args to Child
1c9f9660 f2bb8363 b772f730 1c9f97d0 1c9f96c8 c4859620 nvcuda64!+0x0 
1c9f96b0 f2bb890c c4859630 c4859620 b772f730 c4859630 nvcuda64!+0x0 
1c9f9940 f2d81108 00008000 78520730 00000000 78334de7 nvcuda64!+0x0 
1c9f9ab0 783329b6 00000001 00000080 00000000 78520730 nvcuda64!cuLaunchKernel+0x0 
1c9f9bc0 7832fdf4 78520730 c300ffd0 b772f730 1c9f9de0 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
1c9f9d40 78513951 78520730 00000000 78520730 00000000 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
1c9f9eb0 7849e604 23817590 43d36090 49284800 000000c0 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
1c9fa0e0 784af99d 00000000 797a1500 00000000 78520730 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
1c9fa140 7847703b 00000000 00000000 23817590 1c9fa250 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
1c9fa5d0 783943bc 00000000 1c9fa6bc 00000000 4d445010 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
1c9fa8a0 7839700e 1c9fabb0 7833bc3c 1c9fa8f8 78334ce0 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
1c9fa990 782982ca 4d445010 00000000 00000000 0000000c cudnn64_7!cudnnSetDropoutDescriptor+0x0 
1c9faa60 782962b3 00000000 0000000c 1c9faca0 00000002 cudnn64_7!cudnnSetAttnDescriptor+0x0 
1c9fabb0 78299536 00000024 20059ae0 4b4f77e0 00000000 cudnn64_7!cudnnSetAttnDescriptor+0x0 
1c9facc0 782c5f37 49284800 4c51bfe0 00000000 00000000 cudnn64_7!cudnnSetAttnDescriptor+0x0 
1c9fb300 782beafa 00000004 4c51bfe0 00000004 00000000 cudnn64_7!cudnnRNNForwardTrainingEx+0x0 
1c9fb4c0 782d9738 4c51bfe0 00000400 502dc800 20059ae0 cudnn64_7!cudnnRNNForwardTrainingEx+0x0 
1c9fd6d0 a794af5a 1c9fecc0 49280000 1c9fecc0 20059ae0 cudnn64_7!cudnnRNNBackwardData+0x0 
1c9fdc60 a7949c90 00000010 00000000 1c9fe5f0 1c9fe5d8 torch_cuda!at::native::_cudnn_rnn_backward+0x0 
1c9fde50 a79a2808 1c9fe040 1c9fed28 1c9fdf30 00000004 torch_cuda!at::native::_cudnn_rnn_backward+0x0 
1c9fdf60 a79b103d 1c9fe5f0 1c9fe5d0 1c9fed08 00000000 torch_cuda!at::native::set_storage_cuda_+0x0 
1c9fe070 dc46c201 1c9fe5f0 dbfeea63 390591a0 1c9fe738 torch_cuda!at::native::set_storage_cuda_+0x0 
1c9fe200 dc4bbfea 1c9fecc0 00000000 00000007 df50f880 torch_cpu!at::native::mkldnn_sigmoid_+0x0 
1c9fe330 dc4a34da e1344668 1c9fe570 1c9fed28 1c9fe410 torch_cpu!at::bucketize_out+0x0 
1c9fe420 dd79e0a9 1c9fe570 1c9fecc0 1c9fe560 00000000 torch_cpu!at::_cudnn_rnn_backward+0x0 
1c9fe700 dd7aa94d 390577a0 ddc1794a 00000020 00000004 torch_cpu!torch::autograd::GraphRoot::apply+0x0 
1c9fe810 dc46c201 1c9fed18 390576a0 1c9fe9a0 ddc13e3f torch_cpu!torch::autograd::GraphRoot::apply+0x0 
1c9fe9a0 dc4bbfea 1c9fecc0 00000000 00000000 00000000 torch_cpu!at::native::mkldnn_sigmoid_+0x0 
1c9fead0 dc4a34da e1344668 1c9fee40 1c9fed28 1c9febb0 torch_cpu!at::bucketize_out+0x0 
1c9febc0 dd6a994d 1c9fee40 4af53f30 1c9fed00 50293118 torch_cpu!at::_cudnn_rnn_backward+0x0 
1c9ff060 dd6956b1 48812810 1c9ff368 00000000 f0f33bd6 torch_cpu!torch::autograd::generated::CudnnRnnBackward::apply+0x0 
1c9ff270 ddbfd1ea 1c9ff380 48812810 1c9ff380 48812810 torch_cpu!torch::autograd::Node::operator()+0x0 
1c9ff450 ddbfdbdd 00000001 00000001 00000001 00000001 torch_cpu!torch::autograd::Engine::add_thread_pool_task+0x0 
1c9ff930 ddc02812 00000000 00000000 48812800 ffffffff torch_cpu!torch::autograd::Engine::evaluate_function+0x0 
1c9ffc20 ddc02471 e1126d10 1c9ffc60 e1126d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0 
1c9ffc70 ddbf9744 00080001 4dd8f2d0 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0 
1c9ffca0 31a10e82 4dd8f2d0 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0 
1c9ffcd0 32687bd4 00000000 00000000 00000000 00000000 ucrtbase!_beginthreadex+0x0 
1c9ffd00 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
1c9ffd80 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 15876 (state: Waiting): ***

- Information -
Status: Wait Reason: Unknown, , Kernel Time: 1961250048.000000, User Time: 17983281152.000000, Wait Time: 353825728.000000

- Registers -
rax=00000000000001ca rbx=0000000000000000 rcx=00000000393ff5c8 rdx=0000000000000000 rsi=0000000000000000 rdi=0000000000000000
r8=0000000000000000 r9=0000000000000000 r10=0000000000008000 r11=000000001c0e2010 r12=0000000000000004 r13=00000000000001c0
r14=00000000393ff578 r15=0000000000000000 rip=000000003435f9a4 rsp=000000001c0e5a78 rbp=00000000393ff5c8
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
1c0e5a70 34320590 1c0e5c90 f2d44249 00000000 c45e3410 ntdll!ZwWaitForAlertByThreadId+0x0 
1c0e5ae0 31d858fd 393ff570 00000000 00000000 00008000 ntdll!RtlSleepConditionVariableSRW+0x0 
1c0e5b20 eb05ba8d 1c0e5c90 00000000 00008000 1c0e5740 KERNELBASE!SleepConditionVariableSRW+0x0 
1c0e5b60 eb032848 00000000 1c0e5740 ea4b2e0d f0f52433 MSVCP140!__crtSetThreadpoolWait+0x0 
1c0e5b90 eb032710 1c0e6040 eb032f17 00000000 dbff0231 MSVCP140!std::_Winerror_message+0x0 
1c0e5c00 ddc0064b 48812810 000001c0 393ff570 393ff570 MSVCP140!std::_Winerror_message+0x0 
1c0e5c40 ddc025b1 c2971bc0 48812800 48812800 00000000 torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0 
1c0e5f30 ddbff15d 1c0e6210 1c0e6210 1c0e6210 c2971bc0 torch_cpu!torch::autograd::Engine::thread_main+0x0 
1c0e61a0 ddbfeea0 27ab9ba0 e1126d10 fffffffe 00000000 torch_cpu!torch::autograd::Engine::execute_with_graph_task+0x0 
1c0e62d0 ddbf56f9 3524a120 3524a120 1c0e62c0 1c0e63c8 torch_cpu!torch::autograd::Engine::execute+0x0 
1c0e67f0 ddbf5086 a25894a8 dc5c5dc2 00000000 1c0e68c0 torch_cpu!torch::autograd::Engine::make_anomaly_metadata+0x0 
1c0e6890 ddef09be 3905afa0 3524a128 00000000 1c0e6830 torch_cpu!torch::autograd::backward+0x0 
1c0e6970 dd921cd0 c42f4c60 00000000 00000000 00000000 torch_cpu!torch::autograd::VariableType::allCUDATypes+0x0 
1c0e69a0 dc5c0a06 00000000 00000000 00010001 00000001 torch_cpu!torch::autograd::GraphRoot::apply+0x0 
1c0e6bd0 6fa47166 1c0e6ca0 1c0e6ce0 1c0e6ca0 1c0e7240 torch_cpu!at::Tensor::backward+0x0 
1c0e70d0 6fa4b950 1c0e71d0 1c0e71d0 00000000 9a2db060 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0 
1c0ffe70 6fc8c6f8 c4392200 00000000 00000000 c43f97a0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
1c0ffeb0 32687bd4 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
1c0ffee0 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
1c0fff60 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 27744 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 353825728.000000

- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=000000001c5ffa50 rsi=0000000000000000 rdi=0000000000000064
r8=000000001c5fdf30 r9=000000001c5fe358 r10=0000000000000009 r11=000000001c5fdf48 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000003435c6f4 rsp=000000001c5ffa28 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
1c5ffa20 31da6891 1c5ffae8 00000000 00000000 00000000 ntdll!ZwDelayExecution+0x0 
1c5ffac0 6fa6a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0 
1c5ffaf0 32687bd4 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
1c5ffb20 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
1c5ffba0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 4088 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 353825728.000000

- Registers -
rax=000000000000005b rbx=000000000000000b rcx=000000000000000b rdx=000000001c6ff6b0 rsi=0000000000000000 rdi=000000000000000b
r8=0000000000000001 r9=00000000c456f400 r10=0000000000000000 r11=000000001c6ff620 r12=0000000000000064 r13=000000001c6ff6b0
r14=000000001c6ff3a0 r15=0000000000000000 rip=000000003435cbc4 rsp=000000001c6ff348 rbp=00000000c456f400
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
1c6ff340 31db8037 33ca3880 343337d4 00000000 1bee8000 ntdll!NtWaitForMultipleObjects+0x0 
1c6ff640 31db7f1e f3074b48 c2976b70 0000000b 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
1c6ff680 f2d2bb54 c4573f00 00000000 c456da80 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
1c6ff8c0 f2dc09ed 00000000 00000004 00000000 00000000 nvcuda64!+0x0 
1c6ff970 f2d2b523 1d1254fa d4cb88fe c4b0ea10 00000000 nvcuda64!cuProfilerStop+0x0 
1c6ff9a0 f303a750 c4b0ea10 00000000 00000000 00000000 nvcuda64!+0x0 
1c6ff9d0 32687bd4 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
1c6ffa00 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
1c6ffa80 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 19232 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 353598208.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002a0 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002a0
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=00000000c45cda50 r13=0000000000000000
r14=00000000000002a0 r15=0000000000000000 rip=000000003435c0f4 rsp=000000001c7ffc28 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
1c7ffc20 31d98b03 00000000 00000000 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0 
1c7ffcc0 f2f3bf48 00000000 31d84975 00000000 000002a0 KERNELBASE!WaitForSingleObjectEx+0x0 
1c7ffd30 f2d2b523 00000001 d2419ab0 c4b0e4a0 00000000 nvcuda64!cuProfilerStop+0x0 
1c7ffd60 f303a750 c4b0e4a0 00000000 00000000 00000000 nvcuda64!+0x0 
1c7ffd90 32687bd4 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
1c7ffdc0 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
1c7ffe40 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 6716 (state: Waiting): ***

- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 312500.000000, Wait Time: 353825728.000000

- Registers -
rax=00000000000001ca rbx=0000000000000000 rcx=00000000c4857268 rdx=000000001c8ff9a8 rsi=000000001c8ff910 rdi=0000000000000000
r8=0000000000000001 r9=0000000000001a3c r10=00000000c485be38 r11=000000006a00730f r12=000000001c8ff9a8 r13=0000000000000000
r14=00000000c4857268 r15=00000000c485be38 rip=000000003435f9a4 rsp=000000001c8ff8e8 rbp=000000001c8ff940
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
1c8ff8e0 34320815 00000102 f2df965d 00000000 1c8ff910 ntdll!ZwWaitForAlertByThreadId+0x0 
1c8ff950 31ddc2b9 c4859620 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0 
1c8ff980 f2cb223a c4859620 c4859620 c4859620 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0 
1c8ff9e0 f2d2b523 00000002 1d14b416 1bdea1fa 00000000 nvcuda64!+0x0 
1c8ffa10 f303a750 c4b0ed40 00000000 00000000 00000000 nvcuda64!+0x0 
1c8ffa40 32687bd4 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
1c8ffa70 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
1c8ffaf0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)