Task 11125228

Name ParityModified-1639946999-4567-3-0_0
Workunit 8406237
Created 28 Jan 2022, 5:19:22 UTC
Sent 13 Feb 2022, 20:41:52 UTC
Report deadline 21 Feb 2022, 20:41:52 UTC
Received 13 Feb 2022, 22:03:50 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID 571
Run time 55 min 59 sec
CPU time 54 min 46 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 5,441.63 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 2.10 GB
Peak swap size 4.34 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.14.2</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code -1073741819 (0xc0000005)</message>
<stderr_txt>
 0.0311612 | Time: 2278.48 ms
[2022-02-13 22:51:05	                main:574]	:	INFO	:	Epoch 1224 | loss: 0.0311311 | val_loss: 0.0311658 | Time: 2421.64 ms
[2022-02-13 22:51:08	                main:574]	:	INFO	:	Epoch 1225 | loss: 0.0311334 | val_loss: 0.0311703 | Time: 2505.27 ms
[2022-02-13 22:51:10	                main:574]	:	INFO	:	Epoch 1226 | loss: 0.0311315 | val_loss: 0.0311652 | Time: 2248.73 ms
[2022-02-13 22:51:12	                main:574]	:	INFO	:	Epoch 1227 | loss: 0.0311288 | val_loss: 0.0311647 | Time: 2075.44 ms
[2022-02-13 22:51:14	                main:574]	:	INFO	:	Epoch 1228 | loss: 0.0311282 | val_loss: 0.0311697 | Time: 2186.23 ms
[2022-02-13 22:51:17	                main:574]	:	INFO	:	Epoch 1229 | loss: 0.0311321 | val_loss: 0.0311664 | Time: 2114.02 ms
[2022-02-13 22:51:19	                main:574]	:	INFO	:	Epoch 1230 | loss: 0.031128 | val_loss: 0.0311659 | Time: 2219.23 ms
[2022-02-13 22:51:21	                main:574]	:	INFO	:	Epoch 1231 | loss: 0.0311244 | val_loss: 0.0311658 | Time: 2184.3 ms
[2022-02-13 22:51:23	                main:574]	:	INFO	:	Epoch 1232 | loss: 0.0311233 | val_loss: 0.0311657 | Time: 2135.09 ms
[2022-02-13 22:51:25	                main:574]	:	INFO	:	Epoch 1233 | loss: 0.0311237 | val_loss: 0.0311719 | Time: 2165.54 ms
[2022-02-13 22:51:28	                main:574]	:	INFO	:	Epoch 1234 | loss: 0.0311281 | val_loss: 0.0311639 | Time: 2204.65 ms
[2022-02-13 22:51:30	                main:574]	:	INFO	:	Epoch 1235 | loss: 0.0311252 | val_loss: 0.0311676 | Time: 2257.75 ms
[2022-02-13 22:51:32	                main:574]	:	INFO	:	Epoch 1236 | loss: 0.0311212 | val_loss: 0.031169 | Time: 2123.04 ms
[2022-02-13 22:51:34	                main:574]	:	INFO	:	Epoch 1237 | loss: 0.0311209 | val_loss: 0.0311701 | Time: 2203.77 ms
[2022-02-13 22:51:37	                main:574]	:	INFO	:	Epoch 1238 | loss: 0.0311223 | val_loss: 0.0311681 | Time: 2329.84 ms
[2022-02-13 22:51:39	                main:574]	:	INFO	:	Epoch 1239 | loss: 0.031131 | val_loss: 0.0311692 | Time: 2377.77 ms
[2022-02-13 22:51:41	                main:574]	:	INFO	:	Epoch 1240 | loss: 0.0311274 | val_loss: 0.0311649 | Time: 2139.96 ms
[2022-02-13 22:51:44	                main:574]	:	INFO	:	Epoch 1241 | loss: 0.0311321 | val_loss: 0.0311675 | Time: 2538.59 ms
[2022-02-13 22:51:46	                main:574]	:	INFO	:	Epoch 1242 | loss: 0.0311345 | val_loss: 0.0311674 | Time: 2229.02 ms
[2022-02-13 22:51:48	                main:574]	:	INFO	:	Epoch 1243 | loss: 0.0311292 | val_loss: 0.0311669 | Time: 2063.13 ms
[2022-02-13 22:51:50	                main:574]	:	INFO	:	Epoch 1244 | loss: 0.0311273 | val_loss: 0.0311656 | Time: 2199.18 ms
[2022-02-13 22:51:53	                main:574]	:	INFO	:	Epoch 1245 | loss: 0.0311273 | val_loss: 0.0311642 | Time: 2174.66 ms
[2022-02-13 22:51:55	                main:574]	:	INFO	:	Epoch 1246 | loss: 0.0311248 | val_loss: 0.0311669 | Time: 2111.83 ms
[2022-02-13 22:51:57	                main:574]	:	INFO	:	Epoch 1247 | loss: 0.031123 | val_loss: 0.0311654 | Time: 2334.18 ms
[2022-02-13 22:51:59	                main:574]	:	INFO	:	Epoch 1248 | loss: 0.0311233 | val_loss: 0.0311638 | Time: 2258.94 ms
[2022-02-13 22:52:02	                main:574]	:	INFO	:	Epoch 1249 | loss: 0.0311219 | val_loss: 0.0311705 | Time: 2474.4 ms
[2022-02-13 22:52:04	                main:574]	:	INFO	:	Epoch 1250 | loss: 0.0311195 | val_loss: 0.0311691 | Time: 2277.75 ms
[2022-02-13 22:52:07	                main:574]	:	INFO	:	Epoch 1251 | loss: 0.0311194 | val_loss: 0.0311694 | Time: 2469.25 ms
[2022-02-13 22:52:09	                main:574]	:	INFO	:	Epoch 1252 | loss: 0.0311202 | val_loss: 0.0311712 | Time: 2321.52 ms
[2022-02-13 22:52:11	                main:574]	:	INFO	:	Epoch 1253 | loss: 0.0311312 | val_loss: 0.0311621 | Time: 2244.41 ms
[2022-02-13 22:52:14	                main:574]	:	INFO	:	Epoch 1254 | loss: 0.0311245 | val_loss: 0.031164 | Time: 2192.81 ms
[2022-02-13 22:52:16	                main:574]	:	INFO	:	Epoch 1255 | loss: 0.0311208 | val_loss: 0.0311634 | Time: 2311.82 ms
[2022-02-13 22:52:18	                main:574]	:	INFO	:	Epoch 1256 | loss: 0.0311205 | val_loss: 0.031165 | Time: 2038.2 ms
[2022-02-13 22:52:20	                main:574]	:	INFO	:	Epoch 1257 | loss: 0.0311188 | val_loss: 0.0311666 | Time: 2133.37 ms
[2022-02-13 22:52:23	                main:574]	:	INFO	:	Epoch 1258 | loss: 0.031117 | val_loss: 0.0311685 | Time: 2470.06 ms
[2022-02-13 22:52:25	                main:574]	:	INFO	:	Epoch 1259 | loss: 0.0311173 | val_loss: 0.0311689 | Time: 2265.87 ms
[2022-02-13 22:52:27	                main:574]	:	INFO	:	Epoch 1260 | loss: 0.0311187 | val_loss: 0.0311658 | Time: 2129.94 ms
[2022-02-13 22:52:30	                main:574]	:	INFO	:	Epoch 1261 | loss: 0.0311202 | val_loss: 0.0311687 | Time: 2477.14 ms
[2022-02-13 22:52:32	                main:574]	:	INFO	:	Epoch 1262 | loss: 0.0311221 | val_loss: 0.0311713 | Time: 2477.25 ms
[2022-02-13 22:52:35	                main:574]	:	INFO	:	Epoch 1263 | loss: 0.0311201 | val_loss: 0.0311675 | Time: 2396.7 ms
[2022-02-13 22:52:37	                main:574]	:	INFO	:	Epoch 1264 | loss: 0.0311194 | val_loss: 0.0311702 | Time: 2294.93 ms
[2022-02-13 22:52:39	                main:574]	:	INFO	:	Epoch 1265 | loss: 0.0311174 | val_loss: 0.031167 | Time: 2298.15 ms
[2022-02-13 22:52:42	                main:574]	:	INFO	:	Epoch 1266 | loss: 0.0311174 | val_loss: 0.0311702 | Time: 2251.02 ms
[2022-02-13 22:52:44	                main:574]	:	INFO	:	Epoch 1267 | loss: 0.0311184 | val_loss: 0.0311696 | Time: 2195.97 ms
[2022-02-13 22:52:46	                main:574]	:	INFO	:	Epoch 1268 | loss: 0.03112 | val_loss: 0.0311754 | Time: 2219.21 ms
[2022-02-13 22:52:48	                main:574]	:	INFO	:	Epoch 1269 | loss: 0.0311198 | val_loss: 0.0311711 | Time: 2292.57 ms
[2022-02-13 22:52:51	                main:574]	:	INFO	:	Epoch 1270 | loss: 0.0311213 | val_loss: 0.0311763 | Time: 2245.42 ms
[2022-02-13 22:52:53	                main:574]	:	INFO	:	Epoch 1271 | loss: 0.0311205 | val_loss: 0.03117 | Time: 2222.82 ms
[2022-02-13 22:52:55	                main:574]	:	INFO	:	Epoch 1272 | loss: 0.0311231 | val_loss: 0.0311663 | Time: 2282.15 ms
[2022-02-13 22:52:58	                main:574]	:	INFO	:	Epoch 1273 | loss: 0.0311246 | val_loss: 0.0311711 | Time: 2334.21 ms
[2022-02-13 22:53:00	                main:574]	:	INFO	:	Epoch 1274 | loss: 0.0311232 | val_loss: 0.0311669 | Time: 2292.46 ms
[2022-02-13 22:53:02	                main:574]	:	INFO	:	Epoch 1275 | loss: 0.0311324 | val_loss: 0.0311628 | Time: 2270.17 ms
[2022-02-13 22:53:05	                main:574]	:	INFO	:	Epoch 1276 | loss: 0.0311337 | val_loss: 0.0311619 | Time: 2274.39 ms
[2022-02-13 22:53:07	                main:574]	:	INFO	:	Epoch 1277 | loss: 0.0311294 | val_loss: 0.0311652 | Time: 2185.34 ms
[2022-02-13 22:53:09	                main:574]	:	INFO	:	Epoch 1278 | loss: 0.0311256 | val_loss: 0.031162 | Time: 2231.53 ms
[2022-02-13 22:53:11	                main:574]	:	INFO	:	Epoch 1279 | loss: 0.0311245 | val_loss: 0.031163 | Time: 2261.72 ms
[2022-02-13 22:53:14	                main:574]	:	INFO	:	Epoch 1280 | loss: 0.0311232 | val_loss: 0.0311644 | Time: 2298.1 ms
[2022-02-13 22:53:16	                main:574]	:	INFO	:	Epoch 1281 | loss: 0.031128 | val_loss: 0.0311711 | Time: 2242.04 ms
[2022-02-13 22:53:18	                main:574]	:	INFO	:	Epoch 1282 | loss: 0.0311417 | val_loss: 0.0311647 | Time: 2158.25 ms
[2022-02-13 22:53:20	                main:574]	:	INFO	:	Epoch 1283 | loss: 0.0311413 | val_loss: 0.0311641 | Time: 2256.21 ms
[2022-02-13 22:53:23	                main:574]	:	INFO	:	Epoch 1284 | loss: 0.0311342 | val_loss: 0.0311638 | Time: 2344.31 ms
[2022-02-13 22:53:25	                main:574]	:	INFO	:	Epoch 1285 | loss: 0.0311319 | val_loss: 0.0311575 | Time: 2208.8 ms
[2022-02-13 22:53:27	                main:574]	:	INFO	:	Epoch 1286 | loss: 0.0311302 | val_loss: 0.0311603 | Time: 2186.95 ms
[2022-02-13 22:53:30	                main:574]	:	INFO	:	Epoch 1287 | loss: 0.0311278 | val_loss: 0.0311656 | Time: 2151.5 ms
[2022-02-13 22:53:32	                main:574]	:	INFO	:	Epoch 1288 | loss: 0.0311292 | val_loss: 0.0311625 | Time: 2214.34 ms
[2022-02-13 22:53:34	                main:574]	:	INFO	:	Epoch 1289 | loss: 0.0311294 | val_loss: 0.0311677 | Time: 2334.93 ms
[2022-02-13 22:53:36	                main:574]	:	INFO	:	Epoch 1290 | loss: 0.03114 | val_loss: 0.0311795 | Time: 2198.22 ms
[2022-02-13 22:53:39	                main:574]	:	INFO	:	Epoch 1291 | loss: 0.031162 | val_loss: 0.0311787 | Time: 2393.71 ms
[2022-02-13 22:53:41	                main:574]	:	INFO	:	Epoch 1292 | loss: 0.0311573 | val_loss: 0.0311758 | Time: 2227.73 ms
[2022-02-13 22:53:43	                main:574]	:	INFO	:	Epoch 1293 | loss: 0.0311506 | val_loss: 0.0311688 | Time: 2293.17 ms
[2022-02-13 22:53:46	                main:574]	:	INFO	:	Epoch 1294 | loss: 0.0311481 | val_loss: 0.0311687 | Time: 2292.84 ms
[2022-02-13 22:53:48	                main:574]	:	INFO	:	Epoch 1295 | loss: 0.0311468 | val_loss: 0.0311682 | Time: 2249.88 ms
[2022-02-13 22:53:50	                main:574]	:	INFO	:	Epoch 1296 | loss: 0.0311424 | val_loss: 0.0311698 | Time: 2363.77 ms
[2022-02-13 22:53:53	                main:574]	:	INFO	:	Epoch 1297 | loss: 0.0311424 | val_loss: 0.0311667 | Time: 2309.85 ms
[2022-02-13 22:53:55	                main:574]	:	INFO	:	Epoch 1298 | loss: 0.0311396 | val_loss: 0.0311638 | Time: 2373.96 ms
[2022-02-13 22:53:58	                main:574]	:	INFO	:	Epoch 1299 | loss: 0.0311423 | val_loss: 0.0311647 | Time: 2238.12 ms
[2022-02-13 22:54:00	                main:574]	:	INFO	:	Epoch 1300 | loss: 0.0311393 | val_loss: 0.0311608 | Time: 2236.91 ms
[2022-02-13 22:54:02	                main:574]	:	INFO	:	Epoch 1301 | loss: 0.031136 | val_loss: 0.0311643 | Time: 2152.11 ms
[2022-02-13 22:54:04	                main:574]	:	INFO	:	Epoch 1302 | loss: 0.0311348 | val_loss: 0.0311619 | Time: 2359.15 ms
[2022-02-13 22:54:07	                main:574]	:	INFO	:	Epoch 1303 | loss: 0.0311329 | val_loss: 0.0311638 | Time: 2265.31 ms
[2022-02-13 22:54:09	                main:574]	:	INFO	:	Epoch 1304 | loss: 0.0311312 | val_loss: 0.0311621 | Time: 2263.42 ms
[2022-02-13 22:54:11	                main:574]	:	INFO	:	Epoch 1305 | loss: 0.0311313 | val_loss: 0.0311636 | Time: 2386.72 ms
[2022-02-13 22:54:14	                main:574]	:	INFO	:	Epoch 1306 | loss: 0.0311302 | val_loss: 0.0311647 | Time: 2212.42 ms
[2022-02-13 22:54:16	                main:574]	:	INFO	:	Epoch 1307 | loss: 0.0311281 | val_loss: 0.0311627 | Time: 2368.28 ms
[2022-02-13 22:54:19	                main:574]	:	INFO	:	Epoch 1308 | loss: 0.0311283 | val_loss: 0.0311677 | Time: 2455.45 ms
[2022-02-13 22:54:21	                main:574]	:	INFO	:	Epoch 1309 | loss: 0.0311265 | val_loss: 0.0311615 | Time: 2577.68 ms
[2022-02-13 22:54:24	                main:574]	:	INFO	:	Epoch 1310 | loss: 0.0311253 | val_loss: 0.0311646 | Time: 2541.22 ms
[2022-02-13 22:54:26	                main:574]	:	INFO	:	Epoch 1311 | loss: 0.0311264 | val_loss: 0.0311662 | Time: 2431.18 ms
[2022-02-13 22:54:29	                main:574]	:	INFO	:	Epoch 1312 | loss: 0.0311279 | val_loss: 0.0311643 | Time: 2440.63 ms
[2022-02-13 22:54:31	                main:574]	:	INFO	:	Epoch 1313 | loss: 0.0311257 | val_loss: 0.0311657 | Time: 2298.87 ms
[2022-02-13 22:54:33	                main:574]	:	INFO	:	Epoch 1314 | loss: 0.0311266 | val_loss: 0.0311667 | Time: 2167.14 ms
[2022-02-13 22:54:36	                main:574]	:	INFO	:	Epoch 1315 | loss: 0.0311281 | val_loss: 0.0311616 | Time: 2367.79 ms
[2022-02-13 22:54:38	                main:574]	:	INFO	:	Epoch 1316 | loss: 0.0311268 | val_loss: 0.0311649 | Time: 2222.21 ms
[2022-02-13 22:54:40	                main:574]	:	INFO	:	Epoch 1317 | loss: 0.0311275 | val_loss: 0.0311611 | Time: 2272.42 ms
[2022-02-13 22:54:42	                main:574]	:	INFO	:	Epoch 1318 | loss: 0.0311276 | val_loss: 0.0311648 | Time: 2224.91 ms
[2022-02-13 22:54:45	                main:574]	:	INFO	:	Epoch 1319 | loss: 0.031129 | val_loss: 0.0311635 | Time: 2321.95 ms
[2022-02-13 22:54:47	                main:574]	:	INFO	:	Epoch 1320 | loss: 0.0311279 | val_loss: 0.0311621 | Time: 2233.71 ms
[2022-02-13 22:54:49	                main:574]	:	INFO	:	Epoch 1321 | loss: 0.0311278 | val_loss: 0.0311643 | Time: 2164.09 ms
[2022-02-13 22:54:52	                main:574]	:	INFO	:	Epoch 1322 | loss: 0.0311285 | val_loss: 0.0311607 | Time: 2542.25 ms
[2022-02-13 22:54:54	                main:574]	:	INFO	:	Epoch 1323 | loss: 0.0311306 | val_loss: 0.0311637 | Time: 2211.85 ms
[2022-02-13 22:54:56	                main:574]	:	INFO	:	Epoch 1324 | loss: 0.031129 | val_loss: 0.0311565 | Time: 2290.72 ms
[2022-02-13 22:54:59	                main:574]	:	INFO	:	Epoch 1325 | loss: 0.0311274 | val_loss: 0.0311597 | Time: 2244.01 ms
[2022-02-13 22:55:01	                main:574]	:	INFO	:	Epoch 1326 | loss: 0.0311282 | val_loss: 0.0311575 | Time: 2164.19 ms
[2022-02-13 22:55:03	                main:574]	:	INFO	:	Epoch 1327 | loss: 0.0311262 | val_loss: 0.0311636 | Time: 2241.67 ms
[2022-02-13 22:55:06	                main:574]	:	INFO	:	Epoch 1328 | loss: 0.0311274 | val_loss: 0.0311667 | Time: 2395.06 ms
[2022-02-13 22:55:08	                main:574]	:	INFO	:	Epoch 1329 | loss: 0.0311241 | val_loss: 0.0311622 | Time: 2365.33 ms
[2022-02-13 22:55:10	                main:574]	:	INFO	:	Epoch 1330 | loss: 0.0311232 | val_loss: 0.0311618 | Time: 2318.05 ms
[2022-02-13 22:55:13	                main:574]	:	INFO	:	Epoch 1331 | loss: 0.0311211 | val_loss: 0.0311676 | Time: 2155.96 ms
[2022-02-13 22:55:15	                main:574]	:	INFO	:	Epoch 1332 | loss: 0.0311233 | val_loss: 0.0311647 | Time: 2295.38 ms
[2022-02-13 22:55:17	                main:574]	:	INFO	:	Epoch 1333 | loss: 0.0311232 | val_loss: 0.0311649 | Time: 2113.63 ms
[2022-02-13 22:55:19	                main:574]	:	INFO	:	Epoch 1334 | loss: 0.0311224 | val_loss: 0.0311641 | Time: 2195.43 ms
[2022-02-13 22:55:22	                main:574]	:	INFO	:	Epoch 1335 | loss: 0.0311223 | val_loss: 0.0311625 | Time: 2284.38 ms
[2022-02-13 22:55:24	                main:574]	:	INFO	:	Epoch 1336 | loss: 0.031125 | val_loss: 0.0311655 | Time: 2307.05 ms
[2022-02-13 22:55:26	                main:574]	:	INFO	:	Epoch 1337 | loss: 0.0311247 | val_loss: 0.0311655 | Time: 2309.15 ms
[2022-02-13 22:55:29	                main:574]	:	INFO	:	Epoch 1338 | loss: 0.0311225 | val_loss: 0.0311656 | Time: 2442.87 ms
[2022-02-13 22:55:31	                main:574]	:	INFO	:	Epoch 1339 | loss: 0.0311226 | val_loss: 0.0311709 | Time: 2243.8 ms
[2022-02-13 22:55:33	                main:574]	:	INFO	:	Epoch 1340 | loss: 0.0311226 | val_loss: 0.0311636 | Time: 2137.8 ms
[2022-02-13 22:55:35	                main:574]	:	INFO	:	Epoch 1341 | loss: 0.0311211 | val_loss: 0.0311676 | Time: 2167.45 ms
[2022-02-13 22:55:38	                main:574]	:	INFO	:	Epoch 1342 | loss: 0.0311201 | val_loss: 0.0311718 | Time: 2321.14 ms
[2022-02-13 22:55:40	                main:574]	:	INFO	:	Epoch 1343 | loss: 0.0311203 | val_loss: 0.031165 | Time: 2357.53 ms
[2022-02-13 22:55:43	                main:574]	:	INFO	:	Epoch 1344 | loss: 0.0311177 | val_loss: 0.0311637 | Time: 2352.69 ms
[2022-02-13 22:55:45	                main:574]	:	INFO	:	Epoch 1345 | loss: 0.0311174 | val_loss: 0.0311691 | Time: 2096.47 ms
[2022-02-13 22:55:47	                main:574]	:	INFO	:	Epoch 1346 | loss: 0.0311156 | val_loss: 0.0311673 | Time: 2339.58 ms
[2022-02-13 22:55:49	                main:574]	:	INFO	:	Epoch 1347 | loss: 0.0311157 | val_loss: 0.0311637 | Time: 2257.69 ms
[2022-02-13 22:55:52	                main:574]	:	INFO	:	Epoch 1348 | loss: 0.0311178 | val_loss: 0.0311651 | Time: 2356.78 ms
[2022-02-13 22:55:54	                main:574]	:	INFO	:	Epoch 1349 | loss: 0.0311181 | val_loss: 0.0311669 | Time: 2531.85 ms
[2022-02-13 22:55:57	                main:574]	:	INFO	:	Epoch 1350 | loss: 0.0311169 | val_loss: 0.0311637 | Time: 2313.19 ms
[2022-02-13 22:55:59	                main:574]	:	INFO	:	Epoch 1351 | loss: 0.0311176 | val_loss: 0.0311662 | Time: 2278.01 ms
[2022-02-13 22:56:02	                main:574]	:	INFO	:	Epoch 1352 | loss: 0.0311167 | val_loss: 0.0311661 | Time: 2405.89 ms
[2022-02-13 22:56:04	                main:574]	:	INFO	:	Epoch 1353 | loss: 0.0311157 | val_loss: 0.0311697 | Time: 2331.37 ms
[2022-02-13 22:56:06	                main:574]	:	INFO	:	Epoch 1354 | loss: 0.0311253 | val_loss: 0.0311736 | Time: 2447.5 ms
[2022-02-13 22:56:09	                main:574]	:	INFO	:	Epoch 1355 | loss: 0.0311276 | val_loss: 0.0311652 | Time: 2305.35 ms
[2022-02-13 22:56:11	                main:574]	:	INFO	:	Epoch 1356 | loss: 0.0311234 | val_loss: 0.0311678 | Time: 2399.15 ms
[2022-02-13 22:56:14	                main:574]	:	INFO	:	Epoch 1357 | loss: 0.0311332 | val_loss: 0.0311635 | Time: 2475.02 ms
[2022-02-13 22:56:16	                main:574]	:	INFO	:	Epoch 1358 | loss: 0.0311511 | val_loss: 0.0311682 | Time: 2482 ms
[2022-02-13 22:56:18	                main:574]	:	INFO	:	Epoch 1359 | loss: 0.0311479 | val_loss: 0.0311678 | Time: 2195.76 ms
[2022-02-13 22:56:21	                main:574]	:	INFO	:	Epoch 1360 | loss: 0.0311435 | val_loss: 0.0311661 | Time: 2223.44 ms
[2022-02-13 22:56:23	                main:574]	:	INFO	:	Epoch 1361 | loss: 0.0311404 | val_loss: 0.0311659 | Time: 2478.86 ms
[2022-02-13 22:56:25	                main:574]	:	INFO	:	Epoch 1362 | loss: 0.0311409 | val_loss: 0.0311682 | Time: 2086.6 ms
[2022-02-13 22:56:27	                main:574]	:	INFO	:	Epoch 1363 | loss: 0.0311373 | val_loss: 0.0311645 | Time: 2193.42 ms
[2022-02-13 22:56:30	                main:574]	:	INFO	:	Epoch 1364 | loss: 0.0311357 | val_loss: 0.0311666 | Time: 2311.97 ms
[2022-02-13 22:56:32	                main:574]	:	INFO	:	Epoch 1365 | loss: 0.0311338 | val_loss: 0.0311688 | Time: 2259.66 ms
[2022-02-13 22:56:34	                main:574]	:	INFO	:	Epoch 1366 | loss: 0.0311354 | val_loss: 0.031174 | Time: 2220 ms
[2022-02-13 22:56:37	                main:574]	:	INFO	:	Epoch 1367 | loss: 0.0311322 | val_loss: 0.0311626 | Time: 2264.26 ms
[2022-02-13 22:56:39	                main:574]	:	INFO	:	Epoch 1368 | loss: 0.0311286 | val_loss: 0.0311656 | Time: 2402.28 ms
[2022-02-13 22:56:42	                main:574]	:	INFO	:	Epoch 1369 | loss: 0.0311282 | val_loss: 0.0311646 | Time: 2483.51 ms
[2022-02-13 22:56:44	                main:574]	:	INFO	:	Epoch 1370 | loss: 0.0311293 | val_loss: 0.031161 | Time: 2474.6 ms
[2022-02-13 22:56:47	                main:574]	:	INFO	:	Epoch 1371 | loss: 0.031128 | val_loss: 0.0311652 | Time: 2449.82 ms
[2022-02-13 22:56:49	                main:574]	:	INFO	:	Epoch 1372 | loss: 0.0311304 | val_loss: 0.0311671 | Time: 2492.57 ms
[2022-02-13 22:56:52	                main:574]	:	INFO	:	Epoch 1373 | loss: 0.0311348 | val_loss: 0.0311642 | Time: 2313.53 ms
[2022-02-13 22:56:54	                main:574]	:	INFO	:	Epoch 1374 | loss: 0.0311337 | val_loss: 0.0311631 | Time: 2531 ms
[2022-02-13 22:56:57	                main:574]	:	INFO	:	Epoch 1375 | loss: 0.0311317 | val_loss: 0.0311704 | Time: 2416.11 ms
[2022-02-13 22:56:59	                main:574]	:	INFO	:	Epoch 1376 | loss: 0.0311298 | val_loss: 0.0311657 | Time: 2614.1 ms
[2022-02-13 22:57:02	                main:574]	:	INFO	:	Epoch 1377 | loss: 0.0311319 | val_loss: 0.0311734 | Time: 2457 ms
[2022-02-13 22:57:04	                main:574]	:	INFO	:	Epoch 1378 | loss: 0.0311347 | val_loss: 0.0311674 | Time: 2520.09 ms
[2022-02-13 22:57:07	                main:574]	:	INFO	:	Epoch 1379 | loss: 0.0311293 | val_loss: 0.031169 | Time: 2541.62 ms
[2022-02-13 22:57:09	                main:574]	:	INFO	:	Epoch 1380 | loss: 0.0311315 | val_loss: 0.0311677 | Time: 2535.42 ms
[2022-02-13 22:57:12	                main:574]	:	INFO	:	Epoch 1381 | loss: 0.0311307 | val_loss: 0.0311697 | Time: 2589.86 ms
[2022-02-13 22:57:14	                main:574]	:	INFO	:	Epoch 1382 | loss: 0.0311338 | val_loss: 0.0311615 | Time: 2238.89 ms
[2022-02-13 22:57:17	                main:574]	:	INFO	:	Epoch 1383 | loss: 0.0311308 | val_loss: 0.0311649 | Time: 2083.17 ms
[2022-02-13 22:57:19	                main:574]	:	INFO	:	Epoch 1384 | loss: 0.0311298 | val_loss: 0.0311688 | Time: 2157.06 ms
[2022-02-13 22:57:21	                main:574]	:	INFO	:	Epoch 1385 | loss: 0.0311273 | val_loss: 0.0311656 | Time: 2410.84 ms
[2022-02-13 22:57:24	                main:574]	:	INFO	:	Epoch 1386 | loss: 0.0311279 | val_loss: 0.0311685 | Time: 2325.81 ms
[2022-02-13 22:57:26	                main:574]	:	INFO	:	Epoch 1387 | loss: 0.0311275 | val_loss: 0.0311701 | Time: 2473.99 ms
[2022-02-13 22:57:28	                main:574]	:	INFO	:	Epoch 1388 | loss: 0.0311292 | val_loss: 0.0311666 | Time: 2061.3 ms
[2022-02-13 22:57:30	                main:574]	:	INFO	:	Epoch 1389 | loss: 0.0311294 | val_loss: 0.0311691 | Time: 2239.2 ms
[2022-02-13 22:57:33	                main:574]	:	INFO	:	Epoch 1390 | loss: 0.0311328 | val_loss: 0.0311715 | Time: 2499.84 ms
[2022-02-13 22:57:36	                main:574]	:	INFO	:	Epoch 1391 | loss: 0.0311341 | val_loss: 0.0311673 | Time: 2459.42 ms
[2022-02-13 22:57:38	                main:574]	:	INFO	:	Epoch 1392 | loss: 0.0311306 | val_loss: 0.0311687 | Time: 2472.84 ms
[2022-02-13 22:57:41	                main:574]	:	INFO	:	Epoch 1393 | loss: 0.0311296 | val_loss: 0.0311676 | Time: 2518.71 ms
[2022-02-13 22:57:43	                main:574]	:	INFO	:	Epoch 1394 | loss: 0.0311292 | val_loss: 0.03117 | Time: 2251.04 ms
[2022-02-13 22:57:45	                main:574]	:	INFO	:	Epoch 1395 | loss: 0.0311289 | val_loss: 0.0311694 | Time: 2362.79 ms
[2022-02-13 22:57:48	                main:574]	:	INFO	:	Epoch 1396 | loss: 0.0311267 | val_loss: 0.0311667 | Time: 2319.69 ms
[2022-02-13 22:57:50	                main:574]	:	INFO	:	Epoch 1397 | loss: 0.0311273 | val_loss: 0.0311674 | Time: 2246.47 ms
[2022-02-13 22:57:52	                main:574]	:	INFO	:	Epoch 1398 | loss: 0.0311324 | val_loss: 0.0311618 | Time: 2430.39 ms
[2022-02-13 22:57:55	                main:574]	:	INFO	:	Epoch 1399 | loss: 0.0311283 | val_loss: 0.0311682 | Time: 2451.26 ms
[2022-02-13 22:57:57	                main:574]	:	INFO	:	Epoch 1400 | loss: 0.03113 | val_loss: 0.031169 | Time: 2375.97 ms
[2022-02-13 22:58:00	                main:574]	:	INFO	:	Epoch 1401 | loss: 0.0311307 | val_loss: 0.0311636 | Time: 2354.01 ms
[2022-02-13 22:58:02	                main:574]	:	INFO	:	Epoch 1402 | loss: 0.0311289 | val_loss: 0.0311673 | Time: 2250.03 ms
[2022-02-13 22:58:04	                main:574]	:	INFO	:	Epoch 1403 | loss: 0.0311305 | val_loss: 0.0311589 | Time: 2371.96 ms
[2022-02-13 22:58:07	                main:574]	:	INFO	:	Epoch 1404 | loss: 0.0311286 | val_loss: 0.0311595 | Time: 2220.12 ms
[2022-02-13 22:58:09	                main:574]	:	INFO	:	Epoch 1405 | loss: 0.0311289 | val_loss: 0.0311585 | Time: 2377.13 ms
[2022-02-13 22:58:11	                main:574]	:	INFO	:	Epoch 1406 | loss: 0.0311275 | val_loss: 0.0311638 | Time: 2110.24 ms
[2022-02-13 22:58:13	                main:574]	:	INFO	:	Epoch 1407 | loss: 0.0311263 | val_loss: 0.0311642 | Time: 2183.3 ms
[2022-02-13 22:58:16	                main:574]	:	INFO	:	Epoch 1408 | loss: 0.0311315 | val_loss: 0.0311586 | Time: 2248.81 ms
[2022-02-13 22:58:18	                main:574]	:	INFO	:	Epoch 1409 | loss: 0.0311285 | val_loss: 0.0311642 | Time: 2256.8 ms
[2022-02-13 22:58:21	                main:574]	:	INFO	:	Epoch 1410 | loss: 0.0311279 | val_loss: 0.0311605 | Time: 2424.33 ms
[2022-02-13 22:58:23	                main:574]	:	INFO	:	Epoch 1411 | loss: 0.0311252 | val_loss: 0.0311588 | Time: 2270.15 ms
[2022-02-13 22:58:25	                main:574]	:	INFO	:	Epoch 1412 | loss: 0.0311237 | val_loss: 0.0311605 | Time: 2225.23 ms
[2022-02-13 22:58:27	                main:574]	:	INFO	:	Epoch 1413 | loss: 0.0311284 | val_loss: 0.0311605 | Time: 2231.75 ms
[2022-02-13 22:58:30	                main:574]	:	INFO	:	Epoch 1414 | loss: 0.0311281 | val_loss: 0.031167 | Time: 2353.47 ms
[2022-02-13 22:58:32	                main:574]	:	INFO	:	Epoch 1415 | loss: 0.0311284 | val_loss: 0.0311624 | Time: 2378.49 ms
[2022-02-13 22:58:35	                main:574]	:	INFO	:	Epoch 1416 | loss: 0.0311276 | val_loss: 0.0311675 | Time: 2384.58 ms
[2022-02-13 22:58:37	                main:574]	:	INFO	:	Epoch 1417 | loss: 0.0311326 | val_loss: 0.0311647 | Time: 2177.01 ms
[2022-02-13 22:58:39	                main:574]	:	INFO	:	Epoch 1418 | loss: 0.0311314 | val_loss: 0.031164 | Time: 2139.12 ms
[2022-02-13 22:58:41	                main:574]	:	INFO	:	Epoch 1419 | loss: 0.0311303 | val_loss: 0.0311651 | Time: 2182.56 ms
[2022-02-13 22:58:44	                main:574]	:	INFO	:	Epoch 1420 | loss: 0.0311277 | val_loss: 0.0311628 | Time: 2218.03 ms
[2022-02-13 22:58:46	                main:574]	:	INFO	:	Epoch 1421 | loss: 0.0311273 | val_loss: 0.0311648 | Time: 2163.07 ms
[2022-02-13 22:58:48	                main:574]	:	INFO	:	Epoch 1422 | loss: 0.0311245 | val_loss: 0.0311679 | Time: 2142.59 ms
[2022-02-13 22:58:50	                main:574]	:	INFO	:	Epoch 1423 | loss: 0.0311248 | val_loss: 0.0311669 | Time: 2168.63 ms
[2022-02-13 22:58:53	                main:574]	:	INFO	:	Epoch 1424 | loss: 0.0311223 | val_loss: 0.0311669 | Time: 2505.24 ms
[2022-02-13 22:58:55	                main:574]	:	INFO	:	Epoch 1425 | loss: 0.0311206 | val_loss: 0.0311728 | Time: 2341.91 ms
[2022-02-13 22:58:57	                main:574]	:	INFO	:	Epoch 1426 | loss: 0.0311207 | val_loss: 0.0311721 | Time: 2140.71 ms
[2022-02-13 22:58:59	                main:574]	:	INFO	:	Epoch 1427 | loss: 0.0311201 | val_loss: 0.0311659 | Time: 2177.94 ms
[2022-02-13 22:59:02	                main:574]	:	INFO	:	Epoch 1428 | loss: 0.0311196 | val_loss: 0.0311671 | Time: 2221.68 ms
[2022-02-13 22:59:04	                main:574]	:	INFO	:	Epoch 1429 | loss: 0.0311204 | val_loss: 0.0311631 | Time: 2508.19 ms
[2022-02-13 22:59:07	                main:574]	:	INFO	:	Epoch 1430 | loss: 0.0311248 | val_loss: 0.0311678 | Time: 2312.48 ms
[2022-02-13 22:59:09	                main:574]	:	INFO	:	Epoch 1431 | loss: 0.0311259 | val_loss: 0.0311625 | Time: 2379.78 ms
[2022-02-13 22:59:11	                main:574]	:	INFO	:	Epoch 1432 | loss: 0.0311223 | val_loss: 0.0311643 | Time: 2135.34 ms
[2022-02-13 22:59:13	                main:574]	:	INFO	:	Epoch 1433 | loss: 0.0311203 | val_loss: 0.03116 | Time: 2110.08 ms
[2022-02-13 22:59:16	                main:574]	:	INFO	:	Epoch 1434 | loss: 0.0311206 | val_loss: 0.0311629 | Time: 2248.65 ms
[2022-02-13 22:59:18	                main:574]	:	INFO	:	Epoch 1435 | loss: 0.0311205 | val_loss: 0.0311613 | Time: 2065.69 ms
[2022-02-13 22:59:20	                main:574]	:	INFO	:	Epoch 1436 | loss: 0.0311185 | val_loss: 0.0311659 | Time: 2356.05 ms
[2022-02-13 22:59:22	                main:574]	:	INFO	:	Epoch 1437 | loss: 0.0311174 | val_loss: 0.031166 | Time: 2189.54 ms
[2022-02-13 22:59:25	                main:574]	:	INFO	:	Epoch 1438 | loss: 0.0311158 | val_loss: 0.0311653 | Time: 2385.91 ms
[2022-02-13 22:59:27	                main:574]	:	INFO	:	Epoch 1439 | loss: 0.0311148 | val_loss: 0.0311655 | Time: 2399.75 ms
[2022-02-13 22:59:30	                main:574]	:	INFO	:	Epoch 1440 | loss: 0.0311147 | val_loss: 0.0311653 | Time: 2366.8 ms


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x00007FF9F2CEE7F5 read attempt to address 0xFFFFFFFF

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 02/13/22 22:59:30
Install Directory : H:\Program Files\BOINC\
Data Directory    : H:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( H:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( H:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( H:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( H:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: H:\ProgramData\BOINC\slots\110;H:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 000000006fa30000 00000000003df000 H:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000342c0000 00000000001f0000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.18362.815) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000032670000 00000000000b2000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.18362.959 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.959

ModLoad: 0000000031d60000 00000000002a4000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.18362.959 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.959

ModLoad: 00000000324b0000 0000000000194000 C:\WINDOWS\System32\USER32.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000032070000 0000000000021000 C:\WINDOWS\System32\win32u.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.18362.959 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.959

ModLoad: 0000000032840000 0000000000026000 C:\WINDOWS\System32\GDI32.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000320a0000 0000000000196000 C:\WINDOWS\System32\gdi32full.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.18362.959 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.959

ModLoad: 0000000031b70000 000000000009e000 C:\WINDOWS\System32\msvcp_win.dll (6.2.18362.815) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.18362.815 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.815

ModLoad: 00000000319f0000 00000000000fa000 C:\WINDOWS\System32\ucrtbase.dll (6.2.18362.815) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.18362.815 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.815

ModLoad: 0000000033b20000 00000000000a3000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.18362.752) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000032740000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.18362.1

ModLoad: 0000000033be0000 0000000000097000 C:\WINDOWS\System32\sechost.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000032aa0000 0000000000120000 C:\WINDOWS\System32\RPCRT4.dll (6.2.18362.628) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 000000000f330000 0000000000058000 H:\ProgramData\BOINC\slots\110\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000005d10000 0000000000091000 H:\ProgramData\BOINC\slots\110\MSVCP140.dll (14.27.29112.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.27.29112.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.27.29112.0

ModLoad: 000000001e700000 00000000001f4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000013dc0000 0000000000019000 H:\ProgramData\BOINC\slots\110\VCRUNTIME140.dll (14.27.29112.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.27.29112.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.27.29112.0

ModLoad: 0000000018020000 000000000000c000 H:\ProgramData\BOINC\slots\110\VCRUNTIME140_1.dll (14.27.29112.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.27.29112.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.27.29112.0

ModLoad: 00000000d6a20000 000000000abe7000 H:\ProgramData\BOINC\slots\110\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000fe610000 00000000002db000 H:\ProgramData\BOINC\slots\110\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000f4700000 000000000020d000 H:\ProgramData\BOINC\slots\110\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 000000000c4c0000 0000000000040000 H:\ProgramData\BOINC\slots\110\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000712b0000 0000000024b49000 H:\ProgramData\BOINC\slots\110\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000006ddf0000 00000000034b2000 H:\ProgramData\BOINC\slots\110\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 000000006ad40000 00000000030a5000 H:\ProgramData\BOINC\slots\110\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 000000000c440000 0000000000045000 H:\ProgramData\BOINC\slots\110\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000061ba0000 000000000919f000 H:\ProgramData\BOINC\slots\110\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000177c0000 0000000000010000 H:\ProgramData\BOINC\slots\110\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 000000005de40000 0000000003d5b000 H:\ProgramData\BOINC\slots\110\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 000000005bf70000 0000000001eca000 H:\ProgramData\BOINC\slots\110\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 0000000040bc0000 000000001b3a4000 H:\ProgramData\BOINC\slots\110\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 0000000032240000 0000000000080000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.18362.836) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.18362.836 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.836

ModLoad: 0000000033de0000 000000000002e000 C:\WINDOWS\System32\IMM32.DLL (6.2.18362.387) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.18362.387 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.387

ModLoad: 0000000031180000 0000000000011000 C:\WINDOWS\System32\kernel.appcore.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 000000002fe10000 0000000000020000 C:\WINDOWS\SYSTEM32\dxcore.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : DXCore.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000031b20000 000000000004a000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.18362.387) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.18362.387 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.387

ModLoad: 00000000334b0000 0000000000335000 C:\WINDOWS\System32\combase.dll (6.2.18362.900) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000033e10000 0000000000470000 C:\WINDOWS\System32\Setupapi.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000031af0000 0000000000026000 C:\WINDOWS\System32\bcrypt.dll (6.2.18362.267) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000030f10000 000000000002a000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.18362.387) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.18362.387 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.387

ModLoad: 0000000032010000 000000000005c000 C:\WINDOWS\System32\WINTRUST.dll (6.2.18362.387) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.18362.387 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.387

ModLoad: 00000000311a0000 0000000000012000 C:\WINDOWS\System32\MSASN1.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000031c10000 0000000000149000 C:\WINDOWS\System32\CRYPT32.dll (6.2.18362.592) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000032bc0000 00000000006e6000 C:\WINDOWS\System32\Shell32.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.18362.900 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.900

ModLoad: 00000000332b0000 00000000000a9000 C:\WINDOWS\System32\shcore.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000031260000 0000000000782000 C:\WINDOWS\System32\windows.storage.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 00000000311c0000 0000000000023000 C:\WINDOWS\System32\profapi.dll (6.2.18362.693) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : profapi.pdb
    File Version          : 10.0.18362.693 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.693

ModLoad: 00000000311f0000 000000000004a000 C:\WINDOWS\System32\powrprof.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : powrprof.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000031170000 0000000000010000 C:\WINDOWS\System32\UMPDC.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : UMPDC.pdb

ModLoad: 00000000327e0000 0000000000052000 C:\WINDOWS\System32\shlwapi.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000031240000 0000000000017000 C:\WINDOWS\System32\cryptsp.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptsp.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000017a30000 0000000000267000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.5730) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 27.21.14.5730
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.1.114 driver
    Product Version       : 27.21.14.5730

ModLoad: 000000002f150000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000f2b80000 000000000152c000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_5dcb5bbf5c3edcf2\nvcuda64.dll (27.21.14.5730) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 27.21.14.5730
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.1.114 driver
    Product Version       : 27.21.14.5730

ModLoad: 00000000338d0000 000000000006f000 C:\WINDOWS\System32\WS2_32.dll (6.2.18362.387) (-exported- Symbols Loaded)
    Linked PDB Filename   : ws2_32.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 000000002f120000 000000000002f000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000030ab0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 000000002f4a0000 0000000000099000 C:\WINDOWS\system32\uxtheme.dll (6.2.18362.449) (-exported- Symbols Loaded)
    Linked PDB Filename   : UxTheme.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 00000000295b0000 00000000006d6000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.5730) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 27.21.14.5730
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 27.21.14.5730

ModLoad: 0000000033c80000 0000000000157000 C:\WINDOWS\System32\OLE32.DLL (6.2.18362.693) (-exported- Symbols Loaded)
    Linked PDB Filename   : ole32.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000016bf0000 0000000000009000 H:\ProgramData\BOINC\slots\110\caffe2_nvrtc.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000eb790000 0000000000fca000 H:\ProgramData\BOINC\slots\110\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6.14.11.9000
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.89 NVRTC Library
    Product Version       : 6.14.11.9000



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 5061, Write: 5405, Other 18299

- I/O Transfers Counters -
Read: 12442661, Write: 771544, Other 130528

- Paged Pool Usage -
QuotaPagedPoolUsage: 3535448, QuotaPeakPagedPoolUsage: 3535448
QuotaNonPagedPoolUsage: 59424, QuotaPeakNonPagedPoolUsage: 59896

- Virtual Memory Usage -
VirtualSize: 360230912, PeakVirtualSize: 985268224

- Pagefile Usage -
PagefileUsage: 360230912, PeakPagefileUsage: 360230912

- Working Set Size -
WorkingSetSize: -2104365056, PeakWorkingSetSize: -2041450496, PageFaultCount: 856425

*** Dump of thread ID 11108 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 1266562560.000000, User Time: 12624531456.000000, Wait Time: 356138656.000000

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x00007FF9F2CEE7F5 read attempt to address 0xFFFFFFFF

- Registers -
rax=0000000000000000 rbx=00000000296f3480 rcx=00000000377f9570 rdx=00000000296f3480 rsi=00000000a3d161c0 rdi=00000000377f9570
r8=0000000000000080 r9=0000000000000001 r10=0000000000000018 r11=0000000000000094 r12=0000000000000001 r13=0000000000000001
r14=00000000296f3480 r15=0000000000000003 rip=00000000f2cee7f5 rsp=00000000377f9408 rbp=00000000377f9560
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00010246

- Callstack -
ChildEBP RetAddr  Args to Child
377f9400 f2bb8363 296f3480 377f9570 377f9468 a3d161c0 nvcuda64!+0x0 
377f9450 f2bb890c a3d161d0 a3d161c0 296f3480 a3d161d0 nvcuda64!+0x0 
377f96e0 f2d81108 00008000 41b50730 00000000 41964de7 nvcuda64!+0x0 
377f9850 419629b6 00000001 00000080 00000000 41b50730 nvcuda64!cuLaunchKernel+0x0 
377f9960 4195fdf4 41b50730 a254ffd0 296f3480 377f9b80 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
377f9ae0 41b43951 41b50730 00000000 41b50730 00000000 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
377f9c50 41ace604 23817590 43da2090 49284800 000000c0 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
377f9e80 41adf99d 00000000 42dd1500 00000000 41b50730 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
377f9ee0 41aa703b 00000000 00000000 23817590 377f9ff0 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
377fa370 419c43bc 00000000 377fa45c 00000000 4d4e7020 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
377fa640 419c700e 377fa950 4196bc3c 377fa698 41964ce0 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
377fa730 418c82ca 4d4e7020 00000000 00000000 0000000c cudnn64_7!cudnnSetDropoutDescriptor+0x0 
377fa800 418c62b3 00000000 0000000c 377faa40 00000002 cudnn64_7!cudnnSetAttnDescriptor+0x0 
377fa950 418c9536 00000024 1b8db330 482e3390 00000000 cudnn64_7!cudnnSetAttnDescriptor+0x0 
377faa60 418f5f37 49284800 4c831680 00000000 00000000 cudnn64_7!cudnnSetAttnDescriptor+0x0 
377fb0a0 418eeafa 00000004 4c831680 00000004 00000000 cudnn64_7!cudnnRNNForwardTrainingEx+0x0 
377fb260 41909738 4c831680 00000400 4f7ed100 1b8db330 cudnn64_7!cudnnRNNForwardTrainingEx+0x0 
377fd470 7402af5a 377fea60 49280000 377fea60 1b8db330 cudnn64_7!cudnnRNNBackwardData+0x0 
377fda00 74029c90 00000010 00000000 377fe390 377fe378 torch_cuda!at::native::_cudnn_rnn_backward+0x0 
377fdbf0 74082808 377fdde0 377feac8 377fdcd0 00000004 torch_cuda!at::native::_cudnn_rnn_backward+0x0 
377fdd00 7409103d 377fe390 377fe370 377feaa8 00000000 torch_cuda!at::native::set_storage_cuda_+0x0 
377fde10 dc46c201 377fe390 dbfeea63 39fade10 377fe4d8 torch_cuda!at::native::set_storage_cuda_+0x0 
377fdfa0 dc4bbfea 377fea60 00000000 00000007 df50f880 torch_cpu!at::native::mkldnn_sigmoid_+0x0 
377fe0d0 dc4a34da e1344668 377fe310 377feac8 377fe1b0 torch_cpu!at::bucketize_out+0x0 
377fe1c0 dd79e0a9 377fe310 377fea60 377fe300 00000000 torch_cpu!at::_cudnn_rnn_backward+0x0 
377fe4a0 dd7aa94d 39faa610 ddc1794a 00000020 00000004 torch_cpu!torch::autograd::GraphRoot::apply+0x0 
377fe5b0 dc46c201 377feab8 39fae310 377fe740 ddc13e3f torch_cpu!torch::autograd::GraphRoot::apply+0x0 
377fe740 dc4bbfea 377fea60 00000000 00000000 00000000 torch_cpu!at::native::mkldnn_sigmoid_+0x0 
377fe870 dc4a34da e1344668 377febe0 377feac8 377fe950 torch_cpu!at::bucketize_out+0x0 
377fe960 dd6a994d 377febe0 477ea900 377feaa0 4f7c6ad8 torch_cpu!at::_cudnn_rnn_backward+0x0 
377fee00 dd6956b1 3ab23e00 377ff108 00000000 0f333bd6 torch_cpu!torch::autograd::generated::CudnnRnnBackward::apply+0x0 
377ff010 ddbfd1ea 377ff120 3ab23e00 377ff120 3ab23e00 torch_cpu!torch::autograd::Node::operator()+0x0 
377ff1f0 ddbfdbdd 00000001 00000001 00000001 00000001 torch_cpu!torch::autograd::Engine::add_thread_pool_task+0x0 
377ff6d0 ddc02812 00000000 00000000 3ab23df0 ffffffff torch_cpu!torch::autograd::Engine::evaluate_function+0x0 
377ff9c0 ddc02471 e1126d10 377ffa00 e1126d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0 
377ffa10 ddbf9744 00080001 4fa46820 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0 
377ffa40 31a10e82 4fa46820 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0 
377ffa70 32687bd4 00000000 00000000 00000000 00000000 ucrtbase!_beginthreadex+0x0 
377ffaa0 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
377ffb20 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 16536 (state: Waiting): ***

- Information -
Status: Wait Reason: Unknown, , Kernel Time: 2394374912.000000, User Time: 16579375104.000000, Wait Time: 356138656.000000

- Registers -
rax=00000000000001ca rbx=0000000000000000 rcx=00000000478d0798 rdx=0000000000000000 rsi=0000000000000000 rdi=0000000000000000
r8=0000000000000000 r9=0000000000000008 r10=00000000ba0f11e4 r11=00000000000dbb08 r12=0000000000000003 r13=00000000000001c0
r14=00000000478d0748 r15=0000000000000000 rip=000000003435f9a4 rsp=0000000036ee5578 rbp=00000000478d0798
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
36ee5570 34320590 36ee5790 f2d44249 00000000 a3a9c030 ntdll!ZwWaitForAlertByThreadId+0x0 
36ee55e0 31d858fd 478d0740 00000000 00000000 00008000 ntdll!RtlSleepConditionVariableSRW+0x0 
36ee5620 05d4ba8d 36ee5790 00000000 00008000 36ee5240 KERNELBASE!SleepConditionVariableSRW+0x0 
36ee5660 05d22848 00000000 36ee5240 0c442e0d 0f352433 MSVCP140!__crtSetThreadpoolWait+0x0 
36ee5690 05d22710 36ee5b40 05d22f17 00000000 dbff0231 MSVCP140!std::_Winerror_message+0x0 
36ee5700 ddc0064b 3ab23e00 000001c0 478d0740 478d0740 MSVCP140!std::_Winerror_message+0x0 
36ee5740 ddc025b1 a1d7f2e0 3ab23df0 3ab23df0 00000000 torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0 
36ee5a30 ddbff15d 36ee5d10 36ee5d10 36ee5d10 a1d7f2e0 torch_cpu!torch::autograd::Engine::thread_main+0x0 
36ee5ca0 ddbfeea0 3a880c80 e1126d10 fffffffe 00000000 torch_cpu!torch::autograd::Engine::execute_with_graph_task+0x0 
36ee5dd0 ddbf56f9 482e34d0 482e34d0 36ee5dc0 36ee5ec8 torch_cpu!torch::autograd::Engine::execute+0x0 
36ee62f0 ddbf5086 88ac1fb8 dc5c5dc2 00000000 36ee63c0 torch_cpu!torch::autograd::Engine::make_anomaly_metadata+0x0 
36ee6390 ddef09be 39faaf10 482e34d8 00000000 36ee6330 torch_cpu!torch::autograd::backward+0x0 
36ee6470 dd921cd0 a37d09e0 00000000 00000000 00000000 torch_cpu!torch::autograd::VariableType::allCUDATypes+0x0 
36ee64a0 dc5c0a06 00000000 00000000 00010001 00000001 torch_cpu!torch::autograd::GraphRoot::apply+0x0 
36ee66d0 6fa47166 36ee67a0 36ee67e0 36ee67a0 36ee6d40 torch_cpu!at::Tensor::backward+0x0 
36ee6bd0 6fa4b950 36ee6cd0 36ee6cd0 00000000 eb938240 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0 
36eff970 6fc8c6f8 a386cdb0 00000000 00000000 a393acf0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
36eff9b0 32687bd4 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
36eff9e0 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
36effa60 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 8948 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 356138656.000000

- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000373ffc40 rsi=0000000000000000 rdi=0000000000000064
r8=00000000373fed10 r9=00000000373fed40 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000003435c6f4 rsp=00000000373ffc18 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
373ffc10 31da6891 373ffcd8 00000000 00000000 00000000 ntdll!ZwDelayExecution+0x0 
373ffcb0 6fa6a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0 
373ffce0 32687bd4 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
373ffd10 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
373ffd90 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 10884 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 356138656.000000

- Registers -
rax=000000000000005b rbx=000000000000000b rcx=000000000000000b rdx=00000000374ff920 rsi=0000000000000000 rdi=000000000000000b
r8=00000000a3d11090 r9=00000000a3a80c00 r10=0000000000000000 r11=00000000374ff890 r12=0000000000000064 r13=00000000374ff920
r14=00000000374ff610 r15=0000000000000000 rip=000000003435cbc4 rsp=00000000374ff5b8 rbp=00000000a3a80cc0
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
374ff5b0 31db8037 33ca3880 343337d4 00000000 36d37000 ntdll!NtWaitForMultipleObjects+0x0 
374ff8b0 31db7f1e f3074b48 a1d82dd0 0000000b 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
374ff8f0 f2d2bb54 a3a84aa0 00000000 a3a80b40 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
374ffb30 f2dc09ed 00000000 00000004 00000000 00000000 nvcuda64!+0x0 
374ffbe0 f2d2b523 409c62ac 74924223 a3f7bd10 00000000 nvcuda64!cuProfilerStop+0x0 
374ffc10 f303a750 a3f7bd10 00000000 00000000 00000000 nvcuda64!+0x0 
374ffc40 32687bd4 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
374ffc70 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
374ffcf0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 7508 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 355924352.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=000000000000029c rdx=0000000000000000 rsi=0000000000000000 rdi=000000000000029c
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=00000000a3a67bb0 r13=0000000000000000
r14=000000000000029c r15=0000000000000000 rip=000000003435c0f4 rsp=00000000375ff968 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
375ff960 31d98b03 00000000 00000000 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0 
375ffa00 f2f3bf48 00000000 31d84975 00000000 0000029c KERNELBASE!WaitForSingleObjectEx+0x0 
375ffa70 f2d2b523 00000001 a450b5b0 a3f7be90 00000000 nvcuda64!cuProfilerStop+0x0 
375ffaa0 f303a750 a3f7be90 00000000 00000000 00000000 nvcuda64!+0x0 
375ffad0 32687bd4 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
375ffb00 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
375ffb80 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 21344 (state: Waiting): ***

- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 356138656.000000

- Registers -
rax=00000000000001ca rbx=0000000000000000 rcx=00000000a3d14258 rdx=00000000376ffa48 rsi=00000000376ff9b0 rdi=0000000000000000
r8=0000000000000001 r9=0000000000005360 r10=00000000a3d189d8 r11=000000006a00730f r12=00000000376ffa48 r13=0000000000000000
r14=00000000a3d14258 r15=00000000a3d189d8 rip=000000003435f9a4 rsp=00000000376ff988 rbp=00000000376ff9e0
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
376ff980 34320815 00000102 00000102 00000000 376ff9b0 ntdll!ZwWaitForAlertByThreadId+0x0 
376ff9f0 31ddc2b9 a3d161c0 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0 
376ffa20 f2cb223a a3d161c0 a3d161c0 a3d161c0 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0 
376ffa80 f2d2b523 00000004 408227a8 408227a8 00000000 nvcuda64!+0x0 
376ffab0 f303a750 a4441c70 00000000 00000000 00000000 nvcuda64!+0x0 
376ffae0 32687bd4 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
376ffb10 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
376ffb90 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)