Task 14289594

Name ParityModified-1647048089-25983-2-0_0
Workunit 11343852
Created 3 Apr 2022, 6:00:47 UTC
Sent 8 Apr 2022, 1:42:33 UTC
Report deadline 16 Apr 2022, 1:42:33 UTC
Received 13 Apr 2022, 19:55:00 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 11401
Run time 1 hours 1 min 18 sec
CPU time 55 min 54 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 7,468.68 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 2.13 GB
Peak swap size 3.14 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
:35:48	                main:574]	:	INFO	:	Epoch 1310 | loss: nan | val_loss: nan | Time: 3022.2 ms
[2022-04-14 02:35:51	                main:574]	:	INFO	:	Epoch 1311 | loss: nan | val_loss: nan | Time: 3047.09 ms
[2022-04-14 02:35:54	                main:574]	:	INFO	:	Epoch 1312 | loss: nan | val_loss: nan | Time: 3097.99 ms
[2022-04-14 02:35:57	                main:574]	:	INFO	:	Epoch 1313 | loss: nan | val_loss: nan | Time: 3093.12 ms
[2022-04-14 02:36:00	                main:574]	:	INFO	:	Epoch 1314 | loss: nan | val_loss: nan | Time: 3145.73 ms
[2022-04-14 02:36:03	                main:574]	:	INFO	:	Epoch 1315 | loss: nan | val_loss: nan | Time: 3094.15 ms
[2022-04-14 02:36:06	                main:574]	:	INFO	:	Epoch 1316 | loss: nan | val_loss: nan | Time: 3090.2 ms
[2022-04-14 02:36:09	                main:574]	:	INFO	:	Epoch 1317 | loss: nan | val_loss: nan | Time: 3118.64 ms
[2022-04-14 02:36:13	                main:574]	:	INFO	:	Epoch 1318 | loss: nan | val_loss: nan | Time: 3099.26 ms
[2022-04-14 02:36:16	                main:574]	:	INFO	:	Epoch 1319 | loss: nan | val_loss: nan | Time: 3004.46 ms
[2022-04-14 02:36:19	                main:574]	:	INFO	:	Epoch 1320 | loss: nan | val_loss: nan | Time: 3067.27 ms
[2022-04-14 02:36:22	                main:574]	:	INFO	:	Epoch 1321 | loss: nan | val_loss: nan | Time: 3202.59 ms
[2022-04-14 02:36:25	                main:574]	:	INFO	:	Epoch 1322 | loss: nan | val_loss: nan | Time: 3046.07 ms
[2022-04-14 02:36:28	                main:574]	:	INFO	:	Epoch 1323 | loss: nan | val_loss: nan | Time: 2984.92 ms
[2022-04-14 02:36:31	                main:574]	:	INFO	:	Epoch 1324 | loss: nan | val_loss: nan | Time: 3412.95 ms
[2022-04-14 02:36:34	                main:574]	:	INFO	:	Epoch 1325 | loss: nan | val_loss: nan | Time: 2980.61 ms
[2022-04-14 02:36:37	                main:574]	:	INFO	:	Epoch 1326 | loss: nan | val_loss: nan | Time: 3190.46 ms
[2022-04-14 02:36:41	                main:574]	:	INFO	:	Epoch 1327 | loss: nan | val_loss: nan | Time: 3159.58 ms
[2022-04-14 02:36:44	                main:574]	:	INFO	:	Epoch 1328 | loss: nan | val_loss: nan | Time: 3531.72 ms
[2022-04-14 02:36:47	                main:574]	:	INFO	:	Epoch 1329 | loss: nan | val_loss: nan | Time: 3172.92 ms
[2022-04-14 02:36:51	                main:574]	:	INFO	:	Epoch 1330 | loss: nan | val_loss: nan | Time: 3243.35 ms
[2022-04-14 02:36:54	                main:574]	:	INFO	:	Epoch 1331 | loss: nan | val_loss: nan | Time: 3207.94 ms
[2022-04-14 02:36:57	                main:574]	:	INFO	:	Epoch 1332 | loss: nan | val_loss: nan | Time: 3160.42 ms
[2022-04-14 02:37:00	                main:574]	:	INFO	:	Epoch 1333 | loss: nan | val_loss: nan | Time: 3157.03 ms
[2022-04-14 02:37:03	                main:574]	:	INFO	:	Epoch 1334 | loss: nan | val_loss: nan | Time: 3196.09 ms
[2022-04-14 02:37:07	                main:574]	:	INFO	:	Epoch 1335 | loss: nan | val_loss: nan | Time: 3250.39 ms
[2022-04-14 02:37:10	                main:574]	:	INFO	:	Epoch 1336 | loss: nan | val_loss: nan | Time: 3358.43 ms
[2022-04-14 02:37:13	                main:574]	:	INFO	:	Epoch 1337 | loss: nan | val_loss: nan | Time: 3327.69 ms
[2022-04-14 02:37:16	                main:574]	:	INFO	:	Epoch 1338 | loss: nan | val_loss: nan | Time: 3171.31 ms
[2022-04-14 02:37:19	                main:574]	:	INFO	:	Epoch 1339 | loss: nan | val_loss: nan | Time: 2997.47 ms
[2022-04-14 02:37:22	                main:574]	:	INFO	:	Epoch 1340 | loss: nan | val_loss: nan | Time: 3091.36 ms
[2022-04-14 02:37:26	                main:574]	:	INFO	:	Epoch 1341 | loss: nan | val_loss: nan | Time: 3187.25 ms
[2022-04-14 02:37:29	                main:574]	:	INFO	:	Epoch 1342 | loss: nan | val_loss: nan | Time: 3248.43 ms
[2022-04-14 02:37:32	                main:574]	:	INFO	:	Epoch 1343 | loss: nan | val_loss: nan | Time: 3220.29 ms
[2022-04-14 02:37:35	                main:574]	:	INFO	:	Epoch 1344 | loss: nan | val_loss: nan | Time: 3148.79 ms
[2022-04-14 02:37:38	                main:574]	:	INFO	:	Epoch 1345 | loss: nan | val_loss: nan | Time: 3123.52 ms
[2022-04-14 02:37:42	                main:574]	:	INFO	:	Epoch 1346 | loss: nan | val_loss: nan | Time: 3531.86 ms
[2022-04-14 02:37:45	                main:574]	:	INFO	:	Epoch 1347 | loss: nan | val_loss: nan | Time: 3205.46 ms
[2022-04-14 02:37:49	                main:574]	:	INFO	:	Epoch 1348 | loss: nan | val_loss: nan | Time: 3410.04 ms
[2022-04-14 02:37:52	                main:574]	:	INFO	:	Epoch 1349 | loss: nan | val_loss: nan | Time: 3340.65 ms
[2022-04-14 02:37:55	                main:574]	:	INFO	:	Epoch 1350 | loss: nan | val_loss: nan | Time: 3103.65 ms
[2022-04-14 02:37:58	                main:574]	:	INFO	:	Epoch 1351 | loss: nan | val_loss: nan | Time: 3196.61 ms
[2022-04-14 02:38:01	                main:574]	:	INFO	:	Epoch 1352 | loss: nan | val_loss: nan | Time: 3229.11 ms
[2022-04-14 02:38:05	                main:574]	:	INFO	:	Epoch 1353 | loss: nan | val_loss: nan | Time: 3400.3 ms
[2022-04-14 02:38:08	                main:574]	:	INFO	:	Epoch 1354 | loss: nan | val_loss: nan | Time: 3596.82 ms
[2022-04-14 02:38:12	                main:574]	:	INFO	:	Epoch 1355 | loss: nan | val_loss: nan | Time: 3319.46 ms
[2022-04-14 02:38:15	                main:574]	:	INFO	:	Epoch 1356 | loss: nan | val_loss: nan | Time: 3190.13 ms
[2022-04-14 02:38:18	                main:574]	:	INFO	:	Epoch 1357 | loss: nan | val_loss: nan | Time: 3084.23 ms
[2022-04-14 02:38:21	                main:574]	:	INFO	:	Epoch 1358 | loss: nan | val_loss: nan | Time: 3138.45 ms
[2022-04-14 02:38:24	                main:574]	:	INFO	:	Epoch 1359 | loss: nan | val_loss: nan | Time: 3316.16 ms
[2022-04-14 02:38:28	                main:574]	:	INFO	:	Epoch 1360 | loss: nan | val_loss: nan | Time: 3195.97 ms
[2022-04-14 02:38:31	                main:574]	:	INFO	:	Epoch 1361 | loss: nan | val_loss: nan | Time: 3308.51 ms
[2022-04-14 02:38:34	                main:574]	:	INFO	:	Epoch 1362 | loss: nan | val_loss: nan | Time: 3332.76 ms
[2022-04-14 02:38:38	                main:574]	:	INFO	:	Epoch 1363 | loss: nan | val_loss: nan | Time: 3171.73 ms
[2022-04-14 02:38:41	                main:574]	:	INFO	:	Epoch 1364 | loss: nan | val_loss: nan | Time: 3164.07 ms
[2022-04-14 02:38:44	                main:574]	:	INFO	:	Epoch 1365 | loss: nan | val_loss: nan | Time: 3271.19 ms
[2022-04-14 02:38:47	                main:574]	:	INFO	:	Epoch 1366 | loss: nan | val_loss: nan | Time: 3247.74 ms
[2022-04-14 02:38:50	                main:574]	:	INFO	:	Epoch 1367 | loss: nan | val_loss: nan | Time: 3207.36 ms
[2022-04-14 02:38:54	                main:574]	:	INFO	:	Epoch 1368 | loss: nan | val_loss: nan | Time: 3204.07 ms
[2022-04-14 02:38:57	                main:574]	:	INFO	:	Epoch 1369 | loss: nan | val_loss: nan | Time: 3329.25 ms
[2022-04-14 02:39:00	                main:574]	:	INFO	:	Epoch 1370 | loss: nan | val_loss: nan | Time: 3250.28 ms
[2022-04-14 02:39:04	                main:574]	:	INFO	:	Epoch 1371 | loss: nan | val_loss: nan | Time: 3336.8 ms
[2022-04-14 02:39:07	                main:574]	:	INFO	:	Epoch 1372 | loss: nan | val_loss: nan | Time: 3173.61 ms
[2022-04-14 02:39:10	                main:574]	:	INFO	:	Epoch 1373 | loss: nan | val_loss: nan | Time: 3071.04 ms
[2022-04-14 02:39:13	                main:574]	:	INFO	:	Epoch 1374 | loss: nan | val_loss: nan | Time: 3143.48 ms
[2022-04-14 02:39:16	                main:574]	:	INFO	:	Epoch 1375 | loss: nan | val_loss: nan | Time: 3214.61 ms
[2022-04-14 02:39:19	                main:574]	:	INFO	:	Epoch 1376 | loss: nan | val_loss: nan | Time: 3326.09 ms
[2022-04-14 02:39:23	                main:574]	:	INFO	:	Epoch 1377 | loss: nan | val_loss: nan | Time: 3228.4 ms
[2022-04-14 02:39:26	                main:574]	:	INFO	:	Epoch 1378 | loss: nan | val_loss: nan | Time: 3553.3 ms
[2022-04-14 02:39:30	                main:574]	:	INFO	:	Epoch 1379 | loss: nan | val_loss: nan | Time: 3556.58 ms
[2022-04-14 02:39:33	                main:574]	:	INFO	:	Epoch 1380 | loss: nan | val_loss: nan | Time: 3212.78 ms
[2022-04-14 02:39:36	                main:574]	:	INFO	:	Epoch 1381 | loss: nan | val_loss: nan | Time: 3191.56 ms
[2022-04-14 02:39:41	                main:574]	:	INFO	:	Epoch 1382 | loss: nan | val_loss: nan | Time: 3403.67 ms
[2022-04-14 02:39:44	                main:574]	:	INFO	:	Epoch 1383 | loss: nan | val_loss: nan | Time: 3232.85 ms
[2022-04-14 02:39:47	                main:574]	:	INFO	:	Epoch 1384 | loss: nan | val_loss: nan | Time: 3219.15 ms
[2022-04-14 02:39:50	                main:574]	:	INFO	:	Epoch 1385 | loss: nan | val_loss: nan | Time: 3064.13 ms
[2022-04-14 02:39:54	                main:574]	:	INFO	:	Epoch 1386 | loss: nan | val_loss: nan | Time: 3826.02 ms
[2022-04-14 02:39:57	                main:574]	:	INFO	:	Epoch 1387 | loss: nan | val_loss: nan | Time: 3430.48 ms
[2022-04-14 02:40:01	                main:574]	:	INFO	:	Epoch 1388 | loss: nan | val_loss: nan | Time: 3019.83 ms
[2022-04-14 02:40:04	                main:574]	:	INFO	:	Epoch 1389 | loss: nan | val_loss: nan | Time: 3240.05 ms
[2022-04-14 02:40:07	                main:574]	:	INFO	:	Epoch 1390 | loss: nan | val_loss: nan | Time: 3112.08 ms
[2022-04-14 02:40:10	                main:574]	:	INFO	:	Epoch 1391 | loss: nan | val_loss: nan | Time: 3139.67 ms
[2022-04-14 02:40:13	                main:574]	:	INFO	:	Epoch 1392 | loss: nan | val_loss: nan | Time: 3340.5 ms
[2022-04-14 02:40:17	                main:574]	:	INFO	:	Epoch 1393 | loss: nan | val_loss: nan | Time: 3205.67 ms
[2022-04-14 02:40:20	                main:574]	:	INFO	:	Epoch 1394 | loss: nan | val_loss: nan | Time: 3035.68 ms
[2022-04-14 02:40:23	                main:574]	:	INFO	:	Epoch 1395 | loss: nan | val_loss: nan | Time: 3226.47 ms
[2022-04-14 02:40:26	                main:574]	:	INFO	:	Epoch 1396 | loss: nan | val_loss: nan | Time: 3207.3 ms
[2022-04-14 02:40:29	                main:574]	:	INFO	:	Epoch 1397 | loss: nan | val_loss: nan | Time: 3179.31 ms
[2022-04-14 02:40:33	                main:574]	:	INFO	:	Epoch 1398 | loss: nan | val_loss: nan | Time: 3644.46 ms
[2022-04-14 02:40:36	                main:574]	:	INFO	:	Epoch 1399 | loss: nan | val_loss: nan | Time: 3139.88 ms
[2022-04-14 02:40:40	                main:574]	:	INFO	:	Epoch 1400 | loss: nan | val_loss: nan | Time: 3486.79 ms
[2022-04-14 02:40:43	                main:574]	:	INFO	:	Epoch 1401 | loss: nan | val_loss: nan | Time: 3672.1 ms
[2022-04-14 02:40:47	                main:574]	:	INFO	:	Epoch 1402 | loss: nan | val_loss: nan | Time: 3729.94 ms
[2022-04-14 02:40:50	                main:574]	:	INFO	:	Epoch 1403 | loss: nan | val_loss: nan | Time: 3078.73 ms
[2022-04-14 02:40:54	                main:574]	:	INFO	:	Epoch 1404 | loss: nan | val_loss: nan | Time: 3323.81 ms
[2022-04-14 02:40:58	                main:574]	:	INFO	:	Epoch 1405 | loss: nan | val_loss: nan | Time: 3084.09 ms
[2022-04-14 02:41:01	                main:574]	:	INFO	:	Epoch 1406 | loss: nan | val_loss: nan | Time: 3226.39 ms
[2022-04-14 02:41:04	                main:574]	:	INFO	:	Epoch 1407 | loss: nan | val_loss: nan | Time: 3174.26 ms
[2022-04-14 02:41:09	                main:574]	:	INFO	:	Epoch 1408 | loss: nan | val_loss: nan | Time: 3422.97 ms
[2022-04-14 02:41:12	                main:574]	:	INFO	:	Epoch 1409 | loss: nan | val_loss: nan | Time: 3208.5 ms
[2022-04-14 02:41:15	                main:574]	:	INFO	:	Epoch 1410 | loss: nan | val_loss: nan | Time: 3146.24 ms
[2022-04-14 02:41:19	                main:574]	:	INFO	:	Epoch 1411 | loss: nan | val_loss: nan | Time: 3235.93 ms
[2022-04-14 02:41:22	                main:574]	:	INFO	:	Epoch 1412 | loss: nan | val_loss: nan | Time: 3106.19 ms
[2022-04-14 02:41:25	                main:574]	:	INFO	:	Epoch 1413 | loss: nan | val_loss: nan | Time: 3191.6 ms
[2022-04-14 02:41:28	                main:574]	:	INFO	:	Epoch 1414 | loss: nan | val_loss: nan | Time: 3166.09 ms
[2022-04-14 02:41:31	                main:574]	:	INFO	:	Epoch 1415 | loss: nan | val_loss: nan | Time: 3234.21 ms
[2022-04-14 02:41:35	                main:574]	:	INFO	:	Epoch 1416 | loss: nan | val_loss: nan | Time: 3192.16 ms
[2022-04-14 02:41:38	                main:574]	:	INFO	:	Epoch 1417 | loss: nan | val_loss: nan | Time: 3266.38 ms
[2022-04-14 02:41:41	                main:574]	:	INFO	:	Epoch 1418 | loss: nan | val_loss: nan | Time: 3177.05 ms
[2022-04-14 02:41:44	                main:574]	:	INFO	:	Epoch 1419 | loss: nan | val_loss: nan | Time: 3197.98 ms
[2022-04-14 02:41:48	                main:574]	:	INFO	:	Epoch 1420 | loss: nan | val_loss: nan | Time: 3309.34 ms
[2022-04-14 02:41:51	                main:574]	:	INFO	:	Epoch 1421 | loss: nan | val_loss: nan | Time: 3343.87 ms
[2022-04-14 02:41:54	                main:574]	:	INFO	:	Epoch 1422 | loss: nan | val_loss: nan | Time: 3119.8 ms
[2022-04-14 02:41:57	                main:574]	:	INFO	:	Epoch 1423 | loss: nan | val_loss: nan | Time: 3441.74 ms
[2022-04-14 02:42:01	                main:574]	:	INFO	:	Epoch 1424 | loss: nan | val_loss: nan | Time: 3215.74 ms
[2022-04-14 02:42:04	                main:574]	:	INFO	:	Epoch 1425 | loss: nan | val_loss: nan | Time: 3144.68 ms
[2022-04-14 02:42:07	                main:574]	:	INFO	:	Epoch 1426 | loss: nan | val_loss: nan | Time: 3130.76 ms
[2022-04-14 02:42:10	                main:574]	:	INFO	:	Epoch 1427 | loss: nan | val_loss: nan | Time: 3202.46 ms
[2022-04-14 02:42:13	                main:574]	:	INFO	:	Epoch 1428 | loss: nan | val_loss: nan | Time: 3185.23 ms
[2022-04-14 02:42:17	                main:574]	:	INFO	:	Epoch 1429 | loss: nan | val_loss: nan | Time: 3211.39 ms
[2022-04-14 02:42:20	                main:574]	:	INFO	:	Epoch 1430 | loss: nan | val_loss: nan | Time: 3307 ms
[2022-04-14 02:42:23	                main:574]	:	INFO	:	Epoch 1431 | loss: nan | val_loss: nan | Time: 3227.85 ms
[2022-04-14 02:42:27	                main:574]	:	INFO	:	Epoch 1432 | loss: nan | val_loss: nan | Time: 3502.33 ms
[2022-04-14 02:42:30	                main:574]	:	INFO	:	Epoch 1433 | loss: nan | val_loss: nan | Time: 3235.73 ms
[2022-04-14 02:42:33	                main:574]	:	INFO	:	Epoch 1434 | loss: nan | val_loss: nan | Time: 3277.04 ms
[2022-04-14 02:42:36	                main:574]	:	INFO	:	Epoch 1435 | loss: nan | val_loss: nan | Time: 3097.03 ms
[2022-04-14 02:42:40	                main:574]	:	INFO	:	Epoch 1436 | loss: nan | val_loss: nan | Time: 3503.25 ms
[2022-04-14 02:42:43	                main:574]	:	INFO	:	Epoch 1437 | loss: nan | val_loss: nan | Time: 3250.56 ms
[2022-04-14 02:42:46	                main:574]	:	INFO	:	Epoch 1438 | loss: nan | val_loss: nan | Time: 3262.06 ms
[2022-04-14 02:42:50	                main:574]	:	INFO	:	Epoch 1439 | loss: nan | val_loss: nan | Time: 3079.98 ms
[2022-04-14 02:42:53	                main:574]	:	INFO	:	Epoch 1440 | loss: nan | val_loss: nan | Time: 3043.72 ms
[2022-04-14 02:42:56	                main:574]	:	INFO	:	Epoch 1441 | loss: nan | val_loss: nan | Time: 3232.08 ms
[2022-04-14 02:42:59	                main:574]	:	INFO	:	Epoch 1442 | loss: nan | val_loss: nan | Time: 3137.99 ms
[2022-04-14 02:43:02	                main:574]	:	INFO	:	Epoch 1443 | loss: nan | val_loss: nan | Time: 3103.86 ms
[2022-04-14 02:43:05	                main:574]	:	INFO	:	Epoch 1444 | loss: nan | val_loss: nan | Time: 3171.21 ms
[2022-04-14 02:43:08	                main:574]	:	INFO	:	Epoch 1445 | loss: nan | val_loss: nan | Time: 3142.96 ms
[2022-04-14 02:43:11	                main:574]	:	INFO	:	Epoch 1446 | loss: nan | val_loss: nan | Time: 3032.27 ms
[2022-04-14 02:43:15	                main:574]	:	INFO	:	Epoch 1447 | loss: nan | val_loss: nan | Time: 3065.63 ms
[2022-04-14 02:43:18	                main:574]	:	INFO	:	Epoch 1448 | loss: nan | val_loss: nan | Time: 3175.59 ms
[2022-04-14 02:43:21	                main:574]	:	INFO	:	Epoch 1449 | loss: nan | val_loss: nan | Time: 3208.6 ms
[2022-04-14 02:43:24	                main:574]	:	INFO	:	Epoch 1450 | loss: nan | val_loss: nan | Time: 3349.21 ms
[2022-04-14 02:43:28	                main:574]	:	INFO	:	Epoch 1451 | loss: nan | val_loss: nan | Time: 3370.46 ms
[2022-04-14 02:43:31	                main:574]	:	INFO	:	Epoch 1452 | loss: nan | val_loss: nan | Time: 3000.51 ms
[2022-04-14 02:43:35	                main:574]	:	INFO	:	Epoch 1453 | loss: nan | val_loss: nan | Time: 3126.37 ms
[2022-04-14 02:43:38	                main:574]	:	INFO	:	Epoch 1454 | loss: nan | val_loss: nan | Time: 3151.67 ms
[2022-04-14 02:43:41	                main:574]	:	INFO	:	Epoch 1455 | loss: nan | val_loss: nan | Time: 3358.81 ms
[2022-04-14 02:43:47	                main:574]	:	INFO	:	Epoch 1456 | loss: nan | val_loss: nan | Time: 5343.88 ms
[2022-04-14 02:43:50	                main:574]	:	INFO	:	Epoch 1457 | loss: nan | val_loss: nan | Time: 3123.64 ms
[2022-04-14 02:43:53	                main:574]	:	INFO	:	Epoch 1458 | loss: nan | val_loss: nan | Time: 3237.86 ms
[2022-04-14 02:43:56	                main:574]	:	INFO	:	Epoch 1459 | loss: nan | val_loss: nan | Time: 3174.14 ms
[2022-04-14 02:43:59	                main:574]	:	INFO	:	Epoch 1460 | loss: nan | val_loss: nan | Time: 3119.53 ms
[2022-04-14 02:44:02	                main:574]	:	INFO	:	Epoch 1461 | loss: nan | val_loss: nan | Time: 3202.78 ms
[2022-04-14 02:44:06	                main:574]	:	INFO	:	Epoch 1462 | loss: nan | val_loss: nan | Time: 3054.7 ms
[2022-04-14 02:44:09	                main:574]	:	INFO	:	Epoch 1463 | loss: nan | val_loss: nan | Time: 3054.17 ms
[2022-04-14 02:44:12	                main:574]	:	INFO	:	Epoch 1464 | loss: nan | val_loss: nan | Time: 3148.47 ms
[2022-04-14 02:44:15	                main:574]	:	INFO	:	Epoch 1465 | loss: nan | val_loss: nan | Time: 3064.69 ms
[2022-04-14 02:44:18	                main:574]	:	INFO	:	Epoch 1466 | loss: nan | val_loss: nan | Time: 3102.59 ms
[2022-04-14 02:44:21	                main:574]	:	INFO	:	Epoch 1467 | loss: nan | val_loss: nan | Time: 3085.02 ms
[2022-04-14 02:44:24	                main:574]	:	INFO	:	Epoch 1468 | loss: nan | val_loss: nan | Time: 3101.73 ms
[2022-04-14 02:44:28	                main:574]	:	INFO	:	Epoch 1469 | loss: nan | val_loss: nan | Time: 3592.28 ms
[2022-04-14 02:44:31	                main:574]	:	INFO	:	Epoch 1470 | loss: nan | val_loss: nan | Time: 3178.54 ms
[2022-04-14 02:44:34	                main:574]	:	INFO	:	Epoch 1471 | loss: nan | val_loss: nan | Time: 3139.93 ms
[2022-04-14 02:44:37	                main:574]	:	INFO	:	Epoch 1472 | loss: nan | val_loss: nan | Time: 3161.23 ms
[2022-04-14 02:44:40	                main:574]	:	INFO	:	Epoch 1473 | loss: nan | val_loss: nan | Time: 3103.3 ms
[2022-04-14 02:44:43	                main:574]	:	INFO	:	Epoch 1474 | loss: nan | val_loss: nan | Time: 3210.72 ms
[2022-04-14 02:44:47	                main:574]	:	INFO	:	Epoch 1475 | loss: nan | val_loss: nan | Time: 3144.37 ms
[2022-04-14 02:44:50	                main:574]	:	INFO	:	Epoch 1476 | loss: nan | val_loss: nan | Time: 3214.14 ms
[2022-04-14 02:44:53	                main:574]	:	INFO	:	Epoch 1477 | loss: nan | val_loss: nan | Time: 2982.74 ms
[2022-04-14 02:44:56	                main:574]	:	INFO	:	Epoch 1478 | loss: nan | val_loss: nan | Time: 3504.05 ms
[2022-04-14 02:45:00	                main:574]	:	INFO	:	Epoch 1479 | loss: nan | val_loss: nan | Time: 3319.62 ms
[2022-04-14 02:45:03	                main:574]	:	INFO	:	Epoch 1480 | loss: nan | val_loss: nan | Time: 3067.28 ms
[2022-04-14 02:45:06	                main:574]	:	INFO	:	Epoch 1481 | loss: nan | val_loss: nan | Time: 3135.59 ms
[2022-04-14 02:45:09	                main:574]	:	INFO	:	Epoch 1482 | loss: nan | val_loss: nan | Time: 3052.04 ms
[2022-04-14 02:45:12	                main:574]	:	INFO	:	Epoch 1483 | loss: nan | val_loss: nan | Time: 3078.07 ms
[2022-04-14 02:45:16	                main:574]	:	INFO	:	Epoch 1484 | loss: nan | val_loss: nan | Time: 3141.01 ms
[2022-04-14 02:45:20	                main:574]	:	INFO	:	Epoch 1485 | loss: nan | val_loss: nan | Time: 3391.26 ms
[2022-04-14 02:45:23	                main:574]	:	INFO	:	Epoch 1486 | loss: nan | val_loss: nan | Time: 3277.81 ms
[2022-04-14 02:45:26	                main:574]	:	INFO	:	Epoch 1487 | loss: nan | val_loss: nan | Time: 3314.18 ms
[2022-04-14 02:45:30	                main:574]	:	INFO	:	Epoch 1488 | loss: nan | val_loss: nan | Time: 3508.15 ms
[2022-04-14 02:45:35	                main:574]	:	INFO	:	Epoch 1489 | loss: nan | val_loss: nan | Time: 5322.82 ms
[2022-04-14 02:45:38	                main:574]	:	INFO	:	Epoch 1490 | loss: nan | val_loss: nan | Time: 3127.84 ms
[2022-04-14 02:45:41	                main:574]	:	INFO	:	Epoch 1491 | loss: nan | val_loss: nan | Time: 3161.37 ms
[2022-04-14 02:45:44	                main:574]	:	INFO	:	Epoch 1492 | loss: nan | val_loss: nan | Time: 3120.23 ms
[2022-04-14 02:45:48	                main:574]	:	INFO	:	Epoch 1493 | loss: nan | val_loss: nan | Time: 3177.41 ms
[2022-04-14 02:45:51	                main:574]	:	INFO	:	Epoch 1494 | loss: nan | val_loss: nan | Time: 3107.19 ms
[2022-04-14 02:45:54	                main:574]	:	INFO	:	Epoch 1495 | loss: nan | val_loss: nan | Time: 3035.27 ms
[2022-04-14 02:45:57	                main:574]	:	INFO	:	Epoch 1496 | loss: nan | val_loss: nan | Time: 3128.02 ms
[2022-04-14 02:46:00	                main:574]	:	INFO	:	Epoch 1497 | loss: nan | val_loss: nan | Time: 3437.47 ms
[2022-04-14 02:46:03	                main:574]	:	INFO	:	Epoch 1498 | loss: nan | val_loss: nan | Time: 3000.85 ms
[2022-04-14 02:46:06	                main:574]	:	INFO	:	Epoch 1499 | loss: nan | val_loss: nan | Time: 3061.67 ms
[2022-04-14 02:46:09	                main:574]	:	INFO	:	Epoch 1500 | loss: nan | val_loss: nan | Time: 3041.55 ms
[2022-04-14 02:46:12	                main:574]	:	INFO	:	Epoch 1501 | loss: nan | val_loss: nan | Time: 2980.3 ms
[2022-04-14 02:46:16	                main:574]	:	INFO	:	Epoch 1502 | loss: nan | val_loss: nan | Time: 3163.54 ms
[2022-04-14 02:46:19	                main:574]	:	INFO	:	Epoch 1503 | loss: nan | val_loss: nan | Time: 3111.13 ms
[2022-04-14 02:46:22	                main:574]	:	INFO	:	Epoch 1504 | loss: nan | val_loss: nan | Time: 3399.4 ms
[2022-04-14 02:46:25	                main:574]	:	INFO	:	Epoch 1505 | loss: nan | val_loss: nan | Time: 3305.11 ms
[2022-04-14 02:46:28	                main:574]	:	INFO	:	Epoch 1506 | loss: nan | val_loss: nan | Time: 3044.47 ms
[2022-04-14 02:46:32	                main:574]	:	INFO	:	Epoch 1507 | loss: nan | val_loss: nan | Time: 3251.33 ms
[2022-04-14 02:46:35	                main:574]	:	INFO	:	Epoch 1508 | loss: nan | val_loss: nan | Time: 3122.42 ms
[2022-04-14 02:46:39	                main:574]	:	INFO	:	Epoch 1509 | loss: nan | val_loss: nan | Time: 4500.14 ms
[2022-04-14 02:46:53	                main:574]	:	INFO	:	Epoch 1510 | loss: nan | val_loss: nan | Time: 13321.2 ms
[2022-04-14 02:46:57	                main:574]	:	INFO	:	Epoch 1511 | loss: nan | val_loss: nan | Time: 2749.59 ms
[2022-04-14 02:47:05	                main:574]	:	INFO	:	Epoch 1512 | loss: nan | val_loss: nan | Time: 4553.97 ms
[2022-04-14 02:47:10	                main:574]	:	INFO	:	Epoch 1513 | loss: nan | val_loss: nan | Time: 2665.9 ms
[2022-04-14 02:47:16	                main:574]	:	INFO	:	Epoch 1514 | loss: nan | val_loss: nan | Time: 2627.37 ms
[2022-04-14 02:47:19	                main:574]	:	INFO	:	Epoch 1515 | loss: nan | val_loss: nan | Time: 2638.58 ms
[2022-04-14 02:47:32	                main:574]	:	INFO	:	Epoch 1516 | loss: nan | val_loss: nan | Time: 8460.39 ms
[2022-04-14 02:47:35	                main:574]	:	INFO	:	Epoch 1517 | loss: nan | val_loss: nan | Time: 2952.57 ms
[2022-04-14 02:47:44	                main:574]	:	INFO	:	Epoch 1518 | loss: nan | val_loss: nan | Time: 8516.51 ms
[2022-04-14 02:47:48	                main:574]	:	INFO	:	Epoch 1519 | loss: nan | val_loss: nan | Time: 3043.92 ms
[2022-04-14 02:47:55	                main:574]	:	INFO	:	Epoch 1520 | loss: nan | val_loss: nan | Time: 4843.83 ms
[2022-04-14 02:47:58	                main:574]	:	INFO	:	Epoch 1521 | loss: nan | val_loss: nan | Time: 3086.29 ms
[2022-04-14 02:48:01	                main:574]	:	INFO	:	Epoch 1522 | loss: nan | val_loss: nan | Time: 3347.42 ms
[2022-04-14 02:48:04	                main:574]	:	INFO	:	Epoch 1523 | loss: nan | val_loss: nan | Time: 3161.5 ms
[2022-04-14 02:48:07	                main:574]	:	INFO	:	Epoch 1524 | loss: nan | val_loss: nan | Time: 3146.37 ms
[2022-04-14 02:48:11	                main:574]	:	INFO	:	Epoch 1525 | loss: nan | val_loss: nan | Time: 3256.45 ms
[2022-04-14 02:48:14	                main:574]	:	INFO	:	Epoch 1526 | loss: nan | val_loss: nan | Time: 3231.67 ms
[2022-04-14 02:48:17	                main:574]	:	INFO	:	Epoch 1527 | loss: nan | val_loss: nan | Time: 3091.49 ms
[2022-04-14 02:48:20	                main:574]	:	INFO	:	Epoch 1528 | loss: nan | val_loss: nan | Time: 3116.31 ms
[2022-04-14 02:48:23	                main:574]	:	INFO	:	Epoch 1529 | loss: nan | val_loss: nan | Time: 3142.66 ms
[2022-04-14 02:48:26	                main:574]	:	INFO	:	Epoch 1530 | loss: nan | val_loss: nan | Time: 3179.46 ms
[2022-04-14 02:48:30	                main:574]	:	INFO	:	Epoch 1531 | loss: nan | val_loss: nan | Time: 3064.98 ms
[2022-04-14 02:48:33	                main:574]	:	INFO	:	Epoch 1532 | loss: nan | val_loss: nan | Time: 3692.28 ms
[2022-04-14 02:48:38	                main:574]	:	INFO	:	Epoch 1533 | loss: nan | val_loss: nan | Time: 3093.18 ms
[2022-04-14 02:48:42	                main:574]	:	INFO	:	Epoch 1534 | loss: nan | val_loss: nan | Time: 3163.67 ms
[2022-04-14 02:48:45	                main:574]	:	INFO	:	Epoch 1535 | loss: nan | val_loss: nan | Time: 3578.48 ms
[2022-04-14 02:48:48	                main:574]	:	INFO	:	Epoch 1536 | loss: nan | val_loss: nan | Time: 3134.57 ms
[2022-04-14 02:48:52	                main:574]	:	INFO	:	Epoch 1537 | loss: nan | val_loss: nan | Time: 3391.52 ms
[2022-04-14 02:48:55	                main:574]	:	INFO	:	Epoch 1538 | loss: nan | val_loss: nan | Time: 3183.3 ms
[2022-04-14 02:49:02	                main:574]	:	INFO	:	Epoch 1539 | loss: nan | val_loss: nan | Time: 7170.92 ms
[2022-04-14 02:49:09	                main:574]	:	INFO	:	Epoch 1540 | loss: nan | val_loss: nan | Time: 7155.51 ms
[2022-04-14 02:49:13	                main:574]	:	INFO	:	Epoch 1541 | loss: nan | val_loss: nan | Time: 3736.55 ms
[2022-04-14 02:49:16	                main:574]	:	INFO	:	Epoch 1542 | loss: nan | val_loss: nan | Time: 3113.92 ms
[2022-04-14 02:49:19	                main:574]	:	INFO	:	Epoch 1543 | loss: nan | val_loss: nan | Time: 3162.24 ms
[2022-04-14 02:49:23	                main:574]	:	INFO	:	Epoch 1544 | loss: nan | val_loss: nan | Time: 3672.95 ms
[2022-04-14 02:49:26	                main:574]	:	INFO	:	Epoch 1545 | loss: nan | val_loss: nan | Time: 3469.18 ms
[2022-04-14 02:49:30	                main:574]	:	INFO	:	Epoch 1546 | loss: nan | val_loss: nan | Time: 3501.01 ms
[2022-04-14 02:49:33	                main:574]	:	INFO	:	Epoch 1547 | loss: nan | val_loss: nan | Time: 3351.88 ms
[2022-04-14 02:49:36	                main:574]	:	INFO	:	Epoch 1548 | loss: nan | val_loss: nan | Time: 3255.11 ms
[2022-04-14 02:49:40	                main:574]	:	INFO	:	Epoch 1549 | loss: nan | val_loss: nan | Time: 3157.77 ms
[2022-04-14 02:49:43	                main:574]	:	INFO	:	Epoch 1550 | loss: nan | val_loss: nan | Time: 3096.91 ms
[2022-04-14 02:49:47	                main:574]	:	INFO	:	Epoch 1551 | loss: nan | val_loss: nan | Time: 4220.49 ms
[2022-04-14 02:49:50	                main:574]	:	INFO	:	Epoch 1552 | loss: nan | val_loss: nan | Time: 3236.6 ms
[2022-04-14 02:49:54	                main:574]	:	INFO	:	Epoch 1553 | loss: nan | val_loss: nan | Time: 3367.12 ms
[2022-04-14 02:49:57	                main:574]	:	INFO	:	Epoch 1554 | loss: nan | val_loss: nan | Time: 3301.89 ms
[2022-04-14 02:50:00	                main:574]	:	INFO	:	Epoch 1555 | loss: nan | val_loss: nan | Time: 3146.35 ms
[2022-04-14 02:50:04	                main:574]	:	INFO	:	Epoch 1556 | loss: nan | val_loss: nan | Time: 3741.98 ms
[2022-04-14 02:50:07	                main:574]	:	INFO	:	Epoch 1557 | loss: nan | val_loss: nan | Time: 3785.79 ms
[2022-04-14 02:50:11	                main:574]	:	INFO	:	Epoch 1558 | loss: nan | val_loss: nan | Time: 3575.7 ms
[2022-04-14 02:50:18	                main:574]	:	INFO	:	Epoch 1559 | loss: nan | val_loss: nan | Time: 7232.78 ms
[2022-04-14 02:50:25	                main:574]	:	INFO	:	Epoch 1560 | loss: nan | val_loss: nan | Time: 6996.59 ms
[2022-04-14 02:50:29	                main:574]	:	INFO	:	Epoch 1561 | loss: nan | val_loss: nan | Time: 3657.86 ms
[2022-04-14 02:50:32	                main:574]	:	INFO	:	Epoch 1562 | loss: nan | val_loss: nan | Time: 3261.78 ms
[2022-04-14 02:50:35	                main:574]	:	INFO	:	Epoch 1563 | loss: nan | val_loss: nan | Time: 3026.27 ms
[2022-04-14 02:50:40	                main:574]	:	INFO	:	Epoch 1564 | loss: nan | val_loss: nan | Time: 4147.75 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: Tesla V100-PCIE-32GB)
[2022-04-14 02:54:17	                main:435]	:	INFO	:	Set logging level to 1
[2022-04-14 02:54:17	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-04-14 02:54:17	                main:444]	:	INFO	:	Resolving all filenames
[2022-04-14 02:54:17	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-14 02:54:17	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-14 02:54:17	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-14 02:54:17	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-14 02:54:17	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-14 02:54:17	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-04-14 02:54:17	                main:474]	:	INFO	:	Configuration: 
[2022-04-14 02:54:17	                main:475]	:	INFO	:	    Model type: GRU
[2022-04-14 02:54:17	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-04-14 02:54:17	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-04-14 02:54:17	                main:478]	:	INFO	:	    Batch Size: 128
[2022-04-14 02:54:17	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-04-14 02:54:17	                main:480]	:	INFO	:	    Patience: 10
[2022-04-14 02:54:17	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-04-14 02:54:17	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-04-14 02:54:17	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-04-14 02:54:17	                main:484]	:	INFO	:	    # Threads: 1
[2022-04-14 02:54:17	                main:486]	:	INFO	:	Preparing Dataset
[2022-04-14 02:54:17	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-14 02:54:24	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-14 02:54:47	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-04-14 02:54:47	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-14 02:54:52	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-14 02:54:54	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-04-14 02:54:54	                main:494]	:	INFO	:	Creating Model
[2022-04-14 02:54:54	                main:507]	:	INFO	:	Preparing config file
[2022-04-14 02:54:54	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-04-14 02:54:54	                main:512]	:	INFO	:	Loading config


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FF8D9FCA839

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 04/14/22 02:54:55
Install Directory : D:\Program Files\BOINC\
Data Directory    : D:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( D:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( D:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( D:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( D:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: D:\ProgramData\BOINC\slots\1;D:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 0000000068cd0000 00000000003df000 D:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000dc2a0000 00000000001f0000 C:\Windows\SYSTEM32\ntdll.dll (6.2.18362.267) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000dba50000 00000000000b2000 C:\Windows\System32\KERNEL32.DLL (6.2.18362.86) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000d9f90000 00000000002a3000 C:\Windows\System32\KERNELBASE.dll (6.2.18362.267) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000c5d30000 0000000000058000 D:\ProgramData\BOINC\slots\1\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000d9e90000 00000000000fa000 C:\Windows\System32\ucrtbase.dll (6.2.18362.267) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.18362.267 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.267

ModLoad: 00000000c7640000 000000000008e000 C:\Windows\SYSTEM32\MSVCP140.dll (14.30.30704.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\3\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.30.30704.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Visual Studio?
    Product Version       : 14.30.30704.0

ModLoad: 00000000c4c20000 00000000001f4000 C:\Windows\SYSTEM32\dbghelp.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000c76d0000 000000000001b000 C:\Windows\SYSTEM32\VCRUNTIME140.dll (14.30.30704.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\3\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.30.30704.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Visual Studio?
    Product Version       : 14.30.30704.0

ModLoad: 00000000da960000 0000000000193000 C:\Windows\System32\USER32.dll (6.2.18362.267) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.18362.1914 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.1914

ModLoad: 00000000da2a0000 0000000000021000 C:\Windows\System32\win32u.dll (6.2.18362.267) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.18362.267 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.267

ModLoad: 00000000c7610000 000000000000c000 C:\Windows\SYSTEM32\VCRUNTIME140_1.dll (14.30.30704.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\3\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.30.30704.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Visual Studio?
    Product Version       : 14.30.30704.0

ModLoad: 00000000db840000 0000000000026000 C:\Windows\System32\GDI32.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000d9cf0000 0000000000194000 C:\Windows\System32\gdi32full.dll (6.2.18362.267) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.18362.267 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.267

ModLoad: 00000000d9b20000 000000000009e000 C:\Windows\System32\msvcp_win.dll (6.2.18362.267) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.18362.267 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.267

ModLoad: 00000000da740000 00000000000a3000 C:\Windows\System32\ADVAPI32.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.18362.1914 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.1914

ModLoad: 00000000da7f0000 000000000009e000 C:\Windows\System32\msvcrt.dll (7.0.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 7.0.18362.1

ModLoad: 00000000da8c0000 0000000000097000 C:\Windows\System32\sechost.dll (6.2.18362.267) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000db930000 0000000000120000 C:\Windows\System32\RPCRT4.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.18362.1914 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.1914

ModLoad: 000000005e970000 000000000abe7000 D:\ProgramData\BOINC\slots\1\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000c4e40000 000000000020d000 D:\ProgramData\BOINC\slots\1\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 00000000be650000 00000000002db000 D:\ProgramData\BOINC\slots\1\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000caa50000 0000000000040000 D:\ProgramData\BOINC\slots\1\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000069560000 0000000024b49000 D:\ProgramData\BOINC\slots\1\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000c5ce0000 0000000000045000 D:\ProgramData\BOINC\slots\1\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000005b8c0000 00000000030a5000 D:\ProgramData\BOINC\slots\1\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 000000008ffb0000 00000000034b2000 D:\ProgramData\BOINC\slots\1\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000cbd90000 0000000000010000 D:\ProgramData\BOINC\slots\1\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 0000000033610000 0000000003d5b000 D:\ProgramData\BOINC\slots\1\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 0000000037370000 000000000919f000 D:\ProgramData\BOINC\slots\1\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 0000000040510000 000000001b3a4000 D:\ProgramData\BOINC\slots\1\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 0000000031740000 0000000001eca000 D:\ProgramData\BOINC\slots\1\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000da2d0000 0000000000080000 C:\Windows\System32\bcryptPrimitives.dll (6.2.18362.267) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.18362.267 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.267

ModLoad: 00000000da890000 000000000002e000 C:\Windows\System32\IMM32.DLL (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000d9180000 0000000000011000 C:\Windows\System32\kernel.appcore.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000d7d50000 0000000000020000 C:\Windows\SYSTEM32\dxcore.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : DXCore.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000d9ca0000 000000000004a000 C:\Windows\System32\cfgmgr32.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000da350000 0000000000336000 C:\Windows\System32\combase.dll (6.2.18362.267) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000db290000 0000000000470000 C:\Windows\System32\Setupapi.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.18362.1914 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.1914

ModLoad: 00000000d9c70000 0000000000026000 C:\Windows\System32\bcrypt.dll (6.2.18362.267) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.18362.1914 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.1914

ModLoad: 00000000d8f20000 000000000002a000 C:\Windows\SYSTEM32\DEVOBJ.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000da240000 000000000005c000 C:\Windows\System32\WINTRUST.dll (6.2.18362.145) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.18362.145 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.145

ModLoad: 00000000d91c0000 0000000000012000 C:\Windows\System32\MSASN1.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000d9230000 0000000000149000 C:\Windows\System32\CRYPT32.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.18362.1914 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.1914

ModLoad: 00000000dbb70000 00000000006e2000 C:\Windows\System32\Shell32.dll (6.2.18362.267) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000da690000 00000000000a9000 C:\Windows\System32\shcore.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.18362.1914 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.1914

ModLoad: 00000000d93a0000 000000000077c000 C:\Windows\System32\windows.storage.dll (6.2.18362.267) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.18362.1914 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.1914

ModLoad: 00000000d91a0000 000000000001f000 C:\Windows\System32\profapi.dll (6.2.18362.1) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : profapi.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000d91e0000 000000000004a000 C:\Windows\System32\powrprof.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : powrprof.pdb
    File Version          : 10.0.18362.1914 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.1914

ModLoad: 00000000d9170000 0000000000010000 C:\Windows\System32\UMPDC.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : UMPDC.pdb

ModLoad: 00000000daf40000 0000000000052000 C:\Windows\System32\shlwapi.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.18362.1914 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.1914

ModLoad: 00000000d9380000 0000000000017000 C:\Windows\System32\cryptsp.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptsp.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000bca40000 00000000002b9000 C:\Windows\system32\nvcuda.dll (30.0.14.9613) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r495\r495_86\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 30.0.14.9613
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.5.56 driver
    Product Version       : 30.0.14.9613

ModLoad: 000000002e7d0000 0000000001679000 C:\Windows\system32\DriverStore\FileRepository\nv_dispui.inf_amd64_92502fed65f5873d\nvcuda64.dll (30.0.14.9613) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r495\r495_86\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 30.0.14.9613
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.5.56 driver
    Product Version       : 30.0.14.9613

ModLoad: 00000000d8d70000 000000000000a000 C:\Windows\SYSTEM32\VERSION.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000d23f0000 000000000002f000 C:\Windows\SYSTEM32\cryptnet.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000d2270000 0000000000134000 C:\Windows\SYSTEM32\drvstore.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : drvstore.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000d8bd0000 0000000000029000 C:\Windows\SYSTEM32\wldp.dll (6.2.18362.145) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.18362.1914 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.1914

ModLoad: 00000000d8b40000 000000000000c000 C:\Windows\SYSTEM32\cryptbase.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000bff20000 0000000000761000 C:\Windows\SYSTEM32\nvapi64.dll (30.0.14.9613) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r495\r495_86\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 30.0.14.9613
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 30.0.14.9613



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3609, Write: 307, Other 4088

- I/O Transfers Counters -
Read: 6625466, Write: 6045, Other 160636

- Paged Pool Usage -
QuotaPagedPoolUsage: 3394008, QuotaPeakPagedPoolUsage: 3394008
QuotaNonPagedPoolUsage: 6848800, QuotaPeakNonPagedPoolUsage: 6849000

- Virtual Memory Usage -
VirtualSize: -1835417600, PeakVirtualSize: -1338265600

- Pagefile Usage -
PagefileUsage: -1835417600, PeakPagefileUsage: -1835417600

- Working Set Size -
WorkingSetSize: 1276633088, PeakWorkingSetSize: 1276637184, PageFaultCount: 443532

*** Dump of thread ID 16496 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 17343750.000000, User Time: 32656250.000000, Wait Time: 24791796.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FF8D9FCA839

- Registers -
rax=00000000a6d15870 rbx=0000000069034910 rcx=00000000a6005d00 rdx=00000000dc2dc400 rsi=00000000a6d166d0 rdi=0000000019930520
r8=00000000c5d4edca r9=00000000f86eacd8 r10=0000000000000001 r11=0000000078948c19 r12=00000000dd571130 r13=00000000a6d168e0
r14=00000000fc27f020 r15=0000000000000000 rip=00000000d9fca839 rsp=00000000a6d16570 rbp=00000000a6d16860
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
a6d16640 68f4a884 00000040 0000004f dd570a00 f3c9cf60 KERNELBASE!RaiseException+0x0 
a6d166a0 68cf1ca6 000001a4 00002240 f3c9cf80 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
a6d16750 68cf593b 00000020 00000000 00000000 00000003 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
a6d168a0 68cf1a78 00000000 00000000 a6d16bd0 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
a6d16970 68cf1cfc a6d16bd0 00000000 00000080 a6d16ea0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
a6d16a30 68cfc4dd a6d16ea0 a6d16ea0 a6d16ea0 a6d16ea0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
a6d16d20 68ceb2fe a6d17338 a6d16ea0 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
a6d2fac0 68f2c6f8 b6dc5d80 00000000 00000000 b667fb70 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
a6d2fb00 dba67bd4 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
a6d2fb30 dc30ce71 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
a6d2fbb0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 61868 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 24789304.000000

- Registers -
rax=00000000000001cd rbx=00000000b4e794d0 rcx=0000000000000070 rdx=00000000b4e79150 rsi=00000000b4e74d20 rdi=00000000b4e794d0
r8=0000000000000008 r9=0000000000000001 r10=0000000000000140 r11=00000000b7039df0 r12=0000000000000000 r13=00000000b4e75070
r14=0000000000000001 r15=0000000000000000 rip=00000000dc33f9f4 rsp=00000000a70ff708 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
a70ff700 dc2d3ff0 00000000 00000000 b4e74d20 00000004 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
a70ffac0 dba67bd4 00000000 00000000 00000000 00000000 ntdll!RtlInitializeResource+0x0 
a70ffaf0 dc30ce71 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
a70ffb70 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 48132 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 625000.000000, User Time: 0.000000, Wait Time: 24789304.000000

- Registers -
rax=00000000000001cd rbx=00000000b4e79870 rcx=0000000000000070 rdx=00000000b4e794f0 rsi=00000000b4e74d20 rdi=00000000b4e79870
r8=00000000d8d74ffc r9=00000000a71ff610 r10=00000000d8d700f8 r11=0000000000000001 r12=0000000000000000 r13=00000000b4e75070
r14=0000000000000001 r15=0000000000000000 rip=00000000dc33f9f4 rsp=00000000a71ffb68 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
a71ffb60 dc2d3ff0 00000000 00000000 b4e74d20 00000006 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
a71fff20 dba67bd4 00000000 00000000 00000000 00000000 ntdll!RtlInitializeResource+0x0 
a71fff50 dc30ce71 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
a71fffd0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 62212 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 781250.000000, User Time: 0.000000, Wait Time: 24789304.000000

- Registers -
rax=00000000000001cd rbx=00000000b4e79ca0 rcx=0000000000000070 rdx=00000000b4e79920 rsi=00000000b4e74d20 rdi=00000000b4e79ca0
r8=000000000000030d r9=000000000000030d r10=00000000000002e9 r11=0000000000000331 r12=0000000000000000 r13=00000000b4e75070
r14=0000000000000001 r15=0000000000000000 rip=00000000dc33f9f4 rsp=00000000a72ff598 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
a72ff590 dc2d3ff0 00000000 00000000 b4e74d20 00000008 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
a72ff950 dba67bd4 00000000 00000000 00000000 00000000 ntdll!RtlInitializeResource+0x0 
a72ff980 dc30ce71 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
a72ffa00 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 33156 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 24791794.000000

- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000a74ffd40 rsi=0000000000000000 rdi=0000000000000064
r8=00000000a74ffd18 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000dc33c6e4 rsp=00000000a74ffd18 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
a74ffd10 d9fd6931 a74ffdd8 00000000 00000000 00000000 ntdll!ZwDelayExecution+0x0 
a74ffdb0 68d0a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0 
a74ffde0 dba67bd4 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
a74ffe10 dc30ce71 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
a74ffe90 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 59740 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 24791796.000000

- Registers -
rax=000000000000005b rbx=000000000000000f rcx=000000000000000f rdx=00000000a75ffb40 rsi=0000000000000000 rdi=000000000000000f
r8=00000000a75ff7d8 r9=00000000b6f993f0 r10=0000000000000000 r11=0000000000000246 r12=0000000000000064 r13=00000000a75ffb40
r14=00000000a75ff830 r15=0000000000000000 rip=00000000dc33cbb4 rsp=00000000a75ff7d8 rbp=00000000b6f993f0
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
a75ff7d0 d9fe7ff7 c0348510 dc3137f4 00000000 a6f69000 ntdll!NtWaitForMultipleObjects+0x0 
a75ffad0 d9fe7ede 2ed0f1b8 b4e85b00 0000000f 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
a75ffb10 2e9a5be4 b6f9d590 00000000 b6f96510 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
a75ffd50 2ea4d15d 00000000 b6f993f0 00000000 00000000 nvcuda64!+0x0 
a75ffe00 2e9a55b3 ec4b8a38 e38f6386 b780e7a0 00000000 nvcuda64!cuProfilerStop+0x0 
a75ffe30 2ecd4194 b780e7a0 00000000 00000000 00000000 nvcuda64!+0x0 
a75ffe60 dba67bd4 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
a75ffe90 dc30ce71 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
a75fff10 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 22844 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 24790906.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002c8 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002c8
r8=00000000a76ffae8 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=00000000b7025e50 r13=0000000000000000
r14=00000000000002c8 r15=0000000000000000 rip=00000000dc33c0e4 rsp=00000000a76ff868 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
a76ff860 d9fc8ba3 00000000 00001f80 00000000 00000000 ntdll!NtWaitForSingleObject+0x0 
a76ff900 2ebc95ee b780e140 00000000 00000000 000002c8 KERNELBASE!WaitForSingleObjectEx+0x0 
a76ffb40 2e9a55b3 00000000 b780e140 2e7d0000 b6fd14d0 nvcuda64!cuProfilerStop+0x0 
a76ffb70 2ecd4194 b780e140 00000000 00000000 00000000 nvcuda64!+0x0 
a76ffba0 dba67bd4 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
a76ffbd0 dc30ce71 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
a76ffc50 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)