Task 5145602

Name ParityModified-1619235688-20550-1_0
Workunit 3090744
Created 4 May 2021, 8:45:47 UTC
Sent 14 May 2021, 2:49:01 UTC
Report deadline 21 May 2021, 2:49:01 UTC
Received 15 May 2021, 20:20:53 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 1764
Run time 4 hours 24 min 50 sec
CPU time 4 hours 22 min 19 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 9,398.37 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.65 GB
Peak swap size 2.75 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
    main:574]	:	INFO	:	Epoch 1367 | loss: nan | val_loss: nan | Time: 9963.99 ms
[2021-05-15 13:34:59	                main:574]	:	INFO	:	Epoch 1368 | loss: nan | val_loss: nan | Time: 10012 ms
[2021-05-15 13:35:09	                main:574]	:	INFO	:	Epoch 1369 | loss: nan | val_loss: nan | Time: 9993.91 ms
[2021-05-15 13:35:19	                main:574]	:	INFO	:	Epoch 1370 | loss: nan | val_loss: nan | Time: 9940.73 ms
[2021-05-15 13:35:29	                main:574]	:	INFO	:	Epoch 1371 | loss: nan | val_loss: nan | Time: 9951.03 ms
[2021-05-15 13:35:39	                main:574]	:	INFO	:	Epoch 1372 | loss: nan | val_loss: nan | Time: 9947.86 ms
[2021-05-15 13:35:49	                main:574]	:	INFO	:	Epoch 1373 | loss: nan | val_loss: nan | Time: 9905.9 ms
[2021-05-15 13:35:59	                main:574]	:	INFO	:	Epoch 1374 | loss: nan | val_loss: nan | Time: 9878.63 ms
[2021-05-15 13:36:09	                main:574]	:	INFO	:	Epoch 1375 | loss: nan | val_loss: nan | Time: 9856.92 ms
[2021-05-15 13:36:19	                main:574]	:	INFO	:	Epoch 1376 | loss: nan | val_loss: nan | Time: 9886.93 ms
[2021-05-15 13:36:28	                main:574]	:	INFO	:	Epoch 1377 | loss: nan | val_loss: nan | Time: 9893 ms
[2021-05-15 13:36:38	                main:574]	:	INFO	:	Epoch 1378 | loss: nan | val_loss: nan | Time: 9924.88 ms
[2021-05-15 13:36:48	                main:574]	:	INFO	:	Epoch 1379 | loss: nan | val_loss: nan | Time: 9899.12 ms
[2021-05-15 13:36:58	                main:574]	:	INFO	:	Epoch 1380 | loss: nan | val_loss: nan | Time: 9863.93 ms
[2021-05-15 13:37:08	                main:574]	:	INFO	:	Epoch 1381 | loss: nan | val_loss: nan | Time: 9886.1 ms
[2021-05-15 13:37:18	                main:574]	:	INFO	:	Epoch 1382 | loss: nan | val_loss: nan | Time: 9895.18 ms
[2021-05-15 13:37:28	                main:574]	:	INFO	:	Epoch 1383 | loss: nan | val_loss: nan | Time: 9929.84 ms
[2021-05-15 13:37:38	                main:574]	:	INFO	:	Epoch 1384 | loss: nan | val_loss: nan | Time: 9883.48 ms
[2021-05-15 13:37:48	                main:574]	:	INFO	:	Epoch 1385 | loss: nan | val_loss: nan | Time: 9903.98 ms
[2021-05-15 13:37:58	                main:574]	:	INFO	:	Epoch 1386 | loss: nan | val_loss: nan | Time: 9947.6 ms
[2021-05-15 13:38:08	                main:574]	:	INFO	:	Epoch 1387 | loss: nan | val_loss: nan | Time: 9947.36 ms
[2021-05-15 13:38:18	                main:574]	:	INFO	:	Epoch 1388 | loss: nan | val_loss: nan | Time: 9935.72 ms
[2021-05-15 13:38:28	                main:574]	:	INFO	:	Epoch 1389 | loss: nan | val_loss: nan | Time: 9955.53 ms
[2021-05-15 13:38:37	                main:574]	:	INFO	:	Epoch 1390 | loss: nan | val_loss: nan | Time: 9902.3 ms
[2021-05-15 13:38:47	                main:574]	:	INFO	:	Epoch 1391 | loss: nan | val_loss: nan | Time: 9925.92 ms
[2021-05-15 13:38:57	                main:574]	:	INFO	:	Epoch 1392 | loss: nan | val_loss: nan | Time: 10006.9 ms
[2021-05-15 13:39:07	                main:574]	:	INFO	:	Epoch 1393 | loss: nan | val_loss: nan | Time: 9954.04 ms
[2021-05-15 13:39:17	                main:574]	:	INFO	:	Epoch 1394 | loss: nan | val_loss: nan | Time: 9956.12 ms
[2021-05-15 13:39:27	                main:574]	:	INFO	:	Epoch 1395 | loss: nan | val_loss: nan | Time: 9940.95 ms
[2021-05-15 13:39:37	                main:574]	:	INFO	:	Epoch 1396 | loss: nan | val_loss: nan | Time: 9923.12 ms
[2021-05-15 13:39:47	                main:574]	:	INFO	:	Epoch 1397 | loss: nan | val_loss: nan | Time: 9944.6 ms
[2021-05-15 13:39:57	                main:574]	:	INFO	:	Epoch 1398 | loss: nan | val_loss: nan | Time: 9933.75 ms
[2021-05-15 13:40:07	                main:574]	:	INFO	:	Epoch 1399 | loss: nan | val_loss: nan | Time: 9953.09 ms
[2021-05-15 13:40:17	                main:574]	:	INFO	:	Epoch 1400 | loss: nan | val_loss: nan | Time: 9901.21 ms
[2021-05-15 13:40:27	                main:574]	:	INFO	:	Epoch 1401 | loss: nan | val_loss: nan | Time: 9956.09 ms
[2021-05-15 13:40:37	                main:574]	:	INFO	:	Epoch 1402 | loss: nan | val_loss: nan | Time: 9969.66 ms
[2021-05-15 13:40:47	                main:574]	:	INFO	:	Epoch 1403 | loss: nan | val_loss: nan | Time: 9940.2 ms
[2021-05-15 13:40:57	                main:574]	:	INFO	:	Epoch 1404 | loss: nan | val_loss: nan | Time: 9985.51 ms
[2021-05-15 13:41:07	                main:574]	:	INFO	:	Epoch 1405 | loss: nan | val_loss: nan | Time: 9958.41 ms
[2021-05-15 13:41:17	                main:574]	:	INFO	:	Epoch 1406 | loss: nan | val_loss: nan | Time: 9952.88 ms
[2021-05-15 13:41:27	                main:574]	:	INFO	:	Epoch 1407 | loss: nan | val_loss: nan | Time: 9947.91 ms
[2021-05-15 13:41:37	                main:574]	:	INFO	:	Epoch 1408 | loss: nan | val_loss: nan | Time: 9937.93 ms
[2021-05-15 13:41:47	                main:574]	:	INFO	:	Epoch 1409 | loss: nan | val_loss: nan | Time: 9932.54 ms
[2021-05-15 13:41:57	                main:574]	:	INFO	:	Epoch 1410 | loss: nan | val_loss: nan | Time: 9934.29 ms
[2021-05-15 13:42:07	                main:574]	:	INFO	:	Epoch 1411 | loss: nan | val_loss: nan | Time: 9955.7 ms
[2021-05-15 13:42:17	                main:574]	:	INFO	:	Epoch 1412 | loss: nan | val_loss: nan | Time: 9936.11 ms
[2021-05-15 13:42:27	                main:574]	:	INFO	:	Epoch 1413 | loss: nan | val_loss: nan | Time: 9997.69 ms
[2021-05-15 13:42:37	                main:574]	:	INFO	:	Epoch 1414 | loss: nan | val_loss: nan | Time: 10016.1 ms
[2021-05-15 13:42:47	                main:574]	:	INFO	:	Epoch 1415 | loss: nan | val_loss: nan | Time: 9941.91 ms
[2021-05-15 13:42:57	                main:574]	:	INFO	:	Epoch 1416 | loss: nan | val_loss: nan | Time: 9993.46 ms
[2021-05-15 13:43:06	                main:574]	:	INFO	:	Epoch 1417 | loss: nan | val_loss: nan | Time: 9895.97 ms
[2021-05-15 13:43:16	                main:574]	:	INFO	:	Epoch 1418 | loss: nan | val_loss: nan | Time: 9794.38 ms
[2021-05-15 13:43:26	                main:574]	:	INFO	:	Epoch 1419 | loss: nan | val_loss: nan | Time: 9931.16 ms
[2021-05-15 13:43:36	                main:574]	:	INFO	:	Epoch 1420 | loss: nan | val_loss: nan | Time: 9958.51 ms
[2021-05-15 13:43:46	                main:574]	:	INFO	:	Epoch 1421 | loss: nan | val_loss: nan | Time: 10183.4 ms
[2021-05-15 13:43:56	                main:574]	:	INFO	:	Epoch 1422 | loss: nan | val_loss: nan | Time: 9878.96 ms
[2021-05-15 13:44:06	                main:574]	:	INFO	:	Epoch 1423 | loss: nan | val_loss: nan | Time: 9924.96 ms
[2021-05-15 13:44:16	                main:574]	:	INFO	:	Epoch 1424 | loss: nan | val_loss: nan | Time: 9909.78 ms
[2021-05-15 13:44:26	                main:574]	:	INFO	:	Epoch 1425 | loss: nan | val_loss: nan | Time: 9925.89 ms
[2021-05-15 13:44:36	                main:574]	:	INFO	:	Epoch 1426 | loss: nan | val_loss: nan | Time: 9983.4 ms
[2021-05-15 13:44:46	                main:574]	:	INFO	:	Epoch 1427 | loss: nan | val_loss: nan | Time: 10434.9 ms
[2021-05-15 13:44:57	                main:574]	:	INFO	:	Epoch 1428 | loss: nan | val_loss: nan | Time: 10194 ms
[2021-05-15 13:45:07	                main:574]	:	INFO	:	Epoch 1429 | loss: nan | val_loss: nan | Time: 10405.1 ms
[2021-05-15 13:45:17	                main:574]	:	INFO	:	Epoch 1430 | loss: nan | val_loss: nan | Time: 10149.6 ms
[2021-05-15 13:45:27	                main:574]	:	INFO	:	Epoch 1431 | loss: nan | val_loss: nan | Time: 10270.4 ms
[2021-05-15 13:45:38	                main:574]	:	INFO	:	Epoch 1432 | loss: nan | val_loss: nan | Time: 10177.6 ms
[2021-05-15 13:45:48	                main:574]	:	INFO	:	Epoch 1433 | loss: nan | val_loss: nan | Time: 10165.2 ms
[2021-05-15 13:45:58	                main:574]	:	INFO	:	Epoch 1434 | loss: nan | val_loss: nan | Time: 10122.6 ms
[2021-05-15 13:46:08	                main:574]	:	INFO	:	Epoch 1435 | loss: nan | val_loss: nan | Time: 10133.4 ms
[2021-05-15 13:46:18	                main:574]	:	INFO	:	Epoch 1436 | loss: nan | val_loss: nan | Time: 10064.9 ms
[2021-05-15 13:46:28	                main:574]	:	INFO	:	Epoch 1437 | loss: nan | val_loss: nan | Time: 10128.3 ms
[2021-05-15 13:46:39	                main:574]	:	INFO	:	Epoch 1438 | loss: nan | val_loss: nan | Time: 10260.8 ms
[2021-05-15 13:46:49	                main:574]	:	INFO	:	Epoch 1439 | loss: nan | val_loss: nan | Time: 10153.6 ms
[2021-05-15 13:46:59	                main:574]	:	INFO	:	Epoch 1440 | loss: nan | val_loss: nan | Time: 10185.3 ms
[2021-05-15 13:47:09	                main:574]	:	INFO	:	Epoch 1441 | loss: nan | val_loss: nan | Time: 10239.1 ms
[2021-05-15 13:47:20	                main:574]	:	INFO	:	Epoch 1442 | loss: nan | val_loss: nan | Time: 10299.5 ms
[2021-05-15 13:47:30	                main:574]	:	INFO	:	Epoch 1443 | loss: nan | val_loss: nan | Time: 10226.2 ms
[2021-05-15 13:47:40	                main:574]	:	INFO	:	Epoch 1444 | loss: nan | val_loss: nan | Time: 10247.5 ms
[2021-05-15 13:47:50	                main:574]	:	INFO	:	Epoch 1445 | loss: nan | val_loss: nan | Time: 10225.6 ms
[2021-05-15 13:48:01	                main:574]	:	INFO	:	Epoch 1446 | loss: nan | val_loss: nan | Time: 10239.4 ms
[2021-05-15 13:48:11	                main:574]	:	INFO	:	Epoch 1447 | loss: nan | val_loss: nan | Time: 10175.7 ms
[2021-05-15 13:48:21	                main:574]	:	INFO	:	Epoch 1448 | loss: nan | val_loss: nan | Time: 10174.1 ms
[2021-05-15 13:48:31	                main:574]	:	INFO	:	Epoch 1449 | loss: nan | val_loss: nan | Time: 10228.2 ms
[2021-05-15 13:48:42	                main:574]	:	INFO	:	Epoch 1450 | loss: nan | val_loss: nan | Time: 10252 ms
[2021-05-15 13:48:52	                main:574]	:	INFO	:	Epoch 1451 | loss: nan | val_loss: nan | Time: 10207 ms
[2021-05-15 13:49:02	                main:574]	:	INFO	:	Epoch 1452 | loss: nan | val_loss: nan | Time: 10111 ms
[2021-05-15 13:49:12	                main:574]	:	INFO	:	Epoch 1453 | loss: nan | val_loss: nan | Time: 10256.8 ms
[2021-05-15 13:49:22	                main:574]	:	INFO	:	Epoch 1454 | loss: nan | val_loss: nan | Time: 10176.7 ms
[2021-05-15 13:49:33	                main:574]	:	INFO	:	Epoch 1455 | loss: nan | val_loss: nan | Time: 10203.7 ms
[2021-05-15 13:49:43	                main:574]	:	INFO	:	Epoch 1456 | loss: nan | val_loss: nan | Time: 10150.3 ms
[2021-05-15 13:49:53	                main:574]	:	INFO	:	Epoch 1457 | loss: nan | val_loss: nan | Time: 10091.2 ms
[2021-05-15 13:50:03	                main:574]	:	INFO	:	Epoch 1458 | loss: nan | val_loss: nan | Time: 10060.1 ms
[2021-05-15 13:50:13	                main:574]	:	INFO	:	Epoch 1459 | loss: nan | val_loss: nan | Time: 10200.1 ms
[2021-05-15 13:50:23	                main:574]	:	INFO	:	Epoch 1460 | loss: nan | val_loss: nan | Time: 10222 ms
[2021-05-15 13:50:34	                main:574]	:	INFO	:	Epoch 1461 | loss: nan | val_loss: nan | Time: 10090.6 ms
[2021-05-15 13:50:44	                main:574]	:	INFO	:	Epoch 1462 | loss: nan | val_loss: nan | Time: 10261.2 ms
[2021-05-15 13:50:54	                main:574]	:	INFO	:	Epoch 1463 | loss: nan | val_loss: nan | Time: 10395.2 ms
[2021-05-15 13:51:05	                main:574]	:	INFO	:	Epoch 1464 | loss: nan | val_loss: nan | Time: 10381.8 ms
[2021-05-15 13:51:15	                main:574]	:	INFO	:	Epoch 1465 | loss: nan | val_loss: nan | Time: 10386.9 ms
[2021-05-15 13:51:25	                main:574]	:	INFO	:	Epoch 1466 | loss: nan | val_loss: nan | Time: 10502.3 ms
[2021-05-15 13:51:36	                main:574]	:	INFO	:	Epoch 1467 | loss: nan | val_loss: nan | Time: 10339.5 ms
[2021-05-15 13:51:46	                main:574]	:	INFO	:	Epoch 1468 | loss: nan | val_loss: nan | Time: 10183.7 ms
[2021-05-15 13:51:56	                main:574]	:	INFO	:	Epoch 1469 | loss: nan | val_loss: nan | Time: 10112.1 ms
[2021-05-15 13:52:06	                main:574]	:	INFO	:	Epoch 1470 | loss: nan | val_loss: nan | Time: 10085.6 ms
[2021-05-15 13:52:16	                main:574]	:	INFO	:	Epoch 1471 | loss: nan | val_loss: nan | Time: 10126.4 ms
[2021-05-15 13:52:27	                main:574]	:	INFO	:	Epoch 1472 | loss: nan | val_loss: nan | Time: 10231.9 ms
[2021-05-15 13:52:37	                main:574]	:	INFO	:	Epoch 1473 | loss: nan | val_loss: nan | Time: 10287.9 ms
[2021-05-15 13:52:47	                main:574]	:	INFO	:	Epoch 1474 | loss: nan | val_loss: nan | Time: 10073.3 ms
[2021-05-15 13:52:57	                main:574]	:	INFO	:	Epoch 1475 | loss: nan | val_loss: nan | Time: 10233.3 ms
[2021-05-15 13:53:08	                main:574]	:	INFO	:	Epoch 1476 | loss: nan | val_loss: nan | Time: 10328.8 ms
[2021-05-15 13:53:18	                main:574]	:	INFO	:	Epoch 1477 | loss: nan | val_loss: nan | Time: 10088.4 ms
[2021-05-15 13:53:28	                main:574]	:	INFO	:	Epoch 1478 | loss: nan | val_loss: nan | Time: 10162 ms
[2021-05-15 13:53:38	                main:574]	:	INFO	:	Epoch 1479 | loss: nan | val_loss: nan | Time: 10293.2 ms
[2021-05-15 13:53:48	                main:574]	:	INFO	:	Epoch 1480 | loss: nan | val_loss: nan | Time: 10207.1 ms
[2021-05-15 13:53:59	                main:574]	:	INFO	:	Epoch 1481 | loss: nan | val_loss: nan | Time: 10153.7 ms
[2021-05-15 13:54:09	                main:574]	:	INFO	:	Epoch 1482 | loss: nan | val_loss: nan | Time: 10088.4 ms
[2021-05-15 13:54:19	                main:574]	:	INFO	:	Epoch 1483 | loss: nan | val_loss: nan | Time: 10206.3 ms
[2021-05-15 13:54:29	                main:574]	:	INFO	:	Epoch 1484 | loss: nan | val_loss: nan | Time: 10222.2 ms
[2021-05-15 13:54:39	                main:574]	:	INFO	:	Epoch 1485 | loss: nan | val_loss: nan | Time: 10250.2 ms
[2021-05-15 13:54:50	                main:574]	:	INFO	:	Epoch 1486 | loss: nan | val_loss: nan | Time: 10258.4 ms
[2021-05-15 13:55:00	                main:574]	:	INFO	:	Epoch 1487 | loss: nan | val_loss: nan | Time: 10311.8 ms
[2021-05-15 13:55:10	                main:574]	:	INFO	:	Epoch 1488 | loss: nan | val_loss: nan | Time: 10402.4 ms
[2021-05-15 13:55:21	                main:574]	:	INFO	:	Epoch 1489 | loss: nan | val_loss: nan | Time: 10203.3 ms
[2021-05-15 13:55:31	                main:574]	:	INFO	:	Epoch 1490 | loss: nan | val_loss: nan | Time: 10403.4 ms
[2021-05-15 13:55:41	                main:574]	:	INFO	:	Epoch 1491 | loss: nan | val_loss: nan | Time: 10424.6 ms
[2021-05-15 13:55:52	                main:574]	:	INFO	:	Epoch 1492 | loss: nan | val_loss: nan | Time: 10429.1 ms
[2021-05-15 13:56:02	                main:574]	:	INFO	:	Epoch 1493 | loss: nan | val_loss: nan | Time: 10410 ms
[2021-05-15 13:56:13	                main:574]	:	INFO	:	Epoch 1494 | loss: nan | val_loss: nan | Time: 10352.3 ms
[2021-05-15 13:56:23	                main:574]	:	INFO	:	Epoch 1495 | loss: nan | val_loss: nan | Time: 10436.1 ms
[2021-05-15 13:56:33	                main:574]	:	INFO	:	Epoch 1496 | loss: nan | val_loss: nan | Time: 10425.6 ms
[2021-05-15 13:56:44	                main:574]	:	INFO	:	Epoch 1497 | loss: nan | val_loss: nan | Time: 10532.7 ms
[2021-05-15 13:56:55	                main:574]	:	INFO	:	Epoch 1498 | loss: nan | val_loss: nan | Time: 10553.5 ms
[2021-05-15 13:57:05	                main:574]	:	INFO	:	Epoch 1499 | loss: nan | val_loss: nan | Time: 10548.2 ms
[2021-05-15 13:57:15	                main:574]	:	INFO	:	Epoch 1500 | loss: nan | val_loss: nan | Time: 10294.5 ms
[2021-05-15 13:57:26	                main:574]	:	INFO	:	Epoch 1501 | loss: nan | val_loss: nan | Time: 10424.4 ms
[2021-05-15 13:57:36	                main:574]	:	INFO	:	Epoch 1502 | loss: nan | val_loss: nan | Time: 10420.6 ms
[2021-05-15 13:57:47	                main:574]	:	INFO	:	Epoch 1503 | loss: nan | val_loss: nan | Time: 10347.7 ms
[2021-05-15 13:57:57	                main:574]	:	INFO	:	Epoch 1504 | loss: nan | val_loss: nan | Time: 10469.5 ms
[2021-05-15 13:58:08	                main:574]	:	INFO	:	Epoch 1505 | loss: nan | val_loss: nan | Time: 10545.6 ms
[2021-05-15 13:58:18	                main:574]	:	INFO	:	Epoch 1506 | loss: nan | val_loss: nan | Time: 10346.7 ms
[2021-05-15 13:58:28	                main:574]	:	INFO	:	Epoch 1507 | loss: nan | val_loss: nan | Time: 10418.5 ms
[2021-05-15 13:58:39	                main:574]	:	INFO	:	Epoch 1508 | loss: nan | val_loss: nan | Time: 10548.4 ms
[2021-05-15 13:58:50	                main:574]	:	INFO	:	Epoch 1509 | loss: nan | val_loss: nan | Time: 10501.5 ms
[2021-05-15 13:59:00	                main:574]	:	INFO	:	Epoch 1510 | loss: nan | val_loss: nan | Time: 10436 ms
[2021-05-15 13:59:10	                main:574]	:	INFO	:	Epoch 1511 | loss: nan | val_loss: nan | Time: 10467.5 ms
[2021-05-15 13:59:21	                main:574]	:	INFO	:	Epoch 1512 | loss: nan | val_loss: nan | Time: 10552.6 ms
[2021-05-15 13:59:32	                main:574]	:	INFO	:	Epoch 1513 | loss: nan | val_loss: nan | Time: 10563.1 ms
[2021-05-15 13:59:42	                main:574]	:	INFO	:	Epoch 1514 | loss: nan | val_loss: nan | Time: 10533 ms
[2021-05-15 13:59:53	                main:574]	:	INFO	:	Epoch 1515 | loss: nan | val_loss: nan | Time: 10438.9 ms
[2021-05-15 14:00:03	                main:574]	:	INFO	:	Epoch 1516 | loss: nan | val_loss: nan | Time: 10334 ms
[2021-05-15 14:00:13	                main:574]	:	INFO	:	Epoch 1517 | loss: nan | val_loss: nan | Time: 10273.3 ms
[2021-05-15 14:00:24	                main:574]	:	INFO	:	Epoch 1518 | loss: nan | val_loss: nan | Time: 10425.2 ms
[2021-05-15 14:00:34	                main:574]	:	INFO	:	Epoch 1519 | loss: nan | val_loss: nan | Time: 10526.7 ms
[2021-05-15 14:00:45	                main:574]	:	INFO	:	Epoch 1520 | loss: nan | val_loss: nan | Time: 10508.4 ms
[2021-05-15 14:00:55	                main:574]	:	INFO	:	Epoch 1521 | loss: nan | val_loss: nan | Time: 10329 ms
[2021-05-15 14:01:05	                main:574]	:	INFO	:	Epoch 1522 | loss: nan | val_loss: nan | Time: 9995.14 ms
[2021-05-15 14:01:15	                main:574]	:	INFO	:	Epoch 1523 | loss: nan | val_loss: nan | Time: 9892.31 ms
[2021-05-15 14:01:25	                main:574]	:	INFO	:	Epoch 1524 | loss: nan | val_loss: nan | Time: 9917.88 ms
[2021-05-15 14:01:35	                main:574]	:	INFO	:	Epoch 1525 | loss: nan | val_loss: nan | Time: 9964.66 ms
[2021-05-15 14:01:45	                main:574]	:	INFO	:	Epoch 1526 | loss: nan | val_loss: nan | Time: 9907.82 ms
[2021-05-15 14:01:55	                main:574]	:	INFO	:	Epoch 1527 | loss: nan | val_loss: nan | Time: 9925.96 ms
[2021-05-15 14:02:05	                main:574]	:	INFO	:	Epoch 1528 | loss: nan | val_loss: nan | Time: 9949.7 ms
[2021-05-15 14:02:15	                main:574]	:	INFO	:	Epoch 1529 | loss: nan | val_loss: nan | Time: 9916.4 ms
[2021-05-15 14:02:25	                main:574]	:	INFO	:	Epoch 1530 | loss: nan | val_loss: nan | Time: 9940.23 ms
[2021-05-15 14:02:35	                main:574]	:	INFO	:	Epoch 1531 | loss: nan | val_loss: nan | Time: 9939.48 ms
[2021-05-15 14:02:44	                main:574]	:	INFO	:	Epoch 1532 | loss: nan | val_loss: nan | Time: 9891.83 ms
[2021-05-15 14:02:54	                main:574]	:	INFO	:	Epoch 1533 | loss: nan | val_loss: nan | Time: 9924.91 ms
[2021-05-15 14:03:04	                main:574]	:	INFO	:	Epoch 1534 | loss: nan | val_loss: nan | Time: 9919.74 ms
[2021-05-15 14:03:14	                main:574]	:	INFO	:	Epoch 1535 | loss: nan | val_loss: nan | Time: 9941.58 ms
[2021-05-15 14:03:24	                main:574]	:	INFO	:	Epoch 1536 | loss: nan | val_loss: nan | Time: 9981.91 ms
[2021-05-15 14:03:35	                main:574]	:	INFO	:	Epoch 1537 | loss: nan | val_loss: nan | Time: 10303.5 ms
[2021-05-15 14:03:45	                main:574]	:	INFO	:	Epoch 1538 | loss: nan | val_loss: nan | Time: 10279.3 ms
[2021-05-15 14:03:55	                main:574]	:	INFO	:	Epoch 1539 | loss: nan | val_loss: nan | Time: 10346.4 ms
[2021-05-15 14:04:05	                main:574]	:	INFO	:	Epoch 1540 | loss: nan | val_loss: nan | Time: 10109.8 ms
[2021-05-15 14:04:15	                main:574]	:	INFO	:	Epoch 1541 | loss: nan | val_loss: nan | Time: 9864.93 ms
[2021-05-15 14:04:25	                main:574]	:	INFO	:	Epoch 1542 | loss: nan | val_loss: nan | Time: 9935.32 ms
[2021-05-15 14:04:35	                main:574]	:	INFO	:	Epoch 1543 | loss: nan | val_loss: nan | Time: 9918.8 ms
[2021-05-15 14:04:45	                main:574]	:	INFO	:	Epoch 1544 | loss: nan | val_loss: nan | Time: 10027.1 ms
[2021-05-15 14:04:55	                main:574]	:	INFO	:	Epoch 1545 | loss: nan | val_loss: nan | Time: 10000.5 ms
[2021-05-15 14:05:05	                main:574]	:	INFO	:	Epoch 1546 | loss: nan | val_loss: nan | Time: 9976.85 ms
[2021-05-15 14:05:15	                main:574]	:	INFO	:	Epoch 1547 | loss: nan | val_loss: nan | Time: 10130.7 ms
[2021-05-15 14:05:25	                main:574]	:	INFO	:	Epoch 1548 | loss: nan | val_loss: nan | Time: 9989.58 ms
[2021-05-15 14:05:35	                main:574]	:	INFO	:	Epoch 1549 | loss: nan | val_loss: nan | Time: 10026.9 ms
[2021-05-15 14:05:45	                main:574]	:	INFO	:	Epoch 1550 | loss: nan | val_loss: nan | Time: 9954.05 ms
[2021-05-15 14:05:55	                main:574]	:	INFO	:	Epoch 1551 | loss: nan | val_loss: nan | Time: 9955.89 ms
[2021-05-15 14:06:05	                main:574]	:	INFO	:	Epoch 1552 | loss: nan | val_loss: nan | Time: 10017.9 ms
[2021-05-15 14:06:15	                main:574]	:	INFO	:	Epoch 1553 | loss: nan | val_loss: nan | Time: 9969.26 ms
[2021-05-15 14:06:25	                main:574]	:	INFO	:	Epoch 1554 | loss: nan | val_loss: nan | Time: 9994.72 ms
[2021-05-15 14:06:35	                main:574]	:	INFO	:	Epoch 1555 | loss: nan | val_loss: nan | Time: 9981.3 ms
[2021-05-15 14:06:45	                main:574]	:	INFO	:	Epoch 1556 | loss: nan | val_loss: nan | Time: 10043 ms
[2021-05-15 14:06:55	                main:574]	:	INFO	:	Epoch 1557 | loss: nan | val_loss: nan | Time: 9989.25 ms
[2021-05-15 14:07:05	                main:574]	:	INFO	:	Epoch 1558 | loss: nan | val_loss: nan | Time: 9987.89 ms
[2021-05-15 14:07:15	                main:574]	:	INFO	:	Epoch 1559 | loss: nan | val_loss: nan | Time: 9998.81 ms
[2021-05-15 14:07:25	                main:574]	:	INFO	:	Epoch 1560 | loss: nan | val_loss: nan | Time: 9988.29 ms
[2021-05-15 14:07:35	                main:574]	:	INFO	:	Epoch 1561 | loss: nan | val_loss: nan | Time: 9991.61 ms
[2021-05-15 14:07:45	                main:574]	:	INFO	:	Epoch 1562 | loss: nan | val_loss: nan | Time: 9962.33 ms
[2021-05-15 14:07:55	                main:574]	:	INFO	:	Epoch 1563 | loss: nan | val_loss: nan | Time: 9946.16 ms
[2021-05-15 14:08:05	                main:574]	:	INFO	:	Epoch 1564 | loss: nan | val_loss: nan | Time: 9932.58 ms
[2021-05-15 14:08:15	                main:574]	:	INFO	:	Epoch 1565 | loss: nan | val_loss: nan | Time: 9950.28 ms
[2021-05-15 14:08:25	                main:574]	:	INFO	:	Epoch 1566 | loss: nan | val_loss: nan | Time: 9995.03 ms
[2021-05-15 14:08:35	                main:574]	:	INFO	:	Epoch 1567 | loss: nan | val_loss: nan | Time: 9935.75 ms
[2021-05-15 14:08:45	                main:574]	:	INFO	:	Epoch 1568 | loss: nan | val_loss: nan | Time: 9960.07 ms
[2021-05-15 14:08:55	                main:574]	:	INFO	:	Epoch 1569 | loss: nan | val_loss: nan | Time: 10066.7 ms
[2021-05-15 14:09:05	                main:574]	:	INFO	:	Epoch 1570 | loss: nan | val_loss: nan | Time: 9968.24 ms
[2021-05-15 14:09:15	                main:574]	:	INFO	:	Epoch 1571 | loss: nan | val_loss: nan | Time: 9959.53 ms
[2021-05-15 14:09:25	                main:574]	:	INFO	:	Epoch 1572 | loss: nan | val_loss: nan | Time: 9980.53 ms
[2021-05-15 14:09:35	                main:574]	:	INFO	:	Epoch 1573 | loss: nan | val_loss: nan | Time: 9956.13 ms
[2021-05-15 14:09:45	                main:574]	:	INFO	:	Epoch 1574 | loss: nan | val_loss: nan | Time: 9964.04 ms
[2021-05-15 14:09:55	                main:574]	:	INFO	:	Epoch 1575 | loss: nan | val_loss: nan | Time: 9995.38 ms
[2021-05-15 14:10:05	                main:574]	:	INFO	:	Epoch 1576 | loss: nan | val_loss: nan | Time: 9987.74 ms
[2021-05-15 14:10:15	                main:574]	:	INFO	:	Epoch 1577 | loss: nan | val_loss: nan | Time: 10004.7 ms
[2021-05-15 14:10:25	                main:574]	:	INFO	:	Epoch 1578 | loss: nan | val_loss: nan | Time: 10068.7 ms
[2021-05-15 14:10:35	                main:574]	:	INFO	:	Epoch 1579 | loss: nan | val_loss: nan | Time: 9945.54 ms
[2021-05-15 14:10:45	                main:574]	:	INFO	:	Epoch 1580 | loss: nan | val_loss: nan | Time: 9978.7 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 1080)
[2021-05-15 14:19:54	                main:435]	:	INFO	:	Set logging level to 1
[2021-05-15 14:19:54	                main:441]	:	INFO	:	Running in BOINC Client mode
[2021-05-15 14:19:54	                main:444]	:	INFO	:	Resolving all filenames
[2021-05-15 14:19:54	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1)
[2021-05-15 14:19:54	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1619235688-20550-1_0_r1258696501_1 (exists = 1)
[2021-05-15 14:19:54	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1619235688-20550-1_0_r1258696501_0 (exists = 0)
[2021-05-15 14:19:54	                main:452]	:	INFO	:	Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1619235688-20550-1 (exists = 1)
[2021-05-15 14:19:54	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2021-05-15 14:19:54	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5
[2021-05-15 14:19:54	                main:474]	:	INFO	:	Configuration: 
[2021-05-15 14:19:54	                main:475]	:	INFO	:	    Model type: GRU
[2021-05-15 14:19:54	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2021-05-15 14:19:54	                main:477]	:	INFO	:	    Max Epochs: 2048
[2021-05-15 14:19:54	                main:478]	:	INFO	:	    Batch Size: 128
[2021-05-15 14:19:54	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2021-05-15 14:19:54	                main:480]	:	INFO	:	    Patience: 10
[2021-05-15 14:19:54	                main:481]	:	INFO	:	    Hidden Width: 12
[2021-05-15 14:19:54	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2021-05-15 14:19:54	                main:483]	:	INFO	:	    # Backend Layers: 4
[2021-05-15 14:19:54	                main:484]	:	INFO	:	    # Threads: 1
[2021-05-15 14:19:54	                main:486]	:	INFO	:	Preparing Dataset
[2021-05-15 14:19:54	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-05-15 14:19:55	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-05-15 14:19:57	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2021-05-15 14:19:57	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-05-15 14:19:58	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-05-15 14:19:58	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2021-05-15 14:19:58	                main:494]	:	INFO	:	Creating Model
[2021-05-15 14:19:58	                main:507]	:	INFO	:	Preparing config file
[2021-05-15 14:19:58	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2021-05-15 14:19:58	                main:512]	:	INFO	:	Loading config


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x000007FEFCD4B87D

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 05/15/21 14:19:58
Install Directory : D:\Program Files\BOINC\
Data Directory    : D:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( D:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( D:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( D:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( D:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: D:\ProgramData\BOINC\slots\0;D:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 000000003fa60000 00000000003df000 D:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000076ea0000 000000000019f000 C:\Windows\SYSTEM32\ntdll.dll (6.1.7601.24545) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000076c80000 000000000011f000 C:\Windows\system32\kernel32.dll (6.1.7601.24545) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 6.1.7601.17965 (win7sp1_gdr.121004-0333)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17965

ModLoad: 00000000fcd40000 0000000000067000 C:\Windows\system32\KERNELBASE.dll (6.1.7601.24545) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 6.1.7601.17965 (win7sp1_gdr.121004-0333)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17965

ModLoad: 00000000dfda0000 0000000000058000 D:\ProgramData\BOINC\slots\0\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000f86c0000 0000000000099000 C:\Windows\system32\MSVCP140.dll (14.24.28127.4) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.24.28127.4 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.24.28127.4

ModLoad: 00000000f86a0000 0000000000017000 C:\Windows\system32\VCRUNTIME140.dll (14.24.28127.4) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.24.28127.4 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.24.28127.4

ModLoad: 00000000f9b20000 0000000000004000 C:\Windows\system32\api-ms-win-crt-runtime-l1-1-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
    Linked PDB Filename   : api-ms-win-crt-runtime-l1-1-0.pdb
    File Version          : 10.0.14393.2990 (rs1_release_1.190410-1803)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.2990

ModLoad: 00000000f85a0000 00000000000f4000 C:\Windows\system32\ucrtbase.DLL (10.0.14393.2990) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.14393.2990 (rs1_release_1.190410-1803)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.2990

ModLoad: 00000000f95a0000 0000000000003000 C:\Windows\system32\api-ms-win-core-timezone-l1-1-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
    Linked PDB Filename   : api-ms-win-core-timezone-l1-1-0.pdb
    File Version          : 10.0.14393.2990 (rs1_release_1.190410-1803)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.2990

ModLoad: 00000000f9520000 0000000000003000 C:\Windows\system32\api-ms-win-core-file-l2-1-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
    Linked PDB Filename   : api-ms-win-core-file-l2-1-0.pdb
    File Version          : 10.0.14393.2990 (rs1_release_1.190410-1803)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.2990

ModLoad: 00000000f9490000 0000000000003000 C:\Windows\system32\api-ms-win-core-localization-l1-2-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
    Linked PDB Filename   : api-ms-win-core-localization-l1-2-0.pdb
    File Version          : 10.0.14393.2990 (rs1_release_1.190410-1803)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.2990

ModLoad: 00000000f9440000 0000000000003000 C:\Windows\system32\api-ms-win-core-synch-l1-2-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
    Linked PDB Filename   : api-ms-win-core-synch-l1-2-0.pdb
    File Version          : 10.0.14393.2990 (rs1_release_1.190410-1803)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.2990

ModLoad: 00000000f9330000 0000000000003000 C:\Windows\system32\api-ms-win-core-processthreads-l1-1-1.dll (10.0.14393.2990) (-exported- Symbols Loaded)
    Linked PDB Filename   : api-ms-win-core-processthreads-l1-1-1.pdb
    File Version          : 10.0.14393.2990 (rs1_release_1.190410-1803)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.2990

ModLoad: 00000000f9260000 0000000000003000 C:\Windows\system32\api-ms-win-core-file-l1-2-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
    Linked PDB Filename   : api-ms-win-core-file-l1-2-0.pdb
    File Version          : 10.0.14393.2990 (rs1_release_1.190410-1803)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.2990

ModLoad: 00000000f8cd0000 0000000000003000 C:\Windows\system32\api-ms-win-crt-heap-l1-1-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
    Linked PDB Filename   : api-ms-win-crt-heap-l1-1-0.pdb
    File Version          : 10.0.14393.2990 (rs1_release_1.190410-1803)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.2990

ModLoad: 00000000f8590000 0000000000004000 C:\Windows\system32\api-ms-win-crt-string-l1-1-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
    Linked PDB Filename   : api-ms-win-crt-string-l1-1-0.pdb
    File Version          : 10.0.14393.2990 (rs1_release_1.190410-1803)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.2990

ModLoad: 00000000f8580000 0000000000004000 C:\Windows\system32\api-ms-win-crt-stdio-l1-1-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
    Linked PDB Filename   : api-ms-win-crt-stdio-l1-1-0.pdb
    File Version          : 10.0.14393.2990 (rs1_release_1.190410-1803)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.2990

ModLoad: 00000000f8530000 0000000000004000 C:\Windows\system32\api-ms-win-crt-convert-l1-1-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
    Linked PDB Filename   : api-ms-win-crt-convert-l1-1-0.pdb
    File Version          : 10.0.14393.2990 (rs1_release_1.190410-1803)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.2990

ModLoad: 00000000f8520000 0000000000003000 C:\Windows\system32\api-ms-win-crt-locale-l1-1-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
    Linked PDB Filename   : api-ms-win-crt-locale-l1-1-0.pdb
    File Version          : 10.0.14393.2990 (rs1_release_1.190410-1803)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.2990

ModLoad: 00000000f8510000 0000000000003000 C:\Windows\system32\api-ms-win-crt-filesystem-l1-1-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
    Linked PDB Filename   : api-ms-win-crt-filesystem-l1-1-0.pdb
    File Version          : 10.0.14393.2990 (rs1_release_1.190410-1803)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.2990

ModLoad: 00000000f8500000 0000000000003000 C:\Windows\system32\api-ms-win-crt-time-l1-1-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
    Linked PDB Filename   : api-ms-win-crt-time-l1-1-0.pdb
    File Version          : 10.0.14393.2990 (rs1_release_1.190410-1803)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.2990

ModLoad: 00000000f84f0000 0000000000003000 C:\Windows\system32\api-ms-win-crt-environment-l1-1-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
    Linked PDB Filename   : api-ms-win-crt-environment-l1-1-0.pdb
    File Version          : 10.0.14393.2990 (rs1_release_1.190410-1803)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.2990

ModLoad: 00000000f84e0000 0000000000005000 C:\Windows\system32\api-ms-win-crt-math-l1-1-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
    Linked PDB Filename   : api-ms-win-crt-math-l1-1-0.pdb
    File Version          : 10.0.14393.2990 (rs1_release_1.190410-1803)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.2990

ModLoad: 00000000f84d0000 0000000000003000 C:\Windows\system32\api-ms-win-crt-utility-l1-1-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
    Linked PDB Filename   : api-ms-win-crt-utility-l1-1-0.pdb
    File Version          : 10.0.14393.2990 (rs1_release_1.190410-1803)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.2990

ModLoad: 00000000f6670000 0000000000125000 C:\Windows\system32\dbghelp.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 00000000fefc0000 000000000009f000 C:\Windows\system32\msvcrt.dll (7.0.7601.17744) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.7601.17744 (win7sp1_gdr.111215-1535)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.7601.17744

ModLoad: 00000000f4d50000 000000000000c000 C:\Windows\system32\VCRUNTIME140_1.dll (14.24.28127.4) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.24.28127.4 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.24.28127.4

ModLoad: 000000002cd60000 0000000024b49000 D:\ProgramData\BOINC\slots\0\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000e0150000 0000000000045000 D:\ProgramData\BOINC\slots\0\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000d72a0000 00000000030a5000 D:\ProgramData\BOINC\slots\0\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 000000009d500000 00000000034b2000 D:\ProgramData\BOINC\slots\0\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000119b0000 000000001b3a4000 D:\ProgramData\BOINC\slots\0\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 00000000fafb0000 0000000000010000 D:\ProgramData\BOINC\slots\0\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 000000006b810000 000000000abe7000 D:\ProgramData\BOINC\slots\0\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000dee20000 000000000020d000 D:\ProgramData\BOINC\slots\0\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 00000000dda90000 00000000002db000 D:\ProgramData\BOINC\slots\0\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000dfd60000 0000000000040000 D:\ProgramData\BOINC\slots\0\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000fafc0000 0000000000003000 C:\Windows\system32\api-ms-win-crt-process-l1-1-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
    Linked PDB Filename   : api-ms-win-crt-process-l1-1-0.pdb
    File Version          : 10.0.14393.2990 (rs1_release_1.190410-1803)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.14393.2990

ModLoad: 000000008be80000 000000000919f000 D:\ProgramData\BOINC\slots\0\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 0000000088120000 0000000003d5b000 D:\ProgramData\BOINC\slots\0\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000db530000 0000000001eca000 D:\ProgramData\BOINC\slots\0\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 0000000076da0000 00000000000fa000 C:\Windows\system32\USER32.dll (6.1.7601.24546) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 00000000fe7c0000 0000000000067000 C:\Windows\system32\GDI32.dll (6.1.7601.24540) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 6.1.7601.24540 (win7sp1_ldr_escrow.191127-1706)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.24540

ModLoad: 00000000fe1a0000 000000000000e000 C:\Windows\system32\LPK.dll (6.1.7601.24537) (-exported- Symbols Loaded)
    Linked PDB Filename   : lpk.pdb
    File Version          : 6.1.7601.24537 (win7sp1_ldr_escrow.191114-1547)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.24537

ModLoad: 00000000fe340000 00000000000cb000 C:\Windows\system32\USP10.dll (1.626.7601.24535) (-exported- Symbols Loaded)
    Linked PDB Filename   : usp10.pdb
    File Version          : 1.0626.7601.24535 (win7sp1_ldr_escrow.191105-1059)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft(R) Uniscribe Unicode script processor
    Product Version       : 1.0626.7601.24535

ModLoad: 00000000fe410000 00000000000db000 C:\Windows\system32\ADVAPI32.dll (6.1.7601.24545) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 6.1.7601.24545 (win7sp1_ldr_escrow.200102-1707)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.24545

ModLoad: 00000000fdea0000 000000000001f000 C:\Windows\SYSTEM32\sechost.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000fee20000 000000000012c000 C:\Windows\system32\RPCRT4.dll (6.1.7601.24545) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000fcdb0000 000000000002e000 C:\Windows\system32\IMM32.DLL (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000ff060000 000000000010b000 C:\Windows\system32\MSCTF.dll (6.1.7601.24520) (-exported- Symbols Loaded)
    Linked PDB Filename   : msctf.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000da440000 00000000010e7000 C:\Windows\system32\nvcuda.dll (26.21.14.4614) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r445\r445_85\drivers\gpgpu\_out\wddm_amd64_release\nvcuda.pdb
    File Version          : 26.21.14.4614
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.0.140 driver
    Product Version       : 26.21.14.4614

ModLoad: 00000000fbad0000 000000000000c000 C:\Windows\system32\VERSION.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000fd110000 0000000000d8b000 C:\Windows\system32\SHELL32.dll (6.1.7601.24468) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 00000000fdec0000 0000000000071000 C:\Windows\system32\SHLWAPI.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000fdfc0000 00000000001d7000 C:\Windows\system32\SETUPAPI.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000fcd00000 0000000000036000 C:\Windows\system32\CFGMGR32.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

Get Product Name Failed.
ModLoad: 00000000fce30000 00000000000db000 C:\Windows\system32\OLEAUT32.dll (6.1.7601.24537) (-exported- Symbols Loaded)
    Linked PDB Filename   : oleaut32.pdb
    File Version          : 6.1.7601.24537
    Company Name          : Microsoft Corporation
    Product Name          : 
    Product Version       : 6.1.7601.24537

ModLoad: 00000000fcf10000 00000000001ff000 C:\Windows\system32\ole32.dll (6.1.7601.24537) (-exported- Symbols Loaded)
    Linked PDB Filename   : ole32.pdb
    File Version          : 6.1.7601.24537 (win7sp1_ldr_escrow.191114-1547)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.24537

ModLoad: 00000000fcce0000 000000000001a000 C:\Windows\system32\DEVOBJ.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000fcde0000 000000000004d000 C:\Windows\system32\WS2_32.dll (6.1.7601.23451) (-exported- Symbols Loaded)
    Linked PDB Filename   : ws2_32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000fefb0000 0000000000008000 C:\Windows\system32\NSI.dll (6.1.7601.23889) (-exported- Symbols Loaded)
    Linked PDB Filename   : nsi.pdb
    File Version          : 6.1.7601.23889 (win7sp1_ldr.170810-1615)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.23889

ModLoad: 00000000e6da0000 00000000004c0000 C:\Windows\system32\nvapi64.dll (26.21.14.4614) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r445\r445_85\drivers\nvapi\gpu\_out\wddm_amd64_release\nvapi64.pdb
    File Version          : 26.21.14.4614
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 26.21.14.4614

ModLoad: 00000000f5ce0000 000000000005d000 C:\Windows\system32\dxgi.dll (6.2.9200.16492) (-exported- Symbols Loaded)
    Linked PDB Filename   : dxgi.pdb
    File Version          : 6.2.9200.16492 (win8_gdr_oobssr.130113-0015)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.2.9200.16492

ModLoad: 00000000fa6a0000 0000000000018000 C:\Windows\system32\dwmapi.dll (6.1.7601.18917) (-exported- Symbols Loaded)
    Linked PDB Filename   : dwmapi.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000e7470000 000000000009c000 C:\Windows\system32\mscms.dll (6.1.7601.24537) (-exported- Symbols Loaded)
    Linked PDB Filename   : mscms.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000fcab0000 000000000001f000 C:\Windows\system32\USERENV.dll (6.1.7601.24535) (-exported- Symbols Loaded)
    Linked PDB Filename   : userenv.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000fc9f0000 000000000000f000 C:\Windows\system32\profapi.dll (6.1.7600.16385) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : profapi.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000faf50000 0000000000056000 C:\Windows\system32\uxtheme.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : UxTheme.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000fcb10000 000000000003b000 C:\Windows\system32\WINTRUST.dll (6.1.7601.24542) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 6.1.7601.24542 (win7sp1_ldr_escrow.191209-2211)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.24542

ModLoad: 00000000fcb60000 000000000016d000 C:\Windows\system32\CRYPT32.dll (6.1.7601.24542) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 6.1.7601.24542 (win7sp1_ldr_escrow.191209-2211)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.24542

ModLoad: 00000000fca00000 000000000000f000 C:\Windows\system32\MSASN1.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3618, Write: 303, Other 2105

- I/O Transfers Counters -
Read: 6656736, Write: 7197, Other 27636

- Paged Pool Usage -
QuotaPagedPoolUsage: 28547440, QuotaPeakPagedPoolUsage: 28730672
QuotaNonPagedPoolUsage: 2444656, QuotaPeakNonPagedPoolUsage: 2444776

- Virtual Memory Usage -
VirtualSize: -1865355264, PeakVirtualSize: -1415507968

- Pagefile Usage -
PagefileUsage: -1865355264, PeakPagefileUsage: -1865318400

- Working Set Size -
WorkingSetSize: 1181880320, PeakWorkingSetSize: 1181880320, PageFaultCount: 399866

*** Dump of thread ID 13464 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 10920070.000000, User Time: 22620144.000000, Wait Time: 5444465.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x000007FEFCD4B87D

- Registers -
rax=0000000073d9ffd7 rbx=000000003fdc4910 rcx=00000000002a6340 rdx=00000000000000b8 rsi=00000000002a6aa0 rdi=0000000019930520
r8=0000000000000000 r9=0000000000000000 r10=000000003fa60000 r11=00000000002a6990 r12=0000000031bea5c0 r13=00000000002a6cb0
r14=000000003fd74170 r15=0000000000000000 rip=00000000fcd4b87d rsp=00000000002a6950 rbp=00000000002a6c30
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
002a6a10 3fcda884 3fdc4910 002a6a40 00000001 3fa60120 KERNELBASE!RaiseException+0x0 
002a6a70 3fa81ca6 00000000 0000317f 3f1afc78 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
002a6b20 3fa8593b 76ea3128 00000000 00000030 00420000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
002a6c70 3fa81a78 00000000 00000000 002a6fa0 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
002a6d40 3fa81cfc 002a6fa0 00000000 00000080 002a7270 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
002a6e00 3fa8c4dd 002a7270 002a7270 002a7270 002a7270 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
002a70f0 3fa7b2fe 002a7708 002a7270 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
002bfe90 3fcbc6f8 0262bc90 00000000 00000000 0265a080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
002bfed0 76c9556d 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
002bff00 76ef372d 00000000 00000000 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
002bff50 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 24652 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 5444463.000000

- Registers -
rax=0000000000000031 rbx=0000000000000000 rcx=0000000000000000 rdx=000000000562feb0 rsi=0000000000000064 rdi=0000000000000000
r8=000000000562fe88 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=000000000562feb0 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000076f09aea rsp=000000000562fe88 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
0562fe80 fcd41203 0562ff48 00000000 00000000 00000000 ntdll!ZwDelayExecution+0x0 
0562ff20 3fa9a07f 00000000 00000000 00000000 00000000 KERNELBASE!SleepEx+0x0 
0562ff50 76c9556d 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
0562ff80 76ef372d 00000000 00000000 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
0562ffd0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 19384 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 156001.000000, User Time: 0.000000, Wait Time: 5444462.000000

- Registers -
rax=0000000000000058 rbx=000000000f68f4f0 rcx=0000000000000008 rdx=000000000f68f460 rsi=0000000000000000 rdi=0000000000000008
r8=000000000f68f3b8 r9=0000000000000008 r10=0000000000000000 r11=000000000f68f530 r12=000000000f68f408 r13=000000000f68f460
r14=0000000000000000 r15=0000000000000064 rip=0000000076f09d5a rsp=000000000f68f3b8 rbp=0000000000000008
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
0f68f3b0 fcd41420 00000000 00000000 00000000 00000000 ntdll!ZwWaitForMultipleObjects+0x0 
0f68f4b0 76c90260 0f68f530 0f68f4f0 00000000 0f68f7c0 KERNELBASE!GetCurrentProcess+0x0 
0f68f540 da5b98f4 02859fe0 02887c30 00000008 01c29550 kernel32!WaitForMultipleObjects+0x0 
0f68f780 da642b08 00000064 00000000 02887c30 01c29550 nvcuda!+0x0 
0f68f830 da5b92c3 3e0c0b6a 3d98be60 03079710 00000000 nvcuda!cuProfilerStop+0x0 
0f68f860 da87c440 03079710 00000000 00000000 00000000 nvcuda!+0x0 
0f68f890 76c9556d 00000000 00000000 00000000 00000000 nvcuda!cuProfilerStop+0x0 
0f68f8c0 76ef372d 00000000 00000000 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
0f68f910 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 19924 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 5444328.000000

- Registers -
rax=0000000000000001 rbx=0000000000000000 rcx=0000000000000130 rdx=0000000000000000 rsi=00000000ffffffff rdi=0000000000000130
r8=000000000f79f7e8 r9=0000000000000000 r10=0000000000000000 r11=0000000000000203 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000076f097ea rsp=000000000f79f868 rbp=0000000000000001
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
0f79f860 fcd410dc 00000000 00000000 00000000 fcd410dc ntdll!NtWaitForSingleObject+0x0 
0f79f900 da79a317 00000000 0285b8e0 00000000 00000130 KERNELBASE!WaitForSingleObjectEx+0x0 
0f79f950 da5b92c3 00000000 03079920 00000000 da440000 nvcuda!cuProfilerStop+0x0 
0f79f980 da87c440 03079920 00000000 00000000 00000000 nvcuda!+0x0 
0f79f9b0 76c9556d 00000000 00000000 00000000 00000000 nvcuda!cuProfilerStop+0x0 
0f79f9e0 76ef372d 00000000 00000000 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
0f79fa30 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 21448 (state: Waiting): ***

- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 5444461.000000

- Registers -
rax=000000000000018c rbx=0000000000000000 rcx=0000000000000000 rdx=00000000130df6a0 rsi=0000000002ac9358 rdi=0000000000000000
r8=00000000130df678 r9=0000000002ac9328 r10=0000000000000000 r11=0000000000000246 r12=00000000130df728 r13=0000000000000000
r14=0000000000000001 r15=0000000002ac9328 rip=0000000076f0b09a rsp=00000000130df678 rbp=0000000002ac9328
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
130df670 76f60004 130df6a0 00000000 00000000 fcd410dc ntdll!ZwWaitForKeyedEvent+0x0 
130df6d0 76ccb3e8 02ac6b30 00000001 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0 
130df700 da54d04a 02ac6b30 00000000 60daa98f ffb3b4c0 kernel32!SleepConditionVariableCS+0x0 
130df760 da5b92c3 00000001 3dfee7b8 00000000 00000000 nvcuda!+0x0 
130df790 da87c440 03079c50 00000000 00000000 00000000 nvcuda!+0x0 
130df7c0 76c9556d 00000000 00000000 00000000 00000000 nvcuda!cuProfilerStop+0x0 
130df7f0 76ef372d 00000000 00000000 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
130df840 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...



©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)