Task 12193029

Name ParityModified-1645992650-8830-0_0
Workunit 9374210
Created 27 Feb 2022, 20:10:52 UTC
Sent 28 Feb 2022, 14:08:14 UTC
Report deadline 8 Mar 2022, 14:08:14 UTC
Received 1 Mar 2022, 8:49:37 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 571
Run time 2 hours 1 min 7 sec
CPU time 1 hours 52 min 1 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 5,441.63 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 2.10 GB
Peak swap size 4.34 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.14.2</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code -529697949 (0xe06d7363)</message>
<stderr_txt>
4890.88 ms
[2022-03-01 06:42:26	                main:574]	:	INFO	:	Epoch 1440 | loss: nan | val_loss: nan | Time: 4989.38 ms
[2022-03-01 06:42:30	                main:574]	:	INFO	:	Epoch 1441 | loss: nan | val_loss: nan | Time: 4242.79 ms
[2022-03-01 06:42:35	                main:574]	:	INFO	:	Epoch 1442 | loss: nan | val_loss: nan | Time: 4900.85 ms
[2022-03-01 06:42:39	                main:574]	:	INFO	:	Epoch 1443 | loss: nan | val_loss: nan | Time: 4169.87 ms
[2022-03-01 06:42:43	                main:574]	:	INFO	:	Epoch 1444 | loss: nan | val_loss: nan | Time: 3502.74 ms
[2022-03-01 06:42:47	                main:574]	:	INFO	:	Epoch 1445 | loss: nan | val_loss: nan | Time: 4133.38 ms
[2022-03-01 06:42:51	                main:574]	:	INFO	:	Epoch 1446 | loss: nan | val_loss: nan | Time: 4276.39 ms
[2022-03-01 06:42:55	                main:574]	:	INFO	:	Epoch 1447 | loss: nan | val_loss: nan | Time: 3395.06 ms
[2022-03-01 06:42:58	                main:574]	:	INFO	:	Epoch 1448 | loss: nan | val_loss: nan | Time: 3499.48 ms
[2022-03-01 06:43:02	                main:574]	:	INFO	:	Epoch 1449 | loss: nan | val_loss: nan | Time: 3379.98 ms
[2022-03-01 06:43:06	                main:574]	:	INFO	:	Epoch 1450 | loss: nan | val_loss: nan | Time: 4069.22 ms
[2022-03-01 06:43:10	                main:574]	:	INFO	:	Epoch 1451 | loss: nan | val_loss: nan | Time: 3646.88 ms
[2022-03-01 06:43:14	                main:574]	:	INFO	:	Epoch 1452 | loss: nan | val_loss: nan | Time: 4073.71 ms
[2022-03-01 06:43:18	                main:574]	:	INFO	:	Epoch 1453 | loss: nan | val_loss: nan | Time: 4059.86 ms
[2022-03-01 06:43:23	                main:574]	:	INFO	:	Epoch 1454 | loss: nan | val_loss: nan | Time: 5622.68 ms
[2022-03-01 06:43:27	                main:574]	:	INFO	:	Epoch 1455 | loss: nan | val_loss: nan | Time: 3492.81 ms
[2022-03-01 06:43:31	                main:574]	:	INFO	:	Epoch 1456 | loss: nan | val_loss: nan | Time: 4255.7 ms
[2022-03-01 06:43:37	                main:574]	:	INFO	:	Epoch 1457 | loss: nan | val_loss: nan | Time: 5356.64 ms
[2022-03-01 06:43:42	                main:574]	:	INFO	:	Epoch 1458 | loss: nan | val_loss: nan | Time: 5548.48 ms
[2022-03-01 06:43:47	                main:574]	:	INFO	:	Epoch 1459 | loss: nan | val_loss: nan | Time: 4700.31 ms
[2022-03-01 06:43:53	                main:574]	:	INFO	:	Epoch 1460 | loss: nan | val_loss: nan | Time: 5581.29 ms
[2022-03-01 06:43:58	                main:574]	:	INFO	:	Epoch 1461 | loss: nan | val_loss: nan | Time: 5145.55 ms
[2022-03-01 06:44:03	                main:574]	:	INFO	:	Epoch 1462 | loss: nan | val_loss: nan | Time: 5030.5 ms
[2022-03-01 06:44:08	                main:574]	:	INFO	:	Epoch 1463 | loss: nan | val_loss: nan | Time: 4737.61 ms
[2022-03-01 06:44:12	                main:574]	:	INFO	:	Epoch 1464 | loss: nan | val_loss: nan | Time: 4231.62 ms
[2022-03-01 06:44:17	                main:574]	:	INFO	:	Epoch 1465 | loss: nan | val_loss: nan | Time: 4914.92 ms
[2022-03-01 06:44:21	                main:574]	:	INFO	:	Epoch 1466 | loss: nan | val_loss: nan | Time: 4352.32 ms
[2022-03-01 06:44:25	                main:574]	:	INFO	:	Epoch 1467 | loss: nan | val_loss: nan | Time: 4086.2 ms
[2022-03-01 06:44:29	                main:574]	:	INFO	:	Epoch 1468 | loss: nan | val_loss: nan | Time: 3775.73 ms
[2022-03-01 06:44:33	                main:574]	:	INFO	:	Epoch 1469 | loss: nan | val_loss: nan | Time: 3336.35 ms
[2022-03-01 06:44:36	                main:574]	:	INFO	:	Epoch 1470 | loss: nan | val_loss: nan | Time: 3627.64 ms
[2022-03-01 06:44:40	                main:574]	:	INFO	:	Epoch 1471 | loss: nan | val_loss: nan | Time: 4042.25 ms
[2022-03-01 06:44:44	                main:574]	:	INFO	:	Epoch 1472 | loss: nan | val_loss: nan | Time: 3910.8 ms
[2022-03-01 06:44:48	                main:574]	:	INFO	:	Epoch 1473 | loss: nan | val_loss: nan | Time: 3875.55 ms
[2022-03-01 06:44:51	                main:574]	:	INFO	:	Epoch 1474 | loss: nan | val_loss: nan | Time: 3022.66 ms
[2022-03-01 06:44:56	                main:574]	:	INFO	:	Epoch 1475 | loss: nan | val_loss: nan | Time: 4142.59 ms
[2022-03-01 06:45:00	                main:574]	:	INFO	:	Epoch 1476 | loss: nan | val_loss: nan | Time: 3919.33 ms
[2022-03-01 06:45:04	                main:574]	:	INFO	:	Epoch 1477 | loss: nan | val_loss: nan | Time: 4704.52 ms
[2022-03-01 06:45:10	                main:574]	:	INFO	:	Epoch 1478 | loss: nan | val_loss: nan | Time: 5772.35 ms
[2022-03-01 06:45:13	                main:574]	:	INFO	:	Epoch 1479 | loss: nan | val_loss: nan | Time: 2788.14 ms
[2022-03-01 06:45:16	                main:574]	:	INFO	:	Epoch 1480 | loss: nan | val_loss: nan | Time: 3459.85 ms
[2022-03-01 06:45:20	                main:574]	:	INFO	:	Epoch 1481 | loss: nan | val_loss: nan | Time: 3661.79 ms
[2022-03-01 06:45:24	                main:574]	:	INFO	:	Epoch 1482 | loss: nan | val_loss: nan | Time: 3660.39 ms
[2022-03-01 06:45:28	                main:574]	:	INFO	:	Epoch 1483 | loss: nan | val_loss: nan | Time: 4020.91 ms
[2022-03-01 06:45:32	                main:574]	:	INFO	:	Epoch 1484 | loss: nan | val_loss: nan | Time: 4160.94 ms
[2022-03-01 06:45:36	                main:574]	:	INFO	:	Epoch 1485 | loss: nan | val_loss: nan | Time: 3846.82 ms
[2022-03-01 06:45:41	                main:574]	:	INFO	:	Epoch 1486 | loss: nan | val_loss: nan | Time: 4815.96 ms
[2022-03-01 06:45:46	                main:574]	:	INFO	:	Epoch 1487 | loss: nan | val_loss: nan | Time: 4710.96 ms
[2022-03-01 06:45:51	                main:574]	:	INFO	:	Epoch 1488 | loss: nan | val_loss: nan | Time: 4991.2 ms
[2022-03-01 06:45:56	                main:574]	:	INFO	:	Epoch 1489 | loss: nan | val_loss: nan | Time: 5361.44 ms
[2022-03-01 06:46:01	                main:574]	:	INFO	:	Epoch 1490 | loss: nan | val_loss: nan | Time: 4469.55 ms
[2022-03-01 06:46:05	                main:574]	:	INFO	:	Epoch 1491 | loss: nan | val_loss: nan | Time: 4780.7 ms
[2022-03-01 06:46:10	                main:574]	:	INFO	:	Epoch 1492 | loss: nan | val_loss: nan | Time: 4710.13 ms
[2022-03-01 06:46:15	                main:574]	:	INFO	:	Epoch 1493 | loss: nan | val_loss: nan | Time: 4597.54 ms
[2022-03-01 06:46:20	                main:574]	:	INFO	:	Epoch 1494 | loss: nan | val_loss: nan | Time: 4698.68 ms
[2022-03-01 06:46:24	                main:574]	:	INFO	:	Epoch 1495 | loss: nan | val_loss: nan | Time: 4597.46 ms
[2022-03-01 06:46:29	                main:574]	:	INFO	:	Epoch 1496 | loss: nan | val_loss: nan | Time: 4698.48 ms
[2022-03-01 06:46:34	                main:574]	:	INFO	:	Epoch 1497 | loss: nan | val_loss: nan | Time: 5403.07 ms
[2022-03-01 06:46:39	                main:574]	:	INFO	:	Epoch 1498 | loss: nan | val_loss: nan | Time: 4808.46 ms
[2022-03-01 06:46:44	                main:574]	:	INFO	:	Epoch 1499 | loss: nan | val_loss: nan | Time: 4814.42 ms
[2022-03-01 06:46:49	                main:574]	:	INFO	:	Epoch 1500 | loss: nan | val_loss: nan | Time: 4488 ms
[2022-03-01 06:46:53	                main:574]	:	INFO	:	Epoch 1501 | loss: nan | val_loss: nan | Time: 3947.12 ms
[2022-03-01 06:46:57	                main:574]	:	INFO	:	Epoch 1502 | loss: nan | val_loss: nan | Time: 3907.53 ms
[2022-03-01 06:47:01	                main:574]	:	INFO	:	Epoch 1503 | loss: nan | val_loss: nan | Time: 4244.11 ms
[2022-03-01 06:47:06	                main:574]	:	INFO	:	Epoch 1504 | loss: nan | val_loss: nan | Time: 5365.53 ms
[2022-03-01 06:47:11	                main:574]	:	INFO	:	Epoch 1505 | loss: nan | val_loss: nan | Time: 4902.3 ms
[2022-03-01 06:47:17	                main:574]	:	INFO	:	Epoch 1506 | loss: nan | val_loss: nan | Time: 5414.3 ms
[2022-03-01 06:47:22	                main:574]	:	INFO	:	Epoch 1507 | loss: nan | val_loss: nan | Time: 5069.38 ms
[2022-03-01 06:47:27	                main:574]	:	INFO	:	Epoch 1508 | loss: nan | val_loss: nan | Time: 4896.16 ms
[2022-03-01 06:47:31	                main:574]	:	INFO	:	Epoch 1509 | loss: nan | val_loss: nan | Time: 3914.52 ms
[2022-03-01 06:47:35	                main:574]	:	INFO	:	Epoch 1510 | loss: nan | val_loss: nan | Time: 4322.77 ms
[2022-03-01 06:47:39	                main:574]	:	INFO	:	Epoch 1511 | loss: nan | val_loss: nan | Time: 3692.84 ms
[2022-03-01 06:47:43	                main:574]	:	INFO	:	Epoch 1512 | loss: nan | val_loss: nan | Time: 3549.33 ms
[2022-03-01 06:47:48	                main:574]	:	INFO	:	Epoch 1513 | loss: nan | val_loss: nan | Time: 4975.2 ms
[2022-03-01 06:47:52	                main:574]	:	INFO	:	Epoch 1514 | loss: nan | val_loss: nan | Time: 4194.09 ms
[2022-03-01 06:47:57	                main:574]	:	INFO	:	Epoch 1515 | loss: nan | val_loss: nan | Time: 4734.41 ms
[2022-03-01 06:48:01	                main:574]	:	INFO	:	Epoch 1516 | loss: nan | val_loss: nan | Time: 4545.84 ms
[2022-03-01 06:48:07	                main:574]	:	INFO	:	Epoch 1517 | loss: nan | val_loss: nan | Time: 5064.88 ms
[2022-03-01 06:48:12	                main:574]	:	INFO	:	Epoch 1518 | loss: nan | val_loss: nan | Time: 5346.26 ms
[2022-03-01 06:48:17	                main:574]	:	INFO	:	Epoch 1519 | loss: nan | val_loss: nan | Time: 4947.16 ms
[2022-03-01 06:48:22	                main:574]	:	INFO	:	Epoch 1520 | loss: nan | val_loss: nan | Time: 4901.48 ms
[2022-03-01 06:48:27	                main:574]	:	INFO	:	Epoch 1521 | loss: nan | val_loss: nan | Time: 5138.1 ms
[2022-03-01 06:48:32	                main:574]	:	INFO	:	Epoch 1522 | loss: nan | val_loss: nan | Time: 4448.95 ms
[2022-03-01 06:48:37	                main:574]	:	INFO	:	Epoch 1523 | loss: nan | val_loss: nan | Time: 5399.03 ms
[2022-03-01 06:48:43	                main:574]	:	INFO	:	Epoch 1524 | loss: nan | val_loss: nan | Time: 5504.66 ms
[2022-03-01 06:48:48	                main:574]	:	INFO	:	Epoch 1525 | loss: nan | val_loss: nan | Time: 5536.7 ms
[2022-03-01 06:48:52	                main:574]	:	INFO	:	Epoch 1526 | loss: nan | val_loss: nan | Time: 4310.75 ms
[2022-03-01 06:48:56	                main:574]	:	INFO	:	Epoch 1527 | loss: nan | val_loss: nan | Time: 3323.49 ms
[2022-03-01 06:49:00	                main:574]	:	INFO	:	Epoch 1528 | loss: nan | val_loss: nan | Time: 3782.52 ms
[2022-03-01 06:49:04	                main:574]	:	INFO	:	Epoch 1529 | loss: nan | val_loss: nan | Time: 4473.25 ms
[2022-03-01 06:49:08	                main:574]	:	INFO	:	Epoch 1530 | loss: nan | val_loss: nan | Time: 4303.98 ms
[2022-03-01 06:49:14	                main:574]	:	INFO	:	Epoch 1531 | loss: nan | val_loss: nan | Time: 5012.07 ms
[2022-03-01 06:49:19	                main:574]	:	INFO	:	Epoch 1532 | loss: nan | val_loss: nan | Time: 5109.15 ms
[2022-03-01 06:49:24	                main:574]	:	INFO	:	Epoch 1533 | loss: nan | val_loss: nan | Time: 5070.56 ms
[2022-03-01 06:49:29	                main:574]	:	INFO	:	Epoch 1534 | loss: nan | val_loss: nan | Time: 5466.84 ms
[2022-03-01 06:49:34	                main:574]	:	INFO	:	Epoch 1535 | loss: nan | val_loss: nan | Time: 4645.07 ms
[2022-03-01 06:49:38	                main:574]	:	INFO	:	Epoch 1536 | loss: nan | val_loss: nan | Time: 4308.27 ms
[2022-03-01 06:49:42	                main:574]	:	INFO	:	Epoch 1537 | loss: nan | val_loss: nan | Time: 3663.62 ms
[2022-03-01 06:49:48	                main:574]	:	INFO	:	Epoch 1538 | loss: nan | val_loss: nan | Time: 5600.91 ms
[2022-03-01 06:49:52	                main:574]	:	INFO	:	Epoch 1539 | loss: nan | val_loss: nan | Time: 4117.13 ms
[2022-03-01 06:49:56	                main:574]	:	INFO	:	Epoch 1540 | loss: nan | val_loss: nan | Time: 3713.43 ms
[2022-03-01 06:49:59	                main:574]	:	INFO	:	Epoch 1541 | loss: nan | val_loss: nan | Time: 3592.41 ms
[2022-03-01 06:50:02	                main:574]	:	INFO	:	Epoch 1542 | loss: nan | val_loss: nan | Time: 3031.72 ms
[2022-03-01 06:50:06	                main:574]	:	INFO	:	Epoch 1543 | loss: nan | val_loss: nan | Time: 3722.01 ms
[2022-03-01 06:50:10	                main:574]	:	INFO	:	Epoch 1544 | loss: nan | val_loss: nan | Time: 3658.73 ms
[2022-03-01 06:50:14	                main:574]	:	INFO	:	Epoch 1545 | loss: nan | val_loss: nan | Time: 3796.52 ms
[2022-03-01 06:50:17	                main:574]	:	INFO	:	Epoch 1546 | loss: nan | val_loss: nan | Time: 3302.35 ms
[2022-03-01 06:50:22	                main:574]	:	INFO	:	Epoch 1547 | loss: nan | val_loss: nan | Time: 4771.36 ms
[2022-03-01 06:50:27	                main:574]	:	INFO	:	Epoch 1548 | loss: nan | val_loss: nan | Time: 5155.59 ms
[2022-03-01 06:50:32	                main:574]	:	INFO	:	Epoch 1549 | loss: nan | val_loss: nan | Time: 4773.65 ms
[2022-03-01 06:50:36	                main:574]	:	INFO	:	Epoch 1550 | loss: nan | val_loss: nan | Time: 4316.51 ms
[2022-03-01 06:50:41	                main:574]	:	INFO	:	Epoch 1551 | loss: nan | val_loss: nan | Time: 5051.5 ms
[2022-03-01 06:50:45	                main:574]	:	INFO	:	Epoch 1552 | loss: nan | val_loss: nan | Time: 3903.21 ms
[2022-03-01 06:50:49	                main:574]	:	INFO	:	Epoch 1553 | loss: nan | val_loss: nan | Time: 3317.97 ms
[2022-03-01 06:50:53	                main:574]	:	INFO	:	Epoch 1554 | loss: nan | val_loss: nan | Time: 4039.47 ms
[2022-03-01 06:50:57	                main:574]	:	INFO	:	Epoch 1555 | loss: nan | val_loss: nan | Time: 4404.29 ms
[2022-03-01 06:51:02	                main:574]	:	INFO	:	Epoch 1556 | loss: nan | val_loss: nan | Time: 4640.17 ms
[2022-03-01 06:51:06	                main:574]	:	INFO	:	Epoch 1557 | loss: nan | val_loss: nan | Time: 4425.46 ms
[2022-03-01 06:51:11	                main:574]	:	INFO	:	Epoch 1558 | loss: nan | val_loss: nan | Time: 4394.57 ms
[2022-03-01 06:51:15	                main:574]	:	INFO	:	Epoch 1559 | loss: nan | val_loss: nan | Time: 4381.4 ms
[2022-03-01 06:51:20	                main:574]	:	INFO	:	Epoch 1560 | loss: nan | val_loss: nan | Time: 4390.31 ms
[2022-03-01 06:51:24	                main:574]	:	INFO	:	Epoch 1561 | loss: nan | val_loss: nan | Time: 4009.02 ms
[2022-03-01 06:51:27	                main:574]	:	INFO	:	Epoch 1562 | loss: nan | val_loss: nan | Time: 3610.46 ms
[2022-03-01 06:51:30	                main:574]	:	INFO	:	Epoch 1563 | loss: nan | val_loss: nan | Time: 2971 ms
[2022-03-01 06:51:33	                main:574]	:	INFO	:	Epoch 1564 | loss: nan | val_loss: nan | Time: 3059.61 ms
[2022-03-01 06:51:37	                main:574]	:	INFO	:	Epoch 1565 | loss: nan | val_loss: nan | Time: 3113.73 ms
[2022-03-01 06:51:39	                main:574]	:	INFO	:	Epoch 1566 | loss: nan | val_loss: nan | Time: 2847.83 ms
[2022-03-01 06:51:43	                main:574]	:	INFO	:	Epoch 1567 | loss: nan | val_loss: nan | Time: 3057.01 ms
[2022-03-01 06:51:46	                main:574]	:	INFO	:	Epoch 1568 | loss: nan | val_loss: nan | Time: 3217.52 ms
[2022-03-01 06:51:49	                main:574]	:	INFO	:	Epoch 1569 | loss: nan | val_loss: nan | Time: 3071.53 ms
[2022-03-01 06:51:52	                main:574]	:	INFO	:	Epoch 1570 | loss: nan | val_loss: nan | Time: 3291.27 ms
[2022-03-01 06:51:55	                main:574]	:	INFO	:	Epoch 1571 | loss: nan | val_loss: nan | Time: 3037.88 ms
[2022-03-01 06:51:58	                main:574]	:	INFO	:	Epoch 1572 | loss: nan | val_loss: nan | Time: 2950.74 ms
[2022-03-01 06:52:01	                main:574]	:	INFO	:	Epoch 1573 | loss: nan | val_loss: nan | Time: 2993.3 ms
[2022-03-01 06:52:04	                main:574]	:	INFO	:	Epoch 1574 | loss: nan | val_loss: nan | Time: 2853.57 ms
[2022-03-01 06:52:07	                main:574]	:	INFO	:	Epoch 1575 | loss: nan | val_loss: nan | Time: 2929.54 ms
[2022-03-01 06:52:10	                main:574]	:	INFO	:	Epoch 1576 | loss: nan | val_loss: nan | Time: 2855.14 ms
[2022-03-01 06:52:13	                main:574]	:	INFO	:	Epoch 1577 | loss: nan | val_loss: nan | Time: 2657.33 ms
[2022-03-01 06:52:16	                main:574]	:	INFO	:	Epoch 1578 | loss: nan | val_loss: nan | Time: 2876.36 ms
[2022-03-01 06:52:19	                main:574]	:	INFO	:	Epoch 1579 | loss: nan | val_loss: nan | Time: 2972.1 ms
[2022-03-01 06:52:22	                main:574]	:	INFO	:	Epoch 1580 | loss: nan | val_loss: nan | Time: 3016.13 ms
[2022-03-01 06:52:25	                main:574]	:	INFO	:	Epoch 1581 | loss: nan | val_loss: nan | Time: 2904.51 ms
[2022-03-01 06:52:28	                main:574]	:	INFO	:	Epoch 1582 | loss: nan | val_loss: nan | Time: 2790.34 ms
[2022-03-01 06:52:31	                main:574]	:	INFO	:	Epoch 1583 | loss: nan | val_loss: nan | Time: 2884.15 ms
[2022-03-01 06:52:33	                main:574]	:	INFO	:	Epoch 1584 | loss: nan | val_loss: nan | Time: 2827.59 ms
[2022-03-01 06:52:36	                main:574]	:	INFO	:	Epoch 1585 | loss: nan | val_loss: nan | Time: 2730.79 ms
[2022-03-01 06:52:39	                main:574]	:	INFO	:	Epoch 1586 | loss: nan | val_loss: nan | Time: 2659.71 ms
[2022-03-01 06:52:42	                main:574]	:	INFO	:	Epoch 1587 | loss: nan | val_loss: nan | Time: 2668.08 ms
[2022-03-01 06:52:44	                main:574]	:	INFO	:	Epoch 1588 | loss: nan | val_loss: nan | Time: 2668.86 ms
[2022-03-01 06:52:47	                main:574]	:	INFO	:	Epoch 1589 | loss: nan | val_loss: nan | Time: 2747.71 ms
[2022-03-01 06:52:50	                main:574]	:	INFO	:	Epoch 1590 | loss: nan | val_loss: nan | Time: 2820.03 ms
[2022-03-01 06:52:53	                main:574]	:	INFO	:	Epoch 1591 | loss: nan | val_loss: nan | Time: 2870 ms
[2022-03-01 06:52:56	                main:574]	:	INFO	:	Epoch 1592 | loss: nan | val_loss: nan | Time: 2825.24 ms
[2022-03-01 06:52:59	                main:574]	:	INFO	:	Epoch 1593 | loss: nan | val_loss: nan | Time: 2825.49 ms
[2022-03-01 06:53:01	                main:574]	:	INFO	:	Epoch 1594 | loss: nan | val_loss: nan | Time: 2762.66 ms
[2022-03-01 06:53:04	                main:574]	:	INFO	:	Epoch 1595 | loss: nan | val_loss: nan | Time: 2713.91 ms
[2022-03-01 06:53:07	                main:574]	:	INFO	:	Epoch 1596 | loss: nan | val_loss: nan | Time: 3155.19 ms
[2022-03-01 06:53:10	                main:574]	:	INFO	:	Epoch 1597 | loss: nan | val_loss: nan | Time: 2990.57 ms
[2022-03-01 06:53:13	                main:574]	:	INFO	:	Epoch 1598 | loss: nan | val_loss: nan | Time: 2898.73 ms
[2022-03-01 06:53:16	                main:574]	:	INFO	:	Epoch 1599 | loss: nan | val_loss: nan | Time: 3019.22 ms
[2022-03-01 06:53:20	                main:574]	:	INFO	:	Epoch 1600 | loss: nan | val_loss: nan | Time: 3153.9 ms
[2022-03-01 06:53:23	                main:574]	:	INFO	:	Epoch 1601 | loss: nan | val_loss: nan | Time: 3218.11 ms
[2022-03-01 06:53:26	                main:574]	:	INFO	:	Epoch 1602 | loss: nan | val_loss: nan | Time: 3177.52 ms
[2022-03-01 06:53:29	                main:574]	:	INFO	:	Epoch 1603 | loss: nan | val_loss: nan | Time: 3234.69 ms
[2022-03-01 06:53:34	                main:574]	:	INFO	:	Epoch 1604 | loss: nan | val_loss: nan | Time: 4338.52 ms
[2022-03-01 06:53:38	                main:574]	:	INFO	:	Epoch 1605 | loss: nan | val_loss: nan | Time: 4000.28 ms
[2022-03-01 06:53:41	                main:574]	:	INFO	:	Epoch 1606 | loss: nan | val_loss: nan | Time: 2990.49 ms
[2022-03-01 06:53:44	                main:574]	:	INFO	:	Epoch 1607 | loss: nan | val_loss: nan | Time: 2976.35 ms
[2022-03-01 06:53:47	                main:574]	:	INFO	:	Epoch 1608 | loss: nan | val_loss: nan | Time: 3111.11 ms
[2022-03-01 06:53:50	                main:574]	:	INFO	:	Epoch 1609 | loss: nan | val_loss: nan | Time: 2994.73 ms
[2022-03-01 06:53:53	                main:574]	:	INFO	:	Epoch 1610 | loss: nan | val_loss: nan | Time: 3016.23 ms
[2022-03-01 06:53:56	                main:574]	:	INFO	:	Epoch 1611 | loss: nan | val_loss: nan | Time: 2868.5 ms
[2022-03-01 06:53:59	                main:574]	:	INFO	:	Epoch 1612 | loss: nan | val_loss: nan | Time: 3448.64 ms
[2022-03-01 06:54:03	                main:574]	:	INFO	:	Epoch 1613 | loss: nan | val_loss: nan | Time: 3663.68 ms
[2022-03-01 06:54:07	                main:574]	:	INFO	:	Epoch 1614 | loss: nan | val_loss: nan | Time: 3470.18 ms
[2022-03-01 06:54:10	                main:574]	:	INFO	:	Epoch 1615 | loss: nan | val_loss: nan | Time: 3493 ms
[2022-03-01 06:54:14	                main:574]	:	INFO	:	Epoch 1616 | loss: nan | val_loss: nan | Time: 3404.86 ms
[2022-03-01 06:54:17	                main:574]	:	INFO	:	Epoch 1617 | loss: nan | val_loss: nan | Time: 2990.1 ms
[2022-03-01 06:54:20	                main:574]	:	INFO	:	Epoch 1618 | loss: nan | val_loss: nan | Time: 3496.72 ms
[2022-03-01 06:54:24	                main:574]	:	INFO	:	Epoch 1619 | loss: nan | val_loss: nan | Time: 3979.27 ms
[2022-03-01 06:54:28	                main:574]	:	INFO	:	Epoch 1620 | loss: nan | val_loss: nan | Time: 3478.14 ms
[2022-03-01 06:54:31	                main:574]	:	INFO	:	Epoch 1621 | loss: nan | val_loss: nan | Time: 3369.98 ms
[2022-03-01 06:54:34	                main:574]	:	INFO	:	Epoch 1622 | loss: nan | val_loss: nan | Time: 3238.5 ms
[2022-03-01 06:54:39	                main:574]	:	INFO	:	Epoch 1623 | loss: nan | val_loss: nan | Time: 4322.78 ms
[2022-03-01 06:54:42	                main:574]	:	INFO	:	Epoch 1624 | loss: nan | val_loss: nan | Time: 3290.33 ms
[2022-03-01 06:54:45	                main:574]	:	INFO	:	Epoch 1625 | loss: nan | val_loss: nan | Time: 2666.4 ms
[2022-03-01 06:54:47	                main:574]	:	INFO	:	Epoch 1626 | loss: nan | val_loss: nan | Time: 2642.18 ms
[2022-03-01 06:54:50	                main:574]	:	INFO	:	Epoch 1627 | loss: nan | val_loss: nan | Time: 2615.81 ms
[2022-03-01 06:54:53	                main:574]	:	INFO	:	Epoch 1628 | loss: nan | val_loss: nan | Time: 2591.83 ms
[2022-03-01 06:54:55	                main:574]	:	INFO	:	Epoch 1629 | loss: nan | val_loss: nan | Time: 2655.3 ms
[2022-03-01 06:54:58	                main:574]	:	INFO	:	Epoch 1630 | loss: nan | val_loss: nan | Time: 2825.95 ms
[2022-03-01 06:55:01	                main:574]	:	INFO	:	Epoch 1631 | loss: nan | val_loss: nan | Time: 3001.26 ms
[2022-03-01 06:55:04	                main:574]	:	INFO	:	Epoch 1632 | loss: nan | val_loss: nan | Time: 2878.38 ms
[2022-03-01 06:55:07	                main:574]	:	INFO	:	Epoch 1633 | loss: nan | val_loss: nan | Time: 3070.3 ms
[2022-03-01 06:55:10	                main:574]	:	INFO	:	Epoch 1634 | loss: nan | val_loss: nan | Time: 3005.7 ms
[2022-03-01 06:55:13	                main:574]	:	INFO	:	Epoch 1635 | loss: nan | val_loss: nan | Time: 3052.79 ms
[2022-03-01 06:55:17	                main:574]	:	INFO	:	Epoch 1636 | loss: nan | val_loss: nan | Time: 3096.57 ms
[2022-03-01 06:55:20	                main:574]	:	INFO	:	Epoch 1637 | loss: nan | val_loss: nan | Time: 3054.17 ms
[2022-03-01 06:55:23	                main:574]	:	INFO	:	Epoch 1638 | loss: nan | val_loss: nan | Time: 3361.67 ms
[2022-03-01 06:55:27	                main:574]	:	INFO	:	Epoch 1639 | loss: nan | val_loss: nan | Time: 3638.24 ms
[2022-03-01 06:55:30	                main:574]	:	INFO	:	Epoch 1640 | loss: nan | val_loss: nan | Time: 3592.35 ms
[2022-03-01 06:55:34	                main:574]	:	INFO	:	Epoch 1641 | loss: nan | val_loss: nan | Time: 3884.48 ms
[2022-03-01 06:55:38	                main:574]	:	INFO	:	Epoch 1642 | loss: nan | val_loss: nan | Time: 4061.23 ms
[2022-03-01 06:55:42	                main:574]	:	INFO	:	Epoch 1643 | loss: nan | val_loss: nan | Time: 3317.18 ms
[2022-03-01 06:55:45	                main:574]	:	INFO	:	Epoch 1644 | loss: nan | val_loss: nan | Time: 3242.87 ms
[2022-03-01 06:55:49	                main:574]	:	INFO	:	Epoch 1645 | loss: nan | val_loss: nan | Time: 3623.11 ms
[2022-03-01 06:55:52	                main:574]	:	INFO	:	Epoch 1646 | loss: nan | val_loss: nan | Time: 3228.71 ms
[2022-03-01 06:55:55	                main:574]	:	INFO	:	Epoch 1647 | loss: nan | val_loss: nan | Time: 2857.59 ms
[2022-03-01 06:55:58	                main:574]	:	INFO	:	Epoch 1648 | loss: nan | val_loss: nan | Time: 2685.7 ms
[2022-03-01 06:56:00	                main:574]	:	INFO	:	Epoch 1649 | loss: nan | val_loss: nan | Time: 2669.04 ms
[2022-03-01 06:56:03	                main:574]	:	INFO	:	Epoch 1650 | loss: nan | val_loss: nan | Time: 2623.73 ms
[2022-03-01 06:56:06	                main:574]	:	INFO	:	Epoch 1651 | loss: nan | val_loss: nan | Time: 2554.06 ms
[2022-03-01 06:56:09	                main:574]	:	INFO	:	Epoch 1652 | loss: nan | val_loss: nan | Time: 2945.91 ms
[2022-03-01 06:56:13	                main:574]	:	INFO	:	Epoch 1653 | loss: nan | val_loss: nan | Time: 4031.77 ms
[2022-03-01 06:56:19	                main:574]	:	INFO	:	Epoch 1654 | loss: nan | val_loss: nan | Time: 6434.71 ms
[2022-03-01 06:56:23	                main:574]	:	INFO	:	Epoch 1655 | loss: nan | val_loss: nan | Time: 3755.07 ms
[2022-03-01 06:56:26	                main:574]	:	INFO	:	Epoch 1656 | loss: nan | val_loss: nan | Time: 3438.65 ms
[2022-03-01 06:56:30	                main:574]	:	INFO	:	Epoch 1657 | loss: nan | val_loss: nan | Time: 3337.61 ms
[2022-03-01 06:56:33	                main:574]	:	INFO	:	Epoch 1658 | loss: nan | val_loss: nan | Time: 3472.96 ms
[2022-03-01 06:56:37	                main:574]	:	INFO	:	Epoch 1659 | loss: nan | val_loss: nan | Time: 3218.12 ms
[2022-03-01 06:56:40	                main:574]	:	INFO	:	Epoch 1660 | loss: nan | val_loss: nan | Time: 3197.56 ms
[2022-03-01 06:56:43	                main:574]	:	INFO	:	Epoch 1661 | loss: nan | val_loss: nan | Time: 3243.44 ms
[2022-03-01 06:56:47	                main:574]	:	INFO	:	Epoch 1662 | loss: nan | val_loss: nan | Time: 3430.71 ms
[2022-03-01 06:56:50	                main:574]	:	INFO	:	Epoch 1663 | loss: nan | val_loss: nan | Time: 3187.38 ms
[2022-03-01 06:56:53	                main:574]	:	INFO	:	Epoch 1664 | loss: nan | val_loss: nan | Time: 3283.26 ms
[2022-03-01 06:56:56	                main:574]	:	INFO	:	Epoch 1665 | loss: nan | val_loss: nan | Time: 3153.17 ms
[2022-03-01 06:57:00	                main:574]	:	INFO	:	Epoch 1666 | loss: nan | val_loss: nan | Time: 3620.16 ms
[2022-03-01 06:57:03	                main:574]	:	INFO	:	Epoch 1667 | loss: nan | val_loss: nan | Time: 3444.67 ms
[2022-03-01 06:57:07	                main:574]	:	INFO	:	Epoch 1668 | loss: nan | val_loss: nan | Time: 3654.23 ms
[2022-03-01 06:57:11	                main:574]	:	INFO	:	Epoch 1669 | loss: nan | val_loss: nan | Time: 4142.38 ms
[2022-03-01 06:57:15	                main:574]	:	INFO	:	Epoch 1670 | loss: nan | val_loss: nan | Time: 3163.39 ms
[2022-03-01 06:57:18	                main:574]	:	INFO	:	Epoch 1671 | loss: nan | val_loss: nan | Time: 3405.73 ms
[2022-03-01 06:57:21	                main:574]	:	INFO	:	Epoch 1672 | loss: nan | val_loss: nan | Time: 3118.86 ms
[2022-03-01 06:57:24	                main:574]	:	INFO	:	Epoch 1673 | loss: nan | val_loss: nan | Time: 3247.68 ms
[2022-03-01 06:57:27	                main:574]	:	INFO	:	Epoch 1674 | loss: nan | val_loss: nan | Time: 2897.12 ms
[2022-03-01 06:57:30	                main:574]	:	INFO	:	Epoch 1675 | loss: nan | val_loss: nan | Time: 3057.91 ms
[2022-03-01 06:57:34	                main:574]	:	INFO	:	Epoch 1676 | loss: nan | val_loss: nan | Time: 3337.43 ms
[2022-03-01 06:57:37	                main:574]	:	INFO	:	Epoch 1677 | loss: nan | val_loss: nan | Time: 3647.73 ms
[2022-03-01 06:57:42	                main:574]	:	INFO	:	Epoch 1678 | loss: nan | val_loss: nan | Time: 4567.44 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 1660 Ti)
[2022-03-01 08:49:14	                main:435]	:	INFO	:	Set logging level to 1
[2022-03-01 08:49:14	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-03-01 08:49:14	                main:444]	:	INFO	:	Resolving all filenames
[2022-03-01 08:49:14	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-01 08:49:14	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-01 08:49:14	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-01 08:49:14	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 0)
[2022-03-01 08:49:14	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-01 08:49:14	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-03-01 08:49:14	                main:474]	:	INFO	:	Configuration: 
[2022-03-01 08:49:14	                main:475]	:	INFO	:	    Model type: GRU
[2022-03-01 08:49:14	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-03-01 08:49:14	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-03-01 08:49:14	                main:478]	:	INFO	:	    Batch Size: 128
[2022-03-01 08:49:14	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-03-01 08:49:14	                main:480]	:	INFO	:	    Patience: 10
[2022-03-01 08:49:14	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-03-01 08:49:15	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-03-01 08:49:15	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-03-01 08:49:15	                main:484]	:	INFO	:	    # Threads: 1
[2022-03-01 08:49:15	                main:486]	:	INFO	:	Preparing Dataset
[2022-03-01 08:49:15	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-01 08:49:15	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-03-01 08:49:19	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-03-01 08:49:19	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-03-01 08:49:20	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-03-01 08:49:20	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-03-01 08:49:20	                main:494]	:	INFO	:	Creating Model
[2022-03-01 08:49:20	                main:507]	:	INFO	:	Preparing config file
[2022-03-01 08:49:20	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-03-01 08:49:20	                main:512]	:	INFO	:	Loading config


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFA31D9A799

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 03/01/22 08:49:20
Install Directory : H:\Program Files\BOINC\
Data Directory    : H:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( H:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( H:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( H:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( H:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: H:\ProgramData\BOINC\slots\173;H:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 000000006fa30000 00000000003df000 H:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000342c0000 00000000001f0000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.18362.815) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000032670000 00000000000b2000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.18362.959 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.959

ModLoad: 0000000031d60000 00000000002a4000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.18362.959 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.959

ModLoad: 00000000324b0000 0000000000194000 C:\WINDOWS\System32\USER32.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000032070000 0000000000021000 C:\WINDOWS\System32\win32u.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.18362.959 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.959

ModLoad: 0000000032840000 0000000000026000 C:\WINDOWS\System32\GDI32.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000320a0000 0000000000196000 C:\WINDOWS\System32\gdi32full.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.18362.959 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.959

ModLoad: 0000000005c90000 0000000000058000 H:\ProgramData\BOINC\slots\173\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000031b70000 000000000009e000 C:\WINDOWS\System32\msvcp_win.dll (6.2.18362.815) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.18362.815 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.815

ModLoad: 00000000319f0000 00000000000fa000 C:\WINDOWS\System32\ucrtbase.dll (6.2.18362.815) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.18362.815 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.815

ModLoad: 0000000033b20000 00000000000a3000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.18362.752) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000032740000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.18362.1

ModLoad: 0000000033be0000 0000000000097000 C:\WINDOWS\System32\sechost.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000032aa0000 0000000000120000 C:\WINDOWS\System32\RPCRT4.dll (6.2.18362.628) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 00000000f4870000 0000000000091000 H:\ProgramData\BOINC\slots\173\MSVCP140.dll (14.27.29112.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.27.29112.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.27.29112.0

ModLoad: 000000001e700000 00000000001f4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 000000000f360000 0000000000019000 H:\ProgramData\BOINC\slots\173\VCRUNTIME140.dll (14.27.29112.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.27.29112.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.27.29112.0

ModLoad: 000000000f650000 000000000000c000 H:\ProgramData\BOINC\slots\173\VCRUNTIME140_1.dll (14.27.29112.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.27.29112.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.27.29112.0

ModLoad: 00000000be880000 000000000abe7000 H:\ProgramData\BOINC\slots\173\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000f4660000 000000000020d000 H:\ProgramData\BOINC\slots\173\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 00000000f1070000 00000000002db000 H:\ProgramData\BOINC\slots\173\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000000c440000 0000000000040000 H:\ProgramData\BOINC\slots\173\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000099d30000 0000000024b49000 H:\ProgramData\BOINC\slots\173\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000f4570000 0000000000045000 H:\ProgramData\BOINC\slots\173\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000e2380000 00000000030a5000 H:\ProgramData\BOINC\slots\173\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 0000000067130000 00000000034b2000 H:\ProgramData\BOINC\slots\173\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 0000000005980000 0000000000010000 H:\ProgramData\BOINC\slots\173\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 000000003ee80000 000000000919f000 H:\ProgramData\BOINC\slots\173\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 0000000048020000 0000000003d5b000 H:\ProgramData\BOINC\slots\173\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 000000003cfb0000 0000000001eca000 H:\ProgramData\BOINC\slots\173\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 000000004bd80000 000000001b3a4000 H:\ProgramData\BOINC\slots\173\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 0000000032240000 0000000000080000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.18362.836) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.18362.836 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.836

ModLoad: 0000000033de0000 000000000002e000 C:\WINDOWS\System32\IMM32.DLL (6.2.18362.387) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.18362.387 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.387

ModLoad: 0000000031180000 0000000000011000 C:\WINDOWS\System32\kernel.appcore.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 000000002fe10000 0000000000020000 C:\WINDOWS\SYSTEM32\dxcore.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : DXCore.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000031b20000 000000000004a000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.18362.387) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.18362.387 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.387

ModLoad: 00000000334b0000 0000000000335000 C:\WINDOWS\System32\combase.dll (6.2.18362.900) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000033e10000 0000000000470000 C:\WINDOWS\System32\Setupapi.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000031af0000 0000000000026000 C:\WINDOWS\System32\bcrypt.dll (6.2.18362.267) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000030f10000 000000000002a000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.18362.387) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.18362.387 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.387

ModLoad: 0000000032010000 000000000005c000 C:\WINDOWS\System32\WINTRUST.dll (6.2.18362.387) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.18362.387 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.387

ModLoad: 00000000311a0000 0000000000012000 C:\WINDOWS\System32\MSASN1.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000031c10000 0000000000149000 C:\WINDOWS\System32\CRYPT32.dll (6.2.18362.592) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000032bc0000 00000000006e6000 C:\WINDOWS\System32\Shell32.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.18362.900 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.900

ModLoad: 00000000332b0000 00000000000a9000 C:\WINDOWS\System32\shcore.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000031260000 0000000000782000 C:\WINDOWS\System32\windows.storage.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 00000000311c0000 0000000000023000 C:\WINDOWS\System32\profapi.dll (6.2.18362.693) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : profapi.pdb
    File Version          : 10.0.18362.693 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.693

ModLoad: 00000000311f0000 000000000004a000 C:\WINDOWS\System32\powrprof.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : powrprof.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000031170000 0000000000010000 C:\WINDOWS\System32\UMPDC.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : UMPDC.pdb

ModLoad: 00000000327e0000 0000000000052000 C:\WINDOWS\System32\shlwapi.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000031240000 0000000000017000 C:\WINDOWS\System32\cryptsp.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptsp.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000002e30000 0000000000267000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.5730) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 27.21.14.5730
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.1.114 driver
    Product Version       : 27.21.14.5730

ModLoad: 000000002f150000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000f2b80000 000000000152c000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_5dcb5bbf5c3edcf2\nvcuda64.dll (27.21.14.5730) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 27.21.14.5730
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.1.114 driver
    Product Version       : 27.21.14.5730

ModLoad: 00000000338d0000 000000000006f000 C:\WINDOWS\System32\WS2_32.dll (6.2.18362.387) (-exported- Symbols Loaded)
    Linked PDB Filename   : ws2_32.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 000000002f120000 000000000002f000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000030ab0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 000000002f4a0000 0000000000099000 C:\WINDOWS\system32\uxtheme.dll (6.2.18362.449) (-exported- Symbols Loaded)
    Linked PDB Filename   : UxTheme.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 00000000295b0000 00000000006d6000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.5730) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 27.21.14.5730
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 27.21.14.5730

ModLoad: 0000000033c80000 0000000000157000 C:\WINDOWS\System32\OLE32.DLL (6.2.18362.693) (-exported- Symbols Loaded)
    Linked PDB Filename   : ole32.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3621, Write: 308, Other 817

- I/O Transfers Counters -
Read: 6665501, Write: 6043, Other 30044

- Paged Pool Usage -
QuotaPagedPoolUsage: 3449624, QuotaPeakPagedPoolUsage: 3449624
QuotaNonPagedPoolUsage: 38616, QuotaPeakNonPagedPoolUsage: 38680

- Virtual Memory Usage -
VirtualSize: -1272221696, PeakVirtualSize: -668651520

- Pagefile Usage -
PagefileUsage: -1272221696, PeakPagefileUsage: -1272221696

- Working Set Size -
WorkingSetSize: 1229484032, PeakWorkingSetSize: 1229488128, PageFaultCount: 425485

*** Dump of thread ID 14540 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 11875000.000000, User Time: 32656250.000000, Wait Time: 441348320.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFA31D9A799

- Registers -
rax=000000002cee5e08 rbx=000000006fd94910 rcx=0000000095cd1500 rdx=0000000000000000 rsi=000000002cee6670 rdi=0000000019930520
r8=000000002cee5e30 r9=000000002cee5e58 r10=0000000000000004 r11=000000002cee5e68 r12=00000000ea3f9eb0 r13=000000002cee6880
r14=000000008edc7cf0 r15=0000000000000000 rip=0000000031d9a799 rsp=000000002cee6510 rbp=000000002cee6800
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
2cee65e0 6fcaa884 00000040 0000004f ea3f9200 6fccfd48 KERNELBASE!RaiseException+0x0 
2cee6640 6fa51ca6 000034a0 2cee6719 95dd56f8 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
2cee66f0 6fa5593b 00000020 00000000 00000000 00000003 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
2cee6840 6fa51a78 00000000 00000000 2cee6b70 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
2cee6910 6fa51cfc 2cee6b70 00000000 00000080 2cee6e40 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
2cee69d0 6fa5c4dd 2cee6e40 2cee6e40 2cee6e40 2cee6e40 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
2cee6cc0 6fa4b2fe 2cee72d8 2cee6e40 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
2ceffa60 6fc8c6f8 acdae250 00000000 00000000 ac5d0a10 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
2ceffaa0 32687bd4 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
2ceffad0 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
2ceffb50 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 28264 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 441347904.000000

- Registers -
rax=00000000000001cd rbx=00000000ab2754e0 rcx=0000000000000070 rdx=00000000ab275160 rsi=00000000ab273280 rdi=00000000ab2754e0
r8=000000002f154ffc r9=000000002cfff390 r10=000000002f1500f8 r11=0000000000000001 r12=0000000000000000 r13=00000000ab2735b8
r14=0000000000000001 r15=0000000000000000 rip=000000003435fa04 rsp=000000002cfff8e8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
2cfff8e0 342f3fe0 00000000 00000000 ab273280 00000004 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
2cfffca0 32687bd4 00000000 00000000 00000000 00000000 ntdll!RtlInitializeResource+0x0 
2cfffcd0 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
2cfffd50 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 14612 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 468750.000000, User Time: 0.000000, Wait Time: 441347904.000000

- Registers -
rax=00000000000001cd rbx=00000000ab275910 rcx=0000000000000070 rdx=00000000ab275590 rsi=00000000ab273280 rdi=00000000ab275910
r8=0000000000000008 r9=0000000000000001 r10=0000000000000180 r11=00000000acf42750 r12=0000000000000000 r13=00000000ab2735b8
r14=0000000000000001 r15=0000000000000000 rip=000000003435fa04 rsp=000000002d0ff6a8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
2d0ff6a0 342f3fe0 00000000 00000000 ab273280 00000006 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
2d0ffa60 32687bd4 00000000 00000000 00000000 00000000 ntdll!RtlInitializeResource+0x0 
2d0ffa90 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
2d0ffb10 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 10648 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 468750.000000, User Time: 0.000000, Wait Time: 441347904.000000

- Registers -
rax=00000000000001cd rbx=00000000ab2763e0 rcx=0000000000000070 rdx=00000000ab276060 rsi=00000000ab273280 rdi=00000000ab2763e0
r8=0000000000000008 r9=0000000000000001 r10=00000000000001c0 r11=00000000acf428b0 r12=0000000000000000 r13=00000000ab2735b8
r14=0000000000000001 r15=0000000000000000 rip=000000003435fa04 rsp=000000002d1ff8e8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
2d1ff8e0 342f3fe0 00000000 00000000 ab273280 00000001 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
2d1ffca0 32687bd4 00000000 00000000 00000000 00000000 ntdll!RtlInitializeResource+0x0 
2d1ffcd0 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
2d1ffd50 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 8324 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 441348320.000000

- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=000000002d3ff960 rsi=0000000000000000 rdi=0000000000000064
r8=000000002d3fedf0 r9=000000006fce87f0 r10=0000000000000fff r11=0000000000000ff0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000003435c6f4 rsp=000000002d3ff938 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
2d3ff930 31da6891 2d3ff9f8 00000000 00000000 00000000 ntdll!ZwDelayExecution+0x0 
2d3ff9d0 6fa6a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0 
2d3ffa00 32687bd4 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
2d3ffa30 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
2d3ffab0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 12640 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 441348320.000000

- Registers -
rax=000000000000005b rbx=000000000000000b rcx=000000000000000b rdx=000000002d4ff590 rsi=0000000000000000 rdi=000000000000000b
r8=00000000acee8380 r9=000000000000000b r10=00000000acdb4af0 r11=000000006a00730f r12=0000000000000064 r13=000000002d4ff590
r14=000000002d4ff280 r15=0000000000000000 rip=000000003435cbc4 rsp=000000002d4ff228 rbp=00000000acecb2d0
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
2d4ff220 31db8037 33ca3880 343337d4 00000000 2ccbd000 ntdll!NtWaitForMultipleObjects+0x0 
2d4ff520 31db7f1e f3074b48 ab2832b0 0000000b 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
2d4ff560 f2d2bb54 acece390 00000000 aceca4f0 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
2d4ff7a0 f2dc09ed 00000000 00000004 00000000 00000000 nvcuda64!+0x0 
2d4ff850 f2d2b523 296ccae6 26bc928f ad43b930 00000000 nvcuda64!cuProfilerStop+0x0 
2d4ff880 f303a750 ad43b930 00000000 00000000 00000000 nvcuda64!+0x0 
2d4ff8b0 32687bd4 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
2d4ff8e0 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
2d4ff960 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 7436 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 441348064.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002b4 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002b4
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=00000000aceb14b0 r13=0000000000000000
r14=00000000000002b4 r15=0000000000000000 rip=000000003435c0f4 rsp=000000002d5ffab8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
2d5ffab0 31d98b03 00000000 00000000 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0 
2d5ffb50 f2f3bf48 00000000 31d84975 00000000 000002b4 KERNELBASE!WaitForSingleObjectEx+0x0 
2d5ffbc0 f2d2b523 00000001 bad13130 ad43b0f0 00000000 nvcuda64!cuProfilerStop+0x0 
2d5ffbf0 f303a750 ad43b0f0 00000000 00000000 00000000 nvcuda64!+0x0 
2d5ffc20 32687bd4 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
2d5ffc50 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
2d5ffcd0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 10132 (state: Waiting): ***

- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 441348320.000000

- Registers -
rax=00000000000001ca rbx=0000000000000000 rcx=00000000ad163258 rdx=000000002d6ff8d8 rsi=000000002d6ff840 rdi=0000000000000000
r8=000000002d6ff818 r9=000000002d6ff870 r10=0000000000000000 r11=0000000000000246 r12=000000002d6ff8d8 r13=0000000000000000
r14=00000000ad163258 r15=00000000ad167e28 rip=000000003435f9a4 rsp=000000002d6ff818 rbp=000000002d6ff870
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
2d6ff810 34320815 00000102 00000102 00000000 2d6ff840 ntdll!ZwWaitForAlertByThreadId+0x0 
2d6ff880 31ddc2b9 ad165610 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0 
2d6ff8b0 f2cb223a ad165610 ad165610 ad165610 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0 
2d6ff910 f2d2b523 00000004 29195964 2968057e 00000000 nvcuda64!+0x0 
2d6ff940 f303a750 ad43b690 00000000 00000000 00000000 nvcuda64!+0x0 
2d6ff970 32687bd4 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
2d6ff9a0 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
2d6ffa20 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)