Task 14296567

Name ParityModified-1645995882-26295-3-0_3
Workunit 10422053
Created 3 Apr 2022, 9:02:06 UTC
Sent 3 Apr 2022, 9:52:33 UTC
Report deadline 11 Apr 2022, 9:52:33 UTC
Received 3 Apr 2022, 13:22:24 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 28641
Run time 1 hours 27 min 25 sec
CPU time 1 hours 25 min 14 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 4,459.60 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 2.09 GB
Peak swap size 4.32 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
             main:574]	:	INFO	:	Epoch 1542 | loss: nan | val_loss: nan | Time: 2553.85 ms
[2022-04-03 04:12:52	                main:574]	:	INFO	:	Epoch 1543 | loss: nan | val_loss: nan | Time: 2578.15 ms
[2022-04-03 04:12:55	                main:574]	:	INFO	:	Epoch 1544 | loss: nan | val_loss: nan | Time: 2581.23 ms
[2022-04-03 04:12:57	                main:574]	:	INFO	:	Epoch 1545 | loss: nan | val_loss: nan | Time: 2518.18 ms
[2022-04-03 04:13:00	                main:574]	:	INFO	:	Epoch 1546 | loss: nan | val_loss: nan | Time: 2538.14 ms
[2022-04-03 04:13:03	                main:574]	:	INFO	:	Epoch 1547 | loss: nan | val_loss: nan | Time: 2577.43 ms
[2022-04-03 04:13:05	                main:574]	:	INFO	:	Epoch 1548 | loss: nan | val_loss: nan | Time: 2565.08 ms
[2022-04-03 04:13:08	                main:574]	:	INFO	:	Epoch 1549 | loss: nan | val_loss: nan | Time: 2534.04 ms
[2022-04-03 04:13:10	                main:574]	:	INFO	:	Epoch 1550 | loss: nan | val_loss: nan | Time: 2570.97 ms
[2022-04-03 04:13:13	                main:574]	:	INFO	:	Epoch 1551 | loss: nan | val_loss: nan | Time: 2551.93 ms
[2022-04-03 04:13:15	                main:574]	:	INFO	:	Epoch 1552 | loss: nan | val_loss: nan | Time: 2537.76 ms
[2022-04-03 04:13:18	                main:574]	:	INFO	:	Epoch 1553 | loss: nan | val_loss: nan | Time: 2599.46 ms
[2022-04-03 04:13:21	                main:574]	:	INFO	:	Epoch 1554 | loss: nan | val_loss: nan | Time: 2585.79 ms
[2022-04-03 04:13:23	                main:574]	:	INFO	:	Epoch 1555 | loss: nan | val_loss: nan | Time: 2504.91 ms
[2022-04-03 04:13:26	                main:574]	:	INFO	:	Epoch 1556 | loss: nan | val_loss: nan | Time: 2659.88 ms
[2022-04-03 04:13:28	                main:574]	:	INFO	:	Epoch 1557 | loss: nan | val_loss: nan | Time: 2552.13 ms
[2022-04-03 04:13:31	                main:574]	:	INFO	:	Epoch 1558 | loss: nan | val_loss: nan | Time: 2544.44 ms
[2022-04-03 04:13:33	                main:574]	:	INFO	:	Epoch 1559 | loss: nan | val_loss: nan | Time: 2590.52 ms
[2022-04-03 04:13:36	                main:574]	:	INFO	:	Epoch 1560 | loss: nan | val_loss: nan | Time: 2560.52 ms
[2022-04-03 04:13:39	                main:574]	:	INFO	:	Epoch 1561 | loss: nan | val_loss: nan | Time: 2544.56 ms
[2022-04-03 04:13:41	                main:574]	:	INFO	:	Epoch 1562 | loss: nan | val_loss: nan | Time: 2592.98 ms
[2022-04-03 04:13:44	                main:574]	:	INFO	:	Epoch 1563 | loss: nan | val_loss: nan | Time: 2572.66 ms
[2022-04-03 04:13:46	                main:574]	:	INFO	:	Epoch 1564 | loss: nan | val_loss: nan | Time: 2527.68 ms
[2022-04-03 04:13:49	                main:574]	:	INFO	:	Epoch 1565 | loss: nan | val_loss: nan | Time: 2613.37 ms
[2022-04-03 04:13:51	                main:574]	:	INFO	:	Epoch 1566 | loss: nan | val_loss: nan | Time: 2538.59 ms
[2022-04-03 04:13:54	                main:574]	:	INFO	:	Epoch 1567 | loss: nan | val_loss: nan | Time: 2537.79 ms
[2022-04-03 04:13:56	                main:574]	:	INFO	:	Epoch 1568 | loss: nan | val_loss: nan | Time: 2547.76 ms
[2022-04-03 04:13:59	                main:574]	:	INFO	:	Epoch 1569 | loss: nan | val_loss: nan | Time: 2553.61 ms
[2022-04-03 04:14:02	                main:574]	:	INFO	:	Epoch 1570 | loss: nan | val_loss: nan | Time: 2638.87 ms
[2022-04-03 04:14:04	                main:574]	:	INFO	:	Epoch 1571 | loss: nan | val_loss: nan | Time: 2533.19 ms
[2022-04-03 04:14:07	                main:574]	:	INFO	:	Epoch 1572 | loss: nan | val_loss: nan | Time: 2540.45 ms
[2022-04-03 04:14:09	                main:574]	:	INFO	:	Epoch 1573 | loss: nan | val_loss: nan | Time: 2510.11 ms
[2022-04-03 04:14:12	                main:574]	:	INFO	:	Epoch 1574 | loss: nan | val_loss: nan | Time: 2504.01 ms
[2022-04-03 04:14:14	                main:574]	:	INFO	:	Epoch 1575 | loss: nan | val_loss: nan | Time: 2581.36 ms
[2022-04-03 04:14:17	                main:574]	:	INFO	:	Epoch 1576 | loss: nan | val_loss: nan | Time: 2579.86 ms
[2022-04-03 04:14:20	                main:574]	:	INFO	:	Epoch 1577 | loss: nan | val_loss: nan | Time: 2610.76 ms
[2022-04-03 04:14:22	                main:574]	:	INFO	:	Epoch 1578 | loss: nan | val_loss: nan | Time: 2579.26 ms
[2022-04-03 04:14:25	                main:574]	:	INFO	:	Epoch 1579 | loss: nan | val_loss: nan | Time: 2553.86 ms
[2022-04-03 04:14:27	                main:574]	:	INFO	:	Epoch 1580 | loss: nan | val_loss: nan | Time: 2524.39 ms
[2022-04-03 04:14:30	                main:574]	:	INFO	:	Epoch 1581 | loss: nan | val_loss: nan | Time: 2616.41 ms
[2022-04-03 04:14:32	                main:574]	:	INFO	:	Epoch 1582 | loss: nan | val_loss: nan | Time: 2558.24 ms
[2022-04-03 04:14:35	                main:574]	:	INFO	:	Epoch 1583 | loss: nan | val_loss: nan | Time: 2584.03 ms
[2022-04-03 04:14:38	                main:574]	:	INFO	:	Epoch 1584 | loss: nan | val_loss: nan | Time: 2574.23 ms
[2022-04-03 04:14:40	                main:574]	:	INFO	:	Epoch 1585 | loss: nan | val_loss: nan | Time: 2544.1 ms
[2022-04-03 04:14:43	                main:574]	:	INFO	:	Epoch 1586 | loss: nan | val_loss: nan | Time: 2578.8 ms
[2022-04-03 04:14:45	                main:574]	:	INFO	:	Epoch 1587 | loss: nan | val_loss: nan | Time: 2586.47 ms
[2022-04-03 04:14:48	                main:574]	:	INFO	:	Epoch 1588 | loss: nan | val_loss: nan | Time: 2577.21 ms
[2022-04-03 04:14:50	                main:574]	:	INFO	:	Epoch 1589 | loss: nan | val_loss: nan | Time: 2584.57 ms
[2022-04-03 04:14:53	                main:574]	:	INFO	:	Epoch 1590 | loss: nan | val_loss: nan | Time: 2538.37 ms
[2022-04-03 04:14:55	                main:574]	:	INFO	:	Epoch 1591 | loss: nan | val_loss: nan | Time: 2554.58 ms
[2022-04-03 04:14:58	                main:574]	:	INFO	:	Epoch 1592 | loss: nan | val_loss: nan | Time: 2565.02 ms
[2022-04-03 04:15:01	                main:574]	:	INFO	:	Epoch 1593 | loss: nan | val_loss: nan | Time: 2562.51 ms
[2022-04-03 04:15:03	                main:574]	:	INFO	:	Epoch 1594 | loss: nan | val_loss: nan | Time: 2589.32 ms
[2022-04-03 04:15:06	                main:574]	:	INFO	:	Epoch 1595 | loss: nan | val_loss: nan | Time: 2552.2 ms
[2022-04-03 04:15:08	                main:574]	:	INFO	:	Epoch 1596 | loss: nan | val_loss: nan | Time: 2569.48 ms
[2022-04-03 04:15:11	                main:574]	:	INFO	:	Epoch 1597 | loss: nan | val_loss: nan | Time: 2603.24 ms
[2022-04-03 04:15:14	                main:574]	:	INFO	:	Epoch 1598 | loss: nan | val_loss: nan | Time: 2567.62 ms
[2022-04-03 04:15:16	                main:574]	:	INFO	:	Epoch 1599 | loss: nan | val_loss: nan | Time: 2578.09 ms
[2022-04-03 04:15:19	                main:574]	:	INFO	:	Epoch 1600 | loss: nan | val_loss: nan | Time: 2531.63 ms
[2022-04-03 04:15:21	                main:574]	:	INFO	:	Epoch 1601 | loss: nan | val_loss: nan | Time: 2553.09 ms
[2022-04-03 04:15:24	                main:574]	:	INFO	:	Epoch 1602 | loss: nan | val_loss: nan | Time: 2572.59 ms
[2022-04-03 04:15:26	                main:574]	:	INFO	:	Epoch 1603 | loss: nan | val_loss: nan | Time: 2559.23 ms
[2022-04-03 04:15:29	                main:574]	:	INFO	:	Epoch 1604 | loss: nan | val_loss: nan | Time: 2557.34 ms
[2022-04-03 04:15:31	                main:574]	:	INFO	:	Epoch 1605 | loss: nan | val_loss: nan | Time: 2555.56 ms
[2022-04-03 04:15:34	                main:574]	:	INFO	:	Epoch 1606 | loss: nan | val_loss: nan | Time: 2592.93 ms
[2022-04-03 04:15:37	                main:574]	:	INFO	:	Epoch 1607 | loss: nan | val_loss: nan | Time: 2558.6 ms
[2022-04-03 04:15:39	                main:574]	:	INFO	:	Epoch 1608 | loss: nan | val_loss: nan | Time: 2552.02 ms
[2022-04-03 04:15:42	                main:574]	:	INFO	:	Epoch 1609 | loss: nan | val_loss: nan | Time: 2528.58 ms
[2022-04-03 04:15:44	                main:574]	:	INFO	:	Epoch 1610 | loss: nan | val_loss: nan | Time: 2592.11 ms
[2022-04-03 04:15:47	                main:574]	:	INFO	:	Epoch 1611 | loss: nan | val_loss: nan | Time: 2534.14 ms
[2022-04-03 04:15:49	                main:574]	:	INFO	:	Epoch 1612 | loss: nan | val_loss: nan | Time: 2557.37 ms
[2022-04-03 04:15:52	                main:574]	:	INFO	:	Epoch 1613 | loss: nan | val_loss: nan | Time: 2564.26 ms
[2022-04-03 04:15:55	                main:574]	:	INFO	:	Epoch 1614 | loss: nan | val_loss: nan | Time: 2589.13 ms
[2022-04-03 04:15:57	                main:574]	:	INFO	:	Epoch 1615 | loss: nan | val_loss: nan | Time: 2560.07 ms
[2022-04-03 04:16:00	                main:574]	:	INFO	:	Epoch 1616 | loss: nan | val_loss: nan | Time: 2486.33 ms
[2022-04-03 04:16:02	                main:574]	:	INFO	:	Epoch 1617 | loss: nan | val_loss: nan | Time: 2529.04 ms
[2022-04-03 04:16:05	                main:574]	:	INFO	:	Epoch 1618 | loss: nan | val_loss: nan | Time: 2563.08 ms
[2022-04-03 04:16:07	                main:574]	:	INFO	:	Epoch 1619 | loss: nan | val_loss: nan | Time: 2520.5 ms
[2022-04-03 04:16:10	                main:574]	:	INFO	:	Epoch 1620 | loss: nan | val_loss: nan | Time: 2537.49 ms
[2022-04-03 04:16:12	                main:574]	:	INFO	:	Epoch 1621 | loss: nan | val_loss: nan | Time: 2599.32 ms
[2022-04-03 04:16:15	                main:574]	:	INFO	:	Epoch 1622 | loss: nan | val_loss: nan | Time: 2581.02 ms
[2022-04-03 04:16:18	                main:574]	:	INFO	:	Epoch 1623 | loss: nan | val_loss: nan | Time: 2658.92 ms
[2022-04-03 04:16:20	                main:574]	:	INFO	:	Epoch 1624 | loss: nan | val_loss: nan | Time: 2559.56 ms
[2022-04-03 04:16:23	                main:574]	:	INFO	:	Epoch 1625 | loss: nan | val_loss: nan | Time: 2518.42 ms
[2022-04-03 04:16:25	                main:574]	:	INFO	:	Epoch 1626 | loss: nan | val_loss: nan | Time: 2528.42 ms
[2022-04-03 04:16:28	                main:574]	:	INFO	:	Epoch 1627 | loss: nan | val_loss: nan | Time: 2548.4 ms
[2022-04-03 04:16:30	                main:574]	:	INFO	:	Epoch 1628 | loss: nan | val_loss: nan | Time: 2530.42 ms
[2022-04-03 04:16:33	                main:574]	:	INFO	:	Epoch 1629 | loss: nan | val_loss: nan | Time: 2536.4 ms
[2022-04-03 04:16:35	                main:574]	:	INFO	:	Epoch 1630 | loss: nan | val_loss: nan | Time: 2555.76 ms
[2022-04-03 04:16:38	                main:574]	:	INFO	:	Epoch 1631 | loss: nan | val_loss: nan | Time: 2596.18 ms
[2022-04-03 04:16:41	                main:574]	:	INFO	:	Epoch 1632 | loss: nan | val_loss: nan | Time: 2576.35 ms
[2022-04-03 04:16:43	                main:574]	:	INFO	:	Epoch 1633 | loss: nan | val_loss: nan | Time: 2549.61 ms
[2022-04-03 04:16:46	                main:574]	:	INFO	:	Epoch 1634 | loss: nan | val_loss: nan | Time: 2548.56 ms
[2022-04-03 04:16:48	                main:574]	:	INFO	:	Epoch 1635 | loss: nan | val_loss: nan | Time: 2544.02 ms
[2022-04-03 04:16:51	                main:574]	:	INFO	:	Epoch 1636 | loss: nan | val_loss: nan | Time: 2589.34 ms
[2022-04-03 04:16:53	                main:574]	:	INFO	:	Epoch 1637 | loss: nan | val_loss: nan | Time: 2545.3 ms
[2022-04-03 04:16:56	                main:574]	:	INFO	:	Epoch 1638 | loss: nan | val_loss: nan | Time: 2537.34 ms
[2022-04-03 04:16:58	                main:574]	:	INFO	:	Epoch 1639 | loss: nan | val_loss: nan | Time: 2568.45 ms
[2022-04-03 04:17:01	                main:574]	:	INFO	:	Epoch 1640 | loss: nan | val_loss: nan | Time: 2554.09 ms
[2022-04-03 04:17:04	                main:574]	:	INFO	:	Epoch 1641 | loss: nan | val_loss: nan | Time: 2562.06 ms
[2022-04-03 04:17:06	                main:574]	:	INFO	:	Epoch 1642 | loss: nan | val_loss: nan | Time: 2611.6 ms
[2022-04-03 04:17:09	                main:574]	:	INFO	:	Epoch 1643 | loss: nan | val_loss: nan | Time: 2580.53 ms
[2022-04-03 04:17:11	                main:574]	:	INFO	:	Epoch 1644 | loss: nan | val_loss: nan | Time: 2617.16 ms
[2022-04-03 04:17:14	                main:574]	:	INFO	:	Epoch 1645 | loss: nan | val_loss: nan | Time: 2560.25 ms
[2022-04-03 04:17:16	                main:574]	:	INFO	:	Epoch 1646 | loss: nan | val_loss: nan | Time: 2567.18 ms
[2022-04-03 04:17:19	                main:574]	:	INFO	:	Epoch 1647 | loss: nan | val_loss: nan | Time: 2567.69 ms
[2022-04-03 04:17:22	                main:574]	:	INFO	:	Epoch 1648 | loss: nan | val_loss: nan | Time: 2564.52 ms
[2022-04-03 04:17:24	                main:574]	:	INFO	:	Epoch 1649 | loss: nan | val_loss: nan | Time: 2574.9 ms
[2022-04-03 04:17:27	                main:574]	:	INFO	:	Epoch 1650 | loss: nan | val_loss: nan | Time: 2598.47 ms
[2022-04-03 04:17:29	                main:574]	:	INFO	:	Epoch 1651 | loss: nan | val_loss: nan | Time: 2543.16 ms
[2022-04-03 04:17:32	                main:574]	:	INFO	:	Epoch 1652 | loss: nan | val_loss: nan | Time: 2548.19 ms
[2022-04-03 04:17:34	                main:574]	:	INFO	:	Epoch 1653 | loss: nan | val_loss: nan | Time: 2512.46 ms
[2022-04-03 04:17:37	                main:574]	:	INFO	:	Epoch 1654 | loss: nan | val_loss: nan | Time: 2572.25 ms
[2022-04-03 04:17:40	                main:574]	:	INFO	:	Epoch 1655 | loss: nan | val_loss: nan | Time: 2584.68 ms
[2022-04-03 04:17:42	                main:574]	:	INFO	:	Epoch 1656 | loss: nan | val_loss: nan | Time: 2542.83 ms
[2022-04-03 04:17:45	                main:574]	:	INFO	:	Epoch 1657 | loss: nan | val_loss: nan | Time: 2604.46 ms
[2022-04-03 04:17:47	                main:574]	:	INFO	:	Epoch 1658 | loss: nan | val_loss: nan | Time: 2595.97 ms
[2022-04-03 04:17:50	                main:574]	:	INFO	:	Epoch 1659 | loss: nan | val_loss: nan | Time: 2558.22 ms
[2022-04-03 04:17:53	                main:574]	:	INFO	:	Epoch 1660 | loss: nan | val_loss: nan | Time: 2646.05 ms
[2022-04-03 04:17:55	                main:574]	:	INFO	:	Epoch 1661 | loss: nan | val_loss: nan | Time: 2602.66 ms
[2022-04-03 04:17:58	                main:574]	:	INFO	:	Epoch 1662 | loss: nan | val_loss: nan | Time: 2619.3 ms
[2022-04-03 04:18:00	                main:574]	:	INFO	:	Epoch 1663 | loss: nan | val_loss: nan | Time: 2551.5 ms
[2022-04-03 04:18:03	                main:574]	:	INFO	:	Epoch 1664 | loss: nan | val_loss: nan | Time: 2615.67 ms
[2022-04-03 04:18:06	                main:574]	:	INFO	:	Epoch 1665 | loss: nan | val_loss: nan | Time: 2603.14 ms
[2022-04-03 04:18:08	                main:574]	:	INFO	:	Epoch 1666 | loss: nan | val_loss: nan | Time: 2559.52 ms
[2022-04-03 04:18:11	                main:574]	:	INFO	:	Epoch 1667 | loss: nan | val_loss: nan | Time: 2612.59 ms
[2022-04-03 04:18:13	                main:574]	:	INFO	:	Epoch 1668 | loss: nan | val_loss: nan | Time: 2586.91 ms
[2022-04-03 04:18:16	                main:574]	:	INFO	:	Epoch 1669 | loss: nan | val_loss: nan | Time: 2575.62 ms
[2022-04-03 04:18:18	                main:574]	:	INFO	:	Epoch 1670 | loss: nan | val_loss: nan | Time: 2585.26 ms
[2022-04-03 04:18:21	                main:574]	:	INFO	:	Epoch 1671 | loss: nan | val_loss: nan | Time: 2584.69 ms
[2022-04-03 04:18:24	                main:574]	:	INFO	:	Epoch 1672 | loss: nan | val_loss: nan | Time: 2540.14 ms
[2022-04-03 04:18:26	                main:574]	:	INFO	:	Epoch 1673 | loss: nan | val_loss: nan | Time: 2537.1 ms
[2022-04-03 04:18:29	                main:574]	:	INFO	:	Epoch 1674 | loss: nan | val_loss: nan | Time: 2518 ms
[2022-04-03 04:18:31	                main:574]	:	INFO	:	Epoch 1675 | loss: nan | val_loss: nan | Time: 2656.78 ms
[2022-04-03 04:18:34	                main:574]	:	INFO	:	Epoch 1676 | loss: nan | val_loss: nan | Time: 2520.54 ms
[2022-04-03 04:18:36	                main:574]	:	INFO	:	Epoch 1677 | loss: nan | val_loss: nan | Time: 2563.1 ms
[2022-04-03 04:18:39	                main:574]	:	INFO	:	Epoch 1678 | loss: nan | val_loss: nan | Time: 2541.68 ms
[2022-04-03 04:18:41	                main:574]	:	INFO	:	Epoch 1679 | loss: nan | val_loss: nan | Time: 2532.99 ms
[2022-04-03 04:18:44	                main:574]	:	INFO	:	Epoch 1680 | loss: nan | val_loss: nan | Time: 2547.13 ms
[2022-04-03 04:18:47	                main:574]	:	INFO	:	Epoch 1681 | loss: nan | val_loss: nan | Time: 2596.56 ms
[2022-04-03 04:18:49	                main:574]	:	INFO	:	Epoch 1682 | loss: nan | val_loss: nan | Time: 2515.49 ms
[2022-04-03 04:18:52	                main:574]	:	INFO	:	Epoch 1683 | loss: nan | val_loss: nan | Time: 2578.99 ms
[2022-04-03 04:18:54	                main:574]	:	INFO	:	Epoch 1684 | loss: nan | val_loss: nan | Time: 2549.84 ms
[2022-04-03 04:18:57	                main:574]	:	INFO	:	Epoch 1685 | loss: nan | val_loss: nan | Time: 2567.75 ms
[2022-04-03 04:18:59	                main:574]	:	INFO	:	Epoch 1686 | loss: nan | val_loss: nan | Time: 2568.97 ms
[2022-04-03 04:19:02	                main:574]	:	INFO	:	Epoch 1687 | loss: nan | val_loss: nan | Time: 2565.58 ms
[2022-04-03 04:19:05	                main:574]	:	INFO	:	Epoch 1688 | loss: nan | val_loss: nan | Time: 2591 ms
[2022-04-03 04:19:07	                main:574]	:	INFO	:	Epoch 1689 | loss: nan | val_loss: nan | Time: 2560.2 ms
[2022-04-03 04:19:10	                main:574]	:	INFO	:	Epoch 1690 | loss: nan | val_loss: nan | Time: 2521.36 ms
[2022-04-03 04:19:12	                main:574]	:	INFO	:	Epoch 1691 | loss: nan | val_loss: nan | Time: 2567.64 ms
[2022-04-03 04:19:15	                main:574]	:	INFO	:	Epoch 1692 | loss: nan | val_loss: nan | Time: 2466.45 ms
[2022-04-03 04:19:17	                main:574]	:	INFO	:	Epoch 1693 | loss: nan | val_loss: nan | Time: 2556.07 ms
[2022-04-03 04:19:20	                main:574]	:	INFO	:	Epoch 1694 | loss: nan | val_loss: nan | Time: 2516.05 ms
[2022-04-03 04:19:22	                main:574]	:	INFO	:	Epoch 1695 | loss: nan | val_loss: nan | Time: 2586.49 ms
[2022-04-03 04:19:25	                main:574]	:	INFO	:	Epoch 1696 | loss: nan | val_loss: nan | Time: 2523.13 ms
[2022-04-03 04:19:27	                main:574]	:	INFO	:	Epoch 1697 | loss: nan | val_loss: nan | Time: 2528.96 ms
[2022-04-03 04:19:30	                main:574]	:	INFO	:	Epoch 1698 | loss: nan | val_loss: nan | Time: 2588.91 ms
[2022-04-03 04:19:33	                main:574]	:	INFO	:	Epoch 1699 | loss: nan | val_loss: nan | Time: 2529.85 ms
[2022-04-03 04:19:35	                main:574]	:	INFO	:	Epoch 1700 | loss: nan | val_loss: nan | Time: 2538.69 ms
[2022-04-03 04:19:38	                main:574]	:	INFO	:	Epoch 1701 | loss: nan | val_loss: nan | Time: 2569.12 ms
[2022-04-03 04:19:40	                main:574]	:	INFO	:	Epoch 1702 | loss: nan | val_loss: nan | Time: 2580.36 ms
[2022-04-03 04:19:43	                main:574]	:	INFO	:	Epoch 1703 | loss: nan | val_loss: nan | Time: 2528.57 ms
[2022-04-03 04:19:45	                main:574]	:	INFO	:	Epoch 1704 | loss: nan | val_loss: nan | Time: 2593.5 ms
[2022-04-03 04:19:48	                main:574]	:	INFO	:	Epoch 1705 | loss: nan | val_loss: nan | Time: 2555.55 ms
[2022-04-03 04:19:50	                main:574]	:	INFO	:	Epoch 1706 | loss: nan | val_loss: nan | Time: 2584.7 ms
[2022-04-03 04:19:53	                main:574]	:	INFO	:	Epoch 1707 | loss: nan | val_loss: nan | Time: 2645.59 ms
[2022-04-03 04:19:56	                main:574]	:	INFO	:	Epoch 1708 | loss: nan | val_loss: nan | Time: 2526.78 ms
[2022-04-03 04:19:58	                main:574]	:	INFO	:	Epoch 1709 | loss: nan | val_loss: nan | Time: 2537.13 ms
[2022-04-03 04:20:01	                main:574]	:	INFO	:	Epoch 1710 | loss: nan | val_loss: nan | Time: 2628.03 ms
[2022-04-03 04:20:03	                main:574]	:	INFO	:	Epoch 1711 | loss: nan | val_loss: nan | Time: 2575.77 ms
[2022-04-03 04:20:06	                main:574]	:	INFO	:	Epoch 1712 | loss: nan | val_loss: nan | Time: 2550.03 ms
[2022-04-03 04:20:08	                main:574]	:	INFO	:	Epoch 1713 | loss: nan | val_loss: nan | Time: 2511.13 ms
[2022-04-03 04:20:11	                main:574]	:	INFO	:	Epoch 1714 | loss: nan | val_loss: nan | Time: 2627.63 ms
[2022-04-03 04:20:14	                main:574]	:	INFO	:	Epoch 1715 | loss: nan | val_loss: nan | Time: 2542.15 ms
[2022-04-03 04:20:16	                main:574]	:	INFO	:	Epoch 1716 | loss: nan | val_loss: nan | Time: 2572.66 ms
[2022-04-03 04:20:19	                main:574]	:	INFO	:	Epoch 1717 | loss: nan | val_loss: nan | Time: 2551.56 ms
[2022-04-03 04:20:21	                main:574]	:	INFO	:	Epoch 1718 | loss: nan | val_loss: nan | Time: 2533.37 ms
[2022-04-03 04:20:24	                main:574]	:	INFO	:	Epoch 1719 | loss: nan | val_loss: nan | Time: 2549.04 ms
[2022-04-03 04:20:26	                main:574]	:	INFO	:	Epoch 1720 | loss: nan | val_loss: nan | Time: 2542.58 ms
[2022-04-03 04:20:29	                main:574]	:	INFO	:	Epoch 1721 | loss: nan | val_loss: nan | Time: 2534.85 ms
[2022-04-03 04:20:32	                main:574]	:	INFO	:	Epoch 1722 | loss: nan | val_loss: nan | Time: 2554.56 ms
[2022-04-03 04:20:34	                main:574]	:	INFO	:	Epoch 1723 | loss: nan | val_loss: nan | Time: 2522.44 ms
[2022-04-03 04:20:37	                main:574]	:	INFO	:	Epoch 1724 | loss: nan | val_loss: nan | Time: 2511.87 ms
[2022-04-03 04:20:39	                main:574]	:	INFO	:	Epoch 1725 | loss: nan | val_loss: nan | Time: 2567.31 ms
[2022-04-03 04:20:42	                main:574]	:	INFO	:	Epoch 1726 | loss: nan | val_loss: nan | Time: 2623.06 ms
[2022-04-03 04:20:44	                main:574]	:	INFO	:	Epoch 1727 | loss: nan | val_loss: nan | Time: 2535.23 ms
[2022-04-03 04:20:47	                main:574]	:	INFO	:	Epoch 1728 | loss: nan | val_loss: nan | Time: 2565.06 ms
[2022-04-03 04:20:49	                main:574]	:	INFO	:	Epoch 1729 | loss: nan | val_loss: nan | Time: 2526.89 ms
[2022-04-03 04:20:52	                main:574]	:	INFO	:	Epoch 1730 | loss: nan | val_loss: nan | Time: 2599.07 ms
[2022-04-03 04:20:55	                main:574]	:	INFO	:	Epoch 1731 | loss: nan | val_loss: nan | Time: 2606.62 ms
[2022-04-03 04:20:57	                main:574]	:	INFO	:	Epoch 1732 | loss: nan | val_loss: nan | Time: 2527.99 ms
[2022-04-03 04:21:00	                main:574]	:	INFO	:	Epoch 1733 | loss: nan | val_loss: nan | Time: 2554.4 ms
[2022-04-03 04:21:02	                main:574]	:	INFO	:	Epoch 1734 | loss: nan | val_loss: nan | Time: 2571.8 ms
[2022-04-03 04:21:05	                main:574]	:	INFO	:	Epoch 1735 | loss: nan | val_loss: nan | Time: 2557.97 ms
[2022-04-03 04:21:07	                main:574]	:	INFO	:	Epoch 1736 | loss: nan | val_loss: nan | Time: 2602.37 ms
[2022-04-03 04:21:10	                main:574]	:	INFO	:	Epoch 1737 | loss: nan | val_loss: nan | Time: 2554.12 ms
[2022-04-03 04:21:13	                main:574]	:	INFO	:	Epoch 1738 | loss: nan | val_loss: nan | Time: 2592.02 ms
[2022-04-03 04:21:15	                main:574]	:	INFO	:	Epoch 1739 | loss: nan | val_loss: nan | Time: 2568.68 ms
[2022-04-03 04:21:18	                main:574]	:	INFO	:	Epoch 1740 | loss: nan | val_loss: nan | Time: 2539.57 ms
[2022-04-03 04:21:20	                main:574]	:	INFO	:	Epoch 1741 | loss: nan | val_loss: nan | Time: 2547.47 ms
[2022-04-03 04:21:23	                main:574]	:	INFO	:	Epoch 1742 | loss: nan | val_loss: nan | Time: 2643.04 ms
[2022-04-03 04:21:25	                main:574]	:	INFO	:	Epoch 1743 | loss: nan | val_loss: nan | Time: 2517.81 ms
[2022-04-03 04:21:28	                main:574]	:	INFO	:	Epoch 1744 | loss: nan | val_loss: nan | Time: 2580.13 ms
[2022-04-03 04:21:31	                main:574]	:	INFO	:	Epoch 1745 | loss: nan | val_loss: nan | Time: 2579.08 ms
[2022-04-03 04:21:33	                main:574]	:	INFO	:	Epoch 1746 | loss: nan | val_loss: nan | Time: 2499.45 ms
[2022-04-03 04:21:36	                main:574]	:	INFO	:	Epoch 1747 | loss: nan | val_loss: nan | Time: 2549.09 ms
[2022-04-03 04:21:38	                main:574]	:	INFO	:	Epoch 1748 | loss: nan | val_loss: nan | Time: 2566.16 ms
[2022-04-03 04:21:41	                main:574]	:	INFO	:	Epoch 1749 | loss: nan | val_loss: nan | Time: 2627.87 ms
[2022-04-03 04:21:43	                main:574]	:	INFO	:	Epoch 1750 | loss: nan | val_loss: nan | Time: 2551.65 ms
[2022-04-03 04:21:46	                main:574]	:	INFO	:	Epoch 1751 | loss: nan | val_loss: nan | Time: 2505.83 ms
[2022-04-03 04:21:48	                main:574]	:	INFO	:	Epoch 1752 | loss: nan | val_loss: nan | Time: 2561.61 ms
[2022-04-03 04:21:51	                main:574]	:	INFO	:	Epoch 1753 | loss: nan | val_loss: nan | Time: 2518.8 ms
[2022-04-03 04:21:54	                main:574]	:	INFO	:	Epoch 1754 | loss: nan | val_loss: nan | Time: 2572.78 ms
[2022-04-03 04:21:56	                main:574]	:	INFO	:	Epoch 1755 | loss: nan | val_loss: nan | Time: 2565.05 ms
[2022-04-03 04:21:59	                main:574]	:	INFO	:	Epoch 1756 | loss: nan | val_loss: nan | Time: 2538.86 ms
[2022-04-03 04:22:01	                main:574]	:	INFO	:	Epoch 1757 | loss: nan | val_loss: nan | Time: 2494.29 ms
[2022-04-03 04:22:04	                main:574]	:	INFO	:	Epoch 1758 | loss: nan | val_loss: nan | Time: 2549.79 ms
[2022-04-03 04:22:06	                main:574]	:	INFO	:	Epoch 1759 | loss: nan | val_loss: nan | Time: 2574.72 ms
[2022-04-03 04:22:09	                main:574]	:	INFO	:	Epoch 1760 | loss: nan | val_loss: nan | Time: 2546.55 ms
[2022-04-03 04:22:11	                main:574]	:	INFO	:	Epoch 1761 | loss: nan | val_loss: nan | Time: 2510.61 ms
[2022-04-03 04:22:14	                main:574]	:	INFO	:	Epoch 1762 | loss: nan | val_loss: nan | Time: 2587.95 ms
[2022-04-03 04:22:16	                main:574]	:	INFO	:	Epoch 1763 | loss: nan | val_loss: nan | Time: 2558.65 ms
[2022-04-03 04:22:19	                main:574]	:	INFO	:	Epoch 1764 | loss: nan | val_loss: nan | Time: 2497.16 ms
[2022-04-03 04:22:21	                main:574]	:	INFO	:	Epoch 1765 | loss: nan | val_loss: nan | Time: 2532.92 ms
[2022-04-03 04:22:24	                main:574]	:	INFO	:	Epoch 1766 | loss: nan | val_loss: nan | Time: 2606.95 ms
[2022-04-03 04:22:27	                main:574]	:	INFO	:	Epoch 1767 | loss: nan | val_loss: nan | Time: 2540.53 ms
[2022-04-03 04:22:29	                main:574]	:	INFO	:	Epoch 1768 | loss: nan | val_loss: nan | Time: 2598.84 ms
[2022-04-03 04:22:32	                main:574]	:	INFO	:	Epoch 1769 | loss: nan | val_loss: nan | Time: 2596.2 ms
[2022-04-03 04:22:34	                main:574]	:	INFO	:	Epoch 1770 | loss: nan | val_loss: nan | Time: 2516.43 ms
[2022-04-03 04:22:37	                main:574]	:	INFO	:	Epoch 1771 | loss: nan | val_loss: nan | Time: 2530.99 ms
[2022-04-03 04:22:39	                main:574]	:	INFO	:	Epoch 1772 | loss: nan | val_loss: nan | Time: 2523.3 ms
[2022-04-03 04:22:42	                main:574]	:	INFO	:	Epoch 1773 | loss: nan | val_loss: nan | Time: 2577.13 ms
[2022-04-03 04:22:45	                main:574]	:	INFO	:	Epoch 1774 | loss: nan | val_loss: nan | Time: 2551.85 ms
[2022-04-03 04:22:47	                main:574]	:	INFO	:	Epoch 1775 | loss: nan | val_loss: nan | Time: 2529.89 ms
[2022-04-03 04:22:50	                main:574]	:	INFO	:	Epoch 1776 | loss: nan | val_loss: nan | Time: 2565.03 ms
[2022-04-03 04:22:52	                main:574]	:	INFO	:	Epoch 1777 | loss: nan | val_loss: nan | Time: 2563.26 ms
[2022-04-03 04:22:55	                main:574]	:	INFO	:	Epoch 1778 | loss: nan | val_loss: nan | Time: 2551.39 ms
[2022-04-03 04:22:57	                main:574]	:	INFO	:	Epoch 1779 | loss: nan | val_loss: nan | Time: 2538.07 ms
[2022-04-03 04:23:00	                main:574]	:	INFO	:	Epoch 1780 | loss: nan | val_loss: nan | Time: 2563.77 ms
[2022-04-03 04:23:02	                main:574]	:	INFO	:	Epoch 1781 | loss: nan | val_loss: nan | Time: 2553.31 ms
[2022-04-03 04:23:05	                main:574]	:	INFO	:	Epoch 1782 | loss: nan | val_loss: nan | Time: 2549.57 ms
[2022-04-03 04:23:08	                main:574]	:	INFO	:	Epoch 1783 | loss: nan | val_loss: nan | Time: 2550.22 ms
[2022-04-03 04:23:10	                main:574]	:	INFO	:	Epoch 1784 | loss: nan | val_loss: nan | Time: 2511.09 ms
[2022-04-03 04:23:13	                main:574]	:	INFO	:	Epoch 1785 | loss: nan | val_loss: nan | Time: 2536.58 ms
[2022-04-03 04:23:15	                main:574]	:	INFO	:	Epoch 1786 | loss: nan | val_loss: nan | Time: 2575.37 ms
[2022-04-03 04:23:18	                main:574]	:	INFO	:	Epoch 1787 | loss: nan | val_loss: nan | Time: 2593.76 ms
[2022-04-03 04:23:20	                main:574]	:	INFO	:	Epoch 1788 | loss: nan | val_loss: nan | Time: 2566.84 ms
[2022-04-03 04:23:23	                main:574]	:	INFO	:	Epoch 1789 | loss: nan | val_loss: nan | Time: 2522.21 ms
[2022-04-03 04:23:25	                main:574]	:	INFO	:	Epoch 1790 | loss: nan | val_loss: nan | Time: 2526.35 ms
[2022-04-03 04:23:28	                main:574]	:	INFO	:	Epoch 1791 | loss: nan | val_loss: nan | Time: 2585.44 ms
[2022-04-03 04:23:31	                main:574]	:	INFO	:	Epoch 1792 | loss: nan | val_loss: nan | Time: 2613.56 ms
[2022-04-03 04:23:33	                main:574]	:	INFO	:	Epoch 1793 | loss: nan | val_loss: nan | Time: 2442.36 ms
[2022-04-03 04:23:36	                main:574]	:	INFO	:	Epoch 1794 | loss: nan | val_loss: nan | Time: 2797.92 ms
[2022-04-03 04:23:38	                main:574]	:	INFO	:	Epoch 1795 | loss: nan | val_loss: nan | Time: 2534.7 ms
[2022-04-03 04:23:41	                main:574]	:	INFO	:	Epoch 1796 | loss: nan | val_loss: nan | Time: 2473.97 ms
[2022-04-03 04:23:43	                main:574]	:	INFO	:	Epoch 1797 | loss: nan | val_loss: nan | Time: 2611.1 ms
[2022-04-03 04:23:46	                main:574]	:	INFO	:	Epoch 1798 | loss: nan | val_loss: nan | Time: 2615.64 ms
[2022-04-03 04:23:49	                main:574]	:	INFO	:	Epoch 1799 | loss: nan | val_loss: nan | Time: 2601.73 ms
[2022-04-03 04:23:51	                main:574]	:	INFO	:	Epoch 1800 | loss: nan | val_loss: nan | Time: 2635.63 ms
[2022-04-03 04:23:54	                main:574]	:	INFO	:	Epoch 1801 | loss: nan | val_loss: nan | Time: 3020.58 ms
[2022-04-03 04:23:57	                main:574]	:	INFO	:	Epoch 1802 | loss: nan | val_loss: nan | Time: 3021.41 ms
[2022-04-03 04:24:00	                main:574]	:	INFO	:	Epoch 1803 | loss: nan | val_loss: nan | Time: 3056.77 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 1650 SUPER)
[2022-04-03 05:21:33	                main:435]	:	INFO	:	Set logging level to 1
[2022-04-03 05:21:33	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-04-03 05:21:33	                main:444]	:	INFO	:	Resolving all filenames
[2022-04-03 05:21:33	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-03 05:21:33	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-03 05:21:33	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-03 05:21:33	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-03 05:21:33	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-03 05:21:33	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-04-03 05:21:33	                main:474]	:	INFO	:	Configuration: 
[2022-04-03 05:21:33	                main:475]	:	INFO	:	    Model type: GRU
[2022-04-03 05:21:33	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-04-03 05:21:33	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-04-03 05:21:33	                main:478]	:	INFO	:	    Batch Size: 128
[2022-04-03 05:21:33	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-04-03 05:21:33	                main:480]	:	INFO	:	    Patience: 10
[2022-04-03 05:21:33	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-04-03 05:21:33	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-04-03 05:21:33	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-04-03 05:21:33	                main:484]	:	INFO	:	    # Threads: 1
[2022-04-03 05:21:33	                main:486]	:	INFO	:	Preparing Dataset
[2022-04-03 05:21:33	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-03 05:21:33	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-03 05:21:34	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-04-03 05:21:34	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-03 05:21:34	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-03 05:21:34	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-04-03 05:21:34	                main:494]	:	INFO	:	Creating Model
[2022-04-03 05:21:34	                main:507]	:	INFO	:	Preparing config file
[2022-04-03 05:21:34	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-04-03 05:21:34	                main:512]	:	INFO	:	Loading config


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFB44DC466C

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 04/03/22 05:21:34
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\0;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 0000000013a90000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000047720000 0000000000209000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.22000.527) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.22000.434 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.434

ModLoad: 0000000045a40000 00000000000bd000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.22000.434) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.22000.434 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.434

ModLoad: 0000000044d80000 0000000000374000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.22000.593) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.22000.434 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.434

ModLoad: 00000000455c0000 00000000001ac000 C:\WINDOWS\System32\USER32.dll (6.2.22000.282) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000045100000 0000000000026000 C:\WINDOWS\System32\win32u.dll (6.2.22000.593) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.22000.593 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.593

ModLoad: 0000000047190000 0000000000029000 C:\WINDOWS\System32\GDI32.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000454a0000 0000000000112000 C:\WINDOWS\System32\gdi32full.dll (6.2.22000.527) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.22000.527 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.527

ModLoad: 0000000031f60000 0000000000058000 C:\ProgramData\BOINC\slots\0\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000045130000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000045310000 0000000000111000 C:\WINDOWS\System32\ucrtbase.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000045b00000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.22000.434) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000046290000 00000000000a3000 C:\WINDOWS\System32\msvcrt.dll (7.0.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.22000.1

ModLoad: 0000000045f60000 000000000009e000 C:\WINDOWS\System32\sechost.dll (6.2.22000.556) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000046d90000 0000000000120000 C:\WINDOWS\System32\RPCRT4.dll (6.2.22000.434) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 000000002eda0000 0000000000221000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000031ec0000 0000000000099000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.24.28127.4) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.24.28127.4 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.24.28127.4

ModLoad: 00000000321a0000 0000000000017000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.24.28127.4) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.24.28127.4 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.24.28127.4

ModLoad: 000000003f000000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.24.28127.4) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.24.28127.4 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.24.28127.4

ModLoad: 000000006b4e0000 000000000abe7000 C:\ProgramData\BOINC\slots\0\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000fc4d0000 00000000002db000 C:\ProgramData\BOINC\slots\0\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000006f30000 000000000020d000 C:\ProgramData\BOINC\slots\0\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 0000000032070000 0000000000040000 C:\ProgramData\BOINC\slots\0\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000760d0000 0000000024b49000 C:\ProgramData\BOINC\slots\0\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000031e70000 0000000000045000 C:\ProgramData\BOINC\slots\0\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000d6640000 00000000034b2000 C:\ProgramData\BOINC\slots\0\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000dd6f0000 00000000030a5000 C:\ProgramData\BOINC\slots\0\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 000000003e690000 0000000000010000 C:\ProgramData\BOINC\slots\0\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 0000000043230000 0000000003d5b000 C:\ProgramData\BOINC\slots\0\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000f5ae0000 0000000001eca000 C:\ProgramData\BOINC\slots\0\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 0000000046f90000 000000000919f000 C:\ProgramData\BOINC\slots\0\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 0000000050130000 000000001b3a4000 C:\ProgramData\BOINC\slots\0\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 0000000047690000 0000000000031000 C:\WINDOWS\System32\IMM32.DLL (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000043dc0000 0000000000018000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.22000.71) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.22000.71 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.71

ModLoad: 0000000042510000 0000000000038000 C:\WINDOWS\SYSTEM32\dxcore.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : DXCore.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000471c0000 000000000046c000 C:\WINDOWS\System32\Setupapi.dll (6.2.22000.469) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000044930000 000000000002c000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000448e0000 000000000004c000 C:\WINDOWS\SYSTEM32\cfgmgr32.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000045430000 0000000000067000 C:\WINDOWS\System32\WINTRUST.dll (6.2.22000.527) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.22000.527 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.527

ModLoad: 0000000044c10000 0000000000162000 C:\WINDOWS\System32\CRYPT32.dll (6.2.22000.348) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000044500000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000463a0000 00000000007af000 C:\WINDOWS\System32\Shell32.dll (6.2.22000.593) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.22000.593 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.593

ModLoad: 0000000042d50000 0000000000868000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.22000.593) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.22000.184 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.184

ModLoad: 0000000045bd0000 0000000000378000 C:\WINDOWS\System32\combase.dll (6.2.22000.527) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000042be0000 0000000000166000 C:\WINDOWS\SYSTEM32\wintypes.dll (6.2.22000.527) (-exported- Symbols Loaded)
    Linked PDB Filename   : WinTypes.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000460f0000 00000000000ea000 C:\WINDOWS\System32\SHCORE.dll (6.2.22000.71) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000046340000 000000000005d000 C:\WINDOWS\System32\shlwapi.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000fbf60000 0000000000267000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.5671) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r456_61\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 27.21.14.5671
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.1.96 driver
    Product Version       : 27.21.14.5671

ModLoad: 000000003c240000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000f3db0000 000000000152a000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_1c83a5d7cffd7bff\nvcuda64.dll (27.21.14.5671) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r456_61\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 27.21.14.5671
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.1.96 driver
    Product Version       : 27.21.14.5671

ModLoad: 00000000458b0000 000000000006f000 C:\WINDOWS\System32\WS2_32.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : ws2_32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 000000003bf80000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000443d0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000042260000 00000000000ac000 C:\WINDOWS\system32\uxtheme.dll (6.2.22000.120) (-exported- Symbols Loaded)
    Linked PDB Filename   : uxtheme.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000353e0000 00000000006d5000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.5671) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r456_61\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 27.21.14.5671
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 27.21.14.5671

ModLoad: 0000000046eb0000 000000000019a000 C:\WINDOWS\System32\OLE32.DLL (6.2.22000.120) (-exported- Symbols Loaded)
    Linked PDB Filename   : ole32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000045290000 000000000007f000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.22000.376) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.22000.376 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.376



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3621, Write: 307, Other 887

- I/O Transfers Counters -
Read: 6712983, Write: 6049, Other 30186

- Paged Pool Usage -
QuotaPagedPoolUsage: 3460264, QuotaPeakPagedPoolUsage: 3460264
QuotaNonPagedPoolUsage: 41576, QuotaPeakNonPagedPoolUsage: 41640

- Virtual Memory Usage -
VirtualSize: -1284694016, PeakVirtualSize: -681185280

- Pagefile Usage -
PagefileUsage: -1284694016, PeakPagefileUsage: -1284694016

- Working Set Size -
WorkingSetSize: 1227907072, PeakWorkingSetSize: 1227907072, PageFaultCount: 427208

*** Dump of thread ID 1108 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 2500000.000000, User Time: 15468750.000000, Wait Time: 1460194.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFB44DC466C

- Registers -
rax=0000000047748300 rbx=0000000013df4910 rcx=000000004590331d rdx=00000000f26e5f50 rsi=00000000f26e67b0 rdi=0000000019930520
r8=0000000000000004 r9=00000000f26e5fa8 r10=0000000000000004 r11=00000000251488d0 r12=000000004e936c60 r13=00000000f26e69c0
r14=0000000052d4c0e0 r15=0000000000000000 rip=0000000044dc466c rsp=00000000f26e6650 rbp=00000000f26e6940
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
f26e6720 13d0a884 00000040 0000004f 4e936c00 13d2fd48 KERNELBASE!RaiseException+0x0 
f26e6780 13ab1ca6 00000000 00000383 45a8d200 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
f26e6830 13ab593b 00000000 00000020 00000000 00000030 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
f26e6980 13ab1a78 00000000 00000000 f26e6cb0 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
f26e6a50 13ab1cfc f26e6cb0 00000000 00000080 f26e6f80 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
f26e6b10 13abc4dd f26e6f80 f26e6f80 f26e6f80 f26e6f80 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
f26e6e00 13aab2fe f26e7418 f26e6f80 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
f26ffba0 13cec6f8 6b93e2d0 00000000 00000000 69e76c80 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
f26ffbe0 45a554e0 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
f26ffc10 4772485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
f26ffc90 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 1032 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 1460082.000000

- Registers -
rax=00000000000001de rbx=0000000069e69c20 rcx=0000000000000074 rdx=0000000069e698a0 rsi=0000000069e67420 rdi=0000000069e69c20
r8=00000000f27ff250 r9=0000000000000000 r10=00000000f27ff396 r11=00000000f27ff050 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000477c7304 rsp=00000000f27ffac8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
f27ffac0 47736c2f 00000000 00000000 69e67420 69e69c20 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
f27ffdb0 45a554e0 00000000 00000000 00000000 00000000 ntdll!EtwNotificationRegister+0x0 
f27ffde0 4772485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
f27ffe60 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 11796 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 312500.000000, User Time: 0.000000, Wait Time: 1460082.000000

- Registers -
rax=00000000000001de rbx=0000000069e6a280 rcx=0000000000000074 rdx=0000000069e69f00 rsi=0000000069e67420 rdi=0000000069e6a280
r8=000000003c245004 r9=0000000000000000 r10=000000003c2400f0 r11=0000000000000001 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000477c7304 rsp=00000000f28ff8d8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
f28ff8d0 47736c2f 00000000 00000000 69e67420 69e6a280 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
f28ffbc0 45a554e0 00000000 00000000 00000000 00000000 ntdll!EtwNotificationRegister+0x0 
f28ffbf0 4772485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
f28ffc70 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 4140 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 312500.000000, User Time: 0.000000, Wait Time: 1460083.000000

- Registers -
rax=00000000000001de rbx=0000000069e6b280 rcx=0000000000000074 rdx=0000000069e6af00 rsi=0000000069e67420 rdi=0000000069e6b280
r8=0000000000000008 r9=0000000000000040 r10=00000000000005c0 r11=0000000000127c03 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000477c7304 rsp=00000000f29ff8f8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
f29ff8f0 47736c2f 00000000 00000000 69e67420 69e6b280 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
f29ffbe0 45a554e0 00000000 00000000 00000000 00000000 ntdll!EtwNotificationRegister+0x0 
f29ffc10 4772485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
f29ffc90 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 8212 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 1460194.000000

- Registers -
rax=0000000000000034 rbx=00000000f2bffb50 rcx=0000000000000000 rdx=00000000f2bffb50 rsi=00000000f254f000 rdi=0000000000000000
r8=0000000000000001 r9=00000000004e2000 r10=0000000000000002 r11=00000000000001cc r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000477c3dd4 rsp=00000000f2bffa88 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
f2bffa80 4777b5c3 00000000 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0 
f2bffab0 44dcb281 00000000 00000000 00000000 00000000 ntdll!RtlDelayExecution+0x0 
f2bffb30 13aca07f 00000000 00000000 fff0bdc0 00000000 KERNELBASE!SleepEx+0x0 
f2bffb60 45a554e0 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
f2bffb90 4772485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
f2bffc10 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 6344 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 1460189.000000

- Registers -
rax=000000000000005b rbx=0000000000000007 rcx=0000000000000007 rdx=00000000f2cffb40 rsi=0000000000000000 rdi=0000000000000007
r8=0000000000000001 r9=0000000000000000 r10=0000000000000000 r11=00000000f2cffab0 r12=0000000000000064 r13=00000000f2cffb40
r14=00000000f2cff840 r15=0000000000000000 rip=00000000477c42a4 rsp=00000000f2cff7e8 rbp=000000006badb640
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
f2cff7e0 44dcf9f0 00000000 00000000 00000000 00000000 ntdll!NtWaitForMultipleObjects+0x0 
f2cffad0 44dcf8ee f42a3b48 6bbf7b60 00000007 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
f2cffb10 f3f5ba44 6bade520 00000000 6bad9e40 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
f2cffd50 f3ff08dd 00000000 00000004 00000000 00000000 nvcuda64!+0x0 
f2cffe00 f3f5b413 1f36c694 1e6af0df 6bfcb7e0 00000000 nvcuda64!cuProfilerStop+0x0 
f2cffe30 f4269200 6bfcb7e0 00000000 00000000 00000000 nvcuda64!+0x0 
f2cffe60 45a554e0 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
f2cffe90 4772485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
f2cfff10 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 9876 (state: Waiting): ***

- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 1460179.000000

- Registers -
rax=00000000000001db rbx=0000000000000000 rcx=000000006bbf2e88 rdx=00000000f2dffd18 rsi=0000000000000102 rdi=0000000000000000
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=00000000f2dffd18 r13=0000000000000000
r14=000000006bdb4cb8 r15=000000006bbf2e88 rip=00000000477c72a4 rsp=00000000f2dffc58 rbp=00000000f2dffcb0
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
f2dffc50 4778a2da 00000102 00000102 00000000 f2dffc80 ntdll!NtWaitForAlertByThreadId+0x0 
f2dffcc0 44ddd329 6bdb24a0 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0 
f2dffcf0 f3ee21da 6bdb24a0 47726800 6bdb24a0 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0 
f2dffd50 f3f5b413 00000001 1efd8dd1 00000000 00000000 nvcuda64!+0x0 
f2dffd80 f4269200 6bfcbb40 00000000 00000000 00000000 nvcuda64!+0x0 
f2dffdb0 45a554e0 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
f2dffde0 4772485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
f2dffe60 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)