Task 12580013

Name ParityModified-1645993964-4651-2-0_0
Workunit 9739861
Created 5 Mar 2022, 18:59:50 UTC
Sent 10 Mar 2022, 17:43:17 UTC
Report deadline 18 Mar 2022, 17:43:17 UTC
Received 14 Mar 2022, 21:11:36 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 16717
Run time 2 hours 32 min 22 sec
CPU time 2 hours 20 min 41 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 2,142.53 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.63 GB
Peak swap size 3.59 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
_loss: nan | Time: 4958.45 ms
[2022-03-14 20:42:28	                main:574]	:	INFO	:	Epoch 1586 | loss: nan | val_loss: nan | Time: 5050.57 ms
[2022-03-14 20:42:33	                main:574]	:	INFO	:	Epoch 1587 | loss: nan | val_loss: nan | Time: 5221.54 ms
[2022-03-14 20:42:38	                main:574]	:	INFO	:	Epoch 1588 | loss: nan | val_loss: nan | Time: 4845.56 ms
[2022-03-14 20:42:43	                main:574]	:	INFO	:	Epoch 1589 | loss: nan | val_loss: nan | Time: 5011.98 ms
[2022-03-14 20:42:48	                main:574]	:	INFO	:	Epoch 1590 | loss: nan | val_loss: nan | Time: 4958.96 ms
[2022-03-14 20:42:53	                main:574]	:	INFO	:	Epoch 1591 | loss: nan | val_loss: nan | Time: 5070.5 ms
[2022-03-14 20:42:58	                main:574]	:	INFO	:	Epoch 1592 | loss: nan | val_loss: nan | Time: 4873.73 ms
[2022-03-14 20:43:03	                main:574]	:	INFO	:	Epoch 1593 | loss: nan | val_loss: nan | Time: 5094.55 ms
[2022-03-14 20:43:08	                main:574]	:	INFO	:	Epoch 1594 | loss: nan | val_loss: nan | Time: 4974.05 ms
[2022-03-14 20:43:13	                main:574]	:	INFO	:	Epoch 1595 | loss: nan | val_loss: nan | Time: 4946.95 ms
[2022-03-14 20:43:18	                main:574]	:	INFO	:	Epoch 1596 | loss: nan | val_loss: nan | Time: 5126.43 ms
[2022-03-14 20:43:23	                main:574]	:	INFO	:	Epoch 1597 | loss: nan | val_loss: nan | Time: 5054.84 ms
[2022-03-14 20:43:28	                main:574]	:	INFO	:	Epoch 1598 | loss: nan | val_loss: nan | Time: 5040.07 ms
[2022-03-14 20:43:33	                main:574]	:	INFO	:	Epoch 1599 | loss: nan | val_loss: nan | Time: 5028.9 ms
[2022-03-14 20:43:38	                main:574]	:	INFO	:	Epoch 1600 | loss: nan | val_loss: nan | Time: 5085.47 ms
[2022-03-14 20:43:43	                main:574]	:	INFO	:	Epoch 1601 | loss: nan | val_loss: nan | Time: 5010.24 ms
[2022-03-14 20:43:58	                main:574]	:	INFO	:	Epoch 1602 | loss: nan | val_loss: nan | Time: 15084.5 ms
[2022-03-14 20:44:03	                main:574]	:	INFO	:	Epoch 1603 | loss: nan | val_loss: nan | Time: 5029.94 ms
[2022-03-14 20:44:09	                main:574]	:	INFO	:	Epoch 1604 | loss: nan | val_loss: nan | Time: 5183.02 ms
[2022-03-14 20:44:14	                main:574]	:	INFO	:	Epoch 1605 | loss: nan | val_loss: nan | Time: 4927.19 ms
[2022-03-14 20:44:19	                main:574]	:	INFO	:	Epoch 1606 | loss: nan | val_loss: nan | Time: 4957.87 ms
[2022-03-14 20:44:23	                main:574]	:	INFO	:	Epoch 1607 | loss: nan | val_loss: nan | Time: 4944.78 ms
[2022-03-14 20:44:29	                main:574]	:	INFO	:	Epoch 1608 | loss: nan | val_loss: nan | Time: 5166.34 ms
[2022-03-14 20:44:34	                main:574]	:	INFO	:	Epoch 1609 | loss: nan | val_loss: nan | Time: 4985.95 ms
[2022-03-14 20:44:39	                main:574]	:	INFO	:	Epoch 1610 | loss: nan | val_loss: nan | Time: 4960.34 ms
[2022-03-14 20:44:44	                main:574]	:	INFO	:	Epoch 1611 | loss: nan | val_loss: nan | Time: 5147.62 ms
[2022-03-14 20:44:49	                main:574]	:	INFO	:	Epoch 1612 | loss: nan | val_loss: nan | Time: 4836.8 ms
[2022-03-14 20:44:54	                main:574]	:	INFO	:	Epoch 1613 | loss: nan | val_loss: nan | Time: 5078.34 ms
[2022-03-14 20:44:59	                main:574]	:	INFO	:	Epoch 1614 | loss: nan | val_loss: nan | Time: 5026.46 ms
[2022-03-14 20:45:04	                main:574]	:	INFO	:	Epoch 1615 | loss: nan | val_loss: nan | Time: 5018.56 ms
[2022-03-14 20:45:09	                main:574]	:	INFO	:	Epoch 1616 | loss: nan | val_loss: nan | Time: 5088.32 ms
[2022-03-14 20:45:14	                main:574]	:	INFO	:	Epoch 1617 | loss: nan | val_loss: nan | Time: 4944.98 ms
[2022-03-14 20:45:19	                main:574]	:	INFO	:	Epoch 1618 | loss: nan | val_loss: nan | Time: 5035.69 ms
[2022-03-14 20:45:24	                main:574]	:	INFO	:	Epoch 1619 | loss: nan | val_loss: nan | Time: 4780.88 ms
[2022-03-14 20:45:29	                main:574]	:	INFO	:	Epoch 1620 | loss: nan | val_loss: nan | Time: 5083.77 ms
[2022-03-14 20:45:34	                main:574]	:	INFO	:	Epoch 1621 | loss: nan | val_loss: nan | Time: 5069.18 ms
[2022-03-14 20:45:39	                main:574]	:	INFO	:	Epoch 1622 | loss: nan | val_loss: nan | Time: 4899.72 ms
[2022-03-14 20:45:44	                main:574]	:	INFO	:	Epoch 1623 | loss: nan | val_loss: nan | Time: 5036.53 ms
[2022-03-14 20:45:49	                main:574]	:	INFO	:	Epoch 1624 | loss: nan | val_loss: nan | Time: 4918.35 ms
[2022-03-14 20:45:54	                main:574]	:	INFO	:	Epoch 1625 | loss: nan | val_loss: nan | Time: 5030.93 ms
[2022-03-14 20:45:59	                main:574]	:	INFO	:	Epoch 1626 | loss: nan | val_loss: nan | Time: 5109.16 ms
[2022-03-14 20:46:04	                main:574]	:	INFO	:	Epoch 1627 | loss: nan | val_loss: nan | Time: 4958.89 ms
[2022-03-14 20:46:09	                main:574]	:	INFO	:	Epoch 1628 | loss: nan | val_loss: nan | Time: 5076.16 ms
[2022-03-14 20:46:14	                main:574]	:	INFO	:	Epoch 1629 | loss: nan | val_loss: nan | Time: 4967.33 ms
[2022-03-14 20:46:19	                main:574]	:	INFO	:	Epoch 1630 | loss: nan | val_loss: nan | Time: 5089.04 ms
[2022-03-14 20:46:24	                main:574]	:	INFO	:	Epoch 1631 | loss: nan | val_loss: nan | Time: 5053.6 ms
[2022-03-14 20:46:29	                main:574]	:	INFO	:	Epoch 1632 | loss: nan | val_loss: nan | Time: 4972.92 ms
[2022-03-14 20:46:34	                main:574]	:	INFO	:	Epoch 1633 | loss: nan | val_loss: nan | Time: 5074.64 ms
[2022-03-14 20:46:39	                main:574]	:	INFO	:	Epoch 1634 | loss: nan | val_loss: nan | Time: 4953.95 ms
[2022-03-14 20:46:44	                main:574]	:	INFO	:	Epoch 1635 | loss: nan | val_loss: nan | Time: 5050 ms
[2022-03-14 20:46:49	                main:574]	:	INFO	:	Epoch 1636 | loss: nan | val_loss: nan | Time: 4903.14 ms
[2022-03-14 20:46:54	                main:574]	:	INFO	:	Epoch 1637 | loss: nan | val_loss: nan | Time: 5038.9 ms
[2022-03-14 20:46:59	                main:574]	:	INFO	:	Epoch 1638 | loss: nan | val_loss: nan | Time: 5009.21 ms
[2022-03-14 20:47:04	                main:574]	:	INFO	:	Epoch 1639 | loss: nan | val_loss: nan | Time: 4928.09 ms
[2022-03-14 20:47:09	                main:574]	:	INFO	:	Epoch 1640 | loss: nan | val_loss: nan | Time: 5071.27 ms
[2022-03-14 20:47:14	                main:574]	:	INFO	:	Epoch 1641 | loss: nan | val_loss: nan | Time: 4929.8 ms
[2022-03-14 20:47:19	                main:574]	:	INFO	:	Epoch 1642 | loss: nan | val_loss: nan | Time: 5017.9 ms
[2022-03-14 20:47:24	                main:574]	:	INFO	:	Epoch 1643 | loss: nan | val_loss: nan | Time: 5151.8 ms
[2022-03-14 20:47:29	                main:574]	:	INFO	:	Epoch 1644 | loss: nan | val_loss: nan | Time: 5005.08 ms
[2022-03-14 20:47:35	                main:574]	:	INFO	:	Epoch 1645 | loss: nan | val_loss: nan | Time: 5104.76 ms
[2022-03-14 20:47:40	                main:574]	:	INFO	:	Epoch 1646 | loss: nan | val_loss: nan | Time: 4988.21 ms
[2022-03-14 20:47:45	                main:574]	:	INFO	:	Epoch 1647 | loss: nan | val_loss: nan | Time: 5128.97 ms
[2022-03-14 20:47:50	                main:574]	:	INFO	:	Epoch 1648 | loss: nan | val_loss: nan | Time: 5021.23 ms
[2022-03-14 20:47:55	                main:574]	:	INFO	:	Epoch 1649 | loss: nan | val_loss: nan | Time: 4934.81 ms
[2022-03-14 20:48:00	                main:574]	:	INFO	:	Epoch 1650 | loss: nan | val_loss: nan | Time: 5162.32 ms
[2022-03-14 20:48:05	                main:574]	:	INFO	:	Epoch 1651 | loss: nan | val_loss: nan | Time: 4896.21 ms
[2022-03-14 20:48:10	                main:574]	:	INFO	:	Epoch 1652 | loss: nan | val_loss: nan | Time: 5046.14 ms
[2022-03-14 20:48:15	                main:574]	:	INFO	:	Epoch 1653 | loss: nan | val_loss: nan | Time: 5217.77 ms
[2022-03-14 20:48:20	                main:574]	:	INFO	:	Epoch 1654 | loss: nan | val_loss: nan | Time: 4931.64 ms
[2022-03-14 20:48:25	                main:574]	:	INFO	:	Epoch 1655 | loss: nan | val_loss: nan | Time: 5004.61 ms
[2022-03-14 20:48:30	                main:574]	:	INFO	:	Epoch 1656 | loss: nan | val_loss: nan | Time: 5016.17 ms
[2022-03-14 20:48:35	                main:574]	:	INFO	:	Epoch 1657 | loss: nan | val_loss: nan | Time: 5050.62 ms
[2022-03-14 20:48:40	                main:574]	:	INFO	:	Epoch 1658 | loss: nan | val_loss: nan | Time: 4889.65 ms
[2022-03-14 20:48:45	                main:574]	:	INFO	:	Epoch 1659 | loss: nan | val_loss: nan | Time: 5096.71 ms
[2022-03-14 20:48:50	                main:574]	:	INFO	:	Epoch 1660 | loss: nan | val_loss: nan | Time: 5064.17 ms
[2022-03-14 20:48:55	                main:574]	:	INFO	:	Epoch 1661 | loss: nan | val_loss: nan | Time: 4862.01 ms
[2022-03-14 20:49:00	                main:574]	:	INFO	:	Epoch 1662 | loss: nan | val_loss: nan | Time: 5152.01 ms
[2022-03-14 20:49:05	                main:574]	:	INFO	:	Epoch 1663 | loss: nan | val_loss: nan | Time: 4981.41 ms
[2022-03-14 20:49:10	                main:574]	:	INFO	:	Epoch 1664 | loss: nan | val_loss: nan | Time: 5121.24 ms
[2022-03-14 20:49:15	                main:574]	:	INFO	:	Epoch 1665 | loss: nan | val_loss: nan | Time: 4995.55 ms
[2022-03-14 20:49:20	                main:574]	:	INFO	:	Epoch 1666 | loss: nan | val_loss: nan | Time: 4972.46 ms
[2022-03-14 20:49:25	                main:574]	:	INFO	:	Epoch 1667 | loss: nan | val_loss: nan | Time: 5145.76 ms
[2022-03-14 20:49:30	                main:574]	:	INFO	:	Epoch 1668 | loss: nan | val_loss: nan | Time: 4908.6 ms
[2022-03-14 20:49:36	                main:574]	:	INFO	:	Epoch 1669 | loss: nan | val_loss: nan | Time: 5124.75 ms
[2022-03-14 20:49:41	                main:574]	:	INFO	:	Epoch 1670 | loss: nan | val_loss: nan | Time: 5077.43 ms
[2022-03-14 20:49:46	                main:574]	:	INFO	:	Epoch 1671 | loss: nan | val_loss: nan | Time: 4907.12 ms
[2022-03-14 20:49:51	                main:574]	:	INFO	:	Epoch 1672 | loss: nan | val_loss: nan | Time: 5118.8 ms
[2022-03-14 20:49:56	                main:574]	:	INFO	:	Epoch 1673 | loss: nan | val_loss: nan | Time: 4943.16 ms
[2022-03-14 20:50:01	                main:574]	:	INFO	:	Epoch 1674 | loss: nan | val_loss: nan | Time: 5065.57 ms
[2022-03-14 20:50:06	                main:574]	:	INFO	:	Epoch 1675 | loss: nan | val_loss: nan | Time: 5114.08 ms
[2022-03-14 20:50:11	                main:574]	:	INFO	:	Epoch 1676 | loss: nan | val_loss: nan | Time: 4933.32 ms
[2022-03-14 20:50:16	                main:574]	:	INFO	:	Epoch 1677 | loss: nan | val_loss: nan | Time: 4992.98 ms
[2022-03-14 20:50:21	                main:574]	:	INFO	:	Epoch 1678 | loss: nan | val_loss: nan | Time: 4877.6 ms
[2022-03-14 20:50:26	                main:574]	:	INFO	:	Epoch 1679 | loss: nan | val_loss: nan | Time: 5125.95 ms
[2022-03-14 20:50:31	                main:574]	:	INFO	:	Epoch 1680 | loss: nan | val_loss: nan | Time: 4930.38 ms
[2022-03-14 20:50:36	                main:574]	:	INFO	:	Epoch 1681 | loss: nan | val_loss: nan | Time: 5053.37 ms
[2022-03-14 20:50:41	                main:574]	:	INFO	:	Epoch 1682 | loss: nan | val_loss: nan | Time: 5105.95 ms
[2022-03-14 20:50:46	                main:574]	:	INFO	:	Epoch 1683 | loss: nan | val_loss: nan | Time: 4965.39 ms
[2022-03-14 20:50:51	                main:574]	:	INFO	:	Epoch 1684 | loss: nan | val_loss: nan | Time: 4922.71 ms
[2022-03-14 20:50:56	                main:574]	:	INFO	:	Epoch 1685 | loss: nan | val_loss: nan | Time: 4933.58 ms
[2022-03-14 20:51:01	                main:574]	:	INFO	:	Epoch 1686 | loss: nan | val_loss: nan | Time: 5090.21 ms
[2022-03-14 20:51:06	                main:574]	:	INFO	:	Epoch 1687 | loss: nan | val_loss: nan | Time: 5051.09 ms
[2022-03-14 20:51:11	                main:574]	:	INFO	:	Epoch 1688 | loss: nan | val_loss: nan | Time: 4941.68 ms
[2022-03-14 20:51:16	                main:574]	:	INFO	:	Epoch 1689 | loss: nan | val_loss: nan | Time: 5035.86 ms
[2022-03-14 20:51:21	                main:574]	:	INFO	:	Epoch 1690 | loss: nan | val_loss: nan | Time: 5010.69 ms
[2022-03-14 20:51:26	                main:574]	:	INFO	:	Epoch 1691 | loss: nan | val_loss: nan | Time: 5054.26 ms
[2022-03-14 20:51:31	                main:574]	:	INFO	:	Epoch 1692 | loss: nan | val_loss: nan | Time: 5031.21 ms
[2022-03-14 20:51:36	                main:574]	:	INFO	:	Epoch 1693 | loss: nan | val_loss: nan | Time: 4940.28 ms
[2022-03-14 20:51:41	                main:574]	:	INFO	:	Epoch 1694 | loss: nan | val_loss: nan | Time: 5030.57 ms
[2022-03-14 20:51:46	                main:574]	:	INFO	:	Epoch 1695 | loss: nan | val_loss: nan | Time: 4903.73 ms
[2022-03-14 20:51:51	                main:574]	:	INFO	:	Epoch 1696 | loss: nan | val_loss: nan | Time: 5028.79 ms
[2022-03-14 20:51:56	                main:574]	:	INFO	:	Epoch 1697 | loss: nan | val_loss: nan | Time: 4981.6 ms
[2022-03-14 20:52:01	                main:574]	:	INFO	:	Epoch 1698 | loss: nan | val_loss: nan | Time: 5081.27 ms
[2022-03-14 20:52:06	                main:574]	:	INFO	:	Epoch 1699 | loss: nan | val_loss: nan | Time: 5075.16 ms
[2022-03-14 20:52:11	                main:574]	:	INFO	:	Epoch 1700 | loss: nan | val_loss: nan | Time: 4886.7 ms
[2022-03-14 20:52:16	                main:574]	:	INFO	:	Epoch 1701 | loss: nan | val_loss: nan | Time: 5085.04 ms
[2022-03-14 20:52:21	                main:574]	:	INFO	:	Epoch 1702 | loss: nan | val_loss: nan | Time: 4920.49 ms
[2022-03-14 20:52:26	                main:574]	:	INFO	:	Epoch 1703 | loss: nan | val_loss: nan | Time: 5020.78 ms
[2022-03-14 20:52:31	                main:574]	:	INFO	:	Epoch 1704 | loss: nan | val_loss: nan | Time: 4951.43 ms
[2022-03-14 20:52:36	                main:574]	:	INFO	:	Epoch 1705 | loss: nan | val_loss: nan | Time: 4984.66 ms
[2022-03-14 20:52:41	                main:574]	:	INFO	:	Epoch 1706 | loss: nan | val_loss: nan | Time: 5050.56 ms
[2022-03-14 20:52:46	                main:574]	:	INFO	:	Epoch 1707 | loss: nan | val_loss: nan | Time: 4896.46 ms
[2022-03-14 20:52:51	                main:574]	:	INFO	:	Epoch 1708 | loss: nan | val_loss: nan | Time: 5071.49 ms
[2022-03-14 20:52:56	                main:574]	:	INFO	:	Epoch 1709 | loss: nan | val_loss: nan | Time: 5092.24 ms
[2022-03-14 20:53:01	                main:574]	:	INFO	:	Epoch 1710 | loss: nan | val_loss: nan | Time: 4921.98 ms
[2022-03-14 20:53:06	                main:574]	:	INFO	:	Epoch 1711 | loss: nan | val_loss: nan | Time: 5011.89 ms
[2022-03-14 20:53:11	                main:574]	:	INFO	:	Epoch 1712 | loss: nan | val_loss: nan | Time: 4950.53 ms
[2022-03-14 20:53:16	                main:574]	:	INFO	:	Epoch 1713 | loss: nan | val_loss: nan | Time: 5061.98 ms
[2022-03-14 20:53:21	                main:574]	:	INFO	:	Epoch 1714 | loss: nan | val_loss: nan | Time: 5081.19 ms
[2022-03-14 20:53:26	                main:574]	:	INFO	:	Epoch 1715 | loss: nan | val_loss: nan | Time: 4973.15 ms
[2022-03-14 20:53:31	                main:574]	:	INFO	:	Epoch 1716 | loss: nan | val_loss: nan | Time: 5065.72 ms
[2022-03-14 20:53:36	                main:574]	:	INFO	:	Epoch 1717 | loss: nan | val_loss: nan | Time: 4935.7 ms
[2022-03-14 20:53:41	                main:574]	:	INFO	:	Epoch 1718 | loss: nan | val_loss: nan | Time: 5029.81 ms
[2022-03-14 20:53:46	                main:574]	:	INFO	:	Epoch 1719 | loss: nan | val_loss: nan | Time: 4969.07 ms
[2022-03-14 20:53:52	                main:574]	:	INFO	:	Epoch 1720 | loss: nan | val_loss: nan | Time: 5049.07 ms
[2022-03-14 20:53:57	                main:574]	:	INFO	:	Epoch 1721 | loss: nan | val_loss: nan | Time: 5134.09 ms
[2022-03-14 20:54:02	                main:574]	:	INFO	:	Epoch 1722 | loss: nan | val_loss: nan | Time: 5010.74 ms
[2022-03-14 20:54:07	                main:574]	:	INFO	:	Epoch 1723 | loss: nan | val_loss: nan | Time: 5057.06 ms
[2022-03-14 20:54:12	                main:574]	:	INFO	:	Epoch 1724 | loss: nan | val_loss: nan | Time: 4989.73 ms
[2022-03-14 20:54:17	                main:574]	:	INFO	:	Epoch 1725 | loss: nan | val_loss: nan | Time: 5156.92 ms
[2022-03-14 20:54:22	                main:574]	:	INFO	:	Epoch 1726 | loss: nan | val_loss: nan | Time: 5058.45 ms
[2022-03-14 20:54:27	                main:574]	:	INFO	:	Epoch 1727 | loss: nan | val_loss: nan | Time: 4998.28 ms
[2022-03-14 20:54:32	                main:574]	:	INFO	:	Epoch 1728 | loss: nan | val_loss: nan | Time: 5005.89 ms
[2022-03-14 20:54:37	                main:574]	:	INFO	:	Epoch 1729 | loss: nan | val_loss: nan | Time: 4975.06 ms
[2022-03-14 20:54:42	                main:574]	:	INFO	:	Epoch 1730 | loss: nan | val_loss: nan | Time: 5072.06 ms
[2022-03-14 20:54:47	                main:574]	:	INFO	:	Epoch 1731 | loss: nan | val_loss: nan | Time: 5065.66 ms
[2022-03-14 20:54:52	                main:574]	:	INFO	:	Epoch 1732 | loss: nan | val_loss: nan | Time: 4965.64 ms
[2022-03-14 20:54:57	                main:574]	:	INFO	:	Epoch 1733 | loss: nan | val_loss: nan | Time: 5015.2 ms
[2022-03-14 20:55:02	                main:574]	:	INFO	:	Epoch 1734 | loss: nan | val_loss: nan | Time: 4932.64 ms
[2022-03-14 20:55:07	                main:574]	:	INFO	:	Epoch 1735 | loss: nan | val_loss: nan | Time: 5064.51 ms
[2022-03-14 20:55:12	                main:574]	:	INFO	:	Epoch 1736 | loss: nan | val_loss: nan | Time: 5067.21 ms
[2022-03-14 20:55:17	                main:574]	:	INFO	:	Epoch 1737 | loss: nan | val_loss: nan | Time: 5004.76 ms
[2022-03-14 20:55:22	                main:574]	:	INFO	:	Epoch 1738 | loss: nan | val_loss: nan | Time: 5077.05 ms
[2022-03-14 20:55:27	                main:574]	:	INFO	:	Epoch 1739 | loss: nan | val_loss: nan | Time: 4933.43 ms
[2022-03-14 20:55:33	                main:574]	:	INFO	:	Epoch 1740 | loss: nan | val_loss: nan | Time: 5226.45 ms
[2022-03-14 20:55:38	                main:574]	:	INFO	:	Epoch 1741 | loss: nan | val_loss: nan | Time: 5144.21 ms
[2022-03-14 20:55:53	                main:574]	:	INFO	:	Epoch 1742 | loss: nan | val_loss: nan | Time: 15028.9 ms
[2022-03-14 20:55:58	                main:574]	:	INFO	:	Epoch 1743 | loss: nan | val_loss: nan | Time: 5022.78 ms
[2022-03-14 20:56:03	                main:574]	:	INFO	:	Epoch 1744 | loss: nan | val_loss: nan | Time: 4905.55 ms
[2022-03-14 20:56:08	                main:574]	:	INFO	:	Epoch 1745 | loss: nan | val_loss: nan | Time: 5070.57 ms
[2022-03-14 20:56:13	                main:574]	:	INFO	:	Epoch 1746 | loss: nan | val_loss: nan | Time: 5011.82 ms
[2022-03-14 20:56:18	                main:574]	:	INFO	:	Epoch 1747 | loss: nan | val_loss: nan | Time: 5147.2 ms
[2022-03-14 20:56:23	                main:574]	:	INFO	:	Epoch 1748 | loss: nan | val_loss: nan | Time: 5052.19 ms
[2022-03-14 20:56:28	                main:574]	:	INFO	:	Epoch 1749 | loss: nan | val_loss: nan | Time: 4973.81 ms
[2022-03-14 20:56:33	                main:574]	:	INFO	:	Epoch 1750 | loss: nan | val_loss: nan | Time: 5134.65 ms
[2022-03-14 20:56:38	                main:574]	:	INFO	:	Epoch 1751 | loss: nan | val_loss: nan | Time: 4927.71 ms
[2022-03-14 20:56:43	                main:574]	:	INFO	:	Epoch 1752 | loss: nan | val_loss: nan | Time: 5122.27 ms
[2022-03-14 20:56:48	                main:574]	:	INFO	:	Epoch 1753 | loss: nan | val_loss: nan | Time: 5092.08 ms
[2022-03-14 20:56:53	                main:574]	:	INFO	:	Epoch 1754 | loss: nan | val_loss: nan | Time: 4970.77 ms
[2022-03-14 20:56:58	                main:574]	:	INFO	:	Epoch 1755 | loss: nan | val_loss: nan | Time: 5095.72 ms
[2022-03-14 20:57:03	                main:574]	:	INFO	:	Epoch 1756 | loss: nan | val_loss: nan | Time: 4951.49 ms
[2022-03-14 20:57:09	                main:574]	:	INFO	:	Epoch 1757 | loss: nan | val_loss: nan | Time: 5042.1 ms
[2022-03-14 20:57:14	                main:574]	:	INFO	:	Epoch 1758 | loss: nan | val_loss: nan | Time: 4985.36 ms
[2022-03-14 20:57:19	                main:574]	:	INFO	:	Epoch 1759 | loss: nan | val_loss: nan | Time: 4977.39 ms
[2022-03-14 20:57:24	                main:574]	:	INFO	:	Epoch 1760 | loss: nan | val_loss: nan | Time: 5087.09 ms
[2022-03-14 20:57:29	                main:574]	:	INFO	:	Epoch 1761 | loss: nan | val_loss: nan | Time: 4915.75 ms
[2022-03-14 20:57:34	                main:574]	:	INFO	:	Epoch 1762 | loss: nan | val_loss: nan | Time: 5013.11 ms
[2022-03-14 20:57:39	                main:574]	:	INFO	:	Epoch 1763 | loss: nan | val_loss: nan | Time: 5079.24 ms
[2022-03-14 20:57:44	                main:574]	:	INFO	:	Epoch 1764 | loss: nan | val_loss: nan | Time: 4903.27 ms
[2022-03-14 20:57:49	                main:574]	:	INFO	:	Epoch 1765 | loss: nan | val_loss: nan | Time: 5057.31 ms
[2022-03-14 20:57:54	                main:574]	:	INFO	:	Epoch 1766 | loss: nan | val_loss: nan | Time: 4966.85 ms
[2022-03-14 20:57:59	                main:574]	:	INFO	:	Epoch 1767 | loss: nan | val_loss: nan | Time: 5023.11 ms
[2022-03-14 20:58:04	                main:574]	:	INFO	:	Epoch 1768 | loss: nan | val_loss: nan | Time: 5113.66 ms
[2022-03-14 20:58:09	                main:574]	:	INFO	:	Epoch 1769 | loss: nan | val_loss: nan | Time: 5008.11 ms
[2022-03-14 20:58:14	                main:574]	:	INFO	:	Epoch 1770 | loss: nan | val_loss: nan | Time: 4993.5 ms
[2022-03-14 20:58:19	                main:574]	:	INFO	:	Epoch 1771 | loss: nan | val_loss: nan | Time: 4997.54 ms
[2022-03-14 20:58:24	                main:574]	:	INFO	:	Epoch 1772 | loss: nan | val_loss: nan | Time: 5053.13 ms
[2022-03-14 20:58:29	                main:574]	:	INFO	:	Epoch 1773 | loss: nan | val_loss: nan | Time: 4912.47 ms
[2022-03-14 20:58:34	                main:574]	:	INFO	:	Epoch 1774 | loss: nan | val_loss: nan | Time: 5085.96 ms
[2022-03-14 20:58:39	                main:574]	:	INFO	:	Epoch 1775 | loss: nan | val_loss: nan | Time: 5170.4 ms
[2022-03-14 20:58:54	                main:574]	:	INFO	:	Epoch 1776 | loss: nan | val_loss: nan | Time: 14985.5 ms
[2022-03-14 20:58:59	                main:574]	:	INFO	:	Epoch 1777 | loss: nan | val_loss: nan | Time: 5097.38 ms
[2022-03-14 20:59:04	                main:574]	:	INFO	:	Epoch 1778 | loss: nan | val_loss: nan | Time: 4919.35 ms
[2022-03-14 20:59:09	                main:574]	:	INFO	:	Epoch 1779 | loss: nan | val_loss: nan | Time: 5031.05 ms
[2022-03-14 20:59:14	                main:574]	:	INFO	:	Epoch 1780 | loss: nan | val_loss: nan | Time: 5056.57 ms
[2022-03-14 20:59:19	                main:574]	:	INFO	:	Epoch 1781 | loss: nan | val_loss: nan | Time: 4918.62 ms
[2022-03-14 20:59:24	                main:574]	:	INFO	:	Epoch 1782 | loss: nan | val_loss: nan | Time: 5118.58 ms
[2022-03-14 20:59:29	                main:574]	:	INFO	:	Epoch 1783 | loss: nan | val_loss: nan | Time: 4955.77 ms
[2022-03-14 20:59:34	                main:574]	:	INFO	:	Epoch 1784 | loss: nan | val_loss: nan | Time: 5015.61 ms
[2022-03-14 20:59:39	                main:574]	:	INFO	:	Epoch 1785 | loss: nan | val_loss: nan | Time: 5066.99 ms
[2022-03-14 20:59:44	                main:574]	:	INFO	:	Epoch 1786 | loss: nan | val_loss: nan | Time: 4897.26 ms
[2022-03-14 20:59:49	                main:574]	:	INFO	:	Epoch 1787 | loss: nan | val_loss: nan | Time: 5048.94 ms
[2022-03-14 20:59:54	                main:574]	:	INFO	:	Epoch 1788 | loss: nan | val_loss: nan | Time: 4917.17 ms
[2022-03-14 20:59:59	                main:574]	:	INFO	:	Epoch 1789 | loss: nan | val_loss: nan | Time: 5142.47 ms
[2022-03-14 21:00:04	                main:574]	:	INFO	:	Epoch 1790 | loss: nan | val_loss: nan | Time: 4983.08 ms
[2022-03-14 21:00:09	                main:574]	:	INFO	:	Epoch 1791 | loss: nan | val_loss: nan | Time: 5011.23 ms
[2022-03-14 21:00:15	                main:574]	:	INFO	:	Epoch 1792 | loss: nan | val_loss: nan | Time: 5104.1 ms
[2022-03-14 21:00:20	                main:574]	:	INFO	:	Epoch 1793 | loss: nan | val_loss: nan | Time: 5006.91 ms
[2022-03-14 21:00:25	                main:574]	:	INFO	:	Epoch 1794 | loss: nan | val_loss: nan | Time: 5007.35 ms
[2022-03-14 21:00:30	                main:574]	:	INFO	:	Epoch 1795 | loss: nan | val_loss: nan | Time: 4931.89 ms
[2022-03-14 21:00:35	                main:574]	:	INFO	:	Epoch 1796 | loss: nan | val_loss: nan | Time: 5054.93 ms
[2022-03-14 21:00:40	                main:574]	:	INFO	:	Epoch 1797 | loss: nan | val_loss: nan | Time: 5070.33 ms
[2022-03-14 21:00:45	                main:574]	:	INFO	:	Epoch 1798 | loss: nan | val_loss: nan | Time: 4896.88 ms
[2022-03-14 21:00:50	                main:574]	:	INFO	:	Epoch 1799 | loss: nan | val_loss: nan | Time: 5079.29 ms
[2022-03-14 21:00:55	                main:574]	:	INFO	:	Epoch 1800 | loss: nan | val_loss: nan | Time: 4971.65 ms
[2022-03-14 21:01:00	                main:574]	:	INFO	:	Epoch 1801 | loss: nan | val_loss: nan | Time: 5042.31 ms
[2022-03-14 21:01:05	                main:574]	:	INFO	:	Epoch 1802 | loss: nan | val_loss: nan | Time: 5022.23 ms
[2022-03-14 21:01:10	                main:574]	:	INFO	:	Epoch 1803 | loss: nan | val_loss: nan | Time: 4992.15 ms
[2022-03-14 21:01:15	                main:574]	:	INFO	:	Epoch 1804 | loss: nan | val_loss: nan | Time: 5055 ms
[2022-03-14 21:01:20	                main:574]	:	INFO	:	Epoch 1805 | loss: nan | val_loss: nan | Time: 4926.03 ms
[2022-03-14 21:01:25	                main:574]	:	INFO	:	Epoch 1806 | loss: nan | val_loss: nan | Time: 5055.93 ms
[2022-03-14 21:01:30	                main:574]	:	INFO	:	Epoch 1807 | loss: nan | val_loss: nan | Time: 4999.88 ms
[2022-03-14 21:01:35	                main:574]	:	INFO	:	Epoch 1808 | loss: nan | val_loss: nan | Time: 4912.79 ms
[2022-03-14 21:01:40	                main:574]	:	INFO	:	Epoch 1809 | loss: nan | val_loss: nan | Time: 5087.56 ms
[2022-03-14 21:01:45	                main:574]	:	INFO	:	Epoch 1810 | loss: nan | val_loss: nan | Time: 4917.15 ms
[2022-03-14 21:01:50	                main:574]	:	INFO	:	Epoch 1811 | loss: nan | val_loss: nan | Time: 5070.1 ms
[2022-03-14 21:01:55	                main:574]	:	INFO	:	Epoch 1812 | loss: nan | val_loss: nan | Time: 5012.11 ms
[2022-03-14 21:02:00	                main:574]	:	INFO	:	Epoch 1813 | loss: nan | val_loss: nan | Time: 5107.12 ms
[2022-03-14 21:02:05	                main:574]	:	INFO	:	Epoch 1814 | loss: nan | val_loss: nan | Time: 5093.13 ms
[2022-03-14 21:02:10	                main:574]	:	INFO	:	Epoch 1815 | loss: nan | val_loss: nan | Time: 4882.94 ms
[2022-03-14 21:02:15	                main:574]	:	INFO	:	Epoch 1816 | loss: nan | val_loss: nan | Time: 5086.54 ms
[2022-03-14 21:02:20	                main:574]	:	INFO	:	Epoch 1817 | loss: nan | val_loss: nan | Time: 4896.78 ms
[2022-03-14 21:02:25	                main:574]	:	INFO	:	Epoch 1818 | loss: nan | val_loss: nan | Time: 5084.03 ms
[2022-03-14 21:02:30	                main:574]	:	INFO	:	Epoch 1819 | loss: nan | val_loss: nan | Time: 5135.61 ms
[2022-03-14 21:02:35	                main:574]	:	INFO	:	Epoch 1820 | loss: nan | val_loss: nan | Time: 4891.84 ms
[2022-03-14 21:02:40	                main:574]	:	INFO	:	Epoch 1821 | loss: nan | val_loss: nan | Time: 5030.48 ms
[2022-03-14 21:02:45	                main:574]	:	INFO	:	Epoch 1822 | loss: nan | val_loss: nan | Time: 4938.57 ms
[2022-03-14 21:02:50	                main:574]	:	INFO	:	Epoch 1823 | loss: nan | val_loss: nan | Time: 5089.85 ms
[2022-03-14 21:02:55	                main:574]	:	INFO	:	Epoch 1824 | loss: nan | val_loss: nan | Time: 5020.32 ms
[2022-03-14 21:03:00	                main:574]	:	INFO	:	Epoch 1825 | loss: nan | val_loss: nan | Time: 4917.08 ms
[2022-03-14 21:03:05	                main:574]	:	INFO	:	Epoch 1826 | loss: nan | val_loss: nan | Time: 5096.13 ms
[2022-03-14 21:03:10	                main:574]	:	INFO	:	Epoch 1827 | loss: nan | val_loss: nan | Time: 4838.09 ms
[2022-03-14 21:03:15	                main:574]	:	INFO	:	Epoch 1828 | loss: nan | val_loss: nan | Time: 4992.72 ms
[2022-03-14 21:03:20	                main:574]	:	INFO	:	Epoch 1829 | loss: nan | val_loss: nan | Time: 4979.58 ms
[2022-03-14 21:03:25	                main:574]	:	INFO	:	Epoch 1830 | loss: nan | val_loss: nan | Time: 5003.25 ms
[2022-03-14 21:03:30	                main:574]	:	INFO	:	Epoch 1831 | loss: nan | val_loss: nan | Time: 5060.5 ms
[2022-03-14 21:03:35	                main:574]	:	INFO	:	Epoch 1832 | loss: nan | val_loss: nan | Time: 4933.87 ms
[2022-03-14 21:03:40	                main:574]	:	INFO	:	Epoch 1833 | loss: nan | val_loss: nan | Time: 5079.98 ms
[2022-03-14 21:03:45	                main:574]	:	INFO	:	Epoch 1834 | loss: nan | val_loss: nan | Time: 4895.3 ms
[2022-03-14 21:03:50	                main:574]	:	INFO	:	Epoch 1835 | loss: nan | val_loss: nan | Time: 5008.87 ms
[2022-03-14 21:03:55	                main:574]	:	INFO	:	Epoch 1836 | loss: nan | val_loss: nan | Time: 5052.81 ms
[2022-03-14 21:04:00	                main:574]	:	INFO	:	Epoch 1837 | loss: nan | val_loss: nan | Time: 4989.29 ms
[2022-03-14 21:04:05	                main:574]	:	INFO	:	Epoch 1838 | loss: nan | val_loss: nan | Time: 5013.42 ms
[2022-03-14 21:04:10	                main:574]	:	INFO	:	Epoch 1839 | loss: nan | val_loss: nan | Time: 4996.19 ms
[2022-03-14 21:04:16	                main:574]	:	INFO	:	Epoch 1840 | loss: nan | val_loss: nan | Time: 5071.88 ms
[2022-03-14 21:04:21	                main:574]	:	INFO	:	Epoch 1841 | loss: nan | val_loss: nan | Time: 5027.27 ms
[2022-03-14 21:04:26	                main:574]	:	INFO	:	Epoch 1842 | loss: nan | val_loss: nan | Time: 4989.02 ms
[2022-03-14 21:04:31	                main:574]	:	INFO	:	Epoch 1843 | loss: nan | val_loss: nan | Time: 5013.2 ms
[2022-03-14 21:04:36	                main:574]	:	INFO	:	Epoch 1844 | loss: nan | val_loss: nan | Time: 4949.95 ms
[2022-03-14 21:04:41	                main:574]	:	INFO	:	Epoch 1845 | loss: nan | val_loss: nan | Time: 5057.39 ms
[2022-03-14 21:04:46	                main:574]	:	INFO	:	Epoch 1846 | loss: nan | val_loss: nan | Time: 5045.84 ms
[2022-03-14 21:04:51	                main:574]	:	INFO	:	Epoch 1847 | loss: nan | val_loss: nan | Time: 4912.75 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 1050 Ti)
[2022-03-14 21:10:00	                main:435]	:	INFO	:	Set logging level to 1
[2022-03-14 21:10:00	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-03-14 21:10:00	                main:444]	:	INFO	:	Resolving all filenames
[2022-03-14 21:10:00	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-14 21:10:00	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-14 21:10:00	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-14 21:10:00	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-14 21:10:00	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-14 21:10:00	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-03-14 21:10:00	                main:474]	:	INFO	:	Configuration: 
[2022-03-14 21:10:00	                main:475]	:	INFO	:	    Model type: GRU
[2022-03-14 21:10:00	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-03-14 21:10:00	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-03-14 21:10:00	                main:478]	:	INFO	:	    Batch Size: 128
[2022-03-14 21:10:00	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-03-14 21:10:00	                main:480]	:	INFO	:	    Patience: 10
[2022-03-14 21:10:00	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-03-14 21:10:00	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-03-14 21:10:00	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-03-14 21:10:00	                main:484]	:	INFO	:	    # Threads: 1
[2022-03-14 21:10:00	                main:486]	:	INFO	:	Preparing Dataset
[2022-03-14 21:10:00	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-14 21:10:01	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-03-14 21:10:02	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-03-14 21:10:02	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-03-14 21:10:03	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-03-14 21:10:03	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-03-14 21:10:03	                main:494]	:	INFO	:	Creating Model
[2022-03-14 21:10:03	                main:507]	:	INFO	:	Preparing config file
[2022-03-14 21:10:03	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-03-14 21:10:03	                main:512]	:	INFO	:	Loading config


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFA20A6478C

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 03/14/22 21:10:03
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\3;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 0000000053df0000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000023340000 0000000000209000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.22000.527) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.22000.434 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.434

ModLoad: 0000000021260000 00000000000bd000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.22000.434) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.22000.434 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.434

ModLoad: 0000000020a20000 0000000000374000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.22000.527) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.22000.434 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.434

ModLoad: 0000000021750000 00000000001ac000 C:\WINDOWS\System32\USER32.dll (6.2.22000.282) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.22000.556 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.556

ModLoad: 00000000211b0000 0000000000026000 C:\WINDOWS\System32\win32u.dll (6.2.22000.556) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.22000.556 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.556

ModLoad: 0000000022860000 0000000000029000 C:\WINDOWS\System32\GDI32.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000020e60000 0000000000112000 C:\WINDOWS\System32\gdi32full.dll (6.2.22000.527) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.22000.527 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.527

ModLoad: 00000000210a0000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000020f80000 0000000000111000 C:\WINDOWS\System32\ucrtbase.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000022b00000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.22000.434) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000022960000 00000000000a3000 C:\WINDOWS\System32\msvcrt.dll (7.0.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.22000.1

ModLoad: 00000000222d0000 000000000009e000 C:\WINDOWS\System32\sechost.dll (6.2.22000.556) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 000000000ea90000 0000000000058000 C:\ProgramData\BOINC\slots\3\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000021450000 0000000000120000 C:\WINDOWS\System32\RPCRT4.dll (6.2.22000.434) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000e4dd0000 000000000008e000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.31.31103.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\43\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.31.31103.0
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.31.31103.0

ModLoad: 0000000019de0000 0000000000221000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000eb040000 000000000001b000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.31.31103.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\43\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.31.31103.0
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.31.31103.0

ModLoad: 00000000033a0000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.31.31103.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\43\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.31.31103.0
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.31.31103.0

ModLoad: 0000000068e70000 0000000024b49000 C:\ProgramData\BOINC\slots\3\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000054ba0000 000000000abe7000 C:\ProgramData\BOINC\slots\3\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000011590000 0000000000045000 C:\ProgramData\BOINC\slots\3\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000969f0000 00000000034b2000 C:\ProgramData\BOINC\slots\3\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 000000009bb40000 00000000030a5000 C:\ProgramData\BOINC\slots\3\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 000000001a0f0000 0000000000010000 C:\ProgramData\BOINC\slots\3\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 0000000030650000 000000000919f000 C:\ProgramData\BOINC\slots\3\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000fed80000 000000000020d000 C:\ProgramData\BOINC\slots\3\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 00000000c32f0000 00000000002db000 C:\ProgramData\BOINC\slots\3\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000000ebd0000 0000000000040000 C:\ProgramData\BOINC\slots\3\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000397f0000 000000001b3a4000 C:\ProgramData\BOINC\slots\3\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 0000000027b30000 0000000003d5b000 C:\ProgramData\BOINC\slots\3\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 0000000066fa0000 0000000001eca000 C:\ProgramData\BOINC\slots\3\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 0000000021570000 0000000000031000 C:\WINDOWS\System32\IMM32.DLL (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 000000001fa20000 0000000000018000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.22000.71) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.22000.71 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.71

ModLoad: 000000001e080000 0000000000038000 C:\WINDOWS\SYSTEM32\dxcore.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : DXCore.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000223f0000 000000000046c000 C:\WINDOWS\System32\Setupapi.dll (6.2.22000.469) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.22000.556 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.556

ModLoad: 0000000020550000 000000000002c000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000020500000 000000000004c000 C:\WINDOWS\SYSTEM32\CFGMGR32.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000021140000 0000000000067000 C:\WINDOWS\System32\WINTRUST.dll (6.2.22000.527) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.22000.527 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.527

ModLoad: 00000000208b0000 0000000000162000 C:\WINDOWS\System32\CRYPT32.dll (6.2.22000.348) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.22000.556 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.556

ModLoad: 00000000200f0000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000021900000 00000000007ae000 C:\WINDOWS\System32\Shell32.dll (6.2.22000.527) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.22000.556 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.556

ModLoad: 000000001e960000 0000000000868000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.22000.527) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.22000.556 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.556

ModLoad: 0000000022ca0000 0000000000378000 C:\WINDOWS\System32\combase.dll (6.2.22000.527) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 000000001e7f0000 0000000000166000 C:\WINDOWS\SYSTEM32\wintypes.dll (6.2.22000.527) (-exported- Symbols Loaded)
    Linked PDB Filename   : WinTypes.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000022bb0000 00000000000ea000 C:\WINDOWS\System32\SHCORE.dll (6.2.22000.71) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.22000.556 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.556

ModLoad: 0000000022890000 000000000005d000 C:\WINDOWS\System32\shlwapi.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.22000.556 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.556

ModLoad: 00000000feb10000 0000000000267000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.5751) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 27.21.14.5751
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.1.114 driver
    Product Version       : 27.21.14.5751

ModLoad: 000000001a7b0000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 000000002f120000 000000000152c000 C:\WINDOWS\system32\DriverStore\FileRepository\nvdd.inf_amd64_317063b9f4b156d8\nvcuda64.dll (27.21.14.5751) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 27.21.14.5751
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.1.114 driver
    Product Version       : 27.21.14.5751

ModLoad: 0000000022260000 000000000006f000 C:\WINDOWS\System32\WS2_32.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : ws2_32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 000000001ad10000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000020090000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 000000001df80000 00000000000ac000 C:\WINDOWS\system32\uxtheme.dll (6.2.22000.120) (-exported- Symbols Loaded)
    Linked PDB Filename   : uxtheme.pdb
    File Version          : 10.0.22000.556 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.556

ModLoad: 00000000f0270000 00000000006d6000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.5751) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 27.21.14.5751
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 27.21.14.5751

ModLoad: 00000000215b0000 000000000019a000 C:\WINDOWS\System32\OLE32.DLL (6.2.22000.120) (-exported- Symbols Loaded)
    Linked PDB Filename   : ole32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000020830000 000000000007f000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.22000.376) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.22000.376 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.376



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3644, Write: 308, Other 872

- I/O Transfers Counters -
Read: 6818216, Write: 6043, Other 29472

- Paged Pool Usage -
QuotaPagedPoolUsage: 3449784, QuotaPeakPagedPoolUsage: 3449784
QuotaNonPagedPoolUsage: 39648, QuotaPeakNonPagedPoolUsage: 39648

- Virtual Memory Usage -
VirtualSize: -1443422208, PeakVirtualSize: -832249856

- Pagefile Usage -
PagefileUsage: -1443422208, PeakPagefileUsage: -1443422208

- Working Set Size -
WorkingSetSize: 1164173312, PeakWorkingSetSize: 1164173312, PageFaultCount: 397676

*** Dump of thread ID 2488 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 6562500.000000, User Time: 16562500.000000, Wait Time: 699764.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFA20A6478C

- Registers -
rax=0000000000000001 rbx=0000000054154910 rcx=0000000000000000 rdx=00000000edee5ce0 rsi=00000000edee65c0 rdi=0000000019930520
r8=0000000000000000 r9=00000000cdce8f00 r10=00000000edee5d20 r11=00000000edee5d20 r12=00000000edde98d0 r13=00000000edee67d0
r14=00000000cc5d3a10 r15=0000000000000000 rip=0000000020a6478c rsp=00000000edee6460 rbp=00000000edee6750
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
edee6530 5406a884 00000040 0000004f eddea800 00000399 KERNELBASE!RaiseException+0x0 
edee6590 53e11ca6 00003990 00000000 ecc4b518 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
edee6640 53e1593b 00000000 00000020 00000000 00000030 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
edee6790 53e11a78 00000000 00000000 edee6ac0 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
edee6860 53e11cfc edee6ac0 00000000 00000080 edee6d90 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
edee6920 53e1c4dd edee6d90 edee6d90 edee6d90 edee6d90 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
edee6c10 53e0b2fe edee7228 edee6d90 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
edeff9b0 5404c6f8 90aada80 00000000 00000000 90a9a8d0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
edeff9f0 212754e0 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
edeffa20 2334485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
edeffaa0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 12260 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 699600.000000

- Registers -
rax=00000000000001de rbx=000000008efaaa80 rcx=0000000000000074 rdx=000000008efaa700 rsi=000000008efa7700 rdi=000000008efaaa80
r8=00000000000001d5 r9=00000000000001d5 r10=00000000000000b8 r11=00000000000002f3 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000233e7304 rsp=00000000edfff8a8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
edfff8a0 23356c2f 00000000 00000000 8efa7700 8efaaa80 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
edfffb90 212754e0 00000000 00000000 00000000 00000000 ntdll!EtwNotificationRegister+0x0 
edfffbc0 2334485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
edfffc40 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 9180 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 699600.000000

- Registers -
rax=00000000000001de rbx=000000008efabfd0 rcx=0000000000000074 rdx=000000008efabc50 rsi=000000008efa7700 rdi=000000008efabfd0
r8=0000000000000008 r9=0000000000000040 r10=0000000000000180 r11=00000000fffdfbff r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000233e7304 rsp=00000000ee0ff658 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
ee0ff650 23356c2f 00000000 00000000 8efa7700 8efabfd0 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
ee0ff940 212754e0 00000000 00000000 00000000 00000000 ntdll!EtwNotificationRegister+0x0 
ee0ff970 2334485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
ee0ff9f0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 15648 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 699600.000000

- Registers -
rax=00000000000001de rbx=000000008efb00d0 rcx=0000000000000074 rdx=000000008efafd50 rsi=000000008efa7700 rdi=000000008efb00d0
r8=000000001a7b5004 r9=0000000000000000 r10=000000001a7b00f0 r11=0000000000000001 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000233e7304 rsp=00000000ee1ff678 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
ee1ff670 23356c2f 00000000 00000000 8efa7700 8efb00d0 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
ee1ff960 212754e0 00000000 00000000 00000000 00000000 ntdll!EtwNotificationRegister+0x0 
ee1ff990 2334485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
ee1ffa10 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 14788 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 699762.000000

- Registers -
rax=0000000000000034 rbx=00000000ee3ff950 rcx=0000000000000000 rdx=00000000ee3ff950 rsi=00000000eddc7000 rdi=0000000000000000
r8=00000000ee3ff888 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000233e3dd4 rsp=00000000ee3ff888 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
ee3ff880 2339b5c3 00000000 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0 
ee3ff8b0 20a6b3a1 00000000 00000000 00000000 00000000 ntdll!RtlDelayExecution+0x0 
ee3ff930 53e2a07f 00000000 00000000 fff0bdc0 00000000 KERNELBASE!SleepEx+0x0 
ee3ff960 212754e0 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
ee3ff990 2334485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
ee3ffa10 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 9688 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 699762.000000

- Registers -
rax=000000000000005b rbx=0000000000000006 rcx=0000000000000006 rdx=00000000ee4ff650 rsi=0000000000000000 rdi=0000000000000006
r8=00000000ee4ff2f8 r9=0000000090c52140 r10=0000000000000000 r11=0000000000000246 r12=0000000000000064 r13=00000000ee4ff650
r14=00000000ee4ff350 r15=0000000000000000 rip=00000000233e42a4 rsp=00000000ee4ff2f8 rbp=0000000090c52140
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
ee4ff2f0 20a6fb10 00000000 00000000 00000000 00000000 ntdll!NtWaitForMultipleObjects+0x0 
ee4ff5e0 20a6fa0e 2f614b48 90d785a0 00000006 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
ee4ff620 2f2cbb54 90c57f00 00000000 90c51ba0 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
ee4ff860 2f3609ed 00000000 00000004 00000000 00000000 nvcuda64!+0x0 
ee4ff910 2f2cb523 7568188b 7422ee92 9ea339c0 00000000 nvcuda64!cuProfilerStop+0x0 
ee4ff940 2f5da750 9ea339c0 00000000 00000000 00000000 nvcuda64!+0x0 
ee4ff970 212754e0 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
ee4ff9a0 2334485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
ee4ffa20 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 14152 (state: Waiting): ***

- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 699749.000000

- Registers -
rax=00000000000001db rbx=0000000000000000 rcx=0000000090f37268 rdx=00000000ee5ff938 rsi=0000000000000102 rdi=0000000000000000
r8=0000000000000001 r9=0000000000003748 r10=0000000090f3b9e8 r11=00000000efc63f63 r12=00000000ee5ff938 r13=0000000000000000
r14=0000000090f3b9e8 r15=0000000090f37268 rip=00000000233e72a4 rsp=00000000ee5ff878 rbp=00000000ee5ff8d0
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
ee5ff870 233aa2da 00000102 00000102 00000000 ee5ff8a0 ntdll!NtWaitForAlertByThreadId+0x0 
ee5ff8e0 20a7d449 90f391d0 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0 
ee5ff910 2f25223a 90f391d0 23346800 90f391d0 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0 
ee5ff970 2f2cb523 00000001 75527f6a 00000000 00000000 nvcuda64!+0x0 
ee5ff9a0 2f5da750 9ea33ba0 00000000 00000000 00000000 nvcuda64!+0x0 
ee5ff9d0 212754e0 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
ee5ffa00 2334485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
ee5ffa80 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)