Task 14597429

Name ParityModified-1647047931-16791-2-0_2
Workunit 11346522
Created 11 Apr 2022, 16:50:15 UTC
Sent 11 Apr 2022, 16:50:25 UTC
Report deadline 19 Apr 2022, 16:50:25 UTC
Received 13 Apr 2022, 8:03:25 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 19867
Run time 51 min 41 sec
CPU time 51 min 21 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 6,857.70 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.63 GB
Peak swap size 3.63 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
]	:	INFO	:	Epoch 1702 | loss: nan | val_loss: nan | Time: 1578.53 ms
[2022-04-13 08:05:31	                main:574]	:	INFO	:	Epoch 1703 | loss: nan | val_loss: nan | Time: 1579.95 ms
[2022-04-13 08:05:33	                main:574]	:	INFO	:	Epoch 1704 | loss: nan | val_loss: nan | Time: 1578.25 ms
[2022-04-13 08:05:34	                main:574]	:	INFO	:	Epoch 1705 | loss: nan | val_loss: nan | Time: 1581.3 ms
[2022-04-13 08:05:36	                main:574]	:	INFO	:	Epoch 1706 | loss: nan | val_loss: nan | Time: 1579.82 ms
[2022-04-13 08:05:37	                main:574]	:	INFO	:	Epoch 1707 | loss: nan | val_loss: nan | Time: 1574.88 ms
[2022-04-13 08:05:39	                main:574]	:	INFO	:	Epoch 1708 | loss: nan | val_loss: nan | Time: 1569.37 ms
[2022-04-13 08:05:41	                main:574]	:	INFO	:	Epoch 1709 | loss: nan | val_loss: nan | Time: 1570.23 ms
[2022-04-13 08:05:42	                main:574]	:	INFO	:	Epoch 1710 | loss: nan | val_loss: nan | Time: 1560.17 ms
[2022-04-13 08:05:44	                main:574]	:	INFO	:	Epoch 1711 | loss: nan | val_loss: nan | Time: 1564.17 ms
[2022-04-13 08:05:45	                main:574]	:	INFO	:	Epoch 1712 | loss: nan | val_loss: nan | Time: 1574.85 ms
[2022-04-13 08:05:47	                main:574]	:	INFO	:	Epoch 1713 | loss: nan | val_loss: nan | Time: 1575.46 ms
[2022-04-13 08:05:48	                main:574]	:	INFO	:	Epoch 1714 | loss: nan | val_loss: nan | Time: 1564.15 ms
[2022-04-13 08:05:50	                main:574]	:	INFO	:	Epoch 1715 | loss: nan | val_loss: nan | Time: 1559.46 ms
[2022-04-13 08:05:52	                main:574]	:	INFO	:	Epoch 1716 | loss: nan | val_loss: nan | Time: 1565.12 ms
[2022-04-13 08:05:53	                main:574]	:	INFO	:	Epoch 1717 | loss: nan | val_loss: nan | Time: 1577.7 ms
[2022-04-13 08:05:55	                main:574]	:	INFO	:	Epoch 1718 | loss: nan | val_loss: nan | Time: 1562.31 ms
[2022-04-13 08:05:56	                main:574]	:	INFO	:	Epoch 1719 | loss: nan | val_loss: nan | Time: 1563.47 ms
[2022-04-13 08:05:58	                main:574]	:	INFO	:	Epoch 1720 | loss: nan | val_loss: nan | Time: 1561.49 ms
[2022-04-13 08:05:59	                main:574]	:	INFO	:	Epoch 1721 | loss: nan | val_loss: nan | Time: 1561.41 ms
[2022-04-13 08:06:01	                main:574]	:	INFO	:	Epoch 1722 | loss: nan | val_loss: nan | Time: 1563.49 ms
[2022-04-13 08:06:03	                main:574]	:	INFO	:	Epoch 1723 | loss: nan | val_loss: nan | Time: 1562.46 ms
[2022-04-13 08:06:04	                main:574]	:	INFO	:	Epoch 1724 | loss: nan | val_loss: nan | Time: 1564.65 ms
[2022-04-13 08:06:06	                main:574]	:	INFO	:	Epoch 1725 | loss: nan | val_loss: nan | Time: 1561.7 ms
[2022-04-13 08:06:07	                main:574]	:	INFO	:	Epoch 1726 | loss: nan | val_loss: nan | Time: 1562.78 ms
[2022-04-13 08:06:09	                main:574]	:	INFO	:	Epoch 1727 | loss: nan | val_loss: nan | Time: 1564.33 ms
[2022-04-13 08:06:10	                main:574]	:	INFO	:	Epoch 1728 | loss: nan | val_loss: nan | Time: 1562.83 ms
[2022-04-13 08:06:12	                main:574]	:	INFO	:	Epoch 1729 | loss: nan | val_loss: nan | Time: 1561 ms
[2022-04-13 08:06:14	                main:574]	:	INFO	:	Epoch 1730 | loss: nan | val_loss: nan | Time: 1560.12 ms
[2022-04-13 08:06:15	                main:574]	:	INFO	:	Epoch 1731 | loss: nan | val_loss: nan | Time: 1557.11 ms
[2022-04-13 08:06:17	                main:574]	:	INFO	:	Epoch 1732 | loss: nan | val_loss: nan | Time: 1564.46 ms
[2022-04-13 08:06:18	                main:574]	:	INFO	:	Epoch 1733 | loss: nan | val_loss: nan | Time: 1559.32 ms
[2022-04-13 08:06:20	                main:574]	:	INFO	:	Epoch 1734 | loss: nan | val_loss: nan | Time: 1566.34 ms
[2022-04-13 08:06:21	                main:574]	:	INFO	:	Epoch 1735 | loss: nan | val_loss: nan | Time: 1569.59 ms
[2022-04-13 08:06:23	                main:574]	:	INFO	:	Epoch 1736 | loss: nan | val_loss: nan | Time: 1566.48 ms
[2022-04-13 08:06:25	                main:574]	:	INFO	:	Epoch 1737 | loss: nan | val_loss: nan | Time: 1571.11 ms
[2022-04-13 08:06:26	                main:574]	:	INFO	:	Epoch 1738 | loss: nan | val_loss: nan | Time: 1572.2 ms
[2022-04-13 08:06:28	                main:574]	:	INFO	:	Epoch 1739 | loss: nan | val_loss: nan | Time: 1570.79 ms
[2022-04-13 08:06:29	                main:574]	:	INFO	:	Epoch 1740 | loss: nan | val_loss: nan | Time: 1576.5 ms
[2022-04-13 08:06:31	                main:574]	:	INFO	:	Epoch 1741 | loss: nan | val_loss: nan | Time: 1585.56 ms
[2022-04-13 08:06:33	                main:574]	:	INFO	:	Epoch 1742 | loss: nan | val_loss: nan | Time: 1579.04 ms
[2022-04-13 08:06:34	                main:574]	:	INFO	:	Epoch 1743 | loss: nan | val_loss: nan | Time: 1577.51 ms
[2022-04-13 08:06:36	                main:574]	:	INFO	:	Epoch 1744 | loss: nan | val_loss: nan | Time: 1580.74 ms
[2022-04-13 08:06:37	                main:574]	:	INFO	:	Epoch 1745 | loss: nan | val_loss: nan | Time: 1576.25 ms
[2022-04-13 08:06:39	                main:574]	:	INFO	:	Epoch 1746 | loss: nan | val_loss: nan | Time: 1578.71 ms
[2022-04-13 08:06:40	                main:574]	:	INFO	:	Epoch 1747 | loss: nan | val_loss: nan | Time: 1579.77 ms
[2022-04-13 08:06:42	                main:574]	:	INFO	:	Epoch 1748 | loss: nan | val_loss: nan | Time: 1576.87 ms
[2022-04-13 08:06:44	                main:574]	:	INFO	:	Epoch 1749 | loss: nan | val_loss: nan | Time: 1564.85 ms
[2022-04-13 08:06:45	                main:574]	:	INFO	:	Epoch 1750 | loss: nan | val_loss: nan | Time: 1568.03 ms
[2022-04-13 08:06:47	                main:574]	:	INFO	:	Epoch 1751 | loss: nan | val_loss: nan | Time: 1571.57 ms
[2022-04-13 08:06:48	                main:574]	:	INFO	:	Epoch 1752 | loss: nan | val_loss: nan | Time: 1567.54 ms
[2022-04-13 08:06:50	                main:574]	:	INFO	:	Epoch 1753 | loss: nan | val_loss: nan | Time: 1570.12 ms
[2022-04-13 08:06:51	                main:574]	:	INFO	:	Epoch 1754 | loss: nan | val_loss: nan | Time: 1581.17 ms
[2022-04-13 08:06:53	                main:574]	:	INFO	:	Epoch 1755 | loss: nan | val_loss: nan | Time: 1570.62 ms
[2022-04-13 08:07:05	                main:574]	:	INFO	:	Epoch 1756 | loss: nan | val_loss: nan | Time: 11853.3 ms
[2022-04-13 08:07:07	                main:574]	:	INFO	:	Epoch 1757 | loss: nan | val_loss: nan | Time: 1767.5 ms
[2022-04-13 08:07:08	                main:574]	:	INFO	:	Epoch 1758 | loss: nan | val_loss: nan | Time: 1572.81 ms
[2022-04-13 08:07:10	                main:574]	:	INFO	:	Epoch 1759 | loss: nan | val_loss: nan | Time: 1571.51 ms
[2022-04-13 08:07:11	                main:574]	:	INFO	:	Epoch 1760 | loss: nan | val_loss: nan | Time: 1571.45 ms
[2022-04-13 08:07:13	                main:574]	:	INFO	:	Epoch 1761 | loss: nan | val_loss: nan | Time: 1559.06 ms
[2022-04-13 08:07:15	                main:574]	:	INFO	:	Epoch 1762 | loss: nan | val_loss: nan | Time: 1559.9 ms
[2022-04-13 08:07:16	                main:574]	:	INFO	:	Epoch 1763 | loss: nan | val_loss: nan | Time: 1564.13 ms
[2022-04-13 08:07:18	                main:574]	:	INFO	:	Epoch 1764 | loss: nan | val_loss: nan | Time: 1562.04 ms
[2022-04-13 08:07:19	                main:574]	:	INFO	:	Epoch 1765 | loss: nan | val_loss: nan | Time: 1562.48 ms
[2022-04-13 08:07:21	                main:574]	:	INFO	:	Epoch 1766 | loss: nan | val_loss: nan | Time: 1565.53 ms
[2022-04-13 08:07:22	                main:574]	:	INFO	:	Epoch 1767 | loss: nan | val_loss: nan | Time: 1575.83 ms
[2022-04-13 08:07:24	                main:574]	:	INFO	:	Epoch 1768 | loss: nan | val_loss: nan | Time: 1561.47 ms
[2022-04-13 08:07:26	                main:574]	:	INFO	:	Epoch 1769 | loss: nan | val_loss: nan | Time: 1554.68 ms
[2022-04-13 08:07:27	                main:574]	:	INFO	:	Epoch 1770 | loss: nan | val_loss: nan | Time: 1562.91 ms
[2022-04-13 08:07:29	                main:574]	:	INFO	:	Epoch 1771 | loss: nan | val_loss: nan | Time: 1559.24 ms
[2022-04-13 08:07:30	                main:574]	:	INFO	:	Epoch 1772 | loss: nan | val_loss: nan | Time: 1562.04 ms
[2022-04-13 08:07:32	                main:574]	:	INFO	:	Epoch 1773 | loss: nan | val_loss: nan | Time: 1558.69 ms
[2022-04-13 08:07:33	                main:574]	:	INFO	:	Epoch 1774 | loss: nan | val_loss: nan | Time: 1560.38 ms
[2022-04-13 08:07:35	                main:574]	:	INFO	:	Epoch 1775 | loss: nan | val_loss: nan | Time: 1555.46 ms
[2022-04-13 08:07:37	                main:574]	:	INFO	:	Epoch 1776 | loss: nan | val_loss: nan | Time: 1562.45 ms
[2022-04-13 08:07:38	                main:574]	:	INFO	:	Epoch 1777 | loss: nan | val_loss: nan | Time: 1560.65 ms
[2022-04-13 08:07:40	                main:574]	:	INFO	:	Epoch 1778 | loss: nan | val_loss: nan | Time: 1565.33 ms
[2022-04-13 08:07:41	                main:574]	:	INFO	:	Epoch 1779 | loss: nan | val_loss: nan | Time: 1563.33 ms
[2022-04-13 08:07:43	                main:574]	:	INFO	:	Epoch 1780 | loss: nan | val_loss: nan | Time: 1561.35 ms
[2022-04-13 08:07:44	                main:574]	:	INFO	:	Epoch 1781 | loss: nan | val_loss: nan | Time: 1557.78 ms
[2022-04-13 08:07:56	                main:574]	:	INFO	:	Epoch 1782 | loss: nan | val_loss: nan | Time: 11968.3 ms
[2022-04-13 08:07:58	                main:574]	:	INFO	:	Epoch 1783 | loss: nan | val_loss: nan | Time: 1562.23 ms
[2022-04-13 08:07:59	                main:574]	:	INFO	:	Epoch 1784 | loss: nan | val_loss: nan | Time: 1560.33 ms
[2022-04-13 08:08:01	                main:574]	:	INFO	:	Epoch 1785 | loss: nan | val_loss: nan | Time: 1562.05 ms
[2022-04-13 08:08:03	                main:574]	:	INFO	:	Epoch 1786 | loss: nan | val_loss: nan | Time: 1561.36 ms
[2022-04-13 08:08:04	                main:574]	:	INFO	:	Epoch 1787 | loss: nan | val_loss: nan | Time: 1562.37 ms
[2022-04-13 08:08:06	                main:574]	:	INFO	:	Epoch 1788 | loss: nan | val_loss: nan | Time: 1561.79 ms
[2022-04-13 08:08:07	                main:574]	:	INFO	:	Epoch 1789 | loss: nan | val_loss: nan | Time: 1559.72 ms
[2022-04-13 08:08:09	                main:574]	:	INFO	:	Epoch 1790 | loss: nan | val_loss: nan | Time: 1560.09 ms
[2022-04-13 08:08:10	                main:574]	:	INFO	:	Epoch 1791 | loss: nan | val_loss: nan | Time: 1560.36 ms
[2022-04-13 08:08:12	                main:574]	:	INFO	:	Epoch 1792 | loss: nan | val_loss: nan | Time: 1566.8 ms
[2022-04-13 08:08:14	                main:574]	:	INFO	:	Epoch 1793 | loss: nan | val_loss: nan | Time: 1562.69 ms
[2022-04-13 08:08:15	                main:574]	:	INFO	:	Epoch 1794 | loss: nan | val_loss: nan | Time: 1560.3 ms
[2022-04-13 08:08:17	                main:574]	:	INFO	:	Epoch 1795 | loss: nan | val_loss: nan | Time: 1561.26 ms
[2022-04-13 08:08:18	                main:574]	:	INFO	:	Epoch 1796 | loss: nan | val_loss: nan | Time: 1562.71 ms
[2022-04-13 08:08:20	                main:574]	:	INFO	:	Epoch 1797 | loss: nan | val_loss: nan | Time: 1561.47 ms
[2022-04-13 08:08:21	                main:574]	:	INFO	:	Epoch 1798 | loss: nan | val_loss: nan | Time: 1565.95 ms
[2022-04-13 08:08:23	                main:574]	:	INFO	:	Epoch 1799 | loss: nan | val_loss: nan | Time: 1563.8 ms
[2022-04-13 08:08:25	                main:574]	:	INFO	:	Epoch 1800 | loss: nan | val_loss: nan | Time: 1563.1 ms
[2022-04-13 08:08:26	                main:574]	:	INFO	:	Epoch 1801 | loss: nan | val_loss: nan | Time: 1557.99 ms
[2022-04-13 08:08:28	                main:574]	:	INFO	:	Epoch 1802 | loss: nan | val_loss: nan | Time: 1561.25 ms
[2022-04-13 08:08:29	                main:574]	:	INFO	:	Epoch 1803 | loss: nan | val_loss: nan | Time: 1562.89 ms
[2022-04-13 08:08:31	                main:574]	:	INFO	:	Epoch 1804 | loss: nan | val_loss: nan | Time: 1558.48 ms
[2022-04-13 08:08:32	                main:574]	:	INFO	:	Epoch 1805 | loss: nan | val_loss: nan | Time: 1567.34 ms
[2022-04-13 08:08:34	                main:574]	:	INFO	:	Epoch 1806 | loss: nan | val_loss: nan | Time: 1568.44 ms
[2022-04-13 08:08:36	                main:574]	:	INFO	:	Epoch 1807 | loss: nan | val_loss: nan | Time: 1564.66 ms
[2022-04-13 08:08:37	                main:574]	:	INFO	:	Epoch 1808 | loss: nan | val_loss: nan | Time: 1562.35 ms
[2022-04-13 08:08:39	                main:574]	:	INFO	:	Epoch 1809 | loss: nan | val_loss: nan | Time: 1557.07 ms
[2022-04-13 08:08:40	                main:574]	:	INFO	:	Epoch 1810 | loss: nan | val_loss: nan | Time: 1564.87 ms
[2022-04-13 08:08:42	                main:574]	:	INFO	:	Epoch 1811 | loss: nan | val_loss: nan | Time: 1561.12 ms
[2022-04-13 08:08:43	                main:574]	:	INFO	:	Epoch 1812 | loss: nan | val_loss: nan | Time: 1559.08 ms
[2022-04-13 08:08:45	                main:574]	:	INFO	:	Epoch 1813 | loss: nan | val_loss: nan | Time: 1563.42 ms
[2022-04-13 08:08:46	                main:574]	:	INFO	:	Epoch 1814 | loss: nan | val_loss: nan | Time: 1569.75 ms
[2022-04-13 08:08:48	                main:574]	:	INFO	:	Epoch 1815 | loss: nan | val_loss: nan | Time: 1563.56 ms
[2022-04-13 08:08:50	                main:574]	:	INFO	:	Epoch 1816 | loss: nan | val_loss: nan | Time: 1564.74 ms
[2022-04-13 08:08:51	                main:574]	:	INFO	:	Epoch 1817 | loss: nan | val_loss: nan | Time: 1560.91 ms
[2022-04-13 08:08:53	                main:574]	:	INFO	:	Epoch 1818 | loss: nan | val_loss: nan | Time: 1561.52 ms
[2022-04-13 08:08:54	                main:574]	:	INFO	:	Epoch 1819 | loss: nan | val_loss: nan | Time: 1561.08 ms
[2022-04-13 08:09:06	                main:574]	:	INFO	:	Epoch 1820 | loss: nan | val_loss: nan | Time: 11977.6 ms
[2022-04-13 08:09:08	                main:574]	:	INFO	:	Epoch 1821 | loss: nan | val_loss: nan | Time: 1620.45 ms
[2022-04-13 08:09:10	                main:574]	:	INFO	:	Epoch 1822 | loss: nan | val_loss: nan | Time: 1563.03 ms
[2022-04-13 08:09:11	                main:574]	:	INFO	:	Epoch 1823 | loss: nan | val_loss: nan | Time: 1560.79 ms
[2022-04-13 08:09:13	                main:574]	:	INFO	:	Epoch 1824 | loss: nan | val_loss: nan | Time: 1560.54 ms
[2022-04-13 08:09:14	                main:574]	:	INFO	:	Epoch 1825 | loss: nan | val_loss: nan | Time: 1561.27 ms
[2022-04-13 08:09:16	                main:574]	:	INFO	:	Epoch 1826 | loss: nan | val_loss: nan | Time: 1561.95 ms
[2022-04-13 08:09:17	                main:574]	:	INFO	:	Epoch 1827 | loss: nan | val_loss: nan | Time: 1565.44 ms
[2022-04-13 08:09:19	                main:574]	:	INFO	:	Epoch 1828 | loss: nan | val_loss: nan | Time: 1560.6 ms
[2022-04-13 08:09:20	                main:574]	:	INFO	:	Epoch 1829 | loss: nan | val_loss: nan | Time: 1560.01 ms
[2022-04-13 08:09:22	                main:574]	:	INFO	:	Epoch 1830 | loss: nan | val_loss: nan | Time: 1567.22 ms
[2022-04-13 08:09:24	                main:574]	:	INFO	:	Epoch 1831 | loss: nan | val_loss: nan | Time: 1575.04 ms
[2022-04-13 08:09:25	                main:574]	:	INFO	:	Epoch 1832 | loss: nan | val_loss: nan | Time: 1564.27 ms
[2022-04-13 08:09:27	                main:574]	:	INFO	:	Epoch 1833 | loss: nan | val_loss: nan | Time: 1560.44 ms
[2022-04-13 08:09:28	                main:574]	:	INFO	:	Epoch 1834 | loss: nan | val_loss: nan | Time: 1561.47 ms
[2022-04-13 08:09:30	                main:574]	:	INFO	:	Epoch 1835 | loss: nan | val_loss: nan | Time: 1563.02 ms
[2022-04-13 08:09:31	                main:574]	:	INFO	:	Epoch 1836 | loss: nan | val_loss: nan | Time: 1563.27 ms
[2022-04-13 08:09:33	                main:574]	:	INFO	:	Epoch 1837 | loss: nan | val_loss: nan | Time: 1561.21 ms
[2022-04-13 08:09:35	                main:574]	:	INFO	:	Epoch 1838 | loss: nan | val_loss: nan | Time: 1563.79 ms
[2022-04-13 08:09:36	                main:574]	:	INFO	:	Epoch 1839 | loss: nan | val_loss: nan | Time: 1565.23 ms
[2022-04-13 08:09:38	                main:574]	:	INFO	:	Epoch 1840 | loss: nan | val_loss: nan | Time: 1564.48 ms
[2022-04-13 08:09:39	                main:574]	:	INFO	:	Epoch 1841 | loss: nan | val_loss: nan | Time: 1565.36 ms
[2022-04-13 08:09:41	                main:574]	:	INFO	:	Epoch 1842 | loss: nan | val_loss: nan | Time: 1565.51 ms
[2022-04-13 08:09:42	                main:574]	:	INFO	:	Epoch 1843 | loss: nan | val_loss: nan | Time: 1563.17 ms
[2022-04-13 08:09:44	                main:574]	:	INFO	:	Epoch 1844 | loss: nan | val_loss: nan | Time: 1563.98 ms
[2022-04-13 08:09:46	                main:574]	:	INFO	:	Epoch 1845 | loss: nan | val_loss: nan | Time: 1559.97 ms
[2022-04-13 08:09:58	                main:574]	:	INFO	:	Epoch 1846 | loss: nan | val_loss: nan | Time: 12012.5 ms
[2022-04-13 08:09:59	                main:574]	:	INFO	:	Epoch 1847 | loss: nan | val_loss: nan | Time: 1559.94 ms
[2022-04-13 08:10:01	                main:574]	:	INFO	:	Epoch 1848 | loss: nan | val_loss: nan | Time: 1561.31 ms
[2022-04-13 08:10:02	                main:574]	:	INFO	:	Epoch 1849 | loss: nan | val_loss: nan | Time: 1559.75 ms
[2022-04-13 08:10:04	                main:574]	:	INFO	:	Epoch 1850 | loss: nan | val_loss: nan | Time: 1563.35 ms
[2022-04-13 08:10:05	                main:574]	:	INFO	:	Epoch 1851 | loss: nan | val_loss: nan | Time: 1561 ms
[2022-04-13 08:10:07	                main:574]	:	INFO	:	Epoch 1852 | loss: nan | val_loss: nan | Time: 1562.48 ms
[2022-04-13 08:10:09	                main:574]	:	INFO	:	Epoch 1853 | loss: nan | val_loss: nan | Time: 1559.42 ms
[2022-04-13 08:10:10	                main:574]	:	INFO	:	Epoch 1854 | loss: nan | val_loss: nan | Time: 1562.76 ms
[2022-04-13 08:10:12	                main:574]	:	INFO	:	Epoch 1855 | loss: nan | val_loss: nan | Time: 1560.24 ms
[2022-04-13 08:10:13	                main:574]	:	INFO	:	Epoch 1856 | loss: nan | val_loss: nan | Time: 1561.44 ms
[2022-04-13 08:10:15	                main:574]	:	INFO	:	Epoch 1857 | loss: nan | val_loss: nan | Time: 1558.4 ms
[2022-04-13 08:10:16	                main:574]	:	INFO	:	Epoch 1858 | loss: nan | val_loss: nan | Time: 1565.01 ms
[2022-04-13 08:10:18	                main:574]	:	INFO	:	Epoch 1859 | loss: nan | val_loss: nan | Time: 1560.2 ms
[2022-04-13 08:10:20	                main:574]	:	INFO	:	Epoch 1860 | loss: nan | val_loss: nan | Time: 1560.46 ms
[2022-04-13 08:10:21	                main:574]	:	INFO	:	Epoch 1861 | loss: nan | val_loss: nan | Time: 1562.71 ms
[2022-04-13 08:10:23	                main:574]	:	INFO	:	Epoch 1862 | loss: nan | val_loss: nan | Time: 1560.61 ms
[2022-04-13 08:10:24	                main:574]	:	INFO	:	Epoch 1863 | loss: nan | val_loss: nan | Time: 1565.77 ms
[2022-04-13 08:10:26	                main:574]	:	INFO	:	Epoch 1864 | loss: nan | val_loss: nan | Time: 1565.51 ms
[2022-04-13 08:10:27	                main:574]	:	INFO	:	Epoch 1865 | loss: nan | val_loss: nan | Time: 1560.31 ms
[2022-04-13 08:10:29	                main:574]	:	INFO	:	Epoch 1866 | loss: nan | val_loss: nan | Time: 1562.97 ms
[2022-04-13 08:10:31	                main:574]	:	INFO	:	Epoch 1867 | loss: nan | val_loss: nan | Time: 1561.01 ms
[2022-04-13 08:10:32	                main:574]	:	INFO	:	Epoch 1868 | loss: nan | val_loss: nan | Time: 1563.77 ms
[2022-04-13 08:10:34	                main:574]	:	INFO	:	Epoch 1869 | loss: nan | val_loss: nan | Time: 1561.34 ms
[2022-04-13 08:10:35	                main:574]	:	INFO	:	Epoch 1870 | loss: nan | val_loss: nan | Time: 1564.19 ms
[2022-04-13 08:10:37	                main:574]	:	INFO	:	Epoch 1871 | loss: nan | val_loss: nan | Time: 1562.88 ms
[2022-04-13 08:10:38	                main:574]	:	INFO	:	Epoch 1872 | loss: nan | val_loss: nan | Time: 1567.51 ms
[2022-04-13 08:10:40	                main:574]	:	INFO	:	Epoch 1873 | loss: nan | val_loss: nan | Time: 1559.95 ms
[2022-04-13 08:10:41	                main:574]	:	INFO	:	Epoch 1874 | loss: nan | val_loss: nan | Time: 1562.65 ms
[2022-04-13 08:10:43	                main:574]	:	INFO	:	Epoch 1875 | loss: nan | val_loss: nan | Time: 1564.76 ms
[2022-04-13 08:10:45	                main:574]	:	INFO	:	Epoch 1876 | loss: nan | val_loss: nan | Time: 1561.93 ms
[2022-04-13 08:10:46	                main:574]	:	INFO	:	Epoch 1877 | loss: nan | val_loss: nan | Time: 1569.2 ms
[2022-04-13 08:10:48	                main:574]	:	INFO	:	Epoch 1878 | loss: nan | val_loss: nan | Time: 1564.31 ms
[2022-04-13 08:10:49	                main:574]	:	INFO	:	Epoch 1879 | loss: nan | val_loss: nan | Time: 1562.25 ms
[2022-04-13 08:10:51	                main:574]	:	INFO	:	Epoch 1880 | loss: nan | val_loss: nan | Time: 1563.6 ms
[2022-04-13 08:10:52	                main:574]	:	INFO	:	Epoch 1881 | loss: nan | val_loss: nan | Time: 1562.38 ms
[2022-04-13 08:10:54	                main:574]	:	INFO	:	Epoch 1882 | loss: nan | val_loss: nan | Time: 1561.52 ms
[2022-04-13 08:10:56	                main:574]	:	INFO	:	Epoch 1883 | loss: nan | val_loss: nan | Time: 1557.88 ms
[2022-04-13 08:10:57	                main:574]	:	INFO	:	Epoch 1884 | loss: nan | val_loss: nan | Time: 1561.29 ms
[2022-04-13 08:10:59	                main:574]	:	INFO	:	Epoch 1885 | loss: nan | val_loss: nan | Time: 1559.92 ms
[2022-04-13 08:11:00	                main:574]	:	INFO	:	Epoch 1886 | loss: nan | val_loss: nan | Time: 1565.68 ms
[2022-04-13 08:11:02	                main:574]	:	INFO	:	Epoch 1887 | loss: nan | val_loss: nan | Time: 1563.51 ms
[2022-04-13 08:11:03	                main:574]	:	INFO	:	Epoch 1888 | loss: nan | val_loss: nan | Time: 1562.64 ms
[2022-04-13 08:11:05	                main:574]	:	INFO	:	Epoch 1889 | loss: nan | val_loss: nan | Time: 1557.67 ms
[2022-04-13 08:11:07	                main:574]	:	INFO	:	Epoch 1890 | loss: nan | val_loss: nan | Time: 1565.03 ms
[2022-04-13 08:11:08	                main:574]	:	INFO	:	Epoch 1891 | loss: nan | val_loss: nan | Time: 1560.46 ms
[2022-04-13 08:11:10	                main:574]	:	INFO	:	Epoch 1892 | loss: nan | val_loss: nan | Time: 1558.89 ms
[2022-04-13 08:11:11	                main:574]	:	INFO	:	Epoch 1893 | loss: nan | val_loss: nan | Time: 1561.82 ms
[2022-04-13 08:11:13	                main:574]	:	INFO	:	Epoch 1894 | loss: nan | val_loss: nan | Time: 1563.13 ms
[2022-04-13 08:11:14	                main:574]	:	INFO	:	Epoch 1895 | loss: nan | val_loss: nan | Time: 1559.35 ms
[2022-04-13 08:11:16	                main:574]	:	INFO	:	Epoch 1896 | loss: nan | val_loss: nan | Time: 1561.18 ms
[2022-04-13 08:11:18	                main:574]	:	INFO	:	Epoch 1897 | loss: nan | val_loss: nan | Time: 1562.33 ms
[2022-04-13 08:11:19	                main:574]	:	INFO	:	Epoch 1898 | loss: nan | val_loss: nan | Time: 1563.79 ms
[2022-04-13 08:11:21	                main:574]	:	INFO	:	Epoch 1899 | loss: nan | val_loss: nan | Time: 1558.17 ms
[2022-04-13 08:11:22	                main:574]	:	INFO	:	Epoch 1900 | loss: nan | val_loss: nan | Time: 1558.14 ms
[2022-04-13 08:11:24	                main:574]	:	INFO	:	Epoch 1901 | loss: nan | val_loss: nan | Time: 1571.83 ms
[2022-04-13 08:11:25	                main:574]	:	INFO	:	Epoch 1902 | loss: nan | val_loss: nan | Time: 1567.03 ms
[2022-04-13 08:11:27	                main:574]	:	INFO	:	Epoch 1903 | loss: nan | val_loss: nan | Time: 1564.29 ms
[2022-04-13 08:11:29	                main:574]	:	INFO	:	Epoch 1904 | loss: nan | val_loss: nan | Time: 1567.78 ms
[2022-04-13 08:11:30	                main:574]	:	INFO	:	Epoch 1905 | loss: nan | val_loss: nan | Time: 1558.75 ms
[2022-04-13 08:11:32	                main:574]	:	INFO	:	Epoch 1906 | loss: nan | val_loss: nan | Time: 1560.27 ms
[2022-04-13 08:11:33	                main:574]	:	INFO	:	Epoch 1907 | loss: nan | val_loss: nan | Time: 1561.3 ms
[2022-04-13 08:11:35	                main:574]	:	INFO	:	Epoch 1908 | loss: nan | val_loss: nan | Time: 1561.78 ms
[2022-04-13 08:11:36	                main:574]	:	INFO	:	Epoch 1909 | loss: nan | val_loss: nan | Time: 1561.92 ms
[2022-04-13 08:11:38	                main:574]	:	INFO	:	Epoch 1910 | loss: nan | val_loss: nan | Time: 1563.74 ms
[2022-04-13 08:11:39	                main:574]	:	INFO	:	Epoch 1911 | loss: nan | val_loss: nan | Time: 1558.54 ms
[2022-04-13 08:11:41	                main:574]	:	INFO	:	Epoch 1912 | loss: nan | val_loss: nan | Time: 1562.13 ms
[2022-04-13 08:11:43	                main:574]	:	INFO	:	Epoch 1913 | loss: nan | val_loss: nan | Time: 1557.9 ms
[2022-04-13 08:11:44	                main:574]	:	INFO	:	Epoch 1914 | loss: nan | val_loss: nan | Time: 1562.71 ms
[2022-04-13 08:11:46	                main:574]	:	INFO	:	Epoch 1915 | loss: nan | val_loss: nan | Time: 1560.25 ms
[2022-04-13 08:11:58	                main:574]	:	INFO	:	Epoch 1916 | loss: nan | val_loss: nan | Time: 11928.2 ms
[2022-04-13 08:11:59	                main:574]	:	INFO	:	Epoch 1917 | loss: nan | val_loss: nan | Time: 1683.72 ms
[2022-04-13 08:12:01	                main:574]	:	INFO	:	Epoch 1918 | loss: nan | val_loss: nan | Time: 1562.44 ms
[2022-04-13 08:12:03	                main:574]	:	INFO	:	Epoch 1919 | loss: nan | val_loss: nan | Time: 1563.43 ms
[2022-04-13 08:12:04	                main:574]	:	INFO	:	Epoch 1920 | loss: nan | val_loss: nan | Time: 1562.33 ms
[2022-04-13 08:12:06	                main:574]	:	INFO	:	Epoch 1921 | loss: nan | val_loss: nan | Time: 1560.4 ms
[2022-04-13 08:12:07	                main:574]	:	INFO	:	Epoch 1922 | loss: nan | val_loss: nan | Time: 1562.85 ms
[2022-04-13 08:12:09	                main:574]	:	INFO	:	Epoch 1923 | loss: nan | val_loss: nan | Time: 1560.36 ms
[2022-04-13 08:12:10	                main:574]	:	INFO	:	Epoch 1924 | loss: nan | val_loss: nan | Time: 1557.27 ms
[2022-04-13 08:12:12	                main:574]	:	INFO	:	Epoch 1925 | loss: nan | val_loss: nan | Time: 1561.11 ms
[2022-04-13 08:12:13	                main:574]	:	INFO	:	Epoch 1926 | loss: nan | val_loss: nan | Time: 1566.38 ms
[2022-04-13 08:12:15	                main:574]	:	INFO	:	Epoch 1927 | loss: nan | val_loss: nan | Time: 1561.18 ms
[2022-04-13 08:12:17	                main:574]	:	INFO	:	Epoch 1928 | loss: nan | val_loss: nan | Time: 1561.08 ms
[2022-04-13 08:12:18	                main:574]	:	INFO	:	Epoch 1929 | loss: nan | val_loss: nan | Time: 1557.21 ms
[2022-04-13 08:12:20	                main:574]	:	INFO	:	Epoch 1930 | loss: nan | val_loss: nan | Time: 1563.42 ms
[2022-04-13 08:12:21	                main:574]	:	INFO	:	Epoch 1931 | loss: nan | val_loss: nan | Time: 1560.26 ms
[2022-04-13 08:12:23	                main:574]	:	INFO	:	Epoch 1932 | loss: nan | val_loss: nan | Time: 1561.83 ms
[2022-04-13 08:12:24	                main:574]	:	INFO	:	Epoch 1933 | loss: nan | val_loss: nan | Time: 1559.42 ms
[2022-04-13 08:12:26	                main:574]	:	INFO	:	Epoch 1934 | loss: nan | val_loss: nan | Time: 1560.68 ms
[2022-04-13 08:12:28	                main:574]	:	INFO	:	Epoch 1935 | loss: nan | val_loss: nan | Time: 1567.18 ms
[2022-04-13 08:12:29	                main:574]	:	INFO	:	Epoch 1936 | loss: nan | val_loss: nan | Time: 1561.32 ms
[2022-04-13 08:12:31	                main:574]	:	INFO	:	Epoch 1937 | loss: nan | val_loss: nan | Time: 1559.08 ms
[2022-04-13 08:12:32	                main:574]	:	INFO	:	Epoch 1938 | loss: nan | val_loss: nan | Time: 1563.52 ms
[2022-04-13 08:12:34	                main:574]	:	INFO	:	Epoch 1939 | loss: nan | val_loss: nan | Time: 1564.44 ms
[2022-04-13 08:12:35	                main:574]	:	INFO	:	Epoch 1940 | loss: nan | val_loss: nan | Time: 1562.66 ms
[2022-04-13 08:12:37	                main:574]	:	INFO	:	Epoch 1941 | loss: nan | val_loss: nan | Time: 1564.1 ms
[2022-04-13 08:12:39	                main:574]	:	INFO	:	Epoch 1942 | loss: nan | val_loss: nan | Time: 1561.88 ms
[2022-04-13 08:12:40	                main:574]	:	INFO	:	Epoch 1943 | loss: nan | val_loss: nan | Time: 1562.18 ms
[2022-04-13 08:12:42	                main:574]	:	INFO	:	Epoch 1944 | loss: nan | val_loss: nan | Time: 1562.74 ms
[2022-04-13 08:12:43	                main:574]	:	INFO	:	Epoch 1945 | loss: nan | val_loss: nan | Time: 1560.93 ms
[2022-04-13 08:12:45	                main:574]	:	INFO	:	Epoch 1946 | loss: nan | val_loss: nan | Time: 1561.81 ms
[2022-04-13 08:12:46	                main:574]	:	INFO	:	Epoch 1947 | loss: nan | val_loss: nan | Time: 1559.88 ms
[2022-04-13 08:12:58	                main:574]	:	INFO	:	Epoch 1948 | loss: nan | val_loss: nan | Time: 11951.6 ms
[2022-04-13 08:13:00	                main:574]	:	INFO	:	Epoch 1949 | loss: nan | val_loss: nan | Time: 1609.06 ms
[2022-04-13 08:13:02	                main:574]	:	INFO	:	Epoch 1950 | loss: nan | val_loss: nan | Time: 1565.44 ms
[2022-04-13 08:13:03	                main:574]	:	INFO	:	Epoch 1951 | loss: nan | val_loss: nan | Time: 1561.21 ms
[2022-04-13 08:13:05	                main:574]	:	INFO	:	Epoch 1952 | loss: nan | val_loss: nan | Time: 1559.5 ms
[2022-04-13 08:13:06	                main:574]	:	INFO	:	Epoch 1953 | loss: nan | val_loss: nan | Time: 1565.65 ms
[2022-04-13 08:13:08	                main:574]	:	INFO	:	Epoch 1954 | loss: nan | val_loss: nan | Time: 1560.63 ms
[2022-04-13 08:13:09	                main:574]	:	INFO	:	Epoch 1955 | loss: nan | val_loss: nan | Time: 1561.4 ms
[2022-04-13 08:13:11	                main:574]	:	INFO	:	Epoch 1956 | loss: nan | val_loss: nan | Time: 1563.72 ms
[2022-04-13 08:13:12	                main:574]	:	INFO	:	Epoch 1957 | loss: nan | val_loss: nan | Time: 1556 ms
[2022-04-13 08:13:14	                main:574]	:	INFO	:	Epoch 1958 | loss: nan | val_loss: nan | Time: 1563.38 ms
[2022-04-13 08:13:16	                main:574]	:	INFO	:	Epoch 1959 | loss: nan | val_loss: nan | Time: 1559.53 ms
[2022-04-13 08:13:17	                main:574]	:	INFO	:	Epoch 1960 | loss: nan | val_loss: nan | Time: 1566.04 ms
[2022-04-13 08:13:19	                main:574]	:	INFO	:	Epoch 1961 | loss: nan | val_loss: nan | Time: 1559.34 ms
[2022-04-13 08:13:20	                main:574]	:	INFO	:	Epoch 1962 | loss: nan | val_loss: nan | Time: 1560.94 ms
[2022-04-13 08:13:22	                main:574]	:	INFO	:	Epoch 1963 | loss: nan | val_loss: nan | Time: 1562.07 ms
[2022-04-13 08:13:23	                main:574]	:	INFO	:	Epoch 1964 | loss: nan | val_loss: nan | Time: 1557.2 ms
[2022-04-13 08:13:25	                main:574]	:	INFO	:	Epoch 1965 | loss: nan | val_loss: nan | Time: 1572.36 ms
[2022-04-13 08:13:27	                main:574]	:	INFO	:	Epoch 1966 | loss: nan | val_loss: nan | Time: 1558.42 ms
[2022-04-13 08:13:28	                main:574]	:	INFO	:	Epoch 1967 | loss: nan | val_loss: nan | Time: 1565.42 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1070)
[2022-04-13 09:03:21	                main:435]	:	INFO	:	Set logging level to 1
[2022-04-13 09:03:21	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-04-13 09:03:21	                main:444]	:	INFO	:	Resolving all filenames
[2022-04-13 09:03:21	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-13 09:03:21	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-13 09:03:21	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-13 09:03:21	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-13 09:03:21	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-13 09:03:21	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-04-13 09:03:21	                main:474]	:	INFO	:	Configuration: 
[2022-04-13 09:03:21	                main:475]	:	INFO	:	    Model type: GRU
[2022-04-13 09:03:21	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-04-13 09:03:21	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-04-13 09:03:21	                main:478]	:	INFO	:	    Batch Size: 128
[2022-04-13 09:03:21	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-04-13 09:03:21	                main:480]	:	INFO	:	    Patience: 10
[2022-04-13 09:03:21	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-04-13 09:03:21	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-04-13 09:03:21	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-04-13 09:03:21	                main:484]	:	INFO	:	    # Threads: 1
[2022-04-13 09:03:21	                main:486]	:	INFO	:	Preparing Dataset
[2022-04-13 09:03:21	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-13 09:03:21	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-13 09:03:22	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-04-13 09:03:22	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-13 09:03:22	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-13 09:03:22	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-04-13 09:03:22	                main:494]	:	INFO	:	Creating Model
[2022-04-13 09:03:22	                main:507]	:	INFO	:	Preparing config file
[2022-04-13 09:03:23	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-04-13 09:03:23	                main:512]	:	INFO	:	Loading config


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFAA731478C

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 04/13/22 09:03:23
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\10;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 00000000bcc60000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000a9d40000 0000000000209000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.22000.527) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.22000.434 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.434

ModLoad: 00000000a7c60000 00000000000bd000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.22000.434) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.22000.434 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.434

ModLoad: 00000000a72d0000 0000000000374000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.22000.527) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.22000.434 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.434

ModLoad: 00000000a9140000 00000000001ac000 C:\WINDOWS\System32\USER32.dll (6.2.22000.282) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000a7a90000 0000000000026000 C:\WINDOWS\System32\win32u.dll (6.2.22000.556) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.22000.556 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.556

ModLoad: 00000000a9110000 0000000000029000 C:\WINDOWS\System32\GDI32.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000a78f0000 0000000000112000 C:\WINDOWS\System32\gdi32full.dll (6.2.22000.527) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.22000.527 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.527

ModLoad: 00000000a7230000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000097890000 0000000000058000 C:\ProgramData\BOINC\slots\10\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000a7ac0000 0000000000111000 C:\WINDOWS\System32\ucrtbase.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000a7e80000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.22000.434) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000a8b70000 00000000000a3000 C:\WINDOWS\System32\msvcrt.dll (7.0.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.22000.1

ModLoad: 00000000a92f0000 000000000009e000 C:\WINDOWS\System32\sechost.dll (6.2.22000.556) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000a7d60000 0000000000120000 C:\WINDOWS\System32\RPCRT4.dll (6.2.22000.434) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000918d0000 000000000008d000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.29.30139.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\12\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.29.30139.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.29.30139.0

ModLoad: 000000009f110000 0000000000221000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000091b10000 000000000001b000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.29.30139.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\12\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.29.30139.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.29.30139.0

ModLoad: 00000000908b0000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.29.30139.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\12\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.29.30139.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.29.30139.0

ModLoad: 00000000946f0000 000000000abe7000 C:\ProgramData\BOINC\slots\10\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000058920000 000000000020d000 C:\ProgramData\BOINC\slots\10\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 000000004e960000 00000000002db000 C:\ProgramData\BOINC\slots\10\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000092ad0000 0000000000040000 C:\ProgramData\BOINC\slots\10\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000050470000 0000000024b49000 C:\ProgramData\BOINC\slots\10\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000080900000 0000000000045000 C:\ProgramData\BOINC\slots\10\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000007b440000 00000000034b2000 C:\ProgramData\BOINC\slots\10\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 000000007e900000 00000000030a5000 C:\ProgramData\BOINC\slots\10\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 000000009ebb0000 0000000000010000 C:\ProgramData\BOINC\slots\10\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 00000000281c0000 0000000003d5b000 C:\ProgramData\BOINC\slots\10\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000adf00000 0000000001eca000 C:\ProgramData\BOINC\slots\10\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 000000002bf20000 000000000919f000 C:\ProgramData\BOINC\slots\10\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000350c0000 000000001b3a4000 C:\ProgramData\BOINC\slots\10\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 00000000a8390000 0000000000031000 C:\WINDOWS\System32\IMM32.DLL (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000a6370000 0000000000018000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.22000.71) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.22000.71 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.71

ModLoad: 00000000a4a40000 0000000000038000 C:\WINDOWS\SYSTEM32\dxcore.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : DXCore.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000a83d0000 000000000046c000 C:\WINDOWS\System32\Setupapi.dll (6.2.22000.469) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000a6f50000 000000000002c000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000a6f00000 000000000004c000 C:\WINDOWS\SYSTEM32\cfgmgr32.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000a7650000 0000000000067000 C:\WINDOWS\System32\WINTRUST.dll (6.2.22000.527) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.22000.527 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.527

ModLoad: 00000000a76c0000 0000000000162000 C:\WINDOWS\System32\CRYPT32.dll (6.2.22000.348) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000a6b20000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000a94e0000 00000000007ae000 C:\WINDOWS\System32\Shell32.dll (6.2.22000.527) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.22000.184 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.184

ModLoad: 00000000a5360000 0000000000868000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.22000.527) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.22000.184 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.184

ModLoad: 00000000a7f30000 0000000000378000 C:\WINDOWS\System32\combase.dll (6.2.22000.527) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000a51f0000 0000000000166000 C:\WINDOWS\SYSTEM32\wintypes.dll (6.2.22000.527) (-exported- Symbols Loaded)
    Linked PDB Filename   : WinTypes.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000a8a70000 00000000000ea000 C:\WINDOWS\System32\SHCORE.dll (6.2.22000.71) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000a9ca0000 000000000005d000 C:\WINDOWS\System32\shlwapi.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 000000004b9b0000 00000000002cd000 C:\WINDOWS\system32\nvcuda.dll (30.0.15.1179) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_75\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 30.0.15.1179
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.6.110 driver
    Product Version       : 30.0.15.1179

ModLoad: 000000008f3b0000 00000000016a0000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_3b12ac0f95b18b9d\nvcuda64.dll (30.0.15.1179) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_75\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 30.0.15.1179
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.6.110 driver
    Product Version       : 30.0.15.1179

ModLoad: 00000000a17e0000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000a1710000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 000000009ff20000 0000000000149000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.22000.120) (-exported- Symbols Loaded)
    Linked PDB Filename   : drvstore.pdb
    File Version          : 10.0.22000.120 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.120

ModLoad: 00000000a6a80000 000000000003d000 C:\WINDOWS\SYSTEM32\wldp.dll (6.2.22000.120) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000a69f0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 000000009f480000 0000000000768000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.15.1179) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_75\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 30.0.15.1179
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 30.0.15.1179

ModLoad: 00000000a7a10000 000000000007f000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.22000.376) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.22000.376 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.376



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3626, Write: 308, Other 863

- I/O Transfers Counters -
Read: 6811039, Write: 6051, Other 27260

- Paged Pool Usage -
QuotaPagedPoolUsage: 3448336, QuotaPeakPagedPoolUsage: 3448336
QuotaNonPagedPoolUsage: 37800, QuotaPeakNonPagedPoolUsage: 37800

- Virtual Memory Usage -
VirtualSize: -1392513024, PeakVirtualSize: -796504064

- Pagefile Usage -
PagefileUsage: -1392513024, PeakPagefileUsage: -1392496640

- Working Set Size -
WorkingSetSize: 1159712768, PeakWorkingSetSize: 1159712768, PageFaultCount: 395225

*** Dump of thread ID 53156 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 4531250.000000, User Time: 11250000.000000, Wait Time: 92481064.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFAA731478C

- Registers -
rax=00000000a9d68300 rbx=00000000bcfc4910 rcx=000000004590331d rdx=0000000079b86140 rsi=0000000079b869a0 rdi=0000000019930520
r8=0000000000000004 r9=0000000079b86198 r10=0000000000000004 r11=00000000de3ec1e0 r12=00000000e32d4ce0 r13=0000000079b86bb0
r14=00000000856a8650 r15=0000000000000000 rip=00000000a731478c rsp=0000000079b86840 rbp=0000000079b86b30
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
79b86910 bceda884 00000040 0000004f e32d3c00 000003db KERNELBASE!RaiseException+0x0 
79b86970 bcc81ca6 00003db0 00000000 8569f938 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
79b86a20 bcc8593b 00000000 00000020 00000000 00000030 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
79b86b70 bcc81a78 00000000 00000000 79b86ea0 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
79b86c40 bcc81cfc 79b86ea0 00000000 00000080 79b87170 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
79b86d00 bcc8c4dd 79b87170 79b87170 79b87170 79b87170 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
79b86ff0 bcc7b2fe 79b87608 79b87170 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
79b9fd90 bcebc6f8 a48b94f0 00000000 00000000 a490ff20 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
79b9fdd0 a7c754e0 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
79b9fe00 a9d4485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
79b9fe80 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 32984 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 92480960.000000

- Registers -
rax=00000000000001de rbx=00000000a2cd9fb0 rcx=0000000000000074 rdx=00000000a2cd9c30 rsi=00000000a2cd77b0 rdi=00000000a2cd9fb0
r8=0000000079efedc0 r9=0000000000000000 r10=0000000079efef06 r11=0000000079efebc0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000a9de7304 rsp=0000000079eff638 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
79eff630 a9d56c2f 00000000 00000000 a2cd77b0 a2cd9fb0 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
79eff920 a7c754e0 00000000 00000000 00000000 00000000 ntdll!EtwNotificationRegister+0x0 
79eff950 a9d4485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
79eff9d0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 39452 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 156250.000000, Wait Time: 92480960.000000

- Registers -
rax=00000000000001de rbx=00000000a2cda3e0 rcx=0000000000000074 rdx=00000000a2cda060 rsi=00000000a2cd77b0 rdi=00000000a2cda3e0
r8=00000000a17e5004 r9=0000000000000000 r10=00000000a17e00f0 r11=0000000000000001 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000a9de7304 rsp=0000000079fff4b8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
79fff4b0 a9d56c2f 00000000 00000000 a2cd77b0 a2cda3e0 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
79fff7a0 a7c754e0 00000000 00000000 00000000 00000000 ntdll!EtwNotificationRegister+0x0 
79fff7d0 a9d4485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
79fff850 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 45824 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 92480960.000000

- Registers -
rax=00000000000001de rbx=00000000a2cdb3f0 rcx=0000000000000074 rdx=00000000a2cdb070 rsi=00000000a2cd77b0 rdi=00000000a2cdb3f0
r8=0000000000000008 r9=0000000000000040 r10=0000000000000580 r11=000000009d848c05 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000a9de7304 rsp=000000007a0ffaf8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
7a0ffaf0 a9d56c2f 00000000 00000000 a2cd77b0 a2cdb3f0 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
7a0ffde0 a7c754e0 00000000 00000000 00000000 00000000 ntdll!EtwNotificationRegister+0x0 
7a0ffe10 a9d4485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
7a0ffe90 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 37308 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 92481056.000000

- Registers -
rax=0000000000000034 rbx=000000007a2ffc20 rcx=0000000000000000 rdx=000000007a2ffc20 rsi=0000000079d5a000 rdi=0000000000000000
r8=000000007a2ffb58 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000a9de3dd4 rsp=000000007a2ffb58 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
7a2ffb50 a9d9b5c3 00000000 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0 
7a2ffb80 a731b3a1 00000000 00000000 00000000 00000000 ntdll!RtlDelayExecution+0x0 
7a2ffc00 bcc9a07f 00000000 00000000 fff0bdc0 00000000 KERNELBASE!SleepEx+0x0 
7a2ffc30 a7c754e0 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
7a2ffc60 a9d4485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
7a2ffce0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 47944 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 92481064.000000

- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=000000007a3ff680 rsi=0000000000000000 rdi=000000000000000d
r8=000000007a3ff328 r9=0000000000000000 r10=0000000000000000 r11=000000007a3ff5f0 r12=0000000000000064 r13=000000007a3ff680
r14=000000007a3ff380 r15=0000000000000000 rip=00000000a9de42a4 rsp=000000007a3ff328 rbp=00000000a4ac2d40
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
7a3ff320 a731fb10 00000000 00000000 00000000 00000000 ntdll!NtWaitForMultipleObjects+0x0 
7a3ff610 a731fa0e 8f8ff1c8 a4280ab0 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
7a3ff650 8f58d554 a4accac0 00000000 a4abef60 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
7a3ff890 8f6358cd 00000000 a4ac2d40 00000000 00000000 nvcuda64!+0x0 
7a3ff940 8f58cf23 712493ab 70751acc a509b820 00000000 nvcuda64!cuProfilerStop+0x0 
7a3ff970 8f8c4594 a509b820 00000000 00000000 00000000 nvcuda64!+0x0 
7a3ff9a0 a7c754e0 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
7a3ff9d0 a9d4485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
7a3ffa50 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 39468 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 92480992.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002b4 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002b4
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=00000000a4aa8580 r13=0000000000000000
r14=00000000000002b4 r15=0000000000000000 rip=00000000a9de37d4 rsp=000000007a4ff778 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
7a4ff770 a7312a4e 00000000 00000000 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0 
7a4ff810 8f7b5d0e a509c1e0 00000000 00000000 000002b4 KERNELBASE!WaitForSingleObjectEx+0x0 
7a4ffa50 8f58cf23 00000000 a509c1e0 8f3b0000 a4ae1310 nvcuda64!cuProfilerStop+0x0 
7a4ffa80 8f8c4594 a509c1e0 00000000 00000000 00000000 nvcuda64!+0x0 
7a4ffab0 a7c754e0 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
7a4ffae0 a9d4485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
7a4ffb60 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)