Task 13499843

Name ParityModified-1647042637-11191-1-0_1
Workunit 10167014
Created 21 Mar 2022, 8:43:22 UTC
Sent 21 Mar 2022, 9:35:14 UTC
Report deadline 29 Mar 2022, 9:35:14 UTC
Received 21 Mar 2022, 18:03:13 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 18317
Run time 2 hours 56 min 41 sec
CPU time 2 hours 47 min 7 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 882.14 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.55 GB
Peak swap size 3.45 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
:	Epoch 1733 | loss: nan | val_loss: nan | Time: 5326.72 ms
[2022-03-21 17:35:51	                main:574]	:	INFO	:	Epoch 1734 | loss: nan | val_loss: nan | Time: 5325.4 ms
[2022-03-21 17:35:56	                main:574]	:	INFO	:	Epoch 1735 | loss: nan | val_loss: nan | Time: 5326.78 ms
[2022-03-21 17:36:01	                main:574]	:	INFO	:	Epoch 1736 | loss: nan | val_loss: nan | Time: 5327.47 ms
[2022-03-21 17:36:07	                main:574]	:	INFO	:	Epoch 1737 | loss: nan | val_loss: nan | Time: 5324.8 ms
[2022-03-21 17:36:12	                main:574]	:	INFO	:	Epoch 1738 | loss: nan | val_loss: nan | Time: 5333.15 ms
[2022-03-21 17:36:17	                main:574]	:	INFO	:	Epoch 1739 | loss: nan | val_loss: nan | Time: 5325.51 ms
[2022-03-21 17:36:23	                main:574]	:	INFO	:	Epoch 1740 | loss: nan | val_loss: nan | Time: 5325.56 ms
[2022-03-21 17:36:28	                main:574]	:	INFO	:	Epoch 1741 | loss: nan | val_loss: nan | Time: 5332.37 ms
[2022-03-21 17:36:33	                main:574]	:	INFO	:	Epoch 1742 | loss: nan | val_loss: nan | Time: 5327.23 ms
[2022-03-21 17:36:39	                main:574]	:	INFO	:	Epoch 1743 | loss: nan | val_loss: nan | Time: 5322.43 ms
[2022-03-21 17:36:44	                main:574]	:	INFO	:	Epoch 1744 | loss: nan | val_loss: nan | Time: 5327.26 ms
[2022-03-21 17:36:49	                main:574]	:	INFO	:	Epoch 1745 | loss: nan | val_loss: nan | Time: 5318.23 ms
[2022-03-21 17:36:55	                main:574]	:	INFO	:	Epoch 1746 | loss: nan | val_loss: nan | Time: 5320.75 ms
[2022-03-21 17:37:00	                main:574]	:	INFO	:	Epoch 1747 | loss: nan | val_loss: nan | Time: 5336.13 ms
[2022-03-21 17:37:05	                main:574]	:	INFO	:	Epoch 1748 | loss: nan | val_loss: nan | Time: 5329.93 ms
[2022-03-21 17:37:11	                main:574]	:	INFO	:	Epoch 1749 | loss: nan | val_loss: nan | Time: 5324.41 ms
[2022-03-21 17:37:16	                main:574]	:	INFO	:	Epoch 1750 | loss: nan | val_loss: nan | Time: 5318.83 ms
[2022-03-21 17:37:21	                main:574]	:	INFO	:	Epoch 1751 | loss: nan | val_loss: nan | Time: 5325.69 ms
[2022-03-21 17:37:27	                main:574]	:	INFO	:	Epoch 1752 | loss: nan | val_loss: nan | Time: 5315.73 ms
[2022-03-21 17:37:32	                main:574]	:	INFO	:	Epoch 1753 | loss: nan | val_loss: nan | Time: 5325.53 ms
[2022-03-21 17:37:37	                main:574]	:	INFO	:	Epoch 1754 | loss: nan | val_loss: nan | Time: 5329.9 ms
[2022-03-21 17:37:43	                main:574]	:	INFO	:	Epoch 1755 | loss: nan | val_loss: nan | Time: 5325.97 ms
[2022-03-21 17:37:48	                main:574]	:	INFO	:	Epoch 1756 | loss: nan | val_loss: nan | Time: 5323.43 ms
[2022-03-21 17:37:53	                main:574]	:	INFO	:	Epoch 1757 | loss: nan | val_loss: nan | Time: 5323.39 ms
[2022-03-21 17:37:59	                main:574]	:	INFO	:	Epoch 1758 | loss: nan | val_loss: nan | Time: 5336.71 ms
[2022-03-21 17:38:04	                main:574]	:	INFO	:	Epoch 1759 | loss: nan | val_loss: nan | Time: 5324.38 ms
[2022-03-21 17:38:09	                main:574]	:	INFO	:	Epoch 1760 | loss: nan | val_loss: nan | Time: 5327.74 ms
[2022-03-21 17:38:15	                main:574]	:	INFO	:	Epoch 1761 | loss: nan | val_loss: nan | Time: 5317.41 ms
[2022-03-21 17:38:20	                main:574]	:	INFO	:	Epoch 1762 | loss: nan | val_loss: nan | Time: 5323.62 ms
[2022-03-21 17:38:25	                main:574]	:	INFO	:	Epoch 1763 | loss: nan | val_loss: nan | Time: 5322.97 ms
[2022-03-21 17:38:31	                main:574]	:	INFO	:	Epoch 1764 | loss: nan | val_loss: nan | Time: 5321.27 ms
[2022-03-21 17:38:36	                main:574]	:	INFO	:	Epoch 1765 | loss: nan | val_loss: nan | Time: 5325.83 ms
[2022-03-21 17:38:41	                main:574]	:	INFO	:	Epoch 1766 | loss: nan | val_loss: nan | Time: 5330.78 ms
[2022-03-21 17:38:47	                main:574]	:	INFO	:	Epoch 1767 | loss: nan | val_loss: nan | Time: 5321.13 ms
[2022-03-21 17:38:52	                main:574]	:	INFO	:	Epoch 1768 | loss: nan | val_loss: nan | Time: 5332.21 ms
[2022-03-21 17:38:57	                main:574]	:	INFO	:	Epoch 1769 | loss: nan | val_loss: nan | Time: 5326.8 ms
[2022-03-21 17:39:03	                main:574]	:	INFO	:	Epoch 1770 | loss: nan | val_loss: nan | Time: 5333.7 ms
[2022-03-21 17:39:08	                main:574]	:	INFO	:	Epoch 1771 | loss: nan | val_loss: nan | Time: 5324.48 ms
[2022-03-21 17:39:13	                main:574]	:	INFO	:	Epoch 1772 | loss: nan | val_loss: nan | Time: 5328.27 ms
[2022-03-21 17:39:19	                main:574]	:	INFO	:	Epoch 1773 | loss: nan | val_loss: nan | Time: 5321.65 ms
[2022-03-21 17:39:24	                main:574]	:	INFO	:	Epoch 1774 | loss: nan | val_loss: nan | Time: 5319.48 ms
[2022-03-21 17:39:29	                main:574]	:	INFO	:	Epoch 1775 | loss: nan | val_loss: nan | Time: 5334.14 ms
[2022-03-21 17:39:35	                main:574]	:	INFO	:	Epoch 1776 | loss: nan | val_loss: nan | Time: 5327.58 ms
[2022-03-21 17:39:40	                main:574]	:	INFO	:	Epoch 1777 | loss: nan | val_loss: nan | Time: 5322.71 ms
[2022-03-21 17:39:45	                main:574]	:	INFO	:	Epoch 1778 | loss: nan | val_loss: nan | Time: 5333.09 ms
[2022-03-21 17:39:51	                main:574]	:	INFO	:	Epoch 1779 | loss: nan | val_loss: nan | Time: 5327.62 ms
[2022-03-21 17:39:56	                main:574]	:	INFO	:	Epoch 1780 | loss: nan | val_loss: nan | Time: 5329.34 ms
[2022-03-21 17:40:01	                main:574]	:	INFO	:	Epoch 1781 | loss: nan | val_loss: nan | Time: 5323.78 ms
[2022-03-21 17:40:07	                main:574]	:	INFO	:	Epoch 1782 | loss: nan | val_loss: nan | Time: 5324.26 ms
[2022-03-21 17:40:12	                main:574]	:	INFO	:	Epoch 1783 | loss: nan | val_loss: nan | Time: 5325.23 ms
[2022-03-21 17:40:17	                main:574]	:	INFO	:	Epoch 1784 | loss: nan | val_loss: nan | Time: 5336.17 ms
[2022-03-21 17:40:23	                main:574]	:	INFO	:	Epoch 1785 | loss: nan | val_loss: nan | Time: 5316.17 ms
[2022-03-21 17:40:28	                main:574]	:	INFO	:	Epoch 1786 | loss: nan | val_loss: nan | Time: 5326.72 ms
[2022-03-21 17:40:33	                main:574]	:	INFO	:	Epoch 1787 | loss: nan | val_loss: nan | Time: 5342.1 ms
[2022-03-21 17:40:39	                main:574]	:	INFO	:	Epoch 1788 | loss: nan | val_loss: nan | Time: 5320.11 ms
[2022-03-21 17:40:44	                main:574]	:	INFO	:	Epoch 1789 | loss: nan | val_loss: nan | Time: 5326.45 ms
[2022-03-21 17:40:49	                main:574]	:	INFO	:	Epoch 1790 | loss: nan | val_loss: nan | Time: 5322.38 ms
[2022-03-21 17:40:55	                main:574]	:	INFO	:	Epoch 1791 | loss: nan | val_loss: nan | Time: 5322.16 ms
[2022-03-21 17:41:00	                main:574]	:	INFO	:	Epoch 1792 | loss: nan | val_loss: nan | Time: 5320.65 ms
[2022-03-21 17:41:05	                main:574]	:	INFO	:	Epoch 1793 | loss: nan | val_loss: nan | Time: 5335.23 ms
[2022-03-21 17:41:11	                main:574]	:	INFO	:	Epoch 1794 | loss: nan | val_loss: nan | Time: 5331.19 ms
[2022-03-21 17:41:16	                main:574]	:	INFO	:	Epoch 1795 | loss: nan | val_loss: nan | Time: 5326.16 ms
[2022-03-21 17:41:21	                main:574]	:	INFO	:	Epoch 1796 | loss: nan | val_loss: nan | Time: 5328.72 ms
[2022-03-21 17:41:27	                main:574]	:	INFO	:	Epoch 1797 | loss: nan | val_loss: nan | Time: 5325.24 ms
[2022-03-21 17:41:32	                main:574]	:	INFO	:	Epoch 1798 | loss: nan | val_loss: nan | Time: 5328.62 ms
[2022-03-21 17:41:37	                main:574]	:	INFO	:	Epoch 1799 | loss: nan | val_loss: nan | Time: 5327.87 ms
[2022-03-21 17:41:43	                main:574]	:	INFO	:	Epoch 1800 | loss: nan | val_loss: nan | Time: 5327.86 ms
[2022-03-21 17:41:48	                main:574]	:	INFO	:	Epoch 1801 | loss: nan | val_loss: nan | Time: 5318.23 ms
[2022-03-21 17:41:53	                main:574]	:	INFO	:	Epoch 1802 | loss: nan | val_loss: nan | Time: 5320.73 ms
[2022-03-21 17:41:58	                main:574]	:	INFO	:	Epoch 1803 | loss: nan | val_loss: nan | Time: 5324.96 ms
[2022-03-21 17:42:04	                main:574]	:	INFO	:	Epoch 1804 | loss: nan | val_loss: nan | Time: 5325.69 ms
[2022-03-21 17:42:09	                main:574]	:	INFO	:	Epoch 1805 | loss: nan | val_loss: nan | Time: 5323.37 ms
[2022-03-21 17:42:14	                main:574]	:	INFO	:	Epoch 1806 | loss: nan | val_loss: nan | Time: 5323.32 ms
[2022-03-21 17:42:20	                main:574]	:	INFO	:	Epoch 1807 | loss: nan | val_loss: nan | Time: 5321.7 ms
[2022-03-21 17:42:25	                main:574]	:	INFO	:	Epoch 1808 | loss: nan | val_loss: nan | Time: 5324.79 ms
[2022-03-21 17:42:30	                main:574]	:	INFO	:	Epoch 1809 | loss: nan | val_loss: nan | Time: 5323.98 ms
[2022-03-21 17:42:36	                main:574]	:	INFO	:	Epoch 1810 | loss: nan | val_loss: nan | Time: 5329.7 ms
[2022-03-21 17:42:41	                main:574]	:	INFO	:	Epoch 1811 | loss: nan | val_loss: nan | Time: 5324.36 ms
[2022-03-21 17:42:46	                main:574]	:	INFO	:	Epoch 1812 | loss: nan | val_loss: nan | Time: 5329.45 ms
[2022-03-21 17:42:52	                main:574]	:	INFO	:	Epoch 1813 | loss: nan | val_loss: nan | Time: 5318.47 ms
[2022-03-21 17:42:57	                main:574]	:	INFO	:	Epoch 1814 | loss: nan | val_loss: nan | Time: 5329.01 ms
[2022-03-21 17:43:02	                main:574]	:	INFO	:	Epoch 1815 | loss: nan | val_loss: nan | Time: 5324.1 ms
[2022-03-21 17:43:08	                main:574]	:	INFO	:	Epoch 1816 | loss: nan | val_loss: nan | Time: 5331.13 ms
[2022-03-21 17:43:13	                main:574]	:	INFO	:	Epoch 1817 | loss: nan | val_loss: nan | Time: 5325.29 ms
[2022-03-21 17:43:18	                main:574]	:	INFO	:	Epoch 1818 | loss: nan | val_loss: nan | Time: 5327.01 ms
[2022-03-21 17:43:24	                main:574]	:	INFO	:	Epoch 1819 | loss: nan | val_loss: nan | Time: 5322.99 ms
[2022-03-21 17:43:29	                main:574]	:	INFO	:	Epoch 1820 | loss: nan | val_loss: nan | Time: 5323.16 ms
[2022-03-21 17:43:34	                main:574]	:	INFO	:	Epoch 1821 | loss: nan | val_loss: nan | Time: 5322.64 ms
[2022-03-21 17:43:40	                main:574]	:	INFO	:	Epoch 1822 | loss: nan | val_loss: nan | Time: 5355.08 ms
[2022-03-21 17:43:45	                main:574]	:	INFO	:	Epoch 1823 | loss: nan | val_loss: nan | Time: 5327.45 ms
[2022-03-21 17:43:50	                main:574]	:	INFO	:	Epoch 1824 | loss: nan | val_loss: nan | Time: 5333.03 ms
[2022-03-21 17:43:56	                main:574]	:	INFO	:	Epoch 1825 | loss: nan | val_loss: nan | Time: 5330.53 ms
[2022-03-21 17:44:01	                main:574]	:	INFO	:	Epoch 1826 | loss: nan | val_loss: nan | Time: 5322.44 ms
[2022-03-21 17:44:06	                main:574]	:	INFO	:	Epoch 1827 | loss: nan | val_loss: nan | Time: 5323.46 ms
[2022-03-21 17:44:12	                main:574]	:	INFO	:	Epoch 1828 | loss: nan | val_loss: nan | Time: 5327.06 ms
[2022-03-21 17:44:17	                main:574]	:	INFO	:	Epoch 1829 | loss: nan | val_loss: nan | Time: 5323.78 ms
[2022-03-21 17:44:22	                main:574]	:	INFO	:	Epoch 1830 | loss: nan | val_loss: nan | Time: 5328.08 ms
[2022-03-21 17:44:28	                main:574]	:	INFO	:	Epoch 1831 | loss: nan | val_loss: nan | Time: 5325.52 ms
[2022-03-21 17:44:33	                main:574]	:	INFO	:	Epoch 1832 | loss: nan | val_loss: nan | Time: 5321.6 ms
[2022-03-21 17:44:38	                main:574]	:	INFO	:	Epoch 1833 | loss: nan | val_loss: nan | Time: 5326.98 ms
[2022-03-21 17:44:44	                main:574]	:	INFO	:	Epoch 1834 | loss: nan | val_loss: nan | Time: 5319.42 ms
[2022-03-21 17:44:49	                main:574]	:	INFO	:	Epoch 1835 | loss: nan | val_loss: nan | Time: 5323.99 ms
[2022-03-21 17:44:54	                main:574]	:	INFO	:	Epoch 1836 | loss: nan | val_loss: nan | Time: 5330.75 ms
[2022-03-21 17:45:00	                main:574]	:	INFO	:	Epoch 1837 | loss: nan | val_loss: nan | Time: 5331.38 ms
[2022-03-21 17:45:05	                main:574]	:	INFO	:	Epoch 1838 | loss: nan | val_loss: nan | Time: 5331.93 ms
[2022-03-21 17:45:10	                main:574]	:	INFO	:	Epoch 1839 | loss: nan | val_loss: nan | Time: 5328.23 ms
[2022-03-21 17:45:16	                main:574]	:	INFO	:	Epoch 1840 | loss: nan | val_loss: nan | Time: 5326.01 ms
[2022-03-21 17:45:21	                main:574]	:	INFO	:	Epoch 1841 | loss: nan | val_loss: nan | Time: 5323.06 ms
[2022-03-21 17:45:26	                main:574]	:	INFO	:	Epoch 1842 | loss: nan | val_loss: nan | Time: 5322.23 ms
[2022-03-21 17:45:32	                main:574]	:	INFO	:	Epoch 1843 | loss: nan | val_loss: nan | Time: 5329.22 ms
[2022-03-21 17:45:37	                main:574]	:	INFO	:	Epoch 1844 | loss: nan | val_loss: nan | Time: 5329.16 ms
[2022-03-21 17:45:42	                main:574]	:	INFO	:	Epoch 1845 | loss: nan | val_loss: nan | Time: 5328.48 ms
[2022-03-21 17:45:48	                main:574]	:	INFO	:	Epoch 1846 | loss: nan | val_loss: nan | Time: 5328.66 ms
[2022-03-21 17:45:53	                main:574]	:	INFO	:	Epoch 1847 | loss: nan | val_loss: nan | Time: 5334.4 ms
[2022-03-21 17:45:58	                main:574]	:	INFO	:	Epoch 1848 | loss: nan | val_loss: nan | Time: 5317.47 ms
[2022-03-21 17:46:04	                main:574]	:	INFO	:	Epoch 1849 | loss: nan | val_loss: nan | Time: 5326.14 ms
[2022-03-21 17:46:09	                main:574]	:	INFO	:	Epoch 1850 | loss: nan | val_loss: nan | Time: 5333.03 ms
[2022-03-21 17:46:14	                main:574]	:	INFO	:	Epoch 1851 | loss: nan | val_loss: nan | Time: 5327.15 ms
[2022-03-21 17:46:20	                main:574]	:	INFO	:	Epoch 1852 | loss: nan | val_loss: nan | Time: 5331.66 ms
[2022-03-21 17:46:25	                main:574]	:	INFO	:	Epoch 1853 | loss: nan | val_loss: nan | Time: 5322.12 ms
[2022-03-21 17:46:30	                main:574]	:	INFO	:	Epoch 1854 | loss: nan | val_loss: nan | Time: 5322.81 ms
[2022-03-21 17:46:36	                main:574]	:	INFO	:	Epoch 1855 | loss: nan | val_loss: nan | Time: 5321.03 ms
[2022-03-21 17:46:41	                main:574]	:	INFO	:	Epoch 1856 | loss: nan | val_loss: nan | Time: 5324.23 ms
[2022-03-21 17:46:46	                main:574]	:	INFO	:	Epoch 1857 | loss: nan | val_loss: nan | Time: 5322.71 ms
[2022-03-21 17:46:52	                main:574]	:	INFO	:	Epoch 1858 | loss: nan | val_loss: nan | Time: 5324.3 ms
[2022-03-21 17:46:57	                main:574]	:	INFO	:	Epoch 1859 | loss: nan | val_loss: nan | Time: 5322.48 ms
[2022-03-21 17:47:02	                main:574]	:	INFO	:	Epoch 1860 | loss: nan | val_loss: nan | Time: 5331.07 ms
[2022-03-21 17:47:08	                main:574]	:	INFO	:	Epoch 1861 | loss: nan | val_loss: nan | Time: 5324.02 ms
[2022-03-21 17:47:13	                main:574]	:	INFO	:	Epoch 1862 | loss: nan | val_loss: nan | Time: 5323.75 ms
[2022-03-21 17:47:18	                main:574]	:	INFO	:	Epoch 1863 | loss: nan | val_loss: nan | Time: 5326.36 ms
[2022-03-21 17:47:24	                main:574]	:	INFO	:	Epoch 1864 | loss: nan | val_loss: nan | Time: 5321.68 ms
[2022-03-21 17:47:29	                main:574]	:	INFO	:	Epoch 1865 | loss: nan | val_loss: nan | Time: 5325.11 ms
[2022-03-21 17:47:34	                main:574]	:	INFO	:	Epoch 1866 | loss: nan | val_loss: nan | Time: 5331.23 ms
[2022-03-21 17:47:40	                main:574]	:	INFO	:	Epoch 1867 | loss: nan | val_loss: nan | Time: 5328.28 ms
[2022-03-21 17:47:45	                main:574]	:	INFO	:	Epoch 1868 | loss: nan | val_loss: nan | Time: 5328.09 ms
[2022-03-21 17:47:50	                main:574]	:	INFO	:	Epoch 1869 | loss: nan | val_loss: nan | Time: 5328.75 ms
[2022-03-21 17:47:56	                main:574]	:	INFO	:	Epoch 1870 | loss: nan | val_loss: nan | Time: 5328.58 ms
[2022-03-21 17:48:01	                main:574]	:	INFO	:	Epoch 1871 | loss: nan | val_loss: nan | Time: 5322.14 ms
[2022-03-21 17:48:06	                main:574]	:	INFO	:	Epoch 1872 | loss: nan | val_loss: nan | Time: 5321.94 ms
[2022-03-21 17:48:12	                main:574]	:	INFO	:	Epoch 1873 | loss: nan | val_loss: nan | Time: 5332.98 ms
[2022-03-21 17:48:17	                main:574]	:	INFO	:	Epoch 1874 | loss: nan | val_loss: nan | Time: 5330.15 ms
[2022-03-21 17:48:22	                main:574]	:	INFO	:	Epoch 1875 | loss: nan | val_loss: nan | Time: 5320.72 ms
[2022-03-21 17:48:28	                main:574]	:	INFO	:	Epoch 1876 | loss: nan | val_loss: nan | Time: 5321.69 ms
[2022-03-21 17:48:33	                main:574]	:	INFO	:	Epoch 1877 | loss: nan | val_loss: nan | Time: 5327.57 ms
[2022-03-21 17:48:38	                main:574]	:	INFO	:	Epoch 1878 | loss: nan | val_loss: nan | Time: 5327.19 ms
[2022-03-21 17:48:44	                main:574]	:	INFO	:	Epoch 1879 | loss: nan | val_loss: nan | Time: 5320.4 ms
[2022-03-21 17:48:49	                main:574]	:	INFO	:	Epoch 1880 | loss: nan | val_loss: nan | Time: 5334.87 ms
[2022-03-21 17:48:54	                main:574]	:	INFO	:	Epoch 1881 | loss: nan | val_loss: nan | Time: 5325.38 ms
[2022-03-21 17:49:00	                main:574]	:	INFO	:	Epoch 1882 | loss: nan | val_loss: nan | Time: 5330.64 ms
[2022-03-21 17:49:05	                main:574]	:	INFO	:	Epoch 1883 | loss: nan | val_loss: nan | Time: 5317.57 ms
[2022-03-21 17:49:10	                main:574]	:	INFO	:	Epoch 1884 | loss: nan | val_loss: nan | Time: 5331.49 ms
[2022-03-21 17:49:16	                main:574]	:	INFO	:	Epoch 1885 | loss: nan | val_loss: nan | Time: 5325.28 ms
[2022-03-21 17:49:21	                main:574]	:	INFO	:	Epoch 1886 | loss: nan | val_loss: nan | Time: 5327.56 ms
[2022-03-21 17:49:26	                main:574]	:	INFO	:	Epoch 1887 | loss: nan | val_loss: nan | Time: 5333.68 ms
[2022-03-21 17:49:32	                main:574]	:	INFO	:	Epoch 1888 | loss: nan | val_loss: nan | Time: 5314.72 ms
[2022-03-21 17:49:37	                main:574]	:	INFO	:	Epoch 1889 | loss: nan | val_loss: nan | Time: 5320.21 ms
[2022-03-21 17:49:42	                main:574]	:	INFO	:	Epoch 1890 | loss: nan | val_loss: nan | Time: 5324.84 ms
[2022-03-21 17:49:48	                main:574]	:	INFO	:	Epoch 1891 | loss: nan | val_loss: nan | Time: 5326.42 ms
[2022-03-21 17:49:53	                main:574]	:	INFO	:	Epoch 1892 | loss: nan | val_loss: nan | Time: 5326.14 ms
[2022-03-21 17:49:58	                main:574]	:	INFO	:	Epoch 1893 | loss: nan | val_loss: nan | Time: 5327.79 ms
[2022-03-21 17:50:04	                main:574]	:	INFO	:	Epoch 1894 | loss: nan | val_loss: nan | Time: 5330.89 ms
[2022-03-21 17:50:09	                main:574]	:	INFO	:	Epoch 1895 | loss: nan | val_loss: nan | Time: 5325.21 ms
[2022-03-21 17:50:14	                main:574]	:	INFO	:	Epoch 1896 | loss: nan | val_loss: nan | Time: 5331.06 ms
[2022-03-21 17:50:20	                main:574]	:	INFO	:	Epoch 1897 | loss: nan | val_loss: nan | Time: 5322.73 ms
[2022-03-21 17:50:25	                main:574]	:	INFO	:	Epoch 1898 | loss: nan | val_loss: nan | Time: 5329.5 ms
[2022-03-21 17:50:30	                main:574]	:	INFO	:	Epoch 1899 | loss: nan | val_loss: nan | Time: 5326.05 ms
[2022-03-21 17:50:36	                main:574]	:	INFO	:	Epoch 1900 | loss: nan | val_loss: nan | Time: 5319.87 ms
[2022-03-21 17:50:41	                main:574]	:	INFO	:	Epoch 1901 | loss: nan | val_loss: nan | Time: 5334.95 ms
[2022-03-21 17:50:46	                main:574]	:	INFO	:	Epoch 1902 | loss: nan | val_loss: nan | Time: 5329.11 ms
[2022-03-21 17:50:52	                main:574]	:	INFO	:	Epoch 1903 | loss: nan | val_loss: nan | Time: 5324.86 ms
[2022-03-21 17:50:57	                main:574]	:	INFO	:	Epoch 1904 | loss: nan | val_loss: nan | Time: 5326.28 ms
[2022-03-21 17:51:02	                main:574]	:	INFO	:	Epoch 1905 | loss: nan | val_loss: nan | Time: 5327.49 ms
[2022-03-21 17:51:08	                main:574]	:	INFO	:	Epoch 1906 | loss: nan | val_loss: nan | Time: 5317.31 ms
[2022-03-21 17:51:13	                main:574]	:	INFO	:	Epoch 1907 | loss: nan | val_loss: nan | Time: 5327.34 ms
[2022-03-21 17:51:18	                main:574]	:	INFO	:	Epoch 1908 | loss: nan | val_loss: nan | Time: 5326.31 ms
[2022-03-21 17:51:24	                main:574]	:	INFO	:	Epoch 1909 | loss: nan | val_loss: nan | Time: 5331.28 ms
[2022-03-21 17:51:29	                main:574]	:	INFO	:	Epoch 1910 | loss: nan | val_loss: nan | Time: 5325.91 ms
[2022-03-21 17:51:34	                main:574]	:	INFO	:	Epoch 1911 | loss: nan | val_loss: nan | Time: 5322.71 ms
[2022-03-21 17:51:40	                main:574]	:	INFO	:	Epoch 1912 | loss: nan | val_loss: nan | Time: 5318.08 ms
[2022-03-21 17:51:45	                main:574]	:	INFO	:	Epoch 1913 | loss: nan | val_loss: nan | Time: 5321.99 ms
[2022-03-21 17:51:50	                main:574]	:	INFO	:	Epoch 1914 | loss: nan | val_loss: nan | Time: 5332.62 ms
[2022-03-21 17:51:56	                main:574]	:	INFO	:	Epoch 1915 | loss: nan | val_loss: nan | Time: 5336.63 ms
[2022-03-21 17:52:01	                main:574]	:	INFO	:	Epoch 1916 | loss: nan | val_loss: nan | Time: 5331.53 ms
[2022-03-21 17:52:06	                main:574]	:	INFO	:	Epoch 1917 | loss: nan | val_loss: nan | Time: 5326.25 ms
[2022-03-21 17:52:12	                main:574]	:	INFO	:	Epoch 1918 | loss: nan | val_loss: nan | Time: 5327.92 ms
[2022-03-21 17:52:17	                main:574]	:	INFO	:	Epoch 1919 | loss: nan | val_loss: nan | Time: 5325.38 ms
[2022-03-21 17:52:22	                main:574]	:	INFO	:	Epoch 1920 | loss: nan | val_loss: nan | Time: 5323.87 ms
[2022-03-21 17:52:28	                main:574]	:	INFO	:	Epoch 1921 | loss: nan | val_loss: nan | Time: 5324.41 ms
[2022-03-21 17:52:33	                main:574]	:	INFO	:	Epoch 1922 | loss: nan | val_loss: nan | Time: 5331.92 ms
[2022-03-21 17:52:38	                main:574]	:	INFO	:	Epoch 1923 | loss: nan | val_loss: nan | Time: 5323.83 ms
[2022-03-21 17:52:44	                main:574]	:	INFO	:	Epoch 1924 | loss: nan | val_loss: nan | Time: 5322.9 ms
[2022-03-21 17:52:49	                main:574]	:	INFO	:	Epoch 1925 | loss: nan | val_loss: nan | Time: 5325.51 ms
[2022-03-21 17:52:54	                main:574]	:	INFO	:	Epoch 1926 | loss: nan | val_loss: nan | Time: 5335.58 ms
[2022-03-21 17:53:00	                main:574]	:	INFO	:	Epoch 1927 | loss: nan | val_loss: nan | Time: 5316.3 ms
[2022-03-21 17:53:05	                main:574]	:	INFO	:	Epoch 1928 | loss: nan | val_loss: nan | Time: 5325.02 ms
[2022-03-21 17:53:10	                main:574]	:	INFO	:	Epoch 1929 | loss: nan | val_loss: nan | Time: 5328.84 ms
[2022-03-21 17:53:16	                main:574]	:	INFO	:	Epoch 1930 | loss: nan | val_loss: nan | Time: 5327.39 ms
[2022-03-21 17:53:21	                main:574]	:	INFO	:	Epoch 1931 | loss: nan | val_loss: nan | Time: 5322.04 ms
[2022-03-21 17:53:26	                main:574]	:	INFO	:	Epoch 1932 | loss: nan | val_loss: nan | Time: 5328.17 ms
[2022-03-21 17:53:32	                main:574]	:	INFO	:	Epoch 1933 | loss: nan | val_loss: nan | Time: 5326.23 ms
[2022-03-21 17:53:37	                main:574]	:	INFO	:	Epoch 1934 | loss: nan | val_loss: nan | Time: 5329.41 ms
[2022-03-21 17:53:42	                main:574]	:	INFO	:	Epoch 1935 | loss: nan | val_loss: nan | Time: 5325.66 ms
[2022-03-21 17:53:48	                main:574]	:	INFO	:	Epoch 1936 | loss: nan | val_loss: nan | Time: 5326.54 ms
[2022-03-21 17:53:53	                main:574]	:	INFO	:	Epoch 1937 | loss: nan | val_loss: nan | Time: 5343.35 ms
[2022-03-21 17:53:58	                main:574]	:	INFO	:	Epoch 1938 | loss: nan | val_loss: nan | Time: 5326.81 ms
[2022-03-21 17:54:04	                main:574]	:	INFO	:	Epoch 1939 | loss: nan | val_loss: nan | Time: 5325.13 ms
[2022-03-21 17:54:09	                main:574]	:	INFO	:	Epoch 1940 | loss: nan | val_loss: nan | Time: 5329.04 ms
[2022-03-21 17:54:14	                main:574]	:	INFO	:	Epoch 1941 | loss: nan | val_loss: nan | Time: 5323.16 ms
[2022-03-21 17:54:20	                main:574]	:	INFO	:	Epoch 1942 | loss: nan | val_loss: nan | Time: 5328.33 ms
[2022-03-21 17:54:25	                main:574]	:	INFO	:	Epoch 1943 | loss: nan | val_loss: nan | Time: 5325.42 ms
[2022-03-21 17:54:30	                main:574]	:	INFO	:	Epoch 1944 | loss: nan | val_loss: nan | Time: 5331.77 ms
[2022-03-21 17:54:36	                main:574]	:	INFO	:	Epoch 1945 | loss: nan | val_loss: nan | Time: 5328.29 ms
[2022-03-21 17:54:41	                main:574]	:	INFO	:	Epoch 1946 | loss: nan | val_loss: nan | Time: 5325.42 ms
[2022-03-21 17:54:46	                main:574]	:	INFO	:	Epoch 1947 | loss: nan | val_loss: nan | Time: 5321.17 ms
[2022-03-21 17:54:52	                main:574]	:	INFO	:	Epoch 1948 | loss: nan | val_loss: nan | Time: 5326.34 ms
[2022-03-21 17:54:57	                main:574]	:	INFO	:	Epoch 1949 | loss: nan | val_loss: nan | Time: 5331.53 ms
[2022-03-21 17:55:02	                main:574]	:	INFO	:	Epoch 1950 | loss: nan | val_loss: nan | Time: 5327.12 ms
[2022-03-21 17:55:08	                main:574]	:	INFO	:	Epoch 1951 | loss: nan | val_loss: nan | Time: 5323.59 ms
[2022-03-21 17:55:13	                main:574]	:	INFO	:	Epoch 1952 | loss: nan | val_loss: nan | Time: 5323.57 ms
[2022-03-21 17:55:18	                main:574]	:	INFO	:	Epoch 1953 | loss: nan | val_loss: nan | Time: 5327.56 ms
[2022-03-21 17:55:24	                main:574]	:	INFO	:	Epoch 1954 | loss: nan | val_loss: nan | Time: 5323.88 ms
[2022-03-21 17:55:29	                main:574]	:	INFO	:	Epoch 1955 | loss: nan | val_loss: nan | Time: 5324.43 ms
[2022-03-21 17:55:34	                main:574]	:	INFO	:	Epoch 1956 | loss: nan | val_loss: nan | Time: 5327.94 ms
[2022-03-21 17:55:40	                main:574]	:	INFO	:	Epoch 1957 | loss: nan | val_loss: nan | Time: 5337.88 ms
[2022-03-21 17:55:45	                main:574]	:	INFO	:	Epoch 1958 | loss: nan | val_loss: nan | Time: 5332.1 ms
[2022-03-21 17:55:50	                main:574]	:	INFO	:	Epoch 1959 | loss: nan | val_loss: nan | Time: 5321.89 ms
[2022-03-21 17:55:56	                main:574]	:	INFO	:	Epoch 1960 | loss: nan | val_loss: nan | Time: 5340.41 ms
[2022-03-21 17:56:01	                main:574]	:	INFO	:	Epoch 1961 | loss: nan | val_loss: nan | Time: 5323.23 ms
[2022-03-21 17:56:06	                main:574]	:	INFO	:	Epoch 1962 | loss: nan | val_loss: nan | Time: 5322.5 ms
[2022-03-21 17:56:12	                main:574]	:	INFO	:	Epoch 1963 | loss: nan | val_loss: nan | Time: 5336.75 ms
[2022-03-21 17:56:17	                main:574]	:	INFO	:	Epoch 1964 | loss: nan | val_loss: nan | Time: 5327.96 ms
[2022-03-21 17:56:22	                main:574]	:	INFO	:	Epoch 1965 | loss: nan | val_loss: nan | Time: 5328.16 ms
[2022-03-21 17:56:28	                main:574]	:	INFO	:	Epoch 1966 | loss: nan | val_loss: nan | Time: 5321.38 ms
[2022-03-21 17:56:33	                main:574]	:	INFO	:	Epoch 1967 | loss: nan | val_loss: nan | Time: 5321.3 ms
[2022-03-21 17:56:38	                main:574]	:	INFO	:	Epoch 1968 | loss: nan | val_loss: nan | Time: 5321.83 ms
[2022-03-21 17:56:44	                main:574]	:	INFO	:	Epoch 1969 | loss: nan | val_loss: nan | Time: 5323.42 ms
[2022-03-21 17:56:49	                main:574]	:	INFO	:	Epoch 1970 | loss: nan | val_loss: nan | Time: 5328.56 ms
[2022-03-21 17:56:54	                main:574]	:	INFO	:	Epoch 1971 | loss: nan | val_loss: nan | Time: 5327.98 ms
[2022-03-21 17:57:00	                main:574]	:	INFO	:	Epoch 1972 | loss: nan | val_loss: nan | Time: 5320.63 ms
[2022-03-21 17:57:05	                main:574]	:	INFO	:	Epoch 1973 | loss: nan | val_loss: nan | Time: 5322.82 ms
[2022-03-21 17:57:10	                main:574]	:	INFO	:	Epoch 1974 | loss: nan | val_loss: nan | Time: 5323.45 ms
[2022-03-21 17:57:16	                main:574]	:	INFO	:	Epoch 1975 | loss: nan | val_loss: nan | Time: 5324.68 ms
[2022-03-21 17:57:21	                main:574]	:	INFO	:	Epoch 1976 | loss: nan | val_loss: nan | Time: 5324.76 ms
[2022-03-21 17:57:26	                main:574]	:	INFO	:	Epoch 1977 | loss: nan | val_loss: nan | Time: 5327.71 ms
[2022-03-21 17:57:31	                main:574]	:	INFO	:	Epoch 1978 | loss: nan | val_loss: nan | Time: 5323.9 ms
[2022-03-21 17:57:37	                main:574]	:	INFO	:	Epoch 1979 | loss: nan | val_loss: nan | Time: 5329.08 ms
[2022-03-21 17:57:42	                main:574]	:	INFO	:	Epoch 1980 | loss: nan | val_loss: nan | Time: 5326.21 ms
[2022-03-21 17:57:47	                main:574]	:	INFO	:	Epoch 1981 | loss: nan | val_loss: nan | Time: 5319.79 ms
[2022-03-21 17:57:53	                main:574]	:	INFO	:	Epoch 1982 | loss: nan | val_loss: nan | Time: 5350.23 ms
[2022-03-21 17:57:58	                main:574]	:	INFO	:	Epoch 1983 | loss: nan | val_loss: nan | Time: 5327.35 ms
[2022-03-21 17:58:03	                main:574]	:	INFO	:	Epoch 1984 | loss: nan | val_loss: nan | Time: 5322.7 ms
[2022-03-21 17:58:09	                main:574]	:	INFO	:	Epoch 1985 | loss: nan | val_loss: nan | Time: 5324.22 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce 940MX)
[2022-03-21 19:02:33	                main:435]	:	INFO	:	Set logging level to 1
[2022-03-21 19:02:33	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-03-21 19:02:33	                main:444]	:	INFO	:	Resolving all filenames
[2022-03-21 19:02:33	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-21 19:02:33	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-21 19:02:33	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-21 19:02:33	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-21 19:02:33	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-21 19:02:33	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-03-21 19:02:33	                main:474]	:	INFO	:	Configuration: 
[2022-03-21 19:02:33	                main:475]	:	INFO	:	    Model type: GRU
[2022-03-21 19:02:33	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-03-21 19:02:33	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-03-21 19:02:33	                main:478]	:	INFO	:	    Batch Size: 128
[2022-03-21 19:02:33	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-03-21 19:02:33	                main:480]	:	INFO	:	    Patience: 10
[2022-03-21 19:02:33	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-03-21 19:02:33	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-03-21 19:02:33	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-03-21 19:02:33	                main:484]	:	INFO	:	    # Threads: 1
[2022-03-21 19:02:33	                main:486]	:	INFO	:	Preparing Dataset
[2022-03-21 19:02:33	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-21 19:02:34	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-03-21 19:02:36	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-03-21 19:02:36	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-03-21 19:02:37	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-03-21 19:02:37	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-03-21 19:02:37	                main:494]	:	INFO	:	Creating Model
[2022-03-21 19:02:37	                main:507]	:	INFO	:	Preparing config file
[2022-03-21 19:02:37	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-03-21 19:02:37	                main:512]	:	INFO	:	Loading config


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFBDD114F69

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 03/21/22 19:02:37
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\3;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 00000000922f0000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000df5d0000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1586

ModLoad: 00000000de330000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1586

ModLoad: 00000000dd0e0000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1586

ModLoad: 00000000deb40000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1586

ModLoad: 00000000dd030000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1586) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1586

ModLoad: 00000000df560000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202

ModLoad: 00000000dd520000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 00000000dcf90000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 00000000dd420000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 00000000dd860000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1586

ModLoad: 00000000dd7c0000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.19041.546

ModLoad: 00000000ddc80000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.1586) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000dedc0000 0000000000125000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1586

ModLoad: 00000000cc3b0000 0000000000058000 C:\ProgramData\BOINC\slots\3\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000d9690000 000000000008e000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.30.30704.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\3\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.30.30704.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.30.30704.0

ModLoad: 00000000daa70000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.867

ModLoad: 00000000d9bb0000 000000000001b000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.30.30704.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\3\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.30.30704.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.30.30704.0

ModLoad: 00000000d9680000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.30.30704.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\3\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.30.30704.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.30.30704.0

ModLoad: 000000003ce40000 0000000024b49000 C:\ProgramData\BOINC\slots\3\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000084470000 00000000030a5000 C:\ProgramData\BOINC\slots\3\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 0000000080fb0000 00000000034b2000 C:\ProgramData\BOINC\slots\3\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000cd250000 0000000000045000 C:\ProgramData\BOINC\slots\3\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000d7340000 0000000000010000 C:\ProgramData\BOINC\slots\3\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 0000000021a90000 000000001b3a4000 C:\ProgramData\BOINC\slots\3\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 000000006cc20000 000000000919f000 C:\ProgramData\BOINC\slots\3\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 0000000016ea0000 000000000abe7000 C:\ProgramData\BOINC\slots\3\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000077510000 0000000003d5b000 C:\ProgramData\BOINC\slots\3\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 000000009daf0000 000000000020d000 C:\ProgramData\BOINC\slots\3\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 000000006ad50000 0000000001eca000 C:\ProgramData\BOINC\slots\3\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 000000009c250000 00000000002db000 C:\ProgramData\BOINC\slots\3\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000cc370000 0000000000040000 C:\ProgramData\BOINC\slots\3\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000de1e0000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000db550000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000defb0000 0000000000470000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1586

ModLoad: 00000000dd060000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 00000000dd0b0000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1586

ModLoad: 00000000dcab0000 0000000000033000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 00000000dd3b0000 0000000000068000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 00000000dcda0000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1586

ModLoad: 00000000dc8d0000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000de3f0000 0000000000744000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1586

ModLoad: 00000000dada0000 0000000000794000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1586

ModLoad: 00000000ddd30000 0000000000354000 C:\WINDOWS\System32\combase.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1586

ModLoad: 00000000dc750000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1586

ModLoad: 00000000dd910000 00000000000ad000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1586

ModLoad: 00000000de100000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1586

ModLoad: 000000009c000000 0000000000244000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.5167) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r450\r451_65\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 27.21.14.5167
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.0.208 driver
    Product Version       : 27.21.14.5167

ModLoad: 00000000d55c0000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000007c860000 0000000001338000 C:\WINDOWS\system32\DriverStore\FileRepository\nvam.inf_amd64_1cb913a256e10ee4\nvcuda64.dll (27.21.14.5167) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r450\r451_65\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 27.21.14.5167
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.0.208 driver
    Product Version       : 27.21.14.5167

ModLoad: 00000000de090000 000000000006b000 C:\WINDOWS\System32\WS2_32.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : ws2_32.pdb
    File Version          : 10.0.19041.1081 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1081

ModLoad: 00000000d9930000 000000000009e000 C:\WINDOWS\system32\uxtheme.dll (6.2.19041.1266) (-exported- Symbols Loaded)
    Linked PDB Filename   : UxTheme.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1586

ModLoad: 00000000d0830000 0000000000554000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.5167) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r450\r451_65\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 27.21.14.5167
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 27.21.14.5167

ModLoad: 00000000df420000 000000000012a000 C:\WINDOWS\System32\OLE32.DLL (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : ole32.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1586

ModLoad: 00000000db5c0000 00000000000f3000 C:\WINDOWS\SYSTEM32\dxgi.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : dxgi.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 00000000dcf00000 0000000000082000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.19041.1415 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1415



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3683, Write: 308, Other 775

- I/O Transfers Counters -
Read: 7675937, Write: 6031, Other 29484

- Paged Pool Usage -
QuotaPagedPoolUsage: 3463160, QuotaPeakPagedPoolUsage: 3481000
QuotaNonPagedPoolUsage: 37392, QuotaPeakNonPagedPoolUsage: 37392

- Virtual Memory Usage -
VirtualSize: -1500921856, PeakVirtualSize: -1019359232

- Pagefile Usage -
PagefileUsage: -1500921856, PeakPagefileUsage: -1500921856

- Working Set Size -
WorkingSetSize: 1143193600, PeakWorkingSetSize: 1143197696, PageFaultCount: 377964

*** Dump of thread ID 9648 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 11875000.000000, User Time: 19375000.000000, Wait Time: 66520348.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFBDD114F69

- Registers -
rax=000000001ca38b93 rbx=0000000092654910 rcx=000000001bae5d90 rdx=0000000000000001 rsi=000000001bae66d0 rdi=0000000019930520
r8=000000001bae5e28 r9=0000000000000000 r10=0000000000000000 r11=000000002b5aec00 r12=0000000037198720 r13=000000001bae68e0
r14=000000003b4910a0 r15=0000000000000000 rip=00000000dd114f69 rsp=000000001bae6570 rbp=000000001bae6860
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
1bae6640 9256a884 00000040 0000004f 37198000 0000038b KERNELBASE!RaiseException+0x0 
1bae66a0 92311ca6 00000010 65010000 3684b880 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
1bae6750 9231593b 00000000 00000030 00000020 00000008 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
1bae68a0 92311a78 00000000 00000000 1bae6bd0 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
1bae6970 92311cfc 1bae6bd0 00000000 00000080 1bae6ea0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
1bae6a30 9231c4dd 1bae6ea0 1bae6ea0 1bae6ea0 1bae6ea0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
1bae6d20 9230b2fe 1bae7338 1bae6ea0 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
1baffac0 9254c6f8 668b0160 00000000 00000000 66331760 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
1baffb00 de347034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
1baffb30 df622651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
1baffbb0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 10072 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 468750.000000, User Time: 0.000000, Wait Time: 66520100.000000

- Registers -
rax=00000000000001d3 rbx=0000000065015ea0 rcx=0000000000000070 rdx=0000000065015b20 rsi=0000000065013c50 rdi=0000000065015ea0
r8=00000000000000ef r9=00000000000000ef r10=0000000000000056 r11=0000000000000188 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000df6707c4 rsp=000000001bbff5c8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
1bbff5c0 df622dc7 00010003 00000001 00000001 65015ea0 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
1bbff8c0 de347034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
1bbff8f0 df622651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
1bbff970 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 1944 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 312500.000000, Wait Time: 66520100.000000

- Registers -
rax=00000000000001d3 rbx=00000000650162d0 rcx=0000000000000070 rdx=0000000065015f50 rsi=0000000065013c50 rdi=00000000650162d0
r8=0000000000000008 r9=0000000000000040 r10=00000000000000c0 r11=0000000040001800 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000df6707c4 rsp=000000001bcff538 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
1bcff530 df622dc7 00000000 00000000 65013c50 650162d0 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
1bcff830 de347034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
1bcff860 df622651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
1bcff8e0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 7576 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 312500.000000, User Time: 156250.000000, Wait Time: 66520100.000000

- Registers -
rax=00000000000001d3 rbx=0000000065016e80 rcx=0000000000000070 rdx=0000000065016b00 rsi=0000000065013c50 rdi=0000000065016e80
r8=00000000000002b7 r9=00000000000002b7 r10=000000000000029b r11=00000000000002d4 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000df6707c4 rsp=000000001bdffab8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
1bdffab0 df622dc7 00000000 00000000 65013c50 65016e80 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
1bdffdb0 de347034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
1bdffde0 df622651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
1bdffe60 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 2672 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 66520348.000000

- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=000000001bfff6b0 rsi=0000000000000000 rdi=0000000000000064
r8=000000000000000f r9=000000001bffe778 r10=0000000064e45842 r11=0000000000000ff0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000df66d3f4 rsp=000000001bfff688 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
1bfff680 dd12962e 1bfff748 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0 
1bfff720 9232a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0 
1bfff750 de347034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
1bfff780 df622651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
1bfff800 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 3100 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 66520344.000000

- Registers -
rax=000000000000005b rbx=000000000000000a rcx=000000000000000a rdx=000000001c0ff9c0 rsi=0000000000000000 rdi=000000000000000a
r8=0000000066d5d710 r9=0000000066aca760 r10=0000000000000000 r11=000000001c0ffbc0 r12=0000000000000064 r13=000000001c0ff9c0
r14=000000001c0ff6c0 r15=0000000000000000 rip=00000000df66d8c4 rsp=000000001c0ff668 rbp=0000000066aca760
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
1c0ff660 dd12cb20 00000000 1b964000 df73a4d0 1b964000 ntdll!ZwWaitForMultipleObjects+0x0 
1c0ff950 dd12ca1e 650266b0 004e0049 0000000a 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
1c0ff990 7ca121b4 66acd160 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
1c0ffbd0 7caac95d 00000000 00000004 00000000 00000000 nvcuda64!+0x0 
1c0ffc80 7ca11b83 ff56cb30 fd671a8e 66fcc010 00000000 nvcuda64!cuProfilerStop+0x0 
1c0ffcb0 7ccff450 66fcc010 00000000 00000000 00000000 nvcuda64!+0x0 
1c0ffce0 de347034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
1c0ffd10 df622651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
1c0ffd90 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 5232 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 66520160.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002b8 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002b8
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000066ab0b30 r13=0000000000000000
r14=00000000000002b8 r15=0000000000000000 rip=00000000df66cdf4 rsp=000000001c1ff848 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
1c1ff840 dd101a5e 00000000 00000000 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0 
1c1ff8e0 7cc1abd8 00000000 dd10a395 00000000 000002b8 KERNELBASE!WaitForSingleObjectEx+0x0 
1c1ff950 7ca11b83 00000001 66e585b0 66fcbf20 00000000 nvcuda64!cuProfilerStop+0x0 
1c1ff980 7ccff450 66fcbf20 00000000 00000000 00000000 nvcuda64!+0x0 
1c1ff9b0 de347034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
1c1ff9e0 df622651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
1c1ffa60 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 2852 (state: Waiting): ***

- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 66520328.000000

- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=0000000066d652c8 rdx=000000001c2ffa58 rsi=000000001c2ff9c0 rdi=0000000000000000
r8=0000000000000001 r9=0000000000000b24 r10=0000000066d652f8 r11=00000000fac9e29c r12=000000001c2ffa58 r13=0000000000000000
r14=0000000066d652c8 r15=0000000066d652f8 rip=00000000df670764 rsp=000000001c2ff998 rbp=000000001c2ff9f0
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
1c2ff990 df634295 00000102 00000102 00000000 1c2ff9c0 ntdll!NtWaitForAlertByThreadId+0x0 
1c2ffa00 dd14cef9 66d62ad0 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0 
1c2ffa30 7c99f41a 66d62ad0 df6207b0 66d62ad0 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0 
1c2ffa90 7ca11b83 00000001 ff236816 00000000 00000000 nvcuda64!+0x0 
1c2ffac0 7ccff450 66e618d0 00000000 00000000 00000000 nvcuda64!+0x0 
1c2ffaf0 de347034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
1c2ffb20 df622651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
1c2ffba0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


**


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)