Task 8542601

Name ParityModified-1634618430-15418-3_0
Workunit 6038874
Created 31 Oct 2021, 17:34:03 UTC
Sent 1 Nov 2021, 15:00:57 UTC
Report deadline 8 Nov 2021, 15:00:57 UTC
Received 2 Nov 2021, 20:46:52 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID 16174
Run time 1 hours 59 min 32 sec
CPU time 1 hours 58 min 31 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 8,245.48 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 2.96 GB
Peak swap size 4.75 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
Process still present 5 min after writing finish file; aborting</message>
<stderr_txt>
 main:574]	:	INFO	:	Epoch 1825 | loss: 0.0311568 | val_loss: 0.0311653 | Time: 1218.27 ms
[2021-11-01 13:33:33	                main:574]	:	INFO	:	Epoch 1826 | loss: 0.031157 | val_loss: 0.0311644 | Time: 1240.79 ms
[2021-11-01 13:33:34	                main:574]	:	INFO	:	Epoch 1827 | loss: 0.0311547 | val_loss: 0.031165 | Time: 1214.19 ms
[2021-11-01 13:33:36	                main:574]	:	INFO	:	Epoch 1828 | loss: 0.031154 | val_loss: 0.0311655 | Time: 1227.34 ms
[2021-11-01 13:33:37	                main:574]	:	INFO	:	Epoch 1829 | loss: 0.0311557 | val_loss: 0.031163 | Time: 1226.37 ms
[2021-11-01 13:33:38	                main:574]	:	INFO	:	Epoch 1830 | loss: 0.0311552 | val_loss: 0.0311644 | Time: 1277.82 ms
[2021-11-01 13:33:39	                main:574]	:	INFO	:	Epoch 1831 | loss: 0.0311551 | val_loss: 0.0311645 | Time: 1212.82 ms
[2021-11-01 13:33:41	                main:574]	:	INFO	:	Epoch 1832 | loss: 0.0311533 | val_loss: 0.0311648 | Time: 1163.3 ms
[2021-11-01 13:33:42	                main:574]	:	INFO	:	Epoch 1833 | loss: 0.031152 | val_loss: 0.0311622 | Time: 1150.53 ms
[2021-11-01 13:33:43	                main:574]	:	INFO	:	Epoch 1834 | loss: 0.0311536 | val_loss: 0.0311657 | Time: 1215.72 ms
[2021-11-01 13:33:44	                main:574]	:	INFO	:	Epoch 1835 | loss: 0.0311555 | val_loss: 0.0311651 | Time: 1244.15 ms
[2021-11-01 13:33:45	                main:574]	:	INFO	:	Epoch 1836 | loss: 0.0311526 | val_loss: 0.0311645 | Time: 1237.61 ms
[2021-11-01 13:33:47	                main:574]	:	INFO	:	Epoch 1837 | loss: 0.031153 | val_loss: 0.0311666 | Time: 1190.67 ms
[2021-11-01 13:33:48	                main:574]	:	INFO	:	Epoch 1838 | loss: 0.0311553 | val_loss: 0.0311669 | Time: 1121.37 ms
[2021-11-01 13:33:49	                main:574]	:	INFO	:	Epoch 1839 | loss: 0.0311554 | val_loss: 0.0311676 | Time: 1213.13 ms
[2021-11-01 13:33:50	                main:574]	:	INFO	:	Epoch 1840 | loss: 0.0311544 | val_loss: 0.0311687 | Time: 1257.64 ms
[2021-11-01 13:33:51	                main:574]	:	INFO	:	Epoch 1841 | loss: 0.0311552 | val_loss: 0.0311664 | Time: 1157.48 ms
[2021-11-01 13:33:53	                main:574]	:	INFO	:	Epoch 1842 | loss: 0.0311546 | val_loss: 0.031168 | Time: 1181.5 ms
[2021-11-01 13:33:54	                main:574]	:	INFO	:	Epoch 1843 | loss: 0.0311517 | val_loss: 0.0311651 | Time: 1152.1 ms
[2021-11-01 13:33:55	                main:574]	:	INFO	:	Epoch 1844 | loss: 0.0311516 | val_loss: 0.0311625 | Time: 1251.27 ms
[2021-11-01 13:33:56	                main:574]	:	INFO	:	Epoch 1845 | loss: 0.031152 | val_loss: 0.0311706 | Time: 1174.69 ms
[2021-11-01 13:33:57	                main:574]	:	INFO	:	Epoch 1846 | loss: 0.031155 | val_loss: 0.031165 | Time: 1251.9 ms
[2021-11-01 13:33:59	                main:574]	:	INFO	:	Epoch 1847 | loss: 0.0311554 | val_loss: 0.0311639 | Time: 1155.45 ms
[2021-11-01 13:34:00	                main:574]	:	INFO	:	Epoch 1848 | loss: 0.0311562 | val_loss: 0.0311691 | Time: 1225.82 ms
[2021-11-01 13:34:01	                main:574]	:	INFO	:	Epoch 1849 | loss: 0.031154 | val_loss: 0.0311637 | Time: 1207.56 ms
[2021-11-01 13:34:02	                main:574]	:	INFO	:	Epoch 1850 | loss: 0.0311526 | val_loss: 0.0311636 | Time: 1210.71 ms
[2021-11-01 13:34:03	                main:574]	:	INFO	:	Epoch 1851 | loss: 0.0311523 | val_loss: 0.0311647 | Time: 1214.65 ms
[2021-11-01 13:34:05	                main:574]	:	INFO	:	Epoch 1852 | loss: 0.0311519 | val_loss: 0.0311662 | Time: 1164.98 ms
[2021-11-01 13:34:06	                main:574]	:	INFO	:	Epoch 1853 | loss: 0.031152 | val_loss: 0.031167 | Time: 1240.96 ms
[2021-11-01 13:34:07	                main:574]	:	INFO	:	Epoch 1854 | loss: 0.0311546 | val_loss: 0.0311666 | Time: 1246.71 ms
[2021-11-01 13:34:08	                main:574]	:	INFO	:	Epoch 1855 | loss: 0.0311524 | val_loss: 0.031167 | Time: 1241.68 ms
[2021-11-01 13:34:10	                main:574]	:	INFO	:	Epoch 1856 | loss: 0.0311536 | val_loss: 0.0311707 | Time: 1168.83 ms
[2021-11-01 13:34:11	                main:574]	:	INFO	:	Epoch 1857 | loss: 0.0311525 | val_loss: 0.0311646 | Time: 1197.88 ms
[2021-11-01 13:34:12	                main:574]	:	INFO	:	Epoch 1858 | loss: 0.0311501 | val_loss: 0.0311662 | Time: 1324.93 ms
[2021-11-01 13:34:13	                main:574]	:	INFO	:	Epoch 1859 | loss: 0.03115 | val_loss: 0.0311639 | Time: 1261.44 ms
[2021-11-01 13:34:15	                main:574]	:	INFO	:	Epoch 1860 | loss: 0.0311511 | val_loss: 0.0311659 | Time: 1230.48 ms
[2021-11-01 13:34:16	                main:574]	:	INFO	:	Epoch 1861 | loss: 0.031155 | val_loss: 0.0311709 | Time: 1214.92 ms
[2021-11-01 13:34:17	                main:574]	:	INFO	:	Epoch 1862 | loss: 0.0311528 | val_loss: 0.0311629 | Time: 1218.79 ms
[2021-11-01 13:34:18	                main:574]	:	INFO	:	Epoch 1863 | loss: 0.0311503 | val_loss: 0.0311647 | Time: 1231.53 ms
[2021-11-01 13:34:19	                main:574]	:	INFO	:	Epoch 1864 | loss: 0.0311519 | val_loss: 0.0311618 | Time: 1210.02 ms
[2021-11-01 13:34:21	                main:574]	:	INFO	:	Epoch 1865 | loss: 0.0311529 | val_loss: 0.0311635 | Time: 1179.94 ms
[2021-11-01 13:34:22	                main:574]	:	INFO	:	Epoch 1866 | loss: 0.0311517 | val_loss: 0.0311627 | Time: 1203.43 ms
[2021-11-01 13:34:23	                main:574]	:	INFO	:	Epoch 1867 | loss: 0.0311511 | val_loss: 0.0311633 | Time: 1174.27 ms
[2021-11-01 13:34:24	                main:574]	:	INFO	:	Epoch 1868 | loss: 0.0311508 | val_loss: 0.0311619 | Time: 1179.14 ms
[2021-11-01 13:34:25	                main:574]	:	INFO	:	Epoch 1869 | loss: 0.031153 | val_loss: 0.0311659 | Time: 1268.4 ms
[2021-11-01 13:34:27	                main:574]	:	INFO	:	Epoch 1870 | loss: 0.0311531 | val_loss: 0.0311669 | Time: 1141.55 ms
[2021-11-01 13:34:28	                main:574]	:	INFO	:	Epoch 1871 | loss: 0.0311529 | val_loss: 0.0311708 | Time: 1210.25 ms
[2021-11-01 13:34:29	                main:574]	:	INFO	:	Epoch 1872 | loss: 0.031154 | val_loss: 0.0311651 | Time: 1250.16 ms
[2021-11-01 13:34:30	                main:574]	:	INFO	:	Epoch 1873 | loss: 0.0311563 | val_loss: 0.0311662 | Time: 1166.48 ms
[2021-11-01 13:34:31	                main:574]	:	INFO	:	Epoch 1874 | loss: 0.0311589 | val_loss: 0.0311649 | Time: 1191.34 ms
[2021-11-01 13:34:33	                main:574]	:	INFO	:	Epoch 1875 | loss: 0.0311569 | val_loss: 0.0311636 | Time: 1209.39 ms
[2021-11-01 13:34:34	                main:574]	:	INFO	:	Epoch 1876 | loss: 0.0311601 | val_loss: 0.0311696 | Time: 1150.11 ms
[2021-11-01 13:34:35	                main:574]	:	INFO	:	Epoch 1877 | loss: 0.0311584 | val_loss: 0.0311658 | Time: 1229.88 ms
[2021-11-01 13:34:36	                main:574]	:	INFO	:	Epoch 1878 | loss: 0.0311565 | val_loss: 0.0311624 | Time: 1201.21 ms
[2021-11-01 13:34:37	                main:574]	:	INFO	:	Epoch 1879 | loss: 0.0311543 | val_loss: 0.0311629 | Time: 1209.79 ms
[2021-11-01 13:34:39	                main:574]	:	INFO	:	Epoch 1880 | loss: 0.0311541 | val_loss: 0.031161 | Time: 1263.39 ms
[2021-11-01 13:34:40	                main:574]	:	INFO	:	Epoch 1881 | loss: 0.031155 | val_loss: 0.0311642 | Time: 1212.78 ms
[2021-11-01 13:34:41	                main:574]	:	INFO	:	Epoch 1882 | loss: 0.0311529 | val_loss: 0.0311651 | Time: 1289.12 ms
[2021-11-01 13:34:42	                main:574]	:	INFO	:	Epoch 1883 | loss: 0.0311541 | val_loss: 0.0311655 | Time: 1229.09 ms
[2021-11-01 13:34:44	                main:574]	:	INFO	:	Epoch 1884 | loss: 0.0311515 | val_loss: 0.0311651 | Time: 1212.32 ms
[2021-11-01 13:34:45	                main:574]	:	INFO	:	Epoch 1885 | loss: 0.031155 | val_loss: 0.0311642 | Time: 1154.97 ms
[2021-11-01 13:34:46	                main:574]	:	INFO	:	Epoch 1886 | loss: 0.0311586 | val_loss: 0.0311748 | Time: 1185.52 ms
[2021-11-01 13:34:47	                main:574]	:	INFO	:	Epoch 1887 | loss: 0.0311631 | val_loss: 0.0311785 | Time: 1200.5 ms
[2021-11-01 13:34:48	                main:574]	:	INFO	:	Epoch 1888 | loss: 0.0311559 | val_loss: 0.0311656 | Time: 1220.04 ms
[2021-11-01 13:34:50	                main:574]	:	INFO	:	Epoch 1889 | loss: 0.0311552 | val_loss: 0.0311629 | Time: 1316.44 ms
[2021-11-01 13:34:51	                main:574]	:	INFO	:	Epoch 1890 | loss: 0.0311534 | val_loss: 0.0311619 | Time: 1190.73 ms
[2021-11-01 13:34:52	                main:574]	:	INFO	:	Epoch 1891 | loss: 0.0311526 | val_loss: 0.0311616 | Time: 1198.74 ms
[2021-11-01 13:34:53	                main:574]	:	INFO	:	Epoch 1892 | loss: 0.0311508 | val_loss: 0.0311637 | Time: 1193.69 ms
[2021-11-01 13:34:55	                main:574]	:	INFO	:	Epoch 1893 | loss: 0.0311517 | val_loss: 0.0311637 | Time: 1274.51 ms
[2021-11-01 13:34:56	                main:574]	:	INFO	:	Epoch 1894 | loss: 0.0311527 | val_loss: 0.0311646 | Time: 1221.26 ms
[2021-11-01 13:34:57	                main:574]	:	INFO	:	Epoch 1895 | loss: 0.0311537 | val_loss: 0.0311624 | Time: 1198.27 ms
[2021-11-01 13:34:58	                main:574]	:	INFO	:	Epoch 1896 | loss: 0.0311545 | val_loss: 0.0311673 | Time: 1143.71 ms
[2021-11-01 13:34:59	                main:574]	:	INFO	:	Epoch 1897 | loss: 0.0311556 | val_loss: 0.0311627 | Time: 1173.97 ms
[2021-11-01 13:35:01	                main:574]	:	INFO	:	Epoch 1898 | loss: 0.0311513 | val_loss: 0.0311619 | Time: 1245.08 ms
[2021-11-01 13:35:02	                main:574]	:	INFO	:	Epoch 1899 | loss: 0.0311518 | val_loss: 0.0311623 | Time: 1233.97 ms
[2021-11-01 13:35:03	                main:574]	:	INFO	:	Epoch 1900 | loss: 0.0311537 | val_loss: 0.0311627 | Time: 1204.84 ms
[2021-11-01 13:35:04	                main:574]	:	INFO	:	Epoch 1901 | loss: 0.0311549 | val_loss: 0.0311626 | Time: 1247.35 ms
[2021-11-01 13:35:05	                main:574]	:	INFO	:	Epoch 1902 | loss: 0.0311552 | val_loss: 0.0311688 | Time: 1143.33 ms
[2021-11-01 13:35:07	                main:574]	:	INFO	:	Epoch 1903 | loss: 0.0311582 | val_loss: 0.0311735 | Time: 1205.28 ms
[2021-11-01 13:35:08	                main:574]	:	INFO	:	Epoch 1904 | loss: 0.0311625 | val_loss: 0.031173 | Time: 1226.49 ms
[2021-11-01 13:35:09	                main:574]	:	INFO	:	Epoch 1905 | loss: 0.0311575 | val_loss: 0.0311691 | Time: 1264.03 ms
[2021-11-01 13:35:10	                main:574]	:	INFO	:	Epoch 1906 | loss: 0.0311578 | val_loss: 0.0311676 | Time: 1250.23 ms
[2021-11-01 13:35:12	                main:574]	:	INFO	:	Epoch 1907 | loss: 0.031161 | val_loss: 0.031169 | Time: 1284.81 ms
[2021-11-01 13:35:13	                main:574]	:	INFO	:	Epoch 1908 | loss: 0.0311595 | val_loss: 0.0311689 | Time: 1254.81 ms
[2021-11-01 13:35:14	                main:574]	:	INFO	:	Epoch 1909 | loss: 0.0311557 | val_loss: 0.0311661 | Time: 1152.49 ms
[2021-11-01 13:35:15	                main:574]	:	INFO	:	Epoch 1910 | loss: 0.0311561 | val_loss: 0.031168 | Time: 1198.11 ms
[2021-11-01 13:35:16	                main:574]	:	INFO	:	Epoch 1911 | loss: 0.0311556 | val_loss: 0.0311669 | Time: 1135.73 ms
[2021-11-01 13:35:18	                main:574]	:	INFO	:	Epoch 1912 | loss: 0.0311566 | val_loss: 0.0311665 | Time: 1249.18 ms
[2021-11-01 13:35:19	                main:574]	:	INFO	:	Epoch 1913 | loss: 0.0311565 | val_loss: 0.0311681 | Time: 1224.9 ms
[2021-11-01 13:35:20	                main:574]	:	INFO	:	Epoch 1914 | loss: 0.0311537 | val_loss: 0.0311697 | Time: 1167.78 ms
[2021-11-01 13:35:21	                main:574]	:	INFO	:	Epoch 1915 | loss: 0.0311541 | val_loss: 0.0311639 | Time: 1255.64 ms
[2021-11-01 13:35:23	                main:574]	:	INFO	:	Epoch 1916 | loss: 0.0311551 | val_loss: 0.0311697 | Time: 1237.59 ms
[2021-11-01 13:35:24	                main:574]	:	INFO	:	Epoch 1917 | loss: 0.0311566 | val_loss: 0.0311662 | Time: 1243.8 ms
[2021-11-01 13:35:25	                main:574]	:	INFO	:	Epoch 1918 | loss: 0.0311539 | val_loss: 0.0311655 | Time: 1251.58 ms
[2021-11-01 13:35:26	                main:574]	:	INFO	:	Epoch 1919 | loss: 0.0311608 | val_loss: 0.0311726 | Time: 1259.49 ms
[2021-11-01 13:35:28	                main:574]	:	INFO	:	Epoch 1920 | loss: 0.0311634 | val_loss: 0.0311718 | Time: 1237.78 ms
[2021-11-01 13:35:29	                main:574]	:	INFO	:	Epoch 1921 | loss: 0.0311604 | val_loss: 0.0311731 | Time: 1220.15 ms
[2021-11-01 13:35:30	                main:574]	:	INFO	:	Epoch 1922 | loss: 0.0311578 | val_loss: 0.0311711 | Time: 1215.77 ms
[2021-11-01 13:35:31	                main:574]	:	INFO	:	Epoch 1923 | loss: 0.0311586 | val_loss: 0.031176 | Time: 1218.56 ms
[2021-11-01 13:35:32	                main:574]	:	INFO	:	Epoch 1924 | loss: 0.031161 | val_loss: 0.0311729 | Time: 1196.58 ms
[2021-11-01 13:35:34	                main:574]	:	INFO	:	Epoch 1925 | loss: 0.0311624 | val_loss: 0.0311712 | Time: 1240.08 ms
[2021-11-01 13:35:35	                main:574]	:	INFO	:	Epoch 1926 | loss: 0.0311618 | val_loss: 0.0311712 | Time: 1271.12 ms
[2021-11-01 13:35:36	                main:574]	:	INFO	:	Epoch 1927 | loss: 0.0311613 | val_loss: 0.0311675 | Time: 1203.26 ms
[2021-11-01 13:35:37	                main:574]	:	INFO	:	Epoch 1928 | loss: 0.0311632 | val_loss: 0.0311712 | Time: 1213.4 ms
[2021-11-01 13:35:39	                main:574]	:	INFO	:	Epoch 1929 | loss: 0.0311609 | val_loss: 0.0311758 | Time: 1256.58 ms
[2021-11-01 13:35:40	                main:574]	:	INFO	:	Epoch 1930 | loss: 0.0311737 | val_loss: 0.0311745 | Time: 1261.03 ms
[2021-11-01 13:35:41	                main:574]	:	INFO	:	Epoch 1931 | loss: 0.0311628 | val_loss: 0.0311715 | Time: 1204.45 ms
[2021-11-01 13:35:42	                main:574]	:	INFO	:	Epoch 1932 | loss: 0.0311594 | val_loss: 0.0311664 | Time: 1262.63 ms
[2021-11-01 13:35:44	                main:574]	:	INFO	:	Epoch 1933 | loss: 0.0311577 | val_loss: 0.0311636 | Time: 1217.65 ms
[2021-11-01 13:35:45	                main:574]	:	INFO	:	Epoch 1934 | loss: 0.0311569 | val_loss: 0.0311636 | Time: 1253.26 ms
[2021-11-01 13:35:46	                main:574]	:	INFO	:	Epoch 1935 | loss: 0.0311568 | val_loss: 0.0311653 | Time: 1189.5 ms
[2021-11-01 13:35:47	                main:574]	:	INFO	:	Epoch 1936 | loss: 0.0311555 | val_loss: 0.0311637 | Time: 1242.99 ms
[2021-11-01 13:35:49	                main:574]	:	INFO	:	Epoch 1937 | loss: 0.0311599 | val_loss: 0.0311766 | Time: 1207.67 ms
[2021-11-01 13:35:50	                main:574]	:	INFO	:	Epoch 1938 | loss: 0.0311571 | val_loss: 0.0311702 | Time: 1204.67 ms
[2021-11-01 13:35:51	                main:574]	:	INFO	:	Epoch 1939 | loss: 0.0311558 | val_loss: 0.031161 | Time: 1193.44 ms
[2021-11-01 13:35:52	                main:574]	:	INFO	:	Epoch 1940 | loss: 0.0311531 | val_loss: 0.0311638 | Time: 1226.86 ms
[2021-11-01 13:35:53	                main:574]	:	INFO	:	Epoch 1941 | loss: 0.0311536 | val_loss: 0.0311635 | Time: 1258.11 ms
[2021-11-01 13:35:55	                main:574]	:	INFO	:	Epoch 1942 | loss: 0.031155 | val_loss: 0.0311638 | Time: 1199.78 ms
[2021-11-01 13:35:56	                main:574]	:	INFO	:	Epoch 1943 | loss: 0.0311561 | val_loss: 0.0311647 | Time: 1176.62 ms
[2021-11-01 13:35:57	                main:574]	:	INFO	:	Epoch 1944 | loss: 0.0311544 | val_loss: 0.0311655 | Time: 1243.83 ms
[2021-11-01 13:35:58	                main:574]	:	INFO	:	Epoch 1945 | loss: 0.0311548 | val_loss: 0.0311671 | Time: 1213.63 ms
[2021-11-01 13:35:59	                main:574]	:	INFO	:	Epoch 1946 | loss: 0.0311552 | val_loss: 0.0311639 | Time: 1216.98 ms
[2021-11-01 13:36:01	                main:574]	:	INFO	:	Epoch 1947 | loss: 0.031156 | val_loss: 0.0311678 | Time: 1253.34 ms
[2021-11-01 13:36:02	                main:574]	:	INFO	:	Epoch 1948 | loss: 0.0311528 | val_loss: 0.03117 | Time: 1247.43 ms
[2021-11-01 13:36:03	                main:574]	:	INFO	:	Epoch 1949 | loss: 0.0311572 | val_loss: 0.0311705 | Time: 1203.9 ms
[2021-11-01 13:36:04	                main:574]	:	INFO	:	Epoch 1950 | loss: 0.0311543 | val_loss: 0.0311642 | Time: 1209.61 ms
[2021-11-01 13:36:06	                main:574]	:	INFO	:	Epoch 1951 | loss: 0.0311546 | val_loss: 0.0311671 | Time: 1203.24 ms
[2021-11-01 13:36:07	                main:574]	:	INFO	:	Epoch 1952 | loss: 0.0311552 | val_loss: 0.0311736 | Time: 1206.84 ms
[2021-11-01 13:36:08	                main:574]	:	INFO	:	Epoch 1953 | loss: 0.031157 | val_loss: 0.0311667 | Time: 1235.68 ms
[2021-11-01 13:36:09	                main:574]	:	INFO	:	Epoch 1954 | loss: 0.0311538 | val_loss: 0.0311653 | Time: 1341.55 ms
[2021-11-01 13:36:11	                main:574]	:	INFO	:	Epoch 1955 | loss: 0.0311662 | val_loss: 0.0311857 | Time: 1224.99 ms
[2021-11-01 13:36:12	                main:574]	:	INFO	:	Epoch 1956 | loss: 0.0311697 | val_loss: 0.0311781 | Time: 1217.15 ms
[2021-11-01 13:36:13	                main:574]	:	INFO	:	Epoch 1957 | loss: 0.0311652 | val_loss: 0.0311716 | Time: 1252.61 ms
[2021-11-01 13:36:14	                main:574]	:	INFO	:	Epoch 1958 | loss: 0.0311623 | val_loss: 0.0311717 | Time: 1254.17 ms
[2021-11-01 13:36:16	                main:574]	:	INFO	:	Epoch 1959 | loss: 0.0311608 | val_loss: 0.0311709 | Time: 1169.45 ms
[2021-11-01 13:36:17	                main:574]	:	INFO	:	Epoch 1960 | loss: 0.0311604 | val_loss: 0.0311695 | Time: 1209.55 ms
[2021-11-01 13:36:18	                main:574]	:	INFO	:	Epoch 1961 | loss: 0.0311561 | val_loss: 0.0311663 | Time: 1271.16 ms
[2021-11-01 13:36:19	                main:574]	:	INFO	:	Epoch 1962 | loss: 0.0311569 | val_loss: 0.0311668 | Time: 1148.68 ms
[2021-11-01 13:36:20	                main:574]	:	INFO	:	Epoch 1963 | loss: 0.0311563 | val_loss: 0.0311653 | Time: 1284.97 ms
[2021-11-01 13:36:22	                main:574]	:	INFO	:	Epoch 1964 | loss: 0.0311548 | val_loss: 0.0311681 | Time: 1302.28 ms
[2021-11-01 13:36:23	                main:574]	:	INFO	:	Epoch 1965 | loss: 0.0311552 | val_loss: 0.031167 | Time: 1258.34 ms
[2021-11-01 13:36:24	                main:574]	:	INFO	:	Epoch 1966 | loss: 0.0311581 | val_loss: 0.0311674 | Time: 1236.76 ms
[2021-11-01 13:36:26	                main:574]	:	INFO	:	Epoch 1967 | loss: 0.0311607 | val_loss: 0.0311716 | Time: 1237.24 ms
[2021-11-01 13:36:27	                main:574]	:	INFO	:	Epoch 1968 | loss: 0.0311623 | val_loss: 0.0311679 | Time: 1217.03 ms
[2021-11-01 13:36:28	                main:574]	:	INFO	:	Epoch 1969 | loss: 0.0311602 | val_loss: 0.0311671 | Time: 1183.42 ms
[2021-11-01 13:36:29	                main:574]	:	INFO	:	Epoch 1970 | loss: 0.0311592 | val_loss: 0.0311665 | Time: 1196.58 ms
[2021-11-01 13:36:30	                main:574]	:	INFO	:	Epoch 1971 | loss: 0.0311593 | val_loss: 0.0311631 | Time: 1196.9 ms
[2021-11-01 13:36:32	                main:574]	:	INFO	:	Epoch 1972 | loss: 0.0311598 | val_loss: 0.0311683 | Time: 1208.85 ms
[2021-11-01 13:36:33	                main:574]	:	INFO	:	Epoch 1973 | loss: 0.0311571 | val_loss: 0.0311671 | Time: 1232.51 ms
[2021-11-01 13:36:34	                main:574]	:	INFO	:	Epoch 1974 | loss: 0.0311587 | val_loss: 0.0311661 | Time: 1223.65 ms
[2021-11-01 13:36:35	                main:574]	:	INFO	:	Epoch 1975 | loss: 0.031156 | val_loss: 0.0311697 | Time: 1279.22 ms
[2021-11-01 13:36:37	                main:574]	:	INFO	:	Epoch 1976 | loss: 0.0311556 | val_loss: 0.0311653 | Time: 1212.21 ms
[2021-11-01 13:36:38	                main:574]	:	INFO	:	Epoch 1977 | loss: 0.0311574 | val_loss: 0.0311701 | Time: 1206.54 ms
[2021-11-01 13:36:39	                main:574]	:	INFO	:	Epoch 1978 | loss: 0.0311597 | val_loss: 0.0311679 | Time: 1203.32 ms
[2021-11-01 13:36:40	                main:574]	:	INFO	:	Epoch 1979 | loss: 0.0311552 | val_loss: 0.0311657 | Time: 1185.97 ms
[2021-11-01 13:36:41	                main:574]	:	INFO	:	Epoch 1980 | loss: 0.031155 | val_loss: 0.0311666 | Time: 1276.35 ms
[2021-11-01 13:36:43	                main:574]	:	INFO	:	Epoch 1981 | loss: 0.031157 | val_loss: 0.0311689 | Time: 1166.48 ms
[2021-11-01 13:36:44	                main:574]	:	INFO	:	Epoch 1982 | loss: 0.03116 | val_loss: 0.0311639 | Time: 1173.49 ms
[2021-11-01 13:36:45	                main:574]	:	INFO	:	Epoch 1983 | loss: 0.0311558 | val_loss: 0.0311674 | Time: 1211.4 ms
[2021-11-01 13:36:46	                main:574]	:	INFO	:	Epoch 1984 | loss: 0.0311553 | val_loss: 0.0311651 | Time: 1183.82 ms
[2021-11-01 13:36:47	                main:574]	:	INFO	:	Epoch 1985 | loss: 0.0311554 | val_loss: 0.0311603 | Time: 1275.75 ms
[2021-11-01 13:36:49	                main:574]	:	INFO	:	Epoch 1986 | loss: 0.031155 | val_loss: 0.0311637 | Time: 1155.88 ms
[2021-11-01 13:36:50	                main:574]	:	INFO	:	Epoch 1987 | loss: 0.0311555 | val_loss: 0.0311664 | Time: 1233.39 ms
[2021-11-01 13:36:51	                main:574]	:	INFO	:	Epoch 1988 | loss: 0.0311552 | val_loss: 0.0311625 | Time: 1200.86 ms
[2021-11-01 13:36:52	                main:574]	:	INFO	:	Epoch 1989 | loss: 0.0311541 | val_loss: 0.0311661 | Time: 1245.91 ms
[2021-11-01 13:36:53	                main:574]	:	INFO	:	Epoch 1990 | loss: 0.0311535 | val_loss: 0.0311642 | Time: 1186.13 ms
[2021-11-01 13:36:55	                main:574]	:	INFO	:	Epoch 1991 | loss: 0.0311541 | val_loss: 0.0311688 | Time: 1163.03 ms
[2021-11-01 13:36:56	                main:574]	:	INFO	:	Epoch 1992 | loss: 0.0311551 | val_loss: 0.0311652 | Time: 1138.23 ms
[2021-11-01 13:36:57	                main:574]	:	INFO	:	Epoch 1993 | loss: 0.0311537 | val_loss: 0.0311673 | Time: 1230.78 ms
[2021-11-01 13:36:58	                main:574]	:	INFO	:	Epoch 1994 | loss: 0.031154 | val_loss: 0.0311686 | Time: 1351.57 ms
[2021-11-01 13:36:59	                main:574]	:	INFO	:	Epoch 1995 | loss: 0.0311561 | val_loss: 0.0311661 | Time: 1141.49 ms
[2021-11-01 13:37:01	                main:574]	:	INFO	:	Epoch 1996 | loss: 0.0311541 | val_loss: 0.0311646 | Time: 1262.46 ms
[2021-11-01 13:37:02	                main:574]	:	INFO	:	Epoch 1997 | loss: 0.0311555 | val_loss: 0.0311703 | Time: 1268.05 ms
[2021-11-01 13:37:03	                main:574]	:	INFO	:	Epoch 1998 | loss: 0.031164 | val_loss: 0.0311729 | Time: 1184.11 ms
[2021-11-01 13:37:04	                main:574]	:	INFO	:	Epoch 1999 | loss: 0.0311574 | val_loss: 0.0311652 | Time: 1244.78 ms
[2021-11-01 13:37:06	                main:574]	:	INFO	:	Epoch 2000 | loss: 0.0311531 | val_loss: 0.0311625 | Time: 1170.27 ms
[2021-11-01 13:37:07	                main:574]	:	INFO	:	Epoch 2001 | loss: 0.0311518 | val_loss: 0.0311625 | Time: 1213.23 ms
[2021-11-01 13:37:08	                main:574]	:	INFO	:	Epoch 2002 | loss: 0.0311509 | val_loss: 0.0311654 | Time: 1176.72 ms
[2021-11-01 13:37:09	                main:574]	:	INFO	:	Epoch 2003 | loss: 0.0311517 | val_loss: 0.0311653 | Time: 1224.18 ms
[2021-11-01 13:37:10	                main:574]	:	INFO	:	Epoch 2004 | loss: 0.0311512 | val_loss: 0.0311636 | Time: 1185.2 ms
[2021-11-01 13:37:12	                main:574]	:	INFO	:	Epoch 2005 | loss: 0.0311515 | val_loss: 0.0311673 | Time: 1128 ms
[2021-11-01 13:37:13	                main:574]	:	INFO	:	Epoch 2006 | loss: 0.0311543 | val_loss: 0.0311679 | Time: 1248.44 ms
[2021-11-01 13:37:14	                main:574]	:	INFO	:	Epoch 2007 | loss: 0.0311521 | val_loss: 0.0311685 | Time: 1190.63 ms
[2021-11-01 13:37:15	                main:574]	:	INFO	:	Epoch 2008 | loss: 0.0311538 | val_loss: 0.031169 | Time: 1187.05 ms
[2021-11-01 13:37:16	                main:574]	:	INFO	:	Epoch 2009 | loss: 0.0311574 | val_loss: 0.0311659 | Time: 1183.14 ms
[2021-11-01 13:37:18	                main:574]	:	INFO	:	Epoch 2010 | loss: 0.0311568 | val_loss: 0.0311661 | Time: 1191.92 ms
[2021-11-01 13:37:19	                main:574]	:	INFO	:	Epoch 2011 | loss: 0.031157 | val_loss: 0.0311685 | Time: 1232.26 ms
[2021-11-01 13:37:20	                main:574]	:	INFO	:	Epoch 2012 | loss: 0.0311571 | val_loss: 0.0311646 | Time: 1208.31 ms
[2021-11-01 13:37:21	                main:574]	:	INFO	:	Epoch 2013 | loss: 0.0311606 | val_loss: 0.0311717 | Time: 1243.97 ms
[2021-11-01 13:37:23	                main:574]	:	INFO	:	Epoch 2014 | loss: 0.031158 | val_loss: 0.0311652 | Time: 1237.55 ms
[2021-11-01 13:37:24	                main:574]	:	INFO	:	Epoch 2015 | loss: 0.0311648 | val_loss: 0.0311768 | Time: 1198.92 ms
[2021-11-01 13:37:25	                main:574]	:	INFO	:	Epoch 2016 | loss: 0.0311739 | val_loss: 0.0311755 | Time: 1177.62 ms
[2021-11-01 13:37:26	                main:574]	:	INFO	:	Epoch 2017 | loss: 0.0311726 | val_loss: 0.031175 | Time: 1213.27 ms
[2021-11-01 13:37:27	                main:574]	:	INFO	:	Epoch 2018 | loss: 0.0311694 | val_loss: 0.0311726 | Time: 1236.57 ms
[2021-11-01 13:37:29	                main:574]	:	INFO	:	Epoch 2019 | loss: 0.0311671 | val_loss: 0.0311718 | Time: 1206 ms
[2021-11-01 13:37:30	                main:574]	:	INFO	:	Epoch 2020 | loss: 0.0311657 | val_loss: 0.0311734 | Time: 1133.43 ms
[2021-11-01 13:37:31	                main:574]	:	INFO	:	Epoch 2021 | loss: 0.0311662 | val_loss: 0.0311723 | Time: 1166.95 ms
[2021-11-01 13:37:32	                main:574]	:	INFO	:	Epoch 2022 | loss: 0.0311639 | val_loss: 0.0311685 | Time: 1253.38 ms
[2021-11-01 13:37:33	                main:574]	:	INFO	:	Epoch 2023 | loss: 0.0311623 | val_loss: 0.0311724 | Time: 1221.28 ms
[2021-11-01 13:37:35	                main:574]	:	INFO	:	Epoch 2024 | loss: 0.0311649 | val_loss: 0.0311689 | Time: 1290.64 ms
[2021-11-01 13:37:36	                main:574]	:	INFO	:	Epoch 2025 | loss: 0.0311685 | val_loss: 0.0311748 | Time: 1265.23 ms
[2021-11-01 13:37:37	                main:574]	:	INFO	:	Epoch 2026 | loss: 0.0311692 | val_loss: 0.0311783 | Time: 1270.4 ms
[2021-11-01 13:37:38	                main:574]	:	INFO	:	Epoch 2027 | loss: 0.0311677 | val_loss: 0.031173 | Time: 1155.83 ms
[2021-11-01 13:37:40	                main:574]	:	INFO	:	Epoch 2028 | loss: 0.0311719 | val_loss: 0.0311751 | Time: 1200.97 ms
[2021-11-01 13:37:41	                main:574]	:	INFO	:	Epoch 2029 | loss: 0.0311717 | val_loss: 0.0311737 | Time: 1136.75 ms
[2021-11-01 13:37:42	                main:574]	:	INFO	:	Epoch 2030 | loss: 0.0311701 | val_loss: 0.0311707 | Time: 1256.56 ms
[2021-11-01 13:37:43	                main:574]	:	INFO	:	Epoch 2031 | loss: 0.031169 | val_loss: 0.0311733 | Time: 1221.36 ms
[2021-11-01 13:37:44	                main:574]	:	INFO	:	Epoch 2032 | loss: 0.031169 | val_loss: 0.0311716 | Time: 1204.04 ms
[2021-11-01 13:37:46	                main:574]	:	INFO	:	Epoch 2033 | loss: 0.0311688 | val_loss: 0.0311705 | Time: 1181.07 ms
[2021-11-01 13:37:47	                main:574]	:	INFO	:	Epoch 2034 | loss: 0.0311701 | val_loss: 0.0311702 | Time: 1181.78 ms
[2021-11-01 13:37:48	                main:574]	:	INFO	:	Epoch 2035 | loss: 0.0311709 | val_loss: 0.0311721 | Time: 1223.19 ms
[2021-11-01 13:37:49	                main:574]	:	INFO	:	Epoch 2036 | loss: 0.0311736 | val_loss: 0.0311738 | Time: 1138.28 ms
[2021-11-01 13:37:50	                main:574]	:	INFO	:	Epoch 2037 | loss: 0.0311778 | val_loss: 0.0311741 | Time: 1278.72 ms
[2021-11-01 13:37:52	                main:574]	:	INFO	:	Epoch 2038 | loss: 0.0311816 | val_loss: 0.0311756 | Time: 1245.94 ms
[2021-11-01 13:37:53	                main:574]	:	INFO	:	Epoch 2039 | loss: 0.0311768 | val_loss: 0.0311733 | Time: 1226.04 ms
[2021-11-01 13:37:54	                main:574]	:	INFO	:	Epoch 2040 | loss: 0.031175 | val_loss: 0.0311771 | Time: 1256.33 ms
[2021-11-01 13:37:55	                main:574]	:	INFO	:	Epoch 2041 | loss: 0.0311769 | val_loss: 0.0311771 | Time: 1176.67 ms
[2021-11-01 13:37:56	                main:574]	:	INFO	:	Epoch 2042 | loss: 0.0311744 | val_loss: 0.0311742 | Time: 1136.31 ms
[2021-11-01 13:37:58	                main:574]	:	INFO	:	Epoch 2043 | loss: 0.0311735 | val_loss: 0.0311747 | Time: 1188.13 ms
[2021-11-01 13:37:59	                main:574]	:	INFO	:	Epoch 2044 | loss: 0.0311728 | val_loss: 0.0311762 | Time: 1203.38 ms
[2021-11-01 13:38:00	                main:574]	:	INFO	:	Epoch 2045 | loss: 0.0311735 | val_loss: 0.0311731 | Time: 1207.29 ms
[2021-11-01 13:38:01	                main:574]	:	INFO	:	Epoch 2046 | loss: 0.0311721 | val_loss: 0.0311732 | Time: 1231.25 ms
[2021-11-01 13:38:03	                main:574]	:	INFO	:	Epoch 2047 | loss: 0.0311714 | val_loss: 0.031174 | Time: 1231.48 ms
[2021-11-01 13:38:04	                main:574]	:	INFO	:	Epoch 2048 | loss: 0.0311707 | val_loss: 0.0311737 | Time: 1260.76 ms
[2021-11-01 13:38:04	                main:597]	:	INFO	:	Saving trained model to model-final.pt, val_loss 0.0311737
[2021-11-01 13:38:04	                main:603]	:	INFO	:	Saving end state to config to file
[2021-11-01 13:38:04	                main:608]	:	INFO	:	Success, exiting..
13:38:04 (7752): called boinc_finish(0)
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3060 Ti)
[2021-11-01 13:42:04	                main:435]	:	INFO	:	Set logging level to 1
[2021-11-01 13:42:04	                main:441]	:	INFO	:	Running in BOINC Client mode
[2021-11-01 13:42:04	                main:444]	:	INFO	:	Resolving all filenames
[2021-11-01 13:42:04	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1)
[2021-11-01 13:42:04	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1634618430-15418-3_0_r946024237_1 (exists = 1)
[2021-11-01 13:42:04	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1634618430-15418-3_0_r946024237_0 (exists = 1)
[2021-11-01 13:42:04	                main:452]	:	INFO	:	Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1634618430-15418-3 (exists = 1)
[2021-11-01 13:42:04	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2021-11-01 13:42:04	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5
[2021-11-01 13:42:04	                main:474]	:	INFO	:	Configuration: 
[2021-11-01 13:42:04	                main:475]	:	INFO	:	    Model type: GRU
[2021-11-01 13:42:04	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2021-11-01 13:42:04	                main:477]	:	INFO	:	    Max Epochs: 2048
[2021-11-01 13:42:04	                main:478]	:	INFO	:	    Batch Size: 128
[2021-11-01 13:42:04	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2021-11-01 13:42:04	                main:480]	:	INFO	:	    Patience: 10
[2021-11-01 13:42:04	                main:481]	:	INFO	:	    Hidden Width: 12
[2021-11-01 13:42:04	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2021-11-01 13:42:04	                main:483]	:	INFO	:	    # Backend Layers: 4
[2021-11-01 13:42:04	                main:484]	:	INFO	:	    # Threads: 1
[2021-11-01 13:42:04	                main:486]	:	INFO	:	Preparing Dataset
[2021-11-01 13:42:04	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-01 13:42:05	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FF83F699B92

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 11/01/21 13:47:16
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\8;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 000000005f580000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000041850000 00000000001f5000 C:\Windows\SYSTEM32\ntdll.dll (6.2.19041.1288) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.19041.1023 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1023

ModLoad: 000000003fc80000 00000000000be000 C:\Windows\System32\KERNEL32.DLL (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 000000003f5d0000 00000000002c9000 C:\Windows\System32\KERNELBASE.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 0000000040b20000 00000000001a1000 C:\Windows\System32\USER32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000003f330000 0000000000022000 C:\Windows\System32\win32u.dll (6.2.19041.1288) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.19041.1288 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1288

ModLoad: 0000000041450000 000000000002b000 C:\Windows\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202

ModLoad: 000000003f4c0000 000000000010b000 C:\Windows\System32\gdi32full.dll (6.2.19041.1110) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.19041.1110 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1110

ModLoad: 000000003f070000 000000000009d000 C:\Windows\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 000000003ef70000 0000000000100000 C:\Windows\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 0000000035ae0000 0000000000058000 C:\ProgramData\BOINC\slots\8\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000003fec0000 00000000000ac000 C:\Windows\System32\ADVAPI32.dll (6.2.19041.1052) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000003fd40000 000000000009e000 C:\Windows\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.19041.546

ModLoad: 00000000413b0000 000000000009b000 C:\Windows\System32\sechost.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000040e00000 000000000012a000 C:\Windows\System32\RPCRT4.dll (6.2.19041.1288) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000034430000 00000000001e4000 C:\Windows\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.867

ModLoad: 0000000035280000 000000000008d000 C:\Windows\SYSTEM32\MSVCP140.dll (14.29.30133.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.29.30133.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.29.30133.0

ModLoad: 0000000035680000 000000000001b000 C:\Windows\SYSTEM32\VCRUNTIME140.dll (14.29.30133.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.29.30133.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.29.30133.0

ModLoad: 000000003c810000 000000000000c000 C:\Windows\SYSTEM32\VCRUNTIME140_1.dll (14.29.30133.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.29.30133.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.29.30133.0

ModLoad: 00000000b66c0000 000000000abe7000 C:\ProgramData\BOINC\slots\8\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000017d90000 000000000020d000 C:\ProgramData\BOINC\slots\8\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 00000000077a0000 00000000002db000 C:\ProgramData\BOINC\slots\8\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000035240000 0000000000040000 C:\ProgramData\BOINC\slots\8\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000c12b0000 0000000024b49000 C:\ProgramData\BOINC\slots\8\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000351f0000 0000000000045000 C:\ProgramData\BOINC\slots\8\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000b0150000 00000000034b2000 C:\ProgramData\BOINC\slots\8\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000b3610000 00000000030a5000 C:\ProgramData\BOINC\slots\8\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 000000003c300000 0000000000010000 C:\ProgramData\BOINC\slots\8\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 000000008bc00000 000000000919f000 C:\ProgramData\BOINC\slots\8\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 0000000087ea0000 0000000003d5b000 C:\ProgramData\BOINC\slots\8\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 0000000085fd0000 0000000001eca000 C:\ProgramData\BOINC\slots\8\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 0000000094da0000 000000001b3a4000 C:\ProgramData\BOINC\slots\8\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 0000000040240000 0000000000030000 C:\Windows\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000003ce90000 0000000000012000 C:\Windows\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000040f30000 0000000000472000 C:\Windows\System32\Setupapi.dll (6.2.19041.1237) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000003f110000 000000000004e000 C:\Windows\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 000000003f1c0000 0000000000027000 C:\Windows\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000003ed10000 0000000000034000 C:\Windows\SYSTEM32\DEVOBJ.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 000000003f160000 0000000000060000 C:\Windows\System32\WINTRUST.dll (6.2.19041.1266) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.19041.1266 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1266

ModLoad: 000000003f360000 0000000000156000 C:\Windows\System32\CRYPT32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000003eb50000 0000000000012000 C:\Windows\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000040310000 000000000073f000 C:\Windows\System32\Shell32.dll (6.2.19041.1266) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.19041.964 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.964

ModLoad: 000000003d090000 0000000000790000 C:\Windows\SYSTEM32\windows.storage.dll (6.2.19041.1266) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000414b0000 0000000000355000 C:\Windows\System32\combase.dll (6.2.19041.1288) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202

ModLoad: 000000003e9c0000 000000000002c000 C:\Windows\SYSTEM32\Wldp.dll (6.2.19041.662) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000003f8a0000 00000000000ad000 C:\Windows\System32\SHCORE.dll (6.2.19041.1266) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000003fde0000 0000000000055000 C:\Windows\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000070a0000 00000000002cc000 C:\Windows\system32\nvcuda.dll (30.0.14.7212) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r470\r470_00\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 30.0.14.7212
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.4.136 driver
    Product Version       : 30.0.14.7212

ModLoad: 00000000391d0000 000000000000a000 C:\Windows\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000847f0000 00000000017e0000 C:\Windows\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_19c79fb6254e3b11\nvcuda64.dll (30.0.14.7212) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r470\r470_00\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 30.0.14.7212
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.4.136 driver
    Product Version       : 30.0.14.7212

ModLoad: 0000000038f80000 0000000000031000 C:\Windows\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.19041.906 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.906

ModLoad: 0000000036b60000 000000000014a000 C:\Windows\SYSTEM32\drvstore.dll (6.2.19041.1081) (-exported- Symbols Loaded)
    Linked PDB Filename   : drvstore.pdb
    File Version          : 10.0.19041.1081 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1081

ModLoad: 000000003e910000 000000000000c000 C:\Windows\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000003c990000 000000000009e000 C:\Windows\system32\uxtheme.dll (6.2.19041.1266) (-exported- Symbols Loaded)
    Linked PDB Filename   : UxTheme.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000035ef0000 0000000000719000 C:\Windows\SYSTEM32\nvapi64.dll (30.0.14.7212) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r470\r470_00\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 30.0.14.7212
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 30.0.14.7212

ModLoad: 0000000040cd0000 000000000012a000 C:\Windows\System32\ole32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : ole32.pdb
    File Version          : 10.0.19041.1266 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1266

ModLoad: 0000000001c10000 000000000087b000 C:\Windows\System32\DriverStore\FileRepository\nv_dispi.inf_amd64_19c79fb6254e3b11\nvptxJitCompiler64.dll (30.0.14.7212) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 30.0.14.7212
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows PTX JIT Compiler
    Product Version       : 30.0.14.7212

ModLoad: 000000003f1f0000 0000000000083000 C:\Windows\System32\bcryptPrimitives.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 2594, Write: 812, Other 5997

- I/O Transfers Counters -
Read: 5670274, Write: 356419079, Other 91278

- Paged Pool Usage -
QuotaPagedPoolUsage: 3449008, QuotaPeakPagedPoolUsage: 3449008
QuotaNonPagedPoolUsage: 41064, QuotaPeakNonPagedPoolUsage: 49768

- Virtual Memory Usage -
VirtualSize: -1572564992, PeakVirtualSize: -92266496

- Pagefile Usage -
PagefileUsage: -1572564992, PeakPagefileUsage: -801501184

- Working Set Size -
WorkingSetSize: 1159593984, PeakWorkingSetSize: 1929166848, PageFaultCount: 7273421

*** Dump of thread ID 18904 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 71002824.000000

- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FF83F699B92

- Registers -
rax=0000000000000000 rbx=0000000000000001 rcx=000000005f838c40 rdx=00000000a49feae0 rsi=0000000000000000 rdi=0000000000000000
r8=00000000a49feae0 r9=000000005f838c30 r10=0000000000000fff r11=0000000000000ff0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000003f699b92 rsp=00000000a49feab8 rbp=0000000000000000
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
a49feab0 5f5b9100 00000001 a49feae0 a49feae0 5f838c30 KERNELBASE!DebugBreak+0x0 
a49feef0 5f5b9ce4 eb800000 a49ff254 00000000 00000334 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
a49ffe50 5f5ba084 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
a49ffe80 3fc97034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
a49ffeb0 418a2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
a49fff30 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 19216 (state: Running): ***

- Information -
Status: Base Priority: Above Normal, Priority: Above Normal, , Kernel Time: 55625000.000000, User Time: 3058437376.000000, Wait Time: 71002824.000000

- Registers -
rax=0000000000000000 rbx=00000000923b5988 rcx=000000009243fb88 rdx=000000009243fb88 rsi=0000000000000000 rdi=0000000000000000
r8=000000009230f600 r9=0000000000000000 r10=000000009243fbec r11=0000000000000000 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000001e399ca rsp=00000000a44e0400 rbp=00000000a44e0500
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
a44e2e20 01cdad72 b9a30870 9230f600 00000044 0000005b nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0 
a44e2ec0 01cdae63 0000005b b9a30870 00000046 a44e3010 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0 
a44e2fc0 01cb34c9 00000000 9230f600 9230f600 a44e31f0 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0 
a44e3080 01e20b02 86db6060 00000007 86db6060 b8a14678 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0 
a44e30b0 01c11ef9 86db6060 97309088 97309350 97309088 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0 
a44e30e0 01c18071 ae5bcdc8 00000000 86db6060 a44e31f0 nvptxJitCompiler64!+0x0 
a44e3340 01c148f3 b00e0008 a44e3500 b00e0008 89b48bf8 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
a44e36c0 01c16b83 9b931d58 00000005 00000000 a44e4890 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
a44e3750 01c1f861 97309088 a44e3860 00000000 a44e4e78 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
a44e3910 01c12724 93929190 9b9a9998 00000000 00000001 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
a44e4860 84c6fefb 00000001 00000005 a44e48a0 a44e4890 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
a44e4ab0 84c701a0 a6da7c50 a2b86c88 00000056 d7644c95 nvcuda64!cuProfilerStop+0x0 
a44e4ca0 84991dbd a44e4e30 00000000 a44e4e30 00000000 nvcuda64!cuProfilerStop+0x0 
a44e4d50 849927ba d77fbb00 00000000 a44e4e30 f1203048 nvcuda64!+0x0 
a44e4df0 84993165 00000007 84cf0b2c 01c12f33 847f0000 nvcuda64!+0x0 
a44e4fd0 84894a51 00000000 a44e5090 00000000 849b81be nvcuda64!+0x0 
a44e5040 84894bb7 9a781fc0 e5de4fd8 00000000 84a56e63 nvcuda64!+0x0 
a44e5130 84895731 00000000 00000000 00000000 a44e51c1 nvcuda64!+0x0 
a44e5210 c12b8333 00000000 00000000 e5de4fd8 d8a1d790 nvcuda64!+0x0 
a44e5290 c12bfd19 d8971140 d8974d90 00000000 c12bfd00 torch_cuda!+0x0 
a44e52c0 c12b722b d8974d78 d8975988 d8850101 d850f510 torch_cuda!+0x0 
a44e5300 c12ba2d9 d894f3e8 d894f3e8 00000000 d894f3e0 torch_cuda!+0x0 
a44e5380 c12b9ef1 00000001 00000001 00000001 d89648c0 torch_cuda!+0x0 
a44e53c0 c12c03d3 00000000 d8850860 00000000 a44e53a0 torch_cuda!+0x0 
a44e53f0 c12b23c4 00000000 d7531f90 e5440000 00000001 torch_cuda!+0x0 
a44e5440 c12b2381 d8850860 a44e5551 00000001 e0a48040 torch_cuda!+0x0 
a44e5480 c12b5ab0 a44e55f0 00000000 04800000 3f62a6bb torch_cuda!+0x0 
a44e55a0 c341471e 00000001 00000001 a44e5bf0 00000001 torch_cuda!+0x0 
a44e57b0 bbdcf058 9f1dee67 a44e7880 c0fe16c0 a44e5bf0 torch_cuda!at::cuda::CUDAEvent::block+0x0 
a44e59b0 bbdd22d2 a44e5bf0 a44e5ae8 a44e6820 a44e6820 torch_cpu!at::native::conv_tbc_backward+0x0 
a44e5f10 bbdd1eff 00000000 a44e6820 14000000 bbcabfac torch_cpu!at::native::copy_+0x0 
a44e5f70 bc264a0d c0fe0101 c0fe0640 ffffffff bbc90231 torch_cpu!at::native::copy_+0x0 
a44e6190 bdb915e6 10000000 00000000 bf1aac10 00000000 torch_cpu!at::Tensor::copy_+0x0 
a44e65d0 bc264a0d c0fe0640 4187b3c7 a44e6658 c0fe0640 torch_cpu!torch::autograd::VariableType::allCUDATypes+0x0 
a44e67f0 bbf2a38f a44e69b0 35afa8c0 d6dcc5e0 a44e6820 torch_cpu!at::Tensor::copy_+0x0 
a44e68a0 bbf29c19 a44e6e48 a44e7880 a44e6bb0 a44e6e48 torch_cpu!at::native::to_dense_backward+0x0 
a44e6ab0 bc24e363 47b3af1e 00000000 00000002 00000002 torch_cpu!at::native::to+0x0 
a44e6af0 bd4b6573 a44e0000 d753c760 a44e6b30 0000657a torch_cpu!at::zeros_out+0x0 
a44e6b30 bc0902f2 a44e0000 bef024d6 9f1dd167 a44e7880 torch_cpu!torch::autograd::GraphRoot::apply+0x0 
a44e6b70 bc281222 a44e0000 00000000 a44e6bf8 a44e6c80 torch_cpu!at::native::mkldnn_sigmoid_+0x0 
a44e6db0 5f59cd74 a44e7810 a44e7810 a44e7810 00000000 torch_cpu!at::Tensor::to+0x0 
a44e6fc0 5f59af96 a44e78a0 a44e7140 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
a44ffd60 5f7dc6f8 d7387200 00000000 00000000 d6fd28f0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
a44ffda0 3fc97034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
a44ffdd0 418a2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
a44ffe50 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 5572 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 71002816.000000

- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=00000000a4aff770 rsi=0000000000000000 rdi=000000000000000d
r8=00000000a4aff418 r9=00000000d757dfd0 r10=0000000000000000 r11=00000000a4aff6e0 r12=0000000000000064 r13=00000000a4aff770
r14=00000000a4aff470 r15=0000000000000000 rip=00000000418ed8c4 rsp=00000000a4aff418 rbp=00000000d757dfd0
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
a4aff410 3f61cb70 00000000 a4226000 419ba4d0 a4226000 ntdll!ZwWaitForMultipleObjects+0x0 
a4aff700 3f61ca6e d59135e0 006e0069 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
a4aff740 849c12c4 d7580370 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
a4aff980 84a6806d 00000000 d757dfd0 00000000 00000000 nvcuda64!+0x0 
a4affa30 849c0c93 144f94ef 5d0be385 d7b27890 00000000 nvcuda64!cuProfilerStop+0x0 
a4affa60 84cf6b84 d7b27890 00000000 00000000 00000000 nvcuda64!+0x0 
a4affa90 3fc97034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
a4affac0 418a2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
a4affb40 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 21048 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 70982904.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002e4 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002e4
r8=00000000a4bffd48 r9=0000000000000000 r10=0000000000000000 r11=00000000a4bffda8 r12=0000000000000000 r13=0000000000000000
r14=00000000000002e4 r15=0000000000000000 rip=00000000418ecdf4 rsp=00000000a4bffaa8 rbp=00000000d7562d30
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
a4bffaa0 3f5f1a8e 00000000 418a2630 0000027f 00000000 ntdll!ZwWaitForSingleObject+0x0 
a4bffb40 84bee2cd d7b271a0 00000000 00000000 000002e4 KERNELBASE!WaitForSingleObjectEx+0x0 
a4bffda0 849c0c93 00000000 d7b271a0 847f0000 d75b8b90 nvcuda64!cuProfilerStop+0x0 
a4bffdd0 84cf6b84 d7b271a0 00000000 00000000 00000000 nvcuda64!+0x0 
a4bffe00 3fc97034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
a4bffe30 418a2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
a4bffeb0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 17956 (state: Waiting): ***

- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 71002552.000000

- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000d77faf80 rdx=0000000000000000 rsi=00000000a4cff760 rdi=0000000000000000
r8=0000000000000000 r9=0000000000000000 r10=00000000d77fe320 r11=00000000a4cff790 r12=0000000000000000 r13=0000000000000000
r14=00000000d77faf80 r15=00000000d77fe318 rip=00000000418f0764 rsp=00000000a4cff738 rbp=00000000a4cff790
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
a4cff730 418b4295 400001c0 00000000 00000000 a4cff760 ntdll!NtWaitForAlertByThreadId+0x0 
a4cff7a0 3f63ce39 d77fbb00 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0 
a4cff7d0 8492f0fd d77fbb00 00000010 d77fbb00 00000000 KERNELBASE!SleepConditionVariableCS+0x0 
a4cff830 849c0c93 00000002 088798a5 11a58f53 00000000 nvcuda64!+0x0 
a4cff860 84cf6b84 d7b27e00 00000000 00000000 00000000 nvcuda64!+0x0 
a4cff890 3fc97034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
a4cff8c0 418a2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
a4cff940 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)