Task 13751525
| Name | ParityModified-1647047286-13880-1-0_0 |
| Workunit | 10838587 |
| Created | 25 Mar 2022, 11:14:25 UTC |
| Sent | 31 Mar 2022, 10:58:35 UTC |
| Report deadline | 8 Apr 2022, 10:58:35 UTC |
| Received | 7 Apr 2022, 10:59:49 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 18919 |
| Run time | 58 min 40 sec |
| CPU time | 57 min 21 sec |
| Validate state | Valid |
| Credit | 4,160.00 |
| Device peak FLOPS | 4,378.59 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.64 GB |
| Peak swap size | 3.62 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version> <![CDATA[ <stderr_txt> Time: 1799.1 ms [2022-04-05 23:46:27 main:574] : INFO : Epoch 1821 | loss: 0.0310935 | val_loss: 0.0312081 | Time: 1785.74 ms [2022-04-05 23:46:29 main:574] : INFO : Epoch 1822 | loss: 0.0311433 | val_loss: 0.0312061 | Time: 1789.12 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 1060 6GB) [2022-04-06 20:42:41 main:435] : INFO : Set logging level to 1 [2022-04-06 20:42:41 main:441] : INFO : Running in BOINC Client mode [2022-04-06 20:42:41 main:444] : INFO : Resolving all filenames [2022-04-06 20:42:41 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-06 20:42:41 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-06 20:42:41 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-06 20:42:41 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-06 20:42:41 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-06 20:42:41 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-06 20:42:41 main:474] : INFO : Configuration: [2022-04-06 20:42:41 main:475] : INFO : Model type: GRU [2022-04-06 20:42:41 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-06 20:42:41 main:477] : INFO : Max Epochs: 2048 [2022-04-06 20:42:41 main:478] : INFO : Batch Size: 128 [2022-04-06 20:42:41 main:479] : INFO : Learning Rate: 0.01 [2022-04-06 20:42:41 main:480] : INFO : Patience: 10 [2022-04-06 20:42:41 main:481] : INFO : Hidden Width: 12 [2022-04-06 20:42:41 main:482] : INFO : # Recurrent Layers: 4 [2022-04-06 20:42:41 main:483] : INFO : # Backend Layers: 4 [2022-04-06 20:42:41 main:484] : INFO : # Threads: 1 [2022-04-06 20:42:41 main:486] : INFO : Preparing Dataset [2022-04-06 20:42:41 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-06 20:42:41 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-06 20:42:44 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-06 20:42:44 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-06 20:42:44 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-06 20:42:44 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-06 20:42:44 main:494] : INFO : Creating Model [2022-04-06 20:42:44 main:507] : INFO : Preparing config file [2022-04-06 20:42:44 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-06 20:42:44 main:512] : INFO : Loading config [2022-04-06 20:42:44 main:514] : INFO : Loading state [2022-04-06 20:42:44 main:559] : INFO : Loading DataLoader into Memory [2022-04-06 20:42:44 main:562] : INFO : Starting Training [2022-04-06 20:42:46 main:574] : INFO : Epoch 1799 | loss: 0.0311273 | val_loss: 0.0312029 | Time: 1878.24 ms [2022-04-06 20:42:48 main:574] : INFO : Epoch 1800 | loss: 0.0310983 | val_loss: 0.0312037 | Time: 1674.49 ms [2022-04-06 20:42:50 main:574] : INFO : Epoch 1801 | loss: 0.0310957 | val_loss: 0.0312024 | Time: 1582.22 ms [2022-04-06 20:43:01 main:574] : INFO : Epoch 1802 | loss: 0.0310922 | val_loss: 0.0312039 | Time: 11701.7 ms [2022-04-06 20:43:03 main:574] : INFO : Epoch 1803 | loss: 0.0310937 | val_loss: 0.0312087 | Time: 1624.04 ms [2022-04-06 20:43:05 main:574] : INFO : Epoch 1804 | loss: 0.0310953 | val_loss: 0.031208 | Time: 1588.74 ms [2022-04-06 20:43:06 main:574] : INFO : Epoch 1805 | loss: 0.0310946 | val_loss: 0.031199 | Time: 1788.6 ms [2022-04-06 20:43:08 main:574] : INFO : Epoch 1806 | loss: 0.031104 | val_loss: 0.0312022 | Time: 1627.38 ms [2022-04-06 20:43:10 main:574] : INFO : Epoch 1807 | loss: 0.0311057 | val_loss: 0.0311958 | Time: 1588 ms [2022-04-06 20:43:11 main:574] : INFO : Epoch 1808 | loss: 0.0311 | val_loss: 0.0312076 | Time: 1596.15 ms [2022-04-06 20:43:13 main:574] : INFO : Epoch 1809 | loss: 0.0310953 | val_loss: 0.0312024 | Time: 1596.78 ms [2022-04-06 20:43:14 main:574] : INFO : Epoch 1810 | loss: 0.0310928 | val_loss: 0.0312115 | Time: 1598.82 ms [2022-04-06 20:43:16 main:574] : INFO : Epoch 1811 | loss: 0.0311025 | val_loss: 0.0311952 | Time: 1595.81 ms [2022-04-06 20:43:18 main:574] : INFO : Epoch 1812 | loss: 0.0311306 | val_loss: 0.031191 | Time: 1596.57 ms [2022-04-06 20:43:19 main:574] : INFO : Epoch 1813 | loss: 0.031131 | val_loss: 0.0311873 | Time: 1595.06 ms [2022-04-06 20:43:21 main:574] : INFO : Epoch 1814 | loss: 0.0311275 | val_loss: 0.0311973 | Time: 1598.61 ms [2022-04-06 20:43:22 main:574] : INFO : Epoch 1815 | loss: 0.0311193 | val_loss: 0.0311975 | Time: 1586.4 ms [2022-04-06 20:43:24 main:574] : INFO : Epoch 1816 | loss: 0.0311122 | val_loss: 0.0312007 | Time: 1596.01 ms [2022-04-06 20:43:26 main:574] : INFO : Epoch 1817 | loss: 0.0311101 | val_loss: 0.031196 | Time: 2061.18 ms [2022-04-06 20:43:28 main:574] : INFO : Epoch 1818 | loss: 0.0311055 | val_loss: 0.0311972 | Time: 1598.02 ms [2022-04-06 20:43:29 main:574] : INFO : Epoch 1819 | loss: 0.031102 | val_loss: 0.0312009 | Time: 1587.34 ms [2022-04-06 20:43:31 main:574] : INFO : Epoch 1820 | loss: 0.0310997 | val_loss: 0.0311982 | Time: 1634.52 ms [2022-04-06 20:43:33 main:574] : INFO : Epoch 1821 | loss: 0.0310979 | val_loss: 0.0311943 | Time: 1676.95 ms [2022-04-06 20:43:34 main:574] : INFO : Epoch 1822 | loss: 0.031096 | val_loss: 0.0312001 | Time: 1653.07 ms [2022-04-06 20:43:36 main:574] : INFO : Epoch 1823 | loss: 0.0311006 | val_loss: 0.0312088 | Time: 1651.56 ms [2022-04-06 20:43:37 main:574] : INFO : Epoch 1824 | loss: 0.0310982 | val_loss: 0.0311939 | Time: 1595.24 ms [2022-04-06 20:43:39 main:574] : INFO : Epoch 1825 | loss: 0.031095 | val_loss: 0.031205 | Time: 1617.8 ms [2022-04-06 20:43:41 main:574] : INFO : Epoch 1826 | loss: 0.0310896 | val_loss: 0.0312041 | Time: 1622.54 ms [2022-04-06 20:43:42 main:574] : INFO : Epoch 1827 | loss: 0.0310902 | val_loss: 0.0312031 | Time: 1666.7 ms [2022-04-06 20:43:44 main:574] : INFO : Epoch 1828 | loss: 0.0310888 | val_loss: 0.0312088 | Time: 1574.88 ms [2022-04-06 20:43:46 main:574] : INFO : Epoch 1829 | loss: 0.031091 | val_loss: 0.0311996 | Time: 1580.48 ms [2022-04-06 20:43:47 main:574] : INFO : Epoch 1830 | loss: 0.0310879 | val_loss: 0.0312181 | Time: 1572.2 ms [2022-04-06 20:43:49 main:574] : INFO : Epoch 1831 | loss: 0.0311087 | val_loss: 0.03119 | Time: 1565.03 ms [2022-04-06 20:43:50 main:574] : INFO : Epoch 1832 | loss: 0.0311121 | val_loss: 0.0312052 | Time: 1561.95 ms [2022-04-06 20:43:52 main:574] : INFO : Epoch 1833 | loss: 0.0311053 | val_loss: 0.0311933 | Time: 1688.7 ms [2022-04-06 20:43:53 main:574] : INFO : Epoch 1834 | loss: 0.0311125 | val_loss: 0.0311977 | Time: 1578.6 ms [2022-04-06 20:43:55 main:574] : INFO : Epoch 1835 | loss: 0.0311066 | val_loss: 0.0312034 | Time: 1575.59 ms [2022-04-06 20:43:57 main:574] : INFO : Epoch 1836 | loss: 0.0311064 | val_loss: 0.0312083 | Time: 1565.59 ms [2022-04-06 20:43:58 main:574] : INFO : Epoch 1837 | loss: 0.0310992 | val_loss: 0.0312001 | Time: 1573.39 ms [2022-04-06 20:44:00 main:574] : INFO : Epoch 1838 | loss: 0.0311015 | val_loss: 0.0312005 | Time: 1616.29 ms [2022-04-06 20:44:01 main:574] : INFO : Epoch 1839 | loss: 0.0310963 | val_loss: 0.0312003 | Time: 1607.95 ms [2022-04-06 20:44:03 main:574] : INFO : Epoch 1840 | loss: 0.0310924 | val_loss: 0.0312052 | Time: 1615.44 ms [2022-04-06 20:44:05 main:574] : INFO : Epoch 1841 | loss: 0.0310881 | val_loss: 0.0312078 | Time: 1587.24 ms [2022-04-06 20:44:06 main:574] : INFO : Epoch 1842 | loss: 0.0310878 | val_loss: 0.0312097 | Time: 1606.1 ms [2022-04-06 20:44:08 main:574] : INFO : Epoch 1843 | loss: 0.0310835 | val_loss: 0.0312137 | Time: 1581.93 ms [2022-04-06 20:44:09 main:574] : INFO : Epoch 1844 | loss: 0.0310832 | val_loss: 0.0312212 | Time: 1610.17 ms [2022-04-06 20:44:11 main:574] : INFO : Epoch 1845 | loss: 0.0310836 | val_loss: 0.0312096 | Time: 1582.55 ms [2022-04-06 20:44:13 main:574] : INFO : Epoch 1846 | loss: 0.0310835 | val_loss: 0.0312162 | Time: 1583.36 ms [2022-04-06 20:44:14 main:574] : INFO : Epoch 1847 | loss: 0.0310823 | val_loss: 0.0312052 | Time: 1579.05 ms [2022-04-06 20:44:16 main:574] : INFO : Epoch 1848 | loss: 0.0310887 | val_loss: 0.0312086 | Time: 1597.22 ms [2022-04-06 20:44:17 main:574] : INFO : Epoch 1849 | loss: 0.0310828 | val_loss: 0.0312204 | Time: 1602.7 ms [2022-04-06 20:44:19 main:574] : INFO : Epoch 1850 | loss: 0.0310834 | val_loss: 0.0312095 | Time: 1624.89 ms [2022-04-06 20:44:21 main:574] : INFO : Epoch 1851 | loss: 0.0310885 | val_loss: 0.0312117 | Time: 1742.41 ms [2022-04-06 20:44:22 main:574] : INFO : Epoch 1852 | loss: 0.0310849 | val_loss: 0.0312045 | Time: 1607.58 ms [2022-04-06 20:44:24 main:574] : INFO : Epoch 1853 | loss: 0.031084 | val_loss: 0.0312081 | Time: 1558.25 ms [2022-04-06 20:44:26 main:574] : INFO : Epoch 1854 | loss: 0.0310806 | val_loss: 0.0312195 | Time: 1575.15 ms [2022-04-06 20:44:27 main:574] : INFO : Epoch 1855 | loss: 0.0310793 | val_loss: 0.0312163 | Time: 1585.12 ms [2022-04-06 20:44:29 main:574] : INFO : Epoch 1856 | loss: 0.031083 | val_loss: 0.0312085 | Time: 1582.75 ms [2022-04-06 20:44:30 main:574] : INFO : Epoch 1857 | loss: 0.0310829 | val_loss: 0.0312239 | Time: 1605.22 ms [2022-04-06 20:44:32 main:574] : INFO : Epoch 1858 | loss: 0.0310902 | val_loss: 0.0312127 | Time: 1601.9 ms [2022-04-06 20:44:34 main:574] : INFO : Epoch 1859 | loss: 0.0310895 | val_loss: 0.0312086 | Time: 1583.19 ms [2022-04-06 20:44:35 main:574] : INFO : Epoch 1860 | loss: 0.0310874 | val_loss: 0.0312152 | Time: 1563.6 ms [2022-04-06 20:44:37 main:574] : INFO : Epoch 1861 | loss: 0.0310828 | val_loss: 0.0312182 | Time: 1574.09 ms [2022-04-06 20:44:38 main:574] : INFO : Epoch 1862 | loss: 0.0310828 | val_loss: 0.0312218 | Time: 1565.28 ms [2022-04-06 20:44:40 main:574] : INFO : Epoch 1863 | loss: 0.0310843 | val_loss: 0.0312127 | Time: 1568.68 ms [2022-04-06 20:44:41 main:574] : INFO : Epoch 1864 | loss: 0.0310811 | val_loss: 0.0312287 | Time: 1571.07 ms [2022-04-06 20:44:43 main:574] : INFO : Epoch 1865 | loss: 0.0310836 | val_loss: 0.0312114 | Time: 1586.31 ms [2022-04-06 20:44:45 main:574] : INFO : Epoch 1866 | loss: 0.0310874 | val_loss: 0.0312283 | Time: 1558.34 ms [2022-04-06 20:44:46 main:574] : INFO : Epoch 1867 | loss: 0.031091 | val_loss: 0.0312042 | Time: 1573.48 ms [2022-04-06 20:44:48 main:574] : INFO : Epoch 1868 | loss: 0.0311036 | val_loss: 0.0312028 | Time: 1564.2 ms [2022-04-06 20:44:49 main:574] : INFO : Epoch 1869 | loss: 0.0311064 | val_loss: 0.0311951 | Time: 1583.05 ms [2022-04-06 20:44:51 main:574] : INFO : Epoch 1870 | loss: 0.0311026 | val_loss: 0.0312099 | Time: 1563.49 ms [2022-04-06 20:44:52 main:574] : INFO : Epoch 1871 | loss: 0.0310934 | val_loss: 0.031213 | Time: 1573.53 ms [2022-04-06 20:44:54 main:574] : INFO : Epoch 1872 | loss: 0.0310942 | val_loss: 0.0312184 | Time: 1568.84 ms [2022-04-06 20:44:56 main:574] : INFO : Epoch 1873 | loss: 0.0311064 | val_loss: 0.0311968 | Time: 1563.98 ms [2022-04-06 20:44:57 main:574] : INFO : Epoch 1874 | loss: 0.0310965 | val_loss: 0.0312047 | Time: 1575.67 ms [2022-04-06 20:44:59 main:574] : INFO : Epoch 1875 | loss: 0.031093 | val_loss: 0.0312118 | Time: 1564.08 ms [2022-04-06 20:45:00 main:574] : INFO : Epoch 1876 | loss: 0.0310931 | val_loss: 0.0312167 | Time: 1583.27 ms [2022-04-06 20:45:02 main:574] : INFO : Epoch 1877 | loss: 0.0310953 | val_loss: 0.0312078 | Time: 1578 ms [2022-04-06 20:45:03 main:574] : INFO : Epoch 1878 | loss: 0.0311129 | val_loss: 0.0312052 | Time: 1564.58 ms [2022-04-06 20:45:05 main:574] : INFO : Epoch 1879 | loss: 0.0311041 | val_loss: 0.0312131 | Time: 1573.75 ms [2022-04-06 20:45:07 main:574] : INFO : Epoch 1880 | loss: 0.031097 | val_loss: 0.0312085 | Time: 1568.17 ms [2022-04-06 20:45:08 main:574] : INFO : Epoch 1881 | loss: 0.0310973 | val_loss: 0.0312018 | Time: 1554.74 ms [2022-04-06 20:45:10 main:574] : INFO : Epoch 1882 | loss: 0.0311003 | val_loss: 0.0312066 | Time: 1554.07 ms [2022-04-06 20:45:11 main:574] : INFO : Epoch 1883 | loss: 0.031096 | val_loss: 0.0312051 | Time: 1557.75 ms [2022-04-06 20:45:13 main:574] : INFO : Epoch 1884 | loss: 0.0310919 | val_loss: 0.0312086 | Time: 1591.81 ms [2022-04-06 20:45:14 main:574] : INFO : Epoch 1885 | loss: 0.0310906 | val_loss: 0.0312126 | Time: 1557.57 ms [2022-04-06 20:45:16 main:574] : INFO : Epoch 1886 | loss: 0.0310882 | val_loss: 0.0312121 | Time: 1562.25 ms [2022-04-06 20:45:18 main:574] : INFO : Epoch 1887 | loss: 0.0310879 | val_loss: 0.0312098 | Time: 1558.85 ms [2022-04-06 20:45:19 main:574] : INFO : Epoch 1888 | loss: 0.0310885 | val_loss: 0.0312192 | Time: 1564.61 ms [2022-04-06 20:45:21 main:574] : INFO : Epoch 1889 | loss: 0.0310905 | val_loss: 0.0312023 | Time: 1564.01 ms [2022-04-06 20:45:22 main:574] : INFO : Epoch 1890 | loss: 0.0310916 | val_loss: 0.0312087 | Time: 1563.13 ms [2022-04-06 20:45:24 main:574] : INFO : Epoch 1891 | loss: 0.0310849 | val_loss: 0.0312119 | Time: 1571.34 ms [2022-04-06 20:45:25 main:574] : INFO : Epoch 1892 | loss: 0.0310827 | val_loss: 0.0312188 | Time: 1565.47 ms [2022-04-06 20:45:27 main:574] : INFO : Epoch 1893 | loss: 0.0310902 | val_loss: 0.0312078 | Time: 1566.79 ms [2022-04-06 20:45:29 main:574] : INFO : Epoch 1894 | loss: 0.0310881 | val_loss: 0.031219 | Time: 1574.58 ms [2022-04-06 20:45:30 main:574] : INFO : Epoch 1895 | loss: 0.0310869 | val_loss: 0.0312071 | Time: 1573.72 ms [2022-04-06 20:45:32 main:574] : INFO : Epoch 1896 | loss: 0.0310857 | val_loss: 0.0312144 | Time: 1689.99 ms [2022-04-06 20:45:33 main:574] : INFO : Epoch 1897 | loss: 0.0310864 | val_loss: 0.0312173 | Time: 1582.93 ms [2022-04-06 20:45:35 main:574] : INFO : Epoch 1898 | loss: 0.0310902 | val_loss: 0.0312095 | Time: 1568.43 ms [2022-04-06 20:45:37 main:574] : INFO : Epoch 1899 | loss: 0.0310998 | val_loss: 0.0312021 | Time: 1590.8 ms [2022-04-06 20:45:38 main:574] : INFO : Epoch 1900 | loss: 0.0310969 | val_loss: 0.0312027 | Time: 1588.98 ms [2022-04-06 20:45:40 main:574] : INFO : Epoch 1901 | loss: 0.0310977 | val_loss: 0.0312126 | Time: 2047.76 ms [2022-04-06 20:45:42 main:574] : INFO : Epoch 1902 | loss: 0.0310917 | val_loss: 0.0312079 | Time: 1827.37 ms [2022-04-06 20:45:44 main:574] : INFO : Epoch 1903 | loss: 0.0310877 | val_loss: 0.0312147 | Time: 1756.01 ms [2022-04-06 20:45:46 main:574] : INFO : Epoch 1904 | loss: 0.0310889 | val_loss: 0.0312194 | Time: 1785.63 ms [2022-04-06 20:45:47 main:574] : INFO : Epoch 1905 | loss: 0.0310866 | val_loss: 0.0312087 | Time: 1726 ms [2022-04-06 20:45:49 main:574] : INFO : Epoch 1906 | loss: 0.0310862 | val_loss: 0.0312064 | Time: 1726.48 ms [2022-04-06 20:45:51 main:574] : INFO : Epoch 1907 | loss: 0.0310848 | val_loss: 0.031207 | Time: 1655.43 ms [2022-04-06 20:45:52 main:574] : INFO : Epoch 1908 | loss: 0.0310868 | val_loss: 0.0312154 | Time: 1709.64 ms [2022-04-06 20:45:54 main:574] : INFO : Epoch 1909 | loss: 0.0310861 | val_loss: 0.0312238 | Time: 1796.62 ms [2022-04-06 20:45:56 main:574] : INFO : Epoch 1910 | loss: 0.031117 | val_loss: 0.0311978 | Time: 1816.46 ms [2022-04-06 20:45:58 main:574] : INFO : Epoch 1911 | loss: 0.0311164 | val_loss: 0.0312017 | Time: 1583.46 ms [2022-04-06 20:45:59 main:574] : INFO : Epoch 1912 | loss: 0.0311118 | val_loss: 0.0311984 | Time: 1659.41 ms [2022-04-06 20:46:01 main:574] : INFO : Epoch 1913 | loss: 0.031105 | val_loss: 0.0312008 | Time: 1701.14 ms [2022-04-06 20:46:03 main:574] : INFO : Epoch 1914 | loss: 0.0311132 | val_loss: 0.0312052 | Time: 1615.97 ms [2022-04-06 20:46:04 main:574] : INFO : Epoch 1915 | loss: 0.0311072 | val_loss: 0.0311931 | Time: 1577.38 ms [2022-04-06 20:46:06 main:574] : INFO : Epoch 1916 | loss: 0.0311024 | val_loss: 0.0312017 | Time: 1574.58 ms [2022-04-06 20:46:07 main:574] : INFO : Epoch 1917 | loss: 0.0311033 | val_loss: 0.0312146 | Time: 1669.61 ms [2022-04-06 20:46:09 main:574] : INFO : Epoch 1918 | loss: 0.0310947 | val_loss: 0.0312122 | Time: 1596.67 ms [2022-04-06 20:46:11 main:574] : INFO : Epoch 1919 | loss: 0.0310942 | val_loss: 0.0312138 | Time: 1584.51 ms [2022-04-06 20:46:12 main:574] : INFO : Epoch 1920 | loss: 0.0310918 | val_loss: 0.0312049 | Time: 1592.71 ms [2022-04-06 20:46:14 main:574] : INFO : Epoch 1921 | loss: 0.0310906 | val_loss: 0.0312094 | Time: 1584.14 ms [2022-04-06 20:46:15 main:574] : INFO : Epoch 1922 | loss: 0.0310905 | val_loss: 0.0312084 | Time: 1578.3 ms [2022-04-06 20:46:17 main:574] : INFO : Epoch 1923 | loss: 0.0310916 | val_loss: 0.0312072 | Time: 1704.46 ms [2022-04-06 20:46:19 main:574] : INFO : Epoch 1924 | loss: 0.0310935 | val_loss: 0.0312098 | Time: 1574.12 ms [2022-04-06 20:46:20 main:574] : INFO : Epoch 1925 | loss: 0.0310914 | val_loss: 0.0312048 | Time: 1581.78 ms [2022-04-06 20:46:22 main:574] : INFO : Epoch 1926 | loss: 0.0310905 | val_loss: 0.031206 | Time: 1565.42 ms [2022-04-06 20:46:23 main:574] : INFO : Epoch 1927 | loss: 0.0311086 | val_loss: 0.0312008 | Time: 1580.45 ms [2022-04-06 20:46:25 main:574] : INFO : Epoch 1928 | loss: 0.0311282 | val_loss: 0.0311876 | Time: 1572.48 ms [2022-04-06 20:46:27 main:574] : INFO : Epoch 1929 | loss: 0.0311242 | val_loss: 0.0311993 | Time: 1583.97 ms [2022-04-06 20:46:28 main:574] : INFO : Epoch 1930 | loss: 0.0311157 | val_loss: 0.0312003 | Time: 1577.4 ms [2022-04-06 20:46:30 main:574] : INFO : Epoch 1931 | loss: 0.0311142 | val_loss: 0.031192 | Time: 1587.87 ms [2022-04-06 20:46:31 main:574] : INFO : Epoch 1932 | loss: 0.0311118 | val_loss: 0.0311931 | Time: 1580.02 ms [2022-04-06 20:46:33 main:574] : INFO : Epoch 1933 | loss: 0.0311136 | val_loss: 0.031203 | Time: 1586.63 ms [2022-04-06 20:46:35 main:574] : INFO : Epoch 1934 | loss: 0.0311083 | val_loss: 0.0312029 | Time: 1583.85 ms [2022-04-06 20:46:36 main:574] : INFO : Epoch 1935 | loss: 0.0311061 | val_loss: 0.0311975 | Time: 1573.06 ms [2022-04-06 20:46:38 main:574] : INFO : Epoch 1936 | loss: 0.0311077 | val_loss: 0.0311928 | Time: 1576.81 ms [2022-04-06 20:46:39 main:574] : INFO : Epoch 1937 | loss: 0.0311074 | val_loss: 0.0312073 | Time: 1578.99 ms [2022-04-06 20:46:41 main:574] : INFO : Epoch 1938 | loss: 0.0311007 | val_loss: 0.0312086 | Time: 1639.2 ms [2022-04-06 20:46:43 main:574] : INFO : Epoch 1939 | loss: 0.031097 | val_loss: 0.0312066 | Time: 1627.35 ms [2022-04-06 20:46:44 main:574] : INFO : Epoch 1940 | loss: 0.0310957 | val_loss: 0.0312063 | Time: 1595.55 ms [2022-04-06 20:46:46 main:574] : INFO : Epoch 1941 | loss: 0.0310926 | val_loss: 0.0312086 | Time: 1570.03 ms [2022-04-06 20:46:47 main:574] : INFO : Epoch 1942 | loss: 0.0310971 | val_loss: 0.0312055 | Time: 1565.38 ms [2022-04-06 20:46:49 main:574] : INFO : Epoch 1943 | loss: 0.0310956 | val_loss: 0.0312104 | Time: 1579.33 ms [2022-04-06 20:46:50 main:574] : INFO : Epoch 1944 | loss: 0.0311058 | val_loss: 0.0312037 | Time: 1558.54 ms [2022-04-06 20:46:52 main:574] : INFO : Epoch 1945 | loss: 0.031107 | val_loss: 0.0312054 | Time: 1579.71 ms [2022-04-06 20:46:54 main:574] : INFO : Epoch 1946 | loss: 0.0310992 | val_loss: 0.0312033 | Time: 1581.38 ms [2022-04-06 20:46:55 main:574] : INFO : Epoch 1947 | loss: 0.0310956 | val_loss: 0.0312097 | Time: 1576.55 ms [2022-04-06 20:46:57 main:574] : INFO : Epoch 1948 | loss: 0.0310953 | val_loss: 0.0312115 | Time: 1582.34 ms [2022-04-06 20:46:58 main:574] : INFO : Epoch 1949 | loss: 0.0311017 | val_loss: 0.0311985 | Time: 1573.05 ms [2022-04-06 20:47:00 main:574] : INFO : Epoch 1950 | loss: 0.0310999 | val_loss: 0.0312077 | Time: 1578.2 ms [2022-04-06 20:47:02 main:574] : INFO : Epoch 1951 | loss: 0.031099 | val_loss: 0.0312058 | Time: 1568.47 ms [2022-04-06 20:47:03 main:574] : INFO : Epoch 1952 | loss: 0.0310954 | val_loss: 0.0312013 | Time: 1568.94 ms [2022-04-06 20:47:05 main:574] : INFO : Epoch 1953 | loss: 0.0310932 | val_loss: 0.0312067 | Time: 1567.01 ms [2022-04-06 20:47:06 main:574] : INFO : Epoch 1954 | loss: 0.0310991 | val_loss: 0.0312108 | Time: 1580.72 ms [2022-04-06 20:47:08 main:574] : INFO : Epoch 1955 | loss: 0.0310979 | val_loss: 0.031212 | Time: 1598.87 ms [2022-04-06 20:47:09 main:574] : INFO : Epoch 1956 | loss: 0.0310932 | val_loss: 0.0312118 | Time: 1633.9 ms [2022-04-06 20:47:11 main:574] : INFO : Epoch 1957 | loss: 0.0310934 | val_loss: 0.0312123 | Time: 1760.87 ms [2022-04-06 20:47:13 main:574] : INFO : Epoch 1958 | loss: 0.0310905 | val_loss: 0.0312059 | Time: 1600.32 ms [2022-04-06 20:47:14 main:574] : INFO : Epoch 1959 | loss: 0.0310961 | val_loss: 0.0312133 | Time: 1634.44 ms [2022-04-06 20:47:16 main:574] : INFO : Epoch 1960 | loss: 0.0310971 | val_loss: 0.0312101 | Time: 1598.85 ms [2022-04-06 20:47:18 main:574] : INFO : Epoch 1961 | loss: 0.0310911 | val_loss: 0.0312163 | Time: 1635.94 ms [2022-04-06 20:47:19 main:574] : INFO : Epoch 1962 | loss: 0.0310877 | val_loss: 0.0312176 | Time: 1696.19 ms [2022-04-06 20:47:21 main:574] : INFO : Epoch 1963 | loss: 0.0310902 | val_loss: 0.0312046 | Time: 1611.09 ms [2022-04-06 20:47:23 main:574] : INFO : Epoch 1964 | loss: 0.0310892 | val_loss: 0.0312032 | Time: 1637.09 ms [2022-04-06 20:47:24 main:574] : INFO : Epoch 1965 | loss: 0.0310885 | val_loss: 0.0312065 | Time: 1718.16 ms [2022-04-06 20:47:26 main:574] : INFO : Epoch 1966 | loss: 0.0310865 | val_loss: 0.0312096 | Time: 1681.89 ms [2022-04-06 20:47:28 main:574] : INFO : Epoch 1967 | loss: 0.0310861 | val_loss: 0.0312036 | Time: 1688.62 ms [2022-04-06 20:47:29 main:574] : INFO : Epoch 1968 | loss: 0.0310908 | val_loss: 0.0312139 | Time: 1628.98 ms [2022-04-06 20:47:31 main:574] : INFO : Epoch 1969 | loss: 0.0310983 | val_loss: 0.0312054 | Time: 1640.45 ms [2022-04-06 20:47:33 main:574] : INFO : Epoch 1970 | loss: 0.031103 | val_loss: 0.031214 | Time: 1701.6 ms [2022-04-06 20:47:34 main:574] : INFO : Epoch 1971 | loss: 0.0310942 | val_loss: 0.0312071 | Time: 1726.95 ms [2022-04-06 20:47:36 main:574] : INFO : Epoch 1972 | loss: 0.0310943 | val_loss: 0.0312134 | Time: 1637.2 ms [2022-04-06 20:47:38 main:574] : INFO : Epoch 1973 | loss: 0.0310883 | val_loss: 0.0312132 | Time: 1581.03 ms [2022-04-06 20:47:39 main:574] : INFO : Epoch 1974 | loss: 0.0310859 | val_loss: 0.0312154 | Time: 1581.99 ms [2022-04-06 20:47:41 main:574] : INFO : Epoch 1975 | loss: 0.0310839 | val_loss: 0.0312133 | Time: 1611.41 ms [2022-04-06 20:47:43 main:574] : INFO : Epoch 1976 | loss: 0.0310835 | val_loss: 0.031203 | Time: 1799.56 ms [2022-04-06 20:47:44 main:574] : INFO : Epoch 1977 | loss: 0.0310882 | val_loss: 0.0312001 | Time: 1602.5 ms [2022-04-06 20:47:46 main:574] : INFO : Epoch 1978 | loss: 0.031112 | val_loss: 0.0311982 | Time: 1586.72 ms [2022-04-06 20:47:47 main:574] : INFO : Epoch 1979 | loss: 0.0311225 | val_loss: 0.0312116 | Time: 1591.97 ms [2022-04-06 20:47:49 main:574] : INFO : Epoch 1980 | loss: 0.0311088 | val_loss: 0.0312048 | Time: 1582.84 ms [2022-04-06 20:47:51 main:574] : INFO : Epoch 1981 | loss: 0.0311092 | val_loss: 0.031204 | Time: 1573.24 ms [2022-04-06 20:47:52 main:574] : INFO : Epoch 1982 | loss: 0.0311088 | val_loss: 0.0311998 | Time: 1594.14 ms [2022-04-06 20:47:54 main:574] : INFO : Epoch 1983 | loss: 0.0311035 | val_loss: 0.0312041 | Time: 1586.61 ms [2022-04-06 20:47:55 main:574] : INFO : Epoch 1984 | loss: 0.0310985 | val_loss: 0.0312044 | Time: 1567.21 ms [2022-04-06 20:47:57 main:574] : INFO : Epoch 1985 | loss: 0.0310967 | val_loss: 0.0312062 | Time: 1572.35 ms [2022-04-06 20:47:59 main:574] : INFO : Epoch 1986 | loss: 0.0310962 | val_loss: 0.0312022 | Time: 1562.37 ms [2022-04-06 20:48:00 main:574] : INFO : Epoch 1987 | loss: 0.0310967 | val_loss: 0.0311986 | Time: 1603.98 ms [2022-04-06 20:48:02 main:574] : INFO : Epoch 1988 | loss: 0.0310966 | val_loss: 0.0312132 | Time: 1593.27 ms [2022-04-06 20:48:03 main:574] : INFO : Epoch 1989 | loss: 0.0311013 | val_loss: 0.0312022 | Time: 1581.95 ms [2022-04-06 20:48:05 main:574] : INFO : Epoch 1990 | loss: 0.0311023 | val_loss: 0.0312018 | Time: 1579.09 ms [2022-04-06 20:48:06 main:574] : INFO : Epoch 1991 | loss: 0.0311014 | val_loss: 0.0312136 | Time: 1585.09 ms [2022-04-06 20:48:08 main:574] : INFO : Epoch 1992 | loss: 0.0310959 | val_loss: 0.0312106 | Time: 1585.75 ms [2022-04-06 20:48:10 main:574] : INFO : Epoch 1993 | loss: 0.0311057 | val_loss: 0.0311994 | Time: 1590.71 ms [2022-04-06 20:48:11 main:574] : INFO : Epoch 1994 | loss: 0.031105 | val_loss: 0.0311924 | Time: 1567.36 ms [2022-04-06 20:48:13 main:574] : INFO : Epoch 1995 | loss: 0.0311013 | val_loss: 0.0312075 | Time: 1579.58 ms [2022-04-06 20:48:14 main:574] : INFO : Epoch 1996 | loss: 0.0310966 | val_loss: 0.0312057 | Time: 1594.76 ms [2022-04-06 20:48:16 main:574] : INFO : Epoch 1997 | loss: 0.0310935 | val_loss: 0.0312045 | Time: 1581.32 ms [2022-04-06 20:48:18 main:574] : INFO : Epoch 1998 | loss: 0.0310913 | val_loss: 0.0312034 | Time: 1594.24 ms [2022-04-06 20:48:19 main:574] : INFO : Epoch 1999 | loss: 0.0310901 | val_loss: 0.0312073 | Time: 1598.06 ms [2022-04-06 20:48:21 main:574] : INFO : Epoch 2000 | loss: 0.0310881 | val_loss: 0.031212 | Time: 1611.3 ms [2022-04-06 20:48:22 main:574] : INFO : Epoch 2001 | loss: 0.0310881 | val_loss: 0.0312153 | Time: 1670.67 ms [2022-04-06 20:48:24 main:574] : INFO : Epoch 2002 | loss: 0.0310872 | val_loss: 0.0312108 | Time: 1621.49 ms [2022-04-06 20:48:26 main:574] : INFO : Epoch 2003 | loss: 0.0310902 | val_loss: 0.0312007 | Time: 1579.44 ms [2022-04-06 20:48:27 main:574] : INFO : Epoch 2004 | loss: 0.0311115 | val_loss: 0.0312045 | Time: 1572.58 ms [2022-04-06 20:48:29 main:574] : INFO : Epoch 2005 | loss: 0.0311077 | val_loss: 0.0312108 | Time: 1563.95 ms [2022-04-06 20:48:30 main:574] : INFO : Epoch 2006 | loss: 0.0311078 | val_loss: 0.0312038 | Time: 1572.73 ms [2022-04-06 20:48:32 main:574] : INFO : Epoch 2007 | loss: 0.0311015 | val_loss: 0.0312055 | Time: 1591.35 ms [2022-04-06 20:48:34 main:574] : INFO : Epoch 2008 | loss: 0.031097 | val_loss: 0.0312113 | Time: 1582.71 ms [2022-04-06 20:48:35 main:574] : INFO : Epoch 2009 | loss: 0.0311007 | val_loss: 0.0312061 | Time: 1576.5 ms [2022-04-06 20:48:37 main:574] : INFO : Epoch 2010 | loss: 0.031102 | val_loss: 0.0311992 | Time: 1589.98 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 1060 6GB) [2022-04-06 21:10:39 main:435] : INFO : Set logging level to 1 [2022-04-06 21:10:39 main:441] : INFO : Running in BOINC Client mode [2022-04-06 21:10:39 main:444] : INFO : Resolving all filenames [2022-04-06 21:10:39 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-06 21:10:39 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-06 21:10:39 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-06 21:10:39 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-06 21:10:39 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-06 21:10:39 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-06 21:10:39 main:474] : INFO : Configuration: [2022-04-06 21:10:39 main:475] : INFO : Model type: GRU [2022-04-06 21:10:39 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-06 21:10:39 main:477] : INFO : Max Epochs: 2048 [2022-04-06 21:10:39 main:478] : INFO : Batch Size: 128 [2022-04-06 21:10:39 main:479] : INFO : Learning Rate: 0.01 [2022-04-06 21:10:39 main:480] : INFO : Patience: 10 [2022-04-06 21:10:39 main:481] : INFO : Hidden Width: 12 [2022-04-06 21:10:39 main:482] : INFO : # Recurrent Layers: 4 [2022-04-06 21:10:39 main:483] : INFO : # Backend Layers: 4 [2022-04-06 21:10:39 main:484] : INFO : # Threads: 1 [2022-04-06 21:10:39 main:486] : INFO : Preparing Dataset [2022-04-06 21:10:39 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-06 21:10:39 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-06 21:10:41 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-06 21:10:41 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-06 21:10:41 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-06 21:10:41 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-06 21:10:41 main:494] : INFO : Creating Model [2022-04-06 21:10:41 main:507] : INFO : Preparing config file [2022-04-06 21:10:41 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-06 21:10:41 main:512] : INFO : Loading config [2022-04-06 21:10:41 main:514] : INFO : Loading state [2022-04-06 21:10:42 main:559] : INFO : Loading DataLoader into Memory [2022-04-06 21:10:42 main:562] : INFO : Starting Training [2022-04-06 21:10:44 main:574] : INFO : Epoch 1913 | loss: 0.031147 | val_loss: 0.0312006 | Time: 2059.59 ms [2022-04-06 21:10:46 main:574] : INFO : Epoch 1914 | loss: 0.0311129 | val_loss: 0.0312117 | Time: 1726.95 ms [2022-04-06 21:10:47 main:574] : INFO : Epoch 1915 | loss: 0.031106 | val_loss: 0.0311935 | Time: 1652.34 ms [2022-04-06 21:10:49 main:574] : INFO : Epoch 1916 | loss: 0.0311003 | val_loss: 0.0311988 | Time: 1803.04 ms [2022-04-06 21:10:51 main:574] : INFO : Epoch 1917 | loss: 0.0311092 | val_loss: 0.0312059 | Time: 1721.58 ms [2022-04-06 21:10:53 main:574] : INFO : Epoch 1918 | loss: 0.0311287 | val_loss: 0.0311953 | Time: 1764.23 ms [2022-04-06 21:10:55 main:574] : INFO : Epoch 1919 | loss: 0.0311153 | val_loss: 0.0312018 | Time: 1732.93 ms [2022-04-06 21:10:56 main:574] : INFO : Epoch 1920 | loss: 0.0311057 | val_loss: 0.0311957 | Time: 1807.18 ms [2022-04-06 21:10:58 main:574] : INFO : Epoch 1921 | loss: 0.031101 | val_loss: 0.0312047 | Time: 1716.47 ms [2022-04-06 21:11:00 main:574] : INFO : Epoch 1922 | loss: 0.0310984 | val_loss: 0.0311976 | Time: 1711.14 ms [2022-04-06 21:11:01 main:574] : INFO : Epoch 1923 | loss: 0.031097 | val_loss: 0.0312021 | Time: 1712.63 ms [2022-04-06 21:11:03 main:574] : INFO : Epoch 1924 | loss: 0.0311058 | val_loss: 0.0312028 | Time: 1672.02 ms [2022-04-06 21:11:05 main:574] : INFO : Epoch 1925 | loss: 0.0311026 | val_loss: 0.0311964 | Time: 1702.28 ms [2022-04-06 21:11:07 main:574] : INFO : Epoch 1926 | loss: 0.0311016 | val_loss: 0.0312064 | Time: 1692.32 ms [2022-04-06 21:11:08 main:574] : INFO : Epoch 1927 | loss: 0.0310992 | val_loss: 0.0312053 | Time: 1678.83 ms [2022-04-06 21:11:10 main:574] : INFO : Epoch 1928 | loss: 0.0310917 | val_loss: 0.0311998 | Time: 1757.37 ms [2022-04-06 21:11:12 main:574] : INFO : Epoch 1929 | loss: 0.0310964 | val_loss: 0.0312094 | Time: 1749.63 ms [2022-04-06 21:11:14 main:574] : INFO : Epoch 1930 | loss: 0.0310918 | val_loss: 0.0312233 | Time: 1763.66 ms [2022-04-06 21:11:15 main:574] : INFO : Epoch 1931 | loss: 0.0310918 | val_loss: 0.0312074 | Time: 1782.93 ms [2022-04-06 21:11:17 main:574] : INFO : Epoch 1932 | loss: 0.031087 | val_loss: 0.0312109 | Time: 1777.77 ms [2022-04-06 21:11:19 main:574] : INFO : Epoch 1933 | loss: 0.0310871 | val_loss: 0.0312069 | Time: 1762.02 ms [2022-04-06 21:11:21 main:574] : INFO : Epoch 1934 | loss: 0.031092 | val_loss: 0.0312146 | Time: 1804.56 ms [2022-04-06 21:11:22 main:574] : INFO : Epoch 1935 | loss: 0.0310882 | val_loss: 0.0312113 | Time: 1704.91 ms [2022-04-06 21:11:24 main:574] : INFO : Epoch 1936 | loss: 0.0310866 | val_loss: 0.0312087 | Time: 1783.43 ms [2022-04-06 21:11:26 main:574] : INFO : Epoch 1937 | loss: 0.0310862 | val_loss: 0.0312112 | Time: 1752.91 ms [2022-04-06 21:11:28 main:574] : INFO : Epoch 1938 | loss: 0.0310888 | val_loss: 0.0312038 | Time: 1708.08 ms [2022-04-06 21:11:29 main:574] : INFO : Epoch 1939 | loss: 0.0310924 | val_loss: 0.0312084 | Time: 1728.85 ms [2022-04-06 21:11:31 main:574] : INFO : Epoch 1940 | loss: 0.0310899 | val_loss: 0.0312194 | Time: 1705.94 ms [2022-04-06 21:11:33 main:574] : INFO : Epoch 1941 | loss: 0.0310871 | val_loss: 0.031204 | Time: 1648.87 ms [2022-04-06 21:11:34 main:574] : INFO : Epoch 1942 | loss: 0.0310946 | val_loss: 0.0312152 | Time: 1746.19 ms [2022-04-06 21:11:36 main:574] : INFO : Epoch 1943 | loss: 0.031094 | val_loss: 0.0312076 | Time: 1750.15 ms [2022-04-06 21:11:38 main:574] : INFO : Epoch 1944 | loss: 0.031088 | val_loss: 0.0312091 | Time: 1749.67 ms [2022-04-06 21:11:40 main:574] : INFO : Epoch 1945 | loss: 0.0310881 | val_loss: 0.0312158 | Time: 1738.44 ms [2022-04-06 21:11:41 main:574] : INFO : Epoch 1946 | loss: 0.0310988 | val_loss: 0.0312065 | Time: 1719.84 ms [2022-04-06 21:11:43 main:574] : INFO : Epoch 1947 | loss: 0.0310931 | val_loss: 0.0312135 | Time: 1690.7 ms [2022-04-06 21:11:45 main:574] : INFO : Epoch 1948 | loss: 0.0310943 | val_loss: 0.0312001 | Time: 1785.07 ms [2022-04-06 21:11:47 main:574] : INFO : Epoch 1949 | loss: 0.0310888 | val_loss: 0.0312203 | Time: 1750.97 ms [2022-04-06 21:11:48 main:574] : INFO : Epoch 1950 | loss: 0.0310863 | val_loss: 0.0312069 | Time: 1729.68 ms [2022-04-06 21:11:50 main:574] : INFO : Epoch 1951 | loss: 0.0310868 | val_loss: 0.0312113 | Time: 1703.5 ms [2022-04-06 21:11:52 main:574] : INFO : Epoch 1952 | loss: 0.0310857 | val_loss: 0.0312102 | Time: 1767.84 ms [2022-04-06 21:11:54 main:574] : INFO : Epoch 1953 | loss: 0.0310859 | val_loss: 0.0312224 | Time: 1690.21 ms [2022-04-06 21:11:55 main:574] : INFO : Epoch 1954 | loss: 0.0310844 | val_loss: 0.031218 | Time: 1771.8 ms [2022-04-06 21:11:57 main:574] : INFO : Epoch 1955 | loss: 0.0310926 | val_loss: 0.031202 | Time: 1788.07 ms [2022-04-06 21:11:59 main:574] : INFO : Epoch 1956 | loss: 0.0310963 | val_loss: 0.0312184 | Time: 1806.41 ms [2022-04-06 21:12:01 main:574] : INFO : Epoch 1957 | loss: 0.0310904 | val_loss: 0.0312096 | Time: 1773.15 ms [2022-04-06 21:12:02 main:574] : INFO : Epoch 1958 | loss: 0.0310861 | val_loss: 0.0312234 | Time: 1708.77 ms [2022-04-06 21:12:04 main:574] : INFO : Epoch 1959 | loss: 0.031084 | val_loss: 0.0312155 | Time: 1738.77 ms [2022-04-06 21:12:06 main:574] : INFO : Epoch 1960 | loss: 0.0310795 | val_loss: 0.0312282 | Time: 1695.57 ms [2022-04-06 21:12:08 main:574] : INFO : Epoch 1961 | loss: 0.0310834 | val_loss: 0.031219 | Time: 1668.61 ms [2022-04-06 21:12:09 main:574] : INFO : Epoch 1962 | loss: 0.0310847 | val_loss: 0.0312255 | Time: 1797.46 ms [2022-04-06 21:12:11 main:574] : INFO : Epoch 1963 | loss: 0.0310811 | val_loss: 0.0312139 | Time: 1736.26 ms [2022-04-06 21:12:13 main:574] : INFO : Epoch 1964 | loss: 0.0310892 | val_loss: 0.0312261 | Time: 1736.44 ms [2022-04-06 21:12:15 main:574] : INFO : Epoch 1965 | loss: 0.0310894 | val_loss: 0.0312092 | Time: 1892.74 ms [2022-04-06 21:12:17 main:574] : INFO : Epoch 1966 | loss: 0.031085 | val_loss: 0.031226 | Time: 1870.32 ms [2022-04-06 21:12:19 main:574] : INFO : Epoch 1967 | loss: 0.0310825 | val_loss: 0.0312151 | Time: 1919.53 ms [2022-04-06 21:12:20 main:574] : INFO : Epoch 1968 | loss: 0.0310815 | val_loss: 0.0312123 | Time: 1904.57 ms [2022-04-06 21:12:22 main:574] : INFO : Epoch 1969 | loss: 0.0310877 | val_loss: 0.0312251 | Time: 1768.86 ms [2022-04-06 21:12:24 main:574] : INFO : Epoch 1970 | loss: 0.0310879 | val_loss: 0.0312172 | Time: 1744.54 ms [2022-04-06 21:12:26 main:574] : INFO : Epoch 1971 | loss: 0.0310873 | val_loss: 0.0312093 | Time: 1774.13 ms [2022-04-06 21:12:27 main:574] : INFO : Epoch 1972 | loss: 0.0310884 | val_loss: 0.0312358 | Time: 1734.31 ms [2022-04-06 21:12:29 main:574] : INFO : Epoch 1973 | loss: 0.031092 | val_loss: 0.031221 | Time: 1771.45 ms [2022-04-06 21:12:31 main:574] : INFO : Epoch 1974 | loss: 0.0310911 | val_loss: 0.0312194 | Time: 1697.37 ms [2022-04-06 21:12:33 main:574] : INFO : Epoch 1975 | loss: 0.0311 | val_loss: 0.031216 | Time: 1731.92 ms [2022-04-06 21:12:34 main:574] : INFO : Epoch 1976 | loss: 0.0310932 | val_loss: 0.0312101 | Time: 1664.6 ms [2022-04-06 21:12:36 main:574] : INFO : Epoch 1977 | loss: 0.0310885 | val_loss: 0.0312109 | Time: 1828.99 ms [2022-04-06 21:12:38 main:574] : INFO : Epoch 1978 | loss: 0.0310903 | val_loss: 0.0312344 | Time: 1719.32 ms [2022-04-06 21:12:40 main:574] : INFO : Epoch 1979 | loss: 0.0310906 | val_loss: 0.0312134 | Time: 1740.12 ms [2022-04-06 21:12:41 main:574] : INFO : Epoch 1980 | loss: 0.031089 | val_loss: 0.0312133 | Time: 1721.78 ms [2022-04-06 21:12:43 main:574] : INFO : Epoch 1981 | loss: 0.0310866 | val_loss: 0.031212 | Time: 1792.53 ms [2022-04-06 21:12:45 main:574] : INFO : Epoch 1982 | loss: 0.0310885 | val_loss: 0.0312115 | Time: 1750.19 ms [2022-04-06 21:12:47 main:574] : INFO : Epoch 1983 | loss: 0.0310819 | val_loss: 0.0312286 | Time: 1728.78 ms [2022-04-06 21:12:48 main:574] : INFO : Epoch 1984 | loss: 0.0310809 | val_loss: 0.0312096 | Time: 1670.28 ms [2022-04-06 21:12:50 main:574] : INFO : Epoch 1985 | loss: 0.0310824 | val_loss: 0.0312335 | Time: 1682.43 ms [2022-04-06 21:12:52 main:574] : INFO : Epoch 1986 | loss: 0.0310852 | val_loss: 0.0312025 | Time: 1743.47 ms [2022-04-06 21:12:54 main:574] : INFO : Epoch 1987 | loss: 0.0310916 | val_loss: 0.0312097 | Time: 1757.79 ms [2022-04-06 21:12:56 main:574] : INFO : Epoch 1988 | loss: 0.031106 | val_loss: 0.0312131 | Time: 2003.67 ms [2022-04-06 21:12:57 main:574] : INFO : Epoch 1989 | loss: 0.031103 | val_loss: 0.0312028 | Time: 1911.2 ms [2022-04-06 21:12:59 main:574] : INFO : Epoch 1990 | loss: 0.0310938 | val_loss: 0.0312134 | Time: 1801.44 ms [2022-04-06 21:13:01 main:574] : INFO : Epoch 1991 | loss: 0.03109 | val_loss: 0.0312008 | Time: 1763.8 ms [2022-04-06 21:13:03 main:574] : INFO : Epoch 1992 | loss: 0.0310926 | val_loss: 0.0312138 | Time: 1824.04 ms [2022-04-06 21:13:05 main:574] : INFO : Epoch 1993 | loss: 0.0310895 | val_loss: 0.0312099 | Time: 1913.41 ms [2022-04-06 21:13:07 main:574] : INFO : Epoch 1994 | loss: 0.0310847 | val_loss: 0.0312136 | Time: 1832.46 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 1060 6GB) [2022-04-07 06:55:37 main:435] : INFO : Set logging level to 1 [2022-04-07 06:55:37 main:441] : INFO : Running in BOINC Client mode [2022-04-07 06:55:37 main:444] : INFO : Resolving all filenames [2022-04-07 06:55:37 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-07 06:55:37 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-07 06:55:37 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-07 06:55:37 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-07 06:55:37 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-07 06:55:37 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-07 06:55:37 main:474] : INFO : Configuration: [2022-04-07 06:55:37 main:475] : INFO : Model type: GRU [2022-04-07 06:55:37 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-07 06:55:37 main:477] : INFO : Max Epochs: 2048 [2022-04-07 06:55:37 main:478] : INFO : Batch Size: 128 [2022-04-07 06:55:37 main:479] : INFO : Learning Rate: 0.01 [2022-04-07 06:55:37 main:480] : INFO : Patience: 10 [2022-04-07 06:55:37 main:481] : INFO : Hidden Width: 12 [2022-04-07 06:55:37 main:482] : INFO : # Recurrent Layers: 4 [2022-04-07 06:55:37 main:483] : INFO : # Backend Layers: 4 [2022-04-07 06:55:37 main:484] : INFO : # Threads: 1 [2022-04-07 06:55:37 main:486] : INFO : Preparing Dataset [2022-04-07 06:55:37 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-07 06:55:38 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-07 06:55:40 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-07 06:55:40 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-07 06:55:40 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-07 06:55:40 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-07 06:55:40 main:494] : INFO : Creating Model [2022-04-07 06:55:40 main:507] : INFO : Preparing config file [2022-04-07 06:55:40 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-07 06:55:40 main:512] : INFO : Loading config [2022-04-07 06:55:40 main:514] : INFO : Loading state [2022-04-07 06:55:41 main:559] : INFO : Loading DataLoader into Memory [2022-04-07 06:55:41 main:562] : INFO : Starting Training [2022-04-07 06:55:43 main:574] : INFO : Epoch 1913 | loss: 0.0311452 | val_loss: 0.0312115 | Time: 1982.58 ms [2022-04-07 06:55:45 main:574] : INFO : Epoch 1914 | loss: 0.031113 | val_loss: 0.0311992 | Time: 1623.67 ms [2022-04-07 06:56:06 main:574] : INFO : Epoch 1915 | loss: 0.0311078 | val_loss: 0.0311997 | Time: 21856.9 ms [2022-04-07 06:56:08 main:574] : INFO : Epoch 1916 | loss: 0.0311035 | val_loss: 0.0311985 | Time: 1638.54 ms [2022-04-07 06:56:10 main:574] : INFO : Epoch 1917 | loss: 0.0311037 | val_loss: 0.0312 | Time: 1590.63 ms [2022-04-07 06:56:11 main:574] : INFO : Epoch 1918 | loss: 0.0311063 | val_loss: 0.0311992 | Time: 1605.79 ms [2022-04-07 06:56:13 main:574] : INFO : Epoch 1919 | loss: 0.0311 | val_loss: 0.0311981 | Time: 1617.27 ms [2022-04-07 06:56:15 main:574] : INFO : Epoch 1920 | loss: 0.0310939 | val_loss: 0.0311943 | Time: 1642.06 ms [2022-04-07 06:56:16 main:574] : INFO : Epoch 1921 | loss: 0.0310949 | val_loss: 0.0312109 | Time: 1710.48 ms [2022-04-07 06:56:18 main:574] : INFO : Epoch 1922 | loss: 0.0310923 | val_loss: 0.0312118 | Time: 1651.04 ms [2022-04-07 06:56:20 main:574] : INFO : Epoch 1923 | loss: 0.0310911 | val_loss: 0.0312118 | Time: 1601.61 ms [2022-04-07 06:56:21 main:574] : INFO : Epoch 1924 | loss: 0.0310903 | val_loss: 0.0312039 | Time: 1586.34 ms [2022-04-07 06:56:23 main:574] : INFO : Epoch 1925 | loss: 0.0310992 | val_loss: 0.031201 | Time: 1610.34 ms [2022-04-07 06:56:24 main:574] : INFO : Epoch 1926 | loss: 0.031098 | val_loss: 0.0312033 | Time: 1726.73 ms [2022-04-07 06:56:26 main:574] : INFO : Epoch 1927 | loss: 0.0310955 | val_loss: 0.0312105 | Time: 1626.73 ms [2022-04-07 06:56:28 main:574] : INFO : Epoch 1928 | loss: 0.0311047 | val_loss: 0.0312155 | Time: 1601.13 ms [2022-04-07 06:56:29 main:574] : INFO : Epoch 1929 | loss: 0.0311037 | val_loss: 0.0312027 | Time: 1619.66 ms [2022-04-07 06:56:31 main:574] : INFO : Epoch 1930 | loss: 0.0311398 | val_loss: 0.0311906 | Time: 1616.04 ms [2022-04-07 06:56:33 main:574] : INFO : Epoch 1931 | loss: 0.0311404 | val_loss: 0.0311926 | Time: 1636.49 ms [2022-04-07 06:56:34 main:574] : INFO : Epoch 1932 | loss: 0.0311306 | val_loss: 0.0311916 | Time: 1606.97 ms [2022-04-07 06:56:36 main:574] : INFO : Epoch 1933 | loss: 0.0311196 | val_loss: 0.0311938 | Time: 1632.36 ms [2022-04-07 06:56:37 main:574] : INFO : Epoch 1934 | loss: 0.0311097 | val_loss: 0.0311981 | Time: 1625.4 ms [2022-04-07 06:56:39 main:574] : INFO : Epoch 1935 | loss: 0.0311071 | val_loss: 0.031207 | Time: 1628.86 ms [2022-04-07 06:56:41 main:574] : INFO : Epoch 1936 | loss: 0.031108 | val_loss: 0.0311914 | Time: 1604.29 ms [2022-04-07 06:56:42 main:574] : INFO : Epoch 1937 | loss: 0.0311187 | val_loss: 0.031199 | Time: 1653.66 ms [2022-04-07 06:56:44 main:574] : INFO : Epoch 1938 | loss: 0.0311086 | val_loss: 0.0312008 | Time: 1663.76 ms [2022-04-07 06:56:46 main:574] : INFO : Epoch 1939 | loss: 0.0311051 | val_loss: 0.0312076 | Time: 1750.89 ms [2022-04-07 06:56:47 main:574] : INFO : Epoch 1940 | loss: 0.0311065 | val_loss: 0.0312004 | Time: 1704.07 ms [2022-04-07 06:56:49 main:574] : INFO : Epoch 1941 | loss: 0.0311035 | val_loss: 0.0312091 | Time: 1602.79 ms [2022-04-07 06:56:51 main:574] : INFO : Epoch 1942 | loss: 0.0310973 | val_loss: 0.0312091 | Time: 1610.37 ms [2022-04-07 06:56:52 main:574] : INFO : Epoch 1943 | loss: 0.031098 | val_loss: 0.0312011 | Time: 1608.84 ms [2022-04-07 06:56:54 main:574] : INFO : Epoch 1944 | loss: 0.0310979 | val_loss: 0.0312093 | Time: 1692.54 ms [2022-04-07 06:56:56 main:574] : INFO : Epoch 1945 | loss: 0.0310979 | val_loss: 0.0312086 | Time: 1754.47 ms [2022-04-07 06:56:57 main:574] : INFO : Epoch 1946 | loss: 0.0310962 | val_loss: 0.031208 | Time: 1693.92 ms [2022-04-07 06:56:59 main:574] : INFO : Epoch 1947 | loss: 0.0311039 | val_loss: 0.0312034 | Time: 1623.44 ms [2022-04-07 06:57:01 main:574] : INFO : Epoch 1948 | loss: 0.0311004 | val_loss: 0.0311971 | Time: 1737.24 ms [2022-04-07 06:57:03 main:574] : INFO : Epoch 1949 | loss: 0.031098 | val_loss: 0.0312006 | Time: 1673.95 ms [2022-04-07 06:57:04 main:574] : INFO : Epoch 1950 | loss: 0.0310951 | val_loss: 0.0312052 | Time: 1685.93 ms [2022-04-07 06:57:06 main:574] : INFO : Epoch 1951 | loss: 0.0310916 | val_loss: 0.0312124 | Time: 1655.99 ms [2022-04-07 06:57:07 main:574] : INFO : Epoch 1952 | loss: 0.0310928 | val_loss: 0.0312056 | Time: 1641.14 ms [2022-04-07 06:57:09 main:574] : INFO : Epoch 1953 | loss: 0.0310999 | val_loss: 0.0312064 | Time: 1616.3 ms [2022-04-07 06:57:11 main:574] : INFO : Epoch 1954 | loss: 0.0310987 | val_loss: 0.0311977 | Time: 1631.21 ms [2022-04-07 06:57:12 main:574] : INFO : Epoch 1955 | loss: 0.0310961 | val_loss: 0.0312062 | Time: 1609.64 ms [2022-04-07 06:57:14 main:574] : INFO : Epoch 1956 | loss: 0.0310901 | val_loss: 0.0312111 | Time: 1599.08 ms [2022-04-07 06:57:16 main:574] : INFO : Epoch 1957 | loss: 0.0310875 | val_loss: 0.0312088 | Time: 1628.26 ms [2022-04-07 06:57:17 main:574] : INFO : Epoch 1958 | loss: 0.0311043 | val_loss: 0.0311989 | Time: 1616.28 ms [2022-04-07 06:57:19 main:574] : INFO : Epoch 1959 | loss: 0.0311202 | val_loss: 0.031202 | Time: 1614.48 ms [2022-04-07 06:57:20 main:574] : INFO : Epoch 1960 | loss: 0.0311111 | val_loss: 0.0312073 | Time: 1615.25 ms [2022-04-07 06:57:22 main:574] : INFO : Epoch 1961 | loss: 0.0311072 | val_loss: 0.0312058 | Time: 1616.53 ms [2022-04-07 06:57:24 main:574] : INFO : Epoch 1962 | loss: 0.0310981 | val_loss: 0.031208 | Time: 1586.28 ms [2022-04-07 06:57:25 main:574] : INFO : Epoch 1963 | loss: 0.0310935 | val_loss: 0.031201 | Time: 1593.27 ms [2022-04-07 06:57:27 main:574] : INFO : Epoch 1964 | loss: 0.0310933 | val_loss: 0.0312052 | Time: 1574.29 ms [2022-04-07 06:57:28 main:574] : INFO : Epoch 1965 | loss: 0.031088 | val_loss: 0.0312142 | Time: 1578.22 ms [2022-04-07 06:57:30 main:574] : INFO : Epoch 1966 | loss: 0.0311039 | val_loss: 0.0311933 | Time: 1578.44 ms [2022-04-07 06:57:32 main:574] : INFO : Epoch 1967 | loss: 0.0311097 | val_loss: 0.0312014 | Time: 1583.14 ms [2022-04-07 06:57:33 main:574] : INFO : Epoch 1968 | loss: 0.0311022 | val_loss: 0.0312039 | Time: 1597.14 ms [2022-04-07 06:57:35 main:574] : INFO : Epoch 1969 | loss: 0.0310975 | val_loss: 0.0312059 | Time: 1571.92 ms [2022-04-07 06:57:36 main:574] : INFO : Epoch 1970 | loss: 0.0310932 | val_loss: 0.031209 | Time: 1566.44 ms [2022-04-07 06:57:38 main:574] : INFO : Epoch 1971 | loss: 0.031092 | val_loss: 0.0312013 | Time: 1564.72 ms [2022-04-07 06:57:40 main:574] : INFO : Epoch 1972 | loss: 0.0310925 | val_loss: 0.0312158 | Time: 1577.9 ms [2022-04-07 06:57:41 main:574] : INFO : Epoch 1973 | loss: 0.0310889 | val_loss: 0.0312111 | Time: 1590.31 ms [2022-04-07 06:57:43 main:574] : INFO : Epoch 1974 | loss: 0.0310908 | val_loss: 0.0311978 | Time: 1590.89 ms [2022-04-07 06:57:44 main:574] : INFO : Epoch 1975 | loss: 0.0310938 | val_loss: 0.0312119 | Time: 1601.73 ms [2022-04-07 06:57:46 main:574] : INFO : Epoch 1976 | loss: 0.0310879 | val_loss: 0.0312194 | Time: 1587.2 ms [2022-04-07 06:57:48 main:574] : INFO : Epoch 1977 | loss: 0.0310891 | val_loss: 0.0312069 | Time: 1572.65 ms [2022-04-07 06:57:49 main:574] : INFO : Epoch 1978 | loss: 0.031088 | val_loss: 0.0312096 | Time: 1575.22 ms [2022-04-07 06:57:51 main:574] : INFO : Epoch 1979 | loss: 0.0310859 | val_loss: 0.0312128 | Time: 1579.02 ms [2022-04-07 06:57:52 main:574] : INFO : Epoch 1980 | loss: 0.0310852 | val_loss: 0.0312146 | Time: 1585.44 ms [2022-04-07 06:57:54 main:574] : INFO : Epoch 1981 | loss: 0.0310846 | val_loss: 0.0312143 | Time: 1577.5 ms [2022-04-07 06:57:55 main:574] : INFO : Epoch 1982 | loss: 0.0310851 | val_loss: 0.0312174 | Time: 1567.99 ms [2022-04-07 06:57:57 main:574] : INFO : Epoch 1983 | loss: 0.0310799 | val_loss: 0.0312188 | Time: 1582.5 ms [2022-04-07 06:57:59 main:574] : INFO : Epoch 1984 | loss: 0.0310848 | val_loss: 0.0312101 | Time: 1572.71 ms [2022-04-07 06:58:00 main:574] : INFO : Epoch 1985 | loss: 0.0310873 | val_loss: 0.0312055 | Time: 1578.62 ms [2022-04-07 06:58:02 main:574] : INFO : Epoch 1986 | loss: 0.0310834 | val_loss: 0.0312102 | Time: 1572.87 ms [2022-04-07 06:58:03 main:574] : INFO : Epoch 1987 | loss: 0.031086 | val_loss: 0.0312085 | Time: 1586.38 ms [2022-04-07 06:58:05 main:574] : INFO : Epoch 1988 | loss: 0.0310834 | val_loss: 0.0312129 | Time: 1570.31 ms [2022-04-07 06:58:06 main:574] : INFO : Epoch 1989 | loss: 0.0310816 | val_loss: 0.0312149 | Time: 1574.6 ms [2022-04-07 06:58:08 main:574] : INFO : Epoch 1990 | loss: 0.0310827 | val_loss: 0.0312011 | Time: 1583.88 ms [2022-04-07 06:58:10 main:574] : INFO : Epoch 1991 | loss: 0.0310822 | val_loss: 0.0312288 | Time: 1574.13 ms [2022-04-07 06:58:11 main:574] : INFO : Epoch 1992 | loss: 0.0310864 | val_loss: 0.0312038 | Time: 1584.16 ms [2022-04-07 06:58:13 main:574] : INFO : Epoch 1993 | loss: 0.0310824 | val_loss: 0.0312169 | Time: 1583.94 ms [2022-04-07 06:58:14 main:574] : INFO : Epoch 1994 | loss: 0.0310874 | val_loss: 0.0312124 | Time: 1574.93 ms [2022-04-07 06:58:16 main:574] : INFO : Epoch 1995 | loss: 0.0310914 | val_loss: 0.0312146 | Time: 1580.19 ms [2022-04-07 06:58:18 main:574] : INFO : Epoch 1996 | loss: 0.0310871 | val_loss: 0.0312044 | Time: 1573.93 ms [2022-04-07 06:58:19 main:574] : INFO : Epoch 1997 | loss: 0.031087 | val_loss: 0.0312024 | Time: 1577.85 ms [2022-04-07 06:58:21 main:574] : INFO : Epoch 1998 | loss: 0.0310974 | val_loss: 0.0312107 | Time: 1570.07 ms [2022-04-07 06:58:22 main:574] : INFO : Epoch 1999 | loss: 0.0310989 | val_loss: 0.0312078 | Time: 1579.54 ms [2022-04-07 06:58:24 main:574] : INFO : Epoch 2000 | loss: 0.0311 | val_loss: 0.0312119 | Time: 1607.22 ms [2022-04-07 06:58:25 main:574] : INFO : Epoch 2001 | loss: 0.0311019 | val_loss: 0.0312122 | Time: 1581.38 ms [2022-04-07 06:58:27 main:574] : INFO : Epoch 2002 | loss: 0.0310998 | val_loss: 0.0312185 | Time: 1582.68 ms [2022-04-07 06:58:29 main:574] : INFO : Epoch 2003 | loss: 0.0311029 | val_loss: 0.0312043 | Time: 1563.68 ms [2022-04-07 06:58:30 main:574] : INFO : Epoch 2004 | loss: 0.0311001 | val_loss: 0.0312193 | Time: 1572.03 ms [2022-04-07 06:58:32 main:574] : INFO : Epoch 2005 | loss: 0.031094 | val_loss: 0.0312161 | Time: 1568.05 ms [2022-04-07 06:58:33 main:574] : INFO : Epoch 2006 | loss: 0.0310914 | val_loss: 0.0312174 | Time: 1586.96 ms [2022-04-07 06:58:35 main:574] : INFO : Epoch 2007 | loss: 0.0310962 | val_loss: 0.0312224 | Time: 1575.56 ms [2022-04-07 06:58:37 main:574] : INFO : Epoch 2008 | loss: 0.0310925 | val_loss: 0.0312154 | Time: 1731.44 ms [2022-04-07 06:58:38 main:574] : INFO : Epoch 2009 | loss: 0.0310901 | val_loss: 0.0312086 | Time: 1626.46 ms [2022-04-07 06:58:40 main:574] : INFO : Epoch 2010 | loss: 0.0310923 | val_loss: 0.031215 | Time: 1625.81 ms [2022-04-07 06:58:42 main:574] : INFO : Epoch 2011 | loss: 0.0310903 | val_loss: 0.0312132 | Time: 1586.17 ms [2022-04-07 06:58:43 main:574] : INFO : Epoch 2012 | loss: 0.0310865 | val_loss: 0.031209 | Time: 1735.75 ms [2022-04-07 06:58:45 main:574] : INFO : Epoch 2013 | loss: 0.031091 | val_loss: 0.0312166 | Time: 1732.23 ms [2022-04-07 06:58:47 main:574] : INFO : Epoch 2014 | loss: 0.0310918 | val_loss: 0.0312062 | Time: 1589.55 ms [2022-04-07 06:58:48 main:574] : INFO : Epoch 2015 | loss: 0.0310865 | val_loss: 0.0312137 | Time: 1597.11 ms [2022-04-07 06:58:50 main:574] : INFO : Epoch 2016 | loss: 0.0310847 | val_loss: 0.0312102 | Time: 1587.84 ms [2022-04-07 06:58:51 main:574] : INFO : Epoch 2017 | loss: 0.0310852 | val_loss: 0.0312132 | Time: 1592.31 ms [2022-04-07 06:58:53 main:574] : INFO : Epoch 2018 | loss: 0.0310844 | val_loss: 0.0312111 | Time: 1576.58 ms [2022-04-07 06:58:55 main:574] : INFO : Epoch 2019 | loss: 0.0311255 | val_loss: 0.0311935 | Time: 1586.08 ms [2022-04-07 06:58:56 main:574] : INFO : Epoch 2020 | loss: 0.0311367 | val_loss: 0.0311886 | Time: 1589.72 ms [2022-04-07 06:58:58 main:574] : INFO : Epoch 2021 | loss: 0.0311302 | val_loss: 0.0311914 | Time: 1583.49 ms [2022-04-07 06:58:59 main:574] : INFO : Epoch 2022 | loss: 0.031129 | val_loss: 0.031193 | Time: 1582.15 ms [2022-04-07 06:59:01 main:574] : INFO : Epoch 2023 | loss: 0.0311213 | val_loss: 0.0312015 | Time: 1585.08 ms [2022-04-07 06:59:03 main:574] : INFO : Epoch 2024 | loss: 0.0311166 | val_loss: 0.0312013 | Time: 1597.8 ms [2022-04-07 06:59:04 main:574] : INFO : Epoch 2025 | loss: 0.0311128 | val_loss: 0.0312056 | Time: 1601.67 ms [2022-04-07 06:59:06 main:574] : INFO : Epoch 2026 | loss: 0.0311112 | val_loss: 0.0312033 | Time: 1592.21 ms [2022-04-07 06:59:07 main:574] : INFO : Epoch 2027 | loss: 0.0311067 | val_loss: 0.0312065 | Time: 1581.2 ms [2022-04-07 06:59:09 main:574] : INFO : Epoch 2028 | loss: 0.0311055 | val_loss: 0.031197 | Time: 1591.14 ms [2022-04-07 06:59:10 main:574] : INFO : Epoch 2029 | loss: 0.0311043 | val_loss: 0.0311996 | Time: 1589.41 ms [2022-04-07 06:59:12 main:574] : INFO : Epoch 2030 | loss: 0.031099 | val_loss: 0.0312076 | Time: 1595.91 ms [2022-04-07 06:59:14 main:574] : INFO : Epoch 2031 | loss: 0.0310988 | val_loss: 0.0312051 | Time: 1582.66 ms [2022-04-07 06:59:15 main:574] : INFO : Epoch 2032 | loss: 0.0310971 | val_loss: 0.0312071 | Time: 1581.17 ms [2022-04-07 06:59:17 main:574] : INFO : Epoch 2033 | loss: 0.0310943 | val_loss: 0.0312057 | Time: 1601.16 ms [2022-04-07 06:59:18 main:574] : INFO : Epoch 2034 | loss: 0.0310951 | val_loss: 0.0312121 | Time: 1591.99 ms [2022-04-07 06:59:20 main:574] : INFO : Epoch 2035 | loss: 0.0310959 | val_loss: 0.031202 | Time: 1588.55 ms [2022-04-07 06:59:22 main:574] : INFO : Epoch 2036 | loss: 0.031092 | val_loss: 0.0312112 | Time: 1600.15 ms [2022-04-07 06:59:23 main:574] : INFO : Epoch 2037 | loss: 0.0310893 | val_loss: 0.0312168 | Time: 1592.1 ms [2022-04-07 06:59:25 main:574] : INFO : Epoch 2038 | loss: 0.0310912 | val_loss: 0.031205 | Time: 1591.85 ms [2022-04-07 06:59:26 main:574] : INFO : Epoch 2039 | loss: 0.0310963 | val_loss: 0.0312 | Time: 1587.4 ms [2022-04-07 06:59:28 main:574] : INFO : Epoch 2040 | loss: 0.0311012 | val_loss: 0.0312101 | Time: 1587.87 ms [2022-04-07 06:59:30 main:574] : INFO : Epoch 2041 | loss: 0.0310957 | val_loss: 0.0312127 | Time: 1579.9 ms [2022-04-07 06:59:31 main:574] : INFO : Epoch 2042 | loss: 0.0310953 | val_loss: 0.0312074 | Time: 1605.87 ms [2022-04-07 06:59:33 main:574] : INFO : Epoch 2043 | loss: 0.0310932 | val_loss: 0.0312061 | Time: 1587.87 ms [2022-04-07 06:59:34 main:574] : INFO : Epoch 2044 | loss: 0.0310928 | val_loss: 0.0312032 | Time: 1598.54 ms [2022-04-07 06:59:36 main:574] : INFO : Epoch 2045 | loss: 0.0311004 | val_loss: 0.031202 | Time: 1589.1 ms [2022-04-07 06:59:38 main:574] : INFO : Epoch 2046 | loss: 0.0311081 | val_loss: 0.0312137 | Time: 1594.35 ms [2022-04-07 06:59:39 main:574] : INFO : Epoch 2047 | loss: 0.0311374 | val_loss: 0.0313205 | Time: 1597.54 ms [2022-04-07 06:59:41 main:574] : INFO : Epoch 2048 | loss: 0.0311769 | val_loss: 0.0312197 | Time: 1602.62 ms [2022-04-07 06:59:41 main:597] : INFO : Saving trained model to model-final.pt, val_loss 0.0312197 [2022-04-07 06:59:41 main:603] : INFO : Saving end state to config to file [2022-04-07 06:59:41 main:608] : INFO : Success, exiting.. 06:59:41 (9368): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)