Task 13789345
| Name | ParityModified-1645994234-22879-3-0_0 |
| Workunit | 10873326 |
| Created | 26 Mar 2022, 7:01:45 UTC |
| Sent | 31 Mar 2022, 20:51:11 UTC |
| Report deadline | 8 Apr 2022, 20:51:11 UTC |
| Received | 9 Apr 2022, 12:58:08 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 17108 |
| Run time | 3 hours 14 min 25 sec |
| CPU time | 3 hours 3 min 45 sec |
| Validate state | Valid |
| Credit | 4,160.00 |
| Device peak FLOPS | 2,142.66 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.62 GB |
| Peak swap size | 3.59 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version> <![CDATA[ <stderr_txt> ch 1815 | loss: 0.0311445 | val_loss: 0.031165 | Time: 5647.44 ms [2022-04-07 21:52:28 main:574] : INFO : Epoch 1816 | loss: 0.0311472 | val_loss: 0.0311711 | Time: 5507.67 ms [2022-04-07 21:52:34 main:574] : INFO : Epoch 1817 | loss: 0.0311443 | val_loss: 0.0311697 | Time: 5433.94 ms [2022-04-07 21:52:40 main:574] : INFO : Epoch 1818 | loss: 0.0311402 | val_loss: 0.0311665 | Time: 5505.61 ms [2022-04-07 21:52:45 main:574] : INFO : Epoch 1819 | loss: 0.0311399 | val_loss: 0.0311631 | Time: 5456.71 ms [2022-04-07 21:52:52 main:574] : INFO : Epoch 1820 | loss: 0.0311399 | val_loss: 0.0311643 | Time: 5432.99 ms [2022-04-07 21:52:57 main:574] : INFO : Epoch 1821 | loss: 0.0311405 | val_loss: 0.0311656 | Time: 5527.92 ms [2022-04-07 21:53:04 main:574] : INFO : Epoch 1822 | loss: 0.0311386 | val_loss: 0.0311649 | Time: 5807.91 ms [2022-04-07 21:53:09 main:574] : INFO : Epoch 1823 | loss: 0.0311418 | val_loss: 0.0311675 | Time: 5452.3 ms [2022-04-07 21:53:15 main:574] : INFO : Epoch 1824 | loss: 0.0311491 | val_loss: 0.0311645 | Time: 5404.69 ms [2022-04-07 21:53:21 main:574] : INFO : Epoch 1825 | loss: 0.031143 | val_loss: 0.031163 | Time: 5520.89 ms [2022-04-07 21:53:26 main:574] : INFO : Epoch 1826 | loss: 0.031141 | val_loss: 0.0311641 | Time: 5568.5 ms [2022-04-07 21:53:32 main:574] : INFO : Epoch 1827 | loss: 0.031138 | val_loss: 0.0311645 | Time: 5550.02 ms [2022-04-07 21:53:38 main:574] : INFO : Epoch 1828 | loss: 0.0311379 | val_loss: 0.0311715 | Time: 5525.94 ms [2022-04-07 21:53:43 main:574] : INFO : Epoch 1829 | loss: 0.0311459 | val_loss: 0.0311651 | Time: 5513.76 ms [2022-04-07 21:53:49 main:574] : INFO : Epoch 1830 | loss: 0.0311391 | val_loss: 0.0311624 | Time: 5518.25 ms [2022-04-07 21:53:55 main:574] : INFO : Epoch 1831 | loss: 0.0311348 | val_loss: 0.0311748 | Time: 5423.6 ms [2022-04-07 21:54:01 main:574] : INFO : Epoch 1832 | loss: 0.0311408 | val_loss: 0.031166 | Time: 5509.9 ms [2022-04-07 21:54:06 main:574] : INFO : Epoch 1833 | loss: 0.0311357 | val_loss: 0.0311705 | Time: 5436.11 ms [2022-04-07 21:54:13 main:574] : INFO : Epoch 1834 | loss: 0.0311427 | val_loss: 0.0311862 | Time: 5565.16 ms [2022-04-07 21:54:18 main:574] : INFO : Epoch 1835 | loss: 0.0312107 | val_loss: 0.0312218 | Time: 5459.56 ms [2022-04-07 21:54:24 main:574] : INFO : Epoch 1836 | loss: 0.0312241 | val_loss: 0.0312136 | Time: 5616.88 ms [2022-04-07 21:54:29 main:574] : INFO : Epoch 1837 | loss: 0.0314865 | val_loss: 0.0324233 | Time: 5475.09 ms [2022-04-07 21:54:36 main:574] : INFO : Epoch 1838 | loss: 0.0374551 | val_loss: 0.0315987 | Time: 5526.31 ms [2022-04-07 21:54:42 main:574] : INFO : Epoch 1839 | loss: 0.0318756 | val_loss: 0.0314696 | Time: 5530.56 ms [2022-04-07 21:54:47 main:574] : INFO : Epoch 1840 | loss: 0.0313309 | val_loss: 0.0312574 | Time: 5485.64 ms [2022-04-07 21:54:53 main:574] : INFO : Epoch 1841 | loss: 0.0312405 | val_loss: 0.0312293 | Time: 5498.64 ms [2022-04-07 21:54:59 main:574] : INFO : Epoch 1842 | loss: 0.031221 | val_loss: 0.0312204 | Time: 5417.63 ms [2022-04-07 21:55:04 main:574] : INFO : Epoch 1843 | loss: 0.031214 | val_loss: 0.031212 | Time: 5486.5 ms [2022-04-07 21:55:10 main:574] : INFO : Epoch 1844 | loss: 0.0312105 | val_loss: 0.0312103 | Time: 5445.91 ms [2022-04-07 21:55:15 main:574] : INFO : Epoch 1845 | loss: 0.0312068 | val_loss: 0.0312037 | Time: 5443.44 ms [2022-04-07 21:55:21 main:574] : INFO : Epoch 1846 | loss: 0.0312031 | val_loss: 0.0312034 | Time: 5526.5 ms [2022-04-07 21:55:27 main:574] : INFO : Epoch 1847 | loss: 0.0312021 | val_loss: 0.0312015 | Time: 5542.88 ms [2022-04-07 21:55:33 main:574] : INFO : Epoch 1848 | loss: 0.0312002 | val_loss: 0.0311966 | Time: 5509.1 ms [2022-04-07 21:55:39 main:574] : INFO : Epoch 1849 | loss: 0.0311965 | val_loss: 0.0311959 | Time: 5423.9 ms [2022-04-07 21:55:45 main:574] : INFO : Epoch 1850 | loss: 0.0311952 | val_loss: 0.031195 | Time: 5525.34 ms [2022-04-07 21:55:51 main:574] : INFO : Epoch 1851 | loss: 0.0311961 | val_loss: 0.0311921 | Time: 5449.31 ms [2022-04-07 21:55:57 main:574] : INFO : Epoch 1852 | loss: 0.0311945 | val_loss: 0.031194 | Time: 5490.71 ms [2022-04-07 21:56:03 main:574] : INFO : Epoch 1853 | loss: 0.0311954 | val_loss: 0.0311917 | Time: 5453.73 ms [2022-04-07 21:56:09 main:574] : INFO : Epoch 1854 | loss: 0.0311969 | val_loss: 0.0312099 | Time: 5495.99 ms [2022-04-07 21:56:14 main:574] : INFO : Epoch 1855 | loss: 0.031199 | val_loss: 0.0311898 | Time: 5448.68 ms [2022-04-07 21:56:20 main:574] : INFO : Epoch 1856 | loss: 0.0311937 | val_loss: 0.0311908 | Time: 5464.52 ms [2022-04-07 21:56:25 main:574] : INFO : Epoch 1857 | loss: 0.0311914 | val_loss: 0.0311902 | Time: 5599.21 ms [2022-04-07 21:56:31 main:574] : INFO : Epoch 1858 | loss: 0.0311921 | val_loss: 0.0311899 | Time: 5483.16 ms [2022-04-07 21:56:37 main:574] : INFO : Epoch 1859 | loss: 0.0311907 | val_loss: 0.0311895 | Time: 5531.54 ms [2022-04-07 21:56:43 main:574] : INFO : Epoch 1860 | loss: 0.0311906 | val_loss: 0.0311881 | Time: 5428.35 ms [2022-04-07 21:56:49 main:574] : INFO : Epoch 1861 | loss: 0.0311928 | val_loss: 0.0311898 | Time: 5508.6 ms [2022-04-07 21:56:54 main:574] : INFO : Epoch 1862 | loss: 0.0311917 | val_loss: 0.0311882 | Time: 5413.44 ms [2022-04-07 21:57:00 main:574] : INFO : Epoch 1863 | loss: 0.0311973 | val_loss: 0.0311946 | Time: 5493.28 ms [2022-04-07 21:57:05 main:574] : INFO : Epoch 1864 | loss: 0.031194 | val_loss: 0.031188 | Time: 5439.07 ms [2022-04-07 21:57:11 main:574] : INFO : Epoch 1865 | loss: 0.0311911 | val_loss: 0.0311891 | Time: 5444.88 ms [2022-04-07 21:57:16 main:574] : INFO : Epoch 1866 | loss: 0.0311904 | val_loss: 0.0311891 | Time: 5496.49 ms [2022-04-07 21:57:22 main:574] : INFO : Epoch 1867 | loss: 0.0311894 | val_loss: 0.0311878 | Time: 5527.19 ms [2022-04-07 21:57:27 main:574] : INFO : Epoch 1868 | loss: 0.0311898 | val_loss: 0.031189 | Time: 5502.7 ms [2022-04-07 21:57:33 main:574] : INFO : Epoch 1869 | loss: 0.0311918 | val_loss: 0.0311925 | Time: 5512.53 ms [2022-04-07 21:57:39 main:574] : INFO : Epoch 1870 | loss: 0.0311946 | val_loss: 0.0312012 | Time: 5600.53 ms [2022-04-07 21:57:44 main:574] : INFO : Epoch 1871 | loss: 0.03119 | val_loss: 0.0311876 | Time: 5514.38 ms [2022-04-07 21:57:50 main:574] : INFO : Epoch 1872 | loss: 0.0311892 | val_loss: 0.0311918 | Time: 5447.68 ms [2022-04-07 21:57:55 main:574] : INFO : Epoch 1873 | loss: 0.0311909 | val_loss: 0.0311869 | Time: 5488.95 ms [2022-04-07 21:58:01 main:574] : INFO : Epoch 1874 | loss: 0.0311924 | val_loss: 0.0311921 | Time: 5522.48 ms [2022-04-07 21:58:07 main:574] : INFO : Epoch 1875 | loss: 0.0311908 | val_loss: 0.0311912 | Time: 5415.6 ms [2022-04-07 21:58:13 main:574] : INFO : Epoch 1876 | loss: 0.0311887 | val_loss: 0.0311896 | Time: 5393.4 ms [2022-04-07 21:58:18 main:574] : INFO : Epoch 1877 | loss: 0.0311891 | val_loss: 0.0311927 | Time: 5493.75 ms [2022-04-07 21:58:24 main:574] : INFO : Epoch 1878 | loss: 0.031188 | val_loss: 0.0311912 | Time: 5484.95 ms [2022-04-07 21:58:29 main:574] : INFO : Epoch 1879 | loss: 0.0311886 | val_loss: 0.0311944 | Time: 5547.47 ms [2022-04-07 21:58:35 main:574] : INFO : Epoch 1880 | loss: 0.0311894 | val_loss: 0.0311914 | Time: 5469.58 ms [2022-04-07 21:58:41 main:574] : INFO : Epoch 1881 | loss: 0.0311884 | val_loss: 0.0311919 | Time: 5531.5 ms [2022-04-07 21:58:46 main:574] : INFO : Epoch 1882 | loss: 0.0311879 | val_loss: 0.0311963 | Time: 5482.27 ms [2022-04-07 21:58:52 main:574] : INFO : Epoch 1883 | loss: 0.0311891 | val_loss: 0.0311929 | Time: 5408.31 ms [2022-04-07 21:58:57 main:574] : INFO : Epoch 1884 | loss: 0.0311884 | val_loss: 0.0311971 | Time: 5443.66 ms [2022-04-07 21:59:03 main:574] : INFO : Epoch 1885 | loss: 0.0311927 | val_loss: 0.0312108 | Time: 5483.2 ms [2022-04-07 21:59:08 main:574] : INFO : Epoch 1886 | loss: 0.0311944 | val_loss: 0.0311999 | Time: 5453.74 ms [2022-04-07 21:59:14 main:574] : INFO : Epoch 1887 | loss: 0.03119 | val_loss: 0.0311966 | Time: 5495.93 ms [2022-04-07 21:59:20 main:574] : INFO : Epoch 1888 | loss: 0.0311903 | val_loss: 0.0311931 | Time: 5448.87 ms [2022-04-07 21:59:25 main:574] : INFO : Epoch 1889 | loss: 0.0311921 | val_loss: 0.0311916 | Time: 5475.12 ms [2022-04-07 21:59:31 main:574] : INFO : Epoch 1890 | loss: 0.0311919 | val_loss: 0.03119 | Time: 5526.54 ms [2022-04-07 21:59:37 main:574] : INFO : Epoch 1891 | loss: 0.0311885 | val_loss: 0.0311939 | Time: 5469.96 ms [2022-04-07 21:59:42 main:574] : INFO : Epoch 1892 | loss: 0.0311881 | val_loss: 0.0311894 | Time: 5459.83 ms [2022-04-07 21:59:48 main:574] : INFO : Epoch 1893 | loss: 0.0311869 | val_loss: 0.0311901 | Time: 5431.94 ms [2022-04-07 21:59:55 main:574] : INFO : Epoch 1894 | loss: 0.0311867 | val_loss: 0.0311922 | Time: 5415.32 ms [2022-04-07 22:00:02 main:574] : INFO : Epoch 1895 | loss: 0.0311899 | val_loss: 0.0311883 | Time: 5522.2 ms [2022-04-07 22:00:08 main:574] : INFO : Epoch 1896 | loss: 0.0311892 | val_loss: 0.0311857 | Time: 5450.35 ms [2022-04-07 22:00:13 main:574] : INFO : Epoch 1897 | loss: 0.0311894 | val_loss: 0.0312059 | Time: 5463.62 ms [2022-04-07 22:00:19 main:574] : INFO : Epoch 1898 | loss: 0.0311912 | val_loss: 0.0311933 | Time: 5476.89 ms [2022-04-07 22:00:25 main:574] : INFO : Epoch 1899 | loss: 0.0311882 | val_loss: 0.0311908 | Time: 5423.45 ms [2022-04-07 22:00:30 main:574] : INFO : Epoch 1900 | loss: 0.031189 | val_loss: 0.0311906 | Time: 5565.27 ms [2022-04-07 22:00:36 main:574] : INFO : Epoch 1901 | loss: 0.0311878 | val_loss: 0.0311901 | Time: 5479.67 ms [2022-04-07 22:00:41 main:574] : INFO : Epoch 1902 | loss: 0.0311867 | val_loss: 0.0311879 | Time: 5447.62 ms [2022-04-07 22:00:47 main:574] : INFO : Epoch 1903 | loss: 0.0311883 | val_loss: 0.0311893 | Time: 5527.39 ms [2022-04-07 22:00:53 main:574] : INFO : Epoch 1904 | loss: 0.0311867 | val_loss: 0.0311909 | Time: 5429.34 ms [2022-04-07 22:00:59 main:574] : INFO : Epoch 1905 | loss: 0.0311866 | val_loss: 0.031189 | Time: 5441.24 ms [2022-04-07 22:01:05 main:574] : INFO : Epoch 1906 | loss: 0.0311855 | val_loss: 0.03119 | Time: 5476.06 ms [2022-04-07 22:01:10 main:574] : INFO : Epoch 1907 | loss: 0.0311867 | val_loss: 0.0311934 | Time: 5514.68 ms [2022-04-07 22:01:16 main:574] : INFO : Epoch 1908 | loss: 0.03119 | val_loss: 0.0311914 | Time: 5468.4 ms [2022-04-07 22:01:23 main:574] : INFO : Epoch 1909 | loss: 0.0311963 | val_loss: 0.0311893 | Time: 5465.82 ms [2022-04-07 22:01:28 main:574] : INFO : Epoch 1910 | loss: 0.0311867 | val_loss: 0.0311997 | Time: 5422.69 ms [2022-04-07 22:01:34 main:574] : INFO : Epoch 1911 | loss: 0.0311883 | val_loss: 0.031189 | Time: 5478.2 ms [2022-04-07 22:01:39 main:574] : INFO : Epoch 1912 | loss: 0.0311859 | val_loss: 0.0311909 | Time: 5478.23 ms [2022-04-07 22:01:45 main:574] : INFO : Epoch 1913 | loss: 0.031187 | val_loss: 0.0311889 | Time: 5487.76 ms [2022-04-07 22:01:50 main:574] : INFO : Epoch 1914 | loss: 0.0311881 | val_loss: 0.0311897 | Time: 5492.62 ms [2022-04-07 22:01:56 main:574] : INFO : Epoch 1915 | loss: 0.0311868 | val_loss: 0.0311905 | Time: 5417.22 ms [2022-04-07 22:02:01 main:574] : INFO : Epoch 1916 | loss: 0.0311873 | val_loss: 0.0311913 | Time: 5443.39 ms [2022-04-07 22:02:07 main:574] : INFO : Epoch 1917 | loss: 0.0311872 | val_loss: 0.0311885 | Time: 5517.14 ms [2022-04-07 22:02:12 main:574] : INFO : Epoch 1918 | loss: 0.0311853 | val_loss: 0.0311915 | Time: 5424.43 ms [2022-04-07 22:02:18 main:574] : INFO : Epoch 1919 | loss: 0.031185 | val_loss: 0.0311881 | Time: 5506.36 ms [2022-04-07 22:02:24 main:574] : INFO : Epoch 1920 | loss: 0.0311857 | val_loss: 0.0311842 | Time: 5465.6 ms [2022-04-07 22:02:29 main:574] : INFO : Epoch 1921 | loss: 0.0311853 | val_loss: 0.0311915 | Time: 5436.45 ms [2022-04-07 22:02:35 main:574] : INFO : Epoch 1922 | loss: 0.0311855 | val_loss: 0.0311899 | Time: 5474.05 ms [2022-04-07 22:02:40 main:574] : INFO : Epoch 1923 | loss: 0.0311864 | val_loss: 0.0311898 | Time: 5446.53 ms [2022-04-07 22:02:46 main:574] : INFO : Epoch 1924 | loss: 0.0311868 | val_loss: 0.031191 | Time: 5503.84 ms [2022-04-07 22:02:51 main:574] : INFO : Epoch 1925 | loss: 0.0311879 | val_loss: 0.031188 | Time: 5554.88 ms [2022-04-07 22:02:57 main:574] : INFO : Epoch 1926 | loss: 0.0311868 | val_loss: 0.0311903 | Time: 5484.05 ms [2022-04-07 22:03:03 main:574] : INFO : Epoch 1927 | loss: 0.0311848 | val_loss: 0.0311884 | Time: 5500.99 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050 Ti) [2022-04-07 22:07:33 main:435] : INFO : Set logging level to 1 [2022-04-07 22:07:33 main:441] : INFO : Running in BOINC Client mode [2022-04-07 22:07:33 main:444] : INFO : Resolving all filenames [2022-04-07 22:07:33 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-07 22:07:33 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-07 22:07:33 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-07 22:07:33 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-07 22:07:33 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-07 22:07:33 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-07 22:07:33 main:474] : INFO : Configuration: [2022-04-07 22:07:33 main:475] : INFO : Model type: GRU [2022-04-07 22:07:33 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-07 22:07:33 main:477] : INFO : Max Epochs: 2048 [2022-04-07 22:07:33 main:478] : INFO : Batch Size: 128 [2022-04-07 22:07:33 main:479] : INFO : Learning Rate: 0.01 [2022-04-07 22:07:33 main:480] : INFO : Patience: 10 [2022-04-07 22:07:33 main:481] : INFO : Hidden Width: 12 [2022-04-07 22:07:33 main:482] : INFO : # Recurrent Layers: 4 [2022-04-07 22:07:33 main:483] : INFO : # Backend Layers: 4 [2022-04-07 22:07:33 main:484] : INFO : # Threads: 1 [2022-04-07 22:07:33 main:486] : INFO : Preparing Dataset [2022-04-07 22:07:33 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-07 22:07:34 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-07 22:07:35 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-07 22:07:35 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-07 22:07:35 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-07 22:07:35 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-07 22:07:35 main:494] : INFO : Creating Model [2022-04-07 22:07:35 main:507] : INFO : Preparing config file [2022-04-07 22:07:35 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-07 22:07:35 main:512] : INFO : Loading config [2022-04-07 22:07:35 main:514] : INFO : Loading state [2022-04-07 22:07:36 main:559] : INFO : Loading DataLoader into Memory [2022-04-07 22:07:36 main:562] : INFO : Starting Training [2022-04-07 22:07:42 main:574] : INFO : Epoch 1926 | loss: 0.0319945 | val_loss: 0.031395 | Time: 5897.93 ms [2022-04-07 22:07:48 main:574] : INFO : Epoch 1927 | loss: 0.0312544 | val_loss: 0.0312058 | Time: 5729.92 ms [2022-04-07 22:07:54 main:574] : INFO : Epoch 1928 | loss: 0.031193 | val_loss: 0.0311836 | Time: 5664.37 ms [2022-04-07 22:08:00 main:574] : INFO : Epoch 1929 | loss: 0.0311789 | val_loss: 0.031179 | Time: 5691.9 ms [2022-04-07 22:08:05 main:574] : INFO : Epoch 1930 | loss: 0.0311756 | val_loss: 0.0311767 | Time: 5631.86 ms [2022-04-07 22:08:12 main:574] : INFO : Epoch 1931 | loss: 0.0311734 | val_loss: 0.0311774 | Time: 5711.79 ms [2022-04-07 22:08:18 main:574] : INFO : Epoch 1932 | loss: 0.0311725 | val_loss: 0.0311765 | Time: 5526.1 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050 Ti) [2022-04-07 23:23:06 main:435] : INFO : Set logging level to 1 [2022-04-07 23:23:06 main:441] : INFO : Running in BOINC Client mode [2022-04-07 23:23:06 main:444] : INFO : Resolving all filenames [2022-04-07 23:23:06 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-07 23:23:06 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-07 23:23:06 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-07 23:23:06 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-07 23:23:06 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-07 23:23:06 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-07 23:23:06 main:474] : INFO : Configuration: [2022-04-07 23:23:06 main:475] : INFO : Model type: GRU [2022-04-07 23:23:06 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-07 23:23:06 main:477] : INFO : Max Epochs: 2048 [2022-04-07 23:23:06 main:478] : INFO : Batch Size: 128 [2022-04-07 23:23:06 main:479] : INFO : Learning Rate: 0.01 [2022-04-07 23:23:06 main:480] : INFO : Patience: 10 [2022-04-07 23:23:06 main:481] : INFO : Hidden Width: 12 [2022-04-07 23:23:06 main:482] : INFO : # Recurrent Layers: 4 [2022-04-07 23:23:06 main:483] : INFO : # Backend Layers: 4 [2022-04-07 23:23:06 main:484] : INFO : # Threads: 1 [2022-04-07 23:23:06 main:486] : INFO : Preparing Dataset [2022-04-07 23:23:06 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-07 23:23:07 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-07 23:23:08 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-07 23:23:08 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-07 23:23:08 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-07 23:23:08 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-07 23:23:08 main:494] : INFO : Creating Model [2022-04-07 23:23:08 main:507] : INFO : Preparing config file [2022-04-07 23:23:08 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-07 23:23:08 main:512] : INFO : Loading config [2022-04-07 23:23:08 main:514] : INFO : Loading state [2022-04-07 23:23:09 main:559] : INFO : Loading DataLoader into Memory [2022-04-07 23:23:09 main:562] : INFO : Starting Training [2022-04-07 23:23:15 main:574] : INFO : Epoch 1926 | loss: 0.0317357 | val_loss: 0.03132 | Time: 5940.1 ms [2022-04-07 23:23:21 main:574] : INFO : Epoch 1927 | loss: 0.0312798 | val_loss: 0.0312532 | Time: 5791.66 ms [2022-04-07 23:23:27 main:574] : INFO : Epoch 1928 | loss: 0.0312473 | val_loss: 0.0312405 | Time: 5782.33 ms [2022-04-07 23:23:33 main:574] : INFO : Epoch 1929 | loss: 0.0312294 | val_loss: 0.0312187 | Time: 5679.12 ms [2022-04-07 23:23:39 main:574] : INFO : Epoch 1930 | loss: 0.031207 | val_loss: 0.031192 | Time: 5760.5 ms [2022-04-07 23:23:45 main:574] : INFO : Epoch 1931 | loss: 0.0311856 | val_loss: 0.0311802 | Time: 5672.8 ms [2022-04-07 23:23:51 main:574] : INFO : Epoch 1932 | loss: 0.0311803 | val_loss: 0.0311796 | Time: 5758.84 ms [2022-04-07 23:23:56 main:574] : INFO : Epoch 1933 | loss: 0.0311761 | val_loss: 0.0311803 | Time: 5742.04 ms [2022-04-07 23:24:02 main:574] : INFO : Epoch 1934 | loss: 0.0311744 | val_loss: 0.0311784 | Time: 5724.04 ms [2022-04-07 23:24:08 main:574] : INFO : Epoch 1935 | loss: 0.0311727 | val_loss: 0.0311777 | Time: 5810.01 ms [2022-04-07 23:24:14 main:574] : INFO : Epoch 1936 | loss: 0.031172 | val_loss: 0.0311789 | Time: 5738.74 ms [2022-04-07 23:24:20 main:574] : INFO : Epoch 1937 | loss: 0.0311695 | val_loss: 0.0311784 | Time: 5807.73 ms [2022-04-07 23:24:26 main:574] : INFO : Epoch 1938 | loss: 0.0311703 | val_loss: 0.0311798 | Time: 5707.67 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050 Ti) [2022-04-07 23:42:19 main:435] : INFO : Set logging level to 1 [2022-04-07 23:42:19 main:441] : INFO : Running in BOINC Client mode [2022-04-07 23:42:19 main:444] : INFO : Resolving all filenames [2022-04-07 23:42:19 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-07 23:42:19 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-07 23:42:19 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-07 23:42:19 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-07 23:42:19 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-07 23:42:19 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-07 23:42:19 main:474] : INFO : Configuration: [2022-04-07 23:42:20 main:475] : INFO : Model type: GRU [2022-04-07 23:42:20 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-07 23:42:20 main:477] : INFO : Max Epochs: 2048 [2022-04-07 23:42:20 main:478] : INFO : Batch Size: 128 [2022-04-07 23:42:20 main:479] : INFO : Learning Rate: 0.01 [2022-04-07 23:42:20 main:480] : INFO : Patience: 10 [2022-04-07 23:42:20 main:481] : INFO : Hidden Width: 12 [2022-04-07 23:42:20 main:482] : INFO : # Recurrent Layers: 4 [2022-04-07 23:42:20 main:483] : INFO : # Backend Layers: 4 [2022-04-07 23:42:20 main:484] : INFO : # Threads: 1 [2022-04-07 23:42:20 main:486] : INFO : Preparing Dataset [2022-04-07 23:42:20 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-07 23:42:20 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-07 23:42:21 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-07 23:42:22 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-07 23:42:22 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-07 23:42:22 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-07 23:42:22 main:494] : INFO : Creating Model [2022-04-07 23:42:22 main:507] : INFO : Preparing config file [2022-04-07 23:42:22 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-07 23:42:22 main:512] : INFO : Loading config [2022-04-07 23:42:22 main:514] : INFO : Loading state [2022-04-07 23:42:22 main:559] : INFO : Loading DataLoader into Memory [2022-04-07 23:42:23 main:562] : INFO : Starting Training [2022-04-07 23:42:28 main:574] : INFO : Epoch 1926 | loss: 0.0321921 | val_loss: 0.031399 | Time: 5707.3 ms [2022-04-07 23:42:35 main:574] : INFO : Epoch 1927 | loss: 0.0313039 | val_loss: 0.0312427 | Time: 5549.8 ms [2022-04-07 23:42:41 main:574] : INFO : Epoch 1928 | loss: 0.031238 | val_loss: 0.0312273 | Time: 5512.65 ms [2022-04-07 23:42:47 main:574] : INFO : Epoch 1929 | loss: 0.0312114 | val_loss: 0.0311988 | Time: 5578.73 ms [2022-04-07 23:42:53 main:574] : INFO : Epoch 1930 | loss: 0.0311911 | val_loss: 0.031186 | Time: 5495.78 ms [2022-04-07 23:42:58 main:574] : INFO : Epoch 1931 | loss: 0.0311843 | val_loss: 0.0311836 | Time: 5517.94 ms [2022-04-07 23:43:04 main:574] : INFO : Epoch 1932 | loss: 0.0311791 | val_loss: 0.0311802 | Time: 5557.52 ms [2022-04-07 23:43:10 main:574] : INFO : Epoch 1933 | loss: 0.0311762 | val_loss: 0.0311801 | Time: 5499.79 ms [2022-04-07 23:43:16 main:574] : INFO : Epoch 1934 | loss: 0.0311756 | val_loss: 0.0311792 | Time: 5467.36 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050 Ti) [2022-04-07 23:46:18 main:435] : INFO : Set logging level to 1 [2022-04-07 23:46:18 main:441] : INFO : Running in BOINC Client mode [2022-04-07 23:46:18 main:444] : INFO : Resolving all filenames [2022-04-07 23:46:18 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-07 23:46:18 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-07 23:46:18 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-07 23:46:18 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-07 23:46:18 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-07 23:46:18 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-07 23:46:18 main:474] : INFO : Configuration: [2022-04-07 23:46:18 main:475] : INFO : Model type: GRU [2022-04-07 23:46:18 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-07 23:46:18 main:477] : INFO : Max Epochs: 2048 [2022-04-07 23:46:18 main:478] : INFO : Batch Size: 128 [2022-04-07 23:46:18 main:479] : INFO : Learning Rate: 0.01 [2022-04-07 23:46:18 main:480] : INFO : Patience: 10 [2022-04-07 23:46:18 main:481] : INFO : Hidden Width: 12 [2022-04-07 23:46:18 main:482] : INFO : # Recurrent Layers: 4 [2022-04-07 23:46:18 main:483] : INFO : # Backend Layers: 4 [2022-04-07 23:46:18 main:484] : INFO : # Threads: 1 [2022-04-07 23:46:18 main:486] : INFO : Preparing Dataset [2022-04-07 23:46:18 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-07 23:46:19 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-07 23:46:20 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-07 23:46:20 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-07 23:46:20 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-07 23:46:20 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-07 23:46:20 main:494] : INFO : Creating Model [2022-04-07 23:46:20 main:507] : INFO : Preparing config file [2022-04-07 23:46:20 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-07 23:46:21 main:512] : INFO : Loading config [2022-04-07 23:46:21 main:514] : INFO : Loading state [2022-04-07 23:46:21 main:559] : INFO : Loading DataLoader into Memory [2022-04-07 23:46:21 main:562] : INFO : Starting Training [2022-04-07 23:46:27 main:574] : INFO : Epoch 1926 | loss: 0.032163 | val_loss: 0.0314554 | Time: 5705.44 ms [2022-04-07 23:46:33 main:574] : INFO : Epoch 1927 | loss: 0.0313101 | val_loss: 0.0312426 | Time: 5511.75 ms [2022-04-07 23:46:39 main:574] : INFO : Epoch 1928 | loss: 0.0312351 | val_loss: 0.0312241 | Time: 5510.5 ms [2022-04-07 23:46:45 main:574] : INFO : Epoch 1929 | loss: 0.0312112 | val_loss: 0.0311976 | Time: 5524.79 ms [2022-04-07 23:46:50 main:574] : INFO : Epoch 1930 | loss: 0.0311893 | val_loss: 0.0311838 | Time: 5448.89 ms [2022-04-07 23:46:56 main:574] : INFO : Epoch 1931 | loss: 0.0311817 | val_loss: 0.0311833 | Time: 5500.89 ms [2022-04-07 23:47:02 main:574] : INFO : Epoch 1932 | loss: 0.0311802 | val_loss: 0.0311815 | Time: 5515.4 ms [2022-04-07 23:47:08 main:574] : INFO : Epoch 1933 | loss: 0.031176 | val_loss: 0.0311776 | Time: 5567.18 ms [2022-04-07 23:47:13 main:574] : INFO : Epoch 1934 | loss: 0.0311747 | val_loss: 0.0311764 | Time: 5469.99 ms [2022-04-07 23:47:19 main:574] : INFO : Epoch 1935 | loss: 0.031178 | val_loss: 0.0311778 | Time: 5521.74 ms [2022-04-07 23:47:25 main:574] : INFO : Epoch 1936 | loss: 0.0311757 | val_loss: 0.0311821 | Time: 5643.94 ms [2022-04-07 23:47:30 main:574] : INFO : Epoch 1937 | loss: 0.0311741 | val_loss: 0.0311811 | Time: 5547.94 ms [2022-04-07 23:47:36 main:574] : INFO : Epoch 1938 | loss: 0.0311708 | val_loss: 0.0311782 | Time: 5471.86 ms [2022-04-07 23:47:41 main:574] : INFO : Epoch 1939 | loss: 0.0311684 | val_loss: 0.0311763 | Time: 5462.56 ms [2022-04-07 23:47:47 main:574] : INFO : Epoch 1940 | loss: 0.0311671 | val_loss: 0.0311756 | Time: 5594.82 ms [2022-04-07 23:47:53 main:574] : INFO : Epoch 1941 | loss: 0.0311669 | val_loss: 0.0311743 | Time: 5487.82 ms [2022-04-07 23:47:59 main:574] : INFO : Epoch 1942 | loss: 0.0311669 | val_loss: 0.0311741 | Time: 5513.42 ms [2022-04-07 23:48:04 main:574] : INFO : Epoch 1943 | loss: 0.0311664 | val_loss: 0.0311732 | Time: 5577.38 ms [2022-04-07 23:48:11 main:574] : INFO : Epoch 1944 | loss: 0.0311673 | val_loss: 0.0311803 | Time: 5493.44 ms [2022-04-07 23:48:17 main:574] : INFO : Epoch 1945 | loss: 0.0311681 | val_loss: 0.0311746 | Time: 5580.93 ms [2022-04-07 23:48:23 main:574] : INFO : Epoch 1946 | loss: 0.0311654 | val_loss: 0.031175 | Time: 5568.88 ms [2022-04-07 23:48:29 main:574] : INFO : Epoch 1947 | loss: 0.0311662 | val_loss: 0.0311735 | Time: 5517.4 ms [2022-04-07 23:48:35 main:574] : INFO : Epoch 1948 | loss: 0.0311671 | val_loss: 0.031175 | Time: 5323.13 ms [2022-04-07 23:48:41 main:574] : INFO : Epoch 1949 | loss: 0.0311679 | val_loss: 0.0311757 | Time: 5334.64 ms [2022-04-07 23:48:46 main:574] : INFO : Epoch 1950 | loss: 0.0311685 | val_loss: 0.0311763 | Time: 5269.61 ms [2022-04-07 23:48:52 main:574] : INFO : Epoch 1951 | loss: 0.0311669 | val_loss: 0.0311767 | Time: 5260.86 ms [2022-04-07 23:48:58 main:574] : INFO : Epoch 1952 | loss: 0.0311653 | val_loss: 0.0311738 | Time: 5282.97 ms [2022-04-07 23:49:03 main:574] : INFO : Epoch 1953 | loss: 0.0311653 | val_loss: 0.0311739 | Time: 5341.92 ms [2022-04-07 23:49:09 main:574] : INFO : Epoch 1954 | loss: 0.031165 | val_loss: 0.0311733 | Time: 5363.44 ms [2022-04-07 23:49:14 main:574] : INFO : Epoch 1955 | loss: 0.0311658 | val_loss: 0.0311744 | Time: 5348.75 ms [2022-04-07 23:49:20 main:574] : INFO : Epoch 1956 | loss: 0.0311713 | val_loss: 0.031176 | Time: 5315.18 ms [2022-04-07 23:49:25 main:574] : INFO : Epoch 1957 | loss: 0.0311694 | val_loss: 0.0311746 | Time: 5453.9 ms [2022-04-07 23:49:31 main:574] : INFO : Epoch 1958 | loss: 0.0311674 | val_loss: 0.0311764 | Time: 5238.95 ms [2022-04-07 23:49:37 main:574] : INFO : Epoch 1959 | loss: 0.0311654 | val_loss: 0.031175 | Time: 5388.57 ms [2022-04-07 23:49:42 main:574] : INFO : Epoch 1960 | loss: 0.0311645 | val_loss: 0.031172 | Time: 5279.64 ms [2022-04-07 23:49:48 main:574] : INFO : Epoch 1961 | loss: 0.0311616 | val_loss: 0.0311724 | Time: 5341.81 ms [2022-04-07 23:49:54 main:574] : INFO : Epoch 1962 | loss: 0.0311628 | val_loss: 0.0311704 | Time: 5349.47 ms [2022-04-07 23:50:00 main:574] : INFO : Epoch 1963 | loss: 0.0311632 | val_loss: 0.0311708 | Time: 5280.77 ms [2022-04-07 23:50:05 main:574] : INFO : Epoch 1964 | loss: 0.0311636 | val_loss: 0.0311697 | Time: 5355.75 ms [2022-04-07 23:50:11 main:574] : INFO : Epoch 1965 | loss: 0.0311632 | val_loss: 0.0311696 | Time: 5338.17 ms [2022-04-07 23:50:17 main:574] : INFO : Epoch 1966 | loss: 0.031162 | val_loss: 0.031168 | Time: 5310.63 ms [2022-04-07 23:50:22 main:574] : INFO : Epoch 1967 | loss: 0.0311635 | val_loss: 0.031166 | Time: 5296.57 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050 Ti) [2022-04-08 00:09:02 main:435] : INFO : Set logging level to 1 [2022-04-08 00:09:02 main:441] : INFO : Running in BOINC Client mode [2022-04-08 00:09:02 main:444] : INFO : Resolving all filenames [2022-04-08 00:09:02 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-08 00:09:02 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-08 00:09:02 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-08 00:09:02 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-08 00:09:02 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-08 00:09:02 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-08 00:09:02 main:474] : INFO : Configuration: [2022-04-08 00:09:02 main:475] : INFO : Model type: GRU [2022-04-08 00:09:02 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-08 00:09:02 main:477] : INFO : Max Epochs: 2048 [2022-04-08 00:09:02 main:478] : INFO : Batch Size: 128 [2022-04-08 00:09:02 main:479] : INFO : Learning Rate: 0.01 [2022-04-08 00:09:02 main:480] : INFO : Patience: 10 [2022-04-08 00:09:02 main:481] : INFO : Hidden Width: 12 [2022-04-08 00:09:02 main:482] : INFO : # Recurrent Layers: 4 [2022-04-08 00:09:02 main:483] : INFO : # Backend Layers: 4 [2022-04-08 00:09:03 main:484] : INFO : # Threads: 1 [2022-04-08 00:09:03 main:486] : INFO : Preparing Dataset [2022-04-08 00:09:03 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-08 00:09:03 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-08 00:09:04 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-08 00:09:04 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-08 00:09:04 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-08 00:09:05 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-08 00:09:05 main:494] : INFO : Creating Model [2022-04-08 00:09:05 main:507] : INFO : Preparing config file [2022-04-08 00:09:05 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-08 00:09:05 main:512] : INFO : Loading config [2022-04-08 00:09:05 main:514] : INFO : Loading state [2022-04-08 00:09:05 main:559] : INFO : Loading DataLoader into Memory [2022-04-08 00:09:05 main:562] : INFO : Starting Training [2022-04-08 00:09:11 main:574] : INFO : Epoch 1960 | loss: 0.0315893 | val_loss: 0.0313948 | Time: 5727.49 ms [2022-04-08 00:09:17 main:574] : INFO : Epoch 1961 | loss: 0.0312694 | val_loss: 0.0312138 | Time: 5573.56 ms [2022-04-08 00:09:23 main:574] : INFO : Epoch 1962 | loss: 0.0311873 | val_loss: 0.0311751 | Time: 5632.06 ms [2022-04-08 00:09:29 main:574] : INFO : Epoch 1963 | loss: 0.031165 | val_loss: 0.031173 | Time: 5655.6 ms [2022-04-08 00:09:34 main:574] : INFO : Epoch 1964 | loss: 0.0311632 | val_loss: 0.0311688 | Time: 5636.77 ms [2022-04-08 00:09:40 main:574] : INFO : Epoch 1965 | loss: 0.0311616 | val_loss: 0.0311669 | Time: 5647.6 ms [2022-04-08 00:09:46 main:574] : INFO : Epoch 1966 | loss: 0.0311604 | val_loss: 0.0311713 | Time: 5643.49 ms [2022-04-08 00:09:52 main:574] : INFO : Epoch 1967 | loss: 0.0311593 | val_loss: 0.031168 | Time: 5574.59 ms [2022-04-08 00:09:57 main:574] : INFO : Epoch 1968 | loss: 0.0311581 | val_loss: 0.0311683 | Time: 5629.68 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050 Ti) [2022-04-08 00:15:15 main:435] : INFO : Set logging level to 1 [2022-04-08 00:15:15 main:441] : INFO : Running in BOINC Client mode [2022-04-08 00:15:15 main:444] : INFO : Resolving all filenames [2022-04-08 00:15:15 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-08 00:15:15 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-08 00:15:15 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-08 00:15:15 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-08 00:15:15 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-08 00:15:15 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-08 00:15:15 main:474] : INFO : Configuration: [2022-04-08 00:15:15 main:475] : INFO : Model type: GRU [2022-04-08 00:15:15 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-08 00:15:15 main:477] : INFO : Max Epochs: 2048 [2022-04-08 00:15:15 main:478] : INFO : Batch Size: 128 [2022-04-08 00:15:15 main:479] : INFO : Learning Rate: 0.01 [2022-04-08 00:15:15 main:480] : INFO : Patience: 10 [2022-04-08 00:15:15 main:481] : INFO : Hidden Width: 12 [2022-04-08 00:15:15 main:482] : INFO : # Recurrent Layers: 4 [2022-04-08 00:15:15 main:483] : INFO : # Backend Layers: 4 [2022-04-08 00:15:15 main:484] : INFO : # Threads: 1 [2022-04-08 00:15:15 main:486] : INFO : Preparing Dataset [2022-04-08 00:15:15 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-08 00:15:15 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-08 00:15:17 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-08 00:15:17 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-08 00:15:17 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-08 00:15:17 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-08 00:15:17 main:494] : INFO : Creating Model [2022-04-08 00:15:17 main:507] : INFO : Preparing config file [2022-04-08 00:15:17 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-08 00:15:17 main:512] : INFO : Loading config [2022-04-08 00:15:17 main:514] : INFO : Loading state Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050 Ti) [2022-04-08 00:33:25 main:435] : INFO : Set logging level to 1 [2022-04-08 00:33:25 main:441] : INFO : Running in BOINC Client mode [2022-04-08 00:33:25 main:444] : INFO : Resolving all filenames [2022-04-08 00:33:25 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-08 00:33:25 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-08 00:33:25 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-08 00:33:25 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-08 00:33:25 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-08 00:33:25 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-08 00:33:25 main:474] : INFO : Configuration: [2022-04-08 00:33:25 main:475] : INFO : Model type: GRU [2022-04-08 00:33:25 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-08 00:33:25 main:477] : INFO : Max Epochs: 2048 [2022-04-08 00:33:25 main:478] : INFO : Batch Size: 128 [2022-04-08 00:33:25 main:479] : INFO : Learning Rate: 0.01 [2022-04-08 00:33:25 main:480] : INFO : Patience: 10 [2022-04-08 00:33:25 main:481] : INFO : Hidden Width: 12 [2022-04-08 00:33:25 main:482] : INFO : # Recurrent Layers: 4 [2022-04-08 00:33:25 main:483] : INFO : # Backend Layers: 4 [2022-04-08 00:33:25 main:484] : INFO : # Threads: 1 [2022-04-08 00:33:25 main:486] : INFO : Preparing Dataset [2022-04-08 00:33:25 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-08 00:33:25 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-08 00:33:27 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-08 00:33:27 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-08 00:33:27 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-08 00:33:27 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-08 00:33:27 main:494] : INFO : Creating Model [2022-04-08 00:33:27 main:507] : INFO : Preparing config file [2022-04-08 00:33:27 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-08 00:33:27 main:512] : INFO : Loading config [2022-04-08 00:33:27 main:514] : INFO : Loading state [2022-04-08 00:33:28 main:559] : INFO : Loading DataLoader into Memory [2022-04-08 00:33:28 main:562] : INFO : Starting Training [2022-04-08 00:33:34 main:574] : INFO : Epoch 1960 | loss: 0.0315567 | val_loss: 0.0313714 | Time: 5791.38 ms [2022-04-08 00:33:40 main:574] : INFO : Epoch 1961 | loss: 0.0312712 | val_loss: 0.0312229 | Time: 5605.94 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050 Ti) [2022-04-09 13:45:32 main:435] : INFO : Set logging level to 1 [2022-04-09 13:45:32 main:441] : INFO : Running in BOINC Client mode [2022-04-09 13:45:32 main:444] : INFO : Resolving all filenames [2022-04-09 13:45:32 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-09 13:45:32 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-09 13:45:32 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-09 13:45:32 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-09 13:45:32 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-09 13:45:32 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-09 13:45:32 main:474] : INFO : Configuration: [2022-04-09 13:45:32 main:475] : INFO : Model type: GRU [2022-04-09 13:45:32 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-09 13:45:32 main:477] : INFO : Max Epochs: 2048 [2022-04-09 13:45:33 main:478] : INFO : Batch Size: 128 [2022-04-09 13:45:33 main:479] : INFO : Learning Rate: 0.01 [2022-04-09 13:45:33 main:480] : INFO : Patience: 10 [2022-04-09 13:45:33 main:481] : INFO : Hidden Width: 12 [2022-04-09 13:45:33 main:482] : INFO : # Recurrent Layers: 4 [2022-04-09 13:45:33 main:483] : INFO : # Backend Layers: 4 [2022-04-09 13:45:33 main:484] : INFO : # Threads: 1 [2022-04-09 13:45:33 main:486] : INFO : Preparing Dataset [2022-04-09 13:45:33 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-09 13:45:33 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-09 13:45:37 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-09 13:45:37 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-09 13:45:37 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-09 13:45:38 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-09 13:45:38 main:494] : INFO : Creating Model [2022-04-09 13:45:38 main:507] : INFO : Preparing config file [2022-04-09 13:45:38 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-09 13:45:38 main:512] : INFO : Loading config [2022-04-09 13:45:38 main:514] : INFO : Loading state [2022-04-09 13:45:42 main:559] : INFO : Loading DataLoader into Memory [2022-04-09 13:45:42 main:562] : INFO : Starting Training Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050 Ti) [2022-04-09 13:48:50 main:435] : INFO : Set logging level to 1 [2022-04-09 13:48:50 main:441] : INFO : Running in BOINC Client mode [2022-04-09 13:48:50 main:444] : INFO : Resolving all filenames [2022-04-09 13:48:50 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-09 13:48:50 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-09 13:48:50 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-09 13:48:50 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-09 13:48:50 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-09 13:48:50 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-09 13:48:50 main:474] : INFO : Configuration: [2022-04-09 13:48:50 main:475] : INFO : Model type: GRU [2022-04-09 13:48:50 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-09 13:48:50 main:477] : INFO : Max Epochs: 2048 [2022-04-09 13:48:50 main:478] : INFO : Batch Size: 128 [2022-04-09 13:48:51 main:479] : INFO : Learning Rate: 0.01 [2022-04-09 13:48:51 main:480] : INFO : Patience: 10 [2022-04-09 13:48:51 main:481] : INFO : Hidden Width: 12 [2022-04-09 13:48:51 main:482] : INFO : # Recurrent Layers: 4 [2022-04-09 13:48:51 main:483] : INFO : # Backend Layers: 4 [2022-04-09 13:48:51 main:484] : INFO : # Threads: 1 [2022-04-09 13:48:51 main:486] : INFO : Preparing Dataset [2022-04-09 13:48:51 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-09 13:48:51 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-09 13:48:52 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-09 13:48:52 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-09 13:48:52 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-09 13:48:53 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-09 13:48:53 main:494] : INFO : Creating Model [2022-04-09 13:48:53 main:507] : INFO : Preparing config file [2022-04-09 13:48:53 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-09 13:48:53 main:512] : INFO : Loading config [2022-04-09 13:48:53 main:514] : INFO : Loading state [2022-04-09 13:48:53 main:559] : INFO : Loading DataLoader into Memory [2022-04-09 13:48:53 main:562] : INFO : Starting Training [2022-04-09 13:48:59 main:574] : INFO : Epoch 1960 | loss: 0.0314311 | val_loss: 0.0312682 | Time: 5622.45 ms [2022-04-09 13:49:05 main:574] : INFO : Epoch 1961 | loss: 0.0312402 | val_loss: 0.031198 | Time: 5495.19 ms [2022-04-09 13:49:11 main:574] : INFO : Epoch 1962 | loss: 0.0311827 | val_loss: 0.0311798 | Time: 5536.21 ms [2022-04-09 13:49:16 main:574] : INFO : Epoch 1963 | loss: 0.0311711 | val_loss: 0.0311734 | Time: 5468.72 ms [2022-04-09 13:49:22 main:574] : INFO : Epoch 1964 | loss: 0.0311649 | val_loss: 0.0311742 | Time: 5495.96 ms [2022-04-09 13:49:27 main:574] : INFO : Epoch 1965 | loss: 0.0311617 | val_loss: 0.0311718 | Time: 5475.41 ms [2022-04-09 13:49:33 main:574] : INFO : Epoch 1966 | loss: 0.0311606 | val_loss: 0.0311701 | Time: 5479.55 ms [2022-04-09 13:49:38 main:574] : INFO : Epoch 1967 | loss: 0.0311606 | val_loss: 0.0311727 | Time: 5563.95 ms [2022-04-09 13:49:44 main:574] : INFO : Epoch 1968 | loss: 0.03116 | val_loss: 0.0311707 | Time: 5464.23 ms [2022-04-09 13:49:50 main:574] : INFO : Epoch 1969 | loss: 0.0311587 | val_loss: 0.0311693 | Time: 5502.05 ms [2022-04-09 13:49:58 main:574] : INFO : Epoch 1970 | loss: 0.031162 | val_loss: 0.0311784 | Time: 8300.04 ms [2022-04-09 13:50:06 main:574] : INFO : Epoch 1971 | loss: 0.0311607 | val_loss: 0.0311717 | Time: 6998.84 ms [2022-04-09 13:50:12 main:574] : INFO : Epoch 1972 | loss: 0.0311624 | val_loss: 0.0311705 | Time: 6154.77 ms [2022-04-09 13:50:19 main:574] : INFO : Epoch 1973 | loss: 0.0311584 | val_loss: 0.0311709 | Time: 6318.43 ms [2022-04-09 13:50:25 main:574] : INFO : Epoch 1974 | loss: 0.031159 | val_loss: 0.031171 | Time: 6252.43 ms [2022-04-09 13:50:32 main:574] : INFO : Epoch 1975 | loss: 0.0311564 | val_loss: 0.0311735 | Time: 6370.89 ms [2022-04-09 13:50:38 main:574] : INFO : Epoch 1976 | loss: 0.0311549 | val_loss: 0.0311708 | Time: 5944.88 ms [2022-04-09 13:50:44 main:574] : INFO : Epoch 1977 | loss: 0.0311567 | val_loss: 0.0311809 | Time: 5850.55 ms [2022-04-09 13:50:50 main:574] : INFO : Epoch 1978 | loss: 0.0311602 | val_loss: 0.0311694 | Time: 5910.16 ms [2022-04-09 13:50:56 main:574] : INFO : Epoch 1979 | loss: 0.0311594 | val_loss: 0.0311832 | Time: 6140.34 ms [2022-04-09 13:51:02 main:574] : INFO : Epoch 1980 | loss: 0.0311601 | val_loss: 0.0311757 | Time: 5966.67 ms [2022-04-09 13:51:08 main:574] : INFO : Epoch 1981 | loss: 0.0311575 | val_loss: 0.0311714 | Time: 5786.6 ms [2022-04-09 13:51:14 main:574] : INFO : Epoch 1982 | loss: 0.0311592 | val_loss: 0.0311689 | Time: 5763.32 ms [2022-04-09 13:51:21 main:574] : INFO : Epoch 1983 | loss: 0.0311626 | val_loss: 0.0311774 | Time: 5768.27 ms [2022-04-09 13:51:26 main:574] : INFO : Epoch 1984 | loss: 0.0311666 | val_loss: 0.0311752 | Time: 5754.99 ms [2022-04-09 13:51:32 main:574] : INFO : Epoch 1985 | loss: 0.0311644 | val_loss: 0.0311882 | Time: 5728.9 ms [2022-04-09 13:51:39 main:574] : INFO : Epoch 1986 | loss: 0.0311607 | val_loss: 0.0311727 | Time: 5716 ms [2022-04-09 13:51:45 main:574] : INFO : Epoch 1987 | loss: 0.0311598 | val_loss: 0.0311711 | Time: 5716.89 ms [2022-04-09 13:51:51 main:574] : INFO : Epoch 1988 | loss: 0.0311591 | val_loss: 0.0311722 | Time: 5816.73 ms [2022-04-09 13:51:57 main:574] : INFO : Epoch 1989 | loss: 0.0311568 | val_loss: 0.0311662 | Time: 5820.25 ms [2022-04-09 13:52:03 main:574] : INFO : Epoch 1990 | loss: 0.0311559 | val_loss: 0.0311686 | Time: 5767.37 ms [2022-04-09 13:52:09 main:574] : INFO : Epoch 1991 | loss: 0.0311547 | val_loss: 0.0311672 | Time: 5747.1 ms [2022-04-09 13:52:15 main:574] : INFO : Epoch 1992 | loss: 0.0311543 | val_loss: 0.0311668 | Time: 5758.8 ms [2022-04-09 13:52:22 main:574] : INFO : Epoch 1993 | loss: 0.0311546 | val_loss: 0.0311666 | Time: 5739.69 ms [2022-04-09 13:52:28 main:574] : INFO : Epoch 1994 | loss: 0.0311538 | val_loss: 0.0311679 | Time: 5728.12 ms [2022-04-09 13:52:34 main:574] : INFO : Epoch 1995 | loss: 0.031153 | val_loss: 0.0311699 | Time: 5799.12 ms [2022-04-09 13:52:41 main:574] : INFO : Epoch 1996 | loss: 0.0311544 | val_loss: 0.0311697 | Time: 5727.05 ms [2022-04-09 13:52:47 main:574] : INFO : Epoch 1997 | loss: 0.0311537 | val_loss: 0.0311692 | Time: 5807.82 ms [2022-04-09 13:52:53 main:574] : INFO : Epoch 1998 | loss: 0.0311548 | val_loss: 0.0311678 | Time: 5857.65 ms [2022-04-09 13:52:59 main:574] : INFO : Epoch 1999 | loss: 0.0311564 | val_loss: 0.0311669 | Time: 5807.18 ms [2022-04-09 13:53:06 main:574] : INFO : Epoch 2000 | loss: 0.0311531 | val_loss: 0.0311703 | Time: 5727.57 ms [2022-04-09 13:53:13 main:574] : INFO : Epoch 2001 | loss: 0.0311539 | val_loss: 0.0311667 | Time: 5692.97 ms [2022-04-09 13:53:18 main:574] : INFO : Epoch 2002 | loss: 0.0311567 | val_loss: 0.0311701 | Time: 5612.07 ms [2022-04-09 13:53:25 main:574] : INFO : Epoch 2003 | loss: 0.0311564 | val_loss: 0.031166 | Time: 5623.17 ms [2022-04-09 13:53:30 main:574] : INFO : Epoch 2004 | loss: 0.0311548 | val_loss: 0.0311681 | Time: 5668.92 ms [2022-04-09 13:53:36 main:574] : INFO : Epoch 2005 | loss: 0.0311562 | val_loss: 0.0311646 | Time: 5623.26 ms [2022-04-09 13:53:42 main:574] : INFO : Epoch 2006 | loss: 0.0311533 | val_loss: 0.0311631 | Time: 5658.65 ms [2022-04-09 13:53:48 main:574] : INFO : Epoch 2007 | loss: 0.0311536 | val_loss: 0.0311659 | Time: 5709.71 ms [2022-04-09 13:53:53 main:574] : INFO : Epoch 2008 | loss: 0.0311547 | val_loss: 0.0311749 | Time: 5786.38 ms [2022-04-09 13:53:59 main:574] : INFO : Epoch 2009 | loss: 0.0311532 | val_loss: 0.031168 | Time: 5723.62 ms [2022-04-09 13:54:06 main:574] : INFO : Epoch 2010 | loss: 0.0311527 | val_loss: 0.0311675 | Time: 5609.2 ms [2022-04-09 13:54:12 main:574] : INFO : Epoch 2011 | loss: 0.0311538 | val_loss: 0.0311666 | Time: 5609.88 ms [2022-04-09 13:54:18 main:574] : INFO : Epoch 2012 | loss: 0.0311514 | val_loss: 0.0311649 | Time: 5644.19 ms [2022-04-09 13:54:24 main:574] : INFO : Epoch 2013 | loss: 0.0311503 | val_loss: 0.0311666 | Time: 5538.33 ms [2022-04-09 13:54:30 main:574] : INFO : Epoch 2014 | loss: 0.031149 | val_loss: 0.0311637 | Time: 5602.38 ms [2022-04-09 13:54:36 main:574] : INFO : Epoch 2015 | loss: 0.031149 | val_loss: 0.0311635 | Time: 5619.97 ms [2022-04-09 13:54:42 main:574] : INFO : Epoch 2016 | loss: 0.0311488 | val_loss: 0.0311731 | Time: 5666.64 ms [2022-04-09 13:54:49 main:574] : INFO : Epoch 2017 | loss: 0.0311531 | val_loss: 0.0311735 | Time: 5674.4 ms [2022-04-09 13:54:54 main:574] : INFO : Epoch 2018 | loss: 0.0311528 | val_loss: 0.0311629 | Time: 5712.74 ms [2022-04-09 13:55:00 main:574] : INFO : Epoch 2019 | loss: 0.0311564 | val_loss: 0.0311648 | Time: 5663.48 ms [2022-04-09 13:55:06 main:574] : INFO : Epoch 2020 | loss: 0.0311506 | val_loss: 0.0311679 | Time: 5644.71 ms [2022-04-09 13:55:13 main:574] : INFO : Epoch 2021 | loss: 0.0311498 | val_loss: 0.0311622 | Time: 5578.47 ms [2022-04-09 13:55:19 main:574] : INFO : Epoch 2022 | loss: 0.0311507 | val_loss: 0.031165 | Time: 6037.62 ms [2022-04-09 13:55:25 main:574] : INFO : Epoch 2023 | loss: 0.031145 | val_loss: 0.0311593 | Time: 5671.65 ms [2022-04-09 13:55:31 main:574] : INFO : Epoch 2024 | loss: 0.0311444 | val_loss: 0.0311629 | Time: 5665.13 ms [2022-04-09 13:55:37 main:574] : INFO : Epoch 2025 | loss: 0.0311444 | val_loss: 0.0311603 | Time: 5579.74 ms [2022-04-09 13:55:43 main:574] : INFO : Epoch 2026 | loss: 0.0311463 | val_loss: 0.0311614 | Time: 5598.27 ms [2022-04-09 13:55:49 main:574] : INFO : Epoch 2027 | loss: 0.0311466 | val_loss: 0.0311647 | Time: 5626.11 ms [2022-04-09 13:55:55 main:574] : INFO : Epoch 2028 | loss: 0.0311436 | val_loss: 0.0311613 | Time: 5692.91 ms [2022-04-09 13:56:01 main:574] : INFO : Epoch 2029 | loss: 0.0311428 | val_loss: 0.0311628 | Time: 5603.78 ms [2022-04-09 13:56:06 main:574] : INFO : Epoch 2030 | loss: 0.0311445 | val_loss: 0.0311684 | Time: 5616.59 ms [2022-04-09 13:56:12 main:574] : INFO : Epoch 2031 | loss: 0.0311458 | val_loss: 0.0311664 | Time: 5704.66 ms [2022-04-09 13:56:18 main:574] : INFO : Epoch 2032 | loss: 0.0311435 | val_loss: 0.0311636 | Time: 5616.8 ms [2022-04-09 13:56:24 main:574] : INFO : Epoch 2033 | loss: 0.031144 | val_loss: 0.0311759 | Time: 5637.39 ms [2022-04-09 13:56:30 main:574] : INFO : Epoch 2034 | loss: 0.0311463 | val_loss: 0.031163 | Time: 5553.98 ms [2022-04-09 13:56:36 main:574] : INFO : Epoch 2035 | loss: 0.0311426 | val_loss: 0.031165 | Time: 5680.04 ms [2022-04-09 13:56:42 main:574] : INFO : Epoch 2036 | loss: 0.0311415 | val_loss: 0.0311616 | Time: 5580.29 ms [2022-04-09 13:56:48 main:574] : INFO : Epoch 2037 | loss: 0.0311428 | val_loss: 0.0311642 | Time: 5636.83 ms [2022-04-09 13:56:54 main:574] : INFO : Epoch 2038 | loss: 0.0311448 | val_loss: 0.0311622 | Time: 5543.35 ms [2022-04-09 13:57:02 main:574] : INFO : Epoch 2039 | loss: 0.031146 | val_loss: 0.031163 | Time: 5474.87 ms [2022-04-09 13:57:07 main:574] : INFO : Epoch 2040 | loss: 0.0311477 | val_loss: 0.0311648 | Time: 5403.95 ms [2022-04-09 13:57:14 main:574] : INFO : Epoch 2041 | loss: 0.0311485 | val_loss: 0.0311685 | Time: 5464.16 ms [2022-04-09 13:57:20 main:574] : INFO : Epoch 2042 | loss: 0.0311486 | val_loss: 0.0311591 | Time: 5380.79 ms [2022-04-09 13:57:25 main:574] : INFO : Epoch 2043 | loss: 0.0311451 | val_loss: 0.0311626 | Time: 5428.13 ms [2022-04-09 13:57:31 main:574] : INFO : Epoch 2044 | loss: 0.0311463 | val_loss: 0.0311591 | Time: 5442.19 ms [2022-04-09 13:57:36 main:574] : INFO : Epoch 2045 | loss: 0.0311499 | val_loss: 0.0311629 | Time: 5413.63 ms [2022-04-09 13:57:42 main:574] : INFO : Epoch 2046 | loss: 0.0311479 | val_loss: 0.0311606 | Time: 5467.07 ms [2022-04-09 13:57:47 main:574] : INFO : Epoch 2047 | loss: 0.0311454 | val_loss: 0.0311597 | Time: 5389.18 ms [2022-04-09 13:57:53 main:574] : INFO : Epoch 2048 | loss: 0.0311424 | val_loss: 0.0311602 | Time: 5393.21 ms [2022-04-09 13:57:53 main:597] : INFO : Saving trained model to model-final.pt, val_loss 0.0311602 [2022-04-09 13:57:53 main:603] : INFO : Saving end state to config to file [2022-04-09 13:57:53 main:608] : INFO : Success, exiting.. 13:57:53 (13820): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)