Task 9377734
| Name | ParityModified-1636179500-22364-3-0_0 |
| Workunit | 6798745 |
| Created | 3 Dec 2021, 3:30:15 UTC |
| Sent | 5 Dec 2021, 0:36:31 UTC |
| Report deadline | 13 Dec 2021, 0:36:31 UTC |
| Received | 6 Dec 2021, 3:02:34 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 157 |
| Run time | 10 hours 6 min 13 sec |
| CPU time | 6 hours 48 min 21 sec |
| Validate state | Valid |
| Credit | 4,160.00 |
| Device peak FLOPS | 4,474.06 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.62 GB |
| Peak swap size | 3.61 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version> <![CDATA[ <stderr_txt> | Time: 15491.2 ms [2021-12-05 14:43:58 main:574] : INFO : Epoch 1829 | loss: 0.0309476 | val_loss: 0.0311085 | Time: 15115.3 ms [2021-12-05 14:44:13 main:574] : INFO : Epoch 1830 | loss: 0.030949 | val_loss: 0.0311252 | Time: 14700.4 ms [2021-12-05 14:44:29 main:574] : INFO : Epoch 1831 | loss: 0.0309484 | val_loss: 0.0311421 | Time: 15626.7 ms [2021-12-05 14:44:44 main:574] : INFO : Epoch 1832 | loss: 0.0309445 | val_loss: 0.0311039 | Time: 15255.8 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1060 6GB) [2021-12-05 16:37:56 main:435] : INFO : Set logging level to 1 [2021-12-05 16:37:56 main:441] : INFO : Running in BOINC Client mode [2021-12-05 16:37:56 main:444] : INFO : Resolving all filenames [2021-12-05 16:37:56 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2021-12-05 16:37:56 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2021-12-05 16:37:56 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2021-12-05 16:37:56 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2021-12-05 16:37:56 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2021-12-05 16:37:56 main:472] : INFO : Dataset filename: dataset.hdf5 [2021-12-05 16:37:56 main:474] : INFO : Configuration: [2021-12-05 16:37:56 main:475] : INFO : Model type: GRU [2021-12-05 16:37:56 main:476] : INFO : Validation Loss Threshold: 0.0001 [2021-12-05 16:37:56 main:477] : INFO : Max Epochs: 2048 [2021-12-05 16:37:56 main:478] : INFO : Batch Size: 128 [2021-12-05 16:37:56 main:479] : INFO : Learning Rate: 0.01 [2021-12-05 16:37:57 main:480] : INFO : Patience: 10 [2021-12-05 16:37:57 main:481] : INFO : Hidden Width: 12 [2021-12-05 16:37:57 main:482] : INFO : # Recurrent Layers: 4 [2021-12-05 16:37:57 main:483] : INFO : # Backend Layers: 4 [2021-12-05 16:37:57 main:484] : INFO : # Threads: 1 [2021-12-05 16:37:57 main:486] : INFO : Preparing Dataset [2021-12-05 16:37:57 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2021-12-05 16:37:57 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2021-12-05 16:38:01 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2021-12-05 16:38:01 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2021-12-05 16:38:01 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2021-12-05 16:38:01 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2021-12-05 16:38:01 main:494] : INFO : Creating Model [2021-12-05 16:38:01 main:507] : INFO : Preparing config file [2021-12-05 16:38:01 main:511] : INFO : Found checkpoint, attempting to load... [2021-12-05 16:38:01 main:512] : INFO : Loading config [2021-12-05 16:38:01 main:514] : INFO : Loading state [2021-12-05 16:38:04 main:559] : INFO : Loading DataLoader into Memory [2021-12-05 16:38:04 main:562] : INFO : Starting Training [2021-12-05 16:38:21 main:574] : INFO : Epoch 1833 | loss: 0.0309944 | val_loss: 0.0311277 | Time: 15992.4 ms [2021-12-05 16:38:36 main:574] : INFO : Epoch 1834 | loss: 0.0309547 | val_loss: 0.0311282 | Time: 15222.7 ms [2021-12-05 16:38:51 main:574] : INFO : Epoch 1835 | loss: 0.0309509 | val_loss: 0.0311158 | Time: 15090.8 ms [2021-12-05 16:39:07 main:574] : INFO : Epoch 1836 | loss: 0.0309529 | val_loss: 0.0311238 | Time: 15552.5 ms [2021-12-05 16:39:21 main:574] : INFO : Epoch 1837 | loss: 0.0309536 | val_loss: 0.0311011 | Time: 14618.3 ms [2021-12-05 16:39:37 main:574] : INFO : Epoch 1838 | loss: 0.0309868 | val_loss: 0.0311128 | Time: 15565.4 ms [2021-12-05 16:39:52 main:574] : INFO : Epoch 1839 | loss: 0.0309906 | val_loss: 0.0311042 | Time: 14859 ms [2021-12-05 16:40:08 main:574] : INFO : Epoch 1840 | loss: 0.0309828 | val_loss: 0.0311131 | Time: 15634.5 ms [2021-12-05 16:40:23 main:574] : INFO : Epoch 1841 | loss: 0.0309698 | val_loss: 0.0311173 | Time: 15126.7 ms [2021-12-05 16:40:40 main:574] : INFO : Epoch 1842 | loss: 0.0309584 | val_loss: 0.0311117 | Time: 17015.8 ms [2021-12-05 16:40:55 main:574] : INFO : Epoch 1843 | loss: 0.0309551 | val_loss: 0.0311006 | Time: 15210.4 ms [2021-12-05 16:41:11 main:574] : INFO : Epoch 1844 | loss: 0.0309573 | val_loss: 0.0311175 | Time: 15343.9 ms [2021-12-05 16:41:26 main:574] : INFO : Epoch 1845 | loss: 0.0309718 | val_loss: 0.0311161 | Time: 15566.2 ms [2021-12-05 16:41:41 main:574] : INFO : Epoch 1846 | loss: 0.0309565 | val_loss: 0.0310933 | Time: 15075.6 ms [2021-12-05 16:41:57 main:574] : INFO : Epoch 1847 | loss: 0.0309575 | val_loss: 0.0311344 | Time: 15497.2 ms [2021-12-05 16:42:12 main:574] : INFO : Epoch 1848 | loss: 0.0309538 | val_loss: 0.0311022 | Time: 15059.8 ms [2021-12-05 16:42:27 main:574] : INFO : Epoch 1849 | loss: 0.0309511 | val_loss: 0.031117 | Time: 15125 ms [2021-12-05 16:42:43 main:574] : INFO : Epoch 1850 | loss: 0.0309491 | val_loss: 0.031103 | Time: 15257.2 ms [2021-12-05 16:42:58 main:574] : INFO : Epoch 1851 | loss: 0.0310389 | val_loss: 0.0311117 | Time: 15333.5 ms [2021-12-05 16:43:15 main:574] : INFO : Epoch 1852 | loss: 0.0310171 | val_loss: 0.0310909 | Time: 16806.6 ms [2021-12-05 16:43:32 main:574] : INFO : Epoch 1853 | loss: 0.030989 | val_loss: 0.0310983 | Time: 16607.6 ms [2021-12-05 16:43:48 main:574] : INFO : Epoch 1854 | loss: 0.03097 | val_loss: 0.0310969 | Time: 15700.8 ms [2021-12-05 16:44:03 main:574] : INFO : Epoch 1855 | loss: 0.0309761 | val_loss: 0.0310868 | Time: 14944.4 ms [2021-12-05 16:44:18 main:574] : INFO : Epoch 1856 | loss: 0.030977 | val_loss: 0.0311007 | Time: 15463.5 ms [2021-12-05 16:44:33 main:574] : INFO : Epoch 1857 | loss: 0.0309726 | val_loss: 0.031112 | Time: 14941.2 ms [2021-12-05 16:44:49 main:574] : INFO : Epoch 1858 | loss: 0.0309619 | val_loss: 0.031087 | Time: 15590.7 ms [2021-12-05 16:45:04 main:574] : INFO : Epoch 1859 | loss: 0.0309525 | val_loss: 0.0311393 | Time: 15068.3 ms [2021-12-05 16:45:20 main:574] : INFO : Epoch 1860 | loss: 0.0309651 | val_loss: 0.0311012 | Time: 15410.1 ms [2021-12-05 16:45:35 main:574] : INFO : Epoch 1861 | loss: 0.0309717 | val_loss: 0.0310978 | Time: 15255 ms [2021-12-05 16:45:52 main:574] : INFO : Epoch 1862 | loss: 0.0309622 | val_loss: 0.0310968 | Time: 16561.3 ms [2021-12-05 16:46:07 main:574] : INFO : Epoch 1863 | loss: 0.030968 | val_loss: 0.031129 | Time: 15335.5 ms [2021-12-05 16:46:22 main:574] : INFO : Epoch 1864 | loss: 0.0309531 | val_loss: 0.031143 | Time: 15113.9 ms [2021-12-05 16:46:38 main:574] : INFO : Epoch 1865 | loss: 0.0309635 | val_loss: 0.0311113 | Time: 15335.6 ms [2021-12-05 16:46:53 main:574] : INFO : Epoch 1866 | loss: 0.0309573 | val_loss: 0.0311188 | Time: 15214.7 ms [2021-12-05 16:47:08 main:574] : INFO : Epoch 1867 | loss: 0.0309464 | val_loss: 0.031118 | Time: 15285.9 ms [2021-12-05 16:47:24 main:574] : INFO : Epoch 1868 | loss: 0.0309518 | val_loss: 0.0311114 | Time: 15124.5 ms [2021-12-05 16:47:39 main:574] : INFO : Epoch 1869 | loss: 0.0309463 | val_loss: 0.0311163 | Time: 15660.9 ms [2021-12-05 16:47:54 main:574] : INFO : Epoch 1870 | loss: 0.0309507 | val_loss: 0.0311224 | Time: 14859.4 ms [2021-12-05 16:48:10 main:574] : INFO : Epoch 1871 | loss: 0.030956 | val_loss: 0.0311139 | Time: 15349.1 ms [2021-12-05 16:48:25 main:574] : INFO : Epoch 1872 | loss: 0.0309867 | val_loss: 0.0310935 | Time: 15336.4 ms [2021-12-05 16:48:41 main:574] : INFO : Epoch 1873 | loss: 0.0309947 | val_loss: 0.0311064 | Time: 15453.5 ms [2021-12-05 16:48:56 main:574] : INFO : Epoch 1874 | loss: 0.0309889 | val_loss: 0.0310887 | Time: 15198 ms [2021-12-05 16:49:11 main:574] : INFO : Epoch 1875 | loss: 0.0309814 | val_loss: 0.0311088 | Time: 15045.2 ms [2021-12-05 16:49:26 main:574] : INFO : Epoch 1876 | loss: 0.0309752 | val_loss: 0.031096 | Time: 15007.4 ms [2021-12-05 16:49:42 main:574] : INFO : Epoch 1877 | loss: 0.0309651 | val_loss: 0.0311156 | Time: 15310.3 ms [2021-12-05 16:49:57 main:574] : INFO : Epoch 1878 | loss: 0.0309599 | val_loss: 0.0311087 | Time: 15302.6 ms [2021-12-05 16:50:12 main:574] : INFO : Epoch 1879 | loss: 0.0309902 | val_loss: 0.0311167 | Time: 15000.8 ms [2021-12-05 16:50:28 main:574] : INFO : Epoch 1880 | loss: 0.0309921 | val_loss: 0.0311132 | Time: 15889.9 ms [2021-12-05 16:50:43 main:574] : INFO : Epoch 1881 | loss: 0.0309885 | val_loss: 0.0311012 | Time: 14657.7 ms [2021-12-05 16:50:58 main:574] : INFO : Epoch 1882 | loss: 0.0309632 | val_loss: 0.0311048 | Time: 15343.3 ms [2021-12-05 16:51:13 main:574] : INFO : Epoch 1883 | loss: 0.0309651 | val_loss: 0.0311062 | Time: 15124.2 ms [2021-12-05 16:51:29 main:574] : INFO : Epoch 1884 | loss: 0.0309646 | val_loss: 0.0311149 | Time: 15489.2 ms [2021-12-05 16:51:44 main:574] : INFO : Epoch 1885 | loss: 0.0309568 | val_loss: 0.0311017 | Time: 14891.1 ms [2021-12-05 16:51:59 main:574] : INFO : Epoch 1886 | loss: 0.0309611 | val_loss: 0.0311096 | Time: 15392.5 ms [2021-12-05 16:52:15 main:574] : INFO : Epoch 1887 | loss: 0.0309572 | val_loss: 0.0311273 | Time: 14988.2 ms [2021-12-05 16:52:30 main:574] : INFO : Epoch 1888 | loss: 0.0309554 | val_loss: 0.0311227 | Time: 15384.8 ms [2021-12-05 16:52:46 main:574] : INFO : Epoch 1889 | loss: 0.0309796 | val_loss: 0.0311137 | Time: 15366.9 ms [2021-12-05 16:53:01 main:574] : INFO : Epoch 1890 | loss: 0.0309697 | val_loss: 0.0311117 | Time: 15157.7 ms [2021-12-05 16:53:16 main:574] : INFO : Epoch 1891 | loss: 0.0309656 | val_loss: 0.031099 | Time: 15222.2 ms [2021-12-05 16:53:31 main:574] : INFO : Epoch 1892 | loss: 0.0309656 | val_loss: 0.0310961 | Time: 15199.5 ms [2021-12-05 16:53:47 main:574] : INFO : Epoch 1893 | loss: 0.0309742 | val_loss: 0.0311089 | Time: 15173.3 ms [2021-12-05 16:54:02 main:574] : INFO : Epoch 1894 | loss: 0.0309624 | val_loss: 0.0311065 | Time: 15255.1 ms [2021-12-05 16:54:17 main:574] : INFO : Epoch 1895 | loss: 0.0309583 | val_loss: 0.031115 | Time: 15140.6 ms [2021-12-05 16:54:32 main:574] : INFO : Epoch 1896 | loss: 0.0309562 | val_loss: 0.0311092 | Time: 14943 ms [2021-12-05 16:54:48 main:574] : INFO : Epoch 1897 | loss: 0.0309523 | val_loss: 0.0311254 | Time: 15311.4 ms [2021-12-05 16:55:03 main:574] : INFO : Epoch 1898 | loss: 0.0309504 | val_loss: 0.0311234 | Time: 15336.4 ms [2021-12-05 16:55:18 main:574] : INFO : Epoch 1899 | loss: 0.0309421 | val_loss: 0.0311277 | Time: 15284.8 ms [2021-12-05 16:55:33 main:574] : INFO : Epoch 1900 | loss: 0.0309412 | val_loss: 0.0311114 | Time: 14508.1 ms [2021-12-05 16:55:48 main:574] : INFO : Epoch 1901 | loss: 0.0309346 | val_loss: 0.0311096 | Time: 15398.6 ms [2021-12-05 16:56:04 main:574] : INFO : Epoch 1902 | loss: 0.0309354 | val_loss: 0.0311235 | Time: 14949.3 ms [2021-12-05 16:56:20 main:574] : INFO : Epoch 1903 | loss: 0.0309352 | val_loss: 0.0311167 | Time: 16034.4 ms [2021-12-05 16:56:35 main:574] : INFO : Epoch 1904 | loss: 0.0309361 | val_loss: 0.0311305 | Time: 15151.2 ms [2021-12-05 16:56:50 main:574] : INFO : Epoch 1905 | loss: 0.030946 | val_loss: 0.0311104 | Time: 15390.5 ms [2021-12-05 16:57:05 main:574] : INFO : Epoch 1906 | loss: 0.0309488 | val_loss: 0.0311015 | Time: 14931.2 ms [2021-12-05 16:57:21 main:574] : INFO : Epoch 1907 | loss: 0.0309501 | val_loss: 0.0311101 | Time: 15520.7 ms [2021-12-05 16:57:36 main:574] : INFO : Epoch 1908 | loss: 0.0309506 | val_loss: 0.0311302 | Time: 14987.1 ms [2021-12-05 16:57:52 main:574] : INFO : Epoch 1909 | loss: 0.0309416 | val_loss: 0.0311049 | Time: 15557.5 ms [2021-12-05 16:58:07 main:574] : INFO : Epoch 1910 | loss: 0.030942 | val_loss: 0.0311269 | Time: 15213.9 ms [2021-12-05 16:58:22 main:574] : INFO : Epoch 1911 | loss: 0.030935 | val_loss: 0.0311249 | Time: 14973.1 ms [2021-12-05 16:58:37 main:574] : INFO : Epoch 1912 | loss: 0.0309414 | val_loss: 0.0311001 | Time: 15208.6 ms [2021-12-05 16:58:52 main:574] : INFO : Epoch 1913 | loss: 0.0309652 | val_loss: 0.0310984 | Time: 15072.2 ms [2021-12-05 16:59:08 main:574] : INFO : Epoch 1914 | loss: 0.030952 | val_loss: 0.0311192 | Time: 15277.8 ms [2021-12-05 16:59:23 main:574] : INFO : Epoch 1915 | loss: 0.0309539 | val_loss: 0.0311197 | Time: 15017 ms [2021-12-05 16:59:38 main:574] : INFO : Epoch 1916 | loss: 0.0309564 | val_loss: 0.0310929 | Time: 15208.2 ms [2021-12-05 16:59:53 main:574] : INFO : Epoch 1917 | loss: 0.0309474 | val_loss: 0.0311243 | Time: 15114.2 ms [2021-12-05 17:00:09 main:574] : INFO : Epoch 1918 | loss: 0.0309501 | val_loss: 0.031122 | Time: 15354.9 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1060 6GB) [2021-12-05 17:12:06 main:435] : INFO : Set logging level to 1 [2021-12-05 17:12:06 main:441] : INFO : Running in BOINC Client mode [2021-12-05 17:12:06 main:444] : INFO : Resolving all filenames [2021-12-05 17:12:06 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2021-12-05 17:12:06 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2021-12-05 17:12:06 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2021-12-05 17:12:06 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2021-12-05 17:12:06 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2021-12-05 17:12:06 main:472] : INFO : Dataset filename: dataset.hdf5 [2021-12-05 17:12:06 main:474] : INFO : Configuration: [2021-12-05 17:12:07 main:475] : INFO : Model type: GRU [2021-12-05 17:12:07 main:476] : INFO : Validation Loss Threshold: 0.0001 [2021-12-05 17:12:07 main:477] : INFO : Max Epochs: 2048 [2021-12-05 17:12:07 main:478] : INFO : Batch Size: 128 [2021-12-05 17:12:07 main:479] : INFO : Learning Rate: 0.01 [2021-12-05 17:12:07 main:480] : INFO : Patience: 10 [2021-12-05 17:12:07 main:481] : INFO : Hidden Width: 12 [2021-12-05 17:12:08 main:482] : INFO : # Recurrent Layers: 4 [2021-12-05 17:12:08 main:483] : INFO : # Backend Layers: 4 [2021-12-05 17:12:08 main:484] : INFO : # Threads: 1 [2021-12-05 17:12:08 main:486] : INFO : Preparing Dataset [2021-12-05 17:12:08 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2021-12-05 17:12:09 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2021-12-05 17:12:13 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2021-12-05 17:12:13 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2021-12-05 17:12:14 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2021-12-05 17:12:14 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2021-12-05 17:12:14 main:494] : INFO : Creating Model [2021-12-05 17:12:14 main:507] : INFO : Preparing config file [2021-12-05 17:12:14 main:511] : INFO : Found checkpoint, attempting to load... [2021-12-05 17:12:14 main:512] : INFO : Loading config [2021-12-05 17:12:15 main:514] : INFO : Loading state [2021-12-05 17:12:19 main:559] : INFO : Loading DataLoader into Memory [2021-12-05 17:12:19 main:562] : INFO : Starting Training [2021-12-05 17:12:39 main:574] : INFO : Epoch 1833 | loss: 0.0309915 | val_loss: 0.0311218 | Time: 19704.6 ms [2021-12-05 17:12:57 main:574] : INFO : Epoch 1834 | loss: 0.0309575 | val_loss: 0.0311399 | Time: 17953.2 ms [2021-12-05 17:13:14 main:574] : INFO : Epoch 1835 | loss: 0.0309687 | val_loss: 0.0311197 | Time: 17673.8 ms [2021-12-05 17:13:34 main:574] : INFO : Epoch 1836 | loss: 0.0309655 | val_loss: 0.0311156 | Time: 18939.8 ms [2021-12-05 17:13:52 main:574] : INFO : Epoch 1837 | loss: 0.0309539 | val_loss: 0.0311332 | Time: 18570.8 ms [2021-12-05 17:14:11 main:574] : INFO : Epoch 1838 | loss: 0.0309643 | val_loss: 0.0310979 | Time: 18977.1 ms [2021-12-05 17:14:31 main:574] : INFO : Epoch 1839 | loss: 0.0309663 | val_loss: 0.0311119 | Time: 19678.7 ms [2021-12-05 17:14:50 main:574] : INFO : Epoch 1840 | loss: 0.0309573 | val_loss: 0.0311143 | Time: 18822.3 ms [2021-12-05 17:15:09 main:574] : INFO : Epoch 1841 | loss: 0.0309538 | val_loss: 0.0311093 | Time: 19238 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1060 6GB) [2021-12-05 17:17:13 main:435] : INFO : Set logging level to 1 [2021-12-05 17:17:13 main:441] : INFO : Running in BOINC Client mode [2021-12-05 17:17:13 main:444] : INFO : Resolving all filenames [2021-12-05 17:17:13 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2021-12-05 17:17:13 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2021-12-05 17:17:13 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2021-12-05 17:17:13 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2021-12-05 17:17:13 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2021-12-05 17:17:13 main:472] : INFO : Dataset filename: dataset.hdf5 [2021-12-05 17:17:13 main:474] : INFO : Configuration: [2021-12-05 17:17:13 main:475] : INFO : Model type: GRU [2021-12-05 17:17:13 main:476] : INFO : Validation Loss Threshold: 0.0001 [2021-12-05 17:17:14 main:477] : INFO : Max Epochs: 2048 [2021-12-05 17:17:14 main:478] : INFO : Batch Size: 128 [2021-12-05 17:17:14 main:479] : INFO : Learning Rate: 0.01 [2021-12-05 17:17:14 main:480] : INFO : Patience: 10 [2021-12-05 17:17:14 main:481] : INFO : Hidden Width: 12 [2021-12-05 17:17:14 main:482] : INFO : # Recurrent Layers: 4 [2021-12-05 17:17:14 main:483] : INFO : # Backend Layers: 4 [2021-12-05 17:17:14 main:484] : INFO : # Threads: 1 [2021-12-05 17:17:14 main:486] : INFO : Preparing Dataset [2021-12-05 17:17:14 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2021-12-05 17:17:15 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2021-12-05 17:17:22 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2021-12-05 17:17:22 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2021-12-05 17:17:23 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2021-12-05 17:17:23 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2021-12-05 17:17:23 main:494] : INFO : Creating Model [2021-12-05 17:17:23 main:507] : INFO : Preparing config file [2021-12-05 17:17:23 main:511] : INFO : Found checkpoint, attempting to load... [2021-12-05 17:17:23 main:512] : INFO : Loading config [2021-12-05 17:17:23 main:514] : INFO : Loading state [2021-12-05 17:17:26 main:559] : INFO : Loading DataLoader into Memory [2021-12-05 17:17:26 main:562] : INFO : Starting Training [2021-12-05 17:17:46 main:574] : INFO : Epoch 1833 | loss: 0.0310047 | val_loss: 0.031126 | Time: 20017 ms [2021-12-05 17:18:05 main:574] : INFO : Epoch 1834 | loss: 0.0309648 | val_loss: 0.0311278 | Time: 18372.8 ms [2021-12-05 17:18:23 main:574] : INFO : Epoch 1835 | loss: 0.030948 | val_loss: 0.0311215 | Time: 18650.8 ms [2021-12-05 17:18:42 main:574] : INFO : Epoch 1836 | loss: 0.0309488 | val_loss: 0.0311234 | Time: 18978 ms [2021-12-05 17:19:02 main:574] : INFO : Epoch 1837 | loss: 0.0309402 | val_loss: 0.0311391 | Time: 18961 ms [2021-12-05 17:19:21 main:574] : INFO : Epoch 1838 | loss: 0.0309473 | val_loss: 0.0311134 | Time: 19476.3 ms [2021-12-05 17:19:39 main:574] : INFO : Epoch 1839 | loss: 0.0309507 | val_loss: 0.0311073 | Time: 18078.4 ms [2021-12-05 17:19:58 main:574] : INFO : Epoch 1840 | loss: 0.0309399 | val_loss: 0.0311111 | Time: 18904 ms [2021-12-05 17:20:18 main:574] : INFO : Epoch 1841 | loss: 0.030938 | val_loss: 0.0311309 | Time: 19959.2 ms [2021-12-05 17:20:37 main:574] : INFO : Epoch 1842 | loss: 0.03094 | val_loss: 0.0311313 | Time: 18831.6 ms [2021-12-05 17:20:56 main:574] : INFO : Epoch 1843 | loss: 0.0309479 | val_loss: 0.0311031 | Time: 18713.5 ms [2021-12-05 17:21:16 main:574] : INFO : Epoch 1844 | loss: 0.0309467 | val_loss: 0.0311279 | Time: 19266.1 ms [2021-12-05 17:21:34 main:574] : INFO : Epoch 1845 | loss: 0.0309459 | val_loss: 0.031137 | Time: 18264.6 ms [2021-12-05 17:21:52 main:574] : INFO : Epoch 1846 | loss: 0.0309521 | val_loss: 0.0311266 | Time: 17876.6 ms [2021-12-05 17:22:12 main:574] : INFO : Epoch 1847 | loss: 0.030951 | val_loss: 0.0311184 | Time: 19554.2 ms [2021-12-05 17:22:31 main:574] : INFO : Epoch 1848 | loss: 0.0309565 | val_loss: 0.0311061 | Time: 19725.4 ms [2021-12-05 17:22:51 main:574] : INFO : Epoch 1849 | loss: 0.0309678 | val_loss: 0.0311264 | Time: 19105.4 ms [2021-12-05 17:23:09 main:574] : INFO : Epoch 1850 | loss: 0.0309662 | val_loss: 0.031094 | Time: 18178.5 ms [2021-12-05 17:23:27 main:574] : INFO : Epoch 1851 | loss: 0.0309612 | val_loss: 0.0311404 | Time: 18206.3 ms [2021-12-05 17:23:46 main:574] : INFO : Epoch 1852 | loss: 0.0309594 | val_loss: 0.0311153 | Time: 18825.3 ms [2021-12-05 17:24:06 main:574] : INFO : Epoch 1853 | loss: 0.0309497 | val_loss: 0.0311205 | Time: 19055.4 ms [2021-12-05 17:24:25 main:574] : INFO : Epoch 1854 | loss: 0.0309541 | val_loss: 0.0311114 | Time: 18772.8 ms [2021-12-05 17:24:43 main:574] : INFO : Epoch 1855 | loss: 0.0309584 | val_loss: 0.0310961 | Time: 18588.3 ms [2021-12-05 17:25:02 main:574] : INFO : Epoch 1856 | loss: 0.0309536 | val_loss: 0.031097 | Time: 18694.8 ms [2021-12-05 17:25:21 main:574] : INFO : Epoch 1857 | loss: 0.0309457 | val_loss: 0.0311261 | Time: 18843.7 ms [2021-12-05 17:25:40 main:574] : INFO : Epoch 1858 | loss: 0.0309498 | val_loss: 0.0310993 | Time: 18596.8 ms [2021-12-05 17:25:59 main:574] : INFO : Epoch 1859 | loss: 0.0309487 | val_loss: 0.0311309 | Time: 18713 ms [2021-12-05 17:26:17 main:574] : INFO : Epoch 1860 | loss: 0.030945 | val_loss: 0.0310939 | Time: 18554 ms [2021-12-05 17:26:35 main:574] : INFO : Epoch 1861 | loss: 0.0309392 | val_loss: 0.0311455 | Time: 17582.4 ms [2021-12-05 17:26:54 main:574] : INFO : Epoch 1862 | loss: 0.0309401 | val_loss: 0.031102 | Time: 18748.3 ms [2021-12-05 17:27:13 main:574] : INFO : Epoch 1863 | loss: 0.0309415 | val_loss: 0.031123 | Time: 19496.1 ms [2021-12-05 17:27:32 main:574] : INFO : Epoch 1864 | loss: 0.0309477 | val_loss: 0.0311033 | Time: 18085.3 ms [2021-12-05 17:27:51 main:574] : INFO : Epoch 1865 | loss: 0.030944 | val_loss: 0.0311248 | Time: 19353.6 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1060 6GB) [2021-12-05 17:31:01 main:435] : INFO : Set logging level to 1 [2021-12-05 17:31:01 main:441] : INFO : Running in BOINC Client mode [2021-12-05 17:31:01 main:444] : INFO : Resolving all filenames [2021-12-05 17:31:02 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2021-12-05 17:31:02 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2021-12-05 17:31:02 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2021-12-05 17:31:02 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2021-12-05 17:31:02 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2021-12-05 17:31:02 main:472] : INFO : Dataset filename: dataset.hdf5 [2021-12-05 17:31:02 main:474] : INFO : Configuration: [2021-12-05 17:31:03 main:475] : INFO : Model type: GRU [2021-12-05 17:31:03 main:476] : INFO : Validation Loss Threshold: 0.0001 [2021-12-05 17:31:03 main:477] : INFO : Max Epochs: 2048 [2021-12-05 17:31:03 main:478] : INFO : Batch Size: 128 [2021-12-05 17:31:03 main:479] : INFO : Learning Rate: 0.01 [2021-12-05 17:31:03 main:480] : INFO : Patience: 10 [2021-12-05 17:31:03 main:481] : INFO : Hidden Width: 12 [2021-12-05 17:31:03 main:482] : INFO : # Recurrent Layers: 4 [2021-12-05 17:31:03 main:483] : INFO : # Backend Layers: 4 [2021-12-05 17:31:03 main:484] : INFO : # Threads: 1 [2021-12-05 17:31:04 main:486] : INFO : Preparing Dataset [2021-12-05 17:31:04 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2021-12-05 17:31:04 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2021-12-05 17:31:09 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2021-12-05 17:31:09 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2021-12-05 17:31:09 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2021-12-05 17:31:09 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2021-12-05 17:31:10 main:494] : INFO : Creating Model [2021-12-05 17:31:10 main:507] : INFO : Preparing config file [2021-12-05 17:31:10 main:511] : INFO : Found checkpoint, attempting to load... [2021-12-05 17:31:10 main:512] : INFO : Loading config [2021-12-05 17:31:10 main:514] : INFO : Loading state [2021-12-05 17:31:14 main:559] : INFO : Loading DataLoader into Memory [2021-12-05 17:31:14 main:562] : INFO : Starting Training [2021-12-05 17:31:33 main:574] : INFO : Epoch 1833 | loss: 0.0309916 | val_loss: 0.0311004 | Time: 19038.1 ms [2021-12-05 17:31:51 main:574] : INFO : Epoch 1834 | loss: 0.030952 | val_loss: 0.0311312 | Time: 17804.7 ms [2021-12-05 17:32:10 main:574] : INFO : Epoch 1835 | loss: 0.0309484 | val_loss: 0.0311206 | Time: 19016.4 ms [2021-12-05 17:32:30 main:574] : INFO : Epoch 1836 | loss: 0.030949 | val_loss: 0.0311117 | Time: 19415.2 ms [2021-12-05 17:32:48 main:574] : INFO : Epoch 1837 | loss: 0.0309484 | val_loss: 0.0311254 | Time: 17917.2 ms [2021-12-05 17:33:06 main:574] : INFO : Epoch 1838 | loss: 0.0309512 | val_loss: 0.0311103 | Time: 18141.4 ms [2021-12-05 17:33:25 main:574] : INFO : Epoch 1839 | loss: 0.0309546 | val_loss: 0.0311169 | Time: 18760.4 ms [2021-12-05 17:33:44 main:574] : INFO : Epoch 1840 | loss: 0.0309452 | val_loss: 0.0311043 | Time: 18783 ms [2021-12-05 17:34:02 main:574] : INFO : Epoch 1841 | loss: 0.0309532 | val_loss: 0.0311327 | Time: 17978.5 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1060 6GB) [2021-12-05 17:36:08 main:435] : INFO : Set logging level to 1 [2021-12-05 17:36:08 main:441] : INFO : Running in BOINC Client mode [2021-12-05 17:36:08 main:444] : INFO : Resolving all filenames [2021-12-05 17:36:08 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2021-12-05 17:36:08 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2021-12-05 17:36:08 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2021-12-05 17:36:08 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2021-12-05 17:36:08 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2021-12-05 17:36:09 main:472] : INFO : Dataset filename: dataset.hdf5 [2021-12-05 17:36:09 main:474] : INFO : Configuration: [2021-12-05 17:36:09 main:475] : INFO : Model type: GRU [2021-12-05 17:36:09 main:476] : INFO : Validation Loss Threshold: 0.0001 [2021-12-05 17:36:09 main:477] : INFO : Max Epochs: 2048 [2021-12-05 17:36:09 main:478] : INFO : Batch Size: 128 [2021-12-05 17:36:10 main:479] : INFO : Learning Rate: 0.01 [2021-12-05 17:36:10 main:480] : INFO : Patience: 10 [2021-12-05 17:36:10 main:481] : INFO : Hidden Width: 12 [2021-12-05 17:36:10 main:482] : INFO : # Recurrent Layers: 4 [2021-12-05 17:36:10 main:483] : INFO : # Backend Layers: 4 [2021-12-05 17:36:10 main:484] : INFO : # Threads: 1 [2021-12-05 17:36:10 main:486] : INFO : Preparing Dataset [2021-12-05 17:36:10 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2021-12-05 17:36:11 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2021-12-05 17:36:15 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2021-12-05 17:36:15 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2021-12-05 17:36:16 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2021-12-05 17:36:16 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2021-12-05 17:36:16 main:494] : INFO : Creating Model [2021-12-05 17:36:16 main:507] : INFO : Preparing config file [2021-12-05 17:36:16 main:511] : INFO : Found checkpoint, attempting to load... [2021-12-05 17:36:17 main:512] : INFO : Loading config [2021-12-05 17:36:17 main:514] : INFO : Loading state [2021-12-05 17:36:21 main:559] : INFO : Loading DataLoader into Memory [2021-12-05 17:36:21 main:562] : INFO : Starting Training [2021-12-05 17:36:41 main:574] : INFO : Epoch 1833 | loss: 0.031002 | val_loss: 0.0311163 | Time: 19774.9 ms [2021-12-05 17:37:00 main:574] : INFO : Epoch 1834 | loss: 0.0309729 | val_loss: 0.0311129 | Time: 18548 ms [2021-12-05 17:37:18 main:574] : INFO : Epoch 1835 | loss: 0.0309613 | val_loss: 0.0311154 | Time: 17624 ms [2021-12-05 17:37:37 main:574] : INFO : Epoch 1836 | loss: 0.0309471 | val_loss: 0.0311331 | Time: 19285 ms [2021-12-05 17:37:56 main:574] : INFO : Epoch 1837 | loss: 0.0309455 | val_loss: 0.0311118 | Time: 18377 ms [2021-12-05 17:38:15 main:574] : INFO : Epoch 1838 | loss: 0.03094 | val_loss: 0.0311224 | Time: 19076.6 ms [2021-12-05 17:38:34 main:574] : INFO : Epoch 1839 | loss: 0.0309449 | val_loss: 0.0311213 | Time: 18729.7 ms [2021-12-05 17:38:52 main:574] : INFO : Epoch 1840 | loss: 0.0309379 | val_loss: 0.0311184 | Time: 18760.7 ms [2021-12-05 17:39:12 main:574] : INFO : Epoch 1841 | loss: 0.0309457 | val_loss: 0.0311234 | Time: 19187 ms [2021-12-05 17:39:31 main:574] : INFO : Epoch 1842 | loss: 0.0309431 | val_loss: 0.0310999 | Time: 19271.8 ms [2021-12-05 17:39:49 main:574] : INFO : Epoch 1843 | loss: 0.0309555 | val_loss: 0.0311143 | Time: 17516 ms [2021-12-05 17:40:06 main:574] : INFO : Epoch 1844 | loss: 0.0309727 | val_loss: 0.0311059 | Time: 16958.6 ms [2021-12-05 17:40:24 main:574] : INFO : Epoch 1845 | loss: 0.0309634 | val_loss: 0.0311143 | Time: 18622.5 ms [2021-12-05 17:40:45 main:574] : INFO : Epoch 1846 | loss: 0.0309632 | val_loss: 0.031108 | Time: 20368.1 ms [2021-12-05 17:41:04 main:574] : INFO : Epoch 1847 | loss: 0.0309644 | val_loss: 0.0311192 | Time: 19053.9 ms [2021-12-05 17:41:23 main:574] : INFO : Epoch 1848 | loss: 0.0309584 | val_loss: 0.0311238 | Time: 19215.1 ms [2021-12-05 17:41:43 main:574] : INFO : Epoch 1849 | loss: 0.0309468 | val_loss: 0.0311005 | Time: 19283.9 ms [2021-12-05 17:42:02 main:574] : INFO : Epoch 1850 | loss: 0.0309468 | val_loss: 0.0310896 | Time: 19462.1 ms [2021-12-05 17:42:22 main:574] : INFO : Epoch 1851 | loss: 0.0309489 | val_loss: 0.0311026 | Time: 19229.7 ms [2021-12-05 17:42:41 main:574] : INFO : Epoch 1852 | loss: 0.0309567 | val_loss: 0.0311094 | Time: 19385.6 ms [2021-12-05 17:43:00 main:574] : INFO : Epoch 1853 | loss: 0.0309564 | val_loss: 0.0311197 | Time: 19141.4 ms [2021-12-05 17:43:24 main:574] : INFO : Epoch 1854 | loss: 0.030954 | val_loss: 0.0311145 | Time: 23734.3 ms [2021-12-05 17:43:45 main:574] : INFO : Epoch 1855 | loss: 0.0309496 | val_loss: 0.0311116 | Time: 20564.5 ms [2021-12-05 17:44:05 main:574] : INFO : Epoch 1856 | loss: 0.0309426 | val_loss: 0.0311173 | Time: 19486.1 ms [2021-12-05 17:44:24 main:574] : INFO : Epoch 1857 | loss: 0.0309482 | val_loss: 0.0311035 | Time: 19408.4 ms [2021-12-05 17:44:44 main:574] : INFO : Epoch 1858 | loss: 0.0309505 | val_loss: 0.0311128 | Time: 19345.5 ms [2021-12-05 17:45:03 main:574] : INFO : Epoch 1859 | loss: 0.0309473 | val_loss: 0.0311036 | Time: 19467.5 ms [2021-12-05 17:45:23 main:574] : INFO : Epoch 1860 | loss: 0.0309499 | val_loss: 0.03112 | Time: 19139.1 ms [2021-12-05 17:45:42 main:574] : INFO : Epoch 1861 | loss: 0.0309454 | val_loss: 0.0311084 | Time: 19638.8 ms [2021-12-05 17:46:02 main:574] : INFO : Epoch 1862 | loss: 0.0309475 | val_loss: 0.0311116 | Time: 19218.4 ms [2021-12-05 17:46:21 main:574] : INFO : Epoch 1863 | loss: 0.0309503 | val_loss: 0.031121 | Time: 19386.5 ms [2021-12-05 17:46:41 main:574] : INFO : Epoch 1864 | loss: 0.0309416 | val_loss: 0.0311172 | Time: 19872.6 ms [2021-12-05 17:47:01 main:574] : INFO : Epoch 1865 | loss: 0.0309418 | val_loss: 0.031109 | Time: 19293.1 ms [2021-12-05 17:47:20 main:574] : INFO : Epoch 1866 | loss: 0.03095 | val_loss: 0.0311234 | Time: 19403.7 ms [2021-12-05 17:47:39 main:574] : INFO : Epoch 1867 | loss: 0.0309545 | val_loss: 0.0311069 | Time: 19026.1 ms [2021-12-05 17:47:59 main:574] : INFO : Epoch 1868 | loss: 0.030959 | val_loss: 0.0311235 | Time: 19163.8 ms [2021-12-05 17:48:17 main:574] : INFO : Epoch 1869 | loss: 0.0309531 | val_loss: 0.0311213 | Time: 18644.5 ms [2021-12-05 17:48:37 main:574] : INFO : Epoch 1870 | loss: 0.0309455 | val_loss: 0.0310997 | Time: 19517.6 ms [2021-12-05 17:48:56 main:574] : INFO : Epoch 1871 | loss: 0.0309522 | val_loss: 0.0311238 | Time: 19256.4 ms [2021-12-05 17:49:15 main:574] : INFO : Epoch 1872 | loss: 0.0309474 | val_loss: 0.0311184 | Time: 18820.8 ms [2021-12-05 17:49:35 main:574] : INFO : Epoch 1873 | loss: 0.0309773 | val_loss: 0.0311185 | Time: 19097.1 ms [2021-12-05 17:49:53 main:574] : INFO : Epoch 1874 | loss: 0.0309699 | val_loss: 0.0311243 | Time: 18840.3 ms [2021-12-05 17:50:12 main:574] : INFO : Epoch 1875 | loss: 0.0309502 | val_loss: 0.0311479 | Time: 18932.4 ms [2021-12-05 17:50:32 main:574] : INFO : Epoch 1876 | loss: 0.030946 | val_loss: 0.0311072 | Time: 19067.9 ms [2021-12-05 17:50:51 main:574] : INFO : Epoch 1877 | loss: 0.0309902 | val_loss: 0.0311013 | Time: 19287.9 ms [2021-12-05 17:51:10 main:574] : INFO : Epoch 1878 | loss: 0.0309859 | val_loss: 0.0311264 | Time: 19021.1 ms [2021-12-05 17:51:29 main:574] : INFO : Epoch 1879 | loss: 0.0309704 | val_loss: 0.0311064 | Time: 19053.2 ms [2021-12-05 17:51:48 main:574] : INFO : Epoch 1880 | loss: 0.0309791 | val_loss: 0.0311004 | Time: 18803.5 ms [2021-12-05 17:52:07 main:574] : INFO : Epoch 1881 | loss: 0.0309679 | val_loss: 0.0311099 | Time: 18824.1 ms [2021-12-05 17:52:26 main:574] : INFO : Epoch 1882 | loss: 0.0309587 | val_loss: 0.0311062 | Time: 19170.6 ms [2021-12-05 17:52:46 main:574] : INFO : Epoch 1883 | loss: 0.0309546 | val_loss: 0.0310973 | Time: 19880.1 ms [2021-12-05 17:53:06 main:574] : INFO : Epoch 1884 | loss: 0.0309476 | val_loss: 0.0310969 | Time: 19239.2 ms [2021-12-05 17:53:25 main:574] : INFO : Epoch 1885 | loss: 0.0309413 | val_loss: 0.0311104 | Time: 19332.8 ms [2021-12-05 17:53:44 main:574] : INFO : Epoch 1886 | loss: 0.0309489 | val_loss: 0.0311137 | Time: 19187.3 ms [2021-12-05 17:54:03 main:574] : INFO : Epoch 1887 | loss: 0.0309552 | val_loss: 0.0311051 | Time: 18856.9 ms [2021-12-05 17:54:24 main:574] : INFO : Epoch 1888 | loss: 0.0309488 | val_loss: 0.0311217 | Time: 20032.4 ms [2021-12-05 17:54:43 main:574] : INFO : Epoch 1889 | loss: 0.0309627 | val_loss: 0.0311283 | Time: 18990.1 ms [2021-12-05 17:55:02 main:574] : INFO : Epoch 1890 | loss: 0.0309627 | val_loss: 0.0311214 | Time: 18941.4 ms [2021-12-05 17:55:21 main:574] : INFO : Epoch 1891 | loss: 0.030992 | val_loss: 0.0311332 | Time: 19129.6 ms [2021-12-05 17:55:40 main:574] : INFO : Epoch 1892 | loss: 0.0309963 | val_loss: 0.0311105 | Time: 19219.5 ms [2021-12-05 17:55:59 main:574] : INFO : Epoch 1893 | loss: 0.0309709 | val_loss: 0.0310997 | Time: 18798.6 ms [2021-12-05 17:56:18 main:574] : INFO : Epoch 1894 | loss: 0.0309592 | val_loss: 0.0311209 | Time: 18522.9 ms [2021-12-05 17:56:37 main:574] : INFO : Epoch 1895 | loss: 0.0309538 | val_loss: 0.0311037 | Time: 19157.5 ms [2021-12-05 17:56:56 main:574] : INFO : Epoch 1896 | loss: 0.0309469 | val_loss: 0.031119 | Time: 18636.2 ms [2021-12-05 17:57:15 main:574] : INFO : Epoch 1897 | loss: 0.0309524 | val_loss: 0.0311103 | Time: 19087.7 ms [2021-12-05 17:57:34 main:574] : INFO : Epoch 1898 | loss: 0.0309522 | val_loss: 0.0311036 | Time: 19383 ms [2021-12-05 17:57:54 main:574] : INFO : Epoch 1899 | loss: 0.0309791 | val_loss: 0.0311071 | Time: 19242.1 ms [2021-12-05 17:58:13 main:574] : INFO : Epoch 1900 | loss: 0.0309673 | val_loss: 0.0310975 | Time: 19170.9 ms [2021-12-05 17:58:33 main:574] : INFO : Epoch 1901 | loss: 0.0309636 | val_loss: 0.0311136 | Time: 19228.5 ms [2021-12-05 17:58:52 main:574] : INFO : Epoch 1902 | loss: 0.0309672 | val_loss: 0.0311124 | Time: 19234.7 ms [2021-12-05 17:59:11 main:574] : INFO : Epoch 1903 | loss: 0.0309646 | val_loss: 0.0311052 | Time: 19213.4 ms [2021-12-05 17:59:31 main:574] : INFO : Epoch 1904 | loss: 0.0309549 | val_loss: 0.0311319 | Time: 19166.7 ms [2021-12-05 17:59:50 main:574] : INFO : Epoch 1905 | loss: 0.030955 | val_loss: 0.0311083 | Time: 19069.9 ms [2021-12-05 18:00:09 main:574] : INFO : Epoch 1906 | loss: 0.0309527 | val_loss: 0.0311181 | Time: 18797.4 ms [2021-12-05 18:00:28 main:574] : INFO : Epoch 1907 | loss: 0.030944 | val_loss: 0.0311305 | Time: 18893.5 ms [2021-12-05 18:00:47 main:574] : INFO : Epoch 1908 | loss: 0.0309476 | val_loss: 0.0310971 | Time: 19197.4 ms [2021-12-05 18:01:07 main:574] : INFO : Epoch 1909 | loss: 0.0309436 | val_loss: 0.0311151 | Time: 19869.4 ms [2021-12-05 18:01:27 main:574] : INFO : Epoch 1910 | loss: 0.0309349 | val_loss: 0.0311284 | Time: 20041.1 ms [2021-12-05 18:01:47 main:574] : INFO : Epoch 1911 | loss: 0.0309407 | val_loss: 0.031134 | Time: 19638.1 ms [2021-12-05 18:02:06 main:574] : INFO : Epoch 1912 | loss: 0.030937 | val_loss: 0.0311258 | Time: 19449.3 ms [2021-12-05 18:02:26 main:574] : INFO : Epoch 1913 | loss: 0.0309693 | val_loss: 0.0311091 | Time: 19129.4 ms [2021-12-05 18:02:45 main:574] : INFO : Epoch 1914 | loss: 0.0309546 | val_loss: 0.031123 | Time: 18857.5 ms [2021-12-05 18:03:04 main:574] : INFO : Epoch 1915 | loss: 0.0309463 | val_loss: 0.0311264 | Time: 19374.2 ms [2021-12-05 18:03:23 main:574] : INFO : Epoch 1916 | loss: 0.0309405 | val_loss: 0.031133 | Time: 19192.3 ms [2021-12-05 18:03:43 main:574] : INFO : Epoch 1917 | loss: 0.0309687 | val_loss: 0.0311318 | Time: 19609.3 ms [2021-12-05 18:04:03 main:574] : INFO : Epoch 1918 | loss: 0.030967 | val_loss: 0.0311272 | Time: 19393.6 ms [2021-12-05 18:04:22 main:574] : INFO : Epoch 1919 | loss: 0.0309469 | val_loss: 0.0311199 | Time: 18907.6 ms [2021-12-05 18:04:41 main:574] : INFO : Epoch 1920 | loss: 0.030936 | val_loss: 0.031121 | Time: 19039.5 ms [2021-12-05 18:05:00 main:574] : INFO : Epoch 1921 | loss: 0.0309438 | val_loss: 0.0311011 | Time: 19321.8 ms [2021-12-05 18:05:20 main:574] : INFO : Epoch 1922 | loss: 0.0309405 | val_loss: 0.0311226 | Time: 20131.3 ms [2021-12-05 18:05:40 main:574] : INFO : Epoch 1923 | loss: 0.0309441 | val_loss: 0.0311113 | Time: 19003.1 ms [2021-12-05 18:05:58 main:574] : INFO : Epoch 1924 | loss: 0.0309385 | val_loss: 0.0311176 | Time: 18442.9 ms [2021-12-05 18:06:18 main:574] : INFO : Epoch 1925 | loss: 0.0309359 | val_loss: 0.0311375 | Time: 19574.8 ms [2021-12-05 18:06:37 main:574] : INFO : Epoch 1926 | loss: 0.0309523 | val_loss: 0.031104 | Time: 19074.5 ms [2021-12-05 18:06:56 main:574] : INFO : Epoch 1927 | loss: 0.0309642 | val_loss: 0.0311128 | Time: 18858.5 ms [2021-12-05 18:07:15 main:574] : INFO : Epoch 1928 | loss: 0.0309424 | val_loss: 0.0311388 | Time: 18669.7 ms [2021-12-05 18:07:35 main:574] : INFO : Epoch 1929 | loss: 0.030939 | val_loss: 0.031131 | Time: 20359.2 ms [2021-12-05 18:07:54 main:574] : INFO : Epoch 1930 | loss: 0.0309413 | val_loss: 0.0311119 | Time: 18761.8 ms [2021-12-05 18:08:13 main:574] : INFO : Epoch 1931 | loss: 0.0309396 | val_loss: 0.0311241 | Time: 19185.5 ms [2021-12-05 18:08:33 main:574] : INFO : Epoch 1932 | loss: 0.0309686 | val_loss: 0.0311057 | Time: 19250.1 ms [2021-12-05 18:08:52 main:574] : INFO : Epoch 1933 | loss: 0.0309696 | val_loss: 0.031105 | Time: 18994.2 ms [2021-12-05 18:09:11 main:574] : INFO : Epoch 1934 | loss: 0.0309536 | val_loss: 0.0311277 | Time: 19178 ms [2021-12-05 18:09:30 main:574] : INFO : Epoch 1935 | loss: 0.0309488 | val_loss: 0.0311189 | Time: 18503.8 ms [2021-12-05 18:09:49 main:574] : INFO : Epoch 1936 | loss: 0.0309412 | val_loss: 0.0311019 | Time: 18876.3 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1060 6GB) [2021-12-05 19:26:16 main:435] : INFO : Set logging level to 1 [2021-12-05 19:26:16 main:441] : INFO : Running in BOINC Client mode [2021-12-05 19:26:16 main:444] : INFO : Resolving all filenames [2021-12-05 19:26:16 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2021-12-05 19:26:16 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2021-12-05 19:26:16 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2021-12-05 19:26:16 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2021-12-05 19:26:16 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2021-12-05 19:26:17 main:472] : INFO : Dataset filename: dataset.hdf5 [2021-12-05 19:26:17 main:474] : INFO : Configuration: [2021-12-05 19:26:17 main:475] : INFO : Model type: GRU [2021-12-05 19:26:17 main:476] : INFO : Validation Loss Threshold: 0.0001 [2021-12-05 19:26:17 main:477] : INFO : Max Epochs: 2048 [2021-12-05 19:26:17 main:478] : INFO : Batch Size: 128 [2021-12-05 19:26:17 main:479] : INFO : Learning Rate: 0.01 [2021-12-05 19:26:17 main:480] : INFO : Patience: 10 [2021-12-05 19:26:17 main:481] : INFO : Hidden Width: 12 [2021-12-05 19:26:17 main:482] : INFO : # Recurrent Layers: 4 [2021-12-05 19:26:17 main:483] : INFO : # Backend Layers: 4 [2021-12-05 19:26:17 main:484] : INFO : # Threads: 1 [2021-12-05 19:26:18 main:486] : INFO : Preparing Dataset [2021-12-05 19:26:18 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2021-12-05 19:26:19 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2021-12-05 19:26:26 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2021-12-05 19:26:27 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2021-12-05 19:26:27 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2021-12-05 19:26:27 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2021-12-05 19:26:27 main:494] : INFO : Creating Model [2021-12-05 19:26:27 main:507] : INFO : Preparing config file [2021-12-05 19:26:28 main:511] : INFO : Found checkpoint, attempting to load... [2021-12-05 19:26:28 main:512] : INFO : Loading config [2021-12-05 19:26:28 main:514] : INFO : Loading state [2021-12-05 19:26:33 main:559] : INFO : Loading DataLoader into Memory [2021-12-05 19:26:33 main:562] : INFO : Starting Training [2021-12-05 19:26:53 main:574] : INFO : Epoch 1937 | loss: 0.0309978 | val_loss: 0.031105 | Time: 19571.9 ms [2021-12-05 19:27:12 main:574] : INFO : Epoch 1938 | loss: 0.0309612 | val_loss: 0.0311363 | Time: 18823 ms [2021-12-05 19:27:31 main:574] : INFO : Epoch 1939 | loss: 0.0309483 | val_loss: 0.0311186 | Time: 18692.6 ms [2021-12-05 19:27:49 main:574] : INFO : Epoch 1940 | loss: 0.0309593 | val_loss: 0.0311211 | Time: 18778.3 ms [2021-12-05 19:28:08 main:574] : INFO : Epoch 1941 | loss: 0.0309645 | val_loss: 0.0311105 | Time: 18739.2 ms [2021-12-05 19:28:26 main:574] : INFO : Epoch 1942 | loss: 0.030959 | val_loss: 0.0311262 | Time: 17979.6 ms [2021-12-05 19:28:45 main:574] : INFO : Epoch 1943 | loss: 0.0309567 | val_loss: 0.0311065 | Time: 18317.5 ms [2021-12-05 19:29:04 main:574] : INFO : Epoch 1944 | loss: 0.0309531 | val_loss: 0.0310961 | Time: 18895.2 ms [2021-12-05 19:29:22 main:574] : INFO : Epoch 1945 | loss: 0.0309828 | val_loss: 0.031112 | Time: 18010 ms [2021-12-05 19:29:41 main:574] : INFO : Epoch 1946 | loss: 0.0309542 | val_loss: 0.0311038 | Time: 18622.8 ms [2021-12-05 19:30:00 main:574] : INFO : Epoch 1947 | loss: 0.0309566 | val_loss: 0.0311222 | Time: 19280 ms [2021-12-05 19:30:18 main:574] : INFO : Epoch 1948 | loss: 0.0309481 | val_loss: 0.0311335 | Time: 17476.8 ms [2021-12-05 19:30:36 main:574] : INFO : Epoch 1949 | loss: 0.0309458 | val_loss: 0.0311116 | Time: 18223.1 ms [2021-12-05 19:30:55 main:574] : INFO : Epoch 1950 | loss: 0.0309429 | val_loss: 0.0311341 | Time: 18782.8 ms [2021-12-05 19:31:13 main:574] : INFO : Epoch 1951 | loss: 0.030935 | val_loss: 0.0311253 | Time: 17981.1 ms [2021-12-05 19:31:32 main:574] : INFO : Epoch 1952 | loss: 0.0309415 | val_loss: 0.0311154 | Time: 19412.8 ms [2021-12-05 19:31:51 main:574] : INFO : Epoch 1953 | loss: 0.0309424 | val_loss: 0.0311209 | Time: 18586.7 ms [2021-12-05 19:32:09 main:574] : INFO : Epoch 1954 | loss: 0.0309376 | val_loss: 0.0311349 | Time: 17857.3 ms [2021-12-05 19:32:27 main:574] : INFO : Epoch 1955 | loss: 0.0309322 | val_loss: 0.0311102 | Time: 17770.8 ms [2021-12-05 19:32:46 main:574] : INFO : Epoch 1956 | loss: 0.0309383 | val_loss: 0.0311264 | Time: 19156.5 ms [2021-12-05 19:33:05 main:574] : INFO : Epoch 1957 | loss: 0.0309314 | val_loss: 0.0311071 | Time: 18965.3 ms [2021-12-05 19:33:23 main:574] : INFO : Epoch 1958 | loss: 0.0309334 | val_loss: 0.0311365 | Time: 17757 ms [2021-12-05 19:33:42 main:574] : INFO : Epoch 1959 | loss: 0.0309483 | val_loss: 0.0311208 | Time: 18938.6 ms [2021-12-05 19:34:01 main:574] : INFO : Epoch 1960 | loss: 0.0309431 | val_loss: 0.0311058 | Time: 19091.9 ms [2021-12-05 19:34:20 main:574] : INFO : Epoch 1961 | loss: 0.0309446 | val_loss: 0.0311537 | Time: 18429.8 ms [2021-12-05 19:34:38 main:574] : INFO : Epoch 1962 | loss: 0.0309423 | val_loss: 0.0311253 | Time: 18203.5 ms [2021-12-05 19:34:57 main:574] : INFO : Epoch 1963 | loss: 0.0309517 | val_loss: 0.0311139 | Time: 18876.2 ms [2021-12-05 19:35:16 main:574] : INFO : Epoch 1964 | loss: 0.0309484 | val_loss: 0.0311318 | Time: 19462.5 ms [2021-12-05 19:35:35 main:574] : INFO : Epoch 1965 | loss: 0.0309466 | val_loss: 0.0311107 | Time: 18060.6 ms [2021-12-05 19:35:53 main:574] : INFO : Epoch 1966 | loss: 0.0309427 | val_loss: 0.0311209 | Time: 18554.4 ms [2021-12-05 19:36:12 main:574] : INFO : Epoch 1967 | loss: 0.0309444 | val_loss: 0.0311258 | Time: 18229.6 ms [2021-12-05 19:36:30 main:574] : INFO : Epoch 1968 | loss: 0.0309415 | val_loss: 0.0311324 | Time: 18694.9 ms [2021-12-05 19:36:48 main:574] : INFO : Epoch 1969 | loss: 0.0309312 | val_loss: 0.0311234 | Time: 17648.2 ms [2021-12-05 19:37:07 main:574] : INFO : Epoch 1970 | loss: 0.0309378 | val_loss: 0.0311243 | Time: 18696.3 ms [2021-12-05 19:37:26 main:574] : INFO : Epoch 1971 | loss: 0.0309517 | val_loss: 0.0311238 | Time: 19228.7 ms [2021-12-05 19:37:45 main:574] : INFO : Epoch 1972 | loss: 0.0309506 | val_loss: 0.0311337 | Time: 18798 ms [2021-12-05 19:38:04 main:574] : INFO : Epoch 1973 | loss: 0.0309563 | val_loss: 0.0311153 | Time: 18620.1 ms [2021-12-05 19:38:23 main:574] : INFO : Epoch 1974 | loss: 0.0309545 | val_loss: 0.0311197 | Time: 19298.4 ms [2021-12-05 19:38:42 main:574] : INFO : Epoch 1975 | loss: 0.0309506 | val_loss: 0.0311166 | Time: 19050.5 ms [2021-12-05 19:39:02 main:574] : INFO : Epoch 1976 | loss: 0.0309385 | val_loss: 0.031118 | Time: 19164.2 ms [2021-12-05 19:39:19 main:574] : INFO : Epoch 1977 | loss: 0.0309476 | val_loss: 0.0311363 | Time: 17042 ms [2021-12-05 19:39:36 main:574] : INFO : Epoch 1978 | loss: 0.0309489 | val_loss: 0.0311222 | Time: 17241.9 ms [2021-12-05 19:39:53 main:574] : INFO : Epoch 1979 | loss: 0.0309444 | val_loss: 0.0311394 | Time: 16817.4 ms [2021-12-05 19:40:12 main:574] : INFO : Epoch 1980 | loss: 0.0309421 | val_loss: 0.0311105 | Time: 19085.8 ms [2021-12-05 19:40:31 main:574] : INFO : Epoch 1981 | loss: 0.0309508 | val_loss: 0.0311281 | Time: 18311.9 ms [2021-12-05 19:40:50 main:574] : INFO : Epoch 1982 | loss: 0.0309422 | val_loss: 0.0311202 | Time: 19075.1 ms [2021-12-05 19:41:11 main:574] : INFO : Epoch 1983 | loss: 0.0309375 | val_loss: 0.0311359 | Time: 20990.4 ms [2021-12-05 19:41:30 main:574] : INFO : Epoch 1984 | loss: 0.0309436 | val_loss: 0.0311304 | Time: 18795.2 ms [2021-12-05 19:41:48 main:574] : INFO : Epoch 1985 | loss: 0.0309674 | val_loss: 0.031117 | Time: 18476.8 ms [2021-12-05 19:42:08 main:574] : INFO : Epoch 1986 | loss: 0.0310603 | val_loss: 0.031106 | Time: 19159.5 ms [2021-12-05 19:42:27 main:574] : INFO : Epoch 1987 | loss: 0.0310473 | val_loss: 0.0310983 | Time: 19575 ms [2021-12-05 19:42:47 main:574] : INFO : Epoch 1988 | loss: 0.0310342 | val_loss: 0.0310844 | Time: 19370.9 ms [2021-12-05 19:43:06 main:574] : INFO : Epoch 1989 | loss: 0.0310108 | val_loss: 0.0310894 | Time: 18625 ms [2021-12-05 19:43:29 main:574] : INFO : Epoch 1990 | loss: 0.0310021 | val_loss: 0.0310916 | Time: 23608.4 ms [2021-12-05 19:43:49 main:574] : INFO : Epoch 1991 | loss: 0.0309919 | val_loss: 0.0311072 | Time: 19370 ms [2021-12-05 19:44:08 main:574] : INFO : Epoch 1992 | loss: 0.0309807 | val_loss: 0.0311076 | Time: 18927.6 ms [2021-12-05 19:44:28 main:574] : INFO : Epoch 1993 | loss: 0.0309733 | val_loss: 0.0311125 | Time: 19594.4 ms [2021-12-05 19:44:47 main:574] : INFO : Epoch 1994 | loss: 0.0309688 | val_loss: 0.0311078 | Time: 19188.1 ms [2021-12-05 19:45:06 main:574] : INFO : Epoch 1995 | loss: 0.0309739 | val_loss: 0.0311126 | Time: 19162.9 ms [2021-12-05 19:45:25 main:574] : INFO : Epoch 1996 | loss: 0.0309686 | val_loss: 0.0311159 | Time: 19080.4 ms [2021-12-05 19:45:44 main:574] : INFO : Epoch 1997 | loss: 0.0309614 | val_loss: 0.0311167 | Time: 18759.3 ms [2021-12-05 19:46:03 main:574] : INFO : Epoch 1998 | loss: 0.0309643 | val_loss: 0.0311113 | Time: 18970.9 ms [2021-12-05 19:46:22 main:574] : INFO : Epoch 1999 | loss: 0.0309611 | val_loss: 0.0311229 | Time: 18875.9 ms [2021-12-05 19:46:41 main:574] : INFO : Epoch 2000 | loss: 0.0309628 | val_loss: 0.0311242 | Time: 18838.1 ms [2021-12-05 19:47:01 main:574] : INFO : Epoch 2001 | loss: 0.0309563 | val_loss: 0.0311241 | Time: 19326.6 ms [2021-12-05 19:47:19 main:574] : INFO : Epoch 2002 | loss: 0.0309511 | val_loss: 0.0311084 | Time: 18523.7 ms [2021-12-05 19:47:38 main:574] : INFO : Epoch 2003 | loss: 0.0309495 | val_loss: 0.0311016 | Time: 18853.2 ms [2021-12-05 19:47:58 main:574] : INFO : Epoch 2004 | loss: 0.0309462 | val_loss: 0.0311123 | Time: 19219.3 ms [2021-12-05 19:48:17 main:574] : INFO : Epoch 2005 | loss: 0.0309416 | val_loss: 0.0311149 | Time: 18975.6 ms [2021-12-05 19:48:36 main:574] : INFO : Epoch 2006 | loss: 0.0309496 | val_loss: 0.0311063 | Time: 18761.2 ms [2021-12-05 19:48:55 main:574] : INFO : Epoch 2007 | loss: 0.0309482 | val_loss: 0.0311199 | Time: 18880.8 ms [2021-12-05 19:49:15 main:574] : INFO : Epoch 2008 | loss: 0.0309434 | val_loss: 0.031105 | Time: 19926.9 ms [2021-12-05 19:49:34 main:574] : INFO : Epoch 2009 | loss: 0.0309391 | val_loss: 0.0311099 | Time: 19503.2 ms [2021-12-05 19:49:53 main:574] : INFO : Epoch 2010 | loss: 0.0309547 | val_loss: 0.0311327 | Time: 19005.7 ms [2021-12-05 19:50:13 main:574] : INFO : Epoch 2011 | loss: 0.0309719 | val_loss: 0.0311176 | Time: 19417.4 ms [2021-12-05 19:50:32 main:574] : INFO : Epoch 2012 | loss: 0.030952 | val_loss: 0.0311326 | Time: 19016.3 ms [2021-12-05 19:50:51 main:574] : INFO : Epoch 2013 | loss: 0.0309655 | val_loss: 0.0311148 | Time: 18973.1 ms [2021-12-05 19:51:10 main:574] : INFO : Epoch 2014 | loss: 0.0309557 | val_loss: 0.0310992 | Time: 19224.5 ms [2021-12-05 19:51:29 main:574] : INFO : Epoch 2015 | loss: 0.0309571 | val_loss: 0.0311304 | Time: 18230.8 ms [2021-12-05 19:51:48 main:574] : INFO : Epoch 2016 | loss: 0.0309451 | val_loss: 0.0311252 | Time: 18999.4 ms [2021-12-05 19:52:07 main:574] : INFO : Epoch 2017 | loss: 0.0309412 | val_loss: 0.0311058 | Time: 19344.8 ms [2021-12-05 19:52:26 main:574] : INFO : Epoch 2018 | loss: 0.0309422 | val_loss: 0.031122 | Time: 18985.1 ms [2021-12-05 19:52:46 main:574] : INFO : Epoch 2019 | loss: 0.0309393 | val_loss: 0.0311032 | Time: 19976.7 ms [2021-12-05 19:53:06 main:574] : INFO : Epoch 2020 | loss: 0.030947 | val_loss: 0.0311068 | Time: 19314.8 ms [2021-12-05 19:53:25 main:574] : INFO : Epoch 2021 | loss: 0.0309406 | val_loss: 0.0311457 | Time: 18981.2 ms [2021-12-05 19:53:44 main:574] : INFO : Epoch 2022 | loss: 0.0309366 | val_loss: 0.0311165 | Time: 18629.7 ms [2021-12-05 19:54:03 main:574] : INFO : Epoch 2023 | loss: 0.0309387 | val_loss: 0.0311097 | Time: 19465.9 ms [2021-12-05 19:54:22 main:574] : INFO : Epoch 2024 | loss: 0.0309629 | val_loss: 0.0311106 | Time: 18597.1 ms [2021-12-05 19:54:41 main:574] : INFO : Epoch 2025 | loss: 0.0310022 | val_loss: 0.0311058 | Time: 19121.6 ms [2021-12-05 19:54:59 main:574] : INFO : Epoch 2026 | loss: 0.0309814 | val_loss: 0.0311161 | Time: 18128.2 ms [2021-12-05 19:55:19 main:574] : INFO : Epoch 2027 | loss: 0.0309683 | val_loss: 0.0310939 | Time: 19078 ms [2021-12-05 19:55:37 main:574] : INFO : Epoch 2028 | loss: 0.0309595 | val_loss: 0.0311178 | Time: 18647.5 ms [2021-12-05 19:55:56 main:574] : INFO : Epoch 2029 | loss: 0.0309617 | val_loss: 0.0311042 | Time: 19165.2 ms [2021-12-05 19:56:16 main:574] : INFO : Epoch 2030 | loss: 0.0309738 | val_loss: 0.0311158 | Time: 18920.6 ms [2021-12-05 19:56:35 main:574] : INFO : Epoch 2031 | loss: 0.0309867 | val_loss: 0.0311104 | Time: 19245.4 ms [2021-12-05 19:56:54 main:574] : INFO : Epoch 2032 | loss: 0.0309908 | val_loss: 0.0311106 | Time: 18888.5 ms [2021-12-05 19:57:13 main:574] : INFO : Epoch 2033 | loss: 0.0309818 | val_loss: 0.0311092 | Time: 18694.2 ms [2021-12-05 19:57:32 main:574] : INFO : Epoch 2034 | loss: 0.0309688 | val_loss: 0.0311189 | Time: 18837 ms [2021-12-05 19:57:50 main:574] : INFO : Epoch 2035 | loss: 0.0309561 | val_loss: 0.0311237 | Time: 18527.6 ms [2021-12-05 19:58:09 main:574] : INFO : Epoch 2036 | loss: 0.030955 | val_loss: 0.0311222 | Time: 18675.2 ms [2021-12-05 19:58:28 main:574] : INFO : Epoch 2037 | loss: 0.0309536 | val_loss: 0.0311085 | Time: 19122 ms [2021-12-05 19:58:47 main:574] : INFO : Epoch 2038 | loss: 0.0309696 | val_loss: 0.0311267 | Time: 18877.8 ms [2021-12-05 19:59:06 main:574] : INFO : Epoch 2039 | loss: 0.0310171 | val_loss: 0.0310955 | Time: 18803.9 ms [2021-12-05 19:59:25 main:574] : INFO : Epoch 2040 | loss: 0.0310164 | val_loss: 0.0310932 | Time: 19102 ms [2021-12-05 19:59:45 main:574] : INFO : Epoch 2041 | loss: 0.0309951 | val_loss: 0.0310934 | Time: 19477.5 ms [2021-12-05 20:00:04 main:574] : INFO : Epoch 2042 | loss: 0.0309774 | val_loss: 0.0311093 | Time: 19208.1 ms [2021-12-05 20:00:23 main:574] : INFO : Epoch 2043 | loss: 0.0309651 | val_loss: 0.0311143 | Time: 18601.8 ms [2021-12-05 20:00:42 main:574] : INFO : Epoch 2044 | loss: 0.0309609 | val_loss: 0.0311122 | Time: 18996.7 ms [2021-12-05 20:01:03 main:574] : INFO : Epoch 2045 | loss: 0.0309621 | val_loss: 0.0311074 | Time: 20593 ms [2021-12-05 20:01:23 main:574] : INFO : Epoch 2046 | loss: 0.0309643 | val_loss: 0.0311138 | Time: 19454.4 ms [2021-12-05 20:01:42 main:574] : INFO : Epoch 2047 | loss: 0.0309765 | val_loss: 0.0311045 | Time: 19667.8 ms [2021-12-05 20:02:02 main:574] : INFO : Epoch 2048 | loss: 0.0309698 | val_loss: 0.0311011 | Time: 19489 ms [2021-12-05 20:02:02 main:597] : INFO : Saving trained model to model-final.pt, val_loss 0.0311011 [2021-12-05 20:02:02 main:603] : INFO : Saving end state to config to file [2021-12-05 20:02:03 main:608] : INFO : Success, exiting.. 20:02:03 (17268): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)