Task 14322464
| Name | ParityModified-1647040135-26442-3-0_0 |
| Workunit | 11373165 |
| Created | 3 Apr 2022, 20:58:34 UTC |
| Sent | 10 Apr 2022, 6:47:37 UTC |
| Report deadline | 18 Apr 2022, 6:47:37 UTC |
| Received | 18 Apr 2022, 16:29:08 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 14544 |
| Run time | 1 hours 33 min 15 sec |
| CPU time | 1 hours 30 min 42 sec |
| Validate state | Task was reported too late to validate |
| Credit | 0.00 |
| Device peak FLOPS | 3,199.71 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 2.08 GB |
| Peak swap size | 4.30 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version> <![CDATA[ <stderr_txt> ] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-18 14:33:39 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-18 14:33:39 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-18 14:33:39 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-18 14:33:39 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-18 14:33:39 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-18 14:33:39 main:474] : INFO : Configuration: [2022-04-18 14:33:39 main:475] : INFO : Model type: GRU [2022-04-18 14:33:39 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-18 14:33:39 main:477] : INFO : Max Epochs: 2048 [2022-04-18 14:33:39 main:478] : INFO : Batch Size: 128 [2022-04-18 14:33:39 main:479] : INFO : Learning Rate: 0.01 [2022-04-18 14:33:39 main:480] : INFO : Patience: 10 [2022-04-18 14:33:39 main:481] : INFO : Hidden Width: 12 [2022-04-18 14:33:39 main:482] : INFO : # Recurrent Layers: 4 [2022-04-18 14:33:39 main:483] : INFO : # Backend Layers: 4 [2022-04-18 14:33:39 main:484] : INFO : # Threads: 1 [2022-04-18 14:33:39 main:486] : INFO : Preparing Dataset [2022-04-18 14:33:39 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1650) [2022-04-18 15:10:58 main:435] : INFO : Set logging level to 1 [2022-04-18 15:10:58 main:441] : INFO : Running in BOINC Client mode [2022-04-18 15:10:58 main:444] : INFO : Resolving all filenames [2022-04-18 15:10:58 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-18 15:10:58 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-18 15:10:58 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-18 15:10:58 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-18 15:10:58 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-18 15:10:58 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-18 15:10:58 main:474] : INFO : Configuration: [2022-04-18 15:10:58 main:475] : INFO : Model type: GRU [2022-04-18 15:10:58 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-18 15:10:58 main:477] : INFO : Max Epochs: 2048 [2022-04-18 15:10:58 main:478] : INFO : Batch Size: 128 [2022-04-18 15:10:58 main:479] : INFO : Learning Rate: 0.01 [2022-04-18 15:10:58 main:480] : INFO : Patience: 10 [2022-04-18 15:10:58 main:481] : INFO : Hidden Width: 12 [2022-04-18 15:10:58 main:482] : INFO : # Recurrent Layers: 4 [2022-04-18 15:10:58 main:483] : INFO : # Backend Layers: 4 [2022-04-18 15:10:58 main:484] : INFO : # Threads: 1 [2022-04-18 15:10:58 main:486] : INFO : Preparing Dataset [2022-04-18 15:10:58 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-18 15:10:58 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-18 15:11:00 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-18 15:11:00 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-18 15:11:00 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-18 15:11:01 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-18 15:11:01 main:494] : INFO : Creating Model [2022-04-18 15:11:01 main:507] : INFO : Preparing config file [2022-04-18 15:11:01 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-18 15:11:01 main:512] : INFO : Loading config [2022-04-18 15:11:01 main:514] : INFO : Loading state [2022-04-18 15:11:03 main:559] : INFO : Loading DataLoader into Memory [2022-04-18 15:11:03 main:562] : INFO : Starting Training [2022-04-18 15:11:05 main:574] : INFO : Epoch 1755 | loss: 0.0312364 | val_loss: 0.0312279 | Time: 2859.41 ms [2022-04-18 15:11:07 main:574] : INFO : Epoch 1756 | loss: 0.0312145 | val_loss: 0.0312159 | Time: 1881.32 ms [2022-04-18 15:11:09 main:574] : INFO : Epoch 1757 | loss: 0.031211 | val_loss: 0.031213 | Time: 1903.69 ms [2022-04-18 15:11:11 main:574] : INFO : Epoch 1758 | loss: 0.0312085 | val_loss: 0.0312071 | Time: 1881.74 ms [2022-04-18 15:11:13 main:574] : INFO : Epoch 1759 | loss: 0.0312086 | val_loss: 0.0312088 | Time: 1897.58 ms [2022-04-18 15:11:15 main:574] : INFO : Epoch 1760 | loss: 0.0312062 | val_loss: 0.0312081 | Time: 1886.57 ms [2022-04-18 15:11:17 main:574] : INFO : Epoch 1761 | loss: 0.0312047 | val_loss: 0.0312071 | Time: 1874.68 ms [2022-04-18 15:11:19 main:574] : INFO : Epoch 1762 | loss: 0.0312035 | val_loss: 0.0312062 | Time: 1923.92 ms [2022-04-18 15:11:21 main:574] : INFO : Epoch 1763 | loss: 0.0312028 | val_loss: 0.0312054 | Time: 1886.77 ms [2022-04-18 15:11:23 main:574] : INFO : Epoch 1764 | loss: 0.0312012 | val_loss: 0.0312042 | Time: 1923.33 ms [2022-04-18 15:11:24 main:574] : INFO : Epoch 1765 | loss: 0.0311995 | val_loss: 0.0312054 | Time: 1902.21 ms [2022-04-18 15:11:26 main:574] : INFO : Epoch 1766 | loss: 0.0311987 | val_loss: 0.031205 | Time: 1892.6 ms [2022-04-18 15:11:28 main:574] : INFO : Epoch 1767 | loss: 0.0311971 | val_loss: 0.0312067 | Time: 1903.33 ms [2022-04-18 15:11:30 main:574] : INFO : Epoch 1768 | loss: 0.031198 | val_loss: 0.0312048 | Time: 1900.47 ms [2022-04-18 15:11:32 main:574] : INFO : Epoch 1769 | loss: 0.0312011 | val_loss: 0.0312091 | Time: 1880.67 ms [2022-04-18 15:11:34 main:574] : INFO : Epoch 1770 | loss: 0.0312002 | val_loss: 0.0312059 | Time: 1882.29 ms [2022-04-18 15:11:36 main:574] : INFO : Epoch 1771 | loss: 0.0311991 | val_loss: 0.0312042 | Time: 1882.88 ms [2022-04-18 15:11:38 main:574] : INFO : Epoch 1772 | loss: 0.0311982 | val_loss: 0.0312019 | Time: 1902.33 ms [2022-04-18 15:11:40 main:574] : INFO : Epoch 1773 | loss: 0.031198 | val_loss: 0.0312071 | Time: 1902.6 ms [2022-04-18 15:11:42 main:574] : INFO : Epoch 1774 | loss: 0.0311996 | val_loss: 0.0312029 | Time: 1916.2 ms [2022-04-18 15:11:43 main:574] : INFO : Epoch 1775 | loss: 0.0311981 | val_loss: 0.0312058 | Time: 1889.56 ms [2022-04-18 15:11:45 main:574] : INFO : Epoch 1776 | loss: 0.0311983 | val_loss: 0.0311999 | Time: 1893.91 ms [2022-04-18 15:11:47 main:574] : INFO : Epoch 1777 | loss: 0.031196 | val_loss: 0.0312009 | Time: 1926.66 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1650) [2022-04-18 15:16:06 main:435] : INFO : Set logging level to 1 [2022-04-18 15:16:06 main:441] : INFO : Running in BOINC Client mode [2022-04-18 15:16:06 main:444] : INFO : Resolving all filenames [2022-04-18 15:16:06 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-18 15:16:06 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-18 15:16:06 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-18 15:16:06 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-18 15:16:06 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-18 15:16:06 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-18 15:16:06 main:474] : INFO : Configuration: [2022-04-18 15:16:06 main:475] : INFO : Model type: GRU [2022-04-18 15:16:06 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-18 15:16:06 main:477] : INFO : Max Epochs: 2048 [2022-04-18 15:16:06 main:478] : INFO : Batch Size: 128 [2022-04-18 15:16:06 main:479] : INFO : Learning Rate: 0.01 [2022-04-18 15:16:06 main:480] : INFO : Patience: 10 [2022-04-18 15:16:06 main:481] : INFO : Hidden Width: 12 [2022-04-18 15:16:06 main:482] : INFO : # Recurrent Layers: 4 [2022-04-18 15:16:06 main:483] : INFO : # Backend Layers: 4 [2022-04-18 15:16:06 main:484] : INFO : # Threads: 1 [2022-04-18 15:16:06 main:486] : INFO : Preparing Dataset [2022-04-18 15:16:06 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-18 15:16:06 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-18 15:16:08 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-18 15:16:08 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-18 15:16:08 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-18 15:16:08 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-18 15:16:08 main:494] : INFO : Creating Model [2022-04-18 15:16:08 main:507] : INFO : Preparing config file [2022-04-18 15:16:08 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-18 15:16:08 main:512] : INFO : Loading config [2022-04-18 15:16:08 main:514] : INFO : Loading state [2022-04-18 15:16:09 main:559] : INFO : Loading DataLoader into Memory [2022-04-18 15:16:09 main:562] : INFO : Starting Training [2022-04-18 15:16:11 main:574] : INFO : Epoch 1755 | loss: 0.0312338 | val_loss: 0.031213 | Time: 2138.96 ms [2022-04-18 15:16:13 main:574] : INFO : Epoch 1756 | loss: 0.0312079 | val_loss: 0.0312128 | Time: 1879.09 ms [2022-04-18 15:16:15 main:574] : INFO : Epoch 1757 | loss: 0.0312041 | val_loss: 0.0312082 | Time: 1898.49 ms [2022-04-18 15:16:17 main:574] : INFO : Epoch 1758 | loss: 0.0312026 | val_loss: 0.0312049 | Time: 1875.52 ms [2022-04-18 15:16:19 main:574] : INFO : Epoch 1759 | loss: 0.0312028 | val_loss: 0.0312049 | Time: 1880.72 ms [2022-04-18 15:16:21 main:574] : INFO : Epoch 1760 | loss: 0.0312011 | val_loss: 0.0312036 | Time: 1874.52 ms [2022-04-18 15:16:23 main:574] : INFO : Epoch 1761 | loss: 0.0311991 | val_loss: 0.0312027 | Time: 1873.37 ms [2022-04-18 15:16:24 main:574] : INFO : Epoch 1762 | loss: 0.0312012 | val_loss: 0.0312088 | Time: 1885.47 ms [2022-04-18 15:16:26 main:574] : INFO : Epoch 1763 | loss: 0.0312007 | val_loss: 0.0312064 | Time: 1897.81 ms [2022-04-18 15:16:28 main:574] : INFO : Epoch 1764 | loss: 0.0311992 | val_loss: 0.0312046 | Time: 1949.92 ms [2022-04-18 15:16:30 main:574] : INFO : Epoch 1765 | loss: 0.0311976 | val_loss: 0.0312024 | Time: 1904.71 ms [2022-04-18 15:16:32 main:574] : INFO : Epoch 1766 | loss: 0.0311947 | val_loss: 0.0312059 | Time: 1890.32 ms [2022-04-18 15:16:34 main:574] : INFO : Epoch 1767 | loss: 0.0311953 | val_loss: 0.0312011 | Time: 1875.11 ms [2022-04-18 15:16:36 main:574] : INFO : Epoch 1768 | loss: 0.0311942 | val_loss: 0.0312003 | Time: 1908.36 ms [2022-04-18 15:16:38 main:574] : INFO : Epoch 1769 | loss: 0.0311933 | val_loss: 0.0311981 | Time: 1887.97 ms [2022-04-18 15:16:40 main:574] : INFO : Epoch 1770 | loss: 0.0311917 | val_loss: 0.0311968 | Time: 1898.55 ms [2022-04-18 15:16:42 main:574] : INFO : Epoch 1771 | loss: 0.0311915 | val_loss: 0.0311965 | Time: 1898.04 ms [2022-04-18 15:16:44 main:574] : INFO : Epoch 1772 | loss: 0.0311926 | val_loss: 0.0312002 | Time: 1897.11 ms [2022-04-18 15:16:45 main:574] : INFO : Epoch 1773 | loss: 0.0311936 | val_loss: 0.031201 | Time: 1914.51 ms [2022-04-18 15:16:47 main:574] : INFO : Epoch 1774 | loss: 0.0311928 | val_loss: 0.0312001 | Time: 1902.06 ms [2022-04-18 15:16:49 main:574] : INFO : Epoch 1775 | loss: 0.0311911 | val_loss: 0.0311994 | Time: 1930.83 ms [2022-04-18 15:16:51 main:574] : INFO : Epoch 1776 | loss: 0.0311891 | val_loss: 0.0311998 | Time: 1884.06 ms [2022-04-18 15:16:53 main:574] : INFO : Epoch 1777 | loss: 0.0311887 | val_loss: 0.0311992 | Time: 1902.93 ms [2022-04-18 15:16:55 main:574] : INFO : Epoch 1778 | loss: 0.0311883 | val_loss: 0.0311993 | Time: 1913.2 ms [2022-04-18 15:16:57 main:574] : INFO : Epoch 1779 | loss: 0.0311882 | val_loss: 0.0311974 | Time: 1889.41 ms [2022-04-18 15:16:59 main:574] : INFO : Epoch 1780 | loss: 0.0311857 | val_loss: 0.0311921 | Time: 1910.4 ms [2022-04-18 15:17:01 main:574] : INFO : Epoch 1781 | loss: 0.0311854 | val_loss: 0.0311946 | Time: 1896.23 ms [2022-04-18 15:17:03 main:574] : INFO : Epoch 1782 | loss: 0.0311857 | val_loss: 0.0311949 | Time: 1895.35 ms [2022-04-18 15:17:04 main:574] : INFO : Epoch 1783 | loss: 0.0311845 | val_loss: 0.0311952 | Time: 1881.39 ms [2022-04-18 15:17:07 main:574] : INFO : Epoch 1784 | loss: 0.03119 | val_loss: 0.0311919 | Time: 2929.92 ms [2022-04-18 15:17:10 main:574] : INFO : Epoch 1785 | loss: 0.0311842 | val_loss: 0.0311929 | Time: 2876.72 ms [2022-04-18 15:17:13 main:574] : INFO : Epoch 1786 | loss: 0.031183 | val_loss: 0.0311907 | Time: 2704.6 ms [2022-04-18 15:17:15 main:574] : INFO : Epoch 1787 | loss: 0.031183 | val_loss: 0.0311892 | Time: 2268.19 ms [2022-04-18 15:17:18 main:574] : INFO : Epoch 1788 | loss: 0.0311822 | val_loss: 0.0311898 | Time: 2255.31 ms [2022-04-18 15:17:20 main:574] : INFO : Epoch 1789 | loss: 0.0311815 | val_loss: 0.0311882 | Time: 2085.16 ms [2022-04-18 15:17:32 main:574] : INFO : Epoch 1790 | loss: 0.0311806 | val_loss: 0.0311893 | Time: 12335.9 ms [2022-04-18 15:17:34 main:574] : INFO : Epoch 1791 | loss: 0.0311796 | val_loss: 0.031187 | Time: 1899.95 ms [2022-04-18 15:17:36 main:574] : INFO : Epoch 1792 | loss: 0.0311799 | val_loss: 0.031189 | Time: 1893.18 ms [2022-04-18 15:17:38 main:574] : INFO : Epoch 1793 | loss: 0.0311817 | val_loss: 0.0311851 | Time: 1891.35 ms [2022-04-18 15:17:40 main:574] : INFO : Epoch 1794 | loss: 0.0311826 | val_loss: 0.0311877 | Time: 1898.66 ms [2022-04-18 15:17:41 main:574] : INFO : Epoch 1795 | loss: 0.0311835 | val_loss: 0.0311855 | Time: 1897.47 ms [2022-04-18 15:17:43 main:574] : INFO : Epoch 1796 | loss: 0.0311802 | val_loss: 0.0311869 | Time: 1923.91 ms [2022-04-18 15:17:45 main:574] : INFO : Epoch 1797 | loss: 0.0311797 | val_loss: 0.0311875 | Time: 1895.74 ms [2022-04-18 15:17:47 main:574] : INFO : Epoch 1798 | loss: 0.0311805 | val_loss: 0.031186 | Time: 1874.3 ms [2022-04-18 15:17:49 main:574] : INFO : Epoch 1799 | loss: 0.0311792 | val_loss: 0.0311846 | Time: 1904.53 ms [2022-04-18 15:17:51 main:574] : INFO : Epoch 1800 | loss: 0.0311789 | val_loss: 0.0311866 | Time: 1915.82 ms [2022-04-18 15:17:53 main:574] : INFO : Epoch 1801 | loss: 0.0311785 | val_loss: 0.031185 | Time: 1939.8 ms [2022-04-18 15:17:55 main:574] : INFO : Epoch 1802 | loss: 0.031179 | val_loss: 0.0311837 | Time: 1916.73 ms [2022-04-18 15:17:57 main:574] : INFO : Epoch 1803 | loss: 0.0311817 | val_loss: 0.0311952 | Time: 1905.93 ms [2022-04-18 15:17:59 main:574] : INFO : Epoch 1804 | loss: 0.0311907 | val_loss: 0.0311884 | Time: 1938.35 ms [2022-04-18 15:18:01 main:574] : INFO : Epoch 1805 | loss: 0.0311871 | val_loss: 0.0311823 | Time: 1900.83 ms [2022-04-18 15:18:03 main:574] : INFO : Epoch 1806 | loss: 0.0311826 | val_loss: 0.0311837 | Time: 1914.07 ms [2022-04-18 15:18:04 main:574] : INFO : Epoch 1807 | loss: 0.031185 | val_loss: 0.0311828 | Time: 1902.7 ms [2022-04-18 15:18:06 main:574] : INFO : Epoch 1808 | loss: 0.0311834 | val_loss: 0.0311806 | Time: 1886.63 ms [2022-04-18 15:18:08 main:574] : INFO : Epoch 1809 | loss: 0.0311816 | val_loss: 0.0311806 | Time: 1948.46 ms [2022-04-18 15:18:10 main:574] : INFO : Epoch 1810 | loss: 0.0311811 | val_loss: 0.0311788 | Time: 1943.82 ms [2022-04-18 15:18:12 main:574] : INFO : Epoch 1811 | loss: 0.0311777 | val_loss: 0.0311803 | Time: 1912.53 ms [2022-04-18 15:18:14 main:574] : INFO : Epoch 1812 | loss: 0.0311759 | val_loss: 0.0311775 | Time: 1878.95 ms [2022-04-18 15:18:16 main:574] : INFO : Epoch 1813 | loss: 0.0311751 | val_loss: 0.0311769 | Time: 1869.74 ms [2022-04-18 15:18:18 main:574] : INFO : Epoch 1814 | loss: 0.031175 | val_loss: 0.0311776 | Time: 1889.45 ms [2022-04-18 15:18:20 main:574] : INFO : Epoch 1815 | loss: 0.0311746 | val_loss: 0.0311778 | Time: 1922.03 ms [2022-04-18 15:18:22 main:574] : INFO : Epoch 1816 | loss: 0.031181 | val_loss: 0.0311856 | Time: 1889.52 ms [2022-04-18 15:18:24 main:574] : INFO : Epoch 1817 | loss: 0.0311855 | val_loss: 0.031185 | Time: 1879.34 ms [2022-04-18 15:18:25 main:574] : INFO : Epoch 1818 | loss: 0.0311872 | val_loss: 0.0311903 | Time: 1929.03 ms [2022-04-18 15:18:27 main:574] : INFO : Epoch 1819 | loss: 0.0311898 | val_loss: 0.031195 | Time: 1881.78 ms [2022-04-18 15:18:29 main:574] : INFO : Epoch 1820 | loss: 0.0311914 | val_loss: 0.0311945 | Time: 1902.33 ms [2022-04-18 15:18:31 main:574] : INFO : Epoch 1821 | loss: 0.0311882 | val_loss: 0.0311919 | Time: 1882.52 ms [2022-04-18 15:18:33 main:574] : INFO : Epoch 1822 | loss: 0.0311844 | val_loss: 0.0311911 | Time: 1875.68 ms [2022-04-18 15:18:35 main:574] : INFO : Epoch 1823 | loss: 0.0311859 | val_loss: 0.0311878 | Time: 1892.45 ms [2022-04-18 15:18:37 main:574] : INFO : Epoch 1824 | loss: 0.031184 | val_loss: 0.0311882 | Time: 1910.31 ms [2022-04-18 15:18:39 main:574] : INFO : Epoch 1825 | loss: 0.0311842 | val_loss: 0.031191 | Time: 1890.42 ms [2022-04-18 15:18:41 main:574] : INFO : Epoch 1826 | loss: 0.0311816 | val_loss: 0.0311907 | Time: 1947.31 ms [2022-04-18 15:18:43 main:574] : INFO : Epoch 1827 | loss: 0.0311811 | val_loss: 0.0311872 | Time: 1907.59 ms [2022-04-18 15:18:44 main:574] : INFO : Epoch 1828 | loss: 0.0311773 | val_loss: 0.0311869 | Time: 1890.56 ms [2022-04-18 15:18:46 main:574] : INFO : Epoch 1829 | loss: 0.0311757 | val_loss: 0.0311881 | Time: 1912.94 ms [2022-04-18 15:18:48 main:574] : INFO : Epoch 1830 | loss: 0.0311764 | val_loss: 0.0311879 | Time: 1885.97 ms [2022-04-18 15:18:50 main:574] : INFO : Epoch 1831 | loss: 0.0311771 | val_loss: 0.0311886 | Time: 1922.69 ms [2022-04-18 15:18:52 main:574] : INFO : Epoch 1832 | loss: 0.0311771 | val_loss: 0.0311849 | Time: 1903.02 ms [2022-04-18 15:18:54 main:574] : INFO : Epoch 1833 | loss: 0.0311758 | val_loss: 0.0311882 | Time: 1952.82 ms [2022-04-18 15:18:56 main:574] : INFO : Epoch 1834 | loss: 0.0311761 | val_loss: 0.0311891 | Time: 1922.61 ms [2022-04-18 15:18:58 main:574] : INFO : Epoch 1835 | loss: 0.0311738 | val_loss: 0.0311848 | Time: 1919.3 ms [2022-04-18 15:19:00 main:574] : INFO : Epoch 1836 | loss: 0.0311732 | val_loss: 0.0311856 | Time: 1906.85 ms [2022-04-18 15:19:02 main:574] : INFO : Epoch 1837 | loss: 0.0311711 | val_loss: 0.0311867 | Time: 1910.26 ms [2022-04-18 15:19:04 main:574] : INFO : Epoch 1838 | loss: 0.0311715 | val_loss: 0.0311914 | Time: 1955.76 ms [2022-04-18 15:19:06 main:574] : INFO : Epoch 1839 | loss: 0.0311737 | val_loss: 0.0311831 | Time: 1898.18 ms [2022-04-18 15:19:08 main:574] : INFO : Epoch 1840 | loss: 0.0311723 | val_loss: 0.0311832 | Time: 1862.28 ms [2022-04-18 15:19:09 main:574] : INFO : Epoch 1841 | loss: 0.0311727 | val_loss: 0.0311857 | Time: 1910.03 ms [2022-04-18 15:19:11 main:574] : INFO : Epoch 1842 | loss: 0.0311728 | val_loss: 0.031188 | Time: 1893.19 ms [2022-04-18 15:19:13 main:574] : INFO : Epoch 1843 | loss: 0.0311706 | val_loss: 0.0311853 | Time: 1891.06 ms [2022-04-18 15:19:15 main:574] : INFO : Epoch 1844 | loss: 0.0311713 | val_loss: 0.0311854 | Time: 1897.07 ms [2022-04-18 15:19:17 main:574] : INFO : Epoch 1845 | loss: 0.0311708 | val_loss: 0.0311853 | Time: 1878.72 ms [2022-04-18 15:19:19 main:574] : INFO : Epoch 1846 | loss: 0.03117 | val_loss: 0.0311873 | Time: 1925.53 ms [2022-04-18 15:19:21 main:574] : INFO : Epoch 1847 | loss: 0.0311696 | val_loss: 0.0311843 | Time: 1926.73 ms [2022-04-18 15:19:23 main:574] : INFO : Epoch 1848 | loss: 0.0311711 | val_loss: 0.0311844 | Time: 1952.57 ms [2022-04-18 15:19:25 main:574] : INFO : Epoch 1849 | loss: 0.0311685 | val_loss: 0.0311858 | Time: 1910.43 ms [2022-04-18 15:19:27 main:574] : INFO : Epoch 1850 | loss: 0.0311734 | val_loss: 0.0311837 | Time: 1881.25 ms [2022-04-18 15:19:29 main:574] : INFO : Epoch 1851 | loss: 0.0311712 | val_loss: 0.031182 | Time: 1918.02 ms [2022-04-18 15:19:30 main:574] : INFO : Epoch 1852 | loss: 0.0311694 | val_loss: 0.0311823 | Time: 1932.36 ms [2022-04-18 15:19:32 main:574] : INFO : Epoch 1853 | loss: 0.0311697 | val_loss: 0.0311856 | Time: 1947.83 ms [2022-04-18 15:19:34 main:574] : INFO : Epoch 1854 | loss: 0.0311713 | val_loss: 0.0311913 | Time: 1907.59 ms [2022-04-18 15:19:36 main:574] : INFO : Epoch 1855 | loss: 0.0311714 | val_loss: 0.0311867 | Time: 1922.82 ms [2022-04-18 15:19:38 main:574] : INFO : Epoch 1856 | loss: 0.0311689 | val_loss: 0.0311839 | Time: 1903.88 ms [2022-04-18 15:19:40 main:574] : INFO : Epoch 1857 | loss: 0.0311692 | val_loss: 0.0311863 | Time: 2108.45 ms [2022-04-18 15:19:42 main:574] : INFO : Epoch 1858 | loss: 0.0311751 | val_loss: 0.0311813 | Time: 1940.2 ms [2022-04-18 15:19:44 main:574] : INFO : Epoch 1859 | loss: 0.0311721 | val_loss: 0.0311822 | Time: 1904.25 ms [2022-04-18 15:19:46 main:574] : INFO : Epoch 1860 | loss: 0.0311709 | val_loss: 0.0311821 | Time: 1847.47 ms [2022-04-18 15:19:48 main:574] : INFO : Epoch 1861 | loss: 0.031171 | val_loss: 0.0311821 | Time: 1959.8 ms [2022-04-18 15:19:50 main:574] : INFO : Epoch 1862 | loss: 0.0311687 | val_loss: 0.0311816 | Time: 1955.1 ms [2022-04-18 15:19:52 main:574] : INFO : Epoch 1863 | loss: 0.0311679 | val_loss: 0.0311836 | Time: 1976.49 ms [2022-04-18 15:19:54 main:574] : INFO : Epoch 1864 | loss: 0.0311723 | val_loss: 0.0311838 | Time: 1891.74 ms [2022-04-18 15:19:56 main:574] : INFO : Epoch 1865 | loss: 0.0311676 | val_loss: 0.0311819 | Time: 1916.94 ms [2022-04-18 15:19:58 main:574] : INFO : Epoch 1866 | loss: 0.0311656 | val_loss: 0.0311835 | Time: 1913.13 ms [2022-04-18 15:20:00 main:574] : INFO : Epoch 1867 | loss: 0.031166 | val_loss: 0.0311885 | Time: 1906.95 ms [2022-04-18 15:20:02 main:574] : INFO : Epoch 1868 | loss: 0.0311666 | val_loss: 0.0311894 | Time: 1950.84 ms [2022-04-18 15:20:03 main:574] : INFO : Epoch 1869 | loss: 0.0311656 | val_loss: 0.0311826 | Time: 1901.81 ms [2022-04-18 15:20:05 main:574] : INFO : Epoch 1870 | loss: 0.0311636 | val_loss: 0.0311831 | Time: 1896.33 ms [2022-04-18 15:20:07 main:574] : INFO : Epoch 1871 | loss: 0.0311632 | val_loss: 0.031185 | Time: 1885.16 ms [2022-04-18 15:20:09 main:574] : INFO : Epoch 1872 | loss: 0.031163 | val_loss: 0.0311824 | Time: 1917.58 ms [2022-04-18 15:20:11 main:574] : INFO : Epoch 1873 | loss: 0.0311637 | val_loss: 0.0311838 | Time: 1887.92 ms [2022-04-18 15:20:13 main:574] : INFO : Epoch 1874 | loss: 0.0311691 | val_loss: 0.0311839 | Time: 1927.37 ms [2022-04-18 15:20:15 main:574] : INFO : Epoch 1875 | loss: 0.0311669 | val_loss: 0.0311879 | Time: 1888.21 ms [2022-04-18 15:20:17 main:574] : INFO : Epoch 1876 | loss: 0.0311673 | val_loss: 0.0311807 | Time: 1928.27 ms [2022-04-18 15:20:19 main:574] : INFO : Epoch 1877 | loss: 0.0311669 | val_loss: 0.0311834 | Time: 1923.19 ms [2022-04-18 15:20:21 main:574] : INFO : Epoch 1878 | loss: 0.0311655 | val_loss: 0.0311826 | Time: 1909.85 ms [2022-04-18 15:20:23 main:574] : INFO : Epoch 1879 | loss: 0.0311649 | val_loss: 0.0311814 | Time: 1886.38 ms [2022-04-18 15:20:24 main:574] : INFO : Epoch 1880 | loss: 0.0311637 | val_loss: 0.0311844 | Time: 1884.19 ms [2022-04-18 15:20:26 main:574] : INFO : Epoch 1881 | loss: 0.0311646 | val_loss: 0.0311826 | Time: 1981.25 ms [2022-04-18 15:20:28 main:574] : INFO : Epoch 1882 | loss: 0.0311617 | val_loss: 0.031183 | Time: 1901.49 ms [2022-04-18 15:20:30 main:574] : INFO : Epoch 1883 | loss: 0.0311614 | val_loss: 0.0311817 | Time: 1974.99 ms [2022-04-18 15:20:32 main:574] : INFO : Epoch 1884 | loss: 0.0311612 | val_loss: 0.0311783 | Time: 1987.4 ms [2022-04-18 15:20:34 main:574] : INFO : Epoch 1885 | loss: 0.0311625 | val_loss: 0.0311828 | Time: 1966 ms [2022-04-18 15:20:36 main:574] : INFO : Epoch 1886 | loss: 0.0311642 | val_loss: 0.0311856 | Time: 1973.96 ms [2022-04-18 15:20:38 main:574] : INFO : Epoch 1887 | loss: 0.0311642 | val_loss: 0.0311845 | Time: 1952.87 ms [2022-04-18 15:20:40 main:574] : INFO : Epoch 1888 | loss: 0.0311614 | val_loss: 0.0311813 | Time: 1923.07 ms [2022-04-18 15:20:42 main:574] : INFO : Epoch 1889 | loss: 0.0311605 | val_loss: 0.0311827 | Time: 1919.67 ms [2022-04-18 15:20:44 main:574] : INFO : Epoch 1890 | loss: 0.0311648 | val_loss: 0.0311809 | Time: 1902.19 ms [2022-04-18 15:20:46 main:574] : INFO : Epoch 1891 | loss: 0.0311651 | val_loss: 0.0311827 | Time: 1906.13 ms [2022-04-18 15:20:48 main:574] : INFO : Epoch 1892 | loss: 0.0311649 | val_loss: 0.0311827 | Time: 1930.59 ms [2022-04-18 15:20:50 main:574] : INFO : Epoch 1893 | loss: 0.0311635 | val_loss: 0.0311798 | Time: 1915.78 ms [2022-04-18 15:20:52 main:574] : INFO : Epoch 1894 | loss: 0.0311656 | val_loss: 0.0311867 | Time: 1918.27 ms [2022-04-18 15:20:54 main:574] : INFO : Epoch 1895 | loss: 0.0311755 | val_loss: 0.0311823 | Time: 1930.14 ms [2022-04-18 15:20:56 main:574] : INFO : Epoch 1896 | loss: 0.031176 | val_loss: 0.0311846 | Time: 1917.33 ms [2022-04-18 15:20:57 main:574] : INFO : Epoch 1897 | loss: 0.0311761 | val_loss: 0.0311846 | Time: 1919.21 ms [2022-04-18 15:20:59 main:574] : INFO : Epoch 1898 | loss: 0.0311762 | val_loss: 0.0311873 | Time: 1886.03 ms [2022-04-18 15:21:01 main:574] : INFO : Epoch 1899 | loss: 0.0311731 | val_loss: 0.0311835 | Time: 1943.43 ms [2022-04-18 15:21:03 main:574] : INFO : Epoch 1900 | loss: 0.0311724 | val_loss: 0.0311839 | Time: 1898.09 ms [2022-04-18 15:21:05 main:574] : INFO : Epoch 1901 | loss: 0.0311705 | val_loss: 0.0311828 | Time: 1936.72 ms [2022-04-18 15:21:07 main:574] : INFO : Epoch 1902 | loss: 0.0311694 | val_loss: 0.0311807 | Time: 1947.89 ms [2022-04-18 15:21:09 main:574] : INFO : Epoch 1903 | loss: 0.0311696 | val_loss: 0.031181 | Time: 1960.4 ms [2022-04-18 15:21:11 main:574] : INFO : Epoch 1904 | loss: 0.0311704 | val_loss: 0.0311794 | Time: 1970.5 ms [2022-04-18 15:21:13 main:574] : INFO : Epoch 1905 | loss: 0.0311689 | val_loss: 0.0311803 | Time: 1941.6 ms [2022-04-18 15:21:15 main:574] : INFO : Epoch 1906 | loss: 0.0311677 | val_loss: 0.0311792 | Time: 1959.11 ms [2022-04-18 15:21:17 main:574] : INFO : Epoch 1907 | loss: 0.0311655 | val_loss: 0.0311792 | Time: 1913.71 ms [2022-04-18 15:21:19 main:574] : INFO : Epoch 1908 | loss: 0.0311645 | val_loss: 0.0311768 | Time: 1885.32 ms [2022-04-18 15:21:21 main:574] : INFO : Epoch 1909 | loss: 0.0311639 | val_loss: 0.0311777 | Time: 1911.01 ms [2022-04-18 15:21:23 main:574] : INFO : Epoch 1910 | loss: 0.0311627 | val_loss: 0.0311775 | Time: 1968.43 ms [2022-04-18 15:21:25 main:574] : INFO : Epoch 1911 | loss: 0.0311633 | val_loss: 0.0311767 | Time: 1896.56 ms [2022-04-18 15:21:26 main:574] : INFO : Epoch 1912 | loss: 0.0311628 | val_loss: 0.0311783 | Time: 1923.32 ms [2022-04-18 15:21:28 main:574] : INFO : Epoch 1913 | loss: 0.0311635 | val_loss: 0.0311764 | Time: 1908.83 ms [2022-04-18 15:21:30 main:574] : INFO : Epoch 1914 | loss: 0.0311627 | val_loss: 0.0311761 | Time: 1902.64 ms [2022-04-18 15:21:32 main:574] : INFO : Epoch 1915 | loss: 0.0311626 | val_loss: 0.0311755 | Time: 1896.29 ms [2022-04-18 15:21:34 main:574] : INFO : Epoch 1916 | loss: 0.0311627 | val_loss: 0.0311747 | Time: 1931.89 ms [2022-04-18 15:21:36 main:574] : INFO : Epoch 1917 | loss: 0.0311622 | val_loss: 0.0311754 | Time: 1906.31 ms [2022-04-18 15:21:38 main:574] : INFO : Epoch 1918 | loss: 0.0311613 | val_loss: 0.0311775 | Time: 1895.81 ms [2022-04-18 15:21:40 main:574] : INFO : Epoch 1919 | loss: 0.0311601 | val_loss: 0.0311764 | Time: 1972.08 ms [2022-04-18 15:21:42 main:574] : INFO : Epoch 1920 | loss: 0.0311589 | val_loss: 0.0311735 | Time: 1954.39 ms [2022-04-18 15:21:44 main:574] : INFO : Epoch 1921 | loss: 0.0311585 | val_loss: 0.0311764 | Time: 1970.71 ms [2022-04-18 15:21:46 main:574] : INFO : Epoch 1922 | loss: 0.0311593 | val_loss: 0.031174 | Time: 1964.02 ms [2022-04-18 15:21:48 main:574] : INFO : Epoch 1923 | loss: 0.0311572 | val_loss: 0.0311761 | Time: 2015.77 ms [2022-04-18 15:21:50 main:574] : INFO : Epoch 1924 | loss: 0.03116 | val_loss: 0.0311743 | Time: 1959.26 ms [2022-04-18 15:21:52 main:574] : INFO : Epoch 1925 | loss: 0.0311598 | val_loss: 0.0311719 | Time: 1976.25 ms [2022-04-18 15:21:54 main:574] : INFO : Epoch 1926 | loss: 0.0311582 | val_loss: 0.0311719 | Time: 1933.65 ms [2022-04-18 15:21:56 main:574] : INFO : Epoch 1927 | loss: 0.031158 | val_loss: 0.0311718 | Time: 1907.41 ms [2022-04-18 15:21:58 main:574] : INFO : Epoch 1928 | loss: 0.0311591 | val_loss: 0.0311715 | Time: 1926.7 ms [2022-04-18 15:21:59 main:574] : INFO : Epoch 1929 | loss: 0.0311614 | val_loss: 0.0311701 | Time: 1936.49 ms [2022-04-18 15:22:01 main:574] : INFO : Epoch 1930 | loss: 0.0311608 | val_loss: 0.0311703 | Time: 1911.24 ms [2022-04-18 15:22:03 main:574] : INFO : Epoch 1931 | loss: 0.0311587 | val_loss: 0.0311679 | Time: 1876.88 ms [2022-04-18 15:22:05 main:574] : INFO : Epoch 1932 | loss: 0.0311594 | val_loss: 0.0311701 | Time: 1903.22 ms [2022-04-18 15:22:07 main:574] : INFO : Epoch 1933 | loss: 0.0311565 | val_loss: 0.0311706 | Time: 1926.74 ms [2022-04-18 15:22:09 main:574] : INFO : Epoch 1934 | loss: 0.031157 | val_loss: 0.0311749 | Time: 1882.21 ms [2022-04-18 15:22:11 main:574] : INFO : Epoch 1935 | loss: 0.0311587 | val_loss: 0.0311758 | Time: 1920.29 ms [2022-04-18 15:22:13 main:574] : INFO : Epoch 1936 | loss: 0.0311582 | val_loss: 0.0311716 | Time: 1949.51 ms [2022-04-18 15:22:15 main:574] : INFO : Epoch 1937 | loss: 0.0311553 | val_loss: 0.0311735 | Time: 1944.02 ms [2022-04-18 15:22:17 main:574] : INFO : Epoch 1938 | loss: 0.0311543 | val_loss: 0.031171 | Time: 1935.63 ms [2022-04-18 15:22:19 main:574] : INFO : Epoch 1939 | loss: 0.0311538 | val_loss: 0.0311732 | Time: 1984.96 ms [2022-04-18 15:22:21 main:574] : INFO : Epoch 1940 | loss: 0.031153 | val_loss: 0.031172 | Time: 1877.7 ms [2022-04-18 15:22:23 main:574] : INFO : Epoch 1941 | loss: 0.0311528 | val_loss: 0.0311688 | Time: 1938.7 ms [2022-04-18 15:22:24 main:574] : INFO : Epoch 1942 | loss: 0.0311515 | val_loss: 0.0311697 | Time: 1898.13 ms [2022-04-18 15:22:26 main:574] : INFO : Epoch 1943 | loss: 0.0311538 | val_loss: 0.0311721 | Time: 1939.38 ms [2022-04-18 15:22:28 main:574] : INFO : Epoch 1944 | loss: 0.031155 | val_loss: 0.0311681 | Time: 1899.04 ms [2022-04-18 15:22:30 main:574] : INFO : Epoch 1945 | loss: 0.0311535 | val_loss: 0.0311729 | Time: 1950.58 ms [2022-04-18 15:22:32 main:574] : INFO : Epoch 1946 | loss: 0.0311542 | val_loss: 0.0311692 | Time: 1937.72 ms [2022-04-18 15:22:34 main:574] : INFO : Epoch 1947 | loss: 0.031154 | val_loss: 0.0311708 | Time: 1900.04 ms [2022-04-18 15:22:36 main:574] : INFO : Epoch 1948 | loss: 0.0311556 | val_loss: 0.0311679 | Time: 1910.27 ms [2022-04-18 15:22:38 main:574] : INFO : Epoch 1949 | loss: 0.0311527 | val_loss: 0.0311665 | Time: 1918.24 ms [2022-04-18 15:22:40 main:574] : INFO : Epoch 1950 | loss: 0.0311525 | val_loss: 0.03117 | Time: 1914.94 ms [2022-04-18 15:22:42 main:574] : INFO : Epoch 1951 | loss: 0.0311528 | val_loss: 0.0311681 | Time: 1895.23 ms [2022-04-18 15:22:44 main:574] : INFO : Epoch 1952 | loss: 0.0311507 | val_loss: 0.0311673 | Time: 1893.61 ms [2022-04-18 15:22:46 main:574] : INFO : Epoch 1953 | loss: 0.0311507 | val_loss: 0.0311713 | Time: 1882.68 ms [2022-04-18 15:22:48 main:574] : INFO : Epoch 1954 | loss: 0.0311532 | val_loss: 0.0311708 | Time: 1960.65 ms [2022-04-18 15:22:50 main:574] : INFO : Epoch 1955 | loss: 0.031152 | val_loss: 0.0311719 | Time: 1947.23 ms [2022-04-18 15:22:51 main:574] : INFO : Epoch 1956 | loss: 0.0311546 | val_loss: 0.0311735 | Time: 1968.21 ms [2022-04-18 15:22:53 main:574] : INFO : Epoch 1957 | loss: 0.0311539 | val_loss: 0.0311718 | Time: 1937.59 ms [2022-04-18 15:22:55 main:574] : INFO : Epoch 1958 | loss: 0.0311676 | val_loss: 0.0311772 | Time: 1903.18 ms [2022-04-18 15:22:57 main:574] : INFO : Epoch 1959 | loss: 0.031169 | val_loss: 0.0311776 | Time: 1982.46 ms [2022-04-18 15:22:59 main:574] : INFO : Epoch 1960 | loss: 0.0315687 | val_loss: 0.0334735 | Time: 2009.99 ms [2022-04-18 15:23:01 main:574] : INFO : Epoch 1961 | loss: 0.0335607 | val_loss: 0.0315515 | Time: 1999.21 ms [2022-04-18 15:23:03 main:574] : INFO : Epoch 1962 | loss: 0.0316613 | val_loss: 0.0313733 | Time: 1923.11 ms [2022-04-18 15:23:05 main:574] : INFO : Epoch 1963 | loss: 0.0312609 | val_loss: 0.0312143 | Time: 1937.26 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1650) [2022-04-18 17:46:18 main:435] : INFO : Set logging level to 1 [2022-04-18 17:46:18 main:441] : INFO : Running in BOINC Client mode [2022-04-18 17:46:18 main:444] : INFO : Resolving all filenames [2022-04-18 17:46:18 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-18 17:46:18 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-18 17:46:18 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-18 17:46:18 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-18 17:46:18 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-18 17:46:18 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-18 17:46:18 main:474] : INFO : Configuration: [2022-04-18 17:46:18 main:475] : INFO : Model type: GRU [2022-04-18 17:46:18 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-18 17:46:18 main:477] : INFO : Max Epochs: 2048 [2022-04-18 17:46:18 main:478] : INFO : Batch Size: 128 [2022-04-18 17:46:18 main:479] : INFO : Learning Rate: 0.01 [2022-04-18 17:46:18 main:480] : INFO : Patience: 10 [2022-04-18 17:46:18 main:481] : INFO : Hidden Width: 12 [2022-04-18 17:46:18 main:482] : INFO : # Recurrent Layers: 4 [2022-04-18 17:46:18 main:483] : INFO : # Backend Layers: 4 [2022-04-18 17:46:18 main:484] : INFO : # Threads: 1 [2022-04-18 17:46:18 main:486] : INFO : Preparing Dataset [2022-04-18 17:46:18 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-18 17:46:18 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-18 17:46:20 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-18 17:46:20 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-18 17:46:20 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-18 17:46:20 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-18 17:46:20 main:494] : INFO : Creating Model [2022-04-18 17:46:20 main:507] : INFO : Preparing config file [2022-04-18 17:46:20 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-18 17:46:20 main:512] : INFO : Loading config [2022-04-18 17:46:20 main:514] : INFO : Loading state [2022-04-18 17:46:22 main:559] : INFO : Loading DataLoader into Memory [2022-04-18 17:46:22 main:562] : INFO : Starting Training [2022-04-18 17:46:24 main:574] : INFO : Epoch 1951 | loss: 0.0311801 | val_loss: 0.0311708 | Time: 2534.7 ms [2022-04-18 17:46:26 main:574] : INFO : Epoch 1952 | loss: 0.0311576 | val_loss: 0.0311696 | Time: 1883.9 ms [2022-04-18 17:46:28 main:574] : INFO : Epoch 1953 | loss: 0.0311571 | val_loss: 0.0311728 | Time: 1875.16 ms [2022-04-18 17:46:30 main:574] : INFO : Epoch 1954 | loss: 0.0311593 | val_loss: 0.0311687 | Time: 1905.95 ms [2022-04-18 17:46:32 main:574] : INFO : Epoch 1955 | loss: 0.0311583 | val_loss: 0.0311706 | Time: 1896.36 ms [2022-04-18 17:46:34 main:574] : INFO : Epoch 1956 | loss: 0.0311593 | val_loss: 0.0311688 | Time: 1886.04 ms [2022-04-18 17:46:35 main:574] : INFO : Epoch 1957 | loss: 0.0311562 | val_loss: 0.0311632 | Time: 1911.03 ms [2022-04-18 17:46:37 main:574] : INFO : Epoch 1958 | loss: 0.0311564 | val_loss: 0.0311664 | Time: 1893.65 ms [2022-04-18 17:46:39 main:574] : INFO : Epoch 1959 | loss: 0.0311601 | val_loss: 0.0311764 | Time: 1899.98 ms [2022-04-18 17:46:41 main:574] : INFO : Epoch 1960 | loss: 0.0311703 | val_loss: 0.0311716 | Time: 1891.21 ms [2022-04-18 17:46:43 main:574] : INFO : Epoch 1961 | loss: 0.0311682 | val_loss: 0.0311762 | Time: 1900.59 ms [2022-04-18 17:46:45 main:574] : INFO : Epoch 1962 | loss: 0.0311664 | val_loss: 0.0311748 | Time: 1927.57 ms [2022-04-18 17:46:47 main:574] : INFO : Epoch 1963 | loss: 0.0311642 | val_loss: 0.0311739 | Time: 1882 ms [2022-04-18 17:46:49 main:574] : INFO : Epoch 1964 | loss: 0.0311631 | val_loss: 0.0311719 | Time: 1906.06 ms [2022-04-18 17:46:51 main:574] : INFO : Epoch 1965 | loss: 0.0311618 | val_loss: 0.0311727 | Time: 1898.01 ms [2022-04-18 17:46:53 main:574] : INFO : Epoch 1966 | loss: 0.0311605 | val_loss: 0.0311738 | Time: 1928.44 ms [2022-04-18 17:46:55 main:574] : INFO : Epoch 1967 | loss: 0.0311603 | val_loss: 0.0311719 | Time: 1892.55 ms [2022-04-18 17:46:56 main:574] : INFO : Epoch 1968 | loss: 0.0311585 | val_loss: 0.0311707 | Time: 1902.94 ms [2022-04-18 17:46:58 main:574] : INFO : Epoch 1969 | loss: 0.0311584 | val_loss: 0.0311778 | Time: 1902.13 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1650) [2022-04-18 18:20:37 main:435] : INFO : Set logging level to 1 [2022-04-18 18:20:37 main:441] : INFO : Running in BOINC Client mode [2022-04-18 18:20:37 main:444] : INFO : Resolving all filenames [2022-04-18 18:20:37 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-18 18:20:37 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-18 18:20:37 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-18 18:20:37 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-18 18:20:37 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-18 18:20:37 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-18 18:20:37 main:474] : INFO : Configuration: [2022-04-18 18:20:37 main:475] : INFO : Model type: GRU [2022-04-18 18:20:37 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-18 18:20:37 main:477] : INFO : Max Epochs: 2048 [2022-04-18 18:20:37 main:478] : INFO : Batch Size: 128 [2022-04-18 18:20:37 main:479] : INFO : Learning Rate: 0.01 [2022-04-18 18:20:37 main:480] : INFO : Patience: 10 [2022-04-18 18:20:37 main:481] : INFO : Hidden Width: 12 [2022-04-18 18:20:37 main:482] : INFO : # Recurrent Layers: 4 [2022-04-18 18:20:37 main:483] : INFO : # Backend Layers: 4 [2022-04-18 18:20:37 main:484] : INFO : # Threads: 1 [2022-04-18 18:20:37 main:486] : INFO : Preparing Dataset [2022-04-18 18:20:37 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-18 18:20:38 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-18 18:20:39 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-18 18:20:39 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-18 18:20:40 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-18 18:20:40 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-18 18:20:40 main:494] : INFO : Creating Model [2022-04-18 18:20:40 main:507] : INFO : Preparing config file [2022-04-18 18:20:40 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-18 18:20:40 main:512] : INFO : Loading config [2022-04-18 18:20:40 main:514] : INFO : Loading state [2022-04-18 18:20:41 main:559] : INFO : Loading DataLoader into Memory [2022-04-18 18:20:41 main:562] : INFO : Starting Training [2022-04-18 18:20:43 main:574] : INFO : Epoch 1951 | loss: 0.031179 | val_loss: 0.0311708 | Time: 2399.94 ms [2022-04-18 18:20:45 main:574] : INFO : Epoch 1952 | loss: 0.0311609 | val_loss: 0.0311686 | Time: 1891.4 ms [2022-04-18 18:20:47 main:574] : INFO : Epoch 1953 | loss: 0.0311583 | val_loss: 0.0311657 | Time: 1899.44 ms [2022-04-18 18:20:49 main:574] : INFO : Epoch 1954 | loss: 0.0311583 | val_loss: 0.0311651 | Time: 1869.79 ms [2022-04-18 18:20:51 main:574] : INFO : Epoch 1955 | loss: 0.03116 | val_loss: 0.0311693 | Time: 1887.13 ms [2022-04-18 18:20:53 main:574] : INFO : Epoch 1956 | loss: 0.0311585 | val_loss: 0.0311694 | Time: 1911.96 ms [2022-04-18 18:20:55 main:574] : INFO : Epoch 1957 | loss: 0.0311552 | val_loss: 0.0311693 | Time: 1909.32 ms [2022-04-18 18:20:57 main:574] : INFO : Epoch 1958 | loss: 0.0311533 | val_loss: 0.0311711 | Time: 1881.17 ms [2022-04-18 18:20:59 main:574] : INFO : Epoch 1959 | loss: 0.0311541 | val_loss: 0.0311706 | Time: 1888.41 ms [2022-04-18 18:21:00 main:574] : INFO : Epoch 1960 | loss: 0.0311543 | val_loss: 0.0311643 | Time: 1905.3 ms [2022-04-18 18:21:02 main:574] : INFO : Epoch 1961 | loss: 0.0311525 | val_loss: 0.0311651 | Time: 1924.65 ms [2022-04-18 18:21:04 main:574] : INFO : Epoch 1962 | loss: 0.0311521 | val_loss: 0.0311634 | Time: 1878.59 ms [2022-04-18 18:21:06 main:574] : INFO : Epoch 1963 | loss: 0.0311509 | val_loss: 0.0311648 | Time: 1913.34 ms [2022-04-18 18:21:08 main:574] : INFO : Epoch 1964 | loss: 0.0311525 | val_loss: 0.0311653 | Time: 1928.75 ms [2022-04-18 18:21:10 main:574] : INFO : Epoch 1965 | loss: 0.0311522 | val_loss: 0.0311708 | Time: 1934.45 ms [2022-04-18 18:21:12 main:574] : INFO : Epoch 1966 | loss: 0.0311505 | val_loss: 0.0311684 | Time: 1924.12 ms [2022-04-18 18:21:14 main:574] : INFO : Epoch 1967 | loss: 0.031156 | val_loss: 0.0311714 | Time: 1915.83 ms [2022-04-18 18:21:16 main:574] : INFO : Epoch 1968 | loss: 0.0311603 | val_loss: 0.0311716 | Time: 1922.99 ms [2022-04-18 18:21:18 main:574] : INFO : Epoch 1969 | loss: 0.0311582 | val_loss: 0.0311697 | Time: 1908.93 ms [2022-04-18 18:21:20 main:574] : INFO : Epoch 1970 | loss: 0.0311601 | val_loss: 0.0311653 | Time: 1895.82 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1650) [2022-04-18 18:25:45 main:435] : INFO : Set logging level to 1 [2022-04-18 18:25:45 main:441] : INFO : Running in BOINC Client mode [2022-04-18 18:25:45 main:444] : INFO : Resolving all filenames [2022-04-18 18:25:45 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-18 18:25:45 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-18 18:25:45 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-18 18:25:45 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-18 18:25:45 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-18 18:25:45 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-18 18:25:45 main:474] : INFO : Configuration: [2022-04-18 18:25:45 main:475] : INFO : Model type: GRU [2022-04-18 18:25:45 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-18 18:25:45 main:477] : INFO : Max Epochs: 2048 [2022-04-18 18:25:45 main:478] : INFO : Batch Size: 128 [2022-04-18 18:25:45 main:479] : INFO : Learning Rate: 0.01 [2022-04-18 18:25:45 main:480] : INFO : Patience: 10 [2022-04-18 18:25:45 main:481] : INFO : Hidden Width: 12 [2022-04-18 18:25:45 main:482] : INFO : # Recurrent Layers: 4 [2022-04-18 18:25:45 main:483] : INFO : # Backend Layers: 4 [2022-04-18 18:25:45 main:484] : INFO : # Threads: 1 [2022-04-18 18:25:45 main:486] : INFO : Preparing Dataset [2022-04-18 18:25:45 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-18 18:25:45 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-18 18:25:46 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-18 18:25:47 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-18 18:25:47 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-18 18:25:47 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-18 18:25:47 main:494] : INFO : Creating Model [2022-04-18 18:25:47 main:507] : INFO : Preparing config file [2022-04-18 18:25:47 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-18 18:25:47 main:512] : INFO : Loading config [2022-04-18 18:25:47 main:514] : INFO : Loading state [2022-04-18 18:25:48 main:559] : INFO : Loading DataLoader into Memory [2022-04-18 18:25:48 main:562] : INFO : Starting Training [2022-04-18 18:25:50 main:574] : INFO : Epoch 1951 | loss: 0.0311813 | val_loss: 0.0311718 | Time: 2331.94 ms [2022-04-18 18:25:52 main:574] : INFO : Epoch 1952 | loss: 0.0311601 | val_loss: 0.031165 | Time: 1864.65 ms [2022-04-18 18:25:54 main:574] : INFO : Epoch 1953 | loss: 0.0311567 | val_loss: 0.0311652 | Time: 1882.24 ms [2022-04-18 18:25:56 main:574] : INFO : Epoch 1954 | loss: 0.0311556 | val_loss: 0.0311708 | Time: 1905.51 ms [2022-04-18 18:25:58 main:574] : INFO : Epoch 1955 | loss: 0.0311544 | val_loss: 0.0311674 | Time: 1880.76 ms [2022-04-18 18:26:00 main:574] : INFO : Epoch 1956 | loss: 0.0311576 | val_loss: 0.0311697 | Time: 1870.51 ms [2022-04-18 18:26:01 main:574] : INFO : Epoch 1957 | loss: 0.0311597 | val_loss: 0.0311716 | Time: 1887.2 ms [2022-04-18 18:26:03 main:574] : INFO : Epoch 1958 | loss: 0.0311576 | val_loss: 0.0311682 | Time: 1885.07 ms [2022-04-18 18:26:05 main:574] : INFO : Epoch 1959 | loss: 0.0311558 | val_loss: 0.0311691 | Time: 1922.91 ms [2022-04-18 18:26:07 main:574] : INFO : Epoch 1960 | loss: 0.0311543 | val_loss: 0.0311682 | Time: 1880.23 ms [2022-04-18 18:26:09 main:574] : INFO : Epoch 1961 | loss: 0.0311539 | val_loss: 0.0311754 | Time: 1910.56 ms [2022-04-18 18:26:11 main:574] : INFO : Epoch 1962 | loss: 0.0311543 | val_loss: 0.0311631 | Time: 1884.69 ms [2022-04-18 18:26:13 main:574] : INFO : Epoch 1963 | loss: 0.0311526 | val_loss: 0.0311647 | Time: 1883.25 ms [2022-04-18 18:26:15 main:574] : INFO : Epoch 1964 | loss: 0.0311517 | val_loss: 0.0311675 | Time: 1919.37 ms [2022-04-18 18:26:17 main:574] : INFO : Epoch 1965 | loss: 0.0311551 | val_loss: 0.0311684 | Time: 1898.64 ms [2022-04-18 18:26:19 main:574] : INFO : Epoch 1966 | loss: 0.031153 | val_loss: 0.0311669 | Time: 1902.22 ms [2022-04-18 18:26:21 main:574] : INFO : Epoch 1967 | loss: 0.0311534 | val_loss: 0.0311657 | Time: 1918.96 ms [2022-04-18 18:26:22 main:574] : INFO : Epoch 1968 | loss: 0.0311507 | val_loss: 0.0311632 | Time: 1878.19 ms [2022-04-18 18:26:24 main:574] : INFO : Epoch 1969 | loss: 0.0311504 | val_loss: 0.0311628 | Time: 1882.93 ms [2022-04-18 18:26:26 main:574] : INFO : Epoch 1970 | loss: 0.0311499 | val_loss: 0.0311654 | Time: 1911.97 ms [2022-04-18 18:26:28 main:574] : INFO : Epoch 1971 | loss: 0.031151 | val_loss: 0.0311664 | Time: 1902.85 ms [2022-04-18 18:26:30 main:574] : INFO : Epoch 1972 | loss: 0.0311541 | val_loss: 0.0311661 | Time: 1878.76 ms [2022-04-18 18:26:32 main:574] : INFO : Epoch 1973 | loss: 0.0311575 | val_loss: 0.0311643 | Time: 1890.77 ms [2022-04-18 18:26:34 main:574] : INFO : Epoch 1974 | loss: 0.0311565 | val_loss: 0.0311639 | Time: 1927.26 ms [2022-04-18 18:26:36 main:574] : INFO : Epoch 1975 | loss: 0.0311571 | val_loss: 0.0311674 | Time: 1880.09 ms [2022-04-18 18:26:38 main:574] : INFO : Epoch 1976 | loss: 0.0311574 | val_loss: 0.0311657 | Time: 1869.5 ms [2022-04-18 18:26:39 main:574] : INFO : Epoch 1977 | loss: 0.0311561 | val_loss: 0.0311686 | Time: 1896.39 ms [2022-04-18 18:26:41 main:574] : INFO : Epoch 1978 | loss: 0.0311554 | val_loss: 0.0311669 | Time: 1876.66 ms [2022-04-18 18:26:43 main:574] : INFO : Epoch 1979 | loss: 0.0311562 | val_loss: 0.0311655 | Time: 1911.76 ms [2022-04-18 18:26:45 main:574] : INFO : Epoch 1980 | loss: 0.0311555 | val_loss: 0.031165 | Time: 1966.27 ms [2022-04-18 18:26:47 main:574] : INFO : Epoch 1981 | loss: 0.031156 | val_loss: 0.0311695 | Time: 1961.58 ms [2022-04-18 18:26:49 main:574] : INFO : Epoch 1982 | loss: 0.0311557 | val_loss: 0.0311666 | Time: 1886.3 ms [2022-04-18 18:26:51 main:574] : INFO : Epoch 1983 | loss: 0.0311514 | val_loss: 0.0311641 | Time: 1903.66 ms [2022-04-18 18:26:53 main:574] : INFO : Epoch 1984 | loss: 0.0311516 | val_loss: 0.0311651 | Time: 1914.61 ms [2022-04-18 18:26:55 main:574] : INFO : Epoch 1985 | loss: 0.0311497 | val_loss: 0.0311635 | Time: 1911.03 ms [2022-04-18 18:26:57 main:574] : INFO : Epoch 1986 | loss: 0.0311504 | val_loss: 0.0311695 | Time: 1912.32 ms [2022-04-18 18:26:59 main:574] : INFO : Epoch 1987 | loss: 0.0311499 | val_loss: 0.0311621 | Time: 1893.64 ms [2022-04-18 18:27:01 main:574] : INFO : Epoch 1988 | loss: 0.0311515 | val_loss: 0.0311655 | Time: 1918.87 ms [2022-04-18 18:27:03 main:574] : INFO : Epoch 1989 | loss: 0.0311523 | val_loss: 0.0311681 | Time: 1888.57 ms [2022-04-18 18:27:04 main:574] : INFO : Epoch 1990 | loss: 0.0311535 | val_loss: 0.0311663 | Time: 1904.73 ms [2022-04-18 18:27:06 main:574] : INFO : Epoch 1991 | loss: 0.0311486 | val_loss: 0.0311685 | Time: 1912.43 ms [2022-04-18 18:27:08 main:574] : INFO : Epoch 1992 | loss: 0.0311522 | val_loss: 0.0311734 | Time: 1856.89 ms [2022-04-18 18:27:10 main:574] : INFO : Epoch 1993 | loss: 0.0311534 | val_loss: 0.0311701 | Time: 1900.46 ms [2022-04-18 18:27:12 main:574] : INFO : Epoch 1994 | loss: 0.0311511 | val_loss: 0.0311732 | Time: 1921.32 ms [2022-04-18 18:27:14 main:574] : INFO : Epoch 1995 | loss: 0.031151 | val_loss: 0.0311707 | Time: 1885.12 ms [2022-04-18 18:27:16 main:574] : INFO : Epoch 1996 | loss: 0.0311567 | val_loss: 0.0311687 | Time: 1898.99 ms [2022-04-18 18:27:18 main:574] : INFO : Epoch 1997 | loss: 0.0311557 | val_loss: 0.0311731 | Time: 1934.65 ms [2022-04-18 18:27:20 main:574] : INFO : Epoch 1998 | loss: 0.0311544 | val_loss: 0.0311698 | Time: 1891.8 ms [2022-04-18 18:27:22 main:574] : INFO : Epoch 1999 | loss: 0.0311507 | val_loss: 0.0311662 | Time: 1920.74 ms [2022-04-18 18:27:23 main:574] : INFO : Epoch 2000 | loss: 0.0311484 | val_loss: 0.0311648 | Time: 1892.16 ms [2022-04-18 18:27:25 main:574] : INFO : Epoch 2001 | loss: 0.0311487 | val_loss: 0.0311723 | Time: 1883.79 ms [2022-04-18 18:27:27 main:574] : INFO : Epoch 2002 | loss: 0.0311535 | val_loss: 0.0311729 | Time: 1881.8 ms [2022-04-18 18:27:29 main:574] : INFO : Epoch 2003 | loss: 0.0311537 | val_loss: 0.0311668 | Time: 1895.21 ms [2022-04-18 18:27:31 main:574] : INFO : Epoch 2004 | loss: 0.0311507 | val_loss: 0.031168 | Time: 1904.39 ms [2022-04-18 18:27:33 main:574] : INFO : Epoch 2005 | loss: 0.0311511 | val_loss: 0.0311644 | Time: 1912.41 ms [2022-04-18 18:27:35 main:574] : INFO : Epoch 2006 | loss: 0.0311488 | val_loss: 0.0311631 | Time: 1890.49 ms [2022-04-18 18:27:37 main:574] : INFO : Epoch 2007 | loss: 0.0311486 | val_loss: 0.0311648 | Time: 1936.7 ms [2022-04-18 18:27:39 main:574] : INFO : Epoch 2008 | loss: 0.0311491 | val_loss: 0.0311623 | Time: 1899.89 ms [2022-04-18 18:27:41 main:574] : INFO : Epoch 2009 | loss: 0.0311505 | val_loss: 0.0311593 | Time: 1900.3 ms [2022-04-18 18:27:43 main:574] : INFO : Epoch 2010 | loss: 0.0311507 | val_loss: 0.0311649 | Time: 1895.1 ms [2022-04-18 18:27:44 main:574] : INFO : Epoch 2011 | loss: 0.0311593 | val_loss: 0.0311684 | Time: 1897.32 ms [2022-04-18 18:27:46 main:574] : INFO : Epoch 2012 | loss: 0.0311585 | val_loss: 0.0311702 | Time: 1955.77 ms [2022-04-18 18:27:48 main:574] : INFO : Epoch 2013 | loss: 0.0311549 | val_loss: 0.0311681 | Time: 1964.45 ms [2022-04-18 18:27:50 main:574] : INFO : Epoch 2014 | loss: 0.031152 | val_loss: 0.0311645 | Time: 1884.66 ms [2022-04-18 18:27:52 main:574] : INFO : Epoch 2015 | loss: 0.0311501 | val_loss: 0.0311613 | Time: 1893.01 ms [2022-04-18 18:27:54 main:574] : INFO : Epoch 2016 | loss: 0.0311504 | val_loss: 0.031162 | Time: 1884.84 ms [2022-04-18 18:27:56 main:574] : INFO : Epoch 2017 | loss: 0.0311484 | val_loss: 0.0311617 | Time: 1889.47 ms [2022-04-18 18:27:58 main:574] : INFO : Epoch 2018 | loss: 0.0311482 | val_loss: 0.0311613 | Time: 1894.41 ms [2022-04-18 18:28:00 main:574] : INFO : Epoch 2019 | loss: 0.0311477 | val_loss: 0.0311621 | Time: 1952.91 ms [2022-04-18 18:28:02 main:574] : INFO : Epoch 2020 | loss: 0.03115 | val_loss: 0.0311615 | Time: 1887.48 ms [2022-04-18 18:28:04 main:574] : INFO : Epoch 2021 | loss: 0.0311493 | val_loss: 0.0311644 | Time: 1904.62 ms [2022-04-18 18:28:05 main:574] : INFO : Epoch 2022 | loss: 0.0311604 | val_loss: 0.0311698 | Time: 1884.6 ms [2022-04-18 18:28:07 main:574] : INFO : Epoch 2023 | loss: 0.0311602 | val_loss: 0.0311674 | Time: 1879.03 ms [2022-04-18 18:28:09 main:574] : INFO : Epoch 2024 | loss: 0.0311575 | val_loss: 0.0311669 | Time: 1872.44 ms [2022-04-18 18:28:11 main:574] : INFO : Epoch 2025 | loss: 0.0311553 | val_loss: 0.0311673 | Time: 1913.43 ms [2022-04-18 18:28:13 main:574] : INFO : Epoch 2026 | loss: 0.0311546 | val_loss: 0.0311649 | Time: 1879.96 ms [2022-04-18 18:28:15 main:574] : INFO : Epoch 2027 | loss: 0.0311532 | val_loss: 0.0311684 | Time: 1913.48 ms [2022-04-18 18:28:17 main:574] : INFO : Epoch 2028 | loss: 0.0311534 | val_loss: 0.0311642 | Time: 1917.68 ms [2022-04-18 18:28:19 main:574] : INFO : Epoch 2029 | loss: 0.0311511 | val_loss: 0.0311615 | Time: 1907.03 ms [2022-04-18 18:28:21 main:574] : INFO : Epoch 2030 | loss: 0.0311498 | val_loss: 0.0311618 | Time: 1865.68 ms [2022-04-18 18:28:23 main:574] : INFO : Epoch 2031 | loss: 0.0311492 | val_loss: 0.031162 | Time: 1913.51 ms [2022-04-18 18:28:25 main:574] : INFO : Epoch 2032 | loss: 0.0311487 | val_loss: 0.0311575 | Time: 1930.91 ms [2022-04-18 18:28:26 main:574] : INFO : Epoch 2033 | loss: 0.0311475 | val_loss: 0.0311613 | Time: 1952.14 ms [2022-04-18 18:28:28 main:574] : INFO : Epoch 2034 | loss: 0.031147 | val_loss: 0.0311624 | Time: 1910.21 ms [2022-04-18 18:28:30 main:574] : INFO : Epoch 2035 | loss: 0.0311464 | val_loss: 0.0311622 | Time: 1934 ms [2022-04-18 18:28:32 main:574] : INFO : Epoch 2036 | loss: 0.031144 | val_loss: 0.0311623 | Time: 1950 ms [2022-04-18 18:28:34 main:574] : INFO : Epoch 2037 | loss: 0.0311434 | val_loss: 0.0311629 | Time: 1904.62 ms [2022-04-18 18:28:36 main:574] : INFO : Epoch 2038 | loss: 0.0311449 | val_loss: 0.0311634 | Time: 1942.03 ms [2022-04-18 18:28:38 main:574] : INFO : Epoch 2039 | loss: 0.0311438 | val_loss: 0.0311624 | Time: 1889.78 ms [2022-04-18 18:28:40 main:574] : INFO : Epoch 2040 | loss: 0.0311443 | val_loss: 0.0311644 | Time: 1915.58 ms [2022-04-18 18:28:42 main:574] : INFO : Epoch 2041 | loss: 0.0311434 | val_loss: 0.0311608 | Time: 1865.32 ms [2022-04-18 18:28:44 main:574] : INFO : Epoch 2042 | loss: 0.0311472 | val_loss: 0.0311621 | Time: 1893 ms [2022-04-18 18:28:46 main:574] : INFO : Epoch 2043 | loss: 0.0311716 | val_loss: 0.0311963 | Time: 1890.38 ms [2022-04-18 18:28:48 main:574] : INFO : Epoch 2044 | loss: 0.0311914 | val_loss: 0.0311947 | Time: 1913.58 ms [2022-04-18 18:28:49 main:574] : INFO : Epoch 2045 | loss: 0.0311866 | val_loss: 0.0311877 | Time: 1944.12 ms [2022-04-18 18:28:51 main:574] : INFO : Epoch 2046 | loss: 0.0311792 | val_loss: 0.0311821 | Time: 1884.89 ms [2022-04-18 18:28:53 main:574] : INFO : Epoch 2047 | loss: 0.0311732 | val_loss: 0.0311798 | Time: 1883.16 ms [2022-04-18 18:28:55 main:574] : INFO : Epoch 2048 | loss: 0.0311682 | val_loss: 0.0311827 | Time: 1927.29 ms [2022-04-18 18:28:55 main:597] : INFO : Saving trained model to model-final.pt, val_loss 0.0311827 [2022-04-18 18:28:55 main:603] : INFO : Saving end state to config to file [2022-04-18 18:28:55 main:608] : INFO : Success, exiting.. 18:28:55 (9012): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)