Task 12516722
| Name | ParityModified-1639953856-19952-3-0_1 |
| Workunit | 8704184 |
| Created | 4 Mar 2022, 7:03:02 UTC |
| Sent | 4 Mar 2022, 7:35:04 UTC |
| Report deadline | 12 Mar 2022, 7:35:04 UTC |
| Received | 4 Apr 2022, 7:24:17 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 9526 |
| Run time | 3 hours 50 min 31 sec |
| CPU time | 2 hours 30 min 24 sec |
| Validate state | Task was reported too late to validate |
| Credit | 0.00 |
| Device peak FLOPS | 1,867.07 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.62 GB |
| Peak swap size | 3.59 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.11</core_client_version> <![CDATA[ <stderr_txt> | loss: 0.0311868 | val_loss: 0.0311887 | Time: 4735.01 ms [2022-03-29 09:17:33 main:574] : INFO : Epoch 1786 | loss: 0.0311864 | val_loss: 0.0311882 | Time: 4547.86 ms [2022-03-29 09:17:39 main:574] : INFO : Epoch 1787 | loss: 0.0311893 | val_loss: 0.0311897 | Time: 4611.84 ms [2022-03-29 09:17:44 main:574] : INFO : Epoch 1788 | loss: 0.0311855 | val_loss: 0.0311879 | Time: 5239.49 ms [2022-03-29 09:17:50 main:574] : INFO : Epoch 1789 | loss: 0.0311845 | val_loss: 0.0311868 | Time: 5163.49 ms [2022-03-29 09:17:55 main:574] : INFO : Epoch 1790 | loss: 0.0311841 | val_loss: 0.0311874 | Time: 4252.29 ms [2022-03-29 09:17:59 main:574] : INFO : Epoch 1791 | loss: 0.0311846 | val_loss: 0.0311873 | Time: 4414.11 ms [2022-03-29 09:18:04 main:574] : INFO : Epoch 1792 | loss: 0.031185 | val_loss: 0.0311869 | Time: 4333.14 ms [2022-03-29 09:18:09 main:574] : INFO : Epoch 1793 | loss: 0.0311845 | val_loss: 0.0311882 | Time: 4410.89 ms [2022-03-29 09:18:14 main:574] : INFO : Epoch 1794 | loss: 0.0311853 | val_loss: 0.0311873 | Time: 4328.31 ms [2022-03-29 09:18:19 main:574] : INFO : Epoch 1795 | loss: 0.0311856 | val_loss: 0.0311894 | Time: 4412.33 ms [2022-03-29 09:18:24 main:574] : INFO : Epoch 1796 | loss: 0.0311864 | val_loss: 0.0311873 | Time: 4421.76 ms [2022-03-29 09:18:29 main:574] : INFO : Epoch 1797 | loss: 0.0311893 | val_loss: 0.0311901 | Time: 4427.91 ms [2022-03-29 09:18:34 main:574] : INFO : Epoch 1798 | loss: 0.0311868 | val_loss: 0.0311878 | Time: 4772.37 ms [2022-03-29 09:18:39 main:574] : INFO : Epoch 1799 | loss: 0.0311866 | val_loss: 0.0311884 | Time: 4609.34 ms [2022-03-29 09:18:45 main:574] : INFO : Epoch 1800 | loss: 0.0311834 | val_loss: 0.0311871 | Time: 5098.53 ms [2022-03-29 09:18:50 main:574] : INFO : Epoch 1801 | loss: 0.031183 | val_loss: 0.0311869 | Time: 5019.09 ms [2022-03-29 09:18:55 main:574] : INFO : Epoch 1802 | loss: 0.0311838 | val_loss: 0.03119 | Time: 4791.51 ms [2022-03-29 09:19:00 main:574] : INFO : Epoch 1803 | loss: 0.031184 | val_loss: 0.0311878 | Time: 4428.5 ms [2022-03-29 09:19:05 main:574] : INFO : Epoch 1804 | loss: 0.031185 | val_loss: 0.0311875 | Time: 4359.58 ms [2022-03-29 09:19:10 main:574] : INFO : Epoch 1805 | loss: 0.0311915 | val_loss: 0.0312394 | Time: 4354.05 ms [2022-03-29 09:19:15 main:574] : INFO : Epoch 1806 | loss: 0.0322463 | val_loss: 0.0320224 | Time: 4349.05 ms [2022-03-29 09:19:19 main:574] : INFO : Epoch 1807 | loss: 0.0316597 | val_loss: 0.0316782 | Time: 4322.41 ms [2022-03-29 09:19:24 main:574] : INFO : Epoch 1808 | loss: 0.031429 | val_loss: 0.0312665 | Time: 4443.28 ms [2022-03-29 09:19:29 main:574] : INFO : Epoch 1809 | loss: 0.0312577 | val_loss: 0.0312419 | Time: 4723.79 ms [2022-03-29 09:19:34 main:574] : INFO : Epoch 1810 | loss: 0.0312321 | val_loss: 0.031216 | Time: 4496.21 ms [2022-03-29 09:19:39 main:574] : INFO : Epoch 1811 | loss: 0.0312089 | val_loss: 0.0312015 | Time: 4642.69 ms [2022-03-29 09:19:43 main:574] : INFO : Epoch 1812 | loss: 0.0312022 | val_loss: 0.0311989 | Time: 4487.57 ms [2022-03-29 09:19:48 main:574] : INFO : Epoch 1813 | loss: 0.031199 | val_loss: 0.0311959 | Time: 4643.91 ms [2022-03-29 09:19:53 main:574] : INFO : Epoch 1814 | loss: 0.0311961 | val_loss: 0.0311939 | Time: 4402.22 ms [2022-03-29 09:19:58 main:574] : INFO : Epoch 1815 | loss: 0.0311938 | val_loss: 0.031196 | Time: 4445.21 ms [2022-03-29 09:20:02 main:574] : INFO : Epoch 1816 | loss: 0.0311925 | val_loss: 0.0311931 | Time: 4698.94 ms [2022-03-29 09:20:07 main:574] : INFO : Epoch 1817 | loss: 0.0311924 | val_loss: 0.031193 | Time: 4460.54 ms [2022-03-29 09:20:12 main:574] : INFO : Epoch 1818 | loss: 0.031193 | val_loss: 0.0311931 | Time: 4664.99 ms [2022-03-29 09:20:17 main:574] : INFO : Epoch 1819 | loss: 0.0311913 | val_loss: 0.0311919 | Time: 4686.81 ms [2022-03-29 09:20:22 main:574] : INFO : Epoch 1820 | loss: 0.0311903 | val_loss: 0.0311908 | Time: 4698.48 ms [2022-03-29 09:20:27 main:574] : INFO : Epoch 1821 | loss: 0.0311903 | val_loss: 0.0311912 | Time: 4374.34 ms [2022-03-29 09:20:31 main:574] : INFO : Epoch 1822 | loss: 0.031189 | val_loss: 0.0311905 | Time: 4372.66 ms [2022-03-29 09:20:36 main:574] : INFO : Epoch 1823 | loss: 0.0311883 | val_loss: 0.0311901 | Time: 4695.04 ms [2022-03-29 09:20:41 main:574] : INFO : Epoch 1824 | loss: 0.0311888 | val_loss: 0.031191 | Time: 4494.49 ms [2022-03-29 09:20:46 main:574] : INFO : Epoch 1825 | loss: 0.0311879 | val_loss: 0.0311898 | Time: 4731.25 ms [2022-03-29 09:20:51 main:574] : INFO : Epoch 1826 | loss: 0.0311879 | val_loss: 0.0311886 | Time: 4890.93 ms [2022-03-29 09:20:55 main:574] : INFO : Epoch 1827 | loss: 0.0311898 | val_loss: 0.0311896 | Time: 4216.12 ms [2022-03-29 09:21:00 main:574] : INFO : Epoch 1828 | loss: 0.031188 | val_loss: 0.0311901 | Time: 4832.23 ms [2022-03-29 09:21:06 main:574] : INFO : Epoch 1829 | loss: 0.0311888 | val_loss: 0.031189 | Time: 4866.79 ms [2022-03-29 09:21:11 main:574] : INFO : Epoch 1830 | loss: 0.0311895 | val_loss: 0.03119 | Time: 4821.19 ms [2022-03-29 09:21:16 main:574] : INFO : Epoch 1831 | loss: 0.0311874 | val_loss: 0.0311902 | Time: 4410.32 ms [2022-03-29 09:21:21 main:574] : INFO : Epoch 1832 | loss: 0.0311881 | val_loss: 0.0311904 | Time: 4750.62 ms [2022-03-29 09:21:25 main:574] : INFO : Epoch 1833 | loss: 0.0311884 | val_loss: 0.0311889 | Time: 4258.33 ms [2022-03-29 09:21:30 main:574] : INFO : Epoch 1834 | loss: 0.0311884 | val_loss: 0.0311889 | Time: 4514.04 ms [2022-03-29 09:21:35 main:574] : INFO : Epoch 1835 | loss: 0.0311873 | val_loss: 0.0311894 | Time: 4533.36 ms [2022-03-29 09:21:40 main:574] : INFO : Epoch 1836 | loss: 0.0311869 | val_loss: 0.0311901 | Time: 4614.2 ms [2022-03-29 09:21:44 main:574] : INFO : Epoch 1837 | loss: 0.0311886 | val_loss: 0.0311895 | Time: 4345.07 ms [2022-03-29 09:21:49 main:574] : INFO : Epoch 1838 | loss: 0.0311879 | val_loss: 0.0311893 | Time: 4529.11 ms [2022-03-29 09:21:54 main:574] : INFO : Epoch 1839 | loss: 0.031187 | val_loss: 0.0311883 | Time: 4418.03 ms [2022-03-29 09:21:59 main:574] : INFO : Epoch 1840 | loss: 0.0311865 | val_loss: 0.031188 | Time: 4339.45 ms [2022-03-29 09:22:04 main:574] : INFO : Epoch 1841 | loss: 0.0311864 | val_loss: 0.0311877 | Time: 4710.38 ms [2022-03-29 09:22:09 main:574] : INFO : Epoch 1842 | loss: 0.0311925 | val_loss: 0.0311939 | Time: 4655.75 ms [2022-03-29 09:22:13 main:574] : INFO : Epoch 1843 | loss: 0.0311909 | val_loss: 0.0311921 | Time: 4459.79 ms [2022-03-29 09:22:18 main:574] : INFO : Epoch 1844 | loss: 0.0311897 | val_loss: 0.0311929 | Time: 4586.42 ms [2022-03-29 09:22:23 main:574] : INFO : Epoch 1845 | loss: 0.0311892 | val_loss: 0.0311911 | Time: 4263.98 ms [2022-03-29 09:22:27 main:574] : INFO : Epoch 1846 | loss: 0.0311879 | val_loss: 0.0311918 | Time: 4312.95 ms [2022-03-29 09:22:32 main:574] : INFO : Epoch 1847 | loss: 0.0311873 | val_loss: 0.0311899 | Time: 4507.12 ms [2022-03-29 09:22:37 main:574] : INFO : Epoch 1848 | loss: 0.0311882 | val_loss: 0.0311911 | Time: 4489.7 ms [2022-03-29 09:22:42 main:574] : INFO : Epoch 1849 | loss: 0.0311865 | val_loss: 0.0311893 | Time: 4575.65 ms [2022-03-29 09:22:47 main:574] : INFO : Epoch 1850 | loss: 0.0311859 | val_loss: 0.0311901 | Time: 4727.99 ms [2022-03-29 09:22:53 main:574] : INFO : Epoch 1851 | loss: 0.0311865 | val_loss: 0.0311899 | Time: 4899.54 ms [2022-03-29 09:22:58 main:574] : INFO : Epoch 1852 | loss: 0.0311863 | val_loss: 0.031188 | Time: 4756.81 ms [2022-03-29 09:23:03 main:574] : INFO : Epoch 1853 | loss: 0.0311852 | val_loss: 0.0311881 | Time: 4641.17 ms [2022-03-29 09:23:08 main:574] : INFO : Epoch 1854 | loss: 0.0311855 | val_loss: 0.031189 | Time: 4736.25 ms [2022-03-29 09:23:13 main:574] : INFO : Epoch 1855 | loss: 0.0311849 | val_loss: 0.0311878 | Time: 4708.98 ms [2022-03-29 09:23:19 main:574] : INFO : Epoch 1856 | loss: 0.0311856 | val_loss: 0.0311883 | Time: 5170.44 ms [2022-03-29 09:23:24 main:574] : INFO : Epoch 1857 | loss: 0.0311843 | val_loss: 0.0311882 | Time: 4633.88 ms [2022-03-29 09:23:29 main:574] : INFO : Epoch 1858 | loss: 0.0311842 | val_loss: 0.0311873 | Time: 5211.03 ms [2022-03-29 09:23:34 main:574] : INFO : Epoch 1859 | loss: 0.0311841 | val_loss: 0.0311891 | Time: 4742.77 ms [2022-03-29 09:23:39 main:574] : INFO : Epoch 1860 | loss: 0.031185 | val_loss: 0.0311895 | Time: 4933.61 ms [2022-03-29 09:23:44 main:574] : INFO : Epoch 1861 | loss: 0.0311843 | val_loss: 0.0311882 | Time: 4755.49 ms [2022-03-29 09:23:50 main:574] : INFO : Epoch 1862 | loss: 0.0311844 | val_loss: 0.0311871 | Time: 5412.96 ms [2022-03-29 09:23:56 main:574] : INFO : Epoch 1863 | loss: 0.0311845 | val_loss: 0.0311879 | Time: 5283.89 ms [2022-03-29 09:24:01 main:574] : INFO : Epoch 1864 | loss: 0.0311842 | val_loss: 0.031189 | Time: 5045.51 ms [2022-03-29 09:24:07 main:574] : INFO : Epoch 1865 | loss: 0.0311843 | val_loss: 0.0311878 | Time: 5072.47 ms [2022-03-29 09:24:12 main:574] : INFO : Epoch 1866 | loss: 0.0311854 | val_loss: 0.0311876 | Time: 4875.85 ms [2022-03-29 09:24:17 main:574] : INFO : Epoch 1867 | loss: 0.0311849 | val_loss: 0.0311882 | Time: 5103.99 ms [2022-03-29 09:24:22 main:574] : INFO : Epoch 1868 | loss: 0.031185 | val_loss: 0.0311872 | Time: 4416.91 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050) [2022-03-29 14:51:38 main:435] : INFO : Set logging level to 1 [2022-03-29 14:51:39 main:441] : INFO : Running in BOINC Client mode [2022-03-29 14:51:39 main:444] : INFO : Resolving all filenames [2022-03-29 14:51:39 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-03-29 14:51:39 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-03-29 14:51:39 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-03-29 14:51:39 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-03-29 14:51:40 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-03-29 14:51:40 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-03-29 14:51:40 main:474] : INFO : Configuration: [2022-03-29 14:51:40 main:475] : INFO : Model type: GRU [2022-03-29 14:51:40 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-03-29 14:51:40 main:477] : INFO : Max Epochs: 2048 [2022-03-29 14:51:40 main:478] : INFO : Batch Size: 128 [2022-03-29 14:51:40 main:479] : INFO : Learning Rate: 0.01 [2022-03-29 14:51:40 main:480] : INFO : Patience: 10 [2022-03-29 14:51:41 main:481] : INFO : Hidden Width: 12 [2022-03-29 14:51:41 main:482] : INFO : # Recurrent Layers: 4 [2022-03-29 14:51:41 main:483] : INFO : # Backend Layers: 4 [2022-03-29 14:51:41 main:484] : INFO : # Threads: 1 [2022-03-29 14:51:41 main:486] : INFO : Preparing Dataset [2022-03-29 14:51:41 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-03-29 14:51:41 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-03-29 14:51:43 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-03-29 14:51:43 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-03-29 14:51:44 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-03-29 14:51:44 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-03-29 14:51:44 main:494] : INFO : Creating Model [2022-03-29 14:51:44 main:507] : INFO : Preparing config file [2022-03-29 14:51:44 main:511] : INFO : Found checkpoint, attempting to load... [2022-03-29 14:51:44 main:512] : INFO : Loading config [2022-03-29 14:51:44 main:514] : INFO : Loading state Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050) [2022-03-31 09:12:01 main:435] : INFO : Set logging level to 1 [2022-03-31 09:12:01 main:441] : INFO : Running in BOINC Client mode [2022-03-31 09:12:01 main:444] : INFO : Resolving all filenames [2022-03-31 09:12:01 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-03-31 09:12:01 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-03-31 09:12:02 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-03-31 09:12:02 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-03-31 09:12:02 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-03-31 09:12:02 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-03-31 09:12:02 main:474] : INFO : Configuration: [2022-03-31 09:12:02 main:475] : INFO : Model type: GRU [2022-03-31 09:12:02 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-03-31 09:12:02 main:477] : INFO : Max Epochs: 2048 [2022-03-31 09:12:02 main:478] : INFO : Batch Size: 128 [2022-03-31 09:12:02 main:479] : INFO : Learning Rate: 0.01 [2022-03-31 09:12:03 main:480] : INFO : Patience: 10 [2022-03-31 09:12:03 main:481] : INFO : Hidden Width: 12 [2022-03-31 09:12:03 main:482] : INFO : # Recurrent Layers: 4 [2022-03-31 09:12:03 main:483] : INFO : # Backend Layers: 4 [2022-03-31 09:12:03 main:484] : INFO : # Threads: 1 [2022-03-31 09:12:03 main:486] : INFO : Preparing Dataset [2022-03-31 09:12:03 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-03-31 09:12:04 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-03-31 09:12:06 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-03-31 09:12:06 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-03-31 09:12:08 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-03-31 09:12:09 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-03-31 09:12:09 main:494] : INFO : Creating Model [2022-03-31 09:12:20 main:507] : INFO : Preparing config file [2022-03-31 09:12:20 main:511] : INFO : Found checkpoint, attempting to load... [2022-03-31 09:12:20 main:512] : INFO : Loading config [2022-03-31 09:12:21 main:514] : INFO : Loading state [2022-03-31 09:13:01 main:559] : INFO : Loading DataLoader into Memory [2022-03-31 09:13:02 main:562] : INFO : Starting Training [2022-03-31 09:13:10 main:574] : INFO : Epoch 1860 | loss: 0.03139 | val_loss: 0.0312579 | Time: 8559.8 ms [2022-03-31 09:13:15 main:574] : INFO : Epoch 1861 | loss: 0.0312218 | val_loss: 0.0311998 | Time: 4495.45 ms [2022-03-31 09:13:20 main:574] : INFO : Epoch 1862 | loss: 0.031192 | val_loss: 0.0311915 | Time: 4485.23 ms [2022-03-31 09:13:25 main:574] : INFO : Epoch 1863 | loss: 0.0311903 | val_loss: 0.0311905 | Time: 5223.9 ms [2022-03-31 09:13:30 main:574] : INFO : Epoch 1864 | loss: 0.0311881 | val_loss: 0.0311902 | Time: 5156.26 ms [2022-03-31 09:13:35 main:574] : INFO : Epoch 1865 | loss: 0.0311883 | val_loss: 0.0311907 | Time: 4727.45 ms [2022-03-31 09:13:41 main:574] : INFO : Epoch 1866 | loss: 0.031188 | val_loss: 0.0311897 | Time: 4916.08 ms [2022-03-31 09:13:46 main:574] : INFO : Epoch 1867 | loss: 0.0311857 | val_loss: 0.0311891 | Time: 5039.37 ms [2022-03-31 09:13:51 main:574] : INFO : Epoch 1868 | loss: 0.0311878 | val_loss: 0.0311874 | Time: 4862.74 ms [2022-03-31 09:13:56 main:574] : INFO : Epoch 1869 | loss: 0.0311864 | val_loss: 0.0311911 | Time: 4908.15 ms [2022-03-31 09:14:01 main:574] : INFO : Epoch 1870 | loss: 0.0311882 | val_loss: 0.0311906 | Time: 5119.98 ms [2022-03-31 09:14:06 main:574] : INFO : Epoch 1871 | loss: 0.031187 | val_loss: 0.0311937 | Time: 4602.69 ms [2022-03-31 09:14:11 main:574] : INFO : Epoch 1872 | loss: 0.0311854 | val_loss: 0.0311877 | Time: 5184.19 ms [2022-03-31 09:14:16 main:574] : INFO : Epoch 1873 | loss: 0.0311841 | val_loss: 0.031185 | Time: 4789.72 ms [2022-03-31 09:14:21 main:574] : INFO : Epoch 1874 | loss: 0.0311844 | val_loss: 0.0311881 | Time: 5216.75 ms [2022-03-31 09:14:27 main:574] : INFO : Epoch 1875 | loss: 0.0311858 | val_loss: 0.0311908 | Time: 5219.59 ms [2022-03-31 09:14:32 main:574] : INFO : Epoch 1876 | loss: 0.0311878 | val_loss: 0.0311877 | Time: 5216.52 ms [2022-03-31 09:14:37 main:574] : INFO : Epoch 1877 | loss: 0.0311866 | val_loss: 0.0311851 | Time: 4940.72 ms [2022-03-31 09:14:43 main:574] : INFO : Epoch 1878 | loss: 0.031185 | val_loss: 0.0311842 | Time: 4875.16 ms [2022-03-31 09:14:48 main:574] : INFO : Epoch 1879 | loss: 0.0311838 | val_loss: 0.031188 | Time: 4628.9 ms [2022-03-31 09:14:53 main:574] : INFO : Epoch 1880 | loss: 0.0311845 | val_loss: 0.0311888 | Time: 5232.09 ms [2022-03-31 09:14:59 main:574] : INFO : Epoch 1881 | loss: 0.0311843 | val_loss: 0.0311831 | Time: 5269.94 ms [2022-03-31 09:15:04 main:574] : INFO : Epoch 1882 | loss: 0.0311819 | val_loss: 0.0311825 | Time: 5209.92 ms [2022-03-31 09:15:10 main:574] : INFO : Epoch 1883 | loss: 0.0311816 | val_loss: 0.0311806 | Time: 5209.39 ms [2022-03-31 09:15:15 main:574] : INFO : Epoch 1884 | loss: 0.0311818 | val_loss: 0.031184 | Time: 4661.75 ms [2022-03-31 09:15:20 main:574] : INFO : Epoch 1885 | loss: 0.0311819 | val_loss: 0.0311813 | Time: 5202.97 ms [2022-03-31 09:15:25 main:574] : INFO : Epoch 1886 | loss: 0.0311811 | val_loss: 0.031183 | Time: 5288.36 ms [2022-03-31 09:15:31 main:574] : INFO : Epoch 1887 | loss: 0.0311819 | val_loss: 0.0311863 | Time: 5235.18 ms [2022-03-31 09:15:36 main:574] : INFO : Epoch 1888 | loss: 0.0311829 | val_loss: 0.0311898 | Time: 5416.49 ms [2022-03-31 09:15:42 main:574] : INFO : Epoch 1889 | loss: 0.031182 | val_loss: 0.0311819 | Time: 5252.04 ms [2022-03-31 09:15:46 main:574] : INFO : Epoch 1890 | loss: 0.031182 | val_loss: 0.0311827 | Time: 4426.29 ms [2022-03-31 09:15:51 main:574] : INFO : Epoch 1891 | loss: 0.0311841 | val_loss: 0.031183 | Time: 5131.16 ms [2022-03-31 09:15:56 main:574] : INFO : Epoch 1892 | loss: 0.0311831 | val_loss: 0.031182 | Time: 4499.33 ms [2022-03-31 09:16:02 main:574] : INFO : Epoch 1893 | loss: 0.0311826 | val_loss: 0.0311823 | Time: 5139.73 ms [2022-03-31 09:16:07 main:574] : INFO : Epoch 1894 | loss: 0.0311817 | val_loss: 0.0311828 | Time: 4614.67 ms [2022-03-31 09:16:12 main:574] : INFO : Epoch 1895 | loss: 0.0311824 | val_loss: 0.0311848 | Time: 4697.83 ms [2022-03-31 09:16:20 main:574] : INFO : Epoch 1896 | loss: 0.0311843 | val_loss: 0.0311845 | Time: 5310.19 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050) [2022-03-31 09:32:34 main:435] : INFO : Set logging level to 1 [2022-03-31 09:32:34 main:441] : INFO : Running in BOINC Client mode [2022-03-31 09:32:34 main:444] : INFO : Resolving all filenames [2022-03-31 09:32:34 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-03-31 09:32:34 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-03-31 09:32:34 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-03-31 09:32:34 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-03-31 09:32:34 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-03-31 09:32:34 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-03-31 09:32:35 main:474] : INFO : Configuration: [2022-03-31 09:32:35 main:475] : INFO : Model type: GRU [2022-03-31 09:32:35 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-03-31 09:32:35 main:477] : INFO : Max Epochs: 2048 [2022-03-31 09:32:35 main:478] : INFO : Batch Size: 128 [2022-03-31 09:32:35 main:479] : INFO : Learning Rate: 0.01 [2022-03-31 09:32:35 main:480] : INFO : Patience: 10 [2022-03-31 09:32:35 main:481] : INFO : Hidden Width: 12 [2022-03-31 09:32:35 main:482] : INFO : # Recurrent Layers: 4 [2022-03-31 09:32:35 main:483] : INFO : # Backend Layers: 4 [2022-03-31 09:32:35 main:484] : INFO : # Threads: 1 [2022-03-31 09:32:36 main:486] : INFO : Preparing Dataset [2022-03-31 09:32:36 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-03-31 09:32:36 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-03-31 09:32:38 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-03-31 09:32:38 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-03-31 09:32:39 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-03-31 09:32:39 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-03-31 09:32:39 main:494] : INFO : Creating Model [2022-03-31 09:32:39 main:507] : INFO : Preparing config file [2022-03-31 09:32:39 main:511] : INFO : Found checkpoint, attempting to load... [2022-03-31 09:32:39 main:512] : INFO : Loading config [2022-03-31 09:32:39 main:514] : INFO : Loading state [2022-03-31 09:32:40 main:559] : INFO : Loading DataLoader into Memory [2022-03-31 09:32:40 main:562] : INFO : Starting Training [2022-03-31 09:32:46 main:574] : INFO : Epoch 1888 | loss: 0.0312606 | val_loss: 0.0312035 | Time: 5921.27 ms [2022-03-31 09:32:52 main:574] : INFO : Epoch 1889 | loss: 0.031192 | val_loss: 0.0311875 | Time: 5548.09 ms [2022-03-31 09:32:58 main:574] : INFO : Epoch 1890 | loss: 0.0311844 | val_loss: 0.0311847 | Time: 5424.26 ms [2022-03-31 09:33:03 main:574] : INFO : Epoch 1891 | loss: 0.0311821 | val_loss: 0.0311832 | Time: 5681.25 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050) [2022-04-01 08:47:07 main:435] : INFO : Set logging level to 1 [2022-04-01 08:47:07 main:441] : INFO : Running in BOINC Client mode [2022-04-01 08:47:08 main:444] : INFO : Resolving all filenames [2022-04-01 08:47:08 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-01 08:47:08 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-01 08:47:09 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-01 08:47:09 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-01 08:47:09 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-01 08:47:09 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-01 08:47:09 main:474] : INFO : Configuration: [2022-04-01 08:47:09 main:475] : INFO : Model type: GRU [2022-04-01 08:47:10 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-01 08:47:10 main:477] : INFO : Max Epochs: 2048 [2022-04-01 08:47:10 main:478] : INFO : Batch Size: 128 [2022-04-01 08:47:10 main:479] : INFO : Learning Rate: 0.01 [2022-04-01 08:47:11 main:480] : INFO : Patience: 10 [2022-04-01 08:47:11 main:481] : INFO : Hidden Width: 12 [2022-04-01 08:47:11 main:482] : INFO : # Recurrent Layers: 4 [2022-04-01 08:47:11 main:483] : INFO : # Backend Layers: 4 [2022-04-01 08:47:11 main:484] : INFO : # Threads: 1 [2022-04-01 08:47:12 main:486] : INFO : Preparing Dataset [2022-04-01 08:47:12 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-01 08:47:13 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-01 08:48:35 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-01 08:48:35 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-01 08:48:36 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-01 08:48:36 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-01 08:48:36 main:494] : INFO : Creating Model [2022-04-01 08:48:37 main:507] : INFO : Preparing config file [2022-04-01 08:48:37 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-01 08:48:37 main:512] : INFO : Loading config [2022-04-01 08:48:37 main:514] : INFO : Loading state [2022-04-01 08:48:46 main:559] : INFO : Loading DataLoader into Memory [2022-04-01 08:48:46 main:562] : INFO : Starting Training [2022-04-01 08:48:56 main:574] : INFO : Epoch 1888 | loss: 0.0312627 | val_loss: 0.0312041 | Time: 9591.82 ms [2022-04-01 08:49:01 main:574] : INFO : Epoch 1889 | loss: 0.0311938 | val_loss: 0.0311843 | Time: 4446.21 ms [2022-04-01 08:49:06 main:574] : INFO : Epoch 1890 | loss: 0.0311814 | val_loss: 0.0311819 | Time: 4714.12 ms [2022-04-01 08:49:11 main:574] : INFO : Epoch 1891 | loss: 0.0311805 | val_loss: 0.0311805 | Time: 4798.73 ms [2022-04-01 08:49:15 main:574] : INFO : Epoch 1892 | loss: 0.0311801 | val_loss: 0.0311809 | Time: 4583.79 ms [2022-04-01 08:49:21 main:574] : INFO : Epoch 1893 | loss: 0.0311781 | val_loss: 0.0311778 | Time: 5147.72 ms [2022-04-01 08:49:25 main:574] : INFO : Epoch 1894 | loss: 0.0311831 | val_loss: 0.0311849 | Time: 4460.92 ms [2022-04-01 08:49:30 main:574] : INFO : Epoch 1895 | loss: 0.031183 | val_loss: 0.0311825 | Time: 4639.42 ms [2022-04-01 08:49:36 main:574] : INFO : Epoch 1896 | loss: 0.0311818 | val_loss: 0.0311788 | Time: 5144.68 ms [2022-04-01 08:49:41 main:574] : INFO : Epoch 1897 | loss: 0.0311804 | val_loss: 0.0311788 | Time: 4720.91 ms [2022-04-01 08:49:46 main:574] : INFO : Epoch 1898 | loss: 0.0311815 | val_loss: 0.0311783 | Time: 5227.37 ms [2022-04-01 08:49:52 main:574] : INFO : Epoch 1899 | loss: 0.0311798 | val_loss: 0.0311789 | Time: 5587.92 ms [2022-04-01 08:49:57 main:574] : INFO : Epoch 1900 | loss: 0.0311785 | val_loss: 0.0311772 | Time: 4506.02 ms [2022-04-01 08:50:02 main:574] : INFO : Epoch 1901 | loss: 0.0311781 | val_loss: 0.0311768 | Time: 5222.13 ms [2022-04-01 08:50:08 main:574] : INFO : Epoch 1902 | loss: 0.0311778 | val_loss: 0.0311778 | Time: 4896.77 ms [2022-04-01 08:50:13 main:574] : INFO : Epoch 1903 | loss: 0.0311786 | val_loss: 0.0311797 | Time: 4775.94 ms [2022-04-01 08:50:18 main:574] : INFO : Epoch 1904 | loss: 0.0311801 | val_loss: 0.0311804 | Time: 4791.13 ms [2022-04-01 08:50:23 main:574] : INFO : Epoch 1905 | loss: 0.031182 | val_loss: 0.0311794 | Time: 4961.34 ms [2022-04-01 08:50:28 main:574] : INFO : Epoch 1906 | loss: 0.0311799 | val_loss: 0.0311792 | Time: 4880.45 ms [2022-04-01 08:50:33 main:574] : INFO : Epoch 1907 | loss: 0.0311823 | val_loss: 0.0311795 | Time: 4605.89 ms [2022-04-01 08:50:38 main:574] : INFO : Epoch 1908 | loss: 0.03118 | val_loss: 0.0311785 | Time: 4740.41 ms [2022-04-01 08:50:43 main:574] : INFO : Epoch 1909 | loss: 0.0311799 | val_loss: 0.0311785 | Time: 4921.32 ms [2022-04-01 08:50:48 main:574] : INFO : Epoch 1910 | loss: 0.0311797 | val_loss: 0.0311815 | Time: 4679.7 ms [2022-04-01 08:50:53 main:574] : INFO : Epoch 1911 | loss: 0.0311795 | val_loss: 0.0311818 | Time: 4721.11 ms [2022-04-01 08:50:58 main:574] : INFO : Epoch 1912 | loss: 0.0311787 | val_loss: 0.0311779 | Time: 4906.2 ms [2022-04-01 08:51:03 main:574] : INFO : Epoch 1913 | loss: 0.0311778 | val_loss: 0.0311776 | Time: 4588.12 ms [2022-04-01 08:51:08 main:574] : INFO : Epoch 1914 | loss: 0.0311769 | val_loss: 0.0311782 | Time: 4578.51 ms [2022-04-01 08:51:13 main:574] : INFO : Epoch 1915 | loss: 0.0311764 | val_loss: 0.0311788 | Time: 4691.22 ms [2022-04-01 08:51:19 main:574] : INFO : Epoch 1916 | loss: 0.0311769 | val_loss: 0.0311774 | Time: 4904.05 ms [2022-04-01 08:51:24 main:574] : INFO : Epoch 1917 | loss: 0.0311775 | val_loss: 0.0311778 | Time: 4907.6 ms [2022-04-01 08:51:29 main:574] : INFO : Epoch 1918 | loss: 0.0311765 | val_loss: 0.0311773 | Time: 4573.33 ms [2022-04-01 08:51:34 main:574] : INFO : Epoch 1919 | loss: 0.0311775 | val_loss: 0.0311812 | Time: 4801.97 ms [2022-04-01 08:51:39 main:574] : INFO : Epoch 1920 | loss: 0.0311776 | val_loss: 0.031178 | Time: 4887.62 ms [2022-04-01 08:51:44 main:574] : INFO : Epoch 1921 | loss: 0.0311771 | val_loss: 0.0311766 | Time: 5120.15 ms [2022-04-01 08:51:49 main:574] : INFO : Epoch 1922 | loss: 0.0311761 | val_loss: 0.0311807 | Time: 4868.77 ms [2022-04-01 08:51:54 main:574] : INFO : Epoch 1923 | loss: 0.0311766 | val_loss: 0.0311838 | Time: 4830.17 ms [2022-04-01 08:51:59 main:574] : INFO : Epoch 1924 | loss: 0.0311783 | val_loss: 0.0311799 | Time: 4570.73 ms [2022-04-01 08:52:04 main:574] : INFO : Epoch 1925 | loss: 0.0311776 | val_loss: 0.0311756 | Time: 4495.24 ms [2022-04-01 08:52:10 main:574] : INFO : Epoch 1926 | loss: 0.0311761 | val_loss: 0.031177 | Time: 5011.78 ms [2022-04-01 08:52:15 main:574] : INFO : Epoch 1927 | loss: 0.0311751 | val_loss: 0.0311769 | Time: 4691.25 ms [2022-04-01 08:52:19 main:574] : INFO : Epoch 1928 | loss: 0.0311743 | val_loss: 0.0311749 | Time: 4400.2 ms [2022-04-01 08:52:25 main:574] : INFO : Epoch 1929 | loss: 0.0311739 | val_loss: 0.0311754 | Time: 5142.23 ms [2022-04-01 08:52:30 main:574] : INFO : Epoch 1930 | loss: 0.0311745 | val_loss: 0.031177 | Time: 4678.14 ms [2022-04-01 08:52:35 main:574] : INFO : Epoch 1931 | loss: 0.0311749 | val_loss: 0.0311745 | Time: 4773.66 ms [2022-04-01 08:52:40 main:574] : INFO : Epoch 1932 | loss: 0.0311747 | val_loss: 0.0311746 | Time: 4453.44 ms [2022-04-01 08:52:46 main:574] : INFO : Epoch 1933 | loss: 0.0311743 | val_loss: 0.0311734 | Time: 5105.91 ms [2022-04-01 08:52:51 main:574] : INFO : Epoch 1934 | loss: 0.0311738 | val_loss: 0.0311731 | Time: 4986.77 ms [2022-04-01 08:52:57 main:574] : INFO : Epoch 1935 | loss: 0.0311727 | val_loss: 0.0311742 | Time: 5649.41 ms [2022-04-01 08:53:03 main:574] : INFO : Epoch 1936 | loss: 0.0311734 | val_loss: 0.0311734 | Time: 4578.72 ms [2022-04-01 08:53:08 main:574] : INFO : Epoch 1937 | loss: 0.0311738 | val_loss: 0.0311738 | Time: 4681.97 ms [2022-04-01 08:53:13 main:574] : INFO : Epoch 1938 | loss: 0.0311742 | val_loss: 0.0311741 | Time: 4812.8 ms [2022-04-01 08:53:18 main:574] : INFO : Epoch 1939 | loss: 0.0311735 | val_loss: 0.0311733 | Time: 4695.56 ms [2022-04-01 08:53:25 main:574] : INFO : Epoch 1940 | loss: 0.0311737 | val_loss: 0.0311739 | Time: 5106.48 ms [2022-04-01 08:53:30 main:574] : INFO : Epoch 1941 | loss: 0.0311728 | val_loss: 0.031174 | Time: 4698.65 ms [2022-04-01 08:53:35 main:574] : INFO : Epoch 1942 | loss: 0.0311733 | val_loss: 0.0311738 | Time: 4517.35 ms [2022-04-01 08:53:40 main:574] : INFO : Epoch 1943 | loss: 0.0311739 | val_loss: 0.0311741 | Time: 4587.15 ms [2022-04-01 08:53:46 main:574] : INFO : Epoch 1944 | loss: 0.0311762 | val_loss: 0.0311759 | Time: 4906.85 ms [2022-04-01 08:53:51 main:574] : INFO : Epoch 1945 | loss: 0.0311762 | val_loss: 0.031176 | Time: 4877.65 ms [2022-04-01 08:53:56 main:574] : INFO : Epoch 1946 | loss: 0.0311758 | val_loss: 0.0311799 | Time: 4818.04 ms [2022-04-01 08:54:01 main:574] : INFO : Epoch 1947 | loss: 0.0311763 | val_loss: 0.0311782 | Time: 4797.46 ms [2022-04-01 08:54:06 main:574] : INFO : Epoch 1948 | loss: 0.0311768 | val_loss: 0.0311755 | Time: 4414.86 ms [2022-04-01 08:54:11 main:574] : INFO : Epoch 1949 | loss: 0.0311747 | val_loss: 0.0311756 | Time: 4507.49 ms [2022-04-01 08:54:16 main:574] : INFO : Epoch 1950 | loss: 0.0311745 | val_loss: 0.0311791 | Time: 4793.83 ms [2022-04-01 08:54:21 main:574] : INFO : Epoch 1951 | loss: 0.031176 | val_loss: 0.0311775 | Time: 4666.82 ms [2022-04-01 08:54:26 main:574] : INFO : Epoch 1952 | loss: 0.0311747 | val_loss: 0.0311771 | Time: 4716.93 ms [2022-04-01 08:54:31 main:574] : INFO : Epoch 1953 | loss: 0.0311757 | val_loss: 0.0311761 | Time: 4692.64 ms [2022-04-01 08:54:36 main:574] : INFO : Epoch 1954 | loss: 0.0311744 | val_loss: 0.0311747 | Time: 4472.29 ms [2022-04-01 08:54:41 main:574] : INFO : Epoch 1955 | loss: 0.0311727 | val_loss: 0.0311748 | Time: 4892.38 ms [2022-04-01 08:54:46 main:574] : INFO : Epoch 1956 | loss: 0.0311726 | val_loss: 0.0311772 | Time: 4708.93 ms [2022-04-01 08:54:51 main:574] : INFO : Epoch 1957 | loss: 0.0311725 | val_loss: 0.0311771 | Time: 4453.6 ms [2022-04-01 08:54:57 main:574] : INFO : Epoch 1958 | loss: 0.0311735 | val_loss: 0.031178 | Time: 5499.21 ms [2022-04-01 08:55:01 main:574] : INFO : Epoch 1959 | loss: 0.0311738 | val_loss: 0.0311728 | Time: 4551.13 ms [2022-04-01 08:55:07 main:574] : INFO : Epoch 1960 | loss: 0.0311714 | val_loss: 0.031173 | Time: 5141.41 ms [2022-04-01 08:55:11 main:574] : INFO : Epoch 1961 | loss: 0.0311716 | val_loss: 0.0311729 | Time: 4323.83 ms [2022-04-01 08:55:16 main:574] : INFO : Epoch 1962 | loss: 0.0311711 | val_loss: 0.0311737 | Time: 4608.11 ms [2022-04-01 08:55:21 main:574] : INFO : Epoch 1963 | loss: 0.0311708 | val_loss: 0.0311735 | Time: 4464.16 ms [2022-04-01 08:55:26 main:574] : INFO : Epoch 1964 | loss: 0.0311709 | val_loss: 0.031176 | Time: 4788.5 ms [2022-04-01 08:55:31 main:574] : INFO : Epoch 1965 | loss: 0.0311706 | val_loss: 0.0311776 | Time: 5509.49 ms [2022-04-01 08:55:36 main:574] : INFO : Epoch 1966 | loss: 0.0311766 | val_loss: 0.031179 | Time: 4730.89 ms [2022-04-01 08:55:41 main:574] : INFO : Epoch 1967 | loss: 0.0311764 | val_loss: 0.0311768 | Time: 4541.42 ms [2022-04-01 08:55:46 main:574] : INFO : Epoch 1968 | loss: 0.0311746 | val_loss: 0.0311743 | Time: 4411.06 ms [2022-04-01 08:55:51 main:574] : INFO : Epoch 1969 | loss: 0.0311746 | val_loss: 0.0311737 | Time: 4665.22 ms [2022-04-01 08:55:56 main:574] : INFO : Epoch 1970 | loss: 0.0311768 | val_loss: 0.0311847 | Time: 4947.65 ms [2022-04-01 08:56:01 main:574] : INFO : Epoch 1971 | loss: 0.0311793 | val_loss: 0.0311838 | Time: 4828.5 ms [2022-04-01 08:56:06 main:574] : INFO : Epoch 1972 | loss: 0.0311753 | val_loss: 0.0311745 | Time: 4449.91 ms [2022-04-01 08:56:10 main:574] : INFO : Epoch 1973 | loss: 0.0311723 | val_loss: 0.0311774 | Time: 4422.35 ms [2022-04-01 08:56:15 main:574] : INFO : Epoch 1974 | loss: 0.0311729 | val_loss: 0.0311742 | Time: 4500.51 ms [2022-04-01 08:56:20 main:574] : INFO : Epoch 1975 | loss: 0.0311722 | val_loss: 0.0311746 | Time: 4676.28 ms [2022-04-01 08:56:25 main:574] : INFO : Epoch 1976 | loss: 0.0311753 | val_loss: 0.031178 | Time: 4699.2 ms [2022-04-01 08:56:30 main:574] : INFO : Epoch 1977 | loss: 0.0311762 | val_loss: 0.0311778 | Time: 4564.29 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050) [2022-04-01 08:59:38 main:435] : INFO : Set logging level to 1 [2022-04-01 08:59:38 main:441] : INFO : Running in BOINC Client mode [2022-04-01 08:59:39 main:444] : INFO : Resolving all filenames [2022-04-01 08:59:39 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-01 08:59:39 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-01 08:59:39 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-01 08:59:39 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-01 08:59:39 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-01 08:59:39 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-01 08:59:39 main:474] : INFO : Configuration: [2022-04-01 08:59:40 main:475] : INFO : Model type: GRU [2022-04-01 08:59:40 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-01 08:59:40 main:477] : INFO : Max Epochs: 2048 [2022-04-01 08:59:40 main:478] : INFO : Batch Size: 128 [2022-04-01 08:59:40 main:479] : INFO : Learning Rate: 0.01 [2022-04-01 08:59:40 main:480] : INFO : Patience: 10 [2022-04-01 08:59:40 main:481] : INFO : Hidden Width: 12 [2022-04-01 08:59:41 main:482] : INFO : # Recurrent Layers: 4 [2022-04-01 08:59:41 main:483] : INFO : # Backend Layers: 4 [2022-04-01 08:59:41 main:484] : INFO : # Threads: 1 [2022-04-01 08:59:41 main:486] : INFO : Preparing Dataset [2022-04-01 08:59:41 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-01 08:59:41 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-01 08:59:44 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-01 08:59:44 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-01 08:59:44 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-01 08:59:45 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-01 08:59:45 main:494] : INFO : Creating Model [2022-04-01 08:59:45 main:507] : INFO : Preparing config file [2022-04-01 08:59:45 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-01 08:59:45 main:512] : INFO : Loading config [2022-04-01 08:59:46 main:514] : INFO : Loading state [2022-04-01 08:59:46 main:559] : INFO : Loading DataLoader into Memory [2022-04-01 08:59:47 main:562] : INFO : Starting Training [2022-04-01 08:59:53 main:574] : INFO : Epoch 1968 | loss: 0.0312217 | val_loss: 0.0311823 | Time: 5809.22 ms [2022-04-01 08:59:58 main:574] : INFO : Epoch 1969 | loss: 0.0311781 | val_loss: 0.0311763 | Time: 5517.42 ms [2022-04-01 09:00:04 main:574] : INFO : Epoch 1970 | loss: 0.031174 | val_loss: 0.031183 | Time: 5735.39 ms [2022-04-01 09:00:10 main:574] : INFO : Epoch 1971 | loss: 0.0311771 | val_loss: 0.0311732 | Time: 5203.24 ms [2022-04-01 09:00:15 main:574] : INFO : Epoch 1972 | loss: 0.0311763 | val_loss: 0.0311757 | Time: 5400.35 ms [2022-04-01 09:00:20 main:574] : INFO : Epoch 1973 | loss: 0.0311735 | val_loss: 0.0311779 | Time: 4609.45 ms [2022-04-01 09:00:25 main:574] : INFO : Epoch 1974 | loss: 0.031175 | val_loss: 0.0311759 | Time: 4335.29 ms [2022-04-01 09:00:30 main:574] : INFO : Epoch 1975 | loss: 0.0311725 | val_loss: 0.0311722 | Time: 4265.7 ms [2022-04-01 09:00:35 main:574] : INFO : Epoch 1976 | loss: 0.0311732 | val_loss: 0.031175 | Time: 4444.94 ms [2022-04-01 09:00:40 main:574] : INFO : Epoch 1977 | loss: 0.0311729 | val_loss: 0.0311737 | Time: 4427.41 ms [2022-04-01 09:00:45 main:574] : INFO : Epoch 1978 | loss: 0.0311726 | val_loss: 0.0311751 | Time: 4404.79 ms [2022-04-01 09:00:51 main:574] : INFO : Epoch 1979 | loss: 0.0311754 | val_loss: 0.0311758 | Time: 4830.43 ms [2022-04-01 09:00:56 main:574] : INFO : Epoch 1980 | loss: 0.0311799 | val_loss: 0.0311816 | Time: 5342.45 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050) [2022-04-01 10:13:00 main:435] : INFO : Set logging level to 1 [2022-04-01 10:13:00 main:441] : INFO : Running in BOINC Client mode [2022-04-01 10:13:00 main:444] : INFO : Resolving all filenames [2022-04-01 10:13:00 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-01 10:13:00 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-01 10:13:00 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-01 10:13:01 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-01 10:13:01 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-01 10:13:01 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-01 10:13:01 main:474] : INFO : Configuration: [2022-04-01 10:13:01 main:475] : INFO : Model type: GRU [2022-04-01 10:13:01 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-01 10:13:01 main:477] : INFO : Max Epochs: 2048 [2022-04-01 10:13:02 main:478] : INFO : Batch Size: 128 [2022-04-01 10:13:02 main:479] : INFO : Learning Rate: 0.01 [2022-04-01 10:13:02 main:480] : INFO : Patience: 10 [2022-04-01 10:13:02 main:481] : INFO : Hidden Width: 12 [2022-04-01 10:13:02 main:482] : INFO : # Recurrent Layers: 4 [2022-04-01 10:13:02 main:483] : INFO : # Backend Layers: 4 [2022-04-01 10:13:03 main:484] : INFO : # Threads: 1 [2022-04-01 10:13:03 main:486] : INFO : Preparing Dataset [2022-04-01 10:13:03 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-01 10:13:03 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-01 10:13:06 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-01 10:13:06 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-01 10:13:06 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-01 10:13:06 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-01 10:13:06 main:494] : INFO : Creating Model [2022-04-01 10:13:06 main:507] : INFO : Preparing config file [2022-04-01 10:13:06 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-01 10:13:07 main:512] : INFO : Loading config [2022-04-01 10:13:07 main:514] : INFO : Loading state [2022-04-01 10:13:08 main:559] : INFO : Loading DataLoader into Memory [2022-04-01 10:13:08 main:562] : INFO : Starting Training [2022-04-01 10:13:14 main:574] : INFO : Epoch 1979 | loss: 0.0312385 | val_loss: 0.0311839 | Time: 5793.99 ms [2022-04-01 10:13:19 main:574] : INFO : Epoch 1980 | loss: 0.031181 | val_loss: 0.0311738 | Time: 5357.16 ms [2022-04-01 10:13:25 main:574] : INFO : Epoch 1981 | loss: 0.0311727 | val_loss: 0.0311686 | Time: 5418.41 ms [2022-04-01 10:13:31 main:574] : INFO : Epoch 1982 | loss: 0.0311703 | val_loss: 0.0311693 | Time: 5418.48 ms [2022-04-01 10:13:36 main:574] : INFO : Epoch 1983 | loss: 0.0311692 | val_loss: 0.0311697 | Time: 5358.79 ms [2022-04-01 10:13:41 main:574] : INFO : Epoch 1984 | loss: 0.0311689 | val_loss: 0.0311695 | Time: 4995.53 ms [2022-04-01 10:13:46 main:574] : INFO : Epoch 1985 | loss: 0.0311691 | val_loss: 0.03117 | Time: 4626.41 ms [2022-04-01 10:13:52 main:574] : INFO : Epoch 1986 | loss: 0.0311711 | val_loss: 0.0311714 | Time: 4779.91 ms [2022-04-01 10:13:57 main:574] : INFO : Epoch 1987 | loss: 0.0311703 | val_loss: 0.0311694 | Time: 4876 ms [2022-04-01 10:14:02 main:574] : INFO : Epoch 1988 | loss: 0.0311707 | val_loss: 0.0311695 | Time: 4882.41 ms [2022-04-01 10:14:07 main:574] : INFO : Epoch 1989 | loss: 0.0311689 | val_loss: 0.0311686 | Time: 4886.34 ms [2022-04-01 10:14:13 main:574] : INFO : Epoch 1990 | loss: 0.0311682 | val_loss: 0.0311693 | Time: 4862.93 ms [2022-04-01 10:14:20 main:574] : INFO : Epoch 1991 | loss: 0.0311681 | val_loss: 0.0311705 | Time: 5494.71 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050) [2022-04-04 09:09:38 main:435] : INFO : Set logging level to 1 [2022-04-04 09:09:40 main:441] : INFO : Running in BOINC Client mode [2022-04-04 09:09:41 main:444] : INFO : Resolving all filenames [2022-04-04 09:09:41 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-04 09:09:42 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-04 09:09:42 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-04 09:09:42 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-04 09:09:43 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-04 09:09:43 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-04 09:09:43 main:474] : INFO : Configuration: [2022-04-04 09:09:44 main:475] : INFO : Model type: GRU [2022-04-04 09:09:44 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-04 09:09:44 main:477] : INFO : Max Epochs: 2048 [2022-04-04 09:09:44 main:478] : INFO : Batch Size: 128 [2022-04-04 09:09:44 main:479] : INFO : Learning Rate: 0.01 [2022-04-04 09:09:45 main:480] : INFO : Patience: 10 [2022-04-04 09:09:45 main:481] : INFO : Hidden Width: 12 [2022-04-04 09:09:45 main:482] : INFO : # Recurrent Layers: 4 [2022-04-04 09:09:45 main:483] : INFO : # Backend Layers: 4 [2022-04-04 09:09:45 main:484] : INFO : # Threads: 1 [2022-04-04 09:09:46 main:486] : INFO : Preparing Dataset [2022-04-04 09:09:46 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-04 09:09:47 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-04 09:10:03 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-04 09:10:03 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-04 09:10:04 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-04 09:10:04 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-04 09:10:05 main:494] : INFO : Creating Model [2022-04-04 09:10:13 main:507] : INFO : Preparing config file [2022-04-04 09:10:14 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-04 09:10:14 main:512] : INFO : Loading config [2022-04-04 09:10:15 main:514] : INFO : Loading state [2022-04-04 09:10:52 main:559] : INFO : Loading DataLoader into Memory [2022-04-04 09:10:52 main:562] : INFO : Starting Training [2022-04-04 09:11:05 main:574] : INFO : Epoch 1990 | loss: 0.0312386 | val_loss: 0.0311873 | Time: 12612.1 ms [2022-04-04 09:11:11 main:574] : INFO : Epoch 1991 | loss: 0.0311782 | val_loss: 0.0311716 | Time: 5014.87 ms [2022-04-04 09:11:15 main:574] : INFO : Epoch 1992 | loss: 0.0311721 | val_loss: 0.0311702 | Time: 4695.95 ms [2022-04-04 09:11:21 main:574] : INFO : Epoch 1993 | loss: 0.0311699 | val_loss: 0.0311657 | Time: 5059.25 ms [2022-04-04 09:11:27 main:574] : INFO : Epoch 1994 | loss: 0.0311678 | val_loss: 0.0311687 | Time: 4697.92 ms [2022-04-04 09:11:32 main:574] : INFO : Epoch 1995 | loss: 0.0311676 | val_loss: 0.031164 | Time: 4622.15 ms [2022-04-04 09:11:37 main:574] : INFO : Epoch 1996 | loss: 0.0311666 | val_loss: 0.0311642 | Time: 4490.04 ms [2022-04-04 09:11:42 main:574] : INFO : Epoch 1997 | loss: 0.0311678 | val_loss: 0.0311709 | Time: 4582.08 ms [2022-04-04 09:11:47 main:574] : INFO : Epoch 1998 | loss: 0.031172 | val_loss: 0.0311667 | Time: 4472.39 ms [2022-04-04 09:11:52 main:574] : INFO : Epoch 1999 | loss: 0.0311699 | val_loss: 0.0311702 | Time: 4429.31 ms [2022-04-04 09:11:57 main:574] : INFO : Epoch 2000 | loss: 0.0311697 | val_loss: 0.0311704 | Time: 5057.13 ms [2022-04-04 09:12:02 main:574] : INFO : Epoch 2001 | loss: 0.0311714 | val_loss: 0.0311726 | Time: 4808.09 ms [2022-04-04 09:12:07 main:574] : INFO : Epoch 2002 | loss: 0.0311715 | val_loss: 0.031172 | Time: 4509.4 ms [2022-04-04 09:12:12 main:574] : INFO : Epoch 2003 | loss: 0.0311698 | val_loss: 0.0311689 | Time: 5178.59 ms [2022-04-04 09:12:18 main:574] : INFO : Epoch 2004 | loss: 0.0311681 | val_loss: 0.0311689 | Time: 4777.95 ms [2022-04-04 09:12:24 main:574] : INFO : Epoch 2005 | loss: 0.0311682 | val_loss: 0.0311697 | Time: 6244.13 ms [2022-04-04 09:12:30 main:574] : INFO : Epoch 2006 | loss: 0.0311682 | val_loss: 0.0311695 | Time: 5436.02 ms [2022-04-04 09:12:35 main:574] : INFO : Epoch 2007 | loss: 0.0311685 | val_loss: 0.0311703 | Time: 4897.7 ms [2022-04-04 09:12:41 main:574] : INFO : Epoch 2008 | loss: 0.0311688 | val_loss: 0.0311696 | Time: 5347.42 ms [2022-04-04 09:12:47 main:574] : INFO : Epoch 2009 | loss: 0.0311673 | val_loss: 0.0311701 | Time: 6190.46 ms [2022-04-04 09:12:53 main:574] : INFO : Epoch 2010 | loss: 0.0311668 | val_loss: 0.0311702 | Time: 5293.78 ms [2022-04-04 09:12:59 main:574] : INFO : Epoch 2011 | loss: 0.0311686 | val_loss: 0.0311738 | Time: 4655.35 ms [2022-04-04 09:13:04 main:574] : INFO : Epoch 2012 | loss: 0.0311702 | val_loss: 0.0311716 | Time: 4726.84 ms [2022-04-04 09:13:09 main:574] : INFO : Epoch 2013 | loss: 0.0311694 | val_loss: 0.0311709 | Time: 4890.48 ms [2022-04-04 09:13:14 main:574] : INFO : Epoch 2014 | loss: 0.0311687 | val_loss: 0.0311706 | Time: 5127.23 ms [2022-04-04 09:13:19 main:574] : INFO : Epoch 2015 | loss: 0.03117 | val_loss: 0.0311762 | Time: 4998.95 ms [2022-04-04 09:13:25 main:574] : INFO : Epoch 2016 | loss: 0.0311713 | val_loss: 0.0311699 | Time: 4813.43 ms [2022-04-04 09:13:30 main:574] : INFO : Epoch 2017 | loss: 0.0311685 | val_loss: 0.0311705 | Time: 4796.43 ms [2022-04-04 09:13:35 main:574] : INFO : Epoch 2018 | loss: 0.0311702 | val_loss: 0.0311728 | Time: 4738.56 ms [2022-04-04 09:13:41 main:574] : INFO : Epoch 2019 | loss: 0.0311719 | val_loss: 0.0311713 | Time: 4841.71 ms [2022-04-04 09:13:46 main:574] : INFO : Epoch 2020 | loss: 0.0311718 | val_loss: 0.0311726 | Time: 4752.84 ms [2022-04-04 09:13:51 main:574] : INFO : Epoch 2021 | loss: 0.031171 | val_loss: 0.0311703 | Time: 4865.95 ms [2022-04-04 09:13:57 main:574] : INFO : Epoch 2022 | loss: 0.0311726 | val_loss: 0.0311734 | Time: 5215.74 ms [2022-04-04 09:14:02 main:574] : INFO : Epoch 2023 | loss: 0.0311732 | val_loss: 0.0311736 | Time: 4684.81 ms [2022-04-04 09:14:08 main:574] : INFO : Epoch 2024 | loss: 0.0311739 | val_loss: 0.0311739 | Time: 5059.13 ms [2022-04-04 09:14:13 main:574] : INFO : Epoch 2025 | loss: 0.0311734 | val_loss: 0.0311752 | Time: 4800.05 ms [2022-04-04 09:14:19 main:574] : INFO : Epoch 2026 | loss: 0.0311724 | val_loss: 0.0311752 | Time: 4860.81 ms [2022-04-04 09:14:24 main:574] : INFO : Epoch 2027 | loss: 0.0311721 | val_loss: 0.0311731 | Time: 4648.76 ms [2022-04-04 09:14:29 main:574] : INFO : Epoch 2028 | loss: 0.0311724 | val_loss: 0.0311781 | Time: 4922.91 ms [2022-04-04 09:14:34 main:574] : INFO : Epoch 2029 | loss: 0.0311851 | val_loss: 0.0311943 | Time: 4728.82 ms [2022-04-04 09:14:39 main:574] : INFO : Epoch 2030 | loss: 0.0311959 | val_loss: 0.0311919 | Time: 4781.29 ms [2022-04-04 09:14:46 main:574] : INFO : Epoch 2031 | loss: 0.0311911 | val_loss: 0.0311856 | Time: 4702.38 ms [2022-04-04 09:14:51 main:574] : INFO : Epoch 2032 | loss: 0.0311824 | val_loss: 0.0311817 | Time: 4795.22 ms [2022-04-04 09:14:56 main:574] : INFO : Epoch 2033 | loss: 0.0311836 | val_loss: 0.0311785 | Time: 4801.65 ms [2022-04-04 09:15:01 main:574] : INFO : Epoch 2034 | loss: 0.0311783 | val_loss: 0.031184 | Time: 4199.47 ms [2022-04-04 09:15:05 main:574] : INFO : Epoch 2035 | loss: 0.0311793 | val_loss: 0.0311774 | Time: 4451.94 ms [2022-04-04 09:15:10 main:574] : INFO : Epoch 2036 | loss: 0.0311769 | val_loss: 0.031177 | Time: 4568.45 ms [2022-04-04 09:15:15 main:574] : INFO : Epoch 2037 | loss: 0.0311798 | val_loss: 0.0311792 | Time: 4354.12 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050) [2022-04-04 09:21:37 main:435] : INFO : Set logging level to 1 [2022-04-04 09:21:37 main:441] : INFO : Running in BOINC Client mode [2022-04-04 09:21:37 main:444] : INFO : Resolving all filenames [2022-04-04 09:21:37 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-04 09:21:38 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-04 09:21:38 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-04 09:21:38 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-04 09:21:38 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-04 09:21:38 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-04 09:21:38 main:474] : INFO : Configuration: [2022-04-04 09:21:39 main:475] : INFO : Model type: GRU [2022-04-04 09:21:39 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-04 09:21:39 main:477] : INFO : Max Epochs: 2048 [2022-04-04 09:21:39 main:478] : INFO : Batch Size: 128 [2022-04-04 09:21:39 main:479] : INFO : Learning Rate: 0.01 [2022-04-04 09:21:39 main:480] : INFO : Patience: 10 [2022-04-04 09:21:39 main:481] : INFO : Hidden Width: 12 [2022-04-04 09:21:40 main:482] : INFO : # Recurrent Layers: 4 [2022-04-04 09:21:40 main:483] : INFO : # Backend Layers: 4 [2022-04-04 09:21:40 main:484] : INFO : # Threads: 1 [2022-04-04 09:21:40 main:486] : INFO : Preparing Dataset [2022-04-04 09:21:40 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-04 09:21:41 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-04 09:21:43 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-04 09:21:43 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-04 09:21:44 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-04 09:21:44 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-04 09:21:44 main:494] : INFO : Creating Model [2022-04-04 09:21:44 main:507] : INFO : Preparing config file [2022-04-04 09:21:44 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-04 09:21:44 main:512] : INFO : Loading config [2022-04-04 09:21:45 main:514] : INFO : Loading state [2022-04-04 09:21:46 main:559] : INFO : Loading DataLoader into Memory [2022-04-04 09:21:46 main:562] : INFO : Starting Training [2022-04-04 09:21:52 main:574] : INFO : Epoch 2029 | loss: 0.0312082 | val_loss: 0.0311813 | Time: 5922.83 ms [2022-04-04 09:21:58 main:574] : INFO : Epoch 2030 | loss: 0.0311752 | val_loss: 0.0311735 | Time: 5715.94 ms [2022-04-04 09:22:03 main:574] : INFO : Epoch 2031 | loss: 0.0311703 | val_loss: 0.0311728 | Time: 5389.39 ms [2022-04-04 09:22:09 main:574] : INFO : Epoch 2032 | loss: 0.0311696 | val_loss: 0.0311709 | Time: 5438.4 ms [2022-04-04 09:22:15 main:574] : INFO : Epoch 2033 | loss: 0.0311704 | val_loss: 0.0311708 | Time: 5734.55 ms [2022-04-04 09:22:20 main:574] : INFO : Epoch 2034 | loss: 0.0311702 | val_loss: 0.0311692 | Time: 4542 ms [2022-04-04 09:22:25 main:574] : INFO : Epoch 2035 | loss: 0.0311666 | val_loss: 0.0311684 | Time: 4479.27 ms [2022-04-04 09:22:30 main:574] : INFO : Epoch 2036 | loss: 0.0311672 | val_loss: 0.0311674 | Time: 4422.81 ms [2022-04-04 09:22:35 main:574] : INFO : Epoch 2037 | loss: 0.0311662 | val_loss: 0.0311667 | Time: 4575.69 ms [2022-04-04 09:22:40 main:574] : INFO : Epoch 2038 | loss: 0.0311658 | val_loss: 0.0311666 | Time: 4673.79 ms [2022-04-04 09:22:45 main:574] : INFO : Epoch 2039 | loss: 0.0311654 | val_loss: 0.031169 | Time: 4640.17 ms [2022-04-04 09:22:50 main:574] : INFO : Epoch 2040 | loss: 0.0311666 | val_loss: 0.0311675 | Time: 5391.39 ms [2022-04-04 09:22:56 main:574] : INFO : Epoch 2041 | loss: 0.0311651 | val_loss: 0.0311674 | Time: 5406.35 ms [2022-04-04 09:23:02 main:574] : INFO : Epoch 2042 | loss: 0.0311658 | val_loss: 0.0311708 | Time: 5481.2 ms [2022-04-04 09:23:07 main:574] : INFO : Epoch 2043 | loss: 0.0311687 | val_loss: 0.0311696 | Time: 5395.97 ms [2022-04-04 09:23:13 main:574] : INFO : Epoch 2044 | loss: 0.0311671 | val_loss: 0.0311702 | Time: 5604.62 ms [2022-04-04 09:23:19 main:574] : INFO : Epoch 2045 | loss: 0.0311678 | val_loss: 0.0311702 | Time: 5727.87 ms [2022-04-04 09:23:24 main:574] : INFO : Epoch 2046 | loss: 0.0311698 | val_loss: 0.0311695 | Time: 5487.53 ms [2022-04-04 09:23:30 main:574] : INFO : Epoch 2047 | loss: 0.0311695 | val_loss: 0.0311695 | Time: 5574.96 ms [2022-04-04 09:23:36 main:574] : INFO : Epoch 2048 | loss: 0.0311674 | val_loss: 0.0311676 | Time: 5639.9 ms [2022-04-04 09:23:36 main:597] : INFO : Saving trained model to model-final.pt, val_loss 0.0311676 [2022-04-04 09:23:36 main:603] : INFO : Saving end state to config to file [2022-04-04 09:23:36 main:608] : INFO : Success, exiting.. 09:23:36 (8292): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)