Task 10820625
| Name | ParityModified-1638634899-28119-2-0_1 |
| Workunit | 7441442 |
| Created | 16 Jan 2022, 13:52:02 UTC |
| Sent | 16 Jan 2022, 14:51:30 UTC |
| Report deadline | 24 Jan 2022, 14:51:30 UTC |
| Received | 11 Feb 2022, 23:55:49 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 17083 |
| Run time | 4 hours 23 min 34 sec |
| CPU time | 4 hours 16 min 50 sec |
| Validate state | Task was reported too late to validate |
| Credit | 0.00 |
| Device peak FLOPS | 3,199.46 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 3.25 GB |
| Peak swap size | 4.30 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version> <![CDATA[ <stderr_txt> 31089 | val_loss: 0.0311937 | Time: 11821.1 ms [2022-02-09 16:24:38 main:574] : INFO : Epoch 1828 | loss: 0.0310852 | val_loss: 0.0311994 | Time: 11874.2 ms [2022-02-09 16:24:50 main:574] : INFO : Epoch 1829 | loss: 0.0310856 | val_loss: 0.0311972 | Time: 11402.2 ms [2022-02-09 16:25:01 main:574] : INFO : Epoch 1830 | loss: 0.0310842 | val_loss: 0.031199 | Time: 11292.2 ms [2022-02-09 16:25:13 main:574] : INFO : Epoch 1831 | loss: 0.0310835 | val_loss: 0.0312029 | Time: 12268.1 ms [2022-02-09 16:25:25 main:574] : INFO : Epoch 1832 | loss: 0.0310865 | val_loss: 0.0311886 | Time: 11701.3 ms [2022-02-09 16:25:41 main:574] : INFO : Epoch 1833 | loss: 0.031102 | val_loss: 0.0311959 | Time: 16113.8 ms [2022-02-09 16:25:53 main:574] : INFO : Epoch 1834 | loss: 0.0310996 | val_loss: 0.0311902 | Time: 12328.8 ms [2022-02-09 16:26:04 main:574] : INFO : Epoch 1835 | loss: 0.0310914 | val_loss: 0.0311922 | Time: 10429.8 ms [2022-02-09 16:26:14 main:574] : INFO : Epoch 1836 | loss: 0.0310915 | val_loss: 0.0311916 | Time: 10197.3 ms [2022-02-09 16:26:23 main:574] : INFO : Epoch 1837 | loss: 0.0310885 | val_loss: 0.0311932 | Time: 9503.72 ms [2022-02-09 16:26:33 main:574] : INFO : Epoch 1838 | loss: 0.0310887 | val_loss: 0.0311934 | Time: 9870.7 ms [2022-02-09 16:26:43 main:574] : INFO : Epoch 1839 | loss: 0.031088 | val_loss: 0.0312049 | Time: 9769.55 ms [2022-02-09 16:26:53 main:574] : INFO : Epoch 1840 | loss: 0.0310871 | val_loss: 0.0311985 | Time: 9760.57 ms [2022-02-09 16:27:03 main:574] : INFO : Epoch 1841 | loss: 0.0310887 | val_loss: 0.0311889 | Time: 9896.04 ms [2022-02-09 16:27:13 main:574] : INFO : Epoch 1842 | loss: 0.0310931 | val_loss: 0.0311915 | Time: 9832.33 ms [2022-02-09 16:27:22 main:574] : INFO : Epoch 1843 | loss: 0.0310913 | val_loss: 0.031196 | Time: 9840.69 ms [2022-02-09 16:27:32 main:574] : INFO : Epoch 1844 | loss: 0.0310884 | val_loss: 0.0311966 | Time: 9708.26 ms [2022-02-09 16:27:42 main:574] : INFO : Epoch 1845 | loss: 0.0310869 | val_loss: 0.0311996 | Time: 9869.77 ms [2022-02-09 16:27:52 main:574] : INFO : Epoch 1846 | loss: 0.0310855 | val_loss: 0.0312027 | Time: 9776.88 ms [2022-02-09 16:28:02 main:574] : INFO : Epoch 1847 | loss: 0.031091 | val_loss: 0.0312024 | Time: 9826.31 ms [2022-02-09 16:28:12 main:574] : INFO : Epoch 1848 | loss: 0.0310893 | val_loss: 0.0311969 | Time: 9947.43 ms [2022-02-09 16:28:22 main:574] : INFO : Epoch 1849 | loss: 0.0310912 | val_loss: 0.0311923 | Time: 9911.04 ms [2022-02-09 16:28:29 main:574] : INFO : Epoch 1850 | loss: 0.0311009 | val_loss: 0.0311974 | Time: 7734.47 ms [2022-02-09 16:28:37 main:574] : INFO : Epoch 1851 | loss: 0.0310954 | val_loss: 0.0311922 | Time: 7765.97 ms [2022-02-09 16:28:45 main:574] : INFO : Epoch 1852 | loss: 0.0310905 | val_loss: 0.0311938 | Time: 7709.17 ms [2022-02-09 16:28:53 main:574] : INFO : Epoch 1853 | loss: 0.0310915 | val_loss: 0.0311928 | Time: 7919.59 ms [2022-02-09 16:29:01 main:574] : INFO : Epoch 1854 | loss: 0.0310936 | val_loss: 0.0311883 | Time: 8072.16 ms [2022-02-09 16:29:09 main:574] : INFO : Epoch 1855 | loss: 0.03109 | val_loss: 0.0311875 | Time: 7933.59 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1650) [2022-02-10 00:39:14 main:435] : INFO : Set logging level to 1 [2022-02-10 00:39:14 main:441] : INFO : Running in BOINC Client mode [2022-02-10 00:39:14 main:444] : INFO : Resolving all filenames [2022-02-10 00:39:14 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-10 00:39:14 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-10 00:39:14 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-10 00:39:14 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-10 00:39:14 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-10 00:39:14 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-10 00:39:14 main:474] : INFO : Configuration: [2022-02-10 00:39:14 main:475] : INFO : Model type: GRU [2022-02-10 00:39:14 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-10 00:39:14 main:477] : INFO : Max Epochs: 2048 [2022-02-10 00:39:14 main:478] : INFO : Batch Size: 128 [2022-02-10 00:39:14 main:479] : INFO : Learning Rate: 0.01 [2022-02-10 00:39:14 main:480] : INFO : Patience: 10 [2022-02-10 00:39:14 main:481] : INFO : Hidden Width: 12 [2022-02-10 00:39:14 main:482] : INFO : # Recurrent Layers: 4 [2022-02-10 00:39:14 main:483] : INFO : # Backend Layers: 4 [2022-02-10 00:39:14 main:484] : INFO : # Threads: 1 [2022-02-10 00:39:14 main:486] : INFO : Preparing Dataset [2022-02-10 00:39:14 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-10 00:39:15 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-10 00:39:17 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-10 00:39:17 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-10 00:39:18 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-10 00:39:18 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-10 00:39:18 main:494] : INFO : Creating Model [2022-02-10 00:39:18 main:507] : INFO : Preparing config file [2022-02-10 00:39:18 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-10 00:39:18 main:512] : INFO : Loading config [2022-02-10 00:39:18 main:514] : INFO : Loading state [2022-02-10 00:39:20 main:559] : INFO : Loading DataLoader into Memory [2022-02-10 00:39:20 main:562] : INFO : Starting Training [2022-02-10 00:39:27 main:574] : INFO : Epoch 1852 | loss: 0.0311443 | val_loss: 0.0311959 | Time: 6959.78 ms [2022-02-10 00:39:36 main:574] : INFO : Epoch 1853 | loss: 0.0311012 | val_loss: 0.0311926 | Time: 9056.83 ms [2022-02-10 00:39:50 main:574] : INFO : Epoch 1854 | loss: 0.0310933 | val_loss: 0.031197 | Time: 13572.9 ms [2022-02-10 00:40:03 main:574] : INFO : Epoch 1855 | loss: 0.0310972 | val_loss: 0.0311883 | Time: 13240.2 ms [2022-02-10 00:40:16 main:574] : INFO : Epoch 1856 | loss: 0.0310984 | val_loss: 0.0311857 | Time: 13222.7 ms [2022-02-10 00:40:29 main:574] : INFO : Epoch 1857 | loss: 0.0310942 | val_loss: 0.0311902 | Time: 12994.9 ms [2022-02-10 00:40:42 main:574] : INFO : Epoch 1858 | loss: 0.0310911 | val_loss: 0.0311863 | Time: 12826.5 ms [2022-02-10 00:40:55 main:574] : INFO : Epoch 1859 | loss: 0.0310908 | val_loss: 0.0311904 | Time: 12962 ms [2022-02-10 00:41:08 main:574] : INFO : Epoch 1860 | loss: 0.0310911 | val_loss: 0.0311852 | Time: 13302.4 ms [2022-02-10 00:41:21 main:574] : INFO : Epoch 1861 | loss: 0.0310988 | val_loss: 0.0311778 | Time: 12720.2 ms [2022-02-10 00:41:34 main:574] : INFO : Epoch 1862 | loss: 0.0310994 | val_loss: 0.0311861 | Time: 13413.2 ms [2022-02-10 00:41:47 main:574] : INFO : Epoch 1863 | loss: 0.0310906 | val_loss: 0.0311877 | Time: 11538.9 ms [2022-02-10 00:42:00 main:574] : INFO : Epoch 1864 | loss: 0.03109 | val_loss: 0.0311996 | Time: 11504.3 ms [2022-02-10 00:42:12 main:574] : INFO : Epoch 1865 | loss: 0.0310908 | val_loss: 0.0311942 | Time: 11326.1 ms [2022-02-10 00:42:25 main:574] : INFO : Epoch 1866 | loss: 0.0310917 | val_loss: 0.0311857 | Time: 11213.9 ms [2022-02-10 00:42:34 main:574] : INFO : Epoch 1867 | loss: 0.0310899 | val_loss: 0.0311864 | Time: 8704.8 ms [2022-02-10 00:42:43 main:574] : INFO : Epoch 1868 | loss: 0.0310984 | val_loss: 0.0311874 | Time: 9110.16 ms [2022-02-10 00:42:53 main:574] : INFO : Epoch 1869 | loss: 0.0310962 | val_loss: 0.0311794 | Time: 8553.74 ms [2022-02-10 00:43:02 main:574] : INFO : Epoch 1870 | loss: 0.031102 | val_loss: 0.0311843 | Time: 9881.45 ms [2022-02-10 00:43:11 main:574] : INFO : Epoch 1871 | loss: 0.0310996 | val_loss: 0.0311967 | Time: 8863.34 ms [2022-02-10 00:43:25 main:574] : INFO : Epoch 1872 | loss: 0.0310952 | val_loss: 0.0311967 | Time: 13373.7 ms [2022-02-10 00:43:35 main:574] : INFO : Epoch 1873 | loss: 0.0310898 | val_loss: 0.0311871 | Time: 10437.2 ms [2022-02-10 00:43:46 main:574] : INFO : Epoch 1874 | loss: 0.0310991 | val_loss: 0.0311838 | Time: 10262.6 ms [2022-02-10 00:43:56 main:574] : INFO : Epoch 1875 | loss: 0.0310971 | val_loss: 0.0311969 | Time: 10615.7 ms [2022-02-10 00:44:08 main:574] : INFO : Epoch 1876 | loss: 0.0310924 | val_loss: 0.0311928 | Time: 12140.4 ms [2022-02-10 00:44:19 main:574] : INFO : Epoch 1877 | loss: 0.0310921 | val_loss: 0.0311951 | Time: 10439.9 ms [2022-02-10 00:44:32 main:574] : INFO : Epoch 1878 | loss: 0.0310931 | val_loss: 0.0312001 | Time: 12727.9 ms [2022-02-10 00:44:43 main:574] : INFO : Epoch 1879 | loss: 0.0310913 | val_loss: 0.0311937 | Time: 11229 ms [2022-02-10 00:44:54 main:574] : INFO : Epoch 1880 | loss: 0.0310922 | val_loss: 0.0311991 | Time: 11367.9 ms [2022-02-10 00:45:04 main:574] : INFO : Epoch 1881 | loss: 0.0310944 | val_loss: 0.0311913 | Time: 10075.7 ms [2022-02-10 00:45:15 main:574] : INFO : Epoch 1882 | loss: 0.0310913 | val_loss: 0.0311988 | Time: 10404.5 ms [2022-02-10 00:45:25 main:574] : INFO : Epoch 1883 | loss: 0.0310927 | val_loss: 0.0312036 | Time: 10539 ms [2022-02-10 00:45:36 main:574] : INFO : Epoch 1884 | loss: 0.0310993 | val_loss: 0.0311929 | Time: 10456.3 ms [2022-02-10 00:45:46 main:574] : INFO : Epoch 1885 | loss: 0.0310944 | val_loss: 0.0312079 | Time: 10426.2 ms [2022-02-10 00:45:58 main:574] : INFO : Epoch 1886 | loss: 0.0310909 | val_loss: 0.0311929 | Time: 11836.2 ms [2022-02-10 00:46:09 main:574] : INFO : Epoch 1887 | loss: 0.0310879 | val_loss: 0.0311908 | Time: 11111.2 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1650) [2022-02-10 12:17:56 main:435] : INFO : Set logging level to 1 [2022-02-10 12:17:56 main:441] : INFO : Running in BOINC Client mode [2022-02-10 12:17:56 main:444] : INFO : Resolving all filenames [2022-02-10 12:17:56 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-10 12:17:56 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-10 12:17:56 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-10 12:17:56 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-10 12:17:56 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-10 12:17:56 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-10 12:17:56 main:474] : INFO : Configuration: [2022-02-10 12:17:56 main:475] : INFO : Model type: GRU [2022-02-10 12:17:56 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-10 12:17:56 main:477] : INFO : Max Epochs: 2048 [2022-02-10 12:17:56 main:478] : INFO : Batch Size: 128 [2022-02-10 12:17:56 main:479] : INFO : Learning Rate: 0.01 [2022-02-10 12:17:56 main:480] : INFO : Patience: 10 [2022-02-10 12:17:56 main:481] : INFO : Hidden Width: 12 [2022-02-10 12:17:56 main:482] : INFO : # Recurrent Layers: 4 [2022-02-10 12:17:56 main:483] : INFO : # Backend Layers: 4 [2022-02-10 12:17:57 main:484] : INFO : # Threads: 1 [2022-02-10 12:17:57 main:486] : INFO : Preparing Dataset [2022-02-10 12:17:57 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-10 12:17:57 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-10 12:17:59 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-10 12:17:59 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-10 12:17:59 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-10 12:17:59 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-10 12:17:59 main:494] : INFO : Creating Model [2022-02-10 12:17:59 main:507] : INFO : Preparing config file [2022-02-10 12:17:59 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-10 12:17:59 main:512] : INFO : Loading config [2022-02-10 12:17:59 main:514] : INFO : Loading state [2022-02-10 12:18:01 main:559] : INFO : Loading DataLoader into Memory [2022-02-10 12:18:01 main:562] : INFO : Starting Training Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1650) [2022-02-10 13:53:14 main:435] : INFO : Set logging level to 1 [2022-02-10 13:53:14 main:441] : INFO : Running in BOINC Client mode [2022-02-10 13:53:14 main:444] : INFO : Resolving all filenames [2022-02-10 13:53:14 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-10 13:53:14 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-10 13:53:14 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-10 13:53:14 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-10 13:53:14 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-10 13:53:14 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-10 13:53:14 main:474] : INFO : Configuration: [2022-02-10 13:53:14 main:475] : INFO : Model type: GRU [2022-02-10 13:53:14 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-10 13:53:14 main:477] : INFO : Max Epochs: 2048 [2022-02-10 13:53:14 main:478] : INFO : Batch Size: 128 [2022-02-10 13:53:14 main:479] : INFO : Learning Rate: 0.01 [2022-02-10 13:53:14 main:480] : INFO : Patience: 10 [2022-02-10 13:53:14 main:481] : INFO : Hidden Width: 12 [2022-02-10 13:53:14 main:482] : INFO : # Recurrent Layers: 4 [2022-02-10 13:53:14 main:483] : INFO : # Backend Layers: 4 [2022-02-10 13:53:14 main:484] : INFO : # Threads: 1 [2022-02-10 13:53:14 main:486] : INFO : Preparing Dataset [2022-02-10 13:53:14 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-10 13:53:14 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-10 13:53:16 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-10 13:53:16 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-10 13:53:16 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-10 13:53:16 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-10 13:53:16 main:494] : INFO : Creating Model [2022-02-10 13:53:16 main:507] : INFO : Preparing config file [2022-02-10 13:53:16 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-10 13:53:16 main:512] : INFO : Loading config [2022-02-10 13:53:16 main:514] : INFO : Loading state [2022-02-10 13:53:17 main:559] : INFO : Loading DataLoader into Memory [2022-02-10 13:53:17 main:562] : INFO : Starting Training [2022-02-10 13:53:21 main:574] : INFO : Epoch 1887 | loss: 0.0311569 | val_loss: 0.0312052 | Time: 4679.87 ms [2022-02-10 13:53:25 main:574] : INFO : Epoch 1888 | loss: 0.0311001 | val_loss: 0.0311962 | Time: 4063.39 ms [2022-02-10 13:53:30 main:574] : INFO : Epoch 1889 | loss: 0.0310937 | val_loss: 0.0311884 | Time: 4453.48 ms [2022-02-10 13:53:35 main:574] : INFO : Epoch 1890 | loss: 0.0310888 | val_loss: 0.0312044 | Time: 4555.49 ms [2022-02-10 13:53:39 main:574] : INFO : Epoch 1891 | loss: 0.0310882 | val_loss: 0.0311951 | Time: 4686.31 ms [2022-02-10 13:53:45 main:574] : INFO : Epoch 1892 | loss: 0.0310894 | val_loss: 0.03119 | Time: 4662.4 ms [2022-02-10 13:53:50 main:574] : INFO : Epoch 1893 | loss: 0.0310887 | val_loss: 0.0312013 | Time: 4537.52 ms [2022-02-10 13:53:54 main:574] : INFO : Epoch 1894 | loss: 0.0310862 | val_loss: 0.0311995 | Time: 4759.88 ms [2022-02-10 13:53:59 main:574] : INFO : Epoch 1895 | loss: 0.0310844 | val_loss: 0.0311956 | Time: 4930.44 ms [2022-02-10 13:54:04 main:574] : INFO : Epoch 1896 | loss: 0.0310853 | val_loss: 0.0312026 | Time: 5016.82 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1650) [2022-02-10 13:57:15 main:435] : INFO : Set logging level to 1 [2022-02-10 13:57:15 main:441] : INFO : Running in BOINC Client mode [2022-02-10 13:57:15 main:444] : INFO : Resolving all filenames [2022-02-10 13:57:15 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-10 13:57:15 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-10 13:57:15 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-10 13:57:15 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-10 13:57:15 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-10 13:57:15 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-10 13:57:15 main:474] : INFO : Configuration: [2022-02-10 13:57:15 main:475] : INFO : Model type: GRU [2022-02-10 13:57:15 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-10 13:57:15 main:477] : INFO : Max Epochs: 2048 [2022-02-10 13:57:15 main:478] : INFO : Batch Size: 128 [2022-02-10 13:57:15 main:479] : INFO : Learning Rate: 0.01 [2022-02-10 13:57:15 main:480] : INFO : Patience: 10 [2022-02-10 13:57:15 main:481] : INFO : Hidden Width: 12 [2022-02-10 13:57:15 main:482] : INFO : # Recurrent Layers: 4 [2022-02-10 13:57:15 main:483] : INFO : # Backend Layers: 4 [2022-02-10 13:57:15 main:484] : INFO : # Threads: 1 [2022-02-10 13:57:15 main:486] : INFO : Preparing Dataset [2022-02-10 13:57:15 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-10 13:57:15 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-10 13:57:17 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-10 13:57:17 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-10 13:57:17 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-10 13:57:17 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-10 13:57:17 main:494] : INFO : Creating Model [2022-02-10 13:57:17 main:507] : INFO : Preparing config file [2022-02-10 13:57:17 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-10 13:57:17 main:512] : INFO : Loading config [2022-02-10 13:57:17 main:514] : INFO : Loading state [2022-02-10 13:57:18 main:559] : INFO : Loading DataLoader into Memory [2022-02-10 13:57:18 main:562] : INFO : Starting Training [2022-02-10 13:57:22 main:574] : INFO : Epoch 1887 | loss: 0.0311515 | val_loss: 0.0312063 | Time: 4465.4 ms [2022-02-10 13:57:27 main:574] : INFO : Epoch 1888 | loss: 0.0311022 | val_loss: 0.0311998 | Time: 4354.81 ms [2022-02-10 13:57:31 main:574] : INFO : Epoch 1889 | loss: 0.0310924 | val_loss: 0.0311887 | Time: 4247.79 ms [2022-02-10 13:57:36 main:574] : INFO : Epoch 1890 | loss: 0.0310864 | val_loss: 0.0311953 | Time: 4540.24 ms [2022-02-10 13:57:40 main:574] : INFO : Epoch 1891 | loss: 0.0310862 | val_loss: 0.0311914 | Time: 4595.55 ms [2022-02-10 13:57:45 main:574] : INFO : Epoch 1892 | loss: 0.0310846 | val_loss: 0.031191 | Time: 4714.11 ms [2022-02-10 13:57:50 main:574] : INFO : Epoch 1893 | loss: 0.0310869 | val_loss: 0.0311975 | Time: 4763.88 ms [2022-02-10 13:57:54 main:574] : INFO : Epoch 1894 | loss: 0.031091 | val_loss: 0.0311917 | Time: 4595.15 ms [2022-02-10 13:57:59 main:574] : INFO : Epoch 1895 | loss: 0.0310983 | val_loss: 0.0312055 | Time: 4945.18 ms [2022-02-10 13:58:04 main:574] : INFO : Epoch 1896 | loss: 0.031092 | val_loss: 0.0311994 | Time: 5156.43 ms [2022-02-10 13:58:10 main:574] : INFO : Epoch 1897 | loss: 0.03109 | val_loss: 0.0311959 | Time: 5753.79 ms [2022-02-10 13:58:19 main:574] : INFO : Epoch 1898 | loss: 0.0310887 | val_loss: 0.0311895 | Time: 8626.62 ms [2022-02-10 13:58:28 main:574] : INFO : Epoch 1899 | loss: 0.0311011 | val_loss: 0.0311822 | Time: 9577.37 ms [2022-02-10 13:58:38 main:574] : INFO : Epoch 1900 | loss: 0.0311142 | val_loss: 0.0311771 | Time: 10109.7 ms [2022-02-10 13:58:48 main:574] : INFO : Epoch 1901 | loss: 0.0311077 | val_loss: 0.0311887 | Time: 9604.37 ms [2022-02-10 13:58:58 main:574] : INFO : Epoch 1902 | loss: 0.031105 | val_loss: 0.0311813 | Time: 9605.95 ms [2022-02-10 13:59:07 main:574] : INFO : Epoch 1903 | loss: 0.0311051 | val_loss: 0.0311845 | Time: 9394.94 ms [2022-02-10 13:59:15 main:574] : INFO : Epoch 1904 | loss: 0.0311063 | val_loss: 0.031186 | Time: 8448.72 ms [2022-02-10 13:59:24 main:574] : INFO : Epoch 1905 | loss: 0.0311008 | val_loss: 0.0311971 | Time: 8732.35 ms [2022-02-10 13:59:32 main:574] : INFO : Epoch 1906 | loss: 0.0311006 | val_loss: 0.0312003 | Time: 8084.73 ms [2022-02-10 13:59:41 main:574] : INFO : Epoch 1907 | loss: 0.031098 | val_loss: 0.0311829 | Time: 8764.75 ms [2022-02-10 13:59:50 main:574] : INFO : Epoch 1908 | loss: 0.0311039 | val_loss: 0.0311851 | Time: 8886.84 ms [2022-02-10 14:00:08 main:574] : INFO : Epoch 1909 | loss: 0.0310977 | val_loss: 0.0311935 | Time: 18189.7 ms [2022-02-10 14:00:17 main:574] : INFO : Epoch 1910 | loss: 0.0310934 | val_loss: 0.0311942 | Time: 8178.93 ms [2022-02-10 14:00:26 main:574] : INFO : Epoch 1911 | loss: 0.031093 | val_loss: 0.0311954 | Time: 9107.88 ms [2022-02-10 14:00:34 main:574] : INFO : Epoch 1912 | loss: 0.0310894 | val_loss: 0.0311983 | Time: 8704.81 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1650) [2022-02-10 16:26:22 main:435] : INFO : Set logging level to 1 [2022-02-10 16:26:22 main:441] : INFO : Running in BOINC Client mode [2022-02-10 16:26:22 main:444] : INFO : Resolving all filenames [2022-02-10 16:26:22 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-10 16:26:22 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-10 16:26:22 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-10 16:26:22 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-10 16:26:22 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-10 16:26:22 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-10 16:26:22 main:474] : INFO : Configuration: [2022-02-10 16:26:22 main:475] : INFO : Model type: GRU [2022-02-10 16:26:22 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-10 16:26:22 main:477] : INFO : Max Epochs: 2048 [2022-02-10 16:26:22 main:478] : INFO : Batch Size: 128 [2022-02-10 16:26:22 main:479] : INFO : Learning Rate: 0.01 [2022-02-10 16:26:22 main:480] : INFO : Patience: 10 [2022-02-10 16:26:22 main:481] : INFO : Hidden Width: 12 [2022-02-10 16:26:22 main:482] : INFO : # Recurrent Layers: 4 [2022-02-10 16:26:22 main:483] : INFO : # Backend Layers: 4 [2022-02-10 16:26:22 main:484] : INFO : # Threads: 1 [2022-02-10 16:26:22 main:486] : INFO : Preparing Dataset [2022-02-10 16:26:22 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-10 16:26:22 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-10 16:26:24 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-10 16:26:24 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-10 16:26:24 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-10 16:26:24 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-10 16:26:24 main:494] : INFO : Creating Model [2022-02-10 16:26:24 main:507] : INFO : Preparing config file [2022-02-10 16:26:24 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-10 16:26:24 main:512] : INFO : Loading config [2022-02-10 16:26:24 main:514] : INFO : Loading state [2022-02-10 16:26:26 main:559] : INFO : Loading DataLoader into Memory [2022-02-10 16:26:26 main:562] : INFO : Starting Training [2022-02-10 16:26:31 main:574] : INFO : Epoch 1913 | loss: 0.031162 | val_loss: 0.0312053 | Time: 4756.2 ms [2022-02-10 16:26:35 main:574] : INFO : Epoch 1914 | loss: 0.0311032 | val_loss: 0.0311939 | Time: 4614.16 ms [2022-02-10 16:26:40 main:574] : INFO : Epoch 1915 | loss: 0.031093 | val_loss: 0.0311937 | Time: 4535.79 ms [2022-02-10 16:26:44 main:574] : INFO : Epoch 1916 | loss: 0.0310906 | val_loss: 0.0311825 | Time: 4462 ms [2022-02-10 16:26:49 main:574] : INFO : Epoch 1917 | loss: 0.0310919 | val_loss: 0.0311894 | Time: 4676.19 ms [2022-02-10 16:26:54 main:574] : INFO : Epoch 1918 | loss: 0.0310925 | val_loss: 0.0311931 | Time: 4467.16 ms [2022-02-10 16:26:58 main:574] : INFO : Epoch 1919 | loss: 0.031093 | val_loss: 0.0311886 | Time: 4530.16 ms [2022-02-10 16:27:03 main:574] : INFO : Epoch 1920 | loss: 0.0310953 | val_loss: 0.0311924 | Time: 4680.29 ms [2022-02-10 16:27:08 main:574] : INFO : Epoch 1921 | loss: 0.0310928 | val_loss: 0.0311945 | Time: 4758.67 ms [2022-02-10 16:27:13 main:574] : INFO : Epoch 1922 | loss: 0.0310912 | val_loss: 0.031196 | Time: 4880.46 ms [2022-02-10 16:27:18 main:574] : INFO : Epoch 1923 | loss: 0.0310895 | val_loss: 0.0311907 | Time: 4956.75 ms [2022-02-10 16:27:23 main:574] : INFO : Epoch 1924 | loss: 0.0310872 | val_loss: 0.0311982 | Time: 5301.67 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1650) [2022-02-10 16:55:28 main:435] : INFO : Set logging level to 1 [2022-02-10 16:55:28 main:441] : INFO : Running in BOINC Client mode [2022-02-10 16:55:28 main:444] : INFO : Resolving all filenames [2022-02-10 16:55:28 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-10 16:55:28 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-10 16:55:28 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-10 16:55:28 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-10 16:55:28 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-10 16:55:28 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-10 16:55:28 main:474] : INFO : Configuration: [2022-02-10 16:55:28 main:475] : INFO : Model type: GRU [2022-02-10 16:55:28 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-10 16:55:28 main:477] : INFO : Max Epochs: 2048 [2022-02-10 16:55:28 main:478] : INFO : Batch Size: 128 [2022-02-10 16:55:28 main:479] : INFO : Learning Rate: 0.01 [2022-02-10 16:55:28 main:480] : INFO : Patience: 10 [2022-02-10 16:55:28 main:481] : INFO : Hidden Width: 12 [2022-02-10 16:55:28 main:482] : INFO : # Recurrent Layers: 4 [2022-02-10 16:55:28 main:483] : INFO : # Backend Layers: 4 [2022-02-10 16:55:28 main:484] : INFO : # Threads: 1 [2022-02-10 16:55:28 main:486] : INFO : Preparing Dataset [2022-02-10 16:55:28 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-10 16:55:29 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-10 16:55:31 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-10 16:55:31 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-10 16:55:31 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-10 16:55:31 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-10 16:55:31 main:494] : INFO : Creating Model [2022-02-10 16:55:31 main:507] : INFO : Preparing config file [2022-02-10 16:55:31 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-10 16:55:31 main:512] : INFO : Loading config [2022-02-10 16:55:31 main:514] : INFO : Loading state [2022-02-10 16:55:33 main:559] : INFO : Loading DataLoader into Memory [2022-02-10 16:55:33 main:562] : INFO : Starting Training [2022-02-10 16:59:08 main:574] : INFO : Epoch 1913 | loss: 0.0311636 | val_loss: 0.0312111 | Time: 215565 ms [2022-02-10 16:59:13 main:574] : INFO : Epoch 1914 | loss: 0.0310995 | val_loss: 0.0312007 | Time: 4622.72 ms [2022-02-10 16:59:17 main:574] : INFO : Epoch 1915 | loss: 0.0310925 | val_loss: 0.0311931 | Time: 4522.53 ms [2022-02-10 16:59:22 main:574] : INFO : Epoch 1916 | loss: 0.0310922 | val_loss: 0.03119 | Time: 4515.63 ms [2022-02-10 16:59:27 main:574] : INFO : Epoch 1917 | loss: 0.0310873 | val_loss: 0.0311935 | Time: 4727.29 ms [2022-02-10 16:59:31 main:574] : INFO : Epoch 1918 | loss: 0.0310908 | val_loss: 0.0311894 | Time: 4724.5 ms [2022-02-10 16:59:36 main:574] : INFO : Epoch 1919 | loss: 0.0310939 | val_loss: 0.0311947 | Time: 4681.41 ms [2022-02-10 16:59:41 main:574] : INFO : Epoch 1920 | loss: 0.0310943 | val_loss: 0.0311892 | Time: 4627.26 ms [2022-02-10 16:59:45 main:574] : INFO : Epoch 1921 | loss: 0.03109 | val_loss: 0.0311859 | Time: 4614.48 ms [2022-02-10 16:59:51 main:574] : INFO : Epoch 1922 | loss: 0.031089 | val_loss: 0.0311853 | Time: 4749.98 ms [2022-02-10 16:59:56 main:574] : INFO : Epoch 1923 | loss: 0.0310895 | val_loss: 0.031198 | Time: 4886.63 ms [2022-02-10 17:00:01 main:574] : INFO : Epoch 1924 | loss: 0.0310864 | val_loss: 0.0311974 | Time: 4959.31 ms [2022-02-10 17:00:06 main:574] : INFO : Epoch 1925 | loss: 0.0310858 | val_loss: 0.031192 | Time: 5101.92 ms [2022-02-10 17:00:11 main:574] : INFO : Epoch 1926 | loss: 0.0310863 | val_loss: 0.0311991 | Time: 5078.62 ms [2022-02-10 17:00:20 main:574] : INFO : Epoch 1927 | loss: 0.0310844 | val_loss: 0.0312007 | Time: 8501.71 ms [2022-02-10 17:00:28 main:574] : INFO : Epoch 1928 | loss: 0.0310858 | val_loss: 0.0311919 | Time: 8263.27 ms [2022-02-10 17:00:36 main:574] : INFO : Epoch 1929 | loss: 0.031086 | val_loss: 0.0311865 | Time: 8153.14 ms [2022-02-10 17:00:44 main:574] : INFO : Epoch 1930 | loss: 0.0310813 | val_loss: 0.0312065 | Time: 8032.35 ms [2022-02-10 17:00:52 main:574] : INFO : Epoch 1931 | loss: 0.0310848 | val_loss: 0.0311911 | Time: 8038.36 ms [2022-02-10 17:01:00 main:574] : INFO : Epoch 1932 | loss: 0.0310931 | val_loss: 0.0311936 | Time: 7916.64 ms [2022-02-10 17:01:08 main:574] : INFO : Epoch 1933 | loss: 0.0310983 | val_loss: 0.031189 | Time: 8065.02 ms [2022-02-10 17:01:16 main:574] : INFO : Epoch 1934 | loss: 0.0310951 | val_loss: 0.0311916 | Time: 7823.13 ms [2022-02-10 17:01:24 main:574] : INFO : Epoch 1935 | loss: 0.031092 | val_loss: 0.0312058 | Time: 8169.76 ms [2022-02-10 17:01:32 main:574] : INFO : Epoch 1936 | loss: 0.0310935 | val_loss: 0.0311844 | Time: 8358.11 ms [2022-02-10 17:01:41 main:574] : INFO : Epoch 1937 | loss: 0.0311027 | val_loss: 0.0311996 | Time: 8188.05 ms [2022-02-10 17:01:49 main:574] : INFO : Epoch 1938 | loss: 0.0311043 | val_loss: 0.0311849 | Time: 7946.74 ms [2022-02-10 17:01:57 main:574] : INFO : Epoch 1939 | loss: 0.0310984 | val_loss: 0.0311888 | Time: 8087.32 ms [2022-02-10 17:02:05 main:574] : INFO : Epoch 1940 | loss: 0.0310977 | val_loss: 0.0312014 | Time: 8138.17 ms [2022-02-10 17:02:13 main:574] : INFO : Epoch 1941 | loss: 0.0311006 | val_loss: 0.0311895 | Time: 8162.76 ms [2022-02-10 17:02:21 main:574] : INFO : Epoch 1942 | loss: 0.0311002 | val_loss: 0.0311865 | Time: 7842.71 ms [2022-02-10 17:02:29 main:574] : INFO : Epoch 1943 | loss: 0.031096 | val_loss: 0.0312 | Time: 8223.43 ms [2022-02-10 17:02:37 main:574] : INFO : Epoch 1944 | loss: 0.0310954 | val_loss: 0.0311973 | Time: 8093.42 ms [2022-02-10 17:02:45 main:574] : INFO : Epoch 1945 | loss: 0.0310963 | val_loss: 0.0311867 | Time: 8006.43 ms [2022-02-10 17:02:53 main:574] : INFO : Epoch 1946 | loss: 0.0310962 | val_loss: 0.0311882 | Time: 8010.18 ms [2022-02-10 17:03:01 main:574] : INFO : Epoch 1947 | loss: 0.031092 | val_loss: 0.0311866 | Time: 8108.93 ms [2022-02-10 17:03:10 main:574] : INFO : Epoch 1948 | loss: 0.0311078 | val_loss: 0.0311831 | Time: 8224.15 ms [2022-02-10 17:03:18 main:574] : INFO : Epoch 1949 | loss: 0.0311157 | val_loss: 0.0311908 | Time: 7875.73 ms [2022-02-10 17:03:26 main:574] : INFO : Epoch 1950 | loss: 0.0311121 | val_loss: 0.0311967 | Time: 8042.77 ms [2022-02-10 17:03:34 main:574] : INFO : Epoch 1951 | loss: 0.0311128 | val_loss: 0.0311789 | Time: 8020.01 ms [2022-02-10 17:03:42 main:574] : INFO : Epoch 1952 | loss: 0.0311091 | val_loss: 0.0311838 | Time: 8083.78 ms [2022-02-10 17:03:50 main:574] : INFO : Epoch 1953 | loss: 0.0311005 | val_loss: 0.0311843 | Time: 8188.43 ms [2022-02-10 17:03:58 main:574] : INFO : Epoch 1954 | loss: 0.0311004 | val_loss: 0.0311934 | Time: 8157.06 ms [2022-02-10 17:04:06 main:574] : INFO : Epoch 1955 | loss: 0.0310992 | val_loss: 0.031187 | Time: 8219.05 ms [2022-02-10 17:04:14 main:574] : INFO : Epoch 1956 | loss: 0.0311003 | val_loss: 0.031193 | Time: 8008.18 ms [2022-02-10 17:04:22 main:574] : INFO : Epoch 1957 | loss: 0.0310991 | val_loss: 0.0312022 | Time: 7571.46 ms [2022-02-10 17:04:30 main:574] : INFO : Epoch 1958 | loss: 0.0310956 | val_loss: 0.0311847 | Time: 7798.91 ms [2022-02-10 17:04:37 main:574] : INFO : Epoch 1959 | loss: 0.0310938 | val_loss: 0.0311933 | Time: 7584.32 ms [2022-02-10 17:04:45 main:574] : INFO : Epoch 1960 | loss: 0.0310939 | val_loss: 0.031192 | Time: 7861.64 ms [2022-02-10 17:04:53 main:574] : INFO : Epoch 1961 | loss: 0.0311031 | val_loss: 0.0311931 | Time: 7677.65 ms [2022-02-10 17:05:00 main:574] : INFO : Epoch 1962 | loss: 0.0311107 | val_loss: 0.0311913 | Time: 7702.11 ms [2022-02-10 17:05:08 main:574] : INFO : Epoch 1963 | loss: 0.0311139 | val_loss: 0.0311762 | Time: 7839.24 ms [2022-02-10 17:05:16 main:574] : INFO : Epoch 1964 | loss: 0.0311117 | val_loss: 0.0311833 | Time: 7582.58 ms [2022-02-10 17:05:24 main:574] : INFO : Epoch 1965 | loss: 0.0311081 | val_loss: 0.0311942 | Time: 7373.26 ms [2022-02-10 17:05:30 main:574] : INFO : Epoch 1966 | loss: 0.0311049 | val_loss: 0.0311812 | Time: 6044.86 ms [2022-02-10 17:05:36 main:574] : INFO : Epoch 1967 | loss: 0.0311045 | val_loss: 0.0311859 | Time: 5892.34 ms [2022-02-10 17:05:43 main:574] : INFO : Epoch 1968 | loss: 0.0311118 | val_loss: 0.031176 | Time: 7113.74 ms [2022-02-10 17:05:53 main:574] : INFO : Epoch 1969 | loss: 0.031109 | val_loss: 0.0311775 | Time: 9969.1 ms [2022-02-10 17:06:03 main:574] : INFO : Epoch 1970 | loss: 0.0311049 | val_loss: 0.0311827 | Time: 9929.65 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1650) [2022-02-11 14:12:35 main:435] : INFO : Set logging level to 1 [2022-02-11 14:12:35 main:441] : INFO : Running in BOINC Client mode [2022-02-11 14:12:35 main:444] : INFO : Resolving all filenames [2022-02-11 14:12:35 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-11 14:12:35 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-11 14:12:35 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-11 14:12:35 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-11 14:12:35 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-11 14:12:35 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-11 14:12:35 main:474] : INFO : Configuration: [2022-02-11 14:12:35 main:475] : INFO : Model type: GRU [2022-02-11 14:12:35 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-11 14:12:35 main:477] : INFO : Max Epochs: 2048 [2022-02-11 14:12:35 main:478] : INFO : Batch Size: 128 [2022-02-11 14:12:35 main:479] : INFO : Learning Rate: 0.01 [2022-02-11 14:12:35 main:480] : INFO : Patience: 10 [2022-02-11 14:12:35 main:481] : INFO : Hidden Width: 12 [2022-02-11 14:12:35 main:482] : INFO : # Recurrent Layers: 4 [2022-02-11 14:12:35 main:483] : INFO : # Backend Layers: 4 [2022-02-11 14:12:35 main:484] : INFO : # Threads: 1 [2022-02-11 14:12:35 main:486] : INFO : Preparing Dataset [2022-02-11 14:12:35 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-11 14:12:35 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-11 14:12:36 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-11 14:12:36 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-11 14:12:36 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-11 14:12:36 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-11 14:12:36 main:494] : INFO : Creating Model [2022-02-11 14:12:36 main:507] : INFO : Preparing config file [2022-02-11 14:12:36 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-11 14:12:36 main:512] : INFO : Loading config [2022-02-11 14:12:36 main:514] : INFO : Loading state [2022-02-11 14:12:37 main:559] : INFO : Loading DataLoader into Memory [2022-02-11 14:12:37 main:562] : INFO : Starting Training [2022-02-11 14:12:41 main:574] : INFO : Epoch 1968 | loss: 0.031152 | val_loss: 0.0311984 | Time: 3865.27 ms [2022-02-11 14:12:45 main:574] : INFO : Epoch 1969 | loss: 0.0311069 | val_loss: 0.0311816 | Time: 3677.8 ms [2022-02-11 14:12:48 main:574] : INFO : Epoch 1970 | loss: 0.0310985 | val_loss: 0.031188 | Time: 3786.9 ms [2022-02-11 14:12:52 main:574] : INFO : Epoch 1971 | loss: 0.0310977 | val_loss: 0.0311916 | Time: 3725.99 ms [2022-02-11 14:12:56 main:574] : INFO : Epoch 1972 | loss: 0.0310993 | val_loss: 0.0311954 | Time: 3904.75 ms [2022-02-11 14:13:00 main:574] : INFO : Epoch 1973 | loss: 0.0311 | val_loss: 0.0311902 | Time: 4184.93 ms [2022-02-11 14:13:05 main:574] : INFO : Epoch 1974 | loss: 0.0310993 | val_loss: 0.0311938 | Time: 4326 ms [2022-02-11 14:13:09 main:574] : INFO : Epoch 1975 | loss: 0.0310992 | val_loss: 0.0311933 | Time: 4510.67 ms [2022-02-11 14:13:14 main:574] : INFO : Epoch 1976 | loss: 0.0310973 | val_loss: 0.0311865 | Time: 4692.48 ms [2022-02-11 14:13:19 main:574] : INFO : Epoch 1977 | loss: 0.0310989 | val_loss: 0.0311858 | Time: 4445.93 ms [2022-02-11 14:13:23 main:574] : INFO : Epoch 1978 | loss: 0.0311049 | val_loss: 0.031192 | Time: 4564.76 ms [2022-02-11 14:13:28 main:574] : INFO : Epoch 1979 | loss: 0.0311106 | val_loss: 0.0311826 | Time: 4767.6 ms [2022-02-11 14:13:33 main:574] : INFO : Epoch 1980 | loss: 0.0311065 | val_loss: 0.0311888 | Time: 4499.89 ms [2022-02-11 14:13:39 main:574] : INFO : Epoch 1981 | loss: 0.0311009 | val_loss: 0.0311843 | Time: 6700.02 ms [2022-02-11 14:13:56 main:574] : INFO : Epoch 1982 | loss: 0.0310995 | val_loss: 0.0311915 | Time: 16305.4 ms [2022-02-11 14:14:02 main:574] : INFO : Epoch 1983 | loss: 0.0310941 | val_loss: 0.0311889 | Time: 5878.01 ms [2022-02-11 14:14:08 main:574] : INFO : Epoch 1984 | loss: 0.031092 | val_loss: 0.0311902 | Time: 6654.87 ms [2022-02-11 14:14:15 main:574] : INFO : Epoch 1985 | loss: 0.0310897 | val_loss: 0.03119 | Time: 6763.43 ms [2022-02-11 14:14:22 main:574] : INFO : Epoch 1986 | loss: 0.031091 | val_loss: 0.031194 | Time: 6651.76 ms [2022-02-11 14:14:28 main:574] : INFO : Epoch 1987 | loss: 0.0310948 | val_loss: 0.0311801 | Time: 6640.11 ms [2022-02-11 14:14:35 main:574] : INFO : Epoch 1988 | loss: 0.0310896 | val_loss: 0.0311998 | Time: 6742.76 ms [2022-02-11 14:14:42 main:574] : INFO : Epoch 1989 | loss: 0.0310909 | val_loss: 0.031193 | Time: 6709.72 ms [2022-02-11 14:14:49 main:574] : INFO : Epoch 1990 | loss: 0.031091 | val_loss: 0.0311954 | Time: 6661.46 ms [2022-02-11 14:14:55 main:574] : INFO : Epoch 1991 | loss: 0.0310909 | val_loss: 0.0311814 | Time: 6640.88 ms [2022-02-11 14:15:02 main:574] : INFO : Epoch 1992 | loss: 0.0310909 | val_loss: 0.031201 | Time: 6577.17 ms [2022-02-11 14:15:08 main:574] : INFO : Epoch 1993 | loss: 0.0310919 | val_loss: 0.0312012 | Time: 6657.94 ms [2022-02-11 14:15:15 main:574] : INFO : Epoch 1994 | loss: 0.0310874 | val_loss: 0.031191 | Time: 6723.94 ms [2022-02-11 14:15:22 main:574] : INFO : Epoch 1995 | loss: 0.031089 | val_loss: 0.0311863 | Time: 6804.09 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1650) [2022-02-11 15:19:02 main:435] : INFO : Set logging level to 1 [2022-02-11 15:19:02 main:441] : INFO : Running in BOINC Client mode [2022-02-11 15:19:02 main:444] : INFO : Resolving all filenames [2022-02-11 15:19:02 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-11 15:19:02 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-11 15:19:02 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-11 15:19:02 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-11 15:19:02 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-11 15:19:02 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-11 15:19:02 main:474] : INFO : Configuration: [2022-02-11 15:19:02 main:475] : INFO : Model type: GRU [2022-02-11 15:19:02 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-11 15:19:02 main:477] : INFO : Max Epochs: 2048 [2022-02-11 15:19:02 main:478] : INFO : Batch Size: 128 [2022-02-11 15:19:02 main:479] : INFO : Learning Rate: 0.01 [2022-02-11 15:19:02 main:480] : INFO : Patience: 10 [2022-02-11 15:19:02 main:481] : INFO : Hidden Width: 12 [2022-02-11 15:19:02 main:482] : INFO : # Recurrent Layers: 4 [2022-02-11 15:19:02 main:483] : INFO : # Backend Layers: 4 [2022-02-11 15:19:02 main:484] : INFO : # Threads: 1 [2022-02-11 15:19:02 main:486] : INFO : Preparing Dataset [2022-02-11 15:19:02 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-11 15:19:02 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-11 15:19:03 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-11 15:19:03 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-11 15:19:03 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-11 15:19:03 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-11 15:19:03 main:494] : INFO : Creating Model [2022-02-11 15:19:03 main:507] : INFO : Preparing config file [2022-02-11 15:19:03 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-11 15:19:03 main:512] : INFO : Loading config [2022-02-11 15:19:04 main:514] : INFO : Loading state [2022-02-11 15:19:04 main:559] : INFO : Loading DataLoader into Memory [2022-02-11 15:19:05 main:562] : INFO : Starting Training [2022-02-11 15:19:09 main:574] : INFO : Epoch 1968 | loss: 0.0311522 | val_loss: 0.0311935 | Time: 4165.3 ms [2022-02-11 15:19:13 main:574] : INFO : Epoch 1969 | loss: 0.0311051 | val_loss: 0.0311961 | Time: 3943.62 ms [2022-02-11 15:19:17 main:574] : INFO : Epoch 1970 | loss: 0.0311043 | val_loss: 0.0311902 | Time: 4084.4 ms [2022-02-11 15:19:21 main:574] : INFO : Epoch 1971 | loss: 0.0311001 | val_loss: 0.0311829 | Time: 4270.7 ms [2022-02-11 15:19:26 main:574] : INFO : Epoch 1972 | loss: 0.031095 | val_loss: 0.0311922 | Time: 4416.23 ms [2022-02-11 15:19:30 main:574] : INFO : Epoch 1973 | loss: 0.0310996 | val_loss: 0.0311856 | Time: 4550.53 ms [2022-02-11 15:19:35 main:574] : INFO : Epoch 1974 | loss: 0.031098 | val_loss: 0.0311832 | Time: 4407.98 ms [2022-02-11 15:19:39 main:574] : INFO : Epoch 1975 | loss: 0.0310923 | val_loss: 0.0311866 | Time: 4570.58 ms [2022-02-11 15:19:44 main:574] : INFO : Epoch 1976 | loss: 0.0310933 | val_loss: 0.0311866 | Time: 4662.92 ms [2022-02-11 15:19:48 main:574] : INFO : Epoch 1977 | loss: 0.0311014 | val_loss: 0.0311883 | Time: 4503.12 ms [2022-02-11 15:19:53 main:574] : INFO : Epoch 1978 | loss: 0.0310962 | val_loss: 0.0311874 | Time: 4865.69 ms [2022-02-11 15:19:58 main:574] : INFO : Epoch 1979 | loss: 0.0310934 | val_loss: 0.0311907 | Time: 4618.86 ms [2022-02-11 15:20:03 main:574] : INFO : Epoch 1980 | loss: 0.0310918 | val_loss: 0.0311927 | Time: 5118.1 ms [2022-02-11 15:20:08 main:574] : INFO : Epoch 1981 | loss: 0.0310893 | val_loss: 0.0312035 | Time: 5263.2 ms [2022-02-11 15:20:14 main:574] : INFO : Epoch 1982 | loss: 0.0310918 | val_loss: 0.0311924 | Time: 5507.15 ms [2022-02-11 15:20:19 main:574] : INFO : Epoch 1983 | loss: 0.0310959 | val_loss: 0.0311855 | Time: 5298.66 ms [2022-02-11 15:20:24 main:574] : INFO : Epoch 1984 | loss: 0.0311013 | val_loss: 0.0311908 | Time: 5303.8 ms [2022-02-11 15:20:30 main:574] : INFO : Epoch 1985 | loss: 0.0311011 | val_loss: 0.0311825 | Time: 5245.56 ms [2022-02-11 15:20:36 main:574] : INFO : Epoch 1986 | loss: 0.0310996 | val_loss: 0.031185 | Time: 6603.52 ms [2022-02-11 15:20:43 main:574] : INFO : Epoch 1987 | loss: 0.0311155 | val_loss: 0.0311792 | Time: 6391.72 ms [2022-02-11 15:20:50 main:574] : INFO : Epoch 1988 | loss: 0.0311125 | val_loss: 0.0311801 | Time: 7399.49 ms [2022-02-11 15:20:57 main:574] : INFO : Epoch 1989 | loss: 0.0311156 | val_loss: 0.0311822 | Time: 7318.57 ms [2022-02-11 15:21:05 main:574] : INFO : Epoch 1990 | loss: 0.0311136 | val_loss: 0.0311838 | Time: 7247.74 ms [2022-02-11 15:21:11 main:574] : INFO : Epoch 1991 | loss: 0.0311079 | val_loss: 0.0311831 | Time: 6631.16 ms [2022-02-11 15:21:17 main:574] : INFO : Epoch 1992 | loss: 0.0311029 | val_loss: 0.0311811 | Time: 6266.57 ms [2022-02-11 15:21:24 main:574] : INFO : Epoch 1993 | loss: 0.0311015 | val_loss: 0.0311826 | Time: 6472.65 ms [2022-02-11 15:21:30 main:574] : INFO : Epoch 1994 | loss: 0.0310972 | val_loss: 0.0311875 | Time: 6421.92 ms [2022-02-11 15:21:37 main:574] : INFO : Epoch 1995 | loss: 0.0311139 | val_loss: 0.0311781 | Time: 6456.19 ms [2022-02-11 15:21:43 main:574] : INFO : Epoch 1996 | loss: 0.0311306 | val_loss: 0.0311746 | Time: 6531.12 ms [2022-02-11 15:21:50 main:574] : INFO : Epoch 1997 | loss: 0.0311267 | val_loss: 0.0311737 | Time: 6221.36 ms [2022-02-11 15:21:56 main:574] : INFO : Epoch 1998 | loss: 0.0311215 | val_loss: 0.0311769 | Time: 6351.63 ms [2022-02-11 15:22:02 main:574] : INFO : Epoch 1999 | loss: 0.0311179 | val_loss: 0.0311776 | Time: 6451.36 ms [2022-02-11 15:22:09 main:574] : INFO : Epoch 2000 | loss: 0.0311124 | val_loss: 0.0311772 | Time: 6522.18 ms [2022-02-11 15:22:15 main:574] : INFO : Epoch 2001 | loss: 0.0311149 | val_loss: 0.0311865 | Time: 6269.36 ms [2022-02-11 15:22:22 main:574] : INFO : Epoch 2002 | loss: 0.0311187 | val_loss: 0.0311788 | Time: 6505.38 ms [2022-02-11 15:22:28 main:574] : INFO : Epoch 2003 | loss: 0.0311212 | val_loss: 0.0311819 | Time: 6533.2 ms [2022-02-11 15:22:35 main:574] : INFO : Epoch 2004 | loss: 0.0311157 | val_loss: 0.0311889 | Time: 6399.53 ms [2022-02-11 15:22:41 main:574] : INFO : Epoch 2005 | loss: 0.0311105 | val_loss: 0.0311834 | Time: 6457.49 ms [2022-02-11 15:22:48 main:574] : INFO : Epoch 2006 | loss: 0.0311055 | val_loss: 0.0311905 | Time: 6353.77 ms [2022-02-11 15:22:54 main:574] : INFO : Epoch 2007 | loss: 0.031106 | val_loss: 0.0311861 | Time: 6354.41 ms [2022-02-11 15:23:00 main:574] : INFO : Epoch 2008 | loss: 0.0311052 | val_loss: 0.0311876 | Time: 6401.57 ms [2022-02-11 15:23:06 main:574] : INFO : Epoch 2009 | loss: 0.0311063 | val_loss: 0.0311897 | Time: 6188.42 ms [2022-02-11 15:23:13 main:574] : INFO : Epoch 2010 | loss: 0.0311017 | val_loss: 0.0311859 | Time: 6392.17 ms [2022-02-11 15:23:20 main:574] : INFO : Epoch 2011 | loss: 0.0311041 | val_loss: 0.0311824 | Time: 6641.31 ms [2022-02-11 15:23:26 main:574] : INFO : Epoch 2012 | loss: 0.0311003 | val_loss: 0.031188 | Time: 6344.93 ms [2022-02-11 15:23:32 main:574] : INFO : Epoch 2013 | loss: 0.0311105 | val_loss: 0.0311843 | Time: 6413.71 ms [2022-02-11 15:23:39 main:574] : INFO : Epoch 2014 | loss: 0.0311113 | val_loss: 0.03119 | Time: 6247.57 ms [2022-02-11 15:23:45 main:574] : INFO : Epoch 2015 | loss: 0.0311033 | val_loss: 0.0311908 | Time: 6261.09 ms [2022-02-11 15:23:51 main:574] : INFO : Epoch 2016 | loss: 0.0311069 | val_loss: 0.0311819 | Time: 6457.65 ms [2022-02-11 15:23:58 main:574] : INFO : Epoch 2017 | loss: 0.0311021 | val_loss: 0.0311921 | Time: 6462.41 ms [2022-02-11 15:24:04 main:574] : INFO : Epoch 2018 | loss: 0.0310984 | val_loss: 0.0312004 | Time: 6448.79 ms [2022-02-11 15:24:11 main:574] : INFO : Epoch 2019 | loss: 0.031097 | val_loss: 0.0311844 | Time: 6568.32 ms [2022-02-11 15:24:17 main:574] : INFO : Epoch 2020 | loss: 0.0310936 | val_loss: 0.0311809 | Time: 6337.24 ms [2022-02-11 15:24:24 main:574] : INFO : Epoch 2021 | loss: 0.0310933 | val_loss: 0.0311895 | Time: 6280.18 ms [2022-02-11 15:24:30 main:574] : INFO : Epoch 2022 | loss: 0.0310933 | val_loss: 0.0311867 | Time: 6384.96 ms [2022-02-11 15:24:36 main:574] : INFO : Epoch 2023 | loss: 0.0310935 | val_loss: 0.0311875 | Time: 6464.98 ms [2022-02-11 15:24:43 main:574] : INFO : Epoch 2024 | loss: 0.0310934 | val_loss: 0.0311993 | Time: 6222.34 ms [2022-02-11 15:24:49 main:574] : INFO : Epoch 2025 | loss: 0.0310949 | val_loss: 0.0311889 | Time: 6486.31 ms [2022-02-11 15:24:55 main:574] : INFO : Epoch 2026 | loss: 0.0310916 | val_loss: 0.031187 | Time: 6201.7 ms [2022-02-11 15:25:02 main:574] : INFO : Epoch 2027 | loss: 0.0310903 | val_loss: 0.0311881 | Time: 6439.51 ms [2022-02-11 15:25:08 main:574] : INFO : Epoch 2028 | loss: 0.0310949 | val_loss: 0.0312033 | Time: 6220.12 ms [2022-02-11 15:25:15 main:574] : INFO : Epoch 2029 | loss: 0.0310905 | val_loss: 0.0312051 | Time: 6433.53 ms [2022-02-11 15:25:21 main:574] : INFO : Epoch 2030 | loss: 0.0310902 | val_loss: 0.0311838 | Time: 6650.31 ms [2022-02-11 15:25:28 main:574] : INFO : Epoch 2031 | loss: 0.0310891 | val_loss: 0.0311942 | Time: 6337.72 ms [2022-02-11 15:25:34 main:574] : INFO : Epoch 2032 | loss: 0.0310878 | val_loss: 0.0311909 | Time: 6200.02 ms [2022-02-11 15:25:41 main:574] : INFO : Epoch 2033 | loss: 0.0310901 | val_loss: 0.0311945 | Time: 6448.55 ms [2022-02-11 15:25:47 main:574] : INFO : Epoch 2034 | loss: 0.0310896 | val_loss: 0.0311881 | Time: 6255.51 ms [2022-02-11 15:25:54 main:574] : INFO : Epoch 2035 | loss: 0.0310896 | val_loss: 0.031199 | Time: 6393.82 ms [2022-02-11 15:26:00 main:574] : INFO : Epoch 2036 | loss: 0.0310898 | val_loss: 0.0312027 | Time: 6640.64 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1650) [2022-02-11 15:54:30 main:435] : INFO : Set logging level to 1 [2022-02-11 15:54:30 main:441] : INFO : Running in BOINC Client mode [2022-02-11 15:54:30 main:444] : INFO : Resolving all filenames [2022-02-11 15:54:30 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-11 15:54:30 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-11 15:54:30 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-11 15:54:30 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-11 15:54:30 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-11 15:54:30 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-11 15:54:30 main:474] : INFO : Configuration: [2022-02-11 15:54:30 main:475] : INFO : Model type: GRU [2022-02-11 15:54:30 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-11 15:54:30 main:477] : INFO : Max Epochs: 2048 [2022-02-11 15:54:30 main:478] : INFO : Batch Size: 128 [2022-02-11 15:54:30 main:479] : INFO : Learning Rate: 0.01 [2022-02-11 15:54:30 main:480] : INFO : Patience: 10 [2022-02-11 15:54:30 main:481] : INFO : Hidden Width: 12 [2022-02-11 15:54:30 main:482] : INFO : # Recurrent Layers: 4 [2022-02-11 15:54:30 main:483] : INFO : # Backend Layers: 4 [2022-02-11 15:54:30 main:484] : INFO : # Threads: 1 [2022-02-11 15:54:30 main:486] : INFO : Preparing Dataset [2022-02-11 15:54:30 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-11 15:54:30 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-11 15:54:31 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-11 15:54:31 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-11 15:54:31 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-11 15:54:31 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-11 15:54:31 main:494] : INFO : Creating Model [2022-02-11 15:54:31 main:507] : INFO : Preparing config file [2022-02-11 15:54:31 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-11 15:54:31 main:512] : INFO : Loading config [2022-02-11 15:54:31 main:514] : INFO : Loading state [2022-02-11 15:54:32 main:559] : INFO : Loading DataLoader into Memory [2022-02-11 15:54:32 main:562] : INFO : Starting Training [2022-02-11 15:54:36 main:574] : INFO : Epoch 2034 | loss: 0.0311462 | val_loss: 0.0311882 | Time: 4227.02 ms [2022-02-11 15:54:41 main:574] : INFO : Epoch 2035 | loss: 0.0311074 | val_loss: 0.0311871 | Time: 4109.54 ms [2022-02-11 15:54:45 main:574] : INFO : Epoch 2036 | loss: 0.0310979 | val_loss: 0.0311911 | Time: 4151.19 ms [2022-02-11 15:54:49 main:574] : INFO : Epoch 2037 | loss: 0.0310936 | val_loss: 0.0311835 | Time: 4250.1 ms [2022-02-11 15:54:53 main:574] : INFO : Epoch 2038 | loss: 0.0310952 | val_loss: 0.0311802 | Time: 4231.85 ms [2022-02-11 15:54:58 main:574] : INFO : Epoch 2039 | loss: 0.0310925 | val_loss: 0.0311826 | Time: 4426.74 ms [2022-02-11 15:55:02 main:574] : INFO : Epoch 2040 | loss: 0.0310928 | val_loss: 0.0311854 | Time: 4404.07 ms [2022-02-11 15:55:07 main:574] : INFO : Epoch 2041 | loss: 0.0310952 | val_loss: 0.0311957 | Time: 4504.49 ms [2022-02-11 15:55:11 main:574] : INFO : Epoch 2042 | loss: 0.0310939 | val_loss: 0.0311942 | Time: 4579.32 ms [2022-02-11 15:55:16 main:574] : INFO : Epoch 2043 | loss: 0.031093 | val_loss: 0.0311967 | Time: 4727.81 ms [2022-02-11 15:55:21 main:574] : INFO : Epoch 2044 | loss: 0.031092 | val_loss: 0.0311917 | Time: 4714.53 ms [2022-02-11 15:55:25 main:574] : INFO : Epoch 2045 | loss: 0.0310944 | val_loss: 0.0311931 | Time: 4588.73 ms [2022-02-11 15:55:30 main:574] : INFO : Epoch 2046 | loss: 0.0310916 | val_loss: 0.0311908 | Time: 5166.65 ms [2022-02-11 15:55:36 main:574] : INFO : Epoch 2047 | loss: 0.0310896 | val_loss: 0.0311937 | Time: 5305.6 ms [2022-02-11 15:55:41 main:574] : INFO : Epoch 2048 | loss: 0.0310915 | val_loss: 0.0311912 | Time: 4965.02 ms [2022-02-11 15:55:41 main:597] : INFO : Saving trained model to model-final.pt, val_loss 0.0311912 [2022-02-11 15:55:41 main:603] : INFO : Saving end state to config to file [2022-02-11 15:55:41 main:608] : INFO : Success, exiting.. 15:55:41 (30848): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)