Task 14627353
| Name | ParityModified-1647048244-698-3-0_0 |
| Workunit | 11639859 |
| Created | 21 Apr 2022, 13:13:45 UTC |
| Sent | 21 Apr 2022, 13:14:47 UTC |
| Report deadline | 29 Apr 2022, 13:14:47 UTC |
| Received | 2 May 2022, 2:17:05 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 11391 |
| Run time | 2 days 20 hours 49 min 48 sec |
| CPU time | 13 hours 1 min 45 sec |
| Validate state | Task was reported too late to validate |
| Credit | 0.00 |
| Device peak FLOPS | 1,442.10 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.54 GB |
| Peak swap size | 3.44 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version> <![CDATA[ <stderr_txt> 2022-05-01 12:25:32 main:574] : INFO : Epoch 1808 | loss: 0.0311312 | val_loss: 0.0311738 | Time: 200743 ms [2022-05-01 12:28:09 main:574] : INFO : Epoch 1809 | loss: 0.0311367 | val_loss: 0.0311709 | Time: 153617 ms [2022-05-01 12:31:50 main:574] : INFO : Epoch 1810 | loss: 0.0311439 | val_loss: 0.0311713 | Time: 219583 ms [2022-05-01 12:34:31 main:574] : INFO : Epoch 1811 | loss: 0.0311386 | val_loss: 0.0311725 | Time: 156885 ms [2022-05-01 12:37:57 main:574] : INFO : Epoch 1812 | loss: 0.0311379 | val_loss: 0.0311715 | Time: 205964 ms [2022-05-01 12:40:43 main:574] : INFO : Epoch 1813 | loss: 0.0311354 | val_loss: 0.0311726 | Time: 165338 ms [2022-05-01 12:43:46 main:574] : INFO : Epoch 1814 | loss: 0.0311338 | val_loss: 0.0311732 | Time: 182477 ms [2022-05-01 12:47:16 main:574] : INFO : Epoch 1815 | loss: 0.0311384 | val_loss: 0.0311698 | Time: 203326 ms [2022-05-01 12:50:51 main:574] : INFO : Epoch 1816 | loss: 0.031139 | val_loss: 0.0311675 | Time: 210149 ms [2022-05-01 12:52:51 main:574] : INFO : Epoch 1817 | loss: 0.0311387 | val_loss: 0.0311684 | Time: 114633 ms [2022-05-01 12:55:53 main:574] : INFO : Epoch 1818 | loss: 0.0311366 | val_loss: 0.0311701 | Time: 181776 ms [2022-05-01 12:59:30 main:574] : INFO : Epoch 1819 | loss: 0.0311348 | val_loss: 0.0311671 | Time: 207671 ms [2022-05-01 13:02:02 main:574] : INFO : Epoch 1820 | loss: 0.0311378 | val_loss: 0.0311668 | Time: 150129 ms [2022-05-01 13:04:38 main:574] : INFO : Epoch 1821 | loss: 0.0311387 | val_loss: 0.0311693 | Time: 154692 ms [2022-05-01 13:08:10 main:574] : INFO : Epoch 1822 | loss: 0.0311361 | val_loss: 0.0311715 | Time: 209601 ms [2022-05-01 13:11:22 main:574] : INFO : Epoch 1823 | loss: 0.0311344 | val_loss: 0.031167 | Time: 188681 ms [2022-05-01 13:14:31 main:574] : INFO : Epoch 1824 | loss: 0.0311325 | val_loss: 0.0311718 | Time: 182138 ms [2022-05-01 13:17:22 main:574] : INFO : Epoch 1825 | loss: 0.0311336 | val_loss: 0.0311702 | Time: 170849 ms [2022-05-01 13:19:34 main:574] : INFO : Epoch 1826 | loss: 0.0311353 | val_loss: 0.0311705 | Time: 128086 ms [2022-05-01 13:22:12 main:574] : INFO : Epoch 1827 | loss: 0.031132 | val_loss: 0.0311737 | Time: 157935 ms [2022-05-01 13:25:51 main:574] : INFO : Epoch 1828 | loss: 0.0311337 | val_loss: 0.0311672 | Time: 211341 ms [2022-05-01 13:28:07 main:574] : INFO : Epoch 1829 | loss: 0.0311318 | val_loss: 0.0311728 | Time: 131157 ms [2022-05-01 13:31:24 main:574] : INFO : Epoch 1830 | loss: 0.0311328 | val_loss: 0.0311718 | Time: 196373 ms [2022-05-01 13:35:22 main:574] : INFO : Epoch 1831 | loss: 0.0311326 | val_loss: 0.0311703 | Time: 225867 ms [2022-05-01 13:38:32 main:574] : INFO : Epoch 1832 | loss: 0.031132 | val_loss: 0.0311722 | Time: 185182 ms [2022-05-01 13:41:46 main:574] : INFO : Epoch 1833 | loss: 0.0311292 | val_loss: 0.0311689 | Time: 185608 ms [2022-05-01 13:45:12 main:574] : INFO : Epoch 1834 | loss: 0.0311296 | val_loss: 0.0311723 | Time: 201050 ms [2022-05-01 13:48:29 main:574] : INFO : Epoch 1835 | loss: 0.03113 | val_loss: 0.0311724 | Time: 193298 ms [2022-05-01 13:51:18 main:574] : INFO : Epoch 1836 | loss: 0.0311298 | val_loss: 0.0311719 | Time: 163542 ms [2022-05-01 13:54:52 main:574] : INFO : Epoch 1837 | loss: 0.0311301 | val_loss: 0.0311718 | Time: 212797 ms [2022-05-01 13:59:19 main:574] : INFO : Epoch 1838 | loss: 0.0311312 | val_loss: 0.0311713 | Time: 261171 ms [2022-05-01 14:01:55 main:574] : INFO : Epoch 1839 | loss: 0.0311304 | val_loss: 0.0311701 | Time: 151600 ms [2022-05-01 14:04:29 main:574] : INFO : Epoch 1840 | loss: 0.0311329 | val_loss: 0.0311717 | Time: 153305 ms [2022-05-01 14:07:17 main:574] : INFO : Epoch 1841 | loss: 0.031151 | val_loss: 0.0311779 | Time: 167009 ms [2022-05-01 14:10:20 main:574] : INFO : Epoch 1842 | loss: 0.0311506 | val_loss: 0.031171 | Time: 182811 ms [2022-05-01 14:12:55 main:574] : INFO : Epoch 1843 | loss: 0.0311376 | val_loss: 0.0311687 | Time: 152556 ms [2022-05-01 14:16:08 main:574] : INFO : Epoch 1844 | loss: 0.0311357 | val_loss: 0.0311653 | Time: 188371 ms [2022-05-01 14:19:13 main:574] : INFO : Epoch 1845 | loss: 0.0311355 | val_loss: 0.0311689 | Time: 181576 ms [2022-05-01 14:22:20 main:574] : INFO : Epoch 1846 | loss: 0.031135 | val_loss: 0.0311717 | Time: 187407 ms [2022-05-01 14:25:13 main:574] : INFO : Epoch 1847 | loss: 0.0311398 | val_loss: 0.0311699 | Time: 165251 ms [2022-05-01 14:28:25 main:574] : INFO : Epoch 1848 | loss: 0.0311442 | val_loss: 0.0311775 | Time: 190519 ms [2022-05-01 14:31:45 main:574] : INFO : Epoch 1849 | loss: 0.0311458 | val_loss: 0.03117 | Time: 197296 ms [2022-05-01 14:34:36 main:574] : INFO : Epoch 1850 | loss: 0.0311864 | val_loss: 0.0312338 | Time: 170465 ms [2022-05-01 14:38:04 main:574] : INFO : Epoch 1851 | loss: 0.032756 | val_loss: 0.0316343 | Time: 207694 ms [2022-05-01 14:40:53 main:574] : INFO : Epoch 1852 | loss: 0.0326579 | val_loss: 0.0314759 | Time: 160114 ms [2022-05-01 14:43:39 main:574] : INFO : Epoch 1853 | loss: 0.0313647 | val_loss: 0.0312659 | Time: 165057 ms [2022-05-01 14:46:42 main:574] : INFO : Epoch 1854 | loss: 0.0312282 | val_loss: 0.0312098 | Time: 176463 ms [2022-05-01 14:49:08 main:574] : INFO : Epoch 1855 | loss: 0.0311924 | val_loss: 0.0311839 | Time: 145185 ms [2022-05-01 14:50:51 main:574] : INFO : Epoch 1856 | loss: 0.0311836 | val_loss: 0.0311789 | Time: 100681 ms [2022-05-01 14:54:00 main:574] : INFO : Epoch 1857 | loss: 0.0311781 | val_loss: 0.0311767 | Time: 189434 ms [2022-05-01 14:57:09 main:574] : INFO : Epoch 1858 | loss: 0.031175 | val_loss: 0.0311723 | Time: 182653 ms [2022-05-01 14:59:56 main:574] : INFO : Epoch 1859 | loss: 0.0311709 | val_loss: 0.0311721 | Time: 162372 ms [2022-05-01 15:02:33 main:574] : INFO : Epoch 1860 | loss: 0.0311661 | val_loss: 0.031168 | Time: 156562 ms [2022-05-01 15:04:47 main:574] : INFO : Epoch 1861 | loss: 0.0311626 | val_loss: 0.0311651 | Time: 131687 ms [2022-05-01 15:08:00 main:574] : INFO : Epoch 1862 | loss: 0.0311598 | val_loss: 0.0311643 | Time: 192295 ms [2022-05-01 15:10:42 main:574] : INFO : Epoch 1863 | loss: 0.0311595 | val_loss: 0.0311633 | Time: 157731 ms [2022-05-01 15:14:11 main:574] : INFO : Epoch 1864 | loss: 0.0311565 | val_loss: 0.0311637 | Time: 208822 ms [2022-05-01 15:17:26 main:574] : INFO : Epoch 1865 | loss: 0.0311553 | val_loss: 0.0311647 | Time: 187850 ms [2022-05-01 15:20:00 main:574] : INFO : Epoch 1866 | loss: 0.0311554 | val_loss: 0.0311639 | Time: 123276 ms [2022-05-01 15:21:52 main:574] : INFO : Epoch 1867 | loss: 0.0311542 | val_loss: 0.0311631 | Time: 112204 ms [2022-05-01 15:24:07 main:574] : INFO : Epoch 1868 | loss: 0.0311542 | val_loss: 0.0311638 | Time: 133750 ms [2022-05-01 15:26:27 main:574] : INFO : Epoch 1869 | loss: 0.0311537 | val_loss: 0.0311618 | Time: 138342 ms [2022-05-01 15:29:14 main:574] : INFO : Epoch 1870 | loss: 0.0311529 | val_loss: 0.0311651 | Time: 159193 ms [2022-05-01 15:31:09 main:574] : INFO : Epoch 1871 | loss: 0.0311497 | val_loss: 0.0311621 | Time: 114923 ms [2022-05-01 15:34:31 main:574] : INFO : Epoch 1872 | loss: 0.0311488 | val_loss: 0.0311639 | Time: 201594 ms [2022-05-01 15:37:47 main:574] : INFO : Epoch 1873 | loss: 0.0311507 | val_loss: 0.0311609 | Time: 194618 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 950M) [2022-05-01 17:00:23 main:435] : INFO : Set logging level to 1 [2022-05-01 17:00:23 main:441] : INFO : Running in BOINC Client mode [2022-05-01 17:00:24 main:444] : INFO : Resolving all filenames [2022-05-01 17:00:24 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-05-01 17:00:25 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-05-01 17:00:25 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-05-01 17:00:28 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-05-01 17:00:28 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-05-01 17:00:28 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-05-01 17:00:28 main:474] : INFO : Configuration: [2022-05-01 17:00:28 main:475] : INFO : Model type: GRU [2022-05-01 17:00:28 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-05-01 17:00:28 main:477] : INFO : Max Epochs: 2048 [2022-05-01 17:00:28 main:478] : INFO : Batch Size: 128 [2022-05-01 17:00:28 main:479] : INFO : Learning Rate: 0.01 [2022-05-01 17:00:28 main:480] : INFO : Patience: 10 [2022-05-01 17:00:28 main:481] : INFO : Hidden Width: 12 [2022-05-01 17:00:28 main:482] : INFO : # Recurrent Layers: 4 [2022-05-01 17:00:28 main:483] : INFO : # Backend Layers: 4 [2022-05-01 17:00:28 main:484] : INFO : # Threads: 1 [2022-05-01 17:00:29 main:486] : INFO : Preparing Dataset [2022-05-01 17:00:30 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-05-01 17:00:56 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 950M) [2022-05-01 17:12:46 main:435] : INFO : Set logging level to 1 [2022-05-01 17:12:47 main:441] : INFO : Running in BOINC Client mode [2022-05-01 17:12:47 main:444] : INFO : Resolving all filenames [2022-05-01 17:12:47 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-05-01 17:12:47 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-05-01 17:12:48 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-05-01 17:12:48 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-05-01 17:12:49 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-05-01 17:12:49 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-05-01 17:12:49 main:474] : INFO : Configuration: [2022-05-01 17:12:50 main:475] : INFO : Model type: GRU [2022-05-01 17:12:50 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-05-01 17:12:51 main:477] : INFO : Max Epochs: 2048 [2022-05-01 17:12:52 main:478] : INFO : Batch Size: 128 [2022-05-01 17:12:52 main:479] : INFO : Learning Rate: 0.01 [2022-05-01 17:12:53 main:480] : INFO : Patience: 10 [2022-05-01 17:12:53 main:481] : INFO : Hidden Width: 12 [2022-05-01 17:12:53 main:482] : INFO : # Recurrent Layers: 4 [2022-05-01 17:12:53 main:483] : INFO : # Backend Layers: 4 [2022-05-01 17:12:53 main:484] : INFO : # Threads: 1 [2022-05-01 17:12:53 main:486] : INFO : Preparing Dataset [2022-05-01 17:12:54 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-05-01 17:13:02 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 950M) [2022-05-01 17:20:49 main:435] : INFO : Set logging level to 1 [2022-05-01 17:20:49 main:441] : INFO : Running in BOINC Client mode [2022-05-01 17:20:49 main:444] : INFO : Resolving all filenames [2022-05-01 17:20:49 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-05-01 17:20:49 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-05-01 17:20:50 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-05-01 17:20:50 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-05-01 17:20:50 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-05-01 17:20:50 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-05-01 17:20:50 main:474] : INFO : Configuration: [2022-05-01 17:20:50 main:475] : INFO : Model type: GRU [2022-05-01 17:20:51 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-05-01 17:20:51 main:477] : INFO : Max Epochs: 2048 [2022-05-01 17:20:53 main:478] : INFO : Batch Size: 128 [2022-05-01 17:20:53 main:479] : INFO : Learning Rate: 0.01 [2022-05-01 17:20:54 main:480] : INFO : Patience: 10 [2022-05-01 17:20:55 main:481] : INFO : Hidden Width: 12 [2022-05-01 17:20:55 main:482] : INFO : # Recurrent Layers: 4 [2022-05-01 17:20:55 main:483] : INFO : # Backend Layers: 4 [2022-05-01 17:20:56 main:484] : INFO : # Threads: 1 [2022-05-01 17:20:56 main:486] : INFO : Preparing Dataset [2022-05-01 17:20:56 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-05-01 17:21:05 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 950M) [2022-05-01 17:35:18 main:435] : INFO : Set logging level to 1 [2022-05-01 17:35:18 main:441] : INFO : Running in BOINC Client mode [2022-05-01 17:35:19 main:444] : INFO : Resolving all filenames [2022-05-01 17:35:19 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-05-01 17:35:19 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-05-01 17:35:20 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-05-01 17:35:20 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-05-01 17:35:21 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-05-01 17:35:21 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-05-01 17:35:21 main:474] : INFO : Configuration: [2022-05-01 17:35:21 main:475] : INFO : Model type: GRU [2022-05-01 17:35:21 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-05-01 17:35:21 main:477] : INFO : Max Epochs: 2048 [2022-05-01 17:35:22 main:478] : INFO : Batch Size: 128 [2022-05-01 17:35:22 main:479] : INFO : Learning Rate: 0.01 [2022-05-01 17:35:23 main:480] : INFO : Patience: 10 [2022-05-01 17:35:23 main:481] : INFO : Hidden Width: 12 [2022-05-01 17:35:23 main:482] : INFO : # Recurrent Layers: 4 [2022-05-01 17:35:24 main:483] : INFO : # Backend Layers: 4 [2022-05-01 17:35:24 main:484] : INFO : # Threads: 1 [2022-05-01 17:35:24 main:486] : INFO : Preparing Dataset [2022-05-01 17:35:24 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-05-01 17:35:33 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-05-01 17:43:05 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-05-01 17:43:05 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-05-01 17:43:17 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-05-01 17:43:38 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-05-01 17:43:39 main:494] : INFO : Creating Model [2022-05-01 17:43:39 main:507] : INFO : Preparing config file [2022-05-01 17:43:40 main:511] : INFO : Found checkpoint, attempting to load... [2022-05-01 17:43:40 main:512] : INFO : Loading config [2022-05-01 17:43:42 main:514] : INFO : Loading state [2022-05-01 17:46:32 main:559] : INFO : Loading DataLoader into Memory [2022-05-01 17:46:33 main:562] : INFO : Starting Training [2022-05-01 17:49:45 main:574] : INFO : Epoch 1874 | loss: 0.0313514 | val_loss: 0.0312132 | Time: 191070 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 950M) [2022-05-01 18:02:43 main:435] : INFO : Set logging level to 1 [2022-05-01 18:02:43 main:441] : INFO : Running in BOINC Client mode [2022-05-01 18:02:44 main:444] : INFO : Resolving all filenames [2022-05-01 18:02:44 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-05-01 18:02:44 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-05-01 18:02:44 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-05-01 18:02:45 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-05-01 18:02:45 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-05-01 18:02:45 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-05-01 18:02:46 main:474] : INFO : Configuration: [2022-05-01 18:02:46 main:475] : INFO : Model type: GRU [2022-05-01 18:02:46 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-05-01 18:02:46 main:477] : INFO : Max Epochs: 2048 [2022-05-01 18:02:46 main:478] : INFO : Batch Size: 128 [2022-05-01 18:02:46 main:479] : INFO : Learning Rate: 0.01 [2022-05-01 18:02:47 main:480] : INFO : Patience: 10 [2022-05-01 18:02:47 main:481] : INFO : Hidden Width: 12 [2022-05-01 18:02:47 main:482] : INFO : # Recurrent Layers: 4 [2022-05-01 18:02:47 main:483] : INFO : # Backend Layers: 4 [2022-05-01 18:02:47 main:484] : INFO : # Threads: 1 [2022-05-01 18:02:48 main:486] : INFO : Preparing Dataset [2022-05-01 18:02:48 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-05-01 18:03:10 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 950M) [2022-05-01 18:07:02 main:435] : INFO : Set logging level to 1 [2022-05-01 18:07:02 main:441] : INFO : Running in BOINC Client mode [2022-05-01 18:07:03 main:444] : INFO : Resolving all filenames [2022-05-01 18:07:03 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-05-01 18:07:03 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-05-01 18:07:04 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-05-01 18:07:05 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-05-01 18:07:05 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-05-01 18:07:05 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-05-01 18:07:08 main:474] : INFO : Configuration: [2022-05-01 18:07:10 main:475] : INFO : Model type: GRU [2022-05-01 18:07:10 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-05-01 18:07:10 main:477] : INFO : Max Epochs: 2048 [2022-05-01 18:07:10 main:478] : INFO : Batch Size: 128 [2022-05-01 18:07:10 main:479] : INFO : Learning Rate: 0.01 [2022-05-01 18:07:11 main:480] : INFO : Patience: 10 [2022-05-01 18:07:11 main:481] : INFO : Hidden Width: 12 [2022-05-01 18:07:11 main:482] : INFO : # Recurrent Layers: 4 [2022-05-01 18:07:11 main:483] : INFO : # Backend Layers: 4 [2022-05-01 18:07:11 main:484] : INFO : # Threads: 1 [2022-05-01 18:07:11 main:486] : INFO : Preparing Dataset [2022-05-01 18:07:11 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 950M) [2022-05-01 18:10:41 main:435] : INFO : Set logging level to 1 [2022-05-01 18:10:41 main:441] : INFO : Running in BOINC Client mode [2022-05-01 18:10:41 main:444] : INFO : Resolving all filenames [2022-05-01 18:10:42 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-05-01 18:10:42 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-05-01 18:10:42 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-05-01 18:10:42 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-05-01 18:10:42 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-05-01 18:10:42 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-05-01 18:10:42 main:474] : INFO : Configuration: [2022-05-01 18:10:42 main:475] : INFO : Model type: GRU [2022-05-01 18:10:42 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-05-01 18:10:42 main:477] : INFO : Max Epochs: 2048 [2022-05-01 18:10:42 main:478] : INFO : Batch Size: 128 [2022-05-01 18:10:42 main:479] : INFO : Learning Rate: 0.01 [2022-05-01 18:10:42 main:480] : INFO : Patience: 10 [2022-05-01 18:10:43 main:481] : INFO : Hidden Width: 12 [2022-05-01 18:10:43 main:482] : INFO : # Recurrent Layers: 4 [2022-05-01 18:10:43 main:483] : INFO : # Backend Layers: 4 [2022-05-01 18:10:43 main:484] : INFO : # Threads: 1 [2022-05-01 18:10:44 main:486] : INFO : Preparing Dataset [2022-05-01 18:10:44 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-05-01 18:10:50 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-05-01 18:16:41 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-05-01 18:16:42 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-05-01 18:16:50 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-05-01 18:17:06 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-05-01 18:17:06 main:494] : INFO : Creating Model [2022-05-01 18:17:06 main:507] : INFO : Preparing config file [2022-05-01 18:17:06 main:511] : INFO : Found checkpoint, attempting to load... [2022-05-01 18:17:06 main:512] : INFO : Loading config [2022-05-01 18:17:07 main:514] : INFO : Loading state [2022-05-01 18:19:18 main:559] : INFO : Loading DataLoader into Memory [2022-05-01 18:19:19 main:562] : INFO : Starting Training [2022-05-01 18:22:35 main:574] : INFO : Epoch 1875 | loss: 0.0312826 | val_loss: 0.0311948 | Time: 196371 ms [2022-05-01 18:26:11 main:574] : INFO : Epoch 1876 | loss: 0.0311675 | val_loss: 0.0311652 | Time: 212435 ms [2022-05-01 18:30:20 main:574] : INFO : Epoch 1877 | loss: 0.0311512 | val_loss: 0.0311606 | Time: 241410 ms [2022-05-01 18:33:26 main:574] : INFO : Epoch 1878 | loss: 0.0311468 | val_loss: 0.0311678 | Time: 182853 ms [2022-05-01 18:36:56 main:574] : INFO : Epoch 1879 | loss: 0.0311469 | val_loss: 0.0311636 | Time: 208430 ms [2022-05-01 18:39:51 main:574] : INFO : Epoch 1880 | loss: 0.0311441 | val_loss: 0.0311637 | Time: 169488 ms [2022-05-01 18:43:04 main:574] : INFO : Epoch 1881 | loss: 0.0311426 | val_loss: 0.0311642 | Time: 192438 ms [2022-05-01 18:45:09 main:574] : INFO : Epoch 1882 | loss: 0.0311418 | val_loss: 0.0311623 | Time: 123597 ms [2022-05-01 18:48:37 main:574] : INFO : Epoch 1883 | loss: 0.0311433 | val_loss: 0.0311691 | Time: 207137 ms [2022-05-01 18:50:57 main:574] : INFO : Epoch 1884 | loss: 0.0311421 | val_loss: 0.0311604 | Time: 139394 ms [2022-05-01 18:53:20 main:574] : INFO : Epoch 1885 | loss: 0.0311395 | val_loss: 0.031162 | Time: 143429 ms [2022-05-01 18:56:33 main:574] : INFO : Epoch 1886 | loss: 0.0311391 | val_loss: 0.0311673 | Time: 188341 ms [2022-05-01 19:00:53 main:574] : INFO : Epoch 1887 | loss: 0.0311395 | val_loss: 0.0311636 | Time: 256390 ms [2022-05-01 19:04:14 main:574] : INFO : Epoch 1888 | loss: 0.0311397 | val_loss: 0.0311664 | Time: 199036 ms [2022-05-01 19:06:18 main:574] : INFO : Epoch 1889 | loss: 0.0311428 | val_loss: 0.0311656 | Time: 121061 ms [2022-05-01 19:09:07 main:574] : INFO : Epoch 1890 | loss: 0.0311401 | val_loss: 0.0311653 | Time: 168774 ms [2022-05-01 19:11:58 main:574] : INFO : Epoch 1891 | loss: 0.0311386 | val_loss: 0.0311658 | Time: 167302 ms [2022-05-01 19:14:39 main:574] : INFO : Epoch 1892 | loss: 0.0311367 | val_loss: 0.03117 | Time: 157633 ms [2022-05-01 19:17:34 main:574] : INFO : Epoch 1893 | loss: 0.0311375 | val_loss: 0.0311681 | Time: 172909 ms [2022-05-01 19:19:43 main:574] : INFO : Epoch 1894 | loss: 0.031138 | val_loss: 0.0311701 | Time: 128117 ms [2022-05-01 19:22:14 main:574] : INFO : Epoch 1895 | loss: 0.0311375 | val_loss: 0.0311666 | Time: 147802 ms [2022-05-01 19:25:19 main:574] : INFO : Epoch 1896 | loss: 0.0311402 | val_loss: 0.0311756 | Time: 184329 ms [2022-05-01 19:28:00 main:574] : INFO : Epoch 1897 | loss: 0.0311381 | val_loss: 0.0311687 | Time: 161065 ms [2022-05-01 19:30:39 main:574] : INFO : Epoch 1898 | loss: 0.0311372 | val_loss: 0.0311651 | Time: 154817 ms [2022-05-01 19:33:46 main:574] : INFO : Epoch 1899 | loss: 0.0311382 | val_loss: 0.031169 | Time: 185343 ms [2022-05-01 19:36:06 main:574] : INFO : Epoch 1900 | loss: 0.031139 | val_loss: 0.0311707 | Time: 131449 ms [2022-05-01 19:39:06 main:574] : INFO : Epoch 1901 | loss: 0.0311355 | val_loss: 0.03117 | Time: 179149 ms [2022-05-01 19:41:24 main:574] : INFO : Epoch 1902 | loss: 0.0311356 | val_loss: 0.0311664 | Time: 129901 ms [2022-05-01 19:44:27 main:574] : INFO : Epoch 1903 | loss: 0.0311379 | val_loss: 0.0311676 | Time: 179778 ms [2022-05-01 19:47:56 main:574] : INFO : Epoch 1904 | loss: 0.0311356 | val_loss: 0.0311683 | Time: 203134 ms [2022-05-01 19:50:26 main:574] : INFO : Epoch 1905 | loss: 0.0311369 | val_loss: 0.031168 | Time: 147390 ms [2022-05-01 19:53:07 main:574] : INFO : Epoch 1906 | loss: 0.0311372 | val_loss: 0.0311658 | Time: 160767 ms [2022-05-01 19:55:38 main:574] : INFO : Epoch 1907 | loss: 0.031137 | val_loss: 0.0311691 | Time: 147778 ms [2022-05-01 19:58:09 main:574] : INFO : Epoch 1908 | loss: 0.0311359 | val_loss: 0.0311731 | Time: 150822 ms [2022-05-01 20:01:07 main:574] : INFO : Epoch 1909 | loss: 0.0311361 | val_loss: 0.0311764 | Time: 169036 ms [2022-05-01 20:03:18 main:574] : INFO : Epoch 1910 | loss: 0.0311374 | val_loss: 0.0311693 | Time: 131066 ms [2022-05-01 20:05:39 main:574] : INFO : Epoch 1911 | loss: 0.0311384 | val_loss: 0.0311696 | Time: 138769 ms [2022-05-01 20:08:01 main:574] : INFO : Epoch 1912 | loss: 0.0311389 | val_loss: 0.0311639 | Time: 142036 ms [2022-05-01 20:10:30 main:574] : INFO : Epoch 1913 | loss: 0.0311364 | val_loss: 0.0311657 | Time: 147576 ms [2022-05-01 20:13:16 main:574] : INFO : Epoch 1914 | loss: 0.0311391 | val_loss: 0.0311629 | Time: 166062 ms [2022-05-01 20:15:47 main:574] : INFO : Epoch 1915 | loss: 0.0311372 | val_loss: 0.0311688 | Time: 143645 ms [2022-05-01 20:18:51 main:574] : INFO : Epoch 1916 | loss: 0.0311352 | val_loss: 0.0311664 | Time: 184291 ms [2022-05-01 20:21:18 main:574] : INFO : Epoch 1917 | loss: 0.0311373 | val_loss: 0.0311695 | Time: 137421 ms [2022-05-01 20:25:07 main:574] : INFO : Epoch 1918 | loss: 0.0311347 | val_loss: 0.0311668 | Time: 228237 ms [2022-05-01 20:28:09 main:574] : INFO : Epoch 1919 | loss: 0.0311333 | val_loss: 0.0311687 | Time: 177281 ms [2022-05-01 20:30:25 main:574] : INFO : Epoch 1920 | loss: 0.0311322 | val_loss: 0.0311672 | Time: 134206 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 950M) [2022-05-01 20:40:04 main:435] : INFO : Set logging level to 1 [2022-05-01 20:40:05 main:441] : INFO : Running in BOINC Client mode [2022-05-01 20:40:05 main:444] : INFO : Resolving all filenames [2022-05-01 20:40:05 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-05-01 20:40:05 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-05-01 20:40:05 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-05-01 20:40:05 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-05-01 20:40:05 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-05-01 20:40:06 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-05-01 20:40:06 main:474] : INFO : Configuration: [2022-05-01 20:40:06 main:475] : INFO : Model type: GRU [2022-05-01 20:40:06 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-05-01 20:40:06 main:477] : INFO : Max Epochs: 2048 [2022-05-01 20:40:07 main:478] : INFO : Batch Size: 128 [2022-05-01 20:40:08 main:479] : INFO : Learning Rate: 0.01 [2022-05-01 20:40:08 main:480] : INFO : Patience: 10 [2022-05-01 20:40:08 main:481] : INFO : Hidden Width: 12 [2022-05-01 20:40:08 main:482] : INFO : # Recurrent Layers: 4 [2022-05-01 20:40:09 main:483] : INFO : # Backend Layers: 4 [2022-05-01 20:40:09 main:484] : INFO : # Threads: 1 [2022-05-01 20:40:09 main:486] : INFO : Preparing Dataset [2022-05-01 20:40:10 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-05-01 20:40:33 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 950M) [2022-05-01 20:47:33 main:435] : INFO : Set logging level to 1 [2022-05-01 20:47:33 main:441] : INFO : Running in BOINC Client mode [2022-05-01 20:47:33 main:444] : INFO : Resolving all filenames [2022-05-01 20:47:34 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-05-01 20:47:35 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-05-01 20:47:35 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-05-01 20:47:35 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-05-01 20:47:38 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-05-01 20:47:38 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-05-01 20:47:38 main:474] : INFO : Configuration: [2022-05-01 20:47:39 main:475] : INFO : Model type: GRU [2022-05-01 20:47:39 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-05-01 20:47:40 main:477] : INFO : Max Epochs: 2048 [2022-05-01 20:47:40 main:478] : INFO : Batch Size: 128 [2022-05-01 20:47:40 main:479] : INFO : Learning Rate: 0.01 [2022-05-01 20:47:40 main:480] : INFO : Patience: 10 [2022-05-01 20:47:41 main:481] : INFO : Hidden Width: 12 [2022-05-01 20:47:41 main:482] : INFO : # Recurrent Layers: 4 [2022-05-01 20:47:41 main:483] : INFO : # Backend Layers: 4 [2022-05-01 20:47:41 main:484] : INFO : # Threads: 1 [2022-05-01 20:47:41 main:486] : INFO : Preparing Dataset [2022-05-01 20:47:42 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-05-01 20:47:57 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 950M) [2022-05-01 20:55:52 main:435] : INFO : Set logging level to 1 [2022-05-01 20:55:54 main:441] : INFO : Running in BOINC Client mode [2022-05-01 20:55:54 main:444] : INFO : Resolving all filenames [2022-05-01 20:55:55 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-05-01 20:55:55 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-05-01 20:55:55 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-05-01 20:55:55 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 950M) [2022-05-01 21:21:50 main:435] : INFO : Set logging level to 1 [2022-05-01 21:21:50 main:441] : INFO : Running in BOINC Client mode [2022-05-01 21:21:50 main:444] : INFO : Resolving all filenames [2022-05-01 21:21:50 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-05-01 21:21:50 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-05-01 21:21:50 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-05-01 21:21:50 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-05-01 21:21:50 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-05-01 21:21:50 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-05-01 21:21:50 main:474] : INFO : Configuration: [2022-05-01 21:21:50 main:475] : INFO : Model type: GRU [2022-05-01 21:21:50 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-05-01 21:21:51 main:477] : INFO : Max Epochs: 2048 [2022-05-01 21:21:51 main:478] : INFO : Batch Size: 128 [2022-05-01 21:21:51 main:479] : INFO : Learning Rate: 0.01 [2022-05-01 21:21:51 main:480] : INFO : Patience: 10 [2022-05-01 21:21:51 main:481] : INFO : Hidden Width: 12 [2022-05-01 21:21:51 main:482] : INFO : # Recurrent Layers: 4 [2022-05-01 21:21:51 main:483] : INFO : # Backend Layers: 4 [2022-05-01 21:21:51 main:484] : INFO : # Threads: 1 [2022-05-01 21:21:51 main:486] : INFO : Preparing Dataset [2022-05-01 21:21:51 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-05-01 21:22:01 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-05-01 21:28:44 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-05-01 21:28:45 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-05-01 21:28:59 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-05-01 21:29:29 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-05-01 21:29:29 main:494] : INFO : Creating Model [2022-05-01 21:29:29 main:507] : INFO : Preparing config file [2022-05-01 21:29:29 main:511] : INFO : Found checkpoint, attempting to load... [2022-05-01 21:29:29 main:512] : INFO : Loading config [2022-05-01 21:29:34 main:514] : INFO : Loading state [2022-05-01 21:32:45 main:559] : INFO : Loading DataLoader into Memory [2022-05-01 21:32:47 main:562] : INFO : Starting Training [2022-05-01 21:36:40 main:574] : INFO : Epoch 1921 | loss: 0.0312778 | val_loss: 0.0312082 | Time: 230119 ms [2022-05-01 21:40:20 main:574] : INFO : Epoch 1922 | loss: 0.0311498 | val_loss: 0.03117 | Time: 217482 ms [2022-05-01 21:44:24 main:574] : INFO : Epoch 1923 | loss: 0.0311374 | val_loss: 0.0311728 | Time: 239546 ms [2022-05-01 21:47:47 main:574] : INFO : Epoch 1924 | loss: 0.0311362 | val_loss: 0.0311722 | Time: 195111 ms [2022-05-01 21:49:41 main:574] : INFO : Epoch 1925 | loss: 0.0311358 | val_loss: 0.0311703 | Time: 110474 ms [2022-05-01 21:52:51 main:574] : INFO : Epoch 1926 | loss: 0.0311335 | val_loss: 0.0311712 | Time: 189336 ms [2022-05-01 21:56:47 main:574] : INFO : Epoch 1927 | loss: 0.0311349 | val_loss: 0.0311708 | Time: 234332 ms [2022-05-01 21:59:26 main:574] : INFO : Epoch 1928 | loss: 0.0311381 | val_loss: 0.0311772 | Time: 153359 ms [2022-05-01 22:03:03 main:574] : INFO : Epoch 1929 | loss: 0.0311366 | val_loss: 0.0311749 | Time: 216742 ms [2022-05-01 22:05:54 main:574] : INFO : Epoch 1930 | loss: 0.0311347 | val_loss: 0.0311707 | Time: 168304 ms [2022-05-01 22:08:53 main:574] : INFO : Epoch 1931 | loss: 0.0311336 | val_loss: 0.0311707 | Time: 177544 ms [2022-05-01 22:12:11 main:574] : INFO : Epoch 1932 | loss: 0.0311326 | val_loss: 0.0311681 | Time: 196878 ms [2022-05-01 22:15:42 main:574] : INFO : Epoch 1933 | loss: 0.0311345 | val_loss: 0.0311639 | Time: 208473 ms [2022-05-01 22:18:23 main:574] : INFO : Epoch 1934 | loss: 0.0311336 | val_loss: 0.0311707 | Time: 159187 ms [2022-05-01 22:20:09 main:574] : INFO : Epoch 1935 | loss: 0.0311326 | val_loss: 0.0311719 | Time: 105775 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 950M) [2022-05-01 22:27:49 main:435] : INFO : Set logging level to 1 [2022-05-01 22:27:49 main:441] : INFO : Running in BOINC Client mode [2022-05-01 22:27:50 main:444] : INFO : Resolving all filenames [2022-05-01 22:27:51 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-05-01 22:27:51 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-05-01 22:27:52 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-05-01 22:27:53 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-05-01 22:27:53 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-05-01 22:27:53 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-05-01 22:27:53 main:474] : INFO : Configuration: [2022-05-01 22:27:53 main:475] : INFO : Model type: GRU [2022-05-01 22:27:53 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-05-01 22:27:53 main:477] : INFO : Max Epochs: 2048 [2022-05-01 22:27:53 main:478] : INFO : Batch Size: 128 [2022-05-01 22:27:54 main:479] : INFO : Learning Rate: 0.01 [2022-05-01 22:27:54 main:480] : INFO : Patience: 10 [2022-05-01 22:27:54 main:481] : INFO : Hidden Width: 12 [2022-05-01 22:27:54 main:482] : INFO : # Recurrent Layers: 4 [2022-05-01 22:27:55 main:483] : INFO : # Backend Layers: 4 [2022-05-01 22:27:55 main:484] : INFO : # Threads: 1 [2022-05-01 22:27:55 main:486] : INFO : Preparing Dataset [2022-05-01 22:27:55 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-05-01 22:28:15 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 950M) [2022-05-01 22:43:57 main:435] : INFO : Set logging level to 1 [2022-05-01 22:43:57 main:441] : INFO : Running in BOINC Client mode [2022-05-01 22:43:57 main:444] : INFO : Resolving all filenames [2022-05-01 22:43:58 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-05-01 22:43:58 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-05-01 22:43:58 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-05-01 22:43:58 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-05-01 22:43:58 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-05-01 22:43:59 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-05-01 22:43:59 main:474] : INFO : Configuration: [2022-05-01 22:43:59 main:475] : INFO : Model type: GRU [2022-05-01 22:43:59 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-05-01 22:44:00 main:477] : INFO : Max Epochs: 2048 [2022-05-01 22:44:00 main:478] : INFO : Batch Size: 128 [2022-05-01 22:44:01 main:479] : INFO : Learning Rate: 0.01 [2022-05-01 22:44:01 main:480] : INFO : Patience: 10 [2022-05-01 22:44:02 main:481] : INFO : Hidden Width: 12 [2022-05-01 22:44:02 main:482] : INFO : # Recurrent Layers: 4 [2022-05-01 22:44:02 main:483] : INFO : # Backend Layers: 4 [2022-05-01 22:44:02 main:484] : INFO : # Threads: 1 [2022-05-01 22:44:03 main:486] : INFO : Preparing Dataset [2022-05-01 22:44:04 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-05-01 22:44:29 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-05-01 22:49:54 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-05-01 22:49:55 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-05-01 22:50:07 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-05-01 22:50:18 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-05-01 22:50:18 main:494] : INFO : Creating Model [2022-05-01 22:50:19 main:507] : INFO : Preparing config file [2022-05-01 22:50:19 main:511] : INFO : Found checkpoint, attempting to load... [2022-05-01 22:50:21 main:512] : INFO : Loading config [2022-05-01 22:50:23 main:514] : INFO : Loading state [2022-05-01 22:52:39 main:559] : INFO : Loading DataLoader into Memory [2022-05-01 22:52:39 main:562] : INFO : Starting Training [2022-05-01 22:56:23 main:574] : INFO : Epoch 1936 | loss: 0.0312869 | val_loss: 0.0311879 | Time: 223473 ms [2022-05-01 22:58:53 main:574] : INFO : Epoch 1937 | loss: 0.0311534 | val_loss: 0.0311785 | Time: 143212 ms [2022-05-01 23:00:33 main:574] : INFO : Epoch 1938 | loss: 0.0311421 | val_loss: 0.0311693 | Time: 99056.3 ms [2022-05-01 23:02:34 main:574] : INFO : Epoch 1939 | loss: 0.0311397 | val_loss: 0.0311722 | Time: 114160 ms [2022-05-01 23:04:42 main:574] : INFO : Epoch 1940 | loss: 0.0311374 | val_loss: 0.0311678 | Time: 125552 ms [2022-05-01 23:06:30 main:574] : INFO : Epoch 1941 | loss: 0.031138 | val_loss: 0.0311748 | Time: 100712 ms [2022-05-01 23:08:55 main:574] : INFO : Epoch 1942 | loss: 0.0311364 | val_loss: 0.031169 | Time: 144812 ms [2022-05-01 23:10:28 main:574] : INFO : Epoch 1943 | loss: 0.0311338 | val_loss: 0.0311696 | Time: 88976.4 ms [2022-05-01 23:12:58 main:574] : INFO : Epoch 1944 | loss: 0.0311344 | val_loss: 0.0311701 | Time: 149906 ms [2022-05-01 23:14:40 main:574] : INFO : Epoch 1945 | loss: 0.0311351 | val_loss: 0.0311668 | Time: 95499.6 ms [2022-05-01 23:16:37 main:574] : INFO : Epoch 1946 | loss: 0.0311348 | val_loss: 0.0311725 | Time: 116756 ms [2022-05-01 23:18:13 main:574] : INFO : Epoch 1947 | loss: 0.0311331 | val_loss: 0.0311686 | Time: 93201.6 ms [2022-05-01 23:19:21 main:574] : INFO : Epoch 1948 | loss: 0.0311341 | val_loss: 0.0311673 | Time: 67453.8 ms [2022-05-01 23:20:30 main:574] : INFO : Epoch 1949 | loss: 0.0311352 | val_loss: 0.0311677 | Time: 69020.4 ms [2022-05-01 23:22:12 main:574] : INFO : Epoch 1950 | loss: 0.0311395 | val_loss: 0.0311665 | Time: 97056.2 ms [2022-05-01 23:23:45 main:574] : INFO : Epoch 1951 | loss: 0.0311391 | val_loss: 0.0311672 | Time: 93227.7 ms [2022-05-01 23:25:32 main:574] : INFO : Epoch 1952 | loss: 0.0311367 | val_loss: 0.0311716 | Time: 104484 ms [2022-05-01 23:27:22 main:574] : INFO : Epoch 1953 | loss: 0.0311401 | val_loss: 0.0311711 | Time: 104359 ms [2022-05-01 23:29:42 main:574] : INFO : Epoch 1954 | loss: 0.0311387 | val_loss: 0.0311689 | Time: 139453 ms [2022-05-01 23:32:19 main:574] : INFO : Epoch 1955 | loss: 0.0311356 | val_loss: 0.031169 | Time: 156122 ms [2022-05-01 23:34:45 main:574] : INFO : Epoch 1956 | loss: 0.0311356 | val_loss: 0.0311695 | Time: 137181 ms [2022-05-01 23:37:20 main:574] : INFO : Epoch 1957 | loss: 0.0311349 | val_loss: 0.0311681 | Time: 145536 ms [2022-05-01 23:39:23 main:574] : INFO : Epoch 1958 | loss: 0.0311354 | val_loss: 0.0311671 | Time: 121191 ms [2022-05-01 23:41:36 main:574] : INFO : Epoch 1959 | loss: 0.0311357 | val_loss: 0.0311699 | Time: 132428 ms [2022-05-01 23:44:07 main:574] : INFO : Epoch 1960 | loss: 0.0311391 | val_loss: 0.0311677 | Time: 139792 ms [2022-05-01 23:45:59 main:574] : INFO : Epoch 1961 | loss: 0.0311385 | val_loss: 0.0311674 | Time: 110708 ms [2022-05-01 23:49:09 main:574] : INFO : Epoch 1962 | loss: 0.0311344 | val_loss: 0.0311707 | Time: 182068 ms [2022-05-01 23:50:51 main:574] : INFO : Epoch 1963 | loss: 0.0311333 | val_loss: 0.0311681 | Time: 101115 ms [2022-05-01 23:52:44 main:574] : INFO : Epoch 1964 | loss: 0.0311338 | val_loss: 0.0311665 | Time: 112373 ms [2022-05-01 23:54:52 main:574] : INFO : Epoch 1965 | loss: 0.0311375 | val_loss: 0.0311698 | Time: 128101 ms [2022-05-01 23:56:46 main:574] : INFO : Epoch 1966 | loss: 0.0311375 | val_loss: 0.0311669 | Time: 104091 ms [2022-05-01 23:59:43 main:574] : INFO : Epoch 1967 | loss: 0.0311381 | val_loss: 0.0311693 | Time: 176600 ms [2022-05-02 00:02:11 main:574] : INFO : Epoch 1968 | loss: 0.0311395 | val_loss: 0.031173 | Time: 142332 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 950M) [2022-05-02 00:57:37 main:435] : INFO : Set logging level to 1 [2022-05-02 00:57:37 main:441] : INFO : Running in BOINC Client mode [2022-05-02 00:57:38 main:444] : INFO : Resolving all filenames [2022-05-02 00:57:38 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-05-02 00:57:38 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-05-02 00:57:38 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-05-02 00:57:38 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-05-02 00:57:38 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-05-02 00:57:38 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-05-02 00:57:38 main:474] : INFO : Configuration: [2022-05-02 00:57:38 main:475] : INFO : Model type: GRU [2022-05-02 00:57:40 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-05-02 00:57:40 main:477] : INFO : Max Epochs: 2048 [2022-05-02 00:57:40 main:478] : INFO : Batch Size: 128 [2022-05-02 00:57:40 main:479] : INFO : Learning Rate: 0.01 [2022-05-02 00:57:40 main:480] : INFO : Patience: 10 [2022-05-02 00:57:40 main:481] : INFO : Hidden Width: 12 [2022-05-02 00:57:40 main:482] : INFO : # Recurrent Layers: 4 [2022-05-02 00:57:40 main:483] : INFO : # Backend Layers: 4 [2022-05-02 00:57:40 main:484] : INFO : # Threads: 1 [2022-05-02 00:57:41 main:486] : INFO : Preparing Dataset [2022-05-02 00:57:41 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-05-02 00:57:49 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-05-02 01:01:02 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-05-02 01:01:03 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-05-02 01:01:08 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-05-02 01:01:22 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-05-02 01:01:22 main:494] : INFO : Creating Model [2022-05-02 01:01:22 main:507] : INFO : Preparing config file [2022-05-02 01:01:23 main:511] : INFO : Found checkpoint, attempting to load... [2022-05-02 01:01:23 main:512] : INFO : Loading config [2022-05-02 01:01:23 main:514] : INFO : Loading state [2022-05-02 01:04:12 main:559] : INFO : Loading DataLoader into Memory [2022-05-02 01:04:13 main:562] : INFO : Starting Training [2022-05-02 01:09:00 main:574] : INFO : Epoch 1968 | loss: 0.0311962 | val_loss: 0.03118 | Time: 284665 ms [2022-05-02 01:12:18 main:574] : INFO : Epoch 1969 | loss: 0.0311487 | val_loss: 0.0311732 | Time: 177891 ms [2022-05-02 01:14:47 main:574] : INFO : Epoch 1970 | loss: 0.031143 | val_loss: 0.0311684 | Time: 149316 ms [2022-05-02 01:17:18 main:574] : INFO : Epoch 1971 | loss: 0.0311356 | val_loss: 0.0311671 | Time: 146321 ms [2022-05-02 01:19:26 main:574] : INFO : Epoch 1972 | loss: 0.0311353 | val_loss: 0.0311718 | Time: 128429 ms [2022-05-02 01:21:52 main:574] : INFO : Epoch 1973 | loss: 0.0311348 | val_loss: 0.0311628 | Time: 98944.2 ms [2022-05-02 01:24:55 main:574] : INFO : Epoch 1974 | loss: 0.0311361 | val_loss: 0.0311704 | Time: 180899 ms [2022-05-02 01:27:10 main:574] : INFO : Epoch 1975 | loss: 0.0311363 | val_loss: 0.0311669 | Time: 120677 ms [2022-05-02 01:29:41 main:574] : INFO : Epoch 1976 | loss: 0.0311362 | val_loss: 0.0311704 | Time: 150881 ms [2022-05-02 01:33:10 main:574] : INFO : Epoch 1977 | loss: 0.031136 | val_loss: 0.0311632 | Time: 185545 ms [2022-05-02 01:35:33 main:574] : INFO : Epoch 1978 | loss: 0.0311342 | val_loss: 0.0311624 | Time: 133004 ms [2022-05-02 01:38:32 main:574] : INFO : Epoch 1979 | loss: 0.0311344 | val_loss: 0.0311647 | Time: 169595 ms [2022-05-02 01:41:09 main:574] : INFO : Epoch 1980 | loss: 0.031135 | val_loss: 0.0311679 | Time: 149139 ms [2022-05-02 01:43:00 main:574] : INFO : Epoch 1981 | loss: 0.031138 | val_loss: 0.0311652 | Time: 110751 ms [2022-05-02 01:45:01 main:574] : INFO : Epoch 1982 | loss: 0.0311354 | val_loss: 0.0311689 | Time: 115638 ms [2022-05-02 01:47:25 main:574] : INFO : Epoch 1983 | loss: 0.0311373 | val_loss: 0.0311653 | Time: 143479 ms [2022-05-02 01:49:36 main:574] : INFO : Epoch 1984 | loss: 0.0311407 | val_loss: 0.0311658 | Time: 121600 ms [2022-05-02 01:52:26 main:574] : INFO : Epoch 1985 | loss: 0.0311414 | val_loss: 0.0311674 | Time: 166273 ms [2022-05-02 01:55:13 main:574] : INFO : Epoch 1986 | loss: 0.0311436 | val_loss: 0.0311625 | Time: 164247 ms [2022-05-02 01:58:03 main:574] : INFO : Epoch 1987 | loss: 0.0311392 | val_loss: 0.0311657 | Time: 170085 ms [2022-05-02 02:00:33 main:574] : INFO : Epoch 1988 | loss: 0.0311373 | val_loss: 0.0311638 | Time: 133563 ms [2022-05-02 02:01:54 main:574] : INFO : Epoch 1989 | loss: 0.0311365 | val_loss: 0.0311625 | Time: 80305.4 ms [2022-05-02 02:03:41 main:574] : INFO : Epoch 1990 | loss: 0.0311348 | val_loss: 0.0311631 | Time: 102988 ms [2022-05-02 02:05:06 main:574] : INFO : Epoch 1991 | loss: 0.0311331 | val_loss: 0.0311638 | Time: 80894 ms [2022-05-02 02:06:50 main:574] : INFO : Epoch 1992 | loss: 0.0311337 | val_loss: 0.0311752 | Time: 98765.7 ms [2022-05-02 02:08:03 main:574] : INFO : Epoch 1993 | loss: 0.0311326 | val_loss: 0.0311642 | Time: 73219.1 ms [2022-05-02 02:09:52 main:574] : INFO : Epoch 1994 | loss: 0.0311331 | val_loss: 0.0311695 | Time: 106405 ms [2022-05-02 02:11:19 main:574] : INFO : Epoch 1995 | loss: 0.0311327 | val_loss: 0.0311658 | Time: 83977.5 ms [2022-05-02 02:13:01 main:574] : INFO : Epoch 1996 | loss: 0.0311312 | val_loss: 0.0311725 | Time: 102316 ms [2022-05-02 02:14:55 main:574] : INFO : Epoch 1997 | loss: 0.0311303 | val_loss: 0.0311651 | Time: 104402 ms [2022-05-02 02:16:45 main:574] : INFO : Epoch 1998 | loss: 0.031129 | val_loss: 0.031169 | Time: 109997 ms [2022-05-02 02:18:20 main:574] : INFO : Epoch 1999 | loss: 0.0311299 | val_loss: 0.0311677 | Time: 91024.7 ms [2022-05-02 02:19:37 main:574] : INFO : Epoch 2000 | loss: 0.0311284 | val_loss: 0.0311679 | Time: 76750.4 ms [2022-05-02 02:21:03 main:574] : INFO : Epoch 2001 | loss: 0.0311297 | val_loss: 0.0311698 | Time: 85555 ms [2022-05-02 02:22:55 main:574] : INFO : Epoch 2002 | loss: 0.0311309 | val_loss: 0.0311665 | Time: 107332 ms [2022-05-02 02:24:26 main:574] : INFO : Epoch 2003 | loss: 0.0311322 | val_loss: 0.0311689 | Time: 91217.9 ms [2022-05-02 02:25:50 main:574] : INFO : Epoch 2004 | loss: 0.0311327 | val_loss: 0.0311712 | Time: 81689.7 ms [2022-05-02 02:27:25 main:574] : INFO : Epoch 2005 | loss: 0.0311373 | val_loss: 0.0311686 | Time: 94841.1 ms [2022-05-02 02:29:17 main:574] : INFO : Epoch 2006 | loss: 0.0311402 | val_loss: 0.0311694 | Time: 112448 ms [2022-05-02 02:30:48 main:574] : INFO : Epoch 2007 | loss: 0.0311385 | val_loss: 0.0311674 | Time: 88677.5 ms [2022-05-02 02:32:11 main:574] : INFO : Epoch 2008 | loss: 0.031136 | val_loss: 0.0311702 | Time: 82694.4 ms [2022-05-02 02:33:50 main:574] : INFO : Epoch 2009 | loss: 0.0311372 | val_loss: 0.0311709 | Time: 99041.9 ms [2022-05-02 02:35:32 main:574] : INFO : Epoch 2010 | loss: 0.0311345 | val_loss: 0.0311663 | Time: 97638.2 ms [2022-05-02 02:37:14 main:574] : INFO : Epoch 2011 | loss: 0.0311325 | val_loss: 0.0311642 | Time: 101666 ms [2022-05-02 02:38:36 main:574] : INFO : Epoch 2012 | loss: 0.0311317 | val_loss: 0.0311657 | Time: 68160.8 ms [2022-05-02 02:39:59 main:574] : INFO : Epoch 2013 | loss: 0.0311377 | val_loss: 0.0311658 | Time: 82911 ms [2022-05-02 02:41:22 main:574] : INFO : Epoch 2014 | loss: 0.0311368 | val_loss: 0.0311653 | Time: 82564.3 ms [2022-05-02 02:42:54 main:574] : INFO : Epoch 2015 | loss: 0.0311401 | val_loss: 0.0311723 | Time: 86809.3 ms [2022-05-02 02:44:10 main:574] : INFO : Epoch 2016 | loss: 0.03114 | val_loss: 0.031168 | Time: 75756 ms [2022-05-02 02:45:19 main:574] : INFO : Epoch 2017 | loss: 0.0311384 | val_loss: 0.0311646 | Time: 68946.2 ms [2022-05-02 02:48:15 main:574] : INFO : Epoch 2018 | loss: 0.0311408 | val_loss: 0.0311632 | Time: 164919 ms [2022-05-02 02:51:12 main:574] : INFO : Epoch 2019 | loss: 0.0311381 | val_loss: 0.0311639 | Time: 176011 ms [2022-05-02 02:54:11 main:574] : INFO : Epoch 2020 | loss: 0.0311361 | val_loss: 0.0311636 | Time: 177276 ms [2022-05-02 02:56:46 main:574] : INFO : Epoch 2021 | loss: 0.0311354 | val_loss: 0.0311648 | Time: 154290 ms [2022-05-02 02:59:27 main:574] : INFO : Epoch 2022 | loss: 0.0311359 | val_loss: 0.0311748 | Time: 157570 ms [2022-05-02 03:02:03 main:574] : INFO : Epoch 2023 | loss: 0.0311359 | val_loss: 0.0311716 | Time: 155129 ms [2022-05-02 03:04:19 main:574] : INFO : Epoch 2024 | loss: 0.0311345 | val_loss: 0.0311661 | Time: 131034 ms [2022-05-02 03:06:00 main:574] : INFO : Epoch 2025 | loss: 0.0311369 | val_loss: 0.0311705 | Time: 100638 ms [2022-05-02 03:08:58 main:574] : INFO : Epoch 2026 | loss: 0.0311376 | val_loss: 0.0311641 | Time: 176026 ms [2022-05-02 03:11:25 main:574] : INFO : Epoch 2027 | loss: 0.0311363 | val_loss: 0.0311699 | Time: 146377 ms [2022-05-02 03:14:17 main:574] : INFO : Epoch 2028 | loss: 0.0311333 | val_loss: 0.0311652 | Time: 169155 ms [2022-05-02 03:16:57 main:574] : INFO : Epoch 2029 | loss: 0.0311324 | val_loss: 0.0311675 | Time: 159968 ms [2022-05-02 03:19:11 main:574] : INFO : Epoch 2030 | loss: 0.0311328 | val_loss: 0.031168 | Time: 127942 ms [2022-05-02 03:21:35 main:574] : INFO : Epoch 2031 | loss: 0.0311312 | val_loss: 0.0311667 | Time: 143875 ms [2022-05-02 03:24:08 main:574] : INFO : Epoch 2032 | loss: 0.0311311 | val_loss: 0.031165 | Time: 147950 ms [2022-05-02 03:27:00 main:574] : INFO : Epoch 2033 | loss: 0.0311324 | val_loss: 0.0311708 | Time: 171097 ms [2022-05-02 03:29:27 main:574] : INFO : Epoch 2034 | loss: 0.0311311 | val_loss: 0.0311677 | Time: 139513 ms [2022-05-02 03:32:51 main:574] : INFO : Epoch 2035 | loss: 0.0311295 | val_loss: 0.0311712 | Time: 202831 ms [2022-05-02 03:35:27 main:574] : INFO : Epoch 2036 | loss: 0.0311324 | val_loss: 0.0311671 | Time: 142916 ms [2022-05-02 03:37:25 main:574] : INFO : Epoch 2037 | loss: 0.0311345 | val_loss: 0.0311716 | Time: 118050 ms [2022-05-02 03:40:05 main:574] : INFO : Epoch 2038 | loss: 0.0311334 | val_loss: 0.0311699 | Time: 156420 ms [2022-05-02 03:43:42 main:574] : INFO : Epoch 2039 | loss: 0.0311329 | val_loss: 0.0311663 | Time: 217297 ms [2022-05-02 03:46:11 main:574] : INFO : Epoch 2040 | loss: 0.0311467 | val_loss: 0.0311702 | Time: 145169 ms [2022-05-02 03:48:21 main:574] : INFO : Epoch 2041 | loss: 0.0311527 | val_loss: 0.0311665 | Time: 129299 ms [2022-05-02 03:50:49 main:574] : INFO : Epoch 2042 | loss: 0.0311484 | val_loss: 0.0311669 | Time: 146519 ms [2022-05-02 03:54:02 main:574] : INFO : Epoch 2043 | loss: 0.0311431 | val_loss: 0.0311686 | Time: 193266 ms [2022-05-02 03:58:52 main:574] : INFO : Epoch 2044 | loss: 0.0311429 | val_loss: 0.0311635 | Time: 283374 ms [2022-05-02 04:03:37 main:574] : INFO : Epoch 2045 | loss: 0.0311421 | val_loss: 0.0311654 | Time: 271597 ms [2022-05-02 04:07:14 main:574] : INFO : Epoch 2046 | loss: 0.0311378 | val_loss: 0.0311716 | Time: 207856 ms [2022-05-02 04:12:28 main:574] : INFO : Epoch 2047 | loss: 0.0311375 | val_loss: 0.0311693 | Time: 313823 ms [2022-05-02 04:16:24 main:574] : INFO : Epoch 2048 | loss: 0.0311372 | val_loss: 0.0311671 | Time: 232395 ms [2022-05-02 04:16:38 main:597] : INFO : Saving trained model to model-final.pt, val_loss 0.0311671 [2022-05-02 04:16:41 main:603] : INFO : Saving end state to config to file [2022-05-02 04:16:42 main:608] : INFO : Success, exiting.. 04:16:43 (26664): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)