Task 13696869
| Name | ParityModified-1647041709-22893-2-0_0 |
| Workunit | 10787338 |
| Created | 24 Mar 2022, 7:05:15 UTC |
| Sent | 30 Mar 2022, 17:22:27 UTC |
| Report deadline | 7 Apr 2022, 17:22:27 UTC |
| Received | 1 May 2022, 7:09:33 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 12272 |
| Run time | 1 hours 45 min 50 sec |
| CPU time | 44 min 27 sec |
| Validate state | Task was reported too late to validate |
| Credit | 0.00 |
| Device peak FLOPS | 4,174.78 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.54 GB |
| Peak swap size | 3.48 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.11</core_client_version> <![CDATA[ <stderr_txt> loss: 0.0311069 | val_loss: 0.03115 | Time: 241841 ms [2022-04-29 16:23:05 main:574] : INFO : Epoch 1860 | loss: 0.0311078 | val_loss: 0.0311486 | Time: 1687.12 ms [2022-04-29 16:23:06 main:574] : INFO : Epoch 1861 | loss: 0.0311079 | val_loss: 0.0311453 | Time: 1698.99 ms [2022-04-29 16:23:08 main:574] : INFO : Epoch 1862 | loss: 0.031108 | val_loss: 0.0311419 | Time: 1691.22 ms [2022-04-29 16:23:10 main:574] : INFO : Epoch 1863 | loss: 0.031107 | val_loss: 0.0311451 | Time: 1704.81 ms [2022-04-29 16:23:12 main:574] : INFO : Epoch 1864 | loss: 0.0311075 | val_loss: 0.0311483 | Time: 1774.95 ms [2022-04-29 16:24:04 main:574] : INFO : Epoch 1865 | loss: 0.0311053 | val_loss: 0.031148 | Time: 51895.1 ms [2022-04-29 16:24:05 main:574] : INFO : Epoch 1866 | loss: 0.0311041 | val_loss: 0.0311455 | Time: 1692.35 ms [2022-04-29 16:24:07 main:574] : INFO : Epoch 1867 | loss: 0.0311034 | val_loss: 0.0311429 | Time: 1686.02 ms [2022-04-29 16:24:09 main:574] : INFO : Epoch 1868 | loss: 0.0311155 | val_loss: 0.0311584 | Time: 1686.06 ms [2022-04-29 16:24:10 main:574] : INFO : Epoch 1869 | loss: 0.0311388 | val_loss: 0.0311605 | Time: 1711.45 ms [2022-04-29 16:24:12 main:574] : INFO : Epoch 1870 | loss: 0.0311426 | val_loss: 0.03116 | Time: 1695.41 ms [2022-04-29 16:24:34 main:574] : INFO : Epoch 1871 | loss: 0.0311378 | val_loss: 0.0311544 | Time: 21800.9 ms [2022-04-29 16:24:36 main:574] : INFO : Epoch 1872 | loss: 0.0311314 | val_loss: 0.0311493 | Time: 1702.79 ms [2022-04-29 16:24:37 main:574] : INFO : Epoch 1873 | loss: 0.0311282 | val_loss: 0.0311498 | Time: 1710.02 ms [2022-04-29 16:24:39 main:574] : INFO : Epoch 1874 | loss: 0.0311261 | val_loss: 0.0311505 | Time: 1702.51 ms [2022-04-29 16:24:41 main:574] : INFO : Epoch 1875 | loss: 0.0311242 | val_loss: 0.0311513 | Time: 1703.68 ms [2022-04-29 16:24:43 main:574] : INFO : Epoch 1876 | loss: 0.031121 | val_loss: 0.0311497 | Time: 1703.45 ms [2022-04-29 16:26:35 main:574] : INFO : Epoch 1877 | loss: 0.0311191 | val_loss: 0.0311515 | Time: 111777 ms [2022-04-29 16:26:36 main:574] : INFO : Epoch 1878 | loss: 0.0311178 | val_loss: 0.0311503 | Time: 1694.63 ms [2022-04-29 16:26:38 main:574] : INFO : Epoch 1879 | loss: 0.0311181 | val_loss: 0.0311507 | Time: 1700.23 ms [2022-04-29 16:26:40 main:574] : INFO : Epoch 1880 | loss: 0.0311179 | val_loss: 0.0311517 | Time: 1704.97 ms [2022-04-29 16:26:41 main:574] : INFO : Epoch 1881 | loss: 0.0311146 | val_loss: 0.0311458 | Time: 1722.71 ms [2022-04-29 16:28:33 main:574] : INFO : Epoch 1882 | loss: 0.0311142 | val_loss: 0.0311473 | Time: 111752 ms [2022-04-29 16:28:35 main:574] : INFO : Epoch 1883 | loss: 0.0311129 | val_loss: 0.0311448 | Time: 1701.05 ms [2022-04-29 16:28:37 main:574] : INFO : Epoch 1884 | loss: 0.0311126 | val_loss: 0.0311486 | Time: 1701.92 ms [2022-04-29 16:28:38 main:574] : INFO : Epoch 1885 | loss: 0.0311139 | val_loss: 0.0311568 | Time: 1698.07 ms [2022-04-29 16:28:40 main:574] : INFO : Epoch 1886 | loss: 0.0311133 | val_loss: 0.0311481 | Time: 1718.89 ms [2022-04-29 16:28:42 main:574] : INFO : Epoch 1887 | loss: 0.0311113 | val_loss: 0.0311521 | Time: 1724.54 ms [2022-04-29 16:38:34 main:574] : INFO : Epoch 1888 | loss: 0.0311141 | val_loss: 0.0311484 | Time: 592089 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 970) [2022-04-29 17:12:25 main:435] : INFO : Set logging level to 1 [2022-04-29 17:12:25 main:441] : INFO : Running in BOINC Client mode [2022-04-29 17:12:25 main:444] : INFO : Resolving all filenames [2022-04-29 17:12:25 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-29 17:12:25 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-29 17:12:25 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-29 17:12:25 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-29 17:12:25 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-29 17:12:25 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-29 17:12:25 main:474] : INFO : Configuration: [2022-04-29 17:12:25 main:475] : INFO : Model type: GRU [2022-04-29 17:12:25 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-29 17:12:25 main:477] : INFO : Max Epochs: 2048 [2022-04-29 17:12:25 main:478] : INFO : Batch Size: 128 [2022-04-29 17:12:25 main:479] : INFO : Learning Rate: 0.01 [2022-04-29 17:12:25 main:480] : INFO : Patience: 10 [2022-04-29 17:12:25 main:481] : INFO : Hidden Width: 12 [2022-04-29 17:12:25 main:482] : INFO : # Recurrent Layers: 4 [2022-04-29 17:12:25 main:483] : INFO : # Backend Layers: 4 [2022-04-29 17:12:25 main:484] : INFO : # Threads: 1 [2022-04-29 17:12:25 main:486] : INFO : Preparing Dataset [2022-04-29 17:12:25 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-29 17:12:26 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-29 17:12:29 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-29 17:12:29 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-29 17:12:29 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-29 17:12:29 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-29 17:12:29 main:494] : INFO : Creating Model [2022-04-29 17:12:29 main:507] : INFO : Preparing config file [2022-04-29 17:12:29 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-29 17:12:29 main:512] : INFO : Loading config [2022-04-29 17:12:29 main:514] : INFO : Loading state [2022-04-29 17:12:30 main:559] : INFO : Loading DataLoader into Memory [2022-04-29 17:12:30 main:562] : INFO : Starting Training [2022-04-29 17:12:32 main:574] : INFO : Epoch 1889 | loss: 0.0311888 | val_loss: 0.0311658 | Time: 2309.98 ms [2022-04-29 17:12:34 main:574] : INFO : Epoch 1890 | loss: 0.0311224 | val_loss: 0.0311483 | Time: 1745.77 ms [2022-04-29 17:16:26 main:574] : INFO : Epoch 1891 | loss: 0.0311196 | val_loss: 0.0311417 | Time: 231959 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 970) [2022-04-29 17:43:37 main:435] : INFO : Set logging level to 1 [2022-04-29 17:43:37 main:441] : INFO : Running in BOINC Client mode [2022-04-29 17:43:37 main:444] : INFO : Resolving all filenames [2022-04-29 17:43:37 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-29 17:43:37 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-29 17:43:37 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-29 17:43:37 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-29 17:43:37 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-29 17:43:37 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-29 17:43:37 main:474] : INFO : Configuration: [2022-04-29 17:43:37 main:475] : INFO : Model type: GRU [2022-04-29 17:43:37 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-29 17:43:37 main:477] : INFO : Max Epochs: 2048 [2022-04-29 17:43:37 main:478] : INFO : Batch Size: 128 [2022-04-29 17:43:37 main:479] : INFO : Learning Rate: 0.01 [2022-04-29 17:43:37 main:480] : INFO : Patience: 10 [2022-04-29 17:43:37 main:481] : INFO : Hidden Width: 12 [2022-04-29 17:43:37 main:482] : INFO : # Recurrent Layers: 4 [2022-04-29 17:43:37 main:483] : INFO : # Backend Layers: 4 [2022-04-29 17:43:37 main:484] : INFO : # Threads: 1 [2022-04-29 17:43:37 main:486] : INFO : Preparing Dataset [2022-04-29 17:43:37 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-29 17:43:37 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-29 17:43:41 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-29 17:43:41 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-29 17:43:41 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-29 17:43:41 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-29 17:43:41 main:494] : INFO : Creating Model [2022-04-29 17:43:41 main:507] : INFO : Preparing config file [2022-04-29 17:43:41 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-29 17:43:41 main:512] : INFO : Loading config [2022-04-29 17:43:41 main:514] : INFO : Loading state [2022-04-29 17:43:42 main:559] : INFO : Loading DataLoader into Memory [2022-04-29 17:43:43 main:562] : INFO : Starting Training [2022-04-29 17:43:45 main:574] : INFO : Epoch 1892 | loss: 0.0312217 | val_loss: 0.0311746 | Time: 2630.13 ms [2022-04-29 17:49:07 main:574] : INFO : Epoch 1893 | loss: 0.0311278 | val_loss: 0.0311512 | Time: 322052 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 970) [2022-04-29 19:20:11 main:435] : INFO : Set logging level to 1 [2022-04-29 19:20:11 main:441] : INFO : Running in BOINC Client mode [2022-04-29 19:20:11 main:444] : INFO : Resolving all filenames [2022-04-29 19:20:11 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-29 19:20:11 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-29 19:20:11 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-29 19:20:11 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-29 19:20:11 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-29 19:20:11 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-29 19:20:11 main:474] : INFO : Configuration: [2022-04-29 19:20:11 main:475] : INFO : Model type: GRU [2022-04-29 19:20:11 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-29 19:20:11 main:477] : INFO : Max Epochs: 2048 [2022-04-29 19:20:11 main:478] : INFO : Batch Size: 128 [2022-04-29 19:20:11 main:479] : INFO : Learning Rate: 0.01 [2022-04-29 19:20:11 main:480] : INFO : Patience: 10 [2022-04-29 19:20:11 main:481] : INFO : Hidden Width: 12 [2022-04-29 19:20:11 main:482] : INFO : # Recurrent Layers: 4 [2022-04-29 19:20:11 main:483] : INFO : # Backend Layers: 4 [2022-04-29 19:20:11 main:484] : INFO : # Threads: 1 [2022-04-29 19:20:11 main:486] : INFO : Preparing Dataset [2022-04-29 19:20:11 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-29 19:20:12 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-29 19:20:15 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-29 19:20:15 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-29 19:20:15 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-29 19:20:15 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-29 19:20:15 main:494] : INFO : Creating Model [2022-04-29 19:20:15 main:507] : INFO : Preparing config file [2022-04-29 19:20:15 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-29 19:20:15 main:512] : INFO : Loading config [2022-04-29 19:20:15 main:514] : INFO : Loading state [2022-04-29 19:20:16 main:559] : INFO : Loading DataLoader into Memory [2022-04-29 19:20:16 main:562] : INFO : Starting Training [2022-04-29 19:20:19 main:574] : INFO : Epoch 1894 | loss: 0.0312112 | val_loss: 0.0311756 | Time: 2461.84 ms [2022-04-29 19:20:20 main:574] : INFO : Epoch 1895 | loss: 0.031126 | val_loss: 0.0311505 | Time: 1709.62 ms [2022-04-29 19:20:52 main:574] : INFO : Epoch 1896 | loss: 0.0311171 | val_loss: 0.0311544 | Time: 31733.1 ms [2022-04-29 19:20:54 main:574] : INFO : Epoch 1897 | loss: 0.0311129 | val_loss: 0.0311479 | Time: 1790.01 ms [2022-04-29 19:20:56 main:574] : INFO : Epoch 1898 | loss: 0.031115 | val_loss: 0.0311566 | Time: 1734.46 ms [2022-04-29 19:20:58 main:574] : INFO : Epoch 1899 | loss: 0.0311157 | val_loss: 0.0311486 | Time: 1721.11 ms [2022-04-29 19:20:59 main:574] : INFO : Epoch 1900 | loss: 0.031115 | val_loss: 0.0311421 | Time: 1699.22 ms [2022-04-29 19:21:21 main:574] : INFO : Epoch 1901 | loss: 0.0311144 | val_loss: 0.0311436 | Time: 21820.5 ms [2022-04-29 19:21:23 main:574] : INFO : Epoch 1902 | loss: 0.0311124 | val_loss: 0.031142 | Time: 1699.21 ms [2022-04-29 19:21:25 main:574] : INFO : Epoch 1903 | loss: 0.0311118 | val_loss: 0.0311443 | Time: 1703.38 ms [2022-04-29 19:21:26 main:574] : INFO : Epoch 1904 | loss: 0.0311111 | val_loss: 0.0311455 | Time: 1741.09 ms [2022-04-29 19:21:28 main:574] : INFO : Epoch 1905 | loss: 0.0311149 | val_loss: 0.0311467 | Time: 1699.92 ms [2022-04-29 19:21:30 main:574] : INFO : Epoch 1906 | loss: 0.0311145 | val_loss: 0.0311461 | Time: 1752.97 ms [2022-04-29 19:40:42 main:574] : INFO : Epoch 1907 | loss: 0.0311134 | val_loss: 0.0311539 | Time: 1.15253e+06 ms [2022-04-29 19:40:44 main:574] : INFO : Epoch 1908 | loss: 0.0311159 | val_loss: 0.0311534 | Time: 1689.75 ms [2022-04-29 19:40:46 main:574] : INFO : Epoch 1909 | loss: 0.0311144 | val_loss: 0.0311535 | Time: 1703.81 ms [2022-04-29 19:40:48 main:574] : INFO : Epoch 1910 | loss: 0.0311108 | val_loss: 0.0311444 | Time: 1716.31 ms [2022-04-29 19:40:49 main:574] : INFO : Epoch 1911 | loss: 0.0311114 | val_loss: 0.0311456 | Time: 1711.29 ms [2022-04-29 19:40:51 main:574] : INFO : Epoch 1912 | loss: 0.0311088 | val_loss: 0.031146 | Time: 1723.71 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 970) [2022-04-30 08:19:50 main:435] : INFO : Set logging level to 1 [2022-04-30 08:19:50 main:441] : INFO : Running in BOINC Client mode [2022-04-30 08:19:50 main:444] : INFO : Resolving all filenames [2022-04-30 08:19:50 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-30 08:19:50 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-30 08:19:50 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-30 08:19:50 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-30 08:19:50 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-30 08:19:50 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-30 08:19:50 main:474] : INFO : Configuration: [2022-04-30 08:19:50 main:475] : INFO : Model type: GRU [2022-04-30 08:19:50 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-30 08:19:50 main:477] : INFO : Max Epochs: 2048 [2022-04-30 08:19:50 main:478] : INFO : Batch Size: 128 [2022-04-30 08:19:50 main:479] : INFO : Learning Rate: 0.01 [2022-04-30 08:19:50 main:480] : INFO : Patience: 10 [2022-04-30 08:19:50 main:481] : INFO : Hidden Width: 12 [2022-04-30 08:19:50 main:482] : INFO : # Recurrent Layers: 4 [2022-04-30 08:19:50 main:483] : INFO : # Backend Layers: 4 [2022-04-30 08:19:50 main:484] : INFO : # Threads: 1 [2022-04-30 08:19:50 main:486] : INFO : Preparing Dataset [2022-04-30 08:19:50 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-30 08:19:51 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-30 08:19:55 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-30 08:19:55 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-30 08:19:55 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-30 08:19:55 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-30 08:19:55 main:494] : INFO : Creating Model [2022-04-30 08:19:55 main:507] : INFO : Preparing config file [2022-04-30 08:19:55 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-30 08:19:55 main:512] : INFO : Loading config [2022-04-30 08:19:55 main:514] : INFO : Loading state [2022-04-30 08:19:56 main:559] : INFO : Loading DataLoader into Memory [2022-04-30 08:19:57 main:562] : INFO : Starting Training [2022-04-30 08:19:59 main:574] : INFO : Epoch 1908 | loss: 0.0311724 | val_loss: 0.0311524 | Time: 2209.66 ms [2022-04-30 08:20:31 main:574] : INFO : Epoch 1909 | loss: 0.0311203 | val_loss: 0.0311513 | Time: 31801.2 ms [2022-04-30 08:20:32 main:574] : INFO : Epoch 1910 | loss: 0.0311177 | val_loss: 0.0311464 | Time: 1702.12 ms [2022-04-30 08:20:34 main:574] : INFO : Epoch 1911 | loss: 0.0311162 | val_loss: 0.0311487 | Time: 1777.47 ms [2022-04-30 08:20:36 main:574] : INFO : Epoch 1912 | loss: 0.0311132 | val_loss: 0.0311445 | Time: 1704 ms [2022-04-30 08:20:38 main:574] : INFO : Epoch 1913 | loss: 0.0311136 | val_loss: 0.0311458 | Time: 1755.12 ms [2022-04-30 08:20:39 main:574] : INFO : Epoch 1914 | loss: 0.0311096 | val_loss: 0.0311433 | Time: 1753.5 ms [2022-04-30 08:22:21 main:574] : INFO : Epoch 1915 | loss: 0.0311118 | val_loss: 0.0311516 | Time: 101802 ms [2022-04-30 08:22:23 main:574] : INFO : Epoch 1916 | loss: 0.0311116 | val_loss: 0.0311445 | Time: 1700.86 ms [2022-04-30 08:22:25 main:574] : INFO : Epoch 1917 | loss: 0.031111 | val_loss: 0.0311392 | Time: 1728.51 ms [2022-04-30 08:22:27 main:574] : INFO : Epoch 1918 | loss: 0.03111 | val_loss: 0.0311405 | Time: 1708.67 ms [2022-04-30 08:22:28 main:574] : INFO : Epoch 1919 | loss: 0.0311089 | val_loss: 0.0311445 | Time: 1698.7 ms [2022-04-30 08:22:30 main:574] : INFO : Epoch 1920 | loss: 0.0311091 | val_loss: 0.0311392 | Time: 1740.19 ms [2022-04-30 08:25:22 main:574] : INFO : Epoch 1921 | loss: 0.0311099 | val_loss: 0.0311409 | Time: 171909 ms [2022-04-30 08:25:25 main:574] : INFO : Epoch 1922 | loss: 0.0311098 | val_loss: 0.0311413 | Time: 2744.94 ms [2022-04-30 08:25:27 main:574] : INFO : Epoch 1923 | loss: 0.031109 | val_loss: 0.0311485 | Time: 1726.97 ms [2022-04-30 08:25:28 main:574] : INFO : Epoch 1924 | loss: 0.0311061 | val_loss: 0.0311446 | Time: 1698.21 ms [2022-04-30 08:25:30 main:574] : INFO : Epoch 1925 | loss: 0.0311083 | val_loss: 0.0311482 | Time: 1696.85 ms [2022-04-30 08:25:32 main:574] : INFO : Epoch 1926 | loss: 0.0311061 | val_loss: 0.0311468 | Time: 1706.48 ms [2022-04-30 08:25:34 main:574] : INFO : Epoch 1927 | loss: 0.0311057 | val_loss: 0.0311516 | Time: 1773.67 ms [2022-04-30 08:25:35 main:574] : INFO : Epoch 1928 | loss: 0.0311084 | val_loss: 0.0311446 | Time: 1695.04 ms [2022-04-30 08:25:37 main:574] : INFO : Epoch 1929 | loss: 0.031107 | val_loss: 0.0311417 | Time: 1688.07 ms [2022-04-30 08:25:39 main:574] : INFO : Epoch 1930 | loss: 0.0311043 | val_loss: 0.0311508 | Time: 1758.55 ms [2022-04-30 08:33:41 main:574] : INFO : Epoch 1931 | loss: 0.0311043 | val_loss: 0.0311418 | Time: 482078 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 970) [2022-04-30 09:43:43 main:435] : INFO : Set logging level to 1 [2022-04-30 09:43:43 main:441] : INFO : Running in BOINC Client mode [2022-04-30 09:43:43 main:444] : INFO : Resolving all filenames [2022-04-30 09:43:43 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-30 09:43:43 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-30 09:43:43 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-30 09:43:43 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-30 09:43:43 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-30 09:43:43 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-30 09:43:43 main:474] : INFO : Configuration: [2022-04-30 09:43:43 main:475] : INFO : Model type: GRU [2022-04-30 09:43:43 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-30 09:43:43 main:477] : INFO : Max Epochs: 2048 [2022-04-30 09:43:43 main:478] : INFO : Batch Size: 128 [2022-04-30 09:43:43 main:479] : INFO : Learning Rate: 0.01 [2022-04-30 09:43:43 main:480] : INFO : Patience: 10 [2022-04-30 09:43:43 main:481] : INFO : Hidden Width: 12 [2022-04-30 09:43:43 main:482] : INFO : # Recurrent Layers: 4 [2022-04-30 09:43:43 main:483] : INFO : # Backend Layers: 4 [2022-04-30 09:43:43 main:484] : INFO : # Threads: 1 [2022-04-30 09:43:43 main:486] : INFO : Preparing Dataset [2022-04-30 09:43:43 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-30 09:49:34 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 970) [2022-04-30 12:25:23 main:435] : INFO : Set logging level to 1 [2022-04-30 12:25:23 main:441] : INFO : Running in BOINC Client mode [2022-04-30 12:25:23 main:444] : INFO : Resolving all filenames [2022-04-30 12:25:23 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-30 12:25:23 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-30 12:25:23 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-30 12:25:23 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-30 12:25:23 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-30 12:25:23 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-30 12:25:23 main:474] : INFO : Configuration: [2022-04-30 12:25:23 main:475] : INFO : Model type: GRU [2022-04-30 12:25:23 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-30 12:25:23 main:477] : INFO : Max Epochs: 2048 [2022-04-30 12:25:23 main:478] : INFO : Batch Size: 128 [2022-04-30 12:25:23 main:479] : INFO : Learning Rate: 0.01 [2022-04-30 12:25:23 main:480] : INFO : Patience: 10 [2022-04-30 12:25:23 main:481] : INFO : Hidden Width: 12 [2022-04-30 12:25:23 main:482] : INFO : # Recurrent Layers: 4 [2022-04-30 12:25:23 main:483] : INFO : # Backend Layers: 4 [2022-04-30 12:25:23 main:484] : INFO : # Threads: 1 [2022-04-30 12:25:23 main:486] : INFO : Preparing Dataset [2022-04-30 12:25:23 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-30 12:25:24 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-30 12:25:27 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-30 12:25:27 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-30 12:25:27 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-30 12:25:27 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-30 12:25:28 main:494] : INFO : Creating Model [2022-04-30 12:25:28 main:507] : INFO : Preparing config file [2022-04-30 12:25:28 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-30 12:25:28 main:512] : INFO : Loading config [2022-04-30 12:25:28 main:514] : INFO : Loading state [2022-04-30 12:25:29 main:559] : INFO : Loading DataLoader into Memory [2022-04-30 12:25:29 main:562] : INFO : Starting Training [2022-04-30 12:25:31 main:574] : INFO : Epoch 1932 | loss: 0.0311632 | val_loss: 0.0311545 | Time: 2510.47 ms [2022-04-30 12:25:33 main:574] : INFO : Epoch 1933 | loss: 0.0311125 | val_loss: 0.0311557 | Time: 1816.4 ms [2022-04-30 12:25:35 main:574] : INFO : Epoch 1934 | loss: 0.0311048 | val_loss: 0.0311476 | Time: 1723.63 ms [2022-04-30 12:25:37 main:574] : INFO : Epoch 1935 | loss: 0.0311025 | val_loss: 0.0311444 | Time: 1765.54 ms [2022-04-30 12:25:38 main:574] : INFO : Epoch 1936 | loss: 0.0311029 | val_loss: 0.0311492 | Time: 1710.76 ms [2022-04-30 12:25:40 main:574] : INFO : Epoch 1937 | loss: 0.0311036 | val_loss: 0.0311455 | Time: 1711.34 ms [2022-04-30 12:35:32 main:574] : INFO : Epoch 1938 | loss: 0.0311037 | val_loss: 0.0311463 | Time: 592278 ms [2022-04-30 12:35:34 main:574] : INFO : Epoch 1939 | loss: 0.0311034 | val_loss: 0.0311485 | Time: 1792.77 ms [2022-04-30 12:35:36 main:574] : INFO : Epoch 1940 | loss: 0.0311041 | val_loss: 0.0311425 | Time: 1722.63 ms [2022-04-30 12:35:38 main:574] : INFO : Epoch 1941 | loss: 0.0311018 | val_loss: 0.0311485 | Time: 1705.53 ms [2022-04-30 12:35:40 main:574] : INFO : Epoch 1942 | loss: 0.0311062 | val_loss: 0.0311454 | Time: 1717.12 ms [2022-04-30 12:35:41 main:574] : INFO : Epoch 1943 | loss: 0.0311094 | val_loss: 0.0311437 | Time: 1712.25 ms [2022-04-30 12:52:04 main:574] : INFO : Epoch 1944 | loss: 0.0311082 | val_loss: 0.0311475 | Time: 982462 ms [2022-04-30 12:52:05 main:574] : INFO : Epoch 1945 | loss: 0.0311098 | val_loss: 0.0311441 | Time: 1731.59 ms [2022-04-30 12:52:07 main:574] : INFO : Epoch 1946 | loss: 0.0311108 | val_loss: 0.0311451 | Time: 1716.07 ms [2022-04-30 12:52:09 main:574] : INFO : Epoch 1947 | loss: 0.0311142 | val_loss: 0.031147 | Time: 1710.37 ms [2022-04-30 12:52:11 main:574] : INFO : Epoch 1948 | loss: 0.03111 | val_loss: 0.0311451 | Time: 1713.76 ms [2022-04-30 12:52:13 main:574] : INFO : Epoch 1949 | loss: 0.0311107 | val_loss: 0.0311391 | Time: 1727.21 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 970) [2022-04-30 14:13:37 main:435] : INFO : Set logging level to 1 [2022-04-30 14:13:37 main:441] : INFO : Running in BOINC Client mode [2022-04-30 14:13:37 main:444] : INFO : Resolving all filenames [2022-04-30 14:13:37 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-30 14:13:37 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-30 14:13:37 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-30 14:13:37 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-30 14:13:37 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-30 14:13:37 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-30 14:13:37 main:474] : INFO : Configuration: [2022-04-30 14:13:37 main:475] : INFO : Model type: GRU [2022-04-30 14:13:37 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-30 14:13:37 main:477] : INFO : Max Epochs: 2048 [2022-04-30 14:13:37 main:478] : INFO : Batch Size: 128 [2022-04-30 14:13:37 main:479] : INFO : Learning Rate: 0.01 [2022-04-30 14:13:37 main:480] : INFO : Patience: 10 [2022-04-30 14:13:37 main:481] : INFO : Hidden Width: 12 [2022-04-30 14:13:37 main:482] : INFO : # Recurrent Layers: 4 [2022-04-30 14:13:37 main:483] : INFO : # Backend Layers: 4 [2022-04-30 14:13:37 main:484] : INFO : # Threads: 1 [2022-04-30 14:13:37 main:486] : INFO : Preparing Dataset [2022-04-30 14:13:37 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-30 14:13:37 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-30 14:13:39 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-30 14:13:40 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-30 14:13:40 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-30 14:13:40 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-30 14:13:40 main:494] : INFO : Creating Model [2022-04-30 14:13:40 main:507] : INFO : Preparing config file [2022-04-30 14:13:40 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-30 14:13:40 main:512] : INFO : Loading config [2022-04-30 14:13:40 main:514] : INFO : Loading state [2022-04-30 14:13:41 main:559] : INFO : Loading DataLoader into Memory [2022-04-30 14:13:41 main:562] : INFO : Starting Training [2022-04-30 14:13:43 main:574] : INFO : Epoch 1945 | loss: 0.0311806 | val_loss: 0.031149 | Time: 2197.11 ms [2022-04-30 14:13:45 main:574] : INFO : Epoch 1946 | loss: 0.0311171 | val_loss: 0.0311431 | Time: 1721.29 ms [2022-04-30 14:16:37 main:574] : INFO : Epoch 1947 | loss: 0.0311088 | val_loss: 0.0311461 | Time: 171799 ms [2022-04-30 14:16:39 main:574] : INFO : Epoch 1948 | loss: 0.0311171 | val_loss: 0.0311426 | Time: 1722.33 ms [2022-04-30 14:16:41 main:574] : INFO : Epoch 1949 | loss: 0.0311266 | val_loss: 0.0311476 | Time: 2013.31 ms [2022-04-30 14:16:44 main:574] : INFO : Epoch 1950 | loss: 0.0311329 | val_loss: 0.0311514 | Time: 3356.27 ms [2022-04-30 14:16:46 main:574] : INFO : Epoch 1951 | loss: 0.0311318 | val_loss: 0.0311536 | Time: 1929.29 ms [2022-04-30 14:18:58 main:574] : INFO : Epoch 1952 | loss: 0.0311289 | val_loss: 0.0311517 | Time: 131839 ms [2022-04-30 14:18:59 main:574] : INFO : Epoch 1953 | loss: 0.0311378 | val_loss: 0.0311532 | Time: 1712.92 ms [2022-04-30 14:19:01 main:574] : INFO : Epoch 1954 | loss: 0.0311372 | val_loss: 0.0311541 | Time: 1721.75 ms [2022-04-30 14:19:03 main:574] : INFO : Epoch 1955 | loss: 0.0311396 | val_loss: 0.0311573 | Time: 1703.51 ms [2022-04-30 14:19:05 main:574] : INFO : Epoch 1956 | loss: 0.03115 | val_loss: 0.0311594 | Time: 1740.24 ms [2022-04-30 14:19:06 main:574] : INFO : Epoch 1957 | loss: 0.0311501 | val_loss: 0.0311596 | Time: 1710.87 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 970) [2022-04-30 14:48:48 main:435] : INFO : Set logging level to 1 [2022-04-30 14:48:48 main:441] : INFO : Running in BOINC Client mode [2022-04-30 14:48:48 main:444] : INFO : Resolving all filenames [2022-04-30 14:48:48 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-30 14:48:48 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-30 14:48:48 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-30 14:48:48 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-30 14:48:48 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-30 14:48:48 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-30 14:48:48 main:474] : INFO : Configuration: [2022-04-30 14:48:48 main:475] : INFO : Model type: GRU [2022-04-30 14:48:48 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-30 14:48:48 main:477] : INFO : Max Epochs: 2048 [2022-04-30 14:48:48 main:478] : INFO : Batch Size: 128 [2022-04-30 14:48:48 main:479] : INFO : Learning Rate: 0.01 [2022-04-30 14:48:48 main:480] : INFO : Patience: 10 [2022-04-30 14:48:48 main:481] : INFO : Hidden Width: 12 [2022-04-30 14:48:48 main:482] : INFO : # Recurrent Layers: 4 [2022-04-30 14:48:48 main:483] : INFO : # Backend Layers: 4 [2022-04-30 14:48:48 main:484] : INFO : # Threads: 1 [2022-04-30 14:48:48 main:486] : INFO : Preparing Dataset [2022-04-30 14:48:48 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-30 14:48:49 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-30 14:48:52 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-30 14:48:52 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-30 14:48:52 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-30 14:48:52 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-30 14:48:52 main:494] : INFO : Creating Model [2022-04-30 14:48:52 main:507] : INFO : Preparing config file [2022-04-30 14:48:52 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-30 14:48:52 main:512] : INFO : Loading config [2022-04-30 14:48:52 main:514] : INFO : Loading state [2022-04-30 14:48:53 main:559] : INFO : Loading DataLoader into Memory [2022-04-30 14:48:53 main:562] : INFO : Starting Training [2022-04-30 14:48:55 main:574] : INFO : Epoch 1953 | loss: 0.031221 | val_loss: 0.0311729 | Time: 2347.65 ms [2022-04-30 14:48:57 main:574] : INFO : Epoch 1954 | loss: 0.0311349 | val_loss: 0.031154 | Time: 1688.14 ms [2022-04-30 14:49:18 main:574] : INFO : Epoch 1955 | loss: 0.0311247 | val_loss: 0.0311539 | Time: 21633.8 ms [2022-04-30 14:49:20 main:574] : INFO : Epoch 1956 | loss: 0.0311194 | val_loss: 0.0311451 | Time: 1689.28 ms [2022-04-30 14:49:22 main:574] : INFO : Epoch 1957 | loss: 0.0311181 | val_loss: 0.0311443 | Time: 1700.72 ms [2022-04-30 14:49:24 main:574] : INFO : Epoch 1958 | loss: 0.0311197 | val_loss: 0.0311452 | Time: 1756.59 ms [2022-04-30 14:49:25 main:574] : INFO : Epoch 1959 | loss: 0.0311195 | val_loss: 0.0311403 | Time: 1692.33 ms [2022-04-30 14:49:27 main:574] : INFO : Epoch 1960 | loss: 0.0311219 | val_loss: 0.0311428 | Time: 1694.31 ms [2022-04-30 14:56:19 main:574] : INFO : Epoch 1961 | loss: 0.0311191 | val_loss: 0.0311473 | Time: 412041 ms [2022-04-30 14:56:21 main:574] : INFO : Epoch 1962 | loss: 0.0311166 | val_loss: 0.0311449 | Time: 1725.98 ms [2022-04-30 14:56:23 main:574] : INFO : Epoch 1963 | loss: 0.0311151 | val_loss: 0.0311456 | Time: 1692.79 ms [2022-04-30 14:56:24 main:574] : INFO : Epoch 1964 | loss: 0.0311139 | val_loss: 0.0311446 | Time: 1714.63 ms [2022-04-30 14:56:26 main:574] : INFO : Epoch 1965 | loss: 0.0311111 | val_loss: 0.031142 | Time: 1702.37 ms [2022-04-30 14:56:28 main:574] : INFO : Epoch 1966 | loss: 0.0311129 | val_loss: 0.0311405 | Time: 1690.93 ms [2022-04-30 15:00:40 main:574] : INFO : Epoch 1967 | loss: 0.0311132 | val_loss: 0.0311435 | Time: 251810 ms [2022-04-30 15:00:41 main:574] : INFO : Epoch 1968 | loss: 0.0311112 | val_loss: 0.0311447 | Time: 1694.25 ms [2022-04-30 15:00:43 main:574] : INFO : Epoch 1969 | loss: 0.0311133 | val_loss: 0.0311488 | Time: 1702.3 ms [2022-04-30 15:00:45 main:574] : INFO : Epoch 1970 | loss: 0.0311144 | val_loss: 0.031147 | Time: 1723.46 ms [2022-04-30 15:00:47 main:574] : INFO : Epoch 1971 | loss: 0.0311118 | val_loss: 0.0311482 | Time: 1739.04 ms [2022-04-30 15:00:48 main:574] : INFO : Epoch 1972 | loss: 0.0311106 | val_loss: 0.0311403 | Time: 1755.83 ms [2022-04-30 15:05:50 main:574] : INFO : Epoch 1973 | loss: 0.0311102 | val_loss: 0.0311433 | Time: 301902 ms [2022-04-30 15:05:52 main:574] : INFO : Epoch 1974 | loss: 0.0311092 | val_loss: 0.0311411 | Time: 1735.46 ms [2022-04-30 15:05:54 main:574] : INFO : Epoch 1975 | loss: 0.0311118 | val_loss: 0.0311467 | Time: 1706.47 ms [2022-04-30 15:05:56 main:574] : INFO : Epoch 1976 | loss: 0.0311089 | val_loss: 0.0311517 | Time: 1729.14 ms [2022-04-30 15:05:57 main:574] : INFO : Epoch 1977 | loss: 0.0311083 | val_loss: 0.0311448 | Time: 1707.73 ms [2022-04-30 15:21:20 main:574] : INFO : Epoch 1978 | loss: 0.0311113 | val_loss: 0.0311529 | Time: 922363 ms [2022-04-30 15:21:21 main:574] : INFO : Epoch 1979 | loss: 0.0311107 | val_loss: 0.0311458 | Time: 1708.87 ms [2022-04-30 15:21:23 main:574] : INFO : Epoch 1980 | loss: 0.0311089 | val_loss: 0.031141 | Time: 1709.29 ms [2022-04-30 15:21:25 main:574] : INFO : Epoch 1981 | loss: 0.0311083 | val_loss: 0.0311478 | Time: 1703.64 ms [2022-04-30 15:21:27 main:574] : INFO : Epoch 1982 | loss: 0.0311051 | val_loss: 0.0311471 | Time: 1694.29 ms [2022-04-30 15:21:28 main:574] : INFO : Epoch 1983 | loss: 0.0311049 | val_loss: 0.0311468 | Time: 1743.59 ms [2022-04-30 15:36:01 main:574] : INFO : Epoch 1984 | loss: 0.0311043 | val_loss: 0.0311451 | Time: 872246 ms [2022-04-30 15:36:02 main:574] : INFO : Epoch 1985 | loss: 0.0311097 | val_loss: 0.0311514 | Time: 1736.47 ms [2022-04-30 15:36:04 main:574] : INFO : Epoch 1986 | loss: 0.0311096 | val_loss: 0.0311455 | Time: 1695.14 ms [2022-04-30 15:36:06 main:574] : INFO : Epoch 1987 | loss: 0.0311097 | val_loss: 0.0311481 | Time: 1703.51 ms [2022-04-30 15:36:08 main:574] : INFO : Epoch 1988 | loss: 0.0311062 | val_loss: 0.031145 | Time: 1739.27 ms [2022-04-30 15:36:09 main:574] : INFO : Epoch 1989 | loss: 0.0311071 | val_loss: 0.0311459 | Time: 1713.35 ms [2022-04-30 15:41:31 main:574] : INFO : Epoch 1990 | loss: 0.0311053 | val_loss: 0.0311469 | Time: 321944 ms [2022-04-30 15:41:33 main:574] : INFO : Epoch 1991 | loss: 0.0311066 | val_loss: 0.0311498 | Time: 1696.98 ms [2022-04-30 15:41:35 main:574] : INFO : Epoch 1992 | loss: 0.0311087 | val_loss: 0.0311533 | Time: 1698.47 ms [2022-04-30 15:41:37 main:574] : INFO : Epoch 1993 | loss: 0.0311076 | val_loss: 0.0311494 | Time: 1705.44 ms [2022-04-30 15:41:38 main:574] : INFO : Epoch 1994 | loss: 0.0311072 | val_loss: 0.0311508 | Time: 1691.25 ms [2022-04-30 15:41:40 main:574] : INFO : Epoch 1995 | loss: 0.0311079 | val_loss: 0.031153 | Time: 1702.6 ms [2022-04-30 15:52:22 main:574] : INFO : Epoch 1996 | loss: 0.0311153 | val_loss: 0.031147 | Time: 642211 ms [2022-04-30 15:52:24 main:574] : INFO : Epoch 1997 | loss: 0.0311234 | val_loss: 0.031145 | Time: 1683.93 ms [2022-04-30 15:52:26 main:574] : INFO : Epoch 1998 | loss: 0.0311153 | val_loss: 0.0311396 | Time: 1684.98 ms [2022-04-30 15:52:27 main:574] : INFO : Epoch 1999 | loss: 0.0311115 | val_loss: 0.0311413 | Time: 1687.28 ms [2022-04-30 15:52:29 main:574] : INFO : Epoch 2000 | loss: 0.0311101 | val_loss: 0.0311381 | Time: 1674.21 ms [2022-04-30 16:16:42 main:574] : INFO : Epoch 2001 | loss: 0.0311102 | val_loss: 0.0311436 | Time: 1.45281e+06 ms [2022-04-30 16:16:44 main:574] : INFO : Epoch 2002 | loss: 0.0311071 | val_loss: 0.0311438 | Time: 1740.32 ms [2022-04-30 16:16:46 main:574] : INFO : Epoch 2003 | loss: 0.0311062 | val_loss: 0.0311428 | Time: 1714.4 ms [2022-04-30 16:16:47 main:574] : INFO : Epoch 2004 | loss: 0.0311053 | val_loss: 0.0311471 | Time: 1708.74 ms [2022-04-30 16:16:49 main:574] : INFO : Epoch 2005 | loss: 0.0311047 | val_loss: 0.0311447 | Time: 1739.98 ms [2022-04-30 16:16:51 main:574] : INFO : Epoch 2006 | loss: 0.0311043 | val_loss: 0.0311417 | Time: 1692.47 ms [2022-04-30 16:25:43 main:574] : INFO : Epoch 2007 | loss: 0.0311033 | val_loss: 0.0311484 | Time: 532146 ms [2022-04-30 16:25:45 main:574] : INFO : Epoch 2008 | loss: 0.0311043 | val_loss: 0.0311523 | Time: 1668.6 ms [2022-04-30 16:25:46 main:574] : INFO : Epoch 2009 | loss: 0.0311017 | val_loss: 0.0311421 | Time: 1714.23 ms [2022-04-30 16:25:48 main:574] : INFO : Epoch 2010 | loss: 0.0311019 | val_loss: 0.0311432 | Time: 1671.67 ms [2022-04-30 16:25:50 main:574] : INFO : Epoch 2011 | loss: 0.0311037 | val_loss: 0.0311492 | Time: 1694.35 ms [2022-04-30 16:25:52 main:574] : INFO : Epoch 2012 | loss: 0.0311221 | val_loss: 0.0311539 | Time: 1723.27 ms [2022-04-30 16:26:03 main:574] : INFO : Epoch 2013 | loss: 0.0311305 | val_loss: 0.0311497 | Time: 11743.7 ms [2022-04-30 16:26:05 main:574] : INFO : Epoch 2014 | loss: 0.0311274 | val_loss: 0.0311491 | Time: 1674.97 ms [2022-04-30 16:26:07 main:574] : INFO : Epoch 2015 | loss: 0.031134 | val_loss: 0.0311564 | Time: 1699.55 ms [2022-04-30 16:26:08 main:574] : INFO : Epoch 2016 | loss: 0.0311384 | val_loss: 0.0311507 | Time: 1684.69 ms [2022-04-30 16:26:10 main:574] : INFO : Epoch 2017 | loss: 0.031134 | val_loss: 0.0311483 | Time: 1696.79 ms [2022-04-30 16:26:12 main:574] : INFO : Epoch 2018 | loss: 0.0311282 | val_loss: 0.0311532 | Time: 1688.9 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 970) [2022-04-30 16:34:43 main:435] : INFO : Set logging level to 1 [2022-04-30 16:34:43 main:441] : INFO : Running in BOINC Client mode [2022-04-30 16:34:43 main:444] : INFO : Resolving all filenames [2022-04-30 16:34:43 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-30 16:34:43 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-30 16:34:43 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-30 16:34:43 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-30 16:34:43 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-30 16:34:43 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-30 16:34:43 main:474] : INFO : Configuration: [2022-04-30 16:34:43 main:475] : INFO : Model type: GRU [2022-04-30 16:34:43 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-30 16:34:43 main:477] : INFO : Max Epochs: 2048 [2022-04-30 16:34:43 main:478] : INFO : Batch Size: 128 [2022-04-30 16:34:43 main:479] : INFO : Learning Rate: 0.01 [2022-04-30 16:34:43 main:480] : INFO : Patience: 10 [2022-04-30 16:34:43 main:481] : INFO : Hidden Width: 12 [2022-04-30 16:34:43 main:482] : INFO : # Recurrent Layers: 4 [2022-04-30 16:34:43 main:483] : INFO : # Backend Layers: 4 [2022-04-30 16:34:43 main:484] : INFO : # Threads: 1 [2022-04-30 16:34:43 main:486] : INFO : Preparing Dataset [2022-04-30 16:34:43 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-30 16:34:43 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-30 16:34:48 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-30 16:34:48 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-30 16:34:48 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-30 16:34:48 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-30 16:34:48 main:494] : INFO : Creating Model [2022-04-30 16:34:48 main:507] : INFO : Preparing config file [2022-04-30 16:34:48 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-30 16:34:48 main:512] : INFO : Loading config [2022-04-30 16:34:48 main:514] : INFO : Loading state [2022-04-30 16:34:50 main:559] : INFO : Loading DataLoader into Memory [2022-04-30 16:34:50 main:562] : INFO : Starting Training [2022-04-30 16:34:52 main:574] : INFO : Epoch 2008 | loss: 0.0311536 | val_loss: 0.031143 | Time: 2434.76 ms [2022-04-30 16:37:04 main:574] : INFO : Epoch 2009 | loss: 0.0311131 | val_loss: 0.0311558 | Time: 131813 ms [2022-04-30 16:37:06 main:574] : INFO : Epoch 2010 | loss: 0.0311107 | val_loss: 0.0311422 | Time: 1728.98 ms [2022-04-30 16:37:08 main:574] : INFO : Epoch 2011 | loss: 0.031107 | val_loss: 0.0311403 | Time: 1758.01 ms [2022-04-30 16:37:10 main:574] : INFO : Epoch 2012 | loss: 0.0311038 | val_loss: 0.0311395 | Time: 1708.58 ms [2022-04-30 16:37:11 main:574] : INFO : Epoch 2013 | loss: 0.031104 | val_loss: 0.0311438 | Time: 1688.81 ms [2022-04-30 16:39:33 main:574] : INFO : Epoch 2014 | loss: 0.0311069 | val_loss: 0.0311412 | Time: 142084 ms [2022-04-30 16:39:35 main:574] : INFO : Epoch 2015 | loss: 0.0311049 | val_loss: 0.0311447 | Time: 1698.02 ms [2022-04-30 16:39:37 main:574] : INFO : Epoch 2016 | loss: 0.0311044 | val_loss: 0.0311462 | Time: 1712.53 ms [2022-04-30 16:39:39 main:574] : INFO : Epoch 2017 | loss: 0.0311032 | val_loss: 0.0311464 | Time: 1713.15 ms [2022-04-30 16:39:40 main:574] : INFO : Epoch 2018 | loss: 0.031105 | val_loss: 0.0311455 | Time: 1703.52 ms [2022-04-30 16:39:42 main:574] : INFO : Epoch 2019 | loss: 0.0311159 | val_loss: 0.0311396 | Time: 1713.38 ms [2022-04-30 16:45:14 main:574] : INFO : Epoch 2020 | loss: 0.0311106 | val_loss: 0.0311398 | Time: 332053 ms [2022-04-30 16:45:16 main:574] : INFO : Epoch 2021 | loss: 0.0311082 | val_loss: 0.0311395 | Time: 1702.97 ms [2022-04-30 16:45:18 main:574] : INFO : Epoch 2022 | loss: 0.0311055 | val_loss: 0.0311441 | Time: 1692.75 ms [2022-04-30 16:45:19 main:574] : INFO : Epoch 2023 | loss: 0.0311058 | val_loss: 0.0311446 | Time: 1709.02 ms [2022-04-30 16:45:21 main:574] : INFO : Epoch 2024 | loss: 0.0311061 | val_loss: 0.0311421 | Time: 1710.92 ms [2022-04-30 16:45:23 main:574] : INFO : Epoch 2025 | loss: 0.0311087 | val_loss: 0.031143 | Time: 1721.5 ms [2022-04-30 17:13:46 main:574] : INFO : Epoch 2026 | loss: 0.0311056 | val_loss: 0.0311408 | Time: 1.70289e+06 ms [2022-04-30 17:13:48 main:574] : INFO : Epoch 2027 | loss: 0.0311058 | val_loss: 0.0311513 | Time: 1711.8 ms [2022-04-30 17:13:49 main:574] : INFO : Epoch 2028 | loss: 0.0311066 | val_loss: 0.0311395 | Time: 1709.9 ms [2022-04-30 17:13:51 main:574] : INFO : Epoch 2029 | loss: 0.0311017 | val_loss: 0.031139 | Time: 1742.25 ms [2022-04-30 17:13:53 main:574] : INFO : Epoch 2030 | loss: 0.0311048 | val_loss: 0.0311368 | Time: 1718.49 ms [2022-04-30 17:51:16 main:574] : INFO : Epoch 2031 | loss: 0.0311093 | val_loss: 0.0311459 | Time: 2.24332e+06 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 970) [2022-04-30 18:25:27 main:435] : INFO : Set logging level to 1 [2022-04-30 18:25:27 main:441] : INFO : Running in BOINC Client mode [2022-04-30 18:25:27 main:444] : INFO : Resolving all filenames [2022-04-30 18:25:27 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-30 18:25:27 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-30 18:25:27 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-30 18:25:27 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-30 18:25:27 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-30 18:25:27 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-30 18:25:27 main:474] : INFO : Configuration: [2022-04-30 18:25:27 main:475] : INFO : Model type: GRU [2022-04-30 18:25:27 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-30 18:25:27 main:477] : INFO : Max Epochs: 2048 [2022-04-30 18:25:27 main:478] : INFO : Batch Size: 128 [2022-04-30 18:25:28 main:479] : INFO : Learning Rate: 0.01 [2022-04-30 18:25:28 main:480] : INFO : Patience: 10 [2022-04-30 18:25:28 main:481] : INFO : Hidden Width: 12 [2022-04-30 18:25:28 main:482] : INFO : # Recurrent Layers: 4 [2022-04-30 18:25:28 main:483] : INFO : # Backend Layers: 4 [2022-04-30 18:25:28 main:484] : INFO : # Threads: 1 [2022-04-30 18:25:28 main:486] : INFO : Preparing Dataset [2022-04-30 18:25:28 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-30 18:25:28 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-30 18:25:33 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-30 18:25:33 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-30 18:25:33 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-30 18:25:33 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-30 18:25:33 main:494] : INFO : Creating Model [2022-04-30 18:25:33 main:507] : INFO : Preparing config file [2022-04-30 18:25:33 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-30 18:25:33 main:512] : INFO : Loading config [2022-04-30 18:25:33 main:514] : INFO : Loading state [2022-04-30 18:25:35 main:559] : INFO : Loading DataLoader into Memory [2022-04-30 18:25:35 main:562] : INFO : Starting Training [2022-04-30 18:27:28 main:574] : INFO : Epoch 2032 | loss: 0.0311618 | val_loss: 0.0311487 | Time: 112867 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 970) [2022-04-30 18:56:49 main:435] : INFO : Set logging level to 1 [2022-04-30 18:56:49 main:441] : INFO : Running in BOINC Client mode [2022-04-30 18:56:49 main:444] : INFO : Resolving all filenames [2022-04-30 18:56:49 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-30 18:56:49 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-30 18:56:49 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-30 18:56:49 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-30 18:56:49 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-30 18:56:49 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-30 18:56:49 main:474] : INFO : Configuration: [2022-04-30 18:56:49 main:475] : INFO : Model type: GRU [2022-04-30 18:56:49 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-30 18:56:49 main:477] : INFO : Max Epochs: 2048 [2022-04-30 18:56:49 main:478] : INFO : Batch Size: 128 [2022-04-30 18:56:49 main:479] : INFO : Learning Rate: 0.01 [2022-04-30 18:56:49 main:480] : INFO : Patience: 10 [2022-04-30 18:56:49 main:481] : INFO : Hidden Width: 12 [2022-04-30 18:56:49 main:482] : INFO : # Recurrent Layers: 4 [2022-04-30 18:56:49 main:483] : INFO : # Backend Layers: 4 [2022-04-30 18:56:49 main:484] : INFO : # Threads: 1 [2022-04-30 18:56:49 main:486] : INFO : Preparing Dataset [2022-04-30 18:56:49 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-30 18:56:49 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-30 18:56:53 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-30 18:56:53 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-30 18:56:53 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-30 18:56:53 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-30 18:56:53 main:494] : INFO : Creating Model [2022-04-30 18:56:54 main:507] : INFO : Preparing config file [2022-04-30 18:56:54 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-30 18:56:54 main:512] : INFO : Loading config [2022-04-30 18:56:54 main:514] : INFO : Loading state [2022-04-30 18:56:55 main:559] : INFO : Loading DataLoader into Memory [2022-04-30 18:56:55 main:562] : INFO : Starting Training [2022-04-30 18:56:57 main:574] : INFO : Epoch 2033 | loss: 0.0311931 | val_loss: 0.031167 | Time: 2326.29 ms [2022-04-30 19:22:50 main:574] : INFO : Epoch 2034 | loss: 0.0311183 | val_loss: 0.031142 | Time: 1.55289e+06 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 970) [2022-05-01 09:03:36 main:435] : INFO : Set logging level to 1 [2022-05-01 09:03:36 main:441] : INFO : Running in BOINC Client mode [2022-05-01 09:03:36 main:444] : INFO : Resolving all filenames [2022-05-01 09:03:36 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-05-01 09:03:36 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-05-01 09:03:36 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-05-01 09:03:36 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-05-01 09:03:36 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-05-01 09:03:36 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-05-01 09:03:36 main:474] : INFO : Configuration: [2022-05-01 09:03:36 main:475] : INFO : Model type: GRU [2022-05-01 09:03:36 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-05-01 09:03:36 main:477] : INFO : Max Epochs: 2048 [2022-05-01 09:03:36 main:478] : INFO : Batch Size: 128 [2022-05-01 09:03:36 main:479] : INFO : Learning Rate: 0.01 [2022-05-01 09:03:36 main:480] : INFO : Patience: 10 [2022-05-01 09:03:36 main:481] : INFO : Hidden Width: 12 [2022-05-01 09:03:36 main:482] : INFO : # Recurrent Layers: 4 [2022-05-01 09:03:36 main:483] : INFO : # Backend Layers: 4 [2022-05-01 09:03:36 main:484] : INFO : # Threads: 1 [2022-05-01 09:03:36 main:486] : INFO : Preparing Dataset [2022-05-01 09:03:36 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-05-01 09:03:36 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-05-01 09:03:39 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-05-01 09:03:39 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-05-01 09:03:39 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-05-01 09:03:40 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-05-01 09:03:40 main:494] : INFO : Creating Model [2022-05-01 09:03:40 main:507] : INFO : Preparing config file [2022-05-01 09:03:40 main:511] : INFO : Found checkpoint, attempting to load... [2022-05-01 09:03:40 main:512] : INFO : Loading config [2022-05-01 09:03:40 main:514] : INFO : Loading state [2022-05-01 09:03:41 main:559] : INFO : Loading DataLoader into Memory [2022-05-01 09:03:41 main:562] : INFO : Starting Training [2022-05-01 09:03:43 main:574] : INFO : Epoch 2035 | loss: 0.0311636 | val_loss: 0.0311459 | Time: 2531.65 ms [2022-05-01 09:03:45 main:574] : INFO : Epoch 2036 | loss: 0.0311096 | val_loss: 0.0311406 | Time: 1724.27 ms [2022-05-01 09:04:07 main:574] : INFO : Epoch 2037 | loss: 0.0311063 | val_loss: 0.031143 | Time: 21694.1 ms [2022-05-01 09:04:09 main:574] : INFO : Epoch 2038 | loss: 0.0311036 | val_loss: 0.0311391 | Time: 1770.89 ms [2022-05-01 09:04:11 main:574] : INFO : Epoch 2039 | loss: 0.0311032 | val_loss: 0.0311391 | Time: 1839.01 ms [2022-05-01 09:04:13 main:574] : INFO : Epoch 2040 | loss: 0.0311029 | val_loss: 0.0311438 | Time: 1845.81 ms [2022-05-01 09:04:14 main:574] : INFO : Epoch 2041 | loss: 0.0311103 | val_loss: 0.0311407 | Time: 1825.69 ms [2022-05-01 09:05:26 main:574] : INFO : Epoch 2042 | loss: 0.0311074 | val_loss: 0.0311408 | Time: 71876.4 ms [2022-05-01 09:05:28 main:574] : INFO : Epoch 2043 | loss: 0.0311062 | val_loss: 0.0311369 | Time: 1698.15 ms [2022-05-01 09:05:30 main:574] : INFO : Epoch 2044 | loss: 0.0311079 | val_loss: 0.0311419 | Time: 1713.68 ms [2022-05-01 09:05:31 main:574] : INFO : Epoch 2045 | loss: 0.0311157 | val_loss: 0.0311423 | Time: 1684.2 ms [2022-05-01 09:05:33 main:574] : INFO : Epoch 2046 | loss: 0.0311116 | val_loss: 0.0311441 | Time: 1705.5 ms [2022-05-01 09:05:35 main:574] : INFO : Epoch 2047 | loss: 0.031112 | val_loss: 0.0311402 | Time: 1765.55 ms [2022-05-01 09:06:07 main:574] : INFO : Epoch 2048 | loss: 0.0311091 | val_loss: 0.0311518 | Time: 31866 ms [2022-05-01 09:06:07 main:597] : INFO : Saving trained model to model-final.pt, val_loss 0.0311518 [2022-05-01 09:06:07 main:603] : INFO : Saving end state to config to file [2022-05-01 09:06:07 main:608] : INFO : Success, exiting.. 09:06:07 (416): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)