Task 14595510
| Name | ParityModified-1647042035-10245-3-0_0 |
| Workunit | 11617566 |
| Created | 10 Apr 2022, 12:32:43 UTC |
| Sent | 11 Apr 2022, 5:03:29 UTC |
| Report deadline | 19 Apr 2022, 5:03:29 UTC |
| Received | 18 Apr 2022, 5:03:40 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 13970 |
| Run time | 1 days 2 hours 11 min 46 sec |
| CPU time | 15 hours 20 min 34 sec |
| Validate state | Valid |
| Credit | 4,160.00 |
| Device peak FLOPS | 1,168.29 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.63 GB |
| Peak swap size | 3.58 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version> <![CDATA[ <stderr_txt> oss: 0.0311301 | val_loss: 0.0311441 | Time: 44069.3 ms [2022-04-17 19:07:52 main:574] : INFO : Epoch 1667 | loss: 0.0311295 | val_loss: 0.0311418 | Time: 44115.5 ms [2022-04-17 19:08:37 main:574] : INFO : Epoch 1668 | loss: 0.0311284 | val_loss: 0.0311437 | Time: 44114.7 ms [2022-04-17 19:09:21 main:574] : INFO : Epoch 1669 | loss: 0.0311285 | val_loss: 0.0311427 | Time: 44089.4 ms [2022-04-17 19:10:05 main:574] : INFO : Epoch 1670 | loss: 0.0311313 | val_loss: 0.031144 | Time: 44137.1 ms [2022-04-17 19:10:49 main:574] : INFO : Epoch 1671 | loss: 0.0311321 | val_loss: 0.0311427 | Time: 44041.8 ms [2022-04-17 19:11:33 main:574] : INFO : Epoch 1672 | loss: 0.0311311 | val_loss: 0.0311442 | Time: 44079.9 ms [2022-04-17 19:12:18 main:574] : INFO : Epoch 1673 | loss: 0.0311305 | val_loss: 0.0311435 | Time: 44157.3 ms [2022-04-17 19:13:02 main:574] : INFO : Epoch 1674 | loss: 0.0311297 | val_loss: 0.031143 | Time: 44201 ms [2022-04-17 19:13:46 main:574] : INFO : Epoch 1675 | loss: 0.0311306 | val_loss: 0.0311499 | Time: 44067 ms [2022-04-17 19:14:31 main:574] : INFO : Epoch 1676 | loss: 0.0311326 | val_loss: 0.0311423 | Time: 44089.6 ms [2022-04-17 19:15:15 main:574] : INFO : Epoch 1677 | loss: 0.0311326 | val_loss: 0.0311601 | Time: 44205.9 ms [2022-04-17 19:15:59 main:574] : INFO : Epoch 1678 | loss: 0.0311487 | val_loss: 0.031177 | Time: 44087.7 ms [2022-04-17 19:16:43 main:574] : INFO : Epoch 1679 | loss: 0.031149 | val_loss: 0.0311509 | Time: 44082 ms [2022-04-17 19:17:27 main:574] : INFO : Epoch 1680 | loss: 0.0311428 | val_loss: 0.0311498 | Time: 44013 ms [2022-04-17 19:18:12 main:574] : INFO : Epoch 1681 | loss: 0.0311405 | val_loss: 0.0311506 | Time: 44355.1 ms [2022-04-17 19:18:56 main:574] : INFO : Epoch 1682 | loss: 0.0311383 | val_loss: 0.031147 | Time: 44231.3 ms [2022-04-17 19:19:40 main:574] : INFO : Epoch 1683 | loss: 0.0311372 | val_loss: 0.0311465 | Time: 44099.6 ms [2022-04-17 19:20:24 main:574] : INFO : Epoch 1684 | loss: 0.0311353 | val_loss: 0.0311455 | Time: 44133.7 ms [2022-04-17 19:21:09 main:574] : INFO : Epoch 1685 | loss: 0.0311358 | val_loss: 0.0311449 | Time: 44203.4 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GT 1030) [2022-04-17 19:34:37 main:435] : INFO : Set logging level to 1 [2022-04-17 19:34:37 main:441] : INFO : Running in BOINC Client mode [2022-04-17 19:34:37 main:444] : INFO : Resolving all filenames [2022-04-17 19:34:38 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-17 19:34:38 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-17 19:34:38 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-17 19:34:38 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-17 19:34:38 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-17 19:34:38 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-17 19:34:38 main:474] : INFO : Configuration: [2022-04-17 19:34:38 main:475] : INFO : Model type: GRU [2022-04-17 19:34:38 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-17 19:34:38 main:477] : INFO : Max Epochs: 2048 [2022-04-17 19:34:38 main:478] : INFO : Batch Size: 128 [2022-04-17 19:34:38 main:479] : INFO : Learning Rate: 0.01 [2022-04-17 19:34:38 main:480] : INFO : Patience: 10 [2022-04-17 19:34:38 main:481] : INFO : Hidden Width: 12 [2022-04-17 19:34:38 main:482] : INFO : # Recurrent Layers: 4 [2022-04-17 19:34:38 main:483] : INFO : # Backend Layers: 4 [2022-04-17 19:34:38 main:484] : INFO : # Threads: 1 [2022-04-17 19:34:39 main:486] : INFO : Preparing Dataset [2022-04-17 19:34:39 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-17 19:34:41 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-17 19:34:53 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-17 19:34:53 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-17 19:34:53 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-17 19:34:54 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-17 19:34:54 main:494] : INFO : Creating Model [2022-04-17 19:34:54 main:507] : INFO : Preparing config file [2022-04-17 19:34:54 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-17 19:34:54 main:512] : INFO : Loading config [2022-04-17 19:34:54 main:514] : INFO : Loading state [2022-04-17 19:34:58 main:559] : INFO : Loading DataLoader into Memory [2022-04-17 19:34:58 main:562] : INFO : Starting Training [2022-04-17 19:35:44 main:574] : INFO : Epoch 1686 | loss: 0.0311657 | val_loss: 0.0311555 | Time: 45353.3 ms [2022-04-17 19:36:28 main:574] : INFO : Epoch 1687 | loss: 0.031138 | val_loss: 0.0311426 | Time: 44087 ms [2022-04-17 19:37:13 main:574] : INFO : Epoch 1688 | loss: 0.0311335 | val_loss: 0.0311451 | Time: 44784.3 ms [2022-04-17 19:37:57 main:574] : INFO : Epoch 1689 | loss: 0.0311317 | val_loss: 0.0311428 | Time: 44060 ms [2022-04-17 19:38:41 main:574] : INFO : Epoch 1690 | loss: 0.0311309 | val_loss: 0.0311455 | Time: 44054.9 ms [2022-04-17 19:39:25 main:574] : INFO : Epoch 1691 | loss: 0.0311299 | val_loss: 0.0311441 | Time: 44155.3 ms [2022-04-17 19:40:10 main:574] : INFO : Epoch 1692 | loss: 0.0311297 | val_loss: 0.0311435 | Time: 44082.3 ms [2022-04-17 19:40:54 main:574] : INFO : Epoch 1693 | loss: 0.0311297 | val_loss: 0.0311432 | Time: 44162.6 ms [2022-04-17 19:41:38 main:574] : INFO : Epoch 1694 | loss: 0.031129 | val_loss: 0.0311467 | Time: 44152.7 ms [2022-04-17 19:42:22 main:574] : INFO : Epoch 1695 | loss: 0.0311277 | val_loss: 0.0311455 | Time: 44123.2 ms [2022-04-17 19:43:07 main:574] : INFO : Epoch 1696 | loss: 0.0311304 | val_loss: 0.0311474 | Time: 44000.6 ms [2022-04-17 19:43:51 main:574] : INFO : Epoch 1697 | loss: 0.0311356 | val_loss: 0.0311459 | Time: 44068.9 ms [2022-04-17 19:44:35 main:574] : INFO : Epoch 1698 | loss: 0.0311343 | val_loss: 0.0311447 | Time: 44079.7 ms [2022-04-17 19:45:19 main:574] : INFO : Epoch 1699 | loss: 0.0311314 | val_loss: 0.0311444 | Time: 44055 ms [2022-04-17 19:46:03 main:574] : INFO : Epoch 1700 | loss: 0.0311288 | val_loss: 0.0311406 | Time: 44035.1 ms [2022-04-17 19:46:47 main:574] : INFO : Epoch 1701 | loss: 0.0311279 | val_loss: 0.0311443 | Time: 44143.5 ms [2022-04-17 19:47:32 main:574] : INFO : Epoch 1702 | loss: 0.0311283 | val_loss: 0.031143 | Time: 43998.9 ms [2022-04-17 19:48:16 main:574] : INFO : Epoch 1703 | loss: 0.031128 | val_loss: 0.031141 | Time: 44095.8 ms [2022-04-17 19:49:00 main:574] : INFO : Epoch 1704 | loss: 0.0311263 | val_loss: 0.0311412 | Time: 44142.3 ms [2022-04-17 19:49:44 main:574] : INFO : Epoch 1705 | loss: 0.0311242 | val_loss: 0.0311387 | Time: 44104.3 ms [2022-04-17 19:50:28 main:574] : INFO : Epoch 1706 | loss: 0.0311242 | val_loss: 0.0311415 | Time: 44115.6 ms [2022-04-17 19:51:12 main:574] : INFO : Epoch 1707 | loss: 0.0311244 | val_loss: 0.031141 | Time: 44028.4 ms [2022-04-17 19:51:57 main:574] : INFO : Epoch 1708 | loss: 0.0311242 | val_loss: 0.031145 | Time: 44086.8 ms [2022-04-17 19:52:41 main:574] : INFO : Epoch 1709 | loss: 0.0311263 | val_loss: 0.031143 | Time: 44224 ms [2022-04-17 19:53:25 main:574] : INFO : Epoch 1710 | loss: 0.0311252 | val_loss: 0.0311437 | Time: 44060.9 ms [2022-04-17 19:54:09 main:574] : INFO : Epoch 1711 | loss: 0.0311251 | val_loss: 0.0311445 | Time: 44088.5 ms [2022-04-17 19:54:53 main:574] : INFO : Epoch 1712 | loss: 0.031124 | val_loss: 0.0311438 | Time: 44193.7 ms [2022-04-17 19:55:38 main:574] : INFO : Epoch 1713 | loss: 0.031124 | val_loss: 0.0311408 | Time: 44141.6 ms [2022-04-17 19:56:22 main:574] : INFO : Epoch 1714 | loss: 0.0311228 | val_loss: 0.0311422 | Time: 44068.2 ms [2022-04-17 19:57:06 main:574] : INFO : Epoch 1715 | loss: 0.0311229 | val_loss: 0.0311465 | Time: 43978.5 ms [2022-04-17 19:57:50 main:574] : INFO : Epoch 1716 | loss: 0.0311246 | val_loss: 0.0311429 | Time: 44061.5 ms [2022-04-17 19:58:34 main:574] : INFO : Epoch 1717 | loss: 0.0311228 | val_loss: 0.0311401 | Time: 44217.3 ms [2022-04-17 19:59:19 main:574] : INFO : Epoch 1718 | loss: 0.0311219 | val_loss: 0.031142 | Time: 44114.8 ms [2022-04-17 20:00:03 main:574] : INFO : Epoch 1719 | loss: 0.0311221 | val_loss: 0.0311483 | Time: 44161.9 ms [2022-04-17 20:00:47 main:574] : INFO : Epoch 1720 | loss: 0.0311236 | val_loss: 0.0311432 | Time: 43972 ms [2022-04-17 20:01:31 main:574] : INFO : Epoch 1721 | loss: 0.0311235 | val_loss: 0.0311416 | Time: 44042.3 ms [2022-04-17 20:02:15 main:574] : INFO : Epoch 1722 | loss: 0.0311223 | val_loss: 0.0311415 | Time: 44164.1 ms [2022-04-17 20:03:00 main:574] : INFO : Epoch 1723 | loss: 0.0311215 | val_loss: 0.031145 | Time: 44111.3 ms [2022-04-17 20:03:44 main:574] : INFO : Epoch 1724 | loss: 0.031121 | val_loss: 0.0311445 | Time: 44147.6 ms [2022-04-17 20:04:28 main:574] : INFO : Epoch 1725 | loss: 0.0311208 | val_loss: 0.0311483 | Time: 44141.5 ms [2022-04-17 20:05:12 main:574] : INFO : Epoch 1726 | loss: 0.0311212 | val_loss: 0.0311451 | Time: 44069 ms [2022-04-17 20:05:56 main:574] : INFO : Epoch 1727 | loss: 0.0311213 | val_loss: 0.0311429 | Time: 44035.8 ms [2022-04-17 20:06:41 main:574] : INFO : Epoch 1728 | loss: 0.0311195 | val_loss: 0.031143 | Time: 44623.4 ms [2022-04-17 20:07:25 main:574] : INFO : Epoch 1729 | loss: 0.031128 | val_loss: 0.0311447 | Time: 44056.8 ms [2022-04-17 20:08:09 main:574] : INFO : Epoch 1730 | loss: 0.031132 | val_loss: 0.0311428 | Time: 44026.5 ms [2022-04-17 20:08:54 main:574] : INFO : Epoch 1731 | loss: 0.0311305 | val_loss: 0.031146 | Time: 44333.7 ms [2022-04-17 20:09:38 main:574] : INFO : Epoch 1732 | loss: 0.0311289 | val_loss: 0.0311478 | Time: 44123.5 ms [2022-04-17 20:10:22 main:574] : INFO : Epoch 1733 | loss: 0.0311271 | val_loss: 0.0311428 | Time: 44079.7 ms [2022-04-17 20:11:06 main:574] : INFO : Epoch 1734 | loss: 0.0311283 | val_loss: 0.0311438 | Time: 44054.9 ms [2022-04-17 20:11:51 main:574] : INFO : Epoch 1735 | loss: 0.031127 | val_loss: 0.0311444 | Time: 44096.8 ms [2022-04-17 20:12:35 main:574] : INFO : Epoch 1736 | loss: 0.0311257 | val_loss: 0.0311423 | Time: 44245 ms [2022-04-17 20:13:19 main:574] : INFO : Epoch 1737 | loss: 0.0311247 | val_loss: 0.0311402 | Time: 44260 ms [2022-04-17 20:14:04 main:574] : INFO : Epoch 1738 | loss: 0.0311255 | val_loss: 0.0311401 | Time: 44019.3 ms [2022-04-17 20:14:48 main:574] : INFO : Epoch 1739 | loss: 0.0311242 | val_loss: 0.0311469 | Time: 44038.9 ms [2022-04-17 20:15:32 main:574] : INFO : Epoch 1740 | loss: 0.0311243 | val_loss: 0.031142 | Time: 44078.3 ms [2022-04-17 20:16:16 main:574] : INFO : Epoch 1741 | loss: 0.031124 | val_loss: 0.0311412 | Time: 44137.6 ms [2022-04-17 20:17:00 main:574] : INFO : Epoch 1742 | loss: 0.0311245 | val_loss: 0.0311452 | Time: 44009.5 ms [2022-04-17 20:17:45 main:574] : INFO : Epoch 1743 | loss: 0.0311231 | val_loss: 0.0311414 | Time: 44062.3 ms [2022-04-17 20:18:29 main:574] : INFO : Epoch 1744 | loss: 0.0311205 | val_loss: 0.0311444 | Time: 44192.7 ms [2022-04-17 20:19:13 main:574] : INFO : Epoch 1745 | loss: 0.0311219 | val_loss: 0.0311424 | Time: 44356.7 ms [2022-04-17 20:19:58 main:574] : INFO : Epoch 1746 | loss: 0.0311217 | val_loss: 0.0311441 | Time: 44103.7 ms [2022-04-17 20:20:42 main:574] : INFO : Epoch 1747 | loss: 0.0311237 | val_loss: 0.0311472 | Time: 44131.4 ms [2022-04-17 20:21:26 main:574] : INFO : Epoch 1748 | loss: 0.0311226 | val_loss: 0.0311426 | Time: 44160.4 ms [2022-04-17 20:22:10 main:574] : INFO : Epoch 1749 | loss: 0.0311208 | val_loss: 0.031143 | Time: 44140 ms [2022-04-17 20:22:54 main:574] : INFO : Epoch 1750 | loss: 0.0311188 | val_loss: 0.0311431 | Time: 44091.4 ms [2022-04-17 20:23:39 main:574] : INFO : Epoch 1751 | loss: 0.0311189 | val_loss: 0.0311449 | Time: 44238.2 ms [2022-04-17 20:24:23 main:574] : INFO : Epoch 1752 | loss: 0.0311187 | val_loss: 0.0311451 | Time: 44161.5 ms [2022-04-17 20:25:07 main:574] : INFO : Epoch 1753 | loss: 0.031119 | val_loss: 0.0311407 | Time: 44203.4 ms [2022-04-17 20:25:51 main:574] : INFO : Epoch 1754 | loss: 0.031118 | val_loss: 0.031144 | Time: 44031.7 ms [2022-04-17 20:26:36 main:574] : INFO : Epoch 1755 | loss: 0.0311188 | val_loss: 0.0311413 | Time: 44239.3 ms [2022-04-17 20:27:20 main:574] : INFO : Epoch 1756 | loss: 0.0311177 | val_loss: 0.031143 | Time: 43939.3 ms [2022-04-17 20:28:04 main:574] : INFO : Epoch 1757 | loss: 0.0311177 | val_loss: 0.0311432 | Time: 44080.4 ms [2022-04-17 20:28:48 main:574] : INFO : Epoch 1758 | loss: 0.0311181 | val_loss: 0.0311457 | Time: 44164 ms [2022-04-17 20:29:32 main:574] : INFO : Epoch 1759 | loss: 0.0311176 | val_loss: 0.0311438 | Time: 44115.9 ms [2022-04-17 20:30:16 main:574] : INFO : Epoch 1760 | loss: 0.0311182 | val_loss: 0.0311471 | Time: 44018.4 ms [2022-04-17 20:31:01 main:574] : INFO : Epoch 1761 | loss: 0.0311166 | val_loss: 0.0311468 | Time: 44166.5 ms [2022-04-17 20:31:45 main:574] : INFO : Epoch 1762 | loss: 0.0311201 | val_loss: 0.0311438 | Time: 44005 ms [2022-04-17 20:32:29 main:574] : INFO : Epoch 1763 | loss: 0.0311174 | val_loss: 0.0311466 | Time: 44032.5 ms [2022-04-17 20:33:13 main:574] : INFO : Epoch 1764 | loss: 0.0311171 | val_loss: 0.0311426 | Time: 44045.5 ms [2022-04-17 20:33:57 main:574] : INFO : Epoch 1765 | loss: 0.0311182 | val_loss: 0.0311434 | Time: 44167.1 ms [2022-04-17 20:34:41 main:574] : INFO : Epoch 1766 | loss: 0.031119 | val_loss: 0.0311462 | Time: 44055.9 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GT 1030) [2022-04-17 20:47:54 main:435] : INFO : Set logging level to 1 [2022-04-17 20:47:54 main:441] : INFO : Running in BOINC Client mode [2022-04-17 20:47:54 main:444] : INFO : Resolving all filenames [2022-04-17 20:47:54 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-17 20:47:54 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-17 20:47:54 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-17 20:47:54 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-17 20:47:54 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-17 20:47:54 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-17 20:47:54 main:474] : INFO : Configuration: [2022-04-17 20:47:54 main:475] : INFO : Model type: GRU [2022-04-17 20:47:54 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-17 20:47:54 main:477] : INFO : Max Epochs: 2048 [2022-04-17 20:47:54 main:478] : INFO : Batch Size: 128 [2022-04-17 20:47:55 main:479] : INFO : Learning Rate: 0.01 [2022-04-17 20:47:55 main:480] : INFO : Patience: 10 [2022-04-17 20:47:55 main:481] : INFO : Hidden Width: 12 [2022-04-17 20:47:55 main:482] : INFO : # Recurrent Layers: 4 [2022-04-17 20:47:55 main:483] : INFO : # Backend Layers: 4 [2022-04-17 20:47:55 main:484] : INFO : # Threads: 1 [2022-04-17 20:47:55 main:486] : INFO : Preparing Dataset [2022-04-17 20:47:55 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-17 20:47:56 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-17 20:48:07 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-17 20:48:07 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-17 20:48:07 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-17 20:48:08 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-17 20:48:08 main:494] : INFO : Creating Model [2022-04-17 20:48:08 main:507] : INFO : Preparing config file [2022-04-17 20:48:08 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-17 20:48:08 main:512] : INFO : Loading config [2022-04-17 20:48:08 main:514] : INFO : Loading state [2022-04-17 20:48:12 main:559] : INFO : Loading DataLoader into Memory [2022-04-17 20:48:13 main:562] : INFO : Starting Training [2022-04-17 20:48:58 main:574] : INFO : Epoch 1767 | loss: 0.0311502 | val_loss: 0.031148 | Time: 45600.1 ms [2022-04-17 20:49:43 main:574] : INFO : Epoch 1768 | loss: 0.0311208 | val_loss: 0.0311431 | Time: 44442.6 ms [2022-04-17 20:50:27 main:574] : INFO : Epoch 1769 | loss: 0.0311188 | val_loss: 0.0311415 | Time: 44470.7 ms [2022-04-17 20:51:12 main:574] : INFO : Epoch 1770 | loss: 0.031118 | val_loss: 0.0311402 | Time: 44692.8 ms [2022-04-17 20:51:57 main:574] : INFO : Epoch 1771 | loss: 0.0311187 | val_loss: 0.0311426 | Time: 44563.9 ms [2022-04-17 20:52:42 main:574] : INFO : Epoch 1772 | loss: 0.0311202 | val_loss: 0.0311433 | Time: 44629.8 ms [2022-04-17 20:53:26 main:574] : INFO : Epoch 1773 | loss: 0.0311195 | val_loss: 0.0311415 | Time: 44502.3 ms [2022-04-17 20:54:11 main:574] : INFO : Epoch 1774 | loss: 0.0311186 | val_loss: 0.0311454 | Time: 44444.4 ms [2022-04-17 20:54:56 main:574] : INFO : Epoch 1775 | loss: 0.0311187 | val_loss: 0.031143 | Time: 44519.9 ms [2022-04-17 20:55:40 main:574] : INFO : Epoch 1776 | loss: 0.0311232 | val_loss: 0.0311406 | Time: 44665.7 ms [2022-04-17 20:56:25 main:574] : INFO : Epoch 1777 | loss: 0.0311201 | val_loss: 0.0311418 | Time: 44571.9 ms [2022-04-17 20:57:09 main:574] : INFO : Epoch 1778 | loss: 0.0311213 | val_loss: 0.031143 | Time: 44384.2 ms [2022-04-17 20:57:54 main:574] : INFO : Epoch 1779 | loss: 0.0311245 | val_loss: 0.031142 | Time: 44607.5 ms [2022-04-17 20:58:39 main:574] : INFO : Epoch 1780 | loss: 0.0311248 | val_loss: 0.0311429 | Time: 44468.8 ms [2022-04-17 20:59:24 main:574] : INFO : Epoch 1781 | loss: 0.0311231 | val_loss: 0.0311431 | Time: 45043.3 ms [2022-04-17 21:00:08 main:574] : INFO : Epoch 1782 | loss: 0.0311217 | val_loss: 0.0311441 | Time: 44580.6 ms [2022-04-17 21:00:53 main:574] : INFO : Epoch 1783 | loss: 0.0311204 | val_loss: 0.0311421 | Time: 44517.4 ms [2022-04-17 21:01:38 main:574] : INFO : Epoch 1784 | loss: 0.0311197 | val_loss: 0.0311415 | Time: 44510 ms [2022-04-17 21:02:22 main:574] : INFO : Epoch 1785 | loss: 0.0311195 | val_loss: 0.0311432 | Time: 44528.9 ms [2022-04-17 21:03:07 main:574] : INFO : Epoch 1786 | loss: 0.0311198 | val_loss: 0.031146 | Time: 44525.8 ms [2022-04-17 21:03:52 main:574] : INFO : Epoch 1787 | loss: 0.0311194 | val_loss: 0.0311421 | Time: 44679.8 ms [2022-04-17 21:04:36 main:574] : INFO : Epoch 1788 | loss: 0.0311248 | val_loss: 0.0311401 | Time: 44578.6 ms [2022-04-17 21:05:21 main:574] : INFO : Epoch 1789 | loss: 0.0311217 | val_loss: 0.031145 | Time: 44518.9 ms [2022-04-17 21:06:05 main:574] : INFO : Epoch 1790 | loss: 0.0311228 | val_loss: 0.0311416 | Time: 44479.4 ms [2022-04-17 21:06:50 main:574] : INFO : Epoch 1791 | loss: 0.0311231 | val_loss: 0.0311433 | Time: 44429.8 ms [2022-04-17 21:07:34 main:574] : INFO : Epoch 1792 | loss: 0.0311225 | val_loss: 0.0311407 | Time: 44391.6 ms [2022-04-17 21:08:19 main:574] : INFO : Epoch 1793 | loss: 0.0311203 | val_loss: 0.0311454 | Time: 44440.3 ms [2022-04-17 21:09:04 main:574] : INFO : Epoch 1794 | loss: 0.0311217 | val_loss: 0.0311452 | Time: 44562.6 ms [2022-04-17 21:09:48 main:574] : INFO : Epoch 1795 | loss: 0.031124 | val_loss: 0.0311454 | Time: 44437.9 ms [2022-04-17 21:10:33 main:574] : INFO : Epoch 1796 | loss: 0.0311229 | val_loss: 0.0311457 | Time: 44543.8 ms [2022-04-17 21:11:18 main:574] : INFO : Epoch 1797 | loss: 0.0311256 | val_loss: 0.0311471 | Time: 44482.9 ms [2022-04-17 21:12:02 main:574] : INFO : Epoch 1798 | loss: 0.0311291 | val_loss: 0.0311449 | Time: 44523.7 ms [2022-04-17 21:12:47 main:574] : INFO : Epoch 1799 | loss: 0.0311247 | val_loss: 0.0311476 | Time: 44430 ms [2022-04-17 21:13:31 main:574] : INFO : Epoch 1800 | loss: 0.0311262 | val_loss: 0.0311456 | Time: 44423.5 ms [2022-04-17 21:14:16 main:574] : INFO : Epoch 1801 | loss: 0.0311288 | val_loss: 0.0311432 | Time: 44645.8 ms [2022-04-17 21:15:01 main:574] : INFO : Epoch 1802 | loss: 0.0311272 | val_loss: 0.0311425 | Time: 44531.4 ms [2022-04-17 21:15:45 main:574] : INFO : Epoch 1803 | loss: 0.0311225 | val_loss: 0.031142 | Time: 44443.7 ms [2022-04-17 21:16:30 main:574] : INFO : Epoch 1804 | loss: 0.0311231 | val_loss: 0.0311417 | Time: 44579.4 ms [2022-04-17 21:17:14 main:574] : INFO : Epoch 1805 | loss: 0.0311215 | val_loss: 0.0311411 | Time: 44402.5 ms [2022-04-17 21:17:59 main:574] : INFO : Epoch 1806 | loss: 0.0311221 | val_loss: 0.0311423 | Time: 44481.4 ms [2022-04-17 21:18:44 main:574] : INFO : Epoch 1807 | loss: 0.031123 | val_loss: 0.031144 | Time: 44630.1 ms [2022-04-17 21:19:28 main:574] : INFO : Epoch 1808 | loss: 0.0311239 | val_loss: 0.0311433 | Time: 44636.5 ms [2022-04-17 21:20:13 main:574] : INFO : Epoch 1809 | loss: 0.0311232 | val_loss: 0.0311446 | Time: 44513.5 ms [2022-04-17 21:20:58 main:574] : INFO : Epoch 1810 | loss: 0.0311234 | val_loss: 0.0311415 | Time: 44484.5 ms [2022-04-17 21:21:42 main:574] : INFO : Epoch 1811 | loss: 0.0311215 | val_loss: 0.0311406 | Time: 44679 ms [2022-04-17 21:22:27 main:574] : INFO : Epoch 1812 | loss: 0.0311234 | val_loss: 0.0311395 | Time: 44508.7 ms [2022-04-17 21:23:12 main:574] : INFO : Epoch 1813 | loss: 0.0311247 | val_loss: 0.0311379 | Time: 44573.4 ms [2022-04-17 21:23:56 main:574] : INFO : Epoch 1814 | loss: 0.0311311 | val_loss: 0.0311443 | Time: 44512.8 ms [2022-04-17 21:24:41 main:574] : INFO : Epoch 1815 | loss: 0.0311313 | val_loss: 0.0311407 | Time: 44426.3 ms [2022-04-17 21:25:25 main:574] : INFO : Epoch 1816 | loss: 0.0311289 | val_loss: 0.0311417 | Time: 44447.9 ms [2022-04-17 21:26:10 main:574] : INFO : Epoch 1817 | loss: 0.031128 | val_loss: 0.0311468 | Time: 44455.4 ms [2022-04-17 21:26:54 main:574] : INFO : Epoch 1818 | loss: 0.0311304 | val_loss: 0.0311498 | Time: 44493.1 ms [2022-04-17 21:27:39 main:574] : INFO : Epoch 1819 | loss: 0.0311282 | val_loss: 0.0311413 | Time: 44492.1 ms [2022-04-17 21:28:24 main:574] : INFO : Epoch 1820 | loss: 0.0311263 | val_loss: 0.0311377 | Time: 44520.5 ms [2022-04-17 21:29:08 main:574] : INFO : Epoch 1821 | loss: 0.031125 | val_loss: 0.0311402 | Time: 44480 ms [2022-04-17 21:29:53 main:574] : INFO : Epoch 1822 | loss: 0.0311247 | val_loss: 0.0311386 | Time: 44603 ms [2022-04-17 21:30:37 main:574] : INFO : Epoch 1823 | loss: 0.0311261 | val_loss: 0.031138 | Time: 44435 ms [2022-04-17 21:31:22 main:574] : INFO : Epoch 1824 | loss: 0.0311237 | val_loss: 0.0311403 | Time: 44521.1 ms [2022-04-17 21:32:07 main:574] : INFO : Epoch 1825 | loss: 0.031123 | val_loss: 0.0311397 | Time: 44353.7 ms [2022-04-17 21:32:51 main:574] : INFO : Epoch 1826 | loss: 0.0311275 | val_loss: 0.0311409 | Time: 44547 ms [2022-04-17 21:33:36 main:574] : INFO : Epoch 1827 | loss: 0.0311283 | val_loss: 0.0311421 | Time: 44583 ms [2022-04-17 21:34:20 main:574] : INFO : Epoch 1828 | loss: 0.031125 | val_loss: 0.031139 | Time: 44378.1 ms [2022-04-17 21:35:05 main:574] : INFO : Epoch 1829 | loss: 0.0311253 | val_loss: 0.0311388 | Time: 44504.2 ms [2022-04-17 21:35:50 main:574] : INFO : Epoch 1830 | loss: 0.031122 | val_loss: 0.0311372 | Time: 44500.1 ms [2022-04-17 21:36:34 main:574] : INFO : Epoch 1831 | loss: 0.0311212 | val_loss: 0.0311393 | Time: 44481.5 ms [2022-04-17 21:37:19 main:574] : INFO : Epoch 1832 | loss: 0.0311212 | val_loss: 0.0311388 | Time: 44500.6 ms [2022-04-17 21:38:03 main:574] : INFO : Epoch 1833 | loss: 0.0311215 | val_loss: 0.0311417 | Time: 44585 ms [2022-04-17 21:38:48 main:574] : INFO : Epoch 1834 | loss: 0.0311201 | val_loss: 0.0311394 | Time: 44563.4 ms [2022-04-17 21:39:33 main:574] : INFO : Epoch 1835 | loss: 0.0311191 | val_loss: 0.0311406 | Time: 44484.4 ms [2022-04-17 21:40:17 main:574] : INFO : Epoch 1836 | loss: 0.0311195 | val_loss: 0.0311427 | Time: 44547.5 ms [2022-04-17 21:41:02 main:574] : INFO : Epoch 1837 | loss: 0.0311198 | val_loss: 0.031141 | Time: 44437 ms [2022-04-17 21:41:46 main:574] : INFO : Epoch 1838 | loss: 0.0311216 | val_loss: 0.0311403 | Time: 44524.8 ms [2022-04-17 21:42:31 main:574] : INFO : Epoch 1839 | loss: 0.0311193 | val_loss: 0.0311384 | Time: 44475.4 ms [2022-04-17 21:43:16 main:574] : INFO : Epoch 1840 | loss: 0.0311224 | val_loss: 0.0311504 | Time: 44551.1 ms [2022-04-17 21:44:00 main:574] : INFO : Epoch 1841 | loss: 0.0311224 | val_loss: 0.0311392 | Time: 44551 ms [2022-04-17 21:44:45 main:574] : INFO : Epoch 1842 | loss: 0.0311176 | val_loss: 0.0311409 | Time: 44552.4 ms [2022-04-17 21:45:29 main:574] : INFO : Epoch 1843 | loss: 0.03112 | val_loss: 0.0311393 | Time: 44357 ms [2022-04-17 21:46:14 main:574] : INFO : Epoch 1844 | loss: 0.0311184 | val_loss: 0.0311409 | Time: 44463.1 ms [2022-04-17 21:46:58 main:574] : INFO : Epoch 1845 | loss: 0.0311159 | val_loss: 0.0311369 | Time: 44431.8 ms [2022-04-17 21:47:43 main:574] : INFO : Epoch 1846 | loss: 0.0311171 | val_loss: 0.0311447 | Time: 44454.5 ms [2022-04-17 21:48:28 main:574] : INFO : Epoch 1847 | loss: 0.0311182 | val_loss: 0.0311448 | Time: 44495.2 ms [2022-04-17 21:49:12 main:574] : INFO : Epoch 1848 | loss: 0.0311188 | val_loss: 0.0311404 | Time: 44525.2 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GT 1030) [2022-04-17 22:02:11 main:435] : INFO : Set logging level to 1 [2022-04-17 22:02:11 main:441] : INFO : Running in BOINC Client mode [2022-04-17 22:02:11 main:444] : INFO : Resolving all filenames [2022-04-17 22:02:11 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-17 22:02:11 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-17 22:02:11 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-17 22:02:11 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-17 22:02:11 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-17 22:02:11 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-17 22:02:11 main:474] : INFO : Configuration: [2022-04-17 22:02:11 main:475] : INFO : Model type: GRU [2022-04-17 22:02:12 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-17 22:02:12 main:477] : INFO : Max Epochs: 2048 [2022-04-17 22:02:12 main:478] : INFO : Batch Size: 128 [2022-04-17 22:02:12 main:479] : INFO : Learning Rate: 0.01 [2022-04-17 22:02:12 main:480] : INFO : Patience: 10 [2022-04-17 22:02:12 main:481] : INFO : Hidden Width: 12 [2022-04-17 22:02:12 main:482] : INFO : # Recurrent Layers: 4 [2022-04-17 22:02:12 main:483] : INFO : # Backend Layers: 4 [2022-04-17 22:02:12 main:484] : INFO : # Threads: 1 [2022-04-17 22:02:12 main:486] : INFO : Preparing Dataset [2022-04-17 22:02:12 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-17 22:02:14 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-17 22:02:23 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-17 22:02:24 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-17 22:02:24 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-17 22:02:25 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-17 22:02:25 main:494] : INFO : Creating Model [2022-04-17 22:02:25 main:507] : INFO : Preparing config file [2022-04-17 22:02:25 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-17 22:02:25 main:512] : INFO : Loading config [2022-04-17 22:02:25 main:514] : INFO : Loading state [2022-04-17 22:02:29 main:559] : INFO : Loading DataLoader into Memory [2022-04-17 22:02:29 main:562] : INFO : Starting Training [2022-04-17 22:03:14 main:574] : INFO : Epoch 1849 | loss: 0.0311553 | val_loss: 0.0311539 | Time: 45168.6 ms [2022-04-17 22:03:58 main:574] : INFO : Epoch 1850 | loss: 0.0311221 | val_loss: 0.0311453 | Time: 44140.4 ms [2022-04-17 22:04:43 main:574] : INFO : Epoch 1851 | loss: 0.0311197 | val_loss: 0.0311433 | Time: 44270.9 ms [2022-04-17 22:05:27 main:574] : INFO : Epoch 1852 | loss: 0.031119 | val_loss: 0.0311425 | Time: 44152.1 ms [2022-04-17 22:06:11 main:574] : INFO : Epoch 1853 | loss: 0.0311188 | val_loss: 0.0311418 | Time: 44055.3 ms [2022-04-17 22:06:56 main:574] : INFO : Epoch 1854 | loss: 0.0311186 | val_loss: 0.0311414 | Time: 44128.6 ms [2022-04-17 22:07:40 main:574] : INFO : Epoch 1855 | loss: 0.0311205 | val_loss: 0.0311474 | Time: 44168.5 ms [2022-04-17 22:08:24 main:574] : INFO : Epoch 1856 | loss: 0.0311236 | val_loss: 0.0311511 | Time: 44180.1 ms [2022-04-17 22:09:08 main:574] : INFO : Epoch 1857 | loss: 0.0311242 | val_loss: 0.0311431 | Time: 44064.2 ms [2022-04-17 22:09:52 main:574] : INFO : Epoch 1858 | loss: 0.0311215 | val_loss: 0.0311423 | Time: 44163.8 ms [2022-04-17 22:10:37 main:574] : INFO : Epoch 1859 | loss: 0.0311236 | val_loss: 0.0311444 | Time: 44137.5 ms [2022-04-17 22:11:21 main:574] : INFO : Epoch 1860 | loss: 0.0311246 | val_loss: 0.0311423 | Time: 44207.3 ms [2022-04-17 22:12:05 main:574] : INFO : Epoch 1861 | loss: 0.0311353 | val_loss: 0.0311452 | Time: 44139.9 ms [2022-04-17 22:12:49 main:574] : INFO : Epoch 1862 | loss: 0.0311342 | val_loss: 0.0311432 | Time: 44158.5 ms [2022-04-17 22:13:34 main:574] : INFO : Epoch 1863 | loss: 0.0311325 | val_loss: 0.0311456 | Time: 44123.7 ms [2022-04-17 22:14:18 main:574] : INFO : Epoch 1864 | loss: 0.0311334 | val_loss: 0.0311445 | Time: 44239.7 ms [2022-04-17 22:15:02 main:574] : INFO : Epoch 1865 | loss: 0.0311293 | val_loss: 0.0311413 | Time: 44152.7 ms [2022-04-17 22:15:47 main:574] : INFO : Epoch 1866 | loss: 0.0311258 | val_loss: 0.0311401 | Time: 44186.9 ms [2022-04-17 22:16:31 main:574] : INFO : Epoch 1867 | loss: 0.0311256 | val_loss: 0.0311399 | Time: 44068.5 ms [2022-04-17 22:17:15 main:574] : INFO : Epoch 1868 | loss: 0.0311235 | val_loss: 0.0311416 | Time: 44277.8 ms [2022-04-17 22:17:59 main:574] : INFO : Epoch 1869 | loss: 0.031123 | val_loss: 0.0311388 | Time: 44089.1 ms [2022-04-17 22:18:44 main:574] : INFO : Epoch 1870 | loss: 0.0311213 | val_loss: 0.0311416 | Time: 44183.8 ms [2022-04-17 22:19:28 main:574] : INFO : Epoch 1871 | loss: 0.0311207 | val_loss: 0.031139 | Time: 44094.7 ms [2022-04-17 22:20:12 main:574] : INFO : Epoch 1872 | loss: 0.0311199 | val_loss: 0.0311391 | Time: 44185.2 ms [2022-04-17 22:20:56 main:574] : INFO : Epoch 1873 | loss: 0.0311236 | val_loss: 0.0311406 | Time: 44003.4 ms [2022-04-17 22:21:41 main:574] : INFO : Epoch 1874 | loss: 0.0311233 | val_loss: 0.0311414 | Time: 44499.9 ms [2022-04-17 22:22:25 main:574] : INFO : Epoch 1875 | loss: 0.0311228 | val_loss: 0.0311415 | Time: 44165.9 ms [2022-04-17 22:23:09 main:574] : INFO : Epoch 1876 | loss: 0.0311246 | val_loss: 0.031143 | Time: 44194.9 ms [2022-04-17 22:23:54 main:574] : INFO : Epoch 1877 | loss: 0.0311276 | val_loss: 0.0311418 | Time: 44160.3 ms [2022-04-17 22:24:38 main:574] : INFO : Epoch 1878 | loss: 0.0311299 | val_loss: 0.0311413 | Time: 44169.6 ms [2022-04-17 22:25:22 main:574] : INFO : Epoch 1879 | loss: 0.0311318 | val_loss: 0.0311467 | Time: 44135.3 ms [2022-04-17 22:26:06 main:574] : INFO : Epoch 1880 | loss: 0.0311347 | val_loss: 0.0311472 | Time: 44215.6 ms [2022-04-17 22:26:51 main:574] : INFO : Epoch 1881 | loss: 0.0311287 | val_loss: 0.0311418 | Time: 44144.2 ms [2022-04-17 22:27:35 main:574] : INFO : Epoch 1882 | loss: 0.0311255 | val_loss: 0.031138 | Time: 44117.3 ms [2022-04-17 22:28:19 main:574] : INFO : Epoch 1883 | loss: 0.0311257 | val_loss: 0.0311405 | Time: 44459.5 ms [2022-04-17 22:29:04 main:574] : INFO : Epoch 1884 | loss: 0.0311257 | val_loss: 0.0311385 | Time: 44117 ms [2022-04-17 22:29:48 main:574] : INFO : Epoch 1885 | loss: 0.0311284 | val_loss: 0.0311412 | Time: 44332.3 ms [2022-04-17 22:30:32 main:574] : INFO : Epoch 1886 | loss: 0.0311229 | val_loss: 0.0311401 | Time: 44161 ms [2022-04-17 22:31:17 main:574] : INFO : Epoch 1887 | loss: 0.0311212 | val_loss: 0.0311365 | Time: 44139.6 ms [2022-04-17 22:32:01 main:574] : INFO : Epoch 1888 | loss: 0.0311203 | val_loss: 0.0311391 | Time: 44205.6 ms [2022-04-17 22:32:45 main:574] : INFO : Epoch 1889 | loss: 0.0311209 | val_loss: 0.0311376 | Time: 44129.9 ms [2022-04-17 22:33:29 main:574] : INFO : Epoch 1890 | loss: 0.0311198 | val_loss: 0.0311425 | Time: 44229.8 ms [2022-04-17 22:34:14 main:574] : INFO : Epoch 1891 | loss: 0.0311199 | val_loss: 0.031138 | Time: 44134.9 ms [2022-04-17 22:34:58 main:574] : INFO : Epoch 1892 | loss: 0.0311196 | val_loss: 0.0311399 | Time: 43975.5 ms [2022-04-17 22:35:42 main:574] : INFO : Epoch 1893 | loss: 0.0311176 | val_loss: 0.03114 | Time: 44047.7 ms [2022-04-17 22:36:26 main:574] : INFO : Epoch 1894 | loss: 0.0311175 | val_loss: 0.0311402 | Time: 44130.9 ms [2022-04-17 22:37:10 main:574] : INFO : Epoch 1895 | loss: 0.0311185 | val_loss: 0.0311412 | Time: 44127.7 ms [2022-04-17 22:37:55 main:574] : INFO : Epoch 1896 | loss: 0.0311203 | val_loss: 0.0311416 | Time: 44201.5 ms [2022-04-17 22:38:39 main:574] : INFO : Epoch 1897 | loss: 0.031119 | val_loss: 0.0311416 | Time: 44103.8 ms [2022-04-17 22:39:23 main:574] : INFO : Epoch 1898 | loss: 0.0311185 | val_loss: 0.0311403 | Time: 44172 ms [2022-04-17 22:40:07 main:574] : INFO : Epoch 1899 | loss: 0.0311179 | val_loss: 0.0311408 | Time: 44143.6 ms [2022-04-17 22:40:52 main:574] : INFO : Epoch 1900 | loss: 0.0311175 | val_loss: 0.0311382 | Time: 44210.7 ms [2022-04-17 22:41:36 main:574] : INFO : Epoch 1901 | loss: 0.0311166 | val_loss: 0.0311392 | Time: 44083.1 ms [2022-04-17 22:42:20 main:574] : INFO : Epoch 1902 | loss: 0.0311187 | val_loss: 0.0311377 | Time: 44135.8 ms [2022-04-17 22:43:04 main:574] : INFO : Epoch 1903 | loss: 0.0311193 | val_loss: 0.0311414 | Time: 44180.2 ms [2022-04-17 22:43:49 main:574] : INFO : Epoch 1904 | loss: 0.0311203 | val_loss: 0.0311359 | Time: 44109.6 ms [2022-04-17 22:44:33 main:574] : INFO : Epoch 1905 | loss: 0.0311184 | val_loss: 0.0311379 | Time: 44129.8 ms [2022-04-17 22:45:17 main:574] : INFO : Epoch 1906 | loss: 0.0311217 | val_loss: 0.0311453 | Time: 44170.6 ms [2022-04-17 22:46:01 main:574] : INFO : Epoch 1907 | loss: 0.0311212 | val_loss: 0.0311415 | Time: 44134.4 ms [2022-04-17 22:46:45 main:574] : INFO : Epoch 1908 | loss: 0.0311188 | val_loss: 0.0311446 | Time: 44118.5 ms [2022-04-17 22:47:30 main:574] : INFO : Epoch 1909 | loss: 0.0311194 | val_loss: 0.0311401 | Time: 44110.3 ms [2022-04-17 22:48:14 main:574] : INFO : Epoch 1910 | loss: 0.0311183 | val_loss: 0.0311421 | Time: 44192.5 ms [2022-04-17 22:48:58 main:574] : INFO : Epoch 1911 | loss: 0.0311171 | val_loss: 0.0311392 | Time: 44081.2 ms [2022-04-17 22:49:42 main:574] : INFO : Epoch 1912 | loss: 0.0311198 | val_loss: 0.0311392 | Time: 44150.9 ms [2022-04-17 22:50:26 main:574] : INFO : Epoch 1913 | loss: 0.0311203 | val_loss: 0.0311391 | Time: 44053.9 ms [2022-04-17 22:51:11 main:574] : INFO : Epoch 1914 | loss: 0.0311192 | val_loss: 0.0311421 | Time: 44325.7 ms [2022-04-17 22:51:55 main:574] : INFO : Epoch 1915 | loss: 0.0311226 | val_loss: 0.0311479 | Time: 44229.8 ms [2022-04-17 22:52:40 main:574] : INFO : Epoch 1916 | loss: 0.0311195 | val_loss: 0.0311369 | Time: 44114.2 ms [2022-04-17 22:53:24 main:574] : INFO : Epoch 1917 | loss: 0.0311181 | val_loss: 0.0311354 | Time: 44239.4 ms [2022-04-17 22:54:08 main:574] : INFO : Epoch 1918 | loss: 0.031117 | val_loss: 0.0311385 | Time: 44264.8 ms [2022-04-17 22:54:52 main:574] : INFO : Epoch 1919 | loss: 0.0311178 | val_loss: 0.0311367 | Time: 44039 ms [2022-04-17 22:55:37 main:574] : INFO : Epoch 1920 | loss: 0.0311161 | val_loss: 0.0311397 | Time: 44212.5 ms [2022-04-17 22:56:21 main:574] : INFO : Epoch 1921 | loss: 0.0311173 | val_loss: 0.0311362 | Time: 44186.8 ms [2022-04-17 22:57:05 main:574] : INFO : Epoch 1922 | loss: 0.0311159 | val_loss: 0.0311402 | Time: 44139.8 ms [2022-04-17 22:57:50 main:574] : INFO : Epoch 1923 | loss: 0.0311172 | val_loss: 0.0311399 | Time: 44244.8 ms [2022-04-17 22:58:34 main:574] : INFO : Epoch 1924 | loss: 0.0311178 | val_loss: 0.0311424 | Time: 44203.4 ms [2022-04-17 22:59:18 main:574] : INFO : Epoch 1925 | loss: 0.0311167 | val_loss: 0.0311414 | Time: 44261.6 ms [2022-04-17 23:00:03 main:574] : INFO : Epoch 1926 | loss: 0.0311155 | val_loss: 0.0311427 | Time: 44229.1 ms [2022-04-17 23:00:47 main:574] : INFO : Epoch 1927 | loss: 0.0311152 | val_loss: 0.0311389 | Time: 44167.7 ms [2022-04-17 23:01:31 main:574] : INFO : Epoch 1928 | loss: 0.0311143 | val_loss: 0.0311405 | Time: 44303.3 ms [2022-04-17 23:02:15 main:574] : INFO : Epoch 1929 | loss: 0.0311187 | val_loss: 0.0311477 | Time: 44044.5 ms [2022-04-17 23:03:00 main:574] : INFO : Epoch 1930 | loss: 0.0311332 | val_loss: 0.0311452 | Time: 44284.6 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GT 1030) [2022-04-17 23:17:11 main:435] : INFO : Set logging level to 1 [2022-04-17 23:17:11 main:441] : INFO : Running in BOINC Client mode [2022-04-17 23:17:11 main:444] : INFO : Resolving all filenames [2022-04-17 23:17:11 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-17 23:17:11 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-17 23:17:11 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-17 23:17:11 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-17 23:17:11 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-17 23:17:11 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-17 23:17:11 main:474] : INFO : Configuration: [2022-04-17 23:17:11 main:475] : INFO : Model type: GRU [2022-04-17 23:17:12 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-17 23:17:12 main:477] : INFO : Max Epochs: 2048 [2022-04-17 23:17:12 main:478] : INFO : Batch Size: 128 [2022-04-17 23:17:12 main:479] : INFO : Learning Rate: 0.01 [2022-04-17 23:17:12 main:480] : INFO : Patience: 10 [2022-04-17 23:17:12 main:481] : INFO : Hidden Width: 12 [2022-04-17 23:17:12 main:482] : INFO : # Recurrent Layers: 4 [2022-04-17 23:17:12 main:483] : INFO : # Backend Layers: 4 [2022-04-17 23:17:12 main:484] : INFO : # Threads: 1 [2022-04-17 23:17:13 main:486] : INFO : Preparing Dataset [2022-04-17 23:17:13 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-17 23:17:14 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-17 23:17:24 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-17 23:17:24 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-17 23:17:25 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-17 23:17:25 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-17 23:17:25 main:494] : INFO : Creating Model [2022-04-17 23:17:25 main:507] : INFO : Preparing config file [2022-04-17 23:17:25 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-17 23:17:26 main:512] : INFO : Loading config [2022-04-17 23:17:26 main:514] : INFO : Loading state [2022-04-17 23:17:30 main:559] : INFO : Loading DataLoader into Memory [2022-04-17 23:17:30 main:562] : INFO : Starting Training [2022-04-17 23:18:15 main:574] : INFO : Epoch 1931 | loss: 0.0311509 | val_loss: 0.0311462 | Time: 45095.1 ms [2022-04-17 23:18:59 main:574] : INFO : Epoch 1932 | loss: 0.0311243 | val_loss: 0.0311387 | Time: 44202.3 ms [2022-04-17 23:19:43 main:574] : INFO : Epoch 1933 | loss: 0.0311205 | val_loss: 0.0311376 | Time: 43975.9 ms [2022-04-17 23:20:27 main:574] : INFO : Epoch 1934 | loss: 0.031118 | val_loss: 0.0311401 | Time: 43928.9 ms [2022-04-17 23:21:11 main:574] : INFO : Epoch 1935 | loss: 0.0311199 | val_loss: 0.0311428 | Time: 43936.6 ms [2022-04-17 23:21:56 main:574] : INFO : Epoch 1936 | loss: 0.031122 | val_loss: 0.0311449 | Time: 43987.7 ms [2022-04-17 23:22:40 main:574] : INFO : Epoch 1937 | loss: 0.0311167 | val_loss: 0.0311398 | Time: 43933.3 ms [2022-04-17 23:23:24 main:574] : INFO : Epoch 1938 | loss: 0.0311159 | val_loss: 0.031138 | Time: 43961.6 ms [2022-04-17 23:24:08 main:574] : INFO : Epoch 1939 | loss: 0.031116 | val_loss: 0.0311392 | Time: 43951.4 ms [2022-04-17 23:24:52 main:574] : INFO : Epoch 1940 | loss: 0.0311176 | val_loss: 0.0311375 | Time: 44068.2 ms [2022-04-17 23:25:36 main:574] : INFO : Epoch 1941 | loss: 0.031119 | val_loss: 0.0311437 | Time: 44193.3 ms [2022-04-17 23:26:20 main:574] : INFO : Epoch 1942 | loss: 0.031118 | val_loss: 0.0311383 | Time: 44073.6 ms [2022-04-17 23:27:04 main:574] : INFO : Epoch 1943 | loss: 0.0311181 | val_loss: 0.0311402 | Time: 43914.1 ms [2022-04-17 23:27:49 main:574] : INFO : Epoch 1944 | loss: 0.0311181 | val_loss: 0.0311362 | Time: 44123.9 ms [2022-04-17 23:28:33 main:574] : INFO : Epoch 1945 | loss: 0.0311164 | val_loss: 0.0311439 | Time: 43911.4 ms [2022-04-17 23:29:17 main:574] : INFO : Epoch 1946 | loss: 0.0311205 | val_loss: 0.0311397 | Time: 44007.3 ms [2022-04-17 23:30:01 main:574] : INFO : Epoch 1947 | loss: 0.0311236 | val_loss: 0.0311403 | Time: 44015.5 ms [2022-04-17 23:30:45 main:574] : INFO : Epoch 1948 | loss: 0.0311231 | val_loss: 0.0311376 | Time: 43925.6 ms [2022-04-17 23:31:29 main:574] : INFO : Epoch 1949 | loss: 0.0311233 | val_loss: 0.0311406 | Time: 44042.4 ms [2022-04-17 23:32:13 main:574] : INFO : Epoch 1950 | loss: 0.0311224 | val_loss: 0.0311399 | Time: 43951.1 ms [2022-04-17 23:32:57 main:574] : INFO : Epoch 1951 | loss: 0.0311197 | val_loss: 0.0311378 | Time: 43994.6 ms [2022-04-17 23:33:41 main:574] : INFO : Epoch 1952 | loss: 0.0311177 | val_loss: 0.0311379 | Time: 43976.8 ms [2022-04-17 23:34:25 main:574] : INFO : Epoch 1953 | loss: 0.0311194 | val_loss: 0.0311393 | Time: 43981.4 ms [2022-04-17 23:35:09 main:574] : INFO : Epoch 1954 | loss: 0.0311178 | val_loss: 0.0311417 | Time: 44017.3 ms [2022-04-17 23:35:53 main:574] : INFO : Epoch 1955 | loss: 0.0311177 | val_loss: 0.0311407 | Time: 43905 ms [2022-04-17 23:36:37 main:574] : INFO : Epoch 1956 | loss: 0.0311193 | val_loss: 0.0311385 | Time: 43973.8 ms [2022-04-17 23:37:22 main:574] : INFO : Epoch 1957 | loss: 0.0311167 | val_loss: 0.0311407 | Time: 44175.1 ms [2022-04-17 23:38:06 main:574] : INFO : Epoch 1958 | loss: 0.0311175 | val_loss: 0.0311385 | Time: 43945.3 ms [2022-04-17 23:38:50 main:574] : INFO : Epoch 1959 | loss: 0.0311209 | val_loss: 0.0311391 | Time: 44104.5 ms [2022-04-17 23:39:34 main:574] : INFO : Epoch 1960 | loss: 0.0311206 | val_loss: 0.0311366 | Time: 43991.2 ms [2022-04-17 23:40:18 main:574] : INFO : Epoch 1961 | loss: 0.0311182 | val_loss: 0.0311406 | Time: 43949.3 ms [2022-04-17 23:41:02 main:574] : INFO : Epoch 1962 | loss: 0.0311184 | val_loss: 0.0311396 | Time: 44111.6 ms [2022-04-17 23:41:46 main:574] : INFO : Epoch 1963 | loss: 0.0311181 | val_loss: 0.0311377 | Time: 43935.7 ms [2022-04-17 23:42:31 main:574] : INFO : Epoch 1964 | loss: 0.0311163 | val_loss: 0.0311402 | Time: 44017.5 ms [2022-04-17 23:43:15 main:574] : INFO : Epoch 1965 | loss: 0.031115 | val_loss: 0.0311405 | Time: 44080.3 ms [2022-04-17 23:43:59 main:574] : INFO : Epoch 1966 | loss: 0.0311161 | val_loss: 0.0311393 | Time: 44063.2 ms [2022-04-17 23:44:43 main:574] : INFO : Epoch 1967 | loss: 0.0311155 | val_loss: 0.0311375 | Time: 44064.9 ms [2022-04-17 23:45:27 main:574] : INFO : Epoch 1968 | loss: 0.0311147 | val_loss: 0.0311395 | Time: 44038.2 ms [2022-04-17 23:46:11 main:574] : INFO : Epoch 1969 | loss: 0.0311391 | val_loss: 0.0311569 | Time: 44016.2 ms [2022-04-17 23:46:56 main:574] : INFO : Epoch 1970 | loss: 0.0311591 | val_loss: 0.0311546 | Time: 44070.6 ms [2022-04-17 23:47:40 main:574] : INFO : Epoch 1971 | loss: 0.0311553 | val_loss: 0.0311543 | Time: 44078.9 ms [2022-04-17 23:48:24 main:574] : INFO : Epoch 1972 | loss: 0.03115 | val_loss: 0.0311515 | Time: 43984.5 ms [2022-04-17 23:49:08 main:574] : INFO : Epoch 1973 | loss: 0.0311407 | val_loss: 0.0311447 | Time: 44089 ms [2022-04-17 23:49:52 main:574] : INFO : Epoch 1974 | loss: 0.0311355 | val_loss: 0.0311493 | Time: 44099.6 ms [2022-04-17 23:50:36 main:574] : INFO : Epoch 1975 | loss: 0.0311352 | val_loss: 0.0311462 | Time: 43991.6 ms [2022-04-17 23:51:20 main:574] : INFO : Epoch 1976 | loss: 0.0311299 | val_loss: 0.0311453 | Time: 43973.5 ms [2022-04-17 23:52:05 main:574] : INFO : Epoch 1977 | loss: 0.0311307 | val_loss: 0.0311435 | Time: 44094.7 ms [2022-04-17 23:52:49 main:574] : INFO : Epoch 1978 | loss: 0.0311288 | val_loss: 0.0311503 | Time: 44032.9 ms [2022-04-17 23:53:33 main:574] : INFO : Epoch 1979 | loss: 0.0311305 | val_loss: 0.0311432 | Time: 43962.8 ms [2022-04-17 23:54:17 main:574] : INFO : Epoch 1980 | loss: 0.0311244 | val_loss: 0.0311454 | Time: 44001.9 ms [2022-04-17 23:55:01 main:574] : INFO : Epoch 1981 | loss: 0.0311229 | val_loss: 0.0311413 | Time: 44124.5 ms [2022-04-17 23:55:45 main:574] : INFO : Epoch 1982 | loss: 0.0311199 | val_loss: 0.0311439 | Time: 43885.3 ms [2022-04-17 23:56:29 main:574] : INFO : Epoch 1983 | loss: 0.0311198 | val_loss: 0.0311387 | Time: 44135.5 ms [2022-04-17 23:57:13 main:574] : INFO : Epoch 1984 | loss: 0.0311181 | val_loss: 0.0311374 | Time: 43937.6 ms [2022-04-17 23:57:58 main:574] : INFO : Epoch 1985 | loss: 0.0311179 | val_loss: 0.031137 | Time: 44074.9 ms [2022-04-17 23:58:42 main:574] : INFO : Epoch 1986 | loss: 0.0311171 | val_loss: 0.0311395 | Time: 44106.1 ms [2022-04-17 23:59:26 main:574] : INFO : Epoch 1987 | loss: 0.0311163 | val_loss: 0.0311371 | Time: 43928.2 ms [2022-04-18 00:00:10 main:574] : INFO : Epoch 1988 | loss: 0.0311177 | val_loss: 0.0311384 | Time: 43967.3 ms [2022-04-18 00:00:54 main:574] : INFO : Epoch 1989 | loss: 0.0311161 | val_loss: 0.0311368 | Time: 44035.2 ms [2022-04-18 00:01:38 main:574] : INFO : Epoch 1990 | loss: 0.0311154 | val_loss: 0.0311425 | Time: 44069.8 ms [2022-04-18 00:02:22 main:574] : INFO : Epoch 1991 | loss: 0.0311162 | val_loss: 0.0311406 | Time: 44182.3 ms [2022-04-18 00:03:06 main:574] : INFO : Epoch 1992 | loss: 0.0311158 | val_loss: 0.0311364 | Time: 44112.5 ms [2022-04-18 00:03:51 main:574] : INFO : Epoch 1993 | loss: 0.031115 | val_loss: 0.0311412 | Time: 43941.9 ms [2022-04-18 00:04:35 main:574] : INFO : Epoch 1994 | loss: 0.031118 | val_loss: 0.0311433 | Time: 44107 ms [2022-04-18 00:05:19 main:574] : INFO : Epoch 1995 | loss: 0.0311156 | val_loss: 0.0311399 | Time: 44012 ms [2022-04-18 00:06:03 main:574] : INFO : Epoch 1996 | loss: 0.0311168 | val_loss: 0.0311388 | Time: 43989.8 ms [2022-04-18 00:06:47 main:574] : INFO : Epoch 1997 | loss: 0.031114 | val_loss: 0.0311388 | Time: 43995.3 ms [2022-04-18 00:07:31 main:574] : INFO : Epoch 1998 | loss: 0.031114 | val_loss: 0.0311411 | Time: 44068.5 ms [2022-04-18 00:08:15 main:574] : INFO : Epoch 1999 | loss: 0.031114 | val_loss: 0.0311365 | Time: 44094.8 ms [2022-04-18 00:08:59 main:574] : INFO : Epoch 2000 | loss: 0.0311142 | val_loss: 0.0311395 | Time: 43971.2 ms [2022-04-18 00:09:44 main:574] : INFO : Epoch 2001 | loss: 0.0311135 | val_loss: 0.0311391 | Time: 44128.5 ms [2022-04-18 00:10:28 main:574] : INFO : Epoch 2002 | loss: 0.0311128 | val_loss: 0.0311377 | Time: 44042.5 ms [2022-04-18 00:11:12 main:574] : INFO : Epoch 2003 | loss: 0.0311147 | val_loss: 0.0311404 | Time: 44059.4 ms [2022-04-18 00:11:56 main:574] : INFO : Epoch 2004 | loss: 0.0311132 | val_loss: 0.0311409 | Time: 44060.4 ms [2022-04-18 00:12:40 main:574] : INFO : Epoch 2005 | loss: 0.0311139 | val_loss: 0.0311409 | Time: 43951.1 ms [2022-04-18 00:13:24 main:574] : INFO : Epoch 2006 | loss: 0.0311149 | val_loss: 0.0311425 | Time: 44123.1 ms [2022-04-18 00:14:08 main:574] : INFO : Epoch 2007 | loss: 0.0311144 | val_loss: 0.0311427 | Time: 44005.1 ms [2022-04-18 00:14:52 main:574] : INFO : Epoch 2008 | loss: 0.0311137 | val_loss: 0.0311403 | Time: 43978 ms [2022-04-18 00:15:37 main:574] : INFO : Epoch 2009 | loss: 0.0311139 | val_loss: 0.0311389 | Time: 44010.2 ms [2022-04-18 00:16:21 main:574] : INFO : Epoch 2010 | loss: 0.0311131 | val_loss: 0.0311417 | Time: 44005.9 ms [2022-04-18 00:17:05 main:574] : INFO : Epoch 2011 | loss: 0.031113 | val_loss: 0.0311405 | Time: 44046.9 ms [2022-04-18 00:17:49 main:574] : INFO : Epoch 2012 | loss: 0.0311152 | val_loss: 0.0311416 | Time: 44002.7 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GT 1030) [2022-04-18 00:31:33 main:435] : INFO : Set logging level to 1 [2022-04-18 00:31:33 main:441] : INFO : Running in BOINC Client mode [2022-04-18 00:31:33 main:444] : INFO : Resolving all filenames [2022-04-18 00:31:33 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-18 00:31:33 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-18 00:31:33 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-18 00:31:33 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-18 00:31:33 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-18 00:31:33 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-18 00:31:34 main:474] : INFO : Configuration: [2022-04-18 00:31:34 main:475] : INFO : Model type: GRU [2022-04-18 00:31:34 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-18 00:31:34 main:477] : INFO : Max Epochs: 2048 [2022-04-18 00:31:34 main:478] : INFO : Batch Size: 128 [2022-04-18 00:31:34 main:479] : INFO : Learning Rate: 0.01 [2022-04-18 00:31:34 main:480] : INFO : Patience: 10 [2022-04-18 00:31:34 main:481] : INFO : Hidden Width: 12 [2022-04-18 00:31:34 main:482] : INFO : # Recurrent Layers: 4 [2022-04-18 00:31:34 main:483] : INFO : # Backend Layers: 4 [2022-04-18 00:31:34 main:484] : INFO : # Threads: 1 [2022-04-18 00:31:34 main:486] : INFO : Preparing Dataset [2022-04-18 00:31:34 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-18 00:31:35 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-18 00:31:45 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-18 00:31:45 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-18 00:31:46 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-18 00:31:46 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-18 00:31:46 main:494] : INFO : Creating Model [2022-04-18 00:31:46 main:507] : INFO : Preparing config file [2022-04-18 00:31:46 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-18 00:31:46 main:512] : INFO : Loading config [2022-04-18 00:31:47 main:514] : INFO : Loading state [2022-04-18 00:31:51 main:559] : INFO : Loading DataLoader into Memory [2022-04-18 00:31:51 main:562] : INFO : Starting Training [2022-04-18 00:32:36 main:574] : INFO : Epoch 2013 | loss: 0.0311504 | val_loss: 0.0311487 | Time: 45299.3 ms [2022-04-18 00:33:21 main:574] : INFO : Epoch 2014 | loss: 0.0311172 | val_loss: 0.0311393 | Time: 44172 ms [2022-04-18 00:34:05 main:574] : INFO : Epoch 2015 | loss: 0.0311149 | val_loss: 0.031144 | Time: 44308.5 ms [2022-04-18 00:34:49 main:574] : INFO : Epoch 2016 | loss: 0.031115 | val_loss: 0.0311416 | Time: 44313.5 ms [2022-04-18 00:35:34 main:574] : INFO : Epoch 2017 | loss: 0.0311137 | val_loss: 0.0311423 | Time: 44307.8 ms [2022-04-18 00:36:18 main:574] : INFO : Epoch 2018 | loss: 0.0311133 | val_loss: 0.03114 | Time: 44227.5 ms [2022-04-18 00:37:03 main:574] : INFO : Epoch 2019 | loss: 0.0311132 | val_loss: 0.0311401 | Time: 44403 ms [2022-04-18 00:37:47 main:574] : INFO : Epoch 2020 | loss: 0.0311144 | val_loss: 0.0311409 | Time: 44135.7 ms [2022-04-18 00:38:31 main:574] : INFO : Epoch 2021 | loss: 0.0311173 | val_loss: 0.0311389 | Time: 44253.5 ms [2022-04-18 00:39:16 main:574] : INFO : Epoch 2022 | loss: 0.031114 | val_loss: 0.0311391 | Time: 44277.9 ms [2022-04-18 00:40:00 main:574] : INFO : Epoch 2023 | loss: 0.0311137 | val_loss: 0.0311388 | Time: 44314.7 ms [2022-04-18 00:40:45 main:574] : INFO : Epoch 2024 | loss: 0.0311146 | val_loss: 0.0311378 | Time: 44287 ms [2022-04-18 00:41:29 main:574] : INFO : Epoch 2025 | loss: 0.0311132 | val_loss: 0.0311396 | Time: 44319.1 ms [2022-04-18 00:42:13 main:574] : INFO : Epoch 2026 | loss: 0.0311146 | val_loss: 0.0311378 | Time: 44197 ms [2022-04-18 00:42:58 main:574] : INFO : Epoch 2027 | loss: 0.031115 | val_loss: 0.0311417 | Time: 44216.3 ms [2022-04-18 00:43:42 main:574] : INFO : Epoch 2028 | loss: 0.0311194 | val_loss: 0.0311441 | Time: 44184.6 ms [2022-04-18 00:44:26 main:574] : INFO : Epoch 2029 | loss: 0.0311197 | val_loss: 0.0311427 | Time: 44278.1 ms [2022-04-18 00:45:11 main:574] : INFO : Epoch 2030 | loss: 0.0311225 | val_loss: 0.031139 | Time: 44228.1 ms [2022-04-18 00:45:55 main:574] : INFO : Epoch 2031 | loss: 0.0311214 | val_loss: 0.031144 | Time: 44199.6 ms [2022-04-18 00:46:39 main:574] : INFO : Epoch 2032 | loss: 0.0311194 | val_loss: 0.0311408 | Time: 44259.1 ms [2022-04-18 00:47:24 main:574] : INFO : Epoch 2033 | loss: 0.031121 | val_loss: 0.0311481 | Time: 44299.5 ms [2022-04-18 00:48:08 main:574] : INFO : Epoch 2034 | loss: 0.0311238 | val_loss: 0.031141 | Time: 44336.1 ms [2022-04-18 00:48:52 main:574] : INFO : Epoch 2035 | loss: 0.0311203 | val_loss: 0.0311439 | Time: 44255.9 ms [2022-04-18 00:49:37 main:574] : INFO : Epoch 2036 | loss: 0.0311202 | val_loss: 0.0311478 | Time: 44221.8 ms [2022-04-18 00:50:21 main:574] : INFO : Epoch 2037 | loss: 0.0311283 | val_loss: 0.0311511 | Time: 44298.9 ms [2022-04-18 00:51:05 main:574] : INFO : Epoch 2038 | loss: 0.0311335 | val_loss: 0.0311538 | Time: 44250.3 ms [2022-04-18 00:51:50 main:574] : INFO : Epoch 2039 | loss: 0.0311322 | val_loss: 0.03115 | Time: 44384.5 ms [2022-04-18 00:52:34 main:574] : INFO : Epoch 2040 | loss: 0.0311305 | val_loss: 0.0311487 | Time: 44129.4 ms [2022-04-18 00:53:18 main:574] : INFO : Epoch 2041 | loss: 0.0311281 | val_loss: 0.0311496 | Time: 44211 ms [2022-04-18 00:54:03 main:574] : INFO : Epoch 2042 | loss: 0.0311274 | val_loss: 0.0311475 | Time: 44219.1 ms [2022-04-18 00:54:47 main:574] : INFO : Epoch 2043 | loss: 0.0311261 | val_loss: 0.0311487 | Time: 44262.7 ms [2022-04-18 00:55:31 main:574] : INFO : Epoch 2044 | loss: 0.0311242 | val_loss: 0.0311441 | Time: 44250.1 ms [2022-04-18 00:56:16 main:574] : INFO : Epoch 2045 | loss: 0.0311212 | val_loss: 0.0311442 | Time: 44358.4 ms [2022-04-18 00:57:00 main:574] : INFO : Epoch 2046 | loss: 0.0311221 | val_loss: 0.0311467 | Time: 44168 ms [2022-04-18 00:57:45 main:574] : INFO : Epoch 2047 | loss: 0.0311255 | val_loss: 0.0311469 | Time: 44264.4 ms [2022-04-18 00:58:29 main:574] : INFO : Epoch 2048 | loss: 0.0311216 | val_loss: 0.0311458 | Time: 44184.2 ms [2022-04-18 00:58:29 main:597] : INFO : Saving trained model to model-final.pt, val_loss 0.0311458 [2022-04-18 00:58:29 main:603] : INFO : Saving end state to config to file [2022-04-18 00:58:29 main:608] : INFO : Success, exiting.. 00:58:29 (7420): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)