Task 9432357
| Name | ParityModified-1638639173-28435-0_0 |
| Workunit | 6848470 |
| Created | 4 Dec 2021, 17:32:55 UTC |
| Sent | 14 Dec 2021, 1:10:32 UTC |
| Report deadline | 22 Dec 2021, 1:10:32 UTC |
| Received | 29 Dec 2021, 22:46:10 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 17083 |
| Run time | 3 hours 54 min |
| CPU time | 3 hours 44 min 13 sec |
| Validate state | Task was reported too late to validate |
| Credit | 0.00 |
| Device peak FLOPS | 3,199.41 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 2.08 GB |
| Peak swap size | 4.30 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version> <![CDATA[ <stderr_txt> ms [2021-12-28 17:44:05 main:574] : INFO : Epoch 1688 | loss: 0.0310742 | val_loss: 0.0311996 | Time: 5489.49 ms [2021-12-28 17:44:10 main:574] : INFO : Epoch 1689 | loss: 0.0310695 | val_loss: 0.031209 | Time: 5383.25 ms [2021-12-28 17:44:15 main:574] : INFO : Epoch 1690 | loss: 0.0310675 | val_loss: 0.0312111 | Time: 4987.41 ms [2021-12-28 17:44:20 main:574] : INFO : Epoch 1691 | loss: 0.0310683 | val_loss: 0.0312086 | Time: 5112.63 ms [2021-12-28 17:44:25 main:574] : INFO : Epoch 1692 | loss: 0.0310699 | val_loss: 0.0312038 | Time: 4916.87 ms [2021-12-28 17:44:30 main:574] : INFO : Epoch 1693 | loss: 0.0310699 | val_loss: 0.0312098 | Time: 5062.76 ms [2021-12-28 17:44:35 main:574] : INFO : Epoch 1694 | loss: 0.031068 | val_loss: 0.0312181 | Time: 5332.32 ms [2021-12-28 17:44:41 main:574] : INFO : Epoch 1695 | loss: 0.0310694 | val_loss: 0.0312057 | Time: 5043.45 ms [2021-12-28 17:44:46 main:574] : INFO : Epoch 1696 | loss: 0.0310712 | val_loss: 0.0312032 | Time: 5002.26 ms [2021-12-28 17:44:51 main:574] : INFO : Epoch 1697 | loss: 0.0310709 | val_loss: 0.0312113 | Time: 5068.7 ms [2021-12-28 17:44:56 main:574] : INFO : Epoch 1698 | loss: 0.0310864 | val_loss: 0.0312277 | Time: 5056.13 ms [2021-12-28 17:45:01 main:574] : INFO : Epoch 1699 | loss: 0.0312177 | val_loss: 0.0312277 | Time: 5526.04 ms [2021-12-28 17:45:07 main:574] : INFO : Epoch 1700 | loss: 0.0312107 | val_loss: 0.0312037 | Time: 5254.74 ms [2021-12-28 17:45:12 main:574] : INFO : Epoch 1701 | loss: 0.0311883 | val_loss: 0.0311856 | Time: 5441.02 ms [2021-12-28 17:45:17 main:574] : INFO : Epoch 1702 | loss: 0.0311774 | val_loss: 0.0311782 | Time: 5364.28 ms [2021-12-28 17:45:23 main:574] : INFO : Epoch 1703 | loss: 0.0311707 | val_loss: 0.0311737 | Time: 5401.7 ms [2021-12-28 17:45:28 main:574] : INFO : Epoch 1704 | loss: 0.0311668 | val_loss: 0.0311706 | Time: 5382.85 ms [2021-12-28 17:45:33 main:574] : INFO : Epoch 1705 | loss: 0.0311644 | val_loss: 0.0311683 | Time: 5268.54 ms [2021-12-28 17:45:39 main:574] : INFO : Epoch 1706 | loss: 0.0311622 | val_loss: 0.0311731 | Time: 5302.03 ms [2021-12-28 17:45:44 main:574] : INFO : Epoch 1707 | loss: 0.0311606 | val_loss: 0.0311693 | Time: 5310.98 ms [2021-12-28 17:45:49 main:574] : INFO : Epoch 1708 | loss: 0.0311593 | val_loss: 0.0311683 | Time: 5242.23 ms [2021-12-28 17:45:54 main:574] : INFO : Epoch 1709 | loss: 0.0311552 | val_loss: 0.0311663 | Time: 5107.55 ms [2021-12-28 17:46:00 main:574] : INFO : Epoch 1710 | loss: 0.0311534 | val_loss: 0.0311661 | Time: 5352.18 ms [2021-12-28 17:46:05 main:574] : INFO : Epoch 1711 | loss: 0.0311516 | val_loss: 0.0311677 | Time: 5385.24 ms [2021-12-28 17:46:10 main:574] : INFO : Epoch 1712 | loss: 0.0311495 | val_loss: 0.0311677 | Time: 5295.47 ms [2021-12-28 17:46:16 main:574] : INFO : Epoch 1713 | loss: 0.0311493 | val_loss: 0.0311704 | Time: 5222.99 ms [2021-12-28 17:46:21 main:574] : INFO : Epoch 1714 | loss: 0.0311505 | val_loss: 0.0311696 | Time: 5100.69 ms [2021-12-28 17:46:26 main:574] : INFO : Epoch 1715 | loss: 0.0311482 | val_loss: 0.0311686 | Time: 5333.14 ms [2021-12-28 17:46:33 main:574] : INFO : Epoch 1716 | loss: 0.0311456 | val_loss: 0.0311685 | Time: 5257.21 ms [2021-12-28 17:46:38 main:574] : INFO : Epoch 1717 | loss: 0.0311443 | val_loss: 0.0311693 | Time: 5164.44 ms [2021-12-28 17:46:43 main:574] : INFO : Epoch 1718 | loss: 0.0311428 | val_loss: 0.0311677 | Time: 5382.82 ms [2021-12-28 17:46:49 main:574] : INFO : Epoch 1719 | loss: 0.031142 | val_loss: 0.0311685 | Time: 5537.5 ms [2021-12-28 17:47:04 main:574] : INFO : Epoch 1720 | loss: 0.0311414 | val_loss: 0.0311689 | Time: 15401.8 ms [2021-12-28 17:47:08 main:574] : INFO : Epoch 1721 | loss: 0.0311407 | val_loss: 0.0311694 | Time: 3769.11 ms [2021-12-28 17:47:12 main:574] : INFO : Epoch 1722 | loss: 0.0311402 | val_loss: 0.031171 | Time: 4150.78 ms [2021-12-28 17:47:17 main:574] : INFO : Epoch 1723 | loss: 0.03114 | val_loss: 0.03117 | Time: 4437.23 ms [2021-12-28 17:47:21 main:574] : INFO : Epoch 1724 | loss: 0.0311403 | val_loss: 0.0311736 | Time: 4383.41 ms [2021-12-28 17:47:25 main:574] : INFO : Epoch 1725 | loss: 0.0311389 | val_loss: 0.0311735 | Time: 4452.11 ms [2021-12-28 17:47:31 main:574] : INFO : Epoch 1726 | loss: 0.0311393 | val_loss: 0.0311742 | Time: 5073.86 ms [2021-12-28 17:47:35 main:574] : INFO : Epoch 1727 | loss: 0.0311381 | val_loss: 0.0311737 | Time: 4872.88 ms [2021-12-28 17:47:41 main:574] : INFO : Epoch 1728 | loss: 0.0311366 | val_loss: 0.0311762 | Time: 5416 ms [2021-12-28 17:47:46 main:574] : INFO : Epoch 1729 | loss: 0.031137 | val_loss: 0.0311737 | Time: 5345.35 ms [2021-12-28 17:47:51 main:574] : INFO : Epoch 1730 | loss: 0.0311374 | val_loss: 0.0311737 | Time: 5247.53 ms [2021-12-28 17:47:57 main:574] : INFO : Epoch 1731 | loss: 0.0311373 | val_loss: 0.0311732 | Time: 5377.37 ms [2021-12-28 17:48:02 main:574] : INFO : Epoch 1732 | loss: 0.0311358 | val_loss: 0.0311764 | Time: 5242.76 ms [2021-12-28 17:48:08 main:574] : INFO : Epoch 1733 | loss: 0.031136 | val_loss: 0.0311757 | Time: 5524.97 ms [2021-12-28 17:48:13 main:574] : INFO : Epoch 1734 | loss: 0.0311341 | val_loss: 0.0311746 | Time: 5303.68 ms [2021-12-28 17:48:18 main:574] : INFO : Epoch 1735 | loss: 0.0311363 | val_loss: 0.0311718 | Time: 5231.18 ms [2021-12-28 17:48:24 main:574] : INFO : Epoch 1736 | loss: 0.0311397 | val_loss: 0.0311756 | Time: 5431.59 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1650) [2021-12-28 19:12:22 main:435] : INFO : Set logging level to 1 [2021-12-28 19:12:22 main:441] : INFO : Running in BOINC Client mode [2021-12-28 19:12:22 main:444] : INFO : Resolving all filenames [2021-12-28 19:12:22 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2021-12-28 19:12:22 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2021-12-28 19:12:22 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2021-12-28 19:12:22 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 0) [2021-12-28 19:12:22 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2021-12-28 19:12:22 main:472] : INFO : Dataset filename: dataset.hdf5 [2021-12-28 19:12:22 main:474] : INFO : Configuration: [2021-12-28 19:12:22 main:475] : INFO : Model type: GRU [2021-12-28 19:12:22 main:476] : INFO : Validation Loss Threshold: 0.0001 [2021-12-28 19:12:22 main:477] : INFO : Max Epochs: 2048 [2021-12-28 19:12:22 main:478] : INFO : Batch Size: 128 [2021-12-28 19:12:22 main:479] : INFO : Learning Rate: 0.01 [2021-12-28 19:12:22 main:480] : INFO : Patience: 10 [2021-12-28 19:12:22 main:481] : INFO : Hidden Width: 12 [2021-12-28 19:12:22 main:482] : INFO : # Recurrent Layers: 4 [2021-12-28 19:12:22 main:483] : INFO : # Backend Layers: 4 [2021-12-28 19:12:22 main:484] : INFO : # Threads: 1 [2021-12-28 19:12:22 main:486] : INFO : Preparing Dataset [2021-12-28 19:12:22 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2021-12-28 19:12:22 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2021-12-28 19:12:24 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2021-12-28 19:12:24 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2021-12-28 19:12:24 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2021-12-28 19:12:24 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2021-12-28 19:12:24 main:494] : INFO : Creating Model [2021-12-28 19:12:24 main:507] : INFO : Preparing config file [2021-12-28 19:12:24 main:511] : INFO : Found checkpoint, attempting to load... [2021-12-28 19:12:24 main:512] : INFO : Loading config [2021-12-28 19:12:24 main:514] : INFO : Loading state [2021-12-28 19:12:25 main:559] : INFO : Loading DataLoader into Memory [2021-12-28 19:12:25 main:562] : INFO : Starting Training [2021-12-28 19:12:29 main:574] : INFO : Epoch 1733 | loss: 0.0311781 | val_loss: 0.0311742 | Time: 4031.86 ms [2021-12-28 19:12:33 main:574] : INFO : Epoch 1734 | loss: 0.0311502 | val_loss: 0.0311737 | Time: 3758.28 ms [2021-12-28 19:12:37 main:574] : INFO : Epoch 1735 | loss: 0.0311451 | val_loss: 0.0311677 | Time: 3669.56 ms [2021-12-28 19:12:41 main:574] : INFO : Epoch 1736 | loss: 0.0311438 | val_loss: 0.0311656 | Time: 4052.13 ms [2021-12-28 19:12:45 main:574] : INFO : Epoch 1737 | loss: 0.0311408 | val_loss: 0.0311651 | Time: 4183.08 ms [2021-12-28 19:12:49 main:574] : INFO : Epoch 1738 | loss: 0.0311407 | val_loss: 0.0311657 | Time: 4067.88 ms [2021-12-28 19:12:53 main:574] : INFO : Epoch 1739 | loss: 0.0311431 | val_loss: 0.031173 | Time: 3949.92 ms [2021-12-28 19:12:57 main:574] : INFO : Epoch 1740 | loss: 0.0311455 | val_loss: 0.0311647 | Time: 3981.53 ms [2021-12-28 19:13:01 main:574] : INFO : Epoch 1741 | loss: 0.0311429 | val_loss: 0.0311678 | Time: 4097.33 ms [2021-12-28 19:13:05 main:574] : INFO : Epoch 1742 | loss: 0.0311425 | val_loss: 0.0311684 | Time: 4105.57 ms [2021-12-28 19:13:10 main:574] : INFO : Epoch 1743 | loss: 0.0311423 | val_loss: 0.0311685 | Time: 4240.13 ms [2021-12-28 19:13:14 main:574] : INFO : Epoch 1744 | loss: 0.0311415 | val_loss: 0.0311636 | Time: 4112.25 ms [2021-12-28 19:13:18 main:574] : INFO : Epoch 1745 | loss: 0.0311411 | val_loss: 0.0311679 | Time: 4180.5 ms [2021-12-28 19:13:22 main:574] : INFO : Epoch 1746 | loss: 0.0311394 | val_loss: 0.0311642 | Time: 4269.38 ms [2021-12-28 19:13:27 main:574] : INFO : Epoch 1747 | loss: 0.0311392 | val_loss: 0.031163 | Time: 4364.56 ms [2021-12-28 19:13:31 main:574] : INFO : Epoch 1748 | loss: 0.0311376 | val_loss: 0.0311627 | Time: 4248.35 ms [2021-12-28 19:13:35 main:574] : INFO : Epoch 1749 | loss: 0.0311368 | val_loss: 0.0311635 | Time: 4185 ms [2021-12-28 19:13:39 main:574] : INFO : Epoch 1750 | loss: 0.0311355 | val_loss: 0.031163 | Time: 4193.1 ms [2021-12-28 19:13:43 main:574] : INFO : Epoch 1751 | loss: 0.0311353 | val_loss: 0.0311673 | Time: 4230.22 ms [2021-12-28 19:13:48 main:574] : INFO : Epoch 1752 | loss: 0.0311338 | val_loss: 0.0311648 | Time: 4209.52 ms [2021-12-28 19:13:52 main:574] : INFO : Epoch 1753 | loss: 0.0311348 | val_loss: 0.031164 | Time: 4246.72 ms [2021-12-28 19:13:56 main:574] : INFO : Epoch 1754 | loss: 0.0311321 | val_loss: 0.0311605 | Time: 4219.36 ms [2021-12-28 19:14:01 main:574] : INFO : Epoch 1755 | loss: 0.0311324 | val_loss: 0.0311669 | Time: 4448.47 ms [2021-12-28 19:14:06 main:574] : INFO : Epoch 1756 | loss: 0.031132 | val_loss: 0.0311645 | Time: 5682.69 ms [2021-12-28 19:14:12 main:574] : INFO : Epoch 1757 | loss: 0.0311256 | val_loss: 0.0311632 | Time: 5858.61 ms [2021-12-28 19:14:18 main:574] : INFO : Epoch 1758 | loss: 0.0311311 | val_loss: 0.0311657 | Time: 6090.86 ms [2021-12-28 19:14:24 main:574] : INFO : Epoch 1759 | loss: 0.0311278 | val_loss: 0.031162 | Time: 5509.38 ms [2021-12-28 19:14:29 main:574] : INFO : Epoch 1760 | loss: 0.0311266 | val_loss: 0.0311631 | Time: 5507.37 ms [2021-12-28 19:14:35 main:574] : INFO : Epoch 1761 | loss: 0.0311237 | val_loss: 0.0311625 | Time: 5666.77 ms [2021-12-28 19:14:40 main:574] : INFO : Epoch 1762 | loss: 0.0311252 | val_loss: 0.0311656 | Time: 5225.3 ms [2021-12-28 19:14:45 main:574] : INFO : Epoch 1763 | loss: 0.0311278 | val_loss: 0.0311635 | Time: 5357.86 ms [2021-12-28 19:14:51 main:574] : INFO : Epoch 1764 | loss: 0.0311236 | val_loss: 0.0311669 | Time: 5409.78 ms [2021-12-28 19:14:57 main:574] : INFO : Epoch 1765 | loss: 0.0311248 | val_loss: 0.0311633 | Time: 5686.89 ms [2021-12-28 19:15:02 main:574] : INFO : Epoch 1766 | loss: 0.0311224 | val_loss: 0.0311574 | Time: 5413.69 ms [2021-12-28 19:15:07 main:574] : INFO : Epoch 1767 | loss: 0.0311191 | val_loss: 0.031167 | Time: 5288.42 ms [2021-12-28 19:15:13 main:574] : INFO : Epoch 1768 | loss: 0.0311218 | val_loss: 0.0311586 | Time: 5475.94 ms [2021-12-28 19:15:18 main:574] : INFO : Epoch 1769 | loss: 0.0311226 | val_loss: 0.0311599 | Time: 5262.74 ms [2021-12-28 19:15:24 main:574] : INFO : Epoch 1770 | loss: 0.0311201 | val_loss: 0.0311656 | Time: 5440.55 ms [2021-12-28 19:15:29 main:574] : INFO : Epoch 1771 | loss: 0.0311189 | val_loss: 0.0311581 | Time: 5269.9 ms [2021-12-28 19:15:34 main:574] : INFO : Epoch 1772 | loss: 0.0311199 | val_loss: 0.0311639 | Time: 5363.52 ms [2021-12-28 19:15:39 main:574] : INFO : Epoch 1773 | loss: 0.0311176 | val_loss: 0.0311689 | Time: 4979.52 ms [2021-12-28 19:15:44 main:574] : INFO : Epoch 1774 | loss: 0.0311227 | val_loss: 0.0311691 | Time: 4950.35 ms [2021-12-28 19:15:49 main:574] : INFO : Epoch 1775 | loss: 0.0311265 | val_loss: 0.0311703 | Time: 4948.14 ms [2021-12-28 19:15:54 main:574] : INFO : Epoch 1776 | loss: 0.031124 | val_loss: 0.0311636 | Time: 4923.14 ms [2021-12-28 19:15:59 main:574] : INFO : Epoch 1777 | loss: 0.0311236 | val_loss: 0.0311612 | Time: 4833.94 ms [2021-12-28 19:16:04 main:574] : INFO : Epoch 1778 | loss: 0.0311235 | val_loss: 0.0311618 | Time: 5179.86 ms [2021-12-28 19:16:09 main:574] : INFO : Epoch 1779 | loss: 0.031121 | val_loss: 0.0311668 | Time: 5460.47 ms [2021-12-28 19:16:15 main:574] : INFO : Epoch 1780 | loss: 0.0311238 | val_loss: 0.031168 | Time: 5322.01 ms [2021-12-28 19:16:20 main:574] : INFO : Epoch 1781 | loss: 0.0311201 | val_loss: 0.0311639 | Time: 5597.69 ms [2021-12-28 19:16:26 main:574] : INFO : Epoch 1782 | loss: 0.0311193 | val_loss: 0.0311635 | Time: 5284.24 ms [2021-12-28 19:16:31 main:574] : INFO : Epoch 1783 | loss: 0.0311185 | val_loss: 0.0311615 | Time: 5351.2 ms [2021-12-28 19:16:37 main:574] : INFO : Epoch 1784 | loss: 0.0311173 | val_loss: 0.0311653 | Time: 5540.51 ms [2021-12-28 19:16:42 main:574] : INFO : Epoch 1785 | loss: 0.0311208 | val_loss: 0.0311619 | Time: 5350.34 ms [2021-12-28 19:16:47 main:574] : INFO : Epoch 1786 | loss: 0.0311195 | val_loss: 0.0311632 | Time: 5393.6 ms [2021-12-28 19:16:53 main:574] : INFO : Epoch 1787 | loss: 0.0311199 | val_loss: 0.0311594 | Time: 5611.88 ms [2021-12-28 19:16:58 main:574] : INFO : Epoch 1788 | loss: 0.0311204 | val_loss: 0.0311662 | Time: 5128.84 ms [2021-12-28 19:17:03 main:574] : INFO : Epoch 1789 | loss: 0.0311159 | val_loss: 0.0311678 | Time: 4910.29 ms [2021-12-28 19:17:08 main:574] : INFO : Epoch 1790 | loss: 0.0311172 | val_loss: 0.0311665 | Time: 5267.52 ms [2021-12-28 19:17:14 main:574] : INFO : Epoch 1791 | loss: 0.0311158 | val_loss: 0.0311649 | Time: 5611.37 ms [2021-12-28 19:17:19 main:574] : INFO : Epoch 1792 | loss: 0.0311131 | val_loss: 0.0311679 | Time: 5214.98 ms [2021-12-28 19:17:24 main:574] : INFO : Epoch 1793 | loss: 0.031112 | val_loss: 0.0311691 | Time: 5146.44 ms [2021-12-28 19:17:30 main:574] : INFO : Epoch 1794 | loss: 0.0311098 | val_loss: 0.0311682 | Time: 5405.71 ms [2021-12-28 19:17:35 main:574] : INFO : Epoch 1795 | loss: 0.0311109 | val_loss: 0.0311634 | Time: 5117.51 ms [2021-12-28 19:17:40 main:574] : INFO : Epoch 1796 | loss: 0.0311095 | val_loss: 0.0311701 | Time: 5252.94 ms [2021-12-28 19:17:45 main:574] : INFO : Epoch 1797 | loss: 0.0311112 | val_loss: 0.0311701 | Time: 5057.62 ms [2021-12-28 19:17:50 main:574] : INFO : Epoch 1798 | loss: 0.0311124 | val_loss: 0.0311703 | Time: 5358.95 ms [2021-12-28 19:17:56 main:574] : INFO : Epoch 1799 | loss: 0.0311106 | val_loss: 0.0311715 | Time: 5303.24 ms [2021-12-28 19:18:01 main:574] : INFO : Epoch 1800 | loss: 0.0311115 | val_loss: 0.0311666 | Time: 5381.33 ms [2021-12-28 19:18:07 main:574] : INFO : Epoch 1801 | loss: 0.0311093 | val_loss: 0.0311678 | Time: 5473.32 ms [2021-12-28 19:18:12 main:574] : INFO : Epoch 1802 | loss: 0.0311085 | val_loss: 0.0311699 | Time: 5554.63 ms [2021-12-28 19:18:17 main:574] : INFO : Epoch 1803 | loss: 0.0311112 | val_loss: 0.0311675 | Time: 5181.38 ms [2021-12-28 19:18:23 main:574] : INFO : Epoch 1804 | loss: 0.0311099 | val_loss: 0.0311702 | Time: 5504.11 ms [2021-12-28 19:18:28 main:574] : INFO : Epoch 1805 | loss: 0.0311106 | val_loss: 0.0311739 | Time: 5476 ms [2021-12-28 19:18:33 main:574] : INFO : Epoch 1806 | loss: 0.031113 | val_loss: 0.0311729 | Time: 5017.66 ms [2021-12-28 19:18:38 main:574] : INFO : Epoch 1807 | loss: 0.0311093 | val_loss: 0.0311693 | Time: 4940.03 ms [2021-12-28 19:18:44 main:574] : INFO : Epoch 1808 | loss: 0.0311103 | val_loss: 0.0311683 | Time: 5204.05 ms [2021-12-28 19:18:49 main:574] : INFO : Epoch 1809 | loss: 0.0311145 | val_loss: 0.0311733 | Time: 5097.13 ms [2021-12-28 19:18:54 main:574] : INFO : Epoch 1810 | loss: 0.0311117 | val_loss: 0.0311679 | Time: 5236.94 ms [2021-12-28 19:18:59 main:574] : INFO : Epoch 1811 | loss: 0.0311084 | val_loss: 0.0311725 | Time: 5287.57 ms [2021-12-28 19:19:05 main:574] : INFO : Epoch 1812 | loss: 0.0311079 | val_loss: 0.0311725 | Time: 5481.56 ms [2021-12-28 19:19:10 main:574] : INFO : Epoch 1813 | loss: 0.0311076 | val_loss: 0.0311742 | Time: 5261.88 ms [2021-12-28 19:19:15 main:574] : INFO : Epoch 1814 | loss: 0.0311117 | val_loss: 0.031166 | Time: 5087.74 ms [2021-12-28 19:19:21 main:574] : INFO : Epoch 1815 | loss: 0.031109 | val_loss: 0.0311679 | Time: 5507.91 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1650) [2021-12-28 19:35:52 main:435] : INFO : Set logging level to 1 [2021-12-28 19:35:52 main:441] : INFO : Running in BOINC Client mode [2021-12-28 19:35:52 main:444] : INFO : Resolving all filenames [2021-12-28 19:35:52 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2021-12-28 19:35:52 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2021-12-28 19:35:52 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2021-12-28 19:35:52 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 0) [2021-12-28 19:35:52 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2021-12-28 19:35:52 main:472] : INFO : Dataset filename: dataset.hdf5 [2021-12-28 19:35:52 main:474] : INFO : Configuration: [2021-12-28 19:35:52 main:475] : INFO : Model type: GRU [2021-12-28 19:35:52 main:476] : INFO : Validation Loss Threshold: 0.0001 [2021-12-28 19:35:52 main:477] : INFO : Max Epochs: 2048 [2021-12-28 19:35:52 main:478] : INFO : Batch Size: 128 [2021-12-28 19:35:52 main:479] : INFO : Learning Rate: 0.01 [2021-12-28 19:35:52 main:480] : INFO : Patience: 10 [2021-12-28 19:35:52 main:481] : INFO : Hidden Width: 12 [2021-12-28 19:35:52 main:482] : INFO : # Recurrent Layers: 4 [2021-12-28 19:35:52 main:483] : INFO : # Backend Layers: 4 [2021-12-28 19:35:52 main:484] : INFO : # Threads: 1 [2021-12-28 19:35:52 main:486] : INFO : Preparing Dataset [2021-12-28 19:35:52 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2021-12-28 19:35:52 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2021-12-28 19:35:53 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2021-12-28 19:35:53 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2021-12-28 19:35:53 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2021-12-28 19:35:54 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2021-12-28 19:35:54 main:494] : INFO : Creating Model [2021-12-28 19:35:54 main:507] : INFO : Preparing config file [2021-12-28 19:35:54 main:511] : INFO : Found checkpoint, attempting to load... [2021-12-28 19:35:54 main:512] : INFO : Loading config [2021-12-28 19:35:54 main:514] : INFO : Loading state [2021-12-28 19:35:54 main:559] : INFO : Loading DataLoader into Memory [2021-12-28 19:35:54 main:562] : INFO : Starting Training [2021-12-28 19:35:58 main:574] : INFO : Epoch 1812 | loss: 0.0311468 | val_loss: 0.0311711 | Time: 3803.36 ms [2021-12-28 19:36:02 main:574] : INFO : Epoch 1813 | loss: 0.0311179 | val_loss: 0.0311733 | Time: 3811.58 ms [2021-12-28 19:36:06 main:574] : INFO : Epoch 1814 | loss: 0.0311121 | val_loss: 0.0311639 | Time: 3733.93 ms [2021-12-28 19:36:10 main:574] : INFO : Epoch 1815 | loss: 0.031109 | val_loss: 0.0311665 | Time: 3931.46 ms [2021-12-28 19:36:14 main:574] : INFO : Epoch 1816 | loss: 0.0311068 | val_loss: 0.0311767 | Time: 3900.64 ms [2021-12-28 19:36:18 main:574] : INFO : Epoch 1817 | loss: 0.0311137 | val_loss: 0.0311713 | Time: 3965.09 ms [2021-12-28 19:36:22 main:574] : INFO : Epoch 1818 | loss: 0.0311095 | val_loss: 0.0311723 | Time: 3940.17 ms [2021-12-28 19:36:26 main:574] : INFO : Epoch 1819 | loss: 0.0311079 | val_loss: 0.0311857 | Time: 4244.47 ms [2021-12-28 19:36:30 main:574] : INFO : Epoch 1820 | loss: 0.0311264 | val_loss: 0.0311613 | Time: 4085.07 ms [2021-12-28 19:36:34 main:574] : INFO : Epoch 1821 | loss: 0.0311254 | val_loss: 0.031161 | Time: 4225.33 ms [2021-12-28 19:36:38 main:574] : INFO : Epoch 1822 | loss: 0.0311179 | val_loss: 0.0311652 | Time: 4196.45 ms [2021-12-28 19:36:42 main:574] : INFO : Epoch 1823 | loss: 0.0311159 | val_loss: 0.0311669 | Time: 4130.59 ms [2021-12-28 19:36:47 main:574] : INFO : Epoch 1824 | loss: 0.0311115 | val_loss: 0.0311657 | Time: 4281.17 ms [2021-12-28 19:36:51 main:574] : INFO : Epoch 1825 | loss: 0.0311114 | val_loss: 0.0311683 | Time: 4151.32 ms [2021-12-28 19:37:05 main:574] : INFO : Epoch 1826 | loss: 0.0311091 | val_loss: 0.0311686 | Time: 14429.8 ms [2021-12-28 19:37:10 main:574] : INFO : Epoch 1827 | loss: 0.0311056 | val_loss: 0.031165 | Time: 4352.13 ms [2021-12-28 19:37:14 main:574] : INFO : Epoch 1828 | loss: 0.0311032 | val_loss: 0.0311703 | Time: 4037.55 ms [2021-12-28 19:37:18 main:574] : INFO : Epoch 1829 | loss: 0.0311058 | val_loss: 0.0311686 | Time: 4434.81 ms [2021-12-28 19:37:22 main:574] : INFO : Epoch 1830 | loss: 0.0311076 | val_loss: 0.0311778 | Time: 4292.42 ms [2021-12-28 19:37:28 main:574] : INFO : Epoch 1831 | loss: 0.0311056 | val_loss: 0.0311667 | Time: 5723.74 ms [2021-12-28 19:37:34 main:574] : INFO : Epoch 1832 | loss: 0.0311039 | val_loss: 0.0311733 | Time: 5507.08 ms [2021-12-28 19:37:39 main:574] : INFO : Epoch 1833 | loss: 0.031104 | val_loss: 0.031173 | Time: 5475.32 ms [2021-12-28 19:37:45 main:574] : INFO : Epoch 1834 | loss: 0.0311033 | val_loss: 0.0311715 | Time: 5505.33 ms [2021-12-28 19:37:50 main:574] : INFO : Epoch 1835 | loss: 0.0311025 | val_loss: 0.0311775 | Time: 5516.75 ms [2021-12-28 19:37:56 main:574] : INFO : Epoch 1836 | loss: 0.0311021 | val_loss: 0.0311699 | Time: 5363.01 ms [2021-12-28 19:38:01 main:574] : INFO : Epoch 1837 | loss: 0.0311011 | val_loss: 0.0311777 | Time: 5244.77 ms [2021-12-28 19:38:06 main:574] : INFO : Epoch 1838 | loss: 0.0311008 | val_loss: 0.0311746 | Time: 5354.93 ms [2021-12-28 19:38:12 main:574] : INFO : Epoch 1839 | loss: 0.0311021 | val_loss: 0.0311741 | Time: 5585.51 ms [2021-12-28 19:38:17 main:574] : INFO : Epoch 1840 | loss: 0.0311005 | val_loss: 0.0311677 | Time: 5245.72 ms [2021-12-28 19:38:22 main:574] : INFO : Epoch 1841 | loss: 0.0311024 | val_loss: 0.0311781 | Time: 5393.01 ms [2021-12-28 19:38:28 main:574] : INFO : Epoch 1842 | loss: 0.0310996 | val_loss: 0.0311751 | Time: 5576.54 ms [2021-12-28 19:38:33 main:574] : INFO : Epoch 1843 | loss: 0.0310996 | val_loss: 0.031181 | Time: 5317.77 ms [2021-12-28 19:38:39 main:574] : INFO : Epoch 1844 | loss: 0.0310997 | val_loss: 0.0311786 | Time: 5280.83 ms [2021-12-28 19:38:44 main:574] : INFO : Epoch 1845 | loss: 0.0310959 | val_loss: 0.031182 | Time: 5467.58 ms [2021-12-28 19:38:49 main:574] : INFO : Epoch 1846 | loss: 0.031101 | val_loss: 0.0311738 | Time: 5308.36 ms [2021-12-28 19:38:55 main:574] : INFO : Epoch 1847 | loss: 0.0311045 | val_loss: 0.0311725 | Time: 5354.07 ms [2021-12-28 19:39:02 main:574] : INFO : Epoch 1848 | loss: 0.0311018 | val_loss: 0.0311789 | Time: 7029.34 ms [2021-12-28 19:39:07 main:574] : INFO : Epoch 1849 | loss: 0.0311024 | val_loss: 0.0311757 | Time: 5275.99 ms [2021-12-28 19:39:12 main:574] : INFO : Epoch 1850 | loss: 0.0311022 | val_loss: 0.0311823 | Time: 5264.45 ms [2021-12-28 19:39:18 main:574] : INFO : Epoch 1851 | loss: 0.0311147 | val_loss: 0.0311813 | Time: 5403.8 ms [2021-12-28 19:39:23 main:574] : INFO : Epoch 1852 | loss: 0.031109 | val_loss: 0.031176 | Time: 5331.99 ms [2021-12-28 19:39:29 main:574] : INFO : Epoch 1853 | loss: 0.0311058 | val_loss: 0.0311771 | Time: 5499.85 ms [2021-12-28 19:39:34 main:574] : INFO : Epoch 1854 | loss: 0.0311041 | val_loss: 0.0311727 | Time: 5608.07 ms [2021-12-28 19:39:39 main:574] : INFO : Epoch 1855 | loss: 0.0311023 | val_loss: 0.0311764 | Time: 5262.53 ms [2021-12-28 19:39:44 main:574] : INFO : Epoch 1856 | loss: 0.031103 | val_loss: 0.0311752 | Time: 5055.27 ms [2021-12-28 19:39:50 main:574] : INFO : Epoch 1857 | loss: 0.0311025 | val_loss: 0.0311821 | Time: 5257.17 ms [2021-12-28 19:39:55 main:574] : INFO : Epoch 1858 | loss: 0.0311014 | val_loss: 0.0311779 | Time: 5732.53 ms [2021-12-28 19:40:01 main:574] : INFO : Epoch 1859 | loss: 0.0311012 | val_loss: 0.0311835 | Time: 5441.75 ms [2021-12-28 19:40:07 main:574] : INFO : Epoch 1860 | loss: 0.0311024 | val_loss: 0.0311849 | Time: 5605.01 ms [2021-12-28 19:40:12 main:574] : INFO : Epoch 1861 | loss: 0.0310995 | val_loss: 0.0311841 | Time: 5483.8 ms [2021-12-28 19:40:17 main:574] : INFO : Epoch 1862 | loss: 0.0311071 | val_loss: 0.0311773 | Time: 5228.84 ms [2021-12-28 19:40:23 main:574] : INFO : Epoch 1863 | loss: 0.0311032 | val_loss: 0.031177 | Time: 5290.21 ms [2021-12-28 19:40:28 main:574] : INFO : Epoch 1864 | loss: 0.0310999 | val_loss: 0.0311723 | Time: 5117.91 ms [2021-12-28 19:40:33 main:574] : INFO : Epoch 1865 | loss: 0.0310989 | val_loss: 0.031178 | Time: 5491.06 ms [2021-12-28 19:40:39 main:574] : INFO : Epoch 1866 | loss: 0.0311011 | val_loss: 0.0311827 | Time: 5440.5 ms [2021-12-28 19:40:44 main:574] : INFO : Epoch 1867 | loss: 0.0311021 | val_loss: 0.0311771 | Time: 5158.8 ms [2021-12-28 19:40:49 main:574] : INFO : Epoch 1868 | loss: 0.0311035 | val_loss: 0.0311792 | Time: 5245.96 ms [2021-12-28 19:40:54 main:574] : INFO : Epoch 1869 | loss: 0.0310981 | val_loss: 0.0311814 | Time: 5341.67 ms [2021-12-28 19:41:00 main:574] : INFO : Epoch 1870 | loss: 0.0310985 | val_loss: 0.0311755 | Time: 5282.54 ms [2021-12-28 19:41:05 main:574] : INFO : Epoch 1871 | loss: 0.0310995 | val_loss: 0.03118 | Time: 5044.65 ms [2021-12-28 19:41:10 main:574] : INFO : Epoch 1872 | loss: 0.0310998 | val_loss: 0.0311792 | Time: 5123.72 ms [2021-12-28 19:41:15 main:574] : INFO : Epoch 1873 | loss: 0.0311036 | val_loss: 0.0311771 | Time: 5364.8 ms [2021-12-28 19:41:21 main:574] : INFO : Epoch 1874 | loss: 0.0311056 | val_loss: 0.0311746 | Time: 5492.86 ms [2021-12-28 19:41:26 main:574] : INFO : Epoch 1875 | loss: 0.0311003 | val_loss: 0.0311762 | Time: 5200.74 ms [2021-12-28 19:41:31 main:574] : INFO : Epoch 1876 | loss: 0.031103 | val_loss: 0.0311802 | Time: 5463.46 ms [2021-12-28 19:41:36 main:574] : INFO : Epoch 1877 | loss: 0.0311116 | val_loss: 0.031177 | Time: 5056.3 ms [2021-12-28 19:41:42 main:574] : INFO : Epoch 1878 | loss: 0.0311088 | val_loss: 0.0311769 | Time: 5326.07 ms [2021-12-28 19:41:48 main:574] : INFO : Epoch 1879 | loss: 0.0311058 | val_loss: 0.0311791 | Time: 5698.89 ms [2021-12-28 19:41:53 main:574] : INFO : Epoch 1880 | loss: 0.0311022 | val_loss: 0.0311819 | Time: 5525.59 ms [2021-12-28 19:42:08 main:574] : INFO : Epoch 1881 | loss: 0.0310998 | val_loss: 0.0311883 | Time: 14619.2 ms [2021-12-28 19:42:11 main:574] : INFO : Epoch 1882 | loss: 0.0311016 | val_loss: 0.031178 | Time: 3690.19 ms [2021-12-28 19:42:15 main:574] : INFO : Epoch 1883 | loss: 0.0310974 | val_loss: 0.0311773 | Time: 4093.51 ms [2021-12-28 19:42:20 main:574] : INFO : Epoch 1884 | loss: 0.031099 | val_loss: 0.0311782 | Time: 4536.91 ms [2021-12-28 19:42:24 main:574] : INFO : Epoch 1885 | loss: 0.0310952 | val_loss: 0.031187 | Time: 4276.14 ms [2021-12-28 19:42:29 main:574] : INFO : Epoch 1886 | loss: 0.0310975 | val_loss: 0.0311755 | Time: 4729.54 ms [2021-12-28 19:42:34 main:574] : INFO : Epoch 1887 | loss: 0.0310966 | val_loss: 0.0311837 | Time: 4938.66 ms [2021-12-28 19:42:39 main:574] : INFO : Epoch 1888 | loss: 0.0310994 | val_loss: 0.0311786 | Time: 5005.58 ms [2021-12-28 19:42:45 main:574] : INFO : Epoch 1889 | loss: 0.0310981 | val_loss: 0.0311772 | Time: 5895.28 ms [2021-12-28 19:42:50 main:574] : INFO : Epoch 1890 | loss: 0.0310999 | val_loss: 0.031183 | Time: 5396.45 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1650) [2021-12-29 13:56:42 main:435] : INFO : Set logging level to 1 [2021-12-29 13:56:42 main:441] : INFO : Running in BOINC Client mode [2021-12-29 13:56:42 main:444] : INFO : Resolving all filenames [2021-12-29 13:56:42 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2021-12-29 13:56:42 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2021-12-29 13:56:42 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2021-12-29 13:56:42 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 0) [2021-12-29 13:56:42 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2021-12-29 13:56:42 main:472] : INFO : Dataset filename: dataset.hdf5 [2021-12-29 13:56:42 main:474] : INFO : Configuration: [2021-12-29 13:56:42 main:475] : INFO : Model type: GRU [2021-12-29 13:56:42 main:476] : INFO : Validation Loss Threshold: 0.0001 [2021-12-29 13:56:42 main:477] : INFO : Max Epochs: 2048 [2021-12-29 13:56:42 main:478] : INFO : Batch Size: 128 [2021-12-29 13:56:42 main:479] : INFO : Learning Rate: 0.01 [2021-12-29 13:56:42 main:480] : INFO : Patience: 10 [2021-12-29 13:56:42 main:481] : INFO : Hidden Width: 12 [2021-12-29 13:56:42 main:482] : INFO : # Recurrent Layers: 4 [2021-12-29 13:56:42 main:483] : INFO : # Backend Layers: 4 [2021-12-29 13:56:42 main:484] : INFO : # Threads: 1 [2021-12-29 13:56:42 main:486] : INFO : Preparing Dataset [2021-12-29 13:56:42 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2021-12-29 13:56:42 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2021-12-29 13:56:44 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2021-12-29 13:56:44 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2021-12-29 13:56:44 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2021-12-29 13:56:44 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2021-12-29 13:56:44 main:494] : INFO : Creating Model [2021-12-29 13:56:44 main:507] : INFO : Preparing config file [2021-12-29 13:56:44 main:511] : INFO : Found checkpoint, attempting to load... [2021-12-29 13:56:44 main:512] : INFO : Loading config [2021-12-29 13:56:44 main:514] : INFO : Loading state [2021-12-29 13:56:46 main:559] : INFO : Loading DataLoader into Memory [2021-12-29 13:56:46 main:562] : INFO : Starting Training [2021-12-29 13:56:51 main:574] : INFO : Epoch 1887 | loss: 0.0311382 | val_loss: 0.031184 | Time: 4852.46 ms [2021-12-29 13:57:04 main:574] : INFO : Epoch 1888 | loss: 0.0311088 | val_loss: 0.0311723 | Time: 13980.9 ms [2021-12-29 13:57:09 main:574] : INFO : Epoch 1889 | loss: 0.0311006 | val_loss: 0.0311807 | Time: 4027.65 ms [2021-12-29 13:57:13 main:574] : INFO : Epoch 1890 | loss: 0.0310976 | val_loss: 0.0311848 | Time: 4203.99 ms [2021-12-29 13:57:17 main:574] : INFO : Epoch 1891 | loss: 0.0310964 | val_loss: 0.0311767 | Time: 4114.9 ms [2021-12-29 13:57:21 main:574] : INFO : Epoch 1892 | loss: 0.0310968 | val_loss: 0.0311768 | Time: 4272.76 ms [2021-12-29 13:57:26 main:574] : INFO : Epoch 1893 | loss: 0.0310971 | val_loss: 0.031182 | Time: 4404.34 ms [2021-12-29 13:57:30 main:574] : INFO : Epoch 1894 | loss: 0.0310915 | val_loss: 0.0311847 | Time: 4359.66 ms [2021-12-29 13:57:34 main:574] : INFO : Epoch 1895 | loss: 0.0310917 | val_loss: 0.0311783 | Time: 4357.78 ms [2021-12-29 13:57:39 main:574] : INFO : Epoch 1896 | loss: 0.0311015 | val_loss: 0.0311823 | Time: 4312.03 ms [2021-12-29 13:57:43 main:574] : INFO : Epoch 1897 | loss: 0.0311076 | val_loss: 0.0311803 | Time: 4806.41 ms [2021-12-29 13:57:48 main:574] : INFO : Epoch 1898 | loss: 0.0311 | val_loss: 0.0311798 | Time: 4725.33 ms [2021-12-29 13:57:53 main:574] : INFO : Epoch 1899 | loss: 0.0310963 | val_loss: 0.0311773 | Time: 5338.67 ms [2021-12-29 13:57:59 main:574] : INFO : Epoch 1900 | loss: 0.0310963 | val_loss: 0.0311843 | Time: 5676.77 ms [2021-12-29 13:58:05 main:574] : INFO : Epoch 1901 | loss: 0.0311054 | val_loss: 0.0311823 | Time: 6076.47 ms [2021-12-29 13:58:12 main:574] : INFO : Epoch 1902 | loss: 0.031101 | val_loss: 0.0311737 | Time: 6300.21 ms [2021-12-29 13:58:18 main:574] : INFO : Epoch 1903 | loss: 0.0311109 | val_loss: 0.0311777 | Time: 6172.95 ms [2021-12-29 13:58:24 main:574] : INFO : Epoch 1904 | loss: 0.0311209 | val_loss: 0.0311751 | Time: 6058.17 ms [2021-12-29 13:58:30 main:574] : INFO : Epoch 1905 | loss: 0.0311159 | val_loss: 0.0311678 | Time: 6108.24 ms [2021-12-29 13:58:36 main:574] : INFO : Epoch 1906 | loss: 0.031114 | val_loss: 0.0311738 | Time: 5992.44 ms [2021-12-29 13:58:42 main:574] : INFO : Epoch 1907 | loss: 0.0311076 | val_loss: 0.0311768 | Time: 5920.21 ms [2021-12-29 13:58:48 main:574] : INFO : Epoch 1908 | loss: 0.0311007 | val_loss: 0.0311754 | Time: 5732.88 ms [2021-12-29 13:58:53 main:574] : INFO : Epoch 1909 | loss: 0.0311008 | val_loss: 0.0311779 | Time: 5519.93 ms [2021-12-29 13:58:59 main:574] : INFO : Epoch 1910 | loss: 0.0310978 | val_loss: 0.0311851 | Time: 5475.49 ms [2021-12-29 13:59:04 main:574] : INFO : Epoch 1911 | loss: 0.0310965 | val_loss: 0.031178 | Time: 5294.27 ms [2021-12-29 13:59:09 main:574] : INFO : Epoch 1912 | loss: 0.0310941 | val_loss: 0.0311817 | Time: 5385.69 ms [2021-12-29 13:59:15 main:574] : INFO : Epoch 1913 | loss: 0.0310914 | val_loss: 0.0311826 | Time: 5600.02 ms [2021-12-29 13:59:20 main:574] : INFO : Epoch 1914 | loss: 0.0310928 | val_loss: 0.0311821 | Time: 5306.95 ms [2021-12-29 13:59:26 main:574] : INFO : Epoch 1915 | loss: 0.0310901 | val_loss: 0.0311902 | Time: 5462.38 ms [2021-12-29 13:59:31 main:574] : INFO : Epoch 1916 | loss: 0.0310882 | val_loss: 0.0311828 | Time: 5803.63 ms [2021-12-29 13:59:37 main:574] : INFO : Epoch 1917 | loss: 0.0310883 | val_loss: 0.0311849 | Time: 5518.43 ms [2021-12-29 13:59:42 main:574] : INFO : Epoch 1918 | loss: 0.031087 | val_loss: 0.0311894 | Time: 5523.53 ms [2021-12-29 13:59:48 main:574] : INFO : Epoch 1919 | loss: 0.0310872 | val_loss: 0.0311862 | Time: 5390.07 ms [2021-12-29 13:59:53 main:574] : INFO : Epoch 1920 | loss: 0.0310913 | val_loss: 0.0311775 | Time: 5481.96 ms [2021-12-29 13:59:59 main:574] : INFO : Epoch 1921 | loss: 0.0310995 | val_loss: 0.0311887 | Time: 5575.25 ms [2021-12-29 14:00:04 main:574] : INFO : Epoch 1922 | loss: 0.0310942 | val_loss: 0.0311963 | Time: 5455.51 ms [2021-12-29 14:00:10 main:574] : INFO : Epoch 1923 | loss: 0.0310922 | val_loss: 0.0311883 | Time: 5440.83 ms [2021-12-29 14:00:15 main:574] : INFO : Epoch 1924 | loss: 0.031091 | val_loss: 0.0311967 | Time: 5438.92 ms [2021-12-29 14:00:21 main:574] : INFO : Epoch 1925 | loss: 0.03109 | val_loss: 0.031183 | Time: 5528.25 ms [2021-12-29 14:00:26 main:574] : INFO : Epoch 1926 | loss: 0.0310855 | val_loss: 0.0311882 | Time: 5461.8 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1650) [2021-12-29 14:03:41 main:435] : INFO : Set logging level to 1 [2021-12-29 14:03:41 main:441] : INFO : Running in BOINC Client mode [2021-12-29 14:03:41 main:444] : INFO : Resolving all filenames [2021-12-29 14:03:41 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2021-12-29 14:03:41 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2021-12-29 14:03:41 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2021-12-29 14:03:41 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 0) [2021-12-29 14:03:41 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2021-12-29 14:03:41 main:472] : INFO : Dataset filename: dataset.hdf5 [2021-12-29 14:03:41 main:474] : INFO : Configuration: [2021-12-29 14:03:41 main:475] : INFO : Model type: GRU [2021-12-29 14:03:41 main:476] : INFO : Validation Loss Threshold: 0.0001 [2021-12-29 14:03:41 main:477] : INFO : Max Epochs: 2048 [2021-12-29 14:03:41 main:478] : INFO : Batch Size: 128 [2021-12-29 14:03:41 main:479] : INFO : Learning Rate: 0.01 [2021-12-29 14:03:41 main:480] : INFO : Patience: 10 [2021-12-29 14:03:41 main:481] : INFO : Hidden Width: 12 [2021-12-29 14:03:41 main:482] : INFO : # Recurrent Layers: 4 [2021-12-29 14:03:41 main:483] : INFO : # Backend Layers: 4 [2021-12-29 14:03:41 main:484] : INFO : # Threads: 1 [2021-12-29 14:03:41 main:486] : INFO : Preparing Dataset [2021-12-29 14:03:41 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2021-12-29 14:03:41 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2021-12-29 14:03:43 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2021-12-29 14:03:43 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2021-12-29 14:03:43 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2021-12-29 14:03:43 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2021-12-29 14:03:43 main:494] : INFO : Creating Model [2021-12-29 14:03:43 main:507] : INFO : Preparing config file [2021-12-29 14:03:43 main:511] : INFO : Found checkpoint, attempting to load... [2021-12-29 14:03:43 main:512] : INFO : Loading config [2021-12-29 14:03:43 main:514] : INFO : Loading state [2021-12-29 14:03:44 main:559] : INFO : Loading DataLoader into Memory [2021-12-29 14:03:44 main:562] : INFO : Starting Training [2021-12-29 14:03:48 main:574] : INFO : Epoch 1922 | loss: 0.0311226 | val_loss: 0.0311807 | Time: 4333.8 ms [2021-12-29 14:03:53 main:574] : INFO : Epoch 1923 | loss: 0.0311051 | val_loss: 0.0311833 | Time: 4605.03 ms [2021-12-29 14:03:58 main:574] : INFO : Epoch 1924 | loss: 0.0311009 | val_loss: 0.0311741 | Time: 4901.21 ms [2021-12-29 14:04:02 main:574] : INFO : Epoch 1925 | loss: 0.0310986 | val_loss: 0.0311813 | Time: 4851.99 ms [2021-12-29 14:04:07 main:574] : INFO : Epoch 1926 | loss: 0.0310938 | val_loss: 0.031187 | Time: 4862.24 ms [2021-12-29 14:04:12 main:574] : INFO : Epoch 1927 | loss: 0.0310986 | val_loss: 0.0311857 | Time: 4947.15 ms [2021-12-29 14:04:17 main:574] : INFO : Epoch 1928 | loss: 0.031095 | val_loss: 0.0311839 | Time: 4941.9 ms [2021-12-29 14:04:22 main:574] : INFO : Epoch 1929 | loss: 0.0310912 | val_loss: 0.0311842 | Time: 4893.05 ms [2021-12-29 14:04:27 main:574] : INFO : Epoch 1930 | loss: 0.0310898 | val_loss: 0.0311872 | Time: 4994.13 ms [2021-12-29 14:04:32 main:574] : INFO : Epoch 1931 | loss: 0.0310896 | val_loss: 0.0311893 | Time: 4882.78 ms [2021-12-29 14:04:37 main:574] : INFO : Epoch 1932 | loss: 0.031088 | val_loss: 0.0311853 | Time: 4887.99 ms [2021-12-29 14:04:42 main:574] : INFO : Epoch 1933 | loss: 0.0310889 | val_loss: 0.0311802 | Time: 4935.08 ms [2021-12-29 14:04:47 main:574] : INFO : Epoch 1934 | loss: 0.0310884 | val_loss: 0.0311786 | Time: 5145.08 ms [2021-12-29 14:04:53 main:574] : INFO : Epoch 1935 | loss: 0.0310885 | val_loss: 0.0311857 | Time: 5876.35 ms [2021-12-29 14:04:59 main:574] : INFO : Epoch 1936 | loss: 0.0310916 | val_loss: 0.0311807 | Time: 6252.01 ms [2021-12-29 14:05:05 main:574] : INFO : Epoch 1937 | loss: 0.0310884 | val_loss: 0.0311948 | Time: 6032.22 ms [2021-12-29 14:05:12 main:574] : INFO : Epoch 1938 | loss: 0.0310867 | val_loss: 0.0311849 | Time: 6537.69 ms [2021-12-29 14:05:17 main:574] : INFO : Epoch 1939 | loss: 0.0310864 | val_loss: 0.0311933 | Time: 5739.74 ms [2021-12-29 14:05:23 main:574] : INFO : Epoch 1940 | loss: 0.0310902 | val_loss: 0.031198 | Time: 6010.88 ms [2021-12-29 14:05:29 main:574] : INFO : Epoch 1941 | loss: 0.0310895 | val_loss: 0.031187 | Time: 5511.13 ms [2021-12-29 14:05:34 main:574] : INFO : Epoch 1942 | loss: 0.0310893 | val_loss: 0.0311877 | Time: 5433.95 ms [2021-12-29 14:05:40 main:574] : INFO : Epoch 1943 | loss: 0.0310894 | val_loss: 0.0311858 | Time: 5607.15 ms [2021-12-29 14:05:45 main:574] : INFO : Epoch 1944 | loss: 0.0311074 | val_loss: 0.0311729 | Time: 5365.85 ms [2021-12-29 14:05:51 main:574] : INFO : Epoch 1945 | loss: 0.0311282 | val_loss: 0.0311647 | Time: 5470.71 ms [2021-12-29 14:05:56 main:574] : INFO : Epoch 1946 | loss: 0.0311192 | val_loss: 0.0311656 | Time: 5546.62 ms [2021-12-29 14:06:02 main:574] : INFO : Epoch 1947 | loss: 0.0311122 | val_loss: 0.0311677 | Time: 5264.94 ms [2021-12-29 14:06:06 main:574] : INFO : Epoch 1948 | loss: 0.0311048 | val_loss: 0.0311663 | Time: 4590.73 ms [2021-12-29 14:06:11 main:574] : INFO : Epoch 1949 | loss: 0.0311011 | val_loss: 0.03117 | Time: 5111.58 ms [2021-12-29 14:06:16 main:574] : INFO : Epoch 1950 | loss: 0.0310987 | val_loss: 0.0311686 | Time: 5151.76 ms [2021-12-29 14:06:22 main:574] : INFO : Epoch 1951 | loss: 0.0311003 | val_loss: 0.0311725 | Time: 5075.46 ms [2021-12-29 14:06:27 main:574] : INFO : Epoch 1952 | loss: 0.0310974 | val_loss: 0.0311813 | Time: 5549.58 ms [2021-12-29 14:06:33 main:574] : INFO : Epoch 1953 | loss: 0.031093 | val_loss: 0.0311792 | Time: 5498.42 ms [2021-12-29 14:06:38 main:574] : INFO : Epoch 1954 | loss: 0.0310905 | val_loss: 0.0311822 | Time: 5435.2 ms [2021-12-29 14:06:44 main:574] : INFO : Epoch 1955 | loss: 0.0310867 | val_loss: 0.0311818 | Time: 5449.61 ms [2021-12-29 14:06:59 main:574] : INFO : Epoch 1956 | loss: 0.0310917 | val_loss: 0.0311773 | Time: 15584.2 ms [2021-12-29 14:07:04 main:574] : INFO : Epoch 1957 | loss: 0.0310936 | val_loss: 0.031183 | Time: 4536.08 ms [2021-12-29 14:07:08 main:574] : INFO : Epoch 1958 | loss: 0.0310996 | val_loss: 0.0311795 | Time: 4644.06 ms [2021-12-29 14:07:13 main:574] : INFO : Epoch 1959 | loss: 0.0310979 | val_loss: 0.0311814 | Time: 4563.32 ms [2021-12-29 14:07:17 main:574] : INFO : Epoch 1960 | loss: 0.0310925 | val_loss: 0.0311949 | Time: 4615.12 ms [2021-12-29 14:07:23 main:574] : INFO : Epoch 1961 | loss: 0.0310888 | val_loss: 0.0311805 | Time: 5282.01 ms [2021-12-29 14:07:28 main:574] : INFO : Epoch 1962 | loss: 0.031091 | val_loss: 0.0311805 | Time: 5430.64 ms [2021-12-29 14:07:34 main:574] : INFO : Epoch 1963 | loss: 0.0310894 | val_loss: 0.031186 | Time: 5442.07 ms [2021-12-29 14:07:39 main:574] : INFO : Epoch 1964 | loss: 0.0310848 | val_loss: 0.0311924 | Time: 5456.99 ms [2021-12-29 14:07:45 main:574] : INFO : Epoch 1965 | loss: 0.0310855 | val_loss: 0.031192 | Time: 5502.59 ms [2021-12-29 14:07:50 main:574] : INFO : Epoch 1966 | loss: 0.0310884 | val_loss: 0.0311893 | Time: 5465.5 ms [2021-12-29 14:07:56 main:574] : INFO : Epoch 1967 | loss: 0.0310936 | val_loss: 0.0311892 | Time: 5853.65 ms [2021-12-29 14:08:01 main:574] : INFO : Epoch 1968 | loss: 0.0310905 | val_loss: 0.0311804 | Time: 5515.53 ms [2021-12-29 14:08:07 main:574] : INFO : Epoch 1969 | loss: 0.0310921 | val_loss: 0.031188 | Time: 5535.51 ms [2021-12-29 14:08:13 main:574] : INFO : Epoch 1970 | loss: 0.0310884 | val_loss: 0.0311881 | Time: 5701.12 ms [2021-12-29 14:08:18 main:574] : INFO : Epoch 1971 | loss: 0.031086 | val_loss: 0.0311855 | Time: 5619.47 ms [2021-12-29 14:08:24 main:574] : INFO : Epoch 1972 | loss: 0.0310871 | val_loss: 0.031187 | Time: 5405.95 ms [2021-12-29 14:08:29 main:574] : INFO : Epoch 1973 | loss: 0.0310868 | val_loss: 0.0311807 | Time: 5420.93 ms [2021-12-29 14:08:35 main:574] : INFO : Epoch 1974 | loss: 0.0310888 | val_loss: 0.0311847 | Time: 5433.95 ms [2021-12-29 14:08:40 main:574] : INFO : Epoch 1975 | loss: 0.0310921 | val_loss: 0.0311961 | Time: 5400.85 ms [2021-12-29 14:08:46 main:574] : INFO : Epoch 1976 | loss: 0.0310886 | val_loss: 0.0311908 | Time: 5517.11 ms [2021-12-29 14:08:51 main:574] : INFO : Epoch 1977 | loss: 0.0310837 | val_loss: 0.0312014 | Time: 5676.79 ms [2021-12-29 14:08:57 main:574] : INFO : Epoch 1978 | loss: 0.0310849 | val_loss: 0.0311875 | Time: 5417.69 ms [2021-12-29 14:09:02 main:574] : INFO : Epoch 1979 | loss: 0.031088 | val_loss: 0.0311873 | Time: 5536.59 ms [2021-12-29 14:09:08 main:574] : INFO : Epoch 1980 | loss: 0.0310881 | val_loss: 0.0311942 | Time: 5402.39 ms [2021-12-29 14:09:13 main:574] : INFO : Epoch 1981 | loss: 0.0310868 | val_loss: 0.0311913 | Time: 5121.54 ms [2021-12-29 14:09:18 main:574] : INFO : Epoch 1982 | loss: 0.0310873 | val_loss: 0.0311814 | Time: 5083.13 ms [2021-12-29 14:09:22 main:574] : INFO : Epoch 1983 | loss: 0.0310908 | val_loss: 0.0311859 | Time: 4678.37 ms [2021-12-29 14:09:28 main:574] : INFO : Epoch 1984 | loss: 0.0310902 | val_loss: 0.0311762 | Time: 5437.05 ms [2021-12-29 14:09:34 main:574] : INFO : Epoch 1985 | loss: 0.0310985 | val_loss: 0.0311823 | Time: 5845.66 ms [2021-12-29 14:09:39 main:574] : INFO : Epoch 1986 | loss: 0.0310924 | val_loss: 0.0311788 | Time: 5527.39 ms [2021-12-29 14:09:45 main:574] : INFO : Epoch 1987 | loss: 0.0310919 | val_loss: 0.0311873 | Time: 5480.66 ms [2021-12-29 14:09:50 main:574] : INFO : Epoch 1988 | loss: 0.0310851 | val_loss: 0.0311904 | Time: 5297.67 ms [2021-12-29 14:09:56 main:574] : INFO : Epoch 1989 | loss: 0.0310829 | val_loss: 0.0311923 | Time: 5613.05 ms [2021-12-29 14:10:01 main:574] : INFO : Epoch 1990 | loss: 0.0310801 | val_loss: 0.0312023 | Time: 5602.4 ms [2021-12-29 14:10:07 main:574] : INFO : Epoch 1991 | loss: 0.0310836 | val_loss: 0.0311863 | Time: 5348.61 ms [2021-12-29 14:10:12 main:574] : INFO : Epoch 1992 | loss: 0.0310844 | val_loss: 0.0311953 | Time: 5528.86 ms [2021-12-29 14:10:18 main:574] : INFO : Epoch 1993 | loss: 0.031079 | val_loss: 0.0311862 | Time: 5483.1 ms [2021-12-29 14:10:23 main:574] : INFO : Epoch 1994 | loss: 0.0310814 | val_loss: 0.0311937 | Time: 5469.78 ms [2021-12-29 14:10:29 main:574] : INFO : Epoch 1995 | loss: 0.0310776 | val_loss: 0.0311958 | Time: 5786.36 ms [2021-12-29 14:10:34 main:574] : INFO : Epoch 1996 | loss: 0.03108 | val_loss: 0.0311953 | Time: 5533.57 ms [2021-12-29 14:10:40 main:574] : INFO : Epoch 1997 | loss: 0.0310845 | val_loss: 0.0311821 | Time: 5380.35 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1650) [2021-12-29 14:41:17 main:435] : INFO : Set logging level to 1 [2021-12-29 14:41:17 main:441] : INFO : Running in BOINC Client mode [2021-12-29 14:41:17 main:444] : INFO : Resolving all filenames [2021-12-29 14:41:17 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2021-12-29 14:41:17 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2021-12-29 14:41:17 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2021-12-29 14:41:17 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 0) [2021-12-29 14:41:17 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2021-12-29 14:41:17 main:472] : INFO : Dataset filename: dataset.hdf5 [2021-12-29 14:41:17 main:474] : INFO : Configuration: [2021-12-29 14:41:17 main:475] : INFO : Model type: GRU [2021-12-29 14:41:17 main:476] : INFO : Validation Loss Threshold: 0.0001 [2021-12-29 14:41:17 main:477] : INFO : Max Epochs: 2048 [2021-12-29 14:41:17 main:478] : INFO : Batch Size: 128 [2021-12-29 14:41:17 main:479] : INFO : Learning Rate: 0.01 [2021-12-29 14:41:17 main:480] : INFO : Patience: 10 [2021-12-29 14:41:17 main:481] : INFO : Hidden Width: 12 [2021-12-29 14:41:17 main:482] : INFO : # Recurrent Layers: 4 [2021-12-29 14:41:17 main:483] : INFO : # Backend Layers: 4 [2021-12-29 14:41:17 main:484] : INFO : # Threads: 1 [2021-12-29 14:41:17 main:486] : INFO : Preparing Dataset [2021-12-29 14:41:17 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2021-12-29 14:41:17 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2021-12-29 14:41:19 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2021-12-29 14:41:19 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2021-12-29 14:41:19 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2021-12-29 14:41:19 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2021-12-29 14:41:19 main:494] : INFO : Creating Model [2021-12-29 14:41:19 main:507] : INFO : Preparing config file [2021-12-29 14:41:19 main:511] : INFO : Found checkpoint, attempting to load... [2021-12-29 14:41:19 main:512] : INFO : Loading config [2021-12-29 14:41:19 main:514] : INFO : Loading state [2021-12-29 14:41:20 main:559] : INFO : Loading DataLoader into Memory [2021-12-29 14:41:20 main:562] : INFO : Starting Training [2021-12-29 14:41:24 main:574] : INFO : Epoch 1994 | loss: 0.0311238 | val_loss: 0.0311969 | Time: 3988.03 ms [2021-12-29 14:41:27 main:574] : INFO : Epoch 1995 | loss: 0.0310947 | val_loss: 0.0311828 | Time: 3643.53 ms [2021-12-29 14:41:31 main:574] : INFO : Epoch 1996 | loss: 0.0310916 | val_loss: 0.0311825 | Time: 3737.43 ms [2021-12-29 14:41:35 main:574] : INFO : Epoch 1997 | loss: 0.0310865 | val_loss: 0.0311892 | Time: 3887.15 ms [2021-12-29 14:41:39 main:574] : INFO : Epoch 1998 | loss: 0.0310854 | val_loss: 0.0311883 | Time: 3842.4 ms [2021-12-29 14:41:43 main:574] : INFO : Epoch 1999 | loss: 0.0310841 | val_loss: 0.031192 | Time: 4119.22 ms [2021-12-29 14:41:47 main:574] : INFO : Epoch 2000 | loss: 0.0310859 | val_loss: 0.031185 | Time: 3955.67 ms [2021-12-29 14:41:51 main:574] : INFO : Epoch 2001 | loss: 0.0310846 | val_loss: 0.0311964 | Time: 4124.19 ms [2021-12-29 14:41:55 main:574] : INFO : Epoch 2002 | loss: 0.0310813 | val_loss: 0.0311939 | Time: 4301.85 ms [2021-12-29 14:42:10 main:574] : INFO : Epoch 2003 | loss: 0.0310796 | val_loss: 0.0311865 | Time: 14156.5 ms [2021-12-29 14:42:14 main:574] : INFO : Epoch 2004 | loss: 0.0310858 | val_loss: 0.0311924 | Time: 4047.14 ms [2021-12-29 14:42:18 main:574] : INFO : Epoch 2005 | loss: 0.0310866 | val_loss: 0.0311859 | Time: 4240.93 ms [2021-12-29 14:42:22 main:574] : INFO : Epoch 2006 | loss: 0.031082 | val_loss: 0.0311898 | Time: 4070.17 ms [2021-12-29 14:42:26 main:574] : INFO : Epoch 2007 | loss: 0.0310823 | val_loss: 0.0311912 | Time: 4144.49 ms [2021-12-29 14:42:30 main:574] : INFO : Epoch 2008 | loss: 0.0310867 | val_loss: 0.0311947 | Time: 4243.88 ms [2021-12-29 14:42:34 main:574] : INFO : Epoch 2009 | loss: 0.0310862 | val_loss: 0.0311904 | Time: 4128.84 ms [2021-12-29 14:42:39 main:574] : INFO : Epoch 2010 | loss: 0.0310819 | val_loss: 0.0311745 | Time: 4119.11 ms [2021-12-29 14:42:43 main:574] : INFO : Epoch 2011 | loss: 0.0310863 | val_loss: 0.0311837 | Time: 4334.13 ms [2021-12-29 14:42:47 main:574] : INFO : Epoch 2012 | loss: 0.0310824 | val_loss: 0.0311858 | Time: 4198.54 ms [2021-12-29 14:42:51 main:574] : INFO : Epoch 2013 | loss: 0.0310813 | val_loss: 0.0311899 | Time: 4144.68 ms [2021-12-29 14:42:56 main:574] : INFO : Epoch 2014 | loss: 0.0310812 | val_loss: 0.0311905 | Time: 4460.4 ms [2021-12-29 14:43:01 main:574] : INFO : Epoch 2015 | loss: 0.0310907 | val_loss: 0.031188 | Time: 5515.1 ms [2021-12-29 14:43:07 main:574] : INFO : Epoch 2016 | loss: 0.0310863 | val_loss: 0.031194 | Time: 5467.9 ms [2021-12-29 14:43:12 main:574] : INFO : Epoch 2017 | loss: 0.0310846 | val_loss: 0.0311866 | Time: 5605.53 ms [2021-12-29 14:43:18 main:574] : INFO : Epoch 2018 | loss: 0.0310875 | val_loss: 0.0311833 | Time: 5424 ms [2021-12-29 14:43:23 main:574] : INFO : Epoch 2019 | loss: 0.0310971 | val_loss: 0.0311857 | Time: 5283.55 ms [2021-12-29 14:43:29 main:574] : INFO : Epoch 2020 | loss: 0.0310908 | val_loss: 0.0311885 | Time: 5635.16 ms [2021-12-29 14:43:34 main:574] : INFO : Epoch 2021 | loss: 0.0310864 | val_loss: 0.0311863 | Time: 5319.63 ms [2021-12-29 14:43:40 main:574] : INFO : Epoch 2022 | loss: 0.0310843 | val_loss: 0.0311842 | Time: 5351.38 ms [2021-12-29 14:43:45 main:574] : INFO : Epoch 2023 | loss: 0.0310845 | val_loss: 0.0311853 | Time: 5391.43 ms [2021-12-29 14:43:51 main:574] : INFO : Epoch 2024 | loss: 0.0310816 | val_loss: 0.0311977 | Time: 5528.54 ms [2021-12-29 14:43:56 main:574] : INFO : Epoch 2025 | loss: 0.0310791 | val_loss: 0.0311882 | Time: 5372.85 ms [2021-12-29 14:44:01 main:574] : INFO : Epoch 2026 | loss: 0.0310778 | val_loss: 0.0311957 | Time: 5336.3 ms [2021-12-29 14:44:07 main:574] : INFO : Epoch 2027 | loss: 0.0310755 | val_loss: 0.0311863 | Time: 5452.2 ms [2021-12-29 14:44:12 main:574] : INFO : Epoch 2028 | loss: 0.0310823 | val_loss: 0.0311905 | Time: 5395.52 ms [2021-12-29 14:44:18 main:574] : INFO : Epoch 2029 | loss: 0.0310871 | val_loss: 0.031193 | Time: 5533.64 ms [2021-12-29 14:44:23 main:574] : INFO : Epoch 2030 | loss: 0.0310793 | val_loss: 0.0311899 | Time: 5397.69 ms [2021-12-29 14:44:29 main:574] : INFO : Epoch 2031 | loss: 0.0310784 | val_loss: 0.0312013 | Time: 5356.66 ms [2021-12-29 14:44:34 main:574] : INFO : Epoch 2032 | loss: 0.0310779 | val_loss: 0.0311998 | Time: 5394.36 ms [2021-12-29 14:44:39 main:574] : INFO : Epoch 2033 | loss: 0.0310734 | val_loss: 0.0311937 | Time: 5314.2 ms [2021-12-29 14:44:45 main:574] : INFO : Epoch 2034 | loss: 0.0310718 | val_loss: 0.0312028 | Time: 5388.11 ms [2021-12-29 14:44:50 main:574] : INFO : Epoch 2035 | loss: 0.0310737 | val_loss: 0.0311981 | Time: 5294.97 ms [2021-12-29 14:44:55 main:574] : INFO : Epoch 2036 | loss: 0.031076 | val_loss: 0.031203 | Time: 5348.76 ms [2021-12-29 14:45:00 main:574] : INFO : Epoch 2037 | loss: 0.0310735 | val_loss: 0.0311841 | Time: 4952.41 ms [2021-12-29 14:45:05 main:574] : INFO : Epoch 2038 | loss: 0.0310771 | val_loss: 0.0311941 | Time: 5006.36 ms [2021-12-29 14:45:10 main:574] : INFO : Epoch 2039 | loss: 0.0310806 | val_loss: 0.0311962 | Time: 5230.82 ms [2021-12-29 14:45:16 main:574] : INFO : Epoch 2040 | loss: 0.0310813 | val_loss: 0.0311861 | Time: 5429.51 ms [2021-12-29 14:45:21 main:574] : INFO : Epoch 2041 | loss: 0.0310807 | val_loss: 0.031191 | Time: 5168.88 ms [2021-12-29 14:45:26 main:574] : INFO : Epoch 2042 | loss: 0.0310933 | val_loss: 0.0311873 | Time: 5391.58 ms [2021-12-29 14:45:32 main:574] : INFO : Epoch 2043 | loss: 0.0310916 | val_loss: 0.0311955 | Time: 5317.34 ms [2021-12-29 14:45:37 main:574] : INFO : Epoch 2044 | loss: 0.0310864 | val_loss: 0.0311862 | Time: 5427.62 ms [2021-12-29 14:45:43 main:574] : INFO : Epoch 2045 | loss: 0.0310824 | val_loss: 0.0311924 | Time: 5408.42 ms [2021-12-29 14:45:48 main:574] : INFO : Epoch 2046 | loss: 0.0310786 | val_loss: 0.0311787 | Time: 5325.26 ms [2021-12-29 14:45:53 main:574] : INFO : Epoch 2047 | loss: 0.0310791 | val_loss: 0.0311917 | Time: 5442.61 ms [2021-12-29 14:45:59 main:574] : INFO : Epoch 2048 | loss: 0.0310793 | val_loss: 0.0311849 | Time: 5422.96 ms [2021-12-29 14:45:59 main:597] : INFO : Saving trained model to model-final.pt, val_loss 0.0311849 [2021-12-29 14:45:59 main:603] : INFO : Saving end state to config to file [2021-12-29 14:45:59 main:608] : INFO : Success, exiting.. 14:45:59 (21272): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)