Task 11189789
| Name | ParityModified-1639947713-1187-3-0_0 |
| Workunit | 8464817 |
| Created | 31 Jan 2022, 2:02:51 UTC |
| Sent | 15 Feb 2022, 18:12:28 UTC |
| Report deadline | 23 Feb 2022, 18:12:28 UTC |
| Received | 27 Feb 2022, 21:34:52 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 14544 |
| Run time | 1 hours 8 min 35 sec |
| CPU time | 1 hours 6 min 48 sec |
| Validate state | Task was reported too late to validate |
| Credit | 0.00 |
| Device peak FLOPS | 3,199.35 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 2.08 GB |
| Peak swap size | 4.31 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version> <![CDATA[ <stderr_txt> 11701 | Time: 1858.7 ms [2022-02-27 11:50:48 main:574] : INFO : Epoch 1750 | loss: 0.031139 | val_loss: 0.0311706 | Time: 1851.8 ms [2022-02-27 11:50:49 main:574] : INFO : Epoch 1751 | loss: 0.0311389 | val_loss: 0.0311678 | Time: 1859.98 ms [2022-02-27 11:50:51 main:574] : INFO : Epoch 1752 | loss: 0.0311382 | val_loss: 0.0311699 | Time: 1842.7 ms [2022-02-27 11:50:53 main:574] : INFO : Epoch 1753 | loss: 0.0311407 | val_loss: 0.0311721 | Time: 1867.88 ms [2022-02-27 11:50:55 main:574] : INFO : Epoch 1754 | loss: 0.0311392 | val_loss: 0.0311708 | Time: 1834.62 ms [2022-02-27 11:50:57 main:574] : INFO : Epoch 1755 | loss: 0.0311389 | val_loss: 0.0311716 | Time: 1856.17 ms [2022-02-27 11:50:59 main:574] : INFO : Epoch 1756 | loss: 0.0311402 | val_loss: 0.0311733 | Time: 1869.4 ms [2022-02-27 11:51:01 main:574] : INFO : Epoch 1757 | loss: 0.0311404 | val_loss: 0.0311746 | Time: 1860.99 ms [2022-02-27 11:51:02 main:574] : INFO : Epoch 1758 | loss: 0.0311379 | val_loss: 0.0311702 | Time: 1851.65 ms [2022-02-27 11:51:04 main:574] : INFO : Epoch 1759 | loss: 0.031138 | val_loss: 0.031169 | Time: 1855.5 ms [2022-02-27 11:51:06 main:574] : INFO : Epoch 1760 | loss: 0.0311375 | val_loss: 0.0311709 | Time: 1859.89 ms [2022-02-27 11:51:08 main:574] : INFO : Epoch 1761 | loss: 0.0311378 | val_loss: 0.0311759 | Time: 1860.27 ms [2022-02-27 11:51:10 main:574] : INFO : Epoch 1762 | loss: 0.0311383 | val_loss: 0.0311691 | Time: 1853.22 ms [2022-02-27 11:51:12 main:574] : INFO : Epoch 1763 | loss: 0.0311377 | val_loss: 0.0311735 | Time: 1889.92 ms [2022-02-27 11:51:14 main:574] : INFO : Epoch 1764 | loss: 0.0311361 | val_loss: 0.0311708 | Time: 1887.23 ms [2022-02-27 11:51:16 main:574] : INFO : Epoch 1765 | loss: 0.0311373 | val_loss: 0.0311706 | Time: 1842.45 ms [2022-02-27 11:51:17 main:574] : INFO : Epoch 1766 | loss: 0.03114 | val_loss: 0.0311689 | Time: 1877.88 ms [2022-02-27 11:51:19 main:574] : INFO : Epoch 1767 | loss: 0.0311397 | val_loss: 0.0311702 | Time: 1875.61 ms [2022-02-27 11:51:21 main:574] : INFO : Epoch 1768 | loss: 0.0311414 | val_loss: 0.0311702 | Time: 1875.88 ms [2022-02-27 11:51:23 main:574] : INFO : Epoch 1769 | loss: 0.0311397 | val_loss: 0.0311725 | Time: 1862.91 ms [2022-02-27 11:51:25 main:574] : INFO : Epoch 1770 | loss: 0.0311388 | val_loss: 0.0311729 | Time: 1891.17 ms [2022-02-27 11:51:27 main:574] : INFO : Epoch 1771 | loss: 0.0311391 | val_loss: 0.0311688 | Time: 1917.67 ms [2022-02-27 11:51:29 main:574] : INFO : Epoch 1772 | loss: 0.0311387 | val_loss: 0.0311661 | Time: 1874.99 ms [2022-02-27 11:51:31 main:574] : INFO : Epoch 1773 | loss: 0.0311381 | val_loss: 0.031167 | Time: 1869.24 ms [2022-02-27 11:51:32 main:574] : INFO : Epoch 1774 | loss: 0.0311379 | val_loss: 0.0311695 | Time: 1865.61 ms [2022-02-27 11:51:34 main:574] : INFO : Epoch 1775 | loss: 0.0311362 | val_loss: 0.0311709 | Time: 1883.08 ms [2022-02-27 11:51:36 main:574] : INFO : Epoch 1776 | loss: 0.0311369 | val_loss: 0.0311647 | Time: 1864.41 ms [2022-02-27 11:51:38 main:574] : INFO : Epoch 1777 | loss: 0.0311373 | val_loss: 0.0311738 | Time: 1877.29 ms [2022-02-27 11:51:40 main:574] : INFO : Epoch 1778 | loss: 0.0311369 | val_loss: 0.0311643 | Time: 1884.58 ms [2022-02-27 11:51:42 main:574] : INFO : Epoch 1779 | loss: 0.0311368 | val_loss: 0.0311669 | Time: 1872.71 ms [2022-02-27 11:51:44 main:574] : INFO : Epoch 1780 | loss: 0.031137 | val_loss: 0.0311686 | Time: 1862.5 ms [2022-02-27 11:51:46 main:574] : INFO : Epoch 1781 | loss: 0.0311361 | val_loss: 0.0311684 | Time: 1880.67 ms [2022-02-27 11:51:48 main:574] : INFO : Epoch 1782 | loss: 0.0311373 | val_loss: 0.031167 | Time: 1875.42 ms [2022-02-27 11:51:49 main:574] : INFO : Epoch 1783 | loss: 0.0311357 | val_loss: 0.0311675 | Time: 1867.52 ms [2022-02-27 11:51:51 main:574] : INFO : Epoch 1784 | loss: 0.031137 | val_loss: 0.0311649 | Time: 1883.2 ms [2022-02-27 11:51:53 main:574] : INFO : Epoch 1785 | loss: 0.0311379 | val_loss: 0.0311668 | Time: 1869.02 ms [2022-02-27 11:51:55 main:574] : INFO : Epoch 1786 | loss: 0.0311385 | val_loss: 0.0311697 | Time: 1876.18 ms [2022-02-27 11:51:57 main:574] : INFO : Epoch 1787 | loss: 0.0311387 | val_loss: 0.031166 | Time: 1862.77 ms [2022-02-27 11:51:59 main:574] : INFO : Epoch 1788 | loss: 0.0311384 | val_loss: 0.0311722 | Time: 1870.35 ms [2022-02-27 11:52:01 main:574] : INFO : Epoch 1789 | loss: 0.0311388 | val_loss: 0.0311699 | Time: 1891.91 ms [2022-02-27 11:52:03 main:574] : INFO : Epoch 1790 | loss: 0.0311371 | val_loss: 0.0311689 | Time: 1869.49 ms [2022-02-27 11:52:04 main:574] : INFO : Epoch 1791 | loss: 0.0311374 | val_loss: 0.0311701 | Time: 1879.62 ms [2022-02-27 11:52:06 main:574] : INFO : Epoch 1792 | loss: 0.0311379 | val_loss: 0.0311684 | Time: 1871.08 ms [2022-02-27 11:52:08 main:574] : INFO : Epoch 1793 | loss: 0.0311391 | val_loss: 0.0311707 | Time: 1889.39 ms [2022-02-27 11:52:10 main:574] : INFO : Epoch 1794 | loss: 0.0311386 | val_loss: 0.0311746 | Time: 1876 ms [2022-02-27 11:52:12 main:574] : INFO : Epoch 1795 | loss: 0.0311404 | val_loss: 0.0311675 | Time: 1890.18 ms [2022-02-27 11:52:14 main:574] : INFO : Epoch 1796 | loss: 0.0311361 | val_loss: 0.0311709 | Time: 1898.38 ms [2022-02-27 11:52:16 main:574] : INFO : Epoch 1797 | loss: 0.0311419 | val_loss: 0.0311668 | Time: 1859.46 ms [2022-02-27 11:52:18 main:574] : INFO : Epoch 1798 | loss: 0.0311503 | val_loss: 0.0311664 | Time: 1865.01 ms [2022-02-27 11:52:20 main:574] : INFO : Epoch 1799 | loss: 0.03115 | val_loss: 0.0311669 | Time: 1877.04 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1650) [2022-02-27 11:55:20 main:435] : INFO : Set logging level to 1 [2022-02-27 11:55:20 main:441] : INFO : Running in BOINC Client mode [2022-02-27 11:55:20 main:444] : INFO : Resolving all filenames [2022-02-27 11:55:20 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-27 11:55:20 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-27 11:55:20 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-27 11:55:20 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-27 11:55:20 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-27 11:55:20 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-27 11:55:20 main:474] : INFO : Configuration: [2022-02-27 11:55:20 main:475] : INFO : Model type: GRU [2022-02-27 11:55:20 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-27 11:55:20 main:477] : INFO : Max Epochs: 2048 [2022-02-27 11:55:20 main:478] : INFO : Batch Size: 128 [2022-02-27 11:55:20 main:479] : INFO : Learning Rate: 0.01 [2022-02-27 11:55:20 main:480] : INFO : Patience: 10 [2022-02-27 11:55:20 main:481] : INFO : Hidden Width: 12 [2022-02-27 11:55:20 main:482] : INFO : # Recurrent Layers: 4 [2022-02-27 11:55:20 main:483] : INFO : # Backend Layers: 4 [2022-02-27 11:55:20 main:484] : INFO : # Threads: 1 [2022-02-27 11:55:20 main:486] : INFO : Preparing Dataset [2022-02-27 11:55:20 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-27 11:55:20 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-27 11:55:22 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-27 11:55:22 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-27 11:55:22 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-27 11:55:22 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-27 11:55:22 main:494] : INFO : Creating Model [2022-02-27 11:55:22 main:507] : INFO : Preparing config file [2022-02-27 11:55:22 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-27 11:55:22 main:512] : INFO : Loading config [2022-02-27 11:55:22 main:514] : INFO : Loading state [2022-02-27 11:55:23 main:559] : INFO : Loading DataLoader into Memory [2022-02-27 11:55:23 main:562] : INFO : Starting Training [2022-02-27 11:55:25 main:574] : INFO : Epoch 1734 | loss: 0.0311722 | val_loss: 0.0311723 | Time: 2222.71 ms [2022-02-27 11:55:27 main:574] : INFO : Epoch 1735 | loss: 0.0311447 | val_loss: 0.031168 | Time: 1868.35 ms [2022-02-27 11:55:29 main:574] : INFO : Epoch 1736 | loss: 0.0311429 | val_loss: 0.0311695 | Time: 1872.83 ms [2022-02-27 11:55:31 main:574] : INFO : Epoch 1737 | loss: 0.0311413 | val_loss: 0.0311653 | Time: 1862.92 ms [2022-02-27 11:55:33 main:574] : INFO : Epoch 1738 | loss: 0.0311405 | val_loss: 0.0311664 | Time: 1874.38 ms [2022-02-27 11:55:35 main:574] : INFO : Epoch 1739 | loss: 0.0311403 | val_loss: 0.0311664 | Time: 1929.11 ms [2022-02-27 11:55:37 main:574] : INFO : Epoch 1740 | loss: 0.0311406 | val_loss: 0.0311658 | Time: 1875.82 ms [2022-02-27 11:55:39 main:574] : INFO : Epoch 1741 | loss: 0.0311389 | val_loss: 0.0311649 | Time: 1868.73 ms [2022-02-27 11:55:40 main:574] : INFO : Epoch 1742 | loss: 0.0311411 | val_loss: 0.0311657 | Time: 1865.19 ms [2022-02-27 11:55:42 main:574] : INFO : Epoch 1743 | loss: 0.0311396 | val_loss: 0.0311672 | Time: 1857.64 ms [2022-02-27 11:55:44 main:574] : INFO : Epoch 1744 | loss: 0.0311412 | val_loss: 0.0311715 | Time: 1858.03 ms [2022-02-27 11:55:46 main:574] : INFO : Epoch 1745 | loss: 0.0311393 | val_loss: 0.0311672 | Time: 1868.38 ms [2022-02-27 11:55:48 main:574] : INFO : Epoch 1746 | loss: 0.0311391 | val_loss: 0.0311667 | Time: 1869.82 ms [2022-02-27 11:55:50 main:574] : INFO : Epoch 1747 | loss: 0.0311383 | val_loss: 0.0311637 | Time: 1870.35 ms [2022-02-27 11:55:52 main:574] : INFO : Epoch 1748 | loss: 0.0311398 | val_loss: 0.0311663 | Time: 1885.46 ms [2022-02-27 11:55:54 main:574] : INFO : Epoch 1749 | loss: 0.0311389 | val_loss: 0.0311693 | Time: 1872.9 ms [2022-02-27 11:55:55 main:574] : INFO : Epoch 1750 | loss: 0.031139 | val_loss: 0.031167 | Time: 1878.5 ms [2022-02-27 11:55:57 main:574] : INFO : Epoch 1751 | loss: 0.0311379 | val_loss: 0.0311694 | Time: 1877.98 ms [2022-02-27 11:55:59 main:574] : INFO : Epoch 1752 | loss: 0.0311397 | val_loss: 0.0311679 | Time: 1868.05 ms [2022-02-27 11:56:01 main:574] : INFO : Epoch 1753 | loss: 0.0311387 | val_loss: 0.0311674 | Time: 1891.87 ms [2022-02-27 11:56:03 main:574] : INFO : Epoch 1754 | loss: 0.0311437 | val_loss: 0.0311623 | Time: 1876.18 ms [2022-02-27 11:56:05 main:574] : INFO : Epoch 1755 | loss: 0.0311429 | val_loss: 0.031165 | Time: 1873.77 ms [2022-02-27 11:56:07 main:574] : INFO : Epoch 1756 | loss: 0.0311446 | val_loss: 0.0311613 | Time: 1864.1 ms [2022-02-27 11:56:09 main:574] : INFO : Epoch 1757 | loss: 0.0311409 | val_loss: 0.031166 | Time: 1894.14 ms [2022-02-27 11:56:11 main:574] : INFO : Epoch 1758 | loss: 0.0311402 | val_loss: 0.0311643 | Time: 1863.08 ms [2022-02-27 11:56:12 main:574] : INFO : Epoch 1759 | loss: 0.0311401 | val_loss: 0.0311618 | Time: 1870.05 ms [2022-02-27 11:56:14 main:574] : INFO : Epoch 1760 | loss: 0.031139 | val_loss: 0.0311651 | Time: 1876.82 ms [2022-02-27 11:56:16 main:574] : INFO : Epoch 1761 | loss: 0.0311384 | val_loss: 0.031161 | Time: 1865.55 ms [2022-02-27 11:56:18 main:574] : INFO : Epoch 1762 | loss: 0.0311394 | val_loss: 0.0311666 | Time: 1890.25 ms [2022-02-27 11:56:20 main:574] : INFO : Epoch 1763 | loss: 0.0311389 | val_loss: 0.0311657 | Time: 1873.65 ms [2022-02-27 11:56:22 main:574] : INFO : Epoch 1764 | loss: 0.0311369 | val_loss: 0.031165 | Time: 1926.22 ms [2022-02-27 11:56:24 main:574] : INFO : Epoch 1765 | loss: 0.031137 | val_loss: 0.0311663 | Time: 1882.37 ms [2022-02-27 11:56:26 main:574] : INFO : Epoch 1766 | loss: 0.0311377 | val_loss: 0.0311738 | Time: 1870.62 ms [2022-02-27 11:56:27 main:574] : INFO : Epoch 1767 | loss: 0.0311403 | val_loss: 0.0311662 | Time: 1866.89 ms [2022-02-27 11:56:29 main:574] : INFO : Epoch 1768 | loss: 0.0311407 | val_loss: 0.0311637 | Time: 1873.95 ms [2022-02-27 11:56:31 main:574] : INFO : Epoch 1769 | loss: 0.0311402 | val_loss: 0.0311658 | Time: 1875.46 ms [2022-02-27 11:56:33 main:574] : INFO : Epoch 1770 | loss: 0.0311412 | val_loss: 0.0311763 | Time: 1875.98 ms [2022-02-27 11:56:35 main:574] : INFO : Epoch 1771 | loss: 0.0311425 | val_loss: 0.0311675 | Time: 1876.33 ms [2022-02-27 11:56:37 main:574] : INFO : Epoch 1772 | loss: 0.0311397 | val_loss: 0.0311634 | Time: 1877.97 ms [2022-02-27 11:56:39 main:574] : INFO : Epoch 1773 | loss: 0.0311402 | val_loss: 0.031163 | Time: 1872.56 ms [2022-02-27 11:56:41 main:574] : INFO : Epoch 1774 | loss: 0.0311413 | val_loss: 0.0311654 | Time: 1874.02 ms [2022-02-27 11:56:43 main:574] : INFO : Epoch 1775 | loss: 0.031141 | val_loss: 0.031162 | Time: 1901.63 ms [2022-02-27 11:56:44 main:574] : INFO : Epoch 1776 | loss: 0.0311404 | val_loss: 0.0311652 | Time: 1874.49 ms [2022-02-27 11:56:46 main:574] : INFO : Epoch 1777 | loss: 0.0311417 | val_loss: 0.0311635 | Time: 1860.55 ms [2022-02-27 11:56:48 main:574] : INFO : Epoch 1778 | loss: 0.0311429 | val_loss: 0.0311627 | Time: 1892.81 ms [2022-02-27 11:56:50 main:574] : INFO : Epoch 1779 | loss: 0.0311443 | val_loss: 0.0311646 | Time: 1911.87 ms [2022-02-27 11:56:52 main:574] : INFO : Epoch 1780 | loss: 0.031145 | val_loss: 0.0311666 | Time: 1893.52 ms [2022-02-27 11:56:54 main:574] : INFO : Epoch 1781 | loss: 0.0311462 | val_loss: 0.031172 | Time: 1871.65 ms [2022-02-27 11:56:56 main:574] : INFO : Epoch 1782 | loss: 0.0311436 | val_loss: 0.031163 | Time: 1896.81 ms [2022-02-27 11:56:58 main:574] : INFO : Epoch 1783 | loss: 0.0311394 | val_loss: 0.0311636 | Time: 1881.83 ms [2022-02-27 11:57:00 main:574] : INFO : Epoch 1784 | loss: 0.0311407 | val_loss: 0.0311674 | Time: 1873.8 ms [2022-02-27 11:57:01 main:574] : INFO : Epoch 1785 | loss: 0.0311402 | val_loss: 0.0311653 | Time: 1869.03 ms [2022-02-27 11:57:03 main:574] : INFO : Epoch 1786 | loss: 0.0311393 | val_loss: 0.0311613 | Time: 1877.5 ms [2022-02-27 11:57:05 main:574] : INFO : Epoch 1787 | loss: 0.0311392 | val_loss: 0.0311671 | Time: 1871.47 ms [2022-02-27 11:57:07 main:574] : INFO : Epoch 1788 | loss: 0.0311388 | val_loss: 0.0311685 | Time: 1880.13 ms [2022-02-27 11:57:09 main:574] : INFO : Epoch 1789 | loss: 0.0311388 | val_loss: 0.0311656 | Time: 1867.19 ms [2022-02-27 11:57:11 main:574] : INFO : Epoch 1790 | loss: 0.0311418 | val_loss: 0.0311646 | Time: 1883.14 ms [2022-02-27 11:57:13 main:574] : INFO : Epoch 1791 | loss: 0.0311394 | val_loss: 0.0311646 | Time: 1869.22 ms [2022-02-27 11:57:15 main:574] : INFO : Epoch 1792 | loss: 0.0311419 | val_loss: 0.0311658 | Time: 1857.74 ms [2022-02-27 11:57:16 main:574] : INFO : Epoch 1793 | loss: 0.0311434 | val_loss: 0.0311637 | Time: 1897.29 ms [2022-02-27 11:57:18 main:574] : INFO : Epoch 1794 | loss: 0.031141 | val_loss: 0.031167 | Time: 1869.11 ms [2022-02-27 11:57:20 main:574] : INFO : Epoch 1795 | loss: 0.0311405 | val_loss: 0.0311647 | Time: 1882.45 ms [2022-02-27 11:57:22 main:574] : INFO : Epoch 1796 | loss: 0.0311396 | val_loss: 0.0311667 | Time: 1955.76 ms [2022-02-27 11:57:24 main:574] : INFO : Epoch 1797 | loss: 0.0311396 | val_loss: 0.0311643 | Time: 1886.76 ms [2022-02-27 11:57:26 main:574] : INFO : Epoch 1798 | loss: 0.0311381 | val_loss: 0.0311646 | Time: 1879.03 ms [2022-02-27 11:57:28 main:574] : INFO : Epoch 1799 | loss: 0.0311403 | val_loss: 0.0311614 | Time: 1893.72 ms [2022-02-27 11:57:30 main:574] : INFO : Epoch 1800 | loss: 0.0311395 | val_loss: 0.0311643 | Time: 1892.43 ms [2022-02-27 11:57:32 main:574] : INFO : Epoch 1801 | loss: 0.0311385 | val_loss: 0.0311639 | Time: 1892.79 ms [2022-02-27 11:57:34 main:574] : INFO : Epoch 1802 | loss: 0.0311402 | val_loss: 0.0311659 | Time: 1886.97 ms [2022-02-27 11:57:35 main:574] : INFO : Epoch 1803 | loss: 0.0311398 | val_loss: 0.0311617 | Time: 1895.23 ms [2022-02-27 11:57:37 main:574] : INFO : Epoch 1804 | loss: 0.0311386 | val_loss: 0.0311664 | Time: 1893.61 ms [2022-02-27 11:57:39 main:574] : INFO : Epoch 1805 | loss: 0.0311395 | val_loss: 0.0311626 | Time: 1897.03 ms [2022-02-27 11:57:41 main:574] : INFO : Epoch 1806 | loss: 0.031139 | val_loss: 0.0311632 | Time: 1869.3 ms [2022-02-27 11:57:43 main:574] : INFO : Epoch 1807 | loss: 0.0311387 | val_loss: 0.0311676 | Time: 1896.55 ms [2022-02-27 11:57:45 main:574] : INFO : Epoch 1808 | loss: 0.0311406 | val_loss: 0.0311674 | Time: 1889.43 ms [2022-02-27 11:57:47 main:574] : INFO : Epoch 1809 | loss: 0.0311389 | val_loss: 0.0311614 | Time: 1879.72 ms [2022-02-27 11:57:49 main:574] : INFO : Epoch 1810 | loss: 0.0311381 | val_loss: 0.0311677 | Time: 1884.65 ms [2022-02-27 11:57:51 main:574] : INFO : Epoch 1811 | loss: 0.0311404 | val_loss: 0.0311637 | Time: 1895.58 ms [2022-02-27 11:57:52 main:574] : INFO : Epoch 1812 | loss: 0.0311374 | val_loss: 0.0311661 | Time: 1893.26 ms [2022-02-27 11:57:54 main:574] : INFO : Epoch 1813 | loss: 0.0311404 | val_loss: 0.0311694 | Time: 1890.24 ms [2022-02-27 11:57:56 main:574] : INFO : Epoch 1814 | loss: 0.0311413 | val_loss: 0.0311643 | Time: 1878.69 ms [2022-02-27 11:57:58 main:574] : INFO : Epoch 1815 | loss: 0.03114 | val_loss: 0.0311697 | Time: 1881.66 ms [2022-02-27 11:58:00 main:574] : INFO : Epoch 1816 | loss: 0.0311415 | val_loss: 0.0311641 | Time: 1885.04 ms [2022-02-27 11:58:02 main:574] : INFO : Epoch 1817 | loss: 0.0311391 | val_loss: 0.0311656 | Time: 1899.77 ms [2022-02-27 11:58:04 main:574] : INFO : Epoch 1818 | loss: 0.0311386 | val_loss: 0.0311655 | Time: 1881.65 ms [2022-02-27 11:58:06 main:574] : INFO : Epoch 1819 | loss: 0.0311376 | val_loss: 0.0311687 | Time: 1907.2 ms [2022-02-27 11:58:08 main:574] : INFO : Epoch 1820 | loss: 0.0311385 | val_loss: 0.0311624 | Time: 1877.01 ms [2022-02-27 11:58:09 main:574] : INFO : Epoch 1821 | loss: 0.0311384 | val_loss: 0.0311662 | Time: 1884.98 ms [2022-02-27 11:58:11 main:574] : INFO : Epoch 1822 | loss: 0.0311392 | val_loss: 0.031166 | Time: 1882.29 ms [2022-02-27 11:58:13 main:574] : INFO : Epoch 1823 | loss: 0.0311382 | val_loss: 0.0311671 | Time: 1881.8 ms [2022-02-27 11:58:15 main:574] : INFO : Epoch 1824 | loss: 0.0311389 | val_loss: 0.0311655 | Time: 1876.17 ms [2022-02-27 11:58:17 main:574] : INFO : Epoch 1825 | loss: 0.03114 | val_loss: 0.0311662 | Time: 1896.63 ms [2022-02-27 11:58:19 main:574] : INFO : Epoch 1826 | loss: 0.0311371 | val_loss: 0.0311656 | Time: 1893.41 ms [2022-02-27 11:58:21 main:574] : INFO : Epoch 1827 | loss: 0.031137 | val_loss: 0.0311639 | Time: 1875.52 ms [2022-02-27 11:58:23 main:574] : INFO : Epoch 1828 | loss: 0.0311373 | val_loss: 0.0311673 | Time: 1888.68 ms [2022-02-27 11:58:25 main:574] : INFO : Epoch 1829 | loss: 0.0311391 | val_loss: 0.031164 | Time: 1883 ms [2022-02-27 11:58:27 main:574] : INFO : Epoch 1830 | loss: 0.0311372 | val_loss: 0.0311649 | Time: 1881.23 ms [2022-02-27 11:58:28 main:574] : INFO : Epoch 1831 | loss: 0.0311373 | val_loss: 0.0311672 | Time: 1889.8 ms [2022-02-27 11:58:30 main:574] : INFO : Epoch 1832 | loss: 0.0311379 | val_loss: 0.0311634 | Time: 1879.74 ms [2022-02-27 11:58:32 main:574] : INFO : Epoch 1833 | loss: 0.0311373 | val_loss: 0.0311691 | Time: 1890.2 ms [2022-02-27 11:58:34 main:574] : INFO : Epoch 1834 | loss: 0.0311387 | val_loss: 0.0311668 | Time: 1880.4 ms [2022-02-27 11:58:36 main:574] : INFO : Epoch 1835 | loss: 0.0311389 | val_loss: 0.0311704 | Time: 1881.66 ms [2022-02-27 11:58:38 main:574] : INFO : Epoch 1836 | loss: 0.031142 | val_loss: 0.0311735 | Time: 1879.35 ms [2022-02-27 11:58:40 main:574] : INFO : Epoch 1837 | loss: 0.0311783 | val_loss: 0.0317879 | Time: 1876.36 ms [2022-02-27 11:58:42 main:574] : INFO : Epoch 1838 | loss: 0.0335149 | val_loss: 0.0322091 | Time: 1883.83 ms [2022-02-27 11:58:43 main:574] : INFO : Epoch 1839 | loss: 0.0318174 | val_loss: 0.031474 | Time: 1873.75 ms [2022-02-27 11:58:45 main:574] : INFO : Epoch 1840 | loss: 0.031294 | val_loss: 0.0312119 | Time: 1886.63 ms [2022-02-27 11:58:47 main:574] : INFO : Epoch 1841 | loss: 0.0312055 | val_loss: 0.0311841 | Time: 1880.29 ms [2022-02-27 11:58:49 main:574] : INFO : Epoch 1842 | loss: 0.0311873 | val_loss: 0.0311806 | Time: 1876.09 ms [2022-02-27 11:58:51 main:574] : INFO : Epoch 1843 | loss: 0.0311704 | val_loss: 0.0311718 | Time: 1885.19 ms [2022-02-27 11:58:53 main:574] : INFO : Epoch 1844 | loss: 0.031162 | val_loss: 0.0311676 | Time: 1887.44 ms [2022-02-27 11:58:55 main:574] : INFO : Epoch 1845 | loss: 0.0311587 | val_loss: 0.0311693 | Time: 1885.91 ms [2022-02-27 11:58:57 main:574] : INFO : Epoch 1846 | loss: 0.0311587 | val_loss: 0.0311685 | Time: 1882.16 ms [2022-02-27 11:58:59 main:574] : INFO : Epoch 1847 | loss: 0.0311563 | val_loss: 0.031166 | Time: 1897.81 ms [2022-02-27 11:59:00 main:574] : INFO : Epoch 1848 | loss: 0.0311547 | val_loss: 0.031165 | Time: 1886.61 ms [2022-02-27 11:59:02 main:574] : INFO : Epoch 1849 | loss: 0.0311553 | val_loss: 0.0311653 | Time: 1879.38 ms [2022-02-27 11:59:04 main:574] : INFO : Epoch 1850 | loss: 0.0311576 | val_loss: 0.0311665 | Time: 1874.52 ms [2022-02-27 11:59:06 main:574] : INFO : Epoch 1851 | loss: 0.0311583 | val_loss: 0.0311674 | Time: 1880.29 ms [2022-02-27 11:59:08 main:574] : INFO : Epoch 1852 | loss: 0.0311563 | val_loss: 0.0311655 | Time: 1884.28 ms [2022-02-27 11:59:10 main:574] : INFO : Epoch 1853 | loss: 0.0311546 | val_loss: 0.0311642 | Time: 1878.31 ms [2022-02-27 11:59:12 main:574] : INFO : Epoch 1854 | loss: 0.0311544 | val_loss: 0.0311633 | Time: 1874.55 ms [2022-02-27 11:59:14 main:574] : INFO : Epoch 1855 | loss: 0.0311535 | val_loss: 0.0311638 | Time: 1884.92 ms [2022-02-27 11:59:16 main:574] : INFO : Epoch 1856 | loss: 0.0311535 | val_loss: 0.031163 | Time: 1876.91 ms [2022-02-27 11:59:17 main:574] : INFO : Epoch 1857 | loss: 0.031154 | val_loss: 0.0311637 | Time: 1892.99 ms [2022-02-27 11:59:19 main:574] : INFO : Epoch 1858 | loss: 0.0311533 | val_loss: 0.0311638 | Time: 1877.78 ms [2022-02-27 11:59:21 main:574] : INFO : Epoch 1859 | loss: 0.0311525 | val_loss: 0.0311629 | Time: 1898.93 ms [2022-02-27 11:59:23 main:574] : INFO : Epoch 1860 | loss: 0.0311525 | val_loss: 0.0311652 | Time: 1902.6 ms [2022-02-27 11:59:25 main:574] : INFO : Epoch 1861 | loss: 0.031153 | val_loss: 0.0311632 | Time: 1887.62 ms [2022-02-27 11:59:27 main:574] : INFO : Epoch 1862 | loss: 0.0311544 | val_loss: 0.031163 | Time: 1870.14 ms [2022-02-27 11:59:29 main:574] : INFO : Epoch 1863 | loss: 0.0311547 | val_loss: 0.0311656 | Time: 1892.61 ms [2022-02-27 11:59:31 main:574] : INFO : Epoch 1864 | loss: 0.0311523 | val_loss: 0.0311628 | Time: 1896.16 ms [2022-02-27 11:59:33 main:574] : INFO : Epoch 1865 | loss: 0.0311516 | val_loss: 0.0311622 | Time: 1886.13 ms [2022-02-27 11:59:35 main:574] : INFO : Epoch 1866 | loss: 0.0311511 | val_loss: 0.0311646 | Time: 1886.55 ms [2022-02-27 11:59:36 main:574] : INFO : Epoch 1867 | loss: 0.0311523 | val_loss: 0.0311622 | Time: 1888.14 ms [2022-02-27 11:59:38 main:574] : INFO : Epoch 1868 | loss: 0.0311513 | val_loss: 0.0311634 | Time: 1895.05 ms [2022-02-27 11:59:40 main:574] : INFO : Epoch 1869 | loss: 0.031152 | val_loss: 0.0311619 | Time: 1900.89 ms [2022-02-27 11:59:42 main:574] : INFO : Epoch 1870 | loss: 0.0311516 | val_loss: 0.0311616 | Time: 1888.35 ms [2022-02-27 11:59:44 main:574] : INFO : Epoch 1871 | loss: 0.0311509 | val_loss: 0.0311614 | Time: 1891.77 ms [2022-02-27 11:59:46 main:574] : INFO : Epoch 1872 | loss: 0.031151 | val_loss: 0.0311617 | Time: 1880.58 ms [2022-02-27 11:59:48 main:574] : INFO : Epoch 1873 | loss: 0.031151 | val_loss: 0.0311616 | Time: 1903.46 ms [2022-02-27 11:59:50 main:574] : INFO : Epoch 1874 | loss: 0.0311511 | val_loss: 0.0311616 | Time: 1897.22 ms [2022-02-27 11:59:52 main:574] : INFO : Epoch 1875 | loss: 0.0311507 | val_loss: 0.031163 | Time: 1879.32 ms [2022-02-27 11:59:53 main:574] : INFO : Epoch 1876 | loss: 0.0311509 | val_loss: 0.0311614 | Time: 1883.95 ms [2022-02-27 11:59:55 main:574] : INFO : Epoch 1877 | loss: 0.0311503 | val_loss: 0.0311619 | Time: 1903.18 ms [2022-02-27 11:59:57 main:574] : INFO : Epoch 1878 | loss: 0.0311502 | val_loss: 0.0311613 | Time: 1899.27 ms [2022-02-27 11:59:59 main:574] : INFO : Epoch 1879 | loss: 0.031151 | val_loss: 0.0311633 | Time: 1879 ms [2022-02-27 12:00:01 main:574] : INFO : Epoch 1880 | loss: 0.0311513 | val_loss: 0.0311626 | Time: 1885.9 ms [2022-02-27 12:00:03 main:574] : INFO : Epoch 1881 | loss: 0.0311517 | val_loss: 0.0311633 | Time: 1873.99 ms [2022-02-27 12:00:05 main:574] : INFO : Epoch 1882 | loss: 0.0311518 | val_loss: 0.0311654 | Time: 1887.62 ms [2022-02-27 12:00:07 main:574] : INFO : Epoch 1883 | loss: 0.0311534 | val_loss: 0.0311607 | Time: 1895.55 ms [2022-02-27 12:00:09 main:574] : INFO : Epoch 1884 | loss: 0.0311524 | val_loss: 0.0311616 | Time: 1879.88 ms [2022-02-27 12:00:11 main:574] : INFO : Epoch 1885 | loss: 0.0311516 | val_loss: 0.0311617 | Time: 1896.5 ms [2022-02-27 12:00:12 main:574] : INFO : Epoch 1886 | loss: 0.0311518 | val_loss: 0.0311603 | Time: 1878.24 ms [2022-02-27 12:00:14 main:574] : INFO : Epoch 1887 | loss: 0.0311517 | val_loss: 0.0311602 | Time: 1888.19 ms [2022-02-27 12:00:16 main:574] : INFO : Epoch 1888 | loss: 0.031151 | val_loss: 0.0311609 | Time: 1892.38 ms [2022-02-27 12:00:18 main:574] : INFO : Epoch 1889 | loss: 0.0311506 | val_loss: 0.031163 | Time: 1872.85 ms [2022-02-27 12:00:20 main:574] : INFO : Epoch 1890 | loss: 0.0311512 | val_loss: 0.0311635 | Time: 1871.8 ms [2022-02-27 12:00:22 main:574] : INFO : Epoch 1891 | loss: 0.031151 | val_loss: 0.0311624 | Time: 1882.42 ms [2022-02-27 12:00:24 main:574] : INFO : Epoch 1892 | loss: 0.0311519 | val_loss: 0.0311626 | Time: 1875.73 ms [2022-02-27 12:00:26 main:574] : INFO : Epoch 1893 | loss: 0.0311505 | val_loss: 0.0311605 | Time: 1881.15 ms [2022-02-27 12:00:27 main:574] : INFO : Epoch 1894 | loss: 0.0311502 | val_loss: 0.0311615 | Time: 1877.38 ms [2022-02-27 12:00:29 main:574] : INFO : Epoch 1895 | loss: 0.0311497 | val_loss: 0.0311624 | Time: 1860.99 ms [2022-02-27 12:00:31 main:574] : INFO : Epoch 1896 | loss: 0.0311507 | val_loss: 0.0311615 | Time: 1867.22 ms [2022-02-27 12:00:33 main:574] : INFO : Epoch 1897 | loss: 0.0311505 | val_loss: 0.0311617 | Time: 1885.08 ms [2022-02-27 12:00:35 main:574] : INFO : Epoch 1898 | loss: 0.0311507 | val_loss: 0.0311613 | Time: 1864.12 ms [2022-02-27 12:00:37 main:574] : INFO : Epoch 1899 | loss: 0.0311508 | val_loss: 0.0311619 | Time: 1878.36 ms [2022-02-27 12:00:39 main:574] : INFO : Epoch 1900 | loss: 0.0311498 | val_loss: 0.031162 | Time: 1860.9 ms [2022-02-27 12:00:41 main:574] : INFO : Epoch 1901 | loss: 0.0311498 | val_loss: 0.0311623 | Time: 1875.51 ms [2022-02-27 12:00:42 main:574] : INFO : Epoch 1902 | loss: 0.0311495 | val_loss: 0.0311619 | Time: 1864.58 ms [2022-02-27 12:00:44 main:574] : INFO : Epoch 1903 | loss: 0.0311501 | val_loss: 0.0311623 | Time: 1869.17 ms [2022-02-27 12:00:46 main:574] : INFO : Epoch 1904 | loss: 0.0311523 | val_loss: 0.0311615 | Time: 1863.56 ms [2022-02-27 12:00:48 main:574] : INFO : Epoch 1905 | loss: 0.0311538 | val_loss: 0.031162 | Time: 1875.57 ms [2022-02-27 12:00:50 main:574] : INFO : Epoch 1906 | loss: 0.0311545 | val_loss: 0.0311615 | Time: 1887.48 ms [2022-02-27 12:00:52 main:574] : INFO : Epoch 1907 | loss: 0.0311541 | val_loss: 0.0311659 | Time: 1865.9 ms [2022-02-27 12:00:54 main:574] : INFO : Epoch 1908 | loss: 0.0311556 | val_loss: 0.0311631 | Time: 1866 ms [2022-02-27 12:00:56 main:574] : INFO : Epoch 1909 | loss: 0.0311536 | val_loss: 0.0311648 | Time: 1871.73 ms [2022-02-27 12:00:57 main:574] : INFO : Epoch 1910 | loss: 0.0311548 | val_loss: 0.0311629 | Time: 1874.17 ms [2022-02-27 12:00:59 main:574] : INFO : Epoch 1911 | loss: 0.0311537 | val_loss: 0.0311638 | Time: 1862.4 ms [2022-02-27 12:01:01 main:574] : INFO : Epoch 1912 | loss: 0.0311529 | val_loss: 0.031164 | Time: 1859.93 ms [2022-02-27 12:01:03 main:574] : INFO : Epoch 1913 | loss: 0.0311529 | val_loss: 0.0311638 | Time: 1863.5 ms [2022-02-27 12:01:05 main:574] : INFO : Epoch 1914 | loss: 0.0311547 | val_loss: 0.0311622 | Time: 1871.15 ms [2022-02-27 12:01:07 main:574] : INFO : Epoch 1915 | loss: 0.0311542 | val_loss: 0.0311632 | Time: 1861.32 ms [2022-02-27 12:01:09 main:574] : INFO : Epoch 1916 | loss: 0.0311518 | val_loss: 0.0311617 | Time: 1875.64 ms [2022-02-27 12:01:11 main:574] : INFO : Epoch 1917 | loss: 0.0311509 | val_loss: 0.0311605 | Time: 1857.77 ms [2022-02-27 12:01:12 main:574] : INFO : Epoch 1918 | loss: 0.031152 | val_loss: 0.0311621 | Time: 1879.6 ms [2022-02-27 12:01:14 main:574] : INFO : Epoch 1919 | loss: 0.031152 | val_loss: 0.0311627 | Time: 1874.24 ms [2022-02-27 12:01:16 main:574] : INFO : Epoch 1920 | loss: 0.0311516 | val_loss: 0.0311611 | Time: 1873.96 ms [2022-02-27 12:01:18 main:574] : INFO : Epoch 1921 | loss: 0.0311535 | val_loss: 0.0311617 | Time: 1869.09 ms [2022-02-27 12:01:20 main:574] : INFO : Epoch 1922 | loss: 0.0311532 | val_loss: 0.0311633 | Time: 1871.69 ms [2022-02-27 12:01:22 main:574] : INFO : Epoch 1923 | loss: 0.0311535 | val_loss: 0.0311648 | Time: 1873.91 ms [2022-02-27 12:01:24 main:574] : INFO : Epoch 1924 | loss: 0.0311538 | val_loss: 0.0311634 | Time: 1863.7 ms [2022-02-27 12:01:26 main:574] : INFO : Epoch 1925 | loss: 0.0311538 | val_loss: 0.0311681 | Time: 1850.2 ms [2022-02-27 12:01:27 main:574] : INFO : Epoch 1926 | loss: 0.0311552 | val_loss: 0.0311624 | Time: 1865.39 ms [2022-02-27 12:01:29 main:574] : INFO : Epoch 1927 | loss: 0.0311548 | val_loss: 0.0311651 | Time: 1865.88 ms [2022-02-27 12:01:31 main:574] : INFO : Epoch 1928 | loss: 0.0311554 | val_loss: 0.0311641 | Time: 1874.81 ms [2022-02-27 12:01:33 main:574] : INFO : Epoch 1929 | loss: 0.0311562 | val_loss: 0.0311696 | Time: 1864.25 ms [2022-02-27 12:01:35 main:574] : INFO : Epoch 1930 | loss: 0.0311632 | val_loss: 0.0311755 | Time: 1864.67 ms [2022-02-27 12:01:37 main:574] : INFO : Epoch 1931 | loss: 0.0311651 | val_loss: 0.0311717 | Time: 1882.61 ms [2022-02-27 12:01:39 main:574] : INFO : Epoch 1932 | loss: 0.0311608 | val_loss: 0.0311705 | Time: 1863.79 ms [2022-02-27 12:01:41 main:574] : INFO : Epoch 1933 | loss: 0.0311577 | val_loss: 0.0311712 | Time: 1866.96 ms [2022-02-27 12:01:42 main:574] : INFO : Epoch 1934 | loss: 0.0311571 | val_loss: 0.031168 | Time: 1869.6 ms [2022-02-27 12:01:44 main:574] : INFO : Epoch 1935 | loss: 0.0311568 | val_loss: 0.0311669 | Time: 1850.82 ms [2022-02-27 12:01:46 main:574] : INFO : Epoch 1936 | loss: 0.0311564 | val_loss: 0.0311672 | Time: 1873.74 ms [2022-02-27 12:01:48 main:574] : INFO : Epoch 1937 | loss: 0.0311562 | val_loss: 0.0311665 | Time: 1873.97 ms [2022-02-27 12:01:50 main:574] : INFO : Epoch 1938 | loss: 0.0311553 | val_loss: 0.0311663 | Time: 1876.3 ms [2022-02-27 12:01:52 main:574] : INFO : Epoch 1939 | loss: 0.0311555 | val_loss: 0.0311667 | Time: 1874.13 ms [2022-02-27 12:01:54 main:574] : INFO : Epoch 1940 | loss: 0.0311551 | val_loss: 0.031166 | Time: 1876.14 ms [2022-02-27 12:01:56 main:574] : INFO : Epoch 1941 | loss: 0.031155 | val_loss: 0.0311668 | Time: 1862.25 ms [2022-02-27 12:01:57 main:574] : INFO : Epoch 1942 | loss: 0.0311551 | val_loss: 0.0311672 | Time: 1870.95 ms [2022-02-27 12:01:59 main:574] : INFO : Epoch 1943 | loss: 0.0311542 | val_loss: 0.0311674 | Time: 1866.09 ms [2022-02-27 12:02:01 main:574] : INFO : Epoch 1944 | loss: 0.0311546 | val_loss: 0.0311696 | Time: 1855.85 ms [2022-02-27 12:02:03 main:574] : INFO : Epoch 1945 | loss: 0.0311553 | val_loss: 0.0311706 | Time: 1876.27 ms [2022-02-27 12:02:05 main:574] : INFO : Epoch 1946 | loss: 0.0311589 | val_loss: 0.0311627 | Time: 1878.79 ms [2022-02-27 12:02:07 main:574] : INFO : Epoch 1947 | loss: 0.031156 | val_loss: 0.0311637 | Time: 1870.41 ms [2022-02-27 12:02:09 main:574] : INFO : Epoch 1948 | loss: 0.0311548 | val_loss: 0.0311655 | Time: 1868.53 ms [2022-02-27 12:02:11 main:574] : INFO : Epoch 1949 | loss: 0.0311557 | val_loss: 0.0311632 | Time: 1844.43 ms [2022-02-27 12:02:12 main:574] : INFO : Epoch 1950 | loss: 0.0311556 | val_loss: 0.0311643 | Time: 1866.85 ms [2022-02-27 12:02:14 main:574] : INFO : Epoch 1951 | loss: 0.0311545 | val_loss: 0.031164 | Time: 1868.59 ms [2022-02-27 12:02:16 main:574] : INFO : Epoch 1952 | loss: 0.0311543 | val_loss: 0.0311648 | Time: 1870.41 ms [2022-02-27 12:02:18 main:574] : INFO : Epoch 1953 | loss: 0.0311539 | val_loss: 0.0311643 | Time: 1869.75 ms [2022-02-27 12:02:20 main:574] : INFO : Epoch 1954 | loss: 0.0311552 | val_loss: 0.0311626 | Time: 1861.11 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1650)Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1650) [2022-02-27 22:23:56 main:435] : INFO : Set logging level to 1 [2022-02-27 22:23:56 main:441] : INFO : Running in BOINC Client mode [2022-02-27 22:23:56 main:444] : INFO : Resolving all filenames [2022-02-27 22:23:56 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-27 22:23:56 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-27 22:23:56 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-27 22:23:57 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-27 22:23:57 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-27 22:23:57 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-27 22:23:57 main:474] : INFO : Configuration: [2022-02-27 22:23:57 main:475] : INFO : Model type: GRU [2022-02-27 22:23:57 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-27 22:23:57 main:477] : INFO : Max Epochs: 2048 [2022-02-27 22:23:57 main:478] : INFO : Batch Size: 128 [2022-02-27 22:23:57 main:479] : INFO : Learning Rate: 0.01 [2022-02-27 22:23:57 main:480] : INFO : Patience: 10 [2022-02-27 22:23:57 main:481] : INFO : Hidden Width: 12 [2022-02-27 22:23:57 main:482] : INFO : # Recurrent Layers: 4 [2022-02-27 22:23:57 main:483] : INFO : # Backend Layers: 4 [2022-02-27 22:23:57 main:484] : INFO : # Threads: 1 [2022-02-27 22:23:57 main:486] : INFO : Preparing Dataset [2022-02-27 22:23:57 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-27 22:23:57 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-27 22:23:59 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-27 22:23:59 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-27 22:23:59 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-27 22:23:59 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-27 22:23:59 main:494] : INFO : Creating Model [2022-02-27 22:23:59 main:507] : INFO : Preparing config file [2022-02-27 22:23:59 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-27 22:23:59 main:512] : INFO : Loading config [2022-02-27 22:23:59 main:514] : INFO : Loading state [2022-02-27 22:24:00 main:559] : INFO : Loading DataLoader into Memory [2022-02-27 22:24:00 main:562] : INFO : Starting Training [2022-02-27 22:24:03 main:574] : INFO : Epoch 1927 | loss: 0.0313816 | val_loss: 0.0312635 | Time: 2310.92 ms [2022-02-27 22:24:05 main:574] : INFO : Epoch 1928 | loss: 0.031201 | val_loss: 0.0311751 | Time: 1891.3 ms [2022-02-27 22:24:06 main:574] : INFO : Epoch 1929 | loss: 0.0311628 | val_loss: 0.0311698 | Time: 1901.48 ms [2022-02-27 22:24:08 main:574] : INFO : Epoch 1930 | loss: 0.0311595 | val_loss: 0.0311656 | Time: 1909.98 ms [2022-02-27 22:24:12 main:574] : INFO : Epoch 1931 | loss: 0.0311562 | val_loss: 0.0311665 | Time: 3410.9 ms [2022-02-27 22:24:15 main:574] : INFO : Epoch 1932 | loss: 0.0311517 | val_loss: 0.0311649 | Time: 3282.58 ms [2022-02-27 22:24:18 main:574] : INFO : Epoch 1933 | loss: 0.0311513 | val_loss: 0.0311629 | Time: 3236.16 ms [2022-02-27 22:24:22 main:574] : INFO : Epoch 1934 | loss: 0.0311495 | val_loss: 0.031167 | Time: 3498.08 ms [2022-02-27 22:24:25 main:574] : INFO : Epoch 1935 | loss: 0.0311477 | val_loss: 0.0311733 | Time: 3170.68 ms [2022-02-27 22:24:28 main:574] : INFO : Epoch 1936 | loss: 0.0311465 | val_loss: 0.031163 | Time: 3087.24 ms [2022-02-27 22:24:31 main:574] : INFO : Epoch 1937 | loss: 0.0311467 | val_loss: 0.0311648 | Time: 3416.02 ms [2022-02-27 22:24:35 main:574] : INFO : Epoch 1938 | loss: 0.0311469 | val_loss: 0.0311665 | Time: 3095.38 ms [2022-02-27 22:24:38 main:574] : INFO : Epoch 1939 | loss: 0.0311441 | val_loss: 0.031162 | Time: 3009.91 ms [2022-02-27 22:24:41 main:574] : INFO : Epoch 1940 | loss: 0.0311439 | val_loss: 0.0311656 | Time: 3438.29 ms [2022-02-27 22:24:44 main:574] : INFO : Epoch 1941 | loss: 0.0311449 | val_loss: 0.0311647 | Time: 3202.71 ms [2022-02-27 22:24:47 main:574] : INFO : Epoch 1942 | loss: 0.0311415 | val_loss: 0.0311644 | Time: 3224.39 ms [2022-02-27 22:24:51 main:574] : INFO : Epoch 1943 | loss: 0.0311412 | val_loss: 0.0311639 | Time: 3240.55 ms [2022-02-27 22:24:54 main:574] : INFO : Epoch 1944 | loss: 0.0311435 | val_loss: 0.0311664 | Time: 3503.63 ms [2022-02-27 22:24:59 main:574] : INFO : Epoch 1945 | loss: 0.0311432 | val_loss: 0.0311642 | Time: 4306.79 ms [2022-02-27 22:25:03 main:574] : INFO : Epoch 1946 | loss: 0.0311455 | val_loss: 0.0311666 | Time: 3960.03 ms [2022-02-27 22:25:06 main:574] : INFO : Epoch 1947 | loss: 0.031146 | val_loss: 0.0311702 | Time: 3318.68 ms [2022-02-27 22:25:09 main:574] : INFO : Epoch 1948 | loss: 0.0311441 | val_loss: 0.0311662 | Time: 3191.39 ms [2022-02-27 22:25:13 main:574] : INFO : Epoch 1949 | loss: 0.0311429 | val_loss: 0.0311652 | Time: 3528.31 ms [2022-02-27 22:25:16 main:574] : INFO : Epoch 1950 | loss: 0.0311432 | val_loss: 0.0311632 | Time: 3057.23 ms [2022-02-27 22:25:19 main:574] : INFO : Epoch 1951 | loss: 0.0311408 | val_loss: 0.0311648 | Time: 3161.32 ms [2022-02-27 22:25:22 main:574] : INFO : Epoch 1952 | loss: 0.0311422 | val_loss: 0.0311638 | Time: 3118.06 ms [2022-02-27 22:25:25 main:574] : INFO : Epoch 1953 | loss: 0.0311423 | val_loss: 0.0311634 | Time: 3434.06 ms [2022-02-27 22:25:29 main:574] : INFO : Epoch 1954 | loss: 0.031143 | val_loss: 0.0311633 | Time: 3249.86 ms [2022-02-27 22:25:32 main:574] : INFO : Epoch 1955 | loss: 0.0311426 | val_loss: 0.0311622 | Time: 3185.3 ms [2022-02-27 22:25:35 main:574] : INFO : Epoch 1956 | loss: 0.0311407 | val_loss: 0.0311628 | Time: 3364.79 ms [2022-02-27 22:25:38 main:574] : INFO : Epoch 1957 | loss: 0.0311416 | val_loss: 0.0311638 | Time: 3154.21 ms [2022-02-27 22:25:41 main:574] : INFO : Epoch 1958 | loss: 0.0311408 | val_loss: 0.0311617 | Time: 3098.88 ms [2022-02-27 22:25:45 main:574] : INFO : Epoch 1959 | loss: 0.0311448 | val_loss: 0.0311629 | Time: 3413.34 ms [2022-02-27 22:25:48 main:574] : INFO : Epoch 1960 | loss: 0.0311499 | val_loss: 0.0311693 | Time: 3227.66 ms [2022-02-27 22:25:52 main:574] : INFO : Epoch 1961 | loss: 0.0311517 | val_loss: 0.031172 | Time: 3471.1 ms [2022-02-27 22:25:55 main:574] : INFO : Epoch 1962 | loss: 0.0311526 | val_loss: 0.0311722 | Time: 3655.95 ms [2022-02-27 22:25:59 main:574] : INFO : Epoch 1963 | loss: 0.0311479 | val_loss: 0.0311733 | Time: 3278.39 ms [2022-02-27 22:26:02 main:574] : INFO : Epoch 1964 | loss: 0.0311472 | val_loss: 0.03117 | Time: 3557.71 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1650) [2022-02-27 22:29:04 main:435] : INFO : Set logging level to 1 [2022-02-27 22:29:04 main:441] : INFO : Running in BOINC Client mode [2022-02-27 22:29:04 main:444] : INFO : Resolving all filenames [2022-02-27 22:29:04 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-27 22:29:04 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-27 22:29:04 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-27 22:29:05 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-27 22:29:05 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-27 22:29:05 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-27 22:29:05 main:474] : INFO : Configuration: [2022-02-27 22:29:05 main:475] : INFO : Model type: GRU [2022-02-27 22:29:05 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-27 22:29:05 main:477] : INFO : Max Epochs: 2048 [2022-02-27 22:29:05 main:478] : INFO : Batch Size: 128 [2022-02-27 22:29:05 main:479] : INFO : Learning Rate: 0.01 [2022-02-27 22:29:05 main:480] : INFO : Patience: 10 [2022-02-27 22:29:05 main:481] : INFO : Hidden Width: 12 [2022-02-27 22:29:05 main:482] : INFO : # Recurrent Layers: 4 [2022-02-27 22:29:05 main:483] : INFO : # Backend Layers: 4 [2022-02-27 22:29:05 main:484] : INFO : # Threads: 1 [2022-02-27 22:29:05 main:486] : INFO : Preparing Dataset [2022-02-27 22:29:05 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-27 22:29:05 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-27 22:29:07 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-27 22:29:07 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-27 22:29:07 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-27 22:29:07 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-27 22:29:07 main:494] : INFO : Creating Model [2022-02-27 22:29:07 main:507] : INFO : Preparing config file [2022-02-27 22:29:07 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-27 22:29:07 main:512] : INFO : Loading config [2022-02-27 22:29:07 main:514] : INFO : Loading state [2022-02-27 22:29:08 main:559] : INFO : Loading DataLoader into Memory [2022-02-27 22:29:08 main:562] : INFO : Starting Training [2022-02-27 22:29:10 main:574] : INFO : Epoch 1927 | loss: 0.0313592 | val_loss: 0.0312125 | Time: 2203.5 ms [2022-02-27 22:29:12 main:574] : INFO : Epoch 1928 | loss: 0.0311817 | val_loss: 0.0311711 | Time: 1902.71 ms [2022-02-27 22:29:14 main:574] : INFO : Epoch 1929 | loss: 0.0311578 | val_loss: 0.0311659 | Time: 1916.02 ms [2022-02-27 22:29:17 main:574] : INFO : Epoch 1930 | loss: 0.0311533 | val_loss: 0.0311628 | Time: 2323.28 ms [2022-02-27 22:29:20 main:574] : INFO : Epoch 1931 | loss: 0.0311492 | val_loss: 0.0311661 | Time: 3315.58 ms [2022-02-27 22:29:23 main:574] : INFO : Epoch 1932 | loss: 0.0311498 | val_loss: 0.0311683 | Time: 3073.81 ms [2022-02-27 22:29:26 main:574] : INFO : Epoch 1933 | loss: 0.0311461 | val_loss: 0.0311617 | Time: 3136.06 ms [2022-02-27 22:29:29 main:574] : INFO : Epoch 1934 | loss: 0.0311453 | val_loss: 0.031163 | Time: 3350.4 ms [2022-02-27 22:29:33 main:574] : INFO : Epoch 1935 | loss: 0.0311457 | val_loss: 0.0311615 | Time: 3177.21 ms [2022-02-27 22:29:36 main:574] : INFO : Epoch 1936 | loss: 0.031145 | val_loss: 0.0311649 | Time: 3226.79 ms [2022-02-27 22:29:39 main:574] : INFO : Epoch 1937 | loss: 0.0311437 | val_loss: 0.031163 | Time: 3476.93 ms [2022-02-27 22:29:43 main:574] : INFO : Epoch 1938 | loss: 0.0311425 | val_loss: 0.0311609 | Time: 3198.78 ms [2022-02-27 22:29:46 main:574] : INFO : Epoch 1939 | loss: 0.0311434 | val_loss: 0.0311642 | Time: 3195.48 ms [2022-02-27 22:29:49 main:574] : INFO : Epoch 1940 | loss: 0.0311415 | val_loss: 0.0311688 | Time: 3428.48 ms [2022-02-27 22:29:52 main:574] : INFO : Epoch 1941 | loss: 0.0311414 | val_loss: 0.0311647 | Time: 3055.86 ms [2022-02-27 22:29:56 main:574] : INFO : Epoch 1942 | loss: 0.0311421 | val_loss: 0.0311652 | Time: 3362.38 ms [2022-02-27 22:29:59 main:574] : INFO : Epoch 1943 | loss: 0.0311446 | val_loss: 0.0311629 | Time: 3447.74 ms [2022-02-27 22:30:02 main:574] : INFO : Epoch 1944 | loss: 0.0311435 | val_loss: 0.0311702 | Time: 3239.49 ms [2022-02-27 22:30:06 main:574] : INFO : Epoch 1945 | loss: 0.0311424 | val_loss: 0.0311637 | Time: 3727.87 ms [2022-02-27 22:30:10 main:574] : INFO : Epoch 1946 | loss: 0.0311414 | val_loss: 0.0311608 | Time: 3619.36 ms [2022-02-27 22:30:13 main:574] : INFO : Epoch 1947 | loss: 0.0311402 | val_loss: 0.0311605 | Time: 3272.46 ms [2022-02-27 22:30:16 main:574] : INFO : Epoch 1948 | loss: 0.0311425 | val_loss: 0.0311599 | Time: 3226.54 ms [2022-02-27 22:30:20 main:574] : INFO : Epoch 1949 | loss: 0.0311418 | val_loss: 0.0311593 | Time: 3348.92 ms [2022-02-27 22:30:23 main:574] : INFO : Epoch 1950 | loss: 0.0311419 | val_loss: 0.0311614 | Time: 3111.85 ms [2022-02-27 22:30:26 main:574] : INFO : Epoch 1951 | loss: 0.0311401 | val_loss: 0.0311639 | Time: 3152.92 ms [2022-02-27 22:30:29 main:574] : INFO : Epoch 1952 | loss: 0.0311409 | val_loss: 0.0311637 | Time: 3187.5 ms [2022-02-27 22:30:33 main:574] : INFO : Epoch 1953 | loss: 0.0311414 | val_loss: 0.0311638 | Time: 3507.48 ms [2022-02-27 22:30:36 main:574] : INFO : Epoch 1954 | loss: 0.031141 | val_loss: 0.0311639 | Time: 3239.88 ms [2022-02-27 22:30:39 main:574] : INFO : Epoch 1955 | loss: 0.0311416 | val_loss: 0.0311638 | Time: 3224.82 ms [2022-02-27 22:30:42 main:574] : INFO : Epoch 1956 | loss: 0.0311397 | val_loss: 0.0311682 | Time: 3473.73 ms [2022-02-27 22:30:46 main:574] : INFO : Epoch 1957 | loss: 0.0311434 | val_loss: 0.0311622 | Time: 3144.44 ms [2022-02-27 22:30:49 main:574] : INFO : Epoch 1958 | loss: 0.0311407 | val_loss: 0.0311632 | Time: 3253.39 ms [2022-02-27 22:30:52 main:574] : INFO : Epoch 1959 | loss: 0.0311408 | val_loss: 0.0311645 | Time: 3412.85 ms [2022-02-27 22:30:56 main:574] : INFO : Epoch 1960 | loss: 0.0311398 | val_loss: 0.0311647 | Time: 3278.32 ms [2022-02-27 22:30:59 main:574] : INFO : Epoch 1961 | loss: 0.0311422 | val_loss: 0.0311619 | Time: 3252.34 ms [2022-02-27 22:31:02 main:574] : INFO : Epoch 1962 | loss: 0.0311392 | val_loss: 0.0311632 | Time: 3440.65 ms [2022-02-27 22:31:06 main:574] : INFO : Epoch 1963 | loss: 0.0311384 | val_loss: 0.0311644 | Time: 3288.44 ms [2022-02-27 22:31:09 main:574] : INFO : Epoch 1964 | loss: 0.031138 | val_loss: 0.0311648 | Time: 3586.1 ms [2022-02-27 22:31:13 main:574] : INFO : Epoch 1965 | loss: 0.0311395 | val_loss: 0.0311644 | Time: 3581.42 ms [2022-02-27 22:31:16 main:574] : INFO : Epoch 1966 | loss: 0.0311389 | val_loss: 0.031171 | Time: 3306.18 ms [2022-02-27 22:31:19 main:574] : INFO : Epoch 1967 | loss: 0.0311399 | val_loss: 0.0311637 | Time: 3347.09 ms [2022-02-27 22:31:23 main:574] : INFO : Epoch 1968 | loss: 0.031137 | val_loss: 0.0311639 | Time: 3764.01 ms [2022-02-27 22:31:27 main:574] : INFO : Epoch 1969 | loss: 0.0311376 | val_loss: 0.0311639 | Time: 3339.78 ms [2022-02-27 22:31:30 main:574] : INFO : Epoch 1970 | loss: 0.0311378 | val_loss: 0.0311722 | Time: 3297.53 ms [2022-02-27 22:31:33 main:574] : INFO : Epoch 1971 | loss: 0.0311384 | val_loss: 0.0311648 | Time: 3400.89 ms [2022-02-27 22:31:37 main:574] : INFO : Epoch 1972 | loss: 0.0311413 | val_loss: 0.0311668 | Time: 3702.97 ms [2022-02-27 22:31:40 main:574] : INFO : Epoch 1973 | loss: 0.0311422 | val_loss: 0.0311651 | Time: 3263.94 ms [2022-02-27 22:31:44 main:574] : INFO : Epoch 1974 | loss: 0.0311414 | val_loss: 0.0311636 | Time: 3497.32 ms [2022-02-27 22:31:47 main:574] : INFO : Epoch 1975 | loss: 0.0311392 | val_loss: 0.0311646 | Time: 3541.06 ms [2022-02-27 22:31:51 main:574] : INFO : Epoch 1976 | loss: 0.0311394 | val_loss: 0.0311654 | Time: 3384.49 ms [2022-02-27 22:31:54 main:574] : INFO : Epoch 1977 | loss: 0.0311399 | val_loss: 0.0311624 | Time: 3399.7 ms [2022-02-27 22:31:58 main:574] : INFO : Epoch 1978 | loss: 0.0311443 | val_loss: 0.0311727 | Time: 3500.22 ms [2022-02-27 22:32:01 main:574] : INFO : Epoch 1979 | loss: 0.031147 | val_loss: 0.0311602 | Time: 3470.49 ms [2022-02-27 22:32:04 main:574] : INFO : Epoch 1980 | loss: 0.0311449 | val_loss: 0.0311635 | Time: 3256.88 ms [2022-02-27 22:32:08 main:574] : INFO : Epoch 1981 | loss: 0.0311429 | val_loss: 0.0311631 | Time: 3696.9 ms [2022-02-27 22:32:11 main:574] : INFO : Epoch 1982 | loss: 0.0311434 | val_loss: 0.0311683 | Time: 3325.09 ms [2022-02-27 22:32:15 main:574] : INFO : Epoch 1983 | loss: 0.0311445 | val_loss: 0.031169 | Time: 3286.09 ms [2022-02-27 22:32:18 main:574] : INFO : Epoch 1984 | loss: 0.0311456 | val_loss: 0.03117 | Time: 3293.61 ms [2022-02-27 22:32:22 main:574] : INFO : Epoch 1985 | loss: 0.0311433 | val_loss: 0.0311606 | Time: 3685.12 ms [2022-02-27 22:32:25 main:574] : INFO : Epoch 1986 | loss: 0.0311415 | val_loss: 0.0311657 | Time: 3453.98 ms [2022-02-27 22:32:28 main:574] : INFO : Epoch 1987 | loss: 0.0311393 | val_loss: 0.0311594 | Time: 3367.96 ms [2022-02-27 22:32:32 main:574] : INFO : Epoch 1988 | loss: 0.0311406 | val_loss: 0.0311629 | Time: 3769.84 ms [2022-02-27 22:32:36 main:574] : INFO : Epoch 1989 | loss: 0.0311399 | val_loss: 0.0311641 | Time: 3460.57 ms [2022-02-27 22:32:39 main:574] : INFO : Epoch 1990 | loss: 0.031141 | val_loss: 0.0311649 | Time: 3442.02 ms [2022-02-27 22:32:43 main:574] : INFO : Epoch 1991 | loss: 0.0311393 | val_loss: 0.0311696 | Time: 3687.63 ms [2022-02-27 22:32:46 main:574] : INFO : Epoch 1992 | loss: 0.0311386 | val_loss: 0.031167 | Time: 3488.91 ms [2022-02-27 22:32:50 main:574] : INFO : Epoch 1993 | loss: 0.0311393 | val_loss: 0.0311652 | Time: 3342.23 ms [2022-02-27 22:32:54 main:574] : INFO : Epoch 1994 | loss: 0.0311391 | val_loss: 0.0311637 | Time: 3906.54 ms [2022-02-27 22:32:57 main:574] : INFO : Epoch 1995 | loss: 0.0311408 | val_loss: 0.0311672 | Time: 3511.38 ms [2022-02-27 22:33:01 main:574] : INFO : Epoch 1996 | loss: 0.0311409 | val_loss: 0.0311662 | Time: 3402.63 ms [2022-02-27 22:33:04 main:574] : INFO : Epoch 1997 | loss: 0.0311384 | val_loss: 0.0311594 | Time: 3877.41 ms [2022-02-27 22:33:08 main:574] : INFO : Epoch 1998 | loss: 0.0311387 | val_loss: 0.0311624 | Time: 3094.33 ms [2022-02-27 22:33:09 main:574] : INFO : Epoch 1999 | loss: 0.031139 | val_loss: 0.031166 | Time: 1906.75 ms [2022-02-27 22:33:11 main:574] : INFO : Epoch 2000 | loss: 0.0311375 | val_loss: 0.0311684 | Time: 1874.92 ms [2022-02-27 22:33:13 main:574] : INFO : Epoch 2001 | loss: 0.0311373 | val_loss: 0.0311607 | Time: 1897.8 ms [2022-02-27 22:33:15 main:574] : INFO : Epoch 2002 | loss: 0.0311401 | val_loss: 0.0311653 | Time: 1888.75 ms [2022-02-27 22:33:17 main:574] : INFO : Epoch 2003 | loss: 0.0311382 | val_loss: 0.0311632 | Time: 1891.77 ms [2022-02-27 22:33:19 main:574] : INFO : Epoch 2004 | loss: 0.031137 | val_loss: 0.0311612 | Time: 1894.53 ms [2022-02-27 22:33:21 main:574] : INFO : Epoch 2005 | loss: 0.0311379 | val_loss: 0.0311622 | Time: 1886.5 ms [2022-02-27 22:33:23 main:574] : INFO : Epoch 2006 | loss: 0.0311379 | val_loss: 0.0311614 | Time: 1879.01 ms [2022-02-27 22:33:25 main:574] : INFO : Epoch 2007 | loss: 0.0311377 | val_loss: 0.0311656 | Time: 1880.67 ms [2022-02-27 22:33:26 main:574] : INFO : Epoch 2008 | loss: 0.0311363 | val_loss: 0.0311625 | Time: 1878.57 ms [2022-02-27 22:33:28 main:574] : INFO : Epoch 2009 | loss: 0.0311356 | val_loss: 0.0311602 | Time: 1892.11 ms [2022-02-27 22:33:30 main:574] : INFO : Epoch 2010 | loss: 0.0311341 | val_loss: 0.0311624 | Time: 1896.1 ms [2022-02-27 22:33:32 main:574] : INFO : Epoch 2011 | loss: 0.0311357 | val_loss: 0.0311652 | Time: 1883.77 ms [2022-02-27 22:33:34 main:574] : INFO : Epoch 2012 | loss: 0.0311368 | val_loss: 0.0311662 | Time: 1893.54 ms [2022-02-27 22:33:36 main:574] : INFO : Epoch 2013 | loss: 0.0311365 | val_loss: 0.0311598 | Time: 1885.4 ms [2022-02-27 22:33:38 main:574] : INFO : Epoch 2014 | loss: 0.0311353 | val_loss: 0.0311599 | Time: 1880.18 ms [2022-02-27 22:33:40 main:574] : INFO : Epoch 2015 | loss: 0.0311361 | val_loss: 0.03116 | Time: 1883.67 ms [2022-02-27 22:33:42 main:574] : INFO : Epoch 2016 | loss: 0.0311372 | val_loss: 0.0311619 | Time: 1884.25 ms [2022-02-27 22:33:43 main:574] : INFO : Epoch 2017 | loss: 0.0311405 | val_loss: 0.0311657 | Time: 1896.37 ms [2022-02-27 22:33:45 main:574] : INFO : Epoch 2018 | loss: 0.0311376 | val_loss: 0.0311635 | Time: 1889.71 ms [2022-02-27 22:33:47 main:574] : INFO : Epoch 2019 | loss: 0.0311376 | val_loss: 0.0311589 | Time: 1917.98 ms [2022-02-27 22:33:49 main:574] : INFO : Epoch 2020 | loss: 0.0311385 | val_loss: 0.0311645 | Time: 1881.66 ms [2022-02-27 22:33:51 main:574] : INFO : Epoch 2021 | loss: 0.0311433 | val_loss: 0.031166 | Time: 1889.73 ms [2022-02-27 22:33:53 main:574] : INFO : Epoch 2022 | loss: 0.0311424 | val_loss: 0.0311619 | Time: 1890.94 ms [2022-02-27 22:33:55 main:574] : INFO : Epoch 2023 | loss: 0.0311408 | val_loss: 0.031164 | Time: 1890.81 ms [2022-02-27 22:33:57 main:574] : INFO : Epoch 2024 | loss: 0.0311395 | val_loss: 0.0311631 | Time: 1882.96 ms [2022-02-27 22:33:59 main:574] : INFO : Epoch 2025 | loss: 0.0311407 | val_loss: 0.0311608 | Time: 1894.83 ms [2022-02-27 22:34:01 main:574] : INFO : Epoch 2026 | loss: 0.031141 | val_loss: 0.0311622 | Time: 1899.07 ms [2022-02-27 22:34:02 main:574] : INFO : Epoch 2027 | loss: 0.0311399 | val_loss: 0.0311656 | Time: 1883.03 ms [2022-02-27 22:34:04 main:574] : INFO : Epoch 2028 | loss: 0.0311406 | val_loss: 0.0311647 | Time: 1915.64 ms [2022-02-27 22:34:06 main:574] : INFO : Epoch 2029 | loss: 0.0311377 | val_loss: 0.0311597 | Time: 1890.43 ms [2022-02-27 22:34:08 main:574] : INFO : Epoch 2030 | loss: 0.031138 | val_loss: 0.031166 | Time: 1903.39 ms [2022-02-27 22:34:10 main:574] : INFO : Epoch 2031 | loss: 0.031139 | val_loss: 0.0311606 | Time: 1878.82 ms [2022-02-27 22:34:12 main:574] : INFO : Epoch 2032 | loss: 0.0311392 | val_loss: 0.0311602 | Time: 1889.23 ms [2022-02-27 22:34:14 main:574] : INFO : Epoch 2033 | loss: 0.0311416 | val_loss: 0.0311638 | Time: 1883.92 ms [2022-02-27 22:34:16 main:574] : INFO : Epoch 2034 | loss: 0.0311372 | val_loss: 0.0311607 | Time: 1879 ms [2022-02-27 22:34:18 main:574] : INFO : Epoch 2035 | loss: 0.0311366 | val_loss: 0.0311648 | Time: 1890.77 ms [2022-02-27 22:34:20 main:574] : INFO : Epoch 2036 | loss: 0.0311377 | val_loss: 0.0311705 | Time: 1906.85 ms [2022-02-27 22:34:21 main:574] : INFO : Epoch 2037 | loss: 0.0311447 | val_loss: 0.0311721 | Time: 1880.23 ms [2022-02-27 22:34:23 main:574] : INFO : Epoch 2038 | loss: 0.031147 | val_loss: 0.0311721 | Time: 1892.55 ms [2022-02-27 22:34:25 main:574] : INFO : Epoch 2039 | loss: 0.0311443 | val_loss: 0.0311682 | Time: 1890.95 ms [2022-02-27 22:34:27 main:574] : INFO : Epoch 2040 | loss: 0.0311448 | val_loss: 0.0311717 | Time: 1888.41 ms [2022-02-27 22:34:29 main:574] : INFO : Epoch 2041 | loss: 0.0311451 | val_loss: 0.0311742 | Time: 1900.9 ms [2022-02-27 22:34:31 main:574] : INFO : Epoch 2042 | loss: 0.031147 | val_loss: 0.0311783 | Time: 1885.77 ms [2022-02-27 22:34:33 main:574] : INFO : Epoch 2043 | loss: 0.0311454 | val_loss: 0.0311698 | Time: 1897.87 ms [2022-02-27 22:34:35 main:574] : INFO : Epoch 2044 | loss: 0.0311437 | val_loss: 0.0311688 | Time: 1901.21 ms [2022-02-27 22:34:37 main:574] : INFO : Epoch 2045 | loss: 0.0311403 | val_loss: 0.0311714 | Time: 1897.01 ms [2022-02-27 22:34:39 main:574] : INFO : Epoch 2046 | loss: 0.0311436 | val_loss: 0.0311749 | Time: 1910.04 ms [2022-02-27 22:34:40 main:574] : INFO : Epoch 2047 | loss: 0.0311407 | val_loss: 0.0311695 | Time: 1885.02 ms [2022-02-27 22:34:42 main:574] : INFO : Epoch 2048 | loss: 0.0311401 | val_loss: 0.0311712 | Time: 1888.13 ms [2022-02-27 22:34:42 main:597] : INFO : Saving trained model to model-final.pt, val_loss 0.0311712 [2022-02-27 22:34:42 main:603] : INFO : Saving end state to config to file [2022-02-27 22:34:42 main:608] : INFO : Success, exiting.. 22:34:42 (14436): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)