Task 12591496
| Name | ParityModified-1645993321-23037-1-0_0 |
| Workunit | 9750265 |
| Created | 6 Mar 2022, 2:48:00 UTC |
| Sent | 10 Mar 2022, 19:17:54 UTC |
| Report deadline | 18 Mar 2022, 19:17:54 UTC |
| Received | 13 Mar 2022, 12:10:02 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 14544 |
| Run time | 1 hours 7 min 14 sec |
| CPU time | 1 hours 5 min 30 sec |
| Validate state | Valid |
| Credit | 4,160.00 |
| Device peak FLOPS | 3,199.36 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 2.09 GB |
| Peak swap size | 4.30 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version> <![CDATA[ <stderr_txt> 0.0310998 | val_loss: 0.0312157 | Time: 1888.2 ms [2022-03-13 09:50:54 main:574] : INFO : Epoch 1729 | loss: 0.0311043 | val_loss: 0.0312099 | Time: 1913.81 ms [2022-03-13 09:50:56 main:574] : INFO : Epoch 1730 | loss: 0.0311058 | val_loss: 0.0312098 | Time: 1936.72 ms [2022-03-13 09:50:58 main:574] : INFO : Epoch 1731 | loss: 0.031106 | val_loss: 0.0312129 | Time: 1928.7 ms [2022-03-13 09:51:00 main:574] : INFO : Epoch 1732 | loss: 0.0311018 | val_loss: 0.0312036 | Time: 1899.78 ms [2022-03-13 09:51:02 main:574] : INFO : Epoch 1733 | loss: 0.0311022 | val_loss: 0.0312078 | Time: 1895.54 ms [2022-03-13 09:51:04 main:574] : INFO : Epoch 1734 | loss: 0.0311004 | val_loss: 0.0312093 | Time: 1873.86 ms [2022-03-13 09:51:06 main:574] : INFO : Epoch 1735 | loss: 0.0311034 | val_loss: 0.0312122 | Time: 1930.83 ms [2022-03-13 09:51:08 main:574] : INFO : Epoch 1736 | loss: 0.0311063 | val_loss: 0.0311983 | Time: 1901.15 ms [2022-03-13 09:51:10 main:574] : INFO : Epoch 1737 | loss: 0.0311011 | val_loss: 0.0312046 | Time: 1943.04 ms [2022-03-13 09:51:12 main:574] : INFO : Epoch 1738 | loss: 0.0310975 | val_loss: 0.0312013 | Time: 1874.87 ms [2022-03-13 09:51:14 main:574] : INFO : Epoch 1739 | loss: 0.0310983 | val_loss: 0.0312084 | Time: 1941.52 ms [2022-03-13 09:51:15 main:574] : INFO : Epoch 1740 | loss: 0.0311035 | val_loss: 0.031202 | Time: 1907.7 ms [2022-03-13 09:51:17 main:574] : INFO : Epoch 1741 | loss: 0.0311026 | val_loss: 0.0312174 | Time: 1955.55 ms [2022-03-13 09:51:19 main:574] : INFO : Epoch 1742 | loss: 0.0311041 | val_loss: 0.0312027 | Time: 1880.84 ms [2022-03-13 09:51:21 main:574] : INFO : Epoch 1743 | loss: 0.0311028 | val_loss: 0.0312084 | Time: 1888.6 ms [2022-03-13 09:51:23 main:574] : INFO : Epoch 1744 | loss: 0.0311038 | val_loss: 0.0312052 | Time: 1879.33 ms [2022-03-13 09:51:25 main:574] : INFO : Epoch 1745 | loss: 0.0311361 | val_loss: 0.0312017 | Time: 1929.04 ms [2022-03-13 09:51:27 main:574] : INFO : Epoch 1746 | loss: 0.0311667 | val_loss: 0.031199 | Time: 1960.42 ms [2022-03-13 09:51:29 main:574] : INFO : Epoch 1747 | loss: 0.0311585 | val_loss: 0.031194 | Time: 1899.09 ms [2022-03-13 09:51:31 main:574] : INFO : Epoch 1748 | loss: 0.0311473 | val_loss: 0.0311938 | Time: 1912.49 ms [2022-03-13 09:51:33 main:574] : INFO : Epoch 1749 | loss: 0.0311416 | val_loss: 0.0311947 | Time: 1975.32 ms [2022-03-13 09:51:35 main:574] : INFO : Epoch 1750 | loss: 0.031139 | val_loss: 0.0311974 | Time: 1889.35 ms [2022-03-13 09:51:37 main:574] : INFO : Epoch 1751 | loss: 0.0311343 | val_loss: 0.0311947 | Time: 1910.96 ms [2022-03-13 09:51:39 main:574] : INFO : Epoch 1752 | loss: 0.0311245 | val_loss: 0.0311915 | Time: 1918.76 ms [2022-03-13 09:51:40 main:574] : INFO : Epoch 1753 | loss: 0.031117 | val_loss: 0.0312028 | Time: 1905.84 ms [2022-03-13 09:51:42 main:574] : INFO : Epoch 1754 | loss: 0.0311127 | val_loss: 0.0312038 | Time: 1928.55 ms [2022-03-13 09:51:44 main:574] : INFO : Epoch 1755 | loss: 0.0311079 | val_loss: 0.0312101 | Time: 1905.99 ms [2022-03-13 09:51:46 main:574] : INFO : Epoch 1756 | loss: 0.0311051 | val_loss: 0.0312039 | Time: 1902 ms [2022-03-13 09:51:48 main:574] : INFO : Epoch 1757 | loss: 0.0311049 | val_loss: 0.0312062 | Time: 1936.93 ms [2022-03-13 09:51:50 main:574] : INFO : Epoch 1758 | loss: 0.0311059 | val_loss: 0.0312043 | Time: 1886.4 ms [2022-03-13 09:51:52 main:574] : INFO : Epoch 1759 | loss: 0.0311025 | val_loss: 0.0311975 | Time: 1954.98 ms [2022-03-13 09:51:54 main:574] : INFO : Epoch 1760 | loss: 0.031105 | val_loss: 0.0312017 | Time: 1943.63 ms [2022-03-13 09:51:56 main:574] : INFO : Epoch 1761 | loss: 0.0311021 | val_loss: 0.031196 | Time: 1934.57 ms [2022-03-13 09:51:58 main:574] : INFO : Epoch 1762 | loss: 0.0310986 | val_loss: 0.0312048 | Time: 1913.86 ms [2022-03-13 09:52:00 main:574] : INFO : Epoch 1763 | loss: 0.0311062 | val_loss: 0.0312089 | Time: 1908.97 ms [2022-03-13 09:52:02 main:574] : INFO : Epoch 1764 | loss: 0.0311277 | val_loss: 0.0311922 | Time: 1905.73 ms [2022-03-13 09:52:04 main:574] : INFO : Epoch 1765 | loss: 0.0311317 | val_loss: 0.0311923 | Time: 1904.53 ms [2022-03-13 09:52:05 main:574] : INFO : Epoch 1766 | loss: 0.0311258 | val_loss: 0.0311979 | Time: 1929.7 ms [2022-03-13 09:52:07 main:574] : INFO : Epoch 1767 | loss: 0.0311204 | val_loss: 0.031199 | Time: 1915.61 ms [2022-03-13 09:52:09 main:574] : INFO : Epoch 1768 | loss: 0.0311133 | val_loss: 0.0311938 | Time: 1921.59 ms [2022-03-13 09:52:11 main:574] : INFO : Epoch 1769 | loss: 0.0311097 | val_loss: 0.0311933 | Time: 1940.16 ms [2022-03-13 09:52:13 main:574] : INFO : Epoch 1770 | loss: 0.0311091 | val_loss: 0.0311925 | Time: 1913.43 ms [2022-03-13 09:52:15 main:574] : INFO : Epoch 1771 | loss: 0.0311174 | val_loss: 0.0311994 | Time: 2003.21 ms [2022-03-13 09:52:17 main:574] : INFO : Epoch 1772 | loss: 0.0311125 | val_loss: 0.0311921 | Time: 1915.99 ms [2022-03-13 09:52:19 main:574] : INFO : Epoch 1773 | loss: 0.0311105 | val_loss: 0.0312027 | Time: 1904.59 ms [2022-03-13 09:52:21 main:574] : INFO : Epoch 1774 | loss: 0.0311095 | val_loss: 0.0312058 | Time: 1929.11 ms [2022-03-13 09:52:23 main:574] : INFO : Epoch 1775 | loss: 0.0311169 | val_loss: 0.0311936 | Time: 1873.12 ms [2022-03-13 09:52:25 main:574] : INFO : Epoch 1776 | loss: 0.0311205 | val_loss: 0.0311997 | Time: 1906.38 ms [2022-03-13 09:52:27 main:574] : INFO : Epoch 1777 | loss: 0.0311316 | val_loss: 0.0311917 | Time: 1913.83 ms [2022-03-13 09:52:29 main:574] : INFO : Epoch 1778 | loss: 0.0311707 | val_loss: 0.0311931 | Time: 1916.36 ms [2022-03-13 09:52:30 main:574] : INFO : Epoch 1779 | loss: 0.0311633 | val_loss: 0.0311846 | Time: 1901.28 ms [2022-03-13 09:52:32 main:574] : INFO : Epoch 1780 | loss: 0.0311553 | val_loss: 0.0311823 | Time: 1876.3 ms [2022-03-13 09:52:34 main:574] : INFO : Epoch 1781 | loss: 0.0311487 | val_loss: 0.03118 | Time: 1927.47 ms [2022-03-13 09:52:36 main:574] : INFO : Epoch 1782 | loss: 0.0311439 | val_loss: 0.0311794 | Time: 1900.12 ms [2022-03-13 09:52:38 main:574] : INFO : Epoch 1783 | loss: 0.0311374 | val_loss: 0.0311799 | Time: 1907.62 ms [2022-03-13 09:52:40 main:574] : INFO : Epoch 1784 | loss: 0.0311339 | val_loss: 0.0311822 | Time: 1903.39 ms [2022-03-13 09:52:42 main:574] : INFO : Epoch 1785 | loss: 0.0311353 | val_loss: 0.0311818 | Time: 1890.61 ms [2022-03-13 09:52:44 main:574] : INFO : Epoch 1786 | loss: 0.0311325 | val_loss: 0.03118 | Time: 1887.3 ms [2022-03-13 09:52:46 main:574] : INFO : Epoch 1787 | loss: 0.0311304 | val_loss: 0.0311883 | Time: 1930.72 ms [2022-03-13 09:52:48 main:574] : INFO : Epoch 1788 | loss: 0.03114 | val_loss: 0.031187 | Time: 1874.92 ms [2022-03-13 09:52:50 main:574] : INFO : Epoch 1789 | loss: 0.0311682 | val_loss: 0.031184 | Time: 1899.37 ms [2022-03-13 09:52:51 main:574] : INFO : Epoch 1790 | loss: 0.0311624 | val_loss: 0.0311824 | Time: 1920 ms [2022-03-13 09:52:53 main:574] : INFO : Epoch 1791 | loss: 0.0311554 | val_loss: 0.031186 | Time: 1936.25 ms [2022-03-13 09:52:55 main:574] : INFO : Epoch 1792 | loss: 0.0311507 | val_loss: 0.0311792 | Time: 1916.44 ms [2022-03-13 09:52:57 main:574] : INFO : Epoch 1793 | loss: 0.0311459 | val_loss: 0.031182 | Time: 1901.26 ms [2022-03-13 09:52:59 main:574] : INFO : Epoch 1794 | loss: 0.0311439 | val_loss: 0.0311831 | Time: 1936.01 ms [2022-03-13 09:53:01 main:574] : INFO : Epoch 1795 | loss: 0.0311432 | val_loss: 0.0311846 | Time: 1901.08 ms [2022-03-13 09:53:03 main:574] : INFO : Epoch 1796 | loss: 0.0311397 | val_loss: 0.0311771 | Time: 1881 ms [2022-03-13 09:53:05 main:574] : INFO : Epoch 1797 | loss: 0.0311371 | val_loss: 0.0311811 | Time: 1931.17 ms [2022-03-13 09:53:07 main:574] : INFO : Epoch 1798 | loss: 0.0311354 | val_loss: 0.0311819 | Time: 1914 ms [2022-03-13 09:53:09 main:574] : INFO : Epoch 1799 | loss: 0.031136 | val_loss: 0.0311799 | Time: 1915.7 ms [2022-03-13 09:53:11 main:574] : INFO : Epoch 1800 | loss: 0.0311358 | val_loss: 0.031182 | Time: 1923.43 ms [2022-03-13 09:53:13 main:574] : INFO : Epoch 1801 | loss: 0.0311352 | val_loss: 0.0311896 | Time: 1932.8 ms [2022-03-13 09:53:15 main:574] : INFO : Epoch 1802 | loss: 0.0311352 | val_loss: 0.03118 | Time: 1944.44 ms [2022-03-13 09:53:16 main:574] : INFO : Epoch 1803 | loss: 0.0311327 | val_loss: 0.0311824 | Time: 1921.25 ms [2022-03-13 09:53:18 main:574] : INFO : Epoch 1804 | loss: 0.0311474 | val_loss: 0.0311823 | Time: 1894.58 ms [2022-03-13 09:53:20 main:574] : INFO : Epoch 1805 | loss: 0.0311433 | val_loss: 0.03119 | Time: 1940.36 ms [2022-03-13 09:53:22 main:574] : INFO : Epoch 1806 | loss: 0.0311385 | val_loss: 0.0311866 | Time: 1921.21 ms [2022-03-13 09:53:24 main:574] : INFO : Epoch 1807 | loss: 0.0311317 | val_loss: 0.0311823 | Time: 1904.25 ms [2022-03-13 09:53:26 main:574] : INFO : Epoch 1808 | loss: 0.0311288 | val_loss: 0.0311832 | Time: 1884.54 ms [2022-03-13 09:53:28 main:574] : INFO : Epoch 1809 | loss: 0.0311311 | val_loss: 0.0311816 | Time: 1904.4 ms [2022-03-13 09:53:30 main:574] : INFO : Epoch 1810 | loss: 0.0311322 | val_loss: 0.0311817 | Time: 1918.04 ms [2022-03-13 09:53:32 main:574] : INFO : Epoch 1811 | loss: 0.0311279 | val_loss: 0.0311861 | Time: 1927.26 ms [2022-03-13 09:53:34 main:574] : INFO : Epoch 1812 | loss: 0.0311302 | val_loss: 0.031187 | Time: 1996.21 ms [2022-03-13 09:53:36 main:574] : INFO : Epoch 1813 | loss: 0.0311338 | val_loss: 0.0311942 | Time: 1929.06 ms [2022-03-13 09:53:38 main:574] : INFO : Epoch 1814 | loss: 0.0311277 | val_loss: 0.0311914 | Time: 1900.39 ms [2022-03-13 09:53:40 main:574] : INFO : Epoch 1815 | loss: 0.0311252 | val_loss: 0.0311985 | Time: 1943.79 ms [2022-03-13 09:53:41 main:574] : INFO : Epoch 1816 | loss: 0.0311837 | val_loss: 0.0312829 | Time: 1884.65 ms [2022-03-13 09:53:43 main:574] : INFO : Epoch 1817 | loss: 0.0323606 | val_loss: 0.033 | Time: 1918.07 ms [2022-03-13 09:53:45 main:574] : INFO : Epoch 1818 | loss: 0.0328792 | val_loss: 0.031592 | Time: 1899.97 ms [2022-03-13 09:53:47 main:574] : INFO : Epoch 1819 | loss: 0.0314009 | val_loss: 0.0313207 | Time: 1931.22 ms [2022-03-13 09:53:49 main:574] : INFO : Epoch 1820 | loss: 0.0312755 | val_loss: 0.031255 | Time: 1905.68 ms [2022-03-13 09:53:51 main:574] : INFO : Epoch 1821 | loss: 0.0312544 | val_loss: 0.031253 | Time: 1871.75 ms [2022-03-13 09:53:53 main:574] : INFO : Epoch 1822 | loss: 0.0312511 | val_loss: 0.0312504 | Time: 1911.82 ms [2022-03-13 09:53:55 main:574] : INFO : Epoch 1823 | loss: 0.0312503 | val_loss: 0.0312502 | Time: 1907.95 ms [2022-03-13 09:53:57 main:574] : INFO : Epoch 1824 | loss: 0.0312502 | val_loss: 0.0312502 | Time: 1914.76 ms [2022-03-13 09:53:59 main:574] : INFO : Epoch 1825 | loss: 0.0312501 | val_loss: 0.0312516 | Time: 1915.99 ms [2022-03-13 09:54:01 main:574] : INFO : Epoch 1826 | loss: 0.0312504 | val_loss: 0.0312503 | Time: 1923.17 ms [2022-03-13 09:54:03 main:574] : INFO : Epoch 1827 | loss: 0.03125 | val_loss: 0.0312503 | Time: 1901.46 ms [2022-03-13 09:54:04 main:574] : INFO : Epoch 1828 | loss: 0.0312504 | val_loss: 0.0312503 | Time: 1895.56 ms [2022-03-13 09:54:06 main:574] : INFO : Epoch 1829 | loss: 0.0312504 | val_loss: 0.0312503 | Time: 1917.37 ms [2022-03-13 09:54:08 main:574] : INFO : Epoch 1830 | loss: 0.0312499 | val_loss: 0.0312506 | Time: 1908.59 ms [2022-03-13 09:54:10 main:574] : INFO : Epoch 1831 | loss: 0.0312499 | val_loss: 0.0312505 | Time: 1906.69 ms [2022-03-13 09:54:12 main:574] : INFO : Epoch 1832 | loss: 0.03125 | val_loss: 0.0312514 | Time: 1907.89 ms [2022-03-13 09:54:14 main:574] : INFO : Epoch 1833 | loss: 0.03125 | val_loss: 0.0312503 | Time: 1902.51 ms [2022-03-13 09:54:16 main:574] : INFO : Epoch 1834 | loss: 0.0312503 | val_loss: 0.0312516 | Time: 1905.23 ms [2022-03-13 09:54:18 main:574] : INFO : Epoch 1835 | loss: 0.0312503 | val_loss: 0.0312504 | Time: 1895.17 ms [2022-03-13 09:54:20 main:574] : INFO : Epoch 1836 | loss: 0.0312496 | val_loss: 0.0312506 | Time: 1899.68 ms [2022-03-13 09:54:22 main:574] : INFO : Epoch 1837 | loss: 0.0312494 | val_loss: 0.0312504 | Time: 1894.79 ms [2022-03-13 09:54:24 main:574] : INFO : Epoch 1838 | loss: 0.0312493 | val_loss: 0.0312506 | Time: 1901.98 ms [2022-03-13 09:54:25 main:574] : INFO : Epoch 1839 | loss: 0.0312492 | val_loss: 0.0312509 | Time: 1938 ms [2022-03-13 09:54:27 main:574] : INFO : Epoch 1840 | loss: 0.0312496 | val_loss: 0.0312511 | Time: 1900.54 ms [2022-03-13 09:54:29 main:574] : INFO : Epoch 1841 | loss: 0.0312496 | val_loss: 0.0312508 | Time: 1889.34 ms [2022-03-13 09:54:31 main:574] : INFO : Epoch 1842 | loss: 0.0312494 | val_loss: 0.0312509 | Time: 1924.25 ms [2022-03-13 09:54:33 main:574] : INFO : Epoch 1843 | loss: 0.0312494 | val_loss: 0.0312504 | Time: 1907.08 ms [2022-03-13 09:54:35 main:574] : INFO : Epoch 1844 | loss: 0.0312494 | val_loss: 0.0312504 | Time: 1923.23 ms [2022-03-13 09:54:37 main:574] : INFO : Epoch 1845 | loss: 0.0312498 | val_loss: 0.0312513 | Time: 1907.35 ms [2022-03-13 09:54:39 main:574] : INFO : Epoch 1846 | loss: 0.0312503 | val_loss: 0.03125 | Time: 1922.67 ms [2022-03-13 09:54:41 main:574] : INFO : Epoch 1847 | loss: 0.0312496 | val_loss: 0.0312511 | Time: 1891.26 ms [2022-03-13 09:54:43 main:574] : INFO : Epoch 1848 | loss: 0.0312498 | val_loss: 0.0312505 | Time: 1898.36 ms [2022-03-13 09:54:45 main:574] : INFO : Epoch 1849 | loss: 0.03125 | val_loss: 0.0312507 | Time: 1891.7 ms [2022-03-13 09:54:46 main:574] : INFO : Epoch 1850 | loss: 0.0312496 | val_loss: 0.0312502 | Time: 1903.71 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1650) [2022-03-13 09:56:08 main:435] : INFO : Set logging level to 1 [2022-03-13 09:56:08 main:441] : INFO : Running in BOINC Client mode [2022-03-13 09:56:08 main:444] : INFO : Resolving all filenames [2022-03-13 09:56:08 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-03-13 09:56:08 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-03-13 09:56:08 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-03-13 09:56:08 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-03-13 09:56:08 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-03-13 09:56:08 main:472] : INFO : Dataset filename: dataset.hdf5 Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1650) [2022-03-13 10:07:30 main:435] : INFO : Set logging level to 1 [2022-03-13 10:07:30 main:441] : INFO : Running in BOINC Client mode [2022-03-13 10:07:30 main:444] : INFO : Resolving all filenames [2022-03-13 10:07:30 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-03-13 10:07:30 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-03-13 10:07:30 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-03-13 10:07:30 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-03-13 10:07:30 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-03-13 10:07:30 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-03-13 10:07:30 main:474] : INFO : Configuration: [2022-03-13 10:07:30 main:475] : INFO : Model type: GRU [2022-03-13 10:07:30 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-03-13 10:07:30 main:477] : INFO : Max Epochs: 2048 [2022-03-13 10:07:30 main:478] : INFO : Batch Size: 128 [2022-03-13 10:07:30 main:479] : INFO : Learning Rate: 0.01 [2022-03-13 10:07:30 main:480] : INFO : Patience: 10 [2022-03-13 10:07:30 main:481] : INFO : Hidden Width: 12 [2022-03-13 10:07:30 main:482] : INFO : # Recurrent Layers: 4 [2022-03-13 10:07:30 main:483] : INFO : # Backend Layers: 4 [2022-03-13 10:07:30 main:484] : INFO : # Threads: 1 [2022-03-13 10:07:30 main:486] : INFO : Preparing Dataset [2022-03-13 10:07:30 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-03-13 10:07:30 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-03-13 10:07:32 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-03-13 10:07:32 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-03-13 10:07:32 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-03-13 10:07:32 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-03-13 10:07:32 main:494] : INFO : Creating Model [2022-03-13 10:07:32 main:507] : INFO : Preparing config file [2022-03-13 10:07:32 main:511] : INFO : Found checkpoint, attempting to load... [2022-03-13 10:07:32 main:512] : INFO : Loading config [2022-03-13 10:07:32 main:514] : INFO : Loading state [2022-03-13 10:07:33 main:559] : INFO : Loading DataLoader into Memory [2022-03-13 10:07:33 main:562] : INFO : Starting Training [2022-03-13 10:07:35 main:574] : INFO : Epoch 1824 | loss: 0.0313852 | val_loss: 0.0312776 | Time: 2176.09 ms [2022-03-13 10:07:37 main:574] : INFO : Epoch 1825 | loss: 0.0312626 | val_loss: 0.0312533 | Time: 1884.63 ms [2022-03-13 10:07:39 main:574] : INFO : Epoch 1826 | loss: 0.0312514 | val_loss: 0.0312501 | Time: 1880.29 ms [2022-03-13 10:07:41 main:574] : INFO : Epoch 1827 | loss: 0.0312491 | val_loss: 0.0312499 | Time: 1903.64 ms [2022-03-13 10:07:43 main:574] : INFO : Epoch 1828 | loss: 0.0312493 | val_loss: 0.0312533 | Time: 1880.4 ms [2022-03-13 10:07:45 main:574] : INFO : Epoch 1829 | loss: 0.0312497 | val_loss: 0.031248 | Time: 1950.47 ms [2022-03-13 10:07:47 main:574] : INFO : Epoch 1830 | loss: 0.0312465 | val_loss: 0.0312475 | Time: 1916.7 ms [2022-03-13 10:07:49 main:574] : INFO : Epoch 1831 | loss: 0.0312443 | val_loss: 0.0312447 | Time: 1896.29 ms [2022-03-13 10:07:50 main:574] : INFO : Epoch 1832 | loss: 0.0312408 | val_loss: 0.0312397 | Time: 1880.33 ms [2022-03-13 10:07:52 main:574] : INFO : Epoch 1833 | loss: 0.0312394 | val_loss: 0.0312388 | Time: 1889 ms [2022-03-13 10:07:54 main:574] : INFO : Epoch 1834 | loss: 0.0312388 | val_loss: 0.0312384 | Time: 1884.34 ms [2022-03-13 10:07:56 main:574] : INFO : Epoch 1835 | loss: 0.0312333 | val_loss: 0.0312319 | Time: 1903.36 ms [2022-03-13 10:07:58 main:574] : INFO : Epoch 1836 | loss: 0.0312313 | val_loss: 0.0312353 | Time: 1903.18 ms [2022-03-13 10:08:00 main:574] : INFO : Epoch 1837 | loss: 0.0312308 | val_loss: 0.0312261 | Time: 1915.95 ms [2022-03-13 10:08:02 main:574] : INFO : Epoch 1838 | loss: 0.0312226 | val_loss: 0.0312289 | Time: 1876.69 ms [2022-03-13 10:08:04 main:574] : INFO : Epoch 1839 | loss: 0.0312214 | val_loss: 0.0312222 | Time: 1905.32 ms [2022-03-13 10:08:06 main:574] : INFO : Epoch 1840 | loss: 0.0312163 | val_loss: 0.0312185 | Time: 1879.17 ms [2022-03-13 10:08:08 main:574] : INFO : Epoch 1841 | loss: 0.0312119 | val_loss: 0.0312244 | Time: 1917.91 ms [2022-03-13 10:08:10 main:574] : INFO : Epoch 1842 | loss: 0.0312114 | val_loss: 0.0312195 | Time: 1948.63 ms [2022-03-13 10:08:11 main:574] : INFO : Epoch 1843 | loss: 0.0312126 | val_loss: 0.0312193 | Time: 1865.12 ms [2022-03-13 10:08:13 main:574] : INFO : Epoch 1844 | loss: 0.0312114 | val_loss: 0.0312148 | Time: 1891.38 ms [2022-03-13 10:08:15 main:574] : INFO : Epoch 1845 | loss: 0.0312078 | val_loss: 0.0312131 | Time: 1881.84 ms [2022-03-13 10:08:17 main:574] : INFO : Epoch 1846 | loss: 0.0312065 | val_loss: 0.0312122 | Time: 1886.21 ms [2022-03-13 10:08:19 main:574] : INFO : Epoch 1847 | loss: 0.0312057 | val_loss: 0.0312113 | Time: 1873.64 ms [2022-03-13 10:08:21 main:574] : INFO : Epoch 1848 | loss: 0.0312035 | val_loss: 0.0312131 | Time: 1889.35 ms [2022-03-13 10:08:23 main:574] : INFO : Epoch 1849 | loss: 0.0312038 | val_loss: 0.03121 | Time: 1929.55 ms [2022-03-13 10:08:25 main:574] : INFO : Epoch 1850 | loss: 0.0312016 | val_loss: 0.0312161 | Time: 1873.59 ms [2022-03-13 10:08:27 main:574] : INFO : Epoch 1851 | loss: 0.0312002 | val_loss: 0.0312077 | Time: 1987.76 ms [2022-03-13 10:08:29 main:574] : INFO : Epoch 1852 | loss: 0.0311998 | val_loss: 0.0312135 | Time: 1895.99 ms [2022-03-13 10:08:31 main:574] : INFO : Epoch 1853 | loss: 0.0311988 | val_loss: 0.031212 | Time: 1981.96 ms [2022-03-13 10:08:32 main:574] : INFO : Epoch 1854 | loss: 0.0311967 | val_loss: 0.031206 | Time: 1912.23 ms [2022-03-13 10:08:34 main:574] : INFO : Epoch 1855 | loss: 0.0311952 | val_loss: 0.0312055 | Time: 1901.65 ms [2022-03-13 10:08:36 main:574] : INFO : Epoch 1856 | loss: 0.0311974 | val_loss: 0.0312067 | Time: 1871.27 ms [2022-03-13 10:08:38 main:574] : INFO : Epoch 1857 | loss: 0.0311956 | val_loss: 0.0312059 | Time: 1881.68 ms [2022-03-13 10:08:40 main:574] : INFO : Epoch 1858 | loss: 0.0311955 | val_loss: 0.0312058 | Time: 1903.55 ms [2022-03-13 10:08:42 main:574] : INFO : Epoch 1859 | loss: 0.0311949 | val_loss: 0.031206 | Time: 1890.84 ms [2022-03-13 10:08:44 main:574] : INFO : Epoch 1860 | loss: 0.031192 | val_loss: 0.031205 | Time: 1898.42 ms [2022-03-13 10:08:46 main:574] : INFO : Epoch 1861 | loss: 0.0311912 | val_loss: 0.0312061 | Time: 1881.51 ms [2022-03-13 10:08:48 main:574] : INFO : Epoch 1862 | loss: 0.0311898 | val_loss: 0.031203 | Time: 1889.65 ms [2022-03-13 10:08:49 main:574] : INFO : Epoch 1863 | loss: 0.0311889 | val_loss: 0.0312026 | Time: 1880.08 ms [2022-03-13 10:08:51 main:574] : INFO : Epoch 1864 | loss: 0.0311865 | val_loss: 0.0312017 | Time: 1898.1 ms [2022-03-13 10:08:53 main:574] : INFO : Epoch 1865 | loss: 0.0311894 | val_loss: 0.0312058 | Time: 1916.12 ms [2022-03-13 10:08:55 main:574] : INFO : Epoch 1866 | loss: 0.0311926 | val_loss: 0.0312047 | Time: 1881.34 ms [2022-03-13 10:08:57 main:574] : INFO : Epoch 1867 | loss: 0.0311888 | val_loss: 0.0312024 | Time: 1886.59 ms [2022-03-13 10:08:59 main:574] : INFO : Epoch 1868 | loss: 0.0311858 | val_loss: 0.0311988 | Time: 1905.86 ms [2022-03-13 10:09:01 main:574] : INFO : Epoch 1869 | loss: 0.0311841 | val_loss: 0.0311988 | Time: 1907.27 ms [2022-03-13 10:09:03 main:574] : INFO : Epoch 1870 | loss: 0.0311842 | val_loss: 0.0311978 | Time: 1926.35 ms [2022-03-13 10:09:05 main:574] : INFO : Epoch 1871 | loss: 0.0311823 | val_loss: 0.0311972 | Time: 1878.32 ms [2022-03-13 10:09:07 main:574] : INFO : Epoch 1872 | loss: 0.0311803 | val_loss: 0.0311917 | Time: 1908.3 ms [2022-03-13 10:09:09 main:574] : INFO : Epoch 1873 | loss: 0.0311835 | val_loss: 0.0311926 | Time: 1882.95 ms [2022-03-13 10:09:10 main:574] : INFO : Epoch 1874 | loss: 0.0311827 | val_loss: 0.0312012 | Time: 1898.33 ms [2022-03-13 10:09:12 main:574] : INFO : Epoch 1875 | loss: 0.0311813 | val_loss: 0.031194 | Time: 1882.62 ms [2022-03-13 10:09:14 main:574] : INFO : Epoch 1876 | loss: 0.0311791 | val_loss: 0.0311931 | Time: 1907.81 ms [2022-03-13 10:09:16 main:574] : INFO : Epoch 1877 | loss: 0.0311783 | val_loss: 0.0311966 | Time: 1916.04 ms [2022-03-13 10:09:18 main:574] : INFO : Epoch 1878 | loss: 0.0311789 | val_loss: 0.0311942 | Time: 1884.24 ms [2022-03-13 10:09:20 main:574] : INFO : Epoch 1879 | loss: 0.0311767 | val_loss: 0.0311947 | Time: 1876.98 ms [2022-03-13 10:09:22 main:574] : INFO : Epoch 1880 | loss: 0.0311764 | val_loss: 0.0311949 | Time: 1907.23 ms [2022-03-13 10:09:24 main:574] : INFO : Epoch 1881 | loss: 0.0311774 | val_loss: 0.0312086 | Time: 1879.62 ms [2022-03-13 10:09:26 main:574] : INFO : Epoch 1882 | loss: 0.031181 | val_loss: 0.0311955 | Time: 1884.71 ms [2022-03-13 10:09:27 main:574] : INFO : Epoch 1883 | loss: 0.0311719 | val_loss: 0.0311901 | Time: 1886.68 ms [2022-03-13 10:09:29 main:574] : INFO : Epoch 1884 | loss: 0.0311705 | val_loss: 0.0311919 | Time: 1883.43 ms [2022-03-13 10:09:31 main:574] : INFO : Epoch 1885 | loss: 0.0311738 | val_loss: 0.0311933 | Time: 1957 ms [2022-03-13 10:09:33 main:574] : INFO : Epoch 1886 | loss: 0.0311759 | val_loss: 0.0311887 | Time: 1942.12 ms [2022-03-13 10:09:35 main:574] : INFO : Epoch 1887 | loss: 0.0311761 | val_loss: 0.0311925 | Time: 1903.29 ms [2022-03-13 10:09:37 main:574] : INFO : Epoch 1888 | loss: 0.0311814 | val_loss: 0.0311968 | Time: 1873.97 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1650) [2022-03-13 10:12:38 main:435] : INFO : Set logging level to 1 [2022-03-13 10:12:38 main:441] : INFO : Running in BOINC Client mode [2022-03-13 10:12:38 main:444] : INFO : Resolving all filenames [2022-03-13 10:12:38 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-03-13 10:12:38 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-03-13 10:12:38 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-03-13 10:12:38 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-03-13 10:12:38 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-03-13 10:12:38 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-03-13 10:12:38 main:474] : INFO : Configuration: [2022-03-13 10:12:38 main:475] : INFO : Model type: GRU [2022-03-13 10:12:38 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-03-13 10:12:38 main:477] : INFO : Max Epochs: 2048 [2022-03-13 10:12:38 main:478] : INFO : Batch Size: 128 [2022-03-13 10:12:38 main:479] : INFO : Learning Rate: 0.01 [2022-03-13 10:12:38 main:480] : INFO : Patience: 10 [2022-03-13 10:12:38 main:481] : INFO : Hidden Width: 12 [2022-03-13 10:12:38 main:482] : INFO : # Recurrent Layers: 4 [2022-03-13 10:12:38 main:483] : INFO : # Backend Layers: 4 [2022-03-13 10:12:38 main:484] : INFO : # Threads: 1 [2022-03-13 10:12:38 main:486] : INFO : Preparing Dataset [2022-03-13 10:12:38 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-03-13 10:12:39 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-03-13 10:12:40 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-03-13 10:12:40 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-03-13 10:12:40 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-03-13 10:12:40 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-03-13 10:12:40 main:494] : INFO : Creating Model [2022-03-13 10:12:40 main:507] : INFO : Preparing config file [2022-03-13 10:12:40 main:511] : INFO : Found checkpoint, attempting to load... [2022-03-13 10:12:40 main:512] : INFO : Loading config [2022-03-13 10:12:41 main:514] : INFO : Loading state [2022-03-13 10:12:42 main:559] : INFO : Loading DataLoader into Memory [2022-03-13 10:12:42 main:562] : INFO : Starting Training [2022-03-13 10:12:44 main:574] : INFO : Epoch 1824 | loss: 0.0313599 | val_loss: 0.0312767 | Time: 2247.89 ms [2022-03-13 10:12:46 main:574] : INFO : Epoch 1825 | loss: 0.0312576 | val_loss: 0.0312504 | Time: 1865.82 ms [2022-03-13 10:12:48 main:574] : INFO : Epoch 1826 | loss: 0.0312506 | val_loss: 0.0312493 | Time: 1882.39 ms [2022-03-13 10:12:50 main:574] : INFO : Epoch 1827 | loss: 0.0312486 | val_loss: 0.0312473 | Time: 1910.41 ms [2022-03-13 10:12:52 main:574] : INFO : Epoch 1828 | loss: 0.0312475 | val_loss: 0.0312464 | Time: 1892.12 ms [2022-03-13 10:12:53 main:574] : INFO : Epoch 1829 | loss: 0.0312476 | val_loss: 0.0312456 | Time: 1875.08 ms [2022-03-13 10:12:55 main:574] : INFO : Epoch 1830 | loss: 0.0312451 | val_loss: 0.0312453 | Time: 1892.04 ms [2022-03-13 10:12:57 main:574] : INFO : Epoch 1831 | loss: 0.0312428 | val_loss: 0.031243 | Time: 1901.8 ms [2022-03-13 10:12:59 main:574] : INFO : Epoch 1832 | loss: 0.0312412 | val_loss: 0.0312413 | Time: 1871.69 ms [2022-03-13 10:13:01 main:574] : INFO : Epoch 1833 | loss: 0.0312409 | val_loss: 0.0312442 | Time: 1885.32 ms [2022-03-13 10:13:03 main:574] : INFO : Epoch 1834 | loss: 0.0312439 | val_loss: 0.0312428 | Time: 1964.5 ms [2022-03-13 10:13:05 main:574] : INFO : Epoch 1835 | loss: 0.0312446 | val_loss: 0.0312418 | Time: 1883.98 ms [2022-03-13 10:13:07 main:574] : INFO : Epoch 1836 | loss: 0.0312409 | val_loss: 0.0312387 | Time: 1888.15 ms [2022-03-13 10:13:09 main:574] : INFO : Epoch 1837 | loss: 0.031237 | val_loss: 0.0312323 | Time: 1898.83 ms [2022-03-13 10:13:11 main:574] : INFO : Epoch 1838 | loss: 0.0312376 | val_loss: 0.0312379 | Time: 1868.82 ms [2022-03-13 10:13:12 main:574] : INFO : Epoch 1839 | loss: 0.0312328 | val_loss: 0.0312367 | Time: 1921.07 ms [2022-03-13 10:13:14 main:574] : INFO : Epoch 1840 | loss: 0.0312257 | val_loss: 0.0312236 | Time: 1861.7 ms [2022-03-13 10:13:16 main:574] : INFO : Epoch 1841 | loss: 0.0312197 | val_loss: 0.0312256 | Time: 1881.14 ms [2022-03-13 10:13:18 main:574] : INFO : Epoch 1842 | loss: 0.0312153 | val_loss: 0.0312126 | Time: 1895.02 ms [2022-03-13 10:13:20 main:574] : INFO : Epoch 1843 | loss: 0.0312127 | val_loss: 0.0312145 | Time: 1934.75 ms [2022-03-13 10:13:22 main:574] : INFO : Epoch 1844 | loss: 0.0312086 | val_loss: 0.0312145 | Time: 1876 ms [2022-03-13 10:13:24 main:574] : INFO : Epoch 1845 | loss: 0.031207 | val_loss: 0.0312148 | Time: 1901.81 ms [2022-03-13 10:13:26 main:574] : INFO : Epoch 1846 | loss: 0.0312126 | val_loss: 0.0312159 | Time: 1913.44 ms [2022-03-13 10:13:28 main:574] : INFO : Epoch 1847 | loss: 0.0312026 | val_loss: 0.0312042 | Time: 1895.86 ms [2022-03-13 10:13:30 main:574] : INFO : Epoch 1848 | loss: 0.0311999 | val_loss: 0.0312038 | Time: 1881.57 ms [2022-03-13 10:13:31 main:574] : INFO : Epoch 1849 | loss: 0.0311979 | val_loss: 0.0312022 | Time: 1878.71 ms [2022-03-13 10:13:33 main:574] : INFO : Epoch 1850 | loss: 0.0311948 | val_loss: 0.0312026 | Time: 1875.96 ms [2022-03-13 10:13:35 main:574] : INFO : Epoch 1851 | loss: 0.0311975 | val_loss: 0.0312023 | Time: 1872.53 ms [2022-03-13 10:13:37 main:574] : INFO : Epoch 1852 | loss: 0.0311953 | val_loss: 0.0312018 | Time: 1883.32 ms [2022-03-13 10:13:39 main:574] : INFO : Epoch 1853 | loss: 0.0311923 | val_loss: 0.0312004 | Time: 1994.7 ms [2022-03-13 10:13:41 main:574] : INFO : Epoch 1854 | loss: 0.0311937 | val_loss: 0.0312086 | Time: 1892.42 ms [2022-03-13 10:13:43 main:574] : INFO : Epoch 1855 | loss: 0.0311992 | val_loss: 0.0312019 | Time: 1873.47 ms [2022-03-13 10:13:45 main:574] : INFO : Epoch 1856 | loss: 0.031189 | val_loss: 0.031196 | Time: 1886.49 ms [2022-03-13 10:13:47 main:574] : INFO : Epoch 1857 | loss: 0.0311893 | val_loss: 0.0311932 | Time: 1877.43 ms [2022-03-13 10:13:49 main:574] : INFO : Epoch 1858 | loss: 0.0311884 | val_loss: 0.031195 | Time: 1873.94 ms [2022-03-13 10:13:50 main:574] : INFO : Epoch 1859 | loss: 0.0311881 | val_loss: 0.0311925 | Time: 1865.87 ms [2022-03-13 10:13:52 main:574] : INFO : Epoch 1860 | loss: 0.031188 | val_loss: 0.0311916 | Time: 1885.19 ms [2022-03-13 10:13:54 main:574] : INFO : Epoch 1861 | loss: 0.031191 | val_loss: 0.0312043 | Time: 1874.71 ms [2022-03-13 10:13:56 main:574] : INFO : Epoch 1862 | loss: 0.0311892 | val_loss: 0.0311989 | Time: 1870.87 ms [2022-03-13 10:13:58 main:574] : INFO : Epoch 1863 | loss: 0.0311921 | val_loss: 0.0311987 | Time: 1899.45 ms [2022-03-13 10:14:00 main:574] : INFO : Epoch 1864 | loss: 0.0311905 | val_loss: 0.0311942 | Time: 1872.42 ms [2022-03-13 10:14:02 main:574] : INFO : Epoch 1865 | loss: 0.0311866 | val_loss: 0.031191 | Time: 1897.24 ms [2022-03-13 10:14:04 main:574] : INFO : Epoch 1866 | loss: 0.0311893 | val_loss: 0.0311996 | Time: 1874.65 ms [2022-03-13 10:14:06 main:574] : INFO : Epoch 1867 | loss: 0.0311964 | val_loss: 0.0312002 | Time: 1910.23 ms [2022-03-13 10:14:07 main:574] : INFO : Epoch 1868 | loss: 0.0311995 | val_loss: 0.0312092 | Time: 1950.22 ms [2022-03-13 10:14:09 main:574] : INFO : Epoch 1869 | loss: 0.0311981 | val_loss: 0.0312027 | Time: 1869.78 ms [2022-03-13 10:14:11 main:574] : INFO : Epoch 1870 | loss: 0.031195 | val_loss: 0.031204 | Time: 1869.32 ms [2022-03-13 10:14:13 main:574] : INFO : Epoch 1871 | loss: 0.031193 | val_loss: 0.0311912 | Time: 1899.07 ms [2022-03-13 10:14:15 main:574] : INFO : Epoch 1872 | loss: 0.0311882 | val_loss: 0.0311913 | Time: 1892.65 ms [2022-03-13 10:14:17 main:574] : INFO : Epoch 1873 | loss: 0.0311858 | val_loss: 0.0311906 | Time: 1880.2 ms [2022-03-13 10:14:19 main:574] : INFO : Epoch 1874 | loss: 0.0311852 | val_loss: 0.0311913 | Time: 1868.33 ms [2022-03-13 10:14:21 main:574] : INFO : Epoch 1875 | loss: 0.0311829 | val_loss: 0.0311896 | Time: 1865.2 ms [2022-03-13 10:14:23 main:574] : INFO : Epoch 1876 | loss: 0.031182 | val_loss: 0.0311886 | Time: 1892.38 ms [2022-03-13 10:14:24 main:574] : INFO : Epoch 1877 | loss: 0.0311811 | val_loss: 0.0311881 | Time: 1919.28 ms [2022-03-13 10:14:26 main:574] : INFO : Epoch 1878 | loss: 0.0311832 | val_loss: 0.0311919 | Time: 1872.06 ms [2022-03-13 10:14:28 main:574] : INFO : Epoch 1879 | loss: 0.0311802 | val_loss: 0.0311899 | Time: 1888.77 ms [2022-03-13 10:14:30 main:574] : INFO : Epoch 1880 | loss: 0.0311807 | val_loss: 0.0311861 | Time: 1872.43 ms [2022-03-13 10:14:32 main:574] : INFO : Epoch 1881 | loss: 0.0311817 | val_loss: 0.0311857 | Time: 1883.13 ms [2022-03-13 10:14:34 main:574] : INFO : Epoch 1882 | loss: 0.0311807 | val_loss: 0.0311888 | Time: 1864.47 ms [2022-03-13 10:14:36 main:574] : INFO : Epoch 1883 | loss: 0.0311825 | val_loss: 0.031196 | Time: 1977.83 ms [2022-03-13 10:14:38 main:574] : INFO : Epoch 1884 | loss: 0.0311811 | val_loss: 0.0311908 | Time: 1856.49 ms [2022-03-13 10:14:40 main:574] : INFO : Epoch 1885 | loss: 0.0311822 | val_loss: 0.0311897 | Time: 1900.3 ms [2022-03-13 10:14:42 main:574] : INFO : Epoch 1886 | loss: 0.0311825 | val_loss: 0.0311879 | Time: 1957.72 ms [2022-03-13 10:14:43 main:574] : INFO : Epoch 1887 | loss: 0.0311786 | val_loss: 0.0311879 | Time: 1880.55 ms [2022-03-13 10:14:45 main:574] : INFO : Epoch 1888 | loss: 0.0311761 | val_loss: 0.0311823 | Time: 1886.44 ms [2022-03-13 10:14:47 main:574] : INFO : Epoch 1889 | loss: 0.0311761 | val_loss: 0.0311827 | Time: 1899.97 ms [2022-03-13 10:14:49 main:574] : INFO : Epoch 1890 | loss: 0.0311756 | val_loss: 0.0311817 | Time: 1899.94 ms [2022-03-13 10:14:51 main:574] : INFO : Epoch 1891 | loss: 0.031175 | val_loss: 0.0311826 | Time: 1905.27 ms [2022-03-13 10:14:53 main:574] : INFO : Epoch 1892 | loss: 0.0311737 | val_loss: 0.0311827 | Time: 1951.99 ms [2022-03-13 10:14:55 main:574] : INFO : Epoch 1893 | loss: 0.0311729 | val_loss: 0.0311829 | Time: 1906.29 ms [2022-03-13 10:14:57 main:574] : INFO : Epoch 1894 | loss: 0.031173 | val_loss: 0.0311812 | Time: 1926.24 ms [2022-03-13 10:14:59 main:574] : INFO : Epoch 1895 | loss: 0.0311719 | val_loss: 0.0311836 | Time: 1901.47 ms [2022-03-13 10:15:01 main:574] : INFO : Epoch 1896 | loss: 0.0311719 | val_loss: 0.0311843 | Time: 1922.07 ms [2022-03-13 10:15:03 main:574] : INFO : Epoch 1897 | loss: 0.0311718 | val_loss: 0.0311814 | Time: 1867.42 ms [2022-03-13 10:15:05 main:574] : INFO : Epoch 1898 | loss: 0.0311711 | val_loss: 0.031182 | Time: 1995.01 ms [2022-03-13 10:15:07 main:574] : INFO : Epoch 1899 | loss: 0.0311721 | val_loss: 0.0311854 | Time: 1954.52 ms [2022-03-13 10:15:08 main:574] : INFO : Epoch 1900 | loss: 0.0311719 | val_loss: 0.0311839 | Time: 1918.52 ms [2022-03-13 10:15:10 main:574] : INFO : Epoch 1901 | loss: 0.0311713 | val_loss: 0.031186 | Time: 1915.63 ms [2022-03-13 10:15:12 main:574] : INFO : Epoch 1902 | loss: 0.0311725 | val_loss: 0.0311881 | Time: 1911.61 ms [2022-03-13 10:15:14 main:574] : INFO : Epoch 1903 | loss: 0.0311753 | val_loss: 0.0311904 | Time: 1971.3 ms [2022-03-13 10:15:16 main:574] : INFO : Epoch 1904 | loss: 0.031172 | val_loss: 0.0311846 | Time: 1913.92 ms [2022-03-13 10:15:18 main:574] : INFO : Epoch 1905 | loss: 0.031171 | val_loss: 0.031184 | Time: 1885.33 ms [2022-03-13 10:15:20 main:574] : INFO : Epoch 1906 | loss: 0.0311694 | val_loss: 0.0311837 | Time: 1905.68 ms [2022-03-13 10:15:22 main:574] : INFO : Epoch 1907 | loss: 0.0311714 | val_loss: 0.0311851 | Time: 1910.12 ms [2022-03-13 10:15:24 main:574] : INFO : Epoch 1908 | loss: 0.0311726 | val_loss: 0.0311832 | Time: 1882.93 ms [2022-03-13 10:15:26 main:574] : INFO : Epoch 1909 | loss: 0.0311731 | val_loss: 0.0311834 | Time: 1903.54 ms [2022-03-13 10:15:28 main:574] : INFO : Epoch 1910 | loss: 0.0311704 | val_loss: 0.0311823 | Time: 1918.38 ms [2022-03-13 10:15:30 main:574] : INFO : Epoch 1911 | loss: 0.0311709 | val_loss: 0.0311835 | Time: 1944.75 ms [2022-03-13 10:15:32 main:574] : INFO : Epoch 1912 | loss: 0.0311697 | val_loss: 0.0311833 | Time: 1931.11 ms [2022-03-13 10:15:33 main:574] : INFO : Epoch 1913 | loss: 0.0311698 | val_loss: 0.0311834 | Time: 1906.37 ms [2022-03-13 10:15:35 main:574] : INFO : Epoch 1914 | loss: 0.0311692 | val_loss: 0.031185 | Time: 1920.99 ms [2022-03-13 10:15:37 main:574] : INFO : Epoch 1915 | loss: 0.0311701 | val_loss: 0.031183 | Time: 1887.61 ms [2022-03-13 10:15:39 main:574] : INFO : Epoch 1916 | loss: 0.0311693 | val_loss: 0.0311831 | Time: 1961.48 ms [2022-03-13 10:15:41 main:574] : INFO : Epoch 1917 | loss: 0.0311699 | val_loss: 0.0311827 | Time: 1984.29 ms [2022-03-13 10:15:43 main:574] : INFO : Epoch 1918 | loss: 0.0311682 | val_loss: 0.031182 | Time: 1909.93 ms [2022-03-13 10:15:45 main:574] : INFO : Epoch 1919 | loss: 0.0311678 | val_loss: 0.0311831 | Time: 1924.11 ms [2022-03-13 10:15:47 main:574] : INFO : Epoch 1920 | loss: 0.0311669 | val_loss: 0.0311838 | Time: 1910.01 ms [2022-03-13 10:15:49 main:574] : INFO : Epoch 1921 | loss: 0.0311695 | val_loss: 0.0311825 | Time: 1926.19 ms [2022-03-13 10:15:51 main:574] : INFO : Epoch 1922 | loss: 0.0311702 | val_loss: 0.0311863 | Time: 1909.65 ms [2022-03-13 10:15:53 main:574] : INFO : Epoch 1923 | loss: 0.0311685 | val_loss: 0.0311851 | Time: 1878.59 ms [2022-03-13 10:15:55 main:574] : INFO : Epoch 1924 | loss: 0.0311676 | val_loss: 0.0311855 | Time: 1925.54 ms [2022-03-13 10:15:57 main:574] : INFO : Epoch 1925 | loss: 0.031166 | val_loss: 0.0311868 | Time: 1898.15 ms [2022-03-13 10:15:58 main:574] : INFO : Epoch 1926 | loss: 0.0311661 | val_loss: 0.0311837 | Time: 1903.52 ms [2022-03-13 10:16:00 main:574] : INFO : Epoch 1927 | loss: 0.0311669 | val_loss: 0.0311842 | Time: 1918.48 ms [2022-03-13 10:16:02 main:574] : INFO : Epoch 1928 | loss: 0.0311698 | val_loss: 0.0311845 | Time: 1931.44 ms [2022-03-13 10:16:04 main:574] : INFO : Epoch 1929 | loss: 0.0311814 | val_loss: 0.0312147 | Time: 1932.42 ms [2022-03-13 10:16:06 main:574] : INFO : Epoch 1930 | loss: 0.0312169 | val_loss: 0.0312176 | Time: 1891.89 ms [2022-03-13 10:16:08 main:574] : INFO : Epoch 1931 | loss: 0.0312193 | val_loss: 0.0312165 | Time: 1875.87 ms [2022-03-13 10:16:10 main:574] : INFO : Epoch 1932 | loss: 0.0312138 | val_loss: 0.0312113 | Time: 1913.08 ms [2022-03-13 10:16:12 main:574] : INFO : Epoch 1933 | loss: 0.0312103 | val_loss: 0.0312084 | Time: 1918.48 ms [2022-03-13 10:16:14 main:574] : INFO : Epoch 1934 | loss: 0.0312087 | val_loss: 0.0312067 | Time: 1943.31 ms [2022-03-13 10:16:16 main:574] : INFO : Epoch 1935 | loss: 0.0312092 | val_loss: 0.0312044 | Time: 1907.06 ms [2022-03-13 10:16:18 main:574] : INFO : Epoch 1936 | loss: 0.031205 | val_loss: 0.031204 | Time: 1911.49 ms [2022-03-13 10:16:20 main:574] : INFO : Epoch 1937 | loss: 0.0312138 | val_loss: 0.0312207 | Time: 1891.86 ms [2022-03-13 10:16:21 main:574] : INFO : Epoch 1938 | loss: 0.0312321 | val_loss: 0.0312326 | Time: 1912.02 ms [2022-03-13 10:16:23 main:574] : INFO : Epoch 1939 | loss: 0.0312278 | val_loss: 0.0312239 | Time: 1926.37 ms [2022-03-13 10:16:25 main:574] : INFO : Epoch 1940 | loss: 0.0312222 | val_loss: 0.0312182 | Time: 1900.81 ms [2022-03-13 10:16:27 main:574] : INFO : Epoch 1941 | loss: 0.0312181 | val_loss: 0.0312174 | Time: 1901.91 ms [2022-03-13 10:16:29 main:574] : INFO : Epoch 1942 | loss: 0.0312178 | val_loss: 0.031221 | Time: 1882.34 ms [2022-03-13 10:16:31 main:574] : INFO : Epoch 1943 | loss: 0.0312176 | val_loss: 0.0312155 | Time: 1891.35 ms [2022-03-13 10:16:33 main:574] : INFO : Epoch 1944 | loss: 0.0312178 | val_loss: 0.0312142 | Time: 1904.11 ms [2022-03-13 10:16:35 main:574] : INFO : Epoch 1945 | loss: 0.0312156 | val_loss: 0.0312135 | Time: 1931.4 ms [2022-03-13 10:16:37 main:574] : INFO : Epoch 1946 | loss: 0.0312137 | val_loss: 0.0312197 | Time: 1908.14 ms [2022-03-13 10:16:39 main:574] : INFO : Epoch 1947 | loss: 0.0312177 | val_loss: 0.0312135 | Time: 1963.08 ms [2022-03-13 10:16:41 main:574] : INFO : Epoch 1948 | loss: 0.0312151 | val_loss: 0.0312123 | Time: 1920.4 ms [2022-03-13 10:16:43 main:574] : INFO : Epoch 1949 | loss: 0.0312156 | val_loss: 0.031212 | Time: 1950.49 ms [2022-03-13 10:16:44 main:574] : INFO : Epoch 1950 | loss: 0.0312141 | val_loss: 0.0312114 | Time: 1906.61 ms [2022-03-13 10:16:46 main:574] : INFO : Epoch 1951 | loss: 0.0312134 | val_loss: 0.0312127 | Time: 1907.19 ms [2022-03-13 10:16:48 main:574] : INFO : Epoch 1952 | loss: 0.031212 | val_loss: 0.0312118 | Time: 1925.9 ms [2022-03-13 10:16:50 main:574] : INFO : Epoch 1953 | loss: 0.031214 | val_loss: 0.0312176 | Time: 1929.93 ms [2022-03-13 10:16:52 main:574] : INFO : Epoch 1954 | loss: 0.0312144 | val_loss: 0.0312138 | Time: 1901.89 ms [2022-03-13 10:16:54 main:574] : INFO : Epoch 1955 | loss: 0.0312124 | val_loss: 0.031211 | Time: 1943.89 ms [2022-03-13 10:16:56 main:574] : INFO : Epoch 1956 | loss: 0.0312114 | val_loss: 0.0312129 | Time: 1984.94 ms [2022-03-13 10:16:58 main:574] : INFO : Epoch 1957 | loss: 0.0312123 | val_loss: 0.0312168 | Time: 1909.39 ms [2022-03-13 10:17:00 main:574] : INFO : Epoch 1958 | loss: 0.0312121 | val_loss: 0.0312124 | Time: 1894.19 ms [2022-03-13 10:17:02 main:574] : INFO : Epoch 1959 | loss: 0.0312102 | val_loss: 0.0312135 | Time: 1922.02 ms [2022-03-13 10:17:04 main:574] : INFO : Epoch 1960 | loss: 0.03121 | val_loss: 0.0312096 | Time: 1893.11 ms [2022-03-13 10:17:06 main:574] : INFO : Epoch 1961 | loss: 0.0312092 | val_loss: 0.0312106 | Time: 1964.55 ms [2022-03-13 10:17:08 main:574] : INFO : Epoch 1962 | loss: 0.0312093 | val_loss: 0.0312094 | Time: 1922.39 ms [2022-03-13 10:17:10 main:574] : INFO : Epoch 1963 | loss: 0.0312087 | val_loss: 0.0312104 | Time: 1910.18 ms [2022-03-13 10:17:11 main:574] : INFO : Epoch 1964 | loss: 0.0312084 | val_loss: 0.0312098 | Time: 1903.09 ms [2022-03-13 10:17:13 main:574] : INFO : Epoch 1965 | loss: 0.0312082 | val_loss: 0.03121 | Time: 1903.17 ms [2022-03-13 10:17:15 main:574] : INFO : Epoch 1966 | loss: 0.0312085 | val_loss: 0.0312095 | Time: 1928.44 ms [2022-03-13 10:17:17 main:574] : INFO : Epoch 1967 | loss: 0.0312081 | val_loss: 0.0312086 | Time: 1894.07 ms [2022-03-13 10:17:19 main:574] : INFO : Epoch 1968 | loss: 0.0312085 | val_loss: 0.0312097 | Time: 1949.16 ms [2022-03-13 10:17:21 main:574] : INFO : Epoch 1969 | loss: 0.0312085 | val_loss: 0.0312143 | Time: 1906.68 ms [2022-03-13 10:17:23 main:574] : INFO : Epoch 1970 | loss: 0.0312103 | val_loss: 0.0312085 | Time: 1879.15 ms [2022-03-13 10:17:25 main:574] : INFO : Epoch 1971 | loss: 0.0312078 | val_loss: 0.0312082 | Time: 1907.03 ms [2022-03-13 10:17:27 main:574] : INFO : Epoch 1972 | loss: 0.0312068 | val_loss: 0.0312093 | Time: 1894.18 ms [2022-03-13 10:17:29 main:574] : INFO : Epoch 1973 | loss: 0.0312083 | val_loss: 0.0312101 | Time: 1918.73 ms [2022-03-13 10:17:31 main:574] : INFO : Epoch 1974 | loss: 0.0312081 | val_loss: 0.031208 | Time: 1930.89 ms [2022-03-13 10:17:33 main:574] : INFO : Epoch 1975 | loss: 0.031209 | val_loss: 0.0312119 | Time: 1892.26 ms [2022-03-13 10:17:34 main:574] : INFO : Epoch 1976 | loss: 0.031207 | val_loss: 0.031208 | Time: 1901.74 ms [2022-03-13 10:17:36 main:574] : INFO : Epoch 1977 | loss: 0.0312069 | val_loss: 0.0312095 | Time: 1980.56 ms [2022-03-13 10:17:38 main:574] : INFO : Epoch 1978 | loss: 0.0312065 | val_loss: 0.0312086 | Time: 1908.62 ms [2022-03-13 10:17:40 main:574] : INFO : Epoch 1979 | loss: 0.0312076 | val_loss: 0.0312101 | Time: 1906.92 ms [2022-03-13 10:17:42 main:574] : INFO : Epoch 1980 | loss: 0.0312081 | val_loss: 0.0312087 | Time: 1964.59 ms [2022-03-13 10:17:44 main:574] : INFO : Epoch 1981 | loss: 0.0312058 | val_loss: 0.0312084 | Time: 1934.11 ms [2022-03-13 10:17:46 main:574] : INFO : Epoch 1982 | loss: 0.0312062 | val_loss: 0.0312072 | Time: 1932.04 ms [2022-03-13 10:17:48 main:574] : INFO : Epoch 1983 | loss: 0.0312051 | val_loss: 0.0312071 | Time: 1912.81 ms [2022-03-13 10:17:50 main:574] : INFO : Epoch 1984 | loss: 0.0312052 | val_loss: 0.0312076 | Time: 1916.4 ms [2022-03-13 10:17:52 main:574] : INFO : Epoch 1985 | loss: 0.0312062 | val_loss: 0.0312076 | Time: 1929.45 ms [2022-03-13 10:17:54 main:574] : INFO : Epoch 1986 | loss: 0.0312055 | val_loss: 0.0312066 | Time: 1913.4 ms [2022-03-13 10:17:56 main:574] : INFO : Epoch 1987 | loss: 0.0312049 | val_loss: 0.0312074 | Time: 1945.48 ms [2022-03-13 10:17:58 main:574] : INFO : Epoch 1988 | loss: 0.0312068 | val_loss: 0.0312089 | Time: 1958.57 ms [2022-03-13 10:18:00 main:574] : INFO : Epoch 1989 | loss: 0.0312065 | val_loss: 0.0312097 | Time: 1958.42 ms [2022-03-13 10:18:02 main:574] : INFO : Epoch 1990 | loss: 0.0312048 | val_loss: 0.0312066 | Time: 1922.64 ms [2022-03-13 10:18:04 main:574] : INFO : Epoch 1991 | loss: 0.0312037 | val_loss: 0.0312067 | Time: 1909.85 ms [2022-03-13 10:18:05 main:574] : INFO : Epoch 1992 | loss: 0.0312071 | val_loss: 0.031206 | Time: 1895.68 ms [2022-03-13 10:18:07 main:574] : INFO : Epoch 1993 | loss: 0.0312046 | val_loss: 0.0312081 | Time: 1916.4 ms [2022-03-13 10:18:09 main:574] : INFO : Epoch 1994 | loss: 0.031205 | val_loss: 0.0312057 | Time: 1945.68 ms [2022-03-13 10:18:11 main:574] : INFO : Epoch 1995 | loss: 0.0312075 | val_loss: 0.0312102 | Time: 1880.19 ms [2022-03-13 10:18:13 main:574] : INFO : Epoch 1996 | loss: 0.031205 | val_loss: 0.0312079 | Time: 1930.4 ms [2022-03-13 10:18:15 main:574] : INFO : Epoch 1997 | loss: 0.0312034 | val_loss: 0.0312081 | Time: 1914.88 ms [2022-03-13 10:18:17 main:574] : INFO : Epoch 1998 | loss: 0.0312048 | val_loss: 0.0312066 | Time: 1901.29 ms [2022-03-13 10:18:19 main:574] : INFO : Epoch 1999 | loss: 0.0312032 | val_loss: 0.0312059 | Time: 1886.59 ms [2022-03-13 10:18:21 main:574] : INFO : Epoch 2000 | loss: 0.031203 | val_loss: 0.0312111 | Time: 1884.21 ms [2022-03-13 10:18:23 main:574] : INFO : Epoch 2001 | loss: 0.0312041 | val_loss: 0.0312071 | Time: 1890.83 ms [2022-03-13 10:18:25 main:574] : INFO : Epoch 2002 | loss: 0.0312043 | val_loss: 0.031205 | Time: 1916.15 ms [2022-03-13 10:18:26 main:574] : INFO : Epoch 2003 | loss: 0.0312026 | val_loss: 0.0312072 | Time: 1909.77 ms [2022-03-13 10:18:28 main:574] : INFO : Epoch 2004 | loss: 0.0312022 | val_loss: 0.0312048 | Time: 1937.85 ms [2022-03-13 10:18:30 main:574] : INFO : Epoch 2005 | loss: 0.0312022 | val_loss: 0.0312048 | Time: 1935.23 ms [2022-03-13 10:18:32 main:574] : INFO : Epoch 2006 | loss: 0.0312035 | val_loss: 0.0312088 | Time: 1949.66 ms [2022-03-13 10:18:34 main:574] : INFO : Epoch 2007 | loss: 0.0312035 | val_loss: 0.0312069 | Time: 1915.06 ms [2022-03-13 10:18:36 main:574] : INFO : Epoch 2008 | loss: 0.0312024 | val_loss: 0.031207 | Time: 1979.97 ms [2022-03-13 10:18:38 main:574] : INFO : Epoch 2009 | loss: 0.0312028 | val_loss: 0.0312068 | Time: 1892.71 ms [2022-03-13 10:18:40 main:574] : INFO : Epoch 2010 | loss: 0.0312023 | val_loss: 0.0312043 | Time: 1918.48 ms [2022-03-13 10:18:42 main:574] : INFO : Epoch 2011 | loss: 0.031201 | val_loss: 0.0312046 | Time: 1883.86 ms [2022-03-13 10:18:44 main:574] : INFO : Epoch 2012 | loss: 0.0312008 | val_loss: 0.0312065 | Time: 1891.82 ms [2022-03-13 10:18:46 main:574] : INFO : Epoch 2013 | loss: 0.0312018 | val_loss: 0.0312061 | Time: 1948.62 ms [2022-03-13 10:18:48 main:574] : INFO : Epoch 2014 | loss: 0.0312006 | val_loss: 0.0312044 | Time: 1908.55 ms [2022-03-13 10:18:50 main:574] : INFO : Epoch 2015 | loss: 0.0312022 | val_loss: 0.0312068 | Time: 1925.81 ms [2022-03-13 10:18:51 main:574] : INFO : Epoch 2016 | loss: 0.031201 | val_loss: 0.0312036 | Time: 1881.47 ms [2022-03-13 10:18:53 main:574] : INFO : Epoch 2017 | loss: 0.0312006 | val_loss: 0.0312043 | Time: 1886 ms [2022-03-13 10:18:55 main:574] : INFO : Epoch 2018 | loss: 0.0312022 | val_loss: 0.0312075 | Time: 1926.3 ms [2022-03-13 10:18:57 main:574] : INFO : Epoch 2019 | loss: 0.0312023 | val_loss: 0.0312052 | Time: 1935.71 ms [2022-03-13 10:18:59 main:574] : INFO : Epoch 2020 | loss: 0.0312 | val_loss: 0.0312047 | Time: 1909.01 ms [2022-03-13 10:19:01 main:574] : INFO : Epoch 2021 | loss: 0.0312027 | val_loss: 0.031206 | Time: 1972.26 ms [2022-03-13 10:19:03 main:574] : INFO : Epoch 2022 | loss: 0.0312028 | val_loss: 0.0312049 | Time: 1904.65 ms [2022-03-13 10:19:05 main:574] : INFO : Epoch 2023 | loss: 0.0312008 | val_loss: 0.0312039 | Time: 1904.64 ms [2022-03-13 10:19:07 main:574] : INFO : Epoch 2024 | loss: 0.0312007 | val_loss: 0.0312056 | Time: 1969.16 ms [2022-03-13 10:19:09 main:574] : INFO : Epoch 2025 | loss: 0.0312016 | val_loss: 0.0312047 | Time: 1928.69 ms [2022-03-13 10:19:11 main:574] : INFO : Epoch 2026 | loss: 0.0312003 | val_loss: 0.0312046 | Time: 1944.85 ms [2022-03-13 10:19:13 main:574] : INFO : Epoch 2027 | loss: 0.0312004 | val_loss: 0.0312033 | Time: 1943.06 ms [2022-03-13 10:19:15 main:574] : INFO : Epoch 2028 | loss: 0.031199 | val_loss: 0.0312048 | Time: 1905.61 ms [2022-03-13 10:19:17 main:574] : INFO : Epoch 2029 | loss: 0.0311996 | val_loss: 0.0312055 | Time: 1912.5 ms [2022-03-13 10:19:18 main:574] : INFO : Epoch 2030 | loss: 0.0311997 | val_loss: 0.0312036 | Time: 1912.16 ms [2022-03-13 10:19:20 main:574] : INFO : Epoch 2031 | loss: 0.0311989 | val_loss: 0.0312067 | Time: 1883.73 ms [2022-03-13 10:19:22 main:574] : INFO : Epoch 2032 | loss: 0.0311988 | val_loss: 0.0312037 | Time: 1952.09 ms [2022-03-13 10:19:24 main:574] : INFO : Epoch 2033 | loss: 0.0311988 | val_loss: 0.0312098 | Time: 1899.59 ms [2022-03-13 10:19:26 main:574] : INFO : Epoch 2034 | loss: 0.031205 | val_loss: 0.0312063 | Time: 1901.14 ms [2022-03-13 10:19:28 main:574] : INFO : Epoch 2035 | loss: 0.0311991 | val_loss: 0.0312038 | Time: 1918.03 ms [2022-03-13 10:19:30 main:574] : INFO : Epoch 2036 | loss: 0.0311993 | val_loss: 0.0312033 | Time: 1920.36 ms [2022-03-13 10:19:32 main:574] : INFO : Epoch 2037 | loss: 0.031199 | val_loss: 0.031205 | Time: 1887.35 ms [2022-03-13 10:19:34 main:574] : INFO : Epoch 2038 | loss: 0.0311996 | val_loss: 0.0312032 | Time: 1896.91 ms [2022-03-13 10:19:36 main:574] : INFO : Epoch 2039 | loss: 0.0311984 | val_loss: 0.031204 | Time: 1911.25 ms [2022-03-13 10:19:38 main:574] : INFO : Epoch 2040 | loss: 0.0311989 | val_loss: 0.0312032 | Time: 1929.42 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1650) [2022-03-13 13:09:09 main:435] : INFO : Set logging level to 1 [2022-03-13 13:09:09 main:441] : INFO : Running in BOINC Client mode [2022-03-13 13:09:09 main:444] : INFO : Resolving all filenames [2022-03-13 13:09:09 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-03-13 13:09:09 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-03-13 13:09:09 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-03-13 13:09:09 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-03-13 13:09:09 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-03-13 13:09:09 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-03-13 13:09:09 main:474] : INFO : Configuration: [2022-03-13 13:09:09 main:475] : INFO : Model type: GRU [2022-03-13 13:09:09 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-03-13 13:09:09 main:477] : INFO : Max Epochs: 2048 [2022-03-13 13:09:09 main:478] : INFO : Batch Size: 128 [2022-03-13 13:09:09 main:479] : INFO : Learning Rate: 0.01 [2022-03-13 13:09:10 main:480] : INFO : Patience: 10 [2022-03-13 13:09:10 main:481] : INFO : Hidden Width: 12 [2022-03-13 13:09:10 main:482] : INFO : # Recurrent Layers: 4 [2022-03-13 13:09:10 main:483] : INFO : # Backend Layers: 4 [2022-03-13 13:09:10 main:484] : INFO : # Threads: 1 [2022-03-13 13:09:10 main:486] : INFO : Preparing Dataset [2022-03-13 13:09:10 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-03-13 13:09:10 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-03-13 13:09:13 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-03-13 13:09:13 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-03-13 13:09:13 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-03-13 13:09:13 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-03-13 13:09:13 main:494] : INFO : Creating Model [2022-03-13 13:09:13 main:507] : INFO : Preparing config file [2022-03-13 13:09:13 main:511] : INFO : Found checkpoint, attempting to load... [2022-03-13 13:09:13 main:512] : INFO : Loading config [2022-03-13 13:09:13 main:514] : INFO : Loading state [2022-03-13 13:09:16 main:559] : INFO : Loading DataLoader into Memory [2022-03-13 13:09:16 main:562] : INFO : Starting Training [2022-03-13 13:09:18 main:574] : INFO : Epoch 2029 | loss: 0.031232 | val_loss: 0.0312071 | Time: 2627.51 ms [2022-03-13 13:09:20 main:574] : INFO : Epoch 2030 | loss: 0.0312008 | val_loss: 0.0311989 | Time: 1875.76 ms [2022-03-13 13:09:22 main:574] : INFO : Epoch 2031 | loss: 0.0311958 | val_loss: 0.031194 | Time: 1887.25 ms [2022-03-13 13:09:24 main:574] : INFO : Epoch 2032 | loss: 0.0311934 | val_loss: 0.0311945 | Time: 1864.34 ms [2022-03-13 13:09:26 main:574] : INFO : Epoch 2033 | loss: 0.0311939 | val_loss: 0.0311934 | Time: 1897 ms [2022-03-13 13:09:28 main:574] : INFO : Epoch 2034 | loss: 0.0311913 | val_loss: 0.0311902 | Time: 1879.63 ms [2022-03-13 13:09:30 main:574] : INFO : Epoch 2035 | loss: 0.0311883 | val_loss: 0.0311869 | Time: 1880.33 ms [2022-03-13 13:09:31 main:574] : INFO : Epoch 2036 | loss: 0.0311872 | val_loss: 0.0311904 | Time: 1885.28 ms [2022-03-13 13:09:33 main:574] : INFO : Epoch 2037 | loss: 0.0311864 | val_loss: 0.0311857 | Time: 1876.42 ms [2022-03-13 13:09:35 main:574] : INFO : Epoch 2038 | loss: 0.0311868 | val_loss: 0.0311871 | Time: 1870.04 ms [2022-03-13 13:09:37 main:574] : INFO : Epoch 2039 | loss: 0.0311858 | val_loss: 0.0311864 | Time: 1875.28 ms [2022-03-13 13:09:39 main:574] : INFO : Epoch 2040 | loss: 0.0311825 | val_loss: 0.0311838 | Time: 1880.02 ms [2022-03-13 13:09:41 main:574] : INFO : Epoch 2041 | loss: 0.0311829 | val_loss: 0.0311853 | Time: 1894.55 ms [2022-03-13 13:09:43 main:574] : INFO : Epoch 2042 | loss: 0.031182 | val_loss: 0.0311819 | Time: 1878.05 ms [2022-03-13 13:09:45 main:574] : INFO : Epoch 2043 | loss: 0.0311812 | val_loss: 0.0311823 | Time: 1892.88 ms [2022-03-13 13:09:46 main:574] : INFO : Epoch 2044 | loss: 0.0311795 | val_loss: 0.031183 | Time: 1863.01 ms [2022-03-13 13:09:48 main:574] : INFO : Epoch 2045 | loss: 0.0311796 | val_loss: 0.0311821 | Time: 1889.2 ms [2022-03-13 13:09:50 main:574] : INFO : Epoch 2046 | loss: 0.0311808 | val_loss: 0.0311867 | Time: 1881.4 ms [2022-03-13 13:09:52 main:574] : INFO : Epoch 2047 | loss: 0.031181 | val_loss: 0.0311856 | Time: 1855.98 ms [2022-03-13 13:09:54 main:574] : INFO : Epoch 2048 | loss: 0.0311794 | val_loss: 0.0311816 | Time: 1879.79 ms [2022-03-13 13:09:54 main:597] : INFO : Saving trained model to model-final.pt, val_loss 0.0311816 [2022-03-13 13:09:54 main:603] : INFO : Saving end state to config to file [2022-03-13 13:09:54 main:608] : INFO : Success, exiting.. 13:09:54 (10540): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)