Task 14142710

Name ParityModified-1647045254-28706-0_3
Workunit 10096064
Created 31 Mar 2022, 13:41:41 UTC
Sent 31 Mar 2022, 13:46:18 UTC
Report deadline 8 Apr 2022, 13:46:18 UTC
Received 2 Apr 2022, 11:52:47 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 21006
Run time 3 hours 2 min 24 sec
CPU time 3 hours 2 min 24 sec
Validate state Valid
Credit 4,160.00
Device peak FLOPS 2,255.84 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.63 GB
Peak swap size 3.59 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.20</core_client_version>
<![CDATA[
<stderr_txt>
[2022-03-31 20:52:13	                main:574]	:	INFO	:	Epoch 1766 | loss: 0.0310037 | val_loss: 0.0312775 | Time: 3666.74 ms
[2022-03-31 20:52:17	                main:574]	:	INFO	:	Epoch 1767 | loss: 0.0310018 | val_loss: 0.0312662 | Time: 3611.45 ms
[2022-03-31 20:52:20	                main:574]	:	INFO	:	Epoch 1768 | loss: 0.0310052 | val_loss: 0.031297 | Time: 3645.12 ms
[2022-03-31 20:52:24	                main:574]	:	INFO	:	Epoch 1769 | loss: 0.0309954 | val_loss: 0.031281 | Time: 3604.31 ms
[2022-03-31 20:52:28	                main:574]	:	INFO	:	Epoch 1770 | loss: 0.0310016 | val_loss: 0.0312618 | Time: 3635.12 ms
[2022-03-31 20:52:31	                main:574]	:	INFO	:	Epoch 1771 | loss: 0.0309944 | val_loss: 0.0312649 | Time: 3586.04 ms
[2022-03-31 20:52:35	                main:574]	:	INFO	:	Epoch 1772 | loss: 0.0309984 | val_loss: 0.0312787 | Time: 3541.8 ms
[2022-03-31 20:52:39	                main:574]	:	INFO	:	Epoch 1773 | loss: 0.0309974 | val_loss: 0.031282 | Time: 3643.68 ms
[2022-03-31 20:52:42	                main:574]	:	INFO	:	Epoch 1774 | loss: 0.030993 | val_loss: 0.0313019 | Time: 3617.03 ms
[2022-03-31 20:52:46	                main:574]	:	INFO	:	Epoch 1775 | loss: 0.031002 | val_loss: 0.0312744 | Time: 3599.27 ms
[2022-03-31 20:52:49	                main:574]	:	INFO	:	Epoch 1776 | loss: 0.0309973 | val_loss: 0.0313024 | Time: 3607.66 ms
[2022-03-31 20:52:53	                main:574]	:	INFO	:	Epoch 1777 | loss: 0.0309967 | val_loss: 0.0312881 | Time: 3582.55 ms
[2022-03-31 20:52:57	                main:574]	:	INFO	:	Epoch 1778 | loss: 0.030996 | val_loss: 0.0313019 | Time: 3575.42 ms
[2022-03-31 20:53:00	                main:574]	:	INFO	:	Epoch 1779 | loss: 0.0309944 | val_loss: 0.0312775 | Time: 3566.44 ms
[2022-03-31 20:53:04	                main:574]	:	INFO	:	Epoch 1780 | loss: 0.0309985 | val_loss: 0.0312904 | Time: 3632.74 ms
[2022-03-31 20:53:07	                main:574]	:	INFO	:	Epoch 1781 | loss: 0.0310046 | val_loss: 0.031279 | Time: 3589.02 ms
[2022-03-31 20:53:11	                main:574]	:	INFO	:	Epoch 1782 | loss: 0.0310042 | val_loss: 0.0312543 | Time: 3607.99 ms
[2022-03-31 20:53:15	                main:574]	:	INFO	:	Epoch 1783 | loss: 0.0310021 | val_loss: 0.0312915 | Time: 3570.87 ms
[2022-03-31 20:53:18	                main:574]	:	INFO	:	Epoch 1784 | loss: 0.0310009 | val_loss: 0.0312689 | Time: 3537.31 ms
[2022-03-31 20:53:22	                main:574]	:	INFO	:	Epoch 1785 | loss: 0.0310134 | val_loss: 0.0312802 | Time: 3603.14 ms
[2022-03-31 20:53:25	                main:574]	:	INFO	:	Epoch 1786 | loss: 0.0310071 | val_loss: 0.031279 | Time: 3536.42 ms
[2022-03-31 20:53:29	                main:574]	:	INFO	:	Epoch 1787 | loss: 0.0309995 | val_loss: 0.0312966 | Time: 3605.91 ms
[2022-03-31 20:53:32	                main:574]	:	INFO	:	Epoch 1788 | loss: 0.0310063 | val_loss: 0.03128 | Time: 3581.72 ms
[2022-03-31 20:53:36	                main:574]	:	INFO	:	Epoch 1789 | loss: 0.0310124 | val_loss: 0.0312988 | Time: 3559.69 ms
[2022-03-31 20:53:40	                main:574]	:	INFO	:	Epoch 1790 | loss: 0.0309963 | val_loss: 0.0313079 | Time: 3723.92 ms
[2022-03-31 20:53:43	                main:574]	:	INFO	:	Epoch 1791 | loss: 0.0309934 | val_loss: 0.0312745 | Time: 3585.94 ms
[2022-03-31 20:53:47	                main:574]	:	INFO	:	Epoch 1792 | loss: 0.0309916 | val_loss: 0.0312819 | Time: 3555.73 ms
[2022-03-31 20:53:50	                main:574]	:	INFO	:	Epoch 1793 | loss: 0.0309891 | val_loss: 0.0312819 | Time: 3565.89 ms
[2022-03-31 20:53:54	                main:574]	:	INFO	:	Epoch 1794 | loss: 0.0309994 | val_loss: 0.031259 | Time: 3532.32 ms
[2022-03-31 20:53:58	                main:574]	:	INFO	:	Epoch 1795 | loss: 0.0310076 | val_loss: 0.0312838 | Time: 3568.65 ms
[2022-03-31 20:54:01	                main:574]	:	INFO	:	Epoch 1796 | loss: 0.031 | val_loss: 0.0312773 | Time: 3542.17 ms
[2022-03-31 20:54:05	                main:574]	:	INFO	:	Epoch 1797 | loss: 0.0310022 | val_loss: 0.0313233 | Time: 3631.1 ms
[2022-03-31 20:54:08	                main:574]	:	INFO	:	Epoch 1798 | loss: 0.0310016 | val_loss: 0.031271 | Time: 3564.42 ms
[2022-03-31 20:54:12	                main:574]	:	INFO	:	Epoch 1799 | loss: 0.031 | val_loss: 0.0312828 | Time: 3558.45 ms
[2022-03-31 20:54:15	                main:574]	:	INFO	:	Epoch 1800 | loss: 0.030996 | val_loss: 0.0312754 | Time: 3577.4 ms
[2022-03-31 20:54:19	                main:574]	:	INFO	:	Epoch 1801 | loss: 0.0310027 | val_loss: 0.0312798 | Time: 3602.45 ms
[2022-03-31 20:54:23	                main:574]	:	INFO	:	Epoch 1802 | loss: 0.0310095 | val_loss: 0.0312784 | Time: 3598.52 ms
[2022-03-31 20:54:26	                main:574]	:	INFO	:	Epoch 1803 | loss: 0.0310106 | val_loss: 0.0312639 | Time: 3530 ms
[2022-03-31 20:54:30	                main:574]	:	INFO	:	Epoch 1804 | loss: 0.0310183 | val_loss: 0.0312634 | Time: 3649.47 ms
[2022-03-31 20:54:33	                main:574]	:	INFO	:	Epoch 1805 | loss: 0.0310148 | val_loss: 0.0312678 | Time: 3570.54 ms
[2022-03-31 20:54:37	                main:574]	:	INFO	:	Epoch 1806 | loss: 0.0310035 | val_loss: 0.0312983 | Time: 3583.16 ms
[2022-03-31 20:54:41	                main:574]	:	INFO	:	Epoch 1807 | loss: 0.0310013 | val_loss: 0.0312838 | Time: 3567.33 ms
[2022-03-31 20:54:44	                main:574]	:	INFO	:	Epoch 1808 | loss: 0.0309946 | val_loss: 0.0312958 | Time: 3554.63 ms
[2022-03-31 20:54:48	                main:574]	:	INFO	:	Epoch 1809 | loss: 0.0309926 | val_loss: 0.0312651 | Time: 3546.35 ms
[2022-03-31 20:54:51	                main:574]	:	INFO	:	Epoch 1810 | loss: 0.0309996 | val_loss: 0.0312598 | Time: 3601.05 ms
[2022-03-31 20:54:55	                main:574]	:	INFO	:	Epoch 1811 | loss: 0.0310032 | val_loss: 0.031287 | Time: 3538.13 ms
[2022-03-31 20:54:59	                main:574]	:	INFO	:	Epoch 1812 | loss: 0.030995 | val_loss: 0.0312844 | Time: 3649.49 ms
[2022-03-31 20:55:02	                main:574]	:	INFO	:	Epoch 1813 | loss: 0.031003 | val_loss: 0.0312649 | Time: 3561.91 ms
[2022-03-31 20:55:06	                main:574]	:	INFO	:	Epoch 1814 | loss: 0.0310052 | val_loss: 0.0312827 | Time: 3571.18 ms
[2022-03-31 20:55:09	                main:574]	:	INFO	:	Epoch 1815 | loss: 0.0309998 | val_loss: 0.0312781 | Time: 3552.81 ms
[2022-03-31 20:55:13	                main:574]	:	INFO	:	Epoch 1816 | loss: 0.0310007 | val_loss: 0.031261 | Time: 3596.08 ms
[2022-03-31 20:55:16	                main:574]	:	INFO	:	Epoch 1817 | loss: 0.0309973 | val_loss: 0.0312853 | Time: 3600.37 ms
[2022-03-31 20:55:20	                main:574]	:	INFO	:	Epoch 1818 | loss: 0.0309961 | val_loss: 0.0312927 | Time: 3571.69 ms
[2022-03-31 20:55:24	                main:574]	:	INFO	:	Epoch 1819 | loss: 0.0309934 | val_loss: 0.0313043 | Time: 3543.32 ms
[2022-03-31 20:55:27	                main:574]	:	INFO	:	Epoch 1820 | loss: 0.0309889 | val_loss: 0.0313189 | Time: 3602.08 ms
[2022-03-31 20:55:31	                main:574]	:	INFO	:	Epoch 1821 | loss: 0.0309929 | val_loss: 0.0312835 | Time: 3631.44 ms
[2022-03-31 20:55:34	                main:574]	:	INFO	:	Epoch 1822 | loss: 0.0310003 | val_loss: 0.0312919 | Time: 3595.16 ms
[2022-03-31 20:55:38	                main:574]	:	INFO	:	Epoch 1823 | loss: 0.0309958 | val_loss: 0.0313004 | Time: 3585.39 ms
[2022-03-31 20:55:42	                main:574]	:	INFO	:	Epoch 1824 | loss: 0.0310047 | val_loss: 0.0312908 | Time: 3600.22 ms
[2022-03-31 20:55:45	                main:574]	:	INFO	:	Epoch 1825 | loss: 0.030998 | val_loss: 0.031274 | Time: 3597.19 ms
[2022-03-31 20:55:49	                main:574]	:	INFO	:	Epoch 1826 | loss: 0.0309881 | val_loss: 0.0313118 | Time: 3565.59 ms
[2022-03-31 20:55:52	                main:574]	:	INFO	:	Epoch 1827 | loss: 0.0309891 | val_loss: 0.0312747 | Time: 3586.96 ms
[2022-03-31 20:55:56	                main:574]	:	INFO	:	Epoch 1828 | loss: 0.0310042 | val_loss: 0.0312831 | Time: 3540.5 ms
[2022-03-31 20:56:00	                main:574]	:	INFO	:	Epoch 1829 | loss: 0.0309983 | val_loss: 0.0312916 | Time: 3643.11 ms
[2022-03-31 20:56:03	                main:574]	:	INFO	:	Epoch 1830 | loss: 0.0309958 | val_loss: 0.0313006 | Time: 3685.53 ms
[2022-03-31 20:56:07	                main:574]	:	INFO	:	Epoch 1831 | loss: 0.0310005 | val_loss: 0.0312841 | Time: 3650.22 ms
[2022-03-31 20:56:11	                main:574]	:	INFO	:	Epoch 1832 | loss: 0.0310032 | val_loss: 0.0312668 | Time: 3625.65 ms
[2022-03-31 20:56:14	                main:574]	:	INFO	:	Epoch 1833 | loss: 0.0310134 | val_loss: 0.0312734 | Time: 3666.23 ms
[2022-03-31 20:56:18	                main:574]	:	INFO	:	Epoch 1834 | loss: 0.0310178 | val_loss: 0.0312748 | Time: 3621.78 ms
[2022-03-31 20:56:22	                main:574]	:	INFO	:	Epoch 1835 | loss: 0.0310052 | val_loss: 0.0312952 | Time: 3658.58 ms
[2022-03-31 20:56:25	                main:574]	:	INFO	:	Epoch 1836 | loss: 0.0310008 | val_loss: 0.0312723 | Time: 3609.94 ms
[2022-03-31 20:56:29	                main:574]	:	INFO	:	Epoch 1837 | loss: 0.0309941 | val_loss: 0.0312998 | Time: 3589.86 ms
[2022-03-31 20:56:32	                main:574]	:	INFO	:	Epoch 1838 | loss: 0.0309978 | val_loss: 0.0313018 | Time: 3618.96 ms
[2022-03-31 20:56:36	                main:574]	:	INFO	:	Epoch 1839 | loss: 0.0309999 | val_loss: 0.0312635 | Time: 3636.52 ms
[2022-03-31 20:56:40	                main:574]	:	INFO	:	Epoch 1840 | loss: 0.031003 | val_loss: 0.0312725 | Time: 3667.42 ms
[2022-03-31 20:56:43	                main:574]	:	INFO	:	Epoch 1841 | loss: 0.0310012 | val_loss: 0.0312747 | Time: 3660.08 ms
[2022-03-31 20:56:47	                main:574]	:	INFO	:	Epoch 1842 | loss: 0.0309992 | val_loss: 0.0313022 | Time: 3648.88 ms
[2022-03-31 20:56:51	                main:574]	:	INFO	:	Epoch 1843 | loss: 0.0309952 | val_loss: 0.031295 | Time: 3643.94 ms
[2022-03-31 20:56:54	                main:574]	:	INFO	:	Epoch 1844 | loss: 0.0309953 | val_loss: 0.0312755 | Time: 3603.07 ms
[2022-03-31 20:56:58	                main:574]	:	INFO	:	Epoch 1845 | loss: 0.0309913 | val_loss: 0.0312642 | Time: 3619.86 ms
[2022-03-31 20:57:01	                main:574]	:	INFO	:	Epoch 1846 | loss: 0.0309928 | val_loss: 0.0313045 | Time: 3559.68 ms
[2022-03-31 20:57:05	                main:574]	:	INFO	:	Epoch 1847 | loss: 0.0310044 | val_loss: 0.0312677 | Time: 3603.64 ms
[2022-03-31 20:57:09	                main:574]	:	INFO	:	Epoch 1848 | loss: 0.030995 | val_loss: 0.0312864 | Time: 3679.26 ms
[2022-03-31 20:57:12	                main:574]	:	INFO	:	Epoch 1849 | loss: 0.030997 | val_loss: 0.0312391 | Time: 3533.89 ms
[2022-03-31 20:57:16	                main:574]	:	INFO	:	Epoch 1850 | loss: 0.0310008 | val_loss: 0.0312957 | Time: 3559.47 ms
[2022-03-31 20:57:19	                main:574]	:	INFO	:	Epoch 1851 | loss: 0.03099 | val_loss: 0.0312808 | Time: 3582.88 ms
[2022-03-31 20:57:23	                main:574]	:	INFO	:	Epoch 1852 | loss: 0.030987 | val_loss: 0.031286 | Time: 3602.95 ms
[2022-03-31 20:57:27	                main:574]	:	INFO	:	Epoch 1853 | loss: 0.0309862 | val_loss: 0.031281 | Time: 3610.64 ms
[2022-03-31 20:57:30	                main:574]	:	INFO	:	Epoch 1854 | loss: 0.0309891 | val_loss: 0.031305 | Time: 3587.76 ms
[2022-03-31 20:57:34	                main:574]	:	INFO	:	Epoch 1855 | loss: 0.0309979 | val_loss: 0.0312819 | Time: 3567.83 ms
[2022-03-31 20:57:37	                main:574]	:	INFO	:	Epoch 1856 | loss: 0.0309999 | val_loss: 0.0312679 | Time: 3558.74 ms
[2022-03-31 20:57:41	                main:574]	:	INFO	:	Epoch 1857 | loss: 0.0309957 | val_loss: 0.0312999 | Time: 3500.66 ms
[2022-03-31 20:57:44	                main:574]	:	INFO	:	Epoch 1858 | loss: 0.0309887 | val_loss: 0.031282 | Time: 3523.36 ms
[2022-03-31 20:57:48	                main:574]	:	INFO	:	Epoch 1859 | loss: 0.0309915 | val_loss: 0.0312999 | Time: 3586.58 ms
[2022-03-31 20:57:52	                main:574]	:	INFO	:	Epoch 1860 | loss: 0.0309898 | val_loss: 0.0313044 | Time: 3586.91 ms
[2022-03-31 20:57:55	                main:574]	:	INFO	:	Epoch 1861 | loss: 0.0310011 | val_loss: 0.0313143 | Time: 3556.68 ms
[2022-03-31 20:57:59	                main:574]	:	INFO	:	Epoch 1862 | loss: 0.0309987 | val_loss: 0.031276 | Time: 3640.62 ms
[2022-03-31 20:58:02	                main:574]	:	INFO	:	Epoch 1863 | loss: 0.0309974 | val_loss: 0.0312738 | Time: 3576.59 ms
[2022-03-31 20:58:06	                main:574]	:	INFO	:	Epoch 1864 | loss: 0.0309983 | val_loss: 0.031312 | Time: 3536.66 ms
[2022-03-31 20:58:10	                main:574]	:	INFO	:	Epoch 1865 | loss: 0.0309941 | val_loss: 0.0312795 | Time: 3577.62 ms
[2022-03-31 20:58:13	                main:574]	:	INFO	:	Epoch 1866 | loss: 0.0309993 | val_loss: 0.0312774 | Time: 3559.53 ms
[2022-03-31 20:58:17	                main:574]	:	INFO	:	Epoch 1867 | loss: 0.0309918 | val_loss: 0.0312926 | Time: 3575.93 ms
[2022-03-31 20:58:20	                main:574]	:	INFO	:	Epoch 1868 | loss: 0.030998 | val_loss: 0.0312664 | Time: 3582.3 ms
[2022-03-31 20:58:24	                main:574]	:	INFO	:	Epoch 1869 | loss: 0.0310036 | val_loss: 0.0312779 | Time: 3571.39 ms
[2022-03-31 20:58:27	                main:574]	:	INFO	:	Epoch 1870 | loss: 0.030998 | val_loss: 0.0312904 | Time: 3581.97 ms
[2022-03-31 20:58:31	                main:574]	:	INFO	:	Epoch 1871 | loss: 0.0309972 | val_loss: 0.0312794 | Time: 3573.92 ms
[2022-03-31 20:58:35	                main:574]	:	INFO	:	Epoch 1872 | loss: 0.0309937 | val_loss: 0.0312939 | Time: 3609.75 ms
[2022-03-31 20:58:38	                main:574]	:	INFO	:	Epoch 1873 | loss: 0.0309898 | val_loss: 0.031315 | Time: 3566.5 ms
[2022-03-31 20:58:42	                main:574]	:	INFO	:	Epoch 1874 | loss: 0.0309932 | val_loss: 0.0312695 | Time: 3536.26 ms
[2022-03-31 20:58:45	                main:574]	:	INFO	:	Epoch 1875 | loss: 0.0309947 | val_loss: 0.0313194 | Time: 3630.69 ms
[2022-03-31 20:58:49	                main:574]	:	INFO	:	Epoch 1876 | loss: 0.0309906 | val_loss: 0.0312958 | Time: 3534.87 ms
[2022-03-31 20:58:52	                main:574]	:	INFO	:	Epoch 1877 | loss: 0.0309924 | val_loss: 0.0312886 | Time: 3571.17 ms
[2022-03-31 20:58:56	                main:574]	:	INFO	:	Epoch 1878 | loss: 0.0309863 | val_loss: 0.0313067 | Time: 3588.68 ms
[2022-03-31 20:59:00	                main:574]	:	INFO	:	Epoch 1879 | loss: 0.0309863 | val_loss: 0.031291 | Time: 3559.71 ms
[2022-03-31 20:59:03	                main:574]	:	INFO	:	Epoch 1880 | loss: 0.0309975 | val_loss: 0.0312933 | Time: 3620.98 ms
[2022-03-31 20:59:07	                main:574]	:	INFO	:	Epoch 1881 | loss: 0.0309985 | val_loss: 0.0312888 | Time: 3574.15 ms
[2022-03-31 20:59:10	                main:574]	:	INFO	:	Epoch 1882 | loss: 0.0310014 | val_loss: 0.0312845 | Time: 3592.76 ms
[2022-03-31 20:59:14	                main:574]	:	INFO	:	Epoch 1883 | loss: 0.0310213 | val_loss: 0.0312721 | Time: 3477.31 ms
[2022-03-31 20:59:17	                main:574]	:	INFO	:	Epoch 1884 | loss: 0.0309948 | val_loss: 0.0312761 | Time: 3513.7 ms
[2022-03-31 20:59:21	                main:574]	:	INFO	:	Epoch 1885 | loss: 0.0310097 | val_loss: 0.0312445 | Time: 3625.85 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050 Ti)
[2022-03-31 21:09:34	                main:435]	:	INFO	:	Set logging level to 1
[2022-03-31 21:09:34	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-03-31 21:09:34	                main:444]	:	INFO	:	Resolving all filenames
[2022-03-31 21:09:34	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-31 21:09:34	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-31 21:09:34	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-31 21:09:34	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 0)
[2022-03-31 21:09:34	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-31 21:09:34	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-03-31 21:09:34	                main:474]	:	INFO	:	Configuration: 
[2022-03-31 21:09:34	                main:475]	:	INFO	:	    Model type: GRU
[2022-03-31 21:09:34	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-03-31 21:09:34	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-03-31 21:09:34	                main:478]	:	INFO	:	    Batch Size: 128
[2022-03-31 21:09:34	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-03-31 21:09:34	                main:480]	:	INFO	:	    Patience: 10
[2022-03-31 21:09:34	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-03-31 21:09:34	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-03-31 21:09:34	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-03-31 21:09:34	                main:484]	:	INFO	:	    # Threads: 1
[2022-03-31 21:09:34	                main:486]	:	INFO	:	Preparing Dataset
[2022-03-31 21:09:34	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-31 21:09:34	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-03-31 21:09:39	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-03-31 21:09:39	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-03-31 21:09:39	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-03-31 21:09:39	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-03-31 21:09:39	                main:494]	:	INFO	:	Creating Model
[2022-03-31 21:09:39	                main:507]	:	INFO	:	Preparing config file
[2022-03-31 21:09:39	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-03-31 21:09:39	                main:512]	:	INFO	:	Loading config
[2022-03-31 21:09:39	                main:514]	:	INFO	:	Loading state
[2022-03-31 21:09:42	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2022-03-31 21:09:42	                main:562]	:	INFO	:	Starting Training
[2022-03-31 22:25:46	                main:574]	:	INFO	:	Epoch 1837 | loss: 0.0311159 | val_loss: 0.0312323 | Time: 4.56488e+06 ms
[2022-03-31 22:25:51	                main:574]	:	INFO	:	Epoch 1838 | loss: 0.0310474 | val_loss: 0.0312554 | Time: 4287.96 ms
[2022-03-31 22:26:25	                main:574]	:	INFO	:	Epoch 1839 | loss: 0.031018 | val_loss: 0.0312727 | Time: 34579.1 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050 Ti)
[2022-03-31 22:29:48	                main:435]	:	INFO	:	Set logging level to 1
[2022-03-31 22:29:48	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-03-31 22:29:48	                main:444]	:	INFO	:	Resolving all filenames
[2022-03-31 22:29:48	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-31 22:29:48	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-31 22:29:48	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-31 22:29:48	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 0)
[2022-03-31 22:29:48	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-31 22:29:48	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-03-31 22:29:48	                main:474]	:	INFO	:	Configuration: 
[2022-03-31 22:29:48	                main:475]	:	INFO	:	    Model type: GRU
[2022-03-31 22:29:48	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-03-31 22:29:48	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-03-31 22:29:48	                main:478]	:	INFO	:	    Batch Size: 128
[2022-03-31 22:29:48	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-03-31 22:29:48	                main:480]	:	INFO	:	    Patience: 10
[2022-03-31 22:29:48	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-03-31 22:29:48	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-03-31 22:29:48	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-03-31 22:29:48	                main:484]	:	INFO	:	    # Threads: 1
[2022-03-31 22:29:48	                main:486]	:	INFO	:	Preparing Dataset
[2022-03-31 22:29:48	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-31 22:29:48	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-03-31 22:29:53	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-03-31 22:29:53	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-03-31 22:29:53	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-03-31 22:29:53	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-03-31 22:29:53	                main:494]	:	INFO	:	Creating Model
[2022-03-31 22:29:53	                main:507]	:	INFO	:	Preparing config file
[2022-03-31 22:29:53	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-03-31 22:29:53	                main:512]	:	INFO	:	Loading config
[2022-03-31 22:29:53	                main:514]	:	INFO	:	Loading state
[2022-03-31 22:29:55	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2022-03-31 22:29:55	                main:562]	:	INFO	:	Starting Training
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050 Ti)
[2022-04-02 12:17:42	                main:435]	:	INFO	:	Set logging level to 1
[2022-04-02 12:17:42	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-04-02 12:17:42	                main:444]	:	INFO	:	Resolving all filenames
[2022-04-02 12:17:42	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-02 12:17:42	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-02 12:17:42	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-02 12:17:42	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 0)
[2022-04-02 12:17:42	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-02 12:17:42	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-04-02 12:17:42	                main:474]	:	INFO	:	Configuration: 
[2022-04-02 12:17:42	                main:475]	:	INFO	:	    Model type: GRU
[2022-04-02 12:17:42	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-04-02 12:17:42	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-04-02 12:17:42	                main:478]	:	INFO	:	    Batch Size: 128
[2022-04-02 12:17:42	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-04-02 12:17:42	                main:480]	:	INFO	:	    Patience: 10
[2022-04-02 12:17:42	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-04-02 12:17:42	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-04-02 12:17:42	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-04-02 12:17:42	                main:484]	:	INFO	:	    # Threads: 1
[2022-04-02 12:17:42	                main:486]	:	INFO	:	Preparing Dataset
[2022-04-02 12:17:42	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-02 12:17:43	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-02 12:17:47	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-04-02 12:17:47	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-02 12:17:47	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-02 12:17:47	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-04-02 12:17:47	                main:494]	:	INFO	:	Creating Model
[2022-04-02 12:17:47	                main:507]	:	INFO	:	Preparing config file
[2022-04-02 12:17:47	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-04-02 12:17:47	                main:512]	:	INFO	:	Loading config
[2022-04-02 12:17:47	                main:514]	:	INFO	:	Loading state
[2022-04-02 12:17:50	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2022-04-02 12:17:50	                main:562]	:	INFO	:	Starting Training
[2022-04-02 12:17:55	                main:574]	:	INFO	:	Epoch 1838 | loss: 0.0311423 | val_loss: 0.0312685 | Time: 4807.13 ms
[2022-04-02 12:17:58	                main:574]	:	INFO	:	Epoch 1839 | loss: 0.0310637 | val_loss: 0.0312372 | Time: 3815.45 ms
[2022-04-02 12:18:02	                main:574]	:	INFO	:	Epoch 1840 | loss: 0.0310337 | val_loss: 0.0312534 | Time: 3722.82 ms
[2022-04-02 12:18:06	                main:574]	:	INFO	:	Epoch 1841 | loss: 0.0310158 | val_loss: 0.0312614 | Time: 3660.62 ms
[2022-04-02 12:18:09	                main:574]	:	INFO	:	Epoch 1842 | loss: 0.0310108 | val_loss: 0.0312618 | Time: 3651.41 ms
[2022-04-02 12:18:13	                main:574]	:	INFO	:	Epoch 1843 | loss: 0.0310032 | val_loss: 0.0313057 | Time: 3676.28 ms
[2022-04-02 12:18:17	                main:574]	:	INFO	:	Epoch 1844 | loss: 0.0309999 | val_loss: 0.031289 | Time: 3668.85 ms
[2022-04-02 12:18:20	                main:574]	:	INFO	:	Epoch 1845 | loss: 0.0310044 | val_loss: 0.0312971 | Time: 3649.88 ms
[2022-04-02 12:18:24	                main:574]	:	INFO	:	Epoch 1846 | loss: 0.0309954 | val_loss: 0.031279 | Time: 3616.3 ms
[2022-04-02 12:18:28	                main:574]	:	INFO	:	Epoch 1847 | loss: 0.0310004 | val_loss: 0.0312929 | Time: 3618.21 ms
[2022-04-02 12:18:31	                main:574]	:	INFO	:	Epoch 1848 | loss: 0.0310016 | val_loss: 0.0312814 | Time: 3631.36 ms
[2022-04-02 12:18:35	                main:574]	:	INFO	:	Epoch 1849 | loss: 0.030997 | val_loss: 0.0312778 | Time: 3611.07 ms
[2022-04-02 12:18:39	                main:574]	:	INFO	:	Epoch 1850 | loss: 0.0309973 | val_loss: 0.0312964 | Time: 3618.86 ms
[2022-04-02 12:18:42	                main:574]	:	INFO	:	Epoch 1851 | loss: 0.0309999 | val_loss: 0.031297 | Time: 3609.24 ms
[2022-04-02 12:18:46	                main:574]	:	INFO	:	Epoch 1852 | loss: 0.0309974 | val_loss: 0.0312953 | Time: 3611.57 ms
[2022-04-02 12:18:49	                main:574]	:	INFO	:	Epoch 1853 | loss: 0.0309982 | val_loss: 0.0312723 | Time: 3618.94 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050 Ti)
[2022-04-02 13:00:47	                main:435]	:	INFO	:	Set logging level to 1
[2022-04-02 13:00:47	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-04-02 13:00:47	                main:444]	:	INFO	:	Resolving all filenames
[2022-04-02 13:00:47	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-02 13:00:47	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-02 13:00:47	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-02 13:00:47	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 0)
[2022-04-02 13:00:47	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-02 13:00:47	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-04-02 13:00:47	                main:474]	:	INFO	:	Configuration: 
[2022-04-02 13:00:47	                main:475]	:	INFO	:	    Model type: GRU
[2022-04-02 13:00:47	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-04-02 13:00:47	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-04-02 13:00:47	                main:478]	:	INFO	:	    Batch Size: 128
[2022-04-02 13:00:47	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-04-02 13:00:47	                main:480]	:	INFO	:	    Patience: 10
[2022-04-02 13:00:48	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-04-02 13:00:48	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-04-02 13:00:48	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-04-02 13:00:48	                main:484]	:	INFO	:	    # Threads: 1
[2022-04-02 13:00:48	                main:486]	:	INFO	:	Preparing Dataset
[2022-04-02 13:00:48	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-02 13:00:48	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-02 13:00:53	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-04-02 13:00:53	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-02 13:00:54	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-02 13:00:54	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-04-02 13:00:54	                main:494]	:	INFO	:	Creating Model
[2022-04-02 13:00:54	                main:507]	:	INFO	:	Preparing config file
[2022-04-02 13:00:54	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-04-02 13:00:54	                main:512]	:	INFO	:	Loading config
[2022-04-02 13:00:54	                main:514]	:	INFO	:	Loading state
[2022-04-02 13:00:57	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2022-04-02 13:00:57	                main:562]	:	INFO	:	Starting Training
[2022-04-02 13:01:02	                main:574]	:	INFO	:	Epoch 1838 | loss: 0.0311083 | val_loss: 0.0312407 | Time: 5317.57 ms
[2022-04-02 13:01:06	                main:574]	:	INFO	:	Epoch 1839 | loss: 0.0310479 | val_loss: 0.0312605 | Time: 3889.47 ms
[2022-04-02 13:01:10	                main:574]	:	INFO	:	Epoch 1840 | loss: 0.0310247 | val_loss: 0.0312866 | Time: 3895.28 ms
[2022-04-02 13:01:14	                main:574]	:	INFO	:	Epoch 1841 | loss: 0.0310158 | val_loss: 0.0312594 | Time: 3889.78 ms
[2022-04-02 13:01:18	                main:574]	:	INFO	:	Epoch 1842 | loss: 0.0310147 | val_loss: 0.0312605 | Time: 3943.08 ms
[2022-04-02 13:01:22	                main:574]	:	INFO	:	Epoch 1843 | loss: 0.0310058 | val_loss: 0.0312713 | Time: 4218.57 ms
[2022-04-02 13:01:36	                main:574]	:	INFO	:	Epoch 1844 | loss: 0.0309998 | val_loss: 0.0312948 | Time: 14175.9 ms
[2022-04-02 13:01:40	                main:574]	:	INFO	:	Epoch 1845 | loss: 0.0309979 | val_loss: 0.0312884 | Time: 3809.91 ms
[2022-04-02 13:01:44	                main:574]	:	INFO	:	Epoch 1846 | loss: 0.0310017 | val_loss: 0.0312769 | Time: 3821.04 ms
[2022-04-02 13:01:48	                main:574]	:	INFO	:	Epoch 1847 | loss: 0.0310043 | val_loss: 0.0313032 | Time: 3812.93 ms
[2022-04-02 13:01:52	                main:574]	:	INFO	:	Epoch 1848 | loss: 0.0309983 | val_loss: 0.0312899 | Time: 3827.1 ms
[2022-04-02 13:01:55	                main:574]	:	INFO	:	Epoch 1849 | loss: 0.0309977 | val_loss: 0.0312758 | Time: 3805.51 ms
[2022-04-02 13:01:59	                main:574]	:	INFO	:	Epoch 1850 | loss: 0.0309973 | val_loss: 0.0312829 | Time: 3823.67 ms
[2022-04-02 13:02:03	                main:574]	:	INFO	:	Epoch 1851 | loss: 0.031002 | val_loss: 0.0312689 | Time: 3757.71 ms
[2022-04-02 13:02:07	                main:574]	:	INFO	:	Epoch 1852 | loss: 0.0310061 | val_loss: 0.0312836 | Time: 4130.03 ms
[2022-04-02 13:02:11	                main:574]	:	INFO	:	Epoch 1853 | loss: 0.0310033 | val_loss: 0.0312737 | Time: 4131.54 ms
[2022-04-02 13:02:19	                main:574]	:	INFO	:	Epoch 1854 | loss: 0.0310007 | val_loss: 0.0312666 | Time: 7866.29 ms
[2022-04-02 13:30:30	                main:574]	:	INFO	:	Epoch 1855 | loss: 0.0309973 | val_loss: 0.0312883 | Time: 1.691e+06 ms
[2022-04-02 13:30:34	                main:574]	:	INFO	:	Epoch 1856 | loss: 0.0310029 | val_loss: 0.0313003 | Time: 3731.05 ms
[2022-04-02 13:30:38	                main:574]	:	INFO	:	Epoch 1857 | loss: 0.031016 | val_loss: 0.0312824 | Time: 3661.18 ms
[2022-04-02 13:30:42	                main:574]	:	INFO	:	Epoch 1858 | loss: 0.0310139 | val_loss: 0.0312863 | Time: 3661.09 ms
[2022-04-02 13:30:46	                main:574]	:	INFO	:	Epoch 1859 | loss: 0.0310097 | val_loss: 0.0313056 | Time: 3875.59 ms
[2022-04-02 13:30:50	                main:574]	:	INFO	:	Epoch 1860 | loss: 0.0309995 | val_loss: 0.0312894 | Time: 3579.99 ms
[2022-04-02 13:30:54	                main:574]	:	INFO	:	Epoch 1861 | loss: 0.0310005 | val_loss: 0.031277 | Time: 3761.34 ms
[2022-04-02 13:30:57	                main:574]	:	INFO	:	Epoch 1862 | loss: 0.0310007 | val_loss: 0.0312669 | Time: 3639.53 ms
[2022-04-02 13:31:31	                main:574]	:	INFO	:	Epoch 1863 | loss: 0.0309967 | val_loss: 0.0312778 | Time: 34058.4 ms
[2022-04-02 13:31:35	                main:574]	:	INFO	:	Epoch 1864 | loss: 0.0309886 | val_loss: 0.0312819 | Time: 3687.41 ms
[2022-04-02 13:31:39	                main:574]	:	INFO	:	Epoch 1865 | loss: 0.031 | val_loss: 0.0313051 | Time: 3702.4 ms
[2022-04-02 13:31:42	                main:574]	:	INFO	:	Epoch 1866 | loss: 0.0310009 | val_loss: 0.0312649 | Time: 3702.87 ms
[2022-04-02 13:31:46	                main:574]	:	INFO	:	Epoch 1867 | loss: 0.0309991 | val_loss: 0.031286 | Time: 3775.47 ms
[2022-04-02 13:31:50	                main:574]	:	INFO	:	Epoch 1868 | loss: 0.0309908 | val_loss: 0.0313079 | Time: 3621.02 ms
[2022-04-02 13:31:54	                main:574]	:	INFO	:	Epoch 1869 | loss: 0.0309887 | val_loss: 0.0313019 | Time: 3649.2 ms
[2022-04-02 13:31:57	                main:574]	:	INFO	:	Epoch 1870 | loss: 0.0309968 | val_loss: 0.0312906 | Time: 3576.97 ms
[2022-04-02 13:32:01	                main:574]	:	INFO	:	Epoch 1871 | loss: 0.0309947 | val_loss: 0.0312806 | Time: 3599.31 ms
[2022-04-02 13:32:04	                main:574]	:	INFO	:	Epoch 1872 | loss: 0.0309935 | val_loss: 0.0312899 | Time: 3619.5 ms
[2022-04-02 13:32:08	                main:574]	:	INFO	:	Epoch 1873 | loss: 0.030993 | val_loss: 0.0312897 | Time: 3660.87 ms
[2022-04-02 13:32:12	                main:574]	:	INFO	:	Epoch 1874 | loss: 0.0310582 | val_loss: 0.0312406 | Time: 3586.19 ms
[2022-04-02 13:32:15	                main:574]	:	INFO	:	Epoch 1875 | loss: 0.031047 | val_loss: 0.0312669 | Time: 3737.73 ms
[2022-04-02 13:32:19	                main:574]	:	INFO	:	Epoch 1876 | loss: 0.0310197 | val_loss: 0.0312823 | Time: 3573.93 ms
[2022-04-02 13:32:23	                main:574]	:	INFO	:	Epoch 1877 | loss: 0.0310016 | val_loss: 0.0312641 | Time: 3546.8 ms
[2022-04-02 13:32:28	                main:574]	:	INFO	:	Epoch 1878 | loss: 0.0309991 | val_loss: 0.0312981 | Time: 4745.91 ms
[2022-04-02 13:32:42	                main:574]	:	INFO	:	Epoch 1879 | loss: 0.0310052 | val_loss: 0.0312737 | Time: 14826 ms
[2022-04-02 13:32:46	                main:574]	:	INFO	:	Epoch 1880 | loss: 0.0309947 | val_loss: 0.0312811 | Time: 3985.88 ms
[2022-04-02 13:32:50	                main:574]	:	INFO	:	Epoch 1881 | loss: 0.0309924 | val_loss: 0.0312917 | Time: 3706.28 ms
[2022-04-02 13:32:54	                main:574]	:	INFO	:	Epoch 1882 | loss: 0.0309889 | val_loss: 0.0312962 | Time: 3678.07 ms
[2022-04-02 13:32:58	                main:574]	:	INFO	:	Epoch 1883 | loss: 0.0309862 | val_loss: 0.0313047 | Time: 3727.98 ms
[2022-04-02 13:33:21	                main:574]	:	INFO	:	Epoch 1884 | loss: 0.0309963 | val_loss: 0.0312723 | Time: 23803.3 ms
[2022-04-02 13:33:25	                main:574]	:	INFO	:	Epoch 1885 | loss: 0.0310074 | val_loss: 0.031258 | Time: 3677.2 ms
[2022-04-02 13:33:29	                main:574]	:	INFO	:	Epoch 1886 | loss: 0.0310024 | val_loss: 0.0312971 | Time: 3679.39 ms
[2022-04-02 13:33:32	                main:574]	:	INFO	:	Epoch 1887 | loss: 0.0309958 | val_loss: 0.0312823 | Time: 3657.96 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050 Ti)
[2022-04-02 13:35:35	                main:435]	:	INFO	:	Set logging level to 1
[2022-04-02 13:35:35	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-04-02 13:35:35	                main:444]	:	INFO	:	Resolving all filenames
[2022-04-02 13:35:35	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-02 13:35:35	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-02 13:35:35	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-02 13:35:35	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 0)
[2022-04-02 13:35:35	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-02 13:35:35	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-04-02 13:35:35	                main:474]	:	INFO	:	Configuration: 
[2022-04-02 13:35:35	                main:475]	:	INFO	:	    Model type: GRU
[2022-04-02 13:35:35	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-04-02 13:35:35	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-04-02 13:35:35	                main:478]	:	INFO	:	    Batch Size: 128
[2022-04-02 13:35:35	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-04-02 13:35:35	                main:480]	:	INFO	:	    Patience: 10
[2022-04-02 13:35:35	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-04-02 13:35:35	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-04-02 13:35:35	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-04-02 13:35:35	                main:484]	:	INFO	:	    # Threads: 1
[2022-04-02 13:35:35	                main:486]	:	INFO	:	Preparing Dataset
[2022-04-02 13:35:35	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-02 13:35:35	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-02 13:35:39	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-04-02 13:35:39	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-02 13:35:39	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-02 13:35:40	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-04-02 13:35:40	                main:494]	:	INFO	:	Creating Model
[2022-04-02 13:35:40	                main:507]	:	INFO	:	Preparing config file
[2022-04-02 13:35:40	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-04-02 13:35:40	                main:512]	:	INFO	:	Loading config
[2022-04-02 13:35:40	                main:514]	:	INFO	:	Loading state
[2022-04-02 13:35:42	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2022-04-02 13:35:42	                main:562]	:	INFO	:	Starting Training
[2022-04-02 13:35:46	                main:574]	:	INFO	:	Epoch 1856 | loss: 0.0310767 | val_loss: 0.0312541 | Time: 4301.95 ms
[2022-04-02 13:35:50	                main:574]	:	INFO	:	Epoch 1857 | loss: 0.0310251 | val_loss: 0.0312687 | Time: 3635.16 ms
[2022-04-02 13:35:55	                main:574]	:	INFO	:	Epoch 1858 | loss: 0.0310192 | val_loss: 0.0312665 | Time: 5060.2 ms
[2022-04-02 13:36:21	                main:574]	:	INFO	:	Epoch 1859 | loss: 0.0310068 | val_loss: 0.0312596 | Time: 26591.3 ms
[2022-04-02 13:36:25	                main:574]	:	INFO	:	Epoch 1860 | loss: 0.0310001 | val_loss: 0.0313 | Time: 3587.11 ms
[2022-04-02 13:36:29	                main:574]	:	INFO	:	Epoch 1861 | loss: 0.0310008 | val_loss: 0.031277 | Time: 3783.75 ms
[2022-04-02 13:36:43	                main:574]	:	INFO	:	Epoch 1862 | loss: 0.0309938 | val_loss: 0.0312863 | Time: 13837.9 ms
[2022-04-02 13:36:47	                main:574]	:	INFO	:	Epoch 1863 | loss: 0.030996 | val_loss: 0.0313029 | Time: 3842.16 ms
[2022-04-02 13:36:50	                main:574]	:	INFO	:	Epoch 1864 | loss: 0.0309941 | val_loss: 0.0312958 | Time: 3718.26 ms
[2022-04-02 13:36:54	                main:574]	:	INFO	:	Epoch 1865 | loss: 0.0310002 | val_loss: 0.0312909 | Time: 3682.26 ms
[2022-04-02 13:36:58	                main:574]	:	INFO	:	Epoch 1866 | loss: 0.0310038 | val_loss: 0.0313187 | Time: 4097.38 ms
[2022-04-02 13:37:12	                main:574]	:	INFO	:	Epoch 1867 | loss: 0.0309934 | val_loss: 0.0312945 | Time: 13827.3 ms
[2022-04-02 13:37:16	                main:574]	:	INFO	:	Epoch 1868 | loss: 0.0309869 | val_loss: 0.0312787 | Time: 3926.26 ms
[2022-04-02 13:37:20	                main:574]	:	INFO	:	Epoch 1869 | loss: 0.0309915 | val_loss: 0.0313015 | Time: 3644.3 ms
[2022-04-02 13:37:23	                main:574]	:	INFO	:	Epoch 1870 | loss: 0.0310004 | val_loss: 0.0312879 | Time: 3828.15 ms
[2022-04-02 13:37:27	                main:574]	:	INFO	:	Epoch 1871 | loss: 0.0310085 | val_loss: 0.0312772 | Time: 3730.03 ms
[2022-04-02 13:37:31	                main:574]	:	INFO	:	Epoch 1872 | loss: 0.0310009 | val_loss: 0.0312762 | Time: 3563.66 ms
[2022-04-02 13:37:34	                main:574]	:	INFO	:	Epoch 1873 | loss: 0.0310081 | val_loss: 0.0312557 | Time: 3546.97 ms
[2022-04-02 13:37:38	                main:574]	:	INFO	:	Epoch 1874 | loss: 0.0310346 | val_loss: 0.031255 | Time: 3535.14 ms
[2022-04-02 13:37:41	                main:574]	:	INFO	:	Epoch 1875 | loss: 0.0310069 | val_loss: 0.0312849 | Time: 3549.58 ms
[2022-04-02 13:37:45	                main:574]	:	INFO	:	Epoch 1876 | loss: 0.0309952 | val_loss: 0.0312818 | Time: 3709.42 ms
[2022-04-02 13:37:49	                main:574]	:	INFO	:	Epoch 1877 | loss: 0.0309972 | val_loss: 0.0312763 | Time: 3476.28 ms
[2022-04-02 13:37:52	                main:574]	:	INFO	:	Epoch 1878 | loss: 0.0310003 | val_loss: 0.0312739 | Time: 3504.75 ms
[2022-04-02 13:37:56	                main:574]	:	INFO	:	Epoch 1879 | loss: 0.0309901 | val_loss: 0.0312836 | Time: 3442.19 ms
[2022-04-02 13:37:59	                main:574]	:	INFO	:	Epoch 1880 | loss: 0.0309944 | val_loss: 0.0312706 | Time: 3519.02 ms
[2022-04-02 13:38:03	                main:574]	:	INFO	:	Epoch 1881 | loss: 0.0309983 | val_loss: 0.0312972 | Time: 3555.74 ms
[2022-04-02 13:38:06	                main:574]	:	INFO	:	Epoch 1882 | loss: 0.030995 | val_loss: 0.0312723 | Time: 3607.08 ms
[2022-04-02 13:38:10	                main:574]	:	INFO	:	Epoch 1883 | loss: 0.0309957 | val_loss: 0.0313084 | Time: 3561.58 ms
[2022-04-02 13:38:14	                main:574]	:	INFO	:	Epoch 1884 | loss: 0.0309985 | val_loss: 0.0312611 | Time: 3699.78 ms
[2022-04-02 13:38:17	                main:574]	:	INFO	:	Epoch 1885 | loss: 0.031 | val_loss: 0.0312738 | Time: 3619.18 ms
[2022-04-02 13:38:21	                main:574]	:	INFO	:	Epoch 1886 | loss: 0.0309965 | val_loss: 0.0312844 | Time: 3488.67 ms
[2022-04-02 13:38:24	                main:574]	:	INFO	:	Epoch 1887 | loss: 0.0309945 | val_loss: 0.0312919 | Time: 3505.25 ms
[2022-04-02 13:38:28	                main:574]	:	INFO	:	Epoch 1888 | loss: 0.0309907 | val_loss: 0.0313009 | Time: 3518.66 ms
[2022-04-02 13:38:32	                main:574]	:	INFO	:	Epoch 1889 | loss: 0.0309986 | val_loss: 0.0312855 | Time: 3554.05 ms
[2022-04-02 13:38:35	                main:574]	:	INFO	:	Epoch 1890 | loss: 0.0309924 | val_loss: 0.031288 | Time: 3494.98 ms
[2022-04-02 13:38:39	                main:574]	:	INFO	:	Epoch 1891 | loss: 0.0309947 | val_loss: 0.0313162 | Time: 3535.19 ms
[2022-04-02 13:38:53	                main:574]	:	INFO	:	Epoch 1892 | loss: 0.0309951 | val_loss: 0.0312984 | Time: 14360.3 ms
[2022-04-02 13:38:57	                main:574]	:	INFO	:	Epoch 1893 | loss: 0.0309953 | val_loss: 0.0312683 | Time: 3875.67 ms
[2022-04-02 13:39:01	                main:574]	:	INFO	:	Epoch 1894 | loss: 0.0310004 | val_loss: 0.0312856 | Time: 3735.14 ms
[2022-04-02 13:39:05	                main:574]	:	INFO	:	Epoch 1895 | loss: 0.0310091 | val_loss: 0.0312864 | Time: 3642.49 ms
[2022-04-02 13:39:09	                main:574]	:	INFO	:	Epoch 1896 | loss: 0.031006 | val_loss: 0.0312659 | Time: 3635.48 ms
[2022-04-02 13:39:13	                main:574]	:	INFO	:	Epoch 1897 | loss: 0.0309989 | val_loss: 0.0312959 | Time: 3705.78 ms
[2022-04-02 13:39:17	                main:574]	:	INFO	:	Epoch 1898 | loss: 0.030993 | val_loss: 0.0312747 | Time: 3963.46 ms
[2022-04-02 13:39:21	                main:574]	:	INFO	:	Epoch 1899 | loss: 0.0309964 | val_loss: 0.0312896 | Time: 3893.77 ms
[2022-04-02 13:39:35	                main:574]	:	INFO	:	Epoch 1900 | loss: 0.030993 | val_loss: 0.0312978 | Time: 13731.4 ms
[2022-04-02 13:39:38	                main:574]	:	INFO	:	Epoch 1901 | loss: 0.031 | val_loss: 0.0312886 | Time: 3560.97 ms
[2022-04-02 13:39:42	                main:574]	:	INFO	:	Epoch 1902 | loss: 0.0310108 | val_loss: 0.0312601 | Time: 3587.04 ms
[2022-04-02 13:39:46	                main:574]	:	INFO	:	Epoch 1903 | loss: 0.030997 | val_loss: 0.0312806 | Time: 3789.94 ms
[2022-04-02 13:39:49	                main:574]	:	INFO	:	Epoch 1904 | loss: 0.0310014 | val_loss: 0.0312695 | Time: 3544 ms
[2022-04-02 13:39:53	                main:574]	:	INFO	:	Epoch 1905 | loss: 0.0310123 | val_loss: 0.0312753 | Time: 3607.02 ms
[2022-04-02 13:39:57	                main:574]	:	INFO	:	Epoch 1906 | loss: 0.0310183 | val_loss: 0.0312892 | Time: 3571.12 ms
[2022-04-02 13:40:00	                main:574]	:	INFO	:	Epoch 1907 | loss: 0.0310012 | val_loss: 0.0312792 | Time: 3550.82 ms
[2022-04-02 13:40:04	                main:574]	:	INFO	:	Epoch 1908 | loss: 0.0310013 | val_loss: 0.031269 | Time: 3654.79 ms
[2022-04-02 13:40:07	                main:574]	:	INFO	:	Epoch 1909 | loss: 0.0310061 | val_loss: 0.0312845 | Time: 3667.63 ms
[2022-04-02 13:40:11	                main:574]	:	INFO	:	Epoch 1910 | loss: 0.0310004 | val_loss: 0.0312628 | Time: 3582.77 ms
[2022-04-02 13:40:15	                main:574]	:	INFO	:	Epoch 1911 | loss: 0.0309905 | val_loss: 0.0312937 | Time: 3647.17 ms
[2022-04-02 13:40:18	                main:574]	:	INFO	:	Epoch 1912 | loss: 0.0309953 | val_loss: 0.0312962 | Time: 3560.7 ms
[2022-04-02 13:40:22	                main:574]	:	INFO	:	Epoch 1913 | loss: 0.0310081 | val_loss: 0.0312758 | Time: 3571.5 ms
[2022-04-02 13:40:26	                main:574]	:	INFO	:	Epoch 1914 | loss: 0.0310036 | val_loss: 0.0312792 | Time: 3548.76 ms
[2022-04-02 13:40:29	                main:574]	:	INFO	:	Epoch 1915 | loss: 0.0310022 | val_loss: 0.031281 | Time: 3504.06 ms
[2022-04-02 13:40:33	                main:574]	:	INFO	:	Epoch 1916 | loss: 0.0309938 | val_loss: 0.0313292 | Time: 3988.6 ms
[2022-04-02 13:40:57	                main:574]	:	INFO	:	Epoch 1917 | loss: 0.0310046 | val_loss: 0.0312671 | Time: 23929.9 ms
[2022-04-02 13:41:03	                main:574]	:	INFO	:	Epoch 1918 | loss: 0.0309972 | val_loss: 0.0312916 | Time: 6020.37 ms
[2022-04-02 13:41:17	                main:574]	:	INFO	:	Epoch 1919 | loss: 0.0309933 | val_loss: 0.0312986 | Time: 13713.5 ms
[2022-04-02 13:41:21	                main:574]	:	INFO	:	Epoch 1920 | loss: 0.0309954 | val_loss: 0.0312722 | Time: 3636.39 ms
[2022-04-02 13:41:24	                main:574]	:	INFO	:	Epoch 1921 | loss: 0.0309964 | val_loss: 0.0312906 | Time: 3575.7 ms
[2022-04-02 13:41:28	                main:574]	:	INFO	:	Epoch 1922 | loss: 0.030996 | val_loss: 0.0312821 | Time: 3624.13 ms
[2022-04-02 13:41:32	                main:574]	:	INFO	:	Epoch 1923 | loss: 0.0310098 | val_loss: 0.0312871 | Time: 3822.21 ms
[2022-04-02 13:41:56	                main:574]	:	INFO	:	Epoch 1924 | loss: 0.0309946 | val_loss: 0.0312933 | Time: 23873.8 ms
[2022-04-02 13:41:59	                main:574]	:	INFO	:	Epoch 1925 | loss: 0.0309914 | val_loss: 0.031294 | Time: 3696.9 ms
[2022-04-02 13:42:03	                main:574]	:	INFO	:	Epoch 1926 | loss: 0.0309918 | val_loss: 0.0312949 | Time: 3766.65 ms
[2022-04-02 13:42:07	                main:574]	:	INFO	:	Epoch 1927 | loss: 0.0309939 | val_loss: 0.0312741 | Time: 3740.32 ms
[2022-04-02 13:42:11	                main:574]	:	INFO	:	Epoch 1928 | loss: 0.030988 | val_loss: 0.0312975 | Time: 3680.49 ms
[2022-04-02 13:42:14	                main:574]	:	INFO	:	Epoch 1929 | loss: 0.0309843 | val_loss: 0.0312874 | Time: 3818.43 ms
[2022-04-02 13:42:18	                main:574]	:	INFO	:	Epoch 1930 | loss: 0.0309958 | val_loss: 0.0312556 | Time: 3682.32 ms
[2022-04-02 13:42:22	                main:574]	:	INFO	:	Epoch 1931 | loss: 0.0310026 | val_loss: 0.0312814 | Time: 3770.27 ms
[2022-04-02 13:43:27	                main:574]	:	INFO	:	Epoch 1932 | loss: 0.0310082 | val_loss: 0.0312901 | Time: 65494.1 ms
[2022-04-02 13:43:32	                main:574]	:	INFO	:	Epoch 1933 | loss: 0.0309958 | val_loss: 0.0313003 | Time: 4103.23 ms
[2022-04-02 13:44:16	                main:574]	:	INFO	:	Epoch 1934 | loss: 0.0309853 | val_loss: 0.0312975 | Time: 44279.3 ms
[2022-04-02 13:44:25	                main:574]	:	INFO	:	Epoch 1935 | loss: 0.0309964 | val_loss: 0.0312808 | Time: 4768.92 ms
[2022-04-02 13:44:30	                main:574]	:	INFO	:	Epoch 1936 | loss: 0.0309966 | val_loss: 0.0313138 | Time: 4700.88 ms
[2022-04-02 13:44:34	                main:574]	:	INFO	:	Epoch 1937 | loss: 0.0309967 | val_loss: 0.0313042 | Time: 4166.11 ms
[2022-04-02 13:44:58	                main:574]	:	INFO	:	Epoch 1938 | loss: 0.0309972 | val_loss: 0.0312929 | Time: 24208.4 ms
[2022-04-02 13:45:02	                main:574]	:	INFO	:	Epoch 1939 | loss: 0.0309987 | val_loss: 0.0313122 | Time: 3806.54 ms
[2022-04-02 13:45:06	                main:574]	:	INFO	:	Epoch 1940 | loss: 0.0310146 | val_loss: 0.0312983 | Time: 3757.31 ms
[2022-04-02 13:45:10	                main:574]	:	INFO	:	Epoch 1941 | loss: 0.0309983 | val_loss: 0.0312828 | Time: 3892.69 ms
[2022-04-02 13:45:14	                main:574]	:	INFO	:	Epoch 1942 | loss: 0.0310013 | val_loss: 0.0312983 | Time: 3701.72 ms
[2022-04-02 13:45:38	                main:574]	:	INFO	:	Epoch 1943 | loss: 0.0310018 | val_loss: 0.0313029 | Time: 24670.5 ms
[2022-04-02 13:45:42	                main:574]	:	INFO	:	Epoch 1944 | loss: 0.0309978 | val_loss: 0.0312913 | Time: 3699.69 ms
[2022-04-02 13:45:46	                main:574]	:	INFO	:	Epoch 1945 | loss: 0.0309915 | val_loss: 0.0312887 | Time: 3646.12 ms
[2022-04-02 13:45:49	                main:574]	:	INFO	:	Epoch 1946 | loss: 0.0310125 | val_loss: 0.0312797 | Time: 3552.01 ms
[2022-04-02 13:45:53	                main:574]	:	INFO	:	Epoch 1947 | loss: 0.0310092 | val_loss: 0.0313045 | Time: 3641.91 ms
[2022-04-02 13:45:56	                main:574]	:	INFO	:	Epoch 1948 | loss: 0.0310002 | val_loss: 0.0312732 | Time: 3624.62 ms
[2022-04-02 13:46:00	                main:574]	:	INFO	:	Epoch 1949 | loss: 0.0309991 | val_loss: 0.0312998 | Time: 3579.9 ms
[2022-04-02 13:46:04	                main:574]	:	INFO	:	Epoch 1950 | loss: 0.0309914 | val_loss: 0.0312991 | Time: 3565.59 ms
[2022-04-02 13:46:07	                main:574]	:	INFO	:	Epoch 1951 | loss: 0.0309944 | val_loss: 0.0312618 | Time: 3607.96 ms
[2022-04-02 13:46:11	                main:574]	:	INFO	:	Epoch 1952 | loss: 0.0309983 | val_loss: 0.0312932 | Time: 3567.31 ms
[2022-04-02 13:46:15	                main:574]	:	INFO	:	Epoch 1953 | loss: 0.0309984 | val_loss: 0.0312885 | Time: 3656.23 ms
[2022-04-02 13:46:19	                main:574]	:	INFO	:	Epoch 1954 | loss: 0.0309886 | val_loss: 0.0313015 | Time: 4624.24 ms
[2022-04-02 13:46:23	                main:574]	:	INFO	:	Epoch 1955 | loss: 0.0309919 | val_loss: 0.0312654 | Time: 3753.82 ms
[2022-04-02 13:46:27	                main:574]	:	INFO	:	Epoch 1956 | loss: 0.0309959 | val_loss: 0.0312884 | Time: 3729.43 ms
[2022-04-02 13:46:31	                main:574]	:	INFO	:	Epoch 1957 | loss: 0.0309959 | val_loss: 0.0312871 | Time: 4845.73 ms
[2022-04-02 13:46:47	                main:574]	:	INFO	:	Epoch 1958 | loss: 0.0309954 | val_loss: 0.0312918 | Time: 15312.2 ms
[2022-04-02 13:46:51	                main:574]	:	INFO	:	Epoch 1959 | loss: 0.0309978 | val_loss: 0.0312788 | Time: 3749.87 ms
[2022-04-02 13:46:54	                main:574]	:	INFO	:	Epoch 1960 | loss: 0.0310055 | val_loss: 0.0312896 | Time: 3711.86 ms
[2022-04-02 13:46:58	                main:574]	:	INFO	:	Epoch 1961 | loss: 0.0310024 | val_loss: 0.0312459 | Time: 3621.89 ms
[2022-04-02 13:47:02	                main:574]	:	INFO	:	Epoch 1962 | loss: 0.0310013 | val_loss: 0.031276 | Time: 3660.08 ms
[2022-04-02 13:47:05	                main:574]	:	INFO	:	Epoch 1963 | loss: 0.0309966 | val_loss: 0.0312894 | Time: 3637.04 ms
[2022-04-02 13:47:09	                main:574]	:	INFO	:	Epoch 1964 | loss: 0.0309967 | val_loss: 0.0313002 | Time: 3638.95 ms
[2022-04-02 13:47:12	                main:574]	:	INFO	:	Epoch 1965 | loss: 0.0310015 | val_loss: 0.03131 | Time: 3611.3 ms
[2022-04-02 13:47:16	                main:574]	:	INFO	:	Epoch 1966 | loss: 0.0309955 | val_loss: 0.0312913 | Time: 3635.78 ms
[2022-04-02 13:47:20	                main:574]	:	INFO	:	Epoch 1967 | loss: 0.0309991 | val_loss: 0.0312878 | Time: 3623.56 ms
[2022-04-02 13:47:23	                main:574]	:	INFO	:	Epoch 1968 | loss: 0.0310054 | val_loss: 0.0312793 | Time: 3589.16 ms
[2022-04-02 13:47:30	                main:574]	:	INFO	:	Epoch 1969 | loss: 0.0310042 | val_loss: 0.031268 | Time: 6377.62 ms
[2022-04-02 13:47:35	                main:574]	:	INFO	:	Epoch 1970 | loss: 0.0309912 | val_loss: 0.0313089 | Time: 5261.38 ms
[2022-04-02 13:48:00	                main:574]	:	INFO	:	Epoch 1971 | loss: 0.0309883 | val_loss: 0.031294 | Time: 23827.6 ms
[2022-04-02 13:48:04	                main:574]	:	INFO	:	Epoch 1972 | loss: 0.0309915 | val_loss: 0.0312601 | Time: 3748.64 ms
[2022-04-02 13:48:08	                main:574]	:	INFO	:	Epoch 1973 | loss: 0.0310062 | val_loss: 0.0312597 | Time: 3722.07 ms
[2022-04-02 13:48:12	                main:574]	:	INFO	:	Epoch 1974 | loss: 0.0310024 | val_loss: 0.0312935 | Time: 3724.53 ms
[2022-04-02 13:48:15	                main:574]	:	INFO	:	Epoch 1975 | loss: 0.0309892 | val_loss: 0.0312965 | Time: 3717.33 ms
[2022-04-02 13:48:19	                main:574]	:	INFO	:	Epoch 1976 | loss: 0.0309954 | val_loss: 0.0313084 | Time: 3708.11 ms
[2022-04-02 13:48:23	                main:574]	:	INFO	:	Epoch 1977 | loss: 0.0309948 | val_loss: 0.0313021 | Time: 3733.88 ms
[2022-04-02 13:48:26	                main:574]	:	INFO	:	Epoch 1978 | loss: 0.0309899 | val_loss: 0.0312902 | Time: 3717.22 ms
[2022-04-02 13:48:30	                main:574]	:	INFO	:	Epoch 1979 | loss: 0.0309941 | val_loss: 0.0312965 | Time: 3689.95 ms
[2022-04-02 13:48:34	                main:574]	:	INFO	:	Epoch 1980 | loss: 0.0309887 | val_loss: 0.0312803 | Time: 3661.3 ms
[2022-04-02 13:48:37	                main:574]	:	INFO	:	Epoch 1981 | loss: 0.0309944 | val_loss: 0.0312938 | Time: 3630.11 ms
[2022-04-02 13:48:41	                main:574]	:	INFO	:	Epoch 1982 | loss: 0.0310021 | val_loss: 0.0312872 | Time: 3644.08 ms
[2022-04-02 13:48:45	                main:574]	:	INFO	:	Epoch 1983 | loss: 0.031001 | val_loss: 0.0313001 | Time: 3634.57 ms
[2022-04-02 13:48:48	                main:574]	:	INFO	:	Epoch 1984 | loss: 0.0309948 | val_loss: 0.0312867 | Time: 3632.04 ms
[2022-04-02 13:48:52	                main:574]	:	INFO	:	Epoch 1985 | loss: 0.0309931 | val_loss: 0.0313288 | Time: 3608.21 ms
[2022-04-02 13:48:56	                main:574]	:	INFO	:	Epoch 1986 | loss: 0.0309947 | val_loss: 0.0313039 | Time: 3623.33 ms
[2022-04-02 13:48:59	                main:574]	:	INFO	:	Epoch 1987 | loss: 0.0309916 | val_loss: 0.0312774 | Time: 3597.99 ms
[2022-04-02 13:49:03	                main:574]	:	INFO	:	Epoch 1988 | loss: 0.0310001 | val_loss: 0.0312856 | Time: 3618.73 ms
[2022-04-02 13:49:06	                main:574]	:	INFO	:	Epoch 1989 | loss: 0.0309979 | val_loss: 0.0312841 | Time: 3564.28 ms
[2022-04-02 13:49:10	                main:574]	:	INFO	:	Epoch 1990 | loss: 0.0310026 | val_loss: 0.0312782 | Time: 3623.72 ms
[2022-04-02 13:49:14	                main:574]	:	INFO	:	Epoch 1991 | loss: 0.0310083 | val_loss: 0.031288 | Time: 3590.67 ms
[2022-04-02 13:49:17	                main:574]	:	INFO	:	Epoch 1992 | loss: 0.0309891 | val_loss: 0.0312651 | Time: 3591.66 ms
[2022-04-02 13:49:21	                main:574]	:	INFO	:	Epoch 1993 | loss: 0.0309921 | val_loss: 0.0312968 | Time: 3650.82 ms
[2022-04-02 13:49:24	                main:574]	:	INFO	:	Epoch 1994 | loss: 0.0309892 | val_loss: 0.0313298 | Time: 3609.86 ms
[2022-04-02 13:49:28	                main:574]	:	INFO	:	Epoch 1995 | loss: 0.0309969 | val_loss: 0.0312765 | Time: 3585.34 ms
[2022-04-02 13:49:32	                main:574]	:	INFO	:	Epoch 1996 | loss: 0.0310077 | val_loss: 0.0313023 | Time: 3561.64 ms
[2022-04-02 13:49:35	                main:574]	:	INFO	:	Epoch 1997 | loss: 0.0310146 | val_loss: 0.0313234 | Time: 3623.19 ms
[2022-04-02 13:49:39	                main:574]	:	INFO	:	Epoch 1998 | loss: 0.0310021 | val_loss: 0.0312861 | Time: 3645.76 ms
[2022-04-02 13:49:43	                main:574]	:	INFO	:	Epoch 1999 | loss: 0.0310023 | val_loss: 0.0312993 | Time: 3636.98 ms
[2022-04-02 13:49:46	                main:574]	:	INFO	:	Epoch 2000 | loss: 0.031006 | val_loss: 0.0312677 | Time: 3641.11 ms
[2022-04-02 13:49:50	                main:574]	:	INFO	:	Epoch 2001 | loss: 0.031014 | val_loss: 0.0312549 | Time: 3617 ms
[2022-04-02 13:49:53	                main:574]	:	INFO	:	Epoch 2002 | loss: 0.0310503 | val_loss: 0.0312741 | Time: 3614.24 ms
[2022-04-02 13:49:57	                main:574]	:	INFO	:	Epoch 2003 | loss: 0.0310154 | val_loss: 0.0312895 | Time: 3634.33 ms
[2022-04-02 13:50:01	                main:574]	:	INFO	:	Epoch 2004 | loss: 0.0310077 | val_loss: 0.0313059 | Time: 3600.16 ms
[2022-04-02 13:50:04	                main:574]	:	INFO	:	Epoch 2005 | loss: 0.0310084 | val_loss: 0.0312763 | Time: 3595.38 ms
[2022-04-02 13:50:08	                main:574]	:	INFO	:	Epoch 2006 | loss: 0.0310065 | val_loss: 0.0312963 | Time: 3620.54 ms
[2022-04-02 13:50:12	                main:574]	:	INFO	:	Epoch 2007 | loss: 0.0309975 | val_loss: 0.0312819 | Time: 3606.38 ms
[2022-04-02 13:50:15	                main:574]	:	INFO	:	Epoch 2008 | loss: 0.0310127 | val_loss: 0.0313139 | Time: 3620 ms
[2022-04-02 13:50:19	                main:574]	:	INFO	:	Epoch 2009 | loss: 0.0309996 | val_loss: 0.0313068 | Time: 3654.23 ms
[2022-04-02 13:50:22	                main:574]	:	INFO	:	Epoch 2010 | loss: 0.0309993 | val_loss: 0.0312721 | Time: 3601.87 ms
[2022-04-02 13:50:26	                main:574]	:	INFO	:	Epoch 2011 | loss: 0.0309969 | val_loss: 0.0312966 | Time: 3613.89 ms
[2022-04-02 13:50:30	                main:574]	:	INFO	:	Epoch 2012 | loss: 0.0309892 | val_loss: 0.0313207 | Time: 3561.19 ms
[2022-04-02 13:50:33	                main:574]	:	INFO	:	Epoch 2013 | loss: 0.0309936 | val_loss: 0.0312693 | Time: 3627.05 ms
[2022-04-02 13:50:37	                main:574]	:	INFO	:	Epoch 2014 | loss: 0.0309944 | val_loss: 0.0312829 | Time: 3648.5 ms
[2022-04-02 13:50:41	                main:574]	:	INFO	:	Epoch 2015 | loss: 0.0309956 | val_loss: 0.0312856 | Time: 3623.11 ms
[2022-04-02 13:50:44	                main:574]	:	INFO	:	Epoch 2016 | loss: 0.0309987 | val_loss: 0.0312891 | Time: 3627.38 ms
[2022-04-02 13:50:48	                main:574]	:	INFO	:	Epoch 2017 | loss: 0.0309868 | val_loss: 0.0313083 | Time: 3613.82 ms
[2022-04-02 13:50:51	                main:574]	:	INFO	:	Epoch 2018 | loss: 0.0309917 | val_loss: 0.0312805 | Time: 3631.4 ms
[2022-04-02 13:50:55	                main:574]	:	INFO	:	Epoch 2019 | loss: 0.0309953 | val_loss: 0.0312973 | Time: 3617.25 ms
[2022-04-02 13:50:59	                main:574]	:	INFO	:	Epoch 2020 | loss: 0.0309971 | val_loss: 0.0312674 | Time: 3650.98 ms
[2022-04-02 13:51:02	                main:574]	:	INFO	:	Epoch 2021 | loss: 0.0310085 | val_loss: 0.0312873 | Time: 3583.1 ms
[2022-04-02 13:51:06	                main:574]	:	INFO	:	Epoch 2022 | loss: 0.0310078 | val_loss: 0.0312804 | Time: 3648.35 ms
[2022-04-02 13:51:10	                main:574]	:	INFO	:	Epoch 2023 | loss: 0.0309979 | val_loss: 0.0313123 | Time: 3630.29 ms
[2022-04-02 13:51:13	                main:574]	:	INFO	:	Epoch 2024 | loss: 0.0309917 | val_loss: 0.031286 | Time: 3584.63 ms
[2022-04-02 13:51:17	                main:574]	:	INFO	:	Epoch 2025 | loss: 0.030997 | val_loss: 0.0312826 | Time: 3588.45 ms
[2022-04-02 13:51:20	                main:574]	:	INFO	:	Epoch 2026 | loss: 0.0310057 | val_loss: 0.0312578 | Time: 3583.86 ms
[2022-04-02 13:51:24	                main:574]	:	INFO	:	Epoch 2027 | loss: 0.031008 | val_loss: 0.0312672 | Time: 3659.33 ms
[2022-04-02 13:51:28	                main:574]	:	INFO	:	Epoch 2028 | loss: 0.0310068 | val_loss: 0.0312828 | Time: 3634.97 ms
[2022-04-02 13:51:31	                main:574]	:	INFO	:	Epoch 2029 | loss: 0.0310046 | val_loss: 0.0312876 | Time: 3546.23 ms
[2022-04-02 13:51:35	                main:574]	:	INFO	:	Epoch 2030 | loss: 0.0309933 | val_loss: 0.0312736 | Time: 3621.37 ms
[2022-04-02 13:51:38	                main:574]	:	INFO	:	Epoch 2031 | loss: 0.0309931 | val_loss: 0.0312841 | Time: 3582.62 ms
[2022-04-02 13:51:42	                main:574]	:	INFO	:	Epoch 2032 | loss: 0.0309954 | val_loss: 0.0313025 | Time: 3540.07 ms
[2022-04-02 13:51:46	                main:574]	:	INFO	:	Epoch 2033 | loss: 0.0309948 | val_loss: 0.0312968 | Time: 3568.97 ms
[2022-04-02 13:51:49	                main:574]	:	INFO	:	Epoch 2034 | loss: 0.0309957 | val_loss: 0.0313105 | Time: 3603.61 ms
[2022-04-02 13:51:53	                main:574]	:	INFO	:	Epoch 2035 | loss: 0.0309969 | val_loss: 0.0312826 | Time: 3589.98 ms
[2022-04-02 13:51:56	                main:574]	:	INFO	:	Epoch 2036 | loss: 0.0310136 | val_loss: 0.0312652 | Time: 3602.37 ms
[2022-04-02 13:52:00	                main:574]	:	INFO	:	Epoch 2037 | loss: 0.0310131 | val_loss: 0.031257 | Time: 3615.03 ms
[2022-04-02 13:52:04	                main:574]	:	INFO	:	Epoch 2038 | loss: 0.0310048 | val_loss: 0.0312772 | Time: 3606 ms
[2022-04-02 13:52:07	                main:574]	:	INFO	:	Epoch 2039 | loss: 0.0310007 | val_loss: 0.0313103 | Time: 3520.97 ms
[2022-04-02 13:52:11	                main:574]	:	INFO	:	Epoch 2040 | loss: 0.0309971 | val_loss: 0.0312534 | Time: 3598.33 ms
[2022-04-02 13:52:14	                main:574]	:	INFO	:	Epoch 2041 | loss: 0.0310082 | val_loss: 0.0312959 | Time: 3604.95 ms
[2022-04-02 13:52:18	                main:574]	:	INFO	:	Epoch 2042 | loss: 0.0310045 | val_loss: 0.0312934 | Time: 3612.62 ms
[2022-04-02 13:52:22	                main:574]	:	INFO	:	Epoch 2043 | loss: 0.0309874 | val_loss: 0.0312888 | Time: 3615.01 ms
[2022-04-02 13:52:25	                main:574]	:	INFO	:	Epoch 2044 | loss: 0.0309912 | val_loss: 0.0312931 | Time: 3565.43 ms
[2022-04-02 13:52:29	                main:574]	:	INFO	:	Epoch 2045 | loss: 0.0309878 | val_loss: 0.0313037 | Time: 3587.85 ms
[2022-04-02 13:52:32	                main:574]	:	INFO	:	Epoch 2046 | loss: 0.0309915 | val_loss: 0.0312878 | Time: 3618.49 ms
[2022-04-02 13:52:36	                main:574]	:	INFO	:	Epoch 2047 | loss: 0.0309937 | val_loss: 0.0312947 | Time: 3593.09 ms
[2022-04-02 13:52:40	                main:574]	:	INFO	:	Epoch 2048 | loss: 0.030991 | val_loss: 0.0312715 | Time: 3595.25 ms
[2022-04-02 13:52:40	                main:597]	:	INFO	:	Saving trained model to model-final.pt, val_loss 0.0312715
[2022-04-02 13:52:40	                main:603]	:	INFO	:	Saving end state to config to file
[2022-04-02 13:52:40	                main:608]	:	INFO	:	Success, exiting..
13:52:40 (2180): called boinc_finish(0)

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)