Task 14618832
| Name | ParityModified-1647048446-11914-3-0_0 |
| Workunit | 11638870 |
| Created | 12 Apr 2022, 19:28:11 UTC |
| Sent | 12 Apr 2022, 19:28:37 UTC |
| Report deadline | 20 Apr 2022, 19:28:37 UTC |
| Received | 13 Apr 2022, 1:27:03 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 15008 |
| Run time | 37 min 10 sec |
| CPU time | 36 min 27 sec |
| Validate state | Valid |
| Credit | 4,160.00 |
| Device peak FLOPS | 7,608.92 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 2.08 GB |
| Peak swap size | 4.35 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.11</core_client_version> <![CDATA[ <stderr_txt> 5 | Time: 1092.03 ms [2022-04-12 13:29:05 main:574] : INFO : Epoch 1741 | loss: 0.0311932 | val_loss: 0.0311934 | Time: 1052.58 ms [2022-04-12 13:29:06 main:574] : INFO : Epoch 1742 | loss: 0.0311917 | val_loss: 0.0311927 | Time: 1087.26 ms [2022-04-12 13:29:08 main:574] : INFO : Epoch 1743 | loss: 0.0311918 | val_loss: 0.0311923 | Time: 1081.51 ms [2022-04-12 13:29:09 main:574] : INFO : Epoch 1744 | loss: 0.0311915 | val_loss: 0.0311934 | Time: 1112.44 ms [2022-04-12 13:29:10 main:574] : INFO : Epoch 1745 | loss: 0.0311901 | val_loss: 0.0311914 | Time: 1072.39 ms [2022-04-12 13:29:11 main:574] : INFO : Epoch 1746 | loss: 0.0311888 | val_loss: 0.0311895 | Time: 1075.19 ms [2022-04-12 13:29:12 main:574] : INFO : Epoch 1747 | loss: 0.0311879 | val_loss: 0.0311883 | Time: 1084.89 ms [2022-04-12 13:29:13 main:574] : INFO : Epoch 1748 | loss: 0.0311885 | val_loss: 0.0311905 | Time: 1048.81 ms [2022-04-12 13:29:14 main:574] : INFO : Epoch 1749 | loss: 0.0311883 | val_loss: 0.03119 | Time: 1133.97 ms [2022-04-12 13:29:15 main:574] : INFO : Epoch 1750 | loss: 0.0311869 | val_loss: 0.0311875 | Time: 1041.9 ms [2022-04-12 13:29:16 main:574] : INFO : Epoch 1751 | loss: 0.031188 | val_loss: 0.0311874 | Time: 1127.11 ms [2022-04-12 13:29:17 main:574] : INFO : Epoch 1752 | loss: 0.0311866 | val_loss: 0.0311884 | Time: 1072.25 ms [2022-04-12 13:29:18 main:574] : INFO : Epoch 1753 | loss: 0.0311869 | val_loss: 0.0311925 | Time: 1100.5 ms [2022-04-12 13:29:20 main:574] : INFO : Epoch 1754 | loss: 0.0311882 | val_loss: 0.0311882 | Time: 1051.87 ms [2022-04-12 13:29:21 main:574] : INFO : Epoch 1755 | loss: 0.0311893 | val_loss: 0.0311887 | Time: 1087.7 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 2070) [2022-04-12 14:13:01 main:435] : INFO : Set logging level to 1 [2022-04-12 14:13:01 main:441] : INFO : Running in BOINC Client mode [2022-04-12 14:13:01 main:444] : INFO : Resolving all filenames [2022-04-12 14:13:01 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-12 14:13:01 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-12 14:13:01 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-12 14:13:01 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-12 14:13:01 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-12 14:13:01 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-12 14:13:01 main:474] : INFO : Configuration: [2022-04-12 14:13:01 main:475] : INFO : Model type: GRU [2022-04-12 14:13:01 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-12 14:13:01 main:477] : INFO : Max Epochs: 2048 [2022-04-12 14:13:01 main:478] : INFO : Batch Size: 128 [2022-04-12 14:13:01 main:479] : INFO : Learning Rate: 0.01 [2022-04-12 14:13:01 main:480] : INFO : Patience: 10 [2022-04-12 14:13:01 main:481] : INFO : Hidden Width: 12 [2022-04-12 14:13:01 main:482] : INFO : # Recurrent Layers: 4 [2022-04-12 14:13:01 main:483] : INFO : # Backend Layers: 4 [2022-04-12 14:13:01 main:484] : INFO : # Threads: 1 [2022-04-12 14:13:01 main:486] : INFO : Preparing Dataset [2022-04-12 14:13:01 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-12 14:13:01 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-12 14:13:03 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-12 14:13:03 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-12 14:13:03 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-12 14:13:03 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-12 14:13:03 main:494] : INFO : Creating Model [2022-04-12 14:13:03 main:507] : INFO : Preparing config file [2022-04-12 14:13:03 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-12 14:13:03 main:512] : INFO : Loading config [2022-04-12 14:13:03 main:514] : INFO : Loading state [2022-04-12 14:13:04 main:559] : INFO : Loading DataLoader into Memory [2022-04-12 14:13:04 main:562] : INFO : Starting Training [2022-04-12 14:13:05 main:574] : INFO : Epoch 1713 | loss: 0.0314234 | val_loss: 0.031273 | Time: 1293.53 ms [2022-04-12 14:13:06 main:574] : INFO : Epoch 1714 | loss: 0.0312614 | val_loss: 0.0312482 | Time: 1095.17 ms [2022-04-12 14:13:07 main:574] : INFO : Epoch 1715 | loss: 0.0312478 | val_loss: 0.031242 | Time: 1049.07 ms [2022-04-12 14:13:09 main:574] : INFO : Epoch 1716 | loss: 0.0312388 | val_loss: 0.0312338 | Time: 1095.22 ms [2022-04-12 14:13:10 main:574] : INFO : Epoch 1717 | loss: 0.0312299 | val_loss: 0.0312272 | Time: 1045.77 ms [2022-04-12 14:13:11 main:574] : INFO : Epoch 1718 | loss: 0.0312184 | val_loss: 0.0312137 | Time: 1110.94 ms [2022-04-12 14:13:12 main:574] : INFO : Epoch 1719 | loss: 0.0312131 | val_loss: 0.0312092 | Time: 1052.05 ms [2022-04-12 14:13:13 main:574] : INFO : Epoch 1720 | loss: 0.0312082 | val_loss: 0.0312082 | Time: 1084.07 ms [2022-04-12 14:13:14 main:574] : INFO : Epoch 1721 | loss: 0.0312059 | val_loss: 0.0312053 | Time: 1063.24 ms [2022-04-12 14:13:15 main:574] : INFO : Epoch 1722 | loss: 0.0312027 | val_loss: 0.0312049 | Time: 1082.45 ms [2022-04-12 14:13:16 main:574] : INFO : Epoch 1723 | loss: 0.0312007 | val_loss: 0.0312021 | Time: 1099.28 ms [2022-04-12 14:13:17 main:574] : INFO : Epoch 1724 | loss: 0.0312008 | val_loss: 0.0312024 | Time: 1060.96 ms [2022-04-12 14:13:18 main:574] : INFO : Epoch 1725 | loss: 0.0312013 | val_loss: 0.0312102 | Time: 1079.03 ms [2022-04-12 14:13:19 main:574] : INFO : Epoch 1726 | loss: 0.0312049 | val_loss: 0.0312107 | Time: 1053.38 ms [2022-04-12 14:13:20 main:574] : INFO : Epoch 1727 | loss: 0.0312054 | val_loss: 0.0312093 | Time: 1096.09 ms [2022-04-12 14:13:21 main:574] : INFO : Epoch 1728 | loss: 0.031202 | val_loss: 0.031208 | Time: 1057.02 ms [2022-04-12 14:13:23 main:574] : INFO : Epoch 1729 | loss: 0.0312008 | val_loss: 0.0312009 | Time: 1153.53 ms [2022-04-12 14:13:24 main:574] : INFO : Epoch 1730 | loss: 0.0311996 | val_loss: 0.0312006 | Time: 1052.43 ms [2022-04-12 14:13:25 main:574] : INFO : Epoch 1731 | loss: 0.0311978 | val_loss: 0.0312001 | Time: 1090.6 ms [2022-04-12 14:13:26 main:574] : INFO : Epoch 1732 | loss: 0.0311967 | val_loss: 0.0312002 | Time: 1052.17 ms [2022-04-12 14:13:27 main:574] : INFO : Epoch 1733 | loss: 0.0311953 | val_loss: 0.0311949 | Time: 1072.19 ms [2022-04-12 14:13:28 main:574] : INFO : Epoch 1734 | loss: 0.0311939 | val_loss: 0.0311932 | Time: 1061.38 ms [2022-04-12 14:13:29 main:574] : INFO : Epoch 1735 | loss: 0.0311924 | val_loss: 0.0311909 | Time: 1082.15 ms [2022-04-12 14:13:30 main:574] : INFO : Epoch 1736 | loss: 0.0311917 | val_loss: 0.0311907 | Time: 1070.11 ms [2022-04-12 14:13:31 main:574] : INFO : Epoch 1737 | loss: 0.031191 | val_loss: 0.0311906 | Time: 1065.95 ms [2022-04-12 14:13:32 main:574] : INFO : Epoch 1738 | loss: 0.03119 | val_loss: 0.0311881 | Time: 1074.19 ms [2022-04-12 14:13:33 main:574] : INFO : Epoch 1739 | loss: 0.0311882 | val_loss: 0.0311879 | Time: 1064.04 ms [2022-04-12 14:13:34 main:574] : INFO : Epoch 1740 | loss: 0.0311884 | val_loss: 0.0311883 | Time: 1131.37 ms [2022-04-12 14:13:36 main:574] : INFO : Epoch 1741 | loss: 0.0311884 | val_loss: 0.0311902 | Time: 1045 ms [2022-04-12 14:13:37 main:574] : INFO : Epoch 1742 | loss: 0.0311881 | val_loss: 0.0311871 | Time: 1102.55 ms [2022-04-12 14:13:38 main:574] : INFO : Epoch 1743 | loss: 0.031189 | val_loss: 0.0311868 | Time: 1059.06 ms [2022-04-12 14:13:39 main:574] : INFO : Epoch 1744 | loss: 0.0311905 | val_loss: 0.0311868 | Time: 1101.94 ms [2022-04-12 14:13:40 main:574] : INFO : Epoch 1745 | loss: 0.0311885 | val_loss: 0.031188 | Time: 1058.96 ms [2022-04-12 14:13:41 main:574] : INFO : Epoch 1746 | loss: 0.03119 | val_loss: 0.0311903 | Time: 1077 ms [2022-04-12 14:13:42 main:574] : INFO : Epoch 1747 | loss: 0.0311937 | val_loss: 0.0311961 | Time: 1054.9 ms [2022-04-12 14:13:43 main:574] : INFO : Epoch 1748 | loss: 0.0311933 | val_loss: 0.031194 | Time: 1077.17 ms [2022-04-12 14:13:44 main:574] : INFO : Epoch 1749 | loss: 0.0311888 | val_loss: 0.0311865 | Time: 1074.68 ms [2022-04-12 14:13:45 main:574] : INFO : Epoch 1750 | loss: 0.0311884 | val_loss: 0.0311836 | Time: 1075.58 ms [2022-04-12 14:13:46 main:574] : INFO : Epoch 1751 | loss: 0.0311864 | val_loss: 0.0311843 | Time: 1071.48 ms [2022-04-12 14:13:47 main:574] : INFO : Epoch 1752 | loss: 0.0311898 | val_loss: 0.0311867 | Time: 1062.41 ms [2022-04-12 14:13:48 main:574] : INFO : Epoch 1753 | loss: 0.0311909 | val_loss: 0.0311854 | Time: 1088.82 ms [2022-04-12 14:13:50 main:574] : INFO : Epoch 1754 | loss: 0.0311872 | val_loss: 0.0311837 | Time: 1060.05 ms [2022-04-12 14:13:51 main:574] : INFO : Epoch 1755 | loss: 0.0311862 | val_loss: 0.0311838 | Time: 1119.79 ms [2022-04-12 14:13:52 main:574] : INFO : Epoch 1756 | loss: 0.0311861 | val_loss: 0.0311837 | Time: 1044.51 ms [2022-04-12 14:13:53 main:574] : INFO : Epoch 1757 | loss: 0.0311867 | val_loss: 0.0311834 | Time: 1100.62 ms [2022-04-12 14:13:54 main:574] : INFO : Epoch 1758 | loss: 0.0311843 | val_loss: 0.031184 | Time: 1049.76 ms [2022-04-12 14:13:55 main:574] : INFO : Epoch 1759 | loss: 0.0311834 | val_loss: 0.0311855 | Time: 1099.72 ms [2022-04-12 14:13:56 main:574] : INFO : Epoch 1760 | loss: 0.0311837 | val_loss: 0.0311842 | Time: 1056.01 ms [2022-04-12 14:13:57 main:574] : INFO : Epoch 1761 | loss: 0.0311827 | val_loss: 0.0311823 | Time: 1075.41 ms [2022-04-12 14:13:58 main:574] : INFO : Epoch 1762 | loss: 0.0311822 | val_loss: 0.0311823 | Time: 1067.43 ms [2022-04-12 14:13:59 main:574] : INFO : Epoch 1763 | loss: 0.0311826 | val_loss: 0.0311836 | Time: 1075.76 ms [2022-04-12 14:14:00 main:574] : INFO : Epoch 1764 | loss: 0.031183 | val_loss: 0.0311841 | Time: 1112.84 ms [2022-04-12 14:14:02 main:574] : INFO : Epoch 1765 | loss: 0.0311844 | val_loss: 0.0311829 | Time: 1104.32 ms [2022-04-12 14:14:03 main:574] : INFO : Epoch 1766 | loss: 0.0311827 | val_loss: 0.0311823 | Time: 1131.83 ms [2022-04-12 14:14:04 main:574] : INFO : Epoch 1767 | loss: 0.031182 | val_loss: 0.0311829 | Time: 1057.22 ms [2022-04-12 14:14:05 main:574] : INFO : Epoch 1768 | loss: 0.0311808 | val_loss: 0.0311821 | Time: 1098.05 ms [2022-04-12 14:14:06 main:574] : INFO : Epoch 1769 | loss: 0.03118 | val_loss: 0.0311803 | Time: 1043.84 ms [2022-04-12 14:14:07 main:574] : INFO : Epoch 1770 | loss: 0.0311797 | val_loss: 0.0311833 | Time: 1125.33 ms [2022-04-12 14:14:08 main:574] : INFO : Epoch 1771 | loss: 0.0311797 | val_loss: 0.0311795 | Time: 1061.69 ms [2022-04-12 14:14:09 main:574] : INFO : Epoch 1772 | loss: 0.0311787 | val_loss: 0.0311817 | Time: 1105.68 ms [2022-04-12 14:14:10 main:574] : INFO : Epoch 1773 | loss: 0.03118 | val_loss: 0.0311798 | Time: 1095.39 ms [2022-04-12 14:14:11 main:574] : INFO : Epoch 1774 | loss: 0.0311807 | val_loss: 0.0311805 | Time: 1074.28 ms [2022-04-12 14:14:12 main:574] : INFO : Epoch 1775 | loss: 0.0311808 | val_loss: 0.0311824 | Time: 1067.79 ms [2022-04-12 14:14:13 main:574] : INFO : Epoch 1776 | loss: 0.0311811 | val_loss: 0.0311808 | Time: 1069.8 ms [2022-04-12 14:14:15 main:574] : INFO : Epoch 1777 | loss: 0.0311818 | val_loss: 0.0311837 | Time: 1086.42 ms [2022-04-12 14:14:16 main:574] : INFO : Epoch 1778 | loss: 0.0311796 | val_loss: 0.0311808 | Time: 1064.51 ms [2022-04-12 14:14:17 main:574] : INFO : Epoch 1779 | loss: 0.0311787 | val_loss: 0.031181 | Time: 1088.04 ms [2022-04-12 14:14:18 main:574] : INFO : Epoch 1780 | loss: 0.0311779 | val_loss: 0.0311804 | Time: 1043.1 ms [2022-04-12 14:14:19 main:574] : INFO : Epoch 1781 | loss: 0.0311771 | val_loss: 0.0311786 | Time: 1125.2 ms [2022-04-12 14:14:20 main:574] : INFO : Epoch 1782 | loss: 0.0311765 | val_loss: 0.0311799 | Time: 1040.43 ms [2022-04-12 14:14:21 main:574] : INFO : Epoch 1783 | loss: 0.0311781 | val_loss: 0.0311797 | Time: 1103.69 ms [2022-04-12 14:14:22 main:574] : INFO : Epoch 1784 | loss: 0.0311797 | val_loss: 0.0311778 | Time: 1036.58 ms [2022-04-12 14:14:23 main:574] : INFO : Epoch 1785 | loss: 0.0311781 | val_loss: 0.0311778 | Time: 1099.58 ms [2022-04-12 14:14:24 main:574] : INFO : Epoch 1786 | loss: 0.0311771 | val_loss: 0.0311779 | Time: 1057.31 ms [2022-04-12 14:14:25 main:574] : INFO : Epoch 1787 | loss: 0.0311783 | val_loss: 0.0311764 | Time: 1095.16 ms [2022-04-12 14:14:26 main:574] : INFO : Epoch 1788 | loss: 0.0311781 | val_loss: 0.0311767 | Time: 1060.61 ms [2022-04-12 14:14:28 main:574] : INFO : Epoch 1789 | loss: 0.0311773 | val_loss: 0.0311752 | Time: 1117.42 ms [2022-04-12 14:14:29 main:574] : INFO : Epoch 1790 | loss: 0.0311762 | val_loss: 0.0311751 | Time: 1086.39 ms [2022-04-12 14:14:30 main:574] : INFO : Epoch 1791 | loss: 0.0311773 | val_loss: 0.0311784 | Time: 1077.52 ms [2022-04-12 14:14:31 main:574] : INFO : Epoch 1792 | loss: 0.0311774 | val_loss: 0.0311804 | Time: 1068.46 ms [2022-04-12 14:14:32 main:574] : INFO : Epoch 1793 | loss: 0.031177 | val_loss: 0.0311771 | Time: 1063.57 ms [2022-04-12 14:14:33 main:574] : INFO : Epoch 1794 | loss: 0.0311763 | val_loss: 0.031176 | Time: 1080.84 ms [2022-04-12 14:14:34 main:574] : INFO : Epoch 1795 | loss: 0.0311752 | val_loss: 0.0311745 | Time: 1045.5 ms [2022-04-12 14:14:35 main:574] : INFO : Epoch 1796 | loss: 0.0311738 | val_loss: 0.0311756 | Time: 1092.72 ms [2022-04-12 14:14:36 main:574] : INFO : Epoch 1797 | loss: 0.0311747 | val_loss: 0.0311741 | Time: 1032.4 ms [2022-04-12 14:14:37 main:574] : INFO : Epoch 1798 | loss: 0.0311761 | val_loss: 0.0311752 | Time: 1103.21 ms [2022-04-12 14:14:38 main:574] : INFO : Epoch 1799 | loss: 0.0311771 | val_loss: 0.0311784 | Time: 1047.2 ms [2022-04-12 14:14:39 main:574] : INFO : Epoch 1800 | loss: 0.0311775 | val_loss: 0.0311728 | Time: 1088.18 ms [2022-04-12 14:14:40 main:574] : INFO : Epoch 1801 | loss: 0.031175 | val_loss: 0.0311725 | Time: 1052.71 ms [2022-04-12 14:14:42 main:574] : INFO : Epoch 1802 | loss: 0.031175 | val_loss: 0.0311732 | Time: 1076.33 ms [2022-04-12 14:14:43 main:574] : INFO : Epoch 1803 | loss: 0.0311753 | val_loss: 0.031174 | Time: 1089.08 ms [2022-04-12 14:14:44 main:574] : INFO : Epoch 1804 | loss: 0.0311745 | val_loss: 0.0311719 | Time: 1172.24 ms [2022-04-12 14:14:45 main:574] : INFO : Epoch 1805 | loss: 0.0311749 | val_loss: 0.0311756 | Time: 1068.89 ms [2022-04-12 14:14:46 main:574] : INFO : Epoch 1806 | loss: 0.0311753 | val_loss: 0.0311736 | Time: 1064.46 ms [2022-04-12 14:14:47 main:574] : INFO : Epoch 1807 | loss: 0.0311753 | val_loss: 0.0311781 | Time: 1082.93 ms [2022-04-12 14:14:48 main:574] : INFO : Epoch 1808 | loss: 0.0311835 | val_loss: 0.0311882 | Time: 1052.49 ms [2022-04-12 14:14:49 main:574] : INFO : Epoch 1809 | loss: 0.0311914 | val_loss: 0.0311872 | Time: 1137.94 ms [2022-04-12 14:14:50 main:574] : INFO : Epoch 1810 | loss: 0.0311903 | val_loss: 0.0311809 | Time: 1041.96 ms [2022-04-12 14:14:51 main:574] : INFO : Epoch 1811 | loss: 0.0311851 | val_loss: 0.0311805 | Time: 1096.12 ms [2022-04-12 14:14:52 main:574] : INFO : Epoch 1812 | loss: 0.0311837 | val_loss: 0.031179 | Time: 1047.67 ms [2022-04-12 14:14:53 main:574] : INFO : Epoch 1813 | loss: 0.0311813 | val_loss: 0.0311784 | Time: 1106.38 ms [2022-04-12 14:14:55 main:574] : INFO : Epoch 1814 | loss: 0.0311806 | val_loss: 0.0311799 | Time: 1047.82 ms [2022-04-12 14:14:56 main:574] : INFO : Epoch 1815 | loss: 0.0311802 | val_loss: 0.0311826 | Time: 1082.42 ms [2022-04-12 14:14:57 main:574] : INFO : Epoch 1816 | loss: 0.0311836 | val_loss: 0.0311892 | Time: 1066.84 ms [2022-04-12 14:14:58 main:574] : INFO : Epoch 1817 | loss: 0.0311841 | val_loss: 0.0311846 | Time: 1075.37 ms [2022-04-12 14:14:59 main:574] : INFO : Epoch 1818 | loss: 0.0311844 | val_loss: 0.0311869 | Time: 1070.25 ms [2022-04-12 14:15:00 main:574] : INFO : Epoch 1819 | loss: 0.0311821 | val_loss: 0.0311818 | Time: 1091.77 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 2070) [2022-04-12 15:21:37 main:435] : INFO : Set logging level to 1 [2022-04-12 15:21:37 main:441] : INFO : Running in BOINC Client mode [2022-04-12 15:21:37 main:444] : INFO : Resolving all filenames [2022-04-12 15:21:37 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-12 15:21:37 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-12 15:21:37 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-12 15:21:37 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-12 15:21:37 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-12 15:21:37 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-12 15:21:37 main:474] : INFO : Configuration: [2022-04-12 15:21:37 main:475] : INFO : Model type: GRU [2022-04-12 15:21:37 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-12 15:21:37 main:477] : INFO : Max Epochs: 2048 [2022-04-12 15:21:37 main:478] : INFO : Batch Size: 128 [2022-04-12 15:21:37 main:479] : INFO : Learning Rate: 0.01 [2022-04-12 15:21:37 main:480] : INFO : Patience: 10 [2022-04-12 15:21:37 main:481] : INFO : Hidden Width: 12 [2022-04-12 15:21:37 main:482] : INFO : # Recurrent Layers: 4 [2022-04-12 15:21:37 main:483] : INFO : # Backend Layers: 4 [2022-04-12 15:21:37 main:484] : INFO : # Threads: 1 [2022-04-12 15:21:37 main:486] : INFO : Preparing Dataset [2022-04-12 15:21:37 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-12 15:21:37 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-12 15:21:39 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-12 15:21:39 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-12 15:21:39 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-12 15:21:39 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-12 15:21:39 main:494] : INFO : Creating Model [2022-04-12 15:21:39 main:507] : INFO : Preparing config file [2022-04-12 15:21:39 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-12 15:21:39 main:512] : INFO : Loading config [2022-04-12 15:21:39 main:514] : INFO : Loading state [2022-04-12 15:21:41 main:559] : INFO : Loading DataLoader into Memory [2022-04-12 15:21:41 main:562] : INFO : Starting Training [2022-04-12 15:21:43 main:574] : INFO : Epoch 1771 | loss: 0.0312616 | val_loss: 0.0312044 | Time: 1736.55 ms [2022-04-12 15:21:44 main:574] : INFO : Epoch 1772 | loss: 0.0311915 | val_loss: 0.0311862 | Time: 1199.06 ms [2022-04-12 15:21:45 main:574] : INFO : Epoch 1773 | loss: 0.0311839 | val_loss: 0.031184 | Time: 1167.71 ms [2022-04-12 15:21:46 main:574] : INFO : Epoch 1774 | loss: 0.0311815 | val_loss: 0.0311818 | Time: 1141.21 ms [2022-04-12 15:21:47 main:574] : INFO : Epoch 1775 | loss: 0.0311808 | val_loss: 0.0311817 | Time: 1150.95 ms [2022-04-12 15:21:48 main:574] : INFO : Epoch 1776 | loss: 0.0311807 | val_loss: 0.0311816 | Time: 1167.81 ms [2022-04-12 15:21:49 main:574] : INFO : Epoch 1777 | loss: 0.0311837 | val_loss: 0.0311828 | Time: 1110.94 ms [2022-04-12 15:21:51 main:574] : INFO : Epoch 1778 | loss: 0.0311846 | val_loss: 0.0311842 | Time: 1181.71 ms [2022-04-12 15:21:52 main:574] : INFO : Epoch 1779 | loss: 0.0311817 | val_loss: 0.0311829 | Time: 1109.16 ms [2022-04-12 15:21:53 main:574] : INFO : Epoch 1780 | loss: 0.0311796 | val_loss: 0.0311813 | Time: 1155.13 ms [2022-04-12 15:21:54 main:574] : INFO : Epoch 1781 | loss: 0.03118 | val_loss: 0.0311804 | Time: 1152.37 ms [2022-04-12 15:21:55 main:574] : INFO : Epoch 1782 | loss: 0.031181 | val_loss: 0.0311815 | Time: 1129.61 ms [2022-04-12 15:21:56 main:574] : INFO : Epoch 1783 | loss: 0.0311784 | val_loss: 0.0311809 | Time: 1166.69 ms [2022-04-12 15:21:58 main:574] : INFO : Epoch 1784 | loss: 0.0311799 | val_loss: 0.0311853 | Time: 1113.2 ms [2022-04-12 15:21:59 main:574] : INFO : Epoch 1785 | loss: 0.0311796 | val_loss: 0.0311831 | Time: 1181.95 ms [2022-04-12 15:22:00 main:574] : INFO : Epoch 1786 | loss: 0.0311769 | val_loss: 0.031181 | Time: 1121.99 ms [2022-04-12 15:22:01 main:574] : INFO : Epoch 1787 | loss: 0.0311768 | val_loss: 0.0311772 | Time: 1161.14 ms [2022-04-12 15:22:02 main:574] : INFO : Epoch 1788 | loss: 0.0311761 | val_loss: 0.0311779 | Time: 1121.34 ms [2022-04-12 15:22:03 main:574] : INFO : Epoch 1789 | loss: 0.0311751 | val_loss: 0.0311781 | Time: 1157.26 ms [2022-04-12 15:22:04 main:574] : INFO : Epoch 1790 | loss: 0.0311761 | val_loss: 0.0311806 | Time: 1159.46 ms [2022-04-12 15:22:06 main:574] : INFO : Epoch 1791 | loss: 0.0311761 | val_loss: 0.0311785 | Time: 1121.1 ms [2022-04-12 15:22:07 main:574] : INFO : Epoch 1792 | loss: 0.0311749 | val_loss: 0.0311782 | Time: 1174.15 ms [2022-04-12 15:22:08 main:574] : INFO : Epoch 1793 | loss: 0.0311785 | val_loss: 0.0311823 | Time: 1104.51 ms [2022-04-12 15:22:09 main:574] : INFO : Epoch 1794 | loss: 0.0311829 | val_loss: 0.0311828 | Time: 1184.5 ms [2022-04-12 15:22:10 main:574] : INFO : Epoch 1795 | loss: 0.0311817 | val_loss: 0.0311807 | Time: 1168.49 ms [2022-04-12 15:22:11 main:574] : INFO : Epoch 1796 | loss: 0.0311794 | val_loss: 0.0311802 | Time: 1147.35 ms [2022-04-12 15:22:13 main:574] : INFO : Epoch 1797 | loss: 0.0311801 | val_loss: 0.0311809 | Time: 1158.99 ms [2022-04-12 15:22:14 main:574] : INFO : Epoch 1798 | loss: 0.0311797 | val_loss: 0.0311808 | Time: 1130.32 ms [2022-04-12 15:22:15 main:574] : INFO : Epoch 1799 | loss: 0.031177 | val_loss: 0.0311795 | Time: 1183.4 ms [2022-04-12 15:22:16 main:574] : INFO : Epoch 1800 | loss: 0.0311765 | val_loss: 0.0311855 | Time: 1102.75 ms [2022-04-12 15:22:17 main:574] : INFO : Epoch 1801 | loss: 0.0311789 | val_loss: 0.0311801 | Time: 1151.28 ms [2022-04-12 15:22:18 main:574] : INFO : Epoch 1802 | loss: 0.0311765 | val_loss: 0.0311803 | Time: 1125.16 ms [2022-04-12 15:22:19 main:574] : INFO : Epoch 1803 | loss: 0.031176 | val_loss: 0.0311799 | Time: 1140.42 ms [2022-04-12 15:22:21 main:574] : INFO : Epoch 1804 | loss: 0.0311776 | val_loss: 0.0311791 | Time: 1134.45 ms [2022-04-12 15:22:22 main:574] : INFO : Epoch 1805 | loss: 0.0311774 | val_loss: 0.0311809 | Time: 1126.95 ms [2022-04-12 15:22:23 main:574] : INFO : Epoch 1806 | loss: 0.0311794 | val_loss: 0.0311774 | Time: 1159.93 ms [2022-04-12 15:22:24 main:574] : INFO : Epoch 1807 | loss: 0.0311792 | val_loss: 0.0311812 | Time: 1106.46 ms [2022-04-12 15:22:25 main:574] : INFO : Epoch 1808 | loss: 0.0311756 | val_loss: 0.0311789 | Time: 1168.18 ms [2022-04-12 15:22:26 main:574] : INFO : Epoch 1809 | loss: 0.0311745 | val_loss: 0.0311799 | Time: 1127.36 ms [2022-04-12 15:22:27 main:574] : INFO : Epoch 1810 | loss: 0.0311756 | val_loss: 0.031179 | Time: 1195.9 ms [2022-04-12 15:22:29 main:574] : INFO : Epoch 1811 | loss: 0.0311774 | val_loss: 0.0311809 | Time: 1143.99 ms [2022-04-12 15:22:30 main:574] : INFO : Epoch 1812 | loss: 0.0311767 | val_loss: 0.0311794 | Time: 1138.16 ms [2022-04-12 15:22:31 main:574] : INFO : Epoch 1813 | loss: 0.0311765 | val_loss: 0.0311785 | Time: 1151.6 ms [2022-04-12 15:22:32 main:574] : INFO : Epoch 1814 | loss: 0.0311755 | val_loss: 0.0311773 | Time: 1116 ms [2022-04-12 15:22:33 main:574] : INFO : Epoch 1815 | loss: 0.0311752 | val_loss: 0.0311772 | Time: 1176.66 ms [2022-04-12 15:22:34 main:574] : INFO : Epoch 1816 | loss: 0.0311781 | val_loss: 0.0311842 | Time: 1128.72 ms [2022-04-12 15:22:36 main:574] : INFO : Epoch 1817 | loss: 0.0311777 | val_loss: 0.0311795 | Time: 1202.77 ms [2022-04-12 15:22:37 main:574] : INFO : Epoch 1818 | loss: 0.0311768 | val_loss: 0.0311782 | Time: 1236.93 ms [2022-04-12 15:22:38 main:574] : INFO : Epoch 1819 | loss: 0.0311741 | val_loss: 0.0311767 | Time: 1476.49 ms [2022-04-12 15:22:39 main:574] : INFO : Epoch 1820 | loss: 0.0311744 | val_loss: 0.0311776 | Time: 1177.86 ms [2022-04-12 15:22:41 main:574] : INFO : Epoch 1821 | loss: 0.0311753 | val_loss: 0.0311757 | Time: 1207.32 ms [2022-04-12 15:22:42 main:574] : INFO : Epoch 1822 | loss: 0.0311758 | val_loss: 0.0311781 | Time: 1192.57 ms [2022-04-12 15:22:43 main:574] : INFO : Epoch 1823 | loss: 0.0311748 | val_loss: 0.0311857 | Time: 1197.21 ms [2022-04-12 15:22:44 main:574] : INFO : Epoch 1824 | loss: 0.031178 | val_loss: 0.0311787 | Time: 1115.02 ms [2022-04-12 15:22:45 main:574] : INFO : Epoch 1825 | loss: 0.0311738 | val_loss: 0.0311773 | Time: 1164.15 ms [2022-04-12 15:22:46 main:574] : INFO : Epoch 1826 | loss: 0.0311719 | val_loss: 0.0311763 | Time: 1131.83 ms [2022-04-12 15:22:48 main:574] : INFO : Epoch 1827 | loss: 0.0311712 | val_loss: 0.0311753 | Time: 1139.1 ms [2022-04-12 15:22:49 main:574] : INFO : Epoch 1828 | loss: 0.0311726 | val_loss: 0.0311749 | Time: 1154.96 ms [2022-04-12 15:22:50 main:574] : INFO : Epoch 1829 | loss: 0.0311732 | val_loss: 0.031175 | Time: 1127.65 ms [2022-04-12 15:22:51 main:574] : INFO : Epoch 1830 | loss: 0.0311737 | val_loss: 0.0311737 | Time: 1225.23 ms [2022-04-12 15:22:52 main:574] : INFO : Epoch 1831 | loss: 0.0311722 | val_loss: 0.0311743 | Time: 1099.23 ms [2022-04-12 15:22:53 main:574] : INFO : Epoch 1832 | loss: 0.0311721 | val_loss: 0.0311754 | Time: 1169.19 ms [2022-04-12 15:22:55 main:574] : INFO : Epoch 1833 | loss: 0.0311755 | val_loss: 0.0311775 | Time: 1137.75 ms [2022-04-12 15:22:56 main:574] : INFO : Epoch 1834 | loss: 0.0311754 | val_loss: 0.0311785 | Time: 1135.94 ms [2022-04-12 15:22:57 main:574] : INFO : Epoch 1835 | loss: 0.0311739 | val_loss: 0.0311748 | Time: 1147.03 ms [2022-04-12 15:22:58 main:574] : INFO : Epoch 1836 | loss: 0.0311708 | val_loss: 0.0311732 | Time: 1108.16 ms [2022-04-12 15:22:59 main:574] : INFO : Epoch 1837 | loss: 0.0311737 | val_loss: 0.0311772 | Time: 1163.87 ms [2022-04-12 15:23:00 main:574] : INFO : Epoch 1838 | loss: 0.0311741 | val_loss: 0.031177 | Time: 1106.41 ms [2022-04-12 15:23:01 main:574] : INFO : Epoch 1839 | loss: 0.0311716 | val_loss: 0.0311742 | Time: 1156.58 ms [2022-04-12 15:23:02 main:574] : INFO : Epoch 1840 | loss: 0.0311715 | val_loss: 0.0311758 | Time: 1121.74 ms [2022-04-12 15:23:04 main:574] : INFO : Epoch 1841 | loss: 0.0311715 | val_loss: 0.0311743 | Time: 1148.67 ms [2022-04-12 15:23:05 main:574] : INFO : Epoch 1842 | loss: 0.031174 | val_loss: 0.0311809 | Time: 1131.05 ms [2022-04-12 15:23:06 main:574] : INFO : Epoch 1843 | loss: 0.0311776 | val_loss: 0.0311765 | Time: 1139.08 ms [2022-04-12 15:23:07 main:574] : INFO : Epoch 1844 | loss: 0.031176 | val_loss: 0.0311767 | Time: 1150.73 ms [2022-04-12 15:23:08 main:574] : INFO : Epoch 1845 | loss: 0.0311746 | val_loss: 0.0311782 | Time: 1116.01 ms [2022-04-12 15:23:09 main:574] : INFO : Epoch 1846 | loss: 0.0311773 | val_loss: 0.0311845 | Time: 1185.8 ms [2022-04-12 15:23:11 main:574] : INFO : Epoch 1847 | loss: 0.0311753 | val_loss: 0.0311781 | Time: 1146.87 ms [2022-04-12 15:23:12 main:574] : INFO : Epoch 1848 | loss: 0.0311733 | val_loss: 0.0311772 | Time: 1144.47 ms [2022-04-12 15:23:13 main:574] : INFO : Epoch 1849 | loss: 0.0311742 | val_loss: 0.0311773 | Time: 1124.7 ms [2022-04-12 15:23:14 main:574] : INFO : Epoch 1850 | loss: 0.0311777 | val_loss: 0.0311783 | Time: 1130.71 ms [2022-04-12 15:23:15 main:574] : INFO : Epoch 1851 | loss: 0.0311799 | val_loss: 0.031177 | Time: 1148.38 ms [2022-04-12 15:23:16 main:574] : INFO : Epoch 1852 | loss: 0.0311782 | val_loss: 0.0311827 | Time: 1112.76 ms [2022-04-12 15:23:17 main:574] : INFO : Epoch 1853 | loss: 0.0311762 | val_loss: 0.031176 | Time: 1161.74 ms [2022-04-12 15:23:19 main:574] : INFO : Epoch 1854 | loss: 0.0311745 | val_loss: 0.0311794 | Time: 1126.86 ms [2022-04-12 15:23:20 main:574] : INFO : Epoch 1855 | loss: 0.031174 | val_loss: 0.0311787 | Time: 1151.22 ms [2022-04-12 15:23:21 main:574] : INFO : Epoch 1856 | loss: 0.0311781 | val_loss: 0.0311867 | Time: 1139.37 ms [2022-04-12 15:23:22 main:574] : INFO : Epoch 1857 | loss: 0.0311773 | val_loss: 0.0311767 | Time: 1135.72 ms [2022-04-12 15:23:23 main:574] : INFO : Epoch 1858 | loss: 0.0311732 | val_loss: 0.0311738 | Time: 1137.23 ms [2022-04-12 15:23:24 main:574] : INFO : Epoch 1859 | loss: 0.0311744 | val_loss: 0.031177 | Time: 1135.88 ms [2022-04-12 15:23:25 main:574] : INFO : Epoch 1860 | loss: 0.0311759 | val_loss: 0.0311805 | Time: 1151.68 ms [2022-04-12 15:23:26 main:574] : INFO : Epoch 1861 | loss: 0.0311778 | val_loss: 0.0311793 | Time: 1114.8 ms [2022-04-12 15:23:28 main:574] : INFO : Epoch 1862 | loss: 0.0311772 | val_loss: 0.031176 | Time: 1154.24 ms [2022-04-12 15:23:29 main:574] : INFO : Epoch 1863 | loss: 0.031177 | val_loss: 0.0311777 | Time: 1120.67 ms [2022-04-12 15:23:30 main:574] : INFO : Epoch 1864 | loss: 0.0311777 | val_loss: 0.0311803 | Time: 1150.98 ms [2022-04-12 15:23:31 main:574] : INFO : Epoch 1865 | loss: 0.0311758 | val_loss: 0.0311762 | Time: 1142.15 ms [2022-04-12 15:23:32 main:574] : INFO : Epoch 1866 | loss: 0.0311756 | val_loss: 0.0311777 | Time: 1124.42 ms [2022-04-12 15:23:33 main:574] : INFO : Epoch 1867 | loss: 0.031173 | val_loss: 0.0311754 | Time: 1166 ms [2022-04-12 15:23:35 main:574] : INFO : Epoch 1868 | loss: 0.0311723 | val_loss: 0.0311751 | Time: 1119.98 ms [2022-04-12 15:23:36 main:574] : INFO : Epoch 1869 | loss: 0.0311718 | val_loss: 0.0311747 | Time: 1160.13 ms [2022-04-12 15:23:37 main:574] : INFO : Epoch 1870 | loss: 0.0311727 | val_loss: 0.0311752 | Time: 1110.76 ms [2022-04-12 15:23:38 main:574] : INFO : Epoch 1871 | loss: 0.031172 | val_loss: 0.0311733 | Time: 1141.03 ms [2022-04-12 15:23:39 main:574] : INFO : Epoch 1872 | loss: 0.0311722 | val_loss: 0.0311735 | Time: 1246.46 ms [2022-04-12 15:23:40 main:574] : INFO : Epoch 1873 | loss: 0.0311754 | val_loss: 0.0311733 | Time: 1102.79 ms [2022-04-12 15:23:41 main:574] : INFO : Epoch 1874 | loss: 0.0311726 | val_loss: 0.0311742 | Time: 1152.26 ms [2022-04-12 15:23:43 main:574] : INFO : Epoch 1875 | loss: 0.0311726 | val_loss: 0.0311723 | Time: 1110.8 ms [2022-04-12 15:23:44 main:574] : INFO : Epoch 1876 | loss: 0.0311724 | val_loss: 0.0311734 | Time: 1160.22 ms [2022-04-12 15:23:45 main:574] : INFO : Epoch 1877 | loss: 0.0311725 | val_loss: 0.0311709 | Time: 1118.25 ms [2022-04-12 15:23:46 main:574] : INFO : Epoch 1878 | loss: 0.0311719 | val_loss: 0.0311717 | Time: 1125.76 ms [2022-04-12 15:23:47 main:574] : INFO : Epoch 1879 | loss: 0.0311716 | val_loss: 0.0311715 | Time: 1124.4 ms [2022-04-12 15:23:48 main:574] : INFO : Epoch 1880 | loss: 0.0311714 | val_loss: 0.0311722 | Time: 1130.24 ms [2022-04-12 15:23:49 main:574] : INFO : Epoch 1881 | loss: 0.0311707 | val_loss: 0.0311727 | Time: 1143.86 ms [2022-04-12 15:23:51 main:574] : INFO : Epoch 1882 | loss: 0.0311709 | val_loss: 0.0311737 | Time: 1104.91 ms [2022-04-12 15:23:52 main:574] : INFO : Epoch 1883 | loss: 0.0311701 | val_loss: 0.0311731 | Time: 1168.5 ms [2022-04-12 15:23:53 main:574] : INFO : Epoch 1884 | loss: 0.0311712 | val_loss: 0.031171 | Time: 1087.21 ms [2022-04-12 15:23:54 main:574] : INFO : Epoch 1885 | loss: 0.0311693 | val_loss: 0.0311728 | Time: 1166.61 ms [2022-04-12 15:23:55 main:574] : INFO : Epoch 1886 | loss: 0.0311695 | val_loss: 0.0311738 | Time: 1106.97 ms [2022-04-12 15:23:56 main:574] : INFO : Epoch 1887 | loss: 0.0311726 | val_loss: 0.0311768 | Time: 1136.84 ms [2022-04-12 15:23:57 main:574] : INFO : Epoch 1888 | loss: 0.0311814 | val_loss: 0.0311823 | Time: 1131.78 ms [2022-04-12 15:23:58 main:574] : INFO : Epoch 1889 | loss: 0.0311794 | val_loss: 0.0311758 | Time: 1109.17 ms [2022-04-12 15:24:00 main:574] : INFO : Epoch 1890 | loss: 0.0311773 | val_loss: 0.0311784 | Time: 1165.76 ms [2022-04-12 15:24:01 main:574] : INFO : Epoch 1891 | loss: 0.0311773 | val_loss: 0.0311746 | Time: 1105.9 ms [2022-04-12 15:24:02 main:574] : INFO : Epoch 1892 | loss: 0.0311761 | val_loss: 0.0311753 | Time: 1170.5 ms [2022-04-12 15:24:03 main:574] : INFO : Epoch 1893 | loss: 0.0311754 | val_loss: 0.0311746 | Time: 1105.63 ms [2022-04-12 15:24:04 main:574] : INFO : Epoch 1894 | loss: 0.0311769 | val_loss: 0.0311753 | Time: 1134.9 ms [2022-04-12 15:24:05 main:574] : INFO : Epoch 1895 | loss: 0.0311783 | val_loss: 0.0311745 | Time: 1113.07 ms [2022-04-12 15:24:06 main:574] : INFO : Epoch 1896 | loss: 0.0311777 | val_loss: 0.0311752 | Time: 1134.05 ms [2022-04-12 15:24:08 main:574] : INFO : Epoch 1897 | loss: 0.0311777 | val_loss: 0.0311733 | Time: 1150.48 ms [2022-04-12 15:24:09 main:574] : INFO : Epoch 1898 | loss: 0.0311756 | val_loss: 0.0311749 | Time: 1114.71 ms [2022-04-12 15:24:10 main:574] : INFO : Epoch 1899 | loss: 0.0311746 | val_loss: 0.0311738 | Time: 1146.84 ms [2022-04-12 15:24:11 main:574] : INFO : Epoch 1900 | loss: 0.0311761 | val_loss: 0.0311793 | Time: 1142.61 ms [2022-04-12 15:24:12 main:574] : INFO : Epoch 1901 | loss: 0.0311765 | val_loss: 0.0311739 | Time: 1142.51 ms [2022-04-12 15:24:13 main:574] : INFO : Epoch 1902 | loss: 0.0311729 | val_loss: 0.0311741 | Time: 1124.36 ms [2022-04-12 15:24:14 main:574] : INFO : Epoch 1903 | loss: 0.0311728 | val_loss: 0.0311731 | Time: 1129.59 ms [2022-04-12 15:24:15 main:574] : INFO : Epoch 1904 | loss: 0.0311716 | val_loss: 0.0311739 | Time: 1136.45 ms [2022-04-12 15:24:17 main:574] : INFO : Epoch 1905 | loss: 0.0311721 | val_loss: 0.031175 | Time: 1108.33 ms [2022-04-12 15:24:18 main:574] : INFO : Epoch 1906 | loss: 0.0311751 | val_loss: 0.0311761 | Time: 1148.8 ms [2022-04-12 15:24:19 main:574] : INFO : Epoch 1907 | loss: 0.031173 | val_loss: 0.0311727 | Time: 1099.61 ms [2022-04-12 15:24:20 main:574] : INFO : Epoch 1908 | loss: 0.0311724 | val_loss: 0.0311746 | Time: 1144.74 ms [2022-04-12 15:24:21 main:574] : INFO : Epoch 1909 | loss: 0.0311725 | val_loss: 0.0311744 | Time: 1109.58 ms [2022-04-12 15:24:22 main:574] : INFO : Epoch 1910 | loss: 0.031173 | val_loss: 0.031175 | Time: 1127.81 ms [2022-04-12 15:24:23 main:574] : INFO : Epoch 1911 | loss: 0.031172 | val_loss: 0.0311772 | Time: 1121.19 ms [2022-04-12 15:24:24 main:574] : INFO : Epoch 1912 | loss: 0.0311835 | val_loss: 0.0311826 | Time: 1125.06 ms [2022-04-12 15:24:26 main:574] : INFO : Epoch 1913 | loss: 0.0311839 | val_loss: 0.0311843 | Time: 1118.63 ms [2022-04-12 15:24:27 main:574] : INFO : Epoch 1914 | loss: 0.0311871 | val_loss: 0.0311858 | Time: 1106.81 ms [2022-04-12 15:24:28 main:574] : INFO : Epoch 1915 | loss: 0.0311868 | val_loss: 0.0311892 | Time: 1153.25 ms [2022-04-12 15:24:29 main:574] : INFO : Epoch 1916 | loss: 0.0311868 | val_loss: 0.0311825 | Time: 1089.79 ms [2022-04-12 15:24:30 main:574] : INFO : Epoch 1917 | loss: 0.0311836 | val_loss: 0.0311855 | Time: 1159.21 ms [2022-04-12 15:24:31 main:574] : INFO : Epoch 1918 | loss: 0.0311819 | val_loss: 0.0311832 | Time: 1106 ms [2022-04-12 15:24:32 main:574] : INFO : Epoch 1919 | loss: 0.031181 | val_loss: 0.0311836 | Time: 1123.71 ms [2022-04-12 15:24:34 main:574] : INFO : Epoch 1920 | loss: 0.0311804 | val_loss: 0.0311837 | Time: 1131 ms [2022-04-12 15:24:35 main:574] : INFO : Epoch 1921 | loss: 0.0311798 | val_loss: 0.0311835 | Time: 1106.6 ms [2022-04-12 15:24:36 main:574] : INFO : Epoch 1922 | loss: 0.0311791 | val_loss: 0.0311795 | Time: 1136.6 ms [2022-04-12 15:24:37 main:574] : INFO : Epoch 1923 | loss: 0.0311777 | val_loss: 0.031179 | Time: 1089.38 ms [2022-04-12 15:24:38 main:574] : INFO : Epoch 1924 | loss: 0.0311777 | val_loss: 0.0311794 | Time: 1147.16 ms [2022-04-12 15:24:39 main:574] : INFO : Epoch 1925 | loss: 0.0311774 | val_loss: 0.031179 | Time: 1105.19 ms [2022-04-12 15:24:40 main:574] : INFO : Epoch 1926 | loss: 0.0311766 | val_loss: 0.0311787 | Time: 1149.08 ms [2022-04-12 15:24:41 main:574] : INFO : Epoch 1927 | loss: 0.0311769 | val_loss: 0.0311792 | Time: 1116.34 ms [2022-04-12 15:24:43 main:574] : INFO : Epoch 1928 | loss: 0.0311791 | val_loss: 0.0311795 | Time: 1135.22 ms [2022-04-12 15:24:44 main:574] : INFO : Epoch 1929 | loss: 0.0311823 | val_loss: 0.0311835 | Time: 1171.05 ms [2022-04-12 15:24:45 main:574] : INFO : Epoch 1930 | loss: 0.0311849 | val_loss: 0.0311817 | Time: 1163.22 ms [2022-04-12 15:24:46 main:574] : INFO : Epoch 1931 | loss: 0.0311836 | val_loss: 0.0311829 | Time: 1169.65 ms [2022-04-12 15:24:47 main:574] : INFO : Epoch 1932 | loss: 0.031184 | val_loss: 0.0311836 | Time: 1090.06 ms [2022-04-12 15:24:48 main:574] : INFO : Epoch 1933 | loss: 0.0311824 | val_loss: 0.0311828 | Time: 1151.95 ms [2022-04-12 15:24:49 main:574] : INFO : Epoch 1934 | loss: 0.0311805 | val_loss: 0.031182 | Time: 1101.43 ms [2022-04-12 15:24:51 main:574] : INFO : Epoch 1935 | loss: 0.0311799 | val_loss: 0.0311814 | Time: 1136.74 ms [2022-04-12 15:24:52 main:574] : INFO : Epoch 1936 | loss: 0.0311806 | val_loss: 0.0311812 | Time: 1119.02 ms [2022-04-12 15:24:53 main:574] : INFO : Epoch 1937 | loss: 0.0311813 | val_loss: 0.0311828 | Time: 1115.97 ms [2022-04-12 15:24:54 main:574] : INFO : Epoch 1938 | loss: 0.0311808 | val_loss: 0.0311842 | Time: 1156.83 ms [2022-04-12 15:24:55 main:574] : INFO : Epoch 1939 | loss: 0.0311817 | val_loss: 0.031182 | Time: 1096.15 ms [2022-04-12 15:24:56 main:574] : INFO : Epoch 1940 | loss: 0.0311822 | val_loss: 0.0311842 | Time: 1162.34 ms [2022-04-12 15:24:57 main:574] : INFO : Epoch 1941 | loss: 0.0311863 | val_loss: 0.0311841 | Time: 1121.34 ms [2022-04-12 15:24:58 main:574] : INFO : Epoch 1942 | loss: 0.031187 | val_loss: 0.0311842 | Time: 1143.98 ms [2022-04-12 15:25:00 main:574] : INFO : Epoch 1943 | loss: 0.0311848 | val_loss: 0.0311843 | Time: 1126.76 ms [2022-04-12 15:25:01 main:574] : INFO : Epoch 1944 | loss: 0.031185 | val_loss: 0.031188 | Time: 1128.45 ms [2022-04-12 15:25:02 main:574] : INFO : Epoch 1945 | loss: 0.0311864 | val_loss: 0.0311856 | Time: 1130.87 ms [2022-04-12 15:25:03 main:574] : INFO : Epoch 1946 | loss: 0.0311834 | val_loss: 0.0311837 | Time: 1118.53 ms [2022-04-12 15:25:04 main:574] : INFO : Epoch 1947 | loss: 0.0311826 | val_loss: 0.031183 | Time: 1141.46 ms [2022-04-12 15:25:05 main:574] : INFO : Epoch 1948 | loss: 0.0311841 | val_loss: 0.0311855 | Time: 1085.04 ms [2022-04-12 15:25:06 main:574] : INFO : Epoch 1949 | loss: 0.0311827 | val_loss: 0.0311837 | Time: 1149.83 ms [2022-04-12 15:25:07 main:574] : INFO : Epoch 1950 | loss: 0.031182 | val_loss: 0.0311853 | Time: 1097.45 ms [2022-04-12 15:25:09 main:574] : INFO : Epoch 1951 | loss: 0.0311826 | val_loss: 0.031185 | Time: 1137.09 ms [2022-04-12 15:25:10 main:574] : INFO : Epoch 1952 | loss: 0.031183 | val_loss: 0.0311875 | Time: 1115.02 ms [2022-04-12 15:25:11 main:574] : INFO : Epoch 1953 | loss: 0.0311847 | val_loss: 0.0311892 | Time: 1161.64 ms [2022-04-12 15:25:12 main:574] : INFO : Epoch 1954 | loss: 0.0311823 | val_loss: 0.0311848 | Time: 1136.6 ms [2022-04-12 15:25:13 main:574] : INFO : Epoch 1955 | loss: 0.0311817 | val_loss: 0.031187 | Time: 1104.84 ms [2022-04-12 15:25:14 main:574] : INFO : Epoch 1956 | loss: 0.0311812 | val_loss: 0.0311843 | Time: 1160.01 ms [2022-04-12 15:25:15 main:574] : INFO : Epoch 1957 | loss: 0.0311821 | val_loss: 0.0311843 | Time: 1108.91 ms [2022-04-12 15:25:17 main:574] : INFO : Epoch 1958 | loss: 0.0311813 | val_loss: 0.031183 | Time: 1146.31 ms [2022-04-12 15:25:18 main:574] : INFO : Epoch 1959 | loss: 0.0311793 | val_loss: 0.0311839 | Time: 1118.69 ms [2022-04-12 15:25:19 main:574] : INFO : Epoch 1960 | loss: 0.0311795 | val_loss: 0.0311837 | Time: 1134.53 ms [2022-04-12 15:25:20 main:574] : INFO : Epoch 1961 | loss: 0.0311788 | val_loss: 0.0311831 | Time: 1121.98 ms [2022-04-12 15:25:21 main:574] : INFO : Epoch 1962 | loss: 0.0311784 | val_loss: 0.031185 | Time: 1115.57 ms [2022-04-12 15:25:22 main:574] : INFO : Epoch 1963 | loss: 0.0311794 | val_loss: 0.0311873 | Time: 1163.52 ms [2022-04-12 15:25:23 main:574] : INFO : Epoch 1964 | loss: 0.0311826 | val_loss: 0.0311844 | Time: 1109.37 ms [2022-04-12 15:25:25 main:574] : INFO : Epoch 1965 | loss: 0.0311785 | val_loss: 0.0311841 | Time: 1156.5 ms [2022-04-12 15:25:26 main:574] : INFO : Epoch 1966 | loss: 0.0311783 | val_loss: 0.0311833 | Time: 1100.18 ms [2022-04-12 15:25:27 main:574] : INFO : Epoch 1967 | loss: 0.0311797 | val_loss: 0.0311833 | Time: 1136.17 ms [2022-04-12 15:25:28 main:574] : INFO : Epoch 1968 | loss: 0.0311784 | val_loss: 0.0311829 | Time: 1328.06 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 2070) [2022-04-12 18:16:48 main:435] : INFO : Set logging level to 1 [2022-04-12 18:16:48 main:441] : INFO : Running in BOINC Client mode [2022-04-12 18:16:48 main:444] : INFO : Resolving all filenames [2022-04-12 18:16:48 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-12 18:16:48 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-12 18:16:48 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-12 18:16:48 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-12 18:16:48 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-12 18:16:48 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-12 18:16:48 main:474] : INFO : Configuration: [2022-04-12 18:16:48 main:475] : INFO : Model type: GRU [2022-04-12 18:16:48 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-12 18:16:48 main:477] : INFO : Max Epochs: 2048 [2022-04-12 18:16:48 main:478] : INFO : Batch Size: 128 [2022-04-12 18:16:48 main:479] : INFO : Learning Rate: 0.01 [2022-04-12 18:16:48 main:480] : INFO : Patience: 10 [2022-04-12 18:16:48 main:481] : INFO : Hidden Width: 12 [2022-04-12 18:16:48 main:482] : INFO : # Recurrent Layers: 4 [2022-04-12 18:16:48 main:483] : INFO : # Backend Layers: 4 [2022-04-12 18:16:48 main:484] : INFO : # Threads: 1 [2022-04-12 18:16:48 main:486] : INFO : Preparing Dataset [2022-04-12 18:16:48 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-12 18:16:48 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-12 18:16:50 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-12 18:16:50 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-12 18:16:50 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-12 18:16:50 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-12 18:16:50 main:494] : INFO : Creating Model [2022-04-12 18:16:50 main:507] : INFO : Preparing config file [2022-04-12 18:16:50 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-12 18:16:50 main:512] : INFO : Loading config [2022-04-12 18:16:50 main:514] : INFO : Loading state [2022-04-12 18:16:51 main:559] : INFO : Loading DataLoader into Memory [2022-04-12 18:16:51 main:562] : INFO : Starting Training [2022-04-12 18:16:53 main:574] : INFO : Epoch 1937 | loss: 0.0312105 | val_loss: 0.0311873 | Time: 1649.1 ms [2022-04-12 18:16:54 main:574] : INFO : Epoch 1938 | loss: 0.0311837 | val_loss: 0.0311832 | Time: 1138.15 ms [2022-04-12 18:16:55 main:574] : INFO : Epoch 1939 | loss: 0.0311804 | val_loss: 0.0311812 | Time: 1146.41 ms [2022-04-12 18:16:56 main:574] : INFO : Epoch 1940 | loss: 0.0311794 | val_loss: 0.0311822 | Time: 1133.94 ms [2022-04-12 18:16:58 main:574] : INFO : Epoch 1941 | loss: 0.0311781 | val_loss: 0.0311812 | Time: 1098.67 ms [2022-04-12 18:16:59 main:574] : INFO : Epoch 1942 | loss: 0.0311773 | val_loss: 0.0311807 | Time: 1128.1 ms [2022-04-12 18:17:00 main:574] : INFO : Epoch 1943 | loss: 0.0311761 | val_loss: 0.0311808 | Time: 1078.9 ms [2022-04-12 18:17:01 main:574] : INFO : Epoch 1944 | loss: 0.0311753 | val_loss: 0.0311796 | Time: 1131.74 ms [2022-04-12 18:17:02 main:574] : INFO : Epoch 1945 | loss: 0.0311768 | val_loss: 0.031179 | Time: 1079.32 ms [2022-04-12 18:17:03 main:574] : INFO : Epoch 1946 | loss: 0.0311758 | val_loss: 0.031177 | Time: 1115.84 ms [2022-04-12 18:17:04 main:574] : INFO : Epoch 1947 | loss: 0.0311766 | val_loss: 0.0311773 | Time: 1102.27 ms [2022-04-12 18:17:05 main:574] : INFO : Epoch 1948 | loss: 0.0311756 | val_loss: 0.0311767 | Time: 1108 ms [2022-04-12 18:17:06 main:574] : INFO : Epoch 1949 | loss: 0.0311745 | val_loss: 0.0311767 | Time: 1112.26 ms [2022-04-12 18:17:08 main:574] : INFO : Epoch 1950 | loss: 0.0311735 | val_loss: 0.0311773 | Time: 1100.92 ms [2022-04-12 18:17:09 main:574] : INFO : Epoch 1951 | loss: 0.031174 | val_loss: 0.031178 | Time: 1126.45 ms [2022-04-12 18:17:10 main:574] : INFO : Epoch 1952 | loss: 0.0311743 | val_loss: 0.0311764 | Time: 1089.67 ms [2022-04-12 18:17:11 main:574] : INFO : Epoch 1953 | loss: 0.0311719 | val_loss: 0.0311761 | Time: 1124.06 ms [2022-04-12 18:17:12 main:574] : INFO : Epoch 1954 | loss: 0.0311728 | val_loss: 0.0311769 | Time: 1079.32 ms [2022-04-12 18:17:13 main:574] : INFO : Epoch 1955 | loss: 0.0311728 | val_loss: 0.0311754 | Time: 1130.84 ms [2022-04-12 18:17:14 main:574] : INFO : Epoch 1956 | loss: 0.0311714 | val_loss: 0.0311786 | Time: 1096.84 ms [2022-04-12 18:17:15 main:574] : INFO : Epoch 1957 | loss: 0.0311738 | val_loss: 0.0311806 | Time: 1112.5 ms [2022-04-12 18:17:16 main:574] : INFO : Epoch 1958 | loss: 0.0311743 | val_loss: 0.0311757 | Time: 1106.66 ms [2022-04-12 18:17:18 main:574] : INFO : Epoch 1959 | loss: 0.0311757 | val_loss: 0.0311783 | Time: 1103.75 ms [2022-04-12 18:17:19 main:574] : INFO : Epoch 1960 | loss: 0.0311744 | val_loss: 0.0311762 | Time: 1125.77 ms [2022-04-12 18:17:20 main:574] : INFO : Epoch 1961 | loss: 0.0311744 | val_loss: 0.0311761 | Time: 1087.78 ms [2022-04-12 18:17:21 main:574] : INFO : Epoch 1962 | loss: 0.031174 | val_loss: 0.0311745 | Time: 1135.55 ms [2022-04-12 18:17:22 main:574] : INFO : Epoch 1963 | loss: 0.0311746 | val_loss: 0.031176 | Time: 1083.5 ms [2022-04-12 18:17:23 main:574] : INFO : Epoch 1964 | loss: 0.031175 | val_loss: 0.0311786 | Time: 1123.5 ms [2022-04-12 18:17:24 main:574] : INFO : Epoch 1965 | loss: 0.031175 | val_loss: 0.0311765 | Time: 1084.18 ms [2022-04-12 18:17:25 main:574] : INFO : Epoch 1966 | loss: 0.0311728 | val_loss: 0.0311756 | Time: 1114.23 ms [2022-04-12 18:17:26 main:574] : INFO : Epoch 1967 | loss: 0.0311721 | val_loss: 0.0311758 | Time: 1094.12 ms [2022-04-12 18:17:28 main:574] : INFO : Epoch 1968 | loss: 0.0311723 | val_loss: 0.0311769 | Time: 1101.65 ms [2022-04-12 18:17:29 main:574] : INFO : Epoch 1969 | loss: 0.0311749 | val_loss: 0.0311739 | Time: 1111.4 ms [2022-04-12 18:17:30 main:574] : INFO : Epoch 1970 | loss: 0.0311745 | val_loss: 0.0311738 | Time: 1091.6 ms [2022-04-12 18:17:31 main:574] : INFO : Epoch 1971 | loss: 0.031174 | val_loss: 0.0311734 | Time: 1120.68 ms [2022-04-12 18:17:32 main:574] : INFO : Epoch 1972 | loss: 0.0311728 | val_loss: 0.0311761 | Time: 1082.83 ms [2022-04-12 18:17:33 main:574] : INFO : Epoch 1973 | loss: 0.0311723 | val_loss: 0.0311739 | Time: 1130.41 ms [2022-04-12 18:17:34 main:574] : INFO : Epoch 1974 | loss: 0.0311716 | val_loss: 0.0311741 | Time: 1082.94 ms [2022-04-12 18:17:35 main:574] : INFO : Epoch 1975 | loss: 0.0311722 | val_loss: 0.0311751 | Time: 1123.29 ms [2022-04-12 18:17:36 main:574] : INFO : Epoch 1976 | loss: 0.0311739 | val_loss: 0.0311796 | Time: 1110.15 ms [2022-04-12 18:17:38 main:574] : INFO : Epoch 1977 | loss: 0.0311719 | val_loss: 0.0311731 | Time: 1108.71 ms [2022-04-12 18:17:39 main:574] : INFO : Epoch 1978 | loss: 0.0311714 | val_loss: 0.0311755 | Time: 1116.79 ms [2022-04-12 18:17:40 main:574] : INFO : Epoch 1979 | loss: 0.031171 | val_loss: 0.0311738 | Time: 1097.91 ms [2022-04-12 18:17:41 main:574] : INFO : Epoch 1980 | loss: 0.0311744 | val_loss: 0.0311733 | Time: 1110.85 ms [2022-04-12 18:17:42 main:574] : INFO : Epoch 1981 | loss: 0.0311743 | val_loss: 0.0311731 | Time: 1090.62 ms [2022-04-12 18:17:43 main:574] : INFO : Epoch 1982 | loss: 0.0311698 | val_loss: 0.0311759 | Time: 1140.16 ms [2022-04-12 18:17:44 main:574] : INFO : Epoch 1983 | loss: 0.0311697 | val_loss: 0.031174 | Time: 1077.42 ms [2022-04-12 18:17:45 main:574] : INFO : Epoch 1984 | loss: 0.0311695 | val_loss: 0.0311733 | Time: 1131.67 ms [2022-04-12 18:17:46 main:574] : INFO : Epoch 1985 | loss: 0.0311696 | val_loss: 0.0311733 | Time: 1090.93 ms [2022-04-12 18:17:48 main:574] : INFO : Epoch 1986 | loss: 0.0311691 | val_loss: 0.0311733 | Time: 1117.5 ms [2022-04-12 18:17:49 main:574] : INFO : Epoch 1987 | loss: 0.0311693 | val_loss: 0.0311725 | Time: 1233.1 ms [2022-04-12 18:17:50 main:574] : INFO : Epoch 1988 | loss: 0.0311706 | val_loss: 0.031174 | Time: 1176.21 ms [2022-04-12 18:17:51 main:574] : INFO : Epoch 1989 | loss: 0.0311716 | val_loss: 0.0311739 | Time: 1123.85 ms [2022-04-12 18:17:52 main:574] : INFO : Epoch 1990 | loss: 0.0311718 | val_loss: 0.0311736 | Time: 1076.11 ms [2022-04-12 18:17:53 main:574] : INFO : Epoch 1991 | loss: 0.0311709 | val_loss: 0.0311746 | Time: 1142.02 ms [2022-04-12 18:17:54 main:574] : INFO : Epoch 1992 | loss: 0.0311708 | val_loss: 0.031173 | Time: 1104.61 ms [2022-04-12 18:17:56 main:574] : INFO : Epoch 1993 | loss: 0.0311702 | val_loss: 0.0311734 | Time: 1202.12 ms [2022-04-12 18:17:57 main:574] : INFO : Epoch 1994 | loss: 0.03117 | val_loss: 0.0311737 | Time: 1109.37 ms [2022-04-12 18:17:58 main:574] : INFO : Epoch 1995 | loss: 0.0311694 | val_loss: 0.031173 | Time: 1108.2 ms [2022-04-12 18:17:59 main:574] : INFO : Epoch 1996 | loss: 0.0311685 | val_loss: 0.0311716 | Time: 1167.68 ms [2022-04-12 18:18:00 main:574] : INFO : Epoch 1997 | loss: 0.031171 | val_loss: 0.031177 | Time: 1108.35 ms [2022-04-12 18:18:01 main:574] : INFO : Epoch 1998 | loss: 0.0311748 | val_loss: 0.0311774 | Time: 1140.12 ms [2022-04-12 18:18:02 main:574] : INFO : Epoch 1999 | loss: 0.0311713 | val_loss: 0.0311746 | Time: 1082.59 ms [2022-04-12 18:18:04 main:574] : INFO : Epoch 2000 | loss: 0.0311705 | val_loss: 0.031174 | Time: 1146.2 ms [2022-04-12 18:18:05 main:574] : INFO : Epoch 2001 | loss: 0.0311714 | val_loss: 0.0311753 | Time: 1083.94 ms [2022-04-12 18:18:06 main:574] : INFO : Epoch 2002 | loss: 0.0311704 | val_loss: 0.0311743 | Time: 1113.77 ms [2022-04-12 18:18:07 main:574] : INFO : Epoch 2003 | loss: 0.0311706 | val_loss: 0.0311742 | Time: 1109.09 ms [2022-04-12 18:18:08 main:574] : INFO : Epoch 2004 | loss: 0.0311708 | val_loss: 0.0311749 | Time: 1100.38 ms [2022-04-12 18:18:09 main:574] : INFO : Epoch 2005 | loss: 0.0311701 | val_loss: 0.031173 | Time: 1115.7 ms [2022-04-12 18:18:10 main:574] : INFO : Epoch 2006 | loss: 0.0311689 | val_loss: 0.031172 | Time: 1100.63 ms [2022-04-12 18:18:11 main:574] : INFO : Epoch 2007 | loss: 0.0311694 | val_loss: 0.0311718 | Time: 1127.8 ms [2022-04-12 18:18:12 main:574] : INFO : Epoch 2008 | loss: 0.0311673 | val_loss: 0.0311734 | Time: 1087.03 ms [2022-04-12 18:18:14 main:574] : INFO : Epoch 2009 | loss: 0.0311679 | val_loss: 0.0311715 | Time: 1140.91 ms [2022-04-12 18:18:15 main:574] : INFO : Epoch 2010 | loss: 0.0311722 | val_loss: 0.0311789 | Time: 1083.29 ms [2022-04-12 18:18:16 main:574] : INFO : Epoch 2011 | loss: 0.03118 | val_loss: 0.0311789 | Time: 1120.82 ms [2022-04-12 18:18:17 main:574] : INFO : Epoch 2012 | loss: 0.031179 | val_loss: 0.0311783 | Time: 1101.58 ms [2022-04-12 18:18:18 main:574] : INFO : Epoch 2013 | loss: 0.03118 | val_loss: 0.0311841 | Time: 1120.4 ms [2022-04-12 18:18:19 main:574] : INFO : Epoch 2014 | loss: 0.0311804 | val_loss: 0.0311774 | Time: 1112.18 ms [2022-04-12 18:18:20 main:574] : INFO : Epoch 2015 | loss: 0.0311796 | val_loss: 0.0311784 | Time: 1095.97 ms [2022-04-12 18:18:21 main:574] : INFO : Epoch 2016 | loss: 0.0311789 | val_loss: 0.0311763 | Time: 1118.48 ms [2022-04-12 18:18:22 main:574] : INFO : Epoch 2017 | loss: 0.0311818 | val_loss: 0.0311836 | Time: 1093.84 ms [2022-04-12 18:18:24 main:574] : INFO : Epoch 2018 | loss: 0.0311845 | val_loss: 0.0311849 | Time: 1135.67 ms [2022-04-12 18:18:25 main:574] : INFO : Epoch 2019 | loss: 0.0311857 | val_loss: 0.0311837 | Time: 1088.44 ms [2022-04-12 18:18:26 main:574] : INFO : Epoch 2020 | loss: 0.031186 | val_loss: 0.0311847 | Time: 1124.77 ms [2022-04-12 18:18:27 main:574] : INFO : Epoch 2021 | loss: 0.0311866 | val_loss: 0.0311825 | Time: 1092.62 ms [2022-04-12 18:18:28 main:574] : INFO : Epoch 2022 | loss: 0.0311879 | val_loss: 0.0311837 | Time: 1122.43 ms [2022-04-12 18:18:29 main:574] : INFO : Epoch 2023 | loss: 0.0311869 | val_loss: 0.0311851 | Time: 1102.93 ms [2022-04-12 18:18:30 main:574] : INFO : Epoch 2024 | loss: 0.0311854 | val_loss: 0.0311852 | Time: 1094.46 ms [2022-04-12 18:18:31 main:574] : INFO : Epoch 2025 | loss: 0.0311878 | val_loss: 0.0311842 | Time: 1120.27 ms [2022-04-12 18:18:32 main:574] : INFO : Epoch 2026 | loss: 0.0311847 | val_loss: 0.0311852 | Time: 1090.97 ms [2022-04-12 18:18:34 main:574] : INFO : Epoch 2027 | loss: 0.0311831 | val_loss: 0.031183 | Time: 1134.44 ms [2022-04-12 18:18:35 main:574] : INFO : Epoch 2028 | loss: 0.0311836 | val_loss: 0.0311818 | Time: 1078.56 ms [2022-04-12 18:18:36 main:574] : INFO : Epoch 2029 | loss: 0.0311842 | val_loss: 0.0311858 | Time: 1172.92 ms [2022-04-12 18:18:37 main:574] : INFO : Epoch 2030 | loss: 0.0311841 | val_loss: 0.031181 | Time: 1108.15 ms [2022-04-12 18:18:38 main:574] : INFO : Epoch 2031 | loss: 0.0311822 | val_loss: 0.0311806 | Time: 1108.63 ms [2022-04-12 18:18:39 main:574] : INFO : Epoch 2032 | loss: 0.0311815 | val_loss: 0.0311807 | Time: 1100.68 ms [2022-04-12 18:18:40 main:574] : INFO : Epoch 2033 | loss: 0.0311822 | val_loss: 0.0311799 | Time: 1108.25 ms [2022-04-12 18:18:41 main:574] : INFO : Epoch 2034 | loss: 0.0311832 | val_loss: 0.031181 | Time: 1110.44 ms [2022-04-12 18:18:42 main:574] : INFO : Epoch 2035 | loss: 0.0311828 | val_loss: 0.03118 | Time: 1093.03 ms [2022-04-12 18:18:44 main:574] : INFO : Epoch 2036 | loss: 0.0311821 | val_loss: 0.0311805 | Time: 1130.33 ms [2022-04-12 18:18:45 main:574] : INFO : Epoch 2037 | loss: 0.0311837 | val_loss: 0.0311817 | Time: 1080.81 ms [2022-04-12 18:18:46 main:574] : INFO : Epoch 2038 | loss: 0.03118 | val_loss: 0.0311799 | Time: 1132.64 ms [2022-04-12 18:18:47 main:574] : INFO : Epoch 2039 | loss: 0.0311789 | val_loss: 0.0311793 | Time: 1096.71 ms [2022-04-12 18:18:48 main:574] : INFO : Epoch 2040 | loss: 0.0311781 | val_loss: 0.0311787 | Time: 1142.27 ms [2022-04-12 18:18:49 main:574] : INFO : Epoch 2041 | loss: 0.0311801 | val_loss: 0.0311876 | Time: 1097.09 ms [2022-04-12 18:18:50 main:574] : INFO : Epoch 2042 | loss: 0.0311789 | val_loss: 0.0311787 | Time: 1218.63 ms [2022-04-12 18:18:51 main:574] : INFO : Epoch 2043 | loss: 0.0311827 | val_loss: 0.0311813 | Time: 1075.89 ms [2022-04-12 18:18:53 main:574] : INFO : Epoch 2044 | loss: 0.0311804 | val_loss: 0.0311797 | Time: 1104.21 ms [2022-04-12 18:18:54 main:574] : INFO : Epoch 2045 | loss: 0.031178 | val_loss: 0.0311779 | Time: 1095.43 ms [2022-04-12 18:18:55 main:574] : INFO : Epoch 2046 | loss: 0.0311788 | val_loss: 0.0311815 | Time: 1086.91 ms [2022-04-12 18:18:56 main:574] : INFO : Epoch 2047 | loss: 0.0311782 | val_loss: 0.0311766 | Time: 1093.13 ms [2022-04-12 18:18:57 main:574] : INFO : Epoch 2048 | loss: 0.0311771 | val_loss: 0.0311785 | Time: 1091.38 ms [2022-04-12 18:18:57 main:597] : INFO : Saving trained model to model-final.pt, val_loss 0.0311785 [2022-04-12 18:18:57 main:603] : INFO : Saving end state to config to file [2022-04-12 18:18:57 main:608] : INFO : Success, exiting.. 18:18:57 (276): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)