Task 10621112
| Name | ParityModified-1639958100-10739-1-0_0 |
| Workunit | 7948662 |
| Created | 10 Jan 2022, 17:29:16 UTC |
| Sent | 26 Jan 2022, 14:42:40 UTC |
| Report deadline | 3 Feb 2022, 14:42:40 UTC |
| Received | 27 Jan 2022, 20:13:52 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 6020 |
| Run time | 9 hours 1 min 52 sec |
| CPU time | 8 hours 25 min 43 sec |
| Validate state | Valid |
| Credit | 4,160.00 |
| Device peak FLOPS | 1,880.96 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.64 GB |
| Peak swap size | 3.60 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version> <![CDATA[ <stderr_txt> main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-01-27 10:55:52 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-01-27 10:55:52 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-01-27 10:55:52 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-01-27 10:55:52 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-01-27 10:55:52 main:474] : INFO : Configuration: [2022-01-27 10:55:52 main:475] : INFO : Model type: GRU [2022-01-27 10:55:52 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-01-27 10:55:52 main:477] : INFO : Max Epochs: 2048 [2022-01-27 10:55:52 main:478] : INFO : Batch Size: 128 [2022-01-27 10:55:52 main:479] : INFO : Learning Rate: 0.01 [2022-01-27 10:55:52 main:480] : INFO : Patience: 10 [2022-01-27 10:55:52 main:481] : INFO : Hidden Width: 12 [2022-01-27 10:55:52 main:482] : INFO : # Recurrent Layers: 4 [2022-01-27 10:55:52 main:483] : INFO : # Backend Layers: 4 [2022-01-27 10:55:52 main:484] : INFO : # Threads: 1 [2022-01-27 10:55:52 main:486] : INFO : Preparing Dataset [2022-01-27 10:55:52 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-01-27 10:55:53 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-01-27 10:55:56 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-01-27 10:55:56 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-01-27 10:55:56 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-01-27 10:55:56 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-01-27 10:55:56 main:494] : INFO : Creating Model [2022-01-27 10:55:56 main:507] : INFO : Preparing config file [2022-01-27 10:55:56 main:511] : INFO : Found checkpoint, attempting to load... [2022-01-27 10:55:56 main:512] : INFO : Loading config [2022-01-27 10:55:56 main:514] : INFO : Loading state [2022-01-27 10:55:58 main:559] : INFO : Loading DataLoader into Memory [2022-01-27 10:55:58 main:562] : INFO : Starting Training [2022-01-27 10:56:18 main:574] : INFO : Epoch 1792 | loss: 0.0312002 | val_loss: 0.031191 | Time: 19378.4 ms [2022-01-27 10:56:58 main:574] : INFO : Epoch 1793 | loss: 0.031171 | val_loss: 0.0311777 | Time: 40203.1 ms [2022-01-27 10:57:41 main:574] : INFO : Epoch 1794 | loss: 0.031169 | val_loss: 0.03118 | Time: 43003.8 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce MX350) [2022-01-27 11:03:33 main:435] : INFO : Set logging level to 1 [2022-01-27 11:03:33 main:441] : INFO : Running in BOINC Client mode [2022-01-27 11:03:33 main:444] : INFO : Resolving all filenames [2022-01-27 11:03:33 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-01-27 11:03:33 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-01-27 11:03:33 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-01-27 11:03:33 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-01-27 11:03:33 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-01-27 11:03:33 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-01-27 11:03:33 main:474] : INFO : Configuration: [2022-01-27 11:03:33 main:475] : INFO : Model type: GRU [2022-01-27 11:03:33 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-01-27 11:03:33 main:477] : INFO : Max Epochs: 2048 [2022-01-27 11:03:33 main:478] : INFO : Batch Size: 128 [2022-01-27 11:03:33 main:479] : INFO : Learning Rate: 0.01 [2022-01-27 11:03:33 main:480] : INFO : Patience: 10 [2022-01-27 11:03:33 main:481] : INFO : Hidden Width: 12 [2022-01-27 11:03:33 main:482] : INFO : # Recurrent Layers: 4 [2022-01-27 11:03:33 main:483] : INFO : # Backend Layers: 4 [2022-01-27 11:03:33 main:484] : INFO : # Threads: 1 [2022-01-27 11:03:33 main:486] : INFO : Preparing Dataset [2022-01-27 11:03:33 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-01-27 11:03:34 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-01-27 11:03:36 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-01-27 11:03:36 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-01-27 11:03:36 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-01-27 11:03:36 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-01-27 11:03:36 main:494] : INFO : Creating Model [2022-01-27 11:03:36 main:507] : INFO : Preparing config file [2022-01-27 11:03:36 main:511] : INFO : Found checkpoint, attempting to load... [2022-01-27 11:03:36 main:512] : INFO : Loading config [2022-01-27 11:03:36 main:514] : INFO : Loading state [2022-01-27 11:03:37 main:559] : INFO : Loading DataLoader into Memory [2022-01-27 11:03:37 main:562] : INFO : Starting Training [2022-01-27 11:03:44 main:574] : INFO : Epoch 1792 | loss: 0.0312054 | val_loss: 0.0311841 | Time: 7054 ms [2022-01-27 11:19:49 main:574] : INFO : Epoch 1793 | loss: 0.0311733 | val_loss: 0.0311811 | Time: 964774 ms [2022-01-27 11:20:16 main:574] : INFO : Epoch 1794 | loss: 0.0311699 | val_loss: 0.0311818 | Time: 26693.7 ms [2022-01-27 11:20:59 main:574] : INFO : Epoch 1795 | loss: 0.031167 | val_loss: 0.0311798 | Time: 42617.7 ms [2022-01-27 11:21:31 main:574] : INFO : Epoch 1796 | loss: 0.031167 | val_loss: 0.0311821 | Time: 32588.1 ms [2022-01-27 11:22:05 main:574] : INFO : Epoch 1797 | loss: 0.0311729 | val_loss: 0.0311901 | Time: 34161.4 ms [2022-01-27 11:22:39 main:574] : INFO : Epoch 1798 | loss: 0.0311739 | val_loss: 0.0311753 | Time: 33382.1 ms [2022-01-27 11:23:23 main:574] : INFO : Epoch 1799 | loss: 0.0311698 | val_loss: 0.031178 | Time: 44653.5 ms [2022-01-27 11:24:05 main:574] : INFO : Epoch 1800 | loss: 0.0311716 | val_loss: 0.0311819 | Time: 41839.6 ms [2022-01-27 11:24:56 main:574] : INFO : Epoch 1801 | loss: 0.0311741 | val_loss: 0.0311804 | Time: 50314.8 ms [2022-01-27 11:25:34 main:574] : INFO : Epoch 1802 | loss: 0.0311755 | val_loss: 0.0311763 | Time: 38250 ms [2022-01-27 11:26:39 main:574] : INFO : Epoch 1803 | loss: 0.0311737 | val_loss: 0.0311767 | Time: 65269.9 ms [2022-01-27 11:27:22 main:574] : INFO : Epoch 1804 | loss: 0.0311744 | val_loss: 0.0311791 | Time: 42728.7 ms [2022-01-27 11:27:45 main:574] : INFO : Epoch 1805 | loss: 0.0311753 | val_loss: 0.0311808 | Time: 22956.7 ms [2022-01-27 11:28:35 main:574] : INFO : Epoch 1806 | loss: 0.0311738 | val_loss: 0.0311824 | Time: 50158.1 ms [2022-01-27 11:29:14 main:574] : INFO : Epoch 1807 | loss: 0.0311755 | val_loss: 0.031182 | Time: 39162.9 ms [2022-01-27 11:30:14 main:574] : INFO : Epoch 1808 | loss: 0.0311828 | val_loss: 0.0311973 | Time: 59775.5 ms [2022-01-27 11:30:52 main:574] : INFO : Epoch 1809 | loss: 0.0312161 | val_loss: 0.0312155 | Time: 37842 ms [2022-01-27 11:31:42 main:574] : INFO : Epoch 1810 | loss: 0.0312105 | val_loss: 0.031205 | Time: 49852 ms [2022-01-27 11:32:50 main:574] : INFO : Epoch 1811 | loss: 0.0311995 | val_loss: 0.0311943 | Time: 67892.8 ms [2022-01-27 11:33:36 main:574] : INFO : Epoch 1812 | loss: 0.0311922 | val_loss: 0.0311912 | Time: 46603.4 ms [2022-01-27 11:34:24 main:574] : INFO : Epoch 1813 | loss: 0.0311889 | val_loss: 0.0311892 | Time: 47807.2 ms [2022-01-27 11:35:02 main:574] : INFO : Epoch 1814 | loss: 0.0311878 | val_loss: 0.0311866 | Time: 37481.8 ms [2022-01-27 11:36:04 main:574] : INFO : Epoch 1815 | loss: 0.0311862 | val_loss: 0.031188 | Time: 61903.3 ms [2022-01-27 11:37:19 main:574] : INFO : Epoch 1816 | loss: 0.0311844 | val_loss: 0.0311858 | Time: 75340.9 ms [2022-01-27 11:38:08 main:574] : INFO : Epoch 1817 | loss: 0.0311842 | val_loss: 0.0311899 | Time: 49134.7 ms [2022-01-27 11:38:57 main:574] : INFO : Epoch 1818 | loss: 0.0311847 | val_loss: 0.0311859 | Time: 48871.2 ms [2022-01-27 11:39:57 main:574] : INFO : Epoch 1819 | loss: 0.0311837 | val_loss: 0.0311866 | Time: 59627.5 ms [2022-01-27 11:40:45 main:574] : INFO : Epoch 1820 | loss: 0.0311821 | val_loss: 0.0311848 | Time: 48042.8 ms [2022-01-27 11:41:55 main:574] : INFO : Epoch 1821 | loss: 0.0311814 | val_loss: 0.0311875 | Time: 70078.8 ms [2022-01-27 11:42:41 main:574] : INFO : Epoch 1822 | loss: 0.0311819 | val_loss: 0.0311882 | Time: 46400.1 ms [2022-01-27 11:43:33 main:574] : INFO : Epoch 1823 | loss: 0.0311805 | val_loss: 0.0311875 | Time: 51777.2 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce MX350) [2022-01-27 11:47:16 main:435] : INFO : Set logging level to 1 [2022-01-27 11:47:16 main:441] : INFO : Running in BOINC Client mode [2022-01-27 11:47:16 main:444] : INFO : Resolving all filenames [2022-01-27 11:47:16 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-01-27 11:47:16 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-01-27 11:47:16 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-01-27 11:47:16 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-01-27 11:47:16 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-01-27 11:47:16 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-01-27 11:47:16 main:474] : INFO : Configuration: [2022-01-27 11:47:16 main:475] : INFO : Model type: GRU [2022-01-27 11:47:16 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-01-27 11:47:16 main:477] : INFO : Max Epochs: 2048 [2022-01-27 11:47:16 main:478] : INFO : Batch Size: 128 [2022-01-27 11:47:16 main:479] : INFO : Learning Rate: 0.01 [2022-01-27 11:47:16 main:480] : INFO : Patience: 10 [2022-01-27 11:47:16 main:481] : INFO : Hidden Width: 12 [2022-01-27 11:47:16 main:482] : INFO : # Recurrent Layers: 4 [2022-01-27 11:47:16 main:483] : INFO : # Backend Layers: 4 [2022-01-27 11:47:16 main:484] : INFO : # Threads: 1 [2022-01-27 11:47:16 main:486] : INFO : Preparing Dataset [2022-01-27 11:47:16 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-01-27 11:47:17 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-01-27 11:47:20 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-01-27 11:47:20 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-01-27 11:47:20 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-01-27 11:47:20 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-01-27 11:47:20 main:494] : INFO : Creating Model [2022-01-27 11:47:20 main:507] : INFO : Preparing config file [2022-01-27 11:47:20 main:511] : INFO : Found checkpoint, attempting to load... [2022-01-27 11:47:20 main:512] : INFO : Loading config [2022-01-27 11:47:20 main:514] : INFO : Loading state [2022-01-27 11:47:22 main:559] : INFO : Loading DataLoader into Memory [2022-01-27 11:47:22 main:562] : INFO : Starting Training [2022-01-27 11:47:31 main:574] : INFO : Epoch 1821 | loss: 0.0312399 | val_loss: 0.0311949 | Time: 8220.69 ms [2022-01-27 11:48:03 main:574] : INFO : Epoch 1822 | loss: 0.0311913 | val_loss: 0.0311861 | Time: 32051.5 ms [2022-01-27 11:48:35 main:574] : INFO : Epoch 1823 | loss: 0.0311843 | val_loss: 0.0311818 | Time: 32358.6 ms [2022-01-27 11:49:10 main:574] : INFO : Epoch 1824 | loss: 0.0311816 | val_loss: 0.0311798 | Time: 35027.4 ms [2022-01-27 11:49:46 main:574] : INFO : Epoch 1825 | loss: 0.0311805 | val_loss: 0.0311787 | Time: 36240.4 ms [2022-01-27 11:50:22 main:574] : INFO : Epoch 1826 | loss: 0.0311794 | val_loss: 0.0311792 | Time: 35479.3 ms [2022-01-27 11:50:50 main:574] : INFO : Epoch 1827 | loss: 0.0311793 | val_loss: 0.0311781 | Time: 28237.2 ms [2022-01-27 11:51:19 main:574] : INFO : Epoch 1828 | loss: 0.0311782 | val_loss: 0.031179 | Time: 28851.2 ms [2022-01-27 11:51:48 main:574] : INFO : Epoch 1829 | loss: 0.0311775 | val_loss: 0.0311783 | Time: 28801.3 ms [2022-01-27 11:52:17 main:574] : INFO : Epoch 1830 | loss: 0.0311758 | val_loss: 0.0311778 | Time: 28767.3 ms [2022-01-27 11:52:45 main:574] : INFO : Epoch 1831 | loss: 0.0311744 | val_loss: 0.0311761 | Time: 28317.8 ms [2022-01-27 11:53:24 main:574] : INFO : Epoch 1832 | loss: 0.0311738 | val_loss: 0.0311772 | Time: 38939.5 ms [2022-01-27 11:53:52 main:574] : INFO : Epoch 1833 | loss: 0.0311744 | val_loss: 0.031177 | Time: 28136 ms [2022-01-27 11:54:32 main:574] : INFO : Epoch 1834 | loss: 0.0311742 | val_loss: 0.0311765 | Time: 39713.7 ms [2022-01-27 11:54:59 main:574] : INFO : Epoch 1835 | loss: 0.0311741 | val_loss: 0.0311764 | Time: 27261.4 ms [2022-01-27 11:55:25 main:574] : INFO : Epoch 1836 | loss: 0.0311734 | val_loss: 0.0311762 | Time: 25829.3 ms [2022-01-27 11:55:50 main:574] : INFO : Epoch 1837 | loss: 0.0311737 | val_loss: 0.0311787 | Time: 25091.7 ms [2022-01-27 11:56:16 main:574] : INFO : Epoch 1838 | loss: 0.0311737 | val_loss: 0.0311756 | Time: 25678.5 ms [2022-01-27 11:56:42 main:574] : INFO : Epoch 1839 | loss: 0.0311742 | val_loss: 0.0311759 | Time: 26322.4 ms [2022-01-27 11:57:08 main:574] : INFO : Epoch 1840 | loss: 0.0311734 | val_loss: 0.0311743 | Time: 25864.6 ms [2022-01-27 11:57:33 main:574] : INFO : Epoch 1841 | loss: 0.0311726 | val_loss: 0.0311753 | Time: 25440.4 ms [2022-01-27 11:57:59 main:574] : INFO : Epoch 1842 | loss: 0.0311722 | val_loss: 0.0311743 | Time: 25793.1 ms [2022-01-27 11:58:27 main:574] : INFO : Epoch 1843 | loss: 0.0311719 | val_loss: 0.0311751 | Time: 27915.5 ms [2022-01-27 11:58:53 main:574] : INFO : Epoch 1844 | loss: 0.0311715 | val_loss: 0.0311732 | Time: 25330.1 ms [2022-01-27 11:59:18 main:574] : INFO : Epoch 1845 | loss: 0.0311728 | val_loss: 0.03118 | Time: 25420.3 ms [2022-01-27 11:59:44 main:574] : INFO : Epoch 1846 | loss: 0.031176 | val_loss: 0.031175 | Time: 25812.3 ms [2022-01-27 12:00:08 main:574] : INFO : Epoch 1847 | loss: 0.0311744 | val_loss: 0.031176 | Time: 24481.4 ms [2022-01-27 12:00:33 main:574] : INFO : Epoch 1848 | loss: 0.0311711 | val_loss: 0.0311751 | Time: 25023.8 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce MX350) [2022-01-27 12:18:57 main:435] : INFO : Set logging level to 1 [2022-01-27 12:18:57 main:441] : INFO : Running in BOINC Client mode [2022-01-27 12:18:57 main:444] : INFO : Resolving all filenames [2022-01-27 12:18:57 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-01-27 12:18:57 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-01-27 12:18:57 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-01-27 12:18:57 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-01-27 12:18:57 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-01-27 12:18:57 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-01-27 12:18:57 main:474] : INFO : Configuration: [2022-01-27 12:18:57 main:475] : INFO : Model type: GRU [2022-01-27 12:18:57 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-01-27 12:18:57 main:477] : INFO : Max Epochs: 2048 [2022-01-27 12:18:57 main:478] : INFO : Batch Size: 128 [2022-01-27 12:18:57 main:479] : INFO : Learning Rate: 0.01 [2022-01-27 12:18:57 main:480] : INFO : Patience: 10 [2022-01-27 12:18:57 main:481] : INFO : Hidden Width: 12 [2022-01-27 12:18:57 main:482] : INFO : # Recurrent Layers: 4 [2022-01-27 12:18:57 main:483] : INFO : # Backend Layers: 4 [2022-01-27 12:18:57 main:484] : INFO : # Threads: 1 [2022-01-27 12:18:57 main:486] : INFO : Preparing Dataset [2022-01-27 12:18:57 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-01-27 12:18:57 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-01-27 12:18:59 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-01-27 12:18:59 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-01-27 12:18:59 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-01-27 12:18:59 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-01-27 12:18:59 main:494] : INFO : Creating Model [2022-01-27 12:18:59 main:507] : INFO : Preparing config file [2022-01-27 12:18:59 main:511] : INFO : Found checkpoint, attempting to load... [2022-01-27 12:18:59 main:512] : INFO : Loading config [2022-01-27 12:18:59 main:514] : INFO : Loading state [2022-01-27 12:19:00 main:559] : INFO : Loading DataLoader into Memory [2022-01-27 12:19:00 main:562] : INFO : Starting Training [2022-01-27 12:19:06 main:574] : INFO : Epoch 1843 | loss: 0.0312319 | val_loss: 0.0311828 | Time: 5356.95 ms [2022-01-27 12:19:16 main:574] : INFO : Epoch 1844 | loss: 0.0311784 | val_loss: 0.0311759 | Time: 10158.8 ms [2022-01-27 12:19:40 main:574] : INFO : Epoch 1845 | loss: 0.0311727 | val_loss: 0.0311736 | Time: 23951.6 ms [2022-01-27 12:20:05 main:574] : INFO : Epoch 1846 | loss: 0.031172 | val_loss: 0.0311786 | Time: 25506.9 ms [2022-01-27 12:20:31 main:574] : INFO : Epoch 1847 | loss: 0.0311726 | val_loss: 0.0311796 | Time: 25617.9 ms [2022-01-27 12:20:54 main:574] : INFO : Epoch 1848 | loss: 0.0311737 | val_loss: 0.0311793 | Time: 23406.5 ms [2022-01-27 12:21:20 main:574] : INFO : Epoch 1849 | loss: 0.0311694 | val_loss: 0.0311728 | Time: 25458.6 ms [2022-01-27 12:21:45 main:574] : INFO : Epoch 1850 | loss: 0.0311681 | val_loss: 0.0311729 | Time: 24980.7 ms [2022-01-27 12:22:09 main:574] : INFO : Epoch 1851 | loss: 0.0311684 | val_loss: 0.0311744 | Time: 24227.3 ms [2022-01-27 12:22:34 main:574] : INFO : Epoch 1852 | loss: 0.031168 | val_loss: 0.0311751 | Time: 25257.9 ms [2022-01-27 12:22:59 main:574] : INFO : Epoch 1853 | loss: 0.0311686 | val_loss: 0.0311731 | Time: 24680.8 ms [2022-01-27 12:23:26 main:574] : INFO : Epoch 1854 | loss: 0.0311699 | val_loss: 0.0311805 | Time: 26815.8 ms [2022-01-27 12:23:52 main:574] : INFO : Epoch 1855 | loss: 0.0311705 | val_loss: 0.0311822 | Time: 25908.1 ms [2022-01-27 12:24:16 main:574] : INFO : Epoch 1856 | loss: 0.0311693 | val_loss: 0.0311741 | Time: 24333 ms [2022-01-27 12:24:48 main:574] : INFO : Epoch 1857 | loss: 0.0311675 | val_loss: 0.0311748 | Time: 31745 ms [2022-01-27 12:25:08 main:574] : INFO : Epoch 1858 | loss: 0.0311678 | val_loss: 0.0311741 | Time: 20358.5 ms [2022-01-27 12:25:32 main:574] : INFO : Epoch 1859 | loss: 0.0311659 | val_loss: 0.0311819 | Time: 23335.7 ms [2022-01-27 12:25:57 main:574] : INFO : Epoch 1860 | loss: 0.0311661 | val_loss: 0.0311775 | Time: 25050.5 ms [2022-01-27 12:26:22 main:574] : INFO : Epoch 1861 | loss: 0.0311659 | val_loss: 0.0311768 | Time: 25163.2 ms [2022-01-27 12:26:47 main:574] : INFO : Epoch 1862 | loss: 0.0311657 | val_loss: 0.0311766 | Time: 24527.3 ms [2022-01-27 12:27:12 main:574] : INFO : Epoch 1863 | loss: 0.0311715 | val_loss: 0.031177 | Time: 25310.8 ms [2022-01-27 12:27:36 main:574] : INFO : Epoch 1864 | loss: 0.0311685 | val_loss: 0.0311752 | Time: 23854.1 ms [2022-01-27 12:28:00 main:574] : INFO : Epoch 1865 | loss: 0.0311664 | val_loss: 0.0311721 | Time: 24738.2 ms [2022-01-27 12:28:26 main:574] : INFO : Epoch 1866 | loss: 0.0311672 | val_loss: 0.0311723 | Time: 25235.3 ms [2022-01-27 12:28:51 main:574] : INFO : Epoch 1867 | loss: 0.0311666 | val_loss: 0.0311727 | Time: 24825.3 ms [2022-01-27 12:29:17 main:574] : INFO : Epoch 1868 | loss: 0.0311658 | val_loss: 0.0311732 | Time: 26024.4 ms [2022-01-27 12:29:41 main:574] : INFO : Epoch 1869 | loss: 0.0311667 | val_loss: 0.0311748 | Time: 24522.5 ms [2022-01-27 12:30:06 main:574] : INFO : Epoch 1870 | loss: 0.0311647 | val_loss: 0.0311757 | Time: 24500 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce MX350) [2022-01-27 12:34:38 main:435] : INFO : Set logging level to 1 [2022-01-27 12:34:38 main:441] : INFO : Running in BOINC Client mode [2022-01-27 12:34:39 main:444] : INFO : Resolving all filenames [2022-01-27 12:34:39 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-01-27 12:34:39 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-01-27 12:34:39 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-01-27 12:34:39 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-01-27 12:34:39 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-01-27 12:34:39 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-01-27 12:34:39 main:474] : INFO : Configuration: [2022-01-27 12:34:39 main:475] : INFO : Model type: GRU [2022-01-27 12:34:39 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-01-27 12:34:39 main:477] : INFO : Max Epochs: 2048 [2022-01-27 12:34:39 main:478] : INFO : Batch Size: 128 [2022-01-27 12:34:39 main:479] : INFO : Learning Rate: 0.01 [2022-01-27 12:34:39 main:480] : INFO : Patience: 10 [2022-01-27 12:34:39 main:481] : INFO : Hidden Width: 12 [2022-01-27 12:34:39 main:482] : INFO : # Recurrent Layers: 4 [2022-01-27 12:34:39 main:483] : INFO : # Backend Layers: 4 [2022-01-27 12:34:39 main:484] : INFO : # Threads: 1 [2022-01-27 12:34:39 main:486] : INFO : Preparing Dataset [2022-01-27 12:34:39 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-01-27 12:34:39 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-01-27 12:34:41 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-01-27 12:34:41 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-01-27 12:34:41 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-01-27 12:34:41 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-01-27 12:34:41 main:494] : INFO : Creating Model [2022-01-27 12:34:41 main:507] : INFO : Preparing config file [2022-01-27 12:34:41 main:511] : INFO : Found checkpoint, attempting to load... [2022-01-27 12:34:41 main:512] : INFO : Loading config [2022-01-27 12:34:41 main:514] : INFO : Loading state [2022-01-27 12:34:42 main:559] : INFO : Loading DataLoader into Memory [2022-01-27 12:34:42 main:562] : INFO : Starting Training [2022-01-27 12:34:47 main:574] : INFO : Epoch 1869 | loss: 0.0311999 | val_loss: 0.0311784 | Time: 5329.36 ms [2022-01-27 12:34:57 main:574] : INFO : Epoch 1870 | loss: 0.0311696 | val_loss: 0.0311753 | Time: 9912.06 ms [2022-01-27 12:35:19 main:574] : INFO : Epoch 1871 | loss: 0.0311653 | val_loss: 0.0311744 | Time: 21932.6 ms [2022-01-27 12:35:44 main:574] : INFO : Epoch 1872 | loss: 0.0311644 | val_loss: 0.031174 | Time: 25432.2 ms [2022-01-27 12:36:09 main:574] : INFO : Epoch 1873 | loss: 0.0311636 | val_loss: 0.031173 | Time: 24805.2 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce MX350) [2022-01-27 12:39:29 main:435] : INFO : Set logging level to 1 [2022-01-27 12:39:29 main:441] : INFO : Running in BOINC Client mode [2022-01-27 12:39:29 main:444] : INFO : Resolving all filenames [2022-01-27 12:39:29 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-01-27 12:39:29 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-01-27 12:39:29 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-01-27 12:39:29 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-01-27 12:39:29 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-01-27 12:39:29 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-01-27 12:39:29 main:474] : INFO : Configuration: [2022-01-27 12:39:29 main:475] : INFO : Model type: GRU [2022-01-27 12:39:29 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-01-27 12:39:29 main:477] : INFO : Max Epochs: 2048 [2022-01-27 12:39:29 main:478] : INFO : Batch Size: 128 [2022-01-27 12:39:29 main:479] : INFO : Learning Rate: 0.01 [2022-01-27 12:39:29 main:480] : INFO : Patience: 10 [2022-01-27 12:39:29 main:481] : INFO : Hidden Width: 12 [2022-01-27 12:39:29 main:482] : INFO : # Recurrent Layers: 4 [2022-01-27 12:39:29 main:483] : INFO : # Backend Layers: 4 [2022-01-27 12:39:29 main:484] : INFO : # Threads: 1 [2022-01-27 12:39:29 main:486] : INFO : Preparing Dataset [2022-01-27 12:39:29 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-01-27 12:39:29 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-01-27 12:39:31 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-01-27 12:39:31 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-01-27 12:39:31 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-01-27 12:39:31 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-01-27 12:39:31 main:494] : INFO : Creating Model [2022-01-27 12:39:31 main:507] : INFO : Preparing config file [2022-01-27 12:39:31 main:511] : INFO : Found checkpoint, attempting to load... [2022-01-27 12:39:31 main:512] : INFO : Loading config [2022-01-27 12:39:31 main:514] : INFO : Loading state [2022-01-27 12:39:32 main:559] : INFO : Loading DataLoader into Memory [2022-01-27 12:39:32 main:562] : INFO : Starting Training [2022-01-27 12:39:37 main:574] : INFO : Epoch 1869 | loss: 0.0312149 | val_loss: 0.0311926 | Time: 5411.22 ms [2022-01-27 12:39:48 main:574] : INFO : Epoch 1870 | loss: 0.0311731 | val_loss: 0.0311749 | Time: 10419.4 ms [2022-01-27 12:40:12 main:574] : INFO : Epoch 1871 | loss: 0.0311667 | val_loss: 0.0311749 | Time: 24101.4 ms [2022-01-27 12:40:37 main:574] : INFO : Epoch 1872 | loss: 0.0311657 | val_loss: 0.0311752 | Time: 24684.6 ms [2022-01-27 12:41:02 main:574] : INFO : Epoch 1873 | loss: 0.0311658 | val_loss: 0.0311734 | Time: 24946.6 ms [2022-01-27 12:41:25 main:574] : INFO : Epoch 1874 | loss: 0.0311627 | val_loss: 0.0311758 | Time: 23472.9 ms [2022-01-27 12:41:50 main:574] : INFO : Epoch 1875 | loss: 0.031165 | val_loss: 0.0311746 | Time: 24628.1 ms [2022-01-27 12:42:14 main:574] : INFO : Epoch 1876 | loss: 0.0311661 | val_loss: 0.0311759 | Time: 24106.2 ms [2022-01-27 12:42:39 main:574] : INFO : Epoch 1877 | loss: 0.0311654 | val_loss: 0.0311753 | Time: 25242.1 ms [2022-01-27 12:43:04 main:574] : INFO : Epoch 1878 | loss: 0.0311662 | val_loss: 0.0311782 | Time: 25188.5 ms [2022-01-27 12:43:29 main:574] : INFO : Epoch 1879 | loss: 0.0311682 | val_loss: 0.0311744 | Time: 24932.4 ms [2022-01-27 12:44:06 main:574] : INFO : Epoch 1880 | loss: 0.0311657 | val_loss: 0.0311738 | Time: 36252.6 ms [2022-01-27 12:44:27 main:574] : INFO : Epoch 1881 | loss: 0.0311646 | val_loss: 0.0311724 | Time: 21004.9 ms [2022-01-27 12:44:52 main:574] : INFO : Epoch 1882 | loss: 0.0311638 | val_loss: 0.0311747 | Time: 24944.8 ms [2022-01-27 12:45:15 main:574] : INFO : Epoch 1883 | loss: 0.0311638 | val_loss: 0.0311761 | Time: 23799.5 ms [2022-01-27 12:45:40 main:574] : INFO : Epoch 1884 | loss: 0.0311648 | val_loss: 0.0311726 | Time: 24531.9 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce MX350) [2022-01-27 12:49:17 main:435] : INFO : Set logging level to 1 [2022-01-27 12:49:17 main:441] : INFO : Running in BOINC Client mode [2022-01-27 12:49:17 main:444] : INFO : Resolving all filenames [2022-01-27 12:49:17 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-01-27 12:49:17 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-01-27 12:49:17 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-01-27 12:49:17 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-01-27 12:49:17 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-01-27 12:49:17 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-01-27 12:49:17 main:474] : INFO : Configuration: [2022-01-27 12:49:17 main:475] : INFO : Model type: GRU [2022-01-27 12:49:17 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-01-27 12:49:17 main:477] : INFO : Max Epochs: 2048 [2022-01-27 12:49:17 main:478] : INFO : Batch Size: 128 [2022-01-27 12:49:17 main:479] : INFO : Learning Rate: 0.01 [2022-01-27 12:49:17 main:480] : INFO : Patience: 10 [2022-01-27 12:49:17 main:481] : INFO : Hidden Width: 12 [2022-01-27 12:49:17 main:482] : INFO : # Recurrent Layers: 4 [2022-01-27 12:49:17 main:483] : INFO : # Backend Layers: 4 [2022-01-27 12:49:17 main:484] : INFO : # Threads: 1 [2022-01-27 12:49:17 main:486] : INFO : Preparing Dataset [2022-01-27 12:49:17 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-01-27 12:49:17 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-01-27 12:49:20 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-01-27 12:49:20 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-01-27 12:49:20 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-01-27 12:49:20 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-01-27 12:49:20 main:494] : INFO : Creating Model [2022-01-27 12:49:20 main:507] : INFO : Preparing config file [2022-01-27 12:49:20 main:511] : INFO : Found checkpoint, attempting to load... [2022-01-27 12:49:20 main:512] : INFO : Loading config [2022-01-27 12:49:20 main:514] : INFO : Loading state [2022-01-27 12:49:21 main:559] : INFO : Loading DataLoader into Memory [2022-01-27 12:49:21 main:562] : INFO : Starting Training [2022-01-27 12:49:28 main:574] : INFO : Epoch 1879 | loss: 0.0312362 | val_loss: 0.0311961 | Time: 7244.68 ms [2022-01-27 12:49:43 main:574] : INFO : Epoch 1880 | loss: 0.031172 | val_loss: 0.0311746 | Time: 14850 ms [2022-01-27 12:50:12 main:574] : INFO : Epoch 1881 | loss: 0.0311648 | val_loss: 0.0311715 | Time: 28356.5 ms [2022-01-27 12:50:40 main:574] : INFO : Epoch 1882 | loss: 0.0311646 | val_loss: 0.0311724 | Time: 27718.3 ms [2022-01-27 12:51:07 main:574] : INFO : Epoch 1883 | loss: 0.0311647 | val_loss: 0.0311718 | Time: 27557.9 ms [2022-01-27 12:51:36 main:574] : INFO : Epoch 1884 | loss: 0.0311637 | val_loss: 0.0311725 | Time: 28820.2 ms [2022-01-27 12:52:32 main:574] : INFO : Epoch 1885 | loss: 0.0311644 | val_loss: 0.0311734 | Time: 56434.4 ms [2022-01-27 12:53:21 main:574] : INFO : Epoch 1886 | loss: 0.0311637 | val_loss: 0.0311728 | Time: 48473.8 ms [2022-01-27 12:54:01 main:574] : INFO : Epoch 1887 | loss: 0.0311624 | val_loss: 0.0311713 | Time: 39772.1 ms [2022-01-27 12:54:26 main:574] : INFO : Epoch 1888 | loss: 0.0311609 | val_loss: 0.0311727 | Time: 25334.9 ms [2022-01-27 12:54:52 main:574] : INFO : Epoch 1889 | loss: 0.0311608 | val_loss: 0.0311752 | Time: 25676.5 ms [2022-01-27 12:55:28 main:574] : INFO : Epoch 1890 | loss: 0.0311625 | val_loss: 0.0311733 | Time: 36351.8 ms [2022-01-27 12:55:54 main:574] : INFO : Epoch 1891 | loss: 0.0311636 | val_loss: 0.0311734 | Time: 25937.8 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce MX350) [2022-01-27 12:58:57 main:435] : INFO : Set logging level to 1 [2022-01-27 12:58:57 main:441] : INFO : Running in BOINC Client mode [2022-01-27 12:58:57 main:444] : INFO : Resolving all filenames [2022-01-27 12:58:57 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-01-27 12:58:57 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-01-27 12:58:57 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-01-27 12:58:57 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-01-27 12:58:57 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-01-27 12:58:57 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-01-27 12:58:57 main:474] : INFO : Configuration: [2022-01-27 12:58:57 main:475] : INFO : Model type: GRU [2022-01-27 12:58:57 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-01-27 12:58:57 main:477] : INFO : Max Epochs: 2048 [2022-01-27 12:58:57 main:478] : INFO : Batch Size: 128 [2022-01-27 12:58:57 main:479] : INFO : Learning Rate: 0.01 [2022-01-27 12:58:57 main:480] : INFO : Patience: 10 [2022-01-27 12:58:57 main:481] : INFO : Hidden Width: 12 [2022-01-27 12:58:57 main:482] : INFO : # Recurrent Layers: 4 [2022-01-27 12:58:57 main:483] : INFO : # Backend Layers: 4 [2022-01-27 12:58:57 main:484] : INFO : # Threads: 1 [2022-01-27 12:58:57 main:486] : INFO : Preparing Dataset [2022-01-27 12:58:57 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-01-27 12:58:58 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-01-27 12:59:00 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-01-27 12:59:00 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-01-27 12:59:00 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-01-27 12:59:00 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-01-27 12:59:00 main:494] : INFO : Creating Model [2022-01-27 12:59:00 main:507] : INFO : Preparing config file [2022-01-27 12:59:00 main:511] : INFO : Found checkpoint, attempting to load... [2022-01-27 12:59:00 main:512] : INFO : Loading config [2022-01-27 12:59:00 main:514] : INFO : Loading state [2022-01-27 12:59:01 main:559] : INFO : Loading DataLoader into Memory [2022-01-27 12:59:02 main:562] : INFO : Starting Training [2022-01-27 12:59:09 main:574] : INFO : Epoch 1892 | loss: 0.0312498 | val_loss: 0.0311888 | Time: 6985.57 ms [2022-01-27 12:59:21 main:574] : INFO : Epoch 1893 | loss: 0.031175 | val_loss: 0.0311768 | Time: 12833.2 ms [2022-01-27 12:59:50 main:574] : INFO : Epoch 1894 | loss: 0.0311693 | val_loss: 0.0311747 | Time: 28196.9 ms [2022-01-27 13:00:46 main:574] : INFO : Epoch 1895 | loss: 0.0311634 | val_loss: 0.0311734 | Time: 56343.5 ms [2022-01-27 13:01:13 main:574] : INFO : Epoch 1896 | loss: 0.0311637 | val_loss: 0.031176 | Time: 26792.6 ms [2022-01-27 13:01:39 main:574] : INFO : Epoch 1897 | loss: 0.0311634 | val_loss: 0.0311744 | Time: 26299.3 ms [2022-01-27 13:02:06 main:574] : INFO : Epoch 1898 | loss: 0.0311625 | val_loss: 0.0311752 | Time: 26797.5 ms [2022-01-27 13:02:32 main:574] : INFO : Epoch 1899 | loss: 0.0311619 | val_loss: 0.0311736 | Time: 25771.4 ms [2022-01-27 13:02:58 main:574] : INFO : Epoch 1900 | loss: 0.0311611 | val_loss: 0.0311732 | Time: 25837.2 ms [2022-01-27 13:03:25 main:574] : INFO : Epoch 1901 | loss: 0.0311607 | val_loss: 0.031175 | Time: 26834.3 ms [2022-01-27 13:03:52 main:574] : INFO : Epoch 1902 | loss: 0.0311597 | val_loss: 0.0311737 | Time: 27057.7 ms [2022-01-27 13:04:18 main:574] : INFO : Epoch 1903 | loss: 0.0311601 | val_loss: 0.031173 | Time: 26155.6 ms [2022-01-27 13:04:43 main:574] : INFO : Epoch 1904 | loss: 0.0311592 | val_loss: 0.0311773 | Time: 25219.4 ms [2022-01-27 13:05:13 main:574] : INFO : Epoch 1905 | loss: 0.0311618 | val_loss: 0.0311775 | Time: 29497.2 ms [2022-01-27 13:05:38 main:574] : INFO : Epoch 1906 | loss: 0.0311629 | val_loss: 0.0311757 | Time: 25771.7 ms [2022-01-27 13:06:04 main:574] : INFO : Epoch 1907 | loss: 0.0311626 | val_loss: 0.0311741 | Time: 25809.7 ms [2022-01-27 13:06:33 main:574] : INFO : Epoch 1908 | loss: 0.0311633 | val_loss: 0.0311751 | Time: 28344 ms [2022-01-27 13:07:00 main:574] : INFO : Epoch 1909 | loss: 0.0311633 | val_loss: 0.0311759 | Time: 27472.3 ms [2022-01-27 13:07:30 main:574] : INFO : Epoch 1910 | loss: 0.0311608 | val_loss: 0.0311739 | Time: 29017 ms [2022-01-27 13:07:59 main:574] : INFO : Epoch 1911 | loss: 0.0311629 | val_loss: 0.0311751 | Time: 29092.4 ms [2022-01-27 13:08:27 main:574] : INFO : Epoch 1912 | loss: 0.0311653 | val_loss: 0.0311753 | Time: 28681.5 ms [2022-01-27 13:08:57 main:574] : INFO : Epoch 1913 | loss: 0.0311702 | val_loss: 0.0311825 | Time: 29452.2 ms [2022-01-27 13:09:26 main:574] : INFO : Epoch 1914 | loss: 0.0311688 | val_loss: 0.0311761 | Time: 28696.5 ms [2022-01-27 13:09:55 main:574] : INFO : Epoch 1915 | loss: 0.0311671 | val_loss: 0.0311799 | Time: 29391 ms [2022-01-27 13:10:35 main:574] : INFO : Epoch 1916 | loss: 0.0311655 | val_loss: 0.0311795 | Time: 39536.2 ms [2022-01-27 13:11:03 main:574] : INFO : Epoch 1917 | loss: 0.031166 | val_loss: 0.0311792 | Time: 27974.4 ms [2022-01-27 13:11:31 main:574] : INFO : Epoch 1918 | loss: 0.0311644 | val_loss: 0.0311758 | Time: 28334.6 ms [2022-01-27 13:11:58 main:574] : INFO : Epoch 1919 | loss: 0.0311623 | val_loss: 0.0311777 | Time: 27093.8 ms [2022-01-27 13:12:24 main:574] : INFO : Epoch 1920 | loss: 0.031162 | val_loss: 0.03118 | Time: 25904.2 ms [2022-01-27 13:12:51 main:574] : INFO : Epoch 1921 | loss: 0.0311626 | val_loss: 0.0311738 | Time: 27406 ms [2022-01-27 13:13:17 main:574] : INFO : Epoch 1922 | loss: 0.0311593 | val_loss: 0.0311792 | Time: 25256.8 ms [2022-01-27 13:13:42 main:574] : INFO : Epoch 1923 | loss: 0.0311625 | val_loss: 0.0311765 | Time: 25677 ms [2022-01-27 13:14:09 main:574] : INFO : Epoch 1924 | loss: 0.031165 | val_loss: 0.0311755 | Time: 26917.4 ms [2022-01-27 13:14:34 main:574] : INFO : Epoch 1925 | loss: 0.0311661 | val_loss: 0.031174 | Time: 24819.5 ms [2022-01-27 13:15:01 main:574] : INFO : Epoch 1926 | loss: 0.0311625 | val_loss: 0.0311735 | Time: 26563.5 ms [2022-01-27 13:15:27 main:574] : INFO : Epoch 1927 | loss: 0.0311623 | val_loss: 0.0311764 | Time: 26282 ms [2022-01-27 13:15:53 main:574] : INFO : Epoch 1928 | loss: 0.0311618 | val_loss: 0.031177 | Time: 26435.7 ms [2022-01-27 13:16:20 main:574] : INFO : Epoch 1929 | loss: 0.0311597 | val_loss: 0.0311747 | Time: 26775.6 ms [2022-01-27 13:16:46 main:574] : INFO : Epoch 1930 | loss: 0.0311598 | val_loss: 0.0311769 | Time: 25608.6 ms [2022-01-27 13:17:12 main:574] : INFO : Epoch 1931 | loss: 0.0311609 | val_loss: 0.0311733 | Time: 25884.8 ms [2022-01-27 13:17:37 main:574] : INFO : Epoch 1932 | loss: 0.0311621 | val_loss: 0.0311738 | Time: 25545.4 ms [2022-01-27 13:18:04 main:574] : INFO : Epoch 1933 | loss: 0.0311595 | val_loss: 0.031174 | Time: 26589.1 ms [2022-01-27 13:18:30 main:574] : INFO : Epoch 1934 | loss: 0.0311582 | val_loss: 0.0311776 | Time: 26259.8 ms [2022-01-27 13:18:55 main:574] : INFO : Epoch 1935 | loss: 0.0311644 | val_loss: 0.0311734 | Time: 24650.7 ms [2022-01-27 13:19:19 main:574] : INFO : Epoch 1936 | loss: 0.0311632 | val_loss: 0.0311725 | Time: 24441.9 ms [2022-01-27 13:19:46 main:574] : INFO : Epoch 1937 | loss: 0.0311598 | val_loss: 0.031173 | Time: 26965 ms [2022-01-27 13:20:13 main:574] : INFO : Epoch 1938 | loss: 0.0311582 | val_loss: 0.0311755 | Time: 26217.3 ms [2022-01-27 13:20:38 main:574] : INFO : Epoch 1939 | loss: 0.0311585 | val_loss: 0.0311757 | Time: 25870 ms [2022-01-27 13:21:04 main:574] : INFO : Epoch 1940 | loss: 0.0311718 | val_loss: 0.0311795 | Time: 25197.9 ms [2022-01-27 13:21:30 main:574] : INFO : Epoch 1941 | loss: 0.0311802 | val_loss: 0.0311828 | Time: 26525.5 ms [2022-01-27 13:21:56 main:574] : INFO : Epoch 1942 | loss: 0.0311794 | val_loss: 0.0311922 | Time: 25880 ms [2022-01-27 13:22:22 main:574] : INFO : Epoch 1943 | loss: 0.0311926 | val_loss: 0.0311931 | Time: 25627.2 ms [2022-01-27 13:22:48 main:574] : INFO : Epoch 1944 | loss: 0.0311924 | val_loss: 0.0311913 | Time: 26130.1 ms [2022-01-27 13:23:14 main:574] : INFO : Epoch 1945 | loss: 0.0311919 | val_loss: 0.031195 | Time: 25892.8 ms [2022-01-27 13:23:40 main:574] : INFO : Epoch 1946 | loss: 0.0311888 | val_loss: 0.0311857 | Time: 26107.8 ms [2022-01-27 13:24:06 main:574] : INFO : Epoch 1947 | loss: 0.0311837 | val_loss: 0.0311859 | Time: 26403.8 ms [2022-01-27 13:24:32 main:574] : INFO : Epoch 1948 | loss: 0.0311826 | val_loss: 0.0311904 | Time: 25853.7 ms [2022-01-27 13:24:58 main:574] : INFO : Epoch 1949 | loss: 0.0311838 | val_loss: 0.0311866 | Time: 25987.2 ms [2022-01-27 13:25:25 main:574] : INFO : Epoch 1950 | loss: 0.0311806 | val_loss: 0.0311848 | Time: 26249.3 ms [2022-01-27 13:26:01 main:574] : INFO : Epoch 1951 | loss: 0.0311796 | val_loss: 0.0311879 | Time: 36735.5 ms [2022-01-27 13:26:28 main:574] : INFO : Epoch 1952 | loss: 0.0311787 | val_loss: 0.0311828 | Time: 26299.9 ms [2022-01-27 13:26:54 main:574] : INFO : Epoch 1953 | loss: 0.0311768 | val_loss: 0.0311854 | Time: 26374.5 ms [2022-01-27 13:27:21 main:574] : INFO : Epoch 1954 | loss: 0.0311782 | val_loss: 0.0311852 | Time: 26646.5 ms [2022-01-27 13:27:47 main:574] : INFO : Epoch 1955 | loss: 0.0311785 | val_loss: 0.0311846 | Time: 25989.5 ms [2022-01-27 13:28:13 main:574] : INFO : Epoch 1956 | loss: 0.0311754 | val_loss: 0.0311832 | Time: 26510 ms [2022-01-27 13:28:40 main:574] : INFO : Epoch 1957 | loss: 0.0311753 | val_loss: 0.0311821 | Time: 27033.6 ms [2022-01-27 13:29:06 main:574] : INFO : Epoch 1958 | loss: 0.0311747 | val_loss: 0.0311845 | Time: 26143 ms [2022-01-27 13:29:33 main:574] : INFO : Epoch 1959 | loss: 0.0311739 | val_loss: 0.0311819 | Time: 26174.2 ms [2022-01-27 13:29:59 main:574] : INFO : Epoch 1960 | loss: 0.0311725 | val_loss: 0.0311781 | Time: 26668.4 ms [2022-01-27 13:30:25 main:574] : INFO : Epoch 1961 | loss: 0.0311721 | val_loss: 0.0311783 | Time: 25876.1 ms [2022-01-27 13:30:51 main:574] : INFO : Epoch 1962 | loss: 0.0311703 | val_loss: 0.0311777 | Time: 25842.5 ms [2022-01-27 13:31:17 main:574] : INFO : Epoch 1963 | loss: 0.0311705 | val_loss: 0.0311778 | Time: 25718.8 ms [2022-01-27 13:31:43 main:574] : INFO : Epoch 1964 | loss: 0.0311698 | val_loss: 0.0311795 | Time: 26264.8 ms [2022-01-27 13:32:09 main:574] : INFO : Epoch 1965 | loss: 0.0311694 | val_loss: 0.0311774 | Time: 26268.7 ms [2022-01-27 13:32:35 main:574] : INFO : Epoch 1966 | loss: 0.0311688 | val_loss: 0.0311781 | Time: 25416.2 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce MX350) [2022-01-27 13:36:16 main:435] : INFO : Set logging level to 1 [2022-01-27 13:36:16 main:441] : INFO : Running in BOINC Client mode [2022-01-27 13:36:16 main:444] : INFO : Resolving all filenames [2022-01-27 13:36:16 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-01-27 13:36:16 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-01-27 13:36:16 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-01-27 13:36:16 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-01-27 13:36:16 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-01-27 13:36:16 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-01-27 13:36:16 main:474] : INFO : Configuration: [2022-01-27 13:36:16 main:475] : INFO : Model type: GRU [2022-01-27 13:36:16 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-01-27 13:36:16 main:477] : INFO : Max Epochs: 2048 [2022-01-27 13:36:16 main:478] : INFO : Batch Size: 128 [2022-01-27 13:36:16 main:479] : INFO : Learning Rate: 0.01 [2022-01-27 13:36:16 main:480] : INFO : Patience: 10 [2022-01-27 13:36:16 main:481] : INFO : Hidden Width: 12 [2022-01-27 13:36:16 main:482] : INFO : # Recurrent Layers: 4 [2022-01-27 13:36:16 main:483] : INFO : # Backend Layers: 4 [2022-01-27 13:36:16 main:484] : INFO : # Threads: 1 [2022-01-27 13:36:16 main:486] : INFO : Preparing Dataset [2022-01-27 13:36:16 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-01-27 13:36:17 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-01-27 13:36:20 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-01-27 13:36:20 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-01-27 13:36:20 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-01-27 13:36:20 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-01-27 13:36:20 main:494] : INFO : Creating Model [2022-01-27 13:36:20 main:507] : INFO : Preparing config file [2022-01-27 13:36:20 main:511] : INFO : Found checkpoint, attempting to load... [2022-01-27 13:36:20 main:512] : INFO : Loading config [2022-01-27 13:36:20 main:514] : INFO : Loading state [2022-01-27 13:36:21 main:559] : INFO : Loading DataLoader into Memory [2022-01-27 13:36:22 main:562] : INFO : Starting Training [2022-01-27 13:36:33 main:574] : INFO : Epoch 1962 | loss: 0.0312088 | val_loss: 0.0311831 | Time: 10507.9 ms [2022-01-27 13:37:00 main:574] : INFO : Epoch 1963 | loss: 0.0311775 | val_loss: 0.0311791 | Time: 27316.8 ms [2022-01-27 13:37:50 main:574] : INFO : Epoch 1964 | loss: 0.0311729 | val_loss: 0.0311742 | Time: 50038 ms [2022-01-27 13:38:17 main:574] : INFO : Epoch 1965 | loss: 0.0311705 | val_loss: 0.0311755 | Time: 27223 ms [2022-01-27 13:39:09 main:574] : INFO : Epoch 1966 | loss: 0.0311693 | val_loss: 0.031176 | Time: 52089.4 ms [2022-01-27 13:39:49 main:574] : INFO : Epoch 1967 | loss: 0.0311689 | val_loss: 0.0311782 | Time: 39579.1 ms [2022-01-27 13:40:27 main:574] : INFO : Epoch 1968 | loss: 0.0311714 | val_loss: 0.031176 | Time: 37600.7 ms [2022-01-27 13:40:54 main:574] : INFO : Epoch 1969 | loss: 0.0311703 | val_loss: 0.0311755 | Time: 27309.8 ms [2022-01-27 13:41:46 main:574] : INFO : Epoch 1970 | loss: 0.0311707 | val_loss: 0.0311744 | Time: 51756.5 ms [2022-01-27 13:42:13 main:574] : INFO : Epoch 1971 | loss: 0.0311695 | val_loss: 0.0311758 | Time: 27234.8 ms [2022-01-27 13:43:02 main:574] : INFO : Epoch 1972 | loss: 0.0311695 | val_loss: 0.0311833 | Time: 48813.2 ms [2022-01-27 13:43:40 main:574] : INFO : Epoch 1973 | loss: 0.031171 | val_loss: 0.0311741 | Time: 37724.6 ms [2022-01-27 13:44:42 main:574] : INFO : Epoch 1974 | loss: 0.0311656 | val_loss: 0.0311737 | Time: 62191 ms [2022-01-27 13:48:25 main:574] : INFO : Epoch 1975 | loss: 0.0311644 | val_loss: 0.0311755 | Time: 222931 ms [2022-01-27 13:48:49 main:574] : INFO : Epoch 1976 | loss: 0.031164 | val_loss: 0.0311745 | Time: 23860.2 ms [2022-01-27 13:49:34 main:574] : INFO : Epoch 1977 | loss: 0.0311637 | val_loss: 0.0311723 | Time: 45615.8 ms [2022-01-27 13:50:12 main:574] : INFO : Epoch 1978 | loss: 0.0311643 | val_loss: 0.0311801 | Time: 37362.4 ms [2022-01-27 13:50:50 main:574] : INFO : Epoch 1979 | loss: 0.0311652 | val_loss: 0.0311742 | Time: 38138.1 ms [2022-01-27 13:51:49 main:574] : INFO : Epoch 1980 | loss: 0.0311626 | val_loss: 0.0311735 | Time: 59144.2 ms [2022-01-27 13:52:38 main:574] : INFO : Epoch 1981 | loss: 0.0311617 | val_loss: 0.0311721 | Time: 49212 ms [2022-01-27 13:53:16 main:574] : INFO : Epoch 1982 | loss: 0.0311612 | val_loss: 0.0311739 | Time: 37635.1 ms [2022-01-27 13:54:05 main:574] : INFO : Epoch 1983 | loss: 0.0311625 | val_loss: 0.0311756 | Time: 48842.5 ms [2022-01-27 13:54:43 main:574] : INFO : Epoch 1984 | loss: 0.0311625 | val_loss: 0.031173 | Time: 37815.1 ms [2022-01-27 13:58:49 main:574] : INFO : Epoch 1985 | loss: 0.0311613 | val_loss: 0.0311744 | Time: 246402 ms [2022-01-27 13:59:03 main:574] : INFO : Epoch 1986 | loss: 0.0311629 | val_loss: 0.031172 | Time: 13873.8 ms [2022-01-27 13:59:21 main:574] : INFO : Epoch 1987 | loss: 0.0311635 | val_loss: 0.0311731 | Time: 18507.2 ms [2022-01-27 13:59:48 main:574] : INFO : Epoch 1988 | loss: 0.0311601 | val_loss: 0.0311727 | Time: 26509.3 ms [2022-01-27 14:00:16 main:574] : INFO : Epoch 1989 | loss: 0.0311593 | val_loss: 0.0311743 | Time: 27638.8 ms [2022-01-27 14:00:42 main:574] : INFO : Epoch 1990 | loss: 0.0311596 | val_loss: 0.0311734 | Time: 25912.2 ms [2022-01-27 14:01:06 main:574] : INFO : Epoch 1991 | loss: 0.0311606 | val_loss: 0.0311736 | Time: 24447.3 ms [2022-01-27 14:01:31 main:574] : INFO : Epoch 1992 | loss: 0.0311626 | val_loss: 0.0311784 | Time: 25499.5 ms [2022-01-27 14:01:57 main:574] : INFO : Epoch 1993 | loss: 0.0311583 | val_loss: 0.0311756 | Time: 25956.4 ms [2022-01-27 14:02:22 main:574] : INFO : Epoch 1994 | loss: 0.0311578 | val_loss: 0.0311797 | Time: 24789.8 ms [2022-01-27 14:02:47 main:574] : INFO : Epoch 1995 | loss: 0.0311591 | val_loss: 0.0311722 | Time: 25103.8 ms [2022-01-27 14:03:14 main:574] : INFO : Epoch 1996 | loss: 0.0311591 | val_loss: 0.0311755 | Time: 26144.3 ms [2022-01-27 14:03:39 main:574] : INFO : Epoch 1997 | loss: 0.0311613 | val_loss: 0.0311737 | Time: 25554.6 ms [2022-01-27 14:04:05 main:574] : INFO : Epoch 1998 | loss: 0.0311606 | val_loss: 0.0311764 | Time: 26095.3 ms [2022-01-27 14:04:32 main:574] : INFO : Epoch 1999 | loss: 0.0311623 | val_loss: 0.031177 | Time: 26588.7 ms [2022-01-27 14:04:59 main:574] : INFO : Epoch 2000 | loss: 0.0311625 | val_loss: 0.0311708 | Time: 26722.6 ms [2022-01-27 14:05:25 main:574] : INFO : Epoch 2001 | loss: 0.0311636 | val_loss: 0.0311723 | Time: 26257.8 ms [2022-01-27 14:05:51 main:574] : INFO : Epoch 2002 | loss: 0.0311642 | val_loss: 0.0311738 | Time: 26273.3 ms [2022-01-27 14:06:17 main:574] : INFO : Epoch 2003 | loss: 0.0311602 | val_loss: 0.0311716 | Time: 25561.7 ms [2022-01-27 14:06:43 main:574] : INFO : Epoch 2004 | loss: 0.0311589 | val_loss: 0.0311722 | Time: 26434.7 ms [2022-01-27 14:07:11 main:574] : INFO : Epoch 2005 | loss: 0.0311618 | val_loss: 0.0311747 | Time: 27759.8 ms [2022-01-27 14:07:38 main:574] : INFO : Epoch 2006 | loss: 0.0311634 | val_loss: 0.0311732 | Time: 26950.9 ms [2022-01-27 14:07:47 main:574] : INFO : Epoch 2007 | loss: 0.0311625 | val_loss: 0.031172 | Time: 9498.53 ms [2022-01-27 14:07:56 main:574] : INFO : Epoch 2008 | loss: 0.0311612 | val_loss: 0.0311718 | Time: 8280.04 ms [2022-01-27 14:08:04 main:574] : INFO : Epoch 2009 | loss: 0.0311602 | val_loss: 0.031171 | Time: 8454.22 ms [2022-01-27 14:08:13 main:574] : INFO : Epoch 2010 | loss: 0.0311593 | val_loss: 0.0311714 | Time: 8919.81 ms [2022-01-27 14:08:22 main:574] : INFO : Epoch 2011 | loss: 0.0311592 | val_loss: 0.0311738 | Time: 8686.22 ms [2022-01-27 14:08:30 main:574] : INFO : Epoch 2012 | loss: 0.0311612 | val_loss: 0.0311759 | Time: 8373.65 ms [2022-01-27 14:08:39 main:574] : INFO : Epoch 2013 | loss: 0.0311595 | val_loss: 0.0311728 | Time: 8334.14 ms [2022-01-27 14:08:47 main:574] : INFO : Epoch 2014 | loss: 0.0311575 | val_loss: 0.0311746 | Time: 8720.67 ms [2022-01-27 14:08:56 main:574] : INFO : Epoch 2015 | loss: 0.03116 | val_loss: 0.0311824 | Time: 8636.33 ms [2022-01-27 14:09:04 main:574] : INFO : Epoch 2016 | loss: 0.0311614 | val_loss: 0.0311726 | Time: 8260.61 ms [2022-01-27 14:09:13 main:574] : INFO : Epoch 2017 | loss: 0.0311625 | val_loss: 0.0311816 | Time: 8378.62 ms [2022-01-27 14:09:21 main:574] : INFO : Epoch 2018 | loss: 0.031159 | val_loss: 0.0311748 | Time: 8625.95 ms [2022-01-27 14:09:29 main:574] : INFO : Epoch 2019 | loss: 0.031158 | val_loss: 0.0311749 | Time: 8150.38 ms [2022-01-27 14:09:38 main:574] : INFO : Epoch 2020 | loss: 0.0311635 | val_loss: 0.0311762 | Time: 8828.59 ms [2022-01-27 14:09:47 main:574] : INFO : Epoch 2021 | loss: 0.0311642 | val_loss: 0.0311718 | Time: 8407.69 ms [2022-01-27 14:09:56 main:574] : INFO : Epoch 2022 | loss: 0.0311624 | val_loss: 0.03118 | Time: 8840.54 ms [2022-01-27 14:10:04 main:574] : INFO : Epoch 2023 | loss: 0.0311596 | val_loss: 0.0311712 | Time: 8827.52 ms [2022-01-27 14:10:14 main:574] : INFO : Epoch 2024 | loss: 0.0311591 | val_loss: 0.0311707 | Time: 9182.9 ms [2022-01-27 14:10:22 main:574] : INFO : Epoch 2025 | loss: 0.0311578 | val_loss: 0.0311717 | Time: 8880.52 ms [2022-01-27 14:10:31 main:574] : INFO : Epoch 2026 | loss: 0.0311572 | val_loss: 0.0311692 | Time: 8388.78 ms [2022-01-27 14:10:40 main:574] : INFO : Epoch 2027 | loss: 0.0311552 | val_loss: 0.0311697 | Time: 8742.45 ms [2022-01-27 14:10:48 main:574] : INFO : Epoch 2028 | loss: 0.0311544 | val_loss: 0.0311693 | Time: 8273.14 ms [2022-01-27 14:10:57 main:574] : INFO : Epoch 2029 | loss: 0.0311558 | val_loss: 0.0311714 | Time: 8611.31 ms [2022-01-27 14:11:05 main:574] : INFO : Epoch 2030 | loss: 0.0311554 | val_loss: 0.0311686 | Time: 8251.45 ms [2022-01-27 14:11:13 main:574] : INFO : Epoch 2031 | loss: 0.0311546 | val_loss: 0.0311703 | Time: 8488.85 ms [2022-01-27 14:11:22 main:574] : INFO : Epoch 2032 | loss: 0.0311545 | val_loss: 0.0311682 | Time: 8426.26 ms [2022-01-27 14:11:30 main:574] : INFO : Epoch 2033 | loss: 0.0311551 | val_loss: 0.0311696 | Time: 8746.67 ms [2022-01-27 14:11:39 main:574] : INFO : Epoch 2034 | loss: 0.0311578 | val_loss: 0.0311733 | Time: 8391.7 ms [2022-01-27 14:11:47 main:574] : INFO : Epoch 2035 | loss: 0.0311566 | val_loss: 0.0311693 | Time: 8314.27 ms [2022-01-27 14:11:56 main:574] : INFO : Epoch 2036 | loss: 0.0311547 | val_loss: 0.0311721 | Time: 8475.42 ms [2022-01-27 14:12:04 main:574] : INFO : Epoch 2037 | loss: 0.0311542 | val_loss: 0.0311714 | Time: 8633.98 ms [2022-01-27 14:12:13 main:574] : INFO : Epoch 2038 | loss: 0.0311519 | val_loss: 0.0311716 | Time: 8287.74 ms [2022-01-27 14:12:21 main:574] : INFO : Epoch 2039 | loss: 0.0311525 | val_loss: 0.0311706 | Time: 8072.64 ms [2022-01-27 14:12:29 main:574] : INFO : Epoch 2040 | loss: 0.0311743 | val_loss: 0.0311896 | Time: 8340.76 ms [2022-01-27 14:12:37 main:574] : INFO : Epoch 2041 | loss: 0.0311782 | val_loss: 0.0311729 | Time: 8326.79 ms [2022-01-27 14:12:46 main:574] : INFO : Epoch 2042 | loss: 0.0311711 | val_loss: 0.0311727 | Time: 8765.18 ms [2022-01-27 14:12:54 main:574] : INFO : Epoch 2043 | loss: 0.0311682 | val_loss: 0.0311759 | Time: 8010.02 ms [2022-01-27 14:13:03 main:574] : INFO : Epoch 2044 | loss: 0.0311672 | val_loss: 0.0311712 | Time: 8298.23 ms [2022-01-27 14:13:11 main:574] : INFO : Epoch 2045 | loss: 0.0311663 | val_loss: 0.0311713 | Time: 8354.33 ms [2022-01-27 14:13:19 main:574] : INFO : Epoch 2046 | loss: 0.0311657 | val_loss: 0.0311713 | Time: 8126.2 ms [2022-01-27 14:13:27 main:574] : INFO : Epoch 2047 | loss: 0.0311646 | val_loss: 0.0311704 | Time: 8376.75 ms [2022-01-27 14:13:36 main:574] : INFO : Epoch 2048 | loss: 0.031162 | val_loss: 0.03117 | Time: 8439.08 ms [2022-01-27 14:13:36 main:597] : INFO : Saving trained model to model-final.pt, val_loss 0.03117 [2022-01-27 14:13:36 main:603] : INFO : Saving end state to config to file [2022-01-27 14:13:36 main:608] : INFO : Success, exiting.. 14:13:36 (1892): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)