Task 10807828
| Name | ParityModified-1639949071-15204-2-0_0 |
| Workunit | 8118564 |
| Created | 16 Jan 2022, 2:35:01 UTC |
| Sent | 2 Feb 2022, 10:12:17 UTC |
| Report deadline | 10 Feb 2022, 10:12:17 UTC |
| Received | 7 Feb 2022, 12:30:24 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 6180 |
| Run time | 3 hours 39 min 39 sec |
| CPU time | 3 hours 10 min 59 sec |
| Validate state | Valid |
| Credit | 4,160.00 |
| Device peak FLOPS | 884.73 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.54 GB |
| Peak swap size | 3.44 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version> <![CDATA[ <stderr_txt> t filename: dataset.hdf5 [2022-02-03 18:43:22 main:474] : INFO : Configuration: [2022-02-03 18:43:22 main:475] : INFO : Model type: GRU [2022-02-03 18:43:22 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-03 18:43:22 main:477] : INFO : Max Epochs: 2048 [2022-02-03 18:43:22 main:478] : INFO : Batch Size: 128 [2022-02-03 18:43:22 main:479] : INFO : Learning Rate: 0.01 [2022-02-03 18:43:22 main:480] : INFO : Patience: 10 [2022-02-03 18:43:22 main:481] : INFO : Hidden Width: 12 [2022-02-03 18:43:22 main:482] : INFO : # Recurrent Layers: 4 [2022-02-03 18:43:22 main:483] : INFO : # Backend Layers: 4 [2022-02-03 18:43:22 main:484] : INFO : # Threads: 1 [2022-02-03 18:43:22 main:486] : INFO : Preparing Dataset [2022-02-03 18:43:22 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-03 18:43:23 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-03 18:43:25 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-03 18:43:25 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-03 18:43:25 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-03 18:43:25 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-03 18:43:25 main:494] : INFO : Creating Model [2022-02-03 18:43:25 main:507] : INFO : Preparing config file [2022-02-03 18:43:25 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-03 18:43:25 main:512] : INFO : Loading config [2022-02-03 18:43:25 main:514] : INFO : Loading state [2022-02-03 18:43:26 main:559] : INFO : Loading DataLoader into Memory [2022-02-03 18:43:26 main:562] : INFO : Starting Training Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-02-03 18:44:32 main:435] : INFO : Set logging level to 1 [2022-02-03 18:44:32 main:441] : INFO : Running in BOINC Client mode [2022-02-03 18:44:32 main:444] : INFO : Resolving all filenames [2022-02-03 18:44:32 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-03 18:44:32 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-03 18:44:32 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-03 18:44:32 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-03 18:44:32 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-03 18:44:32 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-03 18:44:32 main:474] : INFO : Configuration: [2022-02-03 18:44:32 main:475] : INFO : Model type: GRU [2022-02-03 18:44:32 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-03 18:44:32 main:477] : INFO : Max Epochs: 2048 [2022-02-03 18:44:32 main:478] : INFO : Batch Size: 128 [2022-02-03 18:44:32 main:479] : INFO : Learning Rate: 0.01 [2022-02-03 18:44:32 main:480] : INFO : Patience: 10 [2022-02-03 18:44:32 main:481] : INFO : Hidden Width: 12 [2022-02-03 18:44:32 main:482] : INFO : # Recurrent Layers: 4 [2022-02-03 18:44:32 main:483] : INFO : # Backend Layers: 4 [2022-02-03 18:44:32 main:484] : INFO : # Threads: 1 [2022-02-03 18:44:32 main:486] : INFO : Preparing Dataset [2022-02-03 18:44:32 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-03 18:44:33 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-03 18:44:35 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-03 18:44:35 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-03 18:44:35 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-03 18:44:35 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-03 18:44:35 main:494] : INFO : Creating Model [2022-02-03 18:44:35 main:507] : INFO : Preparing config file [2022-02-03 18:44:35 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-03 18:44:35 main:512] : INFO : Loading config [2022-02-03 18:44:35 main:514] : INFO : Loading state [2022-02-03 18:44:36 main:559] : INFO : Loading DataLoader into Memory [2022-02-03 18:44:36 main:562] : INFO : Starting Training [2022-02-03 18:44:43 main:574] : INFO : Epoch 1791 | loss: 0.031203 | val_loss: 0.0311829 | Time: 6560.18 ms [2022-02-03 18:44:49 main:574] : INFO : Epoch 1792 | loss: 0.0311456 | val_loss: 0.0311697 | Time: 6292.38 ms [2022-02-03 18:44:55 main:574] : INFO : Epoch 1793 | loss: 0.0311381 | val_loss: 0.0311688 | Time: 6259.69 ms [2022-02-03 18:45:01 main:574] : INFO : Epoch 1794 | loss: 0.0311365 | val_loss: 0.0311706 | Time: 6286.97 ms [2022-02-03 18:45:08 main:574] : INFO : Epoch 1795 | loss: 0.0311364 | val_loss: 0.0311751 | Time: 6280.02 ms [2022-02-03 18:45:14 main:574] : INFO : Epoch 1796 | loss: 0.0311362 | val_loss: 0.0311708 | Time: 6281.37 ms [2022-02-03 18:45:20 main:574] : INFO : Epoch 1797 | loss: 0.0311351 | val_loss: 0.0311691 | Time: 6252.11 ms [2022-02-03 18:45:27 main:574] : INFO : Epoch 1798 | loss: 0.0311334 | val_loss: 0.0311741 | Time: 6258.8 ms [2022-02-03 18:45:33 main:574] : INFO : Epoch 1799 | loss: 0.0311343 | val_loss: 0.031171 | Time: 6308.15 ms [2022-02-03 18:45:39 main:574] : INFO : Epoch 1800 | loss: 0.0311355 | val_loss: 0.0311714 | Time: 6269.47 ms [2022-02-03 18:45:45 main:574] : INFO : Epoch 1801 | loss: 0.0311337 | val_loss: 0.0311721 | Time: 6275.26 ms [2022-02-03 18:45:52 main:574] : INFO : Epoch 1802 | loss: 0.0311342 | val_loss: 0.0311792 | Time: 6281.95 ms [2022-02-03 18:45:58 main:574] : INFO : Epoch 1803 | loss: 0.0311342 | val_loss: 0.0311688 | Time: 6298.34 ms [2022-02-03 18:46:04 main:574] : INFO : Epoch 1804 | loss: 0.0311349 | val_loss: 0.0311686 | Time: 6355.6 ms [2022-02-03 18:46:11 main:574] : INFO : Epoch 1805 | loss: 0.0311346 | val_loss: 0.0311831 | Time: 6268.39 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-02-03 18:47:28 main:435] : INFO : Set logging level to 1 [2022-02-03 18:47:28 main:441] : INFO : Running in BOINC Client mode [2022-02-03 18:47:28 main:444] : INFO : Resolving all filenames [2022-02-03 18:47:28 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-03 18:47:28 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-03 18:47:28 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-03 18:47:28 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-03 18:47:28 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-03 18:47:28 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-03 18:47:28 main:474] : INFO : Configuration: [2022-02-03 18:47:28 main:475] : INFO : Model type: GRU [2022-02-03 18:47:28 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-03 18:47:28 main:477] : INFO : Max Epochs: 2048 [2022-02-03 18:47:28 main:478] : INFO : Batch Size: 128 [2022-02-03 18:47:28 main:479] : INFO : Learning Rate: 0.01 [2022-02-03 18:47:28 main:480] : INFO : Patience: 10 [2022-02-03 18:47:28 main:481] : INFO : Hidden Width: 12 [2022-02-03 18:47:28 main:482] : INFO : # Recurrent Layers: 4 [2022-02-03 18:47:28 main:483] : INFO : # Backend Layers: 4 [2022-02-03 18:47:28 main:484] : INFO : # Threads: 1 [2022-02-03 18:47:28 main:486] : INFO : Preparing Dataset [2022-02-03 18:47:28 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-03 18:47:28 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-03 18:47:31 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-03 18:47:31 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-03 18:47:31 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-03 18:47:31 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-03 18:47:31 main:494] : INFO : Creating Model [2022-02-03 18:47:31 main:507] : INFO : Preparing config file [2022-02-03 18:47:31 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-03 18:47:31 main:512] : INFO : Loading config [2022-02-03 18:47:31 main:514] : INFO : Loading state [2022-02-03 18:47:32 main:559] : INFO : Loading DataLoader into Memory [2022-02-03 18:47:32 main:562] : INFO : Starting Training [2022-02-03 18:47:38 main:574] : INFO : Epoch 1802 | loss: 0.0312191 | val_loss: 0.0311863 | Time: 6563.87 ms [2022-02-03 18:47:45 main:574] : INFO : Epoch 1803 | loss: 0.0311433 | val_loss: 0.0311758 | Time: 6272.81 ms [2022-02-03 18:47:51 main:574] : INFO : Epoch 1804 | loss: 0.0311353 | val_loss: 0.0311711 | Time: 6282.74 ms [2022-02-03 18:47:57 main:574] : INFO : Epoch 1805 | loss: 0.0311333 | val_loss: 0.0311708 | Time: 6304.64 ms [2022-02-03 18:48:04 main:574] : INFO : Epoch 1806 | loss: 0.0311346 | val_loss: 0.0311756 | Time: 6299.36 ms [2022-02-03 18:48:10 main:574] : INFO : Epoch 1807 | loss: 0.0311335 | val_loss: 0.0311743 | Time: 6284.79 ms [2022-02-03 18:48:16 main:574] : INFO : Epoch 1808 | loss: 0.0311328 | val_loss: 0.0311743 | Time: 6290.54 ms [2022-02-03 18:48:22 main:574] : INFO : Epoch 1809 | loss: 0.0311354 | val_loss: 0.0311803 | Time: 6266.83 ms [2022-02-03 18:48:29 main:574] : INFO : Epoch 1810 | loss: 0.031135 | val_loss: 0.0311738 | Time: 6281.95 ms [2022-02-03 18:48:35 main:574] : INFO : Epoch 1811 | loss: 0.0311344 | val_loss: 0.0311751 | Time: 6293.18 ms [2022-02-03 18:48:41 main:574] : INFO : Epoch 1812 | loss: 0.0311358 | val_loss: 0.0311728 | Time: 6272.87 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-02-03 18:50:35 main:435] : INFO : Set logging level to 1 [2022-02-03 18:50:35 main:441] : INFO : Running in BOINC Client mode [2022-02-03 18:50:35 main:444] : INFO : Resolving all filenames [2022-02-03 18:50:35 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-03 18:50:35 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-03 18:50:35 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-03 18:50:35 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-03 18:50:35 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-03 18:50:35 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-03 18:50:35 main:474] : INFO : Configuration: [2022-02-03 18:50:35 main:475] : INFO : Model type: GRU [2022-02-03 18:50:35 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-03 18:50:35 main:477] : INFO : Max Epochs: 2048 [2022-02-03 18:50:35 main:478] : INFO : Batch Size: 128 [2022-02-03 18:50:35 main:479] : INFO : Learning Rate: 0.01 [2022-02-03 18:50:35 main:480] : INFO : Patience: 10 [2022-02-03 18:50:35 main:481] : INFO : Hidden Width: 12 [2022-02-03 18:50:35 main:482] : INFO : # Recurrent Layers: 4 [2022-02-03 18:50:35 main:483] : INFO : # Backend Layers: 4 [2022-02-03 18:50:35 main:484] : INFO : # Threads: 1 [2022-02-03 18:50:35 main:486] : INFO : Preparing Dataset [2022-02-03 18:50:35 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-03 18:50:35 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-03 18:50:37 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-03 18:50:37 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-03 18:50:38 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-03 18:50:38 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-03 18:50:38 main:494] : INFO : Creating Model [2022-02-03 18:50:38 main:507] : INFO : Preparing config file [2022-02-03 18:50:38 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-03 18:50:38 main:512] : INFO : Loading config [2022-02-03 18:50:38 main:514] : INFO : Loading state [2022-02-03 18:50:38 main:559] : INFO : Loading DataLoader into Memory [2022-02-03 18:50:38 main:562] : INFO : Starting Training [2022-02-03 18:50:45 main:574] : INFO : Epoch 1812 | loss: 0.0312194 | val_loss: 0.0311829 | Time: 6569.04 ms [2022-02-03 18:50:51 main:574] : INFO : Epoch 1813 | loss: 0.0311444 | val_loss: 0.0311737 | Time: 6253.36 ms [2022-02-03 18:50:58 main:574] : INFO : Epoch 1814 | loss: 0.0311368 | val_loss: 0.0311734 | Time: 6283.35 ms [2022-02-03 18:51:04 main:574] : INFO : Epoch 1815 | loss: 0.0311344 | val_loss: 0.0311781 | Time: 6286.88 ms [2022-02-03 18:51:10 main:574] : INFO : Epoch 1816 | loss: 0.0311335 | val_loss: 0.031171 | Time: 6273.4 ms [2022-02-03 18:51:16 main:574] : INFO : Epoch 1817 | loss: 0.0311346 | val_loss: 0.0311742 | Time: 6261.29 ms [2022-02-03 18:51:23 main:574] : INFO : Epoch 1818 | loss: 0.0311349 | val_loss: 0.031178 | Time: 6290.84 ms [2022-02-03 18:51:29 main:574] : INFO : Epoch 1819 | loss: 0.0311343 | val_loss: 0.0311745 | Time: 6305.84 ms [2022-02-03 18:51:35 main:574] : INFO : Epoch 1820 | loss: 0.031141 | val_loss: 0.0311751 | Time: 6287.18 ms [2022-02-03 18:51:42 main:574] : INFO : Epoch 1821 | loss: 0.031145 | val_loss: 0.031172 | Time: 6311.43 ms [2022-02-03 18:51:48 main:574] : INFO : Epoch 1822 | loss: 0.0311401 | val_loss: 0.0311753 | Time: 6251.74 ms [2022-02-03 18:51:54 main:574] : INFO : Epoch 1823 | loss: 0.0311368 | val_loss: 0.0311788 | Time: 6301.77 ms [2022-02-03 18:52:00 main:574] : INFO : Epoch 1824 | loss: 0.0311362 | val_loss: 0.0311748 | Time: 6250.42 ms [2022-02-03 18:52:07 main:574] : INFO : Epoch 1825 | loss: 0.0311345 | val_loss: 0.0311691 | Time: 6259.07 ms [2022-02-03 18:52:13 main:574] : INFO : Epoch 1826 | loss: 0.0311332 | val_loss: 0.0311773 | Time: 6305.07 ms [2022-02-03 18:52:19 main:574] : INFO : Epoch 1827 | loss: 0.0311349 | val_loss: 0.0311764 | Time: 6326.14 ms [2022-02-03 18:52:26 main:574] : INFO : Epoch 1828 | loss: 0.0311344 | val_loss: 0.0311724 | Time: 6290.04 ms [2022-02-03 18:52:32 main:574] : INFO : Epoch 1829 | loss: 0.0311312 | val_loss: 0.0311736 | Time: 6270.17 ms [2022-02-03 18:52:38 main:574] : INFO : Epoch 1830 | loss: 0.0311361 | val_loss: 0.0311672 | Time: 6300.48 ms [2022-02-03 18:52:45 main:574] : INFO : Epoch 1831 | loss: 0.0311379 | val_loss: 0.031171 | Time: 6274.47 ms [2022-02-03 18:52:51 main:574] : INFO : Epoch 1832 | loss: 0.0311368 | val_loss: 0.0311737 | Time: 6255.27 ms [2022-02-03 18:52:57 main:574] : INFO : Epoch 1833 | loss: 0.0311323 | val_loss: 0.0311766 | Time: 6287.09 ms [2022-02-03 18:53:03 main:574] : INFO : Epoch 1834 | loss: 0.031132 | val_loss: 0.0311716 | Time: 6309.96 ms [2022-02-03 18:53:10 main:574] : INFO : Epoch 1835 | loss: 0.031131 | val_loss: 0.0311697 | Time: 6282.42 ms [2022-02-03 18:53:16 main:574] : INFO : Epoch 1836 | loss: 0.0311313 | val_loss: 0.031172 | Time: 6280.36 ms [2022-02-03 18:53:22 main:574] : INFO : Epoch 1837 | loss: 0.0311304 | val_loss: 0.0311731 | Time: 6307.98 ms [2022-02-03 18:53:29 main:574] : INFO : Epoch 1838 | loss: 0.0311478 | val_loss: 0.0311691 | Time: 6274.69 ms [2022-02-03 18:53:35 main:574] : INFO : Epoch 1839 | loss: 0.0311569 | val_loss: 0.0311688 | Time: 6357.23 ms [2022-02-03 18:53:41 main:574] : INFO : Epoch 1840 | loss: 0.0311528 | val_loss: 0.0311673 | Time: 6364.64 ms [2022-02-03 18:53:48 main:574] : INFO : Epoch 1841 | loss: 0.0311544 | val_loss: 0.0311627 | Time: 6273.77 ms [2022-02-03 18:53:54 main:574] : INFO : Epoch 1842 | loss: 0.0311508 | val_loss: 0.0311636 | Time: 6301.63 ms [2022-02-03 18:54:00 main:574] : INFO : Epoch 1843 | loss: 0.0311502 | val_loss: 0.0311643 | Time: 6320.71 ms [2022-02-03 18:54:07 main:574] : INFO : Epoch 1844 | loss: 0.0311493 | val_loss: 0.0311661 | Time: 6355.91 ms [2022-02-03 18:54:13 main:574] : INFO : Epoch 1845 | loss: 0.0311466 | val_loss: 0.031166 | Time: 6381.23 ms [2022-02-03 18:54:19 main:574] : INFO : Epoch 1846 | loss: 0.0311453 | val_loss: 0.0311654 | Time: 6360.55 ms [2022-02-03 18:54:26 main:574] : INFO : Epoch 1847 | loss: 0.031144 | val_loss: 0.0311696 | Time: 6298.61 ms [2022-02-03 18:54:32 main:574] : INFO : Epoch 1848 | loss: 0.0311412 | val_loss: 0.0311692 | Time: 6330.43 ms [2022-02-03 18:54:38 main:574] : INFO : Epoch 1849 | loss: 0.0311405 | val_loss: 0.0311716 | Time: 6355.35 ms [2022-02-03 18:54:45 main:574] : INFO : Epoch 1850 | loss: 0.0311409 | val_loss: 0.0311678 | Time: 6340.74 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-02-03 18:55:48 main:435] : INFO : Set logging level to 1 [2022-02-03 18:55:48 main:441] : INFO : Running in BOINC Client mode [2022-02-03 18:55:48 main:444] : INFO : Resolving all filenames [2022-02-03 18:55:48 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-03 18:55:48 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-03 18:55:48 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-03 18:55:48 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-03 18:55:48 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-03 18:55:48 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-03 18:55:48 main:474] : INFO : Configuration: [2022-02-03 18:55:48 main:475] : INFO : Model type: GRU [2022-02-03 18:55:48 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-03 18:55:48 main:477] : INFO : Max Epochs: 2048 [2022-02-03 18:55:48 main:478] : INFO : Batch Size: 128 [2022-02-03 18:55:48 main:479] : INFO : Learning Rate: 0.01 [2022-02-03 18:55:48 main:480] : INFO : Patience: 10 [2022-02-03 18:55:48 main:481] : INFO : Hidden Width: 12 [2022-02-03 18:55:48 main:482] : INFO : # Recurrent Layers: 4 [2022-02-03 18:55:48 main:483] : INFO : # Backend Layers: 4 [2022-02-03 18:55:48 main:484] : INFO : # Threads: 1 [2022-02-03 18:55:48 main:486] : INFO : Preparing Dataset [2022-02-03 18:55:48 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-03 18:55:48 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-03 18:55:51 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-03 18:55:51 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-03 18:55:51 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-03 18:55:51 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-03 18:55:51 main:494] : INFO : Creating Model [2022-02-03 18:55:51 main:507] : INFO : Preparing config file [2022-02-03 18:55:51 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-03 18:55:51 main:512] : INFO : Loading config [2022-02-03 18:55:51 main:514] : INFO : Loading state [2022-02-03 18:55:52 main:559] : INFO : Loading DataLoader into Memory [2022-02-03 18:55:52 main:562] : INFO : Starting Training [2022-02-03 18:55:58 main:574] : INFO : Epoch 1845 | loss: 0.0311939 | val_loss: 0.0311711 | Time: 6576.69 ms [2022-02-03 18:56:05 main:574] : INFO : Epoch 1846 | loss: 0.0311519 | val_loss: 0.0311654 | Time: 6266.92 ms [2022-02-03 18:56:11 main:574] : INFO : Epoch 1847 | loss: 0.0311497 | val_loss: 0.031168 | Time: 6244.53 ms [2022-02-03 18:56:17 main:574] : INFO : Epoch 1848 | loss: 0.0311483 | val_loss: 0.0311679 | Time: 6244.19 ms [2022-02-03 18:56:23 main:574] : INFO : Epoch 1849 | loss: 0.0311494 | val_loss: 0.0311721 | Time: 6261.24 ms [2022-02-03 18:56:30 main:574] : INFO : Epoch 1850 | loss: 0.0311536 | val_loss: 0.0311659 | Time: 6264.83 ms [2022-02-03 18:56:36 main:574] : INFO : Epoch 1851 | loss: 0.0311548 | val_loss: 0.0311653 | Time: 6311.95 ms [2022-02-03 18:56:42 main:574] : INFO : Epoch 1852 | loss: 0.0311523 | val_loss: 0.0311646 | Time: 6317.41 ms [2022-02-03 18:56:49 main:574] : INFO : Epoch 1853 | loss: 0.0311498 | val_loss: 0.0311626 | Time: 6272.88 ms [2022-02-03 18:56:55 main:574] : INFO : Epoch 1854 | loss: 0.0311499 | val_loss: 0.0311631 | Time: 6268.95 ms [2022-02-03 18:57:01 main:574] : INFO : Epoch 1855 | loss: 0.0311555 | val_loss: 0.0311618 | Time: 6255.91 ms [2022-02-03 18:57:07 main:574] : INFO : Epoch 1856 | loss: 0.0311603 | val_loss: 0.0311667 | Time: 6301.36 ms [2022-02-03 18:57:14 main:574] : INFO : Epoch 1857 | loss: 0.0311588 | val_loss: 0.0311664 | Time: 6258.33 ms [2022-02-03 18:57:20 main:574] : INFO : Epoch 1858 | loss: 0.0311596 | val_loss: 0.0311703 | Time: 6268.34 ms [2022-02-03 18:57:26 main:574] : INFO : Epoch 1859 | loss: 0.0311582 | val_loss: 0.0311707 | Time: 6283.88 ms [2022-02-03 18:57:32 main:574] : INFO : Epoch 1860 | loss: 0.0311618 | val_loss: 0.0311662 | Time: 6262.21 ms [2022-02-03 18:57:39 main:574] : INFO : Epoch 1861 | loss: 0.031161 | val_loss: 0.031169 | Time: 6280.16 ms [2022-02-03 18:57:45 main:574] : INFO : Epoch 1862 | loss: 0.0311601 | val_loss: 0.0311664 | Time: 6279.03 ms [2022-02-03 18:57:51 main:574] : INFO : Epoch 1863 | loss: 0.0311592 | val_loss: 0.0311667 | Time: 6295.42 ms [2022-02-03 18:57:58 main:574] : INFO : Epoch 1864 | loss: 0.0311577 | val_loss: 0.031168 | Time: 6319.68 ms [2022-02-03 18:58:04 main:574] : INFO : Epoch 1865 | loss: 0.0311552 | val_loss: 0.0311687 | Time: 6269.36 ms [2022-02-03 18:58:10 main:574] : INFO : Epoch 1866 | loss: 0.0311548 | val_loss: 0.0311684 | Time: 6255.79 ms [2022-02-03 18:58:16 main:574] : INFO : Epoch 1867 | loss: 0.0311541 | val_loss: 0.0311658 | Time: 6257.92 ms [2022-02-03 18:58:23 main:574] : INFO : Epoch 1868 | loss: 0.031153 | val_loss: 0.0311722 | Time: 6264.47 ms [2022-02-03 18:58:29 main:574] : INFO : Epoch 1869 | loss: 0.0311527 | val_loss: 0.0311683 | Time: 6265.3 ms [2022-02-03 18:58:35 main:574] : INFO : Epoch 1870 | loss: 0.0311527 | val_loss: 0.0311738 | Time: 6266.15 ms [2022-02-03 18:58:42 main:574] : INFO : Epoch 1871 | loss: 0.0311537 | val_loss: 0.0311716 | Time: 6283.68 ms [2022-02-03 18:58:48 main:574] : INFO : Epoch 1872 | loss: 0.0311523 | val_loss: 0.0311691 | Time: 6368.65 ms [2022-02-03 18:58:54 main:574] : INFO : Epoch 1873 | loss: 0.0311513 | val_loss: 0.0311726 | Time: 6348.02 ms [2022-02-03 18:59:01 main:574] : INFO : Epoch 1874 | loss: 0.0311501 | val_loss: 0.0311695 | Time: 6399.96 ms [2022-02-03 18:59:07 main:574] : INFO : Epoch 1875 | loss: 0.0311493 | val_loss: 0.0311687 | Time: 6351.27 ms [2022-02-03 18:59:13 main:574] : INFO : Epoch 1876 | loss: 0.0311485 | val_loss: 0.0311702 | Time: 6294.2 ms [2022-02-03 18:59:20 main:574] : INFO : Epoch 1877 | loss: 0.0311494 | val_loss: 0.0311691 | Time: 6288.42 ms [2022-02-03 18:59:26 main:574] : INFO : Epoch 1878 | loss: 0.031148 | val_loss: 0.0311707 | Time: 6339 ms [2022-02-03 18:59:32 main:574] : INFO : Epoch 1879 | loss: 0.0311504 | val_loss: 0.0311744 | Time: 6305.51 ms [2022-02-03 18:59:39 main:574] : INFO : Epoch 1880 | loss: 0.0311514 | val_loss: 0.0311653 | Time: 6287.64 ms [2022-02-03 18:59:45 main:574] : INFO : Epoch 1881 | loss: 0.0311504 | val_loss: 0.0311676 | Time: 6271.09 ms [2022-02-03 18:59:51 main:574] : INFO : Epoch 1882 | loss: 0.0311509 | val_loss: 0.031175 | Time: 6262.15 ms [2022-02-03 18:59:57 main:574] : INFO : Epoch 1883 | loss: 0.0311581 | val_loss: 0.0311699 | Time: 6268.17 ms [2022-02-03 19:00:04 main:574] : INFO : Epoch 1884 | loss: 0.0311656 | val_loss: 0.0311719 | Time: 6286.44 ms [2022-02-03 19:00:10 main:574] : INFO : Epoch 1885 | loss: 0.0311674 | val_loss: 0.0311737 | Time: 6294.68 ms [2022-02-03 19:00:16 main:574] : INFO : Epoch 1886 | loss: 0.0311656 | val_loss: 0.0311727 | Time: 6309.25 ms [2022-02-03 19:00:23 main:574] : INFO : Epoch 1887 | loss: 0.0311642 | val_loss: 0.0311729 | Time: 6334.13 ms [2022-02-03 19:00:29 main:574] : INFO : Epoch 1888 | loss: 0.0311632 | val_loss: 0.0311753 | Time: 6316.24 ms [2022-02-03 19:00:35 main:574] : INFO : Epoch 1889 | loss: 0.0311628 | val_loss: 0.0311722 | Time: 6298.5 ms [2022-02-03 19:00:42 main:574] : INFO : Epoch 1890 | loss: 0.0311626 | val_loss: 0.0311733 | Time: 6274.3 ms [2022-02-03 19:00:48 main:574] : INFO : Epoch 1891 | loss: 0.031163 | val_loss: 0.0311724 | Time: 6318.96 ms [2022-02-03 19:00:54 main:574] : INFO : Epoch 1892 | loss: 0.0311606 | val_loss: 0.0311715 | Time: 6272.75 ms [2022-02-03 19:01:00 main:574] : INFO : Epoch 1893 | loss: 0.0311609 | val_loss: 0.0311746 | Time: 6295.94 ms [2022-02-03 19:01:07 main:574] : INFO : Epoch 1894 | loss: 0.0311609 | val_loss: 0.0311699 | Time: 6297.32 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-02-03 19:02:24 main:435] : INFO : Set logging level to 1 [2022-02-03 19:02:24 main:441] : INFO : Running in BOINC Client mode [2022-02-03 19:02:24 main:444] : INFO : Resolving all filenames [2022-02-03 19:02:24 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-03 19:02:24 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-03 19:02:24 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-03 19:02:24 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-03 19:02:24 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-03 19:02:24 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-03 19:02:24 main:474] : INFO : Configuration: [2022-02-03 19:02:24 main:475] : INFO : Model type: GRU [2022-02-03 19:02:24 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-03 19:02:24 main:477] : INFO : Max Epochs: 2048 [2022-02-03 19:02:24 main:478] : INFO : Batch Size: 128 [2022-02-03 19:02:24 main:479] : INFO : Learning Rate: 0.01 [2022-02-03 19:02:24 main:480] : INFO : Patience: 10 [2022-02-03 19:02:24 main:481] : INFO : Hidden Width: 12 [2022-02-03 19:02:24 main:482] : INFO : # Recurrent Layers: 4 [2022-02-03 19:02:24 main:483] : INFO : # Backend Layers: 4 [2022-02-03 19:02:24 main:484] : INFO : # Threads: 1 [2022-02-03 19:02:24 main:486] : INFO : Preparing Dataset [2022-02-03 19:02:24 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-03 19:02:25 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-03 19:02:27 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-03 19:02:27 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-03 19:02:27 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-03 19:02:27 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-03 19:02:27 main:494] : INFO : Creating Model [2022-02-03 19:02:27 main:507] : INFO : Preparing config file [2022-02-03 19:02:27 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-03 19:02:27 main:512] : INFO : Loading config [2022-02-03 19:02:27 main:514] : INFO : Loading state [2022-02-03 19:02:28 main:559] : INFO : Loading DataLoader into Memory [2022-02-03 19:02:28 main:562] : INFO : Starting Training [2022-02-03 19:02:34 main:574] : INFO : Epoch 1889 | loss: 0.0311925 | val_loss: 0.0311853 | Time: 6459.9 ms [2022-02-03 19:02:41 main:574] : INFO : Epoch 1890 | loss: 0.0311663 | val_loss: 0.0311743 | Time: 6239.51 ms [2022-02-03 19:02:47 main:574] : INFO : Epoch 1891 | loss: 0.0311651 | val_loss: 0.031173 | Time: 6255.71 ms [2022-02-03 19:02:53 main:574] : INFO : Epoch 1892 | loss: 0.0311626 | val_loss: 0.0311718 | Time: 6264.8 ms [2022-02-03 19:03:00 main:574] : INFO : Epoch 1893 | loss: 0.0311623 | val_loss: 0.0311701 | Time: 6327.48 ms [2022-02-03 19:03:06 main:574] : INFO : Epoch 1894 | loss: 0.0311654 | val_loss: 0.0311726 | Time: 6310.95 ms [2022-02-03 19:03:12 main:574] : INFO : Epoch 1895 | loss: 0.0311619 | val_loss: 0.0311666 | Time: 6284.65 ms [2022-02-03 19:03:18 main:574] : INFO : Epoch 1896 | loss: 0.0311602 | val_loss: 0.031166 | Time: 6278.06 ms [2022-02-03 19:03:25 main:574] : INFO : Epoch 1897 | loss: 0.0311579 | val_loss: 0.0311669 | Time: 6263.97 ms [2022-02-03 19:03:31 main:574] : INFO : Epoch 1898 | loss: 0.0311577 | val_loss: 0.0311654 | Time: 6282.12 ms [2022-02-03 19:03:37 main:574] : INFO : Epoch 1899 | loss: 0.0311584 | val_loss: 0.0311653 | Time: 6256.41 ms [2022-02-03 19:03:44 main:574] : INFO : Epoch 1900 | loss: 0.0311574 | val_loss: 0.0311665 | Time: 6285.34 ms [2022-02-03 19:03:50 main:574] : INFO : Epoch 1901 | loss: 0.0311585 | val_loss: 0.0311646 | Time: 6281.25 ms [2022-02-03 19:03:56 main:574] : INFO : Epoch 1902 | loss: 0.0311584 | val_loss: 0.031165 | Time: 6271.9 ms [2022-02-03 19:04:02 main:574] : INFO : Epoch 1903 | loss: 0.0311564 | val_loss: 0.0311644 | Time: 6326.7 ms [2022-02-03 19:04:09 main:574] : INFO : Epoch 1904 | loss: 0.0311567 | val_loss: 0.0311667 | Time: 6267.71 ms [2022-02-03 19:04:15 main:574] : INFO : Epoch 1905 | loss: 0.0311565 | val_loss: 0.0311646 | Time: 6271.47 ms [2022-02-03 19:04:21 main:574] : INFO : Epoch 1906 | loss: 0.0311554 | val_loss: 0.0311691 | Time: 6273.58 ms [2022-02-03 19:04:28 main:574] : INFO : Epoch 1907 | loss: 0.0311556 | val_loss: 0.0311643 | Time: 6286.35 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-02-03 19:05:31 main:435] : INFO : Set logging level to 1 [2022-02-03 19:05:31 main:441] : INFO : Running in BOINC Client mode [2022-02-03 19:05:31 main:444] : INFO : Resolving all filenames [2022-02-03 19:05:31 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-03 19:05:31 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-03 19:05:31 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-03 19:05:31 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-03 19:05:31 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-03 19:05:31 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-03 19:05:31 main:474] : INFO : Configuration: [2022-02-03 19:05:31 main:475] : INFO : Model type: GRU [2022-02-03 19:05:31 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-03 19:05:31 main:477] : INFO : Max Epochs: 2048 [2022-02-03 19:05:31 main:478] : INFO : Batch Size: 128 [2022-02-03 19:05:31 main:479] : INFO : Learning Rate: 0.01 [2022-02-03 19:05:31 main:480] : INFO : Patience: 10 [2022-02-03 19:05:31 main:481] : INFO : Hidden Width: 12 [2022-02-03 19:05:31 main:482] : INFO : # Recurrent Layers: 4 [2022-02-03 19:05:31 main:483] : INFO : # Backend Layers: 4 [2022-02-03 19:05:31 main:484] : INFO : # Threads: 1 [2022-02-03 19:05:31 main:486] : INFO : Preparing Dataset [2022-02-03 19:05:31 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-03 19:05:32 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-03 19:05:34 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-03 19:05:34 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-03 19:05:34 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-03 19:05:34 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-03 19:05:34 main:494] : INFO : Creating Model [2022-02-03 19:05:34 main:507] : INFO : Preparing config file [2022-02-03 19:05:34 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-03 19:05:34 main:512] : INFO : Loading config [2022-02-03 19:05:34 main:514] : INFO : Loading state [2022-02-03 19:05:35 main:559] : INFO : Loading DataLoader into Memory [2022-02-03 19:05:35 main:562] : INFO : Starting Training [2022-02-03 19:05:42 main:574] : INFO : Epoch 1900 | loss: 0.0311945 | val_loss: 0.0311752 | Time: 6629.57 ms [2022-02-03 19:05:48 main:574] : INFO : Epoch 1901 | loss: 0.0311671 | val_loss: 0.031166 | Time: 6246.91 ms [2022-02-03 19:05:54 main:574] : INFO : Epoch 1902 | loss: 0.0311623 | val_loss: 0.0311663 | Time: 6259.77 ms [2022-02-03 19:06:01 main:574] : INFO : Epoch 1903 | loss: 0.0311599 | val_loss: 0.0311643 | Time: 6251.41 ms [2022-02-03 19:06:07 main:574] : INFO : Epoch 1904 | loss: 0.0311571 | val_loss: 0.0311629 | Time: 6270.36 ms [2022-02-03 19:06:13 main:574] : INFO : Epoch 1905 | loss: 0.031156 | val_loss: 0.0311621 | Time: 6266.53 ms [2022-02-03 19:06:19 main:574] : INFO : Epoch 1906 | loss: 0.0311594 | val_loss: 0.031172 | Time: 6270.2 ms [2022-02-03 19:06:26 main:574] : INFO : Epoch 1907 | loss: 0.0311778 | val_loss: 0.0311859 | Time: 6293.73 ms [2022-02-03 19:06:32 main:574] : INFO : Epoch 1908 | loss: 0.0311854 | val_loss: 0.0311885 | Time: 6297.78 ms [2022-02-03 19:06:38 main:574] : INFO : Epoch 1909 | loss: 0.0311864 | val_loss: 0.0311895 | Time: 6280.54 ms [2022-02-03 19:06:45 main:574] : INFO : Epoch 1910 | loss: 0.0311876 | val_loss: 0.0311869 | Time: 6281.95 ms [2022-02-03 19:06:51 main:574] : INFO : Epoch 1911 | loss: 0.0311865 | val_loss: 0.0311876 | Time: 6275.51 ms [2022-02-03 19:06:57 main:574] : INFO : Epoch 1912 | loss: 0.0311853 | val_loss: 0.0311875 | Time: 6271.46 ms [2022-02-03 19:07:03 main:574] : INFO : Epoch 1913 | loss: 0.0311853 | val_loss: 0.0311859 | Time: 6256.86 ms [2022-02-03 19:07:10 main:574] : INFO : Epoch 1914 | loss: 0.0311856 | val_loss: 0.0311912 | Time: 6276.73 ms [2022-02-03 19:07:16 main:574] : INFO : Epoch 1915 | loss: 0.0311854 | val_loss: 0.0311874 | Time: 6292.16 ms [2022-02-03 19:07:22 main:574] : INFO : Epoch 1916 | loss: 0.0311845 | val_loss: 0.0311853 | Time: 6280.73 ms [2022-02-03 19:07:29 main:574] : INFO : Epoch 1917 | loss: 0.0311844 | val_loss: 0.0311878 | Time: 6305.35 ms [2022-02-03 19:07:35 main:574] : INFO : Epoch 1918 | loss: 0.0311859 | val_loss: 0.0311874 | Time: 6326.39 ms [2022-02-03 19:07:41 main:574] : INFO : Epoch 1919 | loss: 0.0311844 | val_loss: 0.0311866 | Time: 6283.9 ms [2022-02-03 19:07:47 main:574] : INFO : Epoch 1920 | loss: 0.0311853 | val_loss: 0.0311865 | Time: 6294.4 ms [2022-02-03 19:07:54 main:574] : INFO : Epoch 1921 | loss: 0.0311844 | val_loss: 0.0311855 | Time: 6277.09 ms [2022-02-03 19:08:00 main:574] : INFO : Epoch 1922 | loss: 0.0311853 | val_loss: 0.0311882 | Time: 6260.83 ms [2022-02-03 19:08:06 main:574] : INFO : Epoch 1923 | loss: 0.031186 | val_loss: 0.0311855 | Time: 6254.19 ms [2022-02-03 19:08:13 main:574] : INFO : Epoch 1924 | loss: 0.0311846 | val_loss: 0.0311854 | Time: 6263.41 ms [2022-02-03 19:08:19 main:574] : INFO : Epoch 1925 | loss: 0.031184 | val_loss: 0.0311851 | Time: 6255.78 ms [2022-02-03 19:08:25 main:574] : INFO : Epoch 1926 | loss: 0.031184 | val_loss: 0.0311872 | Time: 6289.82 ms [2022-02-03 19:08:31 main:574] : INFO : Epoch 1927 | loss: 0.0311843 | val_loss: 0.0311857 | Time: 6312.08 ms [2022-02-03 19:08:38 main:574] : INFO : Epoch 1928 | loss: 0.0311851 | val_loss: 0.0311856 | Time: 6314.98 ms [2022-02-03 19:08:44 main:574] : INFO : Epoch 1929 | loss: 0.0311854 | val_loss: 0.0311855 | Time: 6329.2 ms [2022-02-03 19:08:50 main:574] : INFO : Epoch 1930 | loss: 0.0311845 | val_loss: 0.0311895 | Time: 6322.3 ms [2022-02-03 19:08:57 main:574] : INFO : Epoch 1931 | loss: 0.0311867 | val_loss: 0.0311857 | Time: 6339 ms [2022-02-03 19:09:03 main:574] : INFO : Epoch 1932 | loss: 0.0311843 | val_loss: 0.0311853 | Time: 6349.07 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-02-03 19:10:04 main:435] : INFO : Set logging level to 1 [2022-02-03 19:10:04 main:441] : INFO : Running in BOINC Client mode [2022-02-03 19:10:04 main:444] : INFO : Resolving all filenames [2022-02-03 19:10:04 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-03 19:10:04 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-03 19:10:04 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-03 19:10:04 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-03 19:10:04 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-03 19:10:04 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-03 19:10:04 main:474] : INFO : Configuration: [2022-02-03 19:10:04 main:475] : INFO : Model type: GRU [2022-02-03 19:10:04 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-03 19:10:04 main:477] : INFO : Max Epochs: 2048 [2022-02-03 19:10:04 main:478] : INFO : Batch Size: 128 [2022-02-03 19:10:04 main:479] : INFO : Learning Rate: 0.01 [2022-02-03 19:10:04 main:480] : INFO : Patience: 10 [2022-02-03 19:10:04 main:481] : INFO : Hidden Width: 12 [2022-02-03 19:10:04 main:482] : INFO : # Recurrent Layers: 4 [2022-02-03 19:10:04 main:483] : INFO : # Backend Layers: 4 [2022-02-03 19:10:04 main:484] : INFO : # Threads: 1 [2022-02-03 19:10:04 main:486] : INFO : Preparing Dataset [2022-02-03 19:10:04 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-03 19:10:05 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-03 19:10:07 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-03 19:10:07 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-03 19:10:07 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-03 19:10:07 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-03 19:10:07 main:494] : INFO : Creating Model [2022-02-03 19:10:07 main:507] : INFO : Preparing config file [2022-02-03 19:10:07 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-03 19:10:07 main:512] : INFO : Loading config [2022-02-03 19:10:07 main:514] : INFO : Loading state [2022-02-03 19:10:08 main:559] : INFO : Loading DataLoader into Memory [2022-02-03 19:10:08 main:562] : INFO : Starting Training [2022-02-03 19:10:15 main:574] : INFO : Epoch 1932 | loss: 0.0312038 | val_loss: 0.0311709 | Time: 6605.41 ms [2022-02-03 19:10:21 main:574] : INFO : Epoch 1933 | loss: 0.0311718 | val_loss: 0.031166 | Time: 6293.19 ms [2022-02-03 19:10:27 main:574] : INFO : Epoch 1934 | loss: 0.0311647 | val_loss: 0.0311676 | Time: 6275.46 ms [2022-02-03 19:10:33 main:574] : INFO : Epoch 1935 | loss: 0.0311635 | val_loss: 0.0311681 | Time: 6274.17 ms [2022-02-03 19:10:40 main:574] : INFO : Epoch 1936 | loss: 0.0311598 | val_loss: 0.031168 | Time: 6270.07 ms [2022-02-03 19:10:46 main:574] : INFO : Epoch 1937 | loss: 0.0311592 | val_loss: 0.0311652 | Time: 6278.75 ms [2022-02-03 19:10:52 main:574] : INFO : Epoch 1938 | loss: 0.03116 | val_loss: 0.0311636 | Time: 6274.82 ms [2022-02-03 19:10:59 main:574] : INFO : Epoch 1939 | loss: 0.0311585 | val_loss: 0.0311688 | Time: 6289.84 ms [2022-02-03 19:11:05 main:574] : INFO : Epoch 1940 | loss: 0.0311568 | val_loss: 0.0311664 | Time: 6286.34 ms [2022-02-03 19:11:11 main:574] : INFO : Epoch 1941 | loss: 0.0311561 | val_loss: 0.0311637 | Time: 6282.75 ms [2022-02-03 19:11:17 main:574] : INFO : Epoch 1942 | loss: 0.031157 | val_loss: 0.0311951 | Time: 6282.85 ms [2022-02-03 19:11:24 main:574] : INFO : Epoch 1943 | loss: 0.0311992 | val_loss: 0.031215 | Time: 6267.4 ms [2022-02-03 19:11:30 main:574] : INFO : Epoch 1944 | loss: 0.0312025 | val_loss: 0.0312096 | Time: 6257.4 ms [2022-02-03 19:11:36 main:574] : INFO : Epoch 1945 | loss: 0.031225 | val_loss: 0.0312363 | Time: 6251.51 ms [2022-02-03 19:11:43 main:574] : INFO : Epoch 1946 | loss: 0.0312366 | val_loss: 0.0312333 | Time: 6284.54 ms [2022-02-03 19:11:49 main:574] : INFO : Epoch 1947 | loss: 0.0312389 | val_loss: 0.0312409 | Time: 6292.05 ms [2022-02-03 19:11:55 main:574] : INFO : Epoch 1948 | loss: 0.0312429 | val_loss: 0.0312426 | Time: 6296.49 ms [2022-02-03 19:12:01 main:574] : INFO : Epoch 1949 | loss: 0.0312406 | val_loss: 0.0312387 | Time: 6301.71 ms [2022-02-03 19:12:08 main:574] : INFO : Epoch 1950 | loss: 0.0312399 | val_loss: 0.031241 | Time: 6285.08 ms [2022-02-03 19:12:14 main:574] : INFO : Epoch 1951 | loss: 0.0312404 | val_loss: 0.0312385 | Time: 6309.15 ms [2022-02-03 19:12:20 main:574] : INFO : Epoch 1952 | loss: 0.0312386 | val_loss: 0.0312358 | Time: 6282.23 ms [2022-02-03 19:12:27 main:574] : INFO : Epoch 1953 | loss: 0.0312364 | val_loss: 0.0312395 | Time: 6271.53 ms [2022-02-03 19:12:33 main:574] : INFO : Epoch 1954 | loss: 0.031237 | val_loss: 0.0312361 | Time: 6295.64 ms [2022-02-03 19:12:39 main:574] : INFO : Epoch 1955 | loss: 0.0312344 | val_loss: 0.0312292 | Time: 6286.43 ms [2022-02-03 19:12:45 main:574] : INFO : Epoch 1956 | loss: 0.0312333 | val_loss: 0.0312298 | Time: 6263.56 ms [2022-02-03 19:12:52 main:574] : INFO : Epoch 1957 | loss: 0.0312363 | val_loss: 0.0312386 | Time: 6273.72 ms [2022-02-03 19:12:58 main:574] : INFO : Epoch 1958 | loss: 0.0312358 | val_loss: 0.0312359 | Time: 6269.67 ms [2022-02-03 19:13:04 main:574] : INFO : Epoch 1959 | loss: 0.0312322 | val_loss: 0.0312289 | Time: 6385.45 ms [2022-02-03 19:13:11 main:574] : INFO : Epoch 1960 | loss: 0.031234 | val_loss: 0.031232 | Time: 6357.41 ms [2022-02-03 19:13:17 main:574] : INFO : Epoch 1961 | loss: 0.0312367 | val_loss: 0.0312337 | Time: 6361.17 ms [2022-02-03 19:13:23 main:574] : INFO : Epoch 1962 | loss: 0.0312321 | val_loss: 0.0312339 | Time: 6253.73 ms [2022-02-03 19:13:30 main:574] : INFO : Epoch 1963 | loss: 0.0312283 | val_loss: 0.0312214 | Time: 6291.34 ms [2022-02-03 19:13:36 main:574] : INFO : Epoch 1964 | loss: 0.0312291 | val_loss: 0.0312239 | Time: 6288.76 ms [2022-02-03 19:13:42 main:574] : INFO : Epoch 1965 | loss: 0.0312268 | val_loss: 0.0312266 | Time: 6306.67 ms [2022-02-03 19:13:49 main:574] : INFO : Epoch 1966 | loss: 0.0312249 | val_loss: 0.0312213 | Time: 6344.96 ms [2022-02-03 19:13:55 main:574] : INFO : Epoch 1967 | loss: 0.0312238 | val_loss: 0.0312243 | Time: 6284.91 ms [2022-02-03 19:14:01 main:574] : INFO : Epoch 1968 | loss: 0.0312241 | val_loss: 0.0312248 | Time: 6296.86 ms [2022-02-03 19:14:08 main:574] : INFO : Epoch 1969 | loss: 0.0312227 | val_loss: 0.0312219 | Time: 6312.41 ms [2022-02-03 19:14:14 main:574] : INFO : Epoch 1970 | loss: 0.0312234 | val_loss: 0.0312178 | Time: 6324.62 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-02-03 19:15:18 main:435] : INFO : Set logging level to 1 [2022-02-03 19:15:18 main:441] : INFO : Running in BOINC Client mode [2022-02-03 19:15:18 main:444] : INFO : Resolving all filenames [2022-02-03 19:15:18 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-03 19:15:18 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-03 19:15:18 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-03 19:15:18 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-03 19:15:18 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-03 19:15:18 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-03 19:15:18 main:474] : INFO : Configuration: [2022-02-03 19:15:18 main:475] : INFO : Model type: GRU [2022-02-03 19:15:18 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-03 19:15:18 main:477] : INFO : Max Epochs: 2048 [2022-02-03 19:15:18 main:478] : INFO : Batch Size: 128 [2022-02-03 19:15:18 main:479] : INFO : Learning Rate: 0.01 [2022-02-03 19:15:18 main:480] : INFO : Patience: 10 [2022-02-03 19:15:18 main:481] : INFO : Hidden Width: 12 [2022-02-03 19:15:18 main:482] : INFO : # Recurrent Layers: 4 [2022-02-03 19:15:18 main:483] : INFO : # Backend Layers: 4 [2022-02-03 19:15:18 main:484] : INFO : # Threads: 1 [2022-02-03 19:15:18 main:486] : INFO : Preparing Dataset [2022-02-03 19:15:18 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-03 19:15:19 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-03 19:15:21 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-03 19:15:21 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-03 19:15:21 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-03 19:15:21 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-03 19:15:21 main:494] : INFO : Creating Model [2022-02-03 19:15:21 main:507] : INFO : Preparing config file [2022-02-03 19:15:21 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-03 19:15:21 main:512] : INFO : Loading config [2022-02-03 19:15:21 main:514] : INFO : Loading state [2022-02-03 19:15:22 main:559] : INFO : Loading DataLoader into Memory [2022-02-03 19:15:22 main:562] : INFO : Starting Training [2022-02-03 19:15:28 main:574] : INFO : Epoch 1965 | loss: 0.0312785 | val_loss: 0.0312334 | Time: 6478.04 ms [2022-02-03 19:15:35 main:574] : INFO : Epoch 1966 | loss: 0.0312199 | val_loss: 0.0312156 | Time: 6229.96 ms [2022-02-03 19:15:41 main:574] : INFO : Epoch 1967 | loss: 0.0312095 | val_loss: 0.0312076 | Time: 6263.38 ms [2022-02-03 19:15:47 main:574] : INFO : Epoch 1968 | loss: 0.0312057 | val_loss: 0.0312066 | Time: 6246.22 ms [2022-02-03 19:15:53 main:574] : INFO : Epoch 1969 | loss: 0.0312047 | val_loss: 0.0312037 | Time: 6292.71 ms [2022-02-03 19:16:00 main:574] : INFO : Epoch 1970 | loss: 0.0312031 | val_loss: 0.0312022 | Time: 6279.75 ms [2022-02-03 19:16:06 main:574] : INFO : Epoch 1971 | loss: 0.0312029 | val_loss: 0.0312018 | Time: 6291.59 ms [2022-02-03 19:16:12 main:574] : INFO : Epoch 1972 | loss: 0.0312017 | val_loss: 0.0312001 | Time: 6269.55 ms [2022-02-03 19:16:19 main:574] : INFO : Epoch 1973 | loss: 0.0312005 | val_loss: 0.0311989 | Time: 6261.51 ms [2022-02-03 19:16:25 main:574] : INFO : Epoch 1974 | loss: 0.0311982 | val_loss: 0.0311961 | Time: 6297.44 ms [2022-02-03 19:16:31 main:574] : INFO : Epoch 1975 | loss: 0.0311963 | val_loss: 0.0311959 | Time: 6255.93 ms [2022-02-03 19:16:37 main:574] : INFO : Epoch 1976 | loss: 0.031196 | val_loss: 0.0311914 | Time: 6274.45 ms [2022-02-03 19:16:44 main:574] : INFO : Epoch 1977 | loss: 0.0311949 | val_loss: 0.0311907 | Time: 6279.71 ms [2022-02-03 19:16:50 main:574] : INFO : Epoch 1978 | loss: 0.0311907 | val_loss: 0.0311895 | Time: 6270.72 ms [2022-02-03 19:16:56 main:574] : INFO : Epoch 1979 | loss: 0.0311908 | val_loss: 0.0311917 | Time: 6275.27 ms [2022-02-03 19:17:03 main:574] : INFO : Epoch 1980 | loss: 0.031192 | val_loss: 0.0311907 | Time: 6316.14 ms [2022-02-03 19:17:09 main:574] : INFO : Epoch 1981 | loss: 0.0311912 | val_loss: 0.0311914 | Time: 6281.89 ms [2022-02-03 19:17:15 main:574] : INFO : Epoch 1982 | loss: 0.0311905 | val_loss: 0.031189 | Time: 6285.56 ms [2022-02-03 19:17:22 main:574] : INFO : Epoch 1983 | loss: 0.0311886 | val_loss: 0.0311894 | Time: 6344.08 ms [2022-02-03 19:17:28 main:574] : INFO : Epoch 1984 | loss: 0.0311894 | val_loss: 0.0311942 | Time: 6284.47 ms [2022-02-03 19:17:34 main:574] : INFO : Epoch 1985 | loss: 0.0311887 | val_loss: 0.0311879 | Time: 6292.08 ms [2022-02-03 19:17:40 main:574] : INFO : Epoch 1986 | loss: 0.0311856 | val_loss: 0.0311877 | Time: 6313.03 ms [2022-02-03 19:17:47 main:574] : INFO : Epoch 1987 | loss: 0.0311851 | val_loss: 0.0311879 | Time: 6282.21 ms [2022-02-03 19:17:53 main:574] : INFO : Epoch 1988 | loss: 0.0311863 | val_loss: 0.0311867 | Time: 6274.5 ms [2022-02-03 19:17:59 main:574] : INFO : Epoch 1989 | loss: 0.0311863 | val_loss: 0.0311855 | Time: 6321.47 ms [2022-02-03 19:18:06 main:574] : INFO : Epoch 1990 | loss: 0.0311852 | val_loss: 0.0311895 | Time: 6282.41 ms [2022-02-03 19:18:12 main:574] : INFO : Epoch 1991 | loss: 0.0311856 | val_loss: 0.0311875 | Time: 6315.03 ms [2022-02-03 19:18:18 main:574] : INFO : Epoch 1992 | loss: 0.0311849 | val_loss: 0.0311843 | Time: 6274.64 ms [2022-02-03 19:18:25 main:574] : INFO : Epoch 1993 | loss: 0.0311846 | val_loss: 0.0311815 | Time: 6309.49 ms [2022-02-03 19:18:31 main:574] : INFO : Epoch 1994 | loss: 0.031186 | val_loss: 0.0311864 | Time: 6281.19 ms [2022-02-03 19:18:37 main:574] : INFO : Epoch 1995 | loss: 0.0311908 | val_loss: 0.0311936 | Time: 6281.06 ms [2022-02-03 19:18:43 main:574] : INFO : Epoch 1996 | loss: 0.0311946 | val_loss: 0.031193 | Time: 6315.72 ms [2022-02-03 19:18:50 main:574] : INFO : Epoch 1997 | loss: 0.0311915 | val_loss: 0.0311887 | Time: 6321.16 ms [2022-02-03 19:18:56 main:574] : INFO : Epoch 1998 | loss: 0.0311912 | val_loss: 0.0311873 | Time: 6324.65 ms [2022-02-03 19:19:02 main:574] : INFO : Epoch 1999 | loss: 0.0311895 | val_loss: 0.0311871 | Time: 6343.97 ms [2022-02-03 19:19:09 main:574] : INFO : Epoch 2000 | loss: 0.0311888 | val_loss: 0.0311894 | Time: 6299.87 ms [2022-02-03 19:19:15 main:574] : INFO : Epoch 2001 | loss: 0.0311904 | val_loss: 0.031188 | Time: 6308.66 ms [2022-02-03 19:19:21 main:574] : INFO : Epoch 2002 | loss: 0.0311922 | val_loss: 0.0311942 | Time: 6295.58 ms [2022-02-03 19:19:28 main:574] : INFO : Epoch 2003 | loss: 0.0311918 | val_loss: 0.0311868 | Time: 6284.69 ms [2022-02-03 19:19:34 main:574] : INFO : Epoch 2004 | loss: 0.0311888 | val_loss: 0.0311853 | Time: 6292.4 ms [2022-02-03 19:19:40 main:574] : INFO : Epoch 2005 | loss: 0.0311885 | val_loss: 0.0311866 | Time: 6331.1 ms [2022-02-03 19:19:47 main:574] : INFO : Epoch 2006 | loss: 0.0311893 | val_loss: 0.031186 | Time: 6315.42 ms [2022-02-03 19:19:53 main:574] : INFO : Epoch 2007 | loss: 0.0311878 | val_loss: 0.0311855 | Time: 6315.77 ms [2022-02-03 19:19:59 main:574] : INFO : Epoch 2008 | loss: 0.0311895 | val_loss: 0.0311867 | Time: 6292.71 ms [2022-02-03 19:20:05 main:574] : INFO : Epoch 2009 | loss: 0.031187 | val_loss: 0.0311859 | Time: 6290.73 ms [2022-02-03 19:20:12 main:574] : INFO : Epoch 2010 | loss: 0.0311864 | val_loss: 0.0311844 | Time: 6299.48 ms [2022-02-03 19:20:18 main:574] : INFO : Epoch 2011 | loss: 0.0311859 | val_loss: 0.0311832 | Time: 6280.72 ms [2022-02-03 19:20:24 main:574] : INFO : Epoch 2012 | loss: 0.0311856 | val_loss: 0.0311834 | Time: 6340.18 ms [2022-02-03 19:20:31 main:574] : INFO : Epoch 2013 | loss: 0.0311861 | val_loss: 0.0311876 | Time: 6287.37 ms [2022-02-03 19:20:37 main:574] : INFO : Epoch 2014 | loss: 0.0311848 | val_loss: 0.0311835 | Time: 6313.66 ms [2022-02-03 19:20:43 main:574] : INFO : Epoch 2015 | loss: 0.0311841 | val_loss: 0.0311836 | Time: 6306.27 ms [2022-02-03 19:20:50 main:574] : INFO : Epoch 2016 | loss: 0.0311852 | val_loss: 0.0311823 | Time: 6315.06 ms [2022-02-03 19:20:56 main:574] : INFO : Epoch 2017 | loss: 0.0311873 | val_loss: 0.0311835 | Time: 6286.5 ms [2022-02-03 19:21:02 main:574] : INFO : Epoch 2018 | loss: 0.0311875 | val_loss: 0.031183 | Time: 6275.48 ms [2022-02-03 19:21:09 main:574] : INFO : Epoch 2019 | loss: 0.0311871 | val_loss: 0.0311882 | Time: 6294.76 ms [2022-02-03 19:21:15 main:574] : INFO : Epoch 2020 | loss: 0.0311866 | val_loss: 0.0311837 | Time: 6337.28 ms [2022-02-03 19:21:21 main:574] : INFO : Epoch 2021 | loss: 0.031185 | val_loss: 0.0311823 | Time: 6328.98 ms [2022-02-03 19:21:28 main:574] : INFO : Epoch 2022 | loss: 0.031186 | val_loss: 0.0311819 | Time: 6362.09 ms [2022-02-03 19:21:34 main:574] : INFO : Epoch 2023 | loss: 0.0311859 | val_loss: 0.0311811 | Time: 6320.59 ms [2022-02-03 19:21:40 main:574] : INFO : Epoch 2024 | loss: 0.031187 | val_loss: 0.0311852 | Time: 6294.72 ms [2022-02-03 19:21:46 main:574] : INFO : Epoch 2025 | loss: 0.0311863 | val_loss: 0.0311824 | Time: 6306.99 ms [2022-02-03 19:21:53 main:574] : INFO : Epoch 2026 | loss: 0.0311852 | val_loss: 0.0311875 | Time: 6288.32 ms [2022-02-03 19:21:59 main:574] : INFO : Epoch 2027 | loss: 0.0311854 | val_loss: 0.0311819 | Time: 6270.09 ms [2022-02-03 19:22:05 main:574] : INFO : Epoch 2028 | loss: 0.0311852 | val_loss: 0.0311818 | Time: 6297.12 ms [2022-02-03 19:22:12 main:574] : INFO : Epoch 2029 | loss: 0.0311856 | val_loss: 0.0311867 | Time: 6312.76 ms [2022-02-03 19:22:18 main:574] : INFO : Epoch 2030 | loss: 0.0311849 | val_loss: 0.0311814 | Time: 6332.81 ms [2022-02-03 19:22:24 main:574] : INFO : Epoch 2031 | loss: 0.0311831 | val_loss: 0.0311812 | Time: 6324.6 ms [2022-02-03 19:22:31 main:574] : INFO : Epoch 2032 | loss: 0.0311856 | val_loss: 0.0311839 | Time: 6317.9 ms [2022-02-03 19:22:37 main:574] : INFO : Epoch 2033 | loss: 0.0311847 | val_loss: 0.0311832 | Time: 6264.51 ms [2022-02-03 19:22:43 main:574] : INFO : Epoch 2034 | loss: 0.0311843 | val_loss: 0.0311838 | Time: 6361.79 ms [2022-02-03 19:22:50 main:574] : INFO : Epoch 2035 | loss: 0.0311857 | val_loss: 0.0311856 | Time: 6324.79 ms [2022-02-03 19:22:56 main:574] : INFO : Epoch 2036 | loss: 0.0311836 | val_loss: 0.0311822 | Time: 6326.32 ms [2022-02-03 19:23:02 main:574] : INFO : Epoch 2037 | loss: 0.0311827 | val_loss: 0.0311823 | Time: 6286.97 ms [2022-02-03 19:23:09 main:574] : INFO : Epoch 2038 | loss: 0.0311828 | val_loss: 0.031183 | Time: 6285.92 ms [2022-02-03 19:23:15 main:574] : INFO : Epoch 2039 | loss: 0.0311836 | val_loss: 0.0311821 | Time: 6275.76 ms [2022-02-03 19:23:21 main:574] : INFO : Epoch 2040 | loss: 0.0311825 | val_loss: 0.0311818 | Time: 6273.73 ms [2022-02-03 19:23:27 main:574] : INFO : Epoch 2041 | loss: 0.0311818 | val_loss: 0.0311821 | Time: 6291.21 ms [2022-02-03 19:23:34 main:574] : INFO : Epoch 2042 | loss: 0.0311824 | val_loss: 0.0311842 | Time: 6287.21 ms [2022-02-03 19:23:40 main:574] : INFO : Epoch 2043 | loss: 0.0311823 | val_loss: 0.0311813 | Time: 6284.27 ms [2022-02-03 19:23:46 main:574] : INFO : Epoch 2044 | loss: 0.0311816 | val_loss: 0.0311849 | Time: 6263.5 ms [2022-02-03 19:23:53 main:574] : INFO : Epoch 2045 | loss: 0.0311822 | val_loss: 0.0311819 | Time: 6334.25 ms [2022-02-03 19:23:59 main:574] : INFO : Epoch 2046 | loss: 0.0311814 | val_loss: 0.0311842 | Time: 6340.18 ms [2022-02-03 19:24:05 main:574] : INFO : Epoch 2047 | loss: 0.0311814 | val_loss: 0.0311814 | Time: 6326.51 ms [2022-02-03 19:24:12 main:574] : INFO : Epoch 2048 | loss: 0.0311814 | val_loss: 0.0311823 | Time: 6301.49 ms [2022-02-03 19:24:12 main:597] : INFO : Saving trained model to model-final.pt, val_loss 0.0311823 [2022-02-03 19:24:12 main:603] : INFO : Saving end state to config to file [2022-02-03 19:24:12 main:608] : INFO : Success, exiting.. 19:24:12 (520): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)