Task 13738265
| Name | ParityModified-1645994157-17655-3-0_0 |
| Workunit | 10826163 |
| Created | 25 Mar 2022, 4:53:41 UTC |
| Sent | 31 Mar 2022, 11:49:50 UTC |
| Report deadline | 8 Apr 2022, 11:49:50 UTC |
| Received | 4 Apr 2022, 18:22:49 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 6180 |
| Run time | 3 hours 37 min |
| CPU time | 3 hours 2 min 55 sec |
| Validate state | Valid |
| Credit | 4,160.00 |
| Device peak FLOPS | 884.73 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.66 GB |
| Peak swap size | 3.44 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version> <![CDATA[ <stderr_txt> :444] : INFO : Resolving all filenames [2022-04-04 15:07:55 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-04 15:07:55 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-04 15:07:55 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-04 15:07:55 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-04 15:07:55 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-04 15:07:55 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-04 15:07:55 main:474] : INFO : Configuration: [2022-04-04 15:07:55 main:475] : INFO : Model type: GRU [2022-04-04 15:07:55 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-04 15:07:55 main:477] : INFO : Max Epochs: 2048 [2022-04-04 15:07:55 main:478] : INFO : Batch Size: 128 [2022-04-04 15:07:55 main:479] : INFO : Learning Rate: 0.01 [2022-04-04 15:07:55 main:480] : INFO : Patience: 10 [2022-04-04 15:07:55 main:481] : INFO : Hidden Width: 12 [2022-04-04 15:07:55 main:482] : INFO : # Recurrent Layers: 4 [2022-04-04 15:07:55 main:483] : INFO : # Backend Layers: 4 [2022-04-04 15:07:55 main:484] : INFO : # Threads: 1 [2022-04-04 15:07:55 main:486] : INFO : Preparing Dataset [2022-04-04 15:07:55 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-04 15:07:55 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-04 15:07:58 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-04 15:07:58 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-04 15:07:58 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-04 15:07:58 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-04 15:07:58 main:494] : INFO : Creating Model [2022-04-04 15:07:58 main:507] : INFO : Preparing config file [2022-04-04 15:07:58 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-04 15:07:58 main:512] : INFO : Loading config [2022-04-04 15:07:58 main:514] : INFO : Loading state [2022-04-04 15:07:59 main:559] : INFO : Loading DataLoader into Memory [2022-04-04 15:07:59 main:562] : INFO : Starting Training [2022-04-04 15:08:06 main:574] : INFO : Epoch 1804 | loss: 0.0311817 | val_loss: 0.031181 | Time: 6347.15 ms [2022-04-04 15:08:12 main:574] : INFO : Epoch 1805 | loss: 0.0311633 | val_loss: 0.0311742 | Time: 6187.22 ms [2022-04-04 15:08:18 main:574] : INFO : Epoch 1806 | loss: 0.0311597 | val_loss: 0.0311763 | Time: 6259.1 ms [2022-04-04 15:08:24 main:574] : INFO : Epoch 1807 | loss: 0.0311593 | val_loss: 0.031177 | Time: 6264.98 ms [2022-04-04 15:08:31 main:574] : INFO : Epoch 1808 | loss: 0.0311576 | val_loss: 0.0311774 | Time: 6262.3 ms [2022-04-04 15:08:37 main:574] : INFO : Epoch 1809 | loss: 0.0311583 | val_loss: 0.0311738 | Time: 6280.59 ms [2022-04-04 15:08:43 main:574] : INFO : Epoch 1810 | loss: 0.0311549 | val_loss: 0.0311702 | Time: 6321.24 ms [2022-04-04 15:08:50 main:574] : INFO : Epoch 1811 | loss: 0.0311541 | val_loss: 0.0311705 | Time: 6354.77 ms [2022-04-04 15:08:56 main:574] : INFO : Epoch 1812 | loss: 0.031153 | val_loss: 0.0311675 | Time: 6314.42 ms [2022-04-04 15:09:02 main:574] : INFO : Epoch 1813 | loss: 0.0311526 | val_loss: 0.0311718 | Time: 6297.87 ms [2022-04-04 15:09:08 main:574] : INFO : Epoch 1814 | loss: 0.0311546 | val_loss: 0.0311722 | Time: 6279.8 ms [2022-04-04 15:09:15 main:574] : INFO : Epoch 1815 | loss: 0.031155 | val_loss: 0.0311705 | Time: 6310.57 ms [2022-04-04 15:09:21 main:574] : INFO : Epoch 1816 | loss: 0.0311528 | val_loss: 0.0311719 | Time: 6327.53 ms [2022-04-04 15:09:27 main:574] : INFO : Epoch 1817 | loss: 0.0311537 | val_loss: 0.0311704 | Time: 6333.74 ms [2022-04-04 15:09:34 main:574] : INFO : Epoch 1818 | loss: 0.031155 | val_loss: 0.0311731 | Time: 6369.09 ms [2022-04-04 15:09:40 main:574] : INFO : Epoch 1819 | loss: 0.0311579 | val_loss: 0.0311732 | Time: 6332.49 ms [2022-04-04 15:09:47 main:574] : INFO : Epoch 1820 | loss: 0.0311556 | val_loss: 0.031176 | Time: 6336.23 ms [2022-04-04 15:09:53 main:574] : INFO : Epoch 1821 | loss: 0.0311573 | val_loss: 0.0311729 | Time: 6266.01 ms [2022-04-04 15:09:59 main:574] : INFO : Epoch 1822 | loss: 0.0311598 | val_loss: 0.031173 | Time: 6255.99 ms [2022-04-04 15:10:05 main:574] : INFO : Epoch 1823 | loss: 0.0311624 | val_loss: 0.0311774 | Time: 6403.72 ms [2022-04-04 15:10:12 main:574] : INFO : Epoch 1824 | loss: 0.0311607 | val_loss: 0.031172 | Time: 6282.57 ms [2022-04-04 15:10:18 main:574] : INFO : Epoch 1825 | loss: 0.0311575 | val_loss: 0.0311725 | Time: 6294.27 ms [2022-04-04 15:10:24 main:574] : INFO : Epoch 1826 | loss: 0.0311584 | val_loss: 0.0311753 | Time: 6303.68 ms [2022-04-04 15:10:31 main:574] : INFO : Epoch 1827 | loss: 0.0311567 | val_loss: 0.0311712 | Time: 6274.03 ms [2022-04-04 15:10:37 main:574] : INFO : Epoch 1828 | loss: 0.0311558 | val_loss: 0.0311712 | Time: 6345.35 ms [2022-04-04 15:10:43 main:574] : INFO : Epoch 1829 | loss: 0.0311552 | val_loss: 0.0311731 | Time: 6314.63 ms [2022-04-04 15:10:50 main:574] : INFO : Epoch 1830 | loss: 0.0311621 | val_loss: 0.0311748 | Time: 6274.01 ms [2022-04-04 15:10:56 main:574] : INFO : Epoch 1831 | loss: 0.0311781 | val_loss: 0.0311797 | Time: 6531.89 ms [2022-04-04 15:11:03 main:574] : INFO : Epoch 1832 | loss: 0.0311814 | val_loss: 0.0311793 | Time: 6332.18 ms [2022-04-04 15:11:09 main:574] : INFO : Epoch 1833 | loss: 0.0311797 | val_loss: 0.0311789 | Time: 6322.93 ms [2022-04-04 15:11:15 main:574] : INFO : Epoch 1834 | loss: 0.0311778 | val_loss: 0.0311768 | Time: 6337.53 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-04-04 15:12:29 main:435] : INFO : Set logging level to 1 [2022-04-04 15:12:29 main:441] : INFO : Running in BOINC Client mode [2022-04-04 15:12:29 main:444] : INFO : Resolving all filenames [2022-04-04 15:12:29 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-04 15:12:29 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-04 15:12:29 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-04 15:12:29 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-04 15:12:29 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-04 15:12:29 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-04 15:12:29 main:474] : INFO : Configuration: [2022-04-04 15:12:29 main:475] : INFO : Model type: GRU [2022-04-04 15:12:29 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-04 15:12:29 main:477] : INFO : Max Epochs: 2048 [2022-04-04 15:12:29 main:478] : INFO : Batch Size: 128 [2022-04-04 15:12:29 main:479] : INFO : Learning Rate: 0.01 [2022-04-04 15:12:29 main:480] : INFO : Patience: 10 [2022-04-04 15:12:29 main:481] : INFO : Hidden Width: 12 [2022-04-04 15:12:29 main:482] : INFO : # Recurrent Layers: 4 [2022-04-04 15:12:29 main:483] : INFO : # Backend Layers: 4 [2022-04-04 15:12:29 main:484] : INFO : # Threads: 1 [2022-04-04 15:12:29 main:486] : INFO : Preparing Dataset [2022-04-04 15:12:29 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-04 15:12:29 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-04 15:12:32 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-04 15:12:32 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-04 15:12:32 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-04 15:12:32 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-04 15:12:32 main:494] : INFO : Creating Model [2022-04-04 15:12:32 main:507] : INFO : Preparing config file [2022-04-04 15:12:32 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-04 15:12:32 main:512] : INFO : Loading config [2022-04-04 15:12:32 main:514] : INFO : Loading state [2022-04-04 15:12:33 main:559] : INFO : Loading DataLoader into Memory [2022-04-04 15:12:33 main:562] : INFO : Starting Training [2022-04-04 15:12:40 main:574] : INFO : Epoch 1825 | loss: 0.0311756 | val_loss: 0.0311702 | Time: 6448.8 ms [2022-04-04 15:12:46 main:574] : INFO : Epoch 1826 | loss: 0.0311602 | val_loss: 0.0311673 | Time: 6230.66 ms [2022-04-04 15:12:52 main:574] : INFO : Epoch 1827 | loss: 0.0311552 | val_loss: 0.0311675 | Time: 6288.91 ms [2022-04-04 15:12:59 main:574] : INFO : Epoch 1828 | loss: 0.0311557 | val_loss: 0.0311722 | Time: 6276.73 ms [2022-04-04 15:13:05 main:574] : INFO : Epoch 1829 | loss: 0.0311579 | val_loss: 0.0311763 | Time: 6327.55 ms [2022-04-04 15:13:11 main:574] : INFO : Epoch 1830 | loss: 0.031157 | val_loss: 0.0311743 | Time: 6337.28 ms [2022-04-04 15:13:18 main:574] : INFO : Epoch 1831 | loss: 0.0311565 | val_loss: 0.031168 | Time: 6319.35 ms [2022-04-04 15:13:24 main:574] : INFO : Epoch 1832 | loss: 0.0311581 | val_loss: 0.031169 | Time: 6334.64 ms [2022-04-04 15:13:30 main:574] : INFO : Epoch 1833 | loss: 0.0311561 | val_loss: 0.0311691 | Time: 6335.35 ms [2022-04-04 15:13:37 main:574] : INFO : Epoch 1834 | loss: 0.0311551 | val_loss: 0.0311688 | Time: 6313.49 ms [2022-04-04 15:13:43 main:574] : INFO : Epoch 1835 | loss: 0.0311538 | val_loss: 0.0311701 | Time: 6317.77 ms [2022-04-04 15:13:49 main:574] : INFO : Epoch 1836 | loss: 0.0311551 | val_loss: 0.031179 | Time: 6325.63 ms [2022-04-04 15:13:56 main:574] : INFO : Epoch 1837 | loss: 0.0311545 | val_loss: 0.0311736 | Time: 6266.63 ms [2022-04-04 15:14:02 main:574] : INFO : Epoch 1838 | loss: 0.0311523 | val_loss: 0.0311753 | Time: 6325.5 ms [2022-04-04 15:14:08 main:574] : INFO : Epoch 1839 | loss: 0.031151 | val_loss: 0.0311768 | Time: 6314.71 ms [2022-04-04 15:14:15 main:574] : INFO : Epoch 1840 | loss: 0.0311506 | val_loss: 0.0311699 | Time: 6369.89 ms [2022-04-04 15:14:21 main:574] : INFO : Epoch 1841 | loss: 0.0311493 | val_loss: 0.0311738 | Time: 6375.29 ms [2022-04-04 15:14:27 main:574] : INFO : Epoch 1842 | loss: 0.0311491 | val_loss: 0.0311725 | Time: 6287.91 ms [2022-04-04 15:14:34 main:574] : INFO : Epoch 1843 | loss: 0.0311496 | val_loss: 0.0311698 | Time: 6305.71 ms [2022-04-04 15:14:40 main:574] : INFO : Epoch 1844 | loss: 0.0311501 | val_loss: 0.0311694 | Time: 6314.57 ms [2022-04-04 15:14:46 main:574] : INFO : Epoch 1845 | loss: 0.0311505 | val_loss: 0.0311708 | Time: 6299.34 ms [2022-04-04 15:14:53 main:574] : INFO : Epoch 1846 | loss: 0.0311494 | val_loss: 0.0311719 | Time: 6345.07 ms [2022-04-04 15:14:59 main:574] : INFO : Epoch 1847 | loss: 0.031149 | val_loss: 0.0311686 | Time: 6306.36 ms [2022-04-04 15:15:05 main:574] : INFO : Epoch 1848 | loss: 0.0311535 | val_loss: 0.0311745 | Time: 6286.8 ms [2022-04-04 15:15:12 main:574] : INFO : Epoch 1849 | loss: 0.0311628 | val_loss: 0.0311724 | Time: 6363.2 ms [2022-04-04 15:15:18 main:574] : INFO : Epoch 1850 | loss: 0.0311634 | val_loss: 0.0311717 | Time: 6299.67 ms [2022-04-04 15:15:24 main:574] : INFO : Epoch 1851 | loss: 0.0311611 | val_loss: 0.0311767 | Time: 6263.66 ms [2022-04-04 15:15:31 main:574] : INFO : Epoch 1852 | loss: 0.0311598 | val_loss: 0.0311702 | Time: 6386.82 ms [2022-04-04 15:15:37 main:574] : INFO : Epoch 1853 | loss: 0.0311589 | val_loss: 0.0311738 | Time: 6279.81 ms [2022-04-04 15:15:43 main:574] : INFO : Epoch 1854 | loss: 0.0311584 | val_loss: 0.0311718 | Time: 6290.28 ms [2022-04-04 15:15:50 main:574] : INFO : Epoch 1855 | loss: 0.0311559 | val_loss: 0.0311706 | Time: 6316.19 ms [2022-04-04 15:15:56 main:574] : INFO : Epoch 1856 | loss: 0.0311555 | val_loss: 0.0311704 | Time: 6348.54 ms [2022-04-04 15:16:02 main:574] : INFO : Epoch 1857 | loss: 0.0311549 | val_loss: 0.0311727 | Time: 6311.43 ms [2022-04-04 15:16:08 main:574] : INFO : Epoch 1858 | loss: 0.0311535 | val_loss: 0.0311717 | Time: 6285.86 ms [2022-04-04 15:16:15 main:574] : INFO : Epoch 1859 | loss: 0.031154 | val_loss: 0.0311712 | Time: 6290.6 ms [2022-04-04 15:16:21 main:574] : INFO : Epoch 1860 | loss: 0.0311531 | val_loss: 0.0311706 | Time: 6310.78 ms [2022-04-04 15:16:27 main:574] : INFO : Epoch 1861 | loss: 0.0311535 | val_loss: 0.0311731 | Time: 6302.74 ms [2022-04-04 15:16:34 main:574] : INFO : Epoch 1862 | loss: 0.0311528 | val_loss: 0.031172 | Time: 6288.08 ms [2022-04-04 15:16:40 main:574] : INFO : Epoch 1863 | loss: 0.0311531 | val_loss: 0.0311733 | Time: 6341.63 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-04-04 15:18:11 main:435] : INFO : Set logging level to 1 [2022-04-04 15:18:11 main:441] : INFO : Running in BOINC Client mode [2022-04-04 15:18:11 main:444] : INFO : Resolving all filenames [2022-04-04 15:18:11 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-04 15:18:11 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-04 15:18:11 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-04 15:18:11 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-04 15:18:11 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-04 15:18:11 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-04 15:18:11 main:474] : INFO : Configuration: [2022-04-04 15:18:11 main:475] : INFO : Model type: GRU [2022-04-04 15:18:11 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-04 15:18:11 main:477] : INFO : Max Epochs: 2048 [2022-04-04 15:18:11 main:478] : INFO : Batch Size: 128 [2022-04-04 15:18:11 main:479] : INFO : Learning Rate: 0.01 [2022-04-04 15:18:11 main:480] : INFO : Patience: 10 [2022-04-04 15:18:11 main:481] : INFO : Hidden Width: 12 [2022-04-04 15:18:11 main:482] : INFO : # Recurrent Layers: 4 [2022-04-04 15:18:11 main:483] : INFO : # Backend Layers: 4 [2022-04-04 15:18:11 main:484] : INFO : # Threads: 1 [2022-04-04 15:18:11 main:486] : INFO : Preparing Dataset [2022-04-04 15:18:11 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-04 15:18:11 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-04 15:18:14 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-04 15:18:14 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-04 15:18:14 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-04 15:18:14 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-04 15:18:14 main:494] : INFO : Creating Model [2022-04-04 15:18:14 main:507] : INFO : Preparing config file [2022-04-04 15:18:14 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-04 15:18:14 main:512] : INFO : Loading config [2022-04-04 15:18:14 main:514] : INFO : Loading state [2022-04-04 15:18:15 main:559] : INFO : Loading DataLoader into Memory [2022-04-04 15:18:15 main:562] : INFO : Starting Training [2022-04-04 15:18:22 main:574] : INFO : Epoch 1857 | loss: 0.0311927 | val_loss: 0.0311806 | Time: 6463.86 ms [2022-04-04 15:18:28 main:574] : INFO : Epoch 1858 | loss: 0.0311652 | val_loss: 0.0311704 | Time: 6251.43 ms [2022-04-04 15:18:34 main:574] : INFO : Epoch 1859 | loss: 0.0311628 | val_loss: 0.0311738 | Time: 6277.12 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-04-04 19:41:29 main:435] : INFO : Set logging level to 1 [2022-04-04 19:41:29 main:441] : INFO : Running in BOINC Client mode [2022-04-04 19:41:29 main:444] : INFO : Resolving all filenames [2022-04-04 19:41:29 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-04 19:41:29 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-04 19:41:29 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-04 19:41:29 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-04 19:41:29 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-04 19:41:29 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-04 19:41:29 main:474] : INFO : Configuration: [2022-04-04 19:41:29 main:475] : INFO : Model type: GRU [2022-04-04 19:41:29 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-04 19:41:29 main:477] : INFO : Max Epochs: 2048 [2022-04-04 19:41:29 main:478] : INFO : Batch Size: 128 [2022-04-04 19:41:29 main:479] : INFO : Learning Rate: 0.01 [2022-04-04 19:41:29 main:480] : INFO : Patience: 10 [2022-04-04 19:41:29 main:481] : INFO : Hidden Width: 12 [2022-04-04 19:41:29 main:482] : INFO : # Recurrent Layers: 4 [2022-04-04 19:41:29 main:483] : INFO : # Backend Layers: 4 [2022-04-04 19:41:29 main:484] : INFO : # Threads: 1 [2022-04-04 19:41:29 main:486] : INFO : Preparing Dataset [2022-04-04 19:41:29 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-04 19:41:29 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-04 19:41:33 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-04 19:41:33 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-04 19:41:33 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-04 19:41:34 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-04 19:41:34 main:494] : INFO : Creating Model [2022-04-04 19:41:34 main:507] : INFO : Preparing config file [2022-04-04 19:41:34 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-04 19:41:34 main:512] : INFO : Loading config [2022-04-04 19:41:34 main:514] : INFO : Loading state [2022-04-04 19:41:35 main:559] : INFO : Loading DataLoader into Memory [2022-04-04 19:41:35 main:562] : INFO : Starting Training [2022-04-04 19:41:43 main:574] : INFO : Epoch 1857 | loss: 0.0311861 | val_loss: 0.031175 | Time: 7084.02 ms [2022-04-04 19:41:49 main:574] : INFO : Epoch 1858 | loss: 0.0311597 | val_loss: 0.0311729 | Time: 6320.23 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-04-04 19:45:04 main:435] : INFO : Set logging level to 1 [2022-04-04 19:45:04 main:441] : INFO : Running in BOINC Client mode [2022-04-04 19:45:04 main:444] : INFO : Resolving all filenames [2022-04-04 19:45:04 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-04 19:45:04 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-04 19:45:04 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-04 19:45:04 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-04 19:45:04 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-04 19:45:04 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-04 19:45:04 main:474] : INFO : Configuration: [2022-04-04 19:45:04 main:475] : INFO : Model type: GRU [2022-04-04 19:45:04 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-04 19:45:04 main:477] : INFO : Max Epochs: 2048 [2022-04-04 19:45:04 main:478] : INFO : Batch Size: 128 [2022-04-04 19:45:04 main:479] : INFO : Learning Rate: 0.01 [2022-04-04 19:45:04 main:480] : INFO : Patience: 10 [2022-04-04 19:45:04 main:481] : INFO : Hidden Width: 12 [2022-04-04 19:45:04 main:482] : INFO : # Recurrent Layers: 4 [2022-04-04 19:45:04 main:483] : INFO : # Backend Layers: 4 [2022-04-04 19:45:04 main:484] : INFO : # Threads: 1 [2022-04-04 19:45:04 main:486] : INFO : Preparing Dataset [2022-04-04 19:45:04 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-04 19:45:04 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-04 19:45:07 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-04 19:45:07 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-04 19:45:07 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-04 19:45:07 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-04 19:45:07 main:494] : INFO : Creating Model [2022-04-04 19:45:07 main:507] : INFO : Preparing config file [2022-04-04 19:45:07 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-04 19:45:07 main:512] : INFO : Loading config [2022-04-04 19:45:07 main:514] : INFO : Loading state [2022-04-04 19:45:08 main:559] : INFO : Loading DataLoader into Memory [2022-04-04 19:45:08 main:562] : INFO : Starting Training [2022-04-04 19:45:15 main:574] : INFO : Epoch 1857 | loss: 0.0311933 | val_loss: 0.0311748 | Time: 6635.36 ms [2022-04-04 19:45:21 main:574] : INFO : Epoch 1858 | loss: 0.0311616 | val_loss: 0.0311698 | Time: 6300.56 ms [2022-04-04 19:45:27 main:574] : INFO : Epoch 1859 | loss: 0.0311587 | val_loss: 0.0311697 | Time: 6297.4 ms [2022-04-04 19:45:33 main:574] : INFO : Epoch 1860 | loss: 0.0311596 | val_loss: 0.0311664 | Time: 6258.75 ms [2022-04-04 19:45:40 main:574] : INFO : Epoch 1861 | loss: 0.0311576 | val_loss: 0.0311649 | Time: 6289.99 ms [2022-04-04 19:45:46 main:574] : INFO : Epoch 1862 | loss: 0.0311579 | val_loss: 0.0311662 | Time: 6273.49 ms [2022-04-04 19:45:52 main:574] : INFO : Epoch 1863 | loss: 0.0311572 | val_loss: 0.0311688 | Time: 6248.41 ms [2022-04-04 19:45:58 main:574] : INFO : Epoch 1864 | loss: 0.0311575 | val_loss: 0.0311713 | Time: 6249.21 ms [2022-04-04 19:46:05 main:574] : INFO : Epoch 1865 | loss: 0.0311592 | val_loss: 0.031168 | Time: 6262.08 ms [2022-04-04 19:46:11 main:574] : INFO : Epoch 1866 | loss: 0.0311628 | val_loss: 0.031168 | Time: 6275.46 ms [2022-04-04 19:46:17 main:574] : INFO : Epoch 1867 | loss: 0.0311605 | val_loss: 0.0311675 | Time: 6257.3 ms [2022-04-04 19:46:24 main:574] : INFO : Epoch 1868 | loss: 0.0311578 | val_loss: 0.0311655 | Time: 6360.79 ms [2022-04-04 19:46:30 main:574] : INFO : Epoch 1869 | loss: 0.0311578 | val_loss: 0.0311722 | Time: 6285.7 ms [2022-04-04 19:46:36 main:574] : INFO : Epoch 1870 | loss: 0.0311588 | val_loss: 0.031168 | Time: 6254.13 ms [2022-04-04 19:46:43 main:574] : INFO : Epoch 1871 | loss: 0.0311577 | val_loss: 0.0311685 | Time: 6279.96 ms [2022-04-04 19:46:49 main:574] : INFO : Epoch 1872 | loss: 0.031157 | val_loss: 0.0311686 | Time: 6257.67 ms [2022-04-04 19:46:55 main:574] : INFO : Epoch 1873 | loss: 0.0311551 | val_loss: 0.0311653 | Time: 6269.75 ms [2022-04-04 19:47:01 main:574] : INFO : Epoch 1874 | loss: 0.0311547 | val_loss: 0.0311669 | Time: 6306.52 ms [2022-04-04 19:47:08 main:574] : INFO : Epoch 1875 | loss: 0.0311569 | val_loss: 0.0311661 | Time: 6289.64 ms [2022-04-04 19:47:14 main:574] : INFO : Epoch 1876 | loss: 0.0311542 | val_loss: 0.0311647 | Time: 6302.95 ms [2022-04-04 19:47:20 main:574] : INFO : Epoch 1877 | loss: 0.0311566 | val_loss: 0.0311684 | Time: 6320.84 ms [2022-04-04 19:47:27 main:574] : INFO : Epoch 1878 | loss: 0.0311553 | val_loss: 0.0311661 | Time: 6270.5 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-04-04 19:48:29 main:435] : INFO : Set logging level to 1 [2022-04-04 19:48:29 main:441] : INFO : Running in BOINC Client mode [2022-04-04 19:48:29 main:444] : INFO : Resolving all filenames [2022-04-04 19:48:29 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-04 19:48:29 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-04 19:48:29 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-04 19:48:29 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-04 19:48:29 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-04 19:48:29 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-04 19:48:29 main:474] : INFO : Configuration: [2022-04-04 19:48:29 main:475] : INFO : Model type: GRU [2022-04-04 19:48:29 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-04 19:48:29 main:477] : INFO : Max Epochs: 2048 [2022-04-04 19:48:29 main:478] : INFO : Batch Size: 128 [2022-04-04 19:48:29 main:479] : INFO : Learning Rate: 0.01 [2022-04-04 19:48:29 main:480] : INFO : Patience: 10 [2022-04-04 19:48:29 main:481] : INFO : Hidden Width: 12 [2022-04-04 19:48:29 main:482] : INFO : # Recurrent Layers: 4 [2022-04-04 19:48:29 main:483] : INFO : # Backend Layers: 4 [2022-04-04 19:48:29 main:484] : INFO : # Threads: 1 [2022-04-04 19:48:29 main:486] : INFO : Preparing Dataset [2022-04-04 19:48:29 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-04 19:48:29 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-04 19:48:31 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-04 19:48:31 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-04 19:48:31 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-04 19:48:31 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-04 19:48:31 main:494] : INFO : Creating Model [2022-04-04 19:48:31 main:507] : INFO : Preparing config file [2022-04-04 19:48:31 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-04 19:48:31 main:512] : INFO : Loading config [2022-04-04 19:48:31 main:514] : INFO : Loading state [2022-04-04 19:48:32 main:559] : INFO : Loading DataLoader into Memory [2022-04-04 19:48:32 main:562] : INFO : Starting Training [2022-04-04 19:48:39 main:574] : INFO : Epoch 1878 | loss: 0.0311751 | val_loss: 0.0311655 | Time: 6688.66 ms [2022-04-04 19:48:45 main:574] : INFO : Epoch 1879 | loss: 0.0311577 | val_loss: 0.0311642 | Time: 6249.45 ms [2022-04-04 19:48:51 main:574] : INFO : Epoch 1880 | loss: 0.0311539 | val_loss: 0.0311619 | Time: 6292.78 ms [2022-04-04 19:48:58 main:574] : INFO : Epoch 1881 | loss: 0.031152 | val_loss: 0.0311648 | Time: 6303.16 ms [2022-04-04 19:49:04 main:574] : INFO : Epoch 1882 | loss: 0.0311535 | val_loss: 0.0311617 | Time: 6295.84 ms [2022-04-04 19:49:10 main:574] : INFO : Epoch 1883 | loss: 0.0311544 | val_loss: 0.0311635 | Time: 6274.83 ms [2022-04-04 19:49:16 main:574] : INFO : Epoch 1884 | loss: 0.0311547 | val_loss: 0.0311641 | Time: 6285.88 ms [2022-04-04 19:49:23 main:574] : INFO : Epoch 1885 | loss: 0.0311553 | val_loss: 0.0311618 | Time: 6281.54 ms [2022-04-04 19:49:29 main:574] : INFO : Epoch 1886 | loss: 0.0311544 | val_loss: 0.0311635 | Time: 6275.35 ms [2022-04-04 19:49:35 main:574] : INFO : Epoch 1887 | loss: 0.0311539 | val_loss: 0.0311651 | Time: 6285.71 ms [2022-04-04 19:49:42 main:574] : INFO : Epoch 1888 | loss: 0.0311579 | val_loss: 0.0311661 | Time: 6277.33 ms [2022-04-04 19:49:48 main:574] : INFO : Epoch 1889 | loss: 0.0311555 | val_loss: 0.031165 | Time: 6287.42 ms [2022-04-04 19:49:54 main:574] : INFO : Epoch 1890 | loss: 0.0311548 | val_loss: 0.0311634 | Time: 6271.65 ms [2022-04-04 19:50:00 main:574] : INFO : Epoch 1891 | loss: 0.031154 | val_loss: 0.0311682 | Time: 6269.19 ms [2022-04-04 19:50:07 main:574] : INFO : Epoch 1892 | loss: 0.0311527 | val_loss: 0.031164 | Time: 6259.63 ms [2022-04-04 19:50:13 main:574] : INFO : Epoch 1893 | loss: 0.0311527 | val_loss: 0.0311634 | Time: 6268.62 ms [2022-04-04 19:50:19 main:574] : INFO : Epoch 1894 | loss: 0.0311527 | val_loss: 0.0311653 | Time: 6270.66 ms [2022-04-04 19:50:26 main:574] : INFO : Epoch 1895 | loss: 0.031153 | val_loss: 0.031166 | Time: 6287.94 ms [2022-04-04 19:50:32 main:574] : INFO : Epoch 1896 | loss: 0.0311498 | val_loss: 0.0311655 | Time: 6286.52 ms [2022-04-04 19:50:38 main:574] : INFO : Epoch 1897 | loss: 0.031153 | val_loss: 0.0311638 | Time: 6253.25 ms [2022-04-04 19:50:44 main:574] : INFO : Epoch 1898 | loss: 0.0311537 | val_loss: 0.0311674 | Time: 6266.8 ms [2022-04-04 19:50:51 main:574] : INFO : Epoch 1899 | loss: 0.031154 | val_loss: 0.031168 | Time: 6280.62 ms [2022-04-04 19:50:57 main:574] : INFO : Epoch 1900 | loss: 0.0311543 | val_loss: 0.0311732 | Time: 6271.43 ms [2022-04-04 19:51:03 main:574] : INFO : Epoch 1901 | loss: 0.0311596 | val_loss: 0.031167 | Time: 6253.58 ms [2022-04-04 19:51:10 main:574] : INFO : Epoch 1902 | loss: 0.0311563 | val_loss: 0.0311646 | Time: 6287.41 ms [2022-04-04 19:51:16 main:574] : INFO : Epoch 1903 | loss: 0.0311546 | val_loss: 0.0311673 | Time: 6272.1 ms [2022-04-04 19:51:22 main:574] : INFO : Epoch 1904 | loss: 0.0311537 | val_loss: 0.0311643 | Time: 6265.45 ms [2022-04-04 19:51:28 main:574] : INFO : Epoch 1905 | loss: 0.0311526 | val_loss: 0.0311638 | Time: 6251.04 ms [2022-04-04 19:51:35 main:574] : INFO : Epoch 1906 | loss: 0.0311517 | val_loss: 0.0311633 | Time: 6349.58 ms [2022-04-04 19:51:41 main:574] : INFO : Epoch 1907 | loss: 0.0311525 | val_loss: 0.031161 | Time: 6258.73 ms [2022-04-04 19:51:47 main:574] : INFO : Epoch 1908 | loss: 0.0311535 | val_loss: 0.031165 | Time: 6283.12 ms [2022-04-04 19:51:54 main:574] : INFO : Epoch 1909 | loss: 0.0311517 | val_loss: 0.0311614 | Time: 6290.87 ms [2022-04-04 19:52:00 main:574] : INFO : Epoch 1910 | loss: 0.031151 | val_loss: 0.0311635 | Time: 6372.44 ms [2022-04-04 19:52:06 main:574] : INFO : Epoch 1911 | loss: 0.0311481 | val_loss: 0.0311689 | Time: 6362.15 ms [2022-04-04 19:52:13 main:574] : INFO : Epoch 1912 | loss: 0.0311485 | val_loss: 0.0311685 | Time: 6320.53 ms [2022-04-04 19:52:19 main:574] : INFO : Epoch 1913 | loss: 0.0311481 | val_loss: 0.0311657 | Time: 6351.03 ms [2022-04-04 19:52:25 main:574] : INFO : Epoch 1914 | loss: 0.0311477 | val_loss: 0.0311649 | Time: 6371.5 ms [2022-04-04 19:52:32 main:574] : INFO : Epoch 1915 | loss: 0.0311471 | val_loss: 0.0311652 | Time: 6299.51 ms [2022-04-04 19:52:38 main:574] : INFO : Epoch 1916 | loss: 0.0311464 | val_loss: 0.0311636 | Time: 6255 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-04-04 19:53:43 main:435] : INFO : Set logging level to 1 [2022-04-04 19:53:43 main:441] : INFO : Running in BOINC Client mode [2022-04-04 19:53:43 main:444] : INFO : Resolving all filenames [2022-04-04 19:53:43 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-04 19:53:43 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-04 19:53:43 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-04 19:53:43 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-04 19:53:43 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-04 19:53:43 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-04 19:53:43 main:474] : INFO : Configuration: [2022-04-04 19:53:43 main:475] : INFO : Model type: GRU [2022-04-04 19:53:43 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-04 19:53:43 main:477] : INFO : Max Epochs: 2048 [2022-04-04 19:53:43 main:478] : INFO : Batch Size: 128 [2022-04-04 19:53:43 main:479] : INFO : Learning Rate: 0.01 [2022-04-04 19:53:43 main:480] : INFO : Patience: 10 [2022-04-04 19:53:43 main:481] : INFO : Hidden Width: 12 [2022-04-04 19:53:43 main:482] : INFO : # Recurrent Layers: 4 [2022-04-04 19:53:43 main:483] : INFO : # Backend Layers: 4 [2022-04-04 19:53:43 main:484] : INFO : # Threads: 1 [2022-04-04 19:53:43 main:486] : INFO : Preparing Dataset [2022-04-04 19:53:43 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-04 19:53:43 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-04 19:53:45 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-04 19:53:45 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-04 19:53:45 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-04 19:53:45 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-04 19:53:45 main:494] : INFO : Creating Model [2022-04-04 19:53:45 main:507] : INFO : Preparing config file [2022-04-04 19:53:45 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-04 19:53:45 main:512] : INFO : Loading config [2022-04-04 19:53:45 main:514] : INFO : Loading state [2022-04-04 19:53:46 main:559] : INFO : Loading DataLoader into Memory [2022-04-04 19:53:46 main:562] : INFO : Starting Training [2022-04-04 19:53:53 main:574] : INFO : Epoch 1910 | loss: 0.031173 | val_loss: 0.0311694 | Time: 6475.86 ms [2022-04-04 19:53:59 main:574] : INFO : Epoch 1911 | loss: 0.031156 | val_loss: 0.0311623 | Time: 6241.96 ms [2022-04-04 19:54:05 main:574] : INFO : Epoch 1912 | loss: 0.0311524 | val_loss: 0.0311621 | Time: 6258.21 ms [2022-04-04 19:54:11 main:574] : INFO : Epoch 1913 | loss: 0.0311495 | val_loss: 0.0311644 | Time: 6250.86 ms [2022-04-04 19:54:18 main:574] : INFO : Epoch 1914 | loss: 0.0311511 | val_loss: 0.0311602 | Time: 6273.04 ms [2022-04-04 19:54:24 main:574] : INFO : Epoch 1915 | loss: 0.0311509 | val_loss: 0.0311631 | Time: 6274.37 ms [2022-04-04 19:54:30 main:574] : INFO : Epoch 1916 | loss: 0.0311496 | val_loss: 0.0311591 | Time: 6276.22 ms [2022-04-04 19:54:37 main:574] : INFO : Epoch 1917 | loss: 0.0311465 | val_loss: 0.0311595 | Time: 6344.07 ms [2022-04-04 19:54:43 main:574] : INFO : Epoch 1918 | loss: 0.0311468 | val_loss: 0.031158 | Time: 6283.56 ms [2022-04-04 19:54:49 main:574] : INFO : Epoch 1919 | loss: 0.0311476 | val_loss: 0.0311583 | Time: 6261.1 ms [2022-04-04 19:54:56 main:574] : INFO : Epoch 1920 | loss: 0.0311474 | val_loss: 0.0311583 | Time: 6273.76 ms [2022-04-04 19:55:02 main:574] : INFO : Epoch 1921 | loss: 0.0311461 | val_loss: 0.0311589 | Time: 6616.45 ms [2022-04-04 19:55:09 main:574] : INFO : Epoch 1922 | loss: 0.0311444 | val_loss: 0.0311588 | Time: 6971.45 ms [2022-04-04 19:55:15 main:574] : INFO : Epoch 1923 | loss: 0.0311454 | val_loss: 0.0311593 | Time: 6277.82 ms [2022-04-04 19:55:22 main:574] : INFO : Epoch 1924 | loss: 0.0311484 | val_loss: 0.0311584 | Time: 6274.28 ms [2022-04-04 19:55:28 main:574] : INFO : Epoch 1925 | loss: 0.0311492 | val_loss: 0.0311609 | Time: 6293.51 ms [2022-04-04 19:55:34 main:574] : INFO : Epoch 1926 | loss: 0.0311487 | val_loss: 0.0311615 | Time: 6257.17 ms [2022-04-04 19:55:41 main:574] : INFO : Epoch 1927 | loss: 0.0311471 | val_loss: 0.0311619 | Time: 6269.25 ms [2022-04-04 19:55:47 main:574] : INFO : Epoch 1928 | loss: 0.0311477 | val_loss: 0.0311621 | Time: 6296.35 ms [2022-04-04 19:55:53 main:574] : INFO : Epoch 1929 | loss: 0.0311459 | val_loss: 0.0311609 | Time: 6282.17 ms [2022-04-04 19:55:59 main:574] : INFO : Epoch 1930 | loss: 0.0311481 | val_loss: 0.0311639 | Time: 6315.44 ms [2022-04-04 19:56:06 main:574] : INFO : Epoch 1931 | loss: 0.0311479 | val_loss: 0.0311593 | Time: 6272.11 ms [2022-04-04 19:56:12 main:574] : INFO : Epoch 1932 | loss: 0.0311452 | val_loss: 0.0311556 | Time: 6282.99 ms [2022-04-04 19:56:18 main:574] : INFO : Epoch 1933 | loss: 0.031144 | val_loss: 0.0311584 | Time: 6268.59 ms [2022-04-04 19:56:25 main:574] : INFO : Epoch 1934 | loss: 0.031153 | val_loss: 0.0311675 | Time: 6251.51 ms [2022-04-04 19:56:31 main:574] : INFO : Epoch 1935 | loss: 0.0311537 | val_loss: 0.0311647 | Time: 6263.1 ms [2022-04-04 19:56:37 main:574] : INFO : Epoch 1936 | loss: 0.0311472 | val_loss: 0.0311641 | Time: 6303.09 ms [2022-04-04 19:56:43 main:574] : INFO : Epoch 1937 | loss: 0.0311498 | val_loss: 0.0311647 | Time: 6302.03 ms [2022-04-04 19:56:50 main:574] : INFO : Epoch 1938 | loss: 0.0311477 | val_loss: 0.0311601 | Time: 6297.42 ms [2022-04-04 19:56:56 main:574] : INFO : Epoch 1939 | loss: 0.0311461 | val_loss: 0.0311603 | Time: 6409.43 ms [2022-04-04 19:57:03 main:574] : INFO : Epoch 1940 | loss: 0.0311449 | val_loss: 0.0311615 | Time: 6307.09 ms [2022-04-04 19:57:09 main:574] : INFO : Epoch 1941 | loss: 0.031143 | val_loss: 0.0311607 | Time: 6275.38 ms [2022-04-04 19:57:15 main:574] : INFO : Epoch 1942 | loss: 0.0311432 | val_loss: 0.0311602 | Time: 6309.41 ms [2022-04-04 19:57:21 main:574] : INFO : Epoch 1943 | loss: 0.0311441 | val_loss: 0.0311569 | Time: 6301.71 ms [2022-04-04 19:57:28 main:574] : INFO : Epoch 1944 | loss: 0.031145 | val_loss: 0.0311578 | Time: 6325.93 ms [2022-04-04 19:57:34 main:574] : INFO : Epoch 1945 | loss: 0.0311449 | val_loss: 0.0311609 | Time: 6388.81 ms [2022-04-04 19:57:41 main:574] : INFO : Epoch 1946 | loss: 0.031147 | val_loss: 0.0311587 | Time: 6514.64 ms [2022-04-04 19:57:47 main:574] : INFO : Epoch 1947 | loss: 0.0311459 | val_loss: 0.0311592 | Time: 6550.56 ms [2022-04-04 19:57:54 main:574] : INFO : Epoch 1948 | loss: 0.0311444 | val_loss: 0.0311614 | Time: 6627.53 ms [2022-04-04 19:58:00 main:574] : INFO : Epoch 1949 | loss: 0.0311436 | val_loss: 0.0311596 | Time: 6553.95 ms [2022-04-04 19:58:07 main:574] : INFO : Epoch 1950 | loss: 0.0311417 | val_loss: 0.0311606 | Time: 6324.91 ms [2022-04-04 19:58:13 main:574] : INFO : Epoch 1951 | loss: 0.0311442 | val_loss: 0.03116 | Time: 6286.81 ms [2022-04-04 19:58:19 main:574] : INFO : Epoch 1952 | loss: 0.0311425 | val_loss: 0.0311605 | Time: 6267.98 ms [2022-04-04 19:58:26 main:574] : INFO : Epoch 1953 | loss: 0.031142 | val_loss: 0.0311614 | Time: 6308.83 ms [2022-04-04 19:58:32 main:574] : INFO : Epoch 1954 | loss: 0.0311491 | val_loss: 0.0311635 | Time: 6333.51 ms [2022-04-04 19:58:38 main:574] : INFO : Epoch 1955 | loss: 0.0311507 | val_loss: 0.0311606 | Time: 6310.03 ms [2022-04-04 19:58:45 main:574] : INFO : Epoch 1956 | loss: 0.0311469 | val_loss: 0.0311601 | Time: 6360.65 ms [2022-04-04 19:58:51 main:574] : INFO : Epoch 1957 | loss: 0.0311446 | val_loss: 0.0311626 | Time: 6394.02 ms [2022-04-04 19:58:57 main:574] : INFO : Epoch 1958 | loss: 0.0311435 | val_loss: 0.0311582 | Time: 6275.8 ms [2022-04-04 19:59:04 main:574] : INFO : Epoch 1959 | loss: 0.031142 | val_loss: 0.0311566 | Time: 6284.12 ms [2022-04-04 19:59:10 main:574] : INFO : Epoch 1960 | loss: 0.0311574 | val_loss: 0.0311733 | Time: 6274.96 ms [2022-04-04 19:59:16 main:574] : INFO : Epoch 1961 | loss: 0.0311658 | val_loss: 0.0311649 | Time: 6296.53 ms [2022-04-04 19:59:23 main:574] : INFO : Epoch 1962 | loss: 0.031162 | val_loss: 0.0311644 | Time: 6290.35 ms [2022-04-04 19:59:29 main:574] : INFO : Epoch 1963 | loss: 0.0311586 | val_loss: 0.0311589 | Time: 6244.41 ms [2022-04-04 19:59:35 main:574] : INFO : Epoch 1964 | loss: 0.0311562 | val_loss: 0.0311592 | Time: 6305.7 ms [2022-04-04 19:59:42 main:574] : INFO : Epoch 1965 | loss: 0.0311557 | val_loss: 0.031159 | Time: 6306.71 ms [2022-04-04 19:59:48 main:574] : INFO : Epoch 1966 | loss: 0.0311526 | val_loss: 0.0311608 | Time: 6268.84 ms [2022-04-04 19:59:54 main:574] : INFO : Epoch 1967 | loss: 0.031152 | val_loss: 0.0311612 | Time: 6328.84 ms [2022-04-04 20:00:00 main:574] : INFO : Epoch 1968 | loss: 0.0311516 | val_loss: 0.0311645 | Time: 6299.98 ms [2022-04-04 20:00:07 main:574] : INFO : Epoch 1969 | loss: 0.0311519 | val_loss: 0.0311588 | Time: 6305.75 ms [2022-04-04 20:00:13 main:574] : INFO : Epoch 1970 | loss: 0.0311507 | val_loss: 0.0311585 | Time: 6262.31 ms [2022-04-04 20:00:19 main:574] : INFO : Epoch 1971 | loss: 0.0311478 | val_loss: 0.0311588 | Time: 6262.43 ms [2022-04-04 20:00:26 main:574] : INFO : Epoch 1972 | loss: 0.0311506 | val_loss: 0.0311599 | Time: 6273.72 ms [2022-04-04 20:00:32 main:574] : INFO : Epoch 1973 | loss: 0.0311485 | val_loss: 0.0311582 | Time: 6312.71 ms [2022-04-04 20:00:38 main:574] : INFO : Epoch 1974 | loss: 0.0311483 | val_loss: 0.0311581 | Time: 6295.83 ms [2022-04-04 20:00:45 main:574] : INFO : Epoch 1975 | loss: 0.03115 | val_loss: 0.0311581 | Time: 6249.09 ms [2022-04-04 20:00:51 main:574] : INFO : Epoch 1976 | loss: 0.0311476 | val_loss: 0.0311583 | Time: 6295.47 ms [2022-04-04 20:00:57 main:574] : INFO : Epoch 1977 | loss: 0.0311478 | val_loss: 0.0311576 | Time: 6273.08 ms [2022-04-04 20:01:03 main:574] : INFO : Epoch 1978 | loss: 0.0311465 | val_loss: 0.0311587 | Time: 6263.34 ms [2022-04-04 20:01:10 main:574] : INFO : Epoch 1979 | loss: 0.031153 | val_loss: 0.0311591 | Time: 6273.5 ms [2022-04-04 20:01:16 main:574] : INFO : Epoch 1980 | loss: 0.0311545 | val_loss: 0.0311596 | Time: 6260.78 ms [2022-04-04 20:01:22 main:574] : INFO : Epoch 1981 | loss: 0.0311554 | val_loss: 0.0311666 | Time: 6294.15 ms [2022-04-04 20:01:29 main:574] : INFO : Epoch 1982 | loss: 0.0311712 | val_loss: 0.031176 | Time: 6291.86 ms [2022-04-04 20:01:35 main:574] : INFO : Epoch 1983 | loss: 0.0311714 | val_loss: 0.031172 | Time: 6288.92 ms [2022-04-04 20:01:41 main:574] : INFO : Epoch 1984 | loss: 0.0311686 | val_loss: 0.0311715 | Time: 6272.75 ms [2022-04-04 20:01:47 main:574] : INFO : Epoch 1985 | loss: 0.0311657 | val_loss: 0.0311711 | Time: 6281.39 ms [2022-04-04 20:01:54 main:574] : INFO : Epoch 1986 | loss: 0.0311642 | val_loss: 0.0311687 | Time: 6231.96 ms [2022-04-04 20:02:00 main:574] : INFO : Epoch 1987 | loss: 0.031162 | val_loss: 0.0311649 | Time: 6288.22 ms [2022-04-04 20:02:06 main:574] : INFO : Epoch 1988 | loss: 0.0311614 | val_loss: 0.0311669 | Time: 6326.94 ms [2022-04-04 20:02:13 main:574] : INFO : Epoch 1989 | loss: 0.0311601 | val_loss: 0.0311656 | Time: 6305.32 ms [2022-04-04 20:02:19 main:574] : INFO : Epoch 1990 | loss: 0.0311618 | val_loss: 0.0311687 | Time: 6280.77 ms [2022-04-04 20:02:25 main:574] : INFO : Epoch 1991 | loss: 0.0311624 | val_loss: 0.0311695 | Time: 6309.39 ms [2022-04-04 20:02:32 main:574] : INFO : Epoch 1992 | loss: 0.0311628 | val_loss: 0.0311693 | Time: 6275.76 ms [2022-04-04 20:02:38 main:574] : INFO : Epoch 1993 | loss: 0.0311626 | val_loss: 0.0311721 | Time: 6274.03 ms [2022-04-04 20:02:44 main:574] : INFO : Epoch 1994 | loss: 0.0311602 | val_loss: 0.0311647 | Time: 6290.05 ms [2022-04-04 20:02:50 main:574] : INFO : Epoch 1995 | loss: 0.0311578 | val_loss: 0.0311638 | Time: 6259.43 ms [2022-04-04 20:02:57 main:574] : INFO : Epoch 1996 | loss: 0.0311566 | val_loss: 0.0311661 | Time: 6308.22 ms [2022-04-04 20:03:03 main:574] : INFO : Epoch 1997 | loss: 0.0311544 | val_loss: 0.0311658 | Time: 6368.99 ms [2022-04-04 20:03:09 main:574] : INFO : Epoch 1998 | loss: 0.031156 | val_loss: 0.0311652 | Time: 6283.3 ms [2022-04-04 20:03:16 main:574] : INFO : Epoch 1999 | loss: 0.0311567 | val_loss: 0.0311693 | Time: 6280.6 ms [2022-04-04 20:03:22 main:574] : INFO : Epoch 2000 | loss: 0.0311541 | val_loss: 0.0311646 | Time: 6314.88 ms [2022-04-04 20:03:28 main:574] : INFO : Epoch 2001 | loss: 0.0311537 | val_loss: 0.0311685 | Time: 6283.49 ms [2022-04-04 20:03:35 main:574] : INFO : Epoch 2002 | loss: 0.0311532 | val_loss: 0.031164 | Time: 6306.09 ms [2022-04-04 20:03:41 main:574] : INFO : Epoch 2003 | loss: 0.0311553 | val_loss: 0.0311651 | Time: 6262.71 ms [2022-04-04 20:03:47 main:574] : INFO : Epoch 2004 | loss: 0.0311534 | val_loss: 0.0311635 | Time: 6255.3 ms [2022-04-04 20:03:54 main:574] : INFO : Epoch 2005 | loss: 0.031152 | val_loss: 0.0311631 | Time: 6359.72 ms [2022-04-04 20:04:00 main:574] : INFO : Epoch 2006 | loss: 0.031153 | val_loss: 0.0311655 | Time: 6301.98 ms [2022-04-04 20:04:06 main:574] : INFO : Epoch 2007 | loss: 0.0311573 | val_loss: 0.0311664 | Time: 6306.15 ms [2022-04-04 20:04:13 main:574] : INFO : Epoch 2008 | loss: 0.0311572 | val_loss: 0.0311666 | Time: 6394.91 ms [2022-04-04 20:04:19 main:574] : INFO : Epoch 2009 | loss: 0.0311596 | val_loss: 0.0311638 | Time: 6275.28 ms [2022-04-04 20:04:25 main:574] : INFO : Epoch 2010 | loss: 0.0311578 | val_loss: 0.0311653 | Time: 6264.47 ms [2022-04-04 20:04:31 main:574] : INFO : Epoch 2011 | loss: 0.0311576 | val_loss: 0.0311656 | Time: 6269.35 ms [2022-04-04 20:04:38 main:574] : INFO : Epoch 2012 | loss: 0.0311574 | val_loss: 0.0311623 | Time: 6257.62 ms [2022-04-04 20:04:44 main:574] : INFO : Epoch 2013 | loss: 0.0311575 | val_loss: 0.0311616 | Time: 6294.11 ms [2022-04-04 20:04:50 main:574] : INFO : Epoch 2014 | loss: 0.0311593 | val_loss: 0.0311645 | Time: 6334.03 ms [2022-04-04 20:04:57 main:574] : INFO : Epoch 2015 | loss: 0.0311587 | val_loss: 0.0311643 | Time: 6262.47 ms [2022-04-04 20:05:03 main:574] : INFO : Epoch 2016 | loss: 0.0311573 | val_loss: 0.0311654 | Time: 6310.5 ms [2022-04-04 20:05:09 main:574] : INFO : Epoch 2017 | loss: 0.0311577 | val_loss: 0.031164 | Time: 6300.46 ms [2022-04-04 20:05:16 main:574] : INFO : Epoch 2018 | loss: 0.0311568 | val_loss: 0.0311675 | Time: 6245.84 ms [2022-04-04 20:05:22 main:574] : INFO : Epoch 2019 | loss: 0.0311598 | val_loss: 0.0311641 | Time: 6290.26 ms [2022-04-04 20:05:28 main:574] : INFO : Epoch 2020 | loss: 0.0311597 | val_loss: 0.0311657 | Time: 6282.31 ms [2022-04-04 20:05:34 main:574] : INFO : Epoch 2021 | loss: 0.0311579 | val_loss: 0.0311644 | Time: 6258.35 ms [2022-04-04 20:05:41 main:574] : INFO : Epoch 2022 | loss: 0.0311566 | val_loss: 0.031168 | Time: 6265.48 ms [2022-04-04 20:05:47 main:574] : INFO : Epoch 2023 | loss: 0.031157 | val_loss: 0.0311699 | Time: 6308.59 ms [2022-04-04 20:05:53 main:574] : INFO : Epoch 2024 | loss: 0.0311569 | val_loss: 0.0311647 | Time: 6280.5 ms [2022-04-04 20:06:00 main:574] : INFO : Epoch 2025 | loss: 0.0311535 | val_loss: 0.0311708 | Time: 6294.88 ms [2022-04-04 20:06:06 main:574] : INFO : Epoch 2026 | loss: 0.0311537 | val_loss: 0.0311665 | Time: 6319.4 ms [2022-04-04 20:06:12 main:574] : INFO : Epoch 2027 | loss: 0.0311527 | val_loss: 0.0311677 | Time: 6259.55 ms [2022-04-04 20:06:19 main:574] : INFO : Epoch 2028 | loss: 0.031152 | val_loss: 0.0311668 | Time: 6292.08 ms [2022-04-04 20:06:25 main:574] : INFO : Epoch 2029 | loss: 0.0311508 | val_loss: 0.0311653 | Time: 6311.96 ms [2022-04-04 20:06:31 main:574] : INFO : Epoch 2030 | loss: 0.0311498 | val_loss: 0.0311646 | Time: 6278.94 ms [2022-04-04 20:06:37 main:574] : INFO : Epoch 2031 | loss: 0.0311494 | val_loss: 0.0311638 | Time: 6285.13 ms [2022-04-04 20:06:44 main:574] : INFO : Epoch 2032 | loss: 0.0311497 | val_loss: 0.0311656 | Time: 6316.17 ms [2022-04-04 20:06:50 main:574] : INFO : Epoch 2033 | loss: 0.0311487 | val_loss: 0.0311651 | Time: 6356.16 ms [2022-04-04 20:06:56 main:574] : INFO : Epoch 2034 | loss: 0.0311481 | val_loss: 0.0311671 | Time: 6247.28 ms [2022-04-04 20:07:03 main:574] : INFO : Epoch 2035 | loss: 0.0311481 | val_loss: 0.0311673 | Time: 6295.38 ms [2022-04-04 20:07:09 main:574] : INFO : Epoch 2036 | loss: 0.0311507 | val_loss: 0.0311638 | Time: 6309.1 ms [2022-04-04 20:07:15 main:574] : INFO : Epoch 2037 | loss: 0.0311503 | val_loss: 0.0311625 | Time: 6285.62 ms [2022-04-04 20:07:22 main:574] : INFO : Epoch 2038 | loss: 0.0311512 | val_loss: 0.0311643 | Time: 6288.32 ms [2022-04-04 20:07:28 main:574] : INFO : Epoch 2039 | loss: 0.0311508 | val_loss: 0.031164 | Time: 6314.01 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-04-04 20:15:52 main:435] : INFO : Set logging level to 1 [2022-04-04 20:15:52 main:441] : INFO : Running in BOINC Client mode [2022-04-04 20:15:52 main:444] : INFO : Resolving all filenames [2022-04-04 20:15:52 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-04 20:15:52 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-04 20:15:52 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-04 20:15:52 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-04 20:15:52 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-04 20:15:52 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-04 20:15:52 main:474] : INFO : Configuration: [2022-04-04 20:15:52 main:475] : INFO : Model type: GRU [2022-04-04 20:15:52 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-04 20:15:52 main:477] : INFO : Max Epochs: 2048 [2022-04-04 20:15:52 main:478] : INFO : Batch Size: 128 [2022-04-04 20:15:52 main:479] : INFO : Learning Rate: 0.01 [2022-04-04 20:15:52 main:480] : INFO : Patience: 10 [2022-04-04 20:15:52 main:481] : INFO : Hidden Width: 12 [2022-04-04 20:15:52 main:482] : INFO : # Recurrent Layers: 4 [2022-04-04 20:15:52 main:483] : INFO : # Backend Layers: 4 [2022-04-04 20:15:52 main:484] : INFO : # Threads: 1 [2022-04-04 20:15:52 main:486] : INFO : Preparing Dataset [2022-04-04 20:15:52 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-04 20:15:53 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-04 20:15:55 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-04 20:15:55 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-04 20:15:55 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-04 20:15:56 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-04 20:15:56 main:494] : INFO : Creating Model [2022-04-04 20:15:56 main:507] : INFO : Preparing config file [2022-04-04 20:15:56 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-04 20:15:56 main:512] : INFO : Loading config [2022-04-04 20:15:56 main:514] : INFO : Loading state [2022-04-04 20:15:56 main:559] : INFO : Loading DataLoader into Memory [2022-04-04 20:15:56 main:562] : INFO : Starting Training Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-04-04 20:20:36 main:435] : INFO : Set logging level to 1 [2022-04-04 20:20:36 main:441] : INFO : Running in BOINC Client mode [2022-04-04 20:20:36 main:444] : INFO : Resolving all filenames [2022-04-04 20:20:36 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-04 20:20:36 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-04 20:20:36 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-04 20:20:36 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-04 20:20:36 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-04 20:20:36 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-04 20:20:36 main:474] : INFO : Configuration: [2022-04-04 20:20:36 main:475] : INFO : Model type: GRU [2022-04-04 20:20:36 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-04 20:20:36 main:477] : INFO : Max Epochs: 2048 [2022-04-04 20:20:36 main:478] : INFO : Batch Size: 128 [2022-04-04 20:20:36 main:479] : INFO : Learning Rate: 0.01 [2022-04-04 20:20:36 main:480] : INFO : Patience: 10 [2022-04-04 20:20:36 main:481] : INFO : Hidden Width: 12 [2022-04-04 20:20:36 main:482] : INFO : # Recurrent Layers: 4 [2022-04-04 20:20:36 main:483] : INFO : # Backend Layers: 4 [2022-04-04 20:20:36 main:484] : INFO : # Threads: 1 [2022-04-04 20:20:36 main:486] : INFO : Preparing Dataset [2022-04-04 20:20:36 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-04 20:20:36 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-04 20:20:38 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-04 20:20:38 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-04 20:20:38 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-04 20:20:38 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-04 20:20:38 main:494] : INFO : Creating Model [2022-04-04 20:20:38 main:507] : INFO : Preparing config file [2022-04-04 20:20:38 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-04 20:20:38 main:512] : INFO : Loading config [2022-04-04 20:20:38 main:514] : INFO : Loading state [2022-04-04 20:20:39 main:559] : INFO : Loading DataLoader into Memory [2022-04-04 20:20:39 main:562] : INFO : Starting Training [2022-04-04 20:20:46 main:574] : INFO : Epoch 2030 | loss: 0.0311783 | val_loss: 0.0311697 | Time: 6655.78 ms [2022-04-04 20:20:52 main:574] : INFO : Epoch 2031 | loss: 0.031154 | val_loss: 0.0311671 | Time: 6264.69 ms [2022-04-04 20:20:58 main:574] : INFO : Epoch 2032 | loss: 0.031153 | val_loss: 0.0311672 | Time: 6268.38 ms [2022-04-04 20:21:05 main:574] : INFO : Epoch 2033 | loss: 0.0311527 | val_loss: 0.0311701 | Time: 6286.81 ms [2022-04-04 20:21:11 main:574] : INFO : Epoch 2034 | loss: 0.0311525 | val_loss: 0.031168 | Time: 6294.32 ms [2022-04-04 20:21:17 main:574] : INFO : Epoch 2035 | loss: 0.0311507 | val_loss: 0.0311648 | Time: 6255.42 ms [2022-04-04 20:21:23 main:574] : INFO : Epoch 2036 | loss: 0.031149 | val_loss: 0.031166 | Time: 6257.88 ms [2022-04-04 20:21:30 main:574] : INFO : Epoch 2037 | loss: 0.0311492 | val_loss: 0.0311679 | Time: 6306.18 ms [2022-04-04 20:21:36 main:574] : INFO : Epoch 2038 | loss: 0.0311562 | val_loss: 0.0311678 | Time: 6289.05 ms [2022-04-04 20:21:42 main:574] : INFO : Epoch 2039 | loss: 0.0311581 | val_loss: 0.0311691 | Time: 6302.28 ms [2022-04-04 20:21:49 main:574] : INFO : Epoch 2040 | loss: 0.0311575 | val_loss: 0.0311699 | Time: 6270.54 ms [2022-04-04 20:21:55 main:574] : INFO : Epoch 2041 | loss: 0.0311574 | val_loss: 0.0311703 | Time: 6282.65 ms [2022-04-04 20:22:01 main:574] : INFO : Epoch 2042 | loss: 0.0311575 | val_loss: 0.0311691 | Time: 6272.65 ms [2022-04-04 20:22:08 main:574] : INFO : Epoch 2043 | loss: 0.0311574 | val_loss: 0.0311658 | Time: 6276.07 ms [2022-04-04 20:22:14 main:574] : INFO : Epoch 2044 | loss: 0.0311576 | val_loss: 0.0311705 | Time: 6269.48 ms [2022-04-04 20:22:20 main:574] : INFO : Epoch 2045 | loss: 0.0311604 | val_loss: 0.0311714 | Time: 6269.97 ms [2022-04-04 20:22:26 main:574] : INFO : Epoch 2046 | loss: 0.0311634 | val_loss: 0.0311651 | Time: 6303.27 ms [2022-04-04 20:22:33 main:574] : INFO : Epoch 2047 | loss: 0.0311643 | val_loss: 0.0311643 | Time: 6303.82 ms [2022-04-04 20:22:39 main:574] : INFO : Epoch 2048 | loss: 0.0311628 | val_loss: 0.0311639 | Time: 6265.47 ms [2022-04-04 20:22:39 main:597] : INFO : Saving trained model to model-final.pt, val_loss 0.0311639 [2022-04-04 20:22:39 main:603] : INFO : Saving end state to config to file [2022-04-04 20:22:39 main:608] : INFO : Success, exiting.. 20:22:39 (9396): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)