Task 13856587
| Name | ParityModified-1647049374-4975-2-0_0 |
| Workunit | 10935360 |
| Created | 27 Mar 2022, 18:31:38 UTC |
| Sent | 1 Apr 2022, 20:30:59 UTC |
| Report deadline | 9 Apr 2022, 20:30:59 UTC |
| Received | 3 Apr 2022, 4:33:44 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 6170 |
| Run time | 5 hours 28 min 29 sec |
| CPU time | 4 hours 32 min 6 sec |
| Validate state | Valid |
| Credit | 4,160.00 |
| Device peak FLOPS | 1,130.52 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.62 GB |
| Peak swap size | 3.57 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version> <![CDATA[ <stderr_txt> | val_loss: 0.0311638 | Time: 8740.48 ms [2022-04-01 20:51:51 main:574] : INFO : Epoch 1790 | loss: 0.0311621 | val_loss: 0.0311635 | Time: 13944.9 ms [2022-04-01 20:52:02 main:574] : INFO : Epoch 1791 | loss: 0.0311636 | val_loss: 0.0311634 | Time: 10580 ms [2022-04-01 20:52:13 main:574] : INFO : Epoch 1792 | loss: 0.0311618 | val_loss: 0.0311637 | Time: 10351.9 ms [2022-04-01 20:52:20 main:574] : INFO : Epoch 1793 | loss: 0.0311612 | val_loss: 0.0311635 | Time: 6974.77 ms [2022-04-01 20:52:26 main:574] : INFO : Epoch 1794 | loss: 0.0311617 | val_loss: 0.0311648 | Time: 6795.15 ms [2022-04-01 20:52:33 main:574] : INFO : Epoch 1795 | loss: 0.0311629 | val_loss: 0.0311654 | Time: 6619.58 ms [2022-04-01 20:52:40 main:574] : INFO : Epoch 1796 | loss: 0.0311645 | val_loss: 0.0311682 | Time: 6470.76 ms [2022-04-01 20:52:46 main:574] : INFO : Epoch 1797 | loss: 0.0311637 | val_loss: 0.0311636 | Time: 6436.75 ms [2022-04-01 20:52:52 main:574] : INFO : Epoch 1798 | loss: 0.0311626 | val_loss: 0.031164 | Time: 6192.04 ms [2022-04-01 20:52:59 main:574] : INFO : Epoch 1799 | loss: 0.0311621 | val_loss: 0.0311648 | Time: 6088.33 ms [2022-04-01 20:53:04 main:574] : INFO : Epoch 1800 | loss: 0.0311614 | val_loss: 0.0311629 | Time: 5841.75 ms [2022-04-01 20:53:10 main:574] : INFO : Epoch 1801 | loss: 0.0311626 | val_loss: 0.0311621 | Time: 5619.6 ms [2022-04-01 20:53:21 main:574] : INFO : Epoch 1802 | loss: 0.031161 | val_loss: 0.0311628 | Time: 11038.5 ms [2022-04-01 20:53:29 main:574] : INFO : Epoch 1803 | loss: 0.0311607 | val_loss: 0.0311658 | Time: 7818.44 ms [2022-04-01 20:53:36 main:574] : INFO : Epoch 1804 | loss: 0.0311597 | val_loss: 0.0311644 | Time: 6860.28 ms [2022-04-01 20:53:43 main:574] : INFO : Epoch 1805 | loss: 0.0311603 | val_loss: 0.0311684 | Time: 6615.13 ms [2022-04-01 20:53:49 main:574] : INFO : Epoch 1806 | loss: 0.0311606 | val_loss: 0.0311658 | Time: 6568.37 ms [2022-04-01 20:53:55 main:574] : INFO : Epoch 1807 | loss: 0.0311603 | val_loss: 0.0311667 | Time: 6003.15 ms [2022-04-01 20:54:01 main:574] : INFO : Epoch 1808 | loss: 0.0311612 | val_loss: 0.0311679 | Time: 5477.89 ms [2022-04-01 20:54:12 main:574] : INFO : Epoch 1809 | loss: 0.0311627 | val_loss: 0.0311673 | Time: 10814.3 ms [2022-04-01 20:54:20 main:574] : INFO : Epoch 1810 | loss: 0.0311622 | val_loss: 0.0311678 | Time: 8012.73 ms [2022-04-01 20:54:27 main:574] : INFO : Epoch 1811 | loss: 0.0311621 | val_loss: 0.0311652 | Time: 6702.44 ms [2022-04-01 20:54:33 main:574] : INFO : Epoch 1812 | loss: 0.0311599 | val_loss: 0.0311655 | Time: 6357.22 ms [2022-04-01 20:54:47 main:574] : INFO : Epoch 1813 | loss: 0.0311605 | val_loss: 0.0311655 | Time: 13522.5 ms [2022-04-01 20:54:58 main:574] : INFO : Epoch 1814 | loss: 0.0311603 | val_loss: 0.0311684 | Time: 11055.1 ms [2022-04-01 20:55:09 main:574] : INFO : Epoch 1815 | loss: 0.0311633 | val_loss: 0.0311633 | Time: 10983.9 ms [2022-04-01 20:55:17 main:574] : INFO : Epoch 1816 | loss: 0.0311634 | val_loss: 0.0311666 | Time: 8353.22 ms [2022-04-01 20:55:25 main:574] : INFO : Epoch 1817 | loss: 0.0311638 | val_loss: 0.0311648 | Time: 7406.92 ms [2022-04-01 20:55:31 main:574] : INFO : Epoch 1818 | loss: 0.0311607 | val_loss: 0.031162 | Time: 6767.69 ms [2022-04-01 20:55:38 main:574] : INFO : Epoch 1819 | loss: 0.0311623 | val_loss: 0.0311627 | Time: 6713.98 ms [2022-04-01 20:55:49 main:574] : INFO : Epoch 1820 | loss: 0.0311659 | val_loss: 0.0311649 | Time: 11060.2 ms [2022-04-01 20:55:58 main:574] : INFO : Epoch 1821 | loss: 0.0311645 | val_loss: 0.031163 | Time: 8273.91 ms [2022-04-01 20:56:05 main:574] : INFO : Epoch 1822 | loss: 0.0311644 | val_loss: 0.0311643 | Time: 7334.1 ms [2022-04-01 20:56:12 main:574] : INFO : Epoch 1823 | loss: 0.0311665 | val_loss: 0.0311655 | Time: 6353.14 ms [2022-04-01 20:56:18 main:574] : INFO : Epoch 1824 | loss: 0.0311627 | val_loss: 0.0311634 | Time: 5878.6 ms [2022-04-01 20:56:23 main:574] : INFO : Epoch 1825 | loss: 0.0311627 | val_loss: 0.0311637 | Time: 5603.94 ms [2022-04-01 20:56:29 main:574] : INFO : Epoch 1826 | loss: 0.0311612 | val_loss: 0.0311608 | Time: 5578.25 ms [2022-04-01 20:56:34 main:574] : INFO : Epoch 1827 | loss: 0.0311617 | val_loss: 0.0311625 | Time: 5557.82 ms [2022-04-01 20:56:46 main:574] : INFO : Epoch 1828 | loss: 0.0311602 | val_loss: 0.0311615 | Time: 11454 ms [2022-04-01 20:56:55 main:574] : INFO : Epoch 1829 | loss: 0.031162 | val_loss: 0.0311647 | Time: 9419.08 ms [2022-04-01 20:57:03 main:574] : INFO : Epoch 1830 | loss: 0.0311602 | val_loss: 0.0311631 | Time: 7884.94 ms [2022-04-01 20:57:10 main:574] : INFO : Epoch 1831 | loss: 0.0311607 | val_loss: 0.0311619 | Time: 6817.87 ms [2022-04-01 20:57:17 main:574] : INFO : Epoch 1832 | loss: 0.0311608 | val_loss: 0.0311619 | Time: 6939.35 ms [2022-04-01 20:57:28 main:574] : INFO : Epoch 1833 | loss: 0.0311607 | val_loss: 0.0311659 | Time: 10297.9 ms [2022-04-01 20:57:34 main:574] : INFO : Epoch 1834 | loss: 0.031163 | val_loss: 0.0311664 | Time: 6421.3 ms [2022-04-01 20:57:46 main:574] : INFO : Epoch 1835 | loss: 0.03116 | val_loss: 0.0311633 | Time: 12043.8 ms [2022-04-01 20:58:00 main:574] : INFO : Epoch 1836 | loss: 0.0311587 | val_loss: 0.0311632 | Time: 13764.9 ms [2022-04-01 20:58:11 main:574] : INFO : Epoch 1837 | loss: 0.0311601 | val_loss: 0.0311643 | Time: 11269.6 ms [2022-04-01 20:58:21 main:574] : INFO : Epoch 1838 | loss: 0.0311593 | val_loss: 0.0311623 | Time: 9472.11 ms [2022-04-01 20:58:31 main:574] : INFO : Epoch 1839 | loss: 0.0311586 | val_loss: 0.0311606 | Time: 9901.81 ms [2022-04-01 20:58:37 main:574] : INFO : Epoch 1840 | loss: 0.0311579 | val_loss: 0.0311622 | Time: 6657.64 ms [2022-04-01 20:58:44 main:574] : INFO : Epoch 1841 | loss: 0.0311571 | val_loss: 0.0311625 | Time: 6793.3 ms [2022-04-01 20:58:51 main:574] : INFO : Epoch 1842 | loss: 0.0311574 | val_loss: 0.0311637 | Time: 6485.2 ms [2022-04-01 20:58:57 main:574] : INFO : Epoch 1843 | loss: 0.0311573 | val_loss: 0.0311623 | Time: 6363.65 ms [2022-04-01 20:59:04 main:574] : INFO : Epoch 1844 | loss: 0.031157 | val_loss: 0.0311637 | Time: 6382.72 ms [2022-04-01 20:59:16 main:574] : INFO : Epoch 1845 | loss: 0.0311572 | val_loss: 0.031162 | Time: 11907 ms [2022-04-01 20:59:25 main:574] : INFO : Epoch 1846 | loss: 0.0311566 | val_loss: 0.0311611 | Time: 9064.05 ms [2022-04-01 20:59:37 main:574] : INFO : Epoch 1847 | loss: 0.0311565 | val_loss: 0.0311622 | Time: 11840.7 ms [2022-04-01 20:59:46 main:574] : INFO : Epoch 1848 | loss: 0.0311617 | val_loss: 0.0311651 | Time: 9288.93 ms [2022-04-01 20:59:58 main:574] : INFO : Epoch 1849 | loss: 0.0311605 | val_loss: 0.0311618 | Time: 11642.6 ms [2022-04-01 21:00:07 main:574] : INFO : Epoch 1850 | loss: 0.0311589 | val_loss: 0.0311629 | Time: 8736.59 ms [2022-04-01 21:00:14 main:574] : INFO : Epoch 1851 | loss: 0.0311582 | val_loss: 0.0311617 | Time: 7454.01 ms [2022-04-01 21:00:26 main:574] : INFO : Epoch 1852 | loss: 0.0311578 | val_loss: 0.0311649 | Time: 11929.6 ms [2022-04-01 21:00:34 main:574] : INFO : Epoch 1853 | loss: 0.0311574 | val_loss: 0.0311631 | Time: 7789.21 ms [2022-04-01 21:00:41 main:574] : INFO : Epoch 1854 | loss: 0.0311564 | val_loss: 0.0311625 | Time: 7050 ms [2022-04-01 21:00:48 main:574] : INFO : Epoch 1855 | loss: 0.0311565 | val_loss: 0.0311616 | Time: 6867.08 ms [2022-04-01 21:00:55 main:574] : INFO : Epoch 1856 | loss: 0.0311571 | val_loss: 0.0311611 | Time: 6652.08 ms [2022-04-01 21:01:01 main:574] : INFO : Epoch 1857 | loss: 0.0311566 | val_loss: 0.0311624 | Time: 6564.86 ms [2022-04-01 21:01:08 main:574] : INFO : Epoch 1858 | loss: 0.0311571 | val_loss: 0.0311624 | Time: 6345.23 ms [2022-04-01 21:01:21 main:574] : INFO : Epoch 1859 | loss: 0.0311583 | val_loss: 0.0311629 | Time: 12773.7 ms [2022-04-01 21:01:29 main:574] : INFO : Epoch 1860 | loss: 0.0311569 | val_loss: 0.031163 | Time: 8508.21 ms [2022-04-01 21:01:41 main:574] : INFO : Epoch 1861 | loss: 0.0311557 | val_loss: 0.0311625 | Time: 11300.2 ms [2022-04-01 21:01:51 main:574] : INFO : Epoch 1862 | loss: 0.0311562 | val_loss: 0.031166 | Time: 9981.98 ms [2022-04-01 21:02:00 main:574] : INFO : Epoch 1863 | loss: 0.0311583 | val_loss: 0.031164 | Time: 8751.97 ms [2022-04-01 21:02:06 main:574] : INFO : Epoch 1864 | loss: 0.0311575 | val_loss: 0.0311616 | Time: 6544.96 ms [2022-04-01 21:02:13 main:574] : INFO : Epoch 1865 | loss: 0.0311579 | val_loss: 0.0311638 | Time: 6359.44 ms [2022-04-01 21:02:26 main:574] : INFO : Epoch 1866 | loss: 0.0311564 | val_loss: 0.0311595 | Time: 13006.9 ms [2022-04-01 21:02:36 main:574] : INFO : Epoch 1867 | loss: 0.0311559 | val_loss: 0.0311617 | Time: 9934.22 ms [2022-04-01 21:02:45 main:574] : INFO : Epoch 1868 | loss: 0.0311577 | val_loss: 0.0311649 | Time: 9235.3 ms [2022-04-01 21:02:52 main:574] : INFO : Epoch 1869 | loss: 0.0311589 | val_loss: 0.0311625 | Time: 7310.77 ms [2022-04-01 21:02:58 main:574] : INFO : Epoch 1870 | loss: 0.0311595 | val_loss: 0.0311619 | Time: 5968.49 ms [2022-04-01 21:03:04 main:574] : INFO : Epoch 1871 | loss: 0.0311586 | val_loss: 0.0311638 | Time: 5905.95 ms [2022-04-01 21:03:10 main:574] : INFO : Epoch 1872 | loss: 0.0311565 | val_loss: 0.0311634 | Time: 5798.76 ms [2022-04-01 21:03:16 main:574] : INFO : Epoch 1873 | loss: 0.031158 | val_loss: 0.0311631 | Time: 5589.88 ms [2022-04-01 21:03:22 main:574] : INFO : Epoch 1874 | loss: 0.031157 | val_loss: 0.0311626 | Time: 5627.11 ms [2022-04-01 21:03:27 main:574] : INFO : Epoch 1875 | loss: 0.0311562 | val_loss: 0.0311628 | Time: 5585.24 ms [2022-04-01 21:03:33 main:574] : INFO : Epoch 1876 | loss: 0.0311569 | val_loss: 0.0311628 | Time: 5433.21 ms [2022-04-01 21:03:38 main:574] : INFO : Epoch 1877 | loss: 0.0311576 | val_loss: 0.0311633 | Time: 5528.29 ms [2022-04-01 21:03:44 main:574] : INFO : Epoch 1878 | loss: 0.0311555 | val_loss: 0.0311632 | Time: 5576.72 ms [2022-04-01 21:03:56 main:574] : INFO : Epoch 1879 | loss: 0.0311561 | val_loss: 0.0311622 | Time: 12446.8 ms [2022-04-01 21:04:04 main:574] : INFO : Epoch 1880 | loss: 0.0311579 | val_loss: 0.0311624 | Time: 7872.21 ms [2022-04-01 21:04:11 main:574] : INFO : Epoch 1881 | loss: 0.0311557 | val_loss: 0.0311618 | Time: 6584.12 ms [2022-04-01 21:04:18 main:574] : INFO : Epoch 1882 | loss: 0.0311546 | val_loss: 0.0311615 | Time: 6543.42 ms [2022-04-01 21:04:30 main:574] : INFO : Epoch 1883 | loss: 0.0311552 | val_loss: 0.0311613 | Time: 11912.6 ms [2022-04-01 21:04:43 main:574] : INFO : Epoch 1884 | loss: 0.0311542 | val_loss: 0.0311597 | Time: 13091.8 ms [2022-04-01 21:04:53 main:574] : INFO : Epoch 1885 | loss: 0.0311555 | val_loss: 0.031162 | Time: 9608.38 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GT 1030) [2022-04-01 22:14:58 main:435] : INFO : Set logging level to 1 [2022-04-01 22:14:58 main:441] : INFO : Running in BOINC Client mode [2022-04-01 22:14:58 main:444] : INFO : Resolving all filenames [2022-04-01 22:14:58 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-01 22:14:58 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-01 22:14:58 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-01 22:14:58 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-01 22:14:58 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-01 22:14:58 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-01 22:14:58 main:474] : INFO : Configuration: [2022-04-01 22:14:59 main:475] : INFO : Model type: GRU [2022-04-01 22:14:59 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-01 22:14:59 main:477] : INFO : Max Epochs: 2048 [2022-04-01 22:14:59 main:478] : INFO : Batch Size: 128 [2022-04-01 22:14:59 main:479] : INFO : Learning Rate: 0.01 [2022-04-01 22:14:59 main:480] : INFO : Patience: 10 [2022-04-01 22:15:00 main:481] : INFO : Hidden Width: 12 [2022-04-01 22:15:00 main:482] : INFO : # Recurrent Layers: 4 [2022-04-01 22:15:00 main:483] : INFO : # Backend Layers: 4 [2022-04-01 22:15:00 main:484] : INFO : # Threads: 1 [2022-04-01 22:15:00 main:486] : INFO : Preparing Dataset [2022-04-01 22:15:00 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-01 22:15:02 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-01 22:15:10 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-01 22:15:11 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-01 22:15:14 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-01 22:15:15 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-01 22:15:15 main:494] : INFO : Creating Model [2022-04-01 22:15:15 main:507] : INFO : Preparing config file [2022-04-01 22:15:16 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-01 22:15:16 main:512] : INFO : Loading config [2022-04-01 22:15:16 main:514] : INFO : Loading state [2022-04-01 22:15:21 main:559] : INFO : Loading DataLoader into Memory [2022-04-01 22:15:21 main:562] : INFO : Starting Training [2022-04-01 22:15:33 main:574] : INFO : Epoch 1883 | loss: 0.0313761 | val_loss: 0.0312146 | Time: 12060.4 ms [2022-04-01 22:15:46 main:574] : INFO : Epoch 1884 | loss: 0.0311863 | val_loss: 0.031169 | Time: 12159.4 ms [2022-04-01 22:15:59 main:574] : INFO : Epoch 1885 | loss: 0.0311658 | val_loss: 0.0311645 | Time: 13547.3 ms [2022-04-01 22:16:08 main:574] : INFO : Epoch 1886 | loss: 0.0311625 | val_loss: 0.0311658 | Time: 8629.94 ms [2022-04-01 22:16:17 main:574] : INFO : Epoch 1887 | loss: 0.0311613 | val_loss: 0.0311633 | Time: 9233.02 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GT 1030) [2022-04-01 22:18:28 main:435] : INFO : Set logging level to 1 [2022-04-01 22:18:28 main:441] : INFO : Running in BOINC Client mode [2022-04-01 22:18:28 main:444] : INFO : Resolving all filenames [2022-04-01 22:18:28 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-01 22:18:28 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-01 22:18:28 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-01 22:18:28 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-01 22:18:28 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-01 22:18:28 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-01 22:18:28 main:474] : INFO : Configuration: [2022-04-01 22:18:28 main:475] : INFO : Model type: GRU [2022-04-01 22:18:28 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-01 22:18:28 main:477] : INFO : Max Epochs: 2048 [2022-04-01 22:18:28 main:478] : INFO : Batch Size: 128 [2022-04-01 22:18:28 main:479] : INFO : Learning Rate: 0.01 [2022-04-01 22:18:28 main:480] : INFO : Patience: 10 [2022-04-01 22:18:28 main:481] : INFO : Hidden Width: 12 [2022-04-01 22:18:28 main:482] : INFO : # Recurrent Layers: 4 [2022-04-01 22:18:29 main:483] : INFO : # Backend Layers: 4 [2022-04-01 22:18:29 main:484] : INFO : # Threads: 1 [2022-04-01 22:18:29 main:486] : INFO : Preparing Dataset [2022-04-01 22:18:29 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-01 22:18:30 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-01 22:18:38 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-01 22:18:38 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-01 22:18:38 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-01 22:18:39 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-01 22:18:39 main:494] : INFO : Creating Model [2022-04-01 22:18:39 main:507] : INFO : Preparing config file [2022-04-01 22:18:39 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-01 22:18:39 main:512] : INFO : Loading config [2022-04-01 22:18:39 main:514] : INFO : Loading state [2022-04-01 22:18:43 main:559] : INFO : Loading DataLoader into Memory [2022-04-01 22:18:43 main:562] : INFO : Starting Training [2022-04-01 22:18:56 main:574] : INFO : Epoch 1886 | loss: 0.0312609 | val_loss: 0.0311935 | Time: 12557.3 ms [2022-04-01 22:19:04 main:574] : INFO : Epoch 1887 | loss: 0.0311748 | val_loss: 0.0311719 | Time: 7600.57 ms [2022-04-01 22:19:14 main:574] : INFO : Epoch 1888 | loss: 0.0311636 | val_loss: 0.0311677 | Time: 10743.7 ms [2022-04-01 22:19:22 main:574] : INFO : Epoch 1889 | loss: 0.0311607 | val_loss: 0.0311655 | Time: 7321.22 ms [2022-04-01 22:19:34 main:574] : INFO : Epoch 1890 | loss: 0.0311617 | val_loss: 0.0311654 | Time: 11635.5 ms [2022-04-01 22:19:44 main:574] : INFO : Epoch 1891 | loss: 0.0311603 | val_loss: 0.0311668 | Time: 10583.1 ms [2022-04-01 22:19:51 main:574] : INFO : Epoch 1892 | loss: 0.0311603 | val_loss: 0.0311666 | Time: 7301.96 ms [2022-04-01 22:20:03 main:574] : INFO : Epoch 1893 | loss: 0.0311595 | val_loss: 0.0311632 | Time: 11094.1 ms [2022-04-01 22:20:10 main:574] : INFO : Epoch 1894 | loss: 0.0311601 | val_loss: 0.0311627 | Time: 7056.83 ms [2022-04-01 22:20:21 main:574] : INFO : Epoch 1895 | loss: 0.0311597 | val_loss: 0.0311663 | Time: 11633.4 ms [2022-04-01 22:20:30 main:574] : INFO : Epoch 1896 | loss: 0.0311602 | val_loss: 0.0311628 | Time: 8237.36 ms [2022-04-01 22:20:42 main:574] : INFO : Epoch 1897 | loss: 0.0311588 | val_loss: 0.0311632 | Time: 11666.2 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GT 1030) [2022-04-01 22:23:32 main:435] : INFO : Set logging level to 1 [2022-04-01 22:23:32 main:441] : INFO : Running in BOINC Client mode [2022-04-01 22:23:32 main:444] : INFO : Resolving all filenames [2022-04-01 22:23:32 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-01 22:23:32 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-01 22:23:32 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-01 22:23:32 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-01 22:23:32 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-01 22:23:32 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-01 22:23:32 main:474] : INFO : Configuration: [2022-04-01 22:23:32 main:475] : INFO : Model type: GRU [2022-04-01 22:23:32 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-01 22:23:32 main:477] : INFO : Max Epochs: 2048 [2022-04-01 22:23:32 main:478] : INFO : Batch Size: 128 [2022-04-01 22:23:32 main:479] : INFO : Learning Rate: 0.01 [2022-04-01 22:23:32 main:480] : INFO : Patience: 10 [2022-04-01 22:23:32 main:481] : INFO : Hidden Width: 12 [2022-04-01 22:23:33 main:482] : INFO : # Recurrent Layers: 4 [2022-04-01 22:23:33 main:483] : INFO : # Backend Layers: 4 [2022-04-01 22:23:33 main:484] : INFO : # Threads: 1 [2022-04-01 22:23:33 main:486] : INFO : Preparing Dataset [2022-04-01 22:23:33 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-01 22:23:34 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-01 22:23:40 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-01 22:23:40 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-01 22:23:41 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-01 22:23:41 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-01 22:23:41 main:494] : INFO : Creating Model [2022-04-01 22:23:41 main:507] : INFO : Preparing config file [2022-04-01 22:23:41 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-01 22:23:41 main:512] : INFO : Loading config [2022-04-01 22:23:41 main:514] : INFO : Loading state [2022-04-01 22:23:44 main:559] : INFO : Loading DataLoader into Memory [2022-04-01 22:23:44 main:562] : INFO : Starting Training [2022-04-01 22:23:59 main:574] : INFO : Epoch 1898 | loss: 0.0312686 | val_loss: 0.031199 | Time: 14710.8 ms [2022-04-01 22:24:12 main:574] : INFO : Epoch 1899 | loss: 0.0311733 | val_loss: 0.0311735 | Time: 13182.9 ms [2022-04-01 22:24:26 main:574] : INFO : Epoch 1900 | loss: 0.0311614 | val_loss: 0.0311695 | Time: 13597.8 ms [2022-04-01 22:24:39 main:574] : INFO : Epoch 1901 | loss: 0.0311602 | val_loss: 0.0311673 | Time: 12799.5 ms [2022-04-01 22:24:49 main:574] : INFO : Epoch 1902 | loss: 0.0311627 | val_loss: 0.0311666 | Time: 10382.6 ms [2022-04-01 22:24:58 main:574] : INFO : Epoch 1903 | loss: 0.0311618 | val_loss: 0.0311675 | Time: 9145.4 ms [2022-04-01 22:25:07 main:574] : INFO : Epoch 1904 | loss: 0.0311604 | val_loss: 0.0311658 | Time: 9177.8 ms [2022-04-01 22:25:19 main:574] : INFO : Epoch 1905 | loss: 0.0311605 | val_loss: 0.0311671 | Time: 12060.1 ms [2022-04-01 22:25:30 main:574] : INFO : Epoch 1906 | loss: 0.0311604 | val_loss: 0.0311658 | Time: 10934.1 ms [2022-04-01 22:25:38 main:574] : INFO : Epoch 1907 | loss: 0.0311608 | val_loss: 0.03117 | Time: 7485.29 ms [2022-04-01 22:25:50 main:574] : INFO : Epoch 1908 | loss: 0.0311618 | val_loss: 0.0311657 | Time: 11917.7 ms [2022-04-01 22:26:02 main:574] : INFO : Epoch 1909 | loss: 0.0311603 | val_loss: 0.031165 | Time: 12313.9 ms [2022-04-01 22:26:13 main:574] : INFO : Epoch 1910 | loss: 0.0311606 | val_loss: 0.0311626 | Time: 10887.9 ms [2022-04-01 22:26:22 main:574] : INFO : Epoch 1911 | loss: 0.03116 | val_loss: 0.0311622 | Time: 8301.44 ms [2022-04-01 22:26:33 main:574] : INFO : Epoch 1912 | loss: 0.0311597 | val_loss: 0.0311633 | Time: 11575.5 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GT 1030) [2022-04-01 22:28:36 main:435] : INFO : Set logging level to 1 [2022-04-01 22:28:36 main:441] : INFO : Running in BOINC Client mode [2022-04-01 22:28:36 main:444] : INFO : Resolving all filenames [2022-04-01 22:28:36 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-01 22:28:36 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-01 22:28:36 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-01 22:28:36 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-01 22:28:36 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-01 22:28:36 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-01 22:28:37 main:474] : INFO : Configuration: [2022-04-01 22:28:37 main:475] : INFO : Model type: GRU [2022-04-01 22:28:37 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-01 22:28:37 main:477] : INFO : Max Epochs: 2048 [2022-04-01 22:28:37 main:478] : INFO : Batch Size: 128 [2022-04-01 22:28:37 main:479] : INFO : Learning Rate: 0.01 [2022-04-01 22:28:37 main:480] : INFO : Patience: 10 [2022-04-01 22:28:37 main:481] : INFO : Hidden Width: 12 [2022-04-01 22:28:37 main:482] : INFO : # Recurrent Layers: 4 [2022-04-01 22:28:37 main:483] : INFO : # Backend Layers: 4 [2022-04-01 22:28:37 main:484] : INFO : # Threads: 1 [2022-04-01 22:28:37 main:486] : INFO : Preparing Dataset [2022-04-01 22:28:37 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-01 22:28:38 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-01 22:28:45 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-01 22:28:45 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-01 22:28:46 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-01 22:28:46 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-01 22:28:46 main:494] : INFO : Creating Model [2022-04-01 22:28:46 main:507] : INFO : Preparing config file [2022-04-01 22:28:46 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-01 22:28:46 main:512] : INFO : Loading config [2022-04-01 22:28:46 main:514] : INFO : Loading state [2022-04-01 22:28:49 main:559] : INFO : Loading DataLoader into Memory [2022-04-01 22:28:49 main:562] : INFO : Starting Training [2022-04-01 22:29:04 main:574] : INFO : Epoch 1908 | loss: 0.0312766 | val_loss: 0.0312144 | Time: 14791.2 ms [2022-04-01 22:29:19 main:574] : INFO : Epoch 1909 | loss: 0.0311841 | val_loss: 0.0311729 | Time: 14557.3 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GT 1030) [2022-04-01 22:31:21 main:435] : INFO : Set logging level to 1 [2022-04-01 22:31:22 main:441] : INFO : Running in BOINC Client mode [2022-04-01 22:31:22 main:444] : INFO : Resolving all filenames [2022-04-01 22:31:22 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-01 22:31:22 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-01 22:31:22 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-01 22:31:22 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-01 22:31:22 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-01 22:31:22 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-01 22:31:22 main:474] : INFO : Configuration: [2022-04-01 22:31:22 main:475] : INFO : Model type: GRU [2022-04-01 22:31:22 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-01 22:31:22 main:477] : INFO : Max Epochs: 2048 [2022-04-01 22:31:22 main:478] : INFO : Batch Size: 128 [2022-04-01 22:31:22 main:479] : INFO : Learning Rate: 0.01 [2022-04-01 22:31:22 main:480] : INFO : Patience: 10 [2022-04-01 22:31:22 main:481] : INFO : Hidden Width: 12 [2022-04-01 22:31:22 main:482] : INFO : # Recurrent Layers: 4 [2022-04-01 22:31:22 main:483] : INFO : # Backend Layers: 4 [2022-04-01 22:31:22 main:484] : INFO : # Threads: 1 [2022-04-01 22:31:22 main:486] : INFO : Preparing Dataset [2022-04-01 22:31:22 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-01 22:31:24 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-01 22:31:30 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-01 22:31:31 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-01 22:31:31 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-01 22:31:31 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-01 22:31:31 main:494] : INFO : Creating Model [2022-04-01 22:31:31 main:507] : INFO : Preparing config file [2022-04-01 22:31:31 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-01 22:31:32 main:512] : INFO : Loading config [2022-04-01 22:31:32 main:514] : INFO : Loading state [2022-04-01 22:31:35 main:559] : INFO : Loading DataLoader into Memory [2022-04-01 22:31:35 main:562] : INFO : Starting Training [2022-04-01 22:31:50 main:574] : INFO : Epoch 1908 | loss: 0.0312596 | val_loss: 0.031205 | Time: 14935.9 ms [2022-04-01 22:32:04 main:574] : INFO : Epoch 1909 | loss: 0.0311803 | val_loss: 0.0311734 | Time: 14109.1 ms [2022-04-01 22:32:17 main:574] : INFO : Epoch 1910 | loss: 0.0311642 | val_loss: 0.0311678 | Time: 13183.5 ms [2022-04-01 22:32:31 main:574] : INFO : Epoch 1911 | loss: 0.0311614 | val_loss: 0.0311662 | Time: 13140.2 ms [2022-04-01 22:32:43 main:574] : INFO : Epoch 1912 | loss: 0.0311607 | val_loss: 0.0311669 | Time: 12806.5 ms [2022-04-01 22:32:57 main:574] : INFO : Epoch 1913 | loss: 0.0311621 | val_loss: 0.0311675 | Time: 13389.4 ms [2022-04-01 22:33:11 main:574] : INFO : Epoch 1914 | loss: 0.0311645 | val_loss: 0.0311696 | Time: 13467.6 ms [2022-04-01 22:33:22 main:574] : INFO : Epoch 1915 | loss: 0.0311621 | val_loss: 0.0311699 | Time: 11050.9 ms [2022-04-01 22:33:31 main:574] : INFO : Epoch 1916 | loss: 0.0311603 | val_loss: 0.0311678 | Time: 9086.44 ms [2022-04-01 22:33:44 main:574] : INFO : Epoch 1917 | loss: 0.0311579 | val_loss: 0.0311665 | Time: 13145.6 ms [2022-04-01 22:33:57 main:574] : INFO : Epoch 1918 | loss: 0.0311562 | val_loss: 0.0311658 | Time: 13075.5 ms [2022-04-01 22:34:11 main:574] : INFO : Epoch 1919 | loss: 0.0311555 | val_loss: 0.0311652 | Time: 13557.1 ms [2022-04-01 22:34:25 main:574] : INFO : Epoch 1920 | loss: 0.0311558 | val_loss: 0.0311631 | Time: 13714.8 ms [2022-04-01 22:34:39 main:574] : INFO : Epoch 1921 | loss: 0.0311551 | val_loss: 0.031163 | Time: 14092 ms [2022-04-01 22:34:52 main:574] : INFO : Epoch 1922 | loss: 0.0311567 | val_loss: 0.0311621 | Time: 13129.8 ms [2022-04-01 22:35:04 main:574] : INFO : Epoch 1923 | loss: 0.0311554 | val_loss: 0.0311652 | Time: 12138.4 ms [2022-04-01 22:35:17 main:574] : INFO : Epoch 1924 | loss: 0.0311563 | val_loss: 0.0311632 | Time: 12487.5 ms [2022-04-01 22:35:30 main:574] : INFO : Epoch 1925 | loss: 0.0311554 | val_loss: 0.0311654 | Time: 13435.2 ms [2022-04-01 22:35:43 main:574] : INFO : Epoch 1926 | loss: 0.0311544 | val_loss: 0.0311614 | Time: 13182 ms [2022-04-01 22:35:55 main:574] : INFO : Epoch 1927 | loss: 0.0311542 | val_loss: 0.0311634 | Time: 11426.2 ms [2022-04-01 22:36:08 main:574] : INFO : Epoch 1928 | loss: 0.0311562 | val_loss: 0.0311661 | Time: 12803.3 ms [2022-04-01 22:36:20 main:574] : INFO : Epoch 1929 | loss: 0.0311557 | val_loss: 0.0311664 | Time: 12101.8 ms [2022-04-01 22:36:30 main:574] : INFO : Epoch 1930 | loss: 0.0311591 | val_loss: 0.031172 | Time: 10161.2 ms [2022-04-01 22:36:41 main:574] : INFO : Epoch 1931 | loss: 0.0311573 | val_loss: 0.0311625 | Time: 10212.2 ms [2022-04-01 22:36:54 main:574] : INFO : Epoch 1932 | loss: 0.0311563 | val_loss: 0.0311643 | Time: 12909 ms [2022-04-01 22:37:04 main:574] : INFO : Epoch 1933 | loss: 0.0311593 | val_loss: 0.0311618 | Time: 10161.5 ms [2022-04-01 22:37:14 main:574] : INFO : Epoch 1934 | loss: 0.0311591 | val_loss: 0.0311609 | Time: 9728.5 ms [2022-04-01 22:37:23 main:574] : INFO : Epoch 1935 | loss: 0.031157 | val_loss: 0.0311653 | Time: 9248.58 ms [2022-04-01 22:37:32 main:574] : INFO : Epoch 1936 | loss: 0.0311569 | val_loss: 0.031166 | Time: 9076.1 ms [2022-04-01 22:37:41 main:574] : INFO : Epoch 1937 | loss: 0.0311556 | val_loss: 0.0311651 | Time: 9138.57 ms [2022-04-01 22:37:50 main:574] : INFO : Epoch 1938 | loss: 0.0311551 | val_loss: 0.0311648 | Time: 9270.79 ms [2022-04-01 22:38:04 main:574] : INFO : Epoch 1939 | loss: 0.0311548 | val_loss: 0.0311671 | Time: 13553.6 ms [2022-04-01 22:38:19 main:574] : INFO : Epoch 1940 | loss: 0.0311546 | val_loss: 0.0311652 | Time: 14376.5 ms [2022-04-01 22:38:33 main:574] : INFO : Epoch 1941 | loss: 0.031155 | val_loss: 0.0311676 | Time: 14759.4 ms [2022-04-01 22:38:46 main:574] : INFO : Epoch 1942 | loss: 0.0311557 | val_loss: 0.0311658 | Time: 13081.6 ms [2022-04-01 22:39:01 main:574] : INFO : Epoch 1943 | loss: 0.0311561 | val_loss: 0.0311681 | Time: 14752.2 ms [2022-04-01 22:39:15 main:574] : INFO : Epoch 1944 | loss: 0.0311583 | val_loss: 0.0311693 | Time: 13929.7 ms [2022-04-01 22:39:29 main:574] : INFO : Epoch 1945 | loss: 0.0311601 | val_loss: 0.031165 | Time: 13390 ms [2022-04-01 22:39:41 main:574] : INFO : Epoch 1946 | loss: 0.0311563 | val_loss: 0.0311671 | Time: 11866.2 ms [2022-04-01 22:39:54 main:574] : INFO : Epoch 1947 | loss: 0.0311558 | val_loss: 0.0311641 | Time: 13154.2 ms [2022-04-01 22:40:08 main:574] : INFO : Epoch 1948 | loss: 0.0311548 | val_loss: 0.0311677 | Time: 14060.5 ms [2022-04-01 22:40:21 main:574] : INFO : Epoch 1949 | loss: 0.0311578 | val_loss: 0.0311698 | Time: 13280.2 ms [2022-04-01 22:40:33 main:574] : INFO : Epoch 1950 | loss: 0.0311564 | val_loss: 0.0311637 | Time: 11881.8 ms [2022-04-01 22:40:46 main:574] : INFO : Epoch 1951 | loss: 0.0311543 | val_loss: 0.0311646 | Time: 13078.4 ms [2022-04-01 22:41:01 main:574] : INFO : Epoch 1952 | loss: 0.0311573 | val_loss: 0.0311645 | Time: 14579.3 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GT 1030) [2022-04-01 22:43:12 main:435] : INFO : Set logging level to 1 [2022-04-01 22:43:13 main:441] : INFO : Running in BOINC Client mode [2022-04-01 22:43:13 main:444] : INFO : Resolving all filenames [2022-04-01 22:43:13 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-01 22:43:13 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-01 22:43:13 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-01 22:43:13 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-01 22:43:13 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-01 22:43:13 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-01 22:43:13 main:474] : INFO : Configuration: [2022-04-01 22:43:13 main:475] : INFO : Model type: GRU [2022-04-01 22:43:13 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-01 22:43:13 main:477] : INFO : Max Epochs: 2048 [2022-04-01 22:43:13 main:478] : INFO : Batch Size: 128 [2022-04-01 22:43:13 main:479] : INFO : Learning Rate: 0.01 [2022-04-01 22:43:13 main:480] : INFO : Patience: 10 [2022-04-01 22:43:13 main:481] : INFO : Hidden Width: 12 [2022-04-01 22:43:13 main:482] : INFO : # Recurrent Layers: 4 [2022-04-01 22:43:13 main:483] : INFO : # Backend Layers: 4 [2022-04-01 22:43:13 main:484] : INFO : # Threads: 1 [2022-04-01 22:43:13 main:486] : INFO : Preparing Dataset [2022-04-01 22:43:13 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-01 22:43:15 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-01 22:43:21 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-01 22:43:21 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-01 22:43:21 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-01 22:43:22 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-01 22:43:22 main:494] : INFO : Creating Model [2022-04-01 22:43:22 main:507] : INFO : Preparing config file [2022-04-01 22:43:22 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-01 22:43:22 main:512] : INFO : Loading config [2022-04-01 22:43:22 main:514] : INFO : Loading state [2022-04-01 22:43:25 main:559] : INFO : Loading DataLoader into Memory [2022-04-01 22:43:25 main:562] : INFO : Starting Training [2022-04-01 22:43:38 main:574] : INFO : Epoch 1950 | loss: 0.0312013 | val_loss: 0.0311896 | Time: 13621.9 ms [2022-04-01 22:43:51 main:574] : INFO : Epoch 1951 | loss: 0.0311659 | val_loss: 0.0311665 | Time: 13031.4 ms [2022-04-01 22:44:03 main:574] : INFO : Epoch 1952 | loss: 0.031156 | val_loss: 0.0311626 | Time: 11310.6 ms [2022-04-01 22:44:16 main:574] : INFO : Epoch 1953 | loss: 0.0311542 | val_loss: 0.0311647 | Time: 12840.1 ms [2022-04-01 22:44:29 main:574] : INFO : Epoch 1954 | loss: 0.0311533 | val_loss: 0.031167 | Time: 12877.3 ms [2022-04-01 22:44:41 main:574] : INFO : Epoch 1955 | loss: 0.0311541 | val_loss: 0.0311638 | Time: 12130.4 ms [2022-04-01 22:44:54 main:574] : INFO : Epoch 1956 | loss: 0.0311521 | val_loss: 0.0311614 | Time: 13048.4 ms [2022-04-01 22:45:06 main:574] : INFO : Epoch 1957 | loss: 0.0311531 | val_loss: 0.0311604 | Time: 11748.3 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GT 1030) [2022-04-02 21:05:03 main:435] : INFO : Set logging level to 1 [2022-04-02 21:05:03 main:441] : INFO : Running in BOINC Client mode [2022-04-02 21:05:03 main:444] : INFO : Resolving all filenames [2022-04-02 21:05:03 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-02 21:05:03 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-02 21:05:03 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-02 21:05:03 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-02 21:05:03 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-02 21:05:03 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-02 21:05:03 main:474] : INFO : Configuration: [2022-04-02 21:05:03 main:475] : INFO : Model type: GRU [2022-04-02 21:05:03 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-02 21:05:03 main:477] : INFO : Max Epochs: 2048 [2022-04-02 21:05:03 main:478] : INFO : Batch Size: 128 [2022-04-02 21:05:03 main:479] : INFO : Learning Rate: 0.01 [2022-04-02 21:05:03 main:480] : INFO : Patience: 10 [2022-04-02 21:05:03 main:481] : INFO : Hidden Width: 12 [2022-04-02 21:05:03 main:482] : INFO : # Recurrent Layers: 4 [2022-04-02 21:05:03 main:483] : INFO : # Backend Layers: 4 [2022-04-02 21:05:03 main:484] : INFO : # Threads: 1 [2022-04-02 21:05:03 main:486] : INFO : Preparing Dataset [2022-04-02 21:05:03 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-02 21:05:05 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-02 21:05:11 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-02 21:05:11 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-02 21:05:12 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-02 21:05:12 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-02 21:05:12 main:494] : INFO : Creating Model [2022-04-02 21:05:12 main:507] : INFO : Preparing config file [2022-04-02 21:05:13 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-02 21:05:13 main:512] : INFO : Loading config [2022-04-02 21:05:13 main:514] : INFO : Loading state [2022-04-02 21:05:16 main:559] : INFO : Loading DataLoader into Memory [2022-04-02 21:05:16 main:562] : INFO : Starting Training [2022-04-02 21:05:29 main:574] : INFO : Epoch 1954 | loss: 0.0312294 | val_loss: 0.0311791 | Time: 13135.1 ms [2022-04-02 21:05:39 main:574] : INFO : Epoch 1955 | loss: 0.0311635 | val_loss: 0.0311612 | Time: 10403.2 ms [2022-04-02 21:05:50 main:574] : INFO : Epoch 1956 | loss: 0.0311541 | val_loss: 0.0311594 | Time: 10358.4 ms [2022-04-02 21:06:00 main:574] : INFO : Epoch 1957 | loss: 0.0311537 | val_loss: 0.0311593 | Time: 10273 ms [2022-04-02 21:06:11 main:574] : INFO : Epoch 1958 | loss: 0.0311545 | val_loss: 0.0311625 | Time: 10409.3 ms [2022-04-02 21:06:21 main:574] : INFO : Epoch 1959 | loss: 0.0311543 | val_loss: 0.0311635 | Time: 10418.3 ms [2022-04-02 21:06:36 main:574] : INFO : Epoch 1960 | loss: 0.0311557 | val_loss: 0.031164 | Time: 14388 ms [2022-04-02 21:06:50 main:574] : INFO : Epoch 1961 | loss: 0.0311588 | val_loss: 0.031163 | Time: 14121.8 ms [2022-04-02 21:07:04 main:574] : INFO : Epoch 1962 | loss: 0.0311548 | val_loss: 0.0311617 | Time: 13811.3 ms [2022-04-02 21:07:18 main:574] : INFO : Epoch 1963 | loss: 0.0311566 | val_loss: 0.0311654 | Time: 13848.4 ms [2022-04-02 21:07:30 main:574] : INFO : Epoch 1964 | loss: 0.0311565 | val_loss: 0.0311617 | Time: 11895.5 ms [2022-04-02 21:07:44 main:574] : INFO : Epoch 1965 | loss: 0.0311543 | val_loss: 0.0311618 | Time: 14030.7 ms [2022-04-02 21:07:58 main:574] : INFO : Epoch 1966 | loss: 0.0311539 | val_loss: 0.0311631 | Time: 14262.2 ms [2022-04-02 21:08:10 main:574] : INFO : Epoch 1967 | loss: 0.0311527 | val_loss: 0.0311602 | Time: 11908.8 ms [2022-04-02 21:08:25 main:574] : INFO : Epoch 1968 | loss: 0.0311528 | val_loss: 0.0311635 | Time: 14639.1 ms [2022-04-02 21:08:38 main:574] : INFO : Epoch 1969 | loss: 0.0311513 | val_loss: 0.0311694 | Time: 13487.6 ms [2022-04-02 21:08:51 main:574] : INFO : Epoch 1970 | loss: 0.0311536 | val_loss: 0.0311631 | Time: 13312.6 ms [2022-04-02 21:09:04 main:574] : INFO : Epoch 1971 | loss: 0.0311514 | val_loss: 0.0311664 | Time: 12150.2 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GT 1030) [2022-04-02 21:12:36 main:435] : INFO : Set logging level to 1 [2022-04-02 21:12:36 main:441] : INFO : Running in BOINC Client mode [2022-04-02 21:12:36 main:444] : INFO : Resolving all filenames [2022-04-02 21:12:36 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-02 21:12:36 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-02 21:12:36 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-02 21:12:36 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-02 21:12:36 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-02 21:12:36 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-02 21:12:36 main:474] : INFO : Configuration: [2022-04-02 21:12:36 main:475] : INFO : Model type: GRU [2022-04-02 21:12:36 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-02 21:12:36 main:477] : INFO : Max Epochs: 2048 [2022-04-02 21:12:36 main:478] : INFO : Batch Size: 128 [2022-04-02 21:12:36 main:479] : INFO : Learning Rate: 0.01 [2022-04-02 21:12:36 main:480] : INFO : Patience: 10 [2022-04-02 21:12:36 main:481] : INFO : Hidden Width: 12 [2022-04-02 21:12:36 main:482] : INFO : # Recurrent Layers: 4 [2022-04-02 21:12:36 main:483] : INFO : # Backend Layers: 4 [2022-04-02 21:12:36 main:484] : INFO : # Threads: 1 [2022-04-02 21:12:36 main:486] : INFO : Preparing Dataset [2022-04-02 21:12:37 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-02 21:12:38 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-02 21:12:44 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-02 21:12:44 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-02 21:12:44 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-02 21:12:44 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-02 21:12:44 main:494] : INFO : Creating Model [2022-04-02 21:12:45 main:507] : INFO : Preparing config file [2022-04-02 21:12:45 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-02 21:12:45 main:512] : INFO : Loading config [2022-04-02 21:12:45 main:514] : INFO : Loading state [2022-04-02 21:12:47 main:559] : INFO : Loading DataLoader into Memory [2022-04-02 21:12:47 main:562] : INFO : Starting Training [2022-04-02 21:13:02 main:574] : INFO : Epoch 1969 | loss: 0.0312195 | val_loss: 0.0311744 | Time: 14520.1 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GT 1030) [2022-04-02 21:16:26 main:435] : INFO : Set logging level to 1 [2022-04-02 21:16:26 main:441] : INFO : Running in BOINC Client mode [2022-04-02 21:16:27 main:444] : INFO : Resolving all filenames [2022-04-02 21:16:27 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-02 21:16:27 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-02 21:16:27 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-02 21:16:27 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-02 21:16:27 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-02 21:16:27 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-02 21:16:27 main:474] : INFO : Configuration: [2022-04-02 21:16:27 main:475] : INFO : Model type: GRU [2022-04-02 21:16:27 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-02 21:16:27 main:477] : INFO : Max Epochs: 2048 [2022-04-02 21:16:27 main:478] : INFO : Batch Size: 128 [2022-04-02 21:16:27 main:479] : INFO : Learning Rate: 0.01 [2022-04-02 21:16:27 main:480] : INFO : Patience: 10 [2022-04-02 21:16:27 main:481] : INFO : Hidden Width: 12 [2022-04-02 21:16:27 main:482] : INFO : # Recurrent Layers: 4 [2022-04-02 21:16:27 main:483] : INFO : # Backend Layers: 4 [2022-04-02 21:16:27 main:484] : INFO : # Threads: 1 [2022-04-02 21:16:27 main:486] : INFO : Preparing Dataset [2022-04-02 21:16:27 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-02 21:16:28 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-02 21:16:35 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-02 21:16:35 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-02 21:16:36 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-02 21:16:36 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-02 21:16:36 main:494] : INFO : Creating Model [2022-04-02 21:16:36 main:507] : INFO : Preparing config file [2022-04-02 21:16:36 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-02 21:16:36 main:512] : INFO : Loading config [2022-04-02 21:16:36 main:514] : INFO : Loading state [2022-04-02 21:16:40 main:559] : INFO : Loading DataLoader into Memory [2022-04-02 21:16:40 main:562] : INFO : Starting Training [2022-04-02 21:16:54 main:574] : INFO : Epoch 1969 | loss: 0.0311931 | val_loss: 0.031165 | Time: 14556.7 ms [2022-04-02 21:17:05 main:574] : INFO : Epoch 1970 | loss: 0.0311572 | val_loss: 0.0311605 | Time: 10522.3 ms [2022-04-02 21:17:19 main:574] : INFO : Epoch 1971 | loss: 0.0311549 | val_loss: 0.0311648 | Time: 13666.8 ms [2022-04-02 21:17:33 main:574] : INFO : Epoch 1972 | loss: 0.0311535 | val_loss: 0.03116 | Time: 14660.8 ms [2022-04-02 21:17:44 main:574] : INFO : Epoch 1973 | loss: 0.0311521 | val_loss: 0.0311639 | Time: 10150.6 ms [2022-04-02 21:17:58 main:574] : INFO : Epoch 1974 | loss: 0.0311518 | val_loss: 0.0311603 | Time: 14275.6 ms [2022-04-02 21:18:11 main:574] : INFO : Epoch 1975 | loss: 0.0311508 | val_loss: 0.0311615 | Time: 13379.2 ms [2022-04-02 21:18:23 main:574] : INFO : Epoch 1976 | loss: 0.0311517 | val_loss: 0.0311598 | Time: 12017.4 ms [2022-04-02 21:18:34 main:574] : INFO : Epoch 1977 | loss: 0.031151 | val_loss: 0.031162 | Time: 10951.9 ms [2022-04-02 21:18:49 main:574] : INFO : Epoch 1978 | loss: 0.031151 | val_loss: 0.0311636 | Time: 14726.7 ms [2022-04-02 21:19:02 main:574] : INFO : Epoch 1979 | loss: 0.0311514 | val_loss: 0.0311657 | Time: 12857.1 ms [2022-04-02 21:19:12 main:574] : INFO : Epoch 1980 | loss: 0.0311528 | val_loss: 0.0311636 | Time: 9417.79 ms [2022-04-02 21:19:21 main:574] : INFO : Epoch 1981 | loss: 0.031154 | val_loss: 0.0311592 | Time: 9423.17 ms [2022-04-02 21:19:35 main:574] : INFO : Epoch 1982 | loss: 0.0311531 | val_loss: 0.031162 | Time: 14153.1 ms [2022-04-02 21:19:49 main:574] : INFO : Epoch 1983 | loss: 0.0311534 | val_loss: 0.0311604 | Time: 13827.5 ms [2022-04-02 21:20:01 main:574] : INFO : Epoch 1984 | loss: 0.0311546 | val_loss: 0.0311629 | Time: 11826.6 ms [2022-04-02 21:20:15 main:574] : INFO : Epoch 1985 | loss: 0.0311549 | val_loss: 0.0311656 | Time: 13921.2 ms [2022-04-02 21:20:27 main:574] : INFO : Epoch 1986 | loss: 0.0311571 | val_loss: 0.0311655 | Time: 12214.3 ms [2022-04-02 21:20:41 main:574] : INFO : Epoch 1987 | loss: 0.031158 | val_loss: 0.0311666 | Time: 13186.5 ms [2022-04-02 21:20:54 main:574] : INFO : Epoch 1988 | loss: 0.0311594 | val_loss: 0.0311647 | Time: 13517.3 ms [2022-04-02 21:21:07 main:574] : INFO : Epoch 1989 | loss: 0.0311585 | val_loss: 0.0311636 | Time: 12200.4 ms [2022-04-02 21:21:20 main:574] : INFO : Epoch 1990 | loss: 0.031157 | val_loss: 0.0311638 | Time: 13165.6 ms [2022-04-02 21:21:30 main:574] : INFO : Epoch 1991 | loss: 0.0311569 | val_loss: 0.031175 | Time: 10606.5 ms [2022-04-02 21:21:44 main:574] : INFO : Epoch 1992 | loss: 0.0311589 | val_loss: 0.0311623 | Time: 13215.5 ms [2022-04-02 21:21:57 main:574] : INFO : Epoch 1993 | loss: 0.031155 | val_loss: 0.0311581 | Time: 13437.5 ms [2022-04-02 21:22:08 main:574] : INFO : Epoch 1994 | loss: 0.0311553 | val_loss: 0.0311588 | Time: 10217.8 ms [2022-04-02 21:22:22 main:574] : INFO : Epoch 1995 | loss: 0.0311538 | val_loss: 0.0311594 | Time: 14440.1 ms [2022-04-02 21:22:34 main:574] : INFO : Epoch 1996 | loss: 0.0311537 | val_loss: 0.0311614 | Time: 12260 ms [2022-04-02 21:22:46 main:574] : INFO : Epoch 1997 | loss: 0.0311532 | val_loss: 0.0311607 | Time: 11614.9 ms [2022-04-02 21:22:58 main:574] : INFO : Epoch 1998 | loss: 0.0311548 | val_loss: 0.0311636 | Time: 12298.6 ms [2022-04-02 21:23:12 main:574] : INFO : Epoch 1999 | loss: 0.0311553 | val_loss: 0.0311622 | Time: 13602.2 ms [2022-04-02 21:23:24 main:574] : INFO : Epoch 2000 | loss: 0.0311529 | val_loss: 0.0311628 | Time: 12131.1 ms [2022-04-02 21:23:38 main:574] : INFO : Epoch 2001 | loss: 0.0311535 | val_loss: 0.0311642 | Time: 13693 ms [2022-04-02 21:23:50 main:574] : INFO : Epoch 2002 | loss: 0.0311531 | val_loss: 0.0311658 | Time: 12152.2 ms [2022-04-02 21:24:04 main:574] : INFO : Epoch 2003 | loss: 0.0311513 | val_loss: 0.0311631 | Time: 13580.7 ms [2022-04-02 21:24:13 main:574] : INFO : Epoch 2004 | loss: 0.0311514 | val_loss: 0.0311639 | Time: 9504.1 ms [2022-04-02 21:24:26 main:574] : INFO : Epoch 2005 | loss: 0.0311545 | val_loss: 0.0311621 | Time: 12731.9 ms [2022-04-02 21:24:40 main:574] : INFO : Epoch 2006 | loss: 0.0311546 | val_loss: 0.0311615 | Time: 13678.4 ms [2022-04-02 21:24:51 main:574] : INFO : Epoch 2007 | loss: 0.0311553 | val_loss: 0.0311608 | Time: 10438.4 ms [2022-04-02 21:25:05 main:574] : INFO : Epoch 2008 | loss: 0.0311553 | val_loss: 0.031159 | Time: 14642.2 ms [2022-04-02 21:25:19 main:574] : INFO : Epoch 2009 | loss: 0.0311553 | val_loss: 0.0311598 | Time: 13743.7 ms [2022-04-02 21:25:30 main:574] : INFO : Epoch 2010 | loss: 0.0311539 | val_loss: 0.0311617 | Time: 10565.9 ms [2022-04-02 21:25:43 main:574] : INFO : Epoch 2011 | loss: 0.0311531 | val_loss: 0.0311621 | Time: 13443.2 ms [2022-04-02 21:25:57 main:574] : INFO : Epoch 2012 | loss: 0.0311524 | val_loss: 0.0311603 | Time: 13096.7 ms [2022-04-02 21:26:10 main:574] : INFO : Epoch 2013 | loss: 0.0311525 | val_loss: 0.0311624 | Time: 13341.1 ms [2022-04-02 21:26:24 main:574] : INFO : Epoch 2014 | loss: 0.031154 | val_loss: 0.0311613 | Time: 14396.7 ms [2022-04-02 21:26:37 main:574] : INFO : Epoch 2015 | loss: 0.0311542 | val_loss: 0.0311619 | Time: 12825.6 ms [2022-04-02 21:26:52 main:574] : INFO : Epoch 2016 | loss: 0.0311549 | val_loss: 0.031164 | Time: 14564.1 ms [2022-04-02 21:27:05 main:574] : INFO : Epoch 2017 | loss: 0.0311555 | val_loss: 0.0311629 | Time: 13501.9 ms [2022-04-02 21:27:19 main:574] : INFO : Epoch 2018 | loss: 0.0311543 | val_loss: 0.0311649 | Time: 13548.3 ms [2022-04-02 21:27:32 main:574] : INFO : Epoch 2019 | loss: 0.0311526 | val_loss: 0.0311621 | Time: 13334.9 ms [2022-04-02 21:27:46 main:574] : INFO : Epoch 2020 | loss: 0.031152 | val_loss: 0.0311614 | Time: 13682.6 ms [2022-04-02 21:28:00 main:574] : INFO : Epoch 2021 | loss: 0.0311512 | val_loss: 0.0311619 | Time: 13795.3 ms [2022-04-02 21:28:12 main:574] : INFO : Epoch 2022 | loss: 0.0311517 | val_loss: 0.0311649 | Time: 11852.7 ms [2022-04-02 21:28:26 main:574] : INFO : Epoch 2023 | loss: 0.0311521 | val_loss: 0.0311656 | Time: 13880.6 ms [2022-04-02 21:28:39 main:574] : INFO : Epoch 2024 | loss: 0.0311515 | val_loss: 0.0311637 | Time: 13521.2 ms [2022-04-02 21:28:50 main:574] : INFO : Epoch 2025 | loss: 0.0311515 | val_loss: 0.0311619 | Time: 10408.8 ms [2022-04-02 21:29:04 main:574] : INFO : Epoch 2026 | loss: 0.0311494 | val_loss: 0.0311607 | Time: 14527.8 ms [2022-04-02 21:29:18 main:574] : INFO : Epoch 2027 | loss: 0.0311492 | val_loss: 0.0311657 | Time: 13196 ms [2022-04-02 21:29:30 main:574] : INFO : Epoch 2028 | loss: 0.0311504 | val_loss: 0.0311631 | Time: 12114.7 ms [2022-04-02 21:29:39 main:574] : INFO : Epoch 2029 | loss: 0.0311493 | val_loss: 0.0311611 | Time: 9433.51 ms [2022-04-02 21:29:49 main:574] : INFO : Epoch 2030 | loss: 0.0311512 | val_loss: 0.0311603 | Time: 9399.57 ms [2022-04-02 21:30:03 main:574] : INFO : Epoch 2031 | loss: 0.0311475 | val_loss: 0.0311609 | Time: 13821.2 ms [2022-04-02 21:30:15 main:574] : INFO : Epoch 2032 | loss: 0.0311468 | val_loss: 0.0311642 | Time: 11950.8 ms [2022-04-02 21:30:27 main:574] : INFO : Epoch 2033 | loss: 0.0311477 | val_loss: 0.0311639 | Time: 11993.2 ms [2022-04-02 21:30:39 main:574] : INFO : Epoch 2034 | loss: 0.0311479 | val_loss: 0.031164 | Time: 11931.4 ms [2022-04-02 21:30:51 main:574] : INFO : Epoch 2035 | loss: 0.0311471 | val_loss: 0.0311666 | Time: 12556.4 ms [2022-04-02 21:31:05 main:574] : INFO : Epoch 2036 | loss: 0.0311485 | val_loss: 0.0311646 | Time: 13743.6 ms [2022-04-02 21:31:20 main:574] : INFO : Epoch 2037 | loss: 0.0311485 | val_loss: 0.0311597 | Time: 14776.4 ms [2022-04-02 21:31:32 main:574] : INFO : Epoch 2038 | loss: 0.0311487 | val_loss: 0.0311642 | Time: 11596.9 ms [2022-04-02 21:31:44 main:574] : INFO : Epoch 2039 | loss: 0.0311481 | val_loss: 0.031165 | Time: 12113.3 ms [2022-04-02 21:31:57 main:574] : INFO : Epoch 2040 | loss: 0.0311482 | val_loss: 0.0311606 | Time: 13040.2 ms [2022-04-02 21:32:07 main:574] : INFO : Epoch 2041 | loss: 0.0311477 | val_loss: 0.0311621 | Time: 10163.5 ms [2022-04-02 21:32:22 main:574] : INFO : Epoch 2042 | loss: 0.0311471 | val_loss: 0.0311585 | Time: 14927.8 ms [2022-04-02 21:32:34 main:574] : INFO : Epoch 2043 | loss: 0.031146 | val_loss: 0.0311613 | Time: 11561.7 ms [2022-04-02 21:32:44 main:574] : INFO : Epoch 2044 | loss: 0.0311453 | val_loss: 0.0311631 | Time: 10150.1 ms [2022-04-02 21:32:58 main:574] : INFO : Epoch 2045 | loss: 0.0311483 | val_loss: 0.0311637 | Time: 13654.1 ms [2022-04-02 21:33:10 main:574] : INFO : Epoch 2046 | loss: 0.0311472 | val_loss: 0.0311587 | Time: 11998.7 ms [2022-04-02 21:33:22 main:574] : INFO : Epoch 2047 | loss: 0.0311463 | val_loss: 0.0311616 | Time: 12277.8 ms [2022-04-02 21:33:35 main:574] : INFO : Epoch 2048 | loss: 0.0311462 | val_loss: 0.0311603 | Time: 12424.7 ms [2022-04-02 21:33:35 main:597] : INFO : Saving trained model to model-final.pt, val_loss 0.0311603 [2022-04-02 21:33:35 main:603] : INFO : Saving end state to config to file [2022-04-02 21:33:35 main:608] : INFO : Success, exiting.. 21:33:35 (5812): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)