Task 11329171
| Name | ParityModified-1639949109-16695-2-0_1 |
| Workunit | 8103664 |
| Created | 3 Feb 2022, 15:26:35 UTC |
| Sent | 3 Feb 2022, 18:18:51 UTC |
| Report deadline | 11 Feb 2022, 18:18:51 UTC |
| Received | 15 Feb 2022, 22:42:12 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 6180 |
| Run time | 3 hours 42 min 27 sec |
| CPU time | 3 hours 4 min 26 sec |
| Validate state | Task was reported too late to validate |
| Credit | 0.00 |
| Device peak FLOPS | 884.73 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.54 GB |
| Peak swap size | 3.44 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version> <![CDATA[ <stderr_txt> : INFO : Epoch 1853 | loss: 0.0310488 | val_loss: 0.0312488 | Time: 6271.46 ms [2022-02-10 22:22:55 main:574] : INFO : Epoch 1854 | loss: 0.031042 | val_loss: 0.0312309 | Time: 6282.54 ms [2022-02-10 22:23:02 main:574] : INFO : Epoch 1855 | loss: 0.0310384 | val_loss: 0.0312633 | Time: 6248.5 ms [2022-02-10 22:23:08 main:574] : INFO : Epoch 1856 | loss: 0.0310462 | val_loss: 0.0312392 | Time: 6274.41 ms [2022-02-10 22:23:14 main:574] : INFO : Epoch 1857 | loss: 0.0310445 | val_loss: 0.0312418 | Time: 6251.45 ms [2022-02-10 22:23:20 main:574] : INFO : Epoch 1858 | loss: 0.0310435 | val_loss: 0.0312231 | Time: 6307.3 ms [2022-02-10 22:23:27 main:574] : INFO : Epoch 1859 | loss: 0.0310464 | val_loss: 0.0312427 | Time: 6304.77 ms [2022-02-10 22:23:33 main:574] : INFO : Epoch 1860 | loss: 0.0310438 | val_loss: 0.0312472 | Time: 6318.93 ms [2022-02-10 22:23:39 main:574] : INFO : Epoch 1861 | loss: 0.0310433 | val_loss: 0.0312611 | Time: 6324.27 ms [2022-02-10 22:23:46 main:574] : INFO : Epoch 1862 | loss: 0.0310431 | val_loss: 0.0312446 | Time: 6287.4 ms [2022-02-10 22:23:52 main:574] : INFO : Epoch 1863 | loss: 0.0310499 | val_loss: 0.0312421 | Time: 6290.75 ms [2022-02-10 22:23:58 main:574] : INFO : Epoch 1864 | loss: 0.0310449 | val_loss: 0.0312386 | Time: 6275.68 ms [2022-02-10 22:24:05 main:574] : INFO : Epoch 1865 | loss: 0.0310447 | val_loss: 0.0312365 | Time: 6302.36 ms [2022-02-10 22:24:11 main:574] : INFO : Epoch 1866 | loss: 0.0310481 | val_loss: 0.0312428 | Time: 6269.7 ms [2022-02-10 22:24:17 main:574] : INFO : Epoch 1867 | loss: 0.0310523 | val_loss: 0.0312458 | Time: 6325.05 ms [2022-02-10 22:24:23 main:574] : INFO : Epoch 1868 | loss: 0.0310781 | val_loss: 0.0312168 | Time: 6339.21 ms [2022-02-10 22:24:30 main:574] : INFO : Epoch 1869 | loss: 0.0310824 | val_loss: 0.0312098 | Time: 6277.77 ms [2022-02-10 22:24:36 main:574] : INFO : Epoch 1870 | loss: 0.0310828 | val_loss: 0.0312232 | Time: 6271.21 ms [2022-02-10 22:24:42 main:574] : INFO : Epoch 1871 | loss: 0.0310826 | val_loss: 0.0312193 | Time: 6317.92 ms [2022-02-10 22:24:49 main:574] : INFO : Epoch 1872 | loss: 0.0310797 | val_loss: 0.0312361 | Time: 6262.84 ms [2022-02-10 22:24:55 main:574] : INFO : Epoch 1873 | loss: 0.0310778 | val_loss: 0.0312415 | Time: 6253.07 ms [2022-02-10 22:25:01 main:574] : INFO : Epoch 1874 | loss: 0.0310673 | val_loss: 0.0312177 | Time: 6258.66 ms [2022-02-10 22:25:07 main:574] : INFO : Epoch 1875 | loss: 0.0310597 | val_loss: 0.0312404 | Time: 6278.28 ms [2022-02-10 22:25:14 main:574] : INFO : Epoch 1876 | loss: 0.0310589 | val_loss: 0.0312109 | Time: 6301.51 ms [2022-02-10 22:25:20 main:574] : INFO : Epoch 1877 | loss: 0.0310704 | val_loss: 0.0312391 | Time: 6304.46 ms [2022-02-10 22:25:26 main:574] : INFO : Epoch 1878 | loss: 0.03107 | val_loss: 0.0312267 | Time: 6338.65 ms [2022-02-10 22:25:33 main:574] : INFO : Epoch 1879 | loss: 0.0310672 | val_loss: 0.0312226 | Time: 6254.14 ms [2022-02-10 22:25:39 main:574] : INFO : Epoch 1880 | loss: 0.0310562 | val_loss: 0.0312326 | Time: 6281.74 ms [2022-02-10 22:25:45 main:574] : INFO : Epoch 1881 | loss: 0.0310508 | val_loss: 0.0312308 | Time: 6274.72 ms [2022-02-10 22:25:51 main:574] : INFO : Epoch 1882 | loss: 0.0310496 | val_loss: 0.031228 | Time: 6283.98 ms [2022-02-10 22:25:58 main:574] : INFO : Epoch 1883 | loss: 0.0310531 | val_loss: 0.0312747 | Time: 6325.13 ms [2022-02-10 22:26:04 main:574] : INFO : Epoch 1884 | loss: 0.0310517 | val_loss: 0.0312491 | Time: 6301.02 ms [2022-02-10 22:26:10 main:574] : INFO : Epoch 1885 | loss: 0.0310579 | val_loss: 0.0312456 | Time: 6302.42 ms [2022-02-10 22:26:17 main:574] : INFO : Epoch 1886 | loss: 0.0310464 | val_loss: 0.0312446 | Time: 6302.07 ms [2022-02-10 22:26:23 main:574] : INFO : Epoch 1887 | loss: 0.0310504 | val_loss: 0.0312235 | Time: 6297.1 ms [2022-02-10 22:26:29 main:574] : INFO : Epoch 1888 | loss: 0.0310618 | val_loss: 0.0312195 | Time: 6265.73 ms [2022-02-10 22:26:36 main:574] : INFO : Epoch 1889 | loss: 0.0310635 | val_loss: 0.0312456 | Time: 6244.47 ms [2022-02-10 22:26:42 main:574] : INFO : Epoch 1890 | loss: 0.0310636 | val_loss: 0.0312107 | Time: 6321.42 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-02-10 22:28:07 main:435] : INFO : Set logging level to 1 [2022-02-10 22:28:07 main:441] : INFO : Running in BOINC Client mode [2022-02-10 22:28:07 main:444] : INFO : Resolving all filenames [2022-02-10 22:28:07 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-10 22:28:07 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-10 22:28:07 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-10 22:28:07 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-10 22:28:07 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-10 22:28:07 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-10 22:28:07 main:474] : INFO : Configuration: [2022-02-10 22:28:07 main:475] : INFO : Model type: GRU [2022-02-10 22:28:07 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-10 22:28:07 main:477] : INFO : Max Epochs: 2048 [2022-02-10 22:28:07 main:478] : INFO : Batch Size: 128 [2022-02-10 22:28:07 main:479] : INFO : Learning Rate: 0.01 [2022-02-10 22:28:07 main:480] : INFO : Patience: 10 [2022-02-10 22:28:07 main:481] : INFO : Hidden Width: 12 [2022-02-10 22:28:07 main:482] : INFO : # Recurrent Layers: 4 [2022-02-10 22:28:07 main:483] : INFO : # Backend Layers: 4 [2022-02-10 22:28:07 main:484] : INFO : # Threads: 1 [2022-02-10 22:28:07 main:486] : INFO : Preparing Dataset [2022-02-10 22:28:07 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-10 22:28:08 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-10 22:28:10 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-10 22:28:10 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-10 22:28:10 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-10 22:28:11 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-10 22:28:11 main:494] : INFO : Creating Model [2022-02-10 22:28:11 main:507] : INFO : Preparing config file [2022-02-10 22:28:11 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-10 22:28:11 main:512] : INFO : Loading config [2022-02-10 22:28:11 main:514] : INFO : Loading state [2022-02-10 22:28:12 main:559] : INFO : Loading DataLoader into Memory [2022-02-10 22:28:12 main:562] : INFO : Starting Training [2022-02-10 22:28:18 main:574] : INFO : Epoch 1884 | loss: 0.0310995 | val_loss: 0.0312222 | Time: 6301.19 ms [2022-02-10 22:28:24 main:574] : INFO : Epoch 1885 | loss: 0.0310694 | val_loss: 0.0312433 | Time: 6173.71 ms [2022-02-10 22:28:30 main:574] : INFO : Epoch 1886 | loss: 0.0310596 | val_loss: 0.0312278 | Time: 6289.3 ms [2022-02-10 22:28:37 main:574] : INFO : Epoch 1887 | loss: 0.0310629 | val_loss: 0.0312114 | Time: 6274.2 ms [2022-02-10 22:28:43 main:574] : INFO : Epoch 1888 | loss: 0.0310681 | val_loss: 0.0312423 | Time: 6318.49 ms [2022-02-10 22:28:49 main:574] : INFO : Epoch 1889 | loss: 0.0310601 | val_loss: 0.0312215 | Time: 6312.92 ms [2022-02-10 22:28:56 main:574] : INFO : Epoch 1890 | loss: 0.0310558 | val_loss: 0.031239 | Time: 6318.11 ms [2022-02-10 22:29:02 main:574] : INFO : Epoch 1891 | loss: 0.0310496 | val_loss: 0.0312243 | Time: 6351.37 ms [2022-02-10 22:29:08 main:574] : INFO : Epoch 1892 | loss: 0.0310545 | val_loss: 0.0312242 | Time: 6349.26 ms [2022-02-10 22:29:15 main:574] : INFO : Epoch 1893 | loss: 0.0310613 | val_loss: 0.0312421 | Time: 6275.92 ms [2022-02-10 22:29:21 main:574] : INFO : Epoch 1894 | loss: 0.0310529 | val_loss: 0.0312312 | Time: 6289.22 ms [2022-02-10 22:29:27 main:574] : INFO : Epoch 1895 | loss: 0.0310523 | val_loss: 0.0312512 | Time: 6261.64 ms [2022-02-10 22:29:34 main:574] : INFO : Epoch 1896 | loss: 0.0310429 | val_loss: 0.031239 | Time: 6277.53 ms [2022-02-10 22:29:40 main:574] : INFO : Epoch 1897 | loss: 0.0310408 | val_loss: 0.0312344 | Time: 6310.99 ms [2022-02-10 22:29:46 main:574] : INFO : Epoch 1898 | loss: 0.0310415 | val_loss: 0.0312468 | Time: 6279.69 ms [2022-02-10 22:29:52 main:574] : INFO : Epoch 1899 | loss: 0.0310434 | val_loss: 0.0312547 | Time: 6264.37 ms [2022-02-10 22:29:59 main:574] : INFO : Epoch 1900 | loss: 0.0310492 | val_loss: 0.0312152 | Time: 6256.94 ms [2022-02-10 22:30:05 main:574] : INFO : Epoch 1901 | loss: 0.0310647 | val_loss: 0.031224 | Time: 6267.92 ms [2022-02-10 22:30:11 main:574] : INFO : Epoch 1902 | loss: 0.0310765 | val_loss: 0.0312255 | Time: 6329.18 ms [2022-02-10 22:30:18 main:574] : INFO : Epoch 1903 | loss: 0.0310624 | val_loss: 0.0312343 | Time: 6267.85 ms [2022-02-10 22:30:24 main:574] : INFO : Epoch 1904 | loss: 0.031055 | val_loss: 0.0312324 | Time: 6330.59 ms [2022-02-10 22:30:30 main:574] : INFO : Epoch 1905 | loss: 0.0310478 | val_loss: 0.0312206 | Time: 6316.81 ms [2022-02-10 22:30:37 main:574] : INFO : Epoch 1906 | loss: 0.0310471 | val_loss: 0.0312442 | Time: 6261.56 ms [2022-02-10 22:30:43 main:574] : INFO : Epoch 1907 | loss: 0.0310435 | val_loss: 0.0312544 | Time: 6278.31 ms [2022-02-10 22:30:49 main:574] : INFO : Epoch 1908 | loss: 0.0310441 | val_loss: 0.0312435 | Time: 6271.98 ms [2022-02-10 22:30:55 main:574] : INFO : Epoch 1909 | loss: 0.0310476 | val_loss: 0.0312445 | Time: 6224.2 ms [2022-02-10 22:31:02 main:574] : INFO : Epoch 1910 | loss: 0.0310536 | val_loss: 0.0312102 | Time: 6224.68 ms [2022-02-10 22:31:08 main:574] : INFO : Epoch 1911 | loss: 0.0310701 | val_loss: 0.0312202 | Time: 6223.95 ms [2022-02-10 22:31:14 main:574] : INFO : Epoch 1912 | loss: 0.0310615 | val_loss: 0.0312368 | Time: 6254.35 ms [2022-02-10 22:31:20 main:574] : INFO : Epoch 1913 | loss: 0.0310534 | val_loss: 0.0312383 | Time: 6266.41 ms [2022-02-10 22:31:27 main:574] : INFO : Epoch 1914 | loss: 0.03105 | val_loss: 0.0312436 | Time: 6261.38 ms [2022-02-10 22:31:33 main:574] : INFO : Epoch 1915 | loss: 0.0310546 | val_loss: 0.0312461 | Time: 6240.39 ms [2022-02-10 22:31:39 main:574] : INFO : Epoch 1916 | loss: 0.031054 | val_loss: 0.0312328 | Time: 6294.24 ms [2022-02-10 22:31:45 main:574] : INFO : Epoch 1917 | loss: 0.031043 | val_loss: 0.031244 | Time: 6291.93 ms [2022-02-10 22:31:52 main:574] : INFO : Epoch 1918 | loss: 0.0310453 | val_loss: 0.031256 | Time: 6245.23 ms [2022-02-10 22:31:58 main:574] : INFO : Epoch 1919 | loss: 0.031049 | val_loss: 0.0312608 | Time: 6261.47 ms [2022-02-10 22:32:04 main:574] : INFO : Epoch 1920 | loss: 0.0310424 | val_loss: 0.0312491 | Time: 6247.81 ms [2022-02-10 22:32:10 main:574] : INFO : Epoch 1921 | loss: 0.0310478 | val_loss: 0.031238 | Time: 6261.06 ms [2022-02-10 22:32:17 main:574] : INFO : Epoch 1922 | loss: 0.0310471 | val_loss: 0.0312211 | Time: 6310.16 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-02-10 22:33:21 main:435] : INFO : Set logging level to 1 [2022-02-10 22:33:21 main:441] : INFO : Running in BOINC Client mode [2022-02-10 22:33:21 main:444] : INFO : Resolving all filenames [2022-02-10 22:33:21 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-10 22:33:21 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-10 22:33:21 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-10 22:33:21 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-10 22:33:21 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-10 22:33:21 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-10 22:33:21 main:474] : INFO : Configuration: [2022-02-10 22:33:21 main:475] : INFO : Model type: GRU [2022-02-10 22:33:21 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-10 22:33:21 main:477] : INFO : Max Epochs: 2048 [2022-02-10 22:33:21 main:478] : INFO : Batch Size: 128 [2022-02-10 22:33:21 main:479] : INFO : Learning Rate: 0.01 [2022-02-10 22:33:21 main:480] : INFO : Patience: 10 [2022-02-10 22:33:21 main:481] : INFO : Hidden Width: 12 [2022-02-10 22:33:21 main:482] : INFO : # Recurrent Layers: 4 [2022-02-10 22:33:21 main:483] : INFO : # Backend Layers: 4 [2022-02-10 22:33:21 main:484] : INFO : # Threads: 1 [2022-02-10 22:33:21 main:486] : INFO : Preparing Dataset [2022-02-10 22:33:21 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-10 22:33:22 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-10 22:33:24 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-10 22:33:24 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-10 22:33:24 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-10 22:33:25 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-10 22:33:25 main:494] : INFO : Creating Model [2022-02-10 22:33:25 main:507] : INFO : Preparing config file [2022-02-10 22:33:25 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-10 22:33:25 main:512] : INFO : Loading config [2022-02-10 22:33:25 main:514] : INFO : Loading state [2022-02-10 22:33:25 main:559] : INFO : Loading DataLoader into Memory [2022-02-10 22:33:25 main:562] : INFO : Starting Training [2022-02-10 22:33:32 main:574] : INFO : Epoch 1916 | loss: 0.0310972 | val_loss: 0.0312258 | Time: 6388.9 ms [2022-02-10 22:33:38 main:574] : INFO : Epoch 1917 | loss: 0.0310773 | val_loss: 0.0312273 | Time: 6182.62 ms [2022-02-10 22:33:44 main:574] : INFO : Epoch 1918 | loss: 0.0310603 | val_loss: 0.0312317 | Time: 6198.12 ms [2022-02-10 22:33:51 main:574] : INFO : Epoch 1919 | loss: 0.0310595 | val_loss: 0.0312396 | Time: 6290.14 ms [2022-02-10 22:33:57 main:574] : INFO : Epoch 1920 | loss: 0.0310558 | val_loss: 0.0312221 | Time: 6269.65 ms [2022-02-10 22:34:03 main:574] : INFO : Epoch 1921 | loss: 0.031058 | val_loss: 0.031249 | Time: 6239.46 ms [2022-02-10 22:34:09 main:574] : INFO : Epoch 1922 | loss: 0.0310504 | val_loss: 0.0312403 | Time: 6244.43 ms [2022-02-10 22:34:16 main:574] : INFO : Epoch 1923 | loss: 0.0310506 | val_loss: 0.0312429 | Time: 6264.12 ms [2022-02-10 22:34:22 main:574] : INFO : Epoch 1924 | loss: 0.031053 | val_loss: 0.031228 | Time: 6281.64 ms [2022-02-10 22:34:28 main:574] : INFO : Epoch 1925 | loss: 0.0310537 | val_loss: 0.031253 | Time: 6261.03 ms [2022-02-10 22:34:34 main:574] : INFO : Epoch 1926 | loss: 0.0310487 | val_loss: 0.0312245 | Time: 6315.51 ms [2022-02-10 22:34:41 main:574] : INFO : Epoch 1927 | loss: 0.0310412 | val_loss: 0.0312382 | Time: 6278.2 ms [2022-02-10 22:34:47 main:574] : INFO : Epoch 1928 | loss: 0.0310404 | val_loss: 0.0312402 | Time: 6262.66 ms [2022-02-10 22:34:53 main:574] : INFO : Epoch 1929 | loss: 0.0310505 | val_loss: 0.0312207 | Time: 6229.77 ms [2022-02-10 22:35:00 main:574] : INFO : Epoch 1930 | loss: 0.0310508 | val_loss: 0.031254 | Time: 6240.03 ms [2022-02-10 22:35:06 main:574] : INFO : Epoch 1931 | loss: 0.0310532 | val_loss: 0.0312386 | Time: 6279.6 ms [2022-02-10 22:35:12 main:574] : INFO : Epoch 1932 | loss: 0.0310493 | val_loss: 0.0312354 | Time: 6258.01 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-02-10 22:42:56 main:435] : INFO : Set logging level to 1 [2022-02-10 22:42:56 main:441] : INFO : Running in BOINC Client mode [2022-02-10 22:42:56 main:444] : INFO : Resolving all filenames [2022-02-10 22:42:56 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-10 22:42:56 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-10 22:42:56 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-10 22:42:56 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-10 22:42:56 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-10 22:42:56 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-10 22:42:56 main:474] : INFO : Configuration: [2022-02-10 22:42:56 main:475] : INFO : Model type: GRU [2022-02-10 22:42:56 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-10 22:42:56 main:477] : INFO : Max Epochs: 2048 [2022-02-10 22:42:56 main:478] : INFO : Batch Size: 128 [2022-02-10 22:42:56 main:479] : INFO : Learning Rate: 0.01 [2022-02-10 22:42:56 main:480] : INFO : Patience: 10 [2022-02-10 22:42:56 main:481] : INFO : Hidden Width: 12 [2022-02-10 22:42:56 main:482] : INFO : # Recurrent Layers: 4 [2022-02-10 22:42:56 main:483] : INFO : # Backend Layers: 4 [2022-02-10 22:42:56 main:484] : INFO : # Threads: 1 [2022-02-10 22:42:56 main:486] : INFO : Preparing Dataset [2022-02-10 22:42:56 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-10 22:42:56 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-10 22:42:58 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-10 22:42:58 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-10 22:42:58 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-10 22:42:58 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-10 22:42:58 main:494] : INFO : Creating Model [2022-02-10 22:42:58 main:507] : INFO : Preparing config file [2022-02-10 22:42:58 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-10 22:42:58 main:512] : INFO : Loading config [2022-02-10 22:42:58 main:514] : INFO : Loading state [2022-02-10 22:42:59 main:559] : INFO : Loading DataLoader into Memory [2022-02-10 22:42:59 main:562] : INFO : Starting Training [2022-02-10 22:43:06 main:574] : INFO : Epoch 1926 | loss: 0.0311185 | val_loss: 0.0312369 | Time: 6624.11 ms [2022-02-10 22:43:12 main:574] : INFO : Epoch 1927 | loss: 0.0310744 | val_loss: 0.0312302 | Time: 6292.16 ms [2022-02-10 22:43:18 main:574] : INFO : Epoch 1928 | loss: 0.0310686 | val_loss: 0.0312417 | Time: 6255 ms [2022-02-10 22:43:25 main:574] : INFO : Epoch 1929 | loss: 0.0310558 | val_loss: 0.0312239 | Time: 6269.7 ms [2022-02-10 22:43:31 main:574] : INFO : Epoch 1930 | loss: 0.0310585 | val_loss: 0.0312435 | Time: 6272.49 ms [2022-02-10 22:43:37 main:574] : INFO : Epoch 1931 | loss: 0.0310526 | val_loss: 0.0312446 | Time: 6259.56 ms [2022-02-10 22:43:43 main:574] : INFO : Epoch 1932 | loss: 0.0310542 | val_loss: 0.0312208 | Time: 6317.83 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-02-15 23:14:34 main:435] : INFO : Set logging level to 1 [2022-02-15 23:14:34 main:441] : INFO : Running in BOINC Client mode [2022-02-15 23:14:34 main:444] : INFO : Resolving all filenames [2022-02-15 23:14:34 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-15 23:14:34 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-15 23:14:34 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-15 23:14:34 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-15 23:14:34 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-15 23:14:34 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-15 23:14:34 main:474] : INFO : Configuration: [2022-02-15 23:14:34 main:475] : INFO : Model type: GRU [2022-02-15 23:14:34 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-15 23:14:34 main:477] : INFO : Max Epochs: 2048 [2022-02-15 23:14:34 main:478] : INFO : Batch Size: 128 [2022-02-15 23:14:34 main:479] : INFO : Learning Rate: 0.01 [2022-02-15 23:14:34 main:480] : INFO : Patience: 10 [2022-02-15 23:14:34 main:481] : INFO : Hidden Width: 12 [2022-02-15 23:14:34 main:482] : INFO : # Recurrent Layers: 4 [2022-02-15 23:14:34 main:483] : INFO : # Backend Layers: 4 [2022-02-15 23:14:34 main:484] : INFO : # Threads: 1 [2022-02-15 23:14:34 main:486] : INFO : Preparing Dataset [2022-02-15 23:14:34 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-15 23:14:34 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-15 23:14:39 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-15 23:14:39 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-15 23:14:39 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-15 23:14:39 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-15 23:14:39 main:494] : INFO : Creating Model [2022-02-15 23:14:39 main:507] : INFO : Preparing config file [2022-02-15 23:14:39 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-15 23:14:39 main:512] : INFO : Loading config [2022-02-15 23:14:39 main:514] : INFO : Loading state [2022-02-15 23:14:41 main:559] : INFO : Loading DataLoader into Memory [2022-02-15 23:14:41 main:562] : INFO : Starting Training [2022-02-15 23:14:49 main:574] : INFO : Epoch 1926 | loss: 0.0311076 | val_loss: 0.0312442 | Time: 7177.5 ms [2022-02-15 23:14:55 main:574] : INFO : Epoch 1927 | loss: 0.0310745 | val_loss: 0.0312309 | Time: 6239.96 ms [2022-02-15 23:15:01 main:574] : INFO : Epoch 1928 | loss: 0.0310708 | val_loss: 0.031229 | Time: 6283.86 ms [2022-02-15 23:15:07 main:574] : INFO : Epoch 1929 | loss: 0.0310656 | val_loss: 0.0312182 | Time: 6327.07 ms [2022-02-15 23:15:14 main:574] : INFO : Epoch 1930 | loss: 0.0310623 | val_loss: 0.0312217 | Time: 6369.98 ms [2022-02-15 23:15:20 main:574] : INFO : Epoch 1931 | loss: 0.0310526 | val_loss: 0.0312206 | Time: 6353.25 ms [2022-02-15 23:15:27 main:574] : INFO : Epoch 1932 | loss: 0.0310526 | val_loss: 0.0312254 | Time: 6349.73 ms [2022-02-15 23:15:33 main:574] : INFO : Epoch 1933 | loss: 0.031057 | val_loss: 0.0312289 | Time: 6284.68 ms [2022-02-15 23:15:39 main:574] : INFO : Epoch 1934 | loss: 0.0310687 | val_loss: 0.0312196 | Time: 6287.45 ms [2022-02-15 23:15:45 main:574] : INFO : Epoch 1935 | loss: 0.0310578 | val_loss: 0.0312445 | Time: 6285.78 ms [2022-02-15 23:15:52 main:574] : INFO : Epoch 1936 | loss: 0.0310496 | val_loss: 0.0312267 | Time: 6293.85 ms [2022-02-15 23:15:58 main:574] : INFO : Epoch 1937 | loss: 0.031052 | val_loss: 0.0312348 | Time: 6297.29 ms [2022-02-15 23:16:04 main:574] : INFO : Epoch 1938 | loss: 0.0310504 | val_loss: 0.0312512 | Time: 6312.5 ms [2022-02-15 23:16:11 main:574] : INFO : Epoch 1939 | loss: 0.0310447 | val_loss: 0.0312476 | Time: 6297.77 ms [2022-02-15 23:16:17 main:574] : INFO : Epoch 1940 | loss: 0.0310512 | val_loss: 0.031241 | Time: 6293.55 ms [2022-02-15 23:16:23 main:574] : INFO : Epoch 1941 | loss: 0.031052 | val_loss: 0.0312525 | Time: 6273.13 ms [2022-02-15 23:16:30 main:574] : INFO : Epoch 1942 | loss: 0.0310571 | val_loss: 0.0312393 | Time: 6273.33 ms [2022-02-15 23:16:36 main:574] : INFO : Epoch 1943 | loss: 0.031054 | val_loss: 0.0312513 | Time: 6287.76 ms [2022-02-15 23:16:42 main:574] : INFO : Epoch 1944 | loss: 0.0310503 | val_loss: 0.0312437 | Time: 6307.21 ms [2022-02-15 23:16:48 main:574] : INFO : Epoch 1945 | loss: 0.0310446 | val_loss: 0.0312467 | Time: 6276 ms [2022-02-15 23:16:55 main:574] : INFO : Epoch 1946 | loss: 0.0310431 | val_loss: 0.0312405 | Time: 6313.5 ms [2022-02-15 23:17:01 main:574] : INFO : Epoch 1947 | loss: 0.0310407 | val_loss: 0.0312443 | Time: 6293.04 ms [2022-02-15 23:17:07 main:574] : INFO : Epoch 1948 | loss: 0.0310433 | val_loss: 0.0312364 | Time: 6279.8 ms [2022-02-15 23:17:14 main:574] : INFO : Epoch 1949 | loss: 0.031066 | val_loss: 0.0312361 | Time: 6289.91 ms [2022-02-15 23:17:20 main:574] : INFO : Epoch 1950 | loss: 0.0310611 | val_loss: 0.0312256 | Time: 6297.64 ms [2022-02-15 23:17:26 main:574] : INFO : Epoch 1951 | loss: 0.0310621 | val_loss: 0.03122 | Time: 6282.13 ms [2022-02-15 23:17:32 main:574] : INFO : Epoch 1952 | loss: 0.0310617 | val_loss: 0.0312305 | Time: 6314.84 ms [2022-02-15 23:17:39 main:574] : INFO : Epoch 1953 | loss: 0.0310468 | val_loss: 0.0312458 | Time: 6324.33 ms [2022-02-15 23:17:45 main:574] : INFO : Epoch 1954 | loss: 0.0310564 | val_loss: 0.0312104 | Time: 6303.18 ms [2022-02-15 23:17:51 main:574] : INFO : Epoch 1955 | loss: 0.0310678 | val_loss: 0.0312441 | Time: 6293.01 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-02-15 23:20:44 main:435] : INFO : Set logging level to 1 [2022-02-15 23:20:44 main:441] : INFO : Running in BOINC Client mode [2022-02-15 23:20:44 main:444] : INFO : Resolving all filenames [2022-02-15 23:20:44 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-15 23:20:44 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-15 23:20:44 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-15 23:20:44 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-15 23:20:44 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-15 23:20:44 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-15 23:20:44 main:474] : INFO : Configuration: [2022-02-15 23:20:44 main:475] : INFO : Model type: GRU [2022-02-15 23:20:44 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-15 23:20:44 main:477] : INFO : Max Epochs: 2048 [2022-02-15 23:20:44 main:478] : INFO : Batch Size: 128 [2022-02-15 23:20:44 main:479] : INFO : Learning Rate: 0.01 [2022-02-15 23:20:44 main:480] : INFO : Patience: 10 [2022-02-15 23:20:44 main:481] : INFO : Hidden Width: 12 [2022-02-15 23:20:44 main:482] : INFO : # Recurrent Layers: 4 [2022-02-15 23:20:44 main:483] : INFO : # Backend Layers: 4 [2022-02-15 23:20:44 main:484] : INFO : # Threads: 1 [2022-02-15 23:20:44 main:486] : INFO : Preparing Dataset [2022-02-15 23:20:44 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-15 23:20:44 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-15 23:20:47 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-15 23:20:47 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-15 23:20:47 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-15 23:20:47 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-15 23:20:47 main:494] : INFO : Creating Model [2022-02-15 23:20:47 main:507] : INFO : Preparing config file [2022-02-15 23:20:47 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-15 23:20:47 main:512] : INFO : Loading config [2022-02-15 23:20:47 main:514] : INFO : Loading state [2022-02-15 23:20:48 main:559] : INFO : Loading DataLoader into Memory [2022-02-15 23:20:48 main:562] : INFO : Starting Training [2022-02-15 23:20:55 main:574] : INFO : Epoch 1947 | loss: 0.0311079 | val_loss: 0.0312261 | Time: 6439.49 ms [2022-02-15 23:21:01 main:574] : INFO : Epoch 1948 | loss: 0.031056 | val_loss: 0.0312371 | Time: 6231.73 ms [2022-02-15 23:21:07 main:574] : INFO : Epoch 1949 | loss: 0.0310492 | val_loss: 0.031245 | Time: 6277.68 ms [2022-02-15 23:21:14 main:574] : INFO : Epoch 1950 | loss: 0.031044 | val_loss: 0.0312431 | Time: 6274.35 ms [2022-02-15 23:21:20 main:574] : INFO : Epoch 1951 | loss: 0.0310558 | val_loss: 0.0312478 | Time: 6269.49 ms [2022-02-15 23:21:26 main:574] : INFO : Epoch 1952 | loss: 0.0310505 | val_loss: 0.0312317 | Time: 6282.5 ms [2022-02-15 23:21:33 main:574] : INFO : Epoch 1953 | loss: 0.0310512 | val_loss: 0.0312353 | Time: 6332.74 ms [2022-02-15 23:21:39 main:574] : INFO : Epoch 1954 | loss: 0.031081 | val_loss: 0.031237 | Time: 6296.06 ms [2022-02-15 23:21:45 main:574] : INFO : Epoch 1955 | loss: 0.0310741 | val_loss: 0.0312129 | Time: 6311.82 ms [2022-02-15 23:21:51 main:574] : INFO : Epoch 1956 | loss: 0.0310779 | val_loss: 0.0312282 | Time: 6281.59 ms [2022-02-15 23:21:58 main:574] : INFO : Epoch 1957 | loss: 0.0310655 | val_loss: 0.0312305 | Time: 6294.87 ms [2022-02-15 23:22:04 main:574] : INFO : Epoch 1958 | loss: 0.0310562 | val_loss: 0.0312321 | Time: 6291.17 ms [2022-02-15 23:22:10 main:574] : INFO : Epoch 1959 | loss: 0.0310546 | val_loss: 0.0312241 | Time: 6276.24 ms [2022-02-15 23:22:17 main:574] : INFO : Epoch 1960 | loss: 0.0310539 | val_loss: 0.031233 | Time: 6314.23 ms [2022-02-15 23:22:23 main:574] : INFO : Epoch 1961 | loss: 0.0310513 | val_loss: 0.0312371 | Time: 6350.23 ms [2022-02-15 23:22:29 main:574] : INFO : Epoch 1962 | loss: 0.031051 | val_loss: 0.0312482 | Time: 6289.37 ms [2022-02-15 23:22:36 main:574] : INFO : Epoch 1963 | loss: 0.0310509 | val_loss: 0.0312226 | Time: 6310.62 ms [2022-02-15 23:22:42 main:574] : INFO : Epoch 1964 | loss: 0.0310509 | val_loss: 0.0312431 | Time: 6269.57 ms [2022-02-15 23:22:48 main:574] : INFO : Epoch 1965 | loss: 0.0310467 | val_loss: 0.0312356 | Time: 6269.67 ms [2022-02-15 23:22:54 main:574] : INFO : Epoch 1966 | loss: 0.0310563 | val_loss: 0.0312273 | Time: 6269.18 ms [2022-02-15 23:23:01 main:574] : INFO : Epoch 1967 | loss: 0.0310602 | val_loss: 0.0312392 | Time: 6267.6 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-02-15 23:24:10 main:435] : INFO : Set logging level to 1 [2022-02-15 23:24:10 main:441] : INFO : Running in BOINC Client mode [2022-02-15 23:24:10 main:444] : INFO : Resolving all filenames [2022-02-15 23:24:10 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-15 23:24:10 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-15 23:24:10 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-15 23:24:10 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-15 23:24:10 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-15 23:24:10 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-15 23:24:10 main:474] : INFO : Configuration: [2022-02-15 23:24:10 main:475] : INFO : Model type: GRU [2022-02-15 23:24:10 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-15 23:24:10 main:477] : INFO : Max Epochs: 2048 [2022-02-15 23:24:10 main:478] : INFO : Batch Size: 128 [2022-02-15 23:24:10 main:479] : INFO : Learning Rate: 0.01 [2022-02-15 23:24:10 main:480] : INFO : Patience: 10 [2022-02-15 23:24:10 main:481] : INFO : Hidden Width: 12 [2022-02-15 23:24:10 main:482] : INFO : # Recurrent Layers: 4 [2022-02-15 23:24:10 main:483] : INFO : # Backend Layers: 4 [2022-02-15 23:24:10 main:484] : INFO : # Threads: 1 [2022-02-15 23:24:10 main:486] : INFO : Preparing Dataset [2022-02-15 23:24:10 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-15 23:24:11 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-15 23:24:13 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-15 23:24:13 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-15 23:24:13 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-15 23:24:13 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-15 23:24:13 main:494] : INFO : Creating Model [2022-02-15 23:24:13 main:507] : INFO : Preparing config file [2022-02-15 23:24:14 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-15 23:24:14 main:512] : INFO : Loading config [2022-02-15 23:24:14 main:514] : INFO : Loading state [2022-02-15 23:24:14 main:559] : INFO : Loading DataLoader into Memory [2022-02-15 23:24:14 main:562] : INFO : Starting Training [2022-02-15 23:24:21 main:574] : INFO : Epoch 1968 | loss: 0.0311045 | val_loss: 0.0312353 | Time: 6371.77 ms [2022-02-15 23:24:27 main:574] : INFO : Epoch 1969 | loss: 0.0310643 | val_loss: 0.0312181 | Time: 6196.41 ms [2022-02-15 23:24:33 main:574] : INFO : Epoch 1970 | loss: 0.0310594 | val_loss: 0.0312162 | Time: 6248.86 ms [2022-02-15 23:24:40 main:574] : INFO : Epoch 1971 | loss: 0.0310466 | val_loss: 0.0312312 | Time: 6250.92 ms [2022-02-15 23:24:46 main:574] : INFO : Epoch 1972 | loss: 0.0310463 | val_loss: 0.0312382 | Time: 6308.11 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-02-15 23:26:58 main:435] : INFO : Set logging level to 1 [2022-02-15 23:26:58 main:441] : INFO : Running in BOINC Client mode [2022-02-15 23:26:58 main:444] : INFO : Resolving all filenames [2022-02-15 23:26:58 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-15 23:26:58 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-15 23:26:58 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-15 23:26:58 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-15 23:26:58 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-15 23:26:58 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-15 23:26:58 main:474] : INFO : Configuration: [2022-02-15 23:26:58 main:475] : INFO : Model type: GRU [2022-02-15 23:26:58 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-15 23:26:58 main:477] : INFO : Max Epochs: 2048 [2022-02-15 23:26:58 main:478] : INFO : Batch Size: 128 [2022-02-15 23:26:58 main:479] : INFO : Learning Rate: 0.01 [2022-02-15 23:26:58 main:480] : INFO : Patience: 10 [2022-02-15 23:26:58 main:481] : INFO : Hidden Width: 12 [2022-02-15 23:26:58 main:482] : INFO : # Recurrent Layers: 4 [2022-02-15 23:26:58 main:483] : INFO : # Backend Layers: 4 [2022-02-15 23:26:58 main:484] : INFO : # Threads: 1 [2022-02-15 23:26:58 main:486] : INFO : Preparing Dataset [2022-02-15 23:26:58 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-15 23:26:58 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-15 23:27:01 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-15 23:27:01 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-15 23:27:01 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-15 23:27:01 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-15 23:27:01 main:494] : INFO : Creating Model [2022-02-15 23:27:02 main:507] : INFO : Preparing config file [2022-02-15 23:27:02 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-15 23:27:02 main:512] : INFO : Loading config [2022-02-15 23:27:02 main:514] : INFO : Loading state [2022-02-15 23:27:02 main:559] : INFO : Loading DataLoader into Memory [2022-02-15 23:27:02 main:562] : INFO : Starting Training [2022-02-15 23:27:09 main:574] : INFO : Epoch 1968 | loss: 0.0311015 | val_loss: 0.0312673 | Time: 6453.22 ms [2022-02-15 23:27:15 main:574] : INFO : Epoch 1969 | loss: 0.0310708 | val_loss: 0.0312149 | Time: 6243.32 ms [2022-02-15 23:27:21 main:574] : INFO : Epoch 1970 | loss: 0.0310613 | val_loss: 0.0312304 | Time: 6287.78 ms [2022-02-15 23:27:28 main:574] : INFO : Epoch 1971 | loss: 0.0310543 | val_loss: 0.0312516 | Time: 6287.19 ms [2022-02-15 23:27:34 main:574] : INFO : Epoch 1972 | loss: 0.0310598 | val_loss: 0.0312439 | Time: 6275.89 ms [2022-02-15 23:27:40 main:574] : INFO : Epoch 1973 | loss: 0.0310512 | val_loss: 0.0312205 | Time: 6273.01 ms [2022-02-15 23:27:46 main:574] : INFO : Epoch 1974 | loss: 0.031054 | val_loss: 0.0312227 | Time: 6258.8 ms [2022-02-15 23:27:53 main:574] : INFO : Epoch 1975 | loss: 0.0310482 | val_loss: 0.0312352 | Time: 6276.17 ms [2022-02-15 23:27:59 main:574] : INFO : Epoch 1976 | loss: 0.0310438 | val_loss: 0.0312372 | Time: 6268.62 ms [2022-02-15 23:28:05 main:574] : INFO : Epoch 1977 | loss: 0.0310441 | val_loss: 0.0312344 | Time: 6274.86 ms [2022-02-15 23:28:12 main:574] : INFO : Epoch 1978 | loss: 0.031045 | val_loss: 0.0312277 | Time: 6293.52 ms [2022-02-15 23:28:18 main:574] : INFO : Epoch 1979 | loss: 0.0310514 | val_loss: 0.031241 | Time: 6318.21 ms [2022-02-15 23:28:24 main:574] : INFO : Epoch 1980 | loss: 0.0310556 | val_loss: 0.0312264 | Time: 6319.61 ms [2022-02-15 23:28:31 main:574] : INFO : Epoch 1981 | loss: 0.0310509 | val_loss: 0.0312504 | Time: 6270.71 ms [2022-02-15 23:28:37 main:574] : INFO : Epoch 1982 | loss: 0.031052 | val_loss: 0.0312314 | Time: 6284.43 ms [2022-02-15 23:28:43 main:574] : INFO : Epoch 1983 | loss: 0.0310596 | val_loss: 0.0312361 | Time: 6280.84 ms [2022-02-15 23:28:49 main:574] : INFO : Epoch 1984 | loss: 0.0310542 | val_loss: 0.0312379 | Time: 6276.17 ms [2022-02-15 23:28:56 main:574] : INFO : Epoch 1985 | loss: 0.0310543 | val_loss: 0.0312517 | Time: 6286.19 ms [2022-02-15 23:29:02 main:574] : INFO : Epoch 1986 | loss: 0.031059 | val_loss: 0.0312213 | Time: 6311.71 ms [2022-02-15 23:29:08 main:574] : INFO : Epoch 1987 | loss: 0.0310496 | val_loss: 0.0312513 | Time: 6310.84 ms [2022-02-15 23:29:15 main:574] : INFO : Epoch 1988 | loss: 0.0310458 | val_loss: 0.0312303 | Time: 6296.47 ms [2022-02-15 23:29:21 main:574] : INFO : Epoch 1989 | loss: 0.0310518 | val_loss: 0.0312286 | Time: 6295.02 ms [2022-02-15 23:29:27 main:574] : INFO : Epoch 1990 | loss: 0.031054 | val_loss: 0.0312164 | Time: 6308.31 ms [2022-02-15 23:29:34 main:574] : INFO : Epoch 1991 | loss: 0.0310569 | val_loss: 0.0312425 | Time: 6262.92 ms [2022-02-15 23:29:40 main:574] : INFO : Epoch 1992 | loss: 0.0310581 | val_loss: 0.0312313 | Time: 6273.83 ms [2022-02-15 23:29:46 main:574] : INFO : Epoch 1993 | loss: 0.0310748 | val_loss: 0.0312245 | Time: 6287.32 ms [2022-02-15 23:29:52 main:574] : INFO : Epoch 1994 | loss: 0.031061 | val_loss: 0.0312395 | Time: 6292.19 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-02-15 23:31:03 main:435] : INFO : Set logging level to 1 [2022-02-15 23:31:03 main:441] : INFO : Running in BOINC Client mode [2022-02-15 23:31:03 main:444] : INFO : Resolving all filenames [2022-02-15 23:31:03 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-15 23:31:03 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-15 23:31:03 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-15 23:31:03 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-15 23:31:03 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-15 23:31:03 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-15 23:31:03 main:474] : INFO : Configuration: [2022-02-15 23:31:03 main:475] : INFO : Model type: GRU [2022-02-15 23:31:03 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-15 23:31:03 main:477] : INFO : Max Epochs: 2048 [2022-02-15 23:31:03 main:478] : INFO : Batch Size: 128 [2022-02-15 23:31:03 main:479] : INFO : Learning Rate: 0.01 [2022-02-15 23:31:03 main:480] : INFO : Patience: 10 [2022-02-15 23:31:03 main:481] : INFO : Hidden Width: 12 [2022-02-15 23:31:03 main:482] : INFO : # Recurrent Layers: 4 [2022-02-15 23:31:03 main:483] : INFO : # Backend Layers: 4 [2022-02-15 23:31:03 main:484] : INFO : # Threads: 1 [2022-02-15 23:31:03 main:486] : INFO : Preparing Dataset [2022-02-15 23:31:03 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-15 23:31:04 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-15 23:31:06 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-15 23:31:06 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-15 23:31:06 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-15 23:31:06 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-15 23:31:06 main:494] : INFO : Creating Model [2022-02-15 23:31:06 main:507] : INFO : Preparing config file [2022-02-15 23:31:06 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-15 23:31:06 main:512] : INFO : Loading config [2022-02-15 23:31:06 main:514] : INFO : Loading state [2022-02-15 23:31:07 main:559] : INFO : Loading DataLoader into Memory [2022-02-15 23:31:07 main:562] : INFO : Starting Training [2022-02-15 23:31:14 main:574] : INFO : Epoch 1989 | loss: 0.031105 | val_loss: 0.0312198 | Time: 6370.56 ms [2022-02-15 23:31:20 main:574] : INFO : Epoch 1990 | loss: 0.0310659 | val_loss: 0.0312317 | Time: 6187.84 ms [2022-02-15 23:31:26 main:574] : INFO : Epoch 1991 | loss: 0.0310619 | val_loss: 0.031243 | Time: 6243.95 ms [2022-02-15 23:31:33 main:574] : INFO : Epoch 1992 | loss: 0.0310564 | val_loss: 0.0312403 | Time: 6272.99 ms [2022-02-15 23:31:39 main:574] : INFO : Epoch 1993 | loss: 0.0310536 | val_loss: 0.0312297 | Time: 6276.11 ms [2022-02-15 23:31:45 main:574] : INFO : Epoch 1994 | loss: 0.0310523 | val_loss: 0.0312475 | Time: 6298.25 ms [2022-02-15 23:31:52 main:574] : INFO : Epoch 1995 | loss: 0.0310553 | val_loss: 0.0312284 | Time: 6450.09 ms [2022-02-15 23:31:58 main:574] : INFO : Epoch 1996 | loss: 0.0310661 | val_loss: 0.0312393 | Time: 6315.09 ms [2022-02-15 23:32:04 main:574] : INFO : Epoch 1997 | loss: 0.0310595 | val_loss: 0.0312415 | Time: 6306.89 ms [2022-02-15 23:32:11 main:574] : INFO : Epoch 1998 | loss: 0.0310511 | val_loss: 0.0312262 | Time: 6282.73 ms [2022-02-15 23:32:17 main:574] : INFO : Epoch 1999 | loss: 0.0310527 | val_loss: 0.031249 | Time: 6280.43 ms [2022-02-15 23:32:23 main:574] : INFO : Epoch 2000 | loss: 0.0310524 | val_loss: 0.0312272 | Time: 6271.46 ms [2022-02-15 23:32:29 main:574] : INFO : Epoch 2001 | loss: 0.0310593 | val_loss: 0.0312512 | Time: 6297.22 ms [2022-02-15 23:32:36 main:574] : INFO : Epoch 2002 | loss: 0.0310574 | val_loss: 0.0312294 | Time: 6302.94 ms [2022-02-15 23:32:42 main:574] : INFO : Epoch 2003 | loss: 0.0310521 | val_loss: 0.0312446 | Time: 6342.84 ms [2022-02-15 23:32:48 main:574] : INFO : Epoch 2004 | loss: 0.0310441 | val_loss: 0.0312386 | Time: 6284.91 ms [2022-02-15 23:32:55 main:574] : INFO : Epoch 2005 | loss: 0.0310445 | val_loss: 0.0312397 | Time: 6266.25 ms [2022-02-15 23:33:01 main:574] : INFO : Epoch 2006 | loss: 0.0310538 | val_loss: 0.0312295 | Time: 6270.56 ms [2022-02-15 23:33:07 main:574] : INFO : Epoch 2007 | loss: 0.0310583 | val_loss: 0.0312286 | Time: 6293.9 ms [2022-02-15 23:33:13 main:574] : INFO : Epoch 2008 | loss: 0.0310476 | val_loss: 0.0312341 | Time: 6267.78 ms [2022-02-15 23:33:20 main:574] : INFO : Epoch 2009 | loss: 0.0310427 | val_loss: 0.0312444 | Time: 6273.93 ms [2022-02-15 23:33:26 main:574] : INFO : Epoch 2010 | loss: 0.0310405 | val_loss: 0.0312467 | Time: 6293.56 ms [2022-02-15 23:33:32 main:574] : INFO : Epoch 2011 | loss: 0.0310427 | val_loss: 0.0312312 | Time: 6290.47 ms [2022-02-15 23:33:39 main:574] : INFO : Epoch 2012 | loss: 0.0310406 | val_loss: 0.0312371 | Time: 6311.04 ms [2022-02-15 23:33:45 main:574] : INFO : Epoch 2013 | loss: 0.0310748 | val_loss: 0.0312158 | Time: 6281.8 ms [2022-02-15 23:33:51 main:574] : INFO : Epoch 2014 | loss: 0.031075 | val_loss: 0.0312409 | Time: 6297.34 ms [2022-02-15 23:33:58 main:574] : INFO : Epoch 2015 | loss: 0.0310624 | val_loss: 0.0312221 | Time: 6272.04 ms [2022-02-15 23:34:04 main:574] : INFO : Epoch 2016 | loss: 0.0310553 | val_loss: 0.0312299 | Time: 6292.53 ms [2022-02-15 23:34:10 main:574] : INFO : Epoch 2017 | loss: 0.0310559 | val_loss: 0.0312081 | Time: 6317.95 ms [2022-02-15 23:34:16 main:574] : INFO : Epoch 2018 | loss: 0.031091 | val_loss: 0.0312091 | Time: 6319.76 ms [2022-02-15 23:34:23 main:574] : INFO : Epoch 2019 | loss: 0.0310763 | val_loss: 0.0312151 | Time: 6281.12 ms [2022-02-15 23:34:29 main:574] : INFO : Epoch 2020 | loss: 0.0310644 | val_loss: 0.0312361 | Time: 6324.36 ms [2022-02-15 23:34:35 main:574] : INFO : Epoch 2021 | loss: 0.0310712 | val_loss: 0.0312052 | Time: 6295.11 ms [2022-02-15 23:34:42 main:574] : INFO : Epoch 2022 | loss: 0.0310574 | val_loss: 0.0312552 | Time: 6282.04 ms [2022-02-15 23:34:48 main:574] : INFO : Epoch 2023 | loss: 0.0310536 | val_loss: 0.0312224 | Time: 6271.79 ms [2022-02-15 23:34:54 main:574] : INFO : Epoch 2024 | loss: 0.0310491 | val_loss: 0.0312495 | Time: 6270.45 ms [2022-02-15 23:35:00 main:574] : INFO : Epoch 2025 | loss: 0.0310482 | val_loss: 0.0312357 | Time: 6299.32 ms [2022-02-15 23:35:07 main:574] : INFO : Epoch 2026 | loss: 0.0310488 | val_loss: 0.031252 | Time: 6336.53 ms [2022-02-15 23:35:13 main:574] : INFO : Epoch 2027 | loss: 0.0310487 | val_loss: 0.0312377 | Time: 6336.13 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-02-15 23:36:17 main:435] : INFO : Set logging level to 1 [2022-02-15 23:36:17 main:441] : INFO : Running in BOINC Client mode [2022-02-15 23:36:17 main:444] : INFO : Resolving all filenames [2022-02-15 23:36:17 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-15 23:36:17 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-15 23:36:17 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-15 23:36:17 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-15 23:36:17 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-15 23:36:17 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-15 23:36:17 main:474] : INFO : Configuration: [2022-02-15 23:36:17 main:475] : INFO : Model type: GRU [2022-02-15 23:36:17 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-15 23:36:18 main:477] : INFO : Max Epochs: 2048 [2022-02-15 23:36:18 main:478] : INFO : Batch Size: 128 [2022-02-15 23:36:18 main:479] : INFO : Learning Rate: 0.01 [2022-02-15 23:36:18 main:480] : INFO : Patience: 10 [2022-02-15 23:36:18 main:481] : INFO : Hidden Width: 12 [2022-02-15 23:36:18 main:482] : INFO : # Recurrent Layers: 4 [2022-02-15 23:36:18 main:483] : INFO : # Backend Layers: 4 [2022-02-15 23:36:18 main:484] : INFO : # Threads: 1 [2022-02-15 23:36:18 main:486] : INFO : Preparing Dataset [2022-02-15 23:36:18 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-15 23:36:18 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-15 23:36:20 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-15 23:36:20 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-15 23:36:21 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-15 23:36:21 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-15 23:36:21 main:494] : INFO : Creating Model [2022-02-15 23:36:21 main:507] : INFO : Preparing config file [2022-02-15 23:36:21 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-15 23:36:21 main:512] : INFO : Loading config [2022-02-15 23:36:21 main:514] : INFO : Loading state [2022-02-15 23:36:22 main:559] : INFO : Loading DataLoader into Memory [2022-02-15 23:36:22 main:562] : INFO : Starting Training [2022-02-15 23:36:28 main:574] : INFO : Epoch 2021 | loss: 0.0311052 | val_loss: 0.0312499 | Time: 6408.67 ms [2022-02-15 23:36:35 main:574] : INFO : Epoch 2022 | loss: 0.0310825 | val_loss: 0.0312407 | Time: 6225.5 ms [2022-02-15 23:36:41 main:574] : INFO : Epoch 2023 | loss: 0.0310706 | val_loss: 0.0312196 | Time: 6265.95 ms [2022-02-15 23:36:47 main:574] : INFO : Epoch 2024 | loss: 0.0310691 | val_loss: 0.0312334 | Time: 6327.68 ms [2022-02-15 23:36:53 main:574] : INFO : Epoch 2025 | loss: 0.0310628 | val_loss: 0.0312442 | Time: 6290.57 ms [2022-02-15 23:37:00 main:574] : INFO : Epoch 2026 | loss: 0.0310698 | val_loss: 0.0312181 | Time: 6344.15 ms [2022-02-15 23:37:06 main:574] : INFO : Epoch 2027 | loss: 0.031063 | val_loss: 0.0312334 | Time: 6313.73 ms [2022-02-15 23:37:12 main:574] : INFO : Epoch 2028 | loss: 0.0310563 | val_loss: 0.031242 | Time: 6332.29 ms [2022-02-15 23:37:19 main:574] : INFO : Epoch 2029 | loss: 0.0310629 | val_loss: 0.0312344 | Time: 6297.27 ms [2022-02-15 23:37:25 main:574] : INFO : Epoch 2030 | loss: 0.0310679 | val_loss: 0.0312422 | Time: 6292.49 ms [2022-02-15 23:37:31 main:574] : INFO : Epoch 2031 | loss: 0.0310584 | val_loss: 0.0312198 | Time: 6300.73 ms [2022-02-15 23:37:38 main:574] : INFO : Epoch 2032 | loss: 0.0310553 | val_loss: 0.0312427 | Time: 6333.29 ms [2022-02-15 23:37:44 main:574] : INFO : Epoch 2033 | loss: 0.0310522 | val_loss: 0.031247 | Time: 6291.31 ms [2022-02-15 23:37:50 main:574] : INFO : Epoch 2034 | loss: 0.0310549 | val_loss: 0.0312296 | Time: 6336.93 ms [2022-02-15 23:37:57 main:574] : INFO : Epoch 2035 | loss: 0.0310584 | val_loss: 0.0312305 | Time: 6313.41 ms [2022-02-15 23:38:03 main:574] : INFO : Epoch 2036 | loss: 0.0310605 | val_loss: 0.0312154 | Time: 6288.89 ms [2022-02-15 23:38:09 main:574] : INFO : Epoch 2037 | loss: 0.031059 | val_loss: 0.0312288 | Time: 6271.65 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-02-15 23:40:00 main:435] : INFO : Set logging level to 1 [2022-02-15 23:40:00 main:441] : INFO : Running in BOINC Client mode [2022-02-15 23:40:00 main:444] : INFO : Resolving all filenames [2022-02-15 23:40:00 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-15 23:40:00 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-15 23:40:00 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-15 23:40:00 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-15 23:40:00 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-15 23:40:00 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-15 23:40:00 main:474] : INFO : Configuration: [2022-02-15 23:40:00 main:475] : INFO : Model type: GRU [2022-02-15 23:40:00 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-15 23:40:00 main:477] : INFO : Max Epochs: 2048 [2022-02-15 23:40:00 main:478] : INFO : Batch Size: 128 [2022-02-15 23:40:00 main:479] : INFO : Learning Rate: 0.01 [2022-02-15 23:40:00 main:480] : INFO : Patience: 10 [2022-02-15 23:40:00 main:481] : INFO : Hidden Width: 12 [2022-02-15 23:40:00 main:482] : INFO : # Recurrent Layers: 4 [2022-02-15 23:40:00 main:483] : INFO : # Backend Layers: 4 [2022-02-15 23:40:00 main:484] : INFO : # Threads: 1 [2022-02-15 23:40:00 main:486] : INFO : Preparing Dataset [2022-02-15 23:40:00 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-15 23:40:00 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-15 23:40:02 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-15 23:40:02 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-15 23:40:02 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-15 23:40:02 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-15 23:40:02 main:494] : INFO : Creating Model [2022-02-15 23:40:02 main:507] : INFO : Preparing config file [2022-02-15 23:40:02 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-15 23:40:02 main:512] : INFO : Loading config [2022-02-15 23:40:02 main:514] : INFO : Loading state [2022-02-15 23:40:03 main:559] : INFO : Loading DataLoader into Memory [2022-02-15 23:40:03 main:562] : INFO : Starting Training [2022-02-15 23:40:10 main:574] : INFO : Epoch 2031 | loss: 0.0310952 | val_loss: 0.031227 | Time: 6480.8 ms [2022-02-15 23:40:16 main:574] : INFO : Epoch 2032 | loss: 0.0310648 | val_loss: 0.0312364 | Time: 6225.68 ms [2022-02-15 23:40:22 main:574] : INFO : Epoch 2033 | loss: 0.0310675 | val_loss: 0.0312183 | Time: 6252.01 ms [2022-02-15 23:40:28 main:574] : INFO : Epoch 2034 | loss: 0.0310675 | val_loss: 0.0312269 | Time: 6282.18 ms [2022-02-15 23:40:35 main:574] : INFO : Epoch 2035 | loss: 0.0310591 | val_loss: 0.0312508 | Time: 6276.95 ms [2022-02-15 23:40:41 main:574] : INFO : Epoch 2036 | loss: 0.0310522 | val_loss: 0.0312215 | Time: 6280.11 ms [2022-02-15 23:40:47 main:574] : INFO : Epoch 2037 | loss: 0.0310456 | val_loss: 0.031233 | Time: 6301.06 ms [2022-02-15 23:40:54 main:574] : INFO : Epoch 2038 | loss: 0.0310535 | val_loss: 0.0312461 | Time: 6297.3 ms [2022-02-15 23:41:00 main:574] : INFO : Epoch 2039 | loss: 0.0310548 | val_loss: 0.0312132 | Time: 6296.68 ms [2022-02-15 23:41:06 main:574] : INFO : Epoch 2040 | loss: 0.0310505 | val_loss: 0.0312574 | Time: 6276.25 ms [2022-02-15 23:41:13 main:574] : INFO : Epoch 2041 | loss: 0.0310558 | val_loss: 0.0312266 | Time: 6299.98 ms [2022-02-15 23:41:19 main:574] : INFO : Epoch 2042 | loss: 0.0310562 | val_loss: 0.0312261 | Time: 6258.55 ms [2022-02-15 23:41:25 main:574] : INFO : Epoch 2043 | loss: 0.0310552 | val_loss: 0.0312325 | Time: 6294.45 ms [2022-02-15 23:41:31 main:574] : INFO : Epoch 2044 | loss: 0.0310573 | val_loss: 0.0312413 | Time: 6313.85 ms [2022-02-15 23:41:38 main:574] : INFO : Epoch 2045 | loss: 0.031051 | val_loss: 0.0312385 | Time: 6306.42 ms [2022-02-15 23:41:44 main:574] : INFO : Epoch 2046 | loss: 0.0310486 | val_loss: 0.0312507 | Time: 6292.69 ms [2022-02-15 23:41:50 main:574] : INFO : Epoch 2047 | loss: 0.0310493 | val_loss: 0.0312354 | Time: 6277.45 ms [2022-02-15 23:41:57 main:574] : INFO : Epoch 2048 | loss: 0.0310545 | val_loss: 0.03123 | Time: 6291.42 ms [2022-02-15 23:41:57 main:597] : INFO : Saving trained model to model-final.pt, val_loss 0.03123 [2022-02-15 23:41:57 main:603] : INFO : Saving end state to config to file [2022-02-15 23:41:57 main:608] : INFO : Success, exiting.. 23:41:57 (9384): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)