Task 11087500
| Name | ParityModified-1639956180-4296-1-0_1 |
| Workunit | 7883244 |
| Created | 26 Jan 2022, 16:13:38 UTC |
| Sent | 26 Jan 2022, 18:38:52 UTC |
| Report deadline | 3 Feb 2022, 18:38:52 UTC |
| Received | 29 Jan 2022, 22:28:07 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 6180 |
| Run time | 3 hours 40 min 51 sec |
| CPU time | 3 hours 12 min 13 sec |
| Validate state | Valid |
| Credit | 4,160.00 |
| Device peak FLOPS | 884.73 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.54 GB |
| Peak swap size | 3.44 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version> <![CDATA[ <stderr_txt> sor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-01-29 22:43:34 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-01-29 22:43:35 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-01-29 22:43:35 main:494] : INFO : Creating Model [2022-01-29 22:43:35 main:507] : INFO : Preparing config file [2022-01-29 22:43:35 main:511] : INFO : Found checkpoint, attempting to load... [2022-01-29 22:43:35 main:512] : INFO : Loading config [2022-01-29 22:43:35 main:514] : INFO : Loading state [2022-01-29 22:43:36 main:559] : INFO : Loading DataLoader into Memory [2022-01-29 22:43:36 main:562] : INFO : Starting Training [2022-01-29 22:43:42 main:574] : INFO : Epoch 1869 | loss: 0.0311937 | val_loss: 0.0311598 | Time: 6376.76 ms [2022-01-29 22:43:48 main:574] : INFO : Epoch 1870 | loss: 0.031144 | val_loss: 0.0311574 | Time: 6196.63 ms [2022-01-29 22:43:55 main:574] : INFO : Epoch 1871 | loss: 0.0311404 | val_loss: 0.0311602 | Time: 6258.08 ms [2022-01-29 22:44:01 main:574] : INFO : Epoch 1872 | loss: 0.03114 | val_loss: 0.0311575 | Time: 6275.86 ms [2022-01-29 22:44:07 main:574] : INFO : Epoch 1873 | loss: 0.0311401 | val_loss: 0.0311567 | Time: 6294.19 ms [2022-01-29 22:44:14 main:574] : INFO : Epoch 1874 | loss: 0.031139 | val_loss: 0.0311596 | Time: 6307.51 ms [2022-01-29 22:44:20 main:574] : INFO : Epoch 1875 | loss: 0.0311373 | val_loss: 0.0311574 | Time: 6331.82 ms [2022-01-29 22:44:26 main:574] : INFO : Epoch 1876 | loss: 0.0311368 | val_loss: 0.0311562 | Time: 6324.41 ms [2022-01-29 22:44:33 main:574] : INFO : Epoch 1877 | loss: 0.0311359 | val_loss: 0.0311575 | Time: 6298.11 ms [2022-01-29 22:44:39 main:574] : INFO : Epoch 1878 | loss: 0.031136 | val_loss: 0.0311592 | Time: 6277.38 ms [2022-01-29 22:44:45 main:574] : INFO : Epoch 1879 | loss: 0.0311359 | val_loss: 0.031159 | Time: 6296.15 ms [2022-01-29 22:44:51 main:574] : INFO : Epoch 1880 | loss: 0.0311355 | val_loss: 0.0311621 | Time: 6287.06 ms [2022-01-29 22:44:58 main:574] : INFO : Epoch 1881 | loss: 0.0311352 | val_loss: 0.031155 | Time: 6288.35 ms [2022-01-29 22:45:04 main:574] : INFO : Epoch 1882 | loss: 0.0311366 | val_loss: 0.0311605 | Time: 6289.61 ms [2022-01-29 22:45:10 main:574] : INFO : Epoch 1883 | loss: 0.0311357 | val_loss: 0.0311588 | Time: 6290.04 ms [2022-01-29 22:45:17 main:574] : INFO : Epoch 1884 | loss: 0.031136 | val_loss: 0.0311608 | Time: 6318.95 ms [2022-01-29 22:45:23 main:574] : INFO : Epoch 1885 | loss: 0.0311367 | val_loss: 0.0311585 | Time: 6285.04 ms [2022-01-29 22:45:29 main:574] : INFO : Epoch 1886 | loss: 0.0311369 | val_loss: 0.0311541 | Time: 6275.6 ms [2022-01-29 22:45:35 main:574] : INFO : Epoch 1887 | loss: 0.0311352 | val_loss: 0.0311576 | Time: 6284.51 ms [2022-01-29 22:45:42 main:574] : INFO : Epoch 1888 | loss: 0.0311357 | val_loss: 0.0311662 | Time: 6273.26 ms [2022-01-29 22:45:48 main:574] : INFO : Epoch 1889 | loss: 0.0311391 | val_loss: 0.0311587 | Time: 6291.99 ms [2022-01-29 22:45:54 main:574] : INFO : Epoch 1890 | loss: 0.0311392 | val_loss: 0.0311593 | Time: 6297.63 ms [2022-01-29 22:46:01 main:574] : INFO : Epoch 1891 | loss: 0.0311393 | val_loss: 0.0311595 | Time: 6304.46 ms [2022-01-29 22:46:07 main:574] : INFO : Epoch 1892 | loss: 0.0311427 | val_loss: 0.0311603 | Time: 6318.61 ms [2022-01-29 22:46:13 main:574] : INFO : Epoch 1893 | loss: 0.0311381 | val_loss: 0.0311571 | Time: 6287.99 ms [2022-01-29 22:46:20 main:574] : INFO : Epoch 1894 | loss: 0.0311363 | val_loss: 0.0311565 | Time: 6276.74 ms [2022-01-29 22:46:26 main:574] : INFO : Epoch 1895 | loss: 0.0311382 | val_loss: 0.031158 | Time: 6269.94 ms [2022-01-29 22:46:32 main:574] : INFO : Epoch 1896 | loss: 0.0311412 | val_loss: 0.0311582 | Time: 6301.85 ms [2022-01-29 22:46:38 main:574] : INFO : Epoch 1897 | loss: 0.0311421 | val_loss: 0.0311609 | Time: 6290.79 ms [2022-01-29 22:46:45 main:574] : INFO : Epoch 1898 | loss: 0.0311405 | val_loss: 0.0311555 | Time: 6288.96 ms [2022-01-29 22:46:51 main:574] : INFO : Epoch 1899 | loss: 0.0311389 | val_loss: 0.0311562 | Time: 6310.19 ms [2022-01-29 22:46:57 main:574] : INFO : Epoch 1900 | loss: 0.0311378 | val_loss: 0.0311589 | Time: 6309.36 ms [2022-01-29 22:47:04 main:574] : INFO : Epoch 1901 | loss: 0.0311371 | val_loss: 0.0311558 | Time: 6296.12 ms [2022-01-29 22:47:10 main:574] : INFO : Epoch 1902 | loss: 0.0311367 | val_loss: 0.0311564 | Time: 6285.4 ms [2022-01-29 22:47:16 main:574] : INFO : Epoch 1903 | loss: 0.0311354 | val_loss: 0.031158 | Time: 6301.82 ms [2022-01-29 22:47:23 main:574] : INFO : Epoch 1904 | loss: 0.0311357 | val_loss: 0.0311548 | Time: 6327.21 ms [2022-01-29 22:47:29 main:574] : INFO : Epoch 1905 | loss: 0.0311344 | val_loss: 0.0311583 | Time: 6305.84 ms [2022-01-29 22:47:35 main:574] : INFO : Epoch 1906 | loss: 0.0311385 | val_loss: 0.0311578 | Time: 6292.3 ms [2022-01-29 22:47:42 main:574] : INFO : Epoch 1907 | loss: 0.0311377 | val_loss: 0.0311598 | Time: 6321 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-01-29 22:50:11 main:435] : INFO : Set logging level to 1 [2022-01-29 22:50:11 main:441] : INFO : Running in BOINC Client mode [2022-01-29 22:50:11 main:444] : INFO : Resolving all filenames [2022-01-29 22:50:11 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-01-29 22:50:11 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-01-29 22:50:11 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-01-29 22:50:11 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-01-29 22:50:11 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-01-29 22:50:11 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-01-29 22:50:11 main:474] : INFO : Configuration: [2022-01-29 22:50:11 main:475] : INFO : Model type: GRU [2022-01-29 22:50:11 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-01-29 22:50:11 main:477] : INFO : Max Epochs: 2048 [2022-01-29 22:50:11 main:478] : INFO : Batch Size: 128 [2022-01-29 22:50:11 main:479] : INFO : Learning Rate: 0.01 [2022-01-29 22:50:11 main:480] : INFO : Patience: 10 [2022-01-29 22:50:11 main:481] : INFO : Hidden Width: 12 [2022-01-29 22:50:11 main:482] : INFO : # Recurrent Layers: 4 [2022-01-29 22:50:11 main:483] : INFO : # Backend Layers: 4 [2022-01-29 22:50:11 main:484] : INFO : # Threads: 1 [2022-01-29 22:50:11 main:486] : INFO : Preparing Dataset [2022-01-29 22:50:11 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-01-29 22:50:11 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-01-29 22:50:14 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-01-29 22:50:14 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-01-29 22:50:14 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-01-29 22:50:14 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-01-29 22:50:14 main:494] : INFO : Creating Model [2022-01-29 22:50:14 main:507] : INFO : Preparing config file [2022-01-29 22:50:14 main:511] : INFO : Found checkpoint, attempting to load... [2022-01-29 22:50:14 main:512] : INFO : Loading config [2022-01-29 22:50:14 main:514] : INFO : Loading state [2022-01-29 22:50:15 main:559] : INFO : Loading DataLoader into Memory [2022-01-29 22:50:15 main:562] : INFO : Starting Training [2022-01-29 22:50:21 main:574] : INFO : Epoch 1901 | loss: 0.0311745 | val_loss: 0.0311625 | Time: 6296.84 ms [2022-01-29 22:50:28 main:574] : INFO : Epoch 1902 | loss: 0.0311416 | val_loss: 0.0311579 | Time: 6164.13 ms [2022-01-29 22:50:34 main:574] : INFO : Epoch 1903 | loss: 0.0311399 | val_loss: 0.0311601 | Time: 6243.16 ms [2022-01-29 22:50:40 main:574] : INFO : Epoch 1904 | loss: 0.0311384 | val_loss: 0.03116 | Time: 6254.14 ms [2022-01-29 22:50:46 main:574] : INFO : Epoch 1905 | loss: 0.0311374 | val_loss: 0.0311606 | Time: 6264.28 ms [2022-01-29 22:50:53 main:574] : INFO : Epoch 1906 | loss: 0.0311398 | val_loss: 0.0311574 | Time: 6268.33 ms [2022-01-29 22:50:59 main:574] : INFO : Epoch 1907 | loss: 0.0311386 | val_loss: 0.0311553 | Time: 6283.25 ms [2022-01-29 22:51:05 main:574] : INFO : Epoch 1908 | loss: 0.0311356 | val_loss: 0.0311588 | Time: 6317.39 ms [2022-01-29 22:51:11 main:574] : INFO : Epoch 1909 | loss: 0.0311359 | val_loss: 0.0311552 | Time: 6307.44 ms [2022-01-29 22:51:18 main:574] : INFO : Epoch 1910 | loss: 0.0311372 | val_loss: 0.0311561 | Time: 6283.54 ms [2022-01-29 22:51:24 main:574] : INFO : Epoch 1911 | loss: 0.0311366 | val_loss: 0.0311569 | Time: 6285.43 ms [2022-01-29 22:51:30 main:574] : INFO : Epoch 1912 | loss: 0.0311368 | val_loss: 0.0311583 | Time: 6274.11 ms [2022-01-29 22:51:37 main:574] : INFO : Epoch 1913 | loss: 0.0311367 | val_loss: 0.0311555 | Time: 6266.42 ms [2022-01-29 22:51:43 main:574] : INFO : Epoch 1914 | loss: 0.0311369 | val_loss: 0.0311588 | Time: 6286.49 ms [2022-01-29 22:51:49 main:574] : INFO : Epoch 1915 | loss: 0.0311348 | val_loss: 0.0311548 | Time: 6284.51 ms [2022-01-29 22:51:56 main:574] : INFO : Epoch 1916 | loss: 0.0311361 | val_loss: 0.031157 | Time: 6324.25 ms [2022-01-29 22:52:02 main:574] : INFO : Epoch 1917 | loss: 0.0311367 | val_loss: 0.0311612 | Time: 6305.13 ms [2022-01-29 22:52:08 main:574] : INFO : Epoch 1918 | loss: 0.0311381 | val_loss: 0.0311595 | Time: 6294.26 ms [2022-01-29 22:52:14 main:574] : INFO : Epoch 1919 | loss: 0.0311363 | val_loss: 0.0311607 | Time: 6291.85 ms [2022-01-29 22:52:21 main:574] : INFO : Epoch 1920 | loss: 0.031133 | val_loss: 0.0311562 | Time: 6265.25 ms [2022-01-29 22:52:27 main:574] : INFO : Epoch 1921 | loss: 0.0311333 | val_loss: 0.0311587 | Time: 6253.82 ms [2022-01-29 22:52:33 main:574] : INFO : Epoch 1922 | loss: 0.0311342 | val_loss: 0.0311557 | Time: 6278.14 ms [2022-01-29 22:52:40 main:574] : INFO : Epoch 1923 | loss: 0.0311339 | val_loss: 0.0311549 | Time: 6306.02 ms [2022-01-29 22:52:46 main:574] : INFO : Epoch 1924 | loss: 0.0311336 | val_loss: 0.0311587 | Time: 6291.75 ms [2022-01-29 22:52:52 main:574] : INFO : Epoch 1925 | loss: 0.0311349 | val_loss: 0.0311564 | Time: 6313 ms [2022-01-29 22:52:58 main:574] : INFO : Epoch 1926 | loss: 0.0311333 | val_loss: 0.0311591 | Time: 6278.69 ms [2022-01-29 22:53:05 main:574] : INFO : Epoch 1927 | loss: 0.0311334 | val_loss: 0.0311582 | Time: 6295.91 ms [2022-01-29 22:53:11 main:574] : INFO : Epoch 1928 | loss: 0.0311386 | val_loss: 0.0311579 | Time: 6259.75 ms [2022-01-29 22:53:17 main:574] : INFO : Epoch 1929 | loss: 0.031138 | val_loss: 0.031159 | Time: 6283.24 ms [2022-01-29 22:53:24 main:574] : INFO : Epoch 1930 | loss: 0.0311362 | val_loss: 0.0311606 | Time: 6271.45 ms [2022-01-29 22:53:30 main:574] : INFO : Epoch 1931 | loss: 0.0311352 | val_loss: 0.0311604 | Time: 6312.04 ms [2022-01-29 22:53:36 main:574] : INFO : Epoch 1932 | loss: 0.0311347 | val_loss: 0.0311573 | Time: 6300.72 ms [2022-01-29 22:53:42 main:574] : INFO : Epoch 1933 | loss: 0.0311336 | val_loss: 0.0311582 | Time: 6304.5 ms [2022-01-29 22:53:49 main:574] : INFO : Epoch 1934 | loss: 0.0311341 | val_loss: 0.0311574 | Time: 6289.12 ms [2022-01-29 22:53:55 main:574] : INFO : Epoch 1935 | loss: 0.0311342 | val_loss: 0.0311599 | Time: 6329.51 ms [2022-01-29 22:54:01 main:574] : INFO : Epoch 1936 | loss: 0.0311339 | val_loss: 0.0311573 | Time: 6284.06 ms [2022-01-29 22:54:08 main:574] : INFO : Epoch 1937 | loss: 0.0311342 | val_loss: 0.03116 | Time: 6278.11 ms [2022-01-29 22:54:14 main:574] : INFO : Epoch 1938 | loss: 0.0311367 | val_loss: 0.0311556 | Time: 6271.41 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-01-29 22:55:15 main:435] : INFO : Set logging level to 1 [2022-01-29 22:55:15 main:441] : INFO : Running in BOINC Client mode [2022-01-29 22:55:15 main:444] : INFO : Resolving all filenames [2022-01-29 22:55:15 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-01-29 22:55:15 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-01-29 22:55:15 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-01-29 22:55:15 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-01-29 22:55:16 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-01-29 22:55:16 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-01-29 22:55:16 main:474] : INFO : Configuration: [2022-01-29 22:55:16 main:475] : INFO : Model type: GRU [2022-01-29 22:55:16 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-01-29 22:55:16 main:477] : INFO : Max Epochs: 2048 [2022-01-29 22:55:16 main:478] : INFO : Batch Size: 128 [2022-01-29 22:55:16 main:479] : INFO : Learning Rate: 0.01 [2022-01-29 22:55:16 main:480] : INFO : Patience: 10 [2022-01-29 22:55:16 main:481] : INFO : Hidden Width: 12 [2022-01-29 22:55:16 main:482] : INFO : # Recurrent Layers: 4 [2022-01-29 22:55:16 main:483] : INFO : # Backend Layers: 4 [2022-01-29 22:55:16 main:484] : INFO : # Threads: 1 [2022-01-29 22:55:16 main:486] : INFO : Preparing Dataset [2022-01-29 22:55:16 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-01-29 22:55:16 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-01-29 22:55:18 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-01-29 22:55:18 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-01-29 22:55:19 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-01-29 22:55:19 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-01-29 22:55:19 main:494] : INFO : Creating Model [2022-01-29 22:55:19 main:507] : INFO : Preparing config file [2022-01-29 22:55:19 main:511] : INFO : Found checkpoint, attempting to load... [2022-01-29 22:55:19 main:512] : INFO : Loading config [2022-01-29 22:55:19 main:514] : INFO : Loading state [2022-01-29 22:55:20 main:559] : INFO : Loading DataLoader into Memory [2022-01-29 22:55:20 main:562] : INFO : Starting Training Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-01-29 22:57:14 main:435] : INFO : Set logging level to 1 [2022-01-29 22:57:14 main:441] : INFO : Running in BOINC Client mode [2022-01-29 22:57:14 main:444] : INFO : Resolving all filenames [2022-01-29 22:57:14 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-01-29 22:57:14 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-01-29 22:57:14 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-01-29 22:57:14 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-01-29 22:57:14 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-01-29 22:57:14 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-01-29 22:57:14 main:474] : INFO : Configuration: [2022-01-29 22:57:14 main:475] : INFO : Model type: GRU [2022-01-29 22:57:14 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-01-29 22:57:14 main:477] : INFO : Max Epochs: 2048 [2022-01-29 22:57:14 main:478] : INFO : Batch Size: 128 [2022-01-29 22:57:14 main:479] : INFO : Learning Rate: 0.01 [2022-01-29 22:57:14 main:480] : INFO : Patience: 10 [2022-01-29 22:57:14 main:481] : INFO : Hidden Width: 12 [2022-01-29 22:57:14 main:482] : INFO : # Recurrent Layers: 4 [2022-01-29 22:57:14 main:483] : INFO : # Backend Layers: 4 [2022-01-29 22:57:14 main:484] : INFO : # Threads: 1 [2022-01-29 22:57:14 main:486] : INFO : Preparing Dataset [2022-01-29 22:57:14 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-01-29 22:57:14 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-01-29 22:57:17 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-01-29 22:57:17 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-01-29 22:57:17 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-01-29 22:57:17 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-01-29 22:57:17 main:494] : INFO : Creating Model [2022-01-29 22:57:17 main:507] : INFO : Preparing config file [2022-01-29 22:57:17 main:511] : INFO : Found checkpoint, attempting to load... [2022-01-29 22:57:17 main:512] : INFO : Loading config [2022-01-29 22:57:17 main:514] : INFO : Loading state [2022-01-29 22:57:18 main:559] : INFO : Loading DataLoader into Memory [2022-01-29 22:57:18 main:562] : INFO : Starting Training [2022-01-29 22:57:25 main:574] : INFO : Epoch 1933 | loss: 0.0311702 | val_loss: 0.0311603 | Time: 6524.02 ms [2022-01-29 22:57:31 main:574] : INFO : Epoch 1934 | loss: 0.0311397 | val_loss: 0.0311618 | Time: 6183.57 ms [2022-01-29 22:57:37 main:574] : INFO : Epoch 1935 | loss: 0.0311358 | val_loss: 0.0311598 | Time: 6250.3 ms [2022-01-29 22:57:44 main:574] : INFO : Epoch 1936 | loss: 0.0311345 | val_loss: 0.0311595 | Time: 6261.96 ms [2022-01-29 22:57:50 main:574] : INFO : Epoch 1937 | loss: 0.0311346 | val_loss: 0.0311581 | Time: 6265.37 ms [2022-01-29 22:57:56 main:574] : INFO : Epoch 1938 | loss: 0.0311366 | val_loss: 0.0311619 | Time: 6291.59 ms [2022-01-29 22:58:02 main:574] : INFO : Epoch 1939 | loss: 0.0311349 | val_loss: 0.031155 | Time: 6284.98 ms [2022-01-29 22:58:09 main:574] : INFO : Epoch 1940 | loss: 0.0311328 | val_loss: 0.0311537 | Time: 6299.65 ms [2022-01-29 22:58:15 main:574] : INFO : Epoch 1941 | loss: 0.031132 | val_loss: 0.0311544 | Time: 6326.02 ms [2022-01-29 22:58:21 main:574] : INFO : Epoch 1942 | loss: 0.0311315 | val_loss: 0.0311534 | Time: 6296.16 ms [2022-01-29 22:58:28 main:574] : INFO : Epoch 1943 | loss: 0.0311346 | val_loss: 0.0311574 | Time: 6291.61 ms [2022-01-29 22:58:34 main:574] : INFO : Epoch 1944 | loss: 0.0311337 | val_loss: 0.0311559 | Time: 6287.16 ms [2022-01-29 22:58:40 main:574] : INFO : Epoch 1945 | loss: 0.0311332 | val_loss: 0.0311556 | Time: 6275.59 ms [2022-01-29 22:58:47 main:574] : INFO : Epoch 1946 | loss: 0.0311361 | val_loss: 0.0311588 | Time: 6270.92 ms [2022-01-29 22:58:53 main:574] : INFO : Epoch 1947 | loss: 0.0311345 | val_loss: 0.0311528 | Time: 6300.59 ms [2022-01-29 22:58:59 main:574] : INFO : Epoch 1948 | loss: 0.0311359 | val_loss: 0.031159 | Time: 6325.14 ms [2022-01-29 22:59:05 main:574] : INFO : Epoch 1949 | loss: 0.0311366 | val_loss: 0.031157 | Time: 6292.56 ms [2022-01-29 22:59:12 main:574] : INFO : Epoch 1950 | loss: 0.0311379 | val_loss: 0.0311584 | Time: 6303.23 ms [2022-01-29 22:59:18 main:574] : INFO : Epoch 1951 | loss: 0.0311402 | val_loss: 0.0311555 | Time: 6295.16 ms [2022-01-29 22:59:24 main:574] : INFO : Epoch 1952 | loss: 0.0311393 | val_loss: 0.0311558 | Time: 6292.46 ms [2022-01-29 22:59:31 main:574] : INFO : Epoch 1953 | loss: 0.0311388 | val_loss: 0.0311524 | Time: 6278.61 ms [2022-01-29 22:59:37 main:574] : INFO : Epoch 1954 | loss: 0.031139 | val_loss: 0.0311613 | Time: 6266.35 ms [2022-01-29 22:59:43 main:574] : INFO : Epoch 1955 | loss: 0.0311427 | val_loss: 0.0311581 | Time: 6298.88 ms [2022-01-29 22:59:50 main:574] : INFO : Epoch 1956 | loss: 0.0311392 | val_loss: 0.0311596 | Time: 6297.41 ms [2022-01-29 22:59:56 main:574] : INFO : Epoch 1957 | loss: 0.0311363 | val_loss: 0.031158 | Time: 6294.74 ms [2022-01-29 23:00:02 main:574] : INFO : Epoch 1958 | loss: 0.0311343 | val_loss: 0.0311542 | Time: 6310 ms [2022-01-29 23:00:08 main:574] : INFO : Epoch 1959 | loss: 0.0311363 | val_loss: 0.0311572 | Time: 6291.43 ms [2022-01-29 23:00:15 main:574] : INFO : Epoch 1960 | loss: 0.0311365 | val_loss: 0.031159 | Time: 6294.06 ms [2022-01-29 23:00:21 main:574] : INFO : Epoch 1961 | loss: 0.0311343 | val_loss: 0.0311559 | Time: 6288.45 ms [2022-01-29 23:00:27 main:574] : INFO : Epoch 1962 | loss: 0.0311378 | val_loss: 0.031158 | Time: 6283.91 ms [2022-01-29 23:00:34 main:574] : INFO : Epoch 1963 | loss: 0.0311385 | val_loss: 0.0311573 | Time: 6299.5 ms [2022-01-29 23:00:40 main:574] : INFO : Epoch 1964 | loss: 0.0311372 | val_loss: 0.0311543 | Time: 6289.95 ms [2022-01-29 23:00:46 main:574] : INFO : Epoch 1965 | loss: 0.0311373 | val_loss: 0.0311576 | Time: 6297.36 ms [2022-01-29 23:00:53 main:574] : INFO : Epoch 1966 | loss: 0.0311348 | val_loss: 0.0311589 | Time: 6311.69 ms [2022-01-29 23:00:59 main:574] : INFO : Epoch 1967 | loss: 0.0311339 | val_loss: 0.0311581 | Time: 6292.39 ms [2022-01-29 23:01:05 main:574] : INFO : Epoch 1968 | loss: 0.0311327 | val_loss: 0.0311588 | Time: 6277.97 ms [2022-01-29 23:01:11 main:574] : INFO : Epoch 1969 | loss: 0.0311337 | val_loss: 0.0311559 | Time: 6275.91 ms [2022-01-29 23:01:18 main:574] : INFO : Epoch 1970 | loss: 0.0311312 | val_loss: 0.0311592 | Time: 6296.31 ms [2022-01-29 23:01:24 main:574] : INFO : Epoch 1971 | loss: 0.0311293 | val_loss: 0.0311552 | Time: 6296.82 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-01-29 23:05:33 main:435] : INFO : Set logging level to 1 [2022-01-29 23:05:33 main:441] : INFO : Running in BOINC Client mode [2022-01-29 23:05:33 main:444] : INFO : Resolving all filenames [2022-01-29 23:05:33 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-01-29 23:05:33 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-01-29 23:05:33 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-01-29 23:05:33 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-01-29 23:05:33 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-01-29 23:05:33 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-01-29 23:05:33 main:474] : INFO : Configuration: [2022-01-29 23:05:33 main:475] : INFO : Model type: GRU [2022-01-29 23:05:33 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-01-29 23:05:33 main:477] : INFO : Max Epochs: 2048 [2022-01-29 23:05:33 main:478] : INFO : Batch Size: 128 [2022-01-29 23:05:33 main:479] : INFO : Learning Rate: 0.01 [2022-01-29 23:05:33 main:480] : INFO : Patience: 10 [2022-01-29 23:05:33 main:481] : INFO : Hidden Width: 12 [2022-01-29 23:05:33 main:482] : INFO : # Recurrent Layers: 4 [2022-01-29 23:05:33 main:483] : INFO : # Backend Layers: 4 [2022-01-29 23:05:34 main:484] : INFO : # Threads: 1 [2022-01-29 23:05:34 main:486] : INFO : Preparing Dataset [2022-01-29 23:05:34 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-01-29 23:05:34 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-01-29 23:05:36 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-01-29 23:05:36 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-01-29 23:05:37 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-01-29 23:05:37 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-01-29 23:05:37 main:494] : INFO : Creating Model [2022-01-29 23:05:37 main:507] : INFO : Preparing config file [2022-01-29 23:05:37 main:511] : INFO : Found checkpoint, attempting to load... [2022-01-29 23:05:37 main:512] : INFO : Loading config [2022-01-29 23:05:37 main:514] : INFO : Loading state [2022-01-29 23:05:38 main:559] : INFO : Loading DataLoader into Memory [2022-01-29 23:05:38 main:562] : INFO : Starting Training [2022-01-29 23:05:44 main:574] : INFO : Epoch 1965 | loss: 0.0311614 | val_loss: 0.0311565 | Time: 6324.88 ms [2022-01-29 23:05:50 main:574] : INFO : Epoch 1966 | loss: 0.0311382 | val_loss: 0.0311582 | Time: 6189.78 ms [2022-01-29 23:05:56 main:574] : INFO : Epoch 1967 | loss: 0.031135 | val_loss: 0.031158 | Time: 6250.68 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-01-29 23:07:03 main:435] : INFO : Set logging level to 1 [2022-01-29 23:07:03 main:441] : INFO : Running in BOINC Client mode [2022-01-29 23:07:03 main:444] : INFO : Resolving all filenames [2022-01-29 23:07:03 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-01-29 23:07:03 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-01-29 23:07:03 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-01-29 23:07:03 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-01-29 23:07:03 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-01-29 23:07:03 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-01-29 23:07:03 main:474] : INFO : Configuration: [2022-01-29 23:07:03 main:475] : INFO : Model type: GRU [2022-01-29 23:07:04 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-01-29 23:07:04 main:477] : INFO : Max Epochs: 2048 [2022-01-29 23:07:04 main:478] : INFO : Batch Size: 128 [2022-01-29 23:07:04 main:479] : INFO : Learning Rate: 0.01 [2022-01-29 23:07:04 main:480] : INFO : Patience: 10 [2022-01-29 23:07:04 main:481] : INFO : Hidden Width: 12 [2022-01-29 23:07:04 main:482] : INFO : # Recurrent Layers: 4 [2022-01-29 23:07:04 main:483] : INFO : # Backend Layers: 4 [2022-01-29 23:07:04 main:484] : INFO : # Threads: 1 [2022-01-29 23:07:04 main:486] : INFO : Preparing Dataset [2022-01-29 23:07:04 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-01-29 23:07:04 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-01-29 23:07:07 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-01-29 23:07:07 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-01-29 23:07:07 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-01-29 23:07:07 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-01-29 23:07:07 main:494] : INFO : Creating Model [2022-01-29 23:07:07 main:507] : INFO : Preparing config file [2022-01-29 23:07:07 main:511] : INFO : Found checkpoint, attempting to load... [2022-01-29 23:07:07 main:512] : INFO : Loading config [2022-01-29 23:07:07 main:514] : INFO : Loading state [2022-01-29 23:07:08 main:559] : INFO : Loading DataLoader into Memory [2022-01-29 23:07:08 main:562] : INFO : Starting Training [2022-01-29 23:07:15 main:574] : INFO : Epoch 1965 | loss: 0.0311619 | val_loss: 0.0311551 | Time: 6364.04 ms [2022-01-29 23:07:21 main:574] : INFO : Epoch 1966 | loss: 0.0311394 | val_loss: 0.031159 | Time: 6192.31 ms [2022-01-29 23:07:27 main:574] : INFO : Epoch 1967 | loss: 0.0311344 | val_loss: 0.0311551 | Time: 6263.23 ms [2022-01-29 23:07:33 main:574] : INFO : Epoch 1968 | loss: 0.0311325 | val_loss: 0.0311586 | Time: 6265.73 ms [2022-01-29 23:07:40 main:574] : INFO : Epoch 1969 | loss: 0.0311314 | val_loss: 0.0311563 | Time: 6275.98 ms [2022-01-29 23:07:46 main:574] : INFO : Epoch 1970 | loss: 0.0311305 | val_loss: 0.0311608 | Time: 6296.49 ms [2022-01-29 23:07:52 main:574] : INFO : Epoch 1971 | loss: 0.0311308 | val_loss: 0.0311587 | Time: 6292.04 ms [2022-01-29 23:07:58 main:574] : INFO : Epoch 1972 | loss: 0.0311308 | val_loss: 0.0311574 | Time: 6289.06 ms [2022-01-29 23:08:05 main:574] : INFO : Epoch 1973 | loss: 0.0311303 | val_loss: 0.0311606 | Time: 6333.66 ms [2022-01-29 23:08:11 main:574] : INFO : Epoch 1974 | loss: 0.0311305 | val_loss: 0.0311559 | Time: 6282.78 ms [2022-01-29 23:08:17 main:574] : INFO : Epoch 1975 | loss: 0.0311285 | val_loss: 0.03116 | Time: 6268.28 ms [2022-01-29 23:08:24 main:574] : INFO : Epoch 1976 | loss: 0.0311313 | val_loss: 0.0311573 | Time: 6303.57 ms [2022-01-29 23:08:30 main:574] : INFO : Epoch 1977 | loss: 0.0311323 | val_loss: 0.0311575 | Time: 6305.82 ms [2022-01-29 23:08:36 main:574] : INFO : Epoch 1978 | loss: 0.0311358 | val_loss: 0.031162 | Time: 6314.47 ms [2022-01-29 23:08:43 main:574] : INFO : Epoch 1979 | loss: 0.0311369 | val_loss: 0.0311564 | Time: 6290.09 ms [2022-01-29 23:08:49 main:574] : INFO : Epoch 1980 | loss: 0.0311342 | val_loss: 0.0311595 | Time: 6288.15 ms [2022-01-29 23:08:55 main:574] : INFO : Epoch 1981 | loss: 0.0311337 | val_loss: 0.0311561 | Time: 6297.7 ms [2022-01-29 23:09:01 main:574] : INFO : Epoch 1982 | loss: 0.0311329 | val_loss: 0.0311538 | Time: 6281.76 ms [2022-01-29 23:09:08 main:574] : INFO : Epoch 1983 | loss: 0.0311322 | val_loss: 0.0311545 | Time: 6268.45 ms [2022-01-29 23:09:14 main:574] : INFO : Epoch 1984 | loss: 0.0311324 | val_loss: 0.0311554 | Time: 6285.42 ms [2022-01-29 23:09:20 main:574] : INFO : Epoch 1985 | loss: 0.0311406 | val_loss: 0.0311554 | Time: 6262.89 ms [2022-01-29 23:09:27 main:574] : INFO : Epoch 1986 | loss: 0.0311403 | val_loss: 0.0311571 | Time: 6291.22 ms [2022-01-29 23:09:33 main:574] : INFO : Epoch 1987 | loss: 0.0311382 | val_loss: 0.0311572 | Time: 6344.86 ms [2022-01-29 23:09:39 main:574] : INFO : Epoch 1988 | loss: 0.0311355 | val_loss: 0.0311555 | Time: 6333.6 ms [2022-01-29 23:09:46 main:574] : INFO : Epoch 1989 | loss: 0.0311334 | val_loss: 0.0311521 | Time: 6294.11 ms [2022-01-29 23:09:52 main:574] : INFO : Epoch 1990 | loss: 0.0311329 | val_loss: 0.0311574 | Time: 6289.12 ms [2022-01-29 23:09:58 main:574] : INFO : Epoch 1991 | loss: 0.0311355 | val_loss: 0.0311521 | Time: 6271.56 ms [2022-01-29 23:10:04 main:574] : INFO : Epoch 1992 | loss: 0.0311336 | val_loss: 0.031154 | Time: 6270.92 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-01-29 23:11:29 main:435] : INFO : Set logging level to 1 [2022-01-29 23:11:29 main:441] : INFO : Running in BOINC Client mode [2022-01-29 23:11:29 main:444] : INFO : Resolving all filenames [2022-01-29 23:11:29 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-01-29 23:11:29 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-01-29 23:11:29 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-01-29 23:11:29 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-01-29 23:11:29 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-01-29 23:11:29 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-01-29 23:11:29 main:474] : INFO : Configuration: [2022-01-29 23:11:29 main:475] : INFO : Model type: GRU [2022-01-29 23:11:29 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-01-29 23:11:29 main:477] : INFO : Max Epochs: 2048 [2022-01-29 23:11:29 main:478] : INFO : Batch Size: 128 [2022-01-29 23:11:29 main:479] : INFO : Learning Rate: 0.01 [2022-01-29 23:11:29 main:480] : INFO : Patience: 10 [2022-01-29 23:11:29 main:481] : INFO : Hidden Width: 12 [2022-01-29 23:11:29 main:482] : INFO : # Recurrent Layers: 4 [2022-01-29 23:11:29 main:483] : INFO : # Backend Layers: 4 [2022-01-29 23:11:29 main:484] : INFO : # Threads: 1 [2022-01-29 23:11:29 main:486] : INFO : Preparing Dataset [2022-01-29 23:11:29 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-01-29 23:11:29 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-01-29 23:11:31 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-01-29 23:11:32 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-01-29 23:11:32 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-01-29 23:11:32 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-01-29 23:11:32 main:494] : INFO : Creating Model [2022-01-29 23:11:32 main:507] : INFO : Preparing config file [2022-01-29 23:11:32 main:511] : INFO : Found checkpoint, attempting to load... [2022-01-29 23:11:32 main:512] : INFO : Loading config [2022-01-29 23:11:32 main:514] : INFO : Loading state [2022-01-29 23:11:33 main:559] : INFO : Loading DataLoader into Memory [2022-01-29 23:11:33 main:562] : INFO : Starting Training [2022-01-29 23:11:39 main:574] : INFO : Epoch 1986 | loss: 0.031182 | val_loss: 0.031161 | Time: 6385.62 ms [2022-01-29 23:11:45 main:574] : INFO : Epoch 1987 | loss: 0.0311405 | val_loss: 0.031162 | Time: 6184.46 ms [2022-01-29 23:11:52 main:574] : INFO : Epoch 1988 | loss: 0.0311361 | val_loss: 0.0311536 | Time: 6269.58 ms [2022-01-29 23:11:58 main:574] : INFO : Epoch 1989 | loss: 0.0311366 | val_loss: 0.0311574 | Time: 6264.06 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-01-29 23:12:59 main:435] : INFO : Set logging level to 1 [2022-01-29 23:12:59 main:441] : INFO : Running in BOINC Client mode [2022-01-29 23:12:59 main:444] : INFO : Resolving all filenames [2022-01-29 23:12:59 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-01-29 23:12:59 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-01-29 23:12:59 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-01-29 23:12:59 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-01-29 23:12:59 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-01-29 23:12:59 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-01-29 23:12:59 main:474] : INFO : Configuration: [2022-01-29 23:12:59 main:475] : INFO : Model type: GRU [2022-01-29 23:12:59 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-01-29 23:12:59 main:477] : INFO : Max Epochs: 2048 [2022-01-29 23:12:59 main:478] : INFO : Batch Size: 128 [2022-01-29 23:12:59 main:479] : INFO : Learning Rate: 0.01 [2022-01-29 23:12:59 main:480] : INFO : Patience: 10 [2022-01-29 23:12:59 main:481] : INFO : Hidden Width: 12 [2022-01-29 23:12:59 main:482] : INFO : # Recurrent Layers: 4 [2022-01-29 23:12:59 main:483] : INFO : # Backend Layers: 4 [2022-01-29 23:12:59 main:484] : INFO : # Threads: 1 [2022-01-29 23:12:59 main:486] : INFO : Preparing Dataset [2022-01-29 23:12:59 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-01-29 23:13:00 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-01-29 23:13:02 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-01-29 23:13:02 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-01-29 23:13:03 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-01-29 23:13:03 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-01-29 23:13:03 main:494] : INFO : Creating Model [2022-01-29 23:13:03 main:507] : INFO : Preparing config file [2022-01-29 23:13:03 main:511] : INFO : Found checkpoint, attempting to load... [2022-01-29 23:13:03 main:512] : INFO : Loading config [2022-01-29 23:13:03 main:514] : INFO : Loading state [2022-01-29 23:13:04 main:559] : INFO : Loading DataLoader into Memory [2022-01-29 23:13:04 main:562] : INFO : Starting Training [2022-01-29 23:13:10 main:574] : INFO : Epoch 1986 | loss: 0.0311755 | val_loss: 0.0311622 | Time: 6354.3 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-01-29 23:14:25 main:435] : INFO : Set logging level to 1 [2022-01-29 23:14:25 main:441] : INFO : Running in BOINC Client mode [2022-01-29 23:14:25 main:444] : INFO : Resolving all filenames [2022-01-29 23:14:25 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-01-29 23:14:25 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-01-29 23:14:25 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-01-29 23:14:25 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-01-29 23:14:25 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-01-29 23:14:25 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-01-29 23:14:25 main:474] : INFO : Configuration: [2022-01-29 23:14:25 main:475] : INFO : Model type: GRU [2022-01-29 23:14:25 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-01-29 23:14:25 main:477] : INFO : Max Epochs: 2048 [2022-01-29 23:14:25 main:478] : INFO : Batch Size: 128 [2022-01-29 23:14:25 main:479] : INFO : Learning Rate: 0.01 [2022-01-29 23:14:25 main:480] : INFO : Patience: 10 [2022-01-29 23:14:25 main:481] : INFO : Hidden Width: 12 [2022-01-29 23:14:25 main:482] : INFO : # Recurrent Layers: 4 [2022-01-29 23:14:25 main:483] : INFO : # Backend Layers: 4 [2022-01-29 23:14:25 main:484] : INFO : # Threads: 1 [2022-01-29 23:14:25 main:486] : INFO : Preparing Dataset [2022-01-29 23:14:25 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-01-29 23:14:26 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-01-29 23:14:28 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-01-29 23:14:28 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-01-29 23:14:28 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-01-29 23:14:28 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-01-29 23:14:28 main:494] : INFO : Creating Model [2022-01-29 23:14:28 main:507] : INFO : Preparing config file [2022-01-29 23:14:28 main:511] : INFO : Found checkpoint, attempting to load... [2022-01-29 23:14:28 main:512] : INFO : Loading config [2022-01-29 23:14:28 main:514] : INFO : Loading state [2022-01-29 23:14:29 main:559] : INFO : Loading DataLoader into Memory [2022-01-29 23:14:29 main:562] : INFO : Starting Training [2022-01-29 23:14:36 main:574] : INFO : Epoch 1986 | loss: 0.0311779 | val_loss: 0.0311619 | Time: 6536.08 ms [2022-01-29 23:14:42 main:574] : INFO : Epoch 1987 | loss: 0.0311405 | val_loss: 0.0311557 | Time: 6261.26 ms [2022-01-29 23:14:48 main:574] : INFO : Epoch 1988 | loss: 0.0311343 | val_loss: 0.0311553 | Time: 6272.08 ms [2022-01-29 23:14:54 main:574] : INFO : Epoch 1989 | loss: 0.0311307 | val_loss: 0.0311528 | Time: 6260.88 ms [2022-01-29 23:15:01 main:574] : INFO : Epoch 1990 | loss: 0.0311311 | val_loss: 0.0311514 | Time: 6255.13 ms [2022-01-29 23:15:07 main:574] : INFO : Epoch 1991 | loss: 0.0311302 | val_loss: 0.0311524 | Time: 6247.58 ms [2022-01-29 23:15:13 main:574] : INFO : Epoch 1992 | loss: 0.0311322 | val_loss: 0.0311511 | Time: 6248.94 ms [2022-01-29 23:15:19 main:574] : INFO : Epoch 1993 | loss: 0.0311299 | val_loss: 0.0311549 | Time: 6267.59 ms [2022-01-29 23:15:26 main:574] : INFO : Epoch 1994 | loss: 0.0311367 | val_loss: 0.0311533 | Time: 6276.73 ms [2022-01-29 23:15:32 main:574] : INFO : Epoch 1995 | loss: 0.0311386 | val_loss: 0.0311567 | Time: 6258.1 ms [2022-01-29 23:15:38 main:574] : INFO : Epoch 1996 | loss: 0.0311356 | val_loss: 0.0311564 | Time: 6280.32 ms [2022-01-29 23:15:45 main:574] : INFO : Epoch 1997 | loss: 0.0311362 | val_loss: 0.031158 | Time: 6278.75 ms [2022-01-29 23:15:51 main:574] : INFO : Epoch 1998 | loss: 0.031143 | val_loss: 0.0311556 | Time: 6294.23 ms [2022-01-29 23:15:57 main:574] : INFO : Epoch 1999 | loss: 0.0311389 | val_loss: 0.0311588 | Time: 6279.63 ms [2022-01-29 23:16:03 main:574] : INFO : Epoch 2000 | loss: 0.0311373 | val_loss: 0.0311542 | Time: 6261.06 ms [2022-01-29 23:16:10 main:574] : INFO : Epoch 2001 | loss: 0.0311358 | val_loss: 0.0311526 | Time: 6247.46 ms [2022-01-29 23:16:16 main:574] : INFO : Epoch 2002 | loss: 0.031134 | val_loss: 0.0311542 | Time: 6274.99 ms [2022-01-29 23:16:22 main:574] : INFO : Epoch 2003 | loss: 0.0311348 | val_loss: 0.0311536 | Time: 6277.52 ms [2022-01-29 23:16:29 main:574] : INFO : Epoch 2004 | loss: 0.0311346 | val_loss: 0.0311537 | Time: 6264.67 ms [2022-01-29 23:16:35 main:574] : INFO : Epoch 2005 | loss: 0.031134 | val_loss: 0.0311546 | Time: 6282.04 ms [2022-01-29 23:16:41 main:574] : INFO : Epoch 2006 | loss: 0.0311333 | val_loss: 0.0311529 | Time: 6275.4 ms [2022-01-29 23:16:47 main:574] : INFO : Epoch 2007 | loss: 0.0311318 | val_loss: 0.0311545 | Time: 6308.29 ms [2022-01-29 23:16:54 main:574] : INFO : Epoch 2008 | loss: 0.031131 | val_loss: 0.0311549 | Time: 6253.46 ms [2022-01-29 23:17:00 main:574] : INFO : Epoch 2009 | loss: 0.031132 | val_loss: 0.0311574 | Time: 6282.89 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-01-29 23:19:27 main:435] : INFO : Set logging level to 1 [2022-01-29 23:19:27 main:441] : INFO : Running in BOINC Client mode [2022-01-29 23:19:27 main:444] : INFO : Resolving all filenames [2022-01-29 23:19:27 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-01-29 23:19:27 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-01-29 23:19:27 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-01-29 23:19:27 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-01-29 23:19:27 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-01-29 23:19:27 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-01-29 23:19:27 main:474] : INFO : Configuration: [2022-01-29 23:19:27 main:475] : INFO : Model type: GRU [2022-01-29 23:19:27 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-01-29 23:19:27 main:477] : INFO : Max Epochs: 2048 [2022-01-29 23:19:27 main:478] : INFO : Batch Size: 128 [2022-01-29 23:19:27 main:479] : INFO : Learning Rate: 0.01 [2022-01-29 23:19:27 main:480] : INFO : Patience: 10 [2022-01-29 23:19:27 main:481] : INFO : Hidden Width: 12 [2022-01-29 23:19:27 main:482] : INFO : # Recurrent Layers: 4 [2022-01-29 23:19:27 main:483] : INFO : # Backend Layers: 4 [2022-01-29 23:19:27 main:484] : INFO : # Threads: 1 [2022-01-29 23:19:27 main:486] : INFO : Preparing Dataset [2022-01-29 23:19:27 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-01-29 23:19:28 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-01-29 23:19:31 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-01-29 23:19:31 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-01-29 23:19:31 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-01-29 23:19:31 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-01-29 23:19:31 main:494] : INFO : Creating Model [2022-01-29 23:19:31 main:507] : INFO : Preparing config file [2022-01-29 23:19:31 main:511] : INFO : Found checkpoint, attempting to load... [2022-01-29 23:19:31 main:512] : INFO : Loading config [2022-01-29 23:19:31 main:514] : INFO : Loading state [2022-01-29 23:19:32 main:559] : INFO : Loading DataLoader into Memory [2022-01-29 23:19:32 main:562] : INFO : Starting Training [2022-01-29 23:19:38 main:574] : INFO : Epoch 2007 | loss: 0.0311699 | val_loss: 0.0311547 | Time: 6463.94 ms [2022-01-29 23:19:44 main:574] : INFO : Epoch 2008 | loss: 0.031137 | val_loss: 0.0311556 | Time: 6224.68 ms [2022-01-29 23:19:51 main:574] : INFO : Epoch 2009 | loss: 0.0311342 | val_loss: 0.0311544 | Time: 6263.76 ms [2022-01-29 23:19:57 main:574] : INFO : Epoch 2010 | loss: 0.0311344 | val_loss: 0.0311543 | Time: 6283.81 ms [2022-01-29 23:20:03 main:574] : INFO : Epoch 2011 | loss: 0.0311357 | val_loss: 0.0311522 | Time: 6297.33 ms [2022-01-29 23:20:10 main:574] : INFO : Epoch 2012 | loss: 0.0311353 | val_loss: 0.0311559 | Time: 6311.45 ms [2022-01-29 23:20:16 main:574] : INFO : Epoch 2013 | loss: 0.031136 | val_loss: 0.0311545 | Time: 6284.86 ms [2022-01-29 23:20:22 main:574] : INFO : Epoch 2014 | loss: 0.0311375 | val_loss: 0.0311551 | Time: 6277.63 ms [2022-01-29 23:20:28 main:574] : INFO : Epoch 2015 | loss: 0.0311427 | val_loss: 0.031158 | Time: 6287.79 ms [2022-01-29 23:20:35 main:574] : INFO : Epoch 2016 | loss: 0.0311382 | val_loss: 0.0311528 | Time: 6297.24 ms [2022-01-29 23:20:41 main:574] : INFO : Epoch 2017 | loss: 0.0311339 | val_loss: 0.0311513 | Time: 6295.49 ms [2022-01-29 23:20:48 main:574] : INFO : Epoch 2018 | loss: 0.0311328 | val_loss: 0.0311523 | Time: 6546.6 ms [2022-01-29 23:20:54 main:574] : INFO : Epoch 2019 | loss: 0.0311312 | val_loss: 0.0311504 | Time: 6324.94 ms [2022-01-29 23:21:00 main:574] : INFO : Epoch 2020 | loss: 0.0311301 | val_loss: 0.0311528 | Time: 6289.85 ms [2022-01-29 23:21:07 main:574] : INFO : Epoch 2021 | loss: 0.0311302 | val_loss: 0.0311493 | Time: 6278.18 ms [2022-01-29 23:21:13 main:574] : INFO : Epoch 2022 | loss: 0.0311318 | val_loss: 0.0311529 | Time: 6277.42 ms [2022-01-29 23:21:19 main:574] : INFO : Epoch 2023 | loss: 0.0311292 | val_loss: 0.0311526 | Time: 6285.85 ms [2022-01-29 23:21:25 main:574] : INFO : Epoch 2024 | loss: 0.031129 | val_loss: 0.0311537 | Time: 6290.24 ms [2022-01-29 23:21:32 main:574] : INFO : Epoch 2025 | loss: 0.0311299 | val_loss: 0.0311523 | Time: 6286.85 ms [2022-01-29 23:21:38 main:574] : INFO : Epoch 2026 | loss: 0.0311369 | val_loss: 0.0311564 | Time: 6322.67 ms [2022-01-29 23:21:44 main:574] : INFO : Epoch 2027 | loss: 0.0311362 | val_loss: 0.0311513 | Time: 6319.07 ms [2022-01-29 23:21:51 main:574] : INFO : Epoch 2028 | loss: 0.0311341 | val_loss: 0.0311499 | Time: 6277.62 ms [2022-01-29 23:21:57 main:574] : INFO : Epoch 2029 | loss: 0.0311331 | val_loss: 0.0311506 | Time: 6309.06 ms [2022-01-29 23:22:03 main:574] : INFO : Epoch 2030 | loss: 0.0311355 | val_loss: 0.0311516 | Time: 6286.88 ms [2022-01-29 23:22:10 main:574] : INFO : Epoch 2031 | loss: 0.031138 | val_loss: 0.0311548 | Time: 6298.42 ms [2022-01-29 23:22:16 main:574] : INFO : Epoch 2032 | loss: 0.0311361 | val_loss: 0.0311516 | Time: 6318.99 ms [2022-01-29 23:22:22 main:574] : INFO : Epoch 2033 | loss: 0.0311334 | val_loss: 0.0311512 | Time: 6306.81 ms [2022-01-29 23:22:28 main:574] : INFO : Epoch 2034 | loss: 0.0311324 | val_loss: 0.0311508 | Time: 6301.62 ms [2022-01-29 23:22:35 main:574] : INFO : Epoch 2035 | loss: 0.031131 | val_loss: 0.0311488 | Time: 6291.1 ms [2022-01-29 23:22:41 main:574] : INFO : Epoch 2036 | loss: 0.0311316 | val_loss: 0.0311512 | Time: 6267.18 ms [2022-01-29 23:22:47 main:574] : INFO : Epoch 2037 | loss: 0.0311306 | val_loss: 0.03115 | Time: 6262.4 ms [2022-01-29 23:22:54 main:574] : INFO : Epoch 2038 | loss: 0.0311302 | val_loss: 0.0311477 | Time: 6270.43 ms [2022-01-29 23:23:00 main:574] : INFO : Epoch 2039 | loss: 0.0311292 | val_loss: 0.0311489 | Time: 6272.73 ms [2022-01-29 23:23:06 main:574] : INFO : Epoch 2040 | loss: 0.031131 | val_loss: 0.0311493 | Time: 6293.05 ms [2022-01-29 23:23:12 main:574] : INFO : Epoch 2041 | loss: 0.0311299 | val_loss: 0.0311477 | Time: 6311.72 ms [2022-01-29 23:23:19 main:574] : INFO : Epoch 2042 | loss: 0.0311285 | val_loss: 0.0311472 | Time: 6295.23 ms [2022-01-29 23:23:25 main:574] : INFO : Epoch 2043 | loss: 0.0311284 | val_loss: 0.0311483 | Time: 6284.65 ms [2022-01-29 23:23:31 main:574] : INFO : Epoch 2044 | loss: 0.031128 | val_loss: 0.0311464 | Time: 6308.57 ms [2022-01-29 23:23:38 main:574] : INFO : Epoch 2045 | loss: 0.0311288 | val_loss: 0.0311466 | Time: 6276.15 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-01-29 23:24:41 main:435] : INFO : Set logging level to 1 [2022-01-29 23:24:41 main:441] : INFO : Running in BOINC Client mode [2022-01-29 23:24:41 main:444] : INFO : Resolving all filenames [2022-01-29 23:24:41 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-01-29 23:24:41 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-01-29 23:24:41 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-01-29 23:24:41 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-01-29 23:24:41 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-01-29 23:24:42 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-01-29 23:24:42 main:474] : INFO : Configuration: [2022-01-29 23:24:42 main:475] : INFO : Model type: GRU [2022-01-29 23:24:42 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-01-29 23:24:42 main:477] : INFO : Max Epochs: 2048 [2022-01-29 23:24:42 main:478] : INFO : Batch Size: 128 [2022-01-29 23:24:42 main:479] : INFO : Learning Rate: 0.01 [2022-01-29 23:24:42 main:480] : INFO : Patience: 10 [2022-01-29 23:24:42 main:481] : INFO : Hidden Width: 12 [2022-01-29 23:24:42 main:482] : INFO : # Recurrent Layers: 4 [2022-01-29 23:24:42 main:483] : INFO : # Backend Layers: 4 [2022-01-29 23:24:42 main:484] : INFO : # Threads: 1 [2022-01-29 23:24:42 main:486] : INFO : Preparing Dataset [2022-01-29 23:24:42 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-01-29 23:24:42 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-01-29 23:24:45 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-01-29 23:24:45 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-01-29 23:24:45 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-01-29 23:24:45 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-01-29 23:24:45 main:494] : INFO : Creating Model [2022-01-29 23:24:45 main:507] : INFO : Preparing config file [2022-01-29 23:24:45 main:511] : INFO : Found checkpoint, attempting to load... [2022-01-29 23:24:45 main:512] : INFO : Loading config [2022-01-29 23:24:45 main:514] : INFO : Loading state [2022-01-29 23:24:46 main:559] : INFO : Loading DataLoader into Memory [2022-01-29 23:24:46 main:562] : INFO : Starting Training [2022-01-29 23:24:52 main:574] : INFO : Epoch 2039 | loss: 0.0311651 | val_loss: 0.0311525 | Time: 6349.96 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-01-29 23:26:50 main:435] : INFO : Set logging level to 1 [2022-01-29 23:26:50 main:441] : INFO : Running in BOINC Client mode [2022-01-29 23:26:50 main:444] : INFO : Resolving all filenames [2022-01-29 23:26:50 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-01-29 23:26:50 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-01-29 23:26:50 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-01-29 23:26:50 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-01-29 23:26:50 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-01-29 23:26:50 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-01-29 23:26:50 main:474] : INFO : Configuration: [2022-01-29 23:26:50 main:475] : INFO : Model type: GRU [2022-01-29 23:26:50 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-01-29 23:26:50 main:477] : INFO : Max Epochs: 2048 [2022-01-29 23:26:50 main:478] : INFO : Batch Size: 128 [2022-01-29 23:26:50 main:479] : INFO : Learning Rate: 0.01 [2022-01-29 23:26:50 main:480] : INFO : Patience: 10 [2022-01-29 23:26:50 main:481] : INFO : Hidden Width: 12 [2022-01-29 23:26:50 main:482] : INFO : # Recurrent Layers: 4 [2022-01-29 23:26:50 main:483] : INFO : # Backend Layers: 4 [2022-01-29 23:26:50 main:484] : INFO : # Threads: 1 [2022-01-29 23:26:50 main:486] : INFO : Preparing Dataset [2022-01-29 23:26:50 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-01-29 23:26:50 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-01-29 23:26:53 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-01-29 23:26:53 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-01-29 23:26:53 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-01-29 23:26:53 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-01-29 23:26:53 main:494] : INFO : Creating Model [2022-01-29 23:26:53 main:507] : INFO : Preparing config file [2022-01-29 23:26:53 main:511] : INFO : Found checkpoint, attempting to load... [2022-01-29 23:26:53 main:512] : INFO : Loading config [2022-01-29 23:26:53 main:514] : INFO : Loading state [2022-01-29 23:26:54 main:559] : INFO : Loading DataLoader into Memory [2022-01-29 23:26:54 main:562] : INFO : Starting Training [2022-01-29 23:27:01 main:574] : INFO : Epoch 2039 | loss: 0.0311626 | val_loss: 0.0311541 | Time: 6550.05 ms [2022-01-29 23:27:07 main:574] : INFO : Epoch 2040 | loss: 0.0311324 | val_loss: 0.031152 | Time: 6185.64 ms [2022-01-29 23:27:13 main:574] : INFO : Epoch 2041 | loss: 0.0311291 | val_loss: 0.0311501 | Time: 6251.36 ms [2022-01-29 23:27:19 main:574] : INFO : Epoch 2042 | loss: 0.03113 | val_loss: 0.0311468 | Time: 6250.38 ms [2022-01-29 23:27:26 main:574] : INFO : Epoch 2043 | loss: 0.0311292 | val_loss: 0.0311504 | Time: 6277.14 ms [2022-01-29 23:27:32 main:574] : INFO : Epoch 2044 | loss: 0.0311289 | val_loss: 0.0311485 | Time: 6259.45 ms [2022-01-29 23:27:38 main:574] : INFO : Epoch 2045 | loss: 0.0311274 | val_loss: 0.031152 | Time: 6294.15 ms [2022-01-29 23:27:45 main:574] : INFO : Epoch 2046 | loss: 0.0311297 | val_loss: 0.0311532 | Time: 6302.26 ms [2022-01-29 23:27:51 main:574] : INFO : Epoch 2047 | loss: 0.0311289 | val_loss: 0.0311504 | Time: 6287.42 ms [2022-01-29 23:27:57 main:574] : INFO : Epoch 2048 | loss: 0.0311277 | val_loss: 0.0311502 | Time: 6289.81 ms [2022-01-29 23:27:57 main:597] : INFO : Saving trained model to model-final.pt, val_loss 0.0311502 [2022-01-29 23:27:57 main:603] : INFO : Saving end state to config to file [2022-01-29 23:27:57 main:608] : INFO : Success, exiting.. 23:27:57 (12804): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)