Task 12831805
| Name | ParityModified-1645995939-30109-2-0_0 |
| Workunit | 9976070 |
| Created | 9 Mar 2022, 16:16:00 UTC |
| Sent | 10 Mar 2022, 5:41:41 UTC |
| Report deadline | 18 Mar 2022, 5:41:41 UTC |
| Received | 14 Apr 2022, 7:41:52 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 17440 |
| Run time | 6 hours 43 min 33 sec |
| CPU time | 6 hours 19 min 15 sec |
| Validate state | Task was reported too late to validate |
| Credit | 0.00 |
| Device peak FLOPS | 2,491.95 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.62 GB |
| Peak swap size | 3.59 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version> <![CDATA[ <stderr_txt> 1922 | loss: 0.0310949 | val_loss: 0.0311512 | Time: 3400.29 ms [2022-04-11 01:02:49 main:574] : INFO : Epoch 1923 | loss: 0.0310917 | val_loss: 0.0311532 | Time: 5809.14 ms [2022-04-11 01:02:56 main:574] : INFO : Epoch 1924 | loss: 0.0310878 | val_loss: 0.0311463 | Time: 7045.06 ms [2022-04-11 01:03:03 main:574] : INFO : Epoch 1925 | loss: 0.03109 | val_loss: 0.0311398 | Time: 6769.18 ms [2022-04-11 01:03:10 main:574] : INFO : Epoch 1926 | loss: 0.0310976 | val_loss: 0.0311391 | Time: 6838 ms [2022-04-11 01:03:16 main:574] : INFO : Epoch 1927 | loss: 0.0310956 | val_loss: 0.0311433 | Time: 6579.57 ms [2022-04-11 01:03:22 main:574] : INFO : Epoch 1928 | loss: 0.031095 | val_loss: 0.0311454 | Time: 6340.24 ms [2022-04-11 01:03:29 main:574] : INFO : Epoch 1929 | loss: 0.0310948 | val_loss: 0.0311502 | Time: 6854.56 ms [2022-04-11 01:03:38 main:574] : INFO : Epoch 1930 | loss: 0.0310911 | val_loss: 0.0311462 | Time: 8241.56 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050 Ti) [2022-04-11 01:14:03 main:435] : INFO : Set logging level to 1 [2022-04-11 01:14:03 main:441] : INFO : Running in BOINC Client mode [2022-04-11 01:14:03 main:444] : INFO : Resolving all filenames [2022-04-11 01:14:03 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-11 01:14:03 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-11 01:14:03 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-11 01:14:03 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-11 01:14:03 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-11 01:14:03 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-11 01:14:03 main:474] : INFO : Configuration: [2022-04-11 01:14:03 main:475] : INFO : Model type: GRU [2022-04-11 01:14:03 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-11 01:14:03 main:477] : INFO : Max Epochs: 2048 [2022-04-11 01:14:03 main:478] : INFO : Batch Size: 128 [2022-04-11 01:14:03 main:479] : INFO : Learning Rate: 0.01 [2022-04-11 01:14:03 main:480] : INFO : Patience: 10 [2022-04-11 01:14:03 main:481] : INFO : Hidden Width: 12 [2022-04-11 01:14:03 main:482] : INFO : # Recurrent Layers: 4 [2022-04-11 01:14:03 main:483] : INFO : # Backend Layers: 4 [2022-04-11 01:14:03 main:484] : INFO : # Threads: 1 [2022-04-11 01:14:03 main:486] : INFO : Preparing Dataset [2022-04-11 01:14:03 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-11 01:14:03 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-11 01:14:05 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-11 01:14:05 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-11 01:14:05 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-11 01:14:05 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-11 01:14:05 main:494] : INFO : Creating Model [2022-04-11 01:14:05 main:507] : INFO : Preparing config file [2022-04-11 01:14:05 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-11 01:14:05 main:512] : INFO : Loading config [2022-04-11 01:14:05 main:514] : INFO : Loading state [2022-04-11 01:14:05 main:559] : INFO : Loading DataLoader into Memory [2022-04-11 01:14:05 main:562] : INFO : Starting Training [2022-04-11 01:14:09 main:574] : INFO : Epoch 1921 | loss: 0.0311286 | val_loss: 0.0311507 | Time: 3878.82 ms [2022-04-11 01:14:13 main:574] : INFO : Epoch 1922 | loss: 0.0311022 | val_loss: 0.031146 | Time: 3294.6 ms [2022-04-11 01:14:19 main:574] : INFO : Epoch 1923 | loss: 0.0310961 | val_loss: 0.031142 | Time: 6275.56 ms [2022-04-11 01:14:26 main:574] : INFO : Epoch 1924 | loss: 0.0310943 | val_loss: 0.0311449 | Time: 6750.7 ms [2022-04-11 01:14:32 main:574] : INFO : Epoch 1925 | loss: 0.0310933 | val_loss: 0.0311494 | Time: 6823.3 ms [2022-04-11 01:14:38 main:574] : INFO : Epoch 1926 | loss: 0.0310923 | val_loss: 0.0311479 | Time: 5971.12 ms [2022-04-11 01:14:44 main:574] : INFO : Epoch 1927 | loss: 0.0310916 | val_loss: 0.0311477 | Time: 6042.77 ms [2022-04-11 01:14:51 main:574] : INFO : Epoch 1928 | loss: 0.0310889 | val_loss: 0.0311511 | Time: 6709.87 ms [2022-04-11 01:14:58 main:574] : INFO : Epoch 1929 | loss: 0.0310899 | val_loss: 0.0311564 | Time: 6909.86 ms [2022-04-11 01:15:05 main:574] : INFO : Epoch 1930 | loss: 0.031089 | val_loss: 0.0311507 | Time: 7191.84 ms [2022-04-11 01:15:13 main:574] : INFO : Epoch 1931 | loss: 0.0310877 | val_loss: 0.0311457 | Time: 7413.79 ms [2022-04-11 01:15:20 main:574] : INFO : Epoch 1932 | loss: 0.0310864 | val_loss: 0.0311457 | Time: 6920.76 ms [2022-04-11 01:15:26 main:574] : INFO : Epoch 1933 | loss: 0.0310878 | val_loss: 0.0311552 | Time: 6624.97 ms [2022-04-11 01:15:33 main:574] : INFO : Epoch 1934 | loss: 0.0310867 | val_loss: 0.0311477 | Time: 7182.19 ms [2022-04-11 01:15:41 main:574] : INFO : Epoch 1935 | loss: 0.031088 | val_loss: 0.0311501 | Time: 7516.79 ms [2022-04-11 01:15:49 main:574] : INFO : Epoch 1936 | loss: 0.0310912 | val_loss: 0.0311411 | Time: 7664.9 ms [2022-04-11 01:15:57 main:574] : INFO : Epoch 1937 | loss: 0.0310899 | val_loss: 0.031154 | Time: 8335.61 ms [2022-04-11 01:16:07 main:574] : INFO : Epoch 1938 | loss: 0.0310966 | val_loss: 0.0311531 | Time: 9832.89 ms [2022-04-11 01:16:20 main:574] : INFO : Epoch 1939 | loss: 0.0310963 | val_loss: 0.031143 | Time: 13107.8 ms [2022-04-11 01:16:31 main:574] : INFO : Epoch 1940 | loss: 0.0310965 | val_loss: 0.031151 | Time: 10702.4 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050 Ti) [2022-04-12 00:55:52 main:435] : INFO : Set logging level to 1 [2022-04-12 00:55:52 main:441] : INFO : Running in BOINC Client mode [2022-04-12 00:55:52 main:444] : INFO : Resolving all filenames [2022-04-12 00:55:52 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-12 00:55:52 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-12 00:55:52 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-12 00:55:52 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-12 00:55:52 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-12 00:55:52 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-12 00:55:52 main:474] : INFO : Configuration: [2022-04-12 00:55:52 main:475] : INFO : Model type: GRU [2022-04-12 00:55:52 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-12 00:55:52 main:477] : INFO : Max Epochs: 2048 [2022-04-12 00:55:52 main:478] : INFO : Batch Size: 128 [2022-04-12 00:55:52 main:479] : INFO : Learning Rate: 0.01 [2022-04-12 00:55:52 main:480] : INFO : Patience: 10 [2022-04-12 00:55:52 main:481] : INFO : Hidden Width: 12 [2022-04-12 00:55:52 main:482] : INFO : # Recurrent Layers: 4 [2022-04-12 00:55:52 main:483] : INFO : # Backend Layers: 4 [2022-04-12 00:55:52 main:484] : INFO : # Threads: 1 [2022-04-12 00:55:52 main:486] : INFO : Preparing Dataset [2022-04-12 00:55:52 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-12 00:55:53 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-12 00:55:57 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-12 00:55:57 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-12 00:55:57 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-12 00:55:57 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-12 00:55:57 main:494] : INFO : Creating Model [2022-04-12 00:55:57 main:507] : INFO : Preparing config file [2022-04-12 00:55:57 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-12 00:55:57 main:512] : INFO : Loading config [2022-04-12 00:55:57 main:514] : INFO : Loading state [2022-04-12 00:56:00 main:559] : INFO : Loading DataLoader into Memory [2022-04-12 00:56:00 main:562] : INFO : Starting Training [2022-04-12 00:56:05 main:574] : INFO : Epoch 1921 | loss: 0.0311327 | val_loss: 0.0311505 | Time: 5555.41 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050 Ti) [2022-04-14 00:33:45 main:435] : INFO : Set logging level to 1 [2022-04-14 00:33:45 main:441] : INFO : Running in BOINC Client mode [2022-04-14 00:33:45 main:444] : INFO : Resolving all filenames [2022-04-14 00:33:45 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-14 00:33:45 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-14 00:33:45 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-14 00:33:45 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-14 00:33:45 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-14 00:33:45 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-14 00:33:45 main:474] : INFO : Configuration: [2022-04-14 00:33:45 main:475] : INFO : Model type: GRU [2022-04-14 00:33:45 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-14 00:33:45 main:477] : INFO : Max Epochs: 2048 [2022-04-14 00:33:45 main:478] : INFO : Batch Size: 128 [2022-04-14 00:33:45 main:479] : INFO : Learning Rate: 0.01 [2022-04-14 00:33:45 main:480] : INFO : Patience: 10 [2022-04-14 00:33:45 main:481] : INFO : Hidden Width: 12 [2022-04-14 00:33:45 main:482] : INFO : # Recurrent Layers: 4 [2022-04-14 00:33:45 main:483] : INFO : # Backend Layers: 4 [2022-04-14 00:33:45 main:484] : INFO : # Threads: 1 [2022-04-14 00:33:45 main:486] : INFO : Preparing Dataset [2022-04-14 00:33:45 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-14 00:33:46 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-14 00:33:50 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-14 00:33:50 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-14 00:33:50 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-14 00:33:50 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-14 00:33:50 main:494] : INFO : Creating Model [2022-04-14 00:33:50 main:507] : INFO : Preparing config file [2022-04-14 00:33:50 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-14 00:33:50 main:512] : INFO : Loading config [2022-04-14 00:33:50 main:514] : INFO : Loading state [2022-04-14 00:33:52 main:559] : INFO : Loading DataLoader into Memory [2022-04-14 00:33:52 main:562] : INFO : Starting Training [2022-04-14 00:33:58 main:574] : INFO : Epoch 1921 | loss: 0.0311305 | val_loss: 0.0311506 | Time: 5760.88 ms [2022-04-14 00:34:05 main:574] : INFO : Epoch 1922 | loss: 0.0310928 | val_loss: 0.0311489 | Time: 6858.43 ms [2022-04-14 00:34:12 main:574] : INFO : Epoch 1923 | loss: 0.031091 | val_loss: 0.0311497 | Time: 6945.73 ms [2022-04-14 00:34:19 main:574] : INFO : Epoch 1924 | loss: 0.0310938 | val_loss: 0.0311427 | Time: 6863.01 ms [2022-04-14 00:34:25 main:574] : INFO : Epoch 1925 | loss: 0.0310946 | val_loss: 0.031155 | Time: 6504.41 ms [2022-04-14 00:34:32 main:574] : INFO : Epoch 1926 | loss: 0.0310978 | val_loss: 0.031145 | Time: 6522.15 ms [2022-04-14 00:34:38 main:574] : INFO : Epoch 1927 | loss: 0.0310999 | val_loss: 0.0311396 | Time: 6490.8 ms [2022-04-14 00:34:47 main:574] : INFO : Epoch 1928 | loss: 0.0311029 | val_loss: 0.0311529 | Time: 8767.3 ms [2022-04-14 00:35:14 main:574] : INFO : Epoch 1929 | loss: 0.0310944 | val_loss: 0.0311506 | Time: 26633.5 ms [2022-04-14 00:35:59 main:574] : INFO : Epoch 1930 | loss: 0.0310943 | val_loss: 0.031156 | Time: 45723.6 ms [2022-04-14 00:36:25 main:574] : INFO : Epoch 1931 | loss: 0.0310987 | val_loss: 0.0311496 | Time: 25580 ms [2022-04-14 00:36:59 main:574] : INFO : Epoch 1932 | loss: 0.0310988 | val_loss: 0.0311549 | Time: 34190.7 ms [2022-04-14 00:37:11 main:574] : INFO : Epoch 1933 | loss: 0.0310943 | val_loss: 0.0311495 | Time: 12043 ms [2022-04-14 00:37:23 main:574] : INFO : Epoch 1934 | loss: 0.0310992 | val_loss: 0.0311499 | Time: 11386.2 ms [2022-04-14 00:37:38 main:574] : INFO : Epoch 1935 | loss: 0.0311036 | val_loss: 0.0311544 | Time: 14956.4 ms [2022-04-14 00:37:47 main:574] : INFO : Epoch 1936 | loss: 0.0311016 | val_loss: 0.0311533 | Time: 9530.49 ms [2022-04-14 00:37:56 main:574] : INFO : Epoch 1937 | loss: 0.0310977 | val_loss: 0.0311441 | Time: 9189.59 ms [2022-04-14 00:38:07 main:574] : INFO : Epoch 1938 | loss: 0.031094 | val_loss: 0.0311567 | Time: 10072.8 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050 Ti) [2022-04-14 00:42:12 main:435] : INFO : Set logging level to 1 [2022-04-14 00:42:12 main:441] : INFO : Running in BOINC Client mode [2022-04-14 00:42:12 main:444] : INFO : Resolving all filenames [2022-04-14 00:42:12 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-14 00:42:12 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-14 00:42:12 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-14 00:42:12 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-14 00:42:12 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-14 00:42:12 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-14 00:42:12 main:474] : INFO : Configuration: [2022-04-14 00:42:12 main:475] : INFO : Model type: GRU [2022-04-14 00:42:12 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-14 00:42:12 main:477] : INFO : Max Epochs: 2048 [2022-04-14 00:42:12 main:478] : INFO : Batch Size: 128 [2022-04-14 00:42:12 main:479] : INFO : Learning Rate: 0.01 [2022-04-14 00:42:12 main:480] : INFO : Patience: 10 [2022-04-14 00:42:12 main:481] : INFO : Hidden Width: 12 [2022-04-14 00:42:12 main:482] : INFO : # Recurrent Layers: 4 [2022-04-14 00:42:12 main:483] : INFO : # Backend Layers: 4 [2022-04-14 00:42:12 main:484] : INFO : # Threads: 1 [2022-04-14 00:42:12 main:486] : INFO : Preparing Dataset [2022-04-14 00:42:12 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-14 00:42:12 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-14 00:42:14 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-14 00:42:14 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-14 00:42:14 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-14 00:42:14 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-14 00:42:14 main:494] : INFO : Creating Model [2022-04-14 00:42:14 main:507] : INFO : Preparing config file [2022-04-14 00:42:14 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-14 00:42:14 main:512] : INFO : Loading config [2022-04-14 00:42:14 main:514] : INFO : Loading state [2022-04-14 00:42:17 main:559] : INFO : Loading DataLoader into Memory [2022-04-14 00:42:17 main:562] : INFO : Starting Training [2022-04-14 00:42:26 main:574] : INFO : Epoch 1934 | loss: 0.0311334 | val_loss: 0.0311522 | Time: 8893.59 ms [2022-04-14 00:42:38 main:574] : INFO : Epoch 1935 | loss: 0.031097 | val_loss: 0.0311521 | Time: 12139.4 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050 Ti) [2022-04-14 00:45:48 main:435] : INFO : Set logging level to 1 [2022-04-14 00:45:48 main:441] : INFO : Running in BOINC Client mode [2022-04-14 00:45:48 main:444] : INFO : Resolving all filenames [2022-04-14 00:45:48 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-14 00:45:48 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-14 00:45:48 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-14 00:45:48 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-14 00:45:48 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-14 00:45:48 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-14 00:45:48 main:474] : INFO : Configuration: [2022-04-14 00:45:48 main:475] : INFO : Model type: GRU [2022-04-14 00:45:48 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-14 00:45:48 main:477] : INFO : Max Epochs: 2048 [2022-04-14 00:45:48 main:478] : INFO : Batch Size: 128 [2022-04-14 00:45:48 main:479] : INFO : Learning Rate: 0.01 [2022-04-14 00:45:48 main:480] : INFO : Patience: 10 [2022-04-14 00:45:48 main:481] : INFO : Hidden Width: 12 [2022-04-14 00:45:48 main:482] : INFO : # Recurrent Layers: 4 [2022-04-14 00:45:48 main:483] : INFO : # Backend Layers: 4 [2022-04-14 00:45:48 main:484] : INFO : # Threads: 1 [2022-04-14 00:45:48 main:486] : INFO : Preparing Dataset [2022-04-14 00:45:48 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-14 00:45:48 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-14 00:45:50 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-14 00:45:50 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-14 00:45:50 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-14 00:45:50 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-14 00:45:50 main:494] : INFO : Creating Model [2022-04-14 00:45:51 main:507] : INFO : Preparing config file [2022-04-14 00:45:51 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-14 00:45:51 main:512] : INFO : Loading config [2022-04-14 00:45:51 main:514] : INFO : Loading state [2022-04-14 00:45:51 main:559] : INFO : Loading DataLoader into Memory [2022-04-14 00:45:51 main:562] : INFO : Starting Training [2022-04-14 00:45:55 main:574] : INFO : Epoch 1934 | loss: 0.0311351 | val_loss: 0.0311469 | Time: 3928.7 ms [2022-04-14 00:46:00 main:574] : INFO : Epoch 1935 | loss: 0.0311036 | val_loss: 0.0311473 | Time: 4942.7 ms [2022-04-14 00:46:07 main:574] : INFO : Epoch 1936 | loss: 0.0310969 | val_loss: 0.0311457 | Time: 6577.74 ms [2022-04-14 00:46:13 main:574] : INFO : Epoch 1937 | loss: 0.031095 | val_loss: 0.0311448 | Time: 6870.3 ms [2022-04-14 00:46:20 main:574] : INFO : Epoch 1938 | loss: 0.0310974 | val_loss: 0.0311494 | Time: 6653.34 ms [2022-04-14 00:46:27 main:574] : INFO : Epoch 1939 | loss: 0.0310948 | val_loss: 0.0311531 | Time: 7054.85 ms [2022-04-14 00:46:35 main:574] : INFO : Epoch 1940 | loss: 0.0310914 | val_loss: 0.0311473 | Time: 7364.11 ms [2022-04-14 00:46:44 main:574] : INFO : Epoch 1941 | loss: 0.0310894 | val_loss: 0.0311459 | Time: 8986.03 ms [2022-04-14 00:47:12 main:574] : INFO : Epoch 1942 | loss: 0.0310877 | val_loss: 0.0311542 | Time: 28048.9 ms [2022-04-14 00:47:21 main:574] : INFO : Epoch 1943 | loss: 0.0310913 | val_loss: 0.0311523 | Time: 9443.24 ms [2022-04-14 00:47:34 main:574] : INFO : Epoch 1944 | loss: 0.031095 | val_loss: 0.0311416 | Time: 12918 ms [2022-04-14 00:47:42 main:574] : INFO : Epoch 1945 | loss: 0.0310967 | val_loss: 0.0311507 | Time: 8342.82 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050 Ti) [2022-04-14 01:00:07 main:435] : INFO : Set logging level to 1 [2022-04-14 01:00:07 main:441] : INFO : Running in BOINC Client mode [2022-04-14 01:00:07 main:444] : INFO : Resolving all filenames [2022-04-14 01:00:07 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-14 01:00:07 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-14 01:00:07 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-14 01:00:07 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-14 01:00:07 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-14 01:00:07 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-14 01:00:07 main:474] : INFO : Configuration: [2022-04-14 01:00:07 main:475] : INFO : Model type: GRU [2022-04-14 01:00:07 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-14 01:00:07 main:477] : INFO : Max Epochs: 2048 [2022-04-14 01:00:07 main:478] : INFO : Batch Size: 128 [2022-04-14 01:00:07 main:479] : INFO : Learning Rate: 0.01 [2022-04-14 01:00:07 main:480] : INFO : Patience: 10 [2022-04-14 01:00:07 main:481] : INFO : Hidden Width: 12 [2022-04-14 01:00:07 main:482] : INFO : # Recurrent Layers: 4 [2022-04-14 01:00:07 main:483] : INFO : # Backend Layers: 4 [2022-04-14 01:00:07 main:484] : INFO : # Threads: 1 [2022-04-14 01:00:07 main:486] : INFO : Preparing Dataset [2022-04-14 01:00:07 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-14 01:00:08 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-14 01:00:09 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-14 01:00:09 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-14 01:00:09 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-14 01:00:09 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-14 01:00:09 main:494] : INFO : Creating Model [2022-04-14 01:00:09 main:507] : INFO : Preparing config file [2022-04-14 01:00:09 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-14 01:00:10 main:512] : INFO : Loading config [2022-04-14 01:00:10 main:514] : INFO : Loading state [2022-04-14 01:00:10 main:559] : INFO : Loading DataLoader into Memory [2022-04-14 01:00:10 main:562] : INFO : Starting Training [2022-04-14 01:00:15 main:574] : INFO : Epoch 1934 | loss: 0.031136 | val_loss: 0.0311464 | Time: 4777.1 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050 Ti) [2022-04-14 01:08:45 main:435] : INFO : Set logging level to 1 [2022-04-14 01:08:45 main:441] : INFO : Running in BOINC Client mode [2022-04-14 01:08:45 main:444] : INFO : Resolving all filenames [2022-04-14 01:08:45 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-14 01:08:45 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-14 01:08:45 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-14 01:08:45 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-14 01:08:45 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-14 01:08:45 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-14 01:08:45 main:474] : INFO : Configuration: [2022-04-14 01:08:45 main:475] : INFO : Model type: GRU [2022-04-14 01:08:45 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-14 01:08:45 main:477] : INFO : Max Epochs: 2048 [2022-04-14 01:08:45 main:478] : INFO : Batch Size: 128 [2022-04-14 01:08:45 main:479] : INFO : Learning Rate: 0.01 [2022-04-14 01:08:45 main:480] : INFO : Patience: 10 [2022-04-14 01:08:45 main:481] : INFO : Hidden Width: 12 [2022-04-14 01:08:45 main:482] : INFO : # Recurrent Layers: 4 [2022-04-14 01:08:45 main:483] : INFO : # Backend Layers: 4 [2022-04-14 01:08:45 main:484] : INFO : # Threads: 1 [2022-04-14 01:08:45 main:486] : INFO : Preparing Dataset [2022-04-14 01:08:45 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-14 01:08:46 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-14 01:08:47 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-14 01:08:47 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050 Ti) [2022-04-14 01:28:31 main:435] : INFO : Set logging level to 1 [2022-04-14 01:28:31 main:441] : INFO : Running in BOINC Client mode [2022-04-14 01:28:31 main:444] : INFO : Resolving all filenames [2022-04-14 01:28:31 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-14 01:28:31 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-14 01:28:31 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-14 01:28:31 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-14 01:28:31 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-14 01:28:31 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-14 01:28:31 main:474] : INFO : Configuration: [2022-04-14 01:28:31 main:475] : INFO : Model type: GRU [2022-04-14 01:28:31 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-14 01:28:31 main:477] : INFO : Max Epochs: 2048 [2022-04-14 01:28:31 main:478] : INFO : Batch Size: 128 [2022-04-14 01:28:31 main:479] : INFO : Learning Rate: 0.01 [2022-04-14 01:28:31 main:480] : INFO : Patience: 10 [2022-04-14 01:28:31 main:481] : INFO : Hidden Width: 12 [2022-04-14 01:28:31 main:482] : INFO : # Recurrent Layers: 4 [2022-04-14 01:28:31 main:483] : INFO : # Backend Layers: 4 [2022-04-14 01:28:31 main:484] : INFO : # Threads: 1 [2022-04-14 01:28:31 main:486] : INFO : Preparing Dataset [2022-04-14 01:28:31 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-14 01:28:31 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-14 01:28:33 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-14 01:28:33 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-14 01:28:33 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-14 01:28:33 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-14 01:28:33 main:494] : INFO : Creating Model [2022-04-14 01:28:33 main:507] : INFO : Preparing config file [2022-04-14 01:28:33 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-14 01:28:33 main:512] : INFO : Loading config [2022-04-14 01:28:33 main:514] : INFO : Loading state [2022-04-14 01:28:34 main:559] : INFO : Loading DataLoader into Memory [2022-04-14 01:28:34 main:562] : INFO : Starting Training [2022-04-14 01:28:38 main:574] : INFO : Epoch 1934 | loss: 0.0311321 | val_loss: 0.0311573 | Time: 3894.77 ms [2022-04-14 01:28:43 main:574] : INFO : Epoch 1935 | loss: 0.0310984 | val_loss: 0.0311524 | Time: 5093.93 ms [2022-04-14 01:28:49 main:574] : INFO : Epoch 1936 | loss: 0.0310957 | val_loss: 0.0311538 | Time: 6526.68 ms [2022-04-14 01:28:56 main:574] : INFO : Epoch 1937 | loss: 0.0310941 | val_loss: 0.031145 | Time: 6638.52 ms [2022-04-14 01:29:02 main:574] : INFO : Epoch 1938 | loss: 0.0310945 | val_loss: 0.0311494 | Time: 6395.26 ms [2022-04-14 01:29:09 main:574] : INFO : Epoch 1939 | loss: 0.0310922 | val_loss: 0.0311467 | Time: 6815.65 ms [2022-04-14 01:29:16 main:574] : INFO : Epoch 1940 | loss: 0.0310907 | val_loss: 0.0311476 | Time: 6760.12 ms [2022-04-14 01:29:23 main:574] : INFO : Epoch 1941 | loss: 0.0310897 | val_loss: 0.0311497 | Time: 6543.61 ms [2022-04-14 01:29:29 main:574] : INFO : Epoch 1942 | loss: 0.0310905 | val_loss: 0.0311555 | Time: 6636.75 ms [2022-04-14 01:29:37 main:574] : INFO : Epoch 1943 | loss: 0.0310888 | val_loss: 0.0311478 | Time: 8222.83 ms [2022-04-14 01:29:45 main:574] : INFO : Epoch 1944 | loss: 0.0310935 | val_loss: 0.0311428 | Time: 8024.86 ms [2022-04-14 01:29:53 main:574] : INFO : Epoch 1945 | loss: 0.0310948 | val_loss: 0.0311517 | Time: 7327.31 ms [2022-04-14 01:30:00 main:574] : INFO : Epoch 1946 | loss: 0.0310927 | val_loss: 0.0311471 | Time: 7023.56 ms [2022-04-14 01:30:07 main:574] : INFO : Epoch 1947 | loss: 0.0310901 | val_loss: 0.0311513 | Time: 7412.3 ms [2022-04-14 01:30:15 main:574] : INFO : Epoch 1948 | loss: 0.03109 | val_loss: 0.0311434 | Time: 7950.2 ms [2022-04-14 01:30:23 main:574] : INFO : Epoch 1949 | loss: 0.031087 | val_loss: 0.0311543 | Time: 7680.49 ms [2022-04-14 01:30:32 main:574] : INFO : Epoch 1950 | loss: 0.0310879 | val_loss: 0.0311437 | Time: 9033.28 ms [2022-04-14 01:30:42 main:574] : INFO : Epoch 1951 | loss: 0.0310871 | val_loss: 0.0311388 | Time: 9948.46 ms [2022-04-14 01:30:53 main:574] : INFO : Epoch 1952 | loss: 0.0310913 | val_loss: 0.0311358 | Time: 11470.7 ms [2022-04-14 01:31:04 main:574] : INFO : Epoch 1953 | loss: 0.031092 | val_loss: 0.0311471 | Time: 11050 ms [2022-04-14 01:31:13 main:574] : INFO : Epoch 1954 | loss: 0.0310902 | val_loss: 0.0311448 | Time: 8779.67 ms [2022-04-14 01:31:22 main:574] : INFO : Epoch 1955 | loss: 0.0310886 | val_loss: 0.0311466 | Time: 9311.88 ms [2022-04-14 01:31:32 main:574] : INFO : Epoch 1956 | loss: 0.0310958 | val_loss: 0.0311496 | Time: 9508.17 ms [2022-04-14 01:31:46 main:574] : INFO : Epoch 1957 | loss: 0.0310971 | val_loss: 0.0311477 | Time: 14071.9 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050 Ti) [2022-04-14 01:41:56 main:435] : INFO : Set logging level to 1 [2022-04-14 01:41:56 main:441] : INFO : Running in BOINC Client mode [2022-04-14 01:41:56 main:444] : INFO : Resolving all filenames [2022-04-14 01:41:56 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-14 01:41:56 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-14 01:41:56 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-14 01:41:56 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-14 01:41:56 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-14 01:41:56 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-14 01:41:56 main:474] : INFO : Configuration: [2022-04-14 01:41:56 main:475] : INFO : Model type: GRU [2022-04-14 01:41:56 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-14 01:41:56 main:477] : INFO : Max Epochs: 2048 [2022-04-14 01:41:56 main:478] : INFO : Batch Size: 128 [2022-04-14 01:41:56 main:479] : INFO : Learning Rate: 0.01 [2022-04-14 01:41:56 main:480] : INFO : Patience: 10 [2022-04-14 01:41:56 main:481] : INFO : Hidden Width: 12 [2022-04-14 01:41:56 main:482] : INFO : # Recurrent Layers: 4 [2022-04-14 01:41:56 main:483] : INFO : # Backend Layers: 4 [2022-04-14 01:41:56 main:484] : INFO : # Threads: 1 [2022-04-14 01:41:56 main:486] : INFO : Preparing Dataset [2022-04-14 01:41:56 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-14 01:41:56 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-14 01:41:58 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-14 01:41:58 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-14 01:41:58 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-14 01:41:58 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-14 01:41:58 main:494] : INFO : Creating Model [2022-04-14 01:41:58 main:507] : INFO : Preparing config file [2022-04-14 01:41:58 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-14 01:41:58 main:512] : INFO : Loading config [2022-04-14 01:41:58 main:514] : INFO : Loading state [2022-04-14 01:41:58 main:559] : INFO : Loading DataLoader into Memory [2022-04-14 01:41:58 main:562] : INFO : Starting Training [2022-04-14 01:42:02 main:574] : INFO : Epoch 1934 | loss: 0.0311292 | val_loss: 0.0311544 | Time: 3607.67 ms [2022-04-14 01:42:05 main:574] : INFO : Epoch 1935 | loss: 0.0310983 | val_loss: 0.0311465 | Time: 3452.83 ms [2022-04-14 01:42:12 main:574] : INFO : Epoch 1936 | loss: 0.0310937 | val_loss: 0.0311456 | Time: 6962.41 ms [2022-04-14 01:42:19 main:574] : INFO : Epoch 1937 | loss: 0.0310913 | val_loss: 0.0311428 | Time: 6904.4 ms [2022-04-14 01:42:26 main:574] : INFO : Epoch 1938 | loss: 0.0310909 | val_loss: 0.0311518 | Time: 7012.81 ms [2022-04-14 01:42:34 main:574] : INFO : Epoch 1939 | loss: 0.0310915 | val_loss: 0.0311571 | Time: 7203.87 ms [2022-04-14 01:42:41 main:574] : INFO : Epoch 1940 | loss: 0.0310993 | val_loss: 0.0311461 | Time: 7108.8 ms [2022-04-14 01:43:00 main:574] : INFO : Epoch 1941 | loss: 0.0310971 | val_loss: 0.0311414 | Time: 19039.1 ms [2022-04-14 01:43:07 main:574] : INFO : Epoch 1942 | loss: 0.0310953 | val_loss: 0.0311436 | Time: 7327.05 ms [2022-04-14 01:43:14 main:574] : INFO : Epoch 1943 | loss: 0.0310935 | val_loss: 0.0311409 | Time: 6825.18 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050 Ti) [2022-04-14 01:52:28 main:435] : INFO : Set logging level to 1 [2022-04-14 01:52:28 main:441] : INFO : Running in BOINC Client mode [2022-04-14 01:52:28 main:444] : INFO : Resolving all filenames [2022-04-14 01:52:28 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-14 01:52:28 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-14 01:52:28 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-14 01:52:28 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-14 01:52:28 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-14 01:52:28 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-14 01:52:28 main:474] : INFO : Configuration: [2022-04-14 01:52:28 main:475] : INFO : Model type: GRU [2022-04-14 01:52:28 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-14 01:52:28 main:477] : INFO : Max Epochs: 2048 [2022-04-14 01:52:28 main:478] : INFO : Batch Size: 128 [2022-04-14 01:52:28 main:479] : INFO : Learning Rate: 0.01 [2022-04-14 01:52:28 main:480] : INFO : Patience: 10 [2022-04-14 01:52:28 main:481] : INFO : Hidden Width: 12 [2022-04-14 01:52:28 main:482] : INFO : # Recurrent Layers: 4 [2022-04-14 01:52:28 main:483] : INFO : # Backend Layers: 4 [2022-04-14 01:52:28 main:484] : INFO : # Threads: 1 [2022-04-14 01:52:28 main:486] : INFO : Preparing Dataset [2022-04-14 01:52:28 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-14 01:52:28 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-14 01:52:30 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-14 01:52:30 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-14 01:52:30 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-14 01:52:30 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-14 01:52:30 main:494] : INFO : Creating Model [2022-04-14 01:52:30 main:507] : INFO : Preparing config file [2022-04-14 01:52:30 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-14 01:52:30 main:512] : INFO : Loading config [2022-04-14 01:52:30 main:514] : INFO : Loading state [2022-04-14 01:52:31 main:559] : INFO : Loading DataLoader into Memory [2022-04-14 01:52:31 main:562] : INFO : Starting Training [2022-04-14 01:52:35 main:574] : INFO : Epoch 1934 | loss: 0.0311331 | val_loss: 0.0311438 | Time: 3746.61 ms [2022-04-14 01:52:39 main:574] : INFO : Epoch 1935 | loss: 0.0311 | val_loss: 0.0311481 | Time: 4240.34 ms [2022-04-14 01:52:46 main:574] : INFO : Epoch 1936 | loss: 0.0310988 | val_loss: 0.0311497 | Time: 6541.35 ms [2022-04-14 01:52:53 main:574] : INFO : Epoch 1937 | loss: 0.0310939 | val_loss: 0.0311513 | Time: 7023.6 ms [2022-04-14 01:52:59 main:574] : INFO : Epoch 1938 | loss: 0.0310953 | val_loss: 0.0311437 | Time: 6287.44 ms [2022-04-14 01:53:06 main:574] : INFO : Epoch 1939 | loss: 0.0310918 | val_loss: 0.0311495 | Time: 6772.54 ms [2022-04-14 01:53:12 main:574] : INFO : Epoch 1940 | loss: 0.0310908 | val_loss: 0.0311464 | Time: 6570.24 ms [2022-04-14 01:53:19 main:574] : INFO : Epoch 1941 | loss: 0.0310919 | val_loss: 0.0311451 | Time: 6768.28 ms [2022-04-14 01:53:26 main:574] : INFO : Epoch 1942 | loss: 0.0310935 | val_loss: 0.0311553 | Time: 7123.2 ms [2022-04-14 01:53:34 main:574] : INFO : Epoch 1943 | loss: 0.0310943 | val_loss: 0.031156 | Time: 7844.82 ms [2022-04-14 01:53:41 main:574] : INFO : Epoch 1944 | loss: 0.0310936 | val_loss: 0.0311505 | Time: 7242.13 ms [2022-04-14 01:53:48 main:574] : INFO : Epoch 1945 | loss: 0.0310937 | val_loss: 0.0311497 | Time: 6954.7 ms [2022-04-14 01:53:55 main:574] : INFO : Epoch 1946 | loss: 0.0310947 | val_loss: 0.0311539 | Time: 6878.29 ms [2022-04-14 01:54:02 main:574] : INFO : Epoch 1947 | loss: 0.031095 | val_loss: 0.0311528 | Time: 7125.9 ms [2022-04-14 01:54:11 main:574] : INFO : Epoch 1948 | loss: 0.0310942 | val_loss: 0.0311577 | Time: 8701.61 ms [2022-04-14 01:54:19 main:574] : INFO : Epoch 1949 | loss: 0.0310911 | val_loss: 0.0311529 | Time: 8508.89 ms [2022-04-14 01:54:28 main:574] : INFO : Epoch 1950 | loss: 0.0310871 | val_loss: 0.0311462 | Time: 8846.91 ms [2022-04-14 01:54:39 main:574] : INFO : Epoch 1951 | loss: 0.0310872 | val_loss: 0.0311485 | Time: 10969.5 ms [2022-04-14 01:54:50 main:574] : INFO : Epoch 1952 | loss: 0.0310896 | val_loss: 0.0311487 | Time: 10781.2 ms [2022-04-14 01:54:58 main:574] : INFO : Epoch 1953 | loss: 0.0310892 | val_loss: 0.0311466 | Time: 8354.06 ms [2022-04-14 01:55:07 main:574] : INFO : Epoch 1954 | loss: 0.0310883 | val_loss: 0.0311596 | Time: 8367.89 ms [2022-04-14 01:55:15 main:574] : INFO : Epoch 1955 | loss: 0.031092 | val_loss: 0.0311507 | Time: 8567.01 ms [2022-04-14 01:55:26 main:574] : INFO : Epoch 1956 | loss: 0.0310959 | val_loss: 0.0311485 | Time: 10595.5 ms [2022-04-14 01:55:39 main:574] : INFO : Epoch 1957 | loss: 0.0310987 | val_loss: 0.0311485 | Time: 13353.5 ms [2022-04-14 01:55:48 main:574] : INFO : Epoch 1958 | loss: 0.0311024 | val_loss: 0.0311541 | Time: 8770.03 ms [2022-04-14 01:55:56 main:574] : INFO : Epoch 1959 | loss: 0.0311032 | val_loss: 0.0311586 | Time: 8279.57 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050 Ti) [2022-04-14 02:03:28 main:435] : INFO : Set logging level to 1 [2022-04-14 02:03:28 main:441] : INFO : Running in BOINC Client mode [2022-04-14 02:03:28 main:444] : INFO : Resolving all filenames [2022-04-14 02:03:28 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-14 02:03:28 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-14 02:03:28 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-14 02:03:28 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-14 02:03:28 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-14 02:03:28 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-14 02:03:28 main:474] : INFO : Configuration: [2022-04-14 02:03:28 main:475] : INFO : Model type: GRU [2022-04-14 02:03:28 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-14 02:03:28 main:477] : INFO : Max Epochs: 2048 [2022-04-14 02:03:28 main:478] : INFO : Batch Size: 128 [2022-04-14 02:03:28 main:479] : INFO : Learning Rate: 0.01 [2022-04-14 02:03:28 main:480] : INFO : Patience: 10 [2022-04-14 02:03:28 main:481] : INFO : Hidden Width: 12 [2022-04-14 02:03:28 main:482] : INFO : # Recurrent Layers: 4 [2022-04-14 02:03:28 main:483] : INFO : # Backend Layers: 4 [2022-04-14 02:03:28 main:484] : INFO : # Threads: 1 [2022-04-14 02:03:28 main:486] : INFO : Preparing Dataset [2022-04-14 02:03:28 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-14 02:03:28 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-14 02:03:30 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-14 02:03:30 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-14 02:03:30 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-14 02:03:30 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-14 02:03:30 main:494] : INFO : Creating Model [2022-04-14 02:03:30 main:507] : INFO : Preparing config file [2022-04-14 02:03:30 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-14 02:03:30 main:512] : INFO : Loading config [2022-04-14 02:03:30 main:514] : INFO : Loading state [2022-04-14 02:03:31 main:559] : INFO : Loading DataLoader into Memory [2022-04-14 02:03:32 main:562] : INFO : Starting Training [2022-04-14 02:03:37 main:574] : INFO : Epoch 1959 | loss: 0.0311324 | val_loss: 0.0311552 | Time: 4485.2 ms [2022-04-14 02:03:43 main:574] : INFO : Epoch 1960 | loss: 0.0311006 | val_loss: 0.0311507 | Time: 5936.9 ms [2022-04-14 02:03:49 main:574] : INFO : Epoch 1961 | loss: 0.0310945 | val_loss: 0.0311476 | Time: 6247.34 ms [2022-04-14 02:03:55 main:574] : INFO : Epoch 1962 | loss: 0.0310932 | val_loss: 0.0311547 | Time: 5814.42 ms [2022-04-14 02:04:01 main:574] : INFO : Epoch 1963 | loss: 0.0310956 | val_loss: 0.0311579 | Time: 6220.52 ms [2022-04-14 02:04:08 main:574] : INFO : Epoch 1964 | loss: 0.0310952 | val_loss: 0.0311591 | Time: 6473.33 ms [2022-04-14 02:04:14 main:574] : INFO : Epoch 1965 | loss: 0.0311018 | val_loss: 0.0311522 | Time: 5985.25 ms [2022-04-14 02:04:20 main:574] : INFO : Epoch 1966 | loss: 0.0310965 | val_loss: 0.031155 | Time: 6501.73 ms [2022-04-14 02:04:27 main:574] : INFO : Epoch 1967 | loss: 0.0310918 | val_loss: 0.0311591 | Time: 7014.98 ms [2022-04-14 02:04:34 main:574] : INFO : Epoch 1968 | loss: 0.0310991 | val_loss: 0.0311484 | Time: 6996.75 ms [2022-04-14 02:04:41 main:574] : INFO : Epoch 1969 | loss: 0.0311099 | val_loss: 0.0311623 | Time: 6792.14 ms [2022-04-14 02:04:48 main:574] : INFO : Epoch 1970 | loss: 0.0311163 | val_loss: 0.031151 | Time: 7108.15 ms [2022-04-14 02:04:55 main:574] : INFO : Epoch 1971 | loss: 0.0311289 | val_loss: 0.031159 | Time: 7266.43 ms [2022-04-14 02:05:03 main:574] : INFO : Epoch 1972 | loss: 0.0311215 | val_loss: 0.0311509 | Time: 7665 ms [2022-04-14 02:05:12 main:574] : INFO : Epoch 1973 | loss: 0.0311226 | val_loss: 0.0311595 | Time: 8798.26 ms [2022-04-14 02:05:21 main:574] : INFO : Epoch 1974 | loss: 0.0311234 | val_loss: 0.0311537 | Time: 8720.98 ms [2022-04-14 02:05:34 main:574] : INFO : Epoch 1975 | loss: 0.0311173 | val_loss: 0.0311549 | Time: 13099.5 ms [2022-04-14 02:05:43 main:574] : INFO : Epoch 1976 | loss: 0.0311139 | val_loss: 0.0311609 | Time: 9252.07 ms [2022-04-14 02:05:51 main:574] : INFO : Epoch 1977 | loss: 0.0311133 | val_loss: 0.0311529 | Time: 8362.02 ms [2022-04-14 02:06:00 main:574] : INFO : Epoch 1978 | loss: 0.0311132 | val_loss: 0.0311543 | Time: 8698.42 ms [2022-04-14 02:06:12 main:574] : INFO : Epoch 1979 | loss: 0.0311116 | val_loss: 0.031151 | Time: 11551.2 ms [2022-04-14 02:06:25 main:574] : INFO : Epoch 1980 | loss: 0.0311128 | val_loss: 0.0311525 | Time: 13377.7 ms [2022-04-14 02:06:34 main:574] : INFO : Epoch 1981 | loss: 0.0311253 | val_loss: 0.0311502 | Time: 8541.56 ms [2022-04-14 02:06:43 main:574] : INFO : Epoch 1982 | loss: 0.0311261 | val_loss: 0.0311503 | Time: 9039.01 ms [2022-04-14 02:06:52 main:574] : INFO : Epoch 1983 | loss: 0.0311256 | val_loss: 0.0311546 | Time: 9500.98 ms [2022-04-14 02:07:06 main:574] : INFO : Epoch 1984 | loss: 0.0311233 | val_loss: 0.0311478 | Time: 14187.3 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050 Ti) [2022-04-14 03:30:07 main:435] : INFO : Set logging level to 1 [2022-04-14 03:30:07 main:441] : INFO : Running in BOINC Client mode [2022-04-14 03:30:07 main:444] : INFO : Resolving all filenames [2022-04-14 03:30:07 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-14 03:30:07 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-14 03:30:07 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-14 03:30:07 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-14 03:30:07 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-14 03:30:07 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-14 03:30:07 main:474] : INFO : Configuration: [2022-04-14 03:30:07 main:475] : INFO : Model type: GRU [2022-04-14 03:30:07 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-14 03:30:07 main:477] : INFO : Max Epochs: 2048 [2022-04-14 03:30:07 main:478] : INFO : Batch Size: 128 [2022-04-14 03:30:07 main:479] : INFO : Learning Rate: 0.01 [2022-04-14 03:30:07 main:480] : INFO : Patience: 10 [2022-04-14 03:30:07 main:481] : INFO : Hidden Width: 12 [2022-04-14 03:30:07 main:482] : INFO : # Recurrent Layers: 4 [2022-04-14 03:30:07 main:483] : INFO : # Backend Layers: 4 [2022-04-14 03:30:07 main:484] : INFO : # Threads: 1 [2022-04-14 03:30:07 main:486] : INFO : Preparing Dataset [2022-04-14 03:30:07 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-14 03:30:07 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-14 03:30:09 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-14 03:30:09 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-14 03:30:09 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-14 03:30:09 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-14 03:30:09 main:494] : INFO : Creating Model [2022-04-14 03:30:09 main:507] : INFO : Preparing config file [2022-04-14 03:30:09 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-14 03:30:09 main:512] : INFO : Loading config [2022-04-14 03:30:09 main:514] : INFO : Loading state [2022-04-14 03:30:10 main:559] : INFO : Loading DataLoader into Memory [2022-04-14 03:30:10 main:562] : INFO : Starting Training [2022-04-14 03:30:14 main:574] : INFO : Epoch 1984 | loss: 0.0311556 | val_loss: 0.0311567 | Time: 3743.32 ms [2022-04-14 03:30:18 main:574] : INFO : Epoch 1985 | loss: 0.0311189 | val_loss: 0.031149 | Time: 4635.24 ms [2022-04-14 03:30:25 main:574] : INFO : Epoch 1986 | loss: 0.0311143 | val_loss: 0.0311444 | Time: 7019.89 ms [2022-04-14 03:30:32 main:574] : INFO : Epoch 1987 | loss: 0.031112 | val_loss: 0.0311548 | Time: 7142.31 ms [2022-04-14 03:30:39 main:574] : INFO : Epoch 1988 | loss: 0.0311088 | val_loss: 0.0311535 | Time: 6436.65 ms [2022-04-14 03:30:45 main:574] : INFO : Epoch 1989 | loss: 0.03111 | val_loss: 0.0311506 | Time: 6656.41 ms [2022-04-14 03:30:52 main:574] : INFO : Epoch 1990 | loss: 0.031109 | val_loss: 0.0311506 | Time: 7006.24 ms [2022-04-14 03:30:59 main:574] : INFO : Epoch 1991 | loss: 0.0311041 | val_loss: 0.0311584 | Time: 6471.1 ms [2022-04-14 03:31:06 main:574] : INFO : Epoch 1992 | loss: 0.0311056 | val_loss: 0.0311525 | Time: 6772.59 ms [2022-04-14 03:31:14 main:574] : INFO : Epoch 1993 | loss: 0.0311047 | val_loss: 0.0311487 | Time: 8530.91 ms [2022-04-14 03:31:22 main:574] : INFO : Epoch 1994 | loss: 0.0311042 | val_loss: 0.0311491 | Time: 7845.89 ms [2022-04-14 03:31:30 main:574] : INFO : Epoch 1995 | loss: 0.0311039 | val_loss: 0.0311557 | Time: 7482.87 ms [2022-04-14 03:31:38 main:574] : INFO : Epoch 1996 | loss: 0.0311043 | val_loss: 0.0311485 | Time: 8322.8 ms [2022-04-14 03:31:45 main:574] : INFO : Epoch 1997 | loss: 0.0311025 | val_loss: 0.0311427 | Time: 7577.89 ms [2022-04-14 03:31:53 main:574] : INFO : Epoch 1998 | loss: 0.0311041 | val_loss: 0.0311505 | Time: 7519.68 ms [2022-04-14 03:32:01 main:574] : INFO : Epoch 1999 | loss: 0.0311083 | val_loss: 0.0311522 | Time: 8271.76 ms [2022-04-14 03:32:11 main:574] : INFO : Epoch 2000 | loss: 0.0311094 | val_loss: 0.0311488 | Time: 9836.46 ms [2022-04-14 03:32:21 main:574] : INFO : Epoch 2001 | loss: 0.0311052 | val_loss: 0.0311518 | Time: 9608.11 ms [2022-04-14 03:32:34 main:574] : INFO : Epoch 2002 | loss: 0.0311066 | val_loss: 0.0311534 | Time: 13472.2 ms [2022-04-14 03:32:45 main:574] : INFO : Epoch 2003 | loss: 0.0311089 | val_loss: 0.031156 | Time: 10771.5 ms [2022-04-14 03:32:55 main:574] : INFO : Epoch 2004 | loss: 0.0311109 | val_loss: 0.0311474 | Time: 9525.19 ms [2022-04-14 03:33:04 main:574] : INFO : Epoch 2005 | loss: 0.0311073 | val_loss: 0.0311417 | Time: 9216.82 ms [2022-04-14 03:33:14 main:574] : INFO : Epoch 2006 | loss: 0.0311066 | val_loss: 0.031141 | Time: 10024.2 ms [2022-04-14 03:33:28 main:574] : INFO : Epoch 2007 | loss: 0.0311065 | val_loss: 0.0311452 | Time: 14446.2 ms [2022-04-14 03:33:39 main:574] : INFO : Epoch 2008 | loss: 0.0311069 | val_loss: 0.0311454 | Time: 10794.3 ms [2022-04-14 03:33:49 main:574] : INFO : Epoch 2009 | loss: 0.0311054 | val_loss: 0.0311445 | Time: 10364.1 ms [2022-04-14 03:34:01 main:574] : INFO : Epoch 2010 | loss: 0.0311025 | val_loss: 0.0311414 | Time: 11548.2 ms [2022-04-14 03:34:15 main:574] : INFO : Epoch 2011 | loss: 0.0311016 | val_loss: 0.0311467 | Time: 13840.3 ms [2022-04-14 03:34:27 main:574] : INFO : Epoch 2012 | loss: 0.0311009 | val_loss: 0.0311397 | Time: 12493 ms [2022-04-14 03:34:37 main:574] : INFO : Epoch 2013 | loss: 0.0311 | val_loss: 0.0311436 | Time: 9181.41 ms [2022-04-14 03:34:47 main:574] : INFO : Epoch 2014 | loss: 0.0311046 | val_loss: 0.0311439 | Time: 10337.5 ms [2022-04-14 03:35:01 main:574] : INFO : Epoch 2015 | loss: 0.0311043 | val_loss: 0.0311469 | Time: 14026.7 ms [2022-04-14 03:35:13 main:574] : INFO : Epoch 2016 | loss: 0.0311031 | val_loss: 0.0311458 | Time: 12487.3 ms [2022-04-14 03:35:23 main:574] : INFO : Epoch 2017 | loss: 0.0310999 | val_loss: 0.0311462 | Time: 9605.25 ms [2022-04-14 03:35:35 main:574] : INFO : Epoch 2018 | loss: 0.0311001 | val_loss: 0.031139 | Time: 11644 ms [2022-04-14 03:35:49 main:574] : INFO : Epoch 2019 | loss: 0.0311004 | val_loss: 0.0311375 | Time: 14417.1 ms [2022-04-14 03:36:01 main:574] : INFO : Epoch 2020 | loss: 0.0310983 | val_loss: 0.0311404 | Time: 11783.6 ms [2022-04-14 03:36:10 main:574] : INFO : Epoch 2021 | loss: 0.0311012 | val_loss: 0.0311473 | Time: 9002.93 ms [2022-04-14 03:36:22 main:574] : INFO : Epoch 2022 | loss: 0.031098 | val_loss: 0.0311472 | Time: 11741.8 ms [2022-04-14 03:36:36 main:574] : INFO : Epoch 2023 | loss: 0.0311019 | val_loss: 0.0311448 | Time: 13895 ms [2022-04-14 03:36:48 main:574] : INFO : Epoch 2024 | loss: 0.0311028 | val_loss: 0.0311428 | Time: 12765.9 ms [2022-04-14 03:36:58 main:574] : INFO : Epoch 2025 | loss: 0.0311073 | val_loss: 0.0311497 | Time: 9666.57 ms [2022-04-14 03:37:10 main:574] : INFO : Epoch 2026 | loss: 0.0311029 | val_loss: 0.0311436 | Time: 11983.5 ms [2022-04-14 03:37:25 main:574] : INFO : Epoch 2027 | loss: 0.0311009 | val_loss: 0.0311496 | Time: 14753.9 ms [2022-04-14 03:37:39 main:574] : INFO : Epoch 2028 | loss: 0.0311003 | val_loss: 0.0311496 | Time: 14340.1 ms [2022-04-14 03:37:48 main:574] : INFO : Epoch 2029 | loss: 0.0310987 | val_loss: 0.0311457 | Time: 8708.85 ms [2022-04-14 03:37:59 main:574] : INFO : Epoch 2030 | loss: 0.0311032 | val_loss: 0.0311517 | Time: 10756.2 ms [2022-04-14 03:38:12 main:574] : INFO : Epoch 2031 | loss: 0.0311023 | val_loss: 0.0311427 | Time: 13461.2 ms [2022-04-14 03:38:26 main:574] : INFO : Epoch 2032 | loss: 0.0311006 | val_loss: 0.0311507 | Time: 13658.2 ms [2022-04-14 03:38:38 main:574] : INFO : Epoch 2033 | loss: 0.0311066 | val_loss: 0.0311514 | Time: 12353.3 ms [2022-04-14 03:38:48 main:574] : INFO : Epoch 2034 | loss: 0.0311163 | val_loss: 0.0311621 | Time: 9625.4 ms [2022-04-14 03:39:02 main:574] : INFO : Epoch 2035 | loss: 0.0311171 | val_loss: 0.0311616 | Time: 14138.4 ms [2022-04-14 03:39:18 main:574] : INFO : Epoch 2036 | loss: 0.0311326 | val_loss: 0.0311636 | Time: 16382.6 ms [2022-04-14 03:39:31 main:574] : INFO : Epoch 2037 | loss: 0.0311457 | val_loss: 0.0311642 | Time: 12609.9 ms [2022-04-14 03:39:40 main:574] : INFO : Epoch 2038 | loss: 0.0311395 | val_loss: 0.0311531 | Time: 8760.23 ms [2022-04-14 03:39:51 main:574] : INFO : Epoch 2039 | loss: 0.0311312 | val_loss: 0.031158 | Time: 11556.1 ms [2022-04-14 03:40:05 main:574] : INFO : Epoch 2040 | loss: 0.0311243 | val_loss: 0.0311549 | Time: 13769.9 ms [2022-04-14 03:40:19 main:574] : INFO : Epoch 2041 | loss: 0.0311196 | val_loss: 0.0311525 | Time: 14345 ms [2022-04-14 03:40:29 main:574] : INFO : Epoch 2042 | loss: 0.0311128 | val_loss: 0.0311492 | Time: 10023.2 ms [2022-04-14 03:40:39 main:574] : INFO : Epoch 2043 | loss: 0.0311114 | val_loss: 0.0311491 | Time: 9497.84 ms [2022-04-14 03:40:53 main:574] : INFO : Epoch 2044 | loss: 0.0311075 | val_loss: 0.031147 | Time: 14548 ms [2022-04-14 03:41:07 main:574] : INFO : Epoch 2045 | loss: 0.0311047 | val_loss: 0.0311441 | Time: 13938.5 ms [2022-04-14 03:41:19 main:574] : INFO : Epoch 2046 | loss: 0.0311041 | val_loss: 0.0311433 | Time: 11771.8 ms [2022-04-14 03:41:27 main:574] : INFO : Epoch 2047 | loss: 0.0311047 | val_loss: 0.0311428 | Time: 7936.48 ms [2022-04-14 03:41:39 main:574] : INFO : Epoch 2048 | loss: 0.0311038 | val_loss: 0.0311443 | Time: 11810.3 ms [2022-04-14 03:41:39 main:597] : INFO : Saving trained model to model-final.pt, val_loss 0.0311443 [2022-04-14 03:41:39 main:603] : INFO : Saving end state to config to file [2022-04-14 03:41:39 main:608] : INFO : Success, exiting.. 03:41:39 (17380): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)