Task 8854128
| Name | ParityModified-1636178168-2112-1_0 |
| Workunit | 6322931 |
| Created | 10 Nov 2021, 18:26:41 UTC |
| Sent | 16 Nov 2021, 5:28:50 UTC |
| Report deadline | 23 Nov 2021, 5:28:50 UTC |
| Received | 23 Nov 2021, 0:55:59 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 157 |
| Run time | 1 days 2 hours 1 min 6 sec |
| CPU time | 6 hours 55 min 11 sec |
| Validate state | Valid |
| Credit | 4,160.00 |
| Device peak FLOPS | 4,473.99 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.62 GB |
| Peak swap size | 3.61 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version> <![CDATA[ <stderr_txt> _tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 15:17:32 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2021-11-22 15:17:32 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 15:17:32 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 15:17:33 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2021-11-22 15:17:33 main:494] : INFO : Creating Model [2021-11-22 15:17:33 main:507] : INFO : Preparing config file [2021-11-22 15:17:33 main:511] : INFO : Found checkpoint, attempting to load... [2021-11-22 15:17:33 main:512] : INFO : Loading config [2021-11-22 15:17:33 main:514] : INFO : Loading state [2021-11-22 15:17:42 main:559] : INFO : Loading DataLoader into Memory [2021-11-22 15:17:42 main:562] : INFO : Starting Training [2021-11-22 15:18:29 main:574] : INFO : Epoch 1888 | loss: 0.00289619 | val_loss: 0.000818615 | Time: 46444.2 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1060 6GB) [2021-11-22 15:22:31 main:435] : INFO : Set logging level to 1 [2021-11-22 15:22:31 main:441] : INFO : Running in BOINC Client mode [2021-11-22 15:22:32 main:444] : INFO : Resolving all filenames [2021-11-22 15:22:33 main:452] : INFO : Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1) [2021-11-22 15:22:33 main:452] : INFO : Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636178168-2112-1_0_r766946233_1 (exists = 1) [2021-11-22 15:22:35 main:452] : INFO : Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636178168-2112-1_0_r766946233_0 (exists = 0) [2021-11-22 15:22:35 main:452] : INFO : Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636178168-2112-1 (exists = 1) [2021-11-22 15:22:37 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2021-11-22 15:22:38 main:472] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 [2021-11-22 15:22:40 main:474] : INFO : Configuration: [2021-11-22 15:22:40 main:475] : INFO : Model type: GRU [2021-11-22 15:22:40 main:476] : INFO : Validation Loss Threshold: 0.0001 [2021-11-22 15:22:41 main:477] : INFO : Max Epochs: 2048 [2021-11-22 15:22:41 main:478] : INFO : Batch Size: 128 [2021-11-22 15:22:41 main:479] : INFO : Learning Rate: 0.01 [2021-11-22 15:22:41 main:480] : INFO : Patience: 10 [2021-11-22 15:22:41 main:481] : INFO : Hidden Width: 12 [2021-11-22 15:22:41 main:482] : INFO : # Recurrent Layers: 4 [2021-11-22 15:22:42 main:483] : INFO : # Backend Layers: 4 [2021-11-22 15:22:42 main:484] : INFO : # Threads: 1 [2021-11-22 15:22:43 main:486] : INFO : Preparing Dataset [2021-11-22 15:22:51 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 15:22:53 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 15:23:26 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2021-11-22 15:23:26 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 15:23:26 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 15:23:26 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2021-11-22 15:23:26 main:494] : INFO : Creating Model [2021-11-22 15:23:27 main:507] : INFO : Preparing config file [2021-11-22 15:23:27 main:511] : INFO : Found checkpoint, attempting to load... [2021-11-22 15:23:27 main:512] : INFO : Loading config [2021-11-22 15:23:27 main:514] : INFO : Loading state [2021-11-22 15:23:56 main:559] : INFO : Loading DataLoader into Memory [2021-11-22 15:23:56 main:562] : INFO : Starting Training [2021-11-22 15:25:35 main:574] : INFO : Epoch 1888 | loss: 0.00290457 | val_loss: 0.00084849 | Time: 99275.1 ms [2021-11-22 15:27:05 main:574] : INFO : Epoch 1889 | loss: 0.00060375 | val_loss: 0.000476582 | Time: 90028 ms [2021-11-22 15:28:56 main:574] : INFO : Epoch 1890 | loss: 0.000362813 | val_loss: 0.000269707 | Time: 110312 ms [2021-11-22 15:30:05 main:574] : INFO : Epoch 1891 | loss: 0.000233639 | val_loss: 0.000183944 | Time: 69461.8 ms [2021-11-22 15:31:16 main:574] : INFO : Epoch 1892 | loss: 0.000143965 | val_loss: 9.56654e-05 | Time: 70645.5 ms [2021-11-22 15:32:27 main:574] : INFO : Epoch 1893 | loss: 6.31547e-05 | val_loss: 4.3246e-05 | Time: 70649.2 ms [2021-11-22 15:33:54 main:574] : INFO : Epoch 1894 | loss: 3.57248e-05 | val_loss: 3.16896e-05 | Time: 86604.1 ms [2021-11-22 15:34:47 main:574] : INFO : Epoch 1895 | loss: 2.6974e-05 | val_loss: 2.68015e-05 | Time: 53040.2 ms [2021-11-22 15:36:03 main:574] : INFO : Epoch 1896 | loss: 2.38269e-05 | val_loss: 2.4577e-05 | Time: 75850 ms [2021-11-22 15:37:08 main:574] : INFO : Epoch 1897 | loss: 2.23188e-05 | val_loss: 2.32583e-05 | Time: 65451.6 ms [2021-11-22 15:38:12 main:574] : INFO : Epoch 1898 | loss: 2.14801e-05 | val_loss: 2.25394e-05 | Time: 62740 ms [2021-11-22 15:39:11 main:574] : INFO : Epoch 1899 | loss: 2.0889e-05 | val_loss: 2.20767e-05 | Time: 59097.4 ms [2021-11-22 15:41:28 main:574] : INFO : Epoch 1900 | loss: 2.04342e-05 | val_loss: 2.24759e-05 | Time: 137432 ms [2021-11-22 15:44:22 main:574] : INFO : Epoch 1901 | loss: 2.08178e-05 | val_loss: 2.13949e-05 | Time: 173858 ms [2021-11-22 15:46:56 main:574] : INFO : Epoch 1902 | loss: 1.98148e-05 | val_loss: 2.11574e-05 | Time: 153093 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1060 6GB) [2021-11-22 16:08:56 main:435] : INFO : Set logging level to 1 [2021-11-22 16:08:57 main:441] : INFO : Running in BOINC Client mode [2021-11-22 16:08:57 main:444] : INFO : Resolving all filenames [2021-11-22 16:08:57 main:452] : INFO : Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1) [2021-11-22 16:08:57 main:452] : INFO : Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636178168-2112-1_0_r766946233_1 (exists = 1) [2021-11-22 16:09:03 main:452] : INFO : Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636178168-2112-1_0_r766946233_0 (exists = 0) [2021-11-22 16:09:03 main:452] : INFO : Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636178168-2112-1 (exists = 1) [2021-11-22 16:09:03 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2021-11-22 16:09:04 main:472] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 [2021-11-22 16:09:04 main:474] : INFO : Configuration: [2021-11-22 16:09:04 main:475] : INFO : Model type: GRU [2021-11-22 16:09:04 main:476] : INFO : Validation Loss Threshold: 0.0001 [2021-11-22 16:09:04 main:477] : INFO : Max Epochs: 2048 [2021-11-22 16:09:04 main:478] : INFO : Batch Size: 128 [2021-11-22 16:09:04 main:479] : INFO : Learning Rate: 0.01 [2021-11-22 16:09:04 main:480] : INFO : Patience: 10 [2021-11-22 16:09:04 main:481] : INFO : Hidden Width: 12 [2021-11-22 16:09:04 main:482] : INFO : # Recurrent Layers: 4 [2021-11-22 16:09:04 main:483] : INFO : # Backend Layers: 4 [2021-11-22 16:09:04 main:484] : INFO : # Threads: 1 [2021-11-22 16:09:04 main:486] : INFO : Preparing Dataset [2021-11-22 16:09:04 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 16:09:12 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 16:09:37 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2021-11-22 16:09:37 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 16:09:37 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 16:09:37 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2021-11-22 16:09:37 main:494] : INFO : Creating Model [2021-11-22 16:09:37 main:507] : INFO : Preparing config file [2021-11-22 16:09:37 main:511] : INFO : Found checkpoint, attempting to load... [2021-11-22 16:09:37 main:512] : INFO : Loading config [2021-11-22 16:09:37 main:514] : INFO : Loading state [2021-11-22 16:09:44 main:559] : INFO : Loading DataLoader into Memory [2021-11-22 16:09:44 main:562] : INFO : Starting Training [2021-11-22 16:10:10 main:574] : INFO : Epoch 1888 | loss: 0.00283673 | val_loss: 0.000841794 | Time: 26382.3 ms [2021-11-22 16:10:37 main:574] : INFO : Epoch 1889 | loss: 0.00061729 | val_loss: 0.000496842 | Time: 27360.2 ms [2021-11-22 16:11:07 main:574] : INFO : Epoch 1890 | loss: 0.000360759 | val_loss: 0.000267249 | Time: 29803.1 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1060 6GB) [2021-11-22 16:14:04 main:435] : INFO : Set logging level to 1 [2021-11-22 16:14:04 main:441] : INFO : Running in BOINC Client mode [2021-11-22 16:14:04 main:444] : INFO : Resolving all filenames [2021-11-22 16:14:04 main:452] : INFO : Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1) [2021-11-22 16:14:04 main:452] : INFO : Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636178168-2112-1_0_r766946233_1 (exists = 1) [2021-11-22 16:14:04 main:452] : INFO : Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636178168-2112-1_0_r766946233_0 (exists = 0) [2021-11-22 16:14:04 main:452] : INFO : Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636178168-2112-1 (exists = 1) [2021-11-22 16:14:04 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2021-11-22 16:14:04 main:472] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 [2021-11-22 16:14:04 main:474] : INFO : Configuration: [2021-11-22 16:14:04 main:475] : INFO : Model type: GRU [2021-11-22 16:14:04 main:476] : INFO : Validation Loss Threshold: 0.0001 [2021-11-22 16:14:04 main:477] : INFO : Max Epochs: 2048 [2021-11-22 16:14:04 main:478] : INFO : Batch Size: 128 [2021-11-22 16:14:04 main:479] : INFO : Learning Rate: 0.01 [2021-11-22 16:14:04 main:480] : INFO : Patience: 10 [2021-11-22 16:14:05 main:481] : INFO : Hidden Width: 12 [2021-11-22 16:14:05 main:482] : INFO : # Recurrent Layers: 4 [2021-11-22 16:14:05 main:483] : INFO : # Backend Layers: 4 [2021-11-22 16:14:05 main:484] : INFO : # Threads: 1 [2021-11-22 16:14:05 main:486] : INFO : Preparing Dataset [2021-11-22 16:14:05 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 16:14:16 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 16:14:19 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2021-11-22 16:14:19 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 16:14:24 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 16:14:24 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2021-11-22 16:14:24 main:494] : INFO : Creating Model [2021-11-22 16:14:24 main:507] : INFO : Preparing config file [2021-11-22 16:14:24 main:511] : INFO : Found checkpoint, attempting to load... [2021-11-22 16:14:24 main:512] : INFO : Loading config [2021-11-22 16:14:24 main:514] : INFO : Loading state [2021-11-22 16:14:26 main:559] : INFO : Loading DataLoader into Memory [2021-11-22 16:14:26 main:562] : INFO : Starting Training [2021-11-22 16:17:01 main:574] : INFO : Epoch 1888 | loss: 0.0027857 | val_loss: 0.000796814 | Time: 155711 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1060 6GB) [2021-11-22 16:19:06 main:435] : INFO : Set logging level to 1 [2021-11-22 16:19:06 main:441] : INFO : Running in BOINC Client mode [2021-11-22 16:19:06 main:444] : INFO : Resolving all filenames [2021-11-22 16:19:06 main:452] : INFO : Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1) [2021-11-22 16:19:06 main:452] : INFO : Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636178168-2112-1_0_r766946233_1 (exists = 1) [2021-11-22 16:19:06 main:452] : INFO : Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636178168-2112-1_0_r766946233_0 (exists = 0) [2021-11-22 16:19:12 main:452] : INFO : Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636178168-2112-1 (exists = 1) [2021-11-22 16:19:12 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2021-11-22 16:19:12 main:472] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 [2021-11-22 16:19:12 main:474] : INFO : Configuration: [2021-11-22 16:19:12 main:475] : INFO : Model type: GRU [2021-11-22 16:19:13 main:476] : INFO : Validation Loss Threshold: 0.0001 [2021-11-22 16:19:13 main:477] : INFO : Max Epochs: 2048 [2021-11-22 16:19:13 main:478] : INFO : Batch Size: 128 [2021-11-22 16:19:13 main:479] : INFO : Learning Rate: 0.01 [2021-11-22 16:19:13 main:480] : INFO : Patience: 10 [2021-11-22 16:19:13 main:481] : INFO : Hidden Width: 12 [2021-11-22 16:19:13 main:482] : INFO : # Recurrent Layers: 4 [2021-11-22 16:19:18 main:483] : INFO : # Backend Layers: 4 [2021-11-22 16:19:18 main:484] : INFO : # Threads: 1 [2021-11-22 16:19:19 main:486] : INFO : Preparing Dataset [2021-11-22 16:19:19 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 16:19:27 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 16:19:41 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2021-11-22 16:19:41 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 16:19:41 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 16:19:47 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2021-11-22 16:19:47 main:494] : INFO : Creating Model [2021-11-22 16:19:47 main:507] : INFO : Preparing config file [2021-11-22 16:19:47 main:511] : INFO : Found checkpoint, attempting to load... [2021-11-22 16:19:47 main:512] : INFO : Loading config [2021-11-22 16:19:47 main:514] : INFO : Loading state [2021-11-22 16:19:54 main:559] : INFO : Loading DataLoader into Memory [2021-11-22 16:19:54 main:562] : INFO : Starting Training [2021-11-22 16:22:11 main:574] : INFO : Epoch 1888 | loss: 0.00277793 | val_loss: 0.00082889 | Time: 136647 ms [2021-11-22 16:22:52 main:574] : INFO : Epoch 1889 | loss: 0.000577971 | val_loss: 0.000468132 | Time: 40431 ms [2021-11-22 16:23:22 main:574] : INFO : Epoch 1890 | loss: 0.000352846 | val_loss: 0.000261034 | Time: 30135 ms [2021-11-22 16:25:37 main:574] : INFO : Epoch 1891 | loss: 0.000221727 | val_loss: 0.000165404 | Time: 135540 ms [2021-11-22 16:27:55 main:574] : INFO : Epoch 1892 | loss: 0.000122148 | val_loss: 7.60933e-05 | Time: 137480 ms [2021-11-22 16:30:38 main:574] : INFO : Epoch 1893 | loss: 5.28269e-05 | val_loss: 4.23182e-05 | Time: 162617 ms [2021-11-22 16:32:17 main:574] : INFO : Epoch 1894 | loss: 3.41479e-05 | val_loss: 3.08736e-05 | Time: 99234.7 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1060 6GB) [2021-11-22 16:34:52 main:435] : INFO : Set logging level to 1 [2021-11-22 16:34:52 main:441] : INFO : Running in BOINC Client mode [2021-11-22 16:34:52 main:444] : INFO : Resolving all filenames [2021-11-22 16:34:52 main:452] : INFO : Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1) [2021-11-22 16:34:52 main:452] : INFO : Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636178168-2112-1_0_r766946233_1 (exists = 1) [2021-11-22 16:34:52 main:452] : INFO : Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636178168-2112-1_0_r766946233_0 (exists = 0) [2021-11-22 16:34:52 main:452] : INFO : Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636178168-2112-1 (exists = 1) [2021-11-22 16:34:52 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2021-11-22 16:34:52 main:472] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 [2021-11-22 16:34:52 main:474] : INFO : Configuration: [2021-11-22 16:34:52 main:475] : INFO : Model type: GRU [2021-11-22 16:34:52 main:476] : INFO : Validation Loss Threshold: 0.0001 [2021-11-22 16:34:52 main:477] : INFO : Max Epochs: 2048 [2021-11-22 16:34:52 main:478] : INFO : Batch Size: 128 [2021-11-22 16:34:52 main:479] : INFO : Learning Rate: 0.01 [2021-11-22 16:34:52 main:480] : INFO : Patience: 10 [2021-11-22 16:34:52 main:481] : INFO : Hidden Width: 12 [2021-11-22 16:34:53 main:482] : INFO : # Recurrent Layers: 4 [2021-11-22 16:34:53 main:483] : INFO : # Backend Layers: 4 [2021-11-22 16:34:53 main:484] : INFO : # Threads: 1 [2021-11-22 16:34:53 main:486] : INFO : Preparing Dataset [2021-11-22 16:34:53 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 16:34:54 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 16:35:06 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2021-11-22 16:35:06 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 16:35:06 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 16:35:07 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2021-11-22 16:35:07 main:494] : INFO : Creating Model [2021-11-22 16:35:07 main:507] : INFO : Preparing config file [2021-11-22 16:35:07 main:511] : INFO : Found checkpoint, attempting to load... [2021-11-22 16:35:07 main:512] : INFO : Loading config [2021-11-22 16:35:07 main:514] : INFO : Loading state [2021-11-22 16:35:09 main:559] : INFO : Loading DataLoader into Memory [2021-11-22 16:35:09 main:562] : INFO : Starting Training [2021-11-22 16:36:28 main:574] : INFO : Epoch 1888 | loss: 0.00272065 | val_loss: 0.000724974 | Time: 78394.1 ms [2021-11-22 16:36:51 main:574] : INFO : Epoch 1889 | loss: 0.000547243 | val_loss: 0.000433569 | Time: 23270.2 ms [2021-11-22 16:37:18 main:574] : INFO : Epoch 1890 | loss: 0.000341535 | val_loss: 0.00025743 | Time: 27436.3 ms [2021-11-22 16:37:44 main:574] : INFO : Epoch 1891 | loss: 0.000223658 | val_loss: 0.000171954 | Time: 25813.3 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1060 6GB) [2021-11-22 16:40:00 main:435] : INFO : Set logging level to 1 [2021-11-22 16:40:00 main:441] : INFO : Running in BOINC Client mode [2021-11-22 16:40:00 main:444] : INFO : Resolving all filenames [2021-11-22 16:40:01 main:452] : INFO : Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1) [2021-11-22 16:40:01 main:452] : INFO : Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636178168-2112-1_0_r766946233_1 (exists = 1) [2021-11-22 16:40:01 main:452] : INFO : Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636178168-2112-1_0_r766946233_0 (exists = 0) [2021-11-22 16:40:01 main:452] : INFO : Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636178168-2112-1 (exists = 1) [2021-11-22 16:40:01 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2021-11-22 16:40:01 main:472] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 [2021-11-22 16:40:01 main:474] : INFO : Configuration: [2021-11-22 16:40:01 main:475] : INFO : Model type: GRU [2021-11-22 16:40:01 main:476] : INFO : Validation Loss Threshold: 0.0001 [2021-11-22 16:40:01 main:477] : INFO : Max Epochs: 2048 [2021-11-22 16:40:01 main:478] : INFO : Batch Size: 128 [2021-11-22 16:40:01 main:479] : INFO : Learning Rate: 0.01 [2021-11-22 16:40:01 main:480] : INFO : Patience: 10 [2021-11-22 16:40:02 main:481] : INFO : Hidden Width: 12 [2021-11-22 16:40:02 main:482] : INFO : # Recurrent Layers: 4 [2021-11-22 16:40:02 main:483] : INFO : # Backend Layers: 4 [2021-11-22 16:40:02 main:484] : INFO : # Threads: 1 [2021-11-22 16:40:02 main:486] : INFO : Preparing Dataset [2021-11-22 16:40:02 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 16:40:02 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 16:40:05 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2021-11-22 16:40:05 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 16:40:06 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 16:40:06 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2021-11-22 16:40:07 main:494] : INFO : Creating Model [2021-11-22 16:40:07 main:507] : INFO : Preparing config file [2021-11-22 16:40:07 main:511] : INFO : Found checkpoint, attempting to load... [2021-11-22 16:40:07 main:512] : INFO : Loading config [2021-11-22 16:40:07 main:514] : INFO : Loading state [2021-11-22 16:40:09 main:559] : INFO : Loading DataLoader into Memory [2021-11-22 16:40:09 main:562] : INFO : Starting Training [2021-11-22 16:40:39 main:574] : INFO : Epoch 1888 | loss: 0.00271959 | val_loss: 0.000676226 | Time: 30195.8 ms [2021-11-22 16:41:05 main:574] : INFO : Epoch 1889 | loss: 0.000552826 | val_loss: 0.000442594 | Time: 25365.6 ms [2021-11-22 16:41:35 main:574] : INFO : Epoch 1890 | loss: 0.000345844 | val_loss: 0.000260889 | Time: 30590.1 ms [2021-11-22 16:42:01 main:574] : INFO : Epoch 1891 | loss: 0.000223871 | val_loss: 0.000169909 | Time: 25544.1 ms [2021-11-22 16:42:27 main:574] : INFO : Epoch 1892 | loss: 0.000132637 | val_loss: 8.69529e-05 | Time: 26129.4 ms [2021-11-22 16:42:53 main:574] : INFO : Epoch 1893 | loss: 6.06182e-05 | val_loss: 4.28e-05 | Time: 25008.8 ms [2021-11-22 16:43:19 main:574] : INFO : Epoch 1894 | loss: 3.62997e-05 | val_loss: 3.18889e-05 | Time: 26397.5 ms [2021-11-22 16:43:55 main:574] : INFO : Epoch 1895 | loss: 2.68231e-05 | val_loss: 2.6332e-05 | Time: 35777.8 ms [2021-11-22 16:44:19 main:574] : INFO : Epoch 1896 | loss: 2.35407e-05 | val_loss: 2.45342e-05 | Time: 24246.8 ms [2021-11-22 16:44:45 main:574] : INFO : Epoch 1897 | loss: 2.227e-05 | val_loss: 2.32048e-05 | Time: 25536.1 ms [2021-11-22 16:45:09 main:574] : INFO : Epoch 1898 | loss: 2.1592e-05 | val_loss: 2.25382e-05 | Time: 23927.1 ms [2021-11-22 16:45:35 main:574] : INFO : Epoch 1899 | loss: 2.10416e-05 | val_loss: 2.21529e-05 | Time: 25771.4 ms [2021-11-22 16:45:59 main:574] : INFO : Epoch 1900 | loss: 2.06129e-05 | val_loss: 2.20138e-05 | Time: 24421.8 ms [2021-11-22 16:46:25 main:574] : INFO : Epoch 1901 | loss: 2.07294e-05 | val_loss: 2.15769e-05 | Time: 25322.5 ms [2021-11-22 16:46:50 main:574] : INFO : Epoch 1902 | loss: 2.18819e-05 | val_loss: 2.13122e-05 | Time: 24946.1 ms [2021-11-22 16:47:17 main:574] : INFO : Epoch 1903 | loss: 2.01042e-05 | val_loss: 2.0432e-05 | Time: 26851.5 ms [2021-11-22 16:47:44 main:574] : INFO : Epoch 1904 | loss: 1.94242e-05 | val_loss: 2.04674e-05 | Time: 26510.2 ms [2021-11-22 16:48:10 main:574] : INFO : Epoch 1905 | loss: 1.92225e-05 | val_loss: 2.04872e-05 | Time: 25813 ms [2021-11-22 16:48:34 main:574] : INFO : Epoch 1906 | loss: 1.93046e-05 | val_loss: 2.07415e-05 | Time: 23942.8 ms [2021-11-22 16:49:00 main:574] : INFO : Epoch 1907 | loss: 1.93621e-05 | val_loss: 2.07849e-05 | Time: 26227 ms [2021-11-22 16:49:26 main:574] : INFO : Epoch 1908 | loss: 1.89411e-05 | val_loss: 2.11273e-05 | Time: 25858.9 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1060 6GB) [2021-11-22 16:53:30 main:435] : INFO : Set logging level to 1 [2021-11-22 16:53:30 main:441] : INFO : Running in BOINC Client mode [2021-11-22 16:53:31 main:444] : INFO : Resolving all filenames [2021-11-22 16:53:31 main:452] : INFO : Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1) [2021-11-22 16:53:31 main:452] : INFO : Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636178168-2112-1_0_r766946233_1 (exists = 1) [2021-11-22 16:53:31 main:452] : INFO : Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636178168-2112-1_0_r766946233_0 (exists = 0) [2021-11-22 16:53:31 main:452] : INFO : Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636178168-2112-1 (exists = 1) [2021-11-22 16:53:31 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2021-11-22 16:53:32 main:472] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 [2021-11-22 16:53:32 main:474] : INFO : Configuration: [2021-11-22 16:53:32 main:475] : INFO : Model type: GRU [2021-11-22 16:53:32 main:476] : INFO : Validation Loss Threshold: 0.0001 [2021-11-22 16:53:32 main:477] : INFO : Max Epochs: 2048 [2021-11-22 16:53:32 main:478] : INFO : Batch Size: 128 [2021-11-22 16:53:32 main:479] : INFO : Learning Rate: 0.01 [2021-11-22 16:53:32 main:480] : INFO : Patience: 10 [2021-11-22 16:53:33 main:481] : INFO : Hidden Width: 12 [2021-11-22 16:53:33 main:482] : INFO : # Recurrent Layers: 4 [2021-11-22 16:53:33 main:483] : INFO : # Backend Layers: 4 [2021-11-22 16:53:33 main:484] : INFO : # Threads: 1 [2021-11-22 16:53:33 main:486] : INFO : Preparing Dataset [2021-11-22 16:53:33 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 16:53:35 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 16:53:45 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2021-11-22 16:53:46 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 16:53:46 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 16:53:46 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2021-11-22 16:53:46 main:494] : INFO : Creating Model [2021-11-22 16:53:46 main:507] : INFO : Preparing config file [2021-11-22 16:53:46 main:511] : INFO : Found checkpoint, attempting to load... [2021-11-22 16:53:46 main:512] : INFO : Loading config [2021-11-22 16:53:46 main:514] : INFO : Loading state [2021-11-22 16:53:48 main:559] : INFO : Loading DataLoader into Memory [2021-11-22 16:53:48 main:562] : INFO : Starting Training [2021-11-22 16:54:14 main:574] : INFO : Epoch 1888 | loss: 0.00280373 | val_loss: 0.000744426 | Time: 26042.1 ms [2021-11-22 16:54:40 main:574] : INFO : Epoch 1889 | loss: 0.000565054 | val_loss: 0.000460869 | Time: 25894.9 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1060 6GB) [2021-11-22 16:57:06 main:435] : INFO : Set logging level to 1 [2021-11-22 16:57:06 main:441] : INFO : Running in BOINC Client mode [2021-11-22 16:57:06 main:444] : INFO : Resolving all filenames [2021-11-22 16:57:06 main:452] : INFO : Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1) [2021-11-22 16:57:06 main:452] : INFO : Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636178168-2112-1_0_r766946233_1 (exists = 1) [2021-11-22 16:57:06 main:452] : INFO : Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636178168-2112-1_0_r766946233_0 (exists = 0) [2021-11-22 16:57:07 main:452] : INFO : Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636178168-2112-1 (exists = 1) [2021-11-22 16:57:07 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2021-11-22 16:57:07 main:472] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 [2021-11-22 16:57:07 main:474] : INFO : Configuration: [2021-11-22 16:57:07 main:475] : INFO : Model type: GRU [2021-11-22 16:57:07 main:476] : INFO : Validation Loss Threshold: 0.0001 [2021-11-22 16:57:07 main:477] : INFO : Max Epochs: 2048 [2021-11-22 16:57:08 main:478] : INFO : Batch Size: 128 [2021-11-22 16:57:08 main:479] : INFO : Learning Rate: 0.01 [2021-11-22 16:57:08 main:480] : INFO : Patience: 10 [2021-11-22 16:57:08 main:481] : INFO : Hidden Width: 12 [2021-11-22 16:57:08 main:482] : INFO : # Recurrent Layers: 4 [2021-11-22 16:57:08 main:483] : INFO : # Backend Layers: 4 [2021-11-22 16:57:09 main:484] : INFO : # Threads: 1 [2021-11-22 16:57:09 main:486] : INFO : Preparing Dataset [2021-11-22 16:57:09 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 16:57:10 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 16:57:13 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2021-11-22 16:57:13 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 16:57:13 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 16:57:14 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2021-11-22 16:57:14 main:494] : INFO : Creating Model [2021-11-22 16:57:14 main:507] : INFO : Preparing config file [2021-11-22 16:57:14 main:511] : INFO : Found checkpoint, attempting to load... [2021-11-22 16:57:14 main:512] : INFO : Loading config [2021-11-22 16:57:14 main:514] : INFO : Loading state [2021-11-22 16:57:21 main:559] : INFO : Loading DataLoader into Memory [2021-11-22 16:57:21 main:562] : INFO : Starting Training [2021-11-22 16:57:49 main:574] : INFO : Epoch 1888 | loss: 0.00272546 | val_loss: 0.000773398 | Time: 28284.9 ms [2021-11-22 16:58:12 main:574] : INFO : Epoch 1889 | loss: 0.000574658 | val_loss: 0.000442489 | Time: 23209.9 ms [2021-11-22 16:58:40 main:574] : INFO : Epoch 1890 | loss: 0.000359231 | val_loss: 0.000272147 | Time: 27397.8 ms [2021-11-22 16:59:05 main:574] : INFO : Epoch 1891 | loss: 0.000239321 | val_loss: 0.000188599 | Time: 24729.7 ms [2021-11-22 16:59:31 main:574] : INFO : Epoch 1892 | loss: 0.000152032 | val_loss: 0.000107209 | Time: 24381.2 ms [2021-11-22 16:59:56 main:574] : INFO : Epoch 1893 | loss: 7.29326e-05 | val_loss: 4.69054e-05 | Time: 25261.4 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1060 6GB) [2021-11-22 17:02:17 main:435] : INFO : Set logging level to 1 [2021-11-22 17:02:17 main:441] : INFO : Running in BOINC Client mode [2021-11-22 17:02:17 main:444] : INFO : Resolving all filenames [2021-11-22 17:02:18 main:452] : INFO : Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1) [2021-11-22 17:02:18 main:452] : INFO : Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636178168-2112-1_0_r766946233_1 (exists = 1) [2021-11-22 17:02:18 main:452] : INFO : Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636178168-2112-1_0_r766946233_0 (exists = 0) [2021-11-22 17:02:18 main:452] : INFO : Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636178168-2112-1 (exists = 1) [2021-11-22 17:02:18 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2021-11-22 17:02:19 main:472] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 [2021-11-22 17:02:19 main:474] : INFO : Configuration: [2021-11-22 17:02:19 main:475] : INFO : Model type: GRU [2021-11-22 17:02:19 main:476] : INFO : Validation Loss Threshold: 0.0001 [2021-11-22 17:02:22 main:477] : INFO : Max Epochs: 2048 [2021-11-22 17:02:22 main:478] : INFO : Batch Size: 128 [2021-11-22 17:02:22 main:479] : INFO : Learning Rate: 0.01 [2021-11-22 17:02:22 main:480] : INFO : Patience: 10 [2021-11-22 17:02:23 main:481] : INFO : Hidden Width: 12 [2021-11-22 17:02:23 main:482] : INFO : # Recurrent Layers: 4 [2021-11-22 17:02:23 main:483] : INFO : # Backend Layers: 4 [2021-11-22 17:02:23 main:484] : INFO : # Threads: 1 [2021-11-22 17:02:23 main:486] : INFO : Preparing Dataset [2021-11-22 17:02:23 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 17:02:23 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 17:02:42 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2021-11-22 17:02:42 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 17:02:44 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-11-22 17:02:46 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2021-11-22 17:02:47 main:494] : INFO : Creating Model [2021-11-22 17:02:56 main:507] : INFO : Preparing config file [2021-11-22 17:02:56 main:511] : INFO : Found checkpoint, attempting to load... [2021-11-22 17:02:58 main:512] : INFO : Loading config [2021-11-22 17:02:58 main:514] : INFO : Loading state [2021-11-22 17:03:13 main:559] : INFO : Loading DataLoader into Memory [2021-11-22 17:03:14 main:562] : INFO : Starting Training [2021-11-22 17:05:06 main:574] : INFO : Epoch 1888 | loss: 0.0027935 | val_loss: 0.000805353 | Time: 111650 ms [2021-11-22 17:06:29 main:574] : INFO : Epoch 1889 | loss: 0.000589472 | val_loss: 0.000464922 | Time: 82092.1 ms [2021-11-22 17:08:16 main:574] : INFO : Epoch 1890 | loss: 0.00035154 | val_loss: 0.000260241 | Time: 107531 ms [2021-11-22 17:10:16 main:574] : INFO : Epoch 1891 | loss: 0.00022102 | val_loss: 0.000167421 | Time: 119675 ms [2021-11-22 17:12:03 main:574] : INFO : Epoch 1892 | loss: 0.000123924 | val_loss: 7.63278e-05 | Time: 106499 ms [2021-11-22 17:13:34 main:574] : INFO : Epoch 1893 | loss: 5.25836e-05 | val_loss: 4.20731e-05 | Time: 88424.2 ms [2021-11-22 17:15:14 main:574] : INFO : Epoch 1894 | loss: 3.40289e-05 | val_loss: 3.05572e-05 | Time: 99596.7 ms [2021-11-22 17:16:59 main:574] : INFO : Epoch 1895 | loss: 2.65004e-05 | val_loss: 2.64502e-05 | Time: 105083 ms [2021-11-22 17:18:37 main:574] : INFO : Epoch 1896 | loss: 2.389e-05 | val_loss: 2.47242e-05 | Time: 97749 ms [2021-11-22 17:20:30 main:574] : INFO : Epoch 1897 | loss: 2.2429e-05 | val_loss: 2.34631e-05 | Time: 112660 ms [2021-11-22 17:21:34 main:574] : INFO : Epoch 1898 | loss: 2.1562e-05 | val_loss: 2.28624e-05 | Time: 63043.5 ms [2021-11-22 17:23:25 main:574] : INFO : Epoch 1899 | loss: 2.10273e-05 | val_loss: 2.2263e-05 | Time: 110300 ms [2021-11-22 17:25:05 main:574] : INFO : Epoch 1900 | loss: 2.06629e-05 | val_loss: 2.21691e-05 | Time: 100354 ms [2021-11-22 17:26:36 main:574] : INFO : Epoch 1901 | loss: 2.09895e-05 | val_loss: 2.23137e-05 | Time: 90465.6 ms [2021-11-22 17:28:08 main:574] : INFO : Epoch 1902 | loss: 2.04837e-05 | val_loss: 2.15085e-05 | Time: 91637.4 ms [2021-11-22 17:29:23 main:574] : INFO : Epoch 1903 | loss: 2.02835e-05 | val_loss: 2.15034e-05 | Time: 75326.5 ms [2021-11-22 17:30:53 main:574] : INFO : Epoch 1904 | loss: 1.95324e-05 | val_loss: 2.15185e-05 | Time: 90206.1 ms [2021-11-22 17:32:02 main:574] : INFO : Epoch 1905 | loss: 2.26142e-05 | val_loss: 2.17698e-05 | Time: 68524 ms [2021-11-22 17:33:25 main:574] : INFO : Epoch 1906 | loss: 1.97072e-05 | val_loss: 2.10986e-05 | Time: 82884.9 ms [2021-11-22 17:34:23 main:574] : INFO : Epoch 1907 | loss: 1.90029e-05 | val_loss: 2.06742e-05 | Time: 58172.4 ms [2021-11-22 17:35:44 main:574] : INFO : Epoch 1908 | loss: 1.87301e-05 | val_loss: 2.03206e-05 | Time: 80250.1 ms [2021-11-22 17:36:48 main:574] : INFO : Epoch 1909 | loss: 1.85638e-05 | val_loss: 2.01896e-05 | Time: 64271.7 ms [2021-11-22 17:37:45 main:574] : INFO : Epoch 1910 | loss: 1.84743e-05 | val_loss: 2.01383e-05 | Time: 56474.2 ms [2021-11-22 17:38:43 main:574] : INFO : Epoch 1911 | loss: 2.03782e-05 | val_loss: 2.24244e-05 | Time: 58700 ms [2021-11-22 17:40:03 main:574] : INFO : Epoch 1912 | loss: 1.92513e-05 | val_loss: 2.01808e-05 | Time: 79892.2 ms [2021-11-22 17:42:42 main:574] : INFO : Epoch 1913 | loss: 1.83634e-05 | val_loss: 1.99045e-05 | Time: 158579 ms [2021-11-22 17:45:33 main:574] : INFO : Epoch 1914 | loss: 1.81247e-05 | val_loss: 1.9699e-05 | Time: 171059 ms [2021-11-22 17:48:02 main:574] : INFO : Epoch 1915 | loss: 1.80716e-05 | val_loss: 1.95479e-05 | Time: 149016 ms [2021-11-22 17:50:23 main:574] : INFO : Epoch 1916 | loss: 2.02385e-05 | val_loss: 2.35626e-05 | Time: 140390 ms [2021-11-22 17:52:50 main:574] : INFO : Epoch 1917 | loss: 1.90348e-05 | val_loss: 1.94549e-05 | Time: 147030 ms [2021-11-22 17:54:59 main:574] : INFO : Epoch 1918 | loss: 1.805e-05 | val_loss: 1.95457e-05 | Time: 128792 ms [2021-11-22 17:57:10 main:574] : INFO : Epoch 1919 | loss: 1.77942e-05 | val_loss: 1.94513e-05 | Time: 131390 ms [2021-11-22 17:59:29 main:574] : INFO : Epoch 1920 | loss: 1.78318e-05 | val_loss: 1.95258e-05 | Time: 138506 ms [2021-11-22 18:01:43 main:574] : INFO : Epoch 1921 | loss: 1.77232e-05 | val_loss: 1.92014e-05 | Time: 134489 ms [2021-11-22 18:03:54 main:574] : INFO : Epoch 1922 | loss: 2.06341e-05 | val_loss: 3.63208e-05 | Time: 130889 ms [2021-11-22 18:05:34 main:574] : INFO : Epoch 1923 | loss: 2.17229e-05 | val_loss: 2.15393e-05 | Time: 99272.4 ms [2021-11-22 18:06:05 main:574] : INFO : Epoch 1924 | loss: 1.82108e-05 | val_loss: 1.94567e-05 | Time: 31297.5 ms [2021-11-22 18:06:37 main:574] : INFO : Epoch 1925 | loss: 1.76191e-05 | val_loss: 1.92676e-05 | Time: 32163.9 ms [2021-11-22 18:07:13 main:574] : INFO : Epoch 1926 | loss: 1.75575e-05 | val_loss: 1.9004e-05 | Time: 35093 ms [2021-11-22 18:07:46 main:574] : INFO : Epoch 1927 | loss: 1.73584e-05 | val_loss: 1.91221e-05 | Time: 32568.4 ms [2021-11-22 18:08:22 main:574] : INFO : Epoch 1928 | loss: 1.73316e-05 | val_loss: 1.90034e-05 | Time: 35995.1 ms [2021-11-22 18:08:54 main:574] : INFO : Epoch 1929 | loss: 1.72802e-05 | val_loss: 1.89272e-05 | Time: 32115.3 ms [2021-11-22 18:09:26 main:574] : INFO : Epoch 1930 | loss: 1.78526e-05 | val_loss: 2.61584e-05 | Time: 32289.9 ms [2021-11-22 18:10:00 main:574] : INFO : Epoch 1931 | loss: 2.63182e-05 | val_loss: 2.48856e-05 | Time: 33143.6 ms [2021-11-22 18:10:34 main:574] : INFO : Epoch 1932 | loss: 1.91149e-05 | val_loss: 1.98601e-05 | Time: 33851.8 ms [2021-11-22 18:11:06 main:574] : INFO : Epoch 1933 | loss: 1.746e-05 | val_loss: 1.88904e-05 | Time: 32333.1 ms [2021-11-22 18:11:43 main:574] : INFO : Epoch 1934 | loss: 1.73269e-05 | val_loss: 1.89637e-05 | Time: 36076.4 ms [2021-11-22 18:12:14 main:574] : INFO : Epoch 1935 | loss: 1.84613e-05 | val_loss: 2.48557e-05 | Time: 31511.9 ms [2021-11-22 18:12:45 main:574] : INFO : Epoch 1936 | loss: 2.04696e-05 | val_loss: 2.46911e-05 | Time: 30736.6 ms [2021-11-22 18:13:21 main:574] : INFO : Epoch 1937 | loss: 1.93543e-05 | val_loss: 2.0943e-05 | Time: 35437.7 ms [2021-11-22 18:13:54 main:574] : INFO : Epoch 1938 | loss: 1.94207e-05 | val_loss: 1.89781e-05 | Time: 33317.5 ms [2021-11-22 18:14:26 main:574] : INFO : Epoch 1939 | loss: 2.26603e-05 | val_loss: 4.78775e-05 | Time: 31950.9 ms [2021-11-22 18:15:03 main:574] : INFO : Epoch 1940 | loss: 2.54696e-05 | val_loss: 1.90348e-05 | Time: 35931.3 ms [2021-11-22 18:15:36 main:574] : INFO : Epoch 1941 | loss: 1.92055e-05 | val_loss: 1.88891e-05 | Time: 32832.7 ms [2021-11-22 18:16:09 main:574] : INFO : Epoch 1942 | loss: 1.78757e-05 | val_loss: 1.86552e-05 | Time: 33635.9 ms [2021-11-22 18:16:43 main:574] : INFO : Epoch 1943 | loss: 1.90521e-05 | val_loss: 2.35252e-05 | Time: 33684.8 ms [2021-11-22 18:17:15 main:574] : INFO : Epoch 1944 | loss: 2.02586e-05 | val_loss: 3.35696e-05 | Time: 31569.7 ms [2021-11-22 18:17:54 main:574] : INFO : Epoch 1945 | loss: 2.26492e-05 | val_loss: 2.07741e-05 | Time: 38339.5 ms [2021-11-22 18:18:25 main:574] : INFO : Epoch 1946 | loss: 2.16601e-05 | val_loss: 2.07646e-05 | Time: 31505.2 ms [2021-11-22 18:19:00 main:574] : INFO : Epoch 1947 | loss: 2.25605e-05 | val_loss: 2.058e-05 | Time: 34392.8 ms [2021-11-22 18:19:33 main:574] : INFO : Epoch 1948 | loss: 2.05015e-05 | val_loss: 2.52481e-05 | Time: 33690.7 ms [2021-11-22 18:20:05 main:574] : INFO : Epoch 1949 | loss: 1.94065e-05 | val_loss: 1.89326e-05 | Time: 31732.9 ms [2021-11-22 18:20:37 main:574] : INFO : Epoch 1950 | loss: 1.8645e-05 | val_loss: 2.64489e-05 | Time: 32021.2 ms [2021-11-22 18:21:11 main:574] : INFO : Epoch 1951 | loss: 2.23501e-05 | val_loss: 2.10631e-05 | Time: 33065.3 ms [2021-11-22 18:21:44 main:574] : INFO : Epoch 1952 | loss: 1.73017e-05 | val_loss: 1.91188e-05 | Time: 33236.2 ms [2021-11-22 18:22:15 main:574] : INFO : Epoch 1953 | loss: 3.45909e-05 | val_loss: 2.63546e-05 | Time: 31053.1 ms [2021-11-22 18:22:48 main:574] : INFO : Epoch 1954 | loss: 2.51047e-05 | val_loss: 2.48472e-05 | Time: 32865 ms [2021-11-22 18:23:23 main:574] : INFO : Epoch 1955 | loss: 1.95027e-05 | val_loss: 2.17436e-05 | Time: 34758.9 ms [2021-11-22 18:23:55 main:574] : INFO : Epoch 1956 | loss: 1.76454e-05 | val_loss: 1.93989e-05 | Time: 31705.1 ms [2021-11-22 18:24:29 main:574] : INFO : Epoch 1957 | loss: 1.73905e-05 | val_loss: 1.90648e-05 | Time: 34540 ms [2021-11-22 18:25:04 main:574] : INFO : Epoch 1958 | loss: 2.19371e-05 | val_loss: 1.86412e-05 | Time: 34494.4 ms [2021-11-22 18:25:36 main:574] : INFO : Epoch 1959 | loss: 2.10497e-05 | val_loss: 1.91404e-05 | Time: 31536.3 ms [2021-11-22 18:26:08 main:574] : INFO : Epoch 1960 | loss: 1.92296e-05 | val_loss: 1.8535e-05 | Time: 32662.9 ms [2021-11-22 18:26:43 main:574] : INFO : Epoch 1961 | loss: 2.66229e-05 | val_loss: 3.03576e-05 | Time: 34322.4 ms [2021-11-22 18:27:15 main:574] : INFO : Epoch 1962 | loss: 2.43028e-05 | val_loss: 2.44633e-05 | Time: 31580 ms [2021-11-22 18:27:47 main:574] : INFO : Epoch 1963 | loss: 1.99929e-05 | val_loss: 1.83296e-05 | Time: 32363.2 ms [2021-11-22 18:28:25 main:574] : INFO : Epoch 1964 | loss: 1.7299e-05 | val_loss: 1.92316e-05 | Time: 38055.4 ms [2021-11-22 18:28:55 main:574] : INFO : Epoch 1965 | loss: 1.89144e-05 | val_loss: 2.0039e-05 | Time: 29207.8 ms [2021-11-22 18:29:22 main:574] : INFO : Epoch 1966 | loss: 1.78939e-05 | val_loss: 2.98775e-05 | Time: 26886 ms [2021-11-22 18:29:42 main:574] : INFO : Epoch 1967 | loss: 2.95415e-05 | val_loss: 2.67765e-05 | Time: 20460 ms [2021-11-22 18:30:03 main:574] : INFO : Epoch 1968 | loss: 2.28978e-05 | val_loss: 1.81965e-05 | Time: 20384.6 ms [2021-11-22 18:30:22 main:574] : INFO : Epoch 1969 | loss: 1.92005e-05 | val_loss: 1.90991e-05 | Time: 19070 ms [2021-11-22 18:30:41 main:574] : INFO : Epoch 1970 | loss: 2.3699e-05 | val_loss: 2.21079e-05 | Time: 18832.6 ms [2021-11-22 18:31:00 main:574] : INFO : Epoch 1971 | loss: 1.9392e-05 | val_loss: 1.82608e-05 | Time: 19007.3 ms [2021-11-22 18:31:19 main:574] : INFO : Epoch 1972 | loss: 2.34747e-05 | val_loss: 2.4025e-05 | Time: 18335.6 ms [2021-11-22 18:31:37 main:574] : INFO : Epoch 1973 | loss: 1.93757e-05 | val_loss: 2.03518e-05 | Time: 18403.9 ms [2021-11-22 18:31:57 main:574] : INFO : Epoch 1974 | loss: 1.98485e-05 | val_loss: 2.51597e-05 | Time: 19181.2 ms [2021-11-22 18:32:16 main:574] : INFO : Epoch 1975 | loss: 2.08124e-05 | val_loss: 2.60523e-05 | Time: 19069.8 ms [2021-11-22 18:32:36 main:574] : INFO : Epoch 1976 | loss: 2.89552e-05 | val_loss: 2.56905e-05 | Time: 20365.6 ms [2021-11-22 18:32:55 main:574] : INFO : Epoch 1977 | loss: 2.20384e-05 | val_loss: 1.82449e-05 | Time: 18853.1 ms [2021-11-22 18:33:15 main:574] : INFO : Epoch 1978 | loss: 1.97697e-05 | val_loss: 1.92473e-05 | Time: 19393.8 ms [2021-11-22 18:33:34 main:574] : INFO : Epoch 1979 | loss: 2.08119e-05 | val_loss: 2.02338e-05 | Time: 18923.1 ms [2021-11-22 18:33:53 main:574] : INFO : Epoch 1980 | loss: 2.02607e-05 | val_loss: 1.95072e-05 | Time: 19070.8 ms [2021-11-22 18:34:12 main:574] : INFO : Epoch 1981 | loss: 2.26594e-05 | val_loss: 2.24287e-05 | Time: 19024.7 ms [2021-11-22 18:34:31 main:574] : INFO : Epoch 1982 | loss: 2.22596e-05 | val_loss: 2.40449e-05 | Time: 18903.9 ms [2021-11-22 18:34:49 main:574] : INFO : Epoch 1983 | loss: 1.89055e-05 | val_loss: 1.81618e-05 | Time: 18241.7 ms [2021-11-22 18:35:09 main:574] : INFO : Epoch 1984 | loss: 1.63863e-05 | val_loss: 2.00661e-05 | Time: 19065.8 ms [2021-11-22 18:35:27 main:574] : INFO : Epoch 1985 | loss: 3.43957e-05 | val_loss: 2.0126e-05 | Time: 18501.3 ms [2021-11-22 18:35:46 main:574] : INFO : Epoch 1986 | loss: 2.39796e-05 | val_loss: 1.98135e-05 | Time: 19084.1 ms [2021-11-22 18:36:05 main:574] : INFO : Epoch 1987 | loss: 1.90751e-05 | val_loss: 1.87387e-05 | Time: 18712.6 ms [2021-11-22 18:36:24 main:574] : INFO : Epoch 1988 | loss: 1.70034e-05 | val_loss: 2.02841e-05 | Time: 19088.9 ms [2021-11-22 18:36:43 main:574] : INFO : Epoch 1989 | loss: 2.47377e-05 | val_loss: 1.95907e-05 | Time: 18611 ms [2021-11-22 18:37:03 main:574] : INFO : Epoch 1990 | loss: 2.0893e-05 | val_loss: 2.43607e-05 | Time: 19414.1 ms [2021-11-22 18:37:21 main:574] : INFO : Epoch 1991 | loss: 2.13825e-05 | val_loss: 2.57788e-05 | Time: 18243.2 ms [2021-11-22 18:37:40 main:574] : INFO : Epoch 1992 | loss: 2.07847e-05 | val_loss: 2.40691e-05 | Time: 18707.9 ms [2021-11-22 18:37:58 main:574] : INFO : Epoch 1993 | loss: 2.36273e-05 | val_loss: 2.6329e-05 | Time: 18327.6 ms [2021-11-22 18:38:18 main:574] : INFO : Epoch 1994 | loss: 2.04535e-05 | val_loss: 2.42501e-05 | Time: 19184.8 ms [2021-11-22 18:38:37 main:574] : INFO : Epoch 1995 | loss: 2.26825e-05 | val_loss: 2.41137e-05 | Time: 19148.2 ms [2021-11-22 18:38:56 main:574] : INFO : Epoch 1996 | loss: 2.02321e-05 | val_loss: 2.31662e-05 | Time: 19040.3 ms [2021-11-22 18:39:15 main:574] : INFO : Epoch 1997 | loss: 2.50815e-05 | val_loss: 2.79062e-05 | Time: 18891 ms [2021-11-22 18:39:35 main:574] : INFO : Epoch 1998 | loss: 2.30716e-05 | val_loss: 1.80799e-05 | Time: 19969.5 ms [2021-11-22 18:39:54 main:574] : INFO : Epoch 1999 | loss: 1.98382e-05 | val_loss: 2.00062e-05 | Time: 18802.2 ms [2021-11-22 18:40:13 main:574] : INFO : Epoch 2000 | loss: 1.80616e-05 | val_loss: 1.85775e-05 | Time: 19040.3 ms [2021-11-22 18:40:32 main:574] : INFO : Epoch 2001 | loss: 2.25373e-05 | val_loss: 1.84712e-05 | Time: 18873.4 ms [2021-11-22 18:40:51 main:574] : INFO : Epoch 2002 | loss: 2.60239e-05 | val_loss: 2.87723e-05 | Time: 18539 ms [2021-11-22 18:41:09 main:574] : INFO : Epoch 2003 | loss: 2.28182e-05 | val_loss: 1.89719e-05 | Time: 18228.4 ms [2021-11-22 18:41:28 main:574] : INFO : Epoch 2004 | loss: 1.97835e-05 | val_loss: 2.10328e-05 | Time: 18816.2 ms [2021-11-22 18:41:51 main:574] : INFO : Epoch 2005 | loss: 2.05252e-05 | val_loss: 2.18468e-05 | Time: 22619.6 ms [2021-11-22 18:42:09 main:574] : INFO : Epoch 2006 | loss: 2.56142e-05 | val_loss: 3.64783e-05 | Time: 18185.7 ms [2021-11-22 18:42:28 main:574] : INFO : Epoch 2007 | loss: 2.63745e-05 | val_loss: 2.40822e-05 | Time: 18958.5 ms [2021-11-22 18:42:47 main:574] : INFO : Epoch 2008 | loss: 2.14223e-05 | val_loss: 2.21967e-05 | Time: 19289.1 ms [2021-11-22 18:43:11 main:574] : INFO : Epoch 2009 | loss: 2.09111e-05 | val_loss: 2.08082e-05 | Time: 23669.2 ms [2021-11-22 18:43:35 main:574] : INFO : Epoch 2010 | loss: 2.93759e-05 | val_loss: 2.84154e-05 | Time: 24196.5 ms [2021-11-22 18:43:54 main:574] : INFO : Epoch 2011 | loss: 2.28094e-05 | val_loss: 1.7659e-05 | Time: 19015.3 ms [2021-11-22 18:44:14 main:574] : INFO : Epoch 2012 | loss: 2.15244e-05 | val_loss: 2.01202e-05 | Time: 19839.4 ms [2021-11-22 18:44:33 main:574] : INFO : Epoch 2013 | loss: 2.79475e-05 | val_loss: 2.17242e-05 | Time: 18952.2 ms [2021-11-22 18:44:53 main:574] : INFO : Epoch 2014 | loss: 2.64502e-05 | val_loss: 3.21357e-05 | Time: 18963.3 ms [2021-11-22 18:45:12 main:574] : INFO : Epoch 2015 | loss: 2.82777e-05 | val_loss: 2.49931e-05 | Time: 19015.7 ms [2021-11-22 18:45:31 main:574] : INFO : Epoch 2016 | loss: 2.16483e-05 | val_loss: 2.31212e-05 | Time: 18979.6 ms [2021-11-22 18:45:49 main:574] : INFO : Epoch 2017 | loss: 2.16491e-05 | val_loss: 1.71047e-05 | Time: 18411.7 ms [2021-11-22 18:46:08 main:574] : INFO : Epoch 2018 | loss: 1.90798e-05 | val_loss: 2.08969e-05 | Time: 18784.9 ms [2021-11-22 18:46:27 main:574] : INFO : Epoch 2019 | loss: 1.92647e-05 | val_loss: 2.62906e-05 | Time: 19117 ms [2021-11-22 18:46:47 main:574] : INFO : Epoch 2020 | loss: 2.25759e-05 | val_loss: 2.38058e-05 | Time: 19183.6 ms [2021-11-22 18:47:05 main:574] : INFO : Epoch 2021 | loss: 2.17285e-05 | val_loss: 1.71623e-05 | Time: 18470.8 ms [2021-11-22 18:47:25 main:574] : INFO : Epoch 2022 | loss: 1.95987e-05 | val_loss: 2.30119e-05 | Time: 19201 ms [2021-11-22 18:47:45 main:574] : INFO : Epoch 2023 | loss: 2.20827e-05 | val_loss: 3.47474e-05 | Time: 19962.7 ms [2021-11-22 18:48:04 main:574] : INFO : Epoch 2024 | loss: 2.52525e-05 | val_loss: 2.38611e-05 | Time: 19076 ms [2021-11-22 18:48:23 main:574] : INFO : Epoch 2025 | loss: 2.31399e-05 | val_loss: 1.94344e-05 | Time: 19208.6 ms [2021-11-22 18:48:42 main:574] : INFO : Epoch 2026 | loss: 1.76422e-05 | val_loss: 1.84917e-05 | Time: 19089.9 ms [2021-11-22 18:49:01 main:574] : INFO : Epoch 2027 | loss: 1.85191e-05 | val_loss: 2.94985e-05 | Time: 18933.3 ms [2021-11-22 18:49:20 main:574] : INFO : Epoch 2028 | loss: 2.60616e-05 | val_loss: 1.87779e-05 | Time: 18341.2 ms [2021-11-22 18:49:38 main:574] : INFO : Epoch 2029 | loss: 2.10864e-05 | val_loss: 2.86784e-05 | Time: 18667.6 ms [2021-11-22 18:49:58 main:574] : INFO : Epoch 2030 | loss: 2.52084e-05 | val_loss: 1.75213e-05 | Time: 19198 ms [2021-11-22 18:50:17 main:574] : INFO : Epoch 2031 | loss: 1.90353e-05 | val_loss: 2.23766e-05 | Time: 19457 ms [2021-11-22 18:50:36 main:574] : INFO : Epoch 2032 | loss: 2.44408e-05 | val_loss: 3.04085e-05 | Time: 18848.8 ms [2021-11-22 18:50:55 main:574] : INFO : Epoch 2033 | loss: 2.29383e-05 | val_loss: 2.18566e-05 | Time: 19305.8 ms [2021-11-22 18:51:14 main:574] : INFO : Epoch 2034 | loss: 1.72291e-05 | val_loss: 1.69521e-05 | Time: 18716 ms [2021-11-22 18:51:33 main:574] : INFO : Epoch 2035 | loss: 1.66701e-05 | val_loss: 2.12212e-05 | Time: 19167.4 ms [2021-11-22 18:51:52 main:574] : INFO : Epoch 2036 | loss: 2.8274e-05 | val_loss: 1.94875e-05 | Time: 18719.1 ms [2021-11-22 18:52:11 main:574] : INFO : Epoch 2037 | loss: 1.92677e-05 | val_loss: 1.84616e-05 | Time: 18779.9 ms [2021-11-22 18:52:29 main:574] : INFO : Epoch 2038 | loss: 2.1349e-05 | val_loss: 3.14544e-05 | Time: 18137.8 ms [2021-11-22 18:52:48 main:574] : INFO : Epoch 2039 | loss: 2.60553e-05 | val_loss: 2.32399e-05 | Time: 18683 ms [2021-11-22 18:53:08 main:574] : INFO : Epoch 2040 | loss: 2.17377e-05 | val_loss: 1.83379e-05 | Time: 19479.7 ms [2021-11-22 18:53:26 main:574] : INFO : Epoch 2041 | loss: 1.832e-05 | val_loss: 1.87448e-05 | Time: 18284.8 ms [2021-11-22 18:53:45 main:574] : INFO : Epoch 2042 | loss: 1.79e-05 | val_loss: 2.7133e-05 | Time: 18735.1 ms [2021-11-22 18:54:04 main:574] : INFO : Epoch 2043 | loss: 2.60792e-05 | val_loss: 2.78932e-05 | Time: 19059 ms [2021-11-22 18:54:22 main:574] : INFO : Epoch 2044 | loss: 2.57614e-05 | val_loss: 1.75717e-05 | Time: 18192.6 ms [2021-11-22 18:54:41 main:574] : INFO : Epoch 2045 | loss: 2.09528e-05 | val_loss: 2.47922e-05 | Time: 18597.2 ms [2021-11-22 18:55:00 main:574] : INFO : Epoch 2046 | loss: 2.05928e-05 | val_loss: 1.99284e-05 | Time: 18782.1 ms [2021-11-22 18:55:19 main:574] : INFO : Epoch 2047 | loss: 1.87357e-05 | val_loss: 2.34975e-05 | Time: 18798.1 ms [2021-11-22 18:55:38 main:574] : INFO : Epoch 2048 | loss: 1.86005e-05 | val_loss: 2.07636e-05 | Time: 19156.6 ms [2021-11-22 18:55:38 main:597] : INFO : Saving trained model to model-final.pt, val_loss 2.07636e-05 [2021-11-22 18:55:38 main:603] : INFO : Saving end state to config to file [2021-11-22 18:55:38 main:608] : INFO : Success, exiting.. 18:55:38 (6172): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)