Task 5113802
| Name | ParityModified-1607233785-4023-38_4 |
| Workunit | 3030353 |
| Created | 28 Apr 2021, 6:01:02 UTC |
| Sent | 1 May 2021, 22:34:19 UTC |
| Report deadline | 8 May 2021, 22:34:19 UTC |
| Received | 2 May 2021, 22:24:23 UTC |
| Server state | Over |
| Outcome | Validate error |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 11140 |
| Run time | 40 min 35 sec |
| CPU time | |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 13,358.80 GFLOPS |
| Application version | Machine Learning Dataset Generator (test) v9.80 (amdrocm) x86_64-pc-linux-gnu |
| Peak working set size | 1.43 GB |
| Peak swap size | 8.06 GB |
| Peak disk usage | 2.25 GB |
Stderr output
<core_client_version>7.16.16</core_client_version> <![CDATA[ <stderr_txt> DEBUG: Args: ../../projects/www.mlcathome.org_mlcathome/mlds-gpu_9.80_x86_64-pc-linux-gnu__rocm -c --maxepoch 128 nthreads: 1 gpudev: 0 Re-exec()-ing to set environment correctly 16:27:58 (380104): start_timer_thread(): pthread_create(): 22Machine Learning Dataset Generator v9.80 (Linux/x86_64) (libTorch: release/1.7 GPU: Vega 10 XL/XT [Radeon RX Vega 56/64]) [2021-05-02 16:27:58 main:442] : INFO : Set logging level to 1 [2021-05-02 16:27:58 main:448] : INFO : Running in BOINC Client mode [2021-05-02 16:27:58 main:451] : INFO : Resolving all filenames [2021-05-02 16:27:58 main:459] : INFO : Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1) [2021-05-02 16:27:58 main:459] : INFO : Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1607233785-4023-38_4_r812244238_1 (exists = 0) [2021-05-02 16:27:58 main:459] : INFO : Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1607233785-4023-38_4_r812244238_0 (exists = 0) [2021-05-02 16:27:58 main:459] : INFO : Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1607233785-4023-38 (exists = 1) [2021-05-02 16:27:58 main:459] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 0) [2021-05-02 16:27:58 main:479] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 [2021-05-02 16:27:58 main:481] : INFO : Configuration: [2021-05-02 16:27:58 main:482] : INFO : Model type: GRU [2021-05-02 16:27:58 main:483] : INFO : Validation Loss Threshold: 0.0001 [2021-05-02 16:27:58 main:484] : INFO : Max Epochs: 128 [2021-05-02 16:27:58 main:485] : INFO : Batch Size: 128 [2021-05-02 16:27:58 main:486] : INFO : Learning Rate: 0.01 [2021-05-02 16:27:58 main:487] : INFO : Patience: 10 [2021-05-02 16:27:58 main:488] : INFO : Hidden Width: 12 [2021-05-02 16:27:58 main:489] : INFO : # Recurrent Layers: 4 [2021-05-02 16:27:58 main:490] : INFO : # Backend Layers: 4 [2021-05-02 16:27:58 main:491] : INFO : # Threads: 1 [2021-05-02 16:27:58 main:493] : INFO : Preparing Dataset [2021-05-02 16:27:58 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-05-02 16:27:58 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-05-02 16:27:59 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2021-05-02 16:27:59 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-05-02 16:27:59 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-05-02 16:27:59 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2021-05-02 16:27:59 main:501] : INFO : Creating Model [2021-05-02 16:27:59 main:514] : INFO : Preparing config file [2021-05-02 16:27:59 main:526] : INFO : Creating new config file [2021-05-02 16:27:59 main:545] : INFO : This is a continuation WU, loading previous network [2021-05-02 16:27:59 main:566] : INFO : Loading DataLoader into Memory [2021-05-02 16:27:59 main:569] : INFO : Starting Training [2021-05-02 16:28:23 main:581] : INFO : Epoch 1 | loss: 0.0312369 | val_loss: 0.0311921 | Time: 23772.1 ms [2021-05-02 16:28:42 main:581] : INFO : Epoch 2 | loss: 0.0311849 | val_loss: 0.0311721 | Time: 18810.5 ms [2021-05-02 16:29:00 main:581] : INFO : Epoch 3 | loss: 0.031172 | val_loss: 0.0311655 | Time: 18696.2 ms [2021-05-02 16:29:19 main:581] : INFO : Epoch 4 | loss: 0.031166 | val_loss: 0.0311652 | Time: 18812.2 ms [2021-05-02 16:29:38 main:581] : INFO : Epoch 5 | loss: 0.0311638 | val_loss: 0.0311595 | Time: 18763.6 ms [2021-05-02 16:29:57 main:581] : INFO : Epoch 6 | loss: 0.0311594 | val_loss: 0.0311606 | Time: 18874 ms [2021-05-02 16:30:16 main:581] : INFO : Epoch 7 | loss: 0.0311568 | val_loss: 0.0311556 | Time: 18769.4 ms [2021-05-02 16:30:35 main:581] : INFO : Epoch 8 | loss: 0.031154 | val_loss: 0.0311534 | Time: 19007 ms [2021-05-02 16:30:53 main:581] : INFO : Epoch 9 | loss: 0.0311562 | val_loss: 0.0311545 | Time: 18657 ms [2021-05-02 16:31:12 main:581] : INFO : Epoch 10 | loss: 0.0311544 | val_loss: 0.0311514 | Time: 18787.5 ms [2021-05-02 16:31:31 main:581] : INFO : Epoch 11 | loss: 0.0311521 | val_loss: 0.0311494 | Time: 18631.9 ms [2021-05-02 16:31:49 main:581] : INFO : Epoch 12 | loss: 0.0311509 | val_loss: 0.0311514 | Time: 18705.8 ms [2021-05-02 16:32:08 main:581] : INFO : Epoch 13 | loss: 0.0311494 | val_loss: 0.0311477 | Time: 18777.5 ms [2021-05-02 16:32:27 main:581] : INFO : Epoch 14 | loss: 0.0311484 | val_loss: 0.0311474 | Time: 18792.5 ms [2021-05-02 16:32:46 main:581] : INFO : Epoch 15 | loss: 0.0311477 | val_loss: 0.0311509 | Time: 18898.3 ms [2021-05-02 16:33:05 main:581] : INFO : Epoch 16 | loss: 0.0311482 | val_loss: 0.0311463 | Time: 18868.7 ms [2021-05-02 16:33:24 main:581] : INFO : Epoch 17 | loss: 0.0311459 | val_loss: 0.0311446 | Time: 19589.4 ms [2021-05-02 16:33:43 main:581] : INFO : Epoch 18 | loss: 0.0311451 | val_loss: 0.0311471 | Time: 18707.6 ms [2021-05-02 16:34:02 main:581] : INFO : Epoch 19 | loss: 0.0311443 | val_loss: 0.0311465 | Time: 18679.2 ms [2021-05-02 16:34:21 main:581] : INFO : Epoch 20 | loss: 0.0311435 | val_loss: 0.031144 | Time: 18691.7 ms [2021-05-02 16:34:39 main:581] : INFO : Epoch 21 | loss: 0.0311423 | val_loss: 0.0311443 | Time: 18829.2 ms [2021-05-02 16:34:58 main:581] : INFO : Epoch 22 | loss: 0.0311431 | val_loss: 0.0311447 | Time: 18725.5 ms [2021-05-02 16:35:17 main:581] : INFO : Epoch 23 | loss: 0.0311413 | val_loss: 0.0311493 | Time: 18667.9 ms [2021-05-02 16:35:35 main:581] : INFO : Epoch 24 | loss: 0.0311423 | val_loss: 0.0311446 | Time: 18648 ms [2021-05-02 16:35:54 main:581] : INFO : Epoch 25 | loss: 0.0311394 | val_loss: 0.0311446 | Time: 18862.2 ms [2021-05-02 16:36:13 main:581] : INFO : Epoch 26 | loss: 0.0311385 | val_loss: 0.0311424 | Time: 18630.2 ms [2021-05-02 16:36:32 main:581] : INFO : Epoch 27 | loss: 0.0311377 | val_loss: 0.0311429 | Time: 18751.6 ms [2021-05-02 16:36:50 main:581] : INFO : Epoch 28 | loss: 0.0311371 | val_loss: 0.0311447 | Time: 18611.9 ms [2021-05-02 16:37:09 main:581] : INFO : Epoch 29 | loss: 0.0311365 | val_loss: 0.0311431 | Time: 18677.8 ms [2021-05-02 16:37:28 main:581] : INFO : Epoch 30 | loss: 0.0311358 | val_loss: 0.0311446 | Time: 18768.2 ms [2021-05-02 16:37:47 main:581] : INFO : Epoch 31 | loss: 0.0311355 | val_loss: 0.0311456 | Time: 18890 ms [2021-05-02 16:38:05 main:581] : INFO : Epoch 32 | loss: 0.0311372 | val_loss: 0.031146 | Time: 18834.4 ms [2021-05-02 16:38:24 main:581] : INFO : Epoch 33 | loss: 0.0311381 | val_loss: 0.0311458 | Time: 18805 ms [2021-05-02 16:38:43 main:581] : INFO : Epoch 34 | loss: 0.0311389 | val_loss: 0.0311449 | Time: 18796.1 ms [2021-05-02 16:39:02 main:581] : INFO : Epoch 35 | loss: 0.031141 | val_loss: 0.0311459 | Time: 18826.1 ms [2021-05-02 16:39:21 main:581] : INFO : Epoch 36 | loss: 0.0311409 | val_loss: 0.0311472 | Time: 18764.9 ms [2021-05-02 16:39:39 main:581] : INFO : Epoch 37 | loss: 0.0311389 | val_loss: 0.0311462 | Time: 18752.3 ms [2021-05-02 16:39:58 main:581] : INFO : Epoch 38 | loss: 0.0311376 | val_loss: 0.0311454 | Time: 18759.8 ms [2021-05-02 16:40:17 main:581] : INFO : Epoch 39 | loss: 0.0311377 | val_loss: 0.0311462 | Time: 18730.2 ms [2021-05-02 16:40:36 main:581] : INFO : Epoch 40 | loss: 0.0311359 | val_loss: 0.0311463 | Time: 18866.1 ms [2021-05-02 16:40:54 main:581] : INFO : Epoch 41 | loss: 0.0311366 | val_loss: 0.0311472 | Time: 18650.7 ms [2021-05-02 16:41:13 main:581] : INFO : Epoch 42 | loss: 0.0311347 | val_loss: 0.0311463 | Time: 18815 ms [2021-05-02 16:41:32 main:581] : INFO : Epoch 43 | loss: 0.0311345 | val_loss: 0.0311448 | Time: 18815.6 ms [2021-05-02 16:41:51 main:581] : INFO : Epoch 44 | loss: 0.0311342 | val_loss: 0.0311474 | Time: 18899.8 ms [2021-05-02 16:42:10 main:581] : INFO : Epoch 45 | loss: 0.0311321 | val_loss: 0.0311461 | Time: 18679.8 ms [2021-05-02 16:42:29 main:581] : INFO : Epoch 46 | loss: 0.0311326 | val_loss: 0.031152 | Time: 18950.5 ms [2021-05-02 16:42:47 main:581] : INFO : Epoch 47 | loss: 0.0311323 | val_loss: 0.0311493 | Time: 18840.6 ms [2021-05-02 16:43:06 main:581] : INFO : Epoch 48 | loss: 0.0311319 | val_loss: 0.0311495 | Time: 18683.2 ms [2021-05-02 16:43:25 main:581] : INFO : Epoch 49 | loss: 0.0311342 | val_loss: 0.0311501 | Time: 18683.1 ms [2021-05-02 16:43:44 main:581] : INFO : Epoch 50 | loss: 0.0311361 | val_loss: 0.0311483 | Time: 18795.1 ms [2021-05-02 16:44:02 main:581] : INFO : Epoch 51 | loss: 0.0311379 | val_loss: 0.0311504 | Time: 18713.4 ms [2021-05-02 16:44:21 main:581] : INFO : Epoch 52 | loss: 0.031134 | val_loss: 0.0311517 | Time: 18751.3 ms [2021-05-02 16:44:40 main:581] : INFO : Epoch 53 | loss: 0.031133 | val_loss: 0.0311475 | Time: 18874.8 ms [2021-05-02 16:44:59 main:581] : INFO : Epoch 54 | loss: 0.0311331 | val_loss: 0.0311487 | Time: 18883.2 ms [2021-05-02 16:45:18 main:581] : INFO : Epoch 55 | loss: 0.0311322 | val_loss: 0.031148 | Time: 18806.2 ms [2021-05-02 16:45:36 main:581] : INFO : Epoch 56 | loss: 0.0311311 | val_loss: 0.0311484 | Time: 18708.9 ms [2021-05-02 16:45:55 main:581] : INFO : Epoch 57 | loss: 0.0311321 | val_loss: 0.0311465 | Time: 18844.1 ms [2021-05-02 16:46:14 main:581] : INFO : Epoch 58 | loss: 0.0311324 | val_loss: 0.0311476 | Time: 18670.8 ms [2021-05-02 16:46:33 main:581] : INFO : Epoch 59 | loss: 0.0311318 | val_loss: 0.0311471 | Time: 18818.9 ms [2021-05-02 16:46:51 main:581] : INFO : Epoch 60 | loss: 0.0311321 | val_loss: 0.0311481 | Time: 18774.7 ms [2021-05-02 16:47:10 main:581] : INFO : Epoch 61 | loss: 0.03113 | val_loss: 0.031151 | Time: 18777.4 ms [2021-05-02 16:47:29 main:581] : INFO : Epoch 62 | loss: 0.0311313 | val_loss: 0.0311468 | Time: 18808 ms [2021-05-02 16:47:48 main:581] : INFO : Epoch 63 | loss: 0.0311321 | val_loss: 0.0311463 | Time: 18752.2 ms [2021-05-02 16:48:06 main:581] : INFO : Epoch 64 | loss: 0.0311322 | val_loss: 0.0311469 | Time: 18765.3 ms [2021-05-02 16:48:25 main:581] : INFO : Epoch 65 | loss: 0.0311305 | val_loss: 0.0311477 | Time: 18773.5 ms [2021-05-02 16:48:44 main:581] : INFO : Epoch 66 | loss: 0.0311295 | val_loss: 0.0311466 | Time: 18801.6 ms [2021-05-02 16:49:03 main:581] : INFO : Epoch 67 | loss: 0.0311283 | val_loss: 0.03115 | Time: 18884.1 ms [2021-05-02 16:49:22 main:581] : INFO : Epoch 68 | loss: 0.0311284 | val_loss: 0.0311496 | Time: 18861.9 ms [2021-05-02 16:49:41 main:581] : INFO : Epoch 69 | loss: 0.0311297 | val_loss: 0.0311528 | Time: 18711.2 ms [2021-05-02 16:49:59 main:581] : INFO : Epoch 70 | loss: 0.0311303 | val_loss: 0.0311449 | Time: 18858 ms [2021-05-02 16:50:18 main:581] : INFO : Epoch 71 | loss: 0.0311299 | val_loss: 0.0311452 | Time: 18881.9 ms [2021-05-02 16:50:37 main:581] : INFO : Epoch 72 | loss: 0.0311274 | val_loss: 0.0311454 | Time: 18787.2 ms [2021-05-02 16:50:56 main:581] : INFO : Epoch 73 | loss: 0.031128 | val_loss: 0.0311492 | Time: 18681.4 ms [2021-05-02 16:51:15 main:581] : INFO : Epoch 74 | loss: 0.0311302 | val_loss: 0.0311442 | Time: 18810.4 ms [2021-05-02 16:51:33 main:581] : INFO : Epoch 75 | loss: 0.0311292 | val_loss: 0.0311469 | Time: 18747.6 ms [2021-05-02 16:51:52 main:581] : INFO : Epoch 76 | loss: 0.031127 | val_loss: 0.0311443 | Time: 18817.5 ms [2021-05-02 16:52:11 main:581] : INFO : Epoch 77 | loss: 0.0311294 | val_loss: 0.031153 | Time: 18735.9 ms [2021-05-02 16:52:30 main:581] : INFO : Epoch 78 | loss: 0.0311298 | val_loss: 0.031144 | Time: 18798.4 ms [2021-05-02 16:52:48 main:581] : INFO : Epoch 79 | loss: 0.0311291 | val_loss: 0.031148 | Time: 18809.5 ms [2021-05-02 16:53:07 main:581] : INFO : Epoch 80 | loss: 0.0311314 | val_loss: 0.0311472 | Time: 18739 ms [2021-05-02 16:53:26 main:581] : INFO : Epoch 81 | loss: 0.0311293 | val_loss: 0.0311455 | Time: 18754.4 ms [2021-05-02 16:53:45 main:581] : INFO : Epoch 82 | loss: 0.0311289 | val_loss: 0.0311477 | Time: 18778.3 ms [2021-05-02 16:54:03 main:581] : INFO : Epoch 83 | loss: 0.0311313 | val_loss: 0.0311494 | Time: 18737.5 ms [2021-05-02 16:54:22 main:581] : INFO : Epoch 84 | loss: 0.0311295 | val_loss: 0.0311466 | Time: 19056.4 ms [2021-05-02 16:54:42 main:581] : INFO : Epoch 85 | loss: 0.0311284 | val_loss: 0.0311476 | Time: 19205.5 ms [2021-05-02 16:55:01 main:581] : INFO : Epoch 86 | loss: 0.0311263 | val_loss: 0.0311484 | Time: 19250.1 ms [2021-05-02 16:55:20 main:581] : INFO : Epoch 87 | loss: 0.0311256 | val_loss: 0.0311479 | Time: 18956.3 ms [2021-05-02 16:55:40 main:581] : INFO : Epoch 88 | loss: 0.0311246 | val_loss: 0.0311489 | Time: 20381 ms [2021-05-02 16:56:00 main:581] : INFO : Epoch 89 | loss: 0.0311252 | val_loss: 0.0311478 | Time: 19652.8 ms [2021-05-02 16:56:20 main:581] : INFO : Epoch 90 | loss: 0.0311266 | val_loss: 0.0311513 | Time: 19667.7 ms DEBUG: Args: ../../projects/www.mlcathome.org_mlcathome/mlds-gpu_9.80_x86_64-pc-linux-gnu__rocm -c --maxepoch 128 nthreads: 1 gpudev: 0 Re-exec()-ing to set environment correctly 16:57:16 (517427): start_timer_thread(): pthread_create(): 22Machine Learning Dataset Generator v9.80 (Linux/x86_64) (libTorch: release/1.7 GPU: Vega 10 XL/XT [Radeon RX Vega 56/64]) [2021-05-02 16:57:16 main:442] : INFO : Set logging level to 1 [2021-05-02 16:57:16 main:448] : INFO : Running in BOINC Client mode [2021-05-02 16:57:16 main:451] : INFO : Resolving all filenames [2021-05-02 16:57:16 main:459] : INFO : Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1) [2021-05-02 16:57:16 main:459] : INFO : Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1607233785-4023-38_4_r812244238_1 (exists = 1) [2021-05-02 16:57:16 main:459] : INFO : Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1607233785-4023-38_4_r812244238_0 (exists = 0) [2021-05-02 16:57:16 main:459] : INFO : Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1607233785-4023-38 (exists = 1) [2021-05-02 16:57:16 main:459] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 0) [2021-05-02 16:57:16 main:479] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 [2021-05-02 16:57:16 main:481] : INFO : Configuration: [2021-05-02 16:57:16 main:482] : INFO : Model type: GRU [2021-05-02 16:57:16 main:483] : INFO : Validation Loss Threshold: 0.0001 [2021-05-02 16:57:16 main:484] : INFO : Max Epochs: 128 [2021-05-02 16:57:16 main:485] : INFO : Batch Size: 128 [2021-05-02 16:57:16 main:486] : INFO : Learning Rate: 0.01 [2021-05-02 16:57:16 main:487] : INFO : Patience: 10 [2021-05-02 16:57:16 main:488] : INFO : Hidden Width: 12 [2021-05-02 16:57:16 main:489] : INFO : # Recurrent Layers: 4 [2021-05-02 16:57:16 main:490] : INFO : # Backend Layers: 4 [2021-05-02 16:57:16 main:491] : INFO : # Threads: 1 [2021-05-02 16:57:16 main:493] : INFO : Preparing Dataset [2021-05-02 16:57:16 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-05-02 16:57:16 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-05-02 16:57:17 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2021-05-02 16:57:17 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-05-02 16:57:17 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-05-02 16:57:17 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2021-05-02 16:57:17 main:501] : INFO : Creating Model [2021-05-02 16:57:17 main:514] : INFO : Preparing config file [2021-05-02 16:57:17 main:526] : INFO : Creating new config file [2021-05-02 16:57:17 main:545] : INFO : This is a continuation WU, loading previous network [2021-05-02 16:57:17 main:566] : INFO : Loading DataLoader into Memory [2021-05-02 16:57:17 main:569] : INFO : Starting Training [2021-05-02 16:57:43 main:581] : INFO : Epoch 1 | loss: 0.0312376 | val_loss: 0.0311879 | Time: 26045.5 ms [2021-05-02 16:58:04 main:581] : INFO : Epoch 2 | loss: 0.0311844 | val_loss: 0.031174 | Time: 20785.1 ms [2021-05-02 16:58:25 main:581] : INFO : Epoch 3 | loss: 0.0311745 | val_loss: 0.0311695 | Time: 21196.4 ms [2021-05-02 16:58:46 main:581] : INFO : Epoch 4 | loss: 0.0311678 | val_loss: 0.0311631 | Time: 21344.5 ms [2021-05-02 16:59:07 main:581] : INFO : Epoch 5 | loss: 0.0311627 | val_loss: 0.0311587 | Time: 21176.1 ms [2021-05-02 16:59:28 main:581] : INFO : Epoch 6 | loss: 0.0311595 | val_loss: 0.0311562 | Time: 20790 ms [2021-05-02 16:59:49 main:581] : INFO : Epoch 7 | loss: 0.0311565 | val_loss: 0.0311524 | Time: 20653.4 ms [2021-05-02 17:00:09 main:581] : INFO : Epoch 8 | loss: 0.0311513 | val_loss: 0.0311494 | Time: 20402.6 ms [2021-05-02 17:00:30 main:581] : INFO : Epoch 9 | loss: 0.0311486 | val_loss: 0.0311504 | Time: 20241.4 ms [2021-05-02 17:00:50 main:581] : INFO : Epoch 10 | loss: 0.0311491 | val_loss: 0.0311485 | Time: 20619.3 ms [2021-05-02 17:01:11 main:581] : INFO : Epoch 11 | loss: 0.0311442 | val_loss: 0.0311489 | Time: 20368.5 ms [2021-05-02 17:01:31 main:581] : INFO : Epoch 12 | loss: 0.031143 | val_loss: 0.0311489 | Time: 20535.9 ms [2021-05-02 17:01:52 main:581] : INFO : Epoch 13 | loss: 0.0311408 | val_loss: 0.0311506 | Time: 20439.8 ms [2021-05-02 17:02:12 main:581] : INFO : Epoch 14 | loss: 0.03114 | val_loss: 0.0311448 | Time: 20371.2 ms [2021-05-02 17:02:32 main:581] : INFO : Epoch 15 | loss: 0.0311394 | val_loss: 0.0311493 | Time: 20536.6 ms [2021-05-02 17:02:53 main:581] : INFO : Epoch 16 | loss: 0.0311451 | val_loss: 0.031151 | Time: 20654.1 ms [2021-05-02 17:03:13 main:581] : INFO : Epoch 17 | loss: 0.0311442 | val_loss: 0.0311491 | Time: 20125.2 ms [2021-05-02 17:03:34 main:581] : INFO : Epoch 18 | loss: 0.0311412 | val_loss: 0.0311436 | Time: 20467.1 ms [2021-05-02 17:03:54 main:581] : INFO : Epoch 19 | loss: 0.0311387 | val_loss: 0.0311439 | Time: 19976.9 ms [2021-05-02 17:04:14 main:581] : INFO : Epoch 20 | loss: 0.0311372 | val_loss: 0.0311428 | Time: 20371.7 ms [2021-05-02 17:04:35 main:581] : INFO : Epoch 21 | loss: 0.0311393 | val_loss: 0.0311456 | Time: 20531.5 ms DEBUG: Args: ../../projects/www.mlcathome.org_mlcathome/mlds-gpu_9.80_x86_64-pc-linux-gnu__rocm -c --maxepoch 128 nthreads: 1 gpudev: 0 Re-exec()-ing to set environment correctly 17:43:34 (755483): start_timer_thread(): pthread_create(): 22Machine Learning Dataset Generator v9.80 (Linux/x86_64) (libTorch: release/1.7 GPU: Vega 10 XL/XT [Radeon RX Vega 56/64]) [2021-05-02 17:43:34 main:442] : INFO : Set logging level to 1 [2021-05-02 17:43:34 main:448] : INFO : Running in BOINC Client mode [2021-05-02 17:43:34 main:451] : INFO : Resolving all filenames [2021-05-02 17:43:34 main:459] : INFO : Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1) [2021-05-02 17:43:34 main:459] : INFO : Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1607233785-4023-38_4_r812244238_1 (exists = 1) [2021-05-02 17:43:34 main:459] : INFO : Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1607233785-4023-38_4_r812244238_0 (exists = 0) [2021-05-02 17:43:34 main:459] : INFO : Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1607233785-4023-38 (exists = 1) [2021-05-02 17:43:34 main:459] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 0) [2021-05-02 17:43:34 main:479] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 [2021-05-02 17:43:34 main:481] : INFO : Configuration: [2021-05-02 17:43:34 main:482] : INFO : Model type: GRU [2021-05-02 17:43:34 main:483] : INFO : Validation Loss Threshold: 0.0001 [2021-05-02 17:43:34 main:484] : INFO : Max Epochs: 128 [2021-05-02 17:43:34 main:485] : INFO : Batch Size: 128 [2021-05-02 17:43:34 main:486] : INFO : Learning Rate: 0.01 [2021-05-02 17:43:34 main:487] : INFO : Patience: 10 [2021-05-02 17:43:34 main:488] : INFO : Hidden Width: 12 [2021-05-02 17:43:34 main:489] : INFO : # Recurrent Layers: 4 [2021-05-02 17:43:34 main:490] : INFO : # Backend Layers: 4 [2021-05-02 17:43:34 main:491] : INFO : # Threads: 1 [2021-05-02 17:43:34 main:493] : INFO : Preparing Dataset [2021-05-02 17:43:34 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-05-02 17:43:34 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-05-02 17:43:34 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2021-05-02 17:43:34 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-05-02 17:43:35 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory [2021-05-02 17:43:35 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2021-05-02 17:43:35 main:501] : INFO : Creating Model [2021-05-02 17:43:35 main:514] : INFO : Preparing config file [2021-05-02 17:43:35 main:526] : INFO : Creating new config file [2021-05-02 17:43:35 main:545] : INFO : This is a continuation WU, loading previous network [2021-05-02 17:43:35 main:566] : INFO : Loading DataLoader into Memory [2021-05-02 17:43:35 main:569] : INFO : Starting Training [2021-05-02 17:43:57 main:581] : INFO : Epoch 1 | loss: 0.0312309 | val_loss: 0.0311825 | Time: 22745.7 ms [2021-05-02 17:44:16 main:581] : INFO : Epoch 2 | loss: 0.0311858 | val_loss: 0.0311722 | Time: 18837.3 ms [2021-05-02 17:44:35 main:581] : INFO : Epoch 3 | loss: 0.0311727 | val_loss: 0.0311626 | Time: 19164.8 ms [2021-05-02 17:44:54 main:581] : INFO : Epoch 4 | loss: 0.0311636 | val_loss: 0.0311618 | Time: 19130.9 ms [2021-05-02 17:45:14 main:581] : INFO : Epoch 5 | loss: 0.031158 | val_loss: 0.0311574 | Time: 19174.3 ms [2021-05-02 17:45:33 main:581] : INFO : Epoch 6 | loss: 0.0311541 | val_loss: 0.031155 | Time: 19208.7 ms [2021-05-02 17:45:52 main:581] : INFO : Epoch 7 | loss: 0.0311503 | val_loss: 0.0311562 | Time: 19224.4 ms [2021-05-02 17:46:11 main:581] : INFO : Epoch 8 | loss: 0.0311523 | val_loss: 0.0311577 | Time: 18908.5 ms [2021-05-02 17:46:30 main:581] : INFO : Epoch 9 | loss: 0.031151 | val_loss: 0.0311556 | Time: 18990.4 ms [2021-05-02 17:46:49 main:581] : INFO : Epoch 10 | loss: 0.0311486 | val_loss: 0.0311487 | Time: 19161.4 ms [2021-05-02 17:47:08 main:581] : INFO : Epoch 11 | loss: 0.031146 | val_loss: 0.031148 | Time: 19019.4 ms [2021-05-02 17:47:27 main:581] : INFO : Epoch 12 | loss: 0.031146 | val_loss: 0.0311457 | Time: 19041.6 ms [2021-05-02 17:47:46 main:581] : INFO : Epoch 13 | loss: 0.0311467 | val_loss: 0.031149 | Time: 18818 ms [2021-05-02 17:48:05 main:581] : INFO : Epoch 14 | loss: 0.0311457 | val_loss: 0.031149 | Time: 19038.8 ms [2021-05-02 17:48:24 main:581] : INFO : Epoch 15 | loss: 0.0311444 | val_loss: 0.0311488 | Time: 18923.2 ms [2021-05-02 17:48:43 main:581] : INFO : Epoch 16 | loss: 0.0311436 | val_loss: 0.0311458 | Time: 18830.7 ms [2021-05-02 17:49:02 main:581] : INFO : Epoch 17 | loss: 0.0311435 | val_loss: 0.0311487 | Time: 18859.1 ms [2021-05-02 17:49:21 main:581] : INFO : Epoch 18 | loss: 0.0311498 | val_loss: 0.0311622 | Time: 19016.8 ms [2021-05-02 17:49:40 main:581] : INFO : Epoch 19 | loss: 0.031163 | val_loss: 0.0311637 | Time: 18951.7 ms [2021-05-02 17:49:59 main:581] : INFO : Epoch 20 | loss: 0.031163 | val_loss: 0.0311664 | Time: 19001.3 ms [2021-05-02 17:50:18 main:581] : INFO : Epoch 21 | loss: 0.0311584 | val_loss: 0.0311602 | Time: 19067.1 ms [2021-05-02 17:50:37 main:581] : INFO : Epoch 22 | loss: 0.0311598 | val_loss: 0.0311529 | Time: 18973.9 ms [2021-05-02 17:50:56 main:581] : INFO : Epoch 23 | loss: 0.0311539 | val_loss: 0.0311505 | Time: 19114.8 ms [2021-05-02 17:51:15 main:581] : INFO : Epoch 24 | loss: 0.0311519 | val_loss: 0.0311524 | Time: 18927.3 ms [2021-05-02 17:51:34 main:581] : INFO : Epoch 25 | loss: 0.0311518 | val_loss: 0.0311535 | Time: 19055.5 ms [2021-05-02 17:51:53 main:581] : INFO : Epoch 26 | loss: 0.031153 | val_loss: 0.0311492 | Time: 19066.7 ms [2021-05-02 17:52:12 main:581] : INFO : Epoch 27 | loss: 0.031148 | val_loss: 0.0311532 | Time: 19048.5 ms [2021-05-02 17:52:31 main:581] : INFO : Epoch 28 | loss: 0.031148 | val_loss: 0.0311493 | Time: 18977.6 ms [2021-05-02 17:52:50 main:581] : INFO : Epoch 29 | loss: 0.0311456 | val_loss: 0.0311493 | Time: 19014.5 ms [2021-05-02 17:53:09 main:581] : INFO : Epoch 30 | loss: 0.0311443 | val_loss: 0.0311492 | Time: 19244.2 ms [2021-05-02 17:53:28 main:581] : INFO : Epoch 31 | loss: 0.0311444 | val_loss: 0.0311507 | Time: 19205.6 ms [2021-05-02 17:53:48 main:581] : INFO : Epoch 32 | loss: 0.0311432 | val_loss: 0.0311493 | Time: 19197.4 ms [2021-05-02 17:54:07 main:581] : INFO : Epoch 33 | loss: 0.0311414 | val_loss: 0.0311467 | Time: 19103.5 ms [2021-05-02 17:54:26 main:581] : INFO : Epoch 34 | loss: 0.0311416 | val_loss: 0.0311469 | Time: 19088.7 ms [2021-05-02 17:54:45 main:581] : INFO : Epoch 35 | loss: 0.031142 | val_loss: 0.0311461 | Time: 18973.7 ms [2021-05-02 17:55:04 main:581] : INFO : Epoch 36 | loss: 0.0311398 | val_loss: 0.0311467 | Time: 18873.1 ms [2021-05-02 17:55:23 main:581] : INFO : Epoch 37 | loss: 0.0311386 | val_loss: 0.0311512 | Time: 19045.2 ms [2021-05-02 17:55:42 main:581] : INFO : Epoch 38 | loss: 0.0311398 | val_loss: 0.0311502 | Time: 18956.8 ms [2021-05-02 17:56:01 main:581] : INFO : Epoch 39 | loss: 0.0311391 | val_loss: 0.0311475 | Time: 19012.1 ms [2021-05-02 17:56:20 main:581] : INFO : Epoch 40 | loss: 0.0311362 | val_loss: 0.0311482 | Time: 18969.1 ms [2021-05-02 17:56:39 main:581] : INFO : Epoch 41 | loss: 0.0311377 | val_loss: 0.031151 | Time: 19020.2 ms [2021-05-02 17:56:58 main:581] : INFO : Epoch 42 | loss: 0.0311361 | val_loss: 0.031152 | Time: 18952.9 ms [2021-05-02 17:57:17 main:581] : INFO : Epoch 43 | loss: 0.0311395 | val_loss: 0.0311511 | Time: 18968.4 ms [2021-05-02 17:57:36 main:581] : INFO : Epoch 44 | loss: 0.031145 | val_loss: 0.0311487 | Time: 19056 ms [2021-05-02 17:57:55 main:581] : INFO : Epoch 45 | loss: 0.0311412 | val_loss: 0.0311439 | Time: 18980.8 ms [2021-05-02 17:58:14 main:581] : INFO : Epoch 46 | loss: 0.0311387 | val_loss: 0.0311456 | Time: 18996.5 ms [2021-05-02 17:58:33 main:581] : INFO : Epoch 47 | loss: 0.0311385 | val_loss: 0.0311442 | Time: 19005 ms [2021-05-02 17:58:52 main:581] : INFO : Epoch 48 | loss: 0.0311383 | val_loss: 0.0311453 | Time: 18961.6 ms [2021-05-02 17:59:10 main:581] : INFO : Epoch 49 | loss: 0.0311359 | val_loss: 0.0311444 | Time: 18963.7 ms [2021-05-02 17:59:29 main:581] : INFO : Epoch 50 | loss: 0.0311345 | val_loss: 0.0311434 | Time: 18937 ms [2021-05-02 17:59:48 main:581] : INFO : Epoch 51 | loss: 0.0311333 | val_loss: 0.0311419 | Time: 18904.6 ms [2021-05-02 18:00:07 main:581] : INFO : Epoch 52 | loss: 0.031134 | val_loss: 0.031143 | Time: 18938.8 ms [2021-05-02 18:00:26 main:581] : INFO : Epoch 53 | loss: 0.0311356 | val_loss: 0.0311407 | Time: 18985.2 ms [2021-05-02 18:00:45 main:581] : INFO : Epoch 54 | loss: 0.0311354 | val_loss: 0.0311471 | Time: 18961.8 ms [2021-05-02 18:01:04 main:581] : INFO : Epoch 55 | loss: 0.0311375 | val_loss: 0.0311454 | Time: 19071.4 ms [2021-05-02 18:01:23 main:581] : INFO : Epoch 56 | loss: 0.0311374 | val_loss: 0.0311539 | Time: 19031.4 ms [2021-05-02 18:01:42 main:581] : INFO : Epoch 57 | loss: 0.0311389 | val_loss: 0.0311449 | Time: 19034.7 ms [2021-05-02 18:02:01 main:581] : INFO : Epoch 58 | loss: 0.0311377 | val_loss: 0.031152 | Time: 18953.8 ms [2021-05-02 18:02:20 main:581] : INFO : Epoch 59 | loss: 0.0311347 | val_loss: 0.0311405 | Time: 18933.6 ms [2021-05-02 18:02:39 main:581] : INFO : Epoch 60 | loss: 0.0311352 | val_loss: 0.0311421 | Time: 18963.1 ms [2021-05-02 18:02:58 main:581] : INFO : Epoch 61 | loss: 0.0311313 | val_loss: 0.0311449 | Time: 18930.7 ms [2021-05-02 18:03:17 main:581] : INFO : Epoch 62 | loss: 0.0311309 | val_loss: 0.0311427 | Time: 18883.8 ms [2021-05-02 18:03:36 main:581] : INFO : Epoch 63 | loss: 0.0311304 | val_loss: 0.0311427 | Time: 18832.5 ms [2021-05-02 18:03:55 main:581] : INFO : Epoch 64 | loss: 0.0311308 | val_loss: 0.0311452 | Time: 18983.3 ms [2021-05-02 18:04:14 main:581] : INFO : Epoch 65 | loss: 0.0311333 | val_loss: 0.0311406 | Time: 18920.3 ms [2021-05-02 18:04:33 main:581] : INFO : Epoch 66 | loss: 0.0311351 | val_loss: 0.0311412 | Time: 19084.8 ms [2021-05-02 18:04:52 main:581] : INFO : Epoch 67 | loss: 0.0311342 | val_loss: 0.0311434 | Time: 18910.8 ms [2021-05-02 18:05:11 main:581] : INFO : Epoch 68 | loss: 0.0311337 | val_loss: 0.031146 | Time: 18981.5 ms [2021-05-02 18:05:30 main:581] : INFO : Epoch 69 | loss: 0.031136 | val_loss: 0.0311463 | Time: 18873.1 ms [2021-05-02 18:05:48 main:581] : INFO : Epoch 70 | loss: 0.0311324 | val_loss: 0.0311431 | Time: 18744.6 ms [2021-05-02 18:06:07 main:581] : INFO : Epoch 71 | loss: 0.0311308 | val_loss: 0.0311412 | Time: 18889 ms [2021-05-02 18:06:26 main:581] : INFO : Epoch 72 | loss: 0.0311312 | val_loss: 0.0311428 | Time: 19046.2 ms [2021-05-02 18:06:45 main:581] : INFO : Epoch 73 | loss: 0.0311327 | val_loss: 0.0311479 | Time: 18945.9 ms [2021-05-02 18:07:04 main:581] : INFO : Epoch 74 | loss: 0.0311426 | val_loss: 0.0311515 | Time: 18915.7 ms [2021-05-02 18:07:23 main:581] : INFO : Epoch 75 | loss: 0.0311396 | val_loss: 0.0311502 | Time: 18947.1 ms [2021-05-02 18:07:42 main:581] : INFO : Epoch 76 | loss: 0.0311372 | val_loss: 0.0311464 | Time: 18986.3 ms [2021-05-02 18:08:01 main:581] : INFO : Epoch 77 | loss: 0.0311391 | val_loss: 0.0311482 | Time: 18969.9 ms [2021-05-02 18:08:20 main:581] : INFO : Epoch 78 | loss: 0.0311356 | val_loss: 0.0311426 | Time: 18908.7 ms [2021-05-02 18:08:39 main:581] : INFO : Epoch 79 | loss: 0.0311341 | val_loss: 0.0311432 | Time: 19084.2 ms [2021-05-02 18:08:58 main:581] : INFO : Epoch 80 | loss: 0.0311323 | val_loss: 0.0311463 | Time: 19103.3 ms [2021-05-02 18:09:17 main:581] : INFO : Epoch 81 | loss: 0.0311318 | val_loss: 0.0311427 | Time: 18855.7 ms [2021-05-02 18:09:36 main:581] : INFO : Epoch 82 | loss: 0.0311307 | val_loss: 0.0311417 | Time: 18924.7 ms [2021-05-02 18:09:55 main:581] : INFO : Epoch 83 | loss: 0.0311369 | val_loss: 0.0311575 | Time: 18906.5 ms [2021-05-02 18:10:14 main:581] : INFO : Epoch 84 | loss: 0.0311518 | val_loss: 0.0311612 | Time: 18962.2 ms [2021-05-02 18:10:33 main:581] : INFO : Epoch 85 | loss: 0.0311491 | val_loss: 0.0311518 | Time: 18864.3 ms [2021-05-02 18:10:52 main:581] : INFO : Epoch 86 | loss: 0.031153 | val_loss: 0.0311515 | Time: 18878.3 ms [2021-05-02 18:11:10 main:581] : INFO : Epoch 87 | loss: 0.0311509 | val_loss: 0.0311519 | Time: 18906.5 ms [2021-05-02 18:11:29 main:581] : INFO : Epoch 88 | loss: 0.031147 | val_loss: 0.0311484 | Time: 18819.1 ms [2021-05-02 18:11:48 main:581] : INFO : Epoch 89 | loss: 0.0311461 | val_loss: 0.0311488 | Time: 18840.4 ms [2021-05-02 18:12:07 main:581] : INFO : Epoch 90 | loss: 0.0311436 | val_loss: 0.0311525 | Time: 18811.9 ms [2021-05-02 18:12:26 main:581] : INFO : Epoch 91 | loss: 0.0311419 | val_loss: 0.0311491 | Time: 18816.7 ms [2021-05-02 18:12:44 main:581] : INFO : Epoch 92 | loss: 0.0311411 | val_loss: 0.0311509 | Time: 18758.9 ms [2021-05-02 18:13:03 main:581] : INFO : Epoch 93 | loss: 0.0311406 | val_loss: 0.0311505 | Time: 18885 ms [2021-05-02 18:13:22 main:581] : INFO : Epoch 94 | loss: 0.0311417 | val_loss: 0.0311513 | Time: 18900.6 ms [2021-05-02 18:13:41 main:581] : INFO : Epoch 95 | loss: 0.0311435 | val_loss: 0.0311531 | Time: 18971.4 ms [2021-05-02 18:14:00 main:581] : INFO : Epoch 96 | loss: 0.0311408 | val_loss: 0.0311505 | Time: 18955.6 ms [2021-05-02 18:14:19 main:581] : INFO : Epoch 97 | loss: 0.0311391 | val_loss: 0.0311477 | Time: 19002 ms [2021-05-02 18:14:38 main:581] : INFO : Epoch 98 | loss: 0.0311364 | val_loss: 0.0311505 | Time: 19056.8 ms [2021-05-02 18:14:57 main:581] : INFO : Epoch 99 | loss: 0.0311346 | val_loss: 0.0311544 | Time: 19047.8 ms [2021-05-02 18:15:16 main:581] : INFO : Epoch 100 | loss: 0.0311354 | val_loss: 0.0311499 | Time: 18998 ms [2021-05-02 18:15:35 main:581] : INFO : Epoch 101 | loss: 0.0311344 | val_loss: 0.031148 | Time: 19019.7 ms [2021-05-02 18:15:54 main:581] : INFO : Epoch 102 | loss: 0.0311339 | val_loss: 0.0311461 | Time: 18911.2 ms [2021-05-02 18:16:13 main:581] : INFO : Epoch 103 | loss: 0.0311366 | val_loss: 0.0311514 | Time: 18987.9 ms [2021-05-02 18:16:32 main:581] : INFO : Epoch 104 | loss: 0.0311442 | val_loss: 0.0311483 | Time: 18973.6 ms [2021-05-02 18:16:51 main:581] : INFO : Epoch 105 | loss: 0.0311432 | val_loss: 0.0311513 | Time: 18889.7 ms [2021-05-02 18:17:10 main:581] : INFO : Epoch 106 | loss: 0.0311419 | val_loss: 0.0311486 | Time: 18958.1 ms [2021-05-02 18:17:29 main:581] : INFO : Epoch 107 | loss: 0.0311397 | val_loss: 0.0311518 | Time: 18951.5 ms [2021-05-02 18:17:48 main:581] : INFO : Epoch 108 | loss: 0.0311389 | val_loss: 0.0311525 | Time: 18885.8 ms [2021-05-02 18:18:07 main:581] : INFO : Epoch 109 | loss: 0.0311397 | val_loss: 0.0311523 | Time: 18918.1 ms [2021-05-02 18:18:26 main:581] : INFO : Epoch 110 | loss: 0.031137 | val_loss: 0.0311532 | Time: 18947.3 ms [2021-05-02 18:18:45 main:581] : INFO : Epoch 111 | loss: 0.0311358 | val_loss: 0.0311487 | Time: 18927.8 ms [2021-05-02 18:19:04 main:581] : INFO : Epoch 112 | loss: 0.0311367 | val_loss: 0.0311532 | Time: 19004.6 ms [2021-05-02 18:19:23 main:581] : INFO : Epoch 113 | loss: 0.031138 | val_loss: 0.0311542 | Time: 18888 ms [2021-05-02 18:19:42 main:581] : INFO : Epoch 114 | loss: 0.0311449 | val_loss: 0.0311507 | Time: 19018.6 ms [2021-05-02 18:20:00 main:581] : INFO : Epoch 115 | loss: 0.0311426 | val_loss: 0.031152 | Time: 18883.9 ms [2021-05-02 18:20:19 main:581] : INFO : Epoch 116 | loss: 0.0311407 | val_loss: 0.0311513 | Time: 18926 ms [2021-05-02 18:20:38 main:581] : INFO : Epoch 117 | loss: 0.0311374 | val_loss: 0.0311524 | Time: 18922.4 ms [2021-05-02 18:20:57 main:581] : INFO : Epoch 118 | loss: 0.0311372 | val_loss: 0.0311482 | Time: 19004.2 ms [2021-05-02 18:21:16 main:581] : INFO : Epoch 119 | loss: 0.0311375 | val_loss: 0.0311483 | Time: 18899.4 ms [2021-05-02 18:21:35 main:581] : INFO : Epoch 120 | loss: 0.0311333 | val_loss: 0.0311473 | Time: 18878.3 ms [2021-05-02 18:21:54 main:581] : INFO : Epoch 121 | loss: 0.0311339 | val_loss: 0.0311451 | Time: 18961.4 ms [2021-05-02 18:22:13 main:581] : INFO : Epoch 122 | loss: 0.0311337 | val_loss: 0.031148 | Time: 18937.1 ms [2021-05-02 18:22:32 main:581] : INFO : Epoch 123 | loss: 0.031133 | val_loss: 0.031149 | Time: 18843.8 ms [2021-05-02 18:22:51 main:581] : INFO : Epoch 124 | loss: 0.0311352 | val_loss: 0.031151 | Time: 18929.2 ms [2021-05-02 18:23:10 main:581] : INFO : Epoch 125 | loss: 0.0311393 | val_loss: 0.0311503 | Time: 18969 ms [2021-05-02 18:23:29 main:581] : INFO : Epoch 126 | loss: 0.0311594 | val_loss: 0.031198 | Time: 18978 ms [2021-05-02 18:23:48 main:581] : INFO : Epoch 127 | loss: 0.0311801 | val_loss: 0.0311719 | Time: 18890.1 ms [2021-05-02 18:24:07 main:581] : INFO : Epoch 128 | loss: 0.0311715 | val_loss: 0.0311692 | Time: 18979 ms [2021-05-02 18:24:07 main:604] : INFO : Saving trained model to model-final.pt, val_loss 0.0311692 [2021-05-02 18:24:07 main:610] : INFO : Saving end state to config to file [2021-05-02 18:24:07 main:615] : INFO : Success, exiting.. 18:24:07 (755483): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)