Task 2824986
| Name | rand_automata_0024-1604983203-28946-0_2 |
| Workunit | 1263711 |
| Created | 10 Nov 2020, 23:31:35 UTC |
| Sent | 10 Nov 2020, 23:33:55 UTC |
| Report deadline | 11 Nov 2020, 22:03:55 UTC |
| Received | 11 Nov 2020, 0:16:23 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 3985 |
| Run time | 14 min 4 sec |
| CPU time | 13 min 58 sec |
| Validate state | Valid |
| Credit | 959.40 |
| Device peak FLOPS | 3,338.19 GFLOPS |
| Application version | Machine Learning Dataset Generator (test) v9.75 (cuda10200) x86_64-pc-linux-gnu |
| Peak working set size | 2.26 GB |
| Peak swap size | 9.65 GB |
| Peak disk usage | 0.60 MB |
Stderr output
<core_client_version>7.16.11</core_client_version> <![CDATA[ <stderr_txt> DEBUG: Args: ../../projects/www.mlcathome.org_mlcathome/mldstest_9.75_x86_64-pc-linux-gnu__cuda10200 -a LSTM -w 64 -b 2 -s 32 --lr 0.001 --maxepoch 192 --device 0 nthreads: 1 gpudev: 0 Re-exec()-ing to set number of threads correctly... Machine Learning Dataset Generator v9.75 (Linux/x86_64) (libTorch: release/1.6 GPU: GeForce GTX 1650) device already set [2020-11-10 19:02:05 main:435] : INFO : Set logging level to 1 [2020-11-10 19:02:05 main:441] : INFO : Running in BOINC Client mode [2020-11-10 19:02:05 main:444] : INFO : Resolving all filenames [2020-11-10 19:02:05 main:452] : INFO : Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0024-train-val-dataset.hdf5 (exists = 1) [2020-11-10 19:02:05 main:452] : INFO : Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0024-1604983203-28946-0_2_r859854777_1 (exists = 0) [2020-11-10 19:02:05 main:452] : INFO : Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0024-1604983203-28946-0_2_r859854777_0 (exists = 0) [2020-11-10 19:02:05 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 0) [2020-11-10 19:02:05 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 0) [2020-11-10 19:02:05 main:472] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/rand_automata_0024-train-val-dataset.hdf5 [2020-11-10 19:02:05 main:474] : INFO : Configuration: [2020-11-10 19:02:05 main:475] : INFO : Model type: LSTM [2020-11-10 19:02:05 main:476] : INFO : Validation Loss Threshold: 0.0001 [2020-11-10 19:02:05 main:477] : INFO : Max Epochs: 192 [2020-11-10 19:02:05 main:478] : INFO : Batch Size: 32 [2020-11-10 19:02:05 main:479] : INFO : Learning Rate: 0.001 [2020-11-10 19:02:05 main:480] : INFO : Patience: 10 [2020-11-10 19:02:05 main:481] : INFO : Hidden Width: 64 [2020-11-10 19:02:05 main:482] : INFO : # Recurrent Layers: 4 [2020-11-10 19:02:05 main:483] : INFO : # Backend Layers: 2 [2020-11-10 19:02:05 main:484] : INFO : # Threads: 1 [2020-11-10 19:02:05 main:486] : INFO : Preparing Dataset [2020-11-10 19:02:05 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0024-train-val-dataset.hdf5 into memory [2020-11-10 19:02:05 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0024-train-val-dataset.hdf5 into memory [2020-11-10 19:02:08 load:106] : INFO : Successfully loaded dataset of 4096 examples into memory. [2020-11-10 19:02:08 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0024-train-val-dataset.hdf5 into memory [2020-11-10 19:02:08 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0024-train-val-dataset.hdf5 into memory [2020-11-10 19:02:08 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2020-11-10 19:02:08 main:494] : INFO : Creating Model [2020-11-10 19:02:08 main:507] : INFO : Preparing config file [2020-11-10 19:02:08 main:519] : INFO : Creating new config file [2020-11-10 19:02:11 main:559] : INFO : Loading DataLoader into Memory [2020-11-10 19:02:11 main:562] : INFO : Starting Training [2020-11-10 19:02:16 main:574] : INFO : Epoch 1 | loss: 0.0654943 | val_loss: 0.0651845 | Time: 5197.9 ms [2020-11-10 19:02:20 main:574] : INFO : Epoch 2 | loss: 0.0641897 | val_loss: 0.063169 | Time: 4342.33 ms [2020-11-10 19:02:24 main:574] : INFO : Epoch 3 | loss: 0.0612624 | val_loss: 0.0593781 | Time: 4298.18 ms [2020-11-10 19:02:29 main:574] : INFO : Epoch 4 | loss: 0.0579468 | val_loss: 0.0566484 | Time: 4347.69 ms [2020-11-10 19:02:33 main:574] : INFO : Epoch 5 | loss: 0.0555465 | val_loss: 0.0544802 | Time: 4480.02 ms [2020-11-10 19:02:38 main:574] : INFO : Epoch 6 | loss: 0.0535939 | val_loss: 0.0528894 | Time: 4643.29 ms [2020-11-10 19:02:42 main:574] : INFO : Epoch 7 | loss: 0.0519664 | val_loss: 0.0511504 | Time: 4330.71 ms [2020-11-10 19:02:46 main:574] : INFO : Epoch 8 | loss: 0.050467 | val_loss: 0.0499452 | Time: 4235.23 ms [2020-11-10 19:02:51 main:574] : INFO : Epoch 9 | loss: 0.048914 | val_loss: 0.0481943 | Time: 4157.17 ms [2020-11-10 19:02:55 main:574] : INFO : Epoch 10 | loss: 0.0472243 | val_loss: 0.0464976 | Time: 4288.35 ms [2020-11-10 19:02:59 main:574] : INFO : Epoch 11 | loss: 0.0452953 | val_loss: 0.0446464 | Time: 4264.51 ms [2020-11-10 19:03:03 main:574] : INFO : Epoch 12 | loss: 0.0431057 | val_loss: 0.0424208 | Time: 4246.16 ms [2020-11-10 19:03:08 main:574] : INFO : Epoch 13 | loss: 0.0404264 | val_loss: 0.0396772 | Time: 4424.14 ms [2020-11-10 19:03:12 main:574] : INFO : Epoch 14 | loss: 0.0373909 | val_loss: 0.0362677 | Time: 4319.79 ms [2020-11-10 19:03:16 main:574] : INFO : Epoch 15 | loss: 0.0337032 | val_loss: 0.0332053 | Time: 4277.25 ms [2020-11-10 19:03:21 main:574] : INFO : Epoch 16 | loss: 0.0304692 | val_loss: 0.0289807 | Time: 4185.77 ms [2020-11-10 19:03:25 main:574] : INFO : Epoch 17 | loss: 0.0264633 | val_loss: 0.0243012 | Time: 4316.15 ms [2020-11-10 19:03:29 main:574] : INFO : Epoch 18 | loss: 0.0251725 | val_loss: 0.0230826 | Time: 4521.69 ms [2020-11-10 19:03:34 main:574] : INFO : Epoch 19 | loss: 0.0241684 | val_loss: 0.0225635 | Time: 4379.75 ms [2020-11-10 19:03:38 main:574] : INFO : Epoch 20 | loss: 0.0203874 | val_loss: 0.0191293 | Time: 4363.82 ms [2020-11-10 19:03:43 main:574] : INFO : Epoch 21 | loss: 0.0210565 | val_loss: 0.0241967 | Time: 4523.97 ms [2020-11-10 19:03:47 main:574] : INFO : Epoch 22 | loss: 0.0177384 | val_loss: 0.0269296 | Time: 4474.18 ms [2020-11-10 19:03:52 main:574] : INFO : Epoch 23 | loss: 0.0159138 | val_loss: 0.0127388 | Time: 4418.7 ms [2020-11-10 19:03:56 main:574] : INFO : Epoch 24 | loss: 0.0129459 | val_loss: 0.0138089 | Time: 4345.2 ms [2020-11-10 19:04:00 main:574] : INFO : Epoch 25 | loss: 0.0516165 | val_loss: 0.0553551 | Time: 4398.27 ms [2020-11-10 19:04:05 main:574] : INFO : Epoch 26 | loss: 0.0496452 | val_loss: 0.0410132 | Time: 4517.64 ms [2020-11-10 19:04:09 main:574] : INFO : Epoch 27 | loss: 0.0259042 | val_loss: 0.0196483 | Time: 4368.35 ms [2020-11-10 19:04:14 main:574] : INFO : Epoch 28 | loss: 0.016575 | val_loss: 0.0128665 | Time: 4399.07 ms [2020-11-10 19:04:18 main:574] : INFO : Epoch 29 | loss: 0.0117046 | val_loss: 0.0113315 | Time: 4466.09 ms [2020-11-10 19:04:22 main:574] : INFO : Epoch 30 | loss: 0.012575 | val_loss: 0.0203878 | Time: 4259.33 ms [2020-11-10 19:04:27 main:574] : INFO : Epoch 31 | loss: 0.0222076 | val_loss: 0.019512 | Time: 4539.92 ms [2020-11-10 19:04:31 main:574] : INFO : Epoch 32 | loss: 0.0126952 | val_loss: 0.0108242 | Time: 4351.53 ms [2020-11-10 19:04:36 main:574] : INFO : Epoch 33 | loss: 0.00980911 | val_loss: 0.00958183 | Time: 4415.49 ms [2020-11-10 19:04:40 main:574] : INFO : Epoch 34 | loss: 0.00882029 | val_loss: 0.00885589 | Time: 4446.58 ms [2020-11-10 19:04:45 main:574] : INFO : Epoch 35 | loss: 0.00840452 | val_loss: 0.00848628 | Time: 4519.29 ms [2020-11-10 19:04:49 main:574] : INFO : Epoch 36 | loss: 0.00916501 | val_loss: 0.0128253 | Time: 4226.75 ms [2020-11-10 19:04:53 main:574] : INFO : Epoch 37 | loss: 0.00904629 | val_loss: 0.00810517 | Time: 4463.6 ms [2020-11-10 19:04:58 main:574] : INFO : Epoch 38 | loss: 0.00761005 | val_loss: 0.00761943 | Time: 4252.98 ms [2020-11-10 19:05:02 main:574] : INFO : Epoch 39 | loss: 0.00722235 | val_loss: 0.0073154 | Time: 4422.93 ms [2020-11-10 19:05:07 main:574] : INFO : Epoch 40 | loss: 0.0069611 | val_loss: 0.00706689 | Time: 4508.83 ms [2020-11-10 19:05:11 main:574] : INFO : Epoch 41 | loss: 0.00673456 | val_loss: 0.00681052 | Time: 4424.54 ms [2020-11-10 19:05:15 main:574] : INFO : Epoch 42 | loss: 0.00706127 | val_loss: 0.00882674 | Time: 4399.81 ms [2020-11-10 19:05:20 main:574] : INFO : Epoch 43 | loss: 0.00671798 | val_loss: 0.00651487 | Time: 4327.59 ms [2020-11-10 19:05:24 main:574] : INFO : Epoch 44 | loss: 0.00618329 | val_loss: 0.00623749 | Time: 4370.32 ms [2020-11-10 19:05:28 main:574] : INFO : Epoch 45 | loss: 0.00601495 | val_loss: 0.00625092 | Time: 4254.33 ms [2020-11-10 19:05:33 main:574] : INFO : Epoch 46 | loss: 0.00630832 | val_loss: 0.00657982 | Time: 4328.26 ms [2020-11-10 19:05:37 main:574] : INFO : Epoch 47 | loss: 0.00582761 | val_loss: 0.00568632 | Time: 4322.98 ms [2020-11-10 19:05:41 main:574] : INFO : Epoch 48 | loss: 0.00549568 | val_loss: 0.00549985 | Time: 4260.27 ms [2020-11-10 19:05:46 main:574] : INFO : Epoch 49 | loss: 0.00529612 | val_loss: 0.00531988 | Time: 4415.46 ms [2020-11-10 19:05:50 main:574] : INFO : Epoch 50 | loss: 0.00511851 | val_loss: 0.00514709 | Time: 4296.37 ms [2020-11-10 19:05:54 main:574] : INFO : Epoch 51 | loss: 0.00495705 | val_loss: 0.00498883 | Time: 4157.55 ms [2020-11-10 19:05:58 main:574] : INFO : Epoch 52 | loss: 0.0048034 | val_loss: 0.00483433 | Time: 4196.71 ms [2020-11-10 19:06:03 main:574] : INFO : Epoch 53 | loss: 0.00465046 | val_loss: 0.00467352 | Time: 4338.51 ms [2020-11-10 19:06:07 main:574] : INFO : Epoch 54 | loss: 0.00450136 | val_loss: 0.00452506 | Time: 4379.59 ms [2020-11-10 19:06:12 main:574] : INFO : Epoch 55 | loss: 0.00435289 | val_loss: 0.00437478 | Time: 4547.54 ms [2020-11-10 19:06:16 main:574] : INFO : Epoch 56 | loss: 0.00420733 | val_loss: 0.0042297 | Time: 4502.01 ms [2020-11-10 19:06:21 main:574] : INFO : Epoch 57 | loss: 0.0040643 | val_loss: 0.00408403 | Time: 4453.15 ms [2020-11-10 19:06:25 main:574] : INFO : Epoch 58 | loss: 0.00392434 | val_loss: 0.00394103 | Time: 4773.25 ms [2020-11-10 19:06:30 main:574] : INFO : Epoch 59 | loss: 0.00378657 | val_loss: 0.00378582 | Time: 4733.03 ms [2020-11-10 19:06:35 main:574] : INFO : Epoch 60 | loss: 0.00365182 | val_loss: 0.00364982 | Time: 4819.85 ms [2020-11-10 19:06:39 main:574] : INFO : Epoch 61 | loss: 0.0035187 | val_loss: 0.00351339 | Time: 4612.51 ms [2020-11-10 19:06:44 main:574] : INFO : Epoch 62 | loss: 0.00338758 | val_loss: 0.00338712 | Time: 4505.45 ms [2020-11-10 19:06:48 main:574] : INFO : Epoch 63 | loss: 0.00326266 | val_loss: 0.00325351 | Time: 4401.17 ms [2020-11-10 19:06:53 main:574] : INFO : Epoch 64 | loss: 0.00313866 | val_loss: 0.00312443 | Time: 4484.4 ms [2020-11-10 19:06:58 main:574] : INFO : Epoch 65 | loss: 0.00301625 | val_loss: 0.00300276 | Time: 4657.88 ms [2020-11-10 19:07:02 main:574] : INFO : Epoch 66 | loss: 0.00289945 | val_loss: 0.00288151 | Time: 4392.91 ms [2020-11-10 19:07:06 main:574] : INFO : Epoch 67 | loss: 0.00278558 | val_loss: 0.00276895 | Time: 3843.57 ms [2020-11-10 19:07:10 main:574] : INFO : Epoch 68 | loss: 0.00267423 | val_loss: 0.0026548 | Time: 4268.15 ms [2020-11-10 19:07:14 main:574] : INFO : Epoch 69 | loss: 0.00256644 | val_loss: 0.00254811 | Time: 4363.77 ms [2020-11-10 19:07:19 main:574] : INFO : Epoch 70 | loss: 0.00246193 | val_loss: 0.0024415 | Time: 4327.97 ms [2020-11-10 19:07:23 main:574] : INFO : Epoch 71 | loss: 0.00236076 | val_loss: 0.00233997 | Time: 4294.45 ms [2020-11-10 19:07:28 main:574] : INFO : Epoch 72 | loss: 0.00226433 | val_loss: 0.00224237 | Time: 4513.87 ms [2020-11-10 19:07:32 main:574] : INFO : Epoch 73 | loss: 0.00217009 | val_loss: 0.00214964 | Time: 4378.86 ms [2020-11-10 19:07:36 main:574] : INFO : Epoch 74 | loss: 0.00207905 | val_loss: 0.00206061 | Time: 4209.16 ms [2020-11-10 19:07:40 main:574] : INFO : Epoch 75 | loss: 0.00199158 | val_loss: 0.00196931 | Time: 4114.69 ms [2020-11-10 19:07:45 main:574] : INFO : Epoch 76 | loss: 0.00190648 | val_loss: 0.00188566 | Time: 4352.14 ms [2020-11-10 19:07:49 main:574] : INFO : Epoch 77 | loss: 0.00182544 | val_loss: 0.00180486 | Time: 4356.12 ms [2020-11-10 19:07:53 main:574] : INFO : Epoch 78 | loss: 0.00174805 | val_loss: 0.00172775 | Time: 4232.56 ms [2020-11-10 19:07:57 main:574] : INFO : Epoch 79 | loss: 0.00167246 | val_loss: 0.00165042 | Time: 4298.14 ms [2020-11-10 19:08:02 main:574] : INFO : Epoch 80 | loss: 0.0016005 | val_loss: 0.00157953 | Time: 4407.53 ms [2020-11-10 19:08:06 main:574] : INFO : Epoch 81 | loss: 0.00153005 | val_loss: 0.00151488 | Time: 4392.2 ms [2020-11-10 19:08:11 main:574] : INFO : Epoch 82 | loss: 0.00146502 | val_loss: 0.00144594 | Time: 4241.04 ms [2020-11-10 19:08:15 main:574] : INFO : Epoch 83 | loss: 0.00140049 | val_loss: 0.0013807 | Time: 4505.59 ms [2020-11-10 19:08:19 main:574] : INFO : Epoch 84 | loss: 0.00134 | val_loss: 0.00132304 | Time: 4397.62 ms [2020-11-10 19:08:24 main:574] : INFO : Epoch 85 | loss: 0.00128099 | val_loss: 0.0012636 | Time: 4192.02 ms [2020-11-10 19:08:28 main:574] : INFO : Epoch 86 | loss: 0.00122384 | val_loss: 0.00120625 | Time: 4092.47 ms [2020-11-10 19:08:32 main:574] : INFO : Epoch 87 | loss: 0.00117047 | val_loss: 0.0011551 | Time: 4244.4 ms [2020-11-10 19:08:36 main:574] : INFO : Epoch 88 | loss: 0.0011182 | val_loss: 0.001103 | Time: 4341.19 ms [2020-11-10 19:08:41 main:574] : INFO : Epoch 89 | loss: 0.00106971 | val_loss: 0.00105716 | Time: 4301.68 ms [2020-11-10 19:08:45 main:574] : INFO : Epoch 90 | loss: 0.00102247 | val_loss: 0.00100787 | Time: 4418.36 ms [2020-11-10 19:08:49 main:574] : INFO : Epoch 91 | loss: 0.000976083 | val_loss: 0.000963839 | Time: 4443.2 ms [2020-11-10 19:08:54 main:574] : INFO : Epoch 92 | loss: 0.00093302 | val_loss: 0.000918906 | Time: 4357.38 ms [2020-11-10 19:08:58 main:574] : INFO : Epoch 93 | loss: 0.000888537 | val_loss: 0.000876209 | Time: 4351.99 ms [2020-11-10 19:09:02 main:574] : INFO : Epoch 94 | loss: 0.000848838 | val_loss: 0.000837608 | Time: 4308.08 ms [2020-11-10 19:09:07 main:574] : INFO : Epoch 95 | loss: 0.000810396 | val_loss: 0.000799978 | Time: 4291.24 ms [2020-11-10 19:09:11 main:574] : INFO : Epoch 96 | loss: 0.000774545 | val_loss: 0.000765807 | Time: 4282.69 ms [2020-11-10 19:09:15 main:574] : INFO : Epoch 97 | loss: 0.000739744 | val_loss: 0.0007309 | Time: 4423.89 ms [2020-11-10 19:09:20 main:574] : INFO : Epoch 98 | loss: 0.000705451 | val_loss: 0.00069644 | Time: 4436.44 ms [2020-11-10 19:09:24 main:574] : INFO : Epoch 99 | loss: 0.000673418 | val_loss: 0.000664726 | Time: 4407.77 ms [2020-11-10 19:09:29 main:574] : INFO : Epoch 100 | loss: 0.000642764 | val_loss: 0.000637468 | Time: 4306.3 ms [2020-11-10 19:09:33 main:574] : INFO : Epoch 101 | loss: 0.00061449 | val_loss: 0.000608474 | Time: 4293.83 ms [2020-11-10 19:09:37 main:574] : INFO : Epoch 102 | loss: 0.000586421 | val_loss: 0.00058354 | Time: 4275.71 ms [2020-11-10 19:09:42 main:574] : INFO : Epoch 103 | loss: 0.000560003 | val_loss: 0.000555442 | Time: 4400.7 ms [2020-11-10 19:09:46 main:574] : INFO : Epoch 104 | loss: 0.00053503 | val_loss: 0.000530419 | Time: 4277.76 ms [2020-11-10 19:09:50 main:574] : INFO : Epoch 105 | loss: 0.000510764 | val_loss: 0.000506555 | Time: 4381.34 ms [2020-11-10 19:09:55 main:574] : INFO : Epoch 106 | loss: 0.000487185 | val_loss: 0.000486207 | Time: 4541.39 ms [2020-11-10 19:09:59 main:574] : INFO : Epoch 107 | loss: 0.0004665 | val_loss: 0.000464878 | Time: 4273.38 ms [2020-11-10 19:10:03 main:574] : INFO : Epoch 108 | loss: 0.00044618 | val_loss: 0.000444133 | Time: 4269.21 ms [2020-11-10 19:10:08 main:574] : INFO : Epoch 109 | loss: 0.000426612 | val_loss: 0.000424936 | Time: 4227.19 ms [2020-11-10 19:10:12 main:574] : INFO : Epoch 110 | loss: 0.000407953 | val_loss: 0.000405651 | Time: 4275.99 ms [2020-11-10 19:10:16 main:574] : INFO : Epoch 111 | loss: 0.000390352 | val_loss: 0.000387468 | Time: 4197.9 ms [2020-11-10 19:10:20 main:574] : INFO : Epoch 112 | loss: 0.000373217 | val_loss: 0.000373856 | Time: 4177.9 ms [2020-11-10 19:10:25 main:574] : INFO : Epoch 113 | loss: 0.000357733 | val_loss: 0.00035723 | Time: 4338.55 ms [2020-11-10 19:10:29 main:574] : INFO : Epoch 114 | loss: 0.000341997 | val_loss: 0.000341688 | Time: 4211.27 ms [2020-11-10 19:10:33 main:574] : INFO : Epoch 115 | loss: 0.000328212 | val_loss: 0.000326791 | Time: 4225.02 ms [2020-11-10 19:10:37 main:574] : INFO : Epoch 116 | loss: 0.000314387 | val_loss: 0.000313046 | Time: 4380.67 ms [2020-11-10 19:10:42 main:574] : INFO : Epoch 117 | loss: 0.000301473 | val_loss: 0.000304227 | Time: 4437.01 ms [2020-11-10 19:10:46 main:574] : INFO : Epoch 118 | loss: 0.00028936 | val_loss: 0.000289489 | Time: 4361.59 ms [2020-11-10 19:10:50 main:574] : INFO : Epoch 119 | loss: 0.000277598 | val_loss: 0.000280747 | Time: 4271.95 ms [2020-11-10 19:10:55 main:574] : INFO : Epoch 120 | loss: 0.000266469 | val_loss: 0.000266676 | Time: 4402.45 ms [2020-11-10 19:10:59 main:574] : INFO : Epoch 121 | loss: 0.00025555 | val_loss: 0.000256461 | Time: 4238.91 ms [2020-11-10 19:11:03 main:574] : INFO : Epoch 122 | loss: 0.000245906 | val_loss: 0.000245816 | Time: 4259.91 ms [2020-11-10 19:11:08 main:574] : INFO : Epoch 123 | loss: 0.00023621 | val_loss: 0.000238522 | Time: 4543.86 ms [2020-11-10 19:11:12 main:574] : INFO : Epoch 124 | loss: 0.000227588 | val_loss: 0.00022838 | Time: 4466.93 ms [2020-11-10 19:11:17 main:574] : INFO : Epoch 125 | loss: 0.000218739 | val_loss: 0.000219913 | Time: 4415.55 ms [2020-11-10 19:11:21 main:574] : INFO : Epoch 126 | loss: 0.000210488 | val_loss: 0.000212925 | Time: 4515.27 ms [2020-11-10 19:11:26 main:574] : INFO : Epoch 127 | loss: 0.000202953 | val_loss: 0.000203041 | Time: 4334.87 ms [2020-11-10 19:11:30 main:574] : INFO : Epoch 128 | loss: 0.000196113 | val_loss: 0.000203075 | Time: 4340.65 ms [2020-11-10 19:11:34 main:574] : INFO : Epoch 129 | loss: 0.000189494 | val_loss: 0.000190133 | Time: 4133.62 ms [2020-11-10 19:11:38 main:574] : INFO : Epoch 130 | loss: 0.000182377 | val_loss: 0.000185905 | Time: 4238.3 ms [2020-11-10 19:11:43 main:574] : INFO : Epoch 131 | loss: 0.000176438 | val_loss: 0.000178684 | Time: 4304.38 ms [2020-11-10 19:11:47 main:574] : INFO : Epoch 132 | loss: 0.000170537 | val_loss: 0.000171541 | Time: 4347.4 ms [2020-11-10 19:11:51 main:574] : INFO : Epoch 133 | loss: 0.000165248 | val_loss: 0.000165798 | Time: 4253.96 ms [2020-11-10 19:11:56 main:574] : INFO : Epoch 134 | loss: 0.00016034 | val_loss: 0.000162078 | Time: 4361.85 ms [2020-11-10 19:12:00 main:574] : INFO : Epoch 135 | loss: 0.000154729 | val_loss: 0.000156667 | Time: 4446.98 ms [2020-11-10 19:12:04 main:574] : INFO : Epoch 136 | loss: 0.000149776 | val_loss: 0.000150902 | Time: 4381.98 ms [2020-11-10 19:12:09 main:574] : INFO : Epoch 137 | loss: 0.000145954 | val_loss: 0.000145942 | Time: 4388.14 ms [2020-11-10 19:12:13 main:574] : INFO : Epoch 138 | loss: 0.000141754 | val_loss: 0.000143642 | Time: 4342.4 ms [2020-11-10 19:12:18 main:574] : INFO : Epoch 139 | loss: 0.000136985 | val_loss: 0.000138635 | Time: 4432.46 ms [2020-11-10 19:12:22 main:574] : INFO : Epoch 140 | loss: 0.000132648 | val_loss: 0.000135733 | Time: 4356.95 ms [2020-11-10 19:12:26 main:574] : INFO : Epoch 141 | loss: 0.000129394 | val_loss: 0.000133526 | Time: 4352.37 ms [2020-11-10 19:12:31 main:574] : INFO : Epoch 142 | loss: 0.000126016 | val_loss: 0.000125281 | Time: 4275.71 ms [2020-11-10 19:12:35 main:574] : INFO : Epoch 143 | loss: 0.000122325 | val_loss: 0.00012367 | Time: 4259.73 ms [2020-11-10 19:12:39 main:574] : INFO : Epoch 144 | loss: 0.000119142 | val_loss: 0.000121015 | Time: 4330.61 ms [2020-11-10 19:12:43 main:574] : INFO : Epoch 145 | loss: 0.0001166 | val_loss: 0.000118519 | Time: 4322.66 ms [2020-11-10 19:12:48 main:574] : INFO : Epoch 146 | loss: 0.000112765 | val_loss: 0.000112284 | Time: 4288.93 ms [2020-11-10 19:12:52 main:574] : INFO : Epoch 147 | loss: 0.000109821 | val_loss: 0.000110602 | Time: 4263.2 ms [2020-11-10 19:12:56 main:574] : INFO : Epoch 148 | loss: 0.000107983 | val_loss: 0.000109558 | Time: 4328.5 ms [2020-11-10 19:13:01 main:574] : INFO : Epoch 149 | loss: 0.00010497 | val_loss: 0.000105508 | Time: 4316.03 ms [2020-11-10 19:13:05 main:574] : INFO : Epoch 150 | loss: 0.000102377 | val_loss: 0.000102639 | Time: 4215.95 ms [2020-11-10 19:13:09 main:574] : INFO : Epoch 151 | loss: 9.9242e-05 | val_loss: 0.000101305 | Time: 4266.6 ms [2020-11-10 19:13:13 main:574] : INFO : Epoch 152 | loss: 9.77508e-05 | val_loss: 9.80821e-05 | Time: 4274.22 ms [2020-11-10 19:13:18 main:574] : INFO : Epoch 153 | loss: 9.51062e-05 | val_loss: 9.49133e-05 | Time: 4372.86 ms [2020-11-10 19:13:22 main:574] : INFO : Epoch 154 | loss: 9.30132e-05 | val_loss: 9.36508e-05 | Time: 4395.65 ms [2020-11-10 19:13:27 main:574] : INFO : Epoch 155 | loss: 9.15582e-05 | val_loss: 9.40328e-05 | Time: 4296.49 ms [2020-11-10 19:13:31 main:574] : INFO : Epoch 156 | loss: 8.91204e-05 | val_loss: 9.05104e-05 | Time: 4134.86 ms [2020-11-10 19:13:35 main:574] : INFO : Epoch 157 | loss: 8.69889e-05 | val_loss: 8.85395e-05 | Time: 4325.54 ms [2020-11-10 19:13:39 main:574] : INFO : Epoch 158 | loss: 8.54492e-05 | val_loss: 8.45116e-05 | Time: 4284.08 ms [2020-11-10 19:13:44 main:574] : INFO : Epoch 159 | loss: 8.40342e-05 | val_loss: 8.60185e-05 | Time: 4432.75 ms [2020-11-10 19:13:48 main:574] : INFO : Epoch 160 | loss: 8.15552e-05 | val_loss: 8.18288e-05 | Time: 4596.75 ms [2020-11-10 19:13:53 main:574] : INFO : Epoch 161 | loss: 8.01032e-05 | val_loss: 8.07905e-05 | Time: 4220.4 ms [2020-11-10 19:13:57 main:574] : INFO : Epoch 162 | loss: 7.89859e-05 | val_loss: 8.07469e-05 | Time: 4237.03 ms [2020-11-10 19:14:01 main:574] : INFO : Epoch 163 | loss: 7.71643e-05 | val_loss: 7.80397e-05 | Time: 4289.24 ms [2020-11-10 19:14:05 main:574] : INFO : Epoch 164 | loss: 7.55877e-05 | val_loss: 7.64115e-05 | Time: 4383.5 ms [2020-11-10 19:14:10 main:574] : INFO : Epoch 165 | loss: 7.46335e-05 | val_loss: 7.47099e-05 | Time: 4268.75 ms [2020-11-10 19:14:14 main:574] : INFO : Epoch 166 | loss: 7.29332e-05 | val_loss: 7.46083e-05 | Time: 4324.24 ms [2020-11-10 19:14:18 main:574] : INFO : Epoch 167 | loss: 7.1345e-05 | val_loss: 7.19827e-05 | Time: 4263.18 ms [2020-11-10 19:14:23 main:574] : INFO : Epoch 168 | loss: 7.03676e-05 | val_loss: 7.06552e-05 | Time: 4350.1 ms [2020-11-10 19:14:27 main:574] : INFO : Epoch 169 | loss: 6.95342e-05 | val_loss: 6.92151e-05 | Time: 4254.73 ms [2020-11-10 19:14:31 main:574] : INFO : Epoch 170 | loss: 6.72383e-05 | val_loss: 6.78704e-05 | Time: 4381.73 ms [2020-11-10 19:14:36 main:574] : INFO : Epoch 171 | loss: 6.63386e-05 | val_loss: 6.68861e-05 | Time: 4254.84 ms [2020-11-10 19:14:40 main:574] : INFO : Epoch 172 | loss: 6.53185e-05 | val_loss: 6.55427e-05 | Time: 4272.8 ms [2020-11-10 19:14:44 main:574] : INFO : Epoch 173 | loss: 6.42054e-05 | val_loss: 6.7525e-05 | Time: 4350.31 ms [2020-11-10 19:14:48 main:574] : INFO : Epoch 174 | loss: 6.39646e-05 | val_loss: 6.35799e-05 | Time: 4330.73 ms [2020-11-10 19:14:53 main:574] : INFO : Epoch 175 | loss: 6.57691e-05 | val_loss: 6.19005e-05 | Time: 4185.02 ms [2020-11-10 19:14:57 main:574] : INFO : Epoch 176 | loss: 6.11188e-05 | val_loss: 6.50528e-05 | Time: 4291.32 ms [2020-11-10 19:15:01 main:574] : INFO : Epoch 177 | loss: 6.10872e-05 | val_loss: 6.03847e-05 | Time: 4322.08 ms [2020-11-10 19:15:06 main:574] : INFO : Epoch 178 | loss: 5.88406e-05 | val_loss: 5.96924e-05 | Time: 4597.83 ms [2020-11-10 19:15:10 main:574] : INFO : Epoch 179 | loss: 5.77498e-05 | val_loss: 5.86635e-05 | Time: 4158.78 ms [2020-11-10 19:15:14 main:574] : INFO : Epoch 180 | loss: 5.71162e-05 | val_loss: 5.78663e-05 | Time: 4403.13 ms [2020-11-10 19:15:19 main:574] : INFO : Epoch 181 | loss: 5.60412e-05 | val_loss: 5.73162e-05 | Time: 4236.17 ms [2020-11-10 19:15:23 main:574] : INFO : Epoch 182 | loss: 5.53655e-05 | val_loss: 5.6457e-05 | Time: 4454.4 ms [2020-11-10 19:15:27 main:574] : INFO : Epoch 183 | loss: 5.43304e-05 | val_loss: 5.59394e-05 | Time: 4259.17 ms [2020-11-10 19:15:32 main:574] : INFO : Epoch 184 | loss: 5.53434e-05 | val_loss: 5.34833e-05 | Time: 4452.42 ms [2020-11-10 19:15:36 main:574] : INFO : Epoch 185 | loss: 5.3259e-05 | val_loss: 6.28415e-05 | Time: 4463.79 ms [2020-11-10 19:15:40 main:574] : INFO : Epoch 186 | loss: 5.66747e-05 | val_loss: 5.31319e-05 | Time: 4099.14 ms [2020-11-10 19:15:45 main:574] : INFO : Epoch 187 | loss: 5.1405e-05 | val_loss: 5.15332e-05 | Time: 4202.68 ms [2020-11-10 19:15:49 main:574] : INFO : Epoch 188 | loss: 5.05538e-05 | val_loss: 5.3507e-05 | Time: 4319.2 ms [2020-11-10 19:15:54 main:574] : INFO : Epoch 189 | loss: 5.00727e-05 | val_loss: 5.09533e-05 | Time: 4565.37 ms [2020-11-10 19:15:58 main:574] : INFO : Epoch 190 | loss: 4.98778e-05 | val_loss: 4.96633e-05 | Time: 4402.57 ms [2020-11-10 19:16:02 main:574] : INFO : Epoch 191 | loss: 4.82816e-05 | val_loss: 5.00563e-05 | Time: 4308.7 ms [2020-11-10 19:16:07 main:574] : INFO : Epoch 192 | loss: 4.81264e-05 | val_loss: 4.8299e-05 | Time: 4411.7 ms [2020-11-10 19:16:07 main:597] : INFO : Saving trained model to model-final.pt, val_loss 4.8299e-05 [2020-11-10 19:16:07 main:603] : INFO : Saving end state to config to file [2020-11-10 19:16:07 main:608] : INFO : Success, exiting.. 19:16:07 (13149): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)