Task 2824985
| Name | rand_automata_0023-1604983203-28938-0_2 |
| Workunit | 1263710 |
| Created | 10 Nov 2020, 23:31:35 UTC |
| Sent | 10 Nov 2020, 23:34:32 UTC |
| Report deadline | 11 Nov 2020, 22:04:32 UTC |
| Received | 11 Nov 2020, 0:44:30 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 3985 |
| Run time | 14 min 3 sec |
| CPU time | 13 min 55 sec |
| Validate state | Valid |
| Credit | 959.40 |
| Device peak FLOPS | 3,338.19 GFLOPS |
| Application version | Machine Learning Dataset Generator (test) v9.75 (cuda10200) x86_64-pc-linux-gnu |
| Peak working set size | 2.26 GB |
| Peak swap size | 9.65 GB |
| Peak disk usage | 0.60 MB |
Stderr output
<core_client_version>7.16.11</core_client_version> <![CDATA[ <stderr_txt> DEBUG: Args: ../../projects/www.mlcathome.org_mlcathome/mldstest_9.75_x86_64-pc-linux-gnu__cuda10200 -a LSTM -w 64 -b 2 -s 32 --lr 0.001 --maxepoch 192 --device 0 nthreads: 1 gpudev: 0 Re-exec()-ing to set number of threads correctly... Machine Learning Dataset Generator v9.75 (Linux/x86_64) (libTorch: release/1.6 GPU: GeForce GTX 1650) device already set [2020-11-10 19:30:13 main:435] : INFO : Set logging level to 1 [2020-11-10 19:30:13 main:441] : INFO : Running in BOINC Client mode [2020-11-10 19:30:13 main:444] : INFO : Resolving all filenames [2020-11-10 19:30:13 main:452] : INFO : Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0023-train-val-dataset.hdf5 (exists = 1) [2020-11-10 19:30:13 main:452] : INFO : Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0023-1604983203-28938-0_2_r994010239_1 (exists = 0) [2020-11-10 19:30:13 main:452] : INFO : Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0023-1604983203-28938-0_2_r994010239_0 (exists = 0) [2020-11-10 19:30:13 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 0) [2020-11-10 19:30:13 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 0) [2020-11-10 19:30:13 main:472] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/rand_automata_0023-train-val-dataset.hdf5 [2020-11-10 19:30:13 main:474] : INFO : Configuration: [2020-11-10 19:30:13 main:475] : INFO : Model type: LSTM [2020-11-10 19:30:13 main:476] : INFO : Validation Loss Threshold: 0.0001 [2020-11-10 19:30:13 main:477] : INFO : Max Epochs: 192 [2020-11-10 19:30:13 main:478] : INFO : Batch Size: 32 [2020-11-10 19:30:13 main:479] : INFO : Learning Rate: 0.001 [2020-11-10 19:30:13 main:480] : INFO : Patience: 10 [2020-11-10 19:30:13 main:481] : INFO : Hidden Width: 64 [2020-11-10 19:30:13 main:482] : INFO : # Recurrent Layers: 4 [2020-11-10 19:30:13 main:483] : INFO : # Backend Layers: 2 [2020-11-10 19:30:13 main:484] : INFO : # Threads: 1 [2020-11-10 19:30:13 main:486] : INFO : Preparing Dataset [2020-11-10 19:30:13 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0023-train-val-dataset.hdf5 into memory [2020-11-10 19:30:13 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0023-train-val-dataset.hdf5 into memory [2020-11-10 19:30:16 load:106] : INFO : Successfully loaded dataset of 4096 examples into memory. [2020-11-10 19:30:16 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0023-train-val-dataset.hdf5 into memory [2020-11-10 19:30:16 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0023-train-val-dataset.hdf5 into memory [2020-11-10 19:30:16 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2020-11-10 19:30:16 main:494] : INFO : Creating Model [2020-11-10 19:30:16 main:507] : INFO : Preparing config file [2020-11-10 19:30:16 main:519] : INFO : Creating new config file [2020-11-10 19:30:19 main:559] : INFO : Loading DataLoader into Memory [2020-11-10 19:30:19 main:562] : INFO : Starting Training [2020-11-10 19:30:24 main:574] : INFO : Epoch 1 | loss: 0.0660252 | val_loss: 0.0648482 | Time: 5238.9 ms [2020-11-10 19:30:29 main:574] : INFO : Epoch 2 | loss: 0.0634717 | val_loss: 0.0618235 | Time: 4161.12 ms [2020-11-10 19:30:33 main:574] : INFO : Epoch 3 | loss: 0.0601339 | val_loss: 0.0583915 | Time: 4228.8 ms [2020-11-10 19:30:37 main:574] : INFO : Epoch 4 | loss: 0.0570826 | val_loss: 0.0557707 | Time: 4228.67 ms [2020-11-10 19:30:41 main:574] : INFO : Epoch 5 | loss: 0.0549747 | val_loss: 0.053938 | Time: 4189.08 ms [2020-11-10 19:30:46 main:574] : INFO : Epoch 6 | loss: 0.0532526 | val_loss: 0.05238 | Time: 4363.25 ms [2020-11-10 19:30:50 main:574] : INFO : Epoch 7 | loss: 0.0515855 | val_loss: 0.0506689 | Time: 4176.62 ms [2020-11-10 19:30:54 main:574] : INFO : Epoch 8 | loss: 0.0497716 | val_loss: 0.048786 | Time: 4343.22 ms [2020-11-10 19:30:58 main:574] : INFO : Epoch 9 | loss: 0.04772 | val_loss: 0.0465011 | Time: 4197.16 ms [2020-11-10 19:31:02 main:574] : INFO : Epoch 10 | loss: 0.0452543 | val_loss: 0.0440728 | Time: 4191.17 ms [2020-11-10 19:31:07 main:574] : INFO : Epoch 11 | loss: 0.0425017 | val_loss: 0.0412581 | Time: 4267.09 ms [2020-11-10 19:31:11 main:574] : INFO : Epoch 12 | loss: 0.0394993 | val_loss: 0.0385139 | Time: 4428.51 ms [2020-11-10 19:31:16 main:574] : INFO : Epoch 13 | loss: 0.0364463 | val_loss: 0.0355387 | Time: 4401.64 ms [2020-11-10 19:31:20 main:574] : INFO : Epoch 14 | loss: 0.0384296 | val_loss: 0.0352187 | Time: 4236.94 ms [2020-11-10 19:31:24 main:574] : INFO : Epoch 15 | loss: 0.0318565 | val_loss: 0.0314358 | Time: 4243.46 ms [2020-11-10 19:31:28 main:574] : INFO : Epoch 16 | loss: 0.0294358 | val_loss: 0.0286837 | Time: 4145.86 ms [2020-11-10 19:31:33 main:574] : INFO : Epoch 17 | loss: 0.0263324 | val_loss: 0.02529 | Time: 4389.01 ms [2020-11-10 19:31:37 main:574] : INFO : Epoch 18 | loss: 0.0243078 | val_loss: 0.0246666 | Time: 4152.1 ms [2020-11-10 19:31:41 main:574] : INFO : Epoch 19 | loss: 0.0224784 | val_loss: 0.0190909 | Time: 4425.43 ms [2020-11-10 19:31:45 main:574] : INFO : Epoch 20 | loss: 0.0199474 | val_loss: 0.0173695 | Time: 4225.8 ms [2020-11-10 19:31:50 main:574] : INFO : Epoch 21 | loss: 0.0215432 | val_loss: 0.0298716 | Time: 4673.88 ms [2020-11-10 19:31:55 main:574] : INFO : Epoch 22 | loss: 0.0212173 | val_loss: 0.0165481 | Time: 4454.64 ms [2020-11-10 19:31:59 main:574] : INFO : Epoch 23 | loss: 0.0169858 | val_loss: 0.0141053 | Time: 4409.31 ms [2020-11-10 19:32:03 main:574] : INFO : Epoch 24 | loss: 0.0119185 | val_loss: 0.0118505 | Time: 4479.66 ms [2020-11-10 19:32:08 main:574] : INFO : Epoch 25 | loss: 0.0108218 | val_loss: 0.0099697 | Time: 4498.14 ms [2020-11-10 19:32:12 main:574] : INFO : Epoch 26 | loss: 0.0187483 | val_loss: 0.0159895 | Time: 4386.86 ms [2020-11-10 19:32:17 main:574] : INFO : Epoch 27 | loss: 0.0198594 | val_loss: 0.0626839 | Time: 4334.21 ms [2020-11-10 19:32:21 main:574] : INFO : Epoch 28 | loss: 0.0602451 | val_loss: 0.0584407 | Time: 4338.06 ms [2020-11-10 19:32:25 main:574] : INFO : Epoch 29 | loss: 0.0563595 | val_loss: 0.0533479 | Time: 4227.93 ms [2020-11-10 19:32:30 main:574] : INFO : Epoch 30 | loss: 0.0487203 | val_loss: 0.0411602 | Time: 4394.02 ms [2020-11-10 19:32:34 main:574] : INFO : Epoch 31 | loss: 0.0269036 | val_loss: 0.0153136 | Time: 4360.46 ms [2020-11-10 19:32:38 main:574] : INFO : Epoch 32 | loss: 0.0146125 | val_loss: 0.0119879 | Time: 4321.25 ms [2020-11-10 19:32:42 main:574] : INFO : Epoch 33 | loss: 0.0101689 | val_loss: 0.00952904 | Time: 4199.53 ms [2020-11-10 19:32:47 main:574] : INFO : Epoch 34 | loss: 0.00889525 | val_loss: 0.00959399 | Time: 4476.05 ms [2020-11-10 19:32:51 main:574] : INFO : Epoch 35 | loss: 0.00862965 | val_loss: 0.00804287 | Time: 4466.12 ms [2020-11-10 19:32:56 main:574] : INFO : Epoch 36 | loss: 0.00770708 | val_loss: 0.00753438 | Time: 4343.18 ms [2020-11-10 19:33:00 main:574] : INFO : Epoch 37 | loss: 0.00729976 | val_loss: 0.00722972 | Time: 4267.92 ms [2020-11-10 19:33:04 main:574] : INFO : Epoch 38 | loss: 0.00702378 | val_loss: 0.00743926 | Time: 4213.34 ms [2020-11-10 19:33:09 main:574] : INFO : Epoch 39 | loss: 0.00686196 | val_loss: 0.00678741 | Time: 4375.98 ms [2020-11-10 19:33:13 main:574] : INFO : Epoch 40 | loss: 0.00728186 | val_loss: 0.00638236 | Time: 4340.75 ms [2020-11-10 19:33:17 main:574] : INFO : Epoch 41 | loss: 0.00619811 | val_loss: 0.00612237 | Time: 4452.11 ms [2020-11-10 19:33:22 main:574] : INFO : Epoch 42 | loss: 0.00592343 | val_loss: 0.00589355 | Time: 4414.48 ms [2020-11-10 19:33:26 main:574] : INFO : Epoch 43 | loss: 0.00570914 | val_loss: 0.00568716 | Time: 4428.88 ms [2020-11-10 19:33:31 main:574] : INFO : Epoch 44 | loss: 0.00550551 | val_loss: 0.00549168 | Time: 4662.54 ms [2020-11-10 19:33:35 main:574] : INFO : Epoch 45 | loss: 0.00531317 | val_loss: 0.00530452 | Time: 4554.05 ms [2020-11-10 19:33:40 main:574] : INFO : Epoch 46 | loss: 0.00512565 | val_loss: 0.00511136 | Time: 4609.8 ms [2020-11-10 19:33:45 main:574] : INFO : Epoch 47 | loss: 0.00494364 | val_loss: 0.00492697 | Time: 4635.49 ms [2020-11-10 19:33:49 main:574] : INFO : Epoch 48 | loss: 0.00476249 | val_loss: 0.00475124 | Time: 4652.01 ms [2020-11-10 19:33:54 main:574] : INFO : Epoch 49 | loss: 0.00459135 | val_loss: 0.00457264 | Time: 4428.99 ms [2020-11-10 19:33:58 main:574] : INFO : Epoch 50 | loss: 0.0044164 | val_loss: 0.00439572 | Time: 4477.01 ms [2020-11-10 19:34:03 main:574] : INFO : Epoch 51 | loss: 0.00424852 | val_loss: 0.00422927 | Time: 4634.25 ms [2020-11-10 19:34:07 main:574] : INFO : Epoch 52 | loss: 0.00408378 | val_loss: 0.00407045 | Time: 4388.67 ms [2020-11-10 19:34:12 main:574] : INFO : Epoch 53 | loss: 0.00392474 | val_loss: 0.00390974 | Time: 4306.9 ms [2020-11-10 19:34:16 main:574] : INFO : Epoch 54 | loss: 0.00376785 | val_loss: 0.00374374 | Time: 4235.66 ms [2020-11-10 19:34:20 main:574] : INFO : Epoch 55 | loss: 0.00361196 | val_loss: 0.00358973 | Time: 4204.25 ms [2020-11-10 19:34:24 main:574] : INFO : Epoch 56 | loss: 0.00347147 | val_loss: 0.00346912 | Time: 4091.52 ms [2020-11-10 19:34:28 main:574] : INFO : Epoch 57 | loss: 0.00331414 | val_loss: 0.00329447 | Time: 4164.76 ms [2020-11-10 19:34:33 main:574] : INFO : Epoch 58 | loss: 0.00316841 | val_loss: 0.00313195 | Time: 4246.88 ms [2020-11-10 19:34:37 main:574] : INFO : Epoch 59 | loss: 0.0030287 | val_loss: 0.00299334 | Time: 4234.15 ms [2020-11-10 19:34:41 main:574] : INFO : Epoch 60 | loss: 0.00289359 | val_loss: 0.00286056 | Time: 4235.92 ms [2020-11-10 19:34:45 main:574] : INFO : Epoch 61 | loss: 0.00276107 | val_loss: 0.0027297 | Time: 4396.92 ms [2020-11-10 19:34:50 main:574] : INFO : Epoch 62 | loss: 0.00263275 | val_loss: 0.00259971 | Time: 4261.38 ms [2020-11-10 19:34:54 main:574] : INFO : Epoch 63 | loss: 0.00250692 | val_loss: 0.00247819 | Time: 4217.7 ms [2020-11-10 19:34:58 main:574] : INFO : Epoch 64 | loss: 0.00238684 | val_loss: 0.00235806 | Time: 4345.43 ms [2020-11-10 19:35:03 main:574] : INFO : Epoch 65 | loss: 0.00226928 | val_loss: 0.00223881 | Time: 4394.89 ms [2020-11-10 19:35:07 main:574] : INFO : Epoch 66 | loss: 0.00215583 | val_loss: 0.00212565 | Time: 4398.96 ms [2020-11-10 19:35:11 main:574] : INFO : Epoch 67 | loss: 0.00204596 | val_loss: 0.00201923 | Time: 4280.16 ms [2020-11-10 19:35:16 main:574] : INFO : Epoch 68 | loss: 0.00194133 | val_loss: 0.00191489 | Time: 4248.42 ms [2020-11-10 19:35:20 main:574] : INFO : Epoch 69 | loss: 0.00183986 | val_loss: 0.00181277 | Time: 4298.57 ms [2020-11-10 19:35:24 main:574] : INFO : Epoch 70 | loss: 0.0017426 | val_loss: 0.00171696 | Time: 4418.77 ms [2020-11-10 19:35:29 main:574] : INFO : Epoch 71 | loss: 0.00164946 | val_loss: 0.00162286 | Time: 4466.93 ms [2020-11-10 19:35:33 main:574] : INFO : Epoch 72 | loss: 0.00156025 | val_loss: 0.00153809 | Time: 4431.16 ms [2020-11-10 19:35:38 main:574] : INFO : Epoch 73 | loss: 0.00147522 | val_loss: 0.00145099 | Time: 4313.84 ms [2020-11-10 19:35:42 main:574] : INFO : Epoch 74 | loss: 0.00139341 | val_loss: 0.0013712 | Time: 4338.73 ms [2020-11-10 19:35:46 main:574] : INFO : Epoch 75 | loss: 0.00131686 | val_loss: 0.00129753 | Time: 4547.74 ms [2020-11-10 19:35:51 main:574] : INFO : Epoch 76 | loss: 0.00124295 | val_loss: 0.00122127 | Time: 4427.98 ms [2020-11-10 19:35:55 main:574] : INFO : Epoch 77 | loss: 0.0011728 | val_loss: 0.00115295 | Time: 4424.25 ms [2020-11-10 19:36:00 main:574] : INFO : Epoch 78 | loss: 0.00110646 | val_loss: 0.00108868 | Time: 4359.21 ms [2020-11-10 19:36:04 main:574] : INFO : Epoch 79 | loss: 0.00104325 | val_loss: 0.00102716 | Time: 4101.94 ms [2020-11-10 19:36:08 main:574] : INFO : Epoch 80 | loss: 0.000983482 | val_loss: 0.000964418 | Time: 4633.93 ms [2020-11-10 19:36:13 main:574] : INFO : Epoch 81 | loss: 0.000926892 | val_loss: 0.000908701 | Time: 4320.71 ms [2020-11-10 19:36:17 main:574] : INFO : Epoch 82 | loss: 0.000873689 | val_loss: 0.000857836 | Time: 4475.28 ms [2020-11-10 19:36:21 main:574] : INFO : Epoch 83 | loss: 0.000822955 | val_loss: 0.000809856 | Time: 4278.73 ms [2020-11-10 19:36:26 main:574] : INFO : Epoch 84 | loss: 0.000774852 | val_loss: 0.000761329 | Time: 4318.32 ms [2020-11-10 19:36:30 main:574] : INFO : Epoch 85 | loss: 0.000730047 | val_loss: 0.000714658 | Time: 4240.66 ms [2020-11-10 19:36:34 main:574] : INFO : Epoch 86 | loss: 0.00068694 | val_loss: 0.000673315 | Time: 4333.71 ms [2020-11-10 19:36:39 main:574] : INFO : Epoch 87 | loss: 0.000647283 | val_loss: 0.000636194 | Time: 4352.34 ms [2020-11-10 19:36:43 main:574] : INFO : Epoch 88 | loss: 0.000609636 | val_loss: 0.000596364 | Time: 4170.86 ms [2020-11-10 19:36:47 main:574] : INFO : Epoch 89 | loss: 0.000574245 | val_loss: 0.000563318 | Time: 4394.2 ms [2020-11-10 19:36:52 main:574] : INFO : Epoch 90 | loss: 0.000540497 | val_loss: 0.000529137 | Time: 4428.98 ms [2020-11-10 19:36:56 main:574] : INFO : Epoch 91 | loss: 0.000508873 | val_loss: 0.000500365 | Time: 4172.46 ms [2020-11-10 19:37:00 main:574] : INFO : Epoch 92 | loss: 0.000478947 | val_loss: 0.000467857 | Time: 4358.33 ms [2020-11-10 19:37:05 main:574] : INFO : Epoch 93 | loss: 0.000451224 | val_loss: 0.000441724 | Time: 4360.4 ms [2020-11-10 19:37:09 main:574] : INFO : Epoch 94 | loss: 0.000425151 | val_loss: 0.000415887 | Time: 4184.88 ms [2020-11-10 19:37:13 main:574] : INFO : Epoch 95 | loss: 0.000399894 | val_loss: 0.000391168 | Time: 4397.94 ms [2020-11-10 19:37:17 main:574] : INFO : Epoch 96 | loss: 0.000376836 | val_loss: 0.000372173 | Time: 4341.62 ms [2020-11-10 19:37:22 main:574] : INFO : Epoch 97 | loss: 0.000355043 | val_loss: 0.000348162 | Time: 4352.04 ms [2020-11-10 19:37:26 main:574] : INFO : Epoch 98 | loss: 0.000334113 | val_loss: 0.000327186 | Time: 4431.77 ms [2020-11-10 19:37:31 main:574] : INFO : Epoch 99 | loss: 0.00031497 | val_loss: 0.000308955 | Time: 4246.28 ms [2020-11-10 19:37:35 main:574] : INFO : Epoch 100 | loss: 0.000297314 | val_loss: 0.000291675 | Time: 4318.61 ms [2020-11-10 19:37:39 main:574] : INFO : Epoch 101 | loss: 0.000280267 | val_loss: 0.000274509 | Time: 4251.92 ms [2020-11-10 19:37:43 main:574] : INFO : Epoch 102 | loss: 0.000263592 | val_loss: 0.000259674 | Time: 4192.19 ms [2020-11-10 19:37:48 main:574] : INFO : Epoch 103 | loss: 0.000249051 | val_loss: 0.000245738 | Time: 4301.11 ms [2020-11-10 19:37:52 main:574] : INFO : Epoch 104 | loss: 0.0002348 | val_loss: 0.000230866 | Time: 4310.33 ms [2020-11-10 19:37:56 main:574] : INFO : Epoch 105 | loss: 0.000221903 | val_loss: 0.000218348 | Time: 4327.28 ms [2020-11-10 19:38:01 main:574] : INFO : Epoch 106 | loss: 0.0002096 | val_loss: 0.000205115 | Time: 4307 ms [2020-11-10 19:38:05 main:574] : INFO : Epoch 107 | loss: 0.000197349 | val_loss: 0.000194988 | Time: 4329.26 ms [2020-11-10 19:38:09 main:574] : INFO : Epoch 108 | loss: 0.000187411 | val_loss: 0.000183267 | Time: 4342.23 ms [2020-11-10 19:38:14 main:574] : INFO : Epoch 109 | loss: 0.000177125 | val_loss: 0.000174728 | Time: 4320.43 ms [2020-11-10 19:38:18 main:574] : INFO : Epoch 110 | loss: 0.000167 | val_loss: 0.000163933 | Time: 4328.18 ms [2020-11-10 19:38:22 main:574] : INFO : Epoch 111 | loss: 0.000158714 | val_loss: 0.000156117 | Time: 4402.51 ms [2020-11-10 19:38:26 main:574] : INFO : Epoch 112 | loss: 0.000150387 | val_loss: 0.000147598 | Time: 4149.21 ms [2020-11-10 19:38:31 main:574] : INFO : Epoch 113 | loss: 0.000143103 | val_loss: 0.000139965 | Time: 4339.86 ms [2020-11-10 19:38:35 main:574] : INFO : Epoch 114 | loss: 0.000134425 | val_loss: 0.000132664 | Time: 4396.52 ms [2020-11-10 19:38:39 main:574] : INFO : Epoch 115 | loss: 0.000128205 | val_loss: 0.000126613 | Time: 4288.53 ms [2020-11-10 19:38:44 main:574] : INFO : Epoch 116 | loss: 0.000121904 | val_loss: 0.000123165 | Time: 4426.57 ms [2020-11-10 19:38:48 main:574] : INFO : Epoch 117 | loss: 0.00011609 | val_loss: 0.000114696 | Time: 4369.11 ms [2020-11-10 19:38:53 main:574] : INFO : Epoch 118 | loss: 0.000109772 | val_loss: 0.000109062 | Time: 4426.88 ms [2020-11-10 19:38:57 main:574] : INFO : Epoch 119 | loss: 0.000104865 | val_loss: 0.000102623 | Time: 4429.05 ms [2020-11-10 19:39:01 main:574] : INFO : Epoch 120 | loss: 9.9791e-05 | val_loss: 0.000100452 | Time: 4261.56 ms [2020-11-10 19:39:06 main:574] : INFO : Epoch 121 | loss: 9.51634e-05 | val_loss: 9.44855e-05 | Time: 4242.29 ms [2020-11-10 19:39:10 main:574] : INFO : Epoch 122 | loss: 9.14212e-05 | val_loss: 9.08998e-05 | Time: 4342.11 ms [2020-11-10 19:39:14 main:574] : INFO : Epoch 123 | loss: 8.71803e-05 | val_loss: 8.81186e-05 | Time: 4237.44 ms [2020-11-10 19:39:18 main:574] : INFO : Epoch 124 | loss: 8.38022e-05 | val_loss: 8.13203e-05 | Time: 4253.26 ms [2020-11-10 19:39:23 main:574] : INFO : Epoch 125 | loss: 7.98065e-05 | val_loss: 8.04478e-05 | Time: 4217 ms [2020-11-10 19:39:27 main:574] : INFO : Epoch 126 | loss: 7.61491e-05 | val_loss: 7.55424e-05 | Time: 4269.89 ms [2020-11-10 19:39:31 main:574] : INFO : Epoch 127 | loss: 7.30993e-05 | val_loss: 7.39927e-05 | Time: 4226.48 ms [2020-11-10 19:39:35 main:574] : INFO : Epoch 128 | loss: 7.09013e-05 | val_loss: 6.84442e-05 | Time: 4090.94 ms [2020-11-10 19:39:39 main:574] : INFO : Epoch 129 | loss: 6.7646e-05 | val_loss: 6.74559e-05 | Time: 4156.31 ms [2020-11-10 19:39:44 main:574] : INFO : Epoch 130 | loss: 6.5337e-05 | val_loss: 6.58912e-05 | Time: 4353.6 ms [2020-11-10 19:39:48 main:574] : INFO : Epoch 131 | loss: 6.26936e-05 | val_loss: 6.1654e-05 | Time: 4266.65 ms [2020-11-10 19:39:52 main:574] : INFO : Epoch 132 | loss: 6.10363e-05 | val_loss: 6.15525e-05 | Time: 4294.13 ms [2020-11-10 19:39:57 main:574] : INFO : Epoch 133 | loss: 5.93002e-05 | val_loss: 5.87986e-05 | Time: 4590.99 ms [2020-11-10 19:40:01 main:574] : INFO : Epoch 134 | loss: 5.59507e-05 | val_loss: 5.4396e-05 | Time: 4429.16 ms [2020-11-10 19:40:06 main:574] : INFO : Epoch 135 | loss: 5.41984e-05 | val_loss: 5.42002e-05 | Time: 4480.36 ms [2020-11-10 19:40:10 main:574] : INFO : Epoch 136 | loss: 5.23173e-05 | val_loss: 5.34417e-05 | Time: 4342.63 ms [2020-11-10 19:40:15 main:574] : INFO : Epoch 137 | loss: 5.10438e-05 | val_loss: 5.11224e-05 | Time: 4484.07 ms [2020-11-10 19:40:19 main:574] : INFO : Epoch 138 | loss: 4.96951e-05 | val_loss: 4.93707e-05 | Time: 4365.26 ms [2020-11-10 19:40:23 main:574] : INFO : Epoch 139 | loss: 4.77147e-05 | val_loss: 4.69027e-05 | Time: 4327.65 ms [2020-11-10 19:40:28 main:574] : INFO : Epoch 140 | loss: 4.61771e-05 | val_loss: 4.62282e-05 | Time: 4461.95 ms [2020-11-10 19:40:32 main:574] : INFO : Epoch 141 | loss: 4.51271e-05 | val_loss: 4.59008e-05 | Time: 4364 ms [2020-11-10 19:40:36 main:574] : INFO : Epoch 142 | loss: 4.38699e-05 | val_loss: 4.30092e-05 | Time: 4325.65 ms [2020-11-10 19:40:41 main:574] : INFO : Epoch 143 | loss: 4.25112e-05 | val_loss: 4.40676e-05 | Time: 4430.08 ms [2020-11-10 19:40:45 main:574] : INFO : Epoch 144 | loss: 4.1523e-05 | val_loss: 4.2094e-05 | Time: 4311.55 ms [2020-11-10 19:40:49 main:574] : INFO : Epoch 145 | loss: 3.97779e-05 | val_loss: 4.28256e-05 | Time: 4123.66 ms [2020-11-10 19:40:53 main:574] : INFO : Epoch 146 | loss: 3.8734e-05 | val_loss: 3.84156e-05 | Time: 4108.48 ms [2020-11-10 19:40:58 main:574] : INFO : Epoch 147 | loss: 3.81499e-05 | val_loss: 3.82186e-05 | Time: 4358.63 ms [2020-11-10 19:41:02 main:574] : INFO : Epoch 148 | loss: 3.73824e-05 | val_loss: 3.60142e-05 | Time: 4411.93 ms [2020-11-10 19:41:07 main:574] : INFO : Epoch 149 | loss: 3.62498e-05 | val_loss: 3.6096e-05 | Time: 4294.63 ms [2020-11-10 19:41:11 main:574] : INFO : Epoch 150 | loss: 3.53103e-05 | val_loss: 3.5062e-05 | Time: 4135.97 ms [2020-11-10 19:41:15 main:574] : INFO : Epoch 151 | loss: 3.46256e-05 | val_loss: 3.48685e-05 | Time: 4037.72 ms [2020-11-10 19:41:19 main:574] : INFO : Epoch 152 | loss: 3.41282e-05 | val_loss: 3.3688e-05 | Time: 4330.16 ms [2020-11-10 19:41:23 main:574] : INFO : Epoch 153 | loss: 3.25706e-05 | val_loss: 3.30248e-05 | Time: 4336.29 ms [2020-11-10 19:41:28 main:574] : INFO : Epoch 154 | loss: 3.26447e-05 | val_loss: 3.22112e-05 | Time: 4346.99 ms [2020-11-10 19:41:32 main:574] : INFO : Epoch 155 | loss: 3.15519e-05 | val_loss: 3.13705e-05 | Time: 4346.43 ms [2020-11-10 19:41:36 main:574] : INFO : Epoch 156 | loss: 3.06618e-05 | val_loss: 3.07428e-05 | Time: 4415.5 ms [2020-11-10 19:41:41 main:574] : INFO : Epoch 157 | loss: 2.99498e-05 | val_loss: 3.03916e-05 | Time: 4357.01 ms [2020-11-10 19:41:45 main:574] : INFO : Epoch 158 | loss: 2.95772e-05 | val_loss: 2.79854e-05 | Time: 4436.17 ms [2020-11-10 19:41:50 main:574] : INFO : Epoch 159 | loss: 2.87117e-05 | val_loss: 2.94432e-05 | Time: 4263.58 ms [2020-11-10 19:41:54 main:574] : INFO : Epoch 160 | loss: 2.8807e-05 | val_loss: 2.83322e-05 | Time: 4345.28 ms [2020-11-10 19:41:58 main:574] : INFO : Epoch 161 | loss: 2.73122e-05 | val_loss: 2.8954e-05 | Time: 4522.71 ms [2020-11-10 19:42:03 main:574] : INFO : Epoch 162 | loss: 2.69461e-05 | val_loss: 2.63302e-05 | Time: 4641.2 ms [2020-11-10 19:42:08 main:574] : INFO : Epoch 163 | loss: 2.63842e-05 | val_loss: 2.51531e-05 | Time: 4598.52 ms [2020-11-10 19:42:12 main:574] : INFO : Epoch 164 | loss: 2.53647e-05 | val_loss: 2.59301e-05 | Time: 4411.59 ms [2020-11-10 19:42:16 main:574] : INFO : Epoch 165 | loss: 2.53455e-05 | val_loss: 2.57129e-05 | Time: 4286.92 ms [2020-11-10 19:42:20 main:574] : INFO : Epoch 166 | loss: 2.58979e-05 | val_loss: 2.44309e-05 | Time: 4137.01 ms [2020-11-10 19:42:25 main:574] : INFO : Epoch 167 | loss: 2.41819e-05 | val_loss: 2.51545e-05 | Time: 4312.5 ms [2020-11-10 19:42:29 main:574] : INFO : Epoch 168 | loss: 2.43425e-05 | val_loss: 2.31197e-05 | Time: 4317.09 ms [2020-11-10 19:42:33 main:574] : INFO : Epoch 169 | loss: 2.35978e-05 | val_loss: 2.2743e-05 | Time: 4235.81 ms [2020-11-10 19:42:38 main:574] : INFO : Epoch 170 | loss: 2.42653e-05 | val_loss: 2.9016e-05 | Time: 4333.83 ms [2020-11-10 19:42:42 main:574] : INFO : Epoch 171 | loss: 2.26109e-05 | val_loss: 2.22541e-05 | Time: 4380.69 ms [2020-11-10 19:42:46 main:574] : INFO : Epoch 172 | loss: 2.20184e-05 | val_loss: 2.39147e-05 | Time: 4276.77 ms [2020-11-10 19:42:51 main:574] : INFO : Epoch 173 | loss: 2.18028e-05 | val_loss: 2.17898e-05 | Time: 4366.65 ms [2020-11-10 19:42:55 main:574] : INFO : Epoch 174 | loss: 2.16928e-05 | val_loss: 2.52875e-05 | Time: 4317.04 ms [2020-11-10 19:42:59 main:574] : INFO : Epoch 175 | loss: 2.13801e-05 | val_loss: 2.14601e-05 | Time: 4495.39 ms [2020-11-10 19:43:04 main:574] : INFO : Epoch 176 | loss: 2.08519e-05 | val_loss: 1.98187e-05 | Time: 4428.3 ms [2020-11-10 19:43:08 main:574] : INFO : Epoch 177 | loss: 2.08222e-05 | val_loss: 2.23278e-05 | Time: 4352.87 ms [2020-11-10 19:43:13 main:574] : INFO : Epoch 178 | loss: 2.11136e-05 | val_loss: 2.7119e-05 | Time: 4336.16 ms [2020-11-10 19:43:17 main:574] : INFO : Epoch 179 | loss: 1.97895e-05 | val_loss: 1.91096e-05 | Time: 4210.7 ms [2020-11-10 19:43:21 main:574] : INFO : Epoch 180 | loss: 1.94252e-05 | val_loss: 1.83134e-05 | Time: 4328.04 ms [2020-11-10 19:43:25 main:574] : INFO : Epoch 181 | loss: 1.94972e-05 | val_loss: 1.81957e-05 | Time: 4308.6 ms [2020-11-10 19:43:30 main:574] : INFO : Epoch 182 | loss: 1.99165e-05 | val_loss: 1.8103e-05 | Time: 4146.4 ms [2020-11-10 19:43:34 main:574] : INFO : Epoch 183 | loss: 1.78199e-05 | val_loss: 1.81717e-05 | Time: 4287.48 ms [2020-11-10 19:43:38 main:574] : INFO : Epoch 184 | loss: 1.93224e-05 | val_loss: 2.05882e-05 | Time: 4301.48 ms [2020-11-10 19:43:43 main:574] : INFO : Epoch 185 | loss: 1.82111e-05 | val_loss: 1.78122e-05 | Time: 4344.7 ms [2020-11-10 19:43:47 main:574] : INFO : Epoch 186 | loss: 1.77207e-05 | val_loss: 1.74087e-05 | Time: 4439.05 ms [2020-11-10 19:43:52 main:574] : INFO : Epoch 187 | loss: 1.80552e-05 | val_loss: 1.73393e-05 | Time: 4580.74 ms [2020-11-10 19:43:56 main:574] : INFO : Epoch 188 | loss: 1.71628e-05 | val_loss: 1.72014e-05 | Time: 4498.32 ms [2020-11-10 19:44:00 main:574] : INFO : Epoch 189 | loss: 1.76362e-05 | val_loss: 1.75613e-05 | Time: 4315.74 ms [2020-11-10 19:44:05 main:574] : INFO : Epoch 190 | loss: 1.71503e-05 | val_loss: 1.66102e-05 | Time: 4306.89 ms [2020-11-10 19:44:09 main:574] : INFO : Epoch 191 | loss: 1.6652e-05 | val_loss: 1.62707e-05 | Time: 4430.25 ms [2020-11-10 19:44:13 main:574] : INFO : Epoch 192 | loss: 1.65318e-05 | val_loss: 1.59022e-05 | Time: 4205.91 ms [2020-11-10 19:44:13 main:597] : INFO : Saving trained model to model-final.pt, val_loss 1.59022e-05 [2020-11-10 19:44:13 main:603] : INFO : Saving end state to config to file [2020-11-10 19:44:13 main:608] : INFO : Success, exiting.. 19:44:13 (13290): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)