Task 2824983
| Name | rand_automata_0021-1604983202-28902-0_3 |
| Workunit | 1263708 |
| Created | 10 Nov 2020, 23:31:35 UTC |
| Sent | 10 Nov 2020, 23:35:11 UTC |
| Report deadline | 11 Nov 2020, 22:05:11 UTC |
| Received | 11 Nov 2020, 1:55:06 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 3985 |
| Run time | 14 min 5 sec |
| CPU time | 13 min 59 sec |
| Validate state | Valid |
| Credit | 959.40 |
| Device peak FLOPS | 3,338.19 GFLOPS |
| Application version | Machine Learning Dataset Generator (test) v9.75 (cuda10200) x86_64-pc-linux-gnu |
| Peak working set size | 2.26 GB |
| Peak swap size | 9.68 GB |
| Peak disk usage | 0.60 MB |
Stderr output
<core_client_version>7.16.11</core_client_version> <![CDATA[ <stderr_txt> DEBUG: Args: ../../projects/www.mlcathome.org_mlcathome/mldstest_9.75_x86_64-pc-linux-gnu__cuda10200 -a LSTM -w 64 -b 2 -s 32 --lr 0.001 --maxepoch 192 --device 0 nthreads: 1 gpudev: 0 Re-exec()-ing to set number of threads correctly... Machine Learning Dataset Generator v9.75 (Linux/x86_64) (libTorch: release/1.6 GPU: GeForce GTX 1650) device already set [2020-11-10 20:40:49 main:435] : INFO : Set logging level to 1 [2020-11-10 20:40:49 main:441] : INFO : Running in BOINC Client mode [2020-11-10 20:40:49 main:444] : INFO : Resolving all filenames [2020-11-10 20:40:49 main:452] : INFO : Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0021-train-val-dataset.hdf5 (exists = 1) [2020-11-10 20:40:49 main:452] : INFO : Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0021-1604983202-28902-0_3_r251029304_1 (exists = 0) [2020-11-10 20:40:49 main:452] : INFO : Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0021-1604983202-28902-0_3_r251029304_0 (exists = 0) [2020-11-10 20:40:49 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 0) [2020-11-10 20:40:49 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 0) [2020-11-10 20:40:49 main:472] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/rand_automata_0021-train-val-dataset.hdf5 [2020-11-10 20:40:49 main:474] : INFO : Configuration: [2020-11-10 20:40:49 main:475] : INFO : Model type: LSTM [2020-11-10 20:40:49 main:476] : INFO : Validation Loss Threshold: 0.0001 [2020-11-10 20:40:49 main:477] : INFO : Max Epochs: 192 [2020-11-10 20:40:49 main:478] : INFO : Batch Size: 32 [2020-11-10 20:40:49 main:479] : INFO : Learning Rate: 0.001 [2020-11-10 20:40:49 main:480] : INFO : Patience: 10 [2020-11-10 20:40:49 main:481] : INFO : Hidden Width: 64 [2020-11-10 20:40:49 main:482] : INFO : # Recurrent Layers: 4 [2020-11-10 20:40:49 main:483] : INFO : # Backend Layers: 2 [2020-11-10 20:40:49 main:484] : INFO : # Threads: 1 [2020-11-10 20:40:49 main:486] : INFO : Preparing Dataset [2020-11-10 20:40:49 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0021-train-val-dataset.hdf5 into memory [2020-11-10 20:40:49 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0021-train-val-dataset.hdf5 into memory [2020-11-10 20:40:52 load:106] : INFO : Successfully loaded dataset of 4096 examples into memory. [2020-11-10 20:40:52 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0021-train-val-dataset.hdf5 into memory [2020-11-10 20:40:52 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0021-train-val-dataset.hdf5 into memory [2020-11-10 20:40:52 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2020-11-10 20:40:52 main:494] : INFO : Creating Model [2020-11-10 20:40:52 main:507] : INFO : Preparing config file [2020-11-10 20:40:52 main:519] : INFO : Creating new config file [2020-11-10 20:40:55 main:559] : INFO : Loading DataLoader into Memory [2020-11-10 20:40:55 main:562] : INFO : Starting Training [2020-11-10 20:41:00 main:574] : INFO : Epoch 1 | loss: 0.0661252 | val_loss: 0.0659142 | Time: 5185.99 ms [2020-11-10 20:41:04 main:574] : INFO : Epoch 2 | loss: 0.0651638 | val_loss: 0.0643486 | Time: 4306.26 ms [2020-11-10 20:41:08 main:574] : INFO : Epoch 3 | loss: 0.0625771 | val_loss: 0.0610744 | Time: 4205.34 ms [2020-11-10 20:41:12 main:574] : INFO : Epoch 4 | loss: 0.0597394 | val_loss: 0.058495 | Time: 4222.49 ms [2020-11-10 20:41:17 main:574] : INFO : Epoch 5 | loss: 0.0576419 | val_loss: 0.0569106 | Time: 4380.02 ms [2020-11-10 20:41:21 main:574] : INFO : Epoch 6 | loss: 0.0562336 | val_loss: 0.0556942 | Time: 4380.41 ms [2020-11-10 20:41:25 main:574] : INFO : Epoch 7 | loss: 0.0549861 | val_loss: 0.0544791 | Time: 4237.82 ms [2020-11-10 20:41:30 main:574] : INFO : Epoch 8 | loss: 0.0537494 | val_loss: 0.0533106 | Time: 4469.23 ms [2020-11-10 20:41:34 main:574] : INFO : Epoch 9 | loss: 0.0524402 | val_loss: 0.052004 | Time: 4346.73 ms [2020-11-10 20:41:39 main:574] : INFO : Epoch 10 | loss: 0.0509975 | val_loss: 0.0504341 | Time: 4391.91 ms [2020-11-10 20:41:43 main:574] : INFO : Epoch 11 | loss: 0.0492468 | val_loss: 0.0487167 | Time: 4337.75 ms [2020-11-10 20:41:47 main:574] : INFO : Epoch 12 | loss: 0.0473185 | val_loss: 0.0466976 | Time: 4449.52 ms [2020-11-10 20:41:52 main:574] : INFO : Epoch 13 | loss: 0.0448608 | val_loss: 0.0441235 | Time: 4296.27 ms [2020-11-10 20:41:56 main:574] : INFO : Epoch 14 | loss: 0.0418232 | val_loss: 0.0407938 | Time: 4390.8 ms [2020-11-10 20:42:00 main:574] : INFO : Epoch 15 | loss: 0.0385901 | val_loss: 0.0374744 | Time: 4280.43 ms [2020-11-10 20:42:05 main:574] : INFO : Epoch 16 | loss: 0.0344158 | val_loss: 0.0333111 | Time: 4330.88 ms [2020-11-10 20:42:09 main:574] : INFO : Epoch 17 | loss: 0.0304891 | val_loss: 0.030843 | Time: 4412.97 ms [2020-11-10 20:42:14 main:574] : INFO : Epoch 18 | loss: 0.0265807 | val_loss: 0.0253928 | Time: 4390.92 ms [2020-11-10 20:42:18 main:574] : INFO : Epoch 19 | loss: 0.0256634 | val_loss: 0.0226073 | Time: 4281.34 ms [2020-11-10 20:42:22 main:574] : INFO : Epoch 20 | loss: 0.0200767 | val_loss: 0.0204762 | Time: 4485.45 ms [2020-11-10 20:42:27 main:574] : INFO : Epoch 21 | loss: 0.0212642 | val_loss: 0.0175212 | Time: 4424.44 ms [2020-11-10 20:42:31 main:574] : INFO : Epoch 22 | loss: 0.0280763 | val_loss: 0.0232118 | Time: 4458.67 ms [2020-11-10 20:42:36 main:574] : INFO : Epoch 23 | loss: 0.0354297 | val_loss: 0.051155 | Time: 4352.48 ms [2020-11-10 20:42:40 main:574] : INFO : Epoch 24 | loss: 0.0295681 | val_loss: 0.0140048 | Time: 4360.71 ms [2020-11-10 20:42:44 main:574] : INFO : Epoch 25 | loss: 0.0127283 | val_loss: 0.016395 | Time: 4343.46 ms [2020-11-10 20:42:49 main:574] : INFO : Epoch 26 | loss: 0.0121808 | val_loss: 0.0155862 | Time: 4456.83 ms [2020-11-10 20:42:53 main:574] : INFO : Epoch 27 | loss: 0.0108448 | val_loss: 0.0113427 | Time: 4332 ms [2020-11-10 20:42:58 main:574] : INFO : Epoch 28 | loss: 0.00887865 | val_loss: 0.00946813 | Time: 4494.42 ms [2020-11-10 20:43:02 main:574] : INFO : Epoch 29 | loss: 0.00987244 | val_loss: 0.00891232 | Time: 4334.9 ms [2020-11-10 20:43:06 main:574] : INFO : Epoch 30 | loss: 0.00788709 | val_loss: 0.010746 | Time: 4427.96 ms [2020-11-10 20:43:11 main:574] : INFO : Epoch 31 | loss: 0.00753404 | val_loss: 0.00724452 | Time: 4219.11 ms [2020-11-10 20:43:15 main:574] : INFO : Epoch 32 | loss: 0.00668055 | val_loss: 0.00676527 | Time: 4402.97 ms [2020-11-10 20:43:19 main:574] : INFO : Epoch 33 | loss: 0.00635041 | val_loss: 0.00640765 | Time: 4455.74 ms [2020-11-10 20:43:24 main:574] : INFO : Epoch 34 | loss: 0.00608307 | val_loss: 0.0062743 | Time: 4573.96 ms [2020-11-10 20:43:28 main:574] : INFO : Epoch 35 | loss: 0.00584044 | val_loss: 0.00587766 | Time: 4504.32 ms [2020-11-10 20:43:33 main:574] : INFO : Epoch 36 | loss: 0.00929562 | val_loss: 0.00636148 | Time: 4428.28 ms [2020-11-10 20:43:37 main:574] : INFO : Epoch 37 | loss: 0.00582459 | val_loss: 0.00566054 | Time: 4437.69 ms [2020-11-10 20:43:42 main:574] : INFO : Epoch 38 | loss: 0.00537938 | val_loss: 0.00535898 | Time: 4334.74 ms [2020-11-10 20:43:46 main:574] : INFO : Epoch 39 | loss: 0.00512546 | val_loss: 0.00513294 | Time: 4397.56 ms [2020-11-10 20:43:51 main:574] : INFO : Epoch 40 | loss: 0.00489721 | val_loss: 0.00491998 | Time: 4551.62 ms [2020-11-10 20:43:55 main:574] : INFO : Epoch 41 | loss: 0.00470315 | val_loss: 0.00472343 | Time: 4408.44 ms [2020-11-10 20:43:59 main:574] : INFO : Epoch 42 | loss: 0.00452618 | val_loss: 0.00453634 | Time: 4391.56 ms [2020-11-10 20:44:04 main:574] : INFO : Epoch 43 | loss: 0.0120061 | val_loss: 0.00581468 | Time: 4277.38 ms [2020-11-10 20:44:08 main:574] : INFO : Epoch 44 | loss: 0.00547427 | val_loss: 0.00473859 | Time: 4517.56 ms [2020-11-10 20:44:13 main:574] : INFO : Epoch 45 | loss: 0.00443026 | val_loss: 0.00435491 | Time: 4417.07 ms [2020-11-10 20:44:17 main:574] : INFO : Epoch 46 | loss: 0.00415953 | val_loss: 0.00411458 | Time: 4636.73 ms [2020-11-10 20:44:22 main:574] : INFO : Epoch 47 | loss: 0.00397006 | val_loss: 0.00393916 | Time: 4401.72 ms [2020-11-10 20:44:26 main:574] : INFO : Epoch 48 | loss: 0.00380896 | val_loss: 0.00378718 | Time: 4295.17 ms [2020-11-10 20:44:30 main:574] : INFO : Epoch 49 | loss: 0.00366382 | val_loss: 0.00363804 | Time: 4234.89 ms [2020-11-10 20:44:35 main:574] : INFO : Epoch 50 | loss: 0.0035279 | val_loss: 0.00350655 | Time: 4338.43 ms [2020-11-10 20:44:39 main:574] : INFO : Epoch 51 | loss: 0.0033971 | val_loss: 0.00337121 | Time: 4422.28 ms [2020-11-10 20:44:43 main:574] : INFO : Epoch 52 | loss: 0.00327144 | val_loss: 0.00324728 | Time: 4506.24 ms [2020-11-10 20:44:48 main:574] : INFO : Epoch 53 | loss: 0.00314892 | val_loss: 0.00312551 | Time: 4277.78 ms [2020-11-10 20:44:52 main:574] : INFO : Epoch 54 | loss: 0.00303014 | val_loss: 0.00300463 | Time: 4166.65 ms [2020-11-10 20:44:56 main:574] : INFO : Epoch 55 | loss: 0.00291209 | val_loss: 0.00288529 | Time: 4366.28 ms [2020-11-10 20:45:01 main:574] : INFO : Epoch 56 | loss: 0.00279822 | val_loss: 0.0027725 | Time: 4332.97 ms [2020-11-10 20:45:05 main:574] : INFO : Epoch 57 | loss: 0.00268714 | val_loss: 0.0026622 | Time: 4270.37 ms [2020-11-10 20:45:09 main:574] : INFO : Epoch 58 | loss: 0.00257787 | val_loss: 0.0025555 | Time: 4476.37 ms [2020-11-10 20:45:14 main:574] : INFO : Epoch 59 | loss: 0.00247228 | val_loss: 0.00244523 | Time: 4305.74 ms [2020-11-10 20:45:18 main:574] : INFO : Epoch 60 | loss: 0.0023691 | val_loss: 0.00234581 | Time: 4351.59 ms [2020-11-10 20:45:22 main:574] : INFO : Epoch 61 | loss: 0.00226845 | val_loss: 0.00224373 | Time: 4234.79 ms [2020-11-10 20:45:27 main:574] : INFO : Epoch 62 | loss: 0.0021708 | val_loss: 0.0021511 | Time: 4447.33 ms [2020-11-10 20:45:31 main:574] : INFO : Epoch 63 | loss: 0.00207604 | val_loss: 0.00205418 | Time: 4318.2 ms [2020-11-10 20:45:35 main:574] : INFO : Epoch 64 | loss: 0.00198444 | val_loss: 0.00196307 | Time: 4437.58 ms [2020-11-10 20:45:40 main:574] : INFO : Epoch 65 | loss: 0.00189539 | val_loss: 0.00187372 | Time: 4330.43 ms [2020-11-10 20:45:44 main:574] : INFO : Epoch 66 | loss: 0.00180916 | val_loss: 0.00178654 | Time: 4377.54 ms [2020-11-10 20:45:48 main:574] : INFO : Epoch 67 | loss: 0.00172555 | val_loss: 0.00170625 | Time: 4300.1 ms [2020-11-10 20:45:53 main:574] : INFO : Epoch 68 | loss: 0.00164577 | val_loss: 0.00162823 | Time: 4124.1 ms [2020-11-10 20:45:57 main:574] : INFO : Epoch 69 | loss: 0.00156851 | val_loss: 0.00154875 | Time: 4481.12 ms [2020-11-10 20:46:01 main:574] : INFO : Epoch 70 | loss: 0.00149346 | val_loss: 0.00147699 | Time: 4401.73 ms [2020-11-10 20:46:06 main:574] : INFO : Epoch 71 | loss: 0.00142205 | val_loss: 0.00140433 | Time: 4312.78 ms [2020-11-10 20:46:10 main:574] : INFO : Epoch 72 | loss: 0.0013533 | val_loss: 0.00133556 | Time: 4367.67 ms [2020-11-10 20:46:15 main:574] : INFO : Epoch 73 | loss: 0.00128764 | val_loss: 0.00127209 | Time: 4418.83 ms [2020-11-10 20:46:19 main:574] : INFO : Epoch 74 | loss: 0.00122334 | val_loss: 0.00120827 | Time: 4493.9 ms [2020-11-10 20:46:24 main:574] : INFO : Epoch 75 | loss: 0.00116301 | val_loss: 0.00114825 | Time: 4455.26 ms [2020-11-10 20:46:28 main:574] : INFO : Epoch 76 | loss: 0.0011043 | val_loss: 0.0010918 | Time: 4291.32 ms [2020-11-10 20:46:32 main:574] : INFO : Epoch 77 | loss: 0.00104885 | val_loss: 0.0010374 | Time: 4335.13 ms [2020-11-10 20:46:36 main:574] : INFO : Epoch 78 | loss: 0.00099535 | val_loss: 0.000983947 | Time: 4338.15 ms [2020-11-10 20:46:41 main:574] : INFO : Epoch 79 | loss: 0.000945048 | val_loss: 0.00093224 | Time: 4325.99 ms [2020-11-10 20:46:45 main:574] : INFO : Epoch 80 | loss: 0.000895574 | val_loss: 0.000884129 | Time: 4434.08 ms [2020-11-10 20:46:50 main:574] : INFO : Epoch 81 | loss: 0.000849676 | val_loss: 0.000839035 | Time: 4325.07 ms [2020-11-10 20:46:54 main:574] : INFO : Epoch 82 | loss: 0.000805134 | val_loss: 0.000795727 | Time: 4289.19 ms [2020-11-10 20:46:58 main:574] : INFO : Epoch 83 | loss: 0.000762756 | val_loss: 0.000754324 | Time: 4449.2 ms [2020-11-10 20:47:03 main:574] : INFO : Epoch 84 | loss: 0.000722742 | val_loss: 0.000713592 | Time: 4243.15 ms [2020-11-10 20:47:07 main:574] : INFO : Epoch 85 | loss: 0.000684558 | val_loss: 0.000674884 | Time: 4238.71 ms [2020-11-10 20:47:11 main:574] : INFO : Epoch 86 | loss: 0.000648904 | val_loss: 0.000641629 | Time: 4272.1 ms [2020-11-10 20:47:15 main:574] : INFO : Epoch 87 | loss: 0.000614798 | val_loss: 0.000606798 | Time: 4318.18 ms [2020-11-10 20:47:20 main:574] : INFO : Epoch 88 | loss: 0.000580971 | val_loss: 0.000574041 | Time: 4192.38 ms [2020-11-10 20:47:24 main:574] : INFO : Epoch 89 | loss: 0.000550217 | val_loss: 0.000542051 | Time: 4371.43 ms [2020-11-10 20:47:28 main:574] : INFO : Epoch 90 | loss: 0.000521214 | val_loss: 0.000514695 | Time: 4415.47 ms [2020-11-10 20:47:33 main:574] : INFO : Epoch 91 | loss: 0.000493362 | val_loss: 0.000486616 | Time: 4377.61 ms [2020-11-10 20:47:37 main:574] : INFO : Epoch 92 | loss: 0.000467059 | val_loss: 0.000461109 | Time: 4419 ms [2020-11-10 20:47:41 main:574] : INFO : Epoch 93 | loss: 0.000441854 | val_loss: 0.000436251 | Time: 4282.57 ms [2020-11-10 20:47:46 main:574] : INFO : Epoch 94 | loss: 0.000417936 | val_loss: 0.000413934 | Time: 4358.85 ms [2020-11-10 20:47:50 main:574] : INFO : Epoch 95 | loss: 0.000396494 | val_loss: 0.000390356 | Time: 4168.45 ms [2020-11-10 20:47:54 main:574] : INFO : Epoch 96 | loss: 0.000374798 | val_loss: 0.000369 | Time: 4340.69 ms [2020-11-10 20:47:59 main:574] : INFO : Epoch 97 | loss: 0.000355291 | val_loss: 0.000350131 | Time: 4313.97 ms [2020-11-10 20:48:03 main:574] : INFO : Epoch 98 | loss: 0.000336995 | val_loss: 0.00033285 | Time: 4275.08 ms [2020-11-10 20:48:07 main:574] : INFO : Epoch 99 | loss: 0.000319529 | val_loss: 0.000315566 | Time: 4259.38 ms [2020-11-10 20:48:11 main:574] : INFO : Epoch 100 | loss: 0.000302781 | val_loss: 0.000299625 | Time: 4239.51 ms [2020-11-10 20:48:16 main:574] : INFO : Epoch 101 | loss: 0.00028631 | val_loss: 0.000283222 | Time: 4367.01 ms [2020-11-10 20:48:20 main:574] : INFO : Epoch 102 | loss: 0.00027169 | val_loss: 0.000269951 | Time: 4286.78 ms [2020-11-10 20:48:24 main:574] : INFO : Epoch 103 | loss: 0.000258267 | val_loss: 0.000255166 | Time: 4325.51 ms [2020-11-10 20:48:29 main:574] : INFO : Epoch 104 | loss: 0.000245022 | val_loss: 0.000241968 | Time: 4239 ms [2020-11-10 20:48:33 main:574] : INFO : Epoch 105 | loss: 0.000233323 | val_loss: 0.000229229 | Time: 4281.86 ms [2020-11-10 20:48:37 main:574] : INFO : Epoch 106 | loss: 0.000221571 | val_loss: 0.000218846 | Time: 4380.94 ms [2020-11-10 20:48:42 main:574] : INFO : Epoch 107 | loss: 0.000210396 | val_loss: 0.000207584 | Time: 4466.26 ms [2020-11-10 20:48:46 main:574] : INFO : Epoch 108 | loss: 0.000200841 | val_loss: 0.000198337 | Time: 4265.24 ms [2020-11-10 20:48:50 main:574] : INFO : Epoch 109 | loss: 0.000190784 | val_loss: 0.000187465 | Time: 4343.95 ms [2020-11-10 20:48:55 main:574] : INFO : Epoch 110 | loss: 0.000181347 | val_loss: 0.000179902 | Time: 4317.12 ms [2020-11-10 20:48:59 main:574] : INFO : Epoch 111 | loss: 0.00017328 | val_loss: 0.000171612 | Time: 4491.55 ms [2020-11-10 20:49:04 main:574] : INFO : Epoch 112 | loss: 0.000164916 | val_loss: 0.000163375 | Time: 4617.88 ms [2020-11-10 20:49:08 main:574] : INFO : Epoch 113 | loss: 0.000157699 | val_loss: 0.00015741 | Time: 4441.55 ms [2020-11-10 20:49:12 main:574] : INFO : Epoch 114 | loss: 0.000150193 | val_loss: 0.000150832 | Time: 4239.2 ms [2020-11-10 20:49:17 main:574] : INFO : Epoch 115 | loss: 0.000144359 | val_loss: 0.000140581 | Time: 4310.58 ms [2020-11-10 20:49:21 main:574] : INFO : Epoch 116 | loss: 0.000136939 | val_loss: 0.000136041 | Time: 4355.43 ms [2020-11-10 20:49:26 main:574] : INFO : Epoch 117 | loss: 0.000130904 | val_loss: 0.000130706 | Time: 4401.09 ms [2020-11-10 20:49:30 main:574] : INFO : Epoch 118 | loss: 0.00012582 | val_loss: 0.000124774 | Time: 4244.37 ms [2020-11-10 20:49:34 main:574] : INFO : Epoch 119 | loss: 0.000121342 | val_loss: 0.000118929 | Time: 4338.43 ms [2020-11-10 20:49:38 main:574] : INFO : Epoch 120 | loss: 0.000115285 | val_loss: 0.000113881 | Time: 4215.62 ms [2020-11-10 20:49:43 main:574] : INFO : Epoch 121 | loss: 0.000110254 | val_loss: 0.000110117 | Time: 4309.62 ms [2020-11-10 20:49:47 main:574] : INFO : Epoch 122 | loss: 0.00010643 | val_loss: 0.000104936 | Time: 4405.98 ms [2020-11-10 20:49:51 main:574] : INFO : Epoch 123 | loss: 0.000101601 | val_loss: 0.000103125 | Time: 4405.37 ms [2020-11-10 20:49:56 main:574] : INFO : Epoch 124 | loss: 9.73049e-05 | val_loss: 9.67217e-05 | Time: 4433.85 ms [2020-11-10 20:50:00 main:574] : INFO : Epoch 125 | loss: 9.36587e-05 | val_loss: 9.33071e-05 | Time: 4337.35 ms [2020-11-10 20:50:05 main:574] : INFO : Epoch 126 | loss: 8.97114e-05 | val_loss: 8.86973e-05 | Time: 4318.68 ms [2020-11-10 20:50:09 main:574] : INFO : Epoch 127 | loss: 8.67199e-05 | val_loss: 8.65852e-05 | Time: 4402.05 ms [2020-11-10 20:50:13 main:574] : INFO : Epoch 128 | loss: 8.37276e-05 | val_loss: 8.23737e-05 | Time: 4395.43 ms [2020-11-10 20:50:18 main:574] : INFO : Epoch 129 | loss: 8.03811e-05 | val_loss: 8.13022e-05 | Time: 4315.35 ms [2020-11-10 20:50:22 main:574] : INFO : Epoch 130 | loss: 7.74148e-05 | val_loss: 7.69438e-05 | Time: 4520.69 ms [2020-11-10 20:50:27 main:574] : INFO : Epoch 131 | loss: 7.42873e-05 | val_loss: 7.32596e-05 | Time: 4563.96 ms [2020-11-10 20:50:31 main:574] : INFO : Epoch 132 | loss: 7.21243e-05 | val_loss: 7.25282e-05 | Time: 4415.87 ms [2020-11-10 20:50:36 main:574] : INFO : Epoch 133 | loss: 6.92035e-05 | val_loss: 6.80252e-05 | Time: 4358.78 ms [2020-11-10 20:50:40 main:574] : INFO : Epoch 134 | loss: 6.76524e-05 | val_loss: 6.565e-05 | Time: 4352.13 ms [2020-11-10 20:50:44 main:574] : INFO : Epoch 135 | loss: 6.4692e-05 | val_loss: 6.44538e-05 | Time: 4461.34 ms [2020-11-10 20:50:49 main:574] : INFO : Epoch 136 | loss: 6.27143e-05 | val_loss: 6.2424e-05 | Time: 4384.64 ms [2020-11-10 20:50:53 main:574] : INFO : Epoch 137 | loss: 6.10348e-05 | val_loss: 6.0044e-05 | Time: 4388 ms [2020-11-10 20:50:57 main:574] : INFO : Epoch 138 | loss: 5.88494e-05 | val_loss: 5.88406e-05 | Time: 4352.63 ms [2020-11-10 20:51:02 main:574] : INFO : Epoch 139 | loss: 5.71752e-05 | val_loss: 5.67033e-05 | Time: 4284.13 ms [2020-11-10 20:51:06 main:574] : INFO : Epoch 140 | loss: 5.57731e-05 | val_loss: 5.80824e-05 | Time: 4285.92 ms [2020-11-10 20:51:10 main:574] : INFO : Epoch 141 | loss: 5.36517e-05 | val_loss: 5.36645e-05 | Time: 4408.32 ms [2020-11-10 20:51:15 main:574] : INFO : Epoch 142 | loss: 5.21307e-05 | val_loss: 5.1327e-05 | Time: 4493.31 ms [2020-11-10 20:51:19 main:574] : INFO : Epoch 143 | loss: 5.12267e-05 | val_loss: 5.08308e-05 | Time: 4308.27 ms [2020-11-10 20:51:24 main:574] : INFO : Epoch 144 | loss: 4.9099e-05 | val_loss: 4.90818e-05 | Time: 4413.43 ms [2020-11-10 20:51:28 main:574] : INFO : Epoch 145 | loss: 4.85315e-05 | val_loss: 4.66331e-05 | Time: 4185.73 ms [2020-11-10 20:51:32 main:574] : INFO : Epoch 146 | loss: 4.67079e-05 | val_loss: 4.62172e-05 | Time: 4286.68 ms [2020-11-10 20:51:37 main:574] : INFO : Epoch 147 | loss: 4.57693e-05 | val_loss: 4.50645e-05 | Time: 4437.71 ms [2020-11-10 20:51:41 main:574] : INFO : Epoch 148 | loss: 4.47231e-05 | val_loss: 4.41269e-05 | Time: 4313.59 ms [2020-11-10 20:51:45 main:574] : INFO : Epoch 149 | loss: 4.33161e-05 | val_loss: 4.25018e-05 | Time: 4331.44 ms [2020-11-10 20:51:50 main:574] : INFO : Epoch 150 | loss: 4.16429e-05 | val_loss: 4.16235e-05 | Time: 4509.6 ms [2020-11-10 20:51:54 main:574] : INFO : Epoch 151 | loss: 4.10833e-05 | val_loss: 4.23262e-05 | Time: 4587.24 ms [2020-11-10 20:51:59 main:574] : INFO : Epoch 152 | loss: 4.02599e-05 | val_loss: 4.04638e-05 | Time: 4524.55 ms [2020-11-10 20:52:03 main:574] : INFO : Epoch 153 | loss: 3.9204e-05 | val_loss: 3.91168e-05 | Time: 4502.6 ms [2020-11-10 20:52:08 main:574] : INFO : Epoch 154 | loss: 3.78922e-05 | val_loss: 3.88382e-05 | Time: 4401.3 ms [2020-11-10 20:52:12 main:574] : INFO : Epoch 155 | loss: 3.71118e-05 | val_loss: 3.72037e-05 | Time: 4296.54 ms [2020-11-10 20:52:16 main:574] : INFO : Epoch 156 | loss: 3.68486e-05 | val_loss: 3.57328e-05 | Time: 4113.06 ms [2020-11-10 20:52:20 main:574] : INFO : Epoch 157 | loss: 3.53992e-05 | val_loss: 3.52006e-05 | Time: 4292.79 ms [2020-11-10 20:52:25 main:574] : INFO : Epoch 158 | loss: 3.45805e-05 | val_loss: 3.50537e-05 | Time: 4389.89 ms [2020-11-10 20:52:29 main:574] : INFO : Epoch 159 | loss: 3.42971e-05 | val_loss: 3.47019e-05 | Time: 4359.47 ms [2020-11-10 20:52:34 main:574] : INFO : Epoch 160 | loss: 3.30697e-05 | val_loss: 3.35332e-05 | Time: 4456.96 ms [2020-11-10 20:52:38 main:574] : INFO : Epoch 161 | loss: 3.23038e-05 | val_loss: 3.40167e-05 | Time: 4250.78 ms [2020-11-10 20:52:42 main:574] : INFO : Epoch 162 | loss: 3.26465e-05 | val_loss: 3.13651e-05 | Time: 4411.55 ms [2020-11-10 20:52:47 main:574] : INFO : Epoch 163 | loss: 3.13442e-05 | val_loss: 3.10376e-05 | Time: 4268.57 ms [2020-11-10 20:52:51 main:574] : INFO : Epoch 164 | loss: 3.10053e-05 | val_loss: 3.00074e-05 | Time: 4406.01 ms [2020-11-10 20:52:55 main:574] : INFO : Epoch 165 | loss: 2.99376e-05 | val_loss: 2.90145e-05 | Time: 4331.99 ms [2020-11-10 20:53:00 main:574] : INFO : Epoch 166 | loss: 2.94651e-05 | val_loss: 2.94201e-05 | Time: 4203.36 ms [2020-11-10 20:53:04 main:574] : INFO : Epoch 167 | loss: 2.86956e-05 | val_loss: 2.8555e-05 | Time: 4431.98 ms [2020-11-10 20:53:08 main:574] : INFO : Epoch 168 | loss: 2.84445e-05 | val_loss: 2.76792e-05 | Time: 4328.33 ms [2020-11-10 20:53:13 main:574] : INFO : Epoch 169 | loss: 2.76401e-05 | val_loss: 2.69064e-05 | Time: 4313.38 ms [2020-11-10 20:53:17 main:574] : INFO : Epoch 170 | loss: 2.79995e-05 | val_loss: 2.77559e-05 | Time: 4342.57 ms [2020-11-10 20:53:21 main:574] : INFO : Epoch 171 | loss: 2.67878e-05 | val_loss: 2.63484e-05 | Time: 4222.73 ms [2020-11-10 20:53:25 main:574] : INFO : Epoch 172 | loss: 2.62008e-05 | val_loss: 2.64841e-05 | Time: 4228.51 ms [2020-11-10 20:53:30 main:574] : INFO : Epoch 173 | loss: 2.57918e-05 | val_loss: 2.64075e-05 | Time: 4186.87 ms [2020-11-10 20:53:34 main:574] : INFO : Epoch 174 | loss: 2.53353e-05 | val_loss: 2.5246e-05 | Time: 4266.1 ms [2020-11-10 20:53:38 main:574] : INFO : Epoch 175 | loss: 2.50687e-05 | val_loss: 2.66372e-05 | Time: 4309.98 ms [2020-11-10 20:53:42 main:574] : INFO : Epoch 176 | loss: 2.45578e-05 | val_loss: 2.42704e-05 | Time: 4276.4 ms [2020-11-10 20:53:47 main:574] : INFO : Epoch 177 | loss: 2.46232e-05 | val_loss: 2.59356e-05 | Time: 4313.83 ms [2020-11-10 20:53:51 main:574] : INFO : Epoch 178 | loss: 2.38246e-05 | val_loss: 2.35453e-05 | Time: 4328.07 ms [2020-11-10 20:53:55 main:574] : INFO : Epoch 179 | loss: 2.35854e-05 | val_loss: 2.53168e-05 | Time: 4284.83 ms [2020-11-10 20:54:00 main:574] : INFO : Epoch 180 | loss: 2.27488e-05 | val_loss: 2.21582e-05 | Time: 4386.68 ms [2020-11-10 20:54:04 main:574] : INFO : Epoch 181 | loss: 2.28956e-05 | val_loss: 2.23043e-05 | Time: 4234.08 ms [2020-11-10 20:54:08 main:574] : INFO : Epoch 182 | loss: 2.22246e-05 | val_loss: 2.25171e-05 | Time: 4428.24 ms [2020-11-10 20:54:13 main:574] : INFO : Epoch 183 | loss: 2.17101e-05 | val_loss: 2.09101e-05 | Time: 4297.27 ms [2020-11-10 20:54:17 main:574] : INFO : Epoch 184 | loss: 2.15099e-05 | val_loss: 2.17809e-05 | Time: 4276.36 ms [2020-11-10 20:54:21 main:574] : INFO : Epoch 185 | loss: 2.06463e-05 | val_loss: 2.11843e-05 | Time: 4385.54 ms [2020-11-10 20:54:25 main:574] : INFO : Epoch 186 | loss: 2.1221e-05 | val_loss: 2.1383e-05 | Time: 4066.82 ms [2020-11-10 20:54:30 main:574] : INFO : Epoch 187 | loss: 2.11538e-05 | val_loss: 2.14116e-05 | Time: 4302.26 ms [2020-11-10 20:54:34 main:574] : INFO : Epoch 188 | loss: 2.01671e-05 | val_loss: 2.03877e-05 | Time: 4167.02 ms [2020-11-10 20:54:38 main:574] : INFO : Epoch 189 | loss: 1.98221e-05 | val_loss: 1.96212e-05 | Time: 4414.25 ms [2020-11-10 20:54:43 main:574] : INFO : Epoch 190 | loss: 1.97819e-05 | val_loss: 1.97783e-05 | Time: 4337.32 ms [2020-11-10 20:54:47 main:574] : INFO : Epoch 191 | loss: 1.98045e-05 | val_loss: 1.89122e-05 | Time: 4253.42 ms [2020-11-10 20:54:51 main:574] : INFO : Epoch 192 | loss: 1.92438e-05 | val_loss: 1.87004e-05 | Time: 4426.06 ms [2020-11-10 20:54:51 main:597] : INFO : Saving trained model to model-final.pt, val_loss 1.87004e-05 [2020-11-10 20:54:51 main:603] : INFO : Saving end state to config to file [2020-11-10 20:54:51 main:608] : INFO : Success, exiting.. 20:54:51 (13658): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)