Task 2795830
| Name | rand_automata_0041-1604947474-21315-0_1 |
| Workunit | 1259354 |
| Created | 9 Nov 2020, 19:00:31 UTC |
| Sent | 9 Nov 2020, 19:01:28 UTC |
| Report deadline | 10 Nov 2020, 17:31:28 UTC |
| Received | 10 Nov 2020, 0:53:10 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 596 |
| Run time | 51 min 32 sec |
| CPU time | 50 min 4 sec |
| Validate state | Valid |
| Credit | 959.40 |
| Device peak FLOPS | 7,315.00 GFLOPS |
| Application version | Machine Learning Dataset Generator (test) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.98 GB |
| Peak swap size | 3.94 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.14.2</core_client_version> <![CDATA[ <stderr_txt> Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce RTX 2060 SUPER) [2020-11-10 01:01:26 main:435] : INFO : Set logging level to 1 [2020-11-10 01:01:26 main:441] : INFO : Running in BOINC Client mode [2020-11-10 01:01:26 main:444] : INFO : Resolving all filenames [2020-11-10 01:01:26 main:452] : INFO : Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0041-train-val-dataset.hdf5 (exists = 1) [2020-11-10 01:01:26 main:452] : INFO : Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0041-1604947474-21315-0_1_r2138465243_1 (exists = 0) [2020-11-10 01:01:26 main:452] : INFO : Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0041-1604947474-21315-0_1_r2138465243_0 (exists = 0) [2020-11-10 01:01:26 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 0) [2020-11-10 01:01:26 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 0) [2020-11-10 01:01:26 main:472] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/rand_automata_0041-train-val-dataset.hdf5 [2020-11-10 01:01:26 main:474] : INFO : Configuration: [2020-11-10 01:01:26 main:475] : INFO : Model type: LSTM [2020-11-10 01:01:26 main:476] : INFO : Validation Loss Threshold: 0.0001 [2020-11-10 01:01:26 main:477] : INFO : Max Epochs: 192 [2020-11-10 01:01:26 main:478] : INFO : Batch Size: 32 [2020-11-10 01:01:26 main:479] : INFO : Learning Rate: 0.001 [2020-11-10 01:01:26 main:480] : INFO : Patience: 10 [2020-11-10 01:01:26 main:481] : INFO : Hidden Width: 64 [2020-11-10 01:01:26 main:482] : INFO : # Recurrent Layers: 4 [2020-11-10 01:01:26 main:483] : INFO : # Backend Layers: 2 [2020-11-10 01:01:26 main:484] : INFO : # Threads: 1 [2020-11-10 01:01:26 main:486] : INFO : Preparing Dataset [2020-11-10 01:01:26 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0041-train-val-dataset.hdf5 into memory [2020-11-10 01:01:26 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0041-train-val-dataset.hdf5 into memory [2020-11-10 01:01:33 load:106] : INFO : Successfully loaded dataset of 4096 examples into memory. [2020-11-10 01:01:33 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0041-train-val-dataset.hdf5 into memory [2020-11-10 01:01:33 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0041-train-val-dataset.hdf5 into memory [2020-11-10 01:01:33 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2020-11-10 01:01:33 main:494] : INFO : Creating Model [2020-11-10 01:01:33 main:507] : INFO : Preparing config file [2020-11-10 01:01:33 main:519] : INFO : Creating new config file [2020-11-10 01:01:38 main:559] : INFO : Loading DataLoader into Memory [2020-11-10 01:01:38 main:562] : INFO : Starting Training [2020-11-10 01:01:55 main:574] : INFO : Epoch 1 | loss: 0.0663483 | val_loss: 0.0660067 | Time: 17168 ms [2020-11-10 01:02:11 main:574] : INFO : Epoch 2 | loss: 0.0649062 | val_loss: 0.0633934 | Time: 16019 ms [2020-11-10 01:02:27 main:574] : INFO : Epoch 3 | loss: 0.0606235 | val_loss: 0.058418 | Time: 16011.2 ms [2020-11-10 01:02:43 main:574] : INFO : Epoch 4 | loss: 0.0561784 | val_loss: 0.0541893 | Time: 15802.8 ms [2020-11-10 01:02:59 main:574] : INFO : Epoch 5 | loss: 0.0526681 | val_loss: 0.0514025 | Time: 15729.6 ms [2020-11-10 01:03:15 main:574] : INFO : Epoch 6 | loss: 0.050107 | val_loss: 0.0490072 | Time: 15863.5 ms [2020-11-10 01:03:31 main:574] : INFO : Epoch 7 | loss: 0.0477641 | val_loss: 0.0466441 | Time: 15935.3 ms [2020-11-10 01:03:46 main:574] : INFO : Epoch 8 | loss: 0.045309 | val_loss: 0.0442104 | Time: 15714.2 ms [2020-11-10 01:04:02 main:574] : INFO : Epoch 9 | loss: 0.042512 | val_loss: 0.0415426 | Time: 15944.4 ms [2020-11-10 01:04:18 main:574] : INFO : Epoch 10 | loss: 0.0391875 | val_loss: 0.0378313 | Time: 15927.1 ms [2020-11-10 01:04:34 main:574] : INFO : Epoch 11 | loss: 0.0351244 | val_loss: 0.033963 | Time: 15978.1 ms [2020-11-10 01:04:50 main:574] : INFO : Epoch 12 | loss: 0.0305231 | val_loss: 0.0289782 | Time: 15917.9 ms [2020-11-10 01:05:06 main:574] : INFO : Epoch 13 | loss: 0.0260142 | val_loss: 0.0243766 | Time: 15940.3 ms [2020-11-10 01:05:22 main:574] : INFO : Epoch 14 | loss: 0.0223936 | val_loss: 0.0226657 | Time: 15952.6 ms [2020-11-10 01:05:38 main:574] : INFO : Epoch 15 | loss: 0.0180528 | val_loss: 0.0169452 | Time: 15927.5 ms [2020-11-10 01:05:54 main:574] : INFO : Epoch 16 | loss: 0.0164143 | val_loss: 0.0155495 | Time: 15715.3 ms [2020-11-10 01:06:10 main:574] : INFO : Epoch 17 | loss: 0.0161663 | val_loss: 0.0144643 | Time: 15923.4 ms [2020-11-10 01:06:26 main:574] : INFO : Epoch 18 | loss: 0.0153137 | val_loss: 0.0123911 | Time: 15915 ms [2020-11-10 01:06:42 main:574] : INFO : Epoch 19 | loss: 0.0115737 | val_loss: 0.0102974 | Time: 15840.1 ms [2020-11-10 01:06:58 main:574] : INFO : Epoch 20 | loss: 0.0109963 | val_loss: 0.0176309 | Time: 15812.4 ms [2020-11-10 01:07:14 main:574] : INFO : Epoch 21 | loss: 0.00953463 | val_loss: 0.00848982 | Time: 15834.1 ms [2020-11-10 01:07:30 main:574] : INFO : Epoch 22 | loss: 0.00766148 | val_loss: 0.00777935 | Time: 15975.1 ms [2020-11-10 01:07:46 main:574] : INFO : Epoch 23 | loss: 0.00663506 | val_loss: 0.00678551 | Time: 16011.1 ms [2020-11-10 01:08:02 main:574] : INFO : Epoch 24 | loss: 0.00706376 | val_loss: 0.00662884 | Time: 15848.2 ms [2020-11-10 01:08:18 main:574] : INFO : Epoch 25 | loss: 0.00642007 | val_loss: 0.00598032 | Time: 15996.3 ms [2020-11-10 01:08:34 main:574] : INFO : Epoch 26 | loss: 0.00539251 | val_loss: 0.00555604 | Time: 16065.1 ms [2020-11-10 01:08:50 main:574] : INFO : Epoch 27 | loss: 0.00505144 | val_loss: 0.00525782 | Time: 16149.2 ms [2020-11-10 01:09:06 main:574] : INFO : Epoch 28 | loss: 0.00475053 | val_loss: 0.00491198 | Time: 16096.7 ms [2020-11-10 01:09:22 main:574] : INFO : Epoch 29 | loss: 0.00449226 | val_loss: 0.00468878 | Time: 15928.7 ms [2020-11-10 01:09:38 main:574] : INFO : Epoch 30 | loss: 0.0042319 | val_loss: 0.00437669 | Time: 16076.6 ms [2020-11-10 01:09:54 main:574] : INFO : Epoch 31 | loss: 0.0039921 | val_loss: 0.00413296 | Time: 15805.7 ms [2020-11-10 01:10:10 main:574] : INFO : Epoch 32 | loss: 0.00378928 | val_loss: 0.00388508 | Time: 16039.4 ms [2020-11-10 01:10:26 main:574] : INFO : Epoch 33 | loss: 0.00356517 | val_loss: 0.00367758 | Time: 15979.1 ms [2020-11-10 01:10:42 main:574] : INFO : Epoch 34 | loss: 0.00337144 | val_loss: 0.00345386 | Time: 16003.7 ms [2020-11-10 01:10:58 main:574] : INFO : Epoch 35 | loss: 0.00318459 | val_loss: 0.0032532 | Time: 15776.9 ms [2020-11-10 01:11:14 main:574] : INFO : Epoch 36 | loss: 0.00300548 | val_loss: 0.00306548 | Time: 15816.4 ms [2020-11-10 01:11:30 main:574] : INFO : Epoch 37 | loss: 0.00283511 | val_loss: 0.00288574 | Time: 15953.1 ms [2020-11-10 01:11:46 main:574] : INFO : Epoch 38 | loss: 0.00267046 | val_loss: 0.0027195 | Time: 15925.2 ms [2020-11-10 01:12:02 main:574] : INFO : Epoch 39 | loss: 0.00255495 | val_loss: 0.00256351 | Time: 15817.2 ms [2020-11-10 01:12:18 main:574] : INFO : Epoch 40 | loss: 0.00237442 | val_loss: 0.0024125 | Time: 15900 ms [2020-11-10 01:12:34 main:574] : INFO : Epoch 41 | loss: 0.00223359 | val_loss: 0.00227122 | Time: 16183.8 ms [2020-11-10 01:12:50 main:574] : INFO : Epoch 42 | loss: 0.00237812 | val_loss: 0.00242976 | Time: 16024.4 ms [2020-11-10 01:13:06 main:574] : INFO : Epoch 43 | loss: 0.00202723 | val_loss: 0.00202492 | Time: 15801.8 ms [2020-11-10 01:13:22 main:574] : INFO : Epoch 44 | loss: 0.00187186 | val_loss: 0.0018943 | Time: 16096.7 ms [2020-11-10 01:13:38 main:574] : INFO : Epoch 45 | loss: 0.00175977 | val_loss: 0.00178288 | Time: 15847.5 ms [2020-11-10 01:13:54 main:574] : INFO : Epoch 46 | loss: 0.00165576 | val_loss: 0.00167536 | Time: 15805.7 ms [2020-11-10 01:14:09 main:574] : INFO : Epoch 47 | loss: 0.00155853 | val_loss: 0.00157634 | Time: 15796.7 ms [2020-11-10 01:14:25 main:574] : INFO : Epoch 48 | loss: 0.00146586 | val_loss: 0.00148285 | Time: 15831.1 ms [2020-11-10 01:14:41 main:574] : INFO : Epoch 49 | loss: 0.00137852 | val_loss: 0.00139334 | Time: 16000.8 ms [2020-11-10 01:14:57 main:574] : INFO : Epoch 50 | loss: 0.00129658 | val_loss: 0.00131155 | Time: 15761.9 ms [2020-11-10 01:15:13 main:574] : INFO : Epoch 51 | loss: 0.00121896 | val_loss: 0.00123229 | Time: 15793 ms [2020-11-10 01:15:29 main:574] : INFO : Epoch 52 | loss: 0.00114589 | val_loss: 0.00115792 | Time: 15907 ms [2020-11-10 01:15:45 main:574] : INFO : Epoch 53 | loss: 0.00107662 | val_loss: 0.00108887 | Time: 16125.4 ms [2020-11-10 01:16:01 main:574] : INFO : Epoch 54 | loss: 0.00101159 | val_loss: 0.00102076 | Time: 15908.6 ms [2020-11-10 01:16:17 main:574] : INFO : Epoch 55 | loss: 0.000950452 | val_loss: 0.000960965 | Time: 15903.5 ms [2020-11-10 01:16:33 main:574] : INFO : Epoch 56 | loss: 0.000892979 | val_loss: 0.000903598 | Time: 15985.4 ms [2020-11-10 01:16:49 main:574] : INFO : Epoch 57 | loss: 0.000838965 | val_loss: 0.0008495 | Time: 16001.6 ms [2020-11-10 01:17:05 main:574] : INFO : Epoch 58 | loss: 0.00078883 | val_loss: 0.000801736 | Time: 15949.7 ms [2020-11-10 01:17:21 main:574] : INFO : Epoch 59 | loss: 0.000741117 | val_loss: 0.000750153 | Time: 16060.5 ms [2020-11-10 01:17:37 main:574] : INFO : Epoch 60 | loss: 0.000695574 | val_loss: 0.000701832 | Time: 15915.7 ms [2020-11-10 01:17:53 main:574] : INFO : Epoch 61 | loss: 0.000653761 | val_loss: 0.000661043 | Time: 15978.9 ms [2020-11-10 01:18:09 main:574] : INFO : Epoch 62 | loss: 0.000613882 | val_loss: 0.000623262 | Time: 15640 ms [2020-11-10 01:18:25 main:574] : INFO : Epoch 63 | loss: 0.000576097 | val_loss: 0.000583681 | Time: 15748 ms [2020-11-10 01:18:41 main:574] : INFO : Epoch 64 | loss: 0.000541174 | val_loss: 0.000550288 | Time: 16046.7 ms [2020-11-10 01:18:56 main:574] : INFO : Epoch 65 | loss: 0.000508846 | val_loss: 0.000517637 | Time: 15727.8 ms [2020-11-10 01:19:12 main:574] : INFO : Epoch 66 | loss: 0.000477699 | val_loss: 0.000484752 | Time: 15800.2 ms [2020-11-10 01:19:28 main:574] : INFO : Epoch 67 | loss: 0.000448858 | val_loss: 0.000455937 | Time: 15845.3 ms [2020-11-10 01:19:44 main:574] : INFO : Epoch 68 | loss: 0.000421277 | val_loss: 0.00042997 | Time: 15958.9 ms [2020-11-10 01:20:00 main:574] : INFO : Epoch 69 | loss: 0.000396124 | val_loss: 0.000404229 | Time: 16022.7 ms [2020-11-10 01:20:16 main:574] : INFO : Epoch 70 | loss: 0.000372402 | val_loss: 0.000378356 | Time: 15926 ms [2020-11-10 01:20:32 main:574] : INFO : Epoch 71 | loss: 0.000349108 | val_loss: 0.000354901 | Time: 15864.2 ms [2020-11-10 01:20:48 main:574] : INFO : Epoch 72 | loss: 0.000328537 | val_loss: 0.000332079 | Time: 16055.1 ms [2020-11-10 01:21:04 main:574] : INFO : Epoch 73 | loss: 0.000308341 | val_loss: 0.000313052 | Time: 16004.6 ms [2020-11-10 01:21:20 main:574] : INFO : Epoch 74 | loss: 0.000289162 | val_loss: 0.000292146 | Time: 15907.5 ms [2020-11-10 01:21:36 main:574] : INFO : Epoch 75 | loss: 0.000272236 | val_loss: 0.000276682 | Time: 15896 ms [2020-11-10 01:21:52 main:574] : INFO : Epoch 76 | loss: 0.000254913 | val_loss: 0.000256896 | Time: 15850.8 ms [2020-11-10 01:22:08 main:574] : INFO : Epoch 77 | loss: 0.000239923 | val_loss: 0.000242473 | Time: 15977 ms [2020-11-10 01:22:24 main:574] : INFO : Epoch 78 | loss: 0.000225202 | val_loss: 0.000227973 | Time: 15943.5 ms [2020-11-10 01:22:40 main:574] : INFO : Epoch 79 | loss: 0.000211422 | val_loss: 0.00021575 | Time: 16095.3 ms [2020-11-10 01:22:56 main:574] : INFO : Epoch 80 | loss: 0.000198922 | val_loss: 0.000203259 | Time: 15885 ms [2020-11-10 01:23:12 main:574] : INFO : Epoch 81 | loss: 0.000187576 | val_loss: 0.000192213 | Time: 15913.4 ms [2020-11-10 01:23:28 main:574] : INFO : Epoch 82 | loss: 0.000177467 | val_loss: 0.000177375 | Time: 15899.1 ms [2020-11-10 01:23:44 main:574] : INFO : Epoch 83 | loss: 0.00016596 | val_loss: 0.000167019 | Time: 15988.1 ms [2020-11-10 01:24:00 main:574] : INFO : Epoch 84 | loss: 0.00015657 | val_loss: 0.000161051 | Time: 16185 ms [2020-11-10 01:24:16 main:574] : INFO : Epoch 85 | loss: 0.00014816 | val_loss: 0.000148973 | Time: 15963.5 ms [2020-11-10 01:24:32 main:574] : INFO : Epoch 86 | loss: 0.000139436 | val_loss: 0.000140589 | Time: 15993.6 ms [2020-11-10 01:24:48 main:574] : INFO : Epoch 87 | loss: 0.000131754 | val_loss: 0.00013299 | Time: 16000.8 ms [2020-11-10 01:25:05 main:574] : INFO : Epoch 88 | loss: 0.000125367 | val_loss: 0.000126166 | Time: 16021.4 ms [2020-11-10 01:25:21 main:574] : INFO : Epoch 89 | loss: 0.000118288 | val_loss: 0.000119243 | Time: 16076.2 ms [2020-11-10 01:25:37 main:574] : INFO : Epoch 90 | loss: 0.000112125 | val_loss: 0.000116321 | Time: 16045.3 ms [2020-11-10 01:25:53 main:574] : INFO : Epoch 91 | loss: 0.000106895 | val_loss: 0.00010772 | Time: 15864.1 ms [2020-11-10 01:26:09 main:574] : INFO : Epoch 92 | loss: 0.000100864 | val_loss: 0.000101092 | Time: 15926.6 ms [2020-11-10 01:26:25 main:574] : INFO : Epoch 93 | loss: 9.53689e-05 | val_loss: 9.94278e-05 | Time: 15893.3 ms [2020-11-10 01:26:40 main:574] : INFO : Epoch 94 | loss: 9.19302e-05 | val_loss: 9.15105e-05 | Time: 15934.7 ms [2020-11-10 01:26:56 main:574] : INFO : Epoch 95 | loss: 8.62006e-05 | val_loss: 8.74497e-05 | Time: 15882.8 ms [2020-11-10 01:27:12 main:574] : INFO : Epoch 96 | loss: 8.29184e-05 | val_loss: 8.33619e-05 | Time: 15798.8 ms [2020-11-10 01:27:28 main:574] : INFO : Epoch 97 | loss: 7.88613e-05 | val_loss: 7.95179e-05 | Time: 15889.5 ms [2020-11-10 01:27:44 main:574] : INFO : Epoch 98 | loss: 7.48447e-05 | val_loss: 7.58438e-05 | Time: 15970.2 ms [2020-11-10 01:28:00 main:574] : INFO : Epoch 99 | loss: 7.17727e-05 | val_loss: 7.3312e-05 | Time: 16050 ms [2020-11-10 01:28:16 main:574] : INFO : Epoch 100 | loss: 6.91258e-05 | val_loss: 7.14706e-05 | Time: 15945.8 ms [2020-11-10 01:28:32 main:574] : INFO : Epoch 101 | loss: 6.57074e-05 | val_loss: 6.69186e-05 | Time: 15981.8 ms [2020-11-10 01:28:48 main:574] : INFO : Epoch 102 | loss: 6.37096e-05 | val_loss: 6.74874e-05 | Time: 16014.2 ms [2020-11-10 01:29:04 main:574] : INFO : Epoch 103 | loss: 6.0396e-05 | val_loss: 6.29375e-05 | Time: 16140.3 ms [2020-11-10 01:29:21 main:574] : INFO : Epoch 104 | loss: 5.88887e-05 | val_loss: 5.81833e-05 | Time: 16002.3 ms [2020-11-10 01:29:37 main:574] : INFO : Epoch 105 | loss: 5.58524e-05 | val_loss: 5.57975e-05 | Time: 16059.3 ms [2020-11-10 01:29:53 main:574] : INFO : Epoch 106 | loss: 5.31926e-05 | val_loss: 5.44441e-05 | Time: 15936.6 ms [2020-11-10 01:30:08 main:574] : INFO : Epoch 107 | loss: 5.18186e-05 | val_loss: 5.09298e-05 | Time: 15679.8 ms [2020-11-10 01:30:24 main:574] : INFO : Epoch 108 | loss: 4.9456e-05 | val_loss: 4.92078e-05 | Time: 15768.2 ms [2020-11-10 01:30:40 main:574] : INFO : Epoch 109 | loss: 4.76984e-05 | val_loss: 4.71032e-05 | Time: 15924.7 ms [2020-11-10 01:30:56 main:574] : INFO : Epoch 110 | loss: 4.5595e-05 | val_loss: 4.53372e-05 | Time: 15864.1 ms [2020-11-10 01:31:12 main:574] : INFO : Epoch 111 | loss: 4.43736e-05 | val_loss: 4.54497e-05 | Time: 15823.2 ms [2020-11-10 01:31:28 main:574] : INFO : Epoch 112 | loss: 4.22381e-05 | val_loss: 4.58616e-05 | Time: 15834.8 ms [2020-11-10 01:31:44 main:574] : INFO : Epoch 113 | loss: 4.18631e-05 | val_loss: 4.11113e-05 | Time: 15790.1 ms [2020-11-10 01:31:59 main:574] : INFO : Epoch 114 | loss: 4.01751e-05 | val_loss: 3.98958e-05 | Time: 15800.8 ms [2020-11-10 01:32:15 main:574] : INFO : Epoch 115 | loss: 3.84543e-05 | val_loss: 3.98014e-05 | Time: 15970.4 ms [2020-11-10 01:32:32 main:574] : INFO : Epoch 116 | loss: 3.78903e-05 | val_loss: 3.83604e-05 | Time: 15992.6 ms [2020-11-10 01:32:47 main:574] : INFO : Epoch 117 | loss: 3.64113e-05 | val_loss: 3.63389e-05 | Time: 15849.2 ms [2020-11-10 01:33:03 main:574] : INFO : Epoch 118 | loss: 3.50784e-05 | val_loss: 3.67426e-05 | Time: 15865.4 ms [2020-11-10 01:33:19 main:574] : INFO : Epoch 119 | loss: 3.43074e-05 | val_loss: 3.89552e-05 | Time: 16087.7 ms [2020-11-10 01:33:35 main:574] : INFO : Epoch 120 | loss: 3.27829e-05 | val_loss: 3.20332e-05 | Time: 15950.9 ms [2020-11-10 01:33:51 main:574] : INFO : Epoch 121 | loss: 3.1726e-05 | val_loss: 3.13684e-05 | Time: 15881.7 ms [2020-11-10 01:34:07 main:574] : INFO : Epoch 122 | loss: 3.08677e-05 | val_loss: 3.1377e-05 | Time: 15890.1 ms [2020-11-10 01:34:23 main:574] : INFO : Epoch 123 | loss: 3.08073e-05 | val_loss: 3.1775e-05 | Time: 15924.5 ms [2020-11-10 01:34:39 main:574] : INFO : Epoch 124 | loss: 2.92057e-05 | val_loss: 2.87552e-05 | Time: 16001.1 ms [2020-11-10 01:34:55 main:574] : INFO : Epoch 125 | loss: 2.85431e-05 | val_loss: 3.00721e-05 | Time: 15998.2 ms [2020-11-10 01:35:11 main:574] : INFO : Epoch 126 | loss: 2.74836e-05 | val_loss: 2.83305e-05 | Time: 15890.8 ms [2020-11-10 01:35:27 main:574] : INFO : Epoch 127 | loss: 2.68146e-05 | val_loss: 2.68257e-05 | Time: 16081.4 ms [2020-11-10 01:35:43 main:574] : INFO : Epoch 128 | loss: 2.63425e-05 | val_loss: 2.84208e-05 | Time: 15849.7 ms [2020-11-10 01:35:59 main:574] : INFO : Epoch 129 | loss: 2.56177e-05 | val_loss: 2.55218e-05 | Time: 15923.8 ms [2020-11-10 01:36:15 main:574] : INFO : Epoch 130 | loss: 2.52466e-05 | val_loss: 2.48486e-05 | Time: 15906.7 ms [2020-11-10 01:36:31 main:574] : INFO : Epoch 131 | loss: 2.39463e-05 | val_loss: 2.41712e-05 | Time: 15908.4 ms [2020-11-10 01:36:47 main:574] : INFO : Epoch 132 | loss: 2.42004e-05 | val_loss: 2.34921e-05 | Time: 15996.4 ms [2020-11-10 01:37:03 main:574] : INFO : Epoch 133 | loss: 2.30794e-05 | val_loss: 2.25656e-05 | Time: 15921.1 ms [2020-11-10 01:37:19 main:574] : INFO : Epoch 134 | loss: 2.26159e-05 | val_loss: 2.2837e-05 | Time: 15748.5 ms [2020-11-10 01:37:35 main:574] : INFO : Epoch 135 | loss: 2.25975e-05 | val_loss: 2.25991e-05 | Time: 16033.6 ms [2020-11-10 01:37:51 main:574] : INFO : Epoch 136 | loss: 2.14932e-05 | val_loss: 2.16662e-05 | Time: 16033.5 ms [2020-11-10 01:38:07 main:574] : INFO : Epoch 137 | loss: 2.11923e-05 | val_loss: 2.33545e-05 | Time: 15972.1 ms [2020-11-10 01:38:23 main:574] : INFO : Epoch 138 | loss: 2.09294e-05 | val_loss: 2.13526e-05 | Time: 15888 ms [2020-11-10 01:38:39 main:574] : INFO : Epoch 139 | loss: 2.05025e-05 | val_loss: 2.1968e-05 | Time: 15872.3 ms [2020-11-10 01:38:55 main:574] : INFO : Epoch 140 | loss: 2.01185e-05 | val_loss: 1.94408e-05 | Time: 16256.8 ms [2020-11-10 01:39:11 main:574] : INFO : Epoch 141 | loss: 1.91586e-05 | val_loss: 1.939e-05 | Time: 15835.3 ms [2020-11-10 01:39:27 main:574] : INFO : Epoch 142 | loss: 1.87209e-05 | val_loss: 1.85824e-05 | Time: 15929.1 ms [2020-11-10 01:39:43 main:574] : INFO : Epoch 143 | loss: 1.93262e-05 | val_loss: 1.79962e-05 | Time: 15877 ms [2020-11-10 01:39:59 main:574] : INFO : Epoch 144 | loss: 1.79864e-05 | val_loss: 2.05335e-05 | Time: 15981 ms [2020-11-10 01:40:15 main:574] : INFO : Epoch 145 | loss: 1.79131e-05 | val_loss: 1.77986e-05 | Time: 15988.6 ms [2020-11-10 01:40:31 main:574] : INFO : Epoch 146 | loss: 1.78168e-05 | val_loss: 1.71887e-05 | Time: 15991.1 ms [2020-11-10 01:40:47 main:574] : INFO : Epoch 147 | loss: 1.73101e-05 | val_loss: 1.79562e-05 | Time: 16105.5 ms [2020-11-10 01:41:03 main:574] : INFO : Epoch 148 | loss: 1.6851e-05 | val_loss: 1.73705e-05 | Time: 15935.1 ms [2020-11-10 01:41:19 main:574] : INFO : Epoch 149 | loss: 1.71154e-05 | val_loss: 1.61838e-05 | Time: 15988.6 ms [2020-11-10 01:41:35 main:574] : INFO : Epoch 150 | loss: 1.61783e-05 | val_loss: 1.64945e-05 | Time: 15854.4 ms [2020-11-10 01:41:51 main:574] : INFO : Epoch 151 | loss: 1.59683e-05 | val_loss: 1.74949e-05 | Time: 16171.7 ms [2020-11-10 01:42:07 main:574] : INFO : Epoch 152 | loss: 1.5598e-05 | val_loss: 1.5559e-05 | Time: 15863.7 ms [2020-11-10 01:42:23 main:574] : INFO : Epoch 153 | loss: 1.60384e-05 | val_loss: 1.76212e-05 | Time: 15813.4 ms [2020-11-10 01:42:39 main:574] : INFO : Epoch 154 | loss: 1.52009e-05 | val_loss: 1.58311e-05 | Time: 15950.3 ms [2020-11-10 01:42:55 main:574] : INFO : Epoch 155 | loss: 1.52757e-05 | val_loss: 1.45345e-05 | Time: 15827.2 ms [2020-11-10 01:43:11 main:574] : INFO : Epoch 156 | loss: 1.49356e-05 | val_loss: 1.50202e-05 | Time: 15769.4 ms [2020-11-10 01:43:27 main:574] : INFO : Epoch 157 | loss: 1.45763e-05 | val_loss: 1.57582e-05 | Time: 15785.6 ms [2020-11-10 01:43:43 main:574] : INFO : Epoch 158 | loss: 1.4251e-05 | val_loss: 1.52521e-05 | Time: 15965 ms [2020-11-10 01:43:59 main:574] : INFO : Epoch 159 | loss: 1.41522e-05 | val_loss: 1.39118e-05 | Time: 16056.4 ms [2020-11-10 01:44:15 main:574] : INFO : Epoch 160 | loss: 1.36857e-05 | val_loss: 1.4294e-05 | Time: 15968.1 ms [2020-11-10 01:44:31 main:574] : INFO : Epoch 161 | loss: 1.44686e-05 | val_loss: 1.38146e-05 | Time: 16010.1 ms [2020-11-10 01:44:47 main:574] : INFO : Epoch 162 | loss: 1.33429e-05 | val_loss: 1.82346e-05 | Time: 15873.8 ms [2020-11-10 01:45:03 main:574] : INFO : Epoch 163 | loss: 1.35299e-05 | val_loss: 1.34308e-05 | Time: 15992 ms [2020-11-10 01:45:19 main:574] : INFO : Epoch 164 | loss: 1.33821e-05 | val_loss: 1.36254e-05 | Time: 15992.1 ms [2020-11-10 01:45:35 main:574] : INFO : Epoch 165 | loss: 1.26169e-05 | val_loss: 1.23386e-05 | Time: 15881.8 ms [2020-11-10 01:45:51 main:574] : INFO : Epoch 166 | loss: 1.26277e-05 | val_loss: 1.46076e-05 | Time: 15959.5 ms [2020-11-10 01:46:07 main:574] : INFO : Epoch 167 | loss: 1.30612e-05 | val_loss: 1.22461e-05 | Time: 15853.3 ms [2020-11-10 01:46:23 main:574] : INFO : Epoch 168 | loss: 1.23278e-05 | val_loss: 1.36229e-05 | Time: 15868.9 ms [2020-11-10 01:46:39 main:574] : INFO : Epoch 169 | loss: 1.32298e-05 | val_loss: 1.13032e-05 | Time: 15909.5 ms [2020-11-10 01:46:54 main:574] : INFO : Epoch 170 | loss: 1.16212e-05 | val_loss: 1.15762e-05 | Time: 15799.4 ms [2020-11-10 01:47:10 main:574] : INFO : Epoch 171 | loss: 1.17812e-05 | val_loss: 1.1846e-05 | Time: 15878.8 ms [2020-11-10 01:47:26 main:574] : INFO : Epoch 172 | loss: 1.18416e-05 | val_loss: 1.48753e-05 | Time: 15849.7 ms [2020-11-10 01:47:42 main:574] : INFO : Epoch 173 | loss: 1.19722e-05 | val_loss: 1.14043e-05 | Time: 15789.8 ms [2020-11-10 01:47:58 main:574] : INFO : Epoch 174 | loss: 1.11675e-05 | val_loss: 1.2322e-05 | Time: 15918.9 ms [2020-11-10 01:48:14 main:574] : INFO : Epoch 175 | loss: 1.19273e-05 | val_loss: 1.12146e-05 | Time: 15876 ms [2020-11-10 01:48:30 main:574] : INFO : Epoch 176 | loss: 1.1093e-05 | val_loss: 1.11855e-05 | Time: 15908.8 ms [2020-11-10 01:48:46 main:574] : INFO : Epoch 177 | loss: 1.13075e-05 | val_loss: 1.15369e-05 | Time: 16116.9 ms [2020-11-10 01:49:02 main:574] : INFO : Epoch 178 | loss: 1.11638e-05 | val_loss: 1.13603e-05 | Time: 16027.7 ms [2020-11-10 01:49:18 main:574] : INFO : Epoch 179 | loss: 1.07412e-05 | val_loss: 1.08004e-05 | Time: 15959 ms [2020-11-10 01:49:34 main:574] : INFO : Epoch 180 | loss: 1.07543e-05 | val_loss: 1.16988e-05 | Time: 16036.1 ms [2020-11-10 01:49:50 main:574] : INFO : Epoch 181 | loss: 1.11324e-05 | val_loss: 1.03277e-05 | Time: 15809.9 ms [2020-11-10 01:50:06 main:574] : INFO : Epoch 182 | loss: 1.01958e-05 | val_loss: 1.0272e-05 | Time: 16006 ms [2020-11-10 01:50:22 main:574] : INFO : Epoch 183 | loss: 1.03425e-05 | val_loss: 9.44858e-06 | Time: 15932.4 ms [2020-11-10 01:50:38 main:574] : INFO : Epoch 184 | loss: 1.06508e-05 | val_loss: 1.02207e-05 | Time: 15684.4 ms [2020-11-10 01:50:54 main:574] : INFO : Epoch 185 | loss: 1.00033e-05 | val_loss: 9.86413e-06 | Time: 15774.4 ms [2020-11-10 01:51:09 main:574] : INFO : Epoch 186 | loss: 1.01914e-05 | val_loss: 1.65355e-05 | Time: 15618.8 ms [2020-11-10 01:51:25 main:574] : INFO : Epoch 187 | loss: 1.00377e-05 | val_loss: 1.1088e-05 | Time: 15831.7 ms [2020-11-10 01:51:41 main:574] : INFO : Epoch 188 | loss: 9.9513e-06 | val_loss: 9.41011e-06 | Time: 15929.4 ms [2020-11-10 01:51:57 main:574] : INFO : Epoch 189 | loss: 9.56769e-06 | val_loss: 9.4634e-06 | Time: 15899.4 ms [2020-11-10 01:52:13 main:574] : INFO : Epoch 190 | loss: 1.00507e-05 | val_loss: 9.98789e-06 | Time: 16039.9 ms [2020-11-10 01:52:29 main:574] : INFO : Epoch 191 | loss: 9.52482e-06 | val_loss: 9.62516e-06 | Time: 15881.6 ms [2020-11-10 01:52:45 main:574] : INFO : Epoch 192 | loss: 9.81701e-06 | val_loss: 8.47925e-06 | Time: 15987.6 ms [2020-11-10 01:52:45 main:597] : INFO : Saving trained model to model-final.pt, val_loss 8.47925e-06 [2020-11-10 01:52:45 main:603] : INFO : Saving end state to config to file [2020-11-10 01:52:45 main:608] : INFO : Success, exiting.. 01:52:45 (9452): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)