Task 3039729
| Name | rand_automata_0026-1606117989-22463-0_0 |
| Workunit | 1376051 |
| Created | 23 Nov 2020, 7:53:12 UTC |
| Sent | 24 Nov 2020, 5:12:23 UTC |
| Report deadline | 25 Nov 2020, 3:42:23 UTC |
| Received | 24 Nov 2020, 19:41:32 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 4379 |
| Run time | 15 min 28 sec |
| CPU time | 15 min 25 sec |
| Validate state | Valid |
| Credit | 959.40 |
| Device peak FLOPS | 4,493.80 GFLOPS |
| Application version | Machine Learning Dataset Generator (test) v9.80 (cuda10200) x86_64-pc-linux-gnu |
| Peak working set size | 2.19 GB |
| Peak swap size | 10.01 GB |
| Peak disk usage | 2.98 GB |
Stderr output
<core_client_version>7.16.11</core_client_version> <![CDATA[ <stderr_txt> DEBUG: Args: ../../projects/www.mlcathome.org_mlcathome/mlds-gpu_9.80_x86_64-pc-linux-gnu__cuda10200 -a LSTM -w 64 -b 2 -s 32 --lr 0.001 --maxepoch 192 nthreads: 1 gpudev: 0 Re-exec()-ing to set environment correctly Machine Learning Dataset Generator v9.80 (Linux/x86_64) (libTorch: release/1.7 GPU: GeForce GTX 1650 SUPER) [2020-11-24 14:25:53 main:442] : INFO : Set logging level to 1 [2020-11-24 14:25:53 main:448] : INFO : Running in BOINC Client mode [2020-11-24 14:25:53 main:451] : INFO : Resolving all filenames [2020-11-24 14:25:53 main:459] : INFO : Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0026-train-val-dataset.hdf5 (exists = 1) [2020-11-24 14:25:53 main:459] : INFO : Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0026-1606117989-22463-0_0_r1809647004_1 (exists = 0) [2020-11-24 14:25:53 main:459] : INFO : Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0026-1606117989-22463-0_0_r1809647004_0 (exists = 0) [2020-11-24 14:25:53 main:459] : INFO : Resolved: model-input.pt => model-input.pt (exists = 0) [2020-11-24 14:25:53 main:459] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 0) [2020-11-24 14:25:53 main:479] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/rand_automata_0026-train-val-dataset.hdf5 [2020-11-24 14:25:53 main:481] : INFO : Configuration: [2020-11-24 14:25:53 main:482] : INFO : Model type: LSTM [2020-11-24 14:25:53 main:483] : INFO : Validation Loss Threshold: 0.0001 [2020-11-24 14:25:53 main:484] : INFO : Max Epochs: 192 [2020-11-24 14:25:53 main:485] : INFO : Batch Size: 32 [2020-11-24 14:25:53 main:486] : INFO : Learning Rate: 0.001 [2020-11-24 14:25:53 main:487] : INFO : Patience: 10 [2020-11-24 14:25:53 main:488] : INFO : Hidden Width: 64 [2020-11-24 14:25:53 main:489] : INFO : # Recurrent Layers: 4 [2020-11-24 14:25:53 main:490] : INFO : # Backend Layers: 2 [2020-11-24 14:25:53 main:491] : INFO : # Threads: 1 [2020-11-24 14:25:53 main:493] : INFO : Preparing Dataset [2020-11-24 14:25:53 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0026-train-val-dataset.hdf5 into memory [2020-11-24 14:25:53 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0026-train-val-dataset.hdf5 into memory [2020-11-24 14:25:54 load:106] : INFO : Successfully loaded dataset of 4096 examples into memory. [2020-11-24 14:25:54 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0026-train-val-dataset.hdf5 into memory [2020-11-24 14:25:54 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0026-train-val-dataset.hdf5 into memory [2020-11-24 14:25:54 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2020-11-24 14:25:54 main:501] : INFO : Creating Model [2020-11-24 14:25:54 main:514] : INFO : Preparing config file [2020-11-24 14:25:54 main:526] : INFO : Creating new config file [2020-11-24 14:25:55 main:566] : INFO : Loading DataLoader into Memory [2020-11-24 14:25:55 main:569] : INFO : Starting Training [2020-11-24 14:26:00 main:581] : INFO : Epoch 1 | loss: 0.0661001 | val_loss: 0.0657598 | Time: 5300.6 ms [2020-11-24 14:26:05 main:581] : INFO : Epoch 2 | loss: 0.0653597 | val_loss: 0.0638718 | Time: 4760.69 ms [2020-11-24 14:26:10 main:581] : INFO : Epoch 3 | loss: 0.0621349 | val_loss: 0.0600867 | Time: 4764.94 ms [2020-11-24 14:26:14 main:581] : INFO : Epoch 4 | loss: 0.0585245 | val_loss: 0.0570887 | Time: 4761.48 ms [2020-11-24 14:26:19 main:581] : INFO : Epoch 5 | loss: 0.0561153 | val_loss: 0.0553097 | Time: 4736.72 ms [2020-11-24 14:26:24 main:581] : INFO : Epoch 6 | loss: 0.0544609 | val_loss: 0.053907 | Time: 4806.39 ms [2020-11-24 14:26:29 main:581] : INFO : Epoch 7 | loss: 0.0529784 | val_loss: 0.0524733 | Time: 4748.79 ms [2020-11-24 14:26:33 main:581] : INFO : Epoch 8 | loss: 0.0514533 | val_loss: 0.0509178 | Time: 4763.62 ms [2020-11-24 14:26:38 main:581] : INFO : Epoch 9 | loss: 0.0497918 | val_loss: 0.04946 | Time: 4742.46 ms [2020-11-24 14:26:43 main:581] : INFO : Epoch 10 | loss: 0.047918 | val_loss: 0.0476712 | Time: 4736.33 ms [2020-11-24 14:26:48 main:581] : INFO : Epoch 11 | loss: 0.0458631 | val_loss: 0.0452996 | Time: 4742.63 ms [2020-11-24 14:26:52 main:581] : INFO : Epoch 12 | loss: 0.0435071 | val_loss: 0.0427908 | Time: 4786.52 ms [2020-11-24 14:26:57 main:581] : INFO : Epoch 13 | loss: 0.0407081 | val_loss: 0.039835 | Time: 4808.17 ms [2020-11-24 14:27:02 main:581] : INFO : Epoch 14 | loss: 0.0374944 | val_loss: 0.0367392 | Time: 4732 ms [2020-11-24 14:27:07 main:581] : INFO : Epoch 15 | loss: 0.0335932 | val_loss: 0.0333037 | Time: 4760.85 ms [2020-11-24 14:27:12 main:581] : INFO : Epoch 16 | loss: 0.03216 | val_loss: 0.0310841 | Time: 4807.42 ms [2020-11-24 14:27:16 main:581] : INFO : Epoch 17 | loss: 0.0359996 | val_loss: 0.0382915 | Time: 4796.52 ms [2020-11-24 14:27:21 main:581] : INFO : Epoch 18 | loss: 0.0266326 | val_loss: 0.0257531 | Time: 4807.35 ms [2020-11-24 14:27:26 main:581] : INFO : Epoch 19 | loss: 0.0290382 | val_loss: 0.0236045 | Time: 4855.46 ms [2020-11-24 14:27:31 main:581] : INFO : Epoch 20 | loss: 0.0232141 | val_loss: 0.0310164 | Time: 4779.04 ms [2020-11-24 14:27:36 main:581] : INFO : Epoch 21 | loss: 0.0367177 | val_loss: 0.0238832 | Time: 4826.42 ms [2020-11-24 14:27:40 main:581] : INFO : Epoch 22 | loss: 0.0299338 | val_loss: 0.0292148 | Time: 4827.68 ms [2020-11-24 14:27:45 main:581] : INFO : Epoch 23 | loss: 0.0215094 | val_loss: 0.0213433 | Time: 4796.41 ms [2020-11-24 14:27:50 main:581] : INFO : Epoch 24 | loss: 0.0157647 | val_loss: 0.0150932 | Time: 4712.01 ms [2020-11-24 14:27:55 main:581] : INFO : Epoch 25 | loss: 0.017996 | val_loss: 0.0221147 | Time: 5237 ms [2020-11-24 14:28:01 main:581] : INFO : Epoch 26 | loss: 0.0148341 | val_loss: 0.0127265 | Time: 5332.75 ms [2020-11-24 14:28:06 main:581] : INFO : Epoch 27 | loss: 0.023286 | val_loss: 0.0150907 | Time: 5331.11 ms [2020-11-24 14:28:11 main:581] : INFO : Epoch 28 | loss: 0.0133986 | val_loss: 0.0117667 | Time: 5108.48 ms [2020-11-24 14:28:16 main:581] : INFO : Epoch 29 | loss: 0.0133886 | val_loss: 0.0196299 | Time: 4798.95 ms [2020-11-24 14:28:21 main:581] : INFO : Epoch 30 | loss: 0.0106575 | val_loss: 0.00932845 | Time: 4751.42 ms [2020-11-24 14:28:25 main:581] : INFO : Epoch 31 | loss: 0.00861363 | val_loss: 0.00872363 | Time: 4741.15 ms [2020-11-24 14:28:30 main:581] : INFO : Epoch 32 | loss: 0.00819232 | val_loss: 0.0087176 | Time: 4797.33 ms [2020-11-24 14:28:35 main:581] : INFO : Epoch 33 | loss: 0.00982847 | val_loss: 0.00870594 | Time: 4795.9 ms [2020-11-24 14:28:40 main:581] : INFO : Epoch 34 | loss: 0.00788954 | val_loss: 0.00763968 | Time: 4778.25 ms [2020-11-24 14:28:44 main:581] : INFO : Epoch 35 | loss: 0.00721733 | val_loss: 0.00788657 | Time: 4767.22 ms [2020-11-24 14:28:49 main:581] : INFO : Epoch 36 | loss: 0.00757943 | val_loss: 0.00720262 | Time: 4752.23 ms [2020-11-24 14:28:54 main:581] : INFO : Epoch 37 | loss: 0.00665171 | val_loss: 0.00661494 | Time: 4753.17 ms [2020-11-24 14:28:59 main:581] : INFO : Epoch 38 | loss: 0.00628391 | val_loss: 0.00638558 | Time: 4780.07 ms [2020-11-24 14:29:03 main:581] : INFO : Epoch 39 | loss: 0.00601769 | val_loss: 0.00617131 | Time: 4752.39 ms [2020-11-24 14:29:08 main:581] : INFO : Epoch 40 | loss: 0.00579712 | val_loss: 0.00593722 | Time: 4765.43 ms [2020-11-24 14:29:13 main:581] : INFO : Epoch 41 | loss: 0.00558909 | val_loss: 0.00573328 | Time: 4715.88 ms [2020-11-24 14:29:18 main:581] : INFO : Epoch 42 | loss: 0.00539397 | val_loss: 0.00551709 | Time: 4738.85 ms [2020-11-24 14:29:23 main:581] : INFO : Epoch 43 | loss: 0.00520835 | val_loss: 0.00527975 | Time: 4942.75 ms [2020-11-24 14:29:27 main:581] : INFO : Epoch 44 | loss: 0.00500664 | val_loss: 0.00507653 | Time: 4753.96 ms [2020-11-24 14:29:32 main:581] : INFO : Epoch 45 | loss: 0.00482461 | val_loss: 0.00488971 | Time: 4753.37 ms [2020-11-24 14:29:37 main:581] : INFO : Epoch 46 | loss: 0.00464641 | val_loss: 0.00474671 | Time: 4776.09 ms [2020-11-24 14:29:42 main:581] : INFO : Epoch 47 | loss: 0.00447547 | val_loss: 0.00452067 | Time: 4843.35 ms [2020-11-24 14:29:47 main:581] : INFO : Epoch 48 | loss: 0.00430669 | val_loss: 0.00434265 | Time: 4769.45 ms [2020-11-24 14:29:51 main:581] : INFO : Epoch 49 | loss: 0.004143 | val_loss: 0.00417738 | Time: 4792.67 ms [2020-11-24 14:29:56 main:581] : INFO : Epoch 50 | loss: 0.00398314 | val_loss: 0.00401252 | Time: 4876.55 ms [2020-11-24 14:30:01 main:581] : INFO : Epoch 51 | loss: 0.00408705 | val_loss: 0.00421892 | Time: 4764.36 ms [2020-11-24 14:30:06 main:581] : INFO : Epoch 52 | loss: 0.00374822 | val_loss: 0.00368022 | Time: 4737.15 ms [2020-11-24 14:30:10 main:581] : INFO : Epoch 53 | loss: 0.00354062 | val_loss: 0.00351195 | Time: 4754.26 ms [2020-11-24 14:30:15 main:581] : INFO : Epoch 54 | loss: 0.00338849 | val_loss: 0.00336414 | Time: 4776.77 ms [2020-11-24 14:30:20 main:581] : INFO : Epoch 55 | loss: 0.00324514 | val_loss: 0.0032243 | Time: 4749.21 ms [2020-11-24 14:30:25 main:581] : INFO : Epoch 56 | loss: 0.00310799 | val_loss: 0.00308529 | Time: 4734.45 ms [2020-11-24 14:30:29 main:581] : INFO : Epoch 57 | loss: 0.00297502 | val_loss: 0.00295163 | Time: 4739.71 ms [2020-11-24 14:30:34 main:581] : INFO : Epoch 58 | loss: 0.0028463 | val_loss: 0.00282189 | Time: 4752.1 ms [2020-11-24 14:30:39 main:581] : INFO : Epoch 59 | loss: 0.00272235 | val_loss: 0.00270078 | Time: 4742.18 ms [2020-11-24 14:30:44 main:581] : INFO : Epoch 60 | loss: 0.00260243 | val_loss: 0.00257904 | Time: 4750.24 ms [2020-11-24 14:30:48 main:581] : INFO : Epoch 61 | loss: 0.00248598 | val_loss: 0.00246173 | Time: 4750.11 ms [2020-11-24 14:30:53 main:581] : INFO : Epoch 62 | loss: 0.0023735 | val_loss: 0.00234895 | Time: 4764.61 ms [2020-11-24 14:30:58 main:581] : INFO : Epoch 63 | loss: 0.00226502 | val_loss: 0.00223855 | Time: 4768.33 ms [2020-11-24 14:31:03 main:581] : INFO : Epoch 64 | loss: 0.00216054 | val_loss: 0.00213437 | Time: 4759.43 ms [2020-11-24 14:31:08 main:581] : INFO : Epoch 65 | loss: 0.00205891 | val_loss: 0.00203028 | Time: 4763.74 ms [2020-11-24 14:31:12 main:581] : INFO : Epoch 66 | loss: 0.00196188 | val_loss: 0.00193094 | Time: 4822.01 ms [2020-11-24 14:31:17 main:581] : INFO : Epoch 67 | loss: 0.00186835 | val_loss: 0.00183347 | Time: 4821.87 ms [2020-11-24 14:31:22 main:581] : INFO : Epoch 68 | loss: 0.00177829 | val_loss: 0.00174333 | Time: 4778.98 ms [2020-11-24 14:31:27 main:581] : INFO : Epoch 69 | loss: 0.00169141 | val_loss: 0.00165578 | Time: 4695.4 ms [2020-11-24 14:31:31 main:581] : INFO : Epoch 70 | loss: 0.00160866 | val_loss: 0.00157584 | Time: 4761.67 ms [2020-11-24 14:31:36 main:581] : INFO : Epoch 71 | loss: 0.00152959 | val_loss: 0.00149567 | Time: 4787.5 ms [2020-11-24 14:31:41 main:581] : INFO : Epoch 72 | loss: 0.00145361 | val_loss: 0.00142068 | Time: 4719.45 ms [2020-11-24 14:31:46 main:581] : INFO : Epoch 73 | loss: 0.00138137 | val_loss: 0.00134983 | Time: 4747.91 ms [2020-11-24 14:31:50 main:581] : INFO : Epoch 74 | loss: 0.00131192 | val_loss: 0.00127979 | Time: 4799.94 ms [2020-11-24 14:31:56 main:581] : INFO : Epoch 75 | loss: 0.0012452 | val_loss: 0.00121783 | Time: 5061.31 ms [2020-11-24 14:32:00 main:581] : INFO : Epoch 76 | loss: 0.00118263 | val_loss: 0.00115236 | Time: 4985.97 ms [2020-11-24 14:32:05 main:581] : INFO : Epoch 77 | loss: 0.00112246 | val_loss: 0.00109286 | Time: 4742.44 ms [2020-11-24 14:32:10 main:581] : INFO : Epoch 78 | loss: 0.00106483 | val_loss: 0.001038 | Time: 4753.86 ms [2020-11-24 14:32:15 main:581] : INFO : Epoch 79 | loss: 0.0010103 | val_loss: 0.00098243 | Time: 4801.43 ms [2020-11-24 14:32:20 main:581] : INFO : Epoch 80 | loss: 0.000958482 | val_loss: 0.000932336 | Time: 4805.83 ms [2020-11-24 14:32:25 main:581] : INFO : Epoch 81 | loss: 0.000908653 | val_loss: 0.000883766 | Time: 5154.32 ms [2020-11-24 14:32:30 main:581] : INFO : Epoch 82 | loss: 0.000861836 | val_loss: 0.000838406 | Time: 5239.53 ms [2020-11-24 14:32:35 main:581] : INFO : Epoch 83 | loss: 0.000817089 | val_loss: 0.000795005 | Time: 5393.9 ms [2020-11-24 14:32:40 main:581] : INFO : Epoch 84 | loss: 0.000774555 | val_loss: 0.000752255 | Time: 4927.19 ms [2020-11-24 14:32:45 main:581] : INFO : Epoch 85 | loss: 0.000734084 | val_loss: 0.000712547 | Time: 4739.73 ms [2020-11-24 14:32:50 main:581] : INFO : Epoch 86 | loss: 0.000696426 | val_loss: 0.000676258 | Time: 4822 ms [2020-11-24 14:32:55 main:581] : INFO : Epoch 87 | loss: 0.000659411 | val_loss: 0.000638088 | Time: 4787.77 ms [2020-11-24 14:32:59 main:581] : INFO : Epoch 88 | loss: 0.00062453 | val_loss: 0.000605864 | Time: 4789.78 ms [2020-11-24 14:33:04 main:581] : INFO : Epoch 89 | loss: 0.000592117 | val_loss: 0.000573388 | Time: 4824.69 ms [2020-11-24 14:33:09 main:581] : INFO : Epoch 90 | loss: 0.000561166 | val_loss: 0.000542706 | Time: 4824.08 ms [2020-11-24 14:33:14 main:581] : INFO : Epoch 91 | loss: 0.000531614 | val_loss: 0.000513977 | Time: 5196.41 ms [2020-11-24 14:33:19 main:581] : INFO : Epoch 92 | loss: 0.000503568 | val_loss: 0.000486188 | Time: 5164.65 ms [2020-11-24 14:33:25 main:581] : INFO : Epoch 93 | loss: 0.000476236 | val_loss: 0.000461072 | Time: 5091.16 ms [2020-11-24 14:33:29 main:581] : INFO : Epoch 94 | loss: 0.000451608 | val_loss: 0.000436363 | Time: 4798.68 ms [2020-11-24 14:33:34 main:581] : INFO : Epoch 95 | loss: 0.000428102 | val_loss: 0.000412805 | Time: 4970.55 ms [2020-11-24 14:33:39 main:581] : INFO : Epoch 96 | loss: 0.000405008 | val_loss: 0.00039011 | Time: 5063.8 ms [2020-11-24 14:33:44 main:581] : INFO : Epoch 97 | loss: 0.000384034 | val_loss: 0.000371133 | Time: 4738.63 ms [2020-11-24 14:33:49 main:581] : INFO : Epoch 98 | loss: 0.000364268 | val_loss: 0.000351711 | Time: 4805.88 ms [2020-11-24 14:33:54 main:581] : INFO : Epoch 99 | loss: 0.0003454 | val_loss: 0.000332496 | Time: 4796.31 ms [2020-11-24 14:33:59 main:581] : INFO : Epoch 100 | loss: 0.000327761 | val_loss: 0.000316266 | Time: 4810.18 ms [2020-11-24 14:34:03 main:581] : INFO : Epoch 101 | loss: 0.000311193 | val_loss: 0.000300507 | Time: 4791.76 ms [2020-11-24 14:34:08 main:581] : INFO : Epoch 102 | loss: 0.000295501 | val_loss: 0.000284962 | Time: 4798.18 ms [2020-11-24 14:34:13 main:581] : INFO : Epoch 103 | loss: 0.000280315 | val_loss: 0.000271112 | Time: 4804.25 ms [2020-11-24 14:34:18 main:581] : INFO : Epoch 104 | loss: 0.000266479 | val_loss: 0.00025541 | Time: 4886.63 ms [2020-11-24 14:34:23 main:581] : INFO : Epoch 105 | loss: 0.000253192 | val_loss: 0.000244594 | Time: 4741.86 ms [2020-11-24 14:34:27 main:581] : INFO : Epoch 106 | loss: 0.00024051 | val_loss: 0.000230792 | Time: 4713.55 ms [2020-11-24 14:34:32 main:581] : INFO : Epoch 107 | loss: 0.00022929 | val_loss: 0.000221314 | Time: 4712.9 ms [2020-11-24 14:34:37 main:581] : INFO : Epoch 108 | loss: 0.000217499 | val_loss: 0.000208854 | Time: 4707.67 ms [2020-11-24 14:34:42 main:581] : INFO : Epoch 109 | loss: 0.000207018 | val_loss: 0.000198668 | Time: 4844.25 ms [2020-11-24 14:34:46 main:581] : INFO : Epoch 110 | loss: 0.000197619 | val_loss: 0.000191552 | Time: 4758.21 ms [2020-11-24 14:34:51 main:581] : INFO : Epoch 111 | loss: 0.0001886 | val_loss: 0.000181013 | Time: 4694.25 ms [2020-11-24 14:34:56 main:581] : INFO : Epoch 112 | loss: 0.000179384 | val_loss: 0.00017226 | Time: 4705.44 ms [2020-11-24 14:35:00 main:581] : INFO : Epoch 113 | loss: 0.000171579 | val_loss: 0.000163968 | Time: 4701.5 ms [2020-11-24 14:35:05 main:581] : INFO : Epoch 114 | loss: 0.000163307 | val_loss: 0.000157932 | Time: 4768.24 ms [2020-11-24 14:35:10 main:581] : INFO : Epoch 115 | loss: 0.000155827 | val_loss: 0.000150565 | Time: 4786.23 ms [2020-11-24 14:35:15 main:581] : INFO : Epoch 116 | loss: 0.000148553 | val_loss: 0.00014323 | Time: 4711.07 ms [2020-11-24 14:35:19 main:581] : INFO : Epoch 117 | loss: 0.00014223 | val_loss: 0.000136968 | Time: 4736.88 ms [2020-11-24 14:35:24 main:581] : INFO : Epoch 118 | loss: 0.000135824 | val_loss: 0.000131326 | Time: 4794.33 ms [2020-11-24 14:35:29 main:581] : INFO : Epoch 119 | loss: 0.000130251 | val_loss: 0.000124899 | Time: 4776.02 ms [2020-11-24 14:35:34 main:581] : INFO : Epoch 120 | loss: 0.000124932 | val_loss: 0.000120637 | Time: 4768.76 ms [2020-11-24 14:35:39 main:581] : INFO : Epoch 121 | loss: 0.00011959 | val_loss: 0.000114895 | Time: 4787.69 ms [2020-11-24 14:35:44 main:581] : INFO : Epoch 122 | loss: 0.000114183 | val_loss: 0.000111162 | Time: 5017.09 ms [2020-11-24 14:35:48 main:581] : INFO : Epoch 123 | loss: 0.000109489 | val_loss: 0.000105983 | Time: 4781.33 ms [2020-11-24 14:35:53 main:581] : INFO : Epoch 124 | loss: 0.000105477 | val_loss: 0.000101825 | Time: 4763.84 ms [2020-11-24 14:35:58 main:581] : INFO : Epoch 125 | loss: 0.000100733 | val_loss: 9.66195e-05 | Time: 4734.79 ms [2020-11-24 14:36:03 main:581] : INFO : Epoch 126 | loss: 9.72036e-05 | val_loss: 9.37492e-05 | Time: 4784.8 ms [2020-11-24 14:36:07 main:581] : INFO : Epoch 127 | loss: 9.24773e-05 | val_loss: 9.07649e-05 | Time: 4794.38 ms [2020-11-24 14:36:12 main:581] : INFO : Epoch 128 | loss: 8.92409e-05 | val_loss: 8.58796e-05 | Time: 4776.4 ms [2020-11-24 14:36:17 main:581] : INFO : Epoch 129 | loss: 8.55862e-05 | val_loss: 8.24627e-05 | Time: 4822.24 ms [2020-11-24 14:36:22 main:581] : INFO : Epoch 130 | loss: 8.23099e-05 | val_loss: 7.93225e-05 | Time: 4776.84 ms [2020-11-24 14:36:27 main:581] : INFO : Epoch 131 | loss: 7.93542e-05 | val_loss: 7.84373e-05 | Time: 4800.41 ms [2020-11-24 14:36:31 main:581] : INFO : Epoch 132 | loss: 7.65458e-05 | val_loss: 7.45997e-05 | Time: 4826.23 ms [2020-11-24 14:36:36 main:581] : INFO : Epoch 133 | loss: 7.356e-05 | val_loss: 7.03118e-05 | Time: 4743 ms [2020-11-24 14:36:41 main:581] : INFO : Epoch 134 | loss: 7.07376e-05 | val_loss: 6.90451e-05 | Time: 4774.6 ms [2020-11-24 14:36:46 main:581] : INFO : Epoch 135 | loss: 6.84883e-05 | val_loss: 6.65233e-05 | Time: 4819.6 ms [2020-11-24 14:36:51 main:581] : INFO : Epoch 136 | loss: 6.58135e-05 | val_loss: 6.40208e-05 | Time: 4816.23 ms [2020-11-24 14:36:55 main:581] : INFO : Epoch 137 | loss: 6.36324e-05 | val_loss: 6.18584e-05 | Time: 4770.85 ms [2020-11-24 14:37:00 main:581] : INFO : Epoch 138 | loss: 6.16898e-05 | val_loss: 6.00753e-05 | Time: 4825.36 ms [2020-11-24 14:37:05 main:581] : INFO : Epoch 139 | loss: 5.94986e-05 | val_loss: 5.94046e-05 | Time: 4763.16 ms [2020-11-24 14:37:10 main:581] : INFO : Epoch 140 | loss: 5.78084e-05 | val_loss: 5.67242e-05 | Time: 4804.38 ms [2020-11-24 14:37:15 main:581] : INFO : Epoch 141 | loss: 5.63167e-05 | val_loss: 5.68136e-05 | Time: 4787.74 ms [2020-11-24 14:37:19 main:581] : INFO : Epoch 142 | loss: 5.38122e-05 | val_loss: 5.21759e-05 | Time: 4781.01 ms [2020-11-24 14:37:24 main:581] : INFO : Epoch 143 | loss: 5.21642e-05 | val_loss: 5.10343e-05 | Time: 4808.52 ms [2020-11-24 14:37:29 main:581] : INFO : Epoch 144 | loss: 5.10638e-05 | val_loss: 4.9664e-05 | Time: 4828.98 ms [2020-11-24 14:37:34 main:581] : INFO : Epoch 145 | loss: 4.93774e-05 | val_loss: 4.79335e-05 | Time: 4804.91 ms [2020-11-24 14:37:39 main:581] : INFO : Epoch 146 | loss: 4.808e-05 | val_loss: 4.59241e-05 | Time: 4772.43 ms [2020-11-24 14:37:43 main:581] : INFO : Epoch 147 | loss: 4.67589e-05 | val_loss: 4.55389e-05 | Time: 4749.61 ms [2020-11-24 14:37:48 main:581] : INFO : Epoch 148 | loss: 4.54583e-05 | val_loss: 4.52307e-05 | Time: 4757.07 ms [2020-11-24 14:37:53 main:581] : INFO : Epoch 149 | loss: 4.4242e-05 | val_loss: 4.28145e-05 | Time: 4728.67 ms [2020-11-24 14:37:57 main:581] : INFO : Epoch 150 | loss: 4.30618e-05 | val_loss: 4.18535e-05 | Time: 4726.86 ms [2020-11-24 14:38:02 main:581] : INFO : Epoch 151 | loss: 4.19424e-05 | val_loss: 4.15782e-05 | Time: 4741.33 ms [2020-11-24 14:38:07 main:581] : INFO : Epoch 152 | loss: 4.06562e-05 | val_loss: 3.93735e-05 | Time: 4766.1 ms [2020-11-24 14:38:12 main:581] : INFO : Epoch 153 | loss: 3.98905e-05 | val_loss: 3.80396e-05 | Time: 4772.56 ms [2020-11-24 14:38:17 main:581] : INFO : Epoch 154 | loss: 3.90687e-05 | val_loss: 3.90465e-05 | Time: 4813.16 ms [2020-11-24 14:38:22 main:581] : INFO : Epoch 155 | loss: 3.8009e-05 | val_loss: 3.79518e-05 | Time: 4981.99 ms [2020-11-24 14:38:26 main:581] : INFO : Epoch 156 | loss: 3.73328e-05 | val_loss: 3.62436e-05 | Time: 4895.41 ms [2020-11-24 14:38:31 main:581] : INFO : Epoch 157 | loss: 3.63187e-05 | val_loss: 3.52673e-05 | Time: 4742.67 ms [2020-11-24 14:38:36 main:581] : INFO : Epoch 158 | loss: 3.52064e-05 | val_loss: 3.41425e-05 | Time: 4792.62 ms [2020-11-24 14:38:41 main:581] : INFO : Epoch 159 | loss: 3.43148e-05 | val_loss: 3.32409e-05 | Time: 4743.11 ms [2020-11-24 14:38:45 main:581] : INFO : Epoch 160 | loss: 3.42376e-05 | val_loss: 3.26883e-05 | Time: 4743.04 ms [2020-11-24 14:38:50 main:581] : INFO : Epoch 161 | loss: 3.31425e-05 | val_loss: 3.34276e-05 | Time: 4777.81 ms [2020-11-24 14:38:55 main:581] : INFO : Epoch 162 | loss: 3.29009e-05 | val_loss: 3.12936e-05 | Time: 4789.17 ms [2020-11-24 14:39:00 main:581] : INFO : Epoch 163 | loss: 3.16566e-05 | val_loss: 3.16423e-05 | Time: 4837.19 ms [2020-11-24 14:39:05 main:581] : INFO : Epoch 164 | loss: 3.10132e-05 | val_loss: 3.12657e-05 | Time: 4844.48 ms [2020-11-24 14:39:10 main:581] : INFO : Epoch 165 | loss: 3.06728e-05 | val_loss: 2.96206e-05 | Time: 4829.97 ms [2020-11-24 14:39:14 main:581] : INFO : Epoch 166 | loss: 3.02447e-05 | val_loss: 2.95473e-05 | Time: 4796.69 ms [2020-11-24 14:39:19 main:581] : INFO : Epoch 167 | loss: 2.92838e-05 | val_loss: 2.86257e-05 | Time: 4800.53 ms [2020-11-24 14:39:24 main:581] : INFO : Epoch 168 | loss: 2.87241e-05 | val_loss: 2.89711e-05 | Time: 4792.61 ms [2020-11-24 14:39:29 main:581] : INFO : Epoch 169 | loss: 2.90542e-05 | val_loss: 2.77969e-05 | Time: 4792.98 ms [2020-11-24 14:39:33 main:581] : INFO : Epoch 170 | loss: 2.78774e-05 | val_loss: 2.70923e-05 | Time: 4755.03 ms [2020-11-24 14:39:38 main:581] : INFO : Epoch 171 | loss: 2.72935e-05 | val_loss: 2.77857e-05 | Time: 4824.22 ms [2020-11-24 14:39:43 main:581] : INFO : Epoch 172 | loss: 2.69072e-05 | val_loss: 2.65574e-05 | Time: 4807.12 ms [2020-11-24 14:39:48 main:581] : INFO : Epoch 173 | loss: 2.66836e-05 | val_loss: 2.53457e-05 | Time: 4784.21 ms [2020-11-24 14:39:53 main:581] : INFO : Epoch 174 | loss: 2.58442e-05 | val_loss: 2.59528e-05 | Time: 4798.67 ms [2020-11-24 14:39:57 main:581] : INFO : Epoch 175 | loss: 2.58086e-05 | val_loss: 2.59765e-05 | Time: 4789.88 ms [2020-11-24 14:40:02 main:581] : INFO : Epoch 176 | loss: 2.54286e-05 | val_loss: 2.41738e-05 | Time: 4743.79 ms [2020-11-24 14:40:07 main:581] : INFO : Epoch 177 | loss: 2.43218e-05 | val_loss: 2.48512e-05 | Time: 4728.28 ms [2020-11-24 14:40:12 main:581] : INFO : Epoch 178 | loss: 2.47703e-05 | val_loss: 2.45372e-05 | Time: 4711.21 ms [2020-11-24 14:40:16 main:581] : INFO : Epoch 179 | loss: 2.38926e-05 | val_loss: 2.28389e-05 | Time: 4778.14 ms [2020-11-24 14:40:21 main:581] : INFO : Epoch 180 | loss: 2.36756e-05 | val_loss: 2.36098e-05 | Time: 4743.45 ms [2020-11-24 14:40:26 main:581] : INFO : Epoch 181 | loss: 2.31094e-05 | val_loss: 2.29235e-05 | Time: 4791.61 ms [2020-11-24 14:40:31 main:581] : INFO : Epoch 182 | loss: 2.32313e-05 | val_loss: 2.24137e-05 | Time: 4780.31 ms [2020-11-24 14:40:36 main:581] : INFO : Epoch 183 | loss: 2.23194e-05 | val_loss: 2.1442e-05 | Time: 4825.36 ms [2020-11-24 14:40:40 main:581] : INFO : Epoch 184 | loss: 2.20053e-05 | val_loss: 2.12926e-05 | Time: 4769.39 ms [2020-11-24 14:40:45 main:581] : INFO : Epoch 185 | loss: 2.2444e-05 | val_loss: 2.35551e-05 | Time: 4776.64 ms [2020-11-24 14:40:50 main:581] : INFO : Epoch 186 | loss: 2.12586e-05 | val_loss: 2.09019e-05 | Time: 4851.32 ms [2020-11-24 14:40:55 main:581] : INFO : Epoch 187 | loss: 2.18539e-05 | val_loss: 2.05125e-05 | Time: 4781.36 ms [2020-11-24 14:41:00 main:581] : INFO : Epoch 188 | loss: 2.09629e-05 | val_loss: 2.07949e-05 | Time: 4804.52 ms [2020-11-24 14:41:04 main:581] : INFO : Epoch 189 | loss: 2.07053e-05 | val_loss: 2.10624e-05 | Time: 4768.76 ms [2020-11-24 14:41:09 main:581] : INFO : Epoch 190 | loss: 2.08297e-05 | val_loss: 1.94973e-05 | Time: 4789.61 ms [2020-11-24 14:41:14 main:581] : INFO : Epoch 191 | loss: 1.99237e-05 | val_loss: 2.00456e-05 | Time: 4796.47 ms [2020-11-24 14:41:19 main:581] : INFO : Epoch 192 | loss: 2.00941e-05 | val_loss: 1.93076e-05 | Time: 4789.47 ms [2020-11-24 14:41:19 main:604] : INFO : Saving trained model to model-final.pt, val_loss 1.93076e-05 [2020-11-24 14:41:19 main:610] : INFO : Saving end state to config to file [2020-11-24 14:41:19 main:615] : INFO : Success, exiting.. 14:41:19 (3356000): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)