Task 3039717
| Name | rand_automata_0017-1606117984-22299-0_0 |
| Workunit | 1376040 |
| Created | 23 Nov 2020, 7:53:07 UTC |
| Sent | 24 Nov 2020, 5:27:46 UTC |
| Report deadline | 25 Nov 2020, 3:57:46 UTC |
| Received | 24 Nov 2020, 19:57:04 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 4379 |
| Run time | 15 min 29 sec |
| CPU time | 15 min 25 sec |
| Validate state | Valid |
| Credit | 959.40 |
| Device peak FLOPS | 4,493.80 GFLOPS |
| Application version | Machine Learning Dataset Generator (test) v9.80 (cuda10200) x86_64-pc-linux-gnu |
| Peak working set size | 2.19 GB |
| Peak swap size | 10.01 GB |
| Peak disk usage | 2.98 GB |
Stderr output
<core_client_version>7.16.11</core_client_version> <![CDATA[ <stderr_txt> DEBUG: Args: ../../projects/www.mlcathome.org_mlcathome/mlds-gpu_9.80_x86_64-pc-linux-gnu__cuda10200 -a LSTM -w 64 -b 2 -s 32 --lr 0.001 --maxepoch 192 nthreads: 1 gpudev: 0 Re-exec()-ing to set environment correctly Machine Learning Dataset Generator v9.80 (Linux/x86_64) (libTorch: release/1.7 GPU: GeForce GTX 1650 SUPER) [2020-11-24 14:41:25 main:442] : INFO : Set logging level to 1 [2020-11-24 14:41:25 main:448] : INFO : Running in BOINC Client mode [2020-11-24 14:41:25 main:451] : INFO : Resolving all filenames [2020-11-24 14:41:25 main:459] : INFO : Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0017-train-val-dataset.hdf5 (exists = 1) [2020-11-24 14:41:25 main:459] : INFO : Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0017-1606117984-22299-0_0_r750409943_1 (exists = 0) [2020-11-24 14:41:25 main:459] : INFO : Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0017-1606117984-22299-0_0_r750409943_0 (exists = 0) [2020-11-24 14:41:25 main:459] : INFO : Resolved: model-input.pt => model-input.pt (exists = 0) [2020-11-24 14:41:25 main:459] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 0) [2020-11-24 14:41:25 main:479] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/rand_automata_0017-train-val-dataset.hdf5 [2020-11-24 14:41:25 main:481] : INFO : Configuration: [2020-11-24 14:41:25 main:482] : INFO : Model type: LSTM [2020-11-24 14:41:25 main:483] : INFO : Validation Loss Threshold: 0.0001 [2020-11-24 14:41:25 main:484] : INFO : Max Epochs: 192 [2020-11-24 14:41:25 main:485] : INFO : Batch Size: 32 [2020-11-24 14:41:25 main:486] : INFO : Learning Rate: 0.001 [2020-11-24 14:41:25 main:487] : INFO : Patience: 10 [2020-11-24 14:41:25 main:488] : INFO : Hidden Width: 64 [2020-11-24 14:41:25 main:489] : INFO : # Recurrent Layers: 4 [2020-11-24 14:41:25 main:490] : INFO : # Backend Layers: 2 [2020-11-24 14:41:25 main:491] : INFO : # Threads: 1 [2020-11-24 14:41:25 main:493] : INFO : Preparing Dataset [2020-11-24 14:41:25 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0017-train-val-dataset.hdf5 into memory [2020-11-24 14:41:25 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0017-train-val-dataset.hdf5 into memory [2020-11-24 14:41:27 load:106] : INFO : Successfully loaded dataset of 4096 examples into memory. [2020-11-24 14:41:27 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0017-train-val-dataset.hdf5 into memory [2020-11-24 14:41:27 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0017-train-val-dataset.hdf5 into memory [2020-11-24 14:41:27 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2020-11-24 14:41:27 main:501] : INFO : Creating Model [2020-11-24 14:41:27 main:514] : INFO : Preparing config file [2020-11-24 14:41:27 main:526] : INFO : Creating new config file [2020-11-24 14:41:27 main:566] : INFO : Loading DataLoader into Memory [2020-11-24 14:41:27 main:569] : INFO : Starting Training [2020-11-24 14:41:32 main:581] : INFO : Epoch 1 | loss: 0.0660804 | val_loss: 0.0659008 | Time: 5283.43 ms [2020-11-24 14:41:37 main:581] : INFO : Epoch 2 | loss: 0.0644038 | val_loss: 0.0624075 | Time: 4754.16 ms [2020-11-24 14:41:42 main:581] : INFO : Epoch 3 | loss: 0.0607711 | val_loss: 0.0592766 | Time: 4686.39 ms [2020-11-24 14:41:47 main:581] : INFO : Epoch 4 | loss: 0.0582927 | val_loss: 0.0572866 | Time: 4707.1 ms [2020-11-24 14:41:51 main:581] : INFO : Epoch 5 | loss: 0.0566894 | val_loss: 0.0559695 | Time: 4735.93 ms [2020-11-24 14:41:56 main:581] : INFO : Epoch 6 | loss: 0.0555476 | val_loss: 0.0550351 | Time: 4769.15 ms [2020-11-24 14:42:01 main:581] : INFO : Epoch 7 | loss: 0.0545763 | val_loss: 0.0541421 | Time: 4743.1 ms [2020-11-24 14:42:06 main:581] : INFO : Epoch 8 | loss: 0.053655 | val_loss: 0.0532045 | Time: 4772.61 ms [2020-11-24 14:42:10 main:581] : INFO : Epoch 9 | loss: 0.0526729 | val_loss: 0.0521805 | Time: 4743.39 ms [2020-11-24 14:42:15 main:581] : INFO : Epoch 10 | loss: 0.0516424 | val_loss: 0.0511025 | Time: 4752.03 ms [2020-11-24 14:42:20 main:581] : INFO : Epoch 11 | loss: 0.0505175 | val_loss: 0.0500498 | Time: 4734.37 ms [2020-11-24 14:42:25 main:581] : INFO : Epoch 12 | loss: 0.0492882 | val_loss: 0.0487751 | Time: 5139.16 ms [2020-11-24 14:42:30 main:581] : INFO : Epoch 13 | loss: 0.0478473 | val_loss: 0.0473229 | Time: 4950.41 ms [2020-11-24 14:42:35 main:581] : INFO : Epoch 14 | loss: 0.046231 | val_loss: 0.0456965 | Time: 4761.59 ms [2020-11-24 14:42:40 main:581] : INFO : Epoch 15 | loss: 0.0444356 | val_loss: 0.0440987 | Time: 5020.14 ms [2020-11-24 14:42:45 main:581] : INFO : Epoch 16 | loss: 0.0423951 | val_loss: 0.0421126 | Time: 5223.27 ms [2020-11-24 14:42:50 main:581] : INFO : Epoch 17 | loss: 0.0400856 | val_loss: 0.0397975 | Time: 5200.93 ms [2020-11-24 14:42:55 main:581] : INFO : Epoch 18 | loss: 0.0374105 | val_loss: 0.0365793 | Time: 5216.99 ms [2020-11-24 14:43:01 main:581] : INFO : Epoch 19 | loss: 0.0351095 | val_loss: 0.0335044 | Time: 5217.2 ms [2020-11-24 14:43:05 main:581] : INFO : Epoch 20 | loss: 0.0319105 | val_loss: 0.031137 | Time: 4909.14 ms [2020-11-24 14:43:10 main:581] : INFO : Epoch 21 | loss: 0.031671 | val_loss: 0.0369777 | Time: 4765.88 ms [2020-11-24 14:43:15 main:581] : INFO : Epoch 22 | loss: 0.0283765 | val_loss: 0.0266301 | Time: 4779.81 ms [2020-11-24 14:43:20 main:581] : INFO : Epoch 23 | loss: 0.0454268 | val_loss: 0.0559251 | Time: 4789 ms [2020-11-24 14:43:25 main:581] : INFO : Epoch 24 | loss: 0.05232 | val_loss: 0.0476315 | Time: 4788.02 ms [2020-11-24 14:43:29 main:581] : INFO : Epoch 25 | loss: 0.038975 | val_loss: 0.0313248 | Time: 4780.85 ms [2020-11-24 14:43:34 main:581] : INFO : Epoch 26 | loss: 0.0270772 | val_loss: 0.0250151 | Time: 4767.98 ms [2020-11-24 14:43:39 main:581] : INFO : Epoch 27 | loss: 0.0225458 | val_loss: 0.0212317 | Time: 4756.8 ms [2020-11-24 14:43:44 main:581] : INFO : Epoch 28 | loss: 0.0206503 | val_loss: 0.0164617 | Time: 4805.21 ms [2020-11-24 14:43:49 main:581] : INFO : Epoch 29 | loss: 0.0194699 | val_loss: 0.0329814 | Time: 4793.06 ms [2020-11-24 14:43:53 main:581] : INFO : Epoch 30 | loss: 0.0244294 | val_loss: 0.0287793 | Time: 4766.23 ms [2020-11-24 14:43:58 main:581] : INFO : Epoch 31 | loss: 0.0287304 | val_loss: 0.0225068 | Time: 4764.38 ms [2020-11-24 14:44:03 main:581] : INFO : Epoch 32 | loss: 0.0192883 | val_loss: 0.0180372 | Time: 4844.05 ms [2020-11-24 14:44:08 main:581] : INFO : Epoch 33 | loss: 0.0170293 | val_loss: 0.0160386 | Time: 4773.31 ms [2020-11-24 14:44:12 main:581] : INFO : Epoch 34 | loss: 0.0132521 | val_loss: 0.0127705 | Time: 4801.73 ms [2020-11-24 14:44:17 main:581] : INFO : Epoch 35 | loss: 0.0304629 | val_loss: 0.0596801 | Time: 4814.28 ms [2020-11-24 14:44:22 main:581] : INFO : Epoch 36 | loss: 0.0566326 | val_loss: 0.0536515 | Time: 4793.67 ms [2020-11-24 14:44:27 main:581] : INFO : Epoch 37 | loss: 0.0480708 | val_loss: 0.0390583 | Time: 4743.36 ms [2020-11-24 14:44:32 main:581] : INFO : Epoch 38 | loss: 0.0259069 | val_loss: 0.0175357 | Time: 5390.28 ms [2020-11-24 14:44:37 main:581] : INFO : Epoch 39 | loss: 0.0357107 | val_loss: 0.0471366 | Time: 4767.6 ms [2020-11-24 14:44:42 main:581] : INFO : Epoch 40 | loss: 0.0285082 | val_loss: 0.0177134 | Time: 4749.96 ms [2020-11-24 14:44:47 main:581] : INFO : Epoch 41 | loss: 0.0141714 | val_loss: 0.0124393 | Time: 4791.88 ms [2020-11-24 14:44:51 main:581] : INFO : Epoch 42 | loss: 0.0113016 | val_loss: 0.0115531 | Time: 4796.17 ms [2020-11-24 14:44:56 main:581] : INFO : Epoch 43 | loss: 0.0103343 | val_loss: 0.0101699 | Time: 4801.22 ms [2020-11-24 14:45:01 main:581] : INFO : Epoch 44 | loss: 0.00989299 | val_loss: 0.00934541 | Time: 4798.73 ms [2020-11-24 14:45:06 main:581] : INFO : Epoch 45 | loss: 0.00896159 | val_loss: 0.00939861 | Time: 4800.59 ms [2020-11-24 14:45:11 main:581] : INFO : Epoch 46 | loss: 0.00875823 | val_loss: 0.00862082 | Time: 4774.64 ms [2020-11-24 14:45:15 main:581] : INFO : Epoch 47 | loss: 0.00825247 | val_loss: 0.00833138 | Time: 4821.5 ms [2020-11-24 14:45:20 main:581] : INFO : Epoch 48 | loss: 0.0079656 | val_loss: 0.0080308 | Time: 4818.85 ms [2020-11-24 14:45:25 main:581] : INFO : Epoch 49 | loss: 0.00771017 | val_loss: 0.00808241 | Time: 4843.29 ms [2020-11-24 14:45:30 main:581] : INFO : Epoch 50 | loss: 0.0075218 | val_loss: 0.00752187 | Time: 4817.19 ms [2020-11-24 14:45:35 main:581] : INFO : Epoch 51 | loss: 0.00725783 | val_loss: 0.00732253 | Time: 4826.65 ms [2020-11-24 14:45:39 main:581] : INFO : Epoch 52 | loss: 0.00704991 | val_loss: 0.00707639 | Time: 4826.01 ms [2020-11-24 14:45:44 main:581] : INFO : Epoch 53 | loss: 0.00683457 | val_loss: 0.00687599 | Time: 4824.38 ms [2020-11-24 14:45:49 main:581] : INFO : Epoch 54 | loss: 0.00663901 | val_loss: 0.00663736 | Time: 4828.91 ms [2020-11-24 14:45:54 main:581] : INFO : Epoch 55 | loss: 0.00644917 | val_loss: 0.00645321 | Time: 4810 ms [2020-11-24 14:45:59 main:581] : INFO : Epoch 56 | loss: 0.00626146 | val_loss: 0.006249 | Time: 4774.18 ms [2020-11-24 14:46:03 main:581] : INFO : Epoch 57 | loss: 0.00607403 | val_loss: 0.00605648 | Time: 4764.13 ms [2020-11-24 14:46:08 main:581] : INFO : Epoch 58 | loss: 0.00589093 | val_loss: 0.0058832 | Time: 4775.69 ms [2020-11-24 14:46:13 main:581] : INFO : Epoch 59 | loss: 0.00570793 | val_loss: 0.0056755 | Time: 4816.05 ms [2020-11-24 14:46:18 main:581] : INFO : Epoch 60 | loss: 0.00552748 | val_loss: 0.00548781 | Time: 4785.5 ms [2020-11-24 14:46:23 main:581] : INFO : Epoch 61 | loss: 0.00534878 | val_loss: 0.00530107 | Time: 4780.73 ms [2020-11-24 14:46:27 main:581] : INFO : Epoch 62 | loss: 0.0051703 | val_loss: 0.00512775 | Time: 4788.15 ms [2020-11-24 14:46:32 main:581] : INFO : Epoch 63 | loss: 0.0049997 | val_loss: 0.00494121 | Time: 4775.37 ms [2020-11-24 14:46:37 main:581] : INFO : Epoch 64 | loss: 0.00482619 | val_loss: 0.00476997 | Time: 4812.48 ms [2020-11-24 14:46:42 main:581] : INFO : Epoch 65 | loss: 0.00465612 | val_loss: 0.00460219 | Time: 4753.76 ms [2020-11-24 14:46:47 main:581] : INFO : Epoch 66 | loss: 0.00448947 | val_loss: 0.00443145 | Time: 4907.57 ms [2020-11-24 14:46:51 main:581] : INFO : Epoch 67 | loss: 0.00432518 | val_loss: 0.00426953 | Time: 4746.81 ms [2020-11-24 14:46:56 main:581] : INFO : Epoch 68 | loss: 0.00416509 | val_loss: 0.00410692 | Time: 4779.5 ms [2020-11-24 14:47:01 main:581] : INFO : Epoch 69 | loss: 0.00400489 | val_loss: 0.00394786 | Time: 4750.05 ms [2020-11-24 14:47:06 main:581] : INFO : Epoch 70 | loss: 0.00384855 | val_loss: 0.00379052 | Time: 4817.12 ms [2020-11-24 14:47:11 main:581] : INFO : Epoch 71 | loss: 0.00369513 | val_loss: 0.00363822 | Time: 4822.19 ms [2020-11-24 14:47:15 main:581] : INFO : Epoch 72 | loss: 0.00354551 | val_loss: 0.00349047 | Time: 4756.54 ms [2020-11-24 14:47:20 main:581] : INFO : Epoch 73 | loss: 0.00339936 | val_loss: 0.00334154 | Time: 4753 ms [2020-11-24 14:47:25 main:581] : INFO : Epoch 74 | loss: 0.00325541 | val_loss: 0.0032015 | Time: 4778.45 ms [2020-11-24 14:47:30 main:581] : INFO : Epoch 75 | loss: 0.00311607 | val_loss: 0.00306614 | Time: 4783.6 ms [2020-11-24 14:47:34 main:581] : INFO : Epoch 76 | loss: 0.00298151 | val_loss: 0.00293317 | Time: 4787.79 ms [2020-11-24 14:47:39 main:581] : INFO : Epoch 77 | loss: 0.00285113 | val_loss: 0.00280174 | Time: 4753.72 ms [2020-11-24 14:47:44 main:581] : INFO : Epoch 78 | loss: 0.00272385 | val_loss: 0.00267917 | Time: 4758.15 ms [2020-11-24 14:47:49 main:581] : INFO : Epoch 79 | loss: 0.00260116 | val_loss: 0.00255346 | Time: 4794.43 ms [2020-11-24 14:47:54 main:581] : INFO : Epoch 80 | loss: 0.00248201 | val_loss: 0.00243708 | Time: 4774.2 ms [2020-11-24 14:47:58 main:581] : INFO : Epoch 81 | loss: 0.00236826 | val_loss: 0.00232596 | Time: 4750.64 ms [2020-11-24 14:48:03 main:581] : INFO : Epoch 82 | loss: 0.0022576 | val_loss: 0.00221849 | Time: 4738.45 ms [2020-11-24 14:48:08 main:581] : INFO : Epoch 83 | loss: 0.00215259 | val_loss: 0.00211503 | Time: 4736.62 ms [2020-11-24 14:48:13 main:581] : INFO : Epoch 84 | loss: 0.00205099 | val_loss: 0.00201223 | Time: 4814.23 ms [2020-11-24 14:48:17 main:581] : INFO : Epoch 85 | loss: 0.00195353 | val_loss: 0.00191689 | Time: 4834 ms [2020-11-24 14:48:22 main:581] : INFO : Epoch 86 | loss: 0.00186101 | val_loss: 0.00182692 | Time: 4845.52 ms [2020-11-24 14:48:27 main:581] : INFO : Epoch 87 | loss: 0.00177224 | val_loss: 0.00173576 | Time: 4824.99 ms [2020-11-24 14:48:32 main:581] : INFO : Epoch 88 | loss: 0.00168736 | val_loss: 0.0016522 | Time: 4825.98 ms [2020-11-24 14:48:37 main:581] : INFO : Epoch 89 | loss: 0.0016051 | val_loss: 0.00157322 | Time: 4856.19 ms [2020-11-24 14:48:42 main:581] : INFO : Epoch 90 | loss: 0.00152816 | val_loss: 0.0014969 | Time: 4795.66 ms [2020-11-24 14:48:46 main:581] : INFO : Epoch 91 | loss: 0.00145318 | val_loss: 0.00142097 | Time: 4761.27 ms [2020-11-24 14:48:51 main:581] : INFO : Epoch 92 | loss: 0.00138185 | val_loss: 0.00135631 | Time: 4809.72 ms [2020-11-24 14:48:56 main:581] : INFO : Epoch 93 | loss: 0.00131314 | val_loss: 0.00128564 | Time: 4813.43 ms [2020-11-24 14:49:01 main:581] : INFO : Epoch 94 | loss: 0.00124804 | val_loss: 0.00121974 | Time: 4809.08 ms [2020-11-24 14:49:06 main:581] : INFO : Epoch 95 | loss: 0.0011855 | val_loss: 0.00115884 | Time: 4774.37 ms [2020-11-24 14:49:10 main:581] : INFO : Epoch 96 | loss: 0.00112596 | val_loss: 0.00110007 | Time: 4840.28 ms [2020-11-24 14:49:15 main:581] : INFO : Epoch 97 | loss: 0.00107049 | val_loss: 0.00104407 | Time: 4806.1 ms [2020-11-24 14:49:20 main:581] : INFO : Epoch 98 | loss: 0.00101671 | val_loss: 0.000994366 | Time: 4778.18 ms [2020-11-24 14:49:25 main:581] : INFO : Epoch 99 | loss: 0.000964933 | val_loss: 0.000941739 | Time: 4812.77 ms [2020-11-24 14:49:30 main:581] : INFO : Epoch 100 | loss: 0.000916736 | val_loss: 0.000897956 | Time: 4769.6 ms [2020-11-24 14:49:34 main:581] : INFO : Epoch 101 | loss: 0.000870007 | val_loss: 0.000851645 | Time: 4792.67 ms [2020-11-24 14:49:39 main:581] : INFO : Epoch 102 | loss: 0.00082585 | val_loss: 0.000806158 | Time: 4766.28 ms [2020-11-24 14:49:44 main:581] : INFO : Epoch 103 | loss: 0.000783997 | val_loss: 0.00077088 | Time: 4810.04 ms [2020-11-24 14:49:49 main:581] : INFO : Epoch 104 | loss: 0.000744501 | val_loss: 0.000727107 | Time: 4769.91 ms [2020-11-24 14:49:53 main:581] : INFO : Epoch 105 | loss: 0.000706227 | val_loss: 0.000688818 | Time: 4768 ms [2020-11-24 14:49:58 main:581] : INFO : Epoch 106 | loss: 0.000670867 | val_loss: 0.000655748 | Time: 4821.96 ms [2020-11-24 14:50:03 main:581] : INFO : Epoch 107 | loss: 0.000636816 | val_loss: 0.000624628 | Time: 4812.04 ms [2020-11-24 14:50:08 main:581] : INFO : Epoch 108 | loss: 0.00060382 | val_loss: 0.00059361 | Time: 4832.25 ms [2020-11-24 14:50:13 main:581] : INFO : Epoch 109 | loss: 0.000573655 | val_loss: 0.000560469 | Time: 4790.18 ms [2020-11-24 14:50:17 main:581] : INFO : Epoch 110 | loss: 0.000544746 | val_loss: 0.000532602 | Time: 4780.71 ms [2020-11-24 14:50:22 main:581] : INFO : Epoch 111 | loss: 0.000516785 | val_loss: 0.000507081 | Time: 4845.82 ms [2020-11-24 14:50:27 main:581] : INFO : Epoch 112 | loss: 0.000491724 | val_loss: 0.000482014 | Time: 4831.54 ms [2020-11-24 14:50:32 main:581] : INFO : Epoch 113 | loss: 0.00046681 | val_loss: 0.000457277 | Time: 4793.67 ms [2020-11-24 14:50:37 main:581] : INFO : Epoch 114 | loss: 0.000444017 | val_loss: 0.000436078 | Time: 4885.51 ms [2020-11-24 14:50:42 main:581] : INFO : Epoch 115 | loss: 0.000421853 | val_loss: 0.000416293 | Time: 4986.88 ms [2020-11-24 14:50:47 main:581] : INFO : Epoch 116 | loss: 0.000401742 | val_loss: 0.000395148 | Time: 4822.13 ms [2020-11-24 14:50:51 main:581] : INFO : Epoch 117 | loss: 0.000381807 | val_loss: 0.00037441 | Time: 4850.05 ms [2020-11-24 14:50:56 main:581] : INFO : Epoch 118 | loss: 0.000363514 | val_loss: 0.000357914 | Time: 4860.53 ms [2020-11-24 14:51:01 main:581] : INFO : Epoch 119 | loss: 0.000345518 | val_loss: 0.000341987 | Time: 4773.71 ms [2020-11-24 14:51:06 main:581] : INFO : Epoch 120 | loss: 0.000329707 | val_loss: 0.000323437 | Time: 4738 ms [2020-11-24 14:51:11 main:581] : INFO : Epoch 121 | loss: 0.00031397 | val_loss: 0.000310726 | Time: 4738.9 ms [2020-11-24 14:51:15 main:581] : INFO : Epoch 122 | loss: 0.000299085 | val_loss: 0.000295066 | Time: 4744.57 ms [2020-11-24 14:51:20 main:581] : INFO : Epoch 123 | loss: 0.000285229 | val_loss: 0.000286058 | Time: 4777.31 ms [2020-11-24 14:51:25 main:581] : INFO : Epoch 124 | loss: 0.000272492 | val_loss: 0.000266723 | Time: 4842.95 ms [2020-11-24 14:51:30 main:581] : INFO : Epoch 125 | loss: 0.000259369 | val_loss: 0.000256008 | Time: 4843.1 ms [2020-11-24 14:51:35 main:581] : INFO : Epoch 126 | loss: 0.000248123 | val_loss: 0.000242632 | Time: 4819.43 ms [2020-11-24 14:51:39 main:581] : INFO : Epoch 127 | loss: 0.000237076 | val_loss: 0.000233844 | Time: 4778.05 ms [2020-11-24 14:51:44 main:581] : INFO : Epoch 128 | loss: 0.000227318 | val_loss: 0.00022677 | Time: 4832.67 ms [2020-11-24 14:51:49 main:581] : INFO : Epoch 129 | loss: 0.000217113 | val_loss: 0.00021573 | Time: 4814.06 ms [2020-11-24 14:51:54 main:581] : INFO : Epoch 130 | loss: 0.00020793 | val_loss: 0.00020676 | Time: 4812.87 ms [2020-11-24 14:51:59 main:581] : INFO : Epoch 131 | loss: 0.000199871 | val_loss: 0.000197899 | Time: 4788.93 ms [2020-11-24 14:52:03 main:581] : INFO : Epoch 132 | loss: 0.000191192 | val_loss: 0.000190105 | Time: 4839.88 ms [2020-11-24 14:52:08 main:581] : INFO : Epoch 133 | loss: 0.000183671 | val_loss: 0.000183005 | Time: 4844.96 ms [2020-11-24 14:52:13 main:581] : INFO : Epoch 134 | loss: 0.000176272 | val_loss: 0.000174873 | Time: 4786.26 ms [2020-11-24 14:52:18 main:581] : INFO : Epoch 135 | loss: 0.0001691 | val_loss: 0.000167981 | Time: 4853.92 ms [2020-11-24 14:52:23 main:581] : INFO : Epoch 136 | loss: 0.00016302 | val_loss: 0.000163153 | Time: 4838.45 ms [2020-11-24 14:52:28 main:581] : INFO : Epoch 137 | loss: 0.000156807 | val_loss: 0.000155536 | Time: 4768.25 ms [2020-11-24 14:52:32 main:581] : INFO : Epoch 138 | loss: 0.000150852 | val_loss: 0.000150077 | Time: 4796.59 ms [2020-11-24 14:52:37 main:581] : INFO : Epoch 139 | loss: 0.000145265 | val_loss: 0.000143432 | Time: 4768.26 ms [2020-11-24 14:52:42 main:581] : INFO : Epoch 140 | loss: 0.000140183 | val_loss: 0.000137885 | Time: 4797.63 ms [2020-11-24 14:52:47 main:581] : INFO : Epoch 141 | loss: 0.000135151 | val_loss: 0.000133313 | Time: 4752.49 ms [2020-11-24 14:52:51 main:581] : INFO : Epoch 142 | loss: 0.000129846 | val_loss: 0.000129157 | Time: 4727.94 ms [2020-11-24 14:52:56 main:581] : INFO : Epoch 143 | loss: 0.000126164 | val_loss: 0.00012423 | Time: 4779.71 ms [2020-11-24 14:53:01 main:581] : INFO : Epoch 144 | loss: 0.000121765 | val_loss: 0.000121405 | Time: 4772.47 ms [2020-11-24 14:53:06 main:581] : INFO : Epoch 145 | loss: 0.000118323 | val_loss: 0.000116186 | Time: 4750.25 ms [2020-11-24 14:53:10 main:581] : INFO : Epoch 146 | loss: 0.000113523 | val_loss: 0.000112954 | Time: 4754.19 ms [2020-11-24 14:53:15 main:581] : INFO : Epoch 147 | loss: 0.000110351 | val_loss: 0.000110151 | Time: 4765.96 ms [2020-11-24 14:53:20 main:581] : INFO : Epoch 148 | loss: 0.000107274 | val_loss: 0.000106769 | Time: 4777.6 ms [2020-11-24 14:53:25 main:581] : INFO : Epoch 149 | loss: 0.000103154 | val_loss: 0.000102023 | Time: 4806.19 ms [2020-11-24 14:53:30 main:581] : INFO : Epoch 150 | loss: 0.000100314 | val_loss: 9.89852e-05 | Time: 4766.79 ms [2020-11-24 14:53:34 main:581] : INFO : Epoch 151 | loss: 9.71557e-05 | val_loss: 9.65757e-05 | Time: 4841.83 ms [2020-11-24 14:53:39 main:581] : INFO : Epoch 152 | loss: 9.53826e-05 | val_loss: 9.37212e-05 | Time: 4785.62 ms [2020-11-24 14:53:44 main:581] : INFO : Epoch 153 | loss: 9.15036e-05 | val_loss: 9.14285e-05 | Time: 4753.27 ms [2020-11-24 14:53:49 main:581] : INFO : Epoch 154 | loss: 8.89488e-05 | val_loss: 9.05215e-05 | Time: 4734.5 ms [2020-11-24 14:53:53 main:581] : INFO : Epoch 155 | loss: 8.68833e-05 | val_loss: 8.77058e-05 | Time: 4774.02 ms [2020-11-24 14:53:58 main:581] : INFO : Epoch 156 | loss: 8.41699e-05 | val_loss: 8.53274e-05 | Time: 4841.7 ms [2020-11-24 14:54:03 main:581] : INFO : Epoch 157 | loss: 8.23048e-05 | val_loss: 8.11482e-05 | Time: 4829.54 ms [2020-11-24 14:54:08 main:581] : INFO : Epoch 158 | loss: 8.02929e-05 | val_loss: 7.95136e-05 | Time: 4778.97 ms [2020-11-24 14:54:13 main:581] : INFO : Epoch 159 | loss: 7.76282e-05 | val_loss: 7.92521e-05 | Time: 4790.11 ms [2020-11-24 14:54:18 main:581] : INFO : Epoch 160 | loss: 7.62173e-05 | val_loss: 7.55602e-05 | Time: 4796.28 ms [2020-11-24 14:54:22 main:581] : INFO : Epoch 161 | loss: 7.46931e-05 | val_loss: 7.39977e-05 | Time: 4806.62 ms [2020-11-24 14:54:27 main:581] : INFO : Epoch 162 | loss: 7.19709e-05 | val_loss: 7.38779e-05 | Time: 4847.6 ms [2020-11-24 14:54:32 main:581] : INFO : Epoch 163 | loss: 6.99426e-05 | val_loss: 6.9755e-05 | Time: 4805.79 ms [2020-11-24 14:54:37 main:581] : INFO : Epoch 164 | loss: 6.90098e-05 | val_loss: 6.90933e-05 | Time: 4850.84 ms [2020-11-24 14:54:42 main:581] : INFO : Epoch 165 | loss: 6.74903e-05 | val_loss: 6.73796e-05 | Time: 4777.85 ms [2020-11-24 14:54:46 main:581] : INFO : Epoch 166 | loss: 6.56269e-05 | val_loss: 6.64172e-05 | Time: 4779.17 ms [2020-11-24 14:54:51 main:581] : INFO : Epoch 167 | loss: 6.4803e-05 | val_loss: 6.5911e-05 | Time: 4835.13 ms [2020-11-24 14:54:56 main:581] : INFO : Epoch 168 | loss: 6.29035e-05 | val_loss: 6.29865e-05 | Time: 4800.28 ms [2020-11-24 14:55:01 main:581] : INFO : Epoch 169 | loss: 6.14334e-05 | val_loss: 6.17606e-05 | Time: 4775.11 ms [2020-11-24 14:55:06 main:581] : INFO : Epoch 170 | loss: 6.023e-05 | val_loss: 5.98995e-05 | Time: 4775.42 ms [2020-11-24 14:55:10 main:581] : INFO : Epoch 171 | loss: 5.85235e-05 | val_loss: 6.05012e-05 | Time: 4807.03 ms [2020-11-24 14:55:15 main:581] : INFO : Epoch 172 | loss: 5.78562e-05 | val_loss: 5.67668e-05 | Time: 4791.11 ms [2020-11-24 14:55:20 main:581] : INFO : Epoch 173 | loss: 5.72292e-05 | val_loss: 5.75099e-05 | Time: 4782.04 ms [2020-11-24 14:55:25 main:581] : INFO : Epoch 174 | loss: 5.53045e-05 | val_loss: 5.50284e-05 | Time: 4838.77 ms [2020-11-24 14:55:30 main:581] : INFO : Epoch 175 | loss: 5.42857e-05 | val_loss: 5.50433e-05 | Time: 4850.85 ms [2020-11-24 14:55:34 main:581] : INFO : Epoch 176 | loss: 5.33864e-05 | val_loss: 5.55445e-05 | Time: 4800.61 ms [2020-11-24 14:55:39 main:581] : INFO : Epoch 177 | loss: 5.24997e-05 | val_loss: 5.30781e-05 | Time: 4828.84 ms [2020-11-24 14:55:44 main:581] : INFO : Epoch 178 | loss: 5.14717e-05 | val_loss: 5.14834e-05 | Time: 4826.71 ms [2020-11-24 14:55:49 main:581] : INFO : Epoch 179 | loss: 5.02408e-05 | val_loss: 5.12516e-05 | Time: 4777.24 ms [2020-11-24 14:55:54 main:581] : INFO : Epoch 180 | loss: 4.93964e-05 | val_loss: 5.04045e-05 | Time: 4754.77 ms [2020-11-24 14:55:58 main:581] : INFO : Epoch 181 | loss: 4.90746e-05 | val_loss: 4.91476e-05 | Time: 4776.39 ms [2020-11-24 14:56:03 main:581] : INFO : Epoch 182 | loss: 4.78182e-05 | val_loss: 4.85296e-05 | Time: 4833.06 ms [2020-11-24 14:56:08 main:581] : INFO : Epoch 183 | loss: 4.70469e-05 | val_loss: 4.77632e-05 | Time: 4772.07 ms [2020-11-24 14:56:13 main:581] : INFO : Epoch 184 | loss: 4.60863e-05 | val_loss: 4.64938e-05 | Time: 4784.42 ms [2020-11-24 14:56:18 main:581] : INFO : Epoch 185 | loss: 4.52712e-05 | val_loss: 4.81532e-05 | Time: 4808.89 ms [2020-11-24 14:56:22 main:581] : INFO : Epoch 186 | loss: 4.4805e-05 | val_loss: 4.44279e-05 | Time: 4782.5 ms [2020-11-24 14:56:27 main:581] : INFO : Epoch 187 | loss: 4.40684e-05 | val_loss: 4.43207e-05 | Time: 4795.6 ms [2020-11-24 14:56:32 main:581] : INFO : Epoch 188 | loss: 4.33265e-05 | val_loss: 4.29157e-05 | Time: 4840.48 ms [2020-11-24 14:56:37 main:581] : INFO : Epoch 189 | loss: 4.26192e-05 | val_loss: 4.25511e-05 | Time: 4806.17 ms [2020-11-24 14:56:42 main:581] : INFO : Epoch 190 | loss: 4.2321e-05 | val_loss: 4.18311e-05 | Time: 4740.68 ms [2020-11-24 14:56:46 main:581] : INFO : Epoch 191 | loss: 4.11701e-05 | val_loss: 4.13124e-05 | Time: 4779.38 ms [2020-11-24 14:56:51 main:581] : INFO : Epoch 192 | loss: 4.07013e-05 | val_loss: 4.05033e-05 | Time: 4718.24 ms [2020-11-24 14:56:51 main:604] : INFO : Saving trained model to model-final.pt, val_loss 4.05033e-05 [2020-11-24 14:56:51 main:610] : INFO : Saving end state to config to file [2020-11-24 14:56:51 main:615] : INFO : Success, exiting.. 14:56:51 (3397401): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)