Task 3051080
| Name | rand_automata_0014-1606118262-31337-0_2 |
| Workunit | 1376557 |
| Created | 24 Nov 2020, 14:35:58 UTC |
| Sent | 24 Nov 2020, 14:49:48 UTC |
| Report deadline | 25 Nov 2020, 13:19:48 UTC |
| Received | 24 Nov 2020, 21:16:55 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 4379 |
| Run time | 15 min 56 sec |
| CPU time | 15 min 48 sec |
| Validate state | Valid |
| Credit | 959.40 |
| Device peak FLOPS | 4,493.80 GFLOPS |
| Application version | Machine Learning Dataset Generator (test) v9.80 (cuda10200) x86_64-pc-linux-gnu |
| Peak working set size | 2.18 GB |
| Peak swap size | 10.01 GB |
| Peak disk usage | 2.98 GB |
Stderr output
<core_client_version>7.16.11</core_client_version> <![CDATA[ <stderr_txt> DEBUG: Args: ../../projects/www.mlcathome.org_mlcathome/mlds-gpu_9.80_x86_64-pc-linux-gnu__cuda10200 -a LSTM -w 64 -b 2 -s 32 --lr 0.001 --maxepoch 192 nthreads: 1 gpudev: 0 Re-exec()-ing to set environment correctly Machine Learning Dataset Generator v9.80 (Linux/x86_64) (libTorch: release/1.7 GPU: GeForce GTX 1650 SUPER) [2020-11-24 16:00:46 main:442] : INFO : Set logging level to 1 [2020-11-24 16:00:46 main:448] : INFO : Running in BOINC Client mode [2020-11-24 16:00:46 main:451] : INFO : Resolving all filenames [2020-11-24 16:00:46 main:459] : INFO : Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0014-train-val-dataset.hdf5 (exists = 1) [2020-11-24 16:00:46 main:459] : INFO : Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0014-1606118262-31337-0_2_r1590627203_1 (exists = 0) [2020-11-24 16:00:46 main:459] : INFO : Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0014-1606118262-31337-0_2_r1590627203_0 (exists = 0) [2020-11-24 16:00:46 main:459] : INFO : Resolved: model-input.pt => model-input.pt (exists = 0) [2020-11-24 16:00:46 main:459] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 0) [2020-11-24 16:00:46 main:479] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/rand_automata_0014-train-val-dataset.hdf5 [2020-11-24 16:00:46 main:481] : INFO : Configuration: [2020-11-24 16:00:46 main:482] : INFO : Model type: LSTM [2020-11-24 16:00:46 main:483] : INFO : Validation Loss Threshold: 0.0001 [2020-11-24 16:00:46 main:484] : INFO : Max Epochs: 192 [2020-11-24 16:00:46 main:485] : INFO : Batch Size: 32 [2020-11-24 16:00:46 main:486] : INFO : Learning Rate: 0.001 [2020-11-24 16:00:46 main:487] : INFO : Patience: 10 [2020-11-24 16:00:46 main:488] : INFO : Hidden Width: 64 [2020-11-24 16:00:46 main:489] : INFO : # Recurrent Layers: 4 [2020-11-24 16:00:46 main:490] : INFO : # Backend Layers: 2 [2020-11-24 16:00:46 main:491] : INFO : # Threads: 1 [2020-11-24 16:00:46 main:493] : INFO : Preparing Dataset [2020-11-24 16:00:46 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0014-train-val-dataset.hdf5 into memory [2020-11-24 16:00:46 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0014-train-val-dataset.hdf5 into memory [2020-11-24 16:00:47 load:106] : INFO : Successfully loaded dataset of 4096 examples into memory. [2020-11-24 16:00:47 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0014-train-val-dataset.hdf5 into memory [2020-11-24 16:00:47 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0014-train-val-dataset.hdf5 into memory [2020-11-24 16:00:47 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2020-11-24 16:00:47 main:501] : INFO : Creating Model [2020-11-24 16:00:47 main:514] : INFO : Preparing config file [2020-11-24 16:00:47 main:526] : INFO : Creating new config file [2020-11-24 16:00:48 main:566] : INFO : Loading DataLoader into Memory [2020-11-24 16:00:48 main:569] : INFO : Starting Training [2020-11-24 16:00:53 main:581] : INFO : Epoch 1 | loss: 0.0658636 | val_loss: 0.0656584 | Time: 5471.47 ms [2020-11-24 16:00:58 main:581] : INFO : Epoch 2 | loss: 0.0638382 | val_loss: 0.0621294 | Time: 4808.89 ms [2020-11-24 16:01:03 main:581] : INFO : Epoch 3 | loss: 0.0602236 | val_loss: 0.0585947 | Time: 5047.28 ms [2020-11-24 16:01:08 main:581] : INFO : Epoch 4 | loss: 0.0574636 | val_loss: 0.0564134 | Time: 5147.89 ms [2020-11-24 16:01:13 main:581] : INFO : Epoch 5 | loss: 0.0555457 | val_loss: 0.0546858 | Time: 4829.24 ms [2020-11-24 16:01:18 main:581] : INFO : Epoch 6 | loss: 0.0539691 | val_loss: 0.0533419 | Time: 4808.41 ms [2020-11-24 16:01:22 main:581] : INFO : Epoch 7 | loss: 0.052578 | val_loss: 0.0518034 | Time: 4772.84 ms [2020-11-24 16:01:27 main:581] : INFO : Epoch 8 | loss: 0.0511335 | val_loss: 0.0503539 | Time: 4775.09 ms [2020-11-24 16:01:32 main:581] : INFO : Epoch 9 | loss: 0.0497095 | val_loss: 0.0489364 | Time: 4857.36 ms [2020-11-24 16:01:37 main:581] : INFO : Epoch 10 | loss: 0.0481449 | val_loss: 0.0476005 | Time: 4909.46 ms [2020-11-24 16:01:42 main:581] : INFO : Epoch 11 | loss: 0.0465698 | val_loss: 0.0458174 | Time: 4988.58 ms [2020-11-24 16:01:47 main:581] : INFO : Epoch 12 | loss: 0.0447973 | val_loss: 0.0441948 | Time: 4941.47 ms [2020-11-24 16:01:52 main:581] : INFO : Epoch 13 | loss: 0.0428324 | val_loss: 0.0424121 | Time: 4859.91 ms [2020-11-24 16:01:57 main:581] : INFO : Epoch 14 | loss: 0.0407937 | val_loss: 0.0399739 | Time: 4857.87 ms [2020-11-24 16:02:02 main:581] : INFO : Epoch 15 | loss: 0.0383539 | val_loss: 0.038549 | Time: 4849.85 ms [2020-11-24 16:02:06 main:581] : INFO : Epoch 16 | loss: 0.0357844 | val_loss: 0.0352439 | Time: 4858.16 ms [2020-11-24 16:02:11 main:581] : INFO : Epoch 17 | loss: 0.0331735 | val_loss: 0.0324841 | Time: 4984.59 ms [2020-11-24 16:02:16 main:581] : INFO : Epoch 18 | loss: 0.0298652 | val_loss: 0.0288971 | Time: 4847.28 ms [2020-11-24 16:02:21 main:581] : INFO : Epoch 19 | loss: 0.0286256 | val_loss: 0.028523 | Time: 5114.41 ms [2020-11-24 16:02:26 main:581] : INFO : Epoch 20 | loss: 0.0262917 | val_loss: 0.0264562 | Time: 4932.73 ms [2020-11-24 16:02:32 main:581] : INFO : Epoch 21 | loss: 0.052875 | val_loss: 0.0610758 | Time: 5296.79 ms [2020-11-24 16:02:37 main:581] : INFO : Epoch 22 | loss: 0.0602227 | val_loss: 0.0594568 | Time: 5091.1 ms [2020-11-24 16:02:41 main:581] : INFO : Epoch 23 | loss: 0.0587103 | val_loss: 0.0579342 | Time: 4809.28 ms [2020-11-24 16:02:46 main:581] : INFO : Epoch 24 | loss: 0.0568921 | val_loss: 0.055771 | Time: 4788.08 ms [2020-11-24 16:02:51 main:581] : INFO : Epoch 25 | loss: 0.0539311 | val_loss: 0.0519267 | Time: 4829.95 ms [2020-11-24 16:02:56 main:581] : INFO : Epoch 26 | loss: 0.0484813 | val_loss: 0.0446253 | Time: 4865.08 ms [2020-11-24 16:03:01 main:581] : INFO : Epoch 27 | loss: 0.0379569 | val_loss: 0.0316429 | Time: 4868.23 ms [2020-11-24 16:03:06 main:581] : INFO : Epoch 28 | loss: 0.0278158 | val_loss: 0.024814 | Time: 5023.95 ms [2020-11-24 16:03:11 main:581] : INFO : Epoch 29 | loss: 0.0283197 | val_loss: 0.0219271 | Time: 4958.73 ms [2020-11-24 16:03:16 main:581] : INFO : Epoch 30 | loss: 0.0299147 | val_loss: 0.0437711 | Time: 5031.5 ms [2020-11-24 16:03:21 main:581] : INFO : Epoch 31 | loss: 0.0289939 | val_loss: 0.0227723 | Time: 4831.39 ms [2020-11-24 16:03:26 main:581] : INFO : Epoch 32 | loss: 0.0217785 | val_loss: 0.0199698 | Time: 4970.28 ms [2020-11-24 16:03:31 main:581] : INFO : Epoch 33 | loss: 0.0179952 | val_loss: 0.020357 | Time: 5241.53 ms [2020-11-24 16:03:36 main:581] : INFO : Epoch 34 | loss: 0.0323257 | val_loss: 0.0206806 | Time: 5267.26 ms [2020-11-24 16:03:41 main:581] : INFO : Epoch 35 | loss: 0.0249596 | val_loss: 0.0231226 | Time: 5247.49 ms [2020-11-24 16:03:47 main:581] : INFO : Epoch 36 | loss: 0.016719 | val_loss: 0.0147641 | Time: 5410.09 ms [2020-11-24 16:03:52 main:581] : INFO : Epoch 37 | loss: 0.0251774 | val_loss: 0.0197423 | Time: 5244.22 ms [2020-11-24 16:03:57 main:581] : INFO : Epoch 38 | loss: 0.0153641 | val_loss: 0.0134694 | Time: 4807.1 ms [2020-11-24 16:04:02 main:581] : INFO : Epoch 39 | loss: 0.0207371 | val_loss: 0.0151389 | Time: 5243.24 ms [2020-11-24 16:04:07 main:581] : INFO : Epoch 40 | loss: 0.0128802 | val_loss: 0.0128802 | Time: 5377.94 ms [2020-11-24 16:04:13 main:581] : INFO : Epoch 41 | loss: 0.0140449 | val_loss: 0.0139553 | Time: 5039.68 ms [2020-11-24 16:04:17 main:581] : INFO : Epoch 42 | loss: 0.0122501 | val_loss: 0.0114592 | Time: 4845 ms [2020-11-24 16:04:22 main:581] : INFO : Epoch 43 | loss: 0.0101746 | val_loss: 0.0104309 | Time: 4888.81 ms [2020-11-24 16:04:27 main:581] : INFO : Epoch 44 | loss: 0.00964428 | val_loss: 0.00979616 | Time: 4978.03 ms [2020-11-24 16:04:32 main:581] : INFO : Epoch 45 | loss: 0.00936558 | val_loss: 0.00959256 | Time: 4894.19 ms [2020-11-24 16:04:37 main:581] : INFO : Epoch 46 | loss: 0.00886063 | val_loss: 0.00905038 | Time: 4856.32 ms [2020-11-24 16:04:42 main:581] : INFO : Epoch 47 | loss: 0.008706 | val_loss: 0.00880599 | Time: 4861.48 ms [2020-11-24 16:04:47 main:581] : INFO : Epoch 48 | loss: 0.00845024 | val_loss: 0.0086624 | Time: 4873.91 ms [2020-11-24 16:04:52 main:581] : INFO : Epoch 49 | loss: 0.00806648 | val_loss: 0.00826989 | Time: 4874.77 ms [2020-11-24 16:04:57 main:581] : INFO : Epoch 50 | loss: 0.00775534 | val_loss: 0.00836046 | Time: 5128.19 ms [2020-11-24 16:05:02 main:581] : INFO : Epoch 51 | loss: 0.00760687 | val_loss: 0.00776479 | Time: 4798.99 ms [2020-11-24 16:05:06 main:581] : INFO : Epoch 52 | loss: 0.00729774 | val_loss: 0.00752806 | Time: 4759.61 ms [2020-11-24 16:05:11 main:581] : INFO : Epoch 53 | loss: 0.00707876 | val_loss: 0.00730063 | Time: 4825.91 ms [2020-11-24 16:05:16 main:581] : INFO : Epoch 54 | loss: 0.00686707 | val_loss: 0.00705601 | Time: 4825.33 ms [2020-11-24 16:05:21 main:581] : INFO : Epoch 55 | loss: 0.00667294 | val_loss: 0.00688487 | Time: 4839.39 ms [2020-11-24 16:05:26 main:581] : INFO : Epoch 56 | loss: 0.00647907 | val_loss: 0.00661724 | Time: 4972.27 ms [2020-11-24 16:05:31 main:581] : INFO : Epoch 57 | loss: 0.00629199 | val_loss: 0.00639217 | Time: 5220.91 ms [2020-11-24 16:05:36 main:581] : INFO : Epoch 58 | loss: 0.00610681 | val_loss: 0.00618722 | Time: 5026.63 ms [2020-11-24 16:05:41 main:581] : INFO : Epoch 59 | loss: 0.00592466 | val_loss: 0.00599649 | Time: 4919.5 ms [2020-11-24 16:05:46 main:581] : INFO : Epoch 60 | loss: 0.00574631 | val_loss: 0.0057988 | Time: 4890.15 ms [2020-11-24 16:05:51 main:581] : INFO : Epoch 61 | loss: 0.00556862 | val_loss: 0.00561636 | Time: 4868.9 ms [2020-11-24 16:05:56 main:581] : INFO : Epoch 62 | loss: 0.00539405 | val_loss: 0.00541199 | Time: 4855.13 ms [2020-11-24 16:06:00 main:581] : INFO : Epoch 63 | loss: 0.00522089 | val_loss: 0.00522962 | Time: 4820.43 ms [2020-11-24 16:06:05 main:581] : INFO : Epoch 64 | loss: 0.00504975 | val_loss: 0.00505425 | Time: 4840.04 ms [2020-11-24 16:06:10 main:581] : INFO : Epoch 65 | loss: 0.0048811 | val_loss: 0.00488236 | Time: 4791.72 ms [2020-11-24 16:06:15 main:581] : INFO : Epoch 66 | loss: 0.00471581 | val_loss: 0.0047136 | Time: 4900.82 ms [2020-11-24 16:06:20 main:581] : INFO : Epoch 67 | loss: 0.00455462 | val_loss: 0.00455008 | Time: 4859.86 ms [2020-11-24 16:06:25 main:581] : INFO : Epoch 68 | loss: 0.00439774 | val_loss: 0.00439037 | Time: 4869.66 ms [2020-11-24 16:06:29 main:581] : INFO : Epoch 69 | loss: 0.00424339 | val_loss: 0.00423514 | Time: 4839.26 ms [2020-11-24 16:06:34 main:581] : INFO : Epoch 70 | loss: 0.00409423 | val_loss: 0.00407995 | Time: 4952.66 ms [2020-11-24 16:06:39 main:581] : INFO : Epoch 71 | loss: 0.00394596 | val_loss: 0.0039366 | Time: 4887.17 ms [2020-11-24 16:06:44 main:581] : INFO : Epoch 72 | loss: 0.00380334 | val_loss: 0.00377323 | Time: 4838.35 ms [2020-11-24 16:06:49 main:581] : INFO : Epoch 73 | loss: 0.00366576 | val_loss: 0.00363326 | Time: 4927.79 ms [2020-11-24 16:06:54 main:581] : INFO : Epoch 74 | loss: 0.00352903 | val_loss: 0.00349611 | Time: 4958.13 ms [2020-11-24 16:06:59 main:581] : INFO : Epoch 75 | loss: 0.00339849 | val_loss: 0.00336477 | Time: 5115.51 ms [2020-11-24 16:07:04 main:581] : INFO : Epoch 76 | loss: 0.0032722 | val_loss: 0.00324149 | Time: 4863.75 ms [2020-11-24 16:07:09 main:581] : INFO : Epoch 77 | loss: 0.00314898 | val_loss: 0.00311827 | Time: 4875.86 ms [2020-11-24 16:07:14 main:581] : INFO : Epoch 78 | loss: 0.00303098 | val_loss: 0.00299996 | Time: 4812 ms [2020-11-24 16:07:19 main:581] : INFO : Epoch 79 | loss: 0.00291587 | val_loss: 0.00288401 | Time: 4874.84 ms [2020-11-24 16:07:23 main:581] : INFO : Epoch 80 | loss: 0.0028054 | val_loss: 0.00277812 | Time: 4880.16 ms [2020-11-24 16:07:28 main:581] : INFO : Epoch 81 | loss: 0.00269749 | val_loss: 0.00266945 | Time: 4914.2 ms [2020-11-24 16:07:33 main:581] : INFO : Epoch 82 | loss: 0.00259356 | val_loss: 0.00256652 | Time: 4894.03 ms [2020-11-24 16:07:38 main:581] : INFO : Epoch 83 | loss: 0.00249495 | val_loss: 0.00247012 | Time: 5001.13 ms [2020-11-24 16:07:43 main:581] : INFO : Epoch 84 | loss: 0.00239923 | val_loss: 0.00237348 | Time: 4852.45 ms [2020-11-24 16:07:48 main:581] : INFO : Epoch 85 | loss: 0.00230806 | val_loss: 0.00228464 | Time: 4871.42 ms [2020-11-24 16:07:53 main:581] : INFO : Epoch 86 | loss: 0.00221974 | val_loss: 0.00220153 | Time: 5140.73 ms [2020-11-24 16:07:58 main:581] : INFO : Epoch 87 | loss: 0.00213402 | val_loss: 0.00211131 | Time: 5208.35 ms [2020-11-24 16:08:03 main:581] : INFO : Epoch 88 | loss: 0.00205285 | val_loss: 0.00203348 | Time: 5000.88 ms [2020-11-24 16:08:08 main:581] : INFO : Epoch 89 | loss: 0.00197406 | val_loss: 0.00195487 | Time: 4864.07 ms [2020-11-24 16:08:13 main:581] : INFO : Epoch 90 | loss: 0.00189859 | val_loss: 0.00188266 | Time: 4759.58 ms [2020-11-24 16:08:18 main:581] : INFO : Epoch 91 | loss: 0.00182659 | val_loss: 0.0018079 | Time: 4879.73 ms [2020-11-24 16:08:23 main:581] : INFO : Epoch 92 | loss: 0.00175592 | val_loss: 0.00174045 | Time: 4847.01 ms [2020-11-24 16:08:28 main:581] : INFO : Epoch 93 | loss: 0.00168872 | val_loss: 0.00167293 | Time: 4888.63 ms [2020-11-24 16:08:32 main:581] : INFO : Epoch 94 | loss: 0.00162463 | val_loss: 0.00161232 | Time: 4823.93 ms [2020-11-24 16:08:37 main:581] : INFO : Epoch 95 | loss: 0.00156255 | val_loss: 0.0015505 | Time: 4878.8 ms [2020-11-24 16:08:42 main:581] : INFO : Epoch 96 | loss: 0.00150417 | val_loss: 0.0014937 | Time: 4803.27 ms [2020-11-24 16:08:47 main:581] : INFO : Epoch 97 | loss: 0.0014462 | val_loss: 0.00143602 | Time: 4884.89 ms [2020-11-24 16:08:52 main:581] : INFO : Epoch 98 | loss: 0.00139148 | val_loss: 0.00138323 | Time: 5324.56 ms [2020-11-24 16:08:57 main:581] : INFO : Epoch 99 | loss: 0.00133934 | val_loss: 0.00133273 | Time: 5225.96 ms [2020-11-24 16:09:03 main:581] : INFO : Epoch 100 | loss: 0.00128989 | val_loss: 0.00127929 | Time: 5253.28 ms [2020-11-24 16:09:08 main:581] : INFO : Epoch 101 | loss: 0.00124052 | val_loss: 0.00123283 | Time: 5107.94 ms [2020-11-24 16:09:13 main:581] : INFO : Epoch 102 | loss: 0.00119478 | val_loss: 0.00119142 | Time: 5180.49 ms [2020-11-24 16:09:18 main:581] : INFO : Epoch 103 | loss: 0.00115129 | val_loss: 0.00114824 | Time: 5272.29 ms [2020-11-24 16:09:24 main:581] : INFO : Epoch 104 | loss: 0.00110841 | val_loss: 0.00110492 | Time: 5349.44 ms [2020-11-24 16:09:29 main:581] : INFO : Epoch 105 | loss: 0.00106746 | val_loss: 0.00106783 | Time: 5269.78 ms [2020-11-24 16:09:34 main:581] : INFO : Epoch 106 | loss: 0.00102857 | val_loss: 0.00102496 | Time: 5334.6 ms [2020-11-24 16:09:39 main:581] : INFO : Epoch 107 | loss: 0.000990534 | val_loss: 0.000987732 | Time: 4940.15 ms [2020-11-24 16:09:44 main:581] : INFO : Epoch 108 | loss: 0.000954649 | val_loss: 0.000953676 | Time: 4893.65 ms [2020-11-24 16:09:49 main:581] : INFO : Epoch 109 | loss: 0.000920317 | val_loss: 0.000918426 | Time: 5092.63 ms [2020-11-24 16:09:54 main:581] : INFO : Epoch 110 | loss: 0.000887441 | val_loss: 0.00089648 | Time: 4982.53 ms [2020-11-24 16:09:59 main:581] : INFO : Epoch 111 | loss: 0.000856529 | val_loss: 0.00085683 | Time: 4826.26 ms [2020-11-24 16:10:04 main:581] : INFO : Epoch 112 | loss: 0.000825419 | val_loss: 0.00082676 | Time: 4874.46 ms [2020-11-24 16:10:09 main:581] : INFO : Epoch 113 | loss: 0.000796392 | val_loss: 0.000803217 | Time: 5020.68 ms [2020-11-24 16:10:14 main:581] : INFO : Epoch 114 | loss: 0.000769403 | val_loss: 0.000771556 | Time: 5039.18 ms [2020-11-24 16:10:19 main:581] : INFO : Epoch 115 | loss: 0.00074226 | val_loss: 0.000743517 | Time: 4884.85 ms [2020-11-24 16:10:24 main:581] : INFO : Epoch 116 | loss: 0.000717116 | val_loss: 0.000721207 | Time: 4918.18 ms [2020-11-24 16:10:29 main:581] : INFO : Epoch 117 | loss: 0.000693884 | val_loss: 0.000701404 | Time: 4885.62 ms [2020-11-24 16:10:34 main:581] : INFO : Epoch 118 | loss: 0.000670447 | val_loss: 0.000674749 | Time: 5319.9 ms [2020-11-24 16:10:39 main:581] : INFO : Epoch 119 | loss: 0.000646727 | val_loss: 0.000655003 | Time: 4964.93 ms [2020-11-24 16:10:44 main:581] : INFO : Epoch 120 | loss: 0.000626474 | val_loss: 0.000631814 | Time: 4897.76 ms [2020-11-24 16:10:49 main:581] : INFO : Epoch 121 | loss: 0.000604417 | val_loss: 0.000613271 | Time: 4945.19 ms [2020-11-24 16:10:54 main:581] : INFO : Epoch 122 | loss: 0.000585811 | val_loss: 0.000592741 | Time: 4835.03 ms [2020-11-24 16:10:58 main:581] : INFO : Epoch 123 | loss: 0.000567547 | val_loss: 0.000575763 | Time: 4822.88 ms [2020-11-24 16:11:03 main:581] : INFO : Epoch 124 | loss: 0.000549839 | val_loss: 0.000557905 | Time: 4755.22 ms [2020-11-24 16:11:08 main:581] : INFO : Epoch 125 | loss: 0.000532708 | val_loss: 0.00053836 | Time: 4805.93 ms [2020-11-24 16:11:13 main:581] : INFO : Epoch 126 | loss: 0.000516837 | val_loss: 0.000525005 | Time: 4829.2 ms [2020-11-24 16:11:18 main:581] : INFO : Epoch 127 | loss: 0.00050093 | val_loss: 0.000509303 | Time: 4813.31 ms [2020-11-24 16:11:23 main:581] : INFO : Epoch 128 | loss: 0.000487987 | val_loss: 0.000496674 | Time: 4899.14 ms [2020-11-24 16:11:27 main:581] : INFO : Epoch 129 | loss: 0.000473673 | val_loss: 0.000481721 | Time: 4931.15 ms [2020-11-24 16:11:33 main:581] : INFO : Epoch 130 | loss: 0.000460243 | val_loss: 0.000473577 | Time: 5266.83 ms [2020-11-24 16:11:38 main:581] : INFO : Epoch 131 | loss: 0.000447209 | val_loss: 0.000457584 | Time: 5210.95 ms [2020-11-24 16:11:43 main:581] : INFO : Epoch 132 | loss: 0.000435257 | val_loss: 0.00044663 | Time: 4830.23 ms [2020-11-24 16:11:48 main:581] : INFO : Epoch 133 | loss: 0.000424911 | val_loss: 0.000435251 | Time: 5003.05 ms [2020-11-24 16:11:53 main:581] : INFO : Epoch 134 | loss: 0.000413694 | val_loss: 0.000423866 | Time: 5357.99 ms [2020-11-24 16:11:58 main:581] : INFO : Epoch 135 | loss: 0.000402752 | val_loss: 0.00041228 | Time: 5112.88 ms [2020-11-24 16:12:03 main:581] : INFO : Epoch 136 | loss: 0.000393184 | val_loss: 0.000403802 | Time: 4782.82 ms [2020-11-24 16:12:08 main:581] : INFO : Epoch 137 | loss: 0.000383133 | val_loss: 0.000394111 | Time: 4914.01 ms [2020-11-24 16:12:13 main:581] : INFO : Epoch 138 | loss: 0.000374084 | val_loss: 0.00038655 | Time: 4822.46 ms [2020-11-24 16:12:18 main:581] : INFO : Epoch 139 | loss: 0.000365131 | val_loss: 0.000376889 | Time: 4872.61 ms [2020-11-24 16:12:23 main:581] : INFO : Epoch 140 | loss: 0.000358182 | val_loss: 0.00036497 | Time: 4886.06 ms [2020-11-24 16:12:27 main:581] : INFO : Epoch 141 | loss: 0.000349632 | val_loss: 0.000363601 | Time: 4960.74 ms [2020-11-24 16:12:32 main:581] : INFO : Epoch 142 | loss: 0.000341499 | val_loss: 0.000353152 | Time: 4851.25 ms [2020-11-24 16:12:37 main:581] : INFO : Epoch 143 | loss: 0.000333691 | val_loss: 0.000347595 | Time: 4874.42 ms [2020-11-24 16:12:42 main:581] : INFO : Epoch 144 | loss: 0.000326621 | val_loss: 0.000339615 | Time: 4948.7 ms [2020-11-24 16:12:47 main:581] : INFO : Epoch 145 | loss: 0.000320261 | val_loss: 0.000332437 | Time: 4835.58 ms [2020-11-24 16:12:52 main:581] : INFO : Epoch 146 | loss: 0.000313848 | val_loss: 0.000325276 | Time: 5108.83 ms [2020-11-24 16:12:57 main:581] : INFO : Epoch 147 | loss: 0.000307356 | val_loss: 0.000317593 | Time: 5084.73 ms [2020-11-24 16:13:02 main:581] : INFO : Epoch 148 | loss: 0.000300777 | val_loss: 0.000314909 | Time: 4992.17 ms [2020-11-24 16:13:07 main:581] : INFO : Epoch 149 | loss: 0.000294284 | val_loss: 0.000309352 | Time: 5087.96 ms [2020-11-24 16:13:12 main:581] : INFO : Epoch 150 | loss: 0.000289097 | val_loss: 0.000301004 | Time: 5058.21 ms [2020-11-24 16:13:17 main:581] : INFO : Epoch 151 | loss: 0.000282855 | val_loss: 0.000297176 | Time: 4935.96 ms [2020-11-24 16:13:22 main:581] : INFO : Epoch 152 | loss: 0.000278061 | val_loss: 0.000289709 | Time: 4921.39 ms [2020-11-24 16:13:27 main:581] : INFO : Epoch 153 | loss: 0.00027275 | val_loss: 0.000285076 | Time: 4870.08 ms [2020-11-24 16:13:32 main:581] : INFO : Epoch 154 | loss: 0.0002671 | val_loss: 0.000285299 | Time: 4845.12 ms [2020-11-24 16:13:37 main:581] : INFO : Epoch 155 | loss: 0.000263198 | val_loss: 0.000275234 | Time: 4833.22 ms [2020-11-24 16:13:42 main:581] : INFO : Epoch 156 | loss: 0.000257767 | val_loss: 0.000268961 | Time: 4958.1 ms [2020-11-24 16:13:47 main:581] : INFO : Epoch 157 | loss: 0.000252881 | val_loss: 0.000264263 | Time: 4858.32 ms [2020-11-24 16:13:51 main:581] : INFO : Epoch 158 | loss: 0.000248937 | val_loss: 0.000260788 | Time: 4916.15 ms [2020-11-24 16:13:57 main:581] : INFO : Epoch 159 | loss: 0.00024421 | val_loss: 0.000257004 | Time: 5050.55 ms [2020-11-24 16:14:02 main:581] : INFO : Epoch 160 | loss: 0.00023999 | val_loss: 0.000250535 | Time: 5199.69 ms [2020-11-24 16:14:07 main:581] : INFO : Epoch 161 | loss: 0.000236767 | val_loss: 0.000248863 | Time: 5240.33 ms [2020-11-24 16:14:12 main:581] : INFO : Epoch 162 | loss: 0.00023211 | val_loss: 0.000246084 | Time: 4868.93 ms [2020-11-24 16:14:17 main:581] : INFO : Epoch 163 | loss: 0.000228635 | val_loss: 0.000240138 | Time: 5017.82 ms [2020-11-24 16:14:22 main:581] : INFO : Epoch 164 | loss: 0.000224095 | val_loss: 0.000236409 | Time: 4879.18 ms [2020-11-24 16:14:27 main:581] : INFO : Epoch 165 | loss: 0.000220927 | val_loss: 0.000232797 | Time: 4893.71 ms [2020-11-24 16:14:32 main:581] : INFO : Epoch 166 | loss: 0.000217488 | val_loss: 0.000231974 | Time: 4934.5 ms [2020-11-24 16:14:36 main:581] : INFO : Epoch 167 | loss: 0.000214312 | val_loss: 0.000224729 | Time: 4869.34 ms [2020-11-24 16:14:41 main:581] : INFO : Epoch 168 | loss: 0.000210591 | val_loss: 0.000224079 | Time: 4840.22 ms [2020-11-24 16:14:46 main:581] : INFO : Epoch 169 | loss: 0.000207445 | val_loss: 0.000218468 | Time: 5227.89 ms [2020-11-24 16:14:52 main:581] : INFO : Epoch 170 | loss: 0.000204426 | val_loss: 0.000218039 | Time: 5301.28 ms [2020-11-24 16:14:57 main:581] : INFO : Epoch 171 | loss: 0.000200818 | val_loss: 0.000212106 | Time: 5022.08 ms [2020-11-24 16:15:02 main:581] : INFO : Epoch 172 | loss: 0.000197933 | val_loss: 0.000209353 | Time: 4795.45 ms [2020-11-24 16:15:07 main:581] : INFO : Epoch 173 | loss: 0.000195553 | val_loss: 0.000206649 | Time: 4928.97 ms [2020-11-24 16:15:11 main:581] : INFO : Epoch 174 | loss: 0.000192683 | val_loss: 0.000202708 | Time: 4849.25 ms [2020-11-24 16:15:16 main:581] : INFO : Epoch 175 | loss: 0.000189526 | val_loss: 0.000200818 | Time: 4850.09 ms [2020-11-24 16:15:21 main:581] : INFO : Epoch 176 | loss: 0.000186763 | val_loss: 0.000199279 | Time: 4858.46 ms [2020-11-24 16:15:26 main:581] : INFO : Epoch 177 | loss: 0.000184211 | val_loss: 0.000194064 | Time: 4887.3 ms [2020-11-24 16:15:31 main:581] : INFO : Epoch 178 | loss: 0.000181561 | val_loss: 0.000192526 | Time: 4875.18 ms [2020-11-24 16:15:36 main:581] : INFO : Epoch 179 | loss: 0.000179075 | val_loss: 0.000192334 | Time: 4867.88 ms [2020-11-24 16:15:41 main:581] : INFO : Epoch 180 | loss: 0.000176754 | val_loss: 0.00018728 | Time: 4866.63 ms [2020-11-24 16:15:46 main:581] : INFO : Epoch 181 | loss: 0.000174644 | val_loss: 0.000186499 | Time: 4952.46 ms [2020-11-24 16:15:50 main:581] : INFO : Epoch 182 | loss: 0.00017192 | val_loss: 0.000182192 | Time: 4958.72 ms [2020-11-24 16:15:55 main:581] : INFO : Epoch 183 | loss: 0.000170048 | val_loss: 0.000179901 | Time: 4838.65 ms [2020-11-24 16:16:00 main:581] : INFO : Epoch 184 | loss: 0.00016783 | val_loss: 0.000178218 | Time: 4895.17 ms [2020-11-24 16:16:05 main:581] : INFO : Epoch 185 | loss: 0.000165521 | val_loss: 0.000178415 | Time: 4864.49 ms [2020-11-24 16:16:10 main:581] : INFO : Epoch 186 | loss: 0.000163461 | val_loss: 0.000174319 | Time: 4837.55 ms [2020-11-24 16:16:15 main:581] : INFO : Epoch 187 | loss: 0.000161778 | val_loss: 0.000171289 | Time: 4890.36 ms [2020-11-24 16:16:20 main:581] : INFO : Epoch 188 | loss: 0.000159497 | val_loss: 0.000168131 | Time: 4855.87 ms [2020-11-24 16:16:25 main:581] : INFO : Epoch 189 | loss: 0.000157428 | val_loss: 0.000166845 | Time: 4834.38 ms [2020-11-24 16:16:29 main:581] : INFO : Epoch 190 | loss: 0.000155825 | val_loss: 0.00016609 | Time: 4825.72 ms [2020-11-24 16:16:34 main:581] : INFO : Epoch 191 | loss: 0.00015306 | val_loss: 0.000166868 | Time: 4837.86 ms [2020-11-24 16:16:39 main:581] : INFO : Epoch 192 | loss: 0.000152305 | val_loss: 0.000160355 | Time: 4872.39 ms [2020-11-24 16:16:39 main:604] : INFO : Saving trained model to model-final.pt, val_loss 0.000160355 [2020-11-24 16:16:39 main:610] : INFO : Saving end state to config to file [2020-11-24 16:16:39 main:615] : INFO : Success, exiting.. 16:16:39 (3611974): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)