Task 3039726
| Name | rand_automata_0023-1606117987-22412-0_0 |
| Workunit | 1376048 |
| Created | 23 Nov 2020, 7:53:12 UTC |
| Sent | 24 Nov 2020, 4:57:05 UTC |
| Report deadline | 25 Nov 2020, 3:27:05 UTC |
| Received | 24 Nov 2020, 18:54:40 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 4379 |
| Run time | 13 min 43 sec |
| CPU time | 13 min 40 sec |
| Validate state | Valid |
| Credit | 959.40 |
| Device peak FLOPS | 4,493.80 GFLOPS |
| Application version | Machine Learning Dataset Generator (test) v9.80 (cuda10200) x86_64-pc-linux-gnu |
| Peak working set size | 2.19 GB |
| Peak swap size | 10.01 GB |
| Peak disk usage | 2.98 GB |
Stderr output
<core_client_version>7.16.11</core_client_version> <![CDATA[ <stderr_txt> DEBUG: Args: ../../projects/www.mlcathome.org_mlcathome/mlds-gpu_9.80_x86_64-pc-linux-gnu__cuda10200 -a LSTM -w 64 -b 2 -s 32 --lr 0.001 --maxepoch 192 nthreads: 1 gpudev: 0 Re-exec()-ing to set environment correctly Machine Learning Dataset Generator v9.80 (Linux/x86_64) (libTorch: release/1.7 GPU: GeForce GTX 1650 SUPER) [2020-11-24 13:40:49 main:442] : INFO : Set logging level to 1 [2020-11-24 13:40:49 main:448] : INFO : Running in BOINC Client mode [2020-11-24 13:40:49 main:451] : INFO : Resolving all filenames [2020-11-24 13:40:49 main:459] : INFO : Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0023-train-val-dataset.hdf5 (exists = 1) [2020-11-24 13:40:49 main:459] : INFO : Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0023-1606117987-22412-0_0_r1283511818_1 (exists = 0) [2020-11-24 13:40:49 main:459] : INFO : Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0023-1606117987-22412-0_0_r1283511818_0 (exists = 0) [2020-11-24 13:40:49 main:459] : INFO : Resolved: model-input.pt => model-input.pt (exists = 0) [2020-11-24 13:40:49 main:459] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 0) [2020-11-24 13:40:49 main:479] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/rand_automata_0023-train-val-dataset.hdf5 [2020-11-24 13:40:49 main:481] : INFO : Configuration: [2020-11-24 13:40:49 main:482] : INFO : Model type: LSTM [2020-11-24 13:40:49 main:483] : INFO : Validation Loss Threshold: 0.0001 [2020-11-24 13:40:49 main:484] : INFO : Max Epochs: 192 [2020-11-24 13:40:49 main:485] : INFO : Batch Size: 32 [2020-11-24 13:40:49 main:486] : INFO : Learning Rate: 0.001 [2020-11-24 13:40:49 main:487] : INFO : Patience: 10 [2020-11-24 13:40:49 main:488] : INFO : Hidden Width: 64 [2020-11-24 13:40:49 main:489] : INFO : # Recurrent Layers: 4 [2020-11-24 13:40:49 main:490] : INFO : # Backend Layers: 2 [2020-11-24 13:40:49 main:491] : INFO : # Threads: 1 [2020-11-24 13:40:49 main:493] : INFO : Preparing Dataset [2020-11-24 13:40:49 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0023-train-val-dataset.hdf5 into memory [2020-11-24 13:40:49 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0023-train-val-dataset.hdf5 into memory [2020-11-24 13:40:50 load:106] : INFO : Successfully loaded dataset of 4096 examples into memory. [2020-11-24 13:40:50 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0023-train-val-dataset.hdf5 into memory [2020-11-24 13:40:50 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0023-train-val-dataset.hdf5 into memory [2020-11-24 13:40:50 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2020-11-24 13:40:50 main:501] : INFO : Creating Model [2020-11-24 13:40:50 main:514] : INFO : Preparing config file [2020-11-24 13:40:50 main:526] : INFO : Creating new config file [2020-11-24 13:40:51 main:566] : INFO : Loading DataLoader into Memory [2020-11-24 13:40:51 main:569] : INFO : Starting Training [2020-11-24 13:40:54 main:581] : INFO : Epoch 1 | loss: 0.0661954 | val_loss: 0.0659904 | Time: 3816.24 ms [2020-11-24 13:40:58 main:581] : INFO : Epoch 2 | loss: 0.0643596 | val_loss: 0.0622902 | Time: 3753.51 ms [2020-11-24 13:41:02 main:581] : INFO : Epoch 3 | loss: 0.0606378 | val_loss: 0.0589991 | Time: 3597.63 ms [2020-11-24 13:41:05 main:581] : INFO : Epoch 4 | loss: 0.0578047 | val_loss: 0.0565529 | Time: 3534.08 ms [2020-11-24 13:41:09 main:581] : INFO : Epoch 5 | loss: 0.0557493 | val_loss: 0.0547498 | Time: 3454.93 ms [2020-11-24 13:41:13 main:581] : INFO : Epoch 6 | loss: 0.0541151 | val_loss: 0.0532094 | Time: 3733.26 ms [2020-11-24 13:41:16 main:581] : INFO : Epoch 7 | loss: 0.0526795 | val_loss: 0.0518638 | Time: 3582.33 ms [2020-11-24 13:41:20 main:581] : INFO : Epoch 8 | loss: 0.0512903 | val_loss: 0.0503531 | Time: 3570.26 ms [2020-11-24 13:41:23 main:581] : INFO : Epoch 9 | loss: 0.0498856 | val_loss: 0.0490017 | Time: 3589.54 ms [2020-11-24 13:41:27 main:581] : INFO : Epoch 10 | loss: 0.0481934 | val_loss: 0.0473391 | Time: 3921.46 ms [2020-11-24 13:41:31 main:581] : INFO : Epoch 11 | loss: 0.046275 | val_loss: 0.045344 | Time: 3960 ms [2020-11-24 13:41:35 main:581] : INFO : Epoch 12 | loss: 0.0439389 | val_loss: 0.0429748 | Time: 3872.6 ms [2020-11-24 13:41:39 main:581] : INFO : Epoch 13 | loss: 0.0414679 | val_loss: 0.0403631 | Time: 3722.19 ms [2020-11-24 13:41:43 main:581] : INFO : Epoch 14 | loss: 0.0385963 | val_loss: 0.0376347 | Time: 3805.23 ms [2020-11-24 13:41:46 main:581] : INFO : Epoch 15 | loss: 0.0354945 | val_loss: 0.0347326 | Time: 3542.22 ms [2020-11-24 13:41:50 main:581] : INFO : Epoch 16 | loss: 0.0324217 | val_loss: 0.0328017 | Time: 3539.7 ms [2020-11-24 13:41:53 main:581] : INFO : Epoch 17 | loss: 0.0306214 | val_loss: 0.031926 | Time: 3807.59 ms [2020-11-24 13:41:58 main:581] : INFO : Epoch 18 | loss: 0.0282256 | val_loss: 0.0266859 | Time: 4139.94 ms [2020-11-24 13:42:02 main:581] : INFO : Epoch 19 | loss: 0.0249574 | val_loss: 0.0249145 | Time: 4053.31 ms [2020-11-24 13:42:06 main:581] : INFO : Epoch 20 | loss: 0.0255297 | val_loss: 0.0217738 | Time: 3986.4 ms [2020-11-24 13:42:09 main:581] : INFO : Epoch 21 | loss: 0.0211134 | val_loss: 0.0237372 | Time: 3836.09 ms [2020-11-24 13:42:14 main:581] : INFO : Epoch 22 | loss: 0.021501 | val_loss: 0.0186054 | Time: 4146.64 ms [2020-11-24 13:42:18 main:581] : INFO : Epoch 23 | loss: 0.0174456 | val_loss: 0.018877 | Time: 3908.72 ms [2020-11-24 13:42:22 main:581] : INFO : Epoch 24 | loss: 0.0170112 | val_loss: 0.0142314 | Time: 4118.87 ms [2020-11-24 13:42:26 main:581] : INFO : Epoch 25 | loss: 0.0127851 | val_loss: 0.0130993 | Time: 4080.16 ms [2020-11-24 13:42:30 main:581] : INFO : Epoch 26 | loss: 0.0120172 | val_loss: 0.0119269 | Time: 3983.21 ms [2020-11-24 13:42:34 main:581] : INFO : Epoch 27 | loss: 0.0108376 | val_loss: 0.011231 | Time: 3927.52 ms [2020-11-24 13:42:38 main:581] : INFO : Epoch 28 | loss: 0.0381241 | val_loss: 0.0163194 | Time: 3968.2 ms [2020-11-24 13:42:42 main:581] : INFO : Epoch 29 | loss: 0.0270813 | val_loss: 0.0409315 | Time: 4043.92 ms [2020-11-24 13:42:46 main:581] : INFO : Epoch 30 | loss: 0.0430105 | val_loss: 0.0579347 | Time: 4155.13 ms [2020-11-24 13:42:50 main:581] : INFO : Epoch 31 | loss: 0.0550146 | val_loss: 0.0515823 | Time: 4274.63 ms [2020-11-24 13:42:54 main:581] : INFO : Epoch 32 | loss: 0.045695 | val_loss: 0.0346983 | Time: 4166.36 ms [2020-11-24 13:42:58 main:581] : INFO : Epoch 33 | loss: 0.021918 | val_loss: 0.0189225 | Time: 3998.86 ms [2020-11-24 13:43:02 main:581] : INFO : Epoch 34 | loss: 0.0153709 | val_loss: 0.0113255 | Time: 3912.34 ms [2020-11-24 13:43:06 main:581] : INFO : Epoch 35 | loss: 0.0149863 | val_loss: 0.0116969 | Time: 4020.86 ms [2020-11-24 13:43:10 main:581] : INFO : Epoch 36 | loss: 0.0108911 | val_loss: 0.00943561 | Time: 3964.25 ms [2020-11-24 13:43:14 main:581] : INFO : Epoch 37 | loss: 0.00878461 | val_loss: 0.00894991 | Time: 4004.58 ms [2020-11-24 13:43:18 main:581] : INFO : Epoch 38 | loss: 0.00818898 | val_loss: 0.00826748 | Time: 3997.05 ms [2020-11-24 13:43:22 main:581] : INFO : Epoch 39 | loss: 0.00914146 | val_loss: 0.0113853 | Time: 3998.37 ms [2020-11-24 13:43:26 main:581] : INFO : Epoch 40 | loss: 0.00799449 | val_loss: 0.00763116 | Time: 3669.28 ms [2020-11-24 13:43:30 main:581] : INFO : Epoch 41 | loss: 0.00714449 | val_loss: 0.00718692 | Time: 3792.26 ms [2020-11-24 13:43:33 main:581] : INFO : Epoch 42 | loss: 0.00683855 | val_loss: 0.00694673 | Time: 3694.1 ms [2020-11-24 13:43:37 main:581] : INFO : Epoch 43 | loss: 0.00720563 | val_loss: 0.0090079 | Time: 3655.34 ms [2020-11-24 13:43:41 main:581] : INFO : Epoch 44 | loss: 0.00672663 | val_loss: 0.00659293 | Time: 3843.4 ms [2020-11-24 13:43:45 main:581] : INFO : Epoch 45 | loss: 0.00678231 | val_loss: 0.00668739 | Time: 4037.94 ms [2020-11-24 13:43:49 main:581] : INFO : Epoch 46 | loss: 0.00611063 | val_loss: 0.00616732 | Time: 4150.91 ms [2020-11-24 13:43:53 main:581] : INFO : Epoch 47 | loss: 0.00583232 | val_loss: 0.00595281 | Time: 4061.91 ms [2020-11-24 13:43:57 main:581] : INFO : Epoch 48 | loss: 0.00564331 | val_loss: 0.00578215 | Time: 3966.55 ms [2020-11-24 13:44:02 main:581] : INFO : Epoch 49 | loss: 0.00547421 | val_loss: 0.00563066 | Time: 4529.12 ms [2020-11-24 13:44:06 main:581] : INFO : Epoch 50 | loss: 0.00530525 | val_loss: 0.00542296 | Time: 4634.53 ms [2020-11-24 13:44:10 main:581] : INFO : Epoch 51 | loss: 0.00514461 | val_loss: 0.00525301 | Time: 4059.86 ms [2020-11-24 13:44:14 main:581] : INFO : Epoch 52 | loss: 0.00498407 | val_loss: 0.00509416 | Time: 4191.81 ms [2020-11-24 13:44:19 main:581] : INFO : Epoch 53 | loss: 0.00483292 | val_loss: 0.00494558 | Time: 4310.02 ms [2020-11-24 13:44:23 main:581] : INFO : Epoch 54 | loss: 0.0046745 | val_loss: 0.00476739 | Time: 4002.84 ms [2020-11-24 13:44:27 main:581] : INFO : Epoch 55 | loss: 0.00462837 | val_loss: 0.00463538 | Time: 4088.39 ms [2020-11-24 13:44:31 main:581] : INFO : Epoch 56 | loss: 0.00437774 | val_loss: 0.00441281 | Time: 4593.37 ms [2020-11-24 13:44:36 main:581] : INFO : Epoch 57 | loss: 0.00422284 | val_loss: 0.00426063 | Time: 4557.87 ms [2020-11-24 13:44:41 main:581] : INFO : Epoch 58 | loss: 0.00407894 | val_loss: 0.00410586 | Time: 4673.33 ms [2020-11-24 13:44:45 main:581] : INFO : Epoch 59 | loss: 0.00394639 | val_loss: 0.00396962 | Time: 4672.6 ms [2020-11-24 13:44:50 main:581] : INFO : Epoch 60 | loss: 0.00379714 | val_loss: 0.00380361 | Time: 4617.18 ms [2020-11-24 13:44:55 main:581] : INFO : Epoch 61 | loss: 0.00365857 | val_loss: 0.00365376 | Time: 4549.75 ms [2020-11-24 13:44:59 main:581] : INFO : Epoch 62 | loss: 0.00352284 | val_loss: 0.00351619 | Time: 4448.48 ms [2020-11-24 13:45:03 main:581] : INFO : Epoch 63 | loss: 0.00338796 | val_loss: 0.00337779 | Time: 4380.71 ms [2020-11-24 13:45:08 main:581] : INFO : Epoch 64 | loss: 0.00325753 | val_loss: 0.00324397 | Time: 4430.1 ms [2020-11-24 13:45:12 main:581] : INFO : Epoch 65 | loss: 0.00312908 | val_loss: 0.00311484 | Time: 4366.3 ms [2020-11-24 13:45:17 main:581] : INFO : Epoch 66 | loss: 0.0030027 | val_loss: 0.00298855 | Time: 4445.11 ms [2020-11-24 13:45:21 main:581] : INFO : Epoch 67 | loss: 0.00287882 | val_loss: 0.00285788 | Time: 4469.7 ms [2020-11-24 13:45:25 main:581] : INFO : Epoch 68 | loss: 0.0027577 | val_loss: 0.0027343 | Time: 4179.58 ms [2020-11-24 13:45:30 main:581] : INFO : Epoch 69 | loss: 0.00263881 | val_loss: 0.00261669 | Time: 4682.2 ms [2020-11-24 13:45:35 main:581] : INFO : Epoch 70 | loss: 0.00252365 | val_loss: 0.00249975 | Time: 4722.99 ms [2020-11-24 13:45:39 main:581] : INFO : Epoch 71 | loss: 0.00241081 | val_loss: 0.00238881 | Time: 4012.84 ms [2020-11-24 13:45:42 main:581] : INFO : Epoch 72 | loss: 0.00230166 | val_loss: 0.00227845 | Time: 3706.77 ms [2020-11-24 13:45:46 main:581] : INFO : Epoch 73 | loss: 0.00219548 | val_loss: 0.00217042 | Time: 3794.17 ms [2020-11-24 13:45:50 main:581] : INFO : Epoch 74 | loss: 0.00209246 | val_loss: 0.00206708 | Time: 3706.4 ms [2020-11-24 13:45:54 main:581] : INFO : Epoch 75 | loss: 0.00199211 | val_loss: 0.00196395 | Time: 3775.59 ms [2020-11-24 13:45:58 main:581] : INFO : Epoch 76 | loss: 0.00189683 | val_loss: 0.00187146 | Time: 3923.72 ms [2020-11-24 13:46:01 main:581] : INFO : Epoch 77 | loss: 0.00180434 | val_loss: 0.00177725 | Time: 3781.04 ms [2020-11-24 13:46:05 main:581] : INFO : Epoch 78 | loss: 0.00171498 | val_loss: 0.00169022 | Time: 3482.62 ms [2020-11-24 13:46:09 main:581] : INFO : Epoch 79 | loss: 0.00163075 | val_loss: 0.00160397 | Time: 4049.86 ms [2020-11-24 13:46:13 main:581] : INFO : Epoch 80 | loss: 0.00154931 | val_loss: 0.00152511 | Time: 3952.72 ms [2020-11-24 13:46:17 main:581] : INFO : Epoch 81 | loss: 0.00146993 | val_loss: 0.00144546 | Time: 3950.42 ms [2020-11-24 13:46:21 main:581] : INFO : Epoch 82 | loss: 0.00139612 | val_loss: 0.00137082 | Time: 4223.65 ms [2020-11-24 13:46:26 main:581] : INFO : Epoch 83 | loss: 0.00132513 | val_loss: 0.0013024 | Time: 4763.37 ms [2020-11-24 13:46:30 main:581] : INFO : Epoch 84 | loss: 0.00125747 | val_loss: 0.00123458 | Time: 4360.48 ms [2020-11-24 13:46:34 main:581] : INFO : Epoch 85 | loss: 0.00119232 | val_loss: 0.00117137 | Time: 4175.16 ms [2020-11-24 13:46:39 main:581] : INFO : Epoch 86 | loss: 0.00113064 | val_loss: 0.0011105 | Time: 4310.02 ms [2020-11-24 13:46:43 main:581] : INFO : Epoch 87 | loss: 0.00107228 | val_loss: 0.00105435 | Time: 4111.91 ms [2020-11-24 13:46:47 main:581] : INFO : Epoch 88 | loss: 0.00101608 | val_loss: 0.000996441 | Time: 4230.6 ms [2020-11-24 13:46:51 main:581] : INFO : Epoch 89 | loss: 0.000962513 | val_loss: 0.000946462 | Time: 4228.87 ms [2020-11-24 13:46:55 main:581] : INFO : Epoch 90 | loss: 0.000912023 | val_loss: 0.000894641 | Time: 4239.09 ms [2020-11-24 13:47:00 main:581] : INFO : Epoch 91 | loss: 0.000863427 | val_loss: 0.000847838 | Time: 4179.58 ms [2020-11-24 13:47:04 main:581] : INFO : Epoch 92 | loss: 0.000818528 | val_loss: 0.000803445 | Time: 4053.91 ms [2020-11-24 13:47:08 main:581] : INFO : Epoch 93 | loss: 0.000774446 | val_loss: 0.000759306 | Time: 4179.87 ms [2020-11-24 13:47:12 main:581] : INFO : Epoch 94 | loss: 0.000733331 | val_loss: 0.000719912 | Time: 4073.32 ms [2020-11-24 13:47:16 main:581] : INFO : Epoch 95 | loss: 0.00069411 | val_loss: 0.000680106 | Time: 3932.03 ms [2020-11-24 13:47:20 main:581] : INFO : Epoch 96 | loss: 0.000656886 | val_loss: 0.000645583 | Time: 4166.24 ms [2020-11-24 13:47:24 main:581] : INFO : Epoch 97 | loss: 0.000621764 | val_loss: 0.000610648 | Time: 4346.1 ms [2020-11-24 13:47:29 main:581] : INFO : Epoch 98 | loss: 0.000588425 | val_loss: 0.000577186 | Time: 4981.32 ms [2020-11-24 13:47:34 main:581] : INFO : Epoch 99 | loss: 0.000556926 | val_loss: 0.000544838 | Time: 4525.81 ms [2020-11-24 13:47:38 main:581] : INFO : Epoch 100 | loss: 0.000526646 | val_loss: 0.000516417 | Time: 4226.59 ms [2020-11-24 13:47:42 main:581] : INFO : Epoch 101 | loss: 0.000498586 | val_loss: 0.000489987 | Time: 4222.02 ms [2020-11-24 13:47:46 main:581] : INFO : Epoch 102 | loss: 0.000471626 | val_loss: 0.000462237 | Time: 4026.14 ms [2020-11-24 13:47:51 main:581] : INFO : Epoch 103 | loss: 0.000445824 | val_loss: 0.000438271 | Time: 4322.94 ms [2020-11-24 13:47:55 main:581] : INFO : Epoch 104 | loss: 0.000421778 | val_loss: 0.000412115 | Time: 4175.01 ms [2020-11-24 13:48:00 main:581] : INFO : Epoch 105 | loss: 0.000398784 | val_loss: 0.000392493 | Time: 4671.13 ms [2020-11-24 13:48:04 main:581] : INFO : Epoch 106 | loss: 0.000377321 | val_loss: 0.00036958 | Time: 4587.99 ms [2020-11-24 13:48:08 main:581] : INFO : Epoch 107 | loss: 0.000356938 | val_loss: 0.000349989 | Time: 4364.26 ms [2020-11-24 13:48:13 main:581] : INFO : Epoch 108 | loss: 0.000337379 | val_loss: 0.000332338 | Time: 4321.42 ms [2020-11-24 13:48:17 main:581] : INFO : Epoch 109 | loss: 0.000320467 | val_loss: 0.000315287 | Time: 4429.76 ms [2020-11-24 13:48:21 main:581] : INFO : Epoch 110 | loss: 0.000303088 | val_loss: 0.00029722 | Time: 4174.46 ms [2020-11-24 13:48:25 main:581] : INFO : Epoch 111 | loss: 0.000287051 | val_loss: 0.000281632 | Time: 3975.86 ms [2020-11-24 13:48:29 main:581] : INFO : Epoch 112 | loss: 0.000271864 | val_loss: 0.000266682 | Time: 4012.22 ms [2020-11-24 13:48:34 main:581] : INFO : Epoch 113 | loss: 0.000257072 | val_loss: 0.000252651 | Time: 4260.78 ms [2020-11-24 13:48:38 main:581] : INFO : Epoch 114 | loss: 0.000243703 | val_loss: 0.000237844 | Time: 4656.58 ms [2020-11-24 13:48:43 main:581] : INFO : Epoch 115 | loss: 0.000231205 | val_loss: 0.000225227 | Time: 4296.24 ms [2020-11-24 13:48:47 main:581] : INFO : Epoch 116 | loss: 0.000219175 | val_loss: 0.000214448 | Time: 4152.65 ms [2020-11-24 13:48:51 main:581] : INFO : Epoch 117 | loss: 0.000208275 | val_loss: 0.00020463 | Time: 4258.47 ms [2020-11-24 13:48:55 main:581] : INFO : Epoch 118 | loss: 0.000197604 | val_loss: 0.000192871 | Time: 4223.15 ms [2020-11-24 13:48:59 main:581] : INFO : Epoch 119 | loss: 0.000187542 | val_loss: 0.000186001 | Time: 4040.16 ms [2020-11-24 13:49:03 main:581] : INFO : Epoch 120 | loss: 0.000177892 | val_loss: 0.00017582 | Time: 4130.61 ms [2020-11-24 13:49:07 main:581] : INFO : Epoch 121 | loss: 0.000169332 | val_loss: 0.000165799 | Time: 4023.02 ms [2020-11-24 13:49:11 main:581] : INFO : Epoch 122 | loss: 0.00016122 | val_loss: 0.000160946 | Time: 4048.79 ms [2020-11-24 13:49:16 main:581] : INFO : Epoch 123 | loss: 0.000153528 | val_loss: 0.000149802 | Time: 4224.84 ms [2020-11-24 13:49:20 main:581] : INFO : Epoch 124 | loss: 0.000146794 | val_loss: 0.000141849 | Time: 4134.59 ms [2020-11-24 13:49:24 main:581] : INFO : Epoch 125 | loss: 0.000139832 | val_loss: 0.000136777 | Time: 4176.82 ms [2020-11-24 13:49:28 main:581] : INFO : Epoch 126 | loss: 0.000133138 | val_loss: 0.000130711 | Time: 4236.73 ms [2020-11-24 13:49:32 main:581] : INFO : Epoch 127 | loss: 0.000126794 | val_loss: 0.0001241 | Time: 4210.81 ms [2020-11-24 13:49:37 main:581] : INFO : Epoch 128 | loss: 0.000121131 | val_loss: 0.000119076 | Time: 4238.79 ms [2020-11-24 13:49:41 main:581] : INFO : Epoch 129 | loss: 0.000116471 | val_loss: 0.000115717 | Time: 4091.6 ms [2020-11-24 13:49:45 main:581] : INFO : Epoch 130 | loss: 0.000111577 | val_loss: 0.000109216 | Time: 3994.57 ms [2020-11-24 13:49:49 main:581] : INFO : Epoch 131 | loss: 0.000106966 | val_loss: 0.000104798 | Time: 4298.96 ms [2020-11-24 13:49:53 main:581] : INFO : Epoch 132 | loss: 0.000102369 | val_loss: 0.000100852 | Time: 4335.77 ms [2020-11-24 13:49:58 main:581] : INFO : Epoch 133 | loss: 9.81576e-05 | val_loss: 9.63118e-05 | Time: 4269.31 ms [2020-11-24 13:50:02 main:581] : INFO : Epoch 134 | loss: 9.37553e-05 | val_loss: 9.09602e-05 | Time: 4125.36 ms [2020-11-24 13:50:06 main:581] : INFO : Epoch 135 | loss: 9.00787e-05 | val_loss: 8.81889e-05 | Time: 4319.1 ms [2020-11-24 13:50:10 main:581] : INFO : Epoch 136 | loss: 8.67003e-05 | val_loss: 8.50952e-05 | Time: 4326.67 ms [2020-11-24 13:50:15 main:581] : INFO : Epoch 137 | loss: 8.36588e-05 | val_loss: 8.14326e-05 | Time: 4635.27 ms [2020-11-24 13:50:19 main:581] : INFO : Epoch 138 | loss: 8.01528e-05 | val_loss: 7.90269e-05 | Time: 4068.54 ms [2020-11-24 13:50:24 main:581] : INFO : Epoch 139 | loss: 7.74535e-05 | val_loss: 7.4946e-05 | Time: 4352.11 ms [2020-11-24 13:50:28 main:581] : INFO : Epoch 140 | loss: 7.4435e-05 | val_loss: 7.24719e-05 | Time: 4331.05 ms [2020-11-24 13:50:33 main:581] : INFO : Epoch 141 | loss: 7.15858e-05 | val_loss: 7.12042e-05 | Time: 4902.21 ms [2020-11-24 13:50:37 main:581] : INFO : Epoch 142 | loss: 6.95761e-05 | val_loss: 6.90498e-05 | Time: 4634.05 ms [2020-11-24 13:50:42 main:581] : INFO : Epoch 143 | loss: 6.73209e-05 | val_loss: 6.71652e-05 | Time: 4972.64 ms [2020-11-24 13:50:47 main:581] : INFO : Epoch 144 | loss: 6.49919e-05 | val_loss: 6.35368e-05 | Time: 4410.4 ms [2020-11-24 13:50:51 main:581] : INFO : Epoch 145 | loss: 6.23347e-05 | val_loss: 6.3061e-05 | Time: 4182.7 ms [2020-11-24 13:50:55 main:581] : INFO : Epoch 146 | loss: 6.03932e-05 | val_loss: 5.96417e-05 | Time: 4106.67 ms [2020-11-24 13:50:59 main:581] : INFO : Epoch 147 | loss: 5.83656e-05 | val_loss: 5.85943e-05 | Time: 4279.55 ms [2020-11-24 13:51:04 main:581] : INFO : Epoch 148 | loss: 5.65671e-05 | val_loss: 5.5734e-05 | Time: 4191.52 ms [2020-11-24 13:51:07 main:581] : INFO : Epoch 149 | loss: 5.55147e-05 | val_loss: 5.33305e-05 | Time: 3974.26 ms [2020-11-24 13:51:12 main:581] : INFO : Epoch 150 | loss: 5.28145e-05 | val_loss: 5.17804e-05 | Time: 4152.26 ms [2020-11-24 13:51:16 main:581] : INFO : Epoch 151 | loss: 5.15601e-05 | val_loss: 5.19518e-05 | Time: 4334.43 ms [2020-11-24 13:51:20 main:581] : INFO : Epoch 152 | loss: 5.00535e-05 | val_loss: 4.95225e-05 | Time: 3962.35 ms [2020-11-24 13:51:24 main:581] : INFO : Epoch 153 | loss: 4.86009e-05 | val_loss: 4.70795e-05 | Time: 4247.34 ms [2020-11-24 13:51:29 main:581] : INFO : Epoch 154 | loss: 4.69571e-05 | val_loss: 4.64688e-05 | Time: 4613.14 ms [2020-11-24 13:51:33 main:581] : INFO : Epoch 155 | loss: 4.56943e-05 | val_loss: 4.45946e-05 | Time: 4532.24 ms [2020-11-24 13:51:38 main:581] : INFO : Epoch 156 | loss: 4.46339e-05 | val_loss: 4.47236e-05 | Time: 4660.99 ms [2020-11-24 13:51:43 main:581] : INFO : Epoch 157 | loss: 4.34766e-05 | val_loss: 4.27527e-05 | Time: 4562.62 ms [2020-11-24 13:51:47 main:581] : INFO : Epoch 158 | loss: 4.17754e-05 | val_loss: 4.20447e-05 | Time: 4506.22 ms [2020-11-24 13:51:52 main:581] : INFO : Epoch 159 | loss: 4.14527e-05 | val_loss: 4.04155e-05 | Time: 4597.86 ms [2020-11-24 13:51:56 main:581] : INFO : Epoch 160 | loss: 3.9528e-05 | val_loss: 3.9241e-05 | Time: 4482.64 ms [2020-11-24 13:52:01 main:581] : INFO : Epoch 161 | loss: 3.88134e-05 | val_loss: 3.85732e-05 | Time: 4617.85 ms [2020-11-24 13:52:05 main:581] : INFO : Epoch 162 | loss: 3.79444e-05 | val_loss: 3.74867e-05 | Time: 4664.76 ms [2020-11-24 13:52:10 main:581] : INFO : Epoch 163 | loss: 3.69524e-05 | val_loss: 3.58194e-05 | Time: 4526.9 ms [2020-11-24 13:52:15 main:581] : INFO : Epoch 164 | loss: 3.63031e-05 | val_loss: 3.55011e-05 | Time: 4619.74 ms [2020-11-24 13:52:19 main:581] : INFO : Epoch 165 | loss: 3.52584e-05 | val_loss: 3.43755e-05 | Time: 4488.92 ms [2020-11-24 13:52:24 main:581] : INFO : Epoch 166 | loss: 3.37077e-05 | val_loss: 3.43273e-05 | Time: 4553.46 ms [2020-11-24 13:52:28 main:581] : INFO : Epoch 167 | loss: 3.36854e-05 | val_loss: 3.36546e-05 | Time: 4587.59 ms [2020-11-24 13:52:33 main:581] : INFO : Epoch 168 | loss: 3.24995e-05 | val_loss: 3.2316e-05 | Time: 4691.41 ms [2020-11-24 13:52:38 main:581] : INFO : Epoch 169 | loss: 3.17888e-05 | val_loss: 3.10322e-05 | Time: 4604.84 ms [2020-11-24 13:52:42 main:581] : INFO : Epoch 170 | loss: 3.13002e-05 | val_loss: 3.2432e-05 | Time: 4866.22 ms [2020-11-24 13:52:47 main:581] : INFO : Epoch 171 | loss: 3.08423e-05 | val_loss: 3.02004e-05 | Time: 4813.07 ms [2020-11-24 13:52:52 main:581] : INFO : Epoch 172 | loss: 2.9567e-05 | val_loss: 2.95625e-05 | Time: 4821.47 ms [2020-11-24 13:52:57 main:581] : INFO : Epoch 173 | loss: 2.8958e-05 | val_loss: 2.91563e-05 | Time: 4814.47 ms [2020-11-24 13:53:02 main:581] : INFO : Epoch 174 | loss: 2.84186e-05 | val_loss: 3.00049e-05 | Time: 4830.92 ms [2020-11-24 13:53:07 main:581] : INFO : Epoch 175 | loss: 2.79622e-05 | val_loss: 2.79061e-05 | Time: 4848.23 ms [2020-11-24 13:53:11 main:581] : INFO : Epoch 176 | loss: 2.69248e-05 | val_loss: 2.6375e-05 | Time: 4876.57 ms [2020-11-24 13:53:16 main:581] : INFO : Epoch 177 | loss: 2.6517e-05 | val_loss: 2.76256e-05 | Time: 4900.41 ms [2020-11-24 13:53:21 main:581] : INFO : Epoch 178 | loss: 2.66537e-05 | val_loss: 2.62448e-05 | Time: 4888.39 ms [2020-11-24 13:53:26 main:581] : INFO : Epoch 179 | loss: 2.55311e-05 | val_loss: 2.5335e-05 | Time: 4886.19 ms [2020-11-24 13:53:31 main:581] : INFO : Epoch 180 | loss: 2.54118e-05 | val_loss: 2.55566e-05 | Time: 4876.45 ms [2020-11-24 13:53:36 main:581] : INFO : Epoch 181 | loss: 2.48758e-05 | val_loss: 2.45518e-05 | Time: 5227.56 ms [2020-11-24 13:53:42 main:581] : INFO : Epoch 182 | loss: 2.44596e-05 | val_loss: 2.41182e-05 | Time: 5360.98 ms [2020-11-24 13:53:47 main:581] : INFO : Epoch 183 | loss: 2.37949e-05 | val_loss: 2.30653e-05 | Time: 5133.91 ms [2020-11-24 13:53:52 main:581] : INFO : Epoch 184 | loss: 2.32832e-05 | val_loss: 2.31722e-05 | Time: 4859.2 ms [2020-11-24 13:53:56 main:581] : INFO : Epoch 185 | loss: 2.29096e-05 | val_loss: 2.24062e-05 | Time: 4819.23 ms [2020-11-24 13:54:01 main:581] : INFO : Epoch 186 | loss: 2.25012e-05 | val_loss: 2.11905e-05 | Time: 4851.07 ms [2020-11-24 13:54:06 main:581] : INFO : Epoch 187 | loss: 2.20232e-05 | val_loss: 2.33594e-05 | Time: 4860.23 ms [2020-11-24 13:54:11 main:581] : INFO : Epoch 188 | loss: 2.20218e-05 | val_loss: 2.1929e-05 | Time: 4852.18 ms [2020-11-24 13:54:16 main:581] : INFO : Epoch 189 | loss: 2.14573e-05 | val_loss: 2.07417e-05 | Time: 4825.19 ms [2020-11-24 13:54:21 main:581] : INFO : Epoch 190 | loss: 2.09743e-05 | val_loss: 2.05391e-05 | Time: 4837.15 ms [2020-11-24 13:54:25 main:581] : INFO : Epoch 191 | loss: 2.01536e-05 | val_loss: 2.07957e-05 | Time: 4812.32 ms [2020-11-24 13:54:30 main:581] : INFO : Epoch 192 | loss: 2.04383e-05 | val_loss: 2.11815e-05 | Time: 4807.6 ms [2020-11-24 13:54:30 main:604] : INFO : Saving trained model to model-final.pt, val_loss 2.11815e-05 [2020-11-24 13:54:30 main:610] : INFO : Saving end state to config to file [2020-11-24 13:54:30 main:615] : INFO : Success, exiting.. 13:54:30 (3221949): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)