Task 2830977
| Name | rand_automata_0046-1604984829-633-1_1 |
| Workunit | 1275775 |
| Created | 11 Nov 2020, 5:55:01 UTC |
| Sent | 11 Nov 2020, 5:55:31 UTC |
| Report deadline | 18 Nov 2020, 5:55:31 UTC |
| Received | 11 Nov 2020, 20:58:13 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 574 |
| Run time | 20 min 23 sec |
| CPU time | 18 min 48 sec |
| Validate state | Valid |
| Credit | 959.40 |
| Device peak FLOPS | 1,475.31 GFLOPS |
| Application version | Machine Learning Dataset Generator (test) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.41 GB |
| Peak swap size | 3.00 GB |
| Peak disk usage | 1.53 GB |
Stderr output
<core_client_version>7.16.11</core_client_version> <![CDATA[ <stderr_txt> Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 750 Ti) [2020-11-11 14:10:01 main:435] : INFO : Set logging level to 1 [2020-11-11 14:10:01 main:441] : INFO : Running in BOINC Client mode [2020-11-11 14:10:01 main:444] : INFO : Resolving all filenames [2020-11-11 14:10:01 main:452] : INFO : Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0046-train-val-dataset.hdf5 (exists = 1) [2020-11-11 14:10:01 main:452] : INFO : Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0046-1604984829-633-1_1_r1920620721_1 (exists = 0) [2020-11-11 14:10:01 main:452] : INFO : Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0046-1604984829-633-1_1_r1920620721_0 (exists = 0) [2020-11-11 14:10:02 main:452] : INFO : Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0046-1604984829-633-1 (exists = 1) [2020-11-11 14:10:02 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 0) [2020-11-11 14:10:02 main:472] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/rand_automata_0046-train-val-dataset.hdf5 [2020-11-11 14:10:02 main:474] : INFO : Configuration: [2020-11-11 14:10:02 main:475] : INFO : Model type: LSTM [2020-11-11 14:10:02 main:476] : INFO : Validation Loss Threshold: 0.0001 [2020-11-11 14:10:02 main:477] : INFO : Max Epochs: 192 [2020-11-11 14:10:02 main:478] : INFO : Batch Size: 32 [2020-11-11 14:10:02 main:479] : INFO : Learning Rate: 0.001 [2020-11-11 14:10:02 main:480] : INFO : Patience: 10 [2020-11-11 14:10:02 main:481] : INFO : Hidden Width: 64 [2020-11-11 14:10:02 main:482] : INFO : # Recurrent Layers: 4 [2020-11-11 14:10:02 main:483] : INFO : # Backend Layers: 2 [2020-11-11 14:10:02 main:484] : INFO : # Threads: 1 [2020-11-11 14:10:02 main:486] : INFO : Preparing Dataset [2020-11-11 14:10:02 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0046-train-val-dataset.hdf5 into memory [2020-11-11 14:10:02 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0046-train-val-dataset.hdf5 into memory [2020-11-11 14:10:05 load:106] : INFO : Successfully loaded dataset of 4096 examples into memory. [2020-11-11 14:10:05 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0046-train-val-dataset.hdf5 into memory [2020-11-11 14:10:05 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0046-train-val-dataset.hdf5 into memory [2020-11-11 14:10:05 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2020-11-11 14:10:05 main:494] : INFO : Creating Model [2020-11-11 14:10:05 main:507] : INFO : Preparing config file [2020-11-11 14:10:05 main:519] : INFO : Creating new config file [2020-11-11 14:10:05 main:538] : INFO : This is a continuation WU, loading previous network [2020-11-11 14:10:06 main:559] : INFO : Loading DataLoader into Memory [2020-11-11 14:10:06 main:562] : INFO : Starting Training [2020-11-11 14:10:13 main:574] : INFO : Epoch 1 | loss: 0.00012701 | val_loss: 0.000101541 | Time: 6805.53 ms [2020-11-11 14:10:20 main:574] : INFO : Epoch 2 | loss: 9.73303e-05 | val_loss: 0.000102646 | Time: 6172.52 ms [2020-11-11 14:10:26 main:574] : INFO : Epoch 3 | loss: 9.77744e-05 | val_loss: 0.000102596 | Time: 6181.01 ms [2020-11-11 14:10:32 main:574] : INFO : Epoch 4 | loss: 9.69923e-05 | val_loss: 0.000101682 | Time: 6137.91 ms [2020-11-11 14:10:38 main:574] : INFO : Epoch 5 | loss: 9.66966e-05 | val_loss: 0.000100912 | Time: 6265.93 ms [2020-11-11 14:10:45 main:574] : INFO : Epoch 6 | loss: 9.55628e-05 | val_loss: 9.97892e-05 | Time: 6128.3 ms [2020-11-11 14:10:51 main:574] : INFO : Epoch 7 | loss: 9.51202e-05 | val_loss: 9.8988e-05 | Time: 6083.95 ms [2020-11-11 14:10:57 main:574] : INFO : Epoch 8 | loss: 9.4124e-05 | val_loss: 9.71021e-05 | Time: 6113.16 ms [2020-11-11 14:11:03 main:574] : INFO : Epoch 9 | loss: 9.28039e-05 | val_loss: 9.8137e-05 | Time: 6051.17 ms [2020-11-11 14:11:09 main:574] : INFO : Epoch 10 | loss: 9.18927e-05 | val_loss: 9.47026e-05 | Time: 6048.08 ms [2020-11-11 14:11:15 main:574] : INFO : Epoch 11 | loss: 9.10073e-05 | val_loss: 9.34284e-05 | Time: 6092.44 ms [2020-11-11 14:11:21 main:574] : INFO : Epoch 12 | loss: 9.00973e-05 | val_loss: 9.40962e-05 | Time: 6002.77 ms [2020-11-11 14:11:27 main:574] : INFO : Epoch 13 | loss: 8.94035e-05 | val_loss: 9.27497e-05 | Time: 6179.06 ms [2020-11-11 14:11:34 main:574] : INFO : Epoch 14 | loss: 8.79754e-05 | val_loss: 9.18185e-05 | Time: 6162.58 ms [2020-11-11 14:11:40 main:574] : INFO : Epoch 15 | loss: 8.71433e-05 | val_loss: 9.04623e-05 | Time: 6089.3 ms [2020-11-11 14:11:46 main:574] : INFO : Epoch 16 | loss: 8.59683e-05 | val_loss: 9.09169e-05 | Time: 6107.64 ms [2020-11-11 14:11:52 main:574] : INFO : Epoch 17 | loss: 8.54823e-05 | val_loss: 8.88065e-05 | Time: 6074.68 ms [2020-11-11 14:11:58 main:574] : INFO : Epoch 18 | loss: 8.39548e-05 | val_loss: 8.70026e-05 | Time: 6029.5 ms [2020-11-11 14:12:04 main:574] : INFO : Epoch 19 | loss: 8.3032e-05 | val_loss: 8.67534e-05 | Time: 6099.64 ms [2020-11-11 14:12:10 main:574] : INFO : Epoch 20 | loss: 8.24285e-05 | val_loss: 8.61949e-05 | Time: 5939.79 ms [2020-11-11 14:12:16 main:574] : INFO : Epoch 21 | loss: 8.12966e-05 | val_loss: 8.67477e-05 | Time: 5993.5 ms [2020-11-11 14:12:22 main:574] : INFO : Epoch 22 | loss: 8.07504e-05 | val_loss: 8.40061e-05 | Time: 6048.87 ms [2020-11-11 14:12:29 main:574] : INFO : Epoch 23 | loss: 7.96871e-05 | val_loss: 8.47368e-05 | Time: 6156.87 ms [2020-11-11 14:12:35 main:574] : INFO : Epoch 24 | loss: 7.87433e-05 | val_loss: 8.16382e-05 | Time: 5975.75 ms [2020-11-11 14:12:41 main:574] : INFO : Epoch 25 | loss: 7.77574e-05 | val_loss: 8.17424e-05 | Time: 6304.87 ms [2020-11-11 14:12:47 main:574] : INFO : Epoch 26 | loss: 7.71356e-05 | val_loss: 8.03046e-05 | Time: 6188.36 ms [2020-11-11 14:12:53 main:574] : INFO : Epoch 27 | loss: 7.66333e-05 | val_loss: 8.06288e-05 | Time: 6045 ms [2020-11-11 14:12:59 main:574] : INFO : Epoch 28 | loss: 7.53784e-05 | val_loss: 7.82166e-05 | Time: 5937.99 ms [2020-11-11 14:13:05 main:574] : INFO : Epoch 29 | loss: 7.47273e-05 | val_loss: 7.73892e-05 | Time: 6043.71 ms [2020-11-11 14:13:12 main:574] : INFO : Epoch 30 | loss: 7.39125e-05 | val_loss: 7.79082e-05 | Time: 6104.56 ms [2020-11-11 14:13:18 main:574] : INFO : Epoch 31 | loss: 7.32736e-05 | val_loss: 7.6258e-05 | Time: 6049.62 ms [2020-11-11 14:13:24 main:574] : INFO : Epoch 32 | loss: 7.29341e-05 | val_loss: 7.69868e-05 | Time: 6094.68 ms [2020-11-11 14:13:30 main:574] : INFO : Epoch 33 | loss: 7.22126e-05 | val_loss: 7.45689e-05 | Time: 6304.95 ms [2020-11-11 14:13:36 main:574] : INFO : Epoch 34 | loss: 7.13781e-05 | val_loss: 7.42091e-05 | Time: 6203.73 ms [2020-11-11 14:13:43 main:574] : INFO : Epoch 35 | loss: 7.0585e-05 | val_loss: 7.496e-05 | Time: 6076.52 ms [2020-11-11 14:13:49 main:574] : INFO : Epoch 36 | loss: 7.01892e-05 | val_loss: 7.2125e-05 | Time: 6270.09 ms [2020-11-11 14:13:55 main:574] : INFO : Epoch 37 | loss: 6.95887e-05 | val_loss: 7.16154e-05 | Time: 6211.71 ms [2020-11-11 14:14:01 main:574] : INFO : Epoch 38 | loss: 6.86734e-05 | val_loss: 7.14349e-05 | Time: 5995.41 ms [2020-11-11 14:14:07 main:574] : INFO : Epoch 39 | loss: 6.77833e-05 | val_loss: 7.11676e-05 | Time: 6074.2 ms [2020-11-11 14:14:13 main:574] : INFO : Epoch 40 | loss: 6.73261e-05 | val_loss: 7.03865e-05 | Time: 5944.15 ms [2020-11-11 14:14:20 main:574] : INFO : Epoch 41 | loss: 6.68465e-05 | val_loss: 7.01332e-05 | Time: 6248.9 ms [2020-11-11 14:14:26 main:574] : INFO : Epoch 42 | loss: 6.59275e-05 | val_loss: 6.94036e-05 | Time: 5954.04 ms [2020-11-11 14:14:32 main:574] : INFO : Epoch 43 | loss: 6.56423e-05 | val_loss: 6.79906e-05 | Time: 6027.27 ms [2020-11-11 14:14:38 main:574] : INFO : Epoch 44 | loss: 6.52186e-05 | val_loss: 6.81655e-05 | Time: 6096.71 ms [2020-11-11 14:14:44 main:574] : INFO : Epoch 45 | loss: 6.42704e-05 | val_loss: 6.81316e-05 | Time: 6227.01 ms [2020-11-11 14:14:50 main:574] : INFO : Epoch 46 | loss: 6.38183e-05 | val_loss: 6.64349e-05 | Time: 6062.16 ms [2020-11-11 14:14:57 main:574] : INFO : Epoch 47 | loss: 6.3471e-05 | val_loss: 6.51939e-05 | Time: 6232.11 ms [2020-11-11 14:15:03 main:574] : INFO : Epoch 48 | loss: 6.24817e-05 | val_loss: 6.55062e-05 | Time: 6187.42 ms [2020-11-11 14:15:09 main:574] : INFO : Epoch 49 | loss: 6.25302e-05 | val_loss: 6.45709e-05 | Time: 6064.08 ms [2020-11-11 14:15:15 main:574] : INFO : Epoch 50 | loss: 6.17855e-05 | val_loss: 6.4064e-05 | Time: 6266.29 ms [2020-11-11 14:15:21 main:574] : INFO : Epoch 51 | loss: 6.14999e-05 | val_loss: 6.47518e-05 | Time: 6102.57 ms [2020-11-11 14:15:28 main:574] : INFO : Epoch 52 | loss: 6.10294e-05 | val_loss: 6.37322e-05 | Time: 6141.94 ms [2020-11-11 14:15:34 main:574] : INFO : Epoch 53 | loss: 6.04808e-05 | val_loss: 6.41124e-05 | Time: 6030.18 ms [2020-11-11 14:15:40 main:574] : INFO : Epoch 54 | loss: 5.98696e-05 | val_loss: 6.29207e-05 | Time: 5979.82 ms [2020-11-11 14:15:46 main:574] : INFO : Epoch 55 | loss: 5.94697e-05 | val_loss: 6.26184e-05 | Time: 6220.85 ms [2020-11-11 14:15:52 main:574] : INFO : Epoch 56 | loss: 5.87255e-05 | val_loss: 6.14438e-05 | Time: 6064.36 ms [2020-11-11 14:15:58 main:574] : INFO : Epoch 57 | loss: 5.82436e-05 | val_loss: 6.14526e-05 | Time: 6024.66 ms [2020-11-11 14:16:04 main:574] : INFO : Epoch 58 | loss: 5.80726e-05 | val_loss: 5.99742e-05 | Time: 5997.72 ms [2020-11-11 14:16:10 main:574] : INFO : Epoch 59 | loss: 5.75191e-05 | val_loss: 6.025e-05 | Time: 6153.85 ms [2020-11-11 14:16:17 main:574] : INFO : Epoch 60 | loss: 5.70701e-05 | val_loss: 5.93959e-05 | Time: 6155.48 ms [2020-11-11 14:16:23 main:574] : INFO : Epoch 61 | loss: 5.68649e-05 | val_loss: 6.09669e-05 | Time: 6042.82 ms [2020-11-11 14:16:29 main:574] : INFO : Epoch 62 | loss: 5.61554e-05 | val_loss: 5.91403e-05 | Time: 6032.29 ms [2020-11-11 14:16:35 main:574] : INFO : Epoch 63 | loss: 5.57124e-05 | val_loss: 5.75748e-05 | Time: 5856.98 ms [2020-11-11 14:16:41 main:574] : INFO : Epoch 64 | loss: 5.53624e-05 | val_loss: 5.76619e-05 | Time: 5965.94 ms [2020-11-11 14:16:47 main:574] : INFO : Epoch 65 | loss: 5.49503e-05 | val_loss: 5.75085e-05 | Time: 5968.97 ms [2020-11-11 14:16:53 main:574] : INFO : Epoch 66 | loss: 5.46443e-05 | val_loss: 5.72669e-05 | Time: 6361.08 ms [2020-11-11 14:16:59 main:574] : INFO : Epoch 67 | loss: 5.39343e-05 | val_loss: 5.66162e-05 | Time: 5838.07 ms [2020-11-11 14:17:05 main:574] : INFO : Epoch 68 | loss: 5.36448e-05 | val_loss: 5.51217e-05 | Time: 6280.79 ms [2020-11-11 14:17:12 main:574] : INFO : Epoch 69 | loss: 5.29777e-05 | val_loss: 5.51605e-05 | Time: 6704.06 ms [2020-11-11 14:17:18 main:574] : INFO : Epoch 70 | loss: 5.26593e-05 | val_loss: 5.59066e-05 | Time: 6260.47 ms [2020-11-11 14:17:25 main:574] : INFO : Epoch 71 | loss: 5.25333e-05 | val_loss: 5.47349e-05 | Time: 6143.15 ms [2020-11-11 14:17:31 main:574] : INFO : Epoch 72 | loss: 5.24493e-05 | val_loss: 5.57617e-05 | Time: 6423.04 ms [2020-11-11 14:17:37 main:574] : INFO : Epoch 73 | loss: 5.21952e-05 | val_loss: 5.62174e-05 | Time: 6217.55 ms [2020-11-11 14:17:44 main:574] : INFO : Epoch 74 | loss: 5.16324e-05 | val_loss: 5.31543e-05 | Time: 6145.2 ms [2020-11-11 14:17:50 main:574] : INFO : Epoch 75 | loss: 5.1002e-05 | val_loss: 5.30371e-05 | Time: 6134.72 ms [2020-11-11 14:17:56 main:574] : INFO : Epoch 76 | loss: 5.08418e-05 | val_loss: 5.30836e-05 | Time: 6171.92 ms [2020-11-11 14:18:02 main:574] : INFO : Epoch 77 | loss: 5.03385e-05 | val_loss: 5.21827e-05 | Time: 6253.7 ms [2020-11-11 14:18:08 main:574] : INFO : Epoch 78 | loss: 4.99294e-05 | val_loss: 5.22697e-05 | Time: 5994.81 ms [2020-11-11 14:18:15 main:574] : INFO : Epoch 79 | loss: 4.98406e-05 | val_loss: 5.2059e-05 | Time: 6272.73 ms [2020-11-11 14:18:21 main:574] : INFO : Epoch 80 | loss: 4.95296e-05 | val_loss: 5.18046e-05 | Time: 6194.79 ms [2020-11-11 14:18:27 main:574] : INFO : Epoch 81 | loss: 4.90197e-05 | val_loss: 5.20602e-05 | Time: 6397.56 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 750 Ti) [2020-11-11 14:48:07 main:435] : INFO : Set logging level to 1 [2020-11-11 14:48:07 main:441] : INFO : Running in BOINC Client mode [2020-11-11 14:48:07 main:444] : INFO : Resolving all filenames [2020-11-11 14:48:07 main:452] : INFO : Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0046-train-val-dataset.hdf5 (exists = 1) [2020-11-11 14:48:07 main:452] : INFO : Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0046-1604984829-633-1_1_r1920620721_1 (exists = 1) [2020-11-11 14:48:07 main:452] : INFO : Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0046-1604984829-633-1_1_r1920620721_0 (exists = 0) [2020-11-11 14:48:07 main:452] : INFO : Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0046-1604984829-633-1 (exists = 1) [2020-11-11 14:48:07 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 0) [2020-11-11 14:48:07 main:472] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/rand_automata_0046-train-val-dataset.hdf5 [2020-11-11 14:48:07 main:474] : INFO : Configuration: [2020-11-11 14:48:07 main:475] : INFO : Model type: LSTM [2020-11-11 14:48:07 main:476] : INFO : Validation Loss Threshold: 0.0001 [2020-11-11 14:48:07 main:477] : INFO : Max Epochs: 192 [2020-11-11 14:48:07 main:478] : INFO : Batch Size: 32 [2020-11-11 14:48:07 main:479] : INFO : Learning Rate: 0.001 [2020-11-11 14:48:07 main:480] : INFO : Patience: 10 [2020-11-11 14:48:07 main:481] : INFO : Hidden Width: 64 [2020-11-11 14:48:07 main:482] : INFO : # Recurrent Layers: 4 [2020-11-11 14:48:07 main:483] : INFO : # Backend Layers: 2 [2020-11-11 14:48:07 main:484] : INFO : # Threads: 1 [2020-11-11 14:48:07 main:486] : INFO : Preparing Dataset [2020-11-11 14:48:07 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0046-train-val-dataset.hdf5 into memory [2020-11-11 14:48:08 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0046-train-val-dataset.hdf5 into memory [2020-11-11 14:48:10 load:106] : INFO : Successfully loaded dataset of 4096 examples into memory. [2020-11-11 14:48:10 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0046-train-val-dataset.hdf5 into memory [2020-11-11 14:48:10 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0046-train-val-dataset.hdf5 into memory [2020-11-11 14:48:10 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2020-11-11 14:48:10 main:494] : INFO : Creating Model [2020-11-11 14:48:10 main:507] : INFO : Preparing config file [2020-11-11 14:48:10 main:519] : INFO : Creating new config file [2020-11-11 14:48:10 main:538] : INFO : This is a continuation WU, loading previous network [2020-11-11 14:48:11 main:559] : INFO : Loading DataLoader into Memory [2020-11-11 14:48:11 main:562] : INFO : Starting Training [2020-11-11 14:48:17 main:574] : INFO : Epoch 1 | loss: 0.000128196 | val_loss: 0.00010188 | Time: 6046.25 ms [2020-11-11 14:48:23 main:574] : INFO : Epoch 2 | loss: 9.71302e-05 | val_loss: 0.000102545 | Time: 5651.51 ms [2020-11-11 14:48:29 main:574] : INFO : Epoch 3 | loss: 9.73883e-05 | val_loss: 0.000102205 | Time: 5591.21 ms [2020-11-11 14:48:34 main:574] : INFO : Epoch 4 | loss: 9.73323e-05 | val_loss: 0.000100663 | Time: 5543.95 ms [2020-11-11 14:48:40 main:574] : INFO : Epoch 5 | loss: 9.658e-05 | val_loss: 0.00010191 | Time: 5588.86 ms [2020-11-11 14:48:45 main:574] : INFO : Epoch 6 | loss: 9.59022e-05 | val_loss: 0.000100263 | Time: 5566.4 ms [2020-11-11 14:48:51 main:574] : INFO : Epoch 7 | loss: 9.48258e-05 | val_loss: 9.83263e-05 | Time: 5643.74 ms [2020-11-11 14:48:57 main:574] : INFO : Epoch 8 | loss: 9.39294e-05 | val_loss: 9.80459e-05 | Time: 5528.86 ms [2020-11-11 14:49:02 main:574] : INFO : Epoch 9 | loss: 9.29957e-05 | val_loss: 9.75234e-05 | Time: 5569.82 ms [2020-11-11 14:49:08 main:574] : INFO : Epoch 10 | loss: 9.18888e-05 | val_loss: 9.79218e-05 | Time: 5617.41 ms [2020-11-11 14:49:14 main:574] : INFO : Epoch 11 | loss: 9.14611e-05 | val_loss: 9.50491e-05 | Time: 5720.96 ms [2020-11-11 14:49:19 main:574] : INFO : Epoch 12 | loss: 9.01009e-05 | val_loss: 9.37929e-05 | Time: 5538.58 ms [2020-11-11 14:49:25 main:574] : INFO : Epoch 13 | loss: 8.94833e-05 | val_loss: 9.29857e-05 | Time: 5631.06 ms [2020-11-11 14:49:31 main:574] : INFO : Epoch 14 | loss: 8.79519e-05 | val_loss: 9.10432e-05 | Time: 5536.11 ms [2020-11-11 14:49:36 main:574] : INFO : Epoch 15 | loss: 8.69563e-05 | val_loss: 9.02512e-05 | Time: 5653 ms [2020-11-11 14:49:42 main:574] : INFO : Epoch 16 | loss: 8.62224e-05 | val_loss: 8.92747e-05 | Time: 5575.08 ms [2020-11-11 14:49:48 main:574] : INFO : Epoch 17 | loss: 8.50415e-05 | val_loss: 8.75734e-05 | Time: 5573.62 ms [2020-11-11 14:49:53 main:574] : INFO : Epoch 18 | loss: 8.4219e-05 | val_loss: 8.75503e-05 | Time: 5639.48 ms [2020-11-11 14:49:59 main:574] : INFO : Epoch 19 | loss: 8.34036e-05 | val_loss: 8.60979e-05 | Time: 5707.91 ms [2020-11-11 14:50:05 main:574] : INFO : Epoch 20 | loss: 8.26875e-05 | val_loss: 8.64209e-05 | Time: 5587.54 ms [2020-11-11 14:50:10 main:574] : INFO : Epoch 21 | loss: 8.16238e-05 | val_loss: 8.46695e-05 | Time: 5595.17 ms [2020-11-11 14:50:16 main:574] : INFO : Epoch 22 | loss: 8.03976e-05 | val_loss: 8.38035e-05 | Time: 5687.29 ms [2020-11-11 14:50:22 main:574] : INFO : Epoch 23 | loss: 7.96885e-05 | val_loss: 8.19771e-05 | Time: 6010.31 ms [2020-11-11 14:50:28 main:574] : INFO : Epoch 24 | loss: 7.88762e-05 | val_loss: 8.14699e-05 | Time: 5760.11 ms [2020-11-11 14:50:33 main:574] : INFO : Epoch 25 | loss: 7.80322e-05 | val_loss: 8.03367e-05 | Time: 5522.94 ms [2020-11-11 14:50:39 main:574] : INFO : Epoch 26 | loss: 7.72374e-05 | val_loss: 8.03212e-05 | Time: 5629.06 ms [2020-11-11 14:50:45 main:574] : INFO : Epoch 27 | loss: 7.67973e-05 | val_loss: 7.93011e-05 | Time: 5547.69 ms [2020-11-11 14:50:50 main:574] : INFO : Epoch 28 | loss: 7.52918e-05 | val_loss: 8.01592e-05 | Time: 5656.51 ms [2020-11-11 14:50:56 main:574] : INFO : Epoch 29 | loss: 7.4758e-05 | val_loss: 7.78807e-05 | Time: 5663.78 ms [2020-11-11 14:51:02 main:574] : INFO : Epoch 30 | loss: 7.38807e-05 | val_loss: 7.82748e-05 | Time: 5609.32 ms [2020-11-11 14:51:07 main:574] : INFO : Epoch 31 | loss: 7.34371e-05 | val_loss: 7.70386e-05 | Time: 5623.24 ms [2020-11-11 14:51:13 main:574] : INFO : Epoch 32 | loss: 7.27307e-05 | val_loss: 7.53874e-05 | Time: 5725.1 ms [2020-11-11 14:51:19 main:574] : INFO : Epoch 33 | loss: 7.20134e-05 | val_loss: 7.55094e-05 | Time: 5625.12 ms [2020-11-11 14:51:25 main:574] : INFO : Epoch 34 | loss: 7.15642e-05 | val_loss: 7.54522e-05 | Time: 5622.3 ms [2020-11-11 14:51:30 main:574] : INFO : Epoch 35 | loss: 7.06643e-05 | val_loss: 7.52997e-05 | Time: 5677.93 ms [2020-11-11 14:51:36 main:574] : INFO : Epoch 36 | loss: 7.00496e-05 | val_loss: 7.27355e-05 | Time: 5627.19 ms [2020-11-11 14:51:42 main:574] : INFO : Epoch 37 | loss: 6.90615e-05 | val_loss: 7.20093e-05 | Time: 5708.52 ms [2020-11-11 14:51:47 main:574] : INFO : Epoch 38 | loss: 6.90436e-05 | val_loss: 7.18807e-05 | Time: 5541.25 ms [2020-11-11 14:51:53 main:574] : INFO : Epoch 39 | loss: 6.82638e-05 | val_loss: 7.07216e-05 | Time: 5711.62 ms [2020-11-11 14:51:59 main:574] : INFO : Epoch 40 | loss: 6.73836e-05 | val_loss: 6.94461e-05 | Time: 5612.03 ms [2020-11-11 14:52:05 main:574] : INFO : Epoch 41 | loss: 6.65259e-05 | val_loss: 6.90027e-05 | Time: 5675.35 ms [2020-11-11 14:52:10 main:574] : INFO : Epoch 42 | loss: 6.63377e-05 | val_loss: 6.81608e-05 | Time: 5608.06 ms [2020-11-11 14:52:16 main:574] : INFO : Epoch 43 | loss: 6.53859e-05 | val_loss: 6.95897e-05 | Time: 5690.95 ms [2020-11-11 14:52:21 main:574] : INFO : Epoch 44 | loss: 6.51033e-05 | val_loss: 6.7625e-05 | Time: 5539.11 ms [2020-11-11 14:52:27 main:574] : INFO : Epoch 45 | loss: 6.45505e-05 | val_loss: 6.79463e-05 | Time: 5664.78 ms [2020-11-11 14:52:33 main:574] : INFO : Epoch 46 | loss: 6.39152e-05 | val_loss: 6.64135e-05 | Time: 5625.02 ms [2020-11-11 14:52:39 main:574] : INFO : Epoch 47 | loss: 6.29859e-05 | val_loss: 6.56675e-05 | Time: 5636.57 ms [2020-11-11 14:52:44 main:574] : INFO : Epoch 48 | loss: 6.29346e-05 | val_loss: 6.53831e-05 | Time: 5819.33 ms [2020-11-11 14:52:50 main:574] : INFO : Epoch 49 | loss: 6.23809e-05 | val_loss: 6.46303e-05 | Time: 5642.46 ms [2020-11-11 14:52:56 main:574] : INFO : Epoch 50 | loss: 6.22736e-05 | val_loss: 6.50379e-05 | Time: 5637.55 ms [2020-11-11 14:53:01 main:574] : INFO : Epoch 51 | loss: 6.12047e-05 | val_loss: 6.35937e-05 | Time: 5579.71 ms [2020-11-11 14:53:07 main:574] : INFO : Epoch 52 | loss: 6.11394e-05 | val_loss: 6.4452e-05 | Time: 5667.56 ms [2020-11-11 14:53:13 main:574] : INFO : Epoch 53 | loss: 6.02667e-05 | val_loss: 6.29717e-05 | Time: 5669.85 ms [2020-11-11 14:53:18 main:574] : INFO : Epoch 54 | loss: 5.97548e-05 | val_loss: 6.27234e-05 | Time: 5533.89 ms [2020-11-11 14:53:24 main:574] : INFO : Epoch 55 | loss: 5.98787e-05 | val_loss: 6.17949e-05 | Time: 5631.09 ms [2020-11-11 14:53:30 main:574] : INFO : Epoch 56 | loss: 5.86131e-05 | val_loss: 6.05923e-05 | Time: 5607.78 ms [2020-11-11 14:53:35 main:574] : INFO : Epoch 57 | loss: 5.88566e-05 | val_loss: 6.15409e-05 | Time: 5627.22 ms [2020-11-11 14:53:41 main:574] : INFO : Epoch 58 | loss: 5.79326e-05 | val_loss: 6.0185e-05 | Time: 5606.34 ms [2020-11-11 14:53:47 main:574] : INFO : Epoch 59 | loss: 5.72855e-05 | val_loss: 5.89688e-05 | Time: 5608.8 ms [2020-11-11 14:53:52 main:574] : INFO : Epoch 60 | loss: 5.69765e-05 | val_loss: 6.01038e-05 | Time: 5553.96 ms [2020-11-11 14:53:58 main:574] : INFO : Epoch 61 | loss: 5.66371e-05 | val_loss: 5.96538e-05 | Time: 5589.6 ms [2020-11-11 14:54:04 main:574] : INFO : Epoch 62 | loss: 5.63039e-05 | val_loss: 5.83738e-05 | Time: 5572.18 ms [2020-11-11 14:54:09 main:574] : INFO : Epoch 63 | loss: 5.56981e-05 | val_loss: 5.86683e-05 | Time: 5568.27 ms [2020-11-11 14:54:15 main:574] : INFO : Epoch 64 | loss: 5.53399e-05 | val_loss: 5.77177e-05 | Time: 5580.46 ms [2020-11-11 14:54:21 main:574] : INFO : Epoch 65 | loss: 5.4818e-05 | val_loss: 5.74592e-05 | Time: 5667.19 ms [2020-11-11 14:54:26 main:574] : INFO : Epoch 66 | loss: 5.46901e-05 | val_loss: 5.64086e-05 | Time: 5680.03 ms [2020-11-11 14:54:32 main:574] : INFO : Epoch 67 | loss: 5.38577e-05 | val_loss: 5.68838e-05 | Time: 5579.47 ms [2020-11-11 14:54:38 main:574] : INFO : Epoch 68 | loss: 5.41149e-05 | val_loss: 5.72425e-05 | Time: 5698.07 ms [2020-11-11 14:54:43 main:574] : INFO : Epoch 69 | loss: 5.35238e-05 | val_loss: 5.65828e-05 | Time: 5581.89 ms [2020-11-11 14:54:49 main:574] : INFO : Epoch 70 | loss: 5.29323e-05 | val_loss: 5.62079e-05 | Time: 5503.44 ms [2020-11-11 14:54:55 main:574] : INFO : Epoch 71 | loss: 5.23206e-05 | val_loss: 5.48362e-05 | Time: 5622.41 ms [2020-11-11 14:55:00 main:574] : INFO : Epoch 72 | loss: 5.22207e-05 | val_loss: 5.46223e-05 | Time: 5696.8 ms [2020-11-11 14:55:06 main:574] : INFO : Epoch 73 | loss: 5.16734e-05 | val_loss: 5.51861e-05 | Time: 5603.69 ms [2020-11-11 14:55:12 main:574] : INFO : Epoch 74 | loss: 5.15392e-05 | val_loss: 5.47774e-05 | Time: 5572.64 ms [2020-11-11 14:55:18 main:574] : INFO : Epoch 75 | loss: 5.13786e-05 | val_loss: 5.37031e-05 | Time: 5879.04 ms [2020-11-11 14:55:23 main:574] : INFO : Epoch 76 | loss: 5.07033e-05 | val_loss: 5.37506e-05 | Time: 5708.11 ms [2020-11-11 14:55:29 main:574] : INFO : Epoch 77 | loss: 5.0341e-05 | val_loss: 5.23344e-05 | Time: 5675.4 ms [2020-11-11 14:55:35 main:574] : INFO : Epoch 78 | loss: 5.01543e-05 | val_loss: 5.27051e-05 | Time: 5664.56 ms [2020-11-11 14:55:41 main:574] : INFO : Epoch 79 | loss: 4.97082e-05 | val_loss: 5.2051e-05 | Time: 5721.48 ms [2020-11-11 14:55:46 main:574] : INFO : Epoch 80 | loss: 4.9338e-05 | val_loss: 5.12044e-05 | Time: 5696.76 ms [2020-11-11 14:55:52 main:574] : INFO : Epoch 81 | loss: 4.90372e-05 | val_loss: 5.04084e-05 | Time: 5619.55 ms [2020-11-11 14:55:58 main:574] : INFO : Epoch 82 | loss: 4.84713e-05 | val_loss: 5.12659e-05 | Time: 5570.69 ms [2020-11-11 14:56:03 main:574] : INFO : Epoch 83 | loss: 4.83749e-05 | val_loss: 5.08212e-05 | Time: 5707.64 ms [2020-11-11 14:56:09 main:574] : INFO : Epoch 84 | loss: 4.82799e-05 | val_loss: 5.00315e-05 | Time: 5560.72 ms [2020-11-11 14:56:15 main:574] : INFO : Epoch 85 | loss: 4.78329e-05 | val_loss: 4.96253e-05 | Time: 5627.42 ms [2020-11-11 14:56:20 main:574] : INFO : Epoch 86 | loss: 4.73364e-05 | val_loss: 5.06766e-05 | Time: 5620.65 ms [2020-11-11 14:56:26 main:574] : INFO : Epoch 87 | loss: 4.71373e-05 | val_loss: 4.88411e-05 | Time: 5662.55 ms [2020-11-11 14:56:32 main:574] : INFO : Epoch 88 | loss: 4.7074e-05 | val_loss: 4.83845e-05 | Time: 5614.3 ms [2020-11-11 14:56:37 main:574] : INFO : Epoch 89 | loss: 4.61562e-05 | val_loss: 4.83716e-05 | Time: 5695.84 ms [2020-11-11 14:56:43 main:574] : INFO : Epoch 90 | loss: 4.60421e-05 | val_loss: 4.75806e-05 | Time: 5514.22 ms [2020-11-11 14:56:49 main:574] : INFO : Epoch 91 | loss: 4.60384e-05 | val_loss: 4.88757e-05 | Time: 5618.19 ms [2020-11-11 14:56:54 main:574] : INFO : Epoch 92 | loss: 4.5715e-05 | val_loss: 4.73131e-05 | Time: 5646.8 ms [2020-11-11 14:57:00 main:574] : INFO : Epoch 93 | loss: 4.54728e-05 | val_loss: 4.71905e-05 | Time: 5660.98 ms [2020-11-11 14:57:06 main:574] : INFO : Epoch 94 | loss: 4.50257e-05 | val_loss: 4.72889e-05 | Time: 5722.83 ms [2020-11-11 14:57:11 main:574] : INFO : Epoch 95 | loss: 4.47407e-05 | val_loss: 4.72438e-05 | Time: 5675.85 ms [2020-11-11 14:57:17 main:574] : INFO : Epoch 96 | loss: 4.46615e-05 | val_loss: 4.67449e-05 | Time: 5727.75 ms [2020-11-11 14:57:23 main:574] : INFO : Epoch 97 | loss: 4.42983e-05 | val_loss: 4.58102e-05 | Time: 5953.21 ms [2020-11-11 14:57:29 main:574] : INFO : Epoch 98 | loss: 4.38901e-05 | val_loss: 4.58269e-05 | Time: 5667.01 ms [2020-11-11 14:57:35 main:574] : INFO : Epoch 99 | loss: 4.39614e-05 | val_loss: 4.58718e-05 | Time: 5574.97 ms [2020-11-11 14:57:40 main:574] : INFO : Epoch 100 | loss: 4.32435e-05 | val_loss: 4.58326e-05 | Time: 5598.21 ms [2020-11-11 14:57:46 main:574] : INFO : Epoch 101 | loss: 4.30066e-05 | val_loss: 4.49963e-05 | Time: 5565.7 ms [2020-11-11 14:57:52 main:574] : INFO : Epoch 102 | loss: 4.30199e-05 | val_loss: 4.52697e-05 | Time: 5603 ms [2020-11-11 14:57:57 main:574] : INFO : Epoch 103 | loss: 4.25057e-05 | val_loss: 4.48888e-05 | Time: 5603.93 ms [2020-11-11 14:58:03 main:574] : INFO : Epoch 104 | loss: 4.24149e-05 | val_loss: 4.53682e-05 | Time: 5755.4 ms [2020-11-11 14:58:09 main:574] : INFO : Epoch 105 | loss: 4.20981e-05 | val_loss: 4.4291e-05 | Time: 5663.55 ms [2020-11-11 14:58:14 main:574] : INFO : Epoch 106 | loss: 4.20703e-05 | val_loss: 4.36923e-05 | Time: 5617.08 ms [2020-11-11 14:58:20 main:574] : INFO : Epoch 107 | loss: 4.16858e-05 | val_loss: 4.32532e-05 | Time: 5552.95 ms [2020-11-11 14:58:26 main:574] : INFO : Epoch 108 | loss: 4.13432e-05 | val_loss: 4.394e-05 | Time: 5806.53 ms [2020-11-11 14:58:31 main:574] : INFO : Epoch 109 | loss: 4.13948e-05 | val_loss: 4.29705e-05 | Time: 5564.42 ms [2020-11-11 14:58:37 main:574] : INFO : Epoch 110 | loss: 4.12237e-05 | val_loss: 4.27982e-05 | Time: 5452.88 ms [2020-11-11 14:58:43 main:574] : INFO : Epoch 111 | loss: 4.07995e-05 | val_loss: 4.30113e-05 | Time: 5577.42 ms [2020-11-11 14:58:48 main:574] : INFO : Epoch 112 | loss: 4.02519e-05 | val_loss: 4.21682e-05 | Time: 5569.35 ms [2020-11-11 14:58:54 main:574] : INFO : Epoch 113 | loss: 4.03109e-05 | val_loss: 4.22939e-05 | Time: 5667.52 ms [2020-11-11 14:59:00 main:574] : INFO : Epoch 114 | loss: 3.98214e-05 | val_loss: 4.21219e-05 | Time: 5752.9 ms [2020-11-11 14:59:05 main:574] : INFO : Epoch 115 | loss: 3.9854e-05 | val_loss: 4.26626e-05 | Time: 5632.69 ms [2020-11-11 14:59:11 main:574] : INFO : Epoch 116 | loss: 3.9769e-05 | val_loss: 4.15237e-05 | Time: 5657.16 ms [2020-11-11 14:59:17 main:574] : INFO : Epoch 117 | loss: 3.93297e-05 | val_loss: 4.12879e-05 | Time: 5608.02 ms [2020-11-11 14:59:22 main:574] : INFO : Epoch 118 | loss: 3.91884e-05 | val_loss: 4.11646e-05 | Time: 5665.77 ms [2020-11-11 14:59:28 main:574] : INFO : Epoch 119 | loss: 3.88203e-05 | val_loss: 4.03708e-05 | Time: 5639.78 ms [2020-11-11 14:59:34 main:574] : INFO : Epoch 120 | loss: 3.84868e-05 | val_loss: 4.10453e-05 | Time: 5581.82 ms [2020-11-11 14:59:39 main:574] : INFO : Epoch 121 | loss: 3.86205e-05 | val_loss: 3.99969e-05 | Time: 5612.97 ms [2020-11-11 14:59:45 main:574] : INFO : Epoch 122 | loss: 3.82526e-05 | val_loss: 4.0425e-05 | Time: 5614.74 ms [2020-11-11 14:59:51 main:574] : INFO : Epoch 123 | loss: 3.82119e-05 | val_loss: 4.03114e-05 | Time: 5600.99 ms [2020-11-11 14:59:56 main:574] : INFO : Epoch 124 | loss: 3.79494e-05 | val_loss: 4.16267e-05 | Time: 5638.74 ms [2020-11-11 15:00:02 main:574] : INFO : Epoch 125 | loss: 3.81379e-05 | val_loss: 4.09019e-05 | Time: 5602.65 ms [2020-11-11 15:00:08 main:574] : INFO : Epoch 126 | loss: 3.70733e-05 | val_loss: 3.97903e-05 | Time: 5525.94 ms [2020-11-11 15:00:13 main:574] : INFO : Epoch 127 | loss: 3.70842e-05 | val_loss: 3.92289e-05 | Time: 5624.01 ms [2020-11-11 15:00:19 main:574] : INFO : Epoch 128 | loss: 3.67119e-05 | val_loss: 3.91414e-05 | Time: 5581.2 ms [2020-11-11 15:00:25 main:574] : INFO : Epoch 129 | loss: 3.73028e-05 | val_loss: 3.95712e-05 | Time: 5678.69 ms [2020-11-11 15:00:30 main:574] : INFO : Epoch 130 | loss: 3.68796e-05 | val_loss: 3.87805e-05 | Time: 5633.7 ms [2020-11-11 15:00:36 main:574] : INFO : Epoch 131 | loss: 3.64168e-05 | val_loss: 3.79243e-05 | Time: 5706.43 ms [2020-11-11 15:00:42 main:574] : INFO : Epoch 132 | loss: 3.62265e-05 | val_loss: 3.89981e-05 | Time: 5643.36 ms [2020-11-11 15:00:47 main:574] : INFO : Epoch 133 | loss: 3.60078e-05 | val_loss: 3.75818e-05 | Time: 5538.29 ms [2020-11-11 15:00:53 main:574] : INFO : Epoch 134 | loss: 3.61774e-05 | val_loss: 3.81703e-05 | Time: 5590.49 ms [2020-11-11 15:00:59 main:574] : INFO : Epoch 135 | loss: 3.58426e-05 | val_loss: 3.84176e-05 | Time: 5663.42 ms [2020-11-11 15:01:05 main:574] : INFO : Epoch 136 | loss: 3.56506e-05 | val_loss: 3.7604e-05 | Time: 5701.85 ms [2020-11-11 15:01:10 main:574] : INFO : Epoch 137 | loss: 3.54459e-05 | val_loss: 3.71156e-05 | Time: 5564.22 ms [2020-11-11 15:01:16 main:574] : INFO : Epoch 138 | loss: 3.51939e-05 | val_loss: 3.7181e-05 | Time: 5653.35 ms [2020-11-11 15:01:22 main:574] : INFO : Epoch 139 | loss: 3.49949e-05 | val_loss: 3.74188e-05 | Time: 5547.28 ms [2020-11-11 15:01:27 main:574] : INFO : Epoch 140 | loss: 3.47291e-05 | val_loss: 3.6798e-05 | Time: 5557 ms [2020-11-11 15:01:33 main:574] : INFO : Epoch 141 | loss: 3.51839e-05 | val_loss: 3.64085e-05 | Time: 5560.34 ms [2020-11-11 15:01:38 main:574] : INFO : Epoch 142 | loss: 3.43375e-05 | val_loss: 3.64506e-05 | Time: 5594.04 ms [2020-11-11 15:01:44 main:574] : INFO : Epoch 143 | loss: 3.41854e-05 | val_loss: 3.57995e-05 | Time: 5590.95 ms [2020-11-11 15:01:50 main:574] : INFO : Epoch 144 | loss: 3.42862e-05 | val_loss: 3.50803e-05 | Time: 5625.93 ms [2020-11-11 15:01:55 main:574] : INFO : Epoch 145 | loss: 3.39385e-05 | val_loss: 3.62456e-05 | Time: 5664.07 ms [2020-11-11 15:02:01 main:574] : INFO : Epoch 146 | loss: 3.38303e-05 | val_loss: 3.59138e-05 | Time: 5673.83 ms [2020-11-11 15:02:07 main:574] : INFO : Epoch 147 | loss: 3.35018e-05 | val_loss: 3.52493e-05 | Time: 5593.49 ms [2020-11-11 15:02:12 main:574] : INFO : Epoch 148 | loss: 3.36579e-05 | val_loss: 3.51543e-05 | Time: 5544.45 ms [2020-11-11 15:02:18 main:574] : INFO : Epoch 149 | loss: 3.3233e-05 | val_loss: 3.51019e-05 | Time: 5612.98 ms [2020-11-11 15:02:24 main:574] : INFO : Epoch 150 | loss: 3.31509e-05 | val_loss: 3.55147e-05 | Time: 5604.06 ms [2020-11-11 15:02:29 main:574] : INFO : Epoch 151 | loss: 3.28091e-05 | val_loss: 3.49822e-05 | Time: 5521.35 ms [2020-11-11 15:02:35 main:574] : INFO : Epoch 152 | loss: 3.28051e-05 | val_loss: 3.54931e-05 | Time: 5633.1 ms [2020-11-11 15:02:41 main:574] : INFO : Epoch 153 | loss: 3.30126e-05 | val_loss: 3.56676e-05 | Time: 5614.17 ms [2020-11-11 15:02:46 main:574] : INFO : Epoch 154 | loss: 3.26049e-05 | val_loss: 3.44182e-05 | Time: 5626.35 ms [2020-11-11 15:02:52 main:574] : INFO : Epoch 155 | loss: 3.25415e-05 | val_loss: 3.49592e-05 | Time: 5649.05 ms [2020-11-11 15:02:58 main:574] : INFO : Epoch 156 | loss: 3.23318e-05 | val_loss: 3.48859e-05 | Time: 5582.73 ms [2020-11-11 15:03:03 main:574] : INFO : Epoch 157 | loss: 3.19588e-05 | val_loss: 3.38182e-05 | Time: 5856.22 ms [2020-11-11 15:03:09 main:574] : INFO : Epoch 158 | loss: 3.24419e-05 | val_loss: 3.34258e-05 | Time: 5560.1 ms [2020-11-11 15:03:15 main:574] : INFO : Epoch 159 | loss: 3.1569e-05 | val_loss: 3.34755e-05 | Time: 5580.46 ms [2020-11-11 15:03:20 main:574] : INFO : Epoch 160 | loss: 3.15288e-05 | val_loss: 3.23977e-05 | Time: 5656.32 ms [2020-11-11 15:03:26 main:574] : INFO : Epoch 161 | loss: 3.14588e-05 | val_loss: 3.30151e-05 | Time: 5573.21 ms [2020-11-11 15:03:32 main:574] : INFO : Epoch 162 | loss: 3.13368e-05 | val_loss: 3.2184e-05 | Time: 5637.77 ms [2020-11-11 15:03:37 main:574] : INFO : Epoch 163 | loss: 3.11706e-05 | val_loss: 3.26065e-05 | Time: 5640.99 ms [2020-11-11 15:03:43 main:574] : INFO : Epoch 164 | loss: 3.10826e-05 | val_loss: 3.31506e-05 | Time: 5565.07 ms [2020-11-11 15:03:49 main:574] : INFO : Epoch 165 | loss: 3.07878e-05 | val_loss: 3.29998e-05 | Time: 5699.56 ms [2020-11-11 15:03:54 main:574] : INFO : Epoch 166 | loss: 3.08295e-05 | val_loss: 3.27864e-05 | Time: 5592.3 ms [2020-11-11 15:04:00 main:574] : INFO : Epoch 167 | loss: 3.05448e-05 | val_loss: 3.18423e-05 | Time: 5591.88 ms [2020-11-11 15:04:06 main:574] : INFO : Epoch 168 | loss: 3.06369e-05 | val_loss: 3.22845e-05 | Time: 5554.24 ms [2020-11-11 15:04:11 main:574] : INFO : Epoch 169 | loss: 3.04004e-05 | val_loss: 3.2038e-05 | Time: 5682.64 ms [2020-11-11 15:04:17 main:574] : INFO : Epoch 170 | loss: 3.01525e-05 | val_loss: 3.23345e-05 | Time: 5589.04 ms [2020-11-11 15:04:23 main:574] : INFO : Epoch 171 | loss: 3.04212e-05 | val_loss: 3.23457e-05 | Time: 5569.47 ms [2020-11-11 15:04:29 main:574] : INFO : Epoch 172 | loss: 2.96048e-05 | val_loss: 3.12325e-05 | Time: 6238.69 ms [2020-11-11 15:04:35 main:574] : INFO : Epoch 173 | loss: 2.98012e-05 | val_loss: 3.13867e-05 | Time: 5690.22 ms [2020-11-11 15:04:41 main:574] : INFO : Epoch 174 | loss: 2.98022e-05 | val_loss: 3.20428e-05 | Time: 5718.84 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 750 Ti) [2020-11-11 21:54:30 main:435] : INFO : Set logging level to 1 [2020-11-11 21:54:30 main:441] : INFO : Running in BOINC Client mode [2020-11-11 21:54:31 main:444] : INFO : Resolving all filenames [2020-11-11 21:54:31 main:452] : INFO : Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0046-train-val-dataset.hdf5 (exists = 1) [2020-11-11 21:54:31 main:452] : INFO : Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0046-1604984829-633-1_1_r1920620721_1 (exists = 1) [2020-11-11 21:54:31 main:452] : INFO : Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0046-1604984829-633-1_1_r1920620721_0 (exists = 0) [2020-11-11 21:54:31 main:452] : INFO : Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0046-1604984829-633-1 (exists = 1) [2020-11-11 21:54:31 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2020-11-11 21:54:31 main:472] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/rand_automata_0046-train-val-dataset.hdf5 [2020-11-11 21:54:31 main:474] : INFO : Configuration: [2020-11-11 21:54:31 main:475] : INFO : Model type: LSTM [2020-11-11 21:54:31 main:476] : INFO : Validation Loss Threshold: 0.0001 [2020-11-11 21:54:31 main:477] : INFO : Max Epochs: 192 [2020-11-11 21:54:31 main:478] : INFO : Batch Size: 32 [2020-11-11 21:54:31 main:479] : INFO : Learning Rate: 0.001 [2020-11-11 21:54:31 main:480] : INFO : Patience: 10 [2020-11-11 21:54:32 main:481] : INFO : Hidden Width: 64 [2020-11-11 21:54:32 main:482] : INFO : # Recurrent Layers: 4 [2020-11-11 21:54:32 main:483] : INFO : # Backend Layers: 2 [2020-11-11 21:54:32 main:484] : INFO : # Threads: 1 [2020-11-11 21:54:32 main:486] : INFO : Preparing Dataset [2020-11-11 21:54:32 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0046-train-val-dataset.hdf5 into memory [2020-11-11 21:54:33 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0046-train-val-dataset.hdf5 into memory [2020-11-11 21:54:56 load:106] : INFO : Successfully loaded dataset of 4096 examples into memory. [2020-11-11 21:54:56 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0046-train-val-dataset.hdf5 into memory [2020-11-11 21:54:56 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0046-train-val-dataset.hdf5 into memory [2020-11-11 21:54:56 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2020-11-11 21:54:56 main:494] : INFO : Creating Model [2020-11-11 21:54:56 main:507] : INFO : Preparing config file [2020-11-11 21:54:57 main:511] : INFO : Found checkpoint, attempting to load... [2020-11-11 21:54:57 main:512] : INFO : Loading config [2020-11-11 21:54:57 main:514] : INFO : Loading state [2020-11-11 21:55:09 main:559] : INFO : Loading DataLoader into Memory [2020-11-11 21:55:09 main:562] : INFO : Starting Training [2020-11-11 21:55:23 main:574] : INFO : Epoch 174 | loss: 5.32747e-05 | val_loss: 2.79797e-05 | Time: 12988 ms [2020-11-11 21:55:31 main:574] : INFO : Epoch 175 | loss: 2.6565e-05 | val_loss: 2.92447e-05 | Time: 8396.89 ms [2020-11-11 21:55:39 main:574] : INFO : Epoch 176 | loss: 2.71232e-05 | val_loss: 2.9126e-05 | Time: 8373.28 ms [2020-11-11 21:55:48 main:574] : INFO : Epoch 177 | loss: 2.75931e-05 | val_loss: 3.04348e-05 | Time: 8125.96 ms [2020-11-11 21:55:56 main:574] : INFO : Epoch 178 | loss: 2.80871e-05 | val_loss: 2.98233e-05 | Time: 8173.43 ms [2020-11-11 21:56:05 main:574] : INFO : Epoch 179 | loss: 2.80325e-05 | val_loss: 2.99548e-05 | Time: 8552.27 ms [2020-11-11 21:56:13 main:574] : INFO : Epoch 180 | loss: 2.84749e-05 | val_loss: 3.08595e-05 | Time: 8259.81 ms [2020-11-11 21:56:21 main:574] : INFO : Epoch 181 | loss: 2.85175e-05 | val_loss: 3.02116e-05 | Time: 8055.96 ms [2020-11-11 21:56:30 main:574] : INFO : Epoch 182 | loss: 2.83809e-05 | val_loss: 2.95988e-05 | Time: 8551.67 ms [2020-11-11 21:56:39 main:574] : INFO : Epoch 183 | loss: 2.82041e-05 | val_loss: 3.11712e-05 | Time: 8753.56 ms [2020-11-11 21:56:47 main:574] : INFO : Epoch 184 | loss: 2.83965e-05 | val_loss: 3.02007e-05 | Time: 8225.81 ms [2020-11-11 21:56:56 main:574] : INFO : Epoch 185 | loss: 2.8496e-05 | val_loss: 2.95975e-05 | Time: 8378.1 ms [2020-11-11 21:57:04 main:574] : INFO : Epoch 186 | loss: 2.85387e-05 | val_loss: 2.93734e-05 | Time: 8243.82 ms [2020-11-11 21:57:12 main:574] : INFO : Epoch 187 | loss: 2.80783e-05 | val_loss: 3.0008e-05 | Time: 8246.99 ms [2020-11-11 21:57:21 main:574] : INFO : Epoch 188 | loss: 2.82858e-05 | val_loss: 3.01905e-05 | Time: 8410.01 ms [2020-11-11 21:57:29 main:574] : INFO : Epoch 189 | loss: 2.83015e-05 | val_loss: 2.9847e-05 | Time: 8149.27 ms [2020-11-11 21:57:37 main:574] : INFO : Epoch 190 | loss: 2.81742e-05 | val_loss: 3.02241e-05 | Time: 8174.42 ms [2020-11-11 21:57:46 main:574] : INFO : Epoch 191 | loss: 2.76613e-05 | val_loss: 3.03964e-05 | Time: 8059.44 ms [2020-11-11 21:57:54 main:574] : INFO : Epoch 192 | loss: 2.78021e-05 | val_loss: 2.89074e-05 | Time: 8062.79 ms [2020-11-11 21:57:54 main:597] : INFO : Saving trained model to model-final.pt, val_loss 2.89074e-05 [2020-11-11 21:57:54 main:603] : INFO : Saving end state to config to file [2020-11-11 21:57:54 main:608] : INFO : Success, exiting.. 21:57:54 (17248): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)