Task 2858960

Name rand_automata_0053-1604983220-29495-1_0
Workunit 1289603
Created 11 Nov 2020, 12:09:08 UTC
Sent 11 Nov 2020, 12:09:08 UTC
Report deadline 18 Nov 2020, 12:09:08 UTC
Received 11 Nov 2020, 21:24:55 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 574
Run time 26 min 3 sec
CPU time 25 min 31 sec
Validate state Valid
Credit 959.40
Device peak FLOPS 1,475.31 GFLOPS
Application version Machine Learning Dataset Generator (test) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.41 GB
Peak swap size 3.00 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.11</core_client_version>
<![CDATA[
<stderr_txt>
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 750 Ti)
[2020-11-11 21:58:44	                main:435]	:	INFO	:	Set logging level to 1
[2020-11-11 21:58:44	                main:441]	:	INFO	:	Running in BOINC Client mode
[2020-11-11 21:58:44	                main:444]	:	INFO	:	Resolving all filenames
[2020-11-11 21:58:44	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0053-train-val-dataset.hdf5 (exists = 1)
[2020-11-11 21:58:44	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0053-1604983220-29495-1_0_r2119379236_1 (exists = 0)
[2020-11-11 21:58:44	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0053-1604983220-29495-1_0_r2119379236_0 (exists = 0)
[2020-11-11 21:58:44	                main:452]	:	INFO	:	Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0053-1604983220-29495-1 (exists = 1)
[2020-11-11 21:58:44	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2020-11-11 21:58:44	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/rand_automata_0053-train-val-dataset.hdf5
[2020-11-11 21:58:44	                main:474]	:	INFO	:	Configuration: 
[2020-11-11 21:58:44	                main:475]	:	INFO	:	    Model type: LSTM
[2020-11-11 21:58:44	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2020-11-11 21:58:44	                main:477]	:	INFO	:	    Max Epochs: 192
[2020-11-11 21:58:44	                main:478]	:	INFO	:	    Batch Size: 32
[2020-11-11 21:58:44	                main:479]	:	INFO	:	    Learning Rate: 0.001
[2020-11-11 21:58:44	                main:480]	:	INFO	:	    Patience: 10
[2020-11-11 21:58:44	                main:481]	:	INFO	:	    Hidden Width: 64
[2020-11-11 21:58:44	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2020-11-11 21:58:44	                main:483]	:	INFO	:	    # Backend Layers: 2
[2020-11-11 21:58:44	                main:484]	:	INFO	:	    # Threads: 1
[2020-11-11 21:58:44	                main:486]	:	INFO	:	Preparing Dataset
[2020-11-11 21:58:45	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0053-train-val-dataset.hdf5 into memory
[2020-11-11 21:58:45	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0053-train-val-dataset.hdf5 into memory
[2020-11-11 21:58:48	                load:106]	:	INFO	:	Successfully loaded dataset of 4096 examples into memory.
[2020-11-11 21:58:48	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0053-train-val-dataset.hdf5 into memory
[2020-11-11 21:58:48	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0053-train-val-dataset.hdf5 into memory
[2020-11-11 21:58:48	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2020-11-11 21:58:48	                main:494]	:	INFO	:	Creating Model
[2020-11-11 21:58:48	                main:507]	:	INFO	:	Preparing config file
[2020-11-11 21:58:48	                main:519]	:	INFO	:	Creating new config file
[2020-11-11 21:58:48	                main:538]	:	INFO	:	This is a continuation WU, loading previous network
[2020-11-11 21:58:49	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2020-11-11 21:58:50	                main:562]	:	INFO	:	Starting Training
[2020-11-11 21:58:58	                main:574]	:	INFO	:	Epoch 1 | loss: 0.000139199 | val_loss: 0.000107811 | Time: 8612.48 ms
[2020-11-11 21:59:07	                main:574]	:	INFO	:	Epoch 2 | loss: 0.000105648 | val_loss: 0.000109199 | Time: 8152.59 ms
[2020-11-11 21:59:15	                main:574]	:	INFO	:	Epoch 3 | loss: 0.000106277 | val_loss: 0.000110909 | Time: 8073.47 ms
[2020-11-11 21:59:23	                main:574]	:	INFO	:	Epoch 4 | loss: 0.00010619 | val_loss: 0.000108475 | Time: 8081.98 ms
[2020-11-11 21:59:31	                main:574]	:	INFO	:	Epoch 5 | loss: 0.000105618 | val_loss: 0.000108017 | Time: 7979.38 ms
[2020-11-11 21:59:39	                main:574]	:	INFO	:	Epoch 6 | loss: 0.000104892 | val_loss: 0.000107012 | Time: 7958.73 ms
[2020-11-11 21:59:47	                main:574]	:	INFO	:	Epoch 7 | loss: 0.000104278 | val_loss: 0.000108014 | Time: 8054.89 ms
[2020-11-11 21:59:55	                main:574]	:	INFO	:	Epoch 8 | loss: 0.000103238 | val_loss: 0.000105577 | Time: 7963.79 ms
[2020-11-11 22:00:03	                main:574]	:	INFO	:	Epoch 9 | loss: 0.000101823 | val_loss: 0.000104356 | Time: 8085.49 ms
[2020-11-11 22:00:11	                main:574]	:	INFO	:	Epoch 10 | loss: 0.000101334 | val_loss: 0.000103237 | Time: 8110.5 ms
[2020-11-11 22:00:19	                main:574]	:	INFO	:	Epoch 11 | loss: 0.000100468 | val_loss: 0.000102133 | Time: 8029.22 ms
[2020-11-11 22:00:27	                main:574]	:	INFO	:	Epoch 12 | loss: 9.90826e-05 | val_loss: 0.000103394 | Time: 7979.37 ms
[2020-11-11 22:00:35	                main:574]	:	INFO	:	Epoch 13 | loss: 9.83643e-05 | val_loss: 0.00010202 | Time: 8086.17 ms
[2020-11-11 22:00:44	                main:574]	:	INFO	:	Epoch 14 | loss: 9.80978e-05 | val_loss: 0.000103452 | Time: 8042.09 ms
[2020-11-11 22:00:52	                main:574]	:	INFO	:	Epoch 15 | loss: 9.65308e-05 | val_loss: 9.85027e-05 | Time: 8022.91 ms
[2020-11-11 22:01:00	                main:574]	:	INFO	:	Epoch 16 | loss: 9.55099e-05 | val_loss: 9.83615e-05 | Time: 8013.74 ms
[2020-11-11 22:01:08	                main:574]	:	INFO	:	Epoch 17 | loss: 9.51158e-05 | val_loss: 9.71181e-05 | Time: 8028.78 ms
[2020-11-11 22:01:16	                main:574]	:	INFO	:	Epoch 18 | loss: 9.34146e-05 | val_loss: 9.6578e-05 | Time: 7948.13 ms
[2020-11-11 22:01:24	                main:574]	:	INFO	:	Epoch 19 | loss: 9.31755e-05 | val_loss: 9.65346e-05 | Time: 8021.88 ms
[2020-11-11 22:01:32	                main:574]	:	INFO	:	Epoch 20 | loss: 9.20462e-05 | val_loss: 9.34305e-05 | Time: 8100.52 ms
[2020-11-11 22:01:40	                main:574]	:	INFO	:	Epoch 21 | loss: 9.13069e-05 | val_loss: 9.31178e-05 | Time: 8325.76 ms
[2020-11-11 22:01:49	                main:574]	:	INFO	:	Epoch 22 | loss: 9.0083e-05 | val_loss: 9.20911e-05 | Time: 8051.72 ms
[2020-11-11 22:01:57	                main:574]	:	INFO	:	Epoch 23 | loss: 8.9414e-05 | val_loss: 9.13004e-05 | Time: 8094.74 ms
[2020-11-11 22:02:05	                main:574]	:	INFO	:	Epoch 24 | loss: 8.89264e-05 | val_loss: 9.25736e-05 | Time: 8106 ms
[2020-11-11 22:02:13	                main:574]	:	INFO	:	Epoch 25 | loss: 8.80873e-05 | val_loss: 9.12803e-05 | Time: 8033.34 ms
[2020-11-11 22:02:21	                main:574]	:	INFO	:	Epoch 26 | loss: 8.71329e-05 | val_loss: 9.03497e-05 | Time: 8006.37 ms
[2020-11-11 22:02:29	                main:574]	:	INFO	:	Epoch 27 | loss: 8.62055e-05 | val_loss: 8.90098e-05 | Time: 8101.76 ms
[2020-11-11 22:02:37	                main:574]	:	INFO	:	Epoch 28 | loss: 8.53854e-05 | val_loss: 8.7899e-05 | Time: 8049.21 ms
[2020-11-11 22:02:45	                main:574]	:	INFO	:	Epoch 29 | loss: 8.46673e-05 | val_loss: 8.85082e-05 | Time: 8007.31 ms
[2020-11-11 22:02:53	                main:574]	:	INFO	:	Epoch 30 | loss: 8.43691e-05 | val_loss: 8.82235e-05 | Time: 7978.37 ms
[2020-11-11 22:03:02	                main:574]	:	INFO	:	Epoch 31 | loss: 8.3772e-05 | val_loss: 8.80492e-05 | Time: 8107.21 ms
[2020-11-11 22:03:10	                main:574]	:	INFO	:	Epoch 32 | loss: 8.28336e-05 | val_loss: 8.45082e-05 | Time: 8068.23 ms
[2020-11-11 22:03:18	                main:574]	:	INFO	:	Epoch 33 | loss: 8.20223e-05 | val_loss: 8.45661e-05 | Time: 8102.02 ms
[2020-11-11 22:03:26	                main:574]	:	INFO	:	Epoch 34 | loss: 8.14101e-05 | val_loss: 8.58419e-05 | Time: 8035.6 ms
[2020-11-11 22:03:34	                main:574]	:	INFO	:	Epoch 35 | loss: 8.07499e-05 | val_loss: 8.46916e-05 | Time: 7990.45 ms
[2020-11-11 22:03:42	                main:574]	:	INFO	:	Epoch 36 | loss: 8.01483e-05 | val_loss: 8.63749e-05 | Time: 8055.1 ms
[2020-11-11 22:03:50	                main:574]	:	INFO	:	Epoch 37 | loss: 7.91611e-05 | val_loss: 8.27087e-05 | Time: 7976.32 ms
[2020-11-11 22:03:58	                main:574]	:	INFO	:	Epoch 38 | loss: 7.91943e-05 | val_loss: 8.18435e-05 | Time: 7968.75 ms
[2020-11-11 22:04:06	                main:574]	:	INFO	:	Epoch 39 | loss: 7.87173e-05 | val_loss: 8.1401e-05 | Time: 8128.55 ms
[2020-11-11 22:04:14	                main:574]	:	INFO	:	Epoch 40 | loss: 7.70721e-05 | val_loss: 8.13023e-05 | Time: 8008.42 ms
[2020-11-11 22:04:22	                main:574]	:	INFO	:	Epoch 41 | loss: 7.70354e-05 | val_loss: 7.97668e-05 | Time: 7929.61 ms
[2020-11-11 22:04:30	                main:574]	:	INFO	:	Epoch 42 | loss: 7.59594e-05 | val_loss: 7.78588e-05 | Time: 7921.46 ms
[2020-11-11 22:04:38	                main:574]	:	INFO	:	Epoch 43 | loss: 7.56743e-05 | val_loss: 7.9505e-05 | Time: 8016.85 ms
[2020-11-11 22:04:46	                main:574]	:	INFO	:	Epoch 44 | loss: 7.55844e-05 | val_loss: 7.75397e-05 | Time: 7997.71 ms
[2020-11-11 22:04:54	                main:574]	:	INFO	:	Epoch 45 | loss: 7.46801e-05 | val_loss: 7.84426e-05 | Time: 7974.41 ms
[2020-11-11 22:05:03	                main:574]	:	INFO	:	Epoch 46 | loss: 7.36419e-05 | val_loss: 7.65525e-05 | Time: 8073.39 ms
[2020-11-11 22:05:11	                main:574]	:	INFO	:	Epoch 47 | loss: 7.34992e-05 | val_loss: 7.50849e-05 | Time: 7959.79 ms
[2020-11-11 22:05:19	                main:574]	:	INFO	:	Epoch 48 | loss: 7.26794e-05 | val_loss: 7.52324e-05 | Time: 8141.7 ms
[2020-11-11 22:05:27	                main:574]	:	INFO	:	Epoch 49 | loss: 7.21482e-05 | val_loss: 7.4401e-05 | Time: 8117.74 ms
[2020-11-11 22:05:35	                main:574]	:	INFO	:	Epoch 50 | loss: 7.16808e-05 | val_loss: 7.3939e-05 | Time: 8081.88 ms
[2020-11-11 22:05:43	                main:574]	:	INFO	:	Epoch 51 | loss: 7.08588e-05 | val_loss: 7.29371e-05 | Time: 8130.62 ms
[2020-11-11 22:05:51	                main:574]	:	INFO	:	Epoch 52 | loss: 7.06613e-05 | val_loss: 7.53626e-05 | Time: 8013.08 ms
[2020-11-11 22:05:59	                main:574]	:	INFO	:	Epoch 53 | loss: 7.00567e-05 | val_loss: 7.37071e-05 | Time: 8090.61 ms
[2020-11-11 22:06:08	                main:574]	:	INFO	:	Epoch 54 | loss: 6.95301e-05 | val_loss: 7.21736e-05 | Time: 8096.91 ms
[2020-11-11 22:06:16	                main:574]	:	INFO	:	Epoch 55 | loss: 6.90332e-05 | val_loss: 7.18644e-05 | Time: 8034.94 ms
[2020-11-11 22:06:24	                main:574]	:	INFO	:	Epoch 56 | loss: 6.86041e-05 | val_loss: 7.10379e-05 | Time: 8021.4 ms
[2020-11-11 22:06:32	                main:574]	:	INFO	:	Epoch 57 | loss: 6.81754e-05 | val_loss: 7.1243e-05 | Time: 8124.86 ms
[2020-11-11 22:06:40	                main:574]	:	INFO	:	Epoch 58 | loss: 6.75483e-05 | val_loss: 6.9482e-05 | Time: 8086.35 ms
[2020-11-11 22:06:48	                main:574]	:	INFO	:	Epoch 59 | loss: 6.72087e-05 | val_loss: 6.83415e-05 | Time: 7979.62 ms
[2020-11-11 22:06:56	                main:574]	:	INFO	:	Epoch 60 | loss: 6.67496e-05 | val_loss: 7.01208e-05 | Time: 8070.18 ms
[2020-11-11 22:07:04	                main:574]	:	INFO	:	Epoch 61 | loss: 6.594e-05 | val_loss: 6.7536e-05 | Time: 8076.53 ms
[2020-11-11 22:07:12	                main:574]	:	INFO	:	Epoch 62 | loss: 6.59742e-05 | val_loss: 6.82027e-05 | Time: 8009.41 ms
[2020-11-11 22:07:20	                main:574]	:	INFO	:	Epoch 63 | loss: 6.49256e-05 | val_loss: 6.73759e-05 | Time: 8016.15 ms
[2020-11-11 22:07:29	                main:574]	:	INFO	:	Epoch 64 | loss: 6.46687e-05 | val_loss: 6.82977e-05 | Time: 8015 ms
[2020-11-11 22:07:37	                main:574]	:	INFO	:	Epoch 65 | loss: 6.43039e-05 | val_loss: 6.62726e-05 | Time: 7972.51 ms
[2020-11-11 22:07:45	                main:574]	:	INFO	:	Epoch 66 | loss: 6.35293e-05 | val_loss: 6.58498e-05 | Time: 8080.7 ms
[2020-11-11 22:07:53	                main:574]	:	INFO	:	Epoch 67 | loss: 6.35267e-05 | val_loss: 6.68366e-05 | Time: 8037.32 ms
[2020-11-11 22:08:01	                main:574]	:	INFO	:	Epoch 68 | loss: 6.32666e-05 | val_loss: 6.7731e-05 | Time: 8043.49 ms
[2020-11-11 22:08:09	                main:574]	:	INFO	:	Epoch 69 | loss: 6.25565e-05 | val_loss: 6.52463e-05 | Time: 8096.54 ms
[2020-11-11 22:08:17	                main:574]	:	INFO	:	Epoch 70 | loss: 6.2173e-05 | val_loss: 6.44396e-05 | Time: 8028.99 ms
[2020-11-11 22:08:25	                main:574]	:	INFO	:	Epoch 71 | loss: 6.15035e-05 | val_loss: 6.41379e-05 | Time: 8071.5 ms
[2020-11-11 22:08:33	                main:574]	:	INFO	:	Epoch 72 | loss: 6.13387e-05 | val_loss: 6.44056e-05 | Time: 7979.62 ms
[2020-11-11 22:08:42	                main:574]	:	INFO	:	Epoch 73 | loss: 6.11757e-05 | val_loss: 6.43668e-05 | Time: 8384.48 ms
[2020-11-11 22:08:50	                main:574]	:	INFO	:	Epoch 74 | loss: 6.06307e-05 | val_loss: 6.25671e-05 | Time: 8368.27 ms
[2020-11-11 22:08:59	                main:574]	:	INFO	:	Epoch 75 | loss: 6.00391e-05 | val_loss: 6.35631e-05 | Time: 8450.13 ms
[2020-11-11 22:09:07	                main:574]	:	INFO	:	Epoch 76 | loss: 5.95411e-05 | val_loss: 6.24402e-05 | Time: 8200.37 ms
[2020-11-11 22:09:15	                main:574]	:	INFO	:	Epoch 77 | loss: 5.96524e-05 | val_loss: 6.05825e-05 | Time: 7857.35 ms
[2020-11-11 22:09:23	                main:574]	:	INFO	:	Epoch 78 | loss: 5.86241e-05 | val_loss: 6.07383e-05 | Time: 7954.67 ms
[2020-11-11 22:09:31	                main:574]	:	INFO	:	Epoch 79 | loss: 5.86239e-05 | val_loss: 6.04287e-05 | Time: 7882.45 ms
[2020-11-11 22:09:39	                main:574]	:	INFO	:	Epoch 80 | loss: 5.80517e-05 | val_loss: 6.05396e-05 | Time: 8020.83 ms
[2020-11-11 22:09:47	                main:574]	:	INFO	:	Epoch 81 | loss: 5.80099e-05 | val_loss: 5.99372e-05 | Time: 7908.19 ms
[2020-11-11 22:09:55	                main:574]	:	INFO	:	Epoch 82 | loss: 5.73417e-05 | val_loss: 5.92767e-05 | Time: 7929.28 ms
[2020-11-11 22:10:03	                main:574]	:	INFO	:	Epoch 83 | loss: 5.73571e-05 | val_loss: 5.86338e-05 | Time: 7952.36 ms
[2020-11-11 22:10:11	                main:574]	:	INFO	:	Epoch 84 | loss: 5.64912e-05 | val_loss: 5.87799e-05 | Time: 8000.52 ms
[2020-11-11 22:10:19	                main:574]	:	INFO	:	Epoch 85 | loss: 5.64132e-05 | val_loss: 6.02566e-05 | Time: 8113.08 ms
[2020-11-11 22:10:27	                main:574]	:	INFO	:	Epoch 86 | loss: 5.62005e-05 | val_loss: 5.79267e-05 | Time: 8011.34 ms
[2020-11-11 22:10:36	                main:574]	:	INFO	:	Epoch 87 | loss: 5.58092e-05 | val_loss: 5.83709e-05 | Time: 7998.02 ms
[2020-11-11 22:10:44	                main:574]	:	INFO	:	Epoch 88 | loss: 5.54449e-05 | val_loss: 5.77347e-05 | Time: 8120.34 ms
[2020-11-11 22:10:52	                main:574]	:	INFO	:	Epoch 89 | loss: 5.4814e-05 | val_loss: 5.79133e-05 | Time: 8012.77 ms
[2020-11-11 22:11:00	                main:574]	:	INFO	:	Epoch 90 | loss: 5.52721e-05 | val_loss: 5.70232e-05 | Time: 7963.14 ms
[2020-11-11 22:11:08	                main:574]	:	INFO	:	Epoch 91 | loss: 5.48377e-05 | val_loss: 5.75172e-05 | Time: 8073.27 ms
[2020-11-11 22:11:16	                main:574]	:	INFO	:	Epoch 92 | loss: 5.38963e-05 | val_loss: 5.6271e-05 | Time: 7995.7 ms
[2020-11-11 22:11:24	                main:574]	:	INFO	:	Epoch 93 | loss: 5.36273e-05 | val_loss: 5.68559e-05 | Time: 8022.73 ms
[2020-11-11 22:11:32	                main:574]	:	INFO	:	Epoch 94 | loss: 5.31448e-05 | val_loss: 5.57459e-05 | Time: 8051.47 ms
[2020-11-11 22:11:40	                main:574]	:	INFO	:	Epoch 95 | loss: 5.29374e-05 | val_loss: 5.46789e-05 | Time: 7927.51 ms
[2020-11-11 22:11:48	                main:574]	:	INFO	:	Epoch 96 | loss: 5.30829e-05 | val_loss: 5.57561e-05 | Time: 7999.81 ms
[2020-11-11 22:11:56	                main:574]	:	INFO	:	Epoch 97 | loss: 5.26673e-05 | val_loss: 5.49401e-05 | Time: 8023.55 ms
[2020-11-11 22:12:04	                main:574]	:	INFO	:	Epoch 98 | loss: 5.20445e-05 | val_loss: 5.55495e-05 | Time: 8015.25 ms
[2020-11-11 22:12:12	                main:574]	:	INFO	:	Epoch 99 | loss: 5.2296e-05 | val_loss: 5.4631e-05 | Time: 8009.12 ms
[2020-11-11 22:12:20	                main:574]	:	INFO	:	Epoch 100 | loss: 5.18498e-05 | val_loss: 5.36485e-05 | Time: 7991.23 ms
[2020-11-11 22:12:28	                main:574]	:	INFO	:	Epoch 101 | loss: 5.1422e-05 | val_loss: 5.32629e-05 | Time: 8002 ms
[2020-11-11 22:12:36	                main:574]	:	INFO	:	Epoch 102 | loss: 5.07946e-05 | val_loss: 5.35257e-05 | Time: 7939.08 ms
[2020-11-11 22:12:44	                main:574]	:	INFO	:	Epoch 103 | loss: 5.05954e-05 | val_loss: 5.31786e-05 | Time: 7854.75 ms
[2020-11-11 22:12:52	                main:574]	:	INFO	:	Epoch 104 | loss: 5.04543e-05 | val_loss: 5.33817e-05 | Time: 8086.52 ms
[2020-11-11 22:13:00	                main:574]	:	INFO	:	Epoch 105 | loss: 5.02062e-05 | val_loss: 5.22799e-05 | Time: 7980.27 ms
[2020-11-11 22:13:08	                main:574]	:	INFO	:	Epoch 106 | loss: 4.97527e-05 | val_loss: 5.12405e-05 | Time: 7884.69 ms
[2020-11-11 22:13:16	                main:574]	:	INFO	:	Epoch 107 | loss: 4.93553e-05 | val_loss: 5.12712e-05 | Time: 7930.23 ms
[2020-11-11 22:13:24	                main:574]	:	INFO	:	Epoch 108 | loss: 4.91527e-05 | val_loss: 5.188e-05 | Time: 7930.15 ms
[2020-11-11 22:13:32	                main:574]	:	INFO	:	Epoch 109 | loss: 4.95285e-05 | val_loss: 5.26291e-05 | Time: 7900.22 ms
[2020-11-11 22:13:40	                main:574]	:	INFO	:	Epoch 110 | loss: 4.88251e-05 | val_loss: 5.14559e-05 | Time: 7956.11 ms
[2020-11-11 22:13:48	                main:574]	:	INFO	:	Epoch 111 | loss: 4.88156e-05 | val_loss: 5.25577e-05 | Time: 7916.63 ms
[2020-11-11 22:13:56	                main:574]	:	INFO	:	Epoch 112 | loss: 4.81977e-05 | val_loss: 5.05861e-05 | Time: 7990.38 ms
[2020-11-11 22:14:04	                main:574]	:	INFO	:	Epoch 113 | loss: 4.81804e-05 | val_loss: 5.16765e-05 | Time: 7911.97 ms
[2020-11-11 22:14:12	                main:574]	:	INFO	:	Epoch 114 | loss: 4.7752e-05 | val_loss: 4.94949e-05 | Time: 8023.76 ms
[2020-11-11 22:14:20	                main:574]	:	INFO	:	Epoch 115 | loss: 4.74327e-05 | val_loss: 4.90682e-05 | Time: 7999.03 ms
[2020-11-11 22:14:28	                main:574]	:	INFO	:	Epoch 116 | loss: 4.74797e-05 | val_loss: 5.02315e-05 | Time: 7964.35 ms
[2020-11-11 22:14:36	                main:574]	:	INFO	:	Epoch 117 | loss: 4.68368e-05 | val_loss: 5.04387e-05 | Time: 7955.49 ms
[2020-11-11 22:14:44	                main:574]	:	INFO	:	Epoch 118 | loss: 4.67999e-05 | val_loss: 4.95374e-05 | Time: 7951.36 ms
[2020-11-11 22:14:53	                main:574]	:	INFO	:	Epoch 119 | loss: 4.64146e-05 | val_loss: 4.92992e-05 | Time: 8002.18 ms
[2020-11-11 22:15:01	                main:574]	:	INFO	:	Epoch 120 | loss: 4.63766e-05 | val_loss: 4.90132e-05 | Time: 7978.03 ms
[2020-11-11 22:15:09	                main:574]	:	INFO	:	Epoch 121 | loss: 4.61153e-05 | val_loss: 4.78234e-05 | Time: 7999.39 ms
[2020-11-11 22:15:17	                main:574]	:	INFO	:	Epoch 122 | loss: 4.61932e-05 | val_loss: 4.86411e-05 | Time: 7985.16 ms
[2020-11-11 22:15:25	                main:574]	:	INFO	:	Epoch 123 | loss: 4.57455e-05 | val_loss: 5.03753e-05 | Time: 7938.12 ms
[2020-11-11 22:15:33	                main:574]	:	INFO	:	Epoch 124 | loss: 4.51789e-05 | val_loss: 4.83933e-05 | Time: 7869.99 ms
[2020-11-11 22:15:40	                main:574]	:	INFO	:	Epoch 125 | loss: 4.47635e-05 | val_loss: 4.72735e-05 | Time: 7895.5 ms
[2020-11-11 22:15:49	                main:574]	:	INFO	:	Epoch 126 | loss: 4.49418e-05 | val_loss: 4.689e-05 | Time: 7981.27 ms
[2020-11-11 22:15:57	                main:574]	:	INFO	:	Epoch 127 | loss: 4.48252e-05 | val_loss: 4.70507e-05 | Time: 7979.36 ms
[2020-11-11 22:16:05	                main:574]	:	INFO	:	Epoch 128 | loss: 4.45881e-05 | val_loss: 4.66765e-05 | Time: 8035.32 ms
[2020-11-11 22:16:13	                main:574]	:	INFO	:	Epoch 129 | loss: 4.45792e-05 | val_loss: 4.65984e-05 | Time: 8030.22 ms
[2020-11-11 22:16:21	                main:574]	:	INFO	:	Epoch 130 | loss: 4.41246e-05 | val_loss: 4.67713e-05 | Time: 8085.67 ms
[2020-11-11 22:16:29	                main:574]	:	INFO	:	Epoch 131 | loss: 4.39776e-05 | val_loss: 4.58815e-05 | Time: 7958.71 ms
[2020-11-11 22:16:37	                main:574]	:	INFO	:	Epoch 132 | loss: 4.38733e-05 | val_loss: 4.6951e-05 | Time: 7950.43 ms
[2020-11-11 22:16:45	                main:574]	:	INFO	:	Epoch 133 | loss: 4.33148e-05 | val_loss: 4.51789e-05 | Time: 7981.95 ms
[2020-11-11 22:16:53	                main:574]	:	INFO	:	Epoch 134 | loss: 4.33349e-05 | val_loss: 4.48466e-05 | Time: 8006.68 ms
[2020-11-11 22:17:01	                main:574]	:	INFO	:	Epoch 135 | loss: 4.29775e-05 | val_loss: 4.68277e-05 | Time: 7961.45 ms
[2020-11-11 22:17:09	                main:574]	:	INFO	:	Epoch 136 | loss: 4.25308e-05 | val_loss: 4.44285e-05 | Time: 8058.6 ms
[2020-11-11 22:17:17	                main:574]	:	INFO	:	Epoch 137 | loss: 4.32554e-05 | val_loss: 4.41714e-05 | Time: 7880.62 ms
[2020-11-11 22:17:25	                main:574]	:	INFO	:	Epoch 138 | loss: 4.23277e-05 | val_loss: 4.52704e-05 | Time: 7867.05 ms
[2020-11-11 22:17:33	                main:574]	:	INFO	:	Epoch 139 | loss: 4.22777e-05 | val_loss: 4.4311e-05 | Time: 8013.07 ms
[2020-11-11 22:17:41	                main:574]	:	INFO	:	Epoch 140 | loss: 4.19899e-05 | val_loss: 4.39693e-05 | Time: 7980.53 ms
[2020-11-11 22:17:49	                main:574]	:	INFO	:	Epoch 141 | loss: 4.19495e-05 | val_loss: 4.34374e-05 | Time: 7947.94 ms
[2020-11-11 22:17:57	                main:574]	:	INFO	:	Epoch 142 | loss: 4.1481e-05 | val_loss: 4.34836e-05 | Time: 7942.4 ms
[2020-11-11 22:18:05	                main:574]	:	INFO	:	Epoch 143 | loss: 4.12258e-05 | val_loss: 4.44524e-05 | Time: 8000.51 ms
[2020-11-11 22:18:13	                main:574]	:	INFO	:	Epoch 144 | loss: 4.15605e-05 | val_loss: 4.36538e-05 | Time: 7908.02 ms
[2020-11-11 22:18:21	                main:574]	:	INFO	:	Epoch 145 | loss: 4.12991e-05 | val_loss: 4.32833e-05 | Time: 8023.15 ms
[2020-11-11 22:18:29	                main:574]	:	INFO	:	Epoch 146 | loss: 4.08661e-05 | val_loss: 4.40264e-05 | Time: 7991.25 ms
[2020-11-11 22:18:37	                main:574]	:	INFO	:	Epoch 147 | loss: 4.10531e-05 | val_loss: 4.36095e-05 | Time: 7898.45 ms
[2020-11-11 22:18:45	                main:574]	:	INFO	:	Epoch 148 | loss: 4.06349e-05 | val_loss: 4.46853e-05 | Time: 7979.41 ms
[2020-11-11 22:18:53	                main:574]	:	INFO	:	Epoch 149 | loss: 4.04911e-05 | val_loss: 4.18761e-05 | Time: 7989.03 ms
[2020-11-11 22:19:01	                main:574]	:	INFO	:	Epoch 150 | loss: 4.0389e-05 | val_loss: 4.2505e-05 | Time: 7944.36 ms
[2020-11-11 22:19:09	                main:574]	:	INFO	:	Epoch 151 | loss: 3.98556e-05 | val_loss: 4.26088e-05 | Time: 7954.8 ms
[2020-11-11 22:19:17	                main:574]	:	INFO	:	Epoch 152 | loss: 3.99696e-05 | val_loss: 4.19077e-05 | Time: 8003.33 ms
[2020-11-11 22:19:25	                main:574]	:	INFO	:	Epoch 153 | loss: 3.96304e-05 | val_loss: 4.22873e-05 | Time: 8013.74 ms
[2020-11-11 22:19:33	                main:574]	:	INFO	:	Epoch 154 | loss: 3.95766e-05 | val_loss: 4.27352e-05 | Time: 7972.76 ms
[2020-11-11 22:19:41	                main:574]	:	INFO	:	Epoch 155 | loss: 3.92723e-05 | val_loss: 4.19638e-05 | Time: 8000.55 ms
[2020-11-11 22:19:49	                main:574]	:	INFO	:	Epoch 156 | loss: 3.92795e-05 | val_loss: 4.06224e-05 | Time: 7913.61 ms
[2020-11-11 22:19:57	                main:574]	:	INFO	:	Epoch 157 | loss: 3.90171e-05 | val_loss: 4.13121e-05 | Time: 7933.09 ms
[2020-11-11 22:20:05	                main:574]	:	INFO	:	Epoch 158 | loss: 3.85069e-05 | val_loss: 4.10461e-05 | Time: 7921.99 ms
[2020-11-11 22:20:13	                main:574]	:	INFO	:	Epoch 159 | loss: 3.86034e-05 | val_loss: 4.19132e-05 | Time: 7966.68 ms
[2020-11-11 22:20:21	                main:574]	:	INFO	:	Epoch 160 | loss: 3.85985e-05 | val_loss: 4.2059e-05 | Time: 8029.09 ms
[2020-11-11 22:20:29	                main:574]	:	INFO	:	Epoch 161 | loss: 3.84005e-05 | val_loss: 4.02805e-05 | Time: 7983.11 ms
[2020-11-11 22:20:38	                main:574]	:	INFO	:	Epoch 162 | loss: 3.82458e-05 | val_loss: 4.1281e-05 | Time: 8008.68 ms
[2020-11-11 22:20:45	                main:574]	:	INFO	:	Epoch 163 | loss: 3.78973e-05 | val_loss: 4.09752e-05 | Time: 7880.08 ms
[2020-11-11 22:20:54	                main:574]	:	INFO	:	Epoch 164 | loss: 3.82941e-05 | val_loss: 3.92573e-05 | Time: 8029.66 ms
[2020-11-11 22:21:02	                main:574]	:	INFO	:	Epoch 165 | loss: 3.76911e-05 | val_loss: 4.24197e-05 | Time: 7956.14 ms
[2020-11-11 22:21:10	                main:574]	:	INFO	:	Epoch 166 | loss: 3.74629e-05 | val_loss: 3.94044e-05 | Time: 7968.14 ms
[2020-11-11 22:21:18	                main:574]	:	INFO	:	Epoch 167 | loss: 3.72595e-05 | val_loss: 3.97617e-05 | Time: 8022.53 ms
[2020-11-11 22:21:26	                main:574]	:	INFO	:	Epoch 168 | loss: 3.73896e-05 | val_loss: 3.99313e-05 | Time: 7893.59 ms
[2020-11-11 22:21:34	                main:574]	:	INFO	:	Epoch 169 | loss: 3.69762e-05 | val_loss: 3.91889e-05 | Time: 7954.83 ms
[2020-11-11 22:21:42	                main:574]	:	INFO	:	Epoch 170 | loss: 3.71059e-05 | val_loss: 3.84245e-05 | Time: 7922.83 ms
[2020-11-11 22:21:50	                main:574]	:	INFO	:	Epoch 171 | loss: 3.67601e-05 | val_loss: 3.87633e-05 | Time: 7995.87 ms
[2020-11-11 22:21:58	                main:574]	:	INFO	:	Epoch 172 | loss: 3.69822e-05 | val_loss: 3.85218e-05 | Time: 7992.53 ms
[2020-11-11 22:22:06	                main:574]	:	INFO	:	Epoch 173 | loss: 3.6299e-05 | val_loss: 3.93311e-05 | Time: 7987.11 ms
[2020-11-11 22:22:14	                main:574]	:	INFO	:	Epoch 174 | loss: 3.64846e-05 | val_loss: 3.86976e-05 | Time: 8157.28 ms
[2020-11-11 22:22:22	                main:574]	:	INFO	:	Epoch 175 | loss: 3.61011e-05 | val_loss: 3.82676e-05 | Time: 7990.75 ms
[2020-11-11 22:22:30	                main:574]	:	INFO	:	Epoch 176 | loss: 3.58266e-05 | val_loss: 3.78483e-05 | Time: 8088.13 ms
[2020-11-11 22:22:38	                main:574]	:	INFO	:	Epoch 177 | loss: 3.59651e-05 | val_loss: 3.85557e-05 | Time: 7988.52 ms
[2020-11-11 22:22:46	                main:574]	:	INFO	:	Epoch 178 | loss: 3.57742e-05 | val_loss: 3.74175e-05 | Time: 8015.83 ms
[2020-11-11 22:22:54	                main:574]	:	INFO	:	Epoch 179 | loss: 3.56863e-05 | val_loss: 3.71993e-05 | Time: 7921.5 ms
[2020-11-11 22:23:02	                main:574]	:	INFO	:	Epoch 180 | loss: 3.55031e-05 | val_loss: 3.7318e-05 | Time: 7957.26 ms
[2020-11-11 22:23:10	                main:574]	:	INFO	:	Epoch 181 | loss: 3.52813e-05 | val_loss: 3.75434e-05 | Time: 7954.79 ms
[2020-11-11 22:23:18	                main:574]	:	INFO	:	Epoch 182 | loss: 3.54019e-05 | val_loss: 3.64662e-05 | Time: 8024.33 ms
[2020-11-11 22:23:26	                main:574]	:	INFO	:	Epoch 183 | loss: 3.54447e-05 | val_loss: 3.856e-05 | Time: 8002.91 ms
[2020-11-11 22:23:34	                main:574]	:	INFO	:	Epoch 184 | loss: 3.48219e-05 | val_loss: 3.84356e-05 | Time: 7893.88 ms
[2020-11-11 22:23:42	                main:574]	:	INFO	:	Epoch 185 | loss: 3.51637e-05 | val_loss: 3.57973e-05 | Time: 7878.07 ms
[2020-11-11 22:23:50	                main:574]	:	INFO	:	Epoch 186 | loss: 3.49113e-05 | val_loss: 3.81249e-05 | Time: 7866.64 ms
[2020-11-11 22:23:58	                main:574]	:	INFO	:	Epoch 187 | loss: 3.47602e-05 | val_loss: 3.69322e-05 | Time: 7975.58 ms
[2020-11-11 22:24:06	                main:574]	:	INFO	:	Epoch 188 | loss: 3.42866e-05 | val_loss: 3.62717e-05 | Time: 8079.37 ms
[2020-11-11 22:24:14	                main:574]	:	INFO	:	Epoch 189 | loss: 3.46996e-05 | val_loss: 3.5367e-05 | Time: 7953.61 ms
[2020-11-11 22:24:22	                main:574]	:	INFO	:	Epoch 190 | loss: 3.40603e-05 | val_loss: 3.82208e-05 | Time: 7924.1 ms
[2020-11-11 22:24:30	                main:574]	:	INFO	:	Epoch 191 | loss: 3.44904e-05 | val_loss: 3.6907e-05 | Time: 7886.51 ms
[2020-11-11 22:24:38	                main:574]	:	INFO	:	Epoch 192 | loss: 3.39936e-05 | val_loss: 3.63295e-05 | Time: 7938.72 ms
[2020-11-11 22:24:38	                main:597]	:	INFO	:	Saving trained model to model-final.pt, val_loss 3.63295e-05
[2020-11-11 22:24:38	                main:603]	:	INFO	:	Saving end state to config to file
[2020-11-11 22:24:38	                main:608]	:	INFO	:	Success, exiting..
22:24:39 (17800): called boinc_finish(0)

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)