Task 2976710

Name rand_automata_0014-1605424623-29706-1_1
Workunit 1344300
Created 17 Nov 2020, 9:48:08 UTC
Sent 23 Nov 2020, 3:21:25 UTC
Report deadline 30 Nov 2020, 3:21:25 UTC
Received 23 Nov 2020, 5:08:12 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 2607
Run time 12 min 4 sec
CPU time 11 min 47 sec
Validate state Valid
Credit 959.40
Device peak FLOPS 2,044.89 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.41 GB
Peak swap size 3.01 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.11</core_client_version>
<![CDATA[
<stderr_txt>
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 950)
[2020-11-23 09:50:19	                main:435]	:	INFO	:	Set logging level to 1
[2020-11-23 09:50:19	                main:441]	:	INFO	:	Running in BOINC Client mode
[2020-11-23 09:50:19	                main:444]	:	INFO	:	Resolving all filenames
[2020-11-23 09:50:19	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0014-train-val-dataset.hdf5 (exists = 1)
[2020-11-23 09:50:19	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0014-1605424623-29706-1_1_r2111322257_1 (exists = 0)
[2020-11-23 09:50:19	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0014-1605424623-29706-1_1_r2111322257_0 (exists = 0)
[2020-11-23 09:50:19	                main:452]	:	INFO	:	Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0014-1605424623-29706-1 (exists = 1)
[2020-11-23 09:50:19	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2020-11-23 09:50:19	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/rand_automata_0014-train-val-dataset.hdf5
[2020-11-23 09:50:19	                main:474]	:	INFO	:	Configuration: 
[2020-11-23 09:50:19	                main:475]	:	INFO	:	    Model type: LSTM
[2020-11-23 09:50:19	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2020-11-23 09:50:19	                main:477]	:	INFO	:	    Max Epochs: 192
[2020-11-23 09:50:19	                main:478]	:	INFO	:	    Batch Size: 32
[2020-11-23 09:50:19	                main:479]	:	INFO	:	    Learning Rate: 0.001
[2020-11-23 09:50:19	                main:480]	:	INFO	:	    Patience: 10
[2020-11-23 09:50:19	                main:481]	:	INFO	:	    Hidden Width: 64
[2020-11-23 09:50:19	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2020-11-23 09:50:19	                main:483]	:	INFO	:	    # Backend Layers: 2
[2020-11-23 09:50:19	                main:484]	:	INFO	:	    # Threads: 1
[2020-11-23 09:50:19	                main:486]	:	INFO	:	Preparing Dataset
[2020-11-23 09:50:19	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0014-train-val-dataset.hdf5 into memory
[2020-11-23 09:50:20	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0014-train-val-dataset.hdf5 into memory
[2020-11-23 09:50:21	                load:106]	:	INFO	:	Successfully loaded dataset of 4096 examples into memory.
[2020-11-23 09:50:21	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0014-train-val-dataset.hdf5 into memory
[2020-11-23 09:50:21	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0014-train-val-dataset.hdf5 into memory
[2020-11-23 09:50:21	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2020-11-23 09:50:21	                main:494]	:	INFO	:	Creating Model
[2020-11-23 09:50:21	                main:507]	:	INFO	:	Preparing config file
[2020-11-23 09:50:21	                main:519]	:	INFO	:	Creating new config file
[2020-11-23 09:50:21	                main:538]	:	INFO	:	This is a continuation WU, loading previous network
[2020-11-23 09:50:22	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2020-11-23 09:50:22	                main:562]	:	INFO	:	Starting Training
[2020-11-23 09:50:26	                main:574]	:	INFO	:	Epoch 1 | loss: 0.000142223 | val_loss: 0.000107729 | Time: 4201.8 ms
[2020-11-23 09:50:30	                main:574]	:	INFO	:	Epoch 2 | loss: 0.000103284 | val_loss: 0.000108286 | Time: 3716.13 ms
[2020-11-23 09:50:34	                main:574]	:	INFO	:	Epoch 3 | loss: 0.00010366 | val_loss: 0.000108108 | Time: 3701.48 ms
[2020-11-23 09:50:37	                main:574]	:	INFO	:	Epoch 4 | loss: 0.000103865 | val_loss: 0.000107561 | Time: 3701.37 ms
[2020-11-23 09:50:41	                main:574]	:	INFO	:	Epoch 5 | loss: 0.000103655 | val_loss: 0.000108224 | Time: 3712.87 ms
[2020-11-23 09:50:45	                main:574]	:	INFO	:	Epoch 6 | loss: 0.000103158 | val_loss: 0.000107612 | Time: 3714.18 ms
[2020-11-23 09:50:49	                main:574]	:	INFO	:	Epoch 7 | loss: 0.000102515 | val_loss: 0.000108349 | Time: 3707.64 ms
[2020-11-23 09:50:52	                main:574]	:	INFO	:	Epoch 8 | loss: 0.000101568 | val_loss: 0.000105657 | Time: 3708.86 ms
[2020-11-23 09:50:56	                main:574]	:	INFO	:	Epoch 9 | loss: 0.000101133 | val_loss: 0.00010465 | Time: 3699.42 ms
[2020-11-23 09:51:00	                main:574]	:	INFO	:	Epoch 10 | loss: 0.000100739 | val_loss: 0.000104211 | Time: 3709.67 ms
[2020-11-23 09:51:04	                main:574]	:	INFO	:	Epoch 11 | loss: 9.89519e-05 | val_loss: 0.000103065 | Time: 3756.19 ms
[2020-11-23 09:51:07	                main:574]	:	INFO	:	Epoch 12 | loss: 9.82823e-05 | val_loss: 0.000102143 | Time: 3723.96 ms
[2020-11-23 09:51:11	                main:574]	:	INFO	:	Epoch 13 | loss: 9.81344e-05 | val_loss: 0.000100507 | Time: 3715.96 ms
[2020-11-23 09:51:15	                main:574]	:	INFO	:	Epoch 14 | loss: 9.67656e-05 | val_loss: 0.000103895 | Time: 3705.73 ms
[2020-11-23 09:51:18	                main:574]	:	INFO	:	Epoch 15 | loss: 9.61549e-05 | val_loss: 9.81238e-05 | Time: 3713.46 ms
[2020-11-23 09:51:22	                main:574]	:	INFO	:	Epoch 16 | loss: 9.48357e-05 | val_loss: 9.74306e-05 | Time: 3729.39 ms
[2020-11-23 09:51:26	                main:574]	:	INFO	:	Epoch 17 | loss: 9.3339e-05 | val_loss: 9.78453e-05 | Time: 3719.39 ms
[2020-11-23 09:51:30	                main:574]	:	INFO	:	Epoch 18 | loss: 9.31453e-05 | val_loss: 9.63051e-05 | Time: 3712.4 ms
[2020-11-23 09:51:33	                main:574]	:	INFO	:	Epoch 19 | loss: 9.24625e-05 | val_loss: 9.45756e-05 | Time: 3721.36 ms
[2020-11-23 09:51:37	                main:574]	:	INFO	:	Epoch 20 | loss: 9.14269e-05 | val_loss: 9.52817e-05 | Time: 3715.92 ms
[2020-11-23 09:51:41	                main:574]	:	INFO	:	Epoch 21 | loss: 9.03669e-05 | val_loss: 9.30491e-05 | Time: 3712.3 ms
[2020-11-23 09:51:45	                main:574]	:	INFO	:	Epoch 22 | loss: 8.98949e-05 | val_loss: 9.37346e-05 | Time: 3741.33 ms
[2020-11-23 09:51:48	                main:574]	:	INFO	:	Epoch 23 | loss: 8.9773e-05 | val_loss: 9.19366e-05 | Time: 3705.32 ms
[2020-11-23 09:51:52	                main:574]	:	INFO	:	Epoch 24 | loss: 8.83263e-05 | val_loss: 9.17851e-05 | Time: 3724.97 ms
[2020-11-23 09:51:56	                main:574]	:	INFO	:	Epoch 25 | loss: 8.67215e-05 | val_loss: 8.94126e-05 | Time: 3711.91 ms
[2020-11-23 09:51:59	                main:574]	:	INFO	:	Epoch 26 | loss: 8.64774e-05 | val_loss: 9.23364e-05 | Time: 3721.63 ms
[2020-11-23 09:52:03	                main:574]	:	INFO	:	Epoch 27 | loss: 8.6738e-05 | val_loss: 9.17834e-05 | Time: 3720.28 ms
[2020-11-23 09:52:07	                main:574]	:	INFO	:	Epoch 28 | loss: 8.50089e-05 | val_loss: 8.89881e-05 | Time: 3716.95 ms
[2020-11-23 09:52:11	                main:574]	:	INFO	:	Epoch 29 | loss: 8.4455e-05 | val_loss: 8.80911e-05 | Time: 3730.4 ms
[2020-11-23 09:52:14	                main:574]	:	INFO	:	Epoch 30 | loss: 8.34261e-05 | val_loss: 8.80846e-05 | Time: 3713.09 ms
[2020-11-23 09:52:18	                main:574]	:	INFO	:	Epoch 31 | loss: 8.24989e-05 | val_loss: 8.80776e-05 | Time: 3723.43 ms
[2020-11-23 09:52:22	                main:574]	:	INFO	:	Epoch 32 | loss: 8.19031e-05 | val_loss: 8.449e-05 | Time: 3716.67 ms
[2020-11-23 09:52:25	                main:574]	:	INFO	:	Epoch 33 | loss: 8.09329e-05 | val_loss: 8.41086e-05 | Time: 3729.89 ms
[2020-11-23 09:52:29	                main:574]	:	INFO	:	Epoch 34 | loss: 8.09309e-05 | val_loss: 8.79321e-05 | Time: 3729.71 ms
[2020-11-23 09:52:33	                main:574]	:	INFO	:	Epoch 35 | loss: 8.03583e-05 | val_loss: 8.36811e-05 | Time: 3728.46 ms
[2020-11-23 09:52:37	                main:574]	:	INFO	:	Epoch 36 | loss: 7.99173e-05 | val_loss: 8.3345e-05 | Time: 3731.57 ms
[2020-11-23 09:52:40	                main:574]	:	INFO	:	Epoch 37 | loss: 7.85487e-05 | val_loss: 8.20063e-05 | Time: 3731.07 ms
[2020-11-23 09:52:44	                main:574]	:	INFO	:	Epoch 38 | loss: 7.85094e-05 | val_loss: 8.03174e-05 | Time: 3724.56 ms
[2020-11-23 09:52:48	                main:574]	:	INFO	:	Epoch 39 | loss: 7.74292e-05 | val_loss: 8.235e-05 | Time: 3733.67 ms
[2020-11-23 09:52:52	                main:574]	:	INFO	:	Epoch 40 | loss: 7.73815e-05 | val_loss: 7.99119e-05 | Time: 3774.69 ms
[2020-11-23 09:52:55	                main:574]	:	INFO	:	Epoch 41 | loss: 7.63513e-05 | val_loss: 8.11194e-05 | Time: 3798.21 ms
[2020-11-23 09:52:59	                main:574]	:	INFO	:	Epoch 42 | loss: 7.58186e-05 | val_loss: 7.95147e-05 | Time: 3714.76 ms
[2020-11-23 09:53:03	                main:574]	:	INFO	:	Epoch 43 | loss: 7.47877e-05 | val_loss: 8.19517e-05 | Time: 3755.07 ms
[2020-11-23 09:53:07	                main:574]	:	INFO	:	Epoch 44 | loss: 7.51222e-05 | val_loss: 7.85665e-05 | Time: 3684.41 ms
[2020-11-23 09:53:10	                main:574]	:	INFO	:	Epoch 45 | loss: 7.351e-05 | val_loss: 7.82547e-05 | Time: 3686.55 ms
[2020-11-23 09:53:14	                main:574]	:	INFO	:	Epoch 46 | loss: 7.33209e-05 | val_loss: 7.69362e-05 | Time: 3681.66 ms
[2020-11-23 09:53:18	                main:574]	:	INFO	:	Epoch 47 | loss: 7.32222e-05 | val_loss: 7.63814e-05 | Time: 3682.13 ms
[2020-11-23 09:53:21	                main:574]	:	INFO	:	Epoch 48 | loss: 7.24929e-05 | val_loss: 7.4253e-05 | Time: 3677.17 ms
[2020-11-23 09:53:25	                main:574]	:	INFO	:	Epoch 49 | loss: 7.15139e-05 | val_loss: 7.56961e-05 | Time: 3688.96 ms
[2020-11-23 09:53:29	                main:574]	:	INFO	:	Epoch 50 | loss: 7.13596e-05 | val_loss: 7.45342e-05 | Time: 3709.76 ms
[2020-11-23 09:53:33	                main:574]	:	INFO	:	Epoch 51 | loss: 7.1318e-05 | val_loss: 7.52647e-05 | Time: 3733.4 ms
[2020-11-23 09:53:36	                main:574]	:	INFO	:	Epoch 52 | loss: 7.04061e-05 | val_loss: 7.25006e-05 | Time: 3697.1 ms
[2020-11-23 09:53:40	                main:574]	:	INFO	:	Epoch 53 | loss: 6.93702e-05 | val_loss: 7.38671e-05 | Time: 3705.05 ms
[2020-11-23 09:53:44	                main:574]	:	INFO	:	Epoch 54 | loss: 6.97771e-05 | val_loss: 7.24352e-05 | Time: 3714.39 ms
[2020-11-23 09:53:47	                main:574]	:	INFO	:	Epoch 55 | loss: 6.90198e-05 | val_loss: 7.16588e-05 | Time: 3689.89 ms
[2020-11-23 09:53:51	                main:574]	:	INFO	:	Epoch 56 | loss: 6.83513e-05 | val_loss: 7.31421e-05 | Time: 3778.89 ms
[2020-11-23 09:53:55	                main:574]	:	INFO	:	Epoch 57 | loss: 6.7743e-05 | val_loss: 7.13616e-05 | Time: 3710.62 ms
[2020-11-23 09:53:59	                main:574]	:	INFO	:	Epoch 58 | loss: 6.73693e-05 | val_loss: 7.03226e-05 | Time: 3716.59 ms
[2020-11-23 09:54:02	                main:574]	:	INFO	:	Epoch 59 | loss: 6.65075e-05 | val_loss: 7.00092e-05 | Time: 3703.14 ms
[2020-11-23 09:54:06	                main:574]	:	INFO	:	Epoch 60 | loss: 6.62587e-05 | val_loss: 6.98611e-05 | Time: 3679.61 ms
[2020-11-23 09:54:10	                main:574]	:	INFO	:	Epoch 61 | loss: 6.60722e-05 | val_loss: 6.87259e-05 | Time: 3699.49 ms
[2020-11-23 09:54:13	                main:574]	:	INFO	:	Epoch 62 | loss: 6.5985e-05 | val_loss: 6.91934e-05 | Time: 3695.83 ms
[2020-11-23 09:54:17	                main:574]	:	INFO	:	Epoch 63 | loss: 6.57027e-05 | val_loss: 7.04252e-05 | Time: 3707.99 ms
[2020-11-23 09:54:21	                main:574]	:	INFO	:	Epoch 64 | loss: 6.51951e-05 | val_loss: 6.67477e-05 | Time: 3700.84 ms
[2020-11-23 09:54:25	                main:574]	:	INFO	:	Epoch 65 | loss: 6.43523e-05 | val_loss: 6.71955e-05 | Time: 3698.24 ms
[2020-11-23 09:54:28	                main:574]	:	INFO	:	Epoch 66 | loss: 6.35494e-05 | val_loss: 6.67574e-05 | Time: 3687.84 ms
[2020-11-23 09:54:32	                main:574]	:	INFO	:	Epoch 67 | loss: 6.38781e-05 | val_loss: 6.69353e-05 | Time: 3686.57 ms
[2020-11-23 09:54:36	                main:574]	:	INFO	:	Epoch 68 | loss: 6.37428e-05 | val_loss: 6.56564e-05 | Time: 3687.06 ms
[2020-11-23 09:54:40	                main:574]	:	INFO	:	Epoch 69 | loss: 6.26824e-05 | val_loss: 6.85022e-05 | Time: 3690.79 ms
[2020-11-23 09:54:43	                main:574]	:	INFO	:	Epoch 70 | loss: 6.25386e-05 | val_loss: 6.48944e-05 | Time: 3707.03 ms
[2020-11-23 09:54:47	                main:574]	:	INFO	:	Epoch 71 | loss: 6.22473e-05 | val_loss: 6.42457e-05 | Time: 3704.37 ms
[2020-11-23 09:54:51	                main:574]	:	INFO	:	Epoch 72 | loss: 6.14441e-05 | val_loss: 6.50586e-05 | Time: 3698.76 ms
[2020-11-23 09:54:54	                main:574]	:	INFO	:	Epoch 73 | loss: 6.10402e-05 | val_loss: 6.38877e-05 | Time: 3692.82 ms
[2020-11-23 09:54:58	                main:574]	:	INFO	:	Epoch 74 | loss: 6.03259e-05 | val_loss: 6.33895e-05 | Time: 3682.39 ms
[2020-11-23 09:55:02	                main:574]	:	INFO	:	Epoch 75 | loss: 6.06839e-05 | val_loss: 6.33358e-05 | Time: 3728.51 ms
[2020-11-23 09:55:05	                main:574]	:	INFO	:	Epoch 76 | loss: 6.00397e-05 | val_loss: 6.344e-05 | Time: 3702.43 ms
[2020-11-23 09:55:09	                main:574]	:	INFO	:	Epoch 77 | loss: 5.94182e-05 | val_loss: 6.46261e-05 | Time: 3698.53 ms
[2020-11-23 09:55:13	                main:574]	:	INFO	:	Epoch 78 | loss: 5.92859e-05 | val_loss: 6.12363e-05 | Time: 3699.47 ms
[2020-11-23 09:55:17	                main:574]	:	INFO	:	Epoch 79 | loss: 5.8503e-05 | val_loss: 6.18842e-05 | Time: 3690.55 ms
[2020-11-23 09:55:20	                main:574]	:	INFO	:	Epoch 80 | loss: 5.9139e-05 | val_loss: 6.13774e-05 | Time: 3698.51 ms
[2020-11-23 09:55:24	                main:574]	:	INFO	:	Epoch 81 | loss: 5.79485e-05 | val_loss: 6.07567e-05 | Time: 3691.92 ms
[2020-11-23 09:55:28	                main:574]	:	INFO	:	Epoch 82 | loss: 5.73871e-05 | val_loss: 6.02498e-05 | Time: 3688.66 ms
[2020-11-23 09:55:31	                main:574]	:	INFO	:	Epoch 83 | loss: 5.80885e-05 | val_loss: 6.13543e-05 | Time: 3692.44 ms
[2020-11-23 09:55:35	                main:574]	:	INFO	:	Epoch 84 | loss: 5.80384e-05 | val_loss: 6.05134e-05 | Time: 3683.68 ms
[2020-11-23 09:55:39	                main:574]	:	INFO	:	Epoch 85 | loss: 5.67701e-05 | val_loss: 6.03055e-05 | Time: 3681.34 ms
[2020-11-23 09:55:42	                main:574]	:	INFO	:	Epoch 86 | loss: 5.59697e-05 | val_loss: 6.00816e-05 | Time: 3695.32 ms
[2020-11-23 09:55:46	                main:574]	:	INFO	:	Epoch 87 | loss: 5.57381e-05 | val_loss: 5.97614e-05 | Time: 3704.62 ms
[2020-11-23 09:55:50	                main:574]	:	INFO	:	Epoch 88 | loss: 5.60152e-05 | val_loss: 5.9889e-05 | Time: 3704.9 ms
[2020-11-23 09:55:54	                main:574]	:	INFO	:	Epoch 89 | loss: 5.60572e-05 | val_loss: 6.01587e-05 | Time: 3692.93 ms
[2020-11-23 09:55:57	                main:574]	:	INFO	:	Epoch 90 | loss: 5.56245e-05 | val_loss: 5.9093e-05 | Time: 3683.88 ms
[2020-11-23 09:56:01	                main:574]	:	INFO	:	Epoch 91 | loss: 5.44621e-05 | val_loss: 6.11036e-05 | Time: 3707.6 ms
[2020-11-23 09:56:05	                main:574]	:	INFO	:	Epoch 92 | loss: 5.46656e-05 | val_loss: 5.78207e-05 | Time: 3700.61 ms
[2020-11-23 09:56:08	                main:574]	:	INFO	:	Epoch 93 | loss: 5.48257e-05 | val_loss: 5.84789e-05 | Time: 3694.38 ms
[2020-11-23 09:56:12	                main:574]	:	INFO	:	Epoch 94 | loss: 5.43081e-05 | val_loss: 5.79897e-05 | Time: 3703.77 ms
[2020-11-23 09:56:16	                main:574]	:	INFO	:	Epoch 95 | loss: 5.40267e-05 | val_loss: 5.51115e-05 | Time: 3698.48 ms
[2020-11-23 09:56:20	                main:574]	:	INFO	:	Epoch 96 | loss: 5.31285e-05 | val_loss: 5.50915e-05 | Time: 3708.91 ms
[2020-11-23 09:56:23	                main:574]	:	INFO	:	Epoch 97 | loss: 5.28492e-05 | val_loss: 5.5079e-05 | Time: 3700.1 ms
[2020-11-23 09:56:27	                main:574]	:	INFO	:	Epoch 98 | loss: 5.2532e-05 | val_loss: 5.48052e-05 | Time: 3699.7 ms
[2020-11-23 09:56:31	                main:574]	:	INFO	:	Epoch 99 | loss: 5.23367e-05 | val_loss: 5.43291e-05 | Time: 3706.05 ms
[2020-11-23 09:56:34	                main:574]	:	INFO	:	Epoch 100 | loss: 5.14812e-05 | val_loss: 5.34328e-05 | Time: 3693.13 ms
[2020-11-23 09:56:38	                main:574]	:	INFO	:	Epoch 101 | loss: 5.12348e-05 | val_loss: 5.47411e-05 | Time: 3680.08 ms
[2020-11-23 09:56:42	                main:574]	:	INFO	:	Epoch 102 | loss: 5.14103e-05 | val_loss: 5.39241e-05 | Time: 3735.58 ms
[2020-11-23 09:56:45	                main:574]	:	INFO	:	Epoch 103 | loss: 5.13831e-05 | val_loss: 5.35909e-05 | Time: 3719.63 ms
[2020-11-23 09:56:49	                main:574]	:	INFO	:	Epoch 104 | loss: 5.03187e-05 | val_loss: 5.24187e-05 | Time: 3691.9 ms
[2020-11-23 09:56:53	                main:574]	:	INFO	:	Epoch 105 | loss: 5.00589e-05 | val_loss: 5.2012e-05 | Time: 3687.31 ms
[2020-11-23 09:56:57	                main:574]	:	INFO	:	Epoch 106 | loss: 5.0919e-05 | val_loss: 5.35789e-05 | Time: 3700.46 ms
[2020-11-23 09:57:00	                main:574]	:	INFO	:	Epoch 107 | loss: 5.01603e-05 | val_loss: 5.28484e-05 | Time: 3695.18 ms
[2020-11-23 09:57:04	                main:574]	:	INFO	:	Epoch 108 | loss: 4.94794e-05 | val_loss: 5.19003e-05 | Time: 3706.17 ms
[2020-11-23 09:57:08	                main:574]	:	INFO	:	Epoch 109 | loss: 4.93654e-05 | val_loss: 5.19749e-05 | Time: 3689.54 ms
[2020-11-23 09:57:11	                main:574]	:	INFO	:	Epoch 110 | loss: 4.91083e-05 | val_loss: 5.06665e-05 | Time: 3689.02 ms
[2020-11-23 09:57:15	                main:574]	:	INFO	:	Epoch 111 | loss: 4.93566e-05 | val_loss: 5.21674e-05 | Time: 3689.91 ms
[2020-11-23 09:57:19	                main:574]	:	INFO	:	Epoch 112 | loss: 4.83766e-05 | val_loss: 5.4671e-05 | Time: 3697.86 ms
[2020-11-23 09:57:22	                main:574]	:	INFO	:	Epoch 113 | loss: 4.96203e-05 | val_loss: 4.96771e-05 | Time: 3694.25 ms
[2020-11-23 09:57:26	                main:574]	:	INFO	:	Epoch 114 | loss: 4.73089e-05 | val_loss: 5.03939e-05 | Time: 3690.51 ms
[2020-11-23 09:57:30	                main:574]	:	INFO	:	Epoch 115 | loss: 4.74932e-05 | val_loss: 4.96289e-05 | Time: 3710.16 ms
[2020-11-23 09:57:34	                main:574]	:	INFO	:	Epoch 116 | loss: 4.75062e-05 | val_loss: 5.03975e-05 | Time: 3694.15 ms
[2020-11-23 09:57:37	                main:574]	:	INFO	:	Epoch 117 | loss: 4.76285e-05 | val_loss: 5.03286e-05 | Time: 3689.1 ms
[2020-11-23 09:57:41	                main:574]	:	INFO	:	Epoch 118 | loss: 4.72797e-05 | val_loss: 4.92394e-05 | Time: 3697.85 ms
[2020-11-23 09:57:45	                main:574]	:	INFO	:	Epoch 119 | loss: 4.72964e-05 | val_loss: 4.83058e-05 | Time: 3703.04 ms
[2020-11-23 09:57:48	                main:574]	:	INFO	:	Epoch 120 | loss: 4.63828e-05 | val_loss: 4.77759e-05 | Time: 3688.65 ms
[2020-11-23 09:57:52	                main:574]	:	INFO	:	Epoch 121 | loss: 4.6602e-05 | val_loss: 4.74461e-05 | Time: 3703.15 ms
[2020-11-23 09:57:56	                main:574]	:	INFO	:	Epoch 122 | loss: 4.57164e-05 | val_loss: 5.21086e-05 | Time: 3713.53 ms
[2020-11-23 09:58:00	                main:574]	:	INFO	:	Epoch 123 | loss: 4.6717e-05 | val_loss: 4.77669e-05 | Time: 3717.97 ms
[2020-11-23 09:58:03	                main:574]	:	INFO	:	Epoch 124 | loss: 4.54903e-05 | val_loss: 4.78497e-05 | Time: 3697.55 ms
[2020-11-23 09:58:07	                main:574]	:	INFO	:	Epoch 125 | loss: 4.58347e-05 | val_loss: 4.71367e-05 | Time: 3683.91 ms
[2020-11-23 09:58:11	                main:574]	:	INFO	:	Epoch 126 | loss: 4.52046e-05 | val_loss: 4.67823e-05 | Time: 3702.5 ms
[2020-11-23 09:58:14	                main:574]	:	INFO	:	Epoch 127 | loss: 4.5142e-05 | val_loss: 4.69883e-05 | Time: 3699.73 ms
[2020-11-23 09:58:18	                main:574]	:	INFO	:	Epoch 128 | loss: 4.46594e-05 | val_loss: 4.59982e-05 | Time: 3704.18 ms
[2020-11-23 09:58:22	                main:574]	:	INFO	:	Epoch 129 | loss: 4.40942e-05 | val_loss: 4.61145e-05 | Time: 3710.34 ms
[2020-11-23 09:58:25	                main:574]	:	INFO	:	Epoch 130 | loss: 4.43952e-05 | val_loss: 4.72044e-05 | Time: 3689.25 ms
[2020-11-23 09:58:29	                main:574]	:	INFO	:	Epoch 131 | loss: 4.45936e-05 | val_loss: 4.49965e-05 | Time: 3675.97 ms
[2020-11-23 09:58:33	                main:574]	:	INFO	:	Epoch 132 | loss: 4.43306e-05 | val_loss: 4.71738e-05 | Time: 3704.24 ms
[2020-11-23 09:58:37	                main:574]	:	INFO	:	Epoch 133 | loss: 4.33253e-05 | val_loss: 4.62043e-05 | Time: 3687.87 ms
[2020-11-23 09:58:40	                main:574]	:	INFO	:	Epoch 134 | loss: 4.35448e-05 | val_loss: 4.52987e-05 | Time: 3693.21 ms
[2020-11-23 09:58:44	                main:574]	:	INFO	:	Epoch 135 | loss: 4.30826e-05 | val_loss: 4.49064e-05 | Time: 3710.43 ms
[2020-11-23 09:58:48	                main:574]	:	INFO	:	Epoch 136 | loss: 4.28252e-05 | val_loss: 4.43798e-05 | Time: 3700.02 ms
[2020-11-23 09:58:51	                main:574]	:	INFO	:	Epoch 137 | loss: 4.29404e-05 | val_loss: 4.5183e-05 | Time: 3699.55 ms
[2020-11-23 09:58:55	                main:574]	:	INFO	:	Epoch 138 | loss: 4.3134e-05 | val_loss: 4.48574e-05 | Time: 3693.37 ms
[2020-11-23 09:58:59	                main:574]	:	INFO	:	Epoch 139 | loss: 4.24783e-05 | val_loss: 4.33996e-05 | Time: 3690.4 ms
[2020-11-23 09:59:02	                main:574]	:	INFO	:	Epoch 140 | loss: 4.22674e-05 | val_loss: 4.35524e-05 | Time: 3690.64 ms
[2020-11-23 09:59:06	                main:574]	:	INFO	:	Epoch 141 | loss: 4.18891e-05 | val_loss: 4.50913e-05 | Time: 3694.38 ms
[2020-11-23 09:59:10	                main:574]	:	INFO	:	Epoch 142 | loss: 4.25988e-05 | val_loss: 4.3431e-05 | Time: 3686.25 ms
[2020-11-23 09:59:14	                main:574]	:	INFO	:	Epoch 143 | loss: 4.20844e-05 | val_loss: 4.32533e-05 | Time: 3690.24 ms
[2020-11-23 09:59:17	                main:574]	:	INFO	:	Epoch 144 | loss: 4.13718e-05 | val_loss: 4.55386e-05 | Time: 3695.02 ms
[2020-11-23 09:59:21	                main:574]	:	INFO	:	Epoch 145 | loss: 4.12998e-05 | val_loss: 4.78529e-05 | Time: 3690.31 ms
[2020-11-23 09:59:25	                main:574]	:	INFO	:	Epoch 146 | loss: 4.14432e-05 | val_loss: 4.26875e-05 | Time: 3687.56 ms
[2020-11-23 09:59:28	                main:574]	:	INFO	:	Epoch 147 | loss: 4.11107e-05 | val_loss: 4.34513e-05 | Time: 3677.11 ms
[2020-11-23 09:59:32	                main:574]	:	INFO	:	Epoch 148 | loss: 4.08585e-05 | val_loss: 4.24249e-05 | Time: 3708.24 ms
[2020-11-23 09:59:36	                main:574]	:	INFO	:	Epoch 149 | loss: 4.11874e-05 | val_loss: 4.4692e-05 | Time: 3691.29 ms
[2020-11-23 09:59:39	                main:574]	:	INFO	:	Epoch 150 | loss: 3.96876e-05 | val_loss: 4.18734e-05 | Time: 3690.21 ms
[2020-11-23 09:59:43	                main:574]	:	INFO	:	Epoch 151 | loss: 4.02326e-05 | val_loss: 4.23806e-05 | Time: 3706.07 ms
[2020-11-23 09:59:47	                main:574]	:	INFO	:	Epoch 152 | loss: 3.9831e-05 | val_loss: 4.25786e-05 | Time: 3690.49 ms
[2020-11-23 09:59:51	                main:574]	:	INFO	:	Epoch 153 | loss: 4.01515e-05 | val_loss: 4.42079e-05 | Time: 3687.44 ms
[2020-11-23 09:59:54	                main:574]	:	INFO	:	Epoch 154 | loss: 4.48952e-05 | val_loss: 4.10466e-05 | Time: 3687.56 ms
[2020-11-23 09:59:58	                main:574]	:	INFO	:	Epoch 155 | loss: 4.02387e-05 | val_loss: 4.03598e-05 | Time: 3693.47 ms
[2020-11-23 10:00:02	                main:574]	:	INFO	:	Epoch 156 | loss: 3.9108e-05 | val_loss: 4.19707e-05 | Time: 3774.06 ms
[2020-11-23 10:00:05	                main:574]	:	INFO	:	Epoch 157 | loss: 3.93712e-05 | val_loss: 4.06591e-05 | Time: 3684.89 ms
[2020-11-23 10:00:09	                main:574]	:	INFO	:	Epoch 158 | loss: 3.862e-05 | val_loss: 4.21162e-05 | Time: 3681.39 ms
[2020-11-23 10:00:13	                main:574]	:	INFO	:	Epoch 159 | loss: 3.87103e-05 | val_loss: 4.11636e-05 | Time: 3693.28 ms
[2020-11-23 10:00:16	                main:574]	:	INFO	:	Epoch 160 | loss: 3.91739e-05 | val_loss: 4.00909e-05 | Time: 3693.19 ms
[2020-11-23 10:00:20	                main:574]	:	INFO	:	Epoch 161 | loss: 3.8288e-05 | val_loss: 4.3019e-05 | Time: 3688.07 ms
[2020-11-23 10:00:24	                main:574]	:	INFO	:	Epoch 162 | loss: 3.87438e-05 | val_loss: 4.08123e-05 | Time: 3680.49 ms
[2020-11-23 10:00:28	                main:574]	:	INFO	:	Epoch 163 | loss: 3.83475e-05 | val_loss: 3.9466e-05 | Time: 3698.94 ms
[2020-11-23 10:00:31	                main:574]	:	INFO	:	Epoch 164 | loss: 3.79848e-05 | val_loss: 3.90144e-05 | Time: 3692.5 ms
[2020-11-23 10:00:35	                main:574]	:	INFO	:	Epoch 165 | loss: 3.79118e-05 | val_loss: 4.08927e-05 | Time: 3701.78 ms
[2020-11-23 10:00:39	                main:574]	:	INFO	:	Epoch 166 | loss: 3.77177e-05 | val_loss: 3.91477e-05 | Time: 3687.73 ms
[2020-11-23 10:00:42	                main:574]	:	INFO	:	Epoch 167 | loss: 3.72827e-05 | val_loss: 4.58355e-05 | Time: 3697.77 ms
[2020-11-23 10:00:46	                main:574]	:	INFO	:	Epoch 168 | loss: 3.87728e-05 | val_loss: 3.97821e-05 | Time: 3709.98 ms
[2020-11-23 10:00:50	                main:574]	:	INFO	:	Epoch 169 | loss: 3.74451e-05 | val_loss: 4.0524e-05 | Time: 3690.77 ms
[2020-11-23 10:00:53	                main:574]	:	INFO	:	Epoch 170 | loss: 3.73355e-05 | val_loss: 4.01561e-05 | Time: 3683.44 ms
[2020-11-23 10:00:57	                main:574]	:	INFO	:	Epoch 171 | loss: 3.72406e-05 | val_loss: 3.82984e-05 | Time: 3693.97 ms
[2020-11-23 10:01:01	                main:574]	:	INFO	:	Epoch 172 | loss: 3.71412e-05 | val_loss: 3.86489e-05 | Time: 3693.95 ms
[2020-11-23 10:01:05	                main:574]	:	INFO	:	Epoch 173 | loss: 3.62183e-05 | val_loss: 3.82189e-05 | Time: 3679.99 ms
[2020-11-23 10:01:08	                main:574]	:	INFO	:	Epoch 174 | loss: 3.66976e-05 | val_loss: 3.77958e-05 | Time: 3692.79 ms
[2020-11-23 10:01:12	                main:574]	:	INFO	:	Epoch 175 | loss: 3.62999e-05 | val_loss: 3.77765e-05 | Time: 3683.15 ms
[2020-11-23 10:01:16	                main:574]	:	INFO	:	Epoch 176 | loss: 3.60708e-05 | val_loss: 3.74751e-05 | Time: 3694.75 ms
[2020-11-23 10:01:19	                main:574]	:	INFO	:	Epoch 177 | loss: 3.62533e-05 | val_loss: 3.9184e-05 | Time: 3688.63 ms
[2020-11-23 10:01:23	                main:574]	:	INFO	:	Epoch 178 | loss: 3.66243e-05 | val_loss: 3.78138e-05 | Time: 3685.72 ms
[2020-11-23 10:01:27	                main:574]	:	INFO	:	Epoch 179 | loss: 3.60737e-05 | val_loss: 4.02164e-05 | Time: 3679.07 ms
[2020-11-23 10:01:30	                main:574]	:	INFO	:	Epoch 180 | loss: 3.62582e-05 | val_loss: 3.67041e-05 | Time: 3700.31 ms
[2020-11-23 10:01:34	                main:574]	:	INFO	:	Epoch 181 | loss: 3.51593e-05 | val_loss: 3.7999e-05 | Time: 3675.74 ms
[2020-11-23 10:01:38	                main:574]	:	INFO	:	Epoch 182 | loss: 3.55116e-05 | val_loss: 3.82637e-05 | Time: 3679.81 ms
[2020-11-23 10:01:41	                main:574]	:	INFO	:	Epoch 183 | loss: 3.52065e-05 | val_loss: 3.72741e-05 | Time: 3681.03 ms
[2020-11-23 10:01:45	                main:574]	:	INFO	:	Epoch 184 | loss: 3.52131e-05 | val_loss: 3.64014e-05 | Time: 3711.56 ms
[2020-11-23 10:01:49	                main:574]	:	INFO	:	Epoch 185 | loss: 3.53443e-05 | val_loss: 3.66281e-05 | Time: 3705.28 ms
[2020-11-23 10:01:53	                main:574]	:	INFO	:	Epoch 186 | loss: 3.63005e-05 | val_loss: 3.70722e-05 | Time: 3703.32 ms
[2020-11-23 10:01:56	                main:574]	:	INFO	:	Epoch 187 | loss: 3.49712e-05 | val_loss: 3.87575e-05 | Time: 3683.56 ms
[2020-11-23 10:02:00	                main:574]	:	INFO	:	Epoch 188 | loss: 3.49326e-05 | val_loss: 3.70025e-05 | Time: 3694 ms
[2020-11-23 10:02:04	                main:574]	:	INFO	:	Epoch 189 | loss: 3.48735e-05 | val_loss: 3.66953e-05 | Time: 3693.41 ms
[2020-11-23 10:02:07	                main:574]	:	INFO	:	Epoch 190 | loss: 3.41074e-05 | val_loss: 3.58201e-05 | Time: 3682.15 ms
[2020-11-23 10:02:11	                main:574]	:	INFO	:	Epoch 191 | loss: 3.46064e-05 | val_loss: 3.69623e-05 | Time: 3694.83 ms
[2020-11-23 10:02:15	                main:574]	:	INFO	:	Epoch 192 | loss: 3.44894e-05 | val_loss: 3.76539e-05 | Time: 3685.43 ms
[2020-11-23 10:02:15	                main:597]	:	INFO	:	Saving trained model to model-final.pt, val_loss 3.76539e-05
[2020-11-23 10:02:15	                main:603]	:	INFO	:	Saving end state to config to file
[2020-11-23 10:02:15	                main:608]	:	INFO	:	Success, exiting..
10:02:15 (17280): called boinc_finish(0)

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)