Task 2969762

Name rand_automata_0049-1605424084-12135-1_0
Workunit 1341264
Created 16 Nov 2020, 15:37:08 UTC
Sent 23 Nov 2020, 5:16:47 UTC
Report deadline 30 Nov 2020, 5:16:47 UTC
Received 23 Nov 2020, 11:12:47 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 4102
Run time 19 min 42 sec
CPU time 15 min 6 sec
Validate state Valid
Credit 959.40
Device peak FLOPS 2,142.34 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.50 GB
Peak swap size 3.14 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.11</core_client_version>
<![CDATA[
<stderr_txt>
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 1050 Ti)
[2020-11-23 11:12:29	                main:435]	:	INFO	:	Set logging level to 1
[2020-11-23 11:12:29	                main:441]	:	INFO	:	Running in BOINC Client mode
[2020-11-23 11:12:29	                main:444]	:	INFO	:	Resolving all filenames
[2020-11-23 11:12:29	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0049-train-val-dataset.hdf5 (exists = 1)
[2020-11-23 11:12:29	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0049-1605424084-12135-1_0_r1169737751_1 (exists = 0)
[2020-11-23 11:12:29	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0049-1605424084-12135-1_0_r1169737751_0 (exists = 0)
[2020-11-23 11:12:30	                main:452]	:	INFO	:	Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0049-1605424084-12135-1 (exists = 1)
[2020-11-23 11:12:30	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2020-11-23 11:12:30	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/rand_automata_0049-train-val-dataset.hdf5
[2020-11-23 11:12:30	                main:474]	:	INFO	:	Configuration: 
[2020-11-23 11:12:30	                main:475]	:	INFO	:	    Model type: LSTM
[2020-11-23 11:12:30	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2020-11-23 11:12:30	                main:477]	:	INFO	:	    Max Epochs: 192
[2020-11-23 11:12:30	                main:478]	:	INFO	:	    Batch Size: 32
[2020-11-23 11:12:30	                main:479]	:	INFO	:	    Learning Rate: 0.001
[2020-11-23 11:12:30	                main:480]	:	INFO	:	    Patience: 10
[2020-11-23 11:12:30	                main:481]	:	INFO	:	    Hidden Width: 64
[2020-11-23 11:12:30	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2020-11-23 11:12:30	                main:483]	:	INFO	:	    # Backend Layers: 2
[2020-11-23 11:12:30	                main:484]	:	INFO	:	    # Threads: 1
[2020-11-23 11:12:31	                main:486]	:	INFO	:	Preparing Dataset
[2020-11-23 11:12:31	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0049-train-val-dataset.hdf5 into memory
[2020-11-23 11:12:31	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0049-train-val-dataset.hdf5 into memory
[2020-11-23 11:12:36	                load:106]	:	INFO	:	Successfully loaded dataset of 4096 examples into memory.
[2020-11-23 11:12:36	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0049-train-val-dataset.hdf5 into memory
[2020-11-23 11:12:36	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0049-train-val-dataset.hdf5 into memory
[2020-11-23 11:12:36	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2020-11-23 11:12:36	                main:494]	:	INFO	:	Creating Model
[2020-11-23 11:12:36	                main:507]	:	INFO	:	Preparing config file
[2020-11-23 11:12:36	                main:519]	:	INFO	:	Creating new config file
[2020-11-23 11:12:36	                main:538]	:	INFO	:	This is a continuation WU, loading previous network
[2020-11-23 11:12:56	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2020-11-23 11:12:56	                main:562]	:	INFO	:	Starting Training
[2020-11-23 11:13:17	                main:574]	:	INFO	:	Epoch 1 | loss: 0.000117494 | val_loss: 0.000106029 | Time: 20915.4 ms
[2020-11-23 11:13:24	                main:574]	:	INFO	:	Epoch 2 | loss: 0.000100544 | val_loss: 0.000106301 | Time: 6919 ms
[2020-11-23 11:13:42	                main:574]	:	INFO	:	Epoch 3 | loss: 0.000100552 | val_loss: 0.000105982 | Time: 17352.6 ms
[2020-11-23 11:13:59	                main:574]	:	INFO	:	Epoch 4 | loss: 0.000100322 | val_loss: 0.000105162 | Time: 17306 ms
[2020-11-23 11:14:30	                main:574]	:	INFO	:	Epoch 5 | loss: 9.98166e-05 | val_loss: 0.000105044 | Time: 30407.1 ms
[2020-11-23 11:14:49	                main:574]	:	INFO	:	Epoch 6 | loss: 9.88019e-05 | val_loss: 0.000103495 | Time: 18866.6 ms
[2020-11-23 11:14:57	                main:574]	:	INFO	:	Epoch 7 | loss: 9.78046e-05 | val_loss: 0.000101819 | Time: 8095.73 ms
[2020-11-23 11:15:23	                main:574]	:	INFO	:	Epoch 8 | loss: 9.71856e-05 | val_loss: 0.000101754 | Time: 6187.3 ms
[2020-11-23 11:15:30	                main:574]	:	INFO	:	Epoch 9 | loss: 9.60913e-05 | val_loss: 0.00010167 | Time: 6319.61 ms
[2020-11-23 11:15:38	                main:574]	:	INFO	:	Epoch 10 | loss: 9.53414e-05 | val_loss: 9.93807e-05 | Time: 7957.96 ms
[2020-11-23 11:16:58	                main:574]	:	INFO	:	Epoch 11 | loss: 9.4121e-05 | val_loss: 9.97405e-05 | Time: 79749.6 ms
[2020-11-23 11:17:04	                main:574]	:	INFO	:	Epoch 12 | loss: 9.32796e-05 | val_loss: 9.77829e-05 | Time: 5800.08 ms
[2020-11-23 11:17:11	                main:574]	:	INFO	:	Epoch 13 | loss: 9.25268e-05 | val_loss: 9.79562e-05 | Time: 6338.67 ms
[2020-11-23 11:17:17	                main:574]	:	INFO	:	Epoch 14 | loss: 9.16369e-05 | val_loss: 9.62827e-05 | Time: 6032.01 ms
[2020-11-23 11:17:23	                main:574]	:	INFO	:	Epoch 15 | loss: 9.07853e-05 | val_loss: 9.51887e-05 | Time: 6581.03 ms
[2020-11-23 11:17:29	                main:574]	:	INFO	:	Epoch 16 | loss: 8.98157e-05 | val_loss: 9.48562e-05 | Time: 6055.77 ms
[2020-11-23 11:17:37	                main:574]	:	INFO	:	Epoch 17 | loss: 8.90297e-05 | val_loss: 9.36854e-05 | Time: 6924.31 ms
[2020-11-23 11:17:53	                main:574]	:	INFO	:	Epoch 18 | loss: 8.82954e-05 | val_loss: 9.27415e-05 | Time: 16050.4 ms
[2020-11-23 11:17:59	                main:574]	:	INFO	:	Epoch 19 | loss: 8.74176e-05 | val_loss: 9.12555e-05 | Time: 6319.7 ms
[2020-11-23 11:18:05	                main:574]	:	INFO	:	Epoch 20 | loss: 8.64346e-05 | val_loss: 9.09328e-05 | Time: 5757.99 ms
[2020-11-23 11:18:12	                main:574]	:	INFO	:	Epoch 21 | loss: 8.62913e-05 | val_loss: 9.11675e-05 | Time: 7026.03 ms
[2020-11-23 11:18:40	                main:574]	:	INFO	:	Epoch 22 | loss: 8.51886e-05 | val_loss: 8.97689e-05 | Time: 27095.2 ms
[2020-11-23 11:18:46	                main:574]	:	INFO	:	Epoch 23 | loss: 8.46034e-05 | val_loss: 8.91332e-05 | Time: 6266.45 ms
[2020-11-23 11:18:52	                main:574]	:	INFO	:	Epoch 24 | loss: 8.36563e-05 | val_loss: 8.88866e-05 | Time: 6164.45 ms
[2020-11-23 11:19:09	                main:574]	:	INFO	:	Epoch 25 | loss: 8.2847e-05 | val_loss: 8.70513e-05 | Time: 17194.9 ms
[2020-11-23 11:19:16	                main:574]	:	INFO	:	Epoch 26 | loss: 8.22684e-05 | val_loss: 8.67773e-05 | Time: 6395.26 ms
[2020-11-23 11:19:23	                main:574]	:	INFO	:	Epoch 27 | loss: 8.13391e-05 | val_loss: 8.53884e-05 | Time: 6815.49 ms
[2020-11-23 11:19:40	                main:574]	:	INFO	:	Epoch 28 | loss: 8.06444e-05 | val_loss: 8.56622e-05 | Time: 16931 ms
[2020-11-23 11:19:46	                main:574]	:	INFO	:	Epoch 29 | loss: 8.00828e-05 | val_loss: 8.42226e-05 | Time: 6417.68 ms
[2020-11-23 11:19:54	                main:574]	:	INFO	:	Epoch 30 | loss: 7.94551e-05 | val_loss: 8.32491e-05 | Time: 7550.73 ms
[2020-11-23 11:20:12	                main:574]	:	INFO	:	Epoch 31 | loss: 7.87641e-05 | val_loss: 8.26161e-05 | Time: 17739 ms
[2020-11-23 11:20:18	                main:574]	:	INFO	:	Epoch 32 | loss: 7.85007e-05 | val_loss: 8.28988e-05 | Time: 5752.33 ms
[2020-11-23 11:20:25	                main:574]	:	INFO	:	Epoch 33 | loss: 7.76491e-05 | val_loss: 8.21769e-05 | Time: 7107.8 ms
[2020-11-23 11:20:41	                main:574]	:	INFO	:	Epoch 34 | loss: 7.6863e-05 | val_loss: 8.14286e-05 | Time: 16242 ms
[2020-11-23 11:20:47	                main:574]	:	INFO	:	Epoch 35 | loss: 7.6339e-05 | val_loss: 8.06617e-05 | Time: 5576.69 ms
[2020-11-23 11:20:53	                main:574]	:	INFO	:	Epoch 36 | loss: 7.596e-05 | val_loss: 7.98979e-05 | Time: 6002.09 ms
[2020-11-23 11:20:59	                main:574]	:	INFO	:	Epoch 37 | loss: 7.48646e-05 | val_loss: 7.89624e-05 | Time: 5635.74 ms
[2020-11-23 11:21:04	                main:574]	:	INFO	:	Epoch 38 | loss: 7.45899e-05 | val_loss: 7.84979e-05 | Time: 5796.73 ms
[2020-11-23 11:21:11	                main:574]	:	INFO	:	Epoch 39 | loss: 7.40026e-05 | val_loss: 7.92817e-05 | Time: 6583.24 ms
[2020-11-23 11:21:18	                main:574]	:	INFO	:	Epoch 40 | loss: 7.35479e-05 | val_loss: 7.72706e-05 | Time: 6219.69 ms
[2020-11-23 11:21:23	                main:574]	:	INFO	:	Epoch 41 | loss: 7.29659e-05 | val_loss: 7.76069e-05 | Time: 5844.46 ms
[2020-11-23 11:21:30	                main:574]	:	INFO	:	Epoch 42 | loss: 7.20696e-05 | val_loss: 7.59795e-05 | Time: 6088.61 ms
[2020-11-23 11:21:36	                main:574]	:	INFO	:	Epoch 43 | loss: 7.17944e-05 | val_loss: 7.55953e-05 | Time: 6625.34 ms
[2020-11-23 11:21:42	                main:574]	:	INFO	:	Epoch 44 | loss: 7.12121e-05 | val_loss: 7.54298e-05 | Time: 5977.85 ms
[2020-11-23 11:21:48	                main:574]	:	INFO	:	Epoch 45 | loss: 7.06401e-05 | val_loss: 7.53668e-05 | Time: 5860.71 ms
[2020-11-23 11:21:55	                main:574]	:	INFO	:	Epoch 46 | loss: 7.02714e-05 | val_loss: 7.39473e-05 | Time: 6216.69 ms
[2020-11-23 11:22:01	                main:574]	:	INFO	:	Epoch 47 | loss: 6.97316e-05 | val_loss: 7.4769e-05 | Time: 6049.88 ms
[2020-11-23 11:22:07	                main:574]	:	INFO	:	Epoch 48 | loss: 6.93036e-05 | val_loss: 7.34463e-05 | Time: 6506.61 ms
[2020-11-23 11:22:24	                main:574]	:	INFO	:	Epoch 49 | loss: 6.86989e-05 | val_loss: 7.30255e-05 | Time: 16389.3 ms
[2020-11-23 11:22:42	                main:574]	:	INFO	:	Epoch 50 | loss: 6.81272e-05 | val_loss: 7.24152e-05 | Time: 18295.4 ms
[2020-11-23 11:22:48	                main:574]	:	INFO	:	Epoch 51 | loss: 6.78241e-05 | val_loss: 7.18174e-05 | Time: 6209.62 ms
[2020-11-23 11:22:54	                main:574]	:	INFO	:	Epoch 52 | loss: 6.6933e-05 | val_loss: 7.02497e-05 | Time: 5651.66 ms
[2020-11-23 11:23:00	                main:574]	:	INFO	:	Epoch 53 | loss: 6.67734e-05 | val_loss: 7.04188e-05 | Time: 5585.84 ms
[2020-11-23 11:23:06	                main:574]	:	INFO	:	Epoch 54 | loss: 6.62768e-05 | val_loss: 7.07387e-05 | Time: 5840.17 ms
[2020-11-23 11:23:11	                main:574]	:	INFO	:	Epoch 55 | loss: 6.57379e-05 | val_loss: 7.14074e-05 | Time: 5625.11 ms
[2020-11-23 11:23:19	                main:574]	:	INFO	:	Epoch 56 | loss: 6.58402e-05 | val_loss: 6.92242e-05 | Time: 7558.88 ms
[2020-11-23 11:23:35	                main:574]	:	INFO	:	Epoch 57 | loss: 6.51484e-05 | val_loss: 6.95066e-05 | Time: 15723.9 ms
[2020-11-23 11:23:41	                main:574]	:	INFO	:	Epoch 58 | loss: 6.44869e-05 | val_loss: 6.86839e-05 | Time: 5819.76 ms
[2020-11-23 11:23:47	                main:574]	:	INFO	:	Epoch 59 | loss: 6.4006e-05 | val_loss: 6.72192e-05 | Time: 6018.17 ms
[2020-11-23 11:23:53	                main:574]	:	INFO	:	Epoch 60 | loss: 6.37884e-05 | val_loss: 6.81069e-05 | Time: 5964.94 ms
[2020-11-23 11:23:59	                main:574]	:	INFO	:	Epoch 61 | loss: 6.31919e-05 | val_loss: 6.65101e-05 | Time: 6027.31 ms
[2020-11-23 11:24:05	                main:574]	:	INFO	:	Epoch 62 | loss: 6.28818e-05 | val_loss: 6.64497e-05 | Time: 5705.8 ms
[2020-11-23 11:24:10	                main:574]	:	INFO	:	Epoch 63 | loss: 6.24271e-05 | val_loss: 6.60924e-05 | Time: 5518.6 ms
[2020-11-23 11:24:16	                main:574]	:	INFO	:	Epoch 64 | loss: 6.19555e-05 | val_loss: 6.51196e-05 | Time: 5983.88 ms
[2020-11-23 11:24:33	                main:574]	:	INFO	:	Epoch 65 | loss: 6.13288e-05 | val_loss: 6.60021e-05 | Time: 16741.2 ms
[2020-11-23 11:24:39	                main:574]	:	INFO	:	Epoch 66 | loss: 6.13727e-05 | val_loss: 6.50911e-05 | Time: 5943.47 ms
[2020-11-23 11:24:47	                main:574]	:	INFO	:	Epoch 67 | loss: 6.09887e-05 | val_loss: 6.50738e-05 | Time: 7397.24 ms
[2020-11-23 11:25:03	                main:574]	:	INFO	:	Epoch 68 | loss: 6.05447e-05 | val_loss: 6.42159e-05 | Time: 16306 ms
[2020-11-23 11:25:10	                main:574]	:	INFO	:	Epoch 69 | loss: 5.9972e-05 | val_loss: 6.33181e-05 | Time: 6384.32 ms
[2020-11-23 11:25:16	                main:574]	:	INFO	:	Epoch 70 | loss: 5.95837e-05 | val_loss: 6.24765e-05 | Time: 5862.94 ms
[2020-11-23 11:25:21	                main:574]	:	INFO	:	Epoch 71 | loss: 5.96863e-05 | val_loss: 6.35397e-05 | Time: 5768.13 ms
[2020-11-23 11:25:27	                main:574]	:	INFO	:	Epoch 72 | loss: 5.87637e-05 | val_loss: 6.23659e-05 | Time: 5902.18 ms
[2020-11-23 11:25:33	                main:574]	:	INFO	:	Epoch 73 | loss: 5.88164e-05 | val_loss: 6.22361e-05 | Time: 5619.94 ms
[2020-11-23 11:25:40	                main:574]	:	INFO	:	Epoch 74 | loss: 5.84589e-05 | val_loss: 6.13368e-05 | Time: 6708.96 ms
[2020-11-23 11:25:46	                main:574]	:	INFO	:	Epoch 75 | loss: 5.78016e-05 | val_loss: 6.14312e-05 | Time: 5520.07 ms
[2020-11-23 11:25:51	                main:574]	:	INFO	:	Epoch 76 | loss: 5.74785e-05 | val_loss: 6.04078e-05 | Time: 5706.16 ms
[2020-11-23 11:25:57	                main:574]	:	INFO	:	Epoch 77 | loss: 5.72367e-05 | val_loss: 6.16937e-05 | Time: 5523.54 ms
[2020-11-23 11:26:03	                main:574]	:	INFO	:	Epoch 78 | loss: 5.70315e-05 | val_loss: 6.07752e-05 | Time: 5722.57 ms
[2020-11-23 11:26:09	                main:574]	:	INFO	:	Epoch 79 | loss: 5.65659e-05 | val_loss: 6.00367e-05 | Time: 5712.73 ms
[2020-11-23 11:26:14	                main:574]	:	INFO	:	Epoch 80 | loss: 5.62881e-05 | val_loss: 5.90376e-05 | Time: 5575.86 ms
[2020-11-23 11:26:21	                main:574]	:	INFO	:	Epoch 81 | loss: 5.6034e-05 | val_loss: 5.94621e-05 | Time: 6620.11 ms
[2020-11-23 11:26:27	                main:574]	:	INFO	:	Epoch 82 | loss: 5.54511e-05 | val_loss: 5.93115e-05 | Time: 6032.94 ms
[2020-11-23 11:26:33	                main:574]	:	INFO	:	Epoch 83 | loss: 5.52229e-05 | val_loss: 5.83032e-05 | Time: 5549.29 ms
[2020-11-23 11:26:39	                main:574]	:	INFO	:	Epoch 84 | loss: 5.49663e-05 | val_loss: 5.84153e-05 | Time: 6068.92 ms
[2020-11-23 11:26:45	                main:574]	:	INFO	:	Epoch 85 | loss: 5.46268e-05 | val_loss: 5.81985e-05 | Time: 5807.27 ms
[2020-11-23 11:26:51	                main:574]	:	INFO	:	Epoch 86 | loss: 5.42425e-05 | val_loss: 5.73541e-05 | Time: 5890.07 ms
[2020-11-23 11:26:56	                main:574]	:	INFO	:	Epoch 87 | loss: 5.41643e-05 | val_loss: 5.69689e-05 | Time: 5598.38 ms
[2020-11-23 11:27:02	                main:574]	:	INFO	:	Epoch 88 | loss: 5.35904e-05 | val_loss: 5.72901e-05 | Time: 5795.11 ms
[2020-11-23 11:27:08	                main:574]	:	INFO	:	Epoch 89 | loss: 5.35651e-05 | val_loss: 5.73646e-05 | Time: 6003.09 ms
[2020-11-23 11:27:14	                main:574]	:	INFO	:	Epoch 90 | loss: 5.35379e-05 | val_loss: 5.57839e-05 | Time: 5391.46 ms
[2020-11-23 11:27:20	                main:574]	:	INFO	:	Epoch 91 | loss: 5.26812e-05 | val_loss: 5.64719e-05 | Time: 6556.12 ms
[2020-11-23 11:27:27	                main:574]	:	INFO	:	Epoch 92 | loss: 5.27045e-05 | val_loss: 5.53549e-05 | Time: 5935.75 ms
[2020-11-23 11:27:32	                main:574]	:	INFO	:	Epoch 93 | loss: 5.23788e-05 | val_loss: 5.61818e-05 | Time: 5912.13 ms
[2020-11-23 11:27:39	                main:574]	:	INFO	:	Epoch 94 | loss: 5.19e-05 | val_loss: 5.45696e-05 | Time: 6264.52 ms
[2020-11-23 11:27:45	                main:574]	:	INFO	:	Epoch 95 | loss: 5.17312e-05 | val_loss: 5.60699e-05 | Time: 5766.51 ms
[2020-11-23 11:27:50	                main:574]	:	INFO	:	Epoch 96 | loss: 5.16036e-05 | val_loss: 5.44972e-05 | Time: 5779.53 ms
[2020-11-23 11:27:56	                main:574]	:	INFO	:	Epoch 97 | loss: 5.12149e-05 | val_loss: 5.40105e-05 | Time: 5869.88 ms
[2020-11-23 11:28:02	                main:574]	:	INFO	:	Epoch 98 | loss: 5.07915e-05 | val_loss: 5.45791e-05 | Time: 5529.32 ms
[2020-11-23 11:28:08	                main:574]	:	INFO	:	Epoch 99 | loss: 5.0974e-05 | val_loss: 5.36616e-05 | Time: 5706.57 ms
[2020-11-23 11:28:14	                main:574]	:	INFO	:	Epoch 100 | loss: 5.07561e-05 | val_loss: 5.31868e-05 | Time: 5939.89 ms
[2020-11-23 11:28:19	                main:574]	:	INFO	:	Epoch 101 | loss: 5.01976e-05 | val_loss: 5.28259e-05 | Time: 5501.54 ms
[2020-11-23 11:28:25	                main:574]	:	INFO	:	Epoch 102 | loss: 4.9963e-05 | val_loss: 5.36275e-05 | Time: 5914.15 ms
[2020-11-23 11:28:31	                main:574]	:	INFO	:	Epoch 103 | loss: 4.9528e-05 | val_loss: 5.22756e-05 | Time: 5795.67 ms
[2020-11-23 11:28:37	                main:574]	:	INFO	:	Epoch 104 | loss: 4.93499e-05 | val_loss: 5.21622e-05 | Time: 5586.34 ms
[2020-11-23 11:28:43	                main:574]	:	INFO	:	Epoch 105 | loss: 4.9372e-05 | val_loss: 5.26238e-05 | Time: 6309.04 ms
[2020-11-23 11:28:49	                main:574]	:	INFO	:	Epoch 106 | loss: 4.88626e-05 | val_loss: 5.22735e-05 | Time: 5721.91 ms
[2020-11-23 11:28:55	                main:574]	:	INFO	:	Epoch 107 | loss: 4.89026e-05 | val_loss: 5.30434e-05 | Time: 5753.24 ms
[2020-11-23 11:29:01	                main:574]	:	INFO	:	Epoch 108 | loss: 4.86113e-05 | val_loss: 5.18832e-05 | Time: 5899.07 ms
[2020-11-23 11:29:07	                main:574]	:	INFO	:	Epoch 109 | loss: 4.828e-05 | val_loss: 5.23828e-05 | Time: 5812.96 ms
[2020-11-23 11:29:13	                main:574]	:	INFO	:	Epoch 110 | loss: 4.7956e-05 | val_loss: 5.04856e-05 | Time: 6113.23 ms
[2020-11-23 11:29:19	                main:574]	:	INFO	:	Epoch 111 | loss: 4.78777e-05 | val_loss: 5.00138e-05 | Time: 6004.88 ms
[2020-11-23 11:29:25	                main:574]	:	INFO	:	Epoch 112 | loss: 4.76414e-05 | val_loss: 5.06049e-05 | Time: 5424.34 ms
[2020-11-23 11:29:31	                main:574]	:	INFO	:	Epoch 113 | loss: 4.72548e-05 | val_loss: 4.94585e-05 | Time: 6068.47 ms
[2020-11-23 11:29:37	                main:574]	:	INFO	:	Epoch 114 | loss: 4.70593e-05 | val_loss: 5.00291e-05 | Time: 5638.04 ms
[2020-11-23 11:29:42	                main:574]	:	INFO	:	Epoch 115 | loss: 4.69554e-05 | val_loss: 4.93565e-05 | Time: 5695.43 ms
[2020-11-23 11:29:48	                main:574]	:	INFO	:	Epoch 116 | loss: 4.66184e-05 | val_loss: 4.87189e-05 | Time: 6025.84 ms
[2020-11-23 11:29:54	                main:574]	:	INFO	:	Epoch 117 | loss: 4.62926e-05 | val_loss: 5.00692e-05 | Time: 5895.59 ms
[2020-11-23 11:30:01	                main:574]	:	INFO	:	Epoch 118 | loss: 4.62157e-05 | val_loss: 4.90491e-05 | Time: 6647.17 ms
[2020-11-23 11:30:08	                main:574]	:	INFO	:	Epoch 119 | loss: 4.61865e-05 | val_loss: 4.80913e-05 | Time: 7099.46 ms
[2020-11-23 11:30:15	                main:574]	:	INFO	:	Epoch 120 | loss: 4.57543e-05 | val_loss: 4.91538e-05 | Time: 6862.23 ms
[2020-11-23 11:30:31	                main:574]	:	INFO	:	Epoch 121 | loss: 4.54691e-05 | val_loss: 4.89387e-05 | Time: 15630 ms
[2020-11-23 11:30:36	                main:574]	:	INFO	:	Epoch 122 | loss: 4.53309e-05 | val_loss: 4.75903e-05 | Time: 5523.1 ms
[2020-11-23 11:30:42	                main:574]	:	INFO	:	Epoch 123 | loss: 4.49332e-05 | val_loss: 4.8401e-05 | Time: 5434.08 ms
[2020-11-23 11:30:47	                main:574]	:	INFO	:	Epoch 124 | loss: 4.48243e-05 | val_loss: 4.83279e-05 | Time: 5414.77 ms
[2020-11-23 11:30:53	                main:574]	:	INFO	:	Epoch 125 | loss: 4.48948e-05 | val_loss: 4.82518e-05 | Time: 5503.01 ms
[2020-11-23 11:30:59	                main:574]	:	INFO	:	Epoch 126 | loss: 4.43924e-05 | val_loss: 4.81857e-05 | Time: 5468.17 ms
[2020-11-23 11:31:04	                main:574]	:	INFO	:	Epoch 127 | loss: 4.45044e-05 | val_loss: 4.74551e-05 | Time: 5468.44 ms
[2020-11-23 11:31:10	                main:574]	:	INFO	:	Epoch 128 | loss: 4.42663e-05 | val_loss: 4.74913e-05 | Time: 5444.26 ms
[2020-11-23 11:31:15	                main:574]	:	INFO	:	Epoch 129 | loss: 4.40994e-05 | val_loss: 4.65485e-05 | Time: 5516.52 ms
[2020-11-23 11:31:21	                main:574]	:	INFO	:	Epoch 130 | loss: 4.40333e-05 | val_loss: 4.65645e-05 | Time: 5403.78 ms
[2020-11-23 11:31:26	                main:574]	:	INFO	:	Epoch 131 | loss: 4.34021e-05 | val_loss: 4.62686e-05 | Time: 5551.69 ms
[2020-11-23 11:31:32	                main:574]	:	INFO	:	Epoch 132 | loss: 4.34659e-05 | val_loss: 4.65033e-05 | Time: 5501.69 ms
[2020-11-23 11:31:37	                main:574]	:	INFO	:	Epoch 133 | loss: 4.31884e-05 | val_loss: 4.5749e-05 | Time: 5647.68 ms
[2020-11-23 11:31:43	                main:574]	:	INFO	:	Epoch 134 | loss: 4.29143e-05 | val_loss: 4.5342e-05 | Time: 5390.23 ms
[2020-11-23 11:31:49	                main:574]	:	INFO	:	Epoch 135 | loss: 4.28715e-05 | val_loss: 4.58255e-05 | Time: 5578.23 ms
[2020-11-23 11:31:54	                main:574]	:	INFO	:	Epoch 136 | loss: 4.26976e-05 | val_loss: 4.57563e-05 | Time: 5495.55 ms
[2020-11-23 11:32:00	                main:574]	:	INFO	:	Epoch 137 | loss: 4.27178e-05 | val_loss: 4.4805e-05 | Time: 5537.59 ms
[2020-11-23 11:32:05	                main:574]	:	INFO	:	Epoch 138 | loss: 4.23941e-05 | val_loss: 4.48627e-05 | Time: 5490.91 ms
[2020-11-23 11:32:11	                main:574]	:	INFO	:	Epoch 139 | loss: 4.24217e-05 | val_loss: 4.50729e-05 | Time: 5435.97 ms
[2020-11-23 11:32:16	                main:574]	:	INFO	:	Epoch 140 | loss: 4.17848e-05 | val_loss: 4.44725e-05 | Time: 5480.75 ms
[2020-11-23 11:32:22	                main:574]	:	INFO	:	Epoch 141 | loss: 4.16914e-05 | val_loss: 4.44591e-05 | Time: 5547.13 ms
[2020-11-23 11:32:27	                main:574]	:	INFO	:	Epoch 142 | loss: 4.14951e-05 | val_loss: 4.48388e-05 | Time: 5415.02 ms
[2020-11-23 11:32:33	                main:574]	:	INFO	:	Epoch 143 | loss: 4.14035e-05 | val_loss: 4.4141e-05 | Time: 5324.57 ms
[2020-11-23 11:32:38	                main:574]	:	INFO	:	Epoch 144 | loss: 4.1665e-05 | val_loss: 4.4313e-05 | Time: 5525.57 ms
[2020-11-23 11:32:44	                main:574]	:	INFO	:	Epoch 145 | loss: 4.12445e-05 | val_loss: 4.33865e-05 | Time: 5525.08 ms
[2020-11-23 11:32:50	                main:574]	:	INFO	:	Epoch 146 | loss: 4.08374e-05 | val_loss: 4.40558e-05 | Time: 5490.33 ms
[2020-11-23 11:32:55	                main:574]	:	INFO	:	Epoch 147 | loss: 4.06431e-05 | val_loss: 4.28889e-05 | Time: 5579.53 ms
[2020-11-23 11:33:01	                main:574]	:	INFO	:	Epoch 148 | loss: 4.04761e-05 | val_loss: 4.29489e-05 | Time: 5630.51 ms
[2020-11-23 11:33:07	                main:574]	:	INFO	:	Epoch 149 | loss: 4.04447e-05 | val_loss: 4.32123e-05 | Time: 5498.53 ms
[2020-11-23 11:33:12	                main:574]	:	INFO	:	Epoch 150 | loss: 4.01985e-05 | val_loss: 4.29205e-05 | Time: 5517.07 ms
[2020-11-23 11:33:18	                main:574]	:	INFO	:	Epoch 151 | loss: 4.0003e-05 | val_loss: 4.27828e-05 | Time: 5474.5 ms
[2020-11-23 11:33:23	                main:574]	:	INFO	:	Epoch 152 | loss: 3.96763e-05 | val_loss: 4.22934e-05 | Time: 5621.96 ms
[2020-11-23 11:33:29	                main:574]	:	INFO	:	Epoch 153 | loss: 3.96898e-05 | val_loss: 4.27559e-05 | Time: 5527.14 ms
[2020-11-23 11:33:34	                main:574]	:	INFO	:	Epoch 154 | loss: 3.9652e-05 | val_loss: 4.23233e-05 | Time: 5430.61 ms
[2020-11-23 11:33:40	                main:574]	:	INFO	:	Epoch 155 | loss: 3.94339e-05 | val_loss: 4.23673e-05 | Time: 5417 ms
[2020-11-23 11:33:46	                main:574]	:	INFO	:	Epoch 156 | loss: 3.95388e-05 | val_loss: 4.28967e-05 | Time: 5540.99 ms
[2020-11-23 11:33:51	                main:574]	:	INFO	:	Epoch 157 | loss: 3.9067e-05 | val_loss: 4.16366e-05 | Time: 5448.92 ms
[2020-11-23 11:33:57	                main:574]	:	INFO	:	Epoch 158 | loss: 3.90279e-05 | val_loss: 4.193e-05 | Time: 5451.8 ms
[2020-11-23 11:34:04	                main:574]	:	INFO	:	Epoch 159 | loss: 3.87564e-05 | val_loss: 4.16358e-05 | Time: 6884.95 ms
[2020-11-23 11:34:10	                main:574]	:	INFO	:	Epoch 160 | loss: 3.88542e-05 | val_loss: 4.17697e-05 | Time: 5559 ms
[2020-11-23 11:34:15	                main:574]	:	INFO	:	Epoch 161 | loss: 3.8453e-05 | val_loss: 4.0099e-05 | Time: 5518.84 ms
[2020-11-23 11:34:21	                main:574]	:	INFO	:	Epoch 162 | loss: 3.81228e-05 | val_loss: 4.14611e-05 | Time: 5784.19 ms
[2020-11-23 11:34:27	                main:574]	:	INFO	:	Epoch 163 | loss: 3.83999e-05 | val_loss: 4.12488e-05 | Time: 5601.04 ms
[2020-11-23 11:34:32	                main:574]	:	INFO	:	Epoch 164 | loss: 3.82672e-05 | val_loss: 4.1225e-05 | Time: 5554.01 ms
[2020-11-23 11:34:38	                main:574]	:	INFO	:	Epoch 165 | loss: 3.81692e-05 | val_loss: 4.04707e-05 | Time: 5457.73 ms
[2020-11-23 11:34:43	                main:574]	:	INFO	:	Epoch 166 | loss: 3.76675e-05 | val_loss: 4.02732e-05 | Time: 5465.02 ms
[2020-11-23 11:34:49	                main:574]	:	INFO	:	Epoch 167 | loss: 3.749e-05 | val_loss: 3.97697e-05 | Time: 5483.41 ms
[2020-11-23 11:34:54	                main:574]	:	INFO	:	Epoch 168 | loss: 3.74247e-05 | val_loss: 4.01692e-05 | Time: 5393.75 ms
[2020-11-23 11:35:00	                main:574]	:	INFO	:	Epoch 169 | loss: 3.7597e-05 | val_loss: 3.94617e-05 | Time: 5468.44 ms
[2020-11-23 11:35:05	                main:574]	:	INFO	:	Epoch 170 | loss: 3.72607e-05 | val_loss: 3.95905e-05 | Time: 5326.03 ms
[2020-11-23 11:35:11	                main:574]	:	INFO	:	Epoch 171 | loss: 3.73473e-05 | val_loss: 3.99409e-05 | Time: 5519.43 ms
[2020-11-23 11:35:16	                main:574]	:	INFO	:	Epoch 172 | loss: 3.70389e-05 | val_loss: 4.00251e-05 | Time: 5511.95 ms
[2020-11-23 11:35:22	                main:574]	:	INFO	:	Epoch 173 | loss: 3.6757e-05 | val_loss: 3.96211e-05 | Time: 5420.96 ms
[2020-11-23 11:35:27	                main:574]	:	INFO	:	Epoch 174 | loss: 3.6806e-05 | val_loss: 3.93372e-05 | Time: 5452.08 ms
[2020-11-23 11:35:33	                main:574]	:	INFO	:	Epoch 175 | loss: 3.65585e-05 | val_loss: 3.89786e-05 | Time: 5522.01 ms
[2020-11-23 11:35:39	                main:574]	:	INFO	:	Epoch 176 | loss: 3.6309e-05 | val_loss: 3.91658e-05 | Time: 5424.56 ms
[2020-11-23 11:35:44	                main:574]	:	INFO	:	Epoch 177 | loss: 3.62155e-05 | val_loss: 3.8714e-05 | Time: 5469.25 ms
[2020-11-23 11:35:50	                main:574]	:	INFO	:	Epoch 178 | loss: 3.62625e-05 | val_loss: 3.9298e-05 | Time: 5478.52 ms
[2020-11-23 11:35:55	                main:574]	:	INFO	:	Epoch 179 | loss: 3.61638e-05 | val_loss: 3.85618e-05 | Time: 5481.52 ms
[2020-11-23 11:36:01	                main:574]	:	INFO	:	Epoch 180 | loss: 3.56671e-05 | val_loss: 3.89112e-05 | Time: 5474.53 ms
[2020-11-23 11:36:06	                main:574]	:	INFO	:	Epoch 181 | loss: 3.58547e-05 | val_loss: 3.83618e-05 | Time: 5518.68 ms
[2020-11-23 11:36:12	                main:574]	:	INFO	:	Epoch 182 | loss: 3.56269e-05 | val_loss: 3.80998e-05 | Time: 5450.63 ms
[2020-11-23 11:36:18	                main:574]	:	INFO	:	Epoch 183 | loss: 3.56358e-05 | val_loss: 3.77008e-05 | Time: 5625.81 ms
[2020-11-23 11:36:23	                main:574]	:	INFO	:	Epoch 184 | loss: 3.54743e-05 | val_loss: 3.87937e-05 | Time: 5818.9 ms
[2020-11-23 11:36:29	                main:574]	:	INFO	:	Epoch 185 | loss: 3.53104e-05 | val_loss: 3.84546e-05 | Time: 5552.26 ms
[2020-11-23 11:36:35	                main:574]	:	INFO	:	Epoch 186 | loss: 3.51602e-05 | val_loss: 3.74254e-05 | Time: 5451.06 ms
[2020-11-23 11:36:40	                main:574]	:	INFO	:	Epoch 187 | loss: 3.48963e-05 | val_loss: 3.74578e-05 | Time: 5463.69 ms
[2020-11-23 11:36:46	                main:574]	:	INFO	:	Epoch 188 | loss: 3.47385e-05 | val_loss: 3.73464e-05 | Time: 5578.91 ms
[2020-11-23 11:36:51	                main:574]	:	INFO	:	Epoch 189 | loss: 3.47675e-05 | val_loss: 3.76139e-05 | Time: 5631.71 ms
[2020-11-23 11:36:57	                main:574]	:	INFO	:	Epoch 190 | loss: 3.45865e-05 | val_loss: 3.76423e-05 | Time: 5301.03 ms
[2020-11-23 11:37:02	                main:574]	:	INFO	:	Epoch 191 | loss: 3.44392e-05 | val_loss: 3.68335e-05 | Time: 5367.03 ms
[2020-11-23 11:37:08	                main:574]	:	INFO	:	Epoch 192 | loss: 3.43564e-05 | val_loss: 3.78955e-05 | Time: 5415.56 ms
[2020-11-23 11:37:08	                main:597]	:	INFO	:	Saving trained model to model-final.pt, val_loss 3.78955e-05
[2020-11-23 11:37:08	                main:603]	:	INFO	:	Saving end state to config to file
[2020-11-23 11:37:08	                main:608]	:	INFO	:	Success, exiting..
11:37:08 (15500): called boinc_finish(0)

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)