Task 2965301

Name rand_automata_0027-1605110213-3826-2_1
Workunit 1339406
Created 16 Nov 2020, 3:02:15 UTC
Sent 22 Nov 2020, 16:40:04 UTC
Report deadline 29 Nov 2020, 16:40:04 UTC
Received 23 Nov 2020, 4:04:58 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 4439
Run time 3 hours 0 min 20 sec
CPU time 2 hours 57 min 21 sec
Validate state Valid
Credit 959.40
Device peak FLOPS 4,458.60 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.96 GB
Peak swap size 3.06 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.11</core_client_version>
<![CDATA[
<stderr_txt>
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 1650 SUPER)
[2020-11-22 19:03:35	                main:435]	:	INFO	:	Set logging level to 1
[2020-11-22 19:03:35	                main:441]	:	INFO	:	Running in BOINC Client mode
[2020-11-22 19:03:35	                main:444]	:	INFO	:	Resolving all filenames
[2020-11-22 19:03:35	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0027-train-val-dataset.hdf5 (exists = 1)
[2020-11-22 19:03:35	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0027-1605110213-3826-2_1_r137332552_1 (exists = 0)
[2020-11-22 19:03:35	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0027-1605110213-3826-2_1_r137332552_0 (exists = 0)
[2020-11-22 19:03:35	                main:452]	:	INFO	:	Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0027-1605110213-3826-2 (exists = 1)
[2020-11-22 19:03:35	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2020-11-22 19:03:35	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/rand_automata_0027-train-val-dataset.hdf5
[2020-11-22 19:03:35	                main:474]	:	INFO	:	Configuration: 
[2020-11-22 19:03:35	                main:475]	:	INFO	:	    Model type: LSTM
[2020-11-22 19:03:35	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2020-11-22 19:03:35	                main:477]	:	INFO	:	    Max Epochs: 192
[2020-11-22 19:03:35	                main:478]	:	INFO	:	    Batch Size: 32
[2020-11-22 19:03:35	                main:479]	:	INFO	:	    Learning Rate: 0.001
[2020-11-22 19:03:35	                main:480]	:	INFO	:	    Patience: 10
[2020-11-22 19:03:35	                main:481]	:	INFO	:	    Hidden Width: 64
[2020-11-22 19:03:35	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2020-11-22 19:03:35	                main:483]	:	INFO	:	    # Backend Layers: 2
[2020-11-22 19:03:35	                main:484]	:	INFO	:	    # Threads: 1
[2020-11-22 19:03:35	                main:486]	:	INFO	:	Preparing Dataset
[2020-11-22 19:03:35	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0027-train-val-dataset.hdf5 into memory
[2020-11-22 19:03:35	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0027-train-val-dataset.hdf5 into memory
[2020-11-22 19:03:37	                load:106]	:	INFO	:	Successfully loaded dataset of 4096 examples into memory.
[2020-11-22 19:03:37	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0027-train-val-dataset.hdf5 into memory
[2020-11-22 19:03:37	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0027-train-val-dataset.hdf5 into memory
[2020-11-22 19:03:37	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2020-11-22 19:03:37	                main:494]	:	INFO	:	Creating Model
[2020-11-22 19:03:37	                main:507]	:	INFO	:	Preparing config file
[2020-11-22 19:03:37	                main:519]	:	INFO	:	Creating new config file
[2020-11-22 19:03:37	                main:538]	:	INFO	:	This is a continuation WU, loading previous network
[2020-11-22 19:03:39	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2020-11-22 19:03:39	                main:562]	:	INFO	:	Starting Training
[2020-11-22 19:04:35	                main:574]	:	INFO	:	Epoch 1 | loss: 0.000801565 | val_loss: 0.000757256 | Time: 55501.8 ms
[2020-11-22 19:05:30	                main:574]	:	INFO	:	Epoch 2 | loss: 0.000723798 | val_loss: 0.000695825 | Time: 55256 ms
[2020-11-22 19:06:25	                main:574]	:	INFO	:	Epoch 3 | loss: 0.000667427 | val_loss: 0.000642766 | Time: 55026.3 ms
[2020-11-22 19:07:20	                main:574]	:	INFO	:	Epoch 4 | loss: 0.000617088 | val_loss: 0.000594415 | Time: 55039.6 ms
[2020-11-22 19:08:15	                main:574]	:	INFO	:	Epoch 5 | loss: 0.000572901 | val_loss: 0.000554416 | Time: 55168.3 ms
[2020-11-22 19:09:10	                main:574]	:	INFO	:	Epoch 6 | loss: 0.000534983 | val_loss: 0.000517668 | Time: 55045.6 ms
[2020-11-22 19:10:06	                main:574]	:	INFO	:	Epoch 7 | loss: 0.000501251 | val_loss: 0.000486442 | Time: 55077.1 ms
[2020-11-22 19:11:02	                main:574]	:	INFO	:	Epoch 8 | loss: 0.000471106 | val_loss: 0.000458576 | Time: 56120.4 ms
[2020-11-22 19:11:58	                main:574]	:	INFO	:	Epoch 9 | loss: 0.000444114 | val_loss: 0.000432249 | Time: 56657.8 ms
[2020-11-22 19:12:55	                main:574]	:	INFO	:	Epoch 10 | loss: 0.000419958 | val_loss: 0.000410056 | Time: 56646.2 ms
[2020-11-22 19:13:52	                main:574]	:	INFO	:	Epoch 11 | loss: 0.000398213 | val_loss: 0.000387261 | Time: 56761.3 ms
[2020-11-22 19:14:48	                main:574]	:	INFO	:	Epoch 12 | loss: 0.000378495 | val_loss: 0.000370515 | Time: 56629.5 ms
[2020-11-22 19:15:45	                main:574]	:	INFO	:	Epoch 13 | loss: 0.000360796 | val_loss: 0.000353627 | Time: 56645.8 ms
[2020-11-22 19:16:42	                main:574]	:	INFO	:	Epoch 14 | loss: 0.000344461 | val_loss: 0.000337138 | Time: 56525 ms
[2020-11-22 19:17:38	                main:574]	:	INFO	:	Epoch 15 | loss: 0.000328742 | val_loss: 0.000322154 | Time: 56705.8 ms
[2020-11-22 19:18:35	                main:574]	:	INFO	:	Epoch 16 | loss: 0.000314881 | val_loss: 0.000308335 | Time: 56563.2 ms
[2020-11-22 19:19:32	                main:574]	:	INFO	:	Epoch 17 | loss: 0.000301698 | val_loss: 0.000296782 | Time: 56595.5 ms
[2020-11-22 19:20:28	                main:574]	:	INFO	:	Epoch 18 | loss: 0.000290062 | val_loss: 0.000283956 | Time: 56567.1 ms
[2020-11-22 19:21:25	                main:574]	:	INFO	:	Epoch 19 | loss: 0.000278824 | val_loss: 0.000272992 | Time: 56582.9 ms
[2020-11-22 19:22:22	                main:574]	:	INFO	:	Epoch 20 | loss: 0.000267362 | val_loss: 0.000264498 | Time: 56854.6 ms
[2020-11-22 19:23:18	                main:574]	:	INFO	:	Epoch 21 | loss: 0.000258178 | val_loss: 0.000254682 | Time: 56583.1 ms
[2020-11-22 19:24:15	                main:574]	:	INFO	:	Epoch 22 | loss: 0.000248556 | val_loss: 0.000244056 | Time: 56607 ms
[2020-11-22 19:25:11	                main:574]	:	INFO	:	Epoch 23 | loss: 0.000240298 | val_loss: 0.000236355 | Time: 56649.3 ms
[2020-11-22 19:26:07	                main:574]	:	INFO	:	Epoch 24 | loss: 0.000231953 | val_loss: 0.0002282 | Time: 55164.6 ms
[2020-11-22 19:27:02	                main:574]	:	INFO	:	Epoch 25 | loss: 0.000224608 | val_loss: 0.00022286 | Time: 55113.3 ms
[2020-11-22 19:27:57	                main:574]	:	INFO	:	Epoch 26 | loss: 0.000217608 | val_loss: 0.000213788 | Time: 55073.6 ms
[2020-11-22 19:28:52	                main:574]	:	INFO	:	Epoch 27 | loss: 0.000211053 | val_loss: 0.000208816 | Time: 55033.1 ms
[2020-11-22 19:29:47	                main:574]	:	INFO	:	Epoch 28 | loss: 0.000203958 | val_loss: 0.00020222 | Time: 55034 ms
[2020-11-22 19:30:42	                main:574]	:	INFO	:	Epoch 29 | loss: 0.000198444 | val_loss: 0.000196198 | Time: 55258.1 ms
[2020-11-22 19:31:37	                main:574]	:	INFO	:	Epoch 30 | loss: 0.000192452 | val_loss: 0.000190369 | Time: 54966.5 ms
[2020-11-22 19:32:32	                main:574]	:	INFO	:	Epoch 31 | loss: 0.000187324 | val_loss: 0.00018396 | Time: 55043.1 ms
[2020-11-22 19:33:28	                main:574]	:	INFO	:	Epoch 32 | loss: 0.000181872 | val_loss: 0.000180146 | Time: 55238.6 ms
[2020-11-22 19:34:23	                main:574]	:	INFO	:	Epoch 33 | loss: 0.000177005 | val_loss: 0.000175635 | Time: 54949.9 ms
[2020-11-22 19:35:18	                main:574]	:	INFO	:	Epoch 34 | loss: 0.000172364 | val_loss: 0.000170869 | Time: 55307.3 ms
[2020-11-22 19:36:13	                main:574]	:	INFO	:	Epoch 35 | loss: 0.000167672 | val_loss: 0.000165623 | Time: 55185 ms
[2020-11-22 19:37:08	                main:574]	:	INFO	:	Epoch 36 | loss: 0.000163181 | val_loss: 0.000162413 | Time: 55299.3 ms
[2020-11-22 19:38:03	                main:574]	:	INFO	:	Epoch 37 | loss: 0.000159417 | val_loss: 0.000157678 | Time: 54996.5 ms
[2020-11-22 19:38:59	                main:574]	:	INFO	:	Epoch 38 | loss: 0.000155528 | val_loss: 0.000154308 | Time: 55123.2 ms
[2020-11-22 19:39:54	                main:574]	:	INFO	:	Epoch 39 | loss: 0.000151972 | val_loss: 0.000150888 | Time: 55324.8 ms
[2020-11-22 19:40:50	                main:574]	:	INFO	:	Epoch 40 | loss: 0.0001479 | val_loss: 0.000147122 | Time: 55725.1 ms
[2020-11-22 19:41:45	                main:574]	:	INFO	:	Epoch 41 | loss: 0.000144466 | val_loss: 0.000143392 | Time: 55047.5 ms
[2020-11-22 19:42:40	                main:574]	:	INFO	:	Epoch 42 | loss: 0.000141154 | val_loss: 0.000140653 | Time: 55229.9 ms
[2020-11-22 19:43:35	                main:574]	:	INFO	:	Epoch 43 | loss: 0.000137941 | val_loss: 0.000136264 | Time: 55311.7 ms
[2020-11-22 19:44:31	                main:574]	:	INFO	:	Epoch 44 | loss: 0.000135097 | val_loss: 0.000134742 | Time: 55674.9 ms
[2020-11-22 19:45:26	                main:574]	:	INFO	:	Epoch 45 | loss: 0.000132279 | val_loss: 0.000130971 | Time: 55389.9 ms
[2020-11-22 19:46:22	                main:574]	:	INFO	:	Epoch 46 | loss: 0.000129842 | val_loss: 0.000128968 | Time: 55347.1 ms
[2020-11-22 19:47:17	                main:574]	:	INFO	:	Epoch 47 | loss: 0.00012691 | val_loss: 0.000126162 | Time: 55210.3 ms
[2020-11-22 19:48:12	                main:574]	:	INFO	:	Epoch 48 | loss: 0.000124327 | val_loss: 0.00012407 | Time: 55449 ms
[2020-11-22 19:49:08	                main:574]	:	INFO	:	Epoch 49 | loss: 0.000121931 | val_loss: 0.00012108 | Time: 55292.4 ms
[2020-11-22 19:50:03	                main:574]	:	INFO	:	Epoch 50 | loss: 0.000119562 | val_loss: 0.00011919 | Time: 55277.1 ms
[2020-11-22 19:50:59	                main:574]	:	INFO	:	Epoch 51 | loss: 0.000117275 | val_loss: 0.000116183 | Time: 55576.3 ms
[2020-11-22 19:51:54	                main:574]	:	INFO	:	Epoch 52 | loss: 0.000114841 | val_loss: 0.000114151 | Time: 55319 ms
[2020-11-22 19:52:50	                main:574]	:	INFO	:	Epoch 53 | loss: 0.000113191 | val_loss: 0.00011439 | Time: 55533.7 ms
[2020-11-22 19:53:45	                main:574]	:	INFO	:	Epoch 54 | loss: 0.000110607 | val_loss: 0.000110632 | Time: 55233.6 ms
[2020-11-22 19:54:40	                main:574]	:	INFO	:	Epoch 55 | loss: 0.000109099 | val_loss: 0.000108804 | Time: 55341 ms
[2020-11-22 19:55:35	                main:574]	:	INFO	:	Epoch 56 | loss: 0.000107083 | val_loss: 0.000107823 | Time: 55335.2 ms
[2020-11-22 19:56:31	                main:574]	:	INFO	:	Epoch 57 | loss: 0.000105263 | val_loss: 0.000104397 | Time: 55546.7 ms
[2020-11-22 19:57:26	                main:574]	:	INFO	:	Epoch 58 | loss: 0.000103567 | val_loss: 0.000103533 | Time: 55367.9 ms
[2020-11-22 19:58:22	                main:574]	:	INFO	:	Epoch 59 | loss: 0.000101665 | val_loss: 0.000101702 | Time: 55486 ms
[2020-11-22 19:59:17	                main:574]	:	INFO	:	Epoch 60 | loss: 9.97312e-05 | val_loss: 9.99693e-05 | Time: 55469.5 ms
[2020-11-22 20:00:13	                main:574]	:	INFO	:	Epoch 61 | loss: 9.83927e-05 | val_loss: 9.80143e-05 | Time: 55339.6 ms
[2020-11-22 20:01:08	                main:574]	:	INFO	:	Epoch 62 | loss: 9.69334e-05 | val_loss: 9.79097e-05 | Time: 55270.8 ms
[2020-11-22 20:02:03	                main:574]	:	INFO	:	Epoch 63 | loss: 9.52887e-05 | val_loss: 9.51283e-05 | Time: 55416 ms
[2020-11-22 20:02:59	                main:574]	:	INFO	:	Epoch 64 | loss: 9.3641e-05 | val_loss: 9.49315e-05 | Time: 55238 ms
[2020-11-22 20:03:54	                main:574]	:	INFO	:	Epoch 65 | loss: 9.24882e-05 | val_loss: 9.14406e-05 | Time: 55505.6 ms
[2020-11-22 20:04:50	                main:574]	:	INFO	:	Epoch 66 | loss: 9.09749e-05 | val_loss: 9.11174e-05 | Time: 55288.3 ms
[2020-11-22 20:05:45	                main:574]	:	INFO	:	Epoch 67 | loss: 8.96142e-05 | val_loss: 8.9604e-05 | Time: 55556.9 ms
[2020-11-22 20:06:40	                main:574]	:	INFO	:	Epoch 68 | loss: 8.85039e-05 | val_loss: 9.03301e-05 | Time: 55223.6 ms
[2020-11-22 20:07:36	                main:574]	:	INFO	:	Epoch 69 | loss: 8.70522e-05 | val_loss: 8.68105e-05 | Time: 55309.7 ms
[2020-11-22 20:08:31	                main:574]	:	INFO	:	Epoch 70 | loss: 8.55692e-05 | val_loss: 8.578e-05 | Time: 55371.5 ms
[2020-11-22 20:09:27	                main:574]	:	INFO	:	Epoch 71 | loss: 8.46597e-05 | val_loss: 8.41677e-05 | Time: 55485.2 ms
[2020-11-22 20:10:22	                main:574]	:	INFO	:	Epoch 72 | loss: 8.32044e-05 | val_loss: 8.44007e-05 | Time: 55463.9 ms
[2020-11-22 20:11:19	                main:574]	:	INFO	:	Epoch 73 | loss: 8.26021e-05 | val_loss: 8.20865e-05 | Time: 56926.7 ms
[2020-11-22 20:12:16	                main:574]	:	INFO	:	Epoch 74 | loss: 8.10716e-05 | val_loss: 8.0592e-05 | Time: 56820.5 ms
[2020-11-22 20:13:13	                main:574]	:	INFO	:	Epoch 75 | loss: 7.98424e-05 | val_loss: 8.09853e-05 | Time: 56940.6 ms
[2020-11-22 20:14:11	                main:574]	:	INFO	:	Epoch 76 | loss: 7.90006e-05 | val_loss: 7.89591e-05 | Time: 58095.8 ms
[2020-11-22 20:15:09	                main:574]	:	INFO	:	Epoch 77 | loss: 7.78713e-05 | val_loss: 7.80047e-05 | Time: 58368.8 ms
[2020-11-22 20:16:06	                main:574]	:	INFO	:	Epoch 78 | loss: 7.71126e-05 | val_loss: 7.70454e-05 | Time: 57017.6 ms
[2020-11-22 20:17:04	                main:574]	:	INFO	:	Epoch 79 | loss: 7.6026e-05 | val_loss: 7.60732e-05 | Time: 57164.4 ms
[2020-11-22 20:18:08	                main:574]	:	INFO	:	Epoch 80 | loss: 7.5023e-05 | val_loss: 7.57843e-05 | Time: 64264.5 ms
[2020-11-22 20:19:10	                main:574]	:	INFO	:	Epoch 81 | loss: 7.39901e-05 | val_loss: 7.42097e-05 | Time: 62072.9 ms
[2020-11-22 20:20:10	                main:574]	:	INFO	:	Epoch 82 | loss: 7.32475e-05 | val_loss: 7.43594e-05 | Time: 59858.3 ms
[2020-11-22 20:21:09	                main:574]	:	INFO	:	Epoch 83 | loss: 7.22249e-05 | val_loss: 7.35958e-05 | Time: 59519.3 ms
[2020-11-22 20:22:08	                main:574]	:	INFO	:	Epoch 84 | loss: 7.13991e-05 | val_loss: 7.04168e-05 | Time: 58777.5 ms
[2020-11-22 20:23:07	                main:574]	:	INFO	:	Epoch 85 | loss: 7.03892e-05 | val_loss: 7.0955e-05 | Time: 59233.8 ms
[2020-11-22 20:24:09	                main:574]	:	INFO	:	Epoch 86 | loss: 6.95721e-05 | val_loss: 7.08801e-05 | Time: 61521 ms
[2020-11-22 20:25:09	                main:574]	:	INFO	:	Epoch 87 | loss: 6.9148e-05 | val_loss: 6.86738e-05 | Time: 59772.7 ms
[2020-11-22 20:26:06	                main:574]	:	INFO	:	Epoch 88 | loss: 6.79198e-05 | val_loss: 6.7783e-05 | Time: 57626.3 ms
[2020-11-22 20:27:09	                main:574]	:	INFO	:	Epoch 89 | loss: 6.70443e-05 | val_loss: 6.72756e-05 | Time: 62943.7 ms
[2020-11-22 20:28:13	                main:574]	:	INFO	:	Epoch 90 | loss: 6.64785e-05 | val_loss: 6.605e-05 | Time: 63206.3 ms
[2020-11-22 20:29:14	                main:574]	:	INFO	:	Epoch 91 | loss: 6.55645e-05 | val_loss: 6.52693e-05 | Time: 61236.1 ms
[2020-11-22 20:30:15	                main:574]	:	INFO	:	Epoch 92 | loss: 6.52892e-05 | val_loss: 6.5222e-05 | Time: 61455.8 ms
[2020-11-22 20:31:15	                main:574]	:	INFO	:	Epoch 93 | loss: 6.40632e-05 | val_loss: 6.5733e-05 | Time: 59839.6 ms
[2020-11-22 20:32:12	                main:574]	:	INFO	:	Epoch 94 | loss: 6.36379e-05 | val_loss: 6.38876e-05 | Time: 56951.4 ms
[2020-11-22 20:33:10	                main:574]	:	INFO	:	Epoch 95 | loss: 6.32431e-05 | val_loss: 6.30953e-05 | Time: 57800.5 ms
[2020-11-22 20:34:06	                main:574]	:	INFO	:	Epoch 96 | loss: 6.22112e-05 | val_loss: 6.41184e-05 | Time: 55682.7 ms
[2020-11-22 20:35:01	                main:574]	:	INFO	:	Epoch 97 | loss: 6.17892e-05 | val_loss: 6.21881e-05 | Time: 55478.4 ms
[2020-11-22 20:35:56	                main:574]	:	INFO	:	Epoch 98 | loss: 6.10783e-05 | val_loss: 6.19021e-05 | Time: 55165.1 ms
[2020-11-22 20:36:57	                main:574]	:	INFO	:	Epoch 99 | loss: 6.05047e-05 | val_loss: 6.14092e-05 | Time: 60949.9 ms
[2020-11-22 20:37:55	                main:574]	:	INFO	:	Epoch 100 | loss: 5.98028e-05 | val_loss: 6.03677e-05 | Time: 57644.9 ms
[2020-11-22 20:38:53	                main:574]	:	INFO	:	Epoch 101 | loss: 5.91579e-05 | val_loss: 5.93364e-05 | Time: 57662.6 ms
[2020-11-22 20:39:49	                main:574]	:	INFO	:	Epoch 102 | loss: 5.8417e-05 | val_loss: 5.89549e-05 | Time: 55960.1 ms
[2020-11-22 20:40:45	                main:574]	:	INFO	:	Epoch 103 | loss: 5.81474e-05 | val_loss: 5.83963e-05 | Time: 55883.4 ms
[2020-11-22 20:41:41	                main:574]	:	INFO	:	Epoch 104 | loss: 5.73017e-05 | val_loss: 5.89195e-05 | Time: 56968.8 ms
[2020-11-22 20:42:41	                main:574]	:	INFO	:	Epoch 105 | loss: 5.71049e-05 | val_loss: 5.74888e-05 | Time: 59048.8 ms
[2020-11-22 20:43:44	                main:574]	:	INFO	:	Epoch 106 | loss: 5.61856e-05 | val_loss: 5.64424e-05 | Time: 63907.7 ms
[2020-11-22 20:44:47	                main:574]	:	INFO	:	Epoch 107 | loss: 5.61626e-05 | val_loss: 5.5849e-05 | Time: 62691.4 ms
[2020-11-22 20:45:46	                main:574]	:	INFO	:	Epoch 108 | loss: 5.5134e-05 | val_loss: 5.56872e-05 | Time: 58599.7 ms
[2020-11-22 20:46:43	                main:574]	:	INFO	:	Epoch 109 | loss: 5.45414e-05 | val_loss: 5.51004e-05 | Time: 57190.3 ms
[2020-11-22 20:47:39	                main:574]	:	INFO	:	Epoch 110 | loss: 5.42309e-05 | val_loss: 5.52417e-05 | Time: 56047.2 ms
[2020-11-22 20:48:41	                main:574]	:	INFO	:	Epoch 111 | loss: 5.38716e-05 | val_loss: 5.42896e-05 | Time: 61581.6 ms
[2020-11-22 20:49:44	                main:574]	:	INFO	:	Epoch 112 | loss: 5.31371e-05 | val_loss: 5.41922e-05 | Time: 63453.5 ms
[2020-11-22 20:50:41	                main:574]	:	INFO	:	Epoch 113 | loss: 5.3109e-05 | val_loss: 5.32553e-05 | Time: 56817.8 ms
[2020-11-22 20:51:39	                main:574]	:	INFO	:	Epoch 114 | loss: 5.23314e-05 | val_loss: 5.28751e-05 | Time: 57720.3 ms
[2020-11-22 20:52:39	                main:574]	:	INFO	:	Epoch 115 | loss: 5.2e-05 | val_loss: 5.21354e-05 | Time: 59990.2 ms
[2020-11-22 20:53:36	                main:574]	:	INFO	:	Epoch 116 | loss: 5.14293e-05 | val_loss: 5.17862e-05 | Time: 57003 ms
[2020-11-22 20:54:34	                main:574]	:	INFO	:	Epoch 117 | loss: 5.10313e-05 | val_loss: 5.10996e-05 | Time: 57776.9 ms
[2020-11-22 20:55:32	                main:574]	:	INFO	:	Epoch 118 | loss: 5.03872e-05 | val_loss: 5.12634e-05 | Time: 58323.4 ms
[2020-11-22 20:56:30	                main:574]	:	INFO	:	Epoch 119 | loss: 5.00861e-05 | val_loss: 5.11607e-05 | Time: 57777.6 ms
[2020-11-22 20:57:26	                main:574]	:	INFO	:	Epoch 120 | loss: 4.99284e-05 | val_loss: 5.06725e-05 | Time: 56108 ms
[2020-11-22 20:58:21	                main:574]	:	INFO	:	Epoch 121 | loss: 4.93265e-05 | val_loss: 4.93702e-05 | Time: 55336.1 ms
[2020-11-22 20:59:17	                main:574]	:	INFO	:	Epoch 122 | loss: 4.90466e-05 | val_loss: 4.97712e-05 | Time: 55466.5 ms
[2020-11-22 21:00:12	                main:574]	:	INFO	:	Epoch 123 | loss: 4.84866e-05 | val_loss: 4.88102e-05 | Time: 55331.7 ms
[2020-11-22 21:01:08	                main:574]	:	INFO	:	Epoch 124 | loss: 4.81982e-05 | val_loss: 4.82047e-05 | Time: 55634.3 ms
[2020-11-22 21:02:03	                main:574]	:	INFO	:	Epoch 125 | loss: 4.77664e-05 | val_loss: 4.92137e-05 | Time: 55375.5 ms
[2020-11-22 21:02:58	                main:574]	:	INFO	:	Epoch 126 | loss: 4.72603e-05 | val_loss: 4.78785e-05 | Time: 55418.8 ms
[2020-11-22 21:03:54	                main:574]	:	INFO	:	Epoch 127 | loss: 4.71624e-05 | val_loss: 4.76707e-05 | Time: 55331 ms
[2020-11-22 21:04:49	                main:574]	:	INFO	:	Epoch 128 | loss: 4.66484e-05 | val_loss: 4.79006e-05 | Time: 55595.9 ms
[2020-11-22 21:05:45	                main:574]	:	INFO	:	Epoch 129 | loss: 4.63692e-05 | val_loss: 4.67012e-05 | Time: 55435.4 ms
[2020-11-22 21:06:40	                main:574]	:	INFO	:	Epoch 130 | loss: 4.60057e-05 | val_loss: 4.62582e-05 | Time: 55508.3 ms
[2020-11-22 21:07:36	                main:574]	:	INFO	:	Epoch 131 | loss: 4.5396e-05 | val_loss: 4.6664e-05 | Time: 55371.1 ms
[2020-11-22 21:08:31	                main:574]	:	INFO	:	Epoch 132 | loss: 4.54395e-05 | val_loss: 4.64583e-05 | Time: 55433.9 ms
[2020-11-22 21:09:27	                main:574]	:	INFO	:	Epoch 133 | loss: 4.50237e-05 | val_loss: 4.5198e-05 | Time: 55237 ms
[2020-11-22 21:10:22	                main:574]	:	INFO	:	Epoch 134 | loss: 4.46917e-05 | val_loss: 4.53837e-05 | Time: 55251.5 ms
[2020-11-22 21:11:17	                main:574]	:	INFO	:	Epoch 135 | loss: 4.43776e-05 | val_loss: 4.57376e-05 | Time: 55386.5 ms
[2020-11-22 21:12:12	                main:574]	:	INFO	:	Epoch 136 | loss: 4.3842e-05 | val_loss: 4.43346e-05 | Time: 55291.4 ms
[2020-11-22 21:13:08	                main:574]	:	INFO	:	Epoch 137 | loss: 4.36151e-05 | val_loss: 4.76184e-05 | Time: 55303 ms
[2020-11-22 21:14:03	                main:574]	:	INFO	:	Epoch 138 | loss: 4.3429e-05 | val_loss: 4.3803e-05 | Time: 55517.3 ms
[2020-11-22 21:14:59	                main:574]	:	INFO	:	Epoch 139 | loss: 4.3004e-05 | val_loss: 4.39175e-05 | Time: 55356.7 ms
[2020-11-22 21:15:54	                main:574]	:	INFO	:	Epoch 140 | loss: 4.26399e-05 | val_loss: 4.31872e-05 | Time: 55341.1 ms
[2020-11-22 21:16:49	                main:574]	:	INFO	:	Epoch 141 | loss: 4.23222e-05 | val_loss: 4.37613e-05 | Time: 55401.8 ms
[2020-11-22 21:17:45	                main:574]	:	INFO	:	Epoch 142 | loss: 4.23384e-05 | val_loss: 4.33043e-05 | Time: 55363.6 ms
[2020-11-22 21:18:40	                main:574]	:	INFO	:	Epoch 143 | loss: 4.18631e-05 | val_loss: 4.21287e-05 | Time: 55234.3 ms
[2020-11-22 21:19:35	                main:574]	:	INFO	:	Epoch 144 | loss: 4.14129e-05 | val_loss: 4.33157e-05 | Time: 55295.7 ms
[2020-11-22 21:20:31	                main:574]	:	INFO	:	Epoch 145 | loss: 4.13353e-05 | val_loss: 4.20841e-05 | Time: 55250.5 ms
[2020-11-22 21:21:26	                main:574]	:	INFO	:	Epoch 146 | loss: 4.09929e-05 | val_loss: 4.14743e-05 | Time: 55254.6 ms
[2020-11-22 21:22:21	                main:574]	:	INFO	:	Epoch 147 | loss: 4.07189e-05 | val_loss: 4.18117e-05 | Time: 55389.4 ms
[2020-11-22 21:23:17	                main:574]	:	INFO	:	Epoch 148 | loss: 4.05263e-05 | val_loss: 4.13396e-05 | Time: 55240.4 ms
[2020-11-22 21:24:12	                main:574]	:	INFO	:	Epoch 149 | loss: 4.02802e-05 | val_loss: 4.12089e-05 | Time: 55190.1 ms
[2020-11-22 21:25:07	                main:574]	:	INFO	:	Epoch 150 | loss: 4.02139e-05 | val_loss: 4.05893e-05 | Time: 55238.7 ms
[2020-11-22 21:26:02	                main:574]	:	INFO	:	Epoch 151 | loss: 3.97636e-05 | val_loss: 3.95217e-05 | Time: 55162.2 ms
[2020-11-22 21:26:57	                main:574]	:	INFO	:	Epoch 152 | loss: 3.92877e-05 | val_loss: 4.00729e-05 | Time: 55063.9 ms
[2020-11-22 21:27:53	                main:574]	:	INFO	:	Epoch 153 | loss: 3.90884e-05 | val_loss: 4.02954e-05 | Time: 55411.8 ms
[2020-11-22 21:28:48	                main:574]	:	INFO	:	Epoch 154 | loss: 3.88162e-05 | val_loss: 3.94509e-05 | Time: 55267.9 ms
[2020-11-22 21:29:43	                main:574]	:	INFO	:	Epoch 155 | loss: 3.8666e-05 | val_loss: 3.89411e-05 | Time: 55272.1 ms
[2020-11-22 21:30:39	                main:574]	:	INFO	:	Epoch 156 | loss: 3.84081e-05 | val_loss: 4.03312e-05 | Time: 55213.5 ms
[2020-11-22 21:31:34	                main:574]	:	INFO	:	Epoch 157 | loss: 3.85246e-05 | val_loss: 3.91156e-05 | Time: 55293.7 ms
[2020-11-22 21:32:29	                main:574]	:	INFO	:	Epoch 158 | loss: 3.8032e-05 | val_loss: 3.78915e-05 | Time: 55284 ms
[2020-11-22 21:33:25	                main:574]	:	INFO	:	Epoch 159 | loss: 3.7794e-05 | val_loss: 3.88031e-05 | Time: 55337.6 ms
[2020-11-22 21:34:20	                main:574]	:	INFO	:	Epoch 160 | loss: 3.75861e-05 | val_loss: 3.7494e-05 | Time: 55191.2 ms
[2020-11-22 21:35:15	                main:574]	:	INFO	:	Epoch 161 | loss: 3.72623e-05 | val_loss: 3.79977e-05 | Time: 55213.7 ms
[2020-11-22 21:36:10	                main:574]	:	INFO	:	Epoch 162 | loss: 3.71254e-05 | val_loss: 3.77545e-05 | Time: 55272 ms
[2020-11-22 21:37:06	                main:574]	:	INFO	:	Epoch 163 | loss: 3.67332e-05 | val_loss: 3.80804e-05 | Time: 55318.3 ms
[2020-11-22 21:38:01	                main:574]	:	INFO	:	Epoch 164 | loss: 3.66044e-05 | val_loss: 3.70721e-05 | Time: 55268.7 ms
[2020-11-22 21:38:56	                main:574]	:	INFO	:	Epoch 165 | loss: 3.63073e-05 | val_loss: 3.6863e-05 | Time: 55015.4 ms
[2020-11-22 21:39:51	                main:574]	:	INFO	:	Epoch 166 | loss: 3.63585e-05 | val_loss: 3.62038e-05 | Time: 55181.1 ms
[2020-11-22 21:40:46	                main:574]	:	INFO	:	Epoch 167 | loss: 3.58353e-05 | val_loss: 3.7097e-05 | Time: 55285.8 ms
[2020-11-22 21:41:42	                main:574]	:	INFO	:	Epoch 168 | loss: 3.59068e-05 | val_loss: 3.58822e-05 | Time: 55124.9 ms
[2020-11-22 21:42:37	                main:574]	:	INFO	:	Epoch 169 | loss: 3.53016e-05 | val_loss: 3.59471e-05 | Time: 55196.6 ms
[2020-11-22 21:43:32	                main:574]	:	INFO	:	Epoch 170 | loss: 3.56491e-05 | val_loss: 3.62667e-05 | Time: 55140 ms
[2020-11-22 21:44:27	                main:574]	:	INFO	:	Epoch 171 | loss: 3.51957e-05 | val_loss: 3.55448e-05 | Time: 55416.3 ms
[2020-11-22 21:45:23	                main:574]	:	INFO	:	Epoch 172 | loss: 3.47839e-05 | val_loss: 3.52604e-05 | Time: 55366 ms
[2020-11-22 21:46:18	                main:574]	:	INFO	:	Epoch 173 | loss: 3.47032e-05 | val_loss: 3.50633e-05 | Time: 55023.7 ms
[2020-11-22 21:47:13	                main:574]	:	INFO	:	Epoch 174 | loss: 3.47314e-05 | val_loss: 3.52129e-05 | Time: 55378.7 ms
[2020-11-22 21:48:08	                main:574]	:	INFO	:	Epoch 175 | loss: 3.44328e-05 | val_loss: 3.61226e-05 | Time: 55226.3 ms
[2020-11-22 21:49:04	                main:574]	:	INFO	:	Epoch 176 | loss: 3.43104e-05 | val_loss: 3.45404e-05 | Time: 55156.6 ms
[2020-11-22 21:49:59	                main:574]	:	INFO	:	Epoch 177 | loss: 3.38696e-05 | val_loss: 3.41052e-05 | Time: 55235.3 ms
[2020-11-22 21:50:54	                main:574]	:	INFO	:	Epoch 178 | loss: 3.3886e-05 | val_loss: 3.43594e-05 | Time: 55205.6 ms
[2020-11-22 21:51:49	                main:574]	:	INFO	:	Epoch 179 | loss: 3.36147e-05 | val_loss: 3.34583e-05 | Time: 55116.5 ms
[2020-11-22 21:52:44	                main:574]	:	INFO	:	Epoch 180 | loss: 3.35562e-05 | val_loss: 3.45744e-05 | Time: 55200.7 ms
[2020-11-22 21:53:40	                main:574]	:	INFO	:	Epoch 181 | loss: 3.34471e-05 | val_loss: 3.31537e-05 | Time: 55238.5 ms
[2020-11-22 21:54:35	                main:574]	:	INFO	:	Epoch 182 | loss: 3.32681e-05 | val_loss: 3.37082e-05 | Time: 55181.1 ms
[2020-11-22 21:55:30	                main:574]	:	INFO	:	Epoch 183 | loss: 3.28831e-05 | val_loss: 3.32774e-05 | Time: 55240.8 ms
[2020-11-22 21:56:25	                main:574]	:	INFO	:	Epoch 184 | loss: 3.2583e-05 | val_loss: 3.34657e-05 | Time: 55313 ms
[2020-11-22 21:57:21	                main:574]	:	INFO	:	Epoch 185 | loss: 3.27287e-05 | val_loss: 3.36104e-05 | Time: 55094.3 ms
[2020-11-22 21:58:16	                main:574]	:	INFO	:	Epoch 186 | loss: 3.25616e-05 | val_loss: 3.286e-05 | Time: 55102.8 ms
[2020-11-22 21:59:11	                main:574]	:	INFO	:	Epoch 187 | loss: 3.24446e-05 | val_loss: 3.32799e-05 | Time: 55114.8 ms
[2020-11-22 22:00:06	                main:574]	:	INFO	:	Epoch 188 | loss: 3.22828e-05 | val_loss: 3.24833e-05 | Time: 55225.4 ms
[2020-11-22 22:01:01	                main:574]	:	INFO	:	Epoch 189 | loss: 3.20394e-05 | val_loss: 3.22319e-05 | Time: 55351 ms
[2020-11-22 22:01:57	                main:574]	:	INFO	:	Epoch 190 | loss: 3.16087e-05 | val_loss: 3.18277e-05 | Time: 55139.2 ms
[2020-11-22 22:02:52	                main:574]	:	INFO	:	Epoch 191 | loss: 3.14228e-05 | val_loss: 3.19646e-05 | Time: 55188 ms
[2020-11-22 22:03:47	                main:574]	:	INFO	:	Epoch 192 | loss: 3.16314e-05 | val_loss: 3.20867e-05 | Time: 55241.7 ms
[2020-11-22 22:03:47	                main:597]	:	INFO	:	Saving trained model to model-final.pt, val_loss 3.20867e-05
[2020-11-22 22:03:47	                main:603]	:	INFO	:	Saving end state to config to file
[2020-11-22 22:03:47	                main:608]	:	INFO	:	Success, exiting..
22:03:47 (9940): called boinc_finish(0)

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)