Task 2969763

Name rand_automata_0049-1605424084-12135-1_1
Workunit 1341264
Created 16 Nov 2020, 15:37:08 UTC
Sent 22 Nov 2020, 16:40:04 UTC
Report deadline 29 Nov 2020, 16:40:04 UTC
Received 22 Nov 2020, 20:48:22 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 4439
Run time 3 hours 5 min 1 sec
CPU time 3 hours 1 min 53 sec
Validate state Valid
Credit 959.40
Device peak FLOPS 4,458.60 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.96 GB
Peak swap size 3.06 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.11</core_client_version>
<![CDATA[
<stderr_txt>
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 1650 SUPER)
[2020-11-22 11:42:46	                main:435]	:	INFO	:	Set logging level to 1
[2020-11-22 11:42:46	                main:441]	:	INFO	:	Running in BOINC Client mode
[2020-11-22 11:42:46	                main:444]	:	INFO	:	Resolving all filenames
[2020-11-22 11:42:46	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0049-train-val-dataset.hdf5 (exists = 1)
[2020-11-22 11:42:46	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0049-1605424084-12135-1_1_r1867841241_1 (exists = 0)
[2020-11-22 11:42:46	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0049-1605424084-12135-1_1_r1867841241_0 (exists = 0)
[2020-11-22 11:42:46	                main:452]	:	INFO	:	Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0049-1605424084-12135-1 (exists = 1)
[2020-11-22 11:42:46	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2020-11-22 11:42:46	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/rand_automata_0049-train-val-dataset.hdf5
[2020-11-22 11:42:46	                main:474]	:	INFO	:	Configuration: 
[2020-11-22 11:42:46	                main:475]	:	INFO	:	    Model type: LSTM
[2020-11-22 11:42:46	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2020-11-22 11:42:46	                main:477]	:	INFO	:	    Max Epochs: 192
[2020-11-22 11:42:46	                main:478]	:	INFO	:	    Batch Size: 32
[2020-11-22 11:42:46	                main:479]	:	INFO	:	    Learning Rate: 0.001
[2020-11-22 11:42:46	                main:480]	:	INFO	:	    Patience: 10
[2020-11-22 11:42:46	                main:481]	:	INFO	:	    Hidden Width: 64
[2020-11-22 11:42:46	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2020-11-22 11:42:46	                main:483]	:	INFO	:	    # Backend Layers: 2
[2020-11-22 11:42:46	                main:484]	:	INFO	:	    # Threads: 1
[2020-11-22 11:42:46	                main:486]	:	INFO	:	Preparing Dataset
[2020-11-22 11:42:46	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0049-train-val-dataset.hdf5 into memory
[2020-11-22 11:42:46	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0049-train-val-dataset.hdf5 into memory
[2020-11-22 11:42:49	                load:106]	:	INFO	:	Successfully loaded dataset of 4096 examples into memory.
[2020-11-22 11:42:49	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0049-train-val-dataset.hdf5 into memory
[2020-11-22 11:42:49	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0049-train-val-dataset.hdf5 into memory
[2020-11-22 11:42:49	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2020-11-22 11:42:49	                main:494]	:	INFO	:	Creating Model
[2020-11-22 11:42:49	                main:507]	:	INFO	:	Preparing config file
[2020-11-22 11:42:49	                main:519]	:	INFO	:	Creating new config file
[2020-11-22 11:42:49	                main:538]	:	INFO	:	This is a continuation WU, loading previous network
[2020-11-22 11:42:51	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2020-11-22 11:42:51	                main:562]	:	INFO	:	Starting Training
[2020-11-22 11:43:52	                main:574]	:	INFO	:	Epoch 1 | loss: 0.000117975 | val_loss: 0.000105964 | Time: 61035.4 ms
[2020-11-22 11:44:52	                main:574]	:	INFO	:	Epoch 2 | loss: 0.000100362 | val_loss: 0.000106638 | Time: 59933.4 ms
[2020-11-22 11:45:50	                main:574]	:	INFO	:	Epoch 3 | loss: 0.000100408 | val_loss: 0.00010626 | Time: 58335 ms
[2020-11-22 11:46:47	                main:574]	:	INFO	:	Epoch 4 | loss: 0.000100179 | val_loss: 0.000104469 | Time: 56474.9 ms
[2020-11-22 11:47:43	                main:574]	:	INFO	:	Epoch 5 | loss: 9.97014e-05 | val_loss: 0.000104728 | Time: 56320.5 ms
[2020-11-22 11:48:40	                main:574]	:	INFO	:	Epoch 6 | loss: 9.88485e-05 | val_loss: 0.00010436 | Time: 57133.5 ms
[2020-11-22 11:49:37	                main:574]	:	INFO	:	Epoch 7 | loss: 9.77252e-05 | val_loss: 0.000102692 | Time: 56349.1 ms
[2020-11-22 11:50:33	                main:574]	:	INFO	:	Epoch 8 | loss: 9.72079e-05 | val_loss: 0.000102112 | Time: 56700.5 ms
[2020-11-22 11:51:30	                main:574]	:	INFO	:	Epoch 9 | loss: 9.63334e-05 | val_loss: 0.000100775 | Time: 56234.6 ms
[2020-11-22 11:52:29	                main:574]	:	INFO	:	Epoch 10 | loss: 9.50559e-05 | val_loss: 0.000100385 | Time: 59124.6 ms
[2020-11-22 11:53:27	                main:574]	:	INFO	:	Epoch 11 | loss: 9.43762e-05 | val_loss: 9.94607e-05 | Time: 57846.3 ms
[2020-11-22 11:54:25	                main:574]	:	INFO	:	Epoch 12 | loss: 9.39059e-05 | val_loss: 9.8396e-05 | Time: 58403.7 ms
[2020-11-22 11:55:22	                main:574]	:	INFO	:	Epoch 13 | loss: 9.24923e-05 | val_loss: 9.7499e-05 | Time: 57193.1 ms
[2020-11-22 11:56:20	                main:574]	:	INFO	:	Epoch 14 | loss: 9.14496e-05 | val_loss: 9.63739e-05 | Time: 57395.4 ms
[2020-11-22 11:57:17	                main:574]	:	INFO	:	Epoch 15 | loss: 9.08846e-05 | val_loss: 9.71506e-05 | Time: 57389.5 ms
[2020-11-22 11:58:14	                main:574]	:	INFO	:	Epoch 16 | loss: 9.02616e-05 | val_loss: 9.5727e-05 | Time: 56977.7 ms
[2020-11-22 11:59:10	                main:574]	:	INFO	:	Epoch 17 | loss: 8.90764e-05 | val_loss: 9.39426e-05 | Time: 56275.1 ms
[2020-11-22 12:00:07	                main:574]	:	INFO	:	Epoch 18 | loss: 8.81837e-05 | val_loss: 9.28064e-05 | Time: 56344.9 ms
[2020-11-22 12:01:03	                main:574]	:	INFO	:	Epoch 19 | loss: 8.73165e-05 | val_loss: 9.20461e-05 | Time: 56212.1 ms
[2020-11-22 12:01:59	                main:574]	:	INFO	:	Epoch 20 | loss: 8.67466e-05 | val_loss: 9.10152e-05 | Time: 56266.5 ms
[2020-11-22 12:02:56	                main:574]	:	INFO	:	Epoch 21 | loss: 8.60268e-05 | val_loss: 9.09947e-05 | Time: 56179 ms
[2020-11-22 12:03:52	                main:574]	:	INFO	:	Epoch 22 | loss: 8.52526e-05 | val_loss: 9.01564e-05 | Time: 56700.9 ms
[2020-11-22 12:04:49	                main:574]	:	INFO	:	Epoch 23 | loss: 8.42553e-05 | val_loss: 8.85753e-05 | Time: 56496.8 ms
[2020-11-22 12:05:48	                main:574]	:	INFO	:	Epoch 24 | loss: 8.38253e-05 | val_loss: 8.87502e-05 | Time: 58834.4 ms
[2020-11-22 12:06:48	                main:574]	:	INFO	:	Epoch 25 | loss: 8.30824e-05 | val_loss: 8.73885e-05 | Time: 60354 ms
[2020-11-22 12:07:44	                main:574]	:	INFO	:	Epoch 26 | loss: 8.21866e-05 | val_loss: 8.5645e-05 | Time: 56459.9 ms
[2020-11-22 12:08:41	                main:574]	:	INFO	:	Epoch 27 | loss: 8.16593e-05 | val_loss: 8.57889e-05 | Time: 56187 ms
[2020-11-22 12:09:37	                main:574]	:	INFO	:	Epoch 28 | loss: 8.08094e-05 | val_loss: 8.57772e-05 | Time: 56344.1 ms
[2020-11-22 12:10:34	                main:574]	:	INFO	:	Epoch 29 | loss: 8.0152e-05 | val_loss: 8.51853e-05 | Time: 57273 ms
[2020-11-22 12:11:33	                main:574]	:	INFO	:	Epoch 30 | loss: 7.94553e-05 | val_loss: 8.46406e-05 | Time: 58846.1 ms
[2020-11-22 12:12:31	                main:574]	:	INFO	:	Epoch 31 | loss: 7.90774e-05 | val_loss: 8.26788e-05 | Time: 57799.7 ms
[2020-11-22 12:13:29	                main:574]	:	INFO	:	Epoch 32 | loss: 7.82646e-05 | val_loss: 8.32976e-05 | Time: 57514.1 ms
[2020-11-22 12:14:26	                main:574]	:	INFO	:	Epoch 33 | loss: 7.749e-05 | val_loss: 8.0953e-05 | Time: 57803.3 ms
[2020-11-22 12:15:24	                main:574]	:	INFO	:	Epoch 34 | loss: 7.6748e-05 | val_loss: 8.10779e-05 | Time: 57702.1 ms
[2020-11-22 12:16:22	                main:574]	:	INFO	:	Epoch 35 | loss: 7.61416e-05 | val_loss: 8.0415e-05 | Time: 57731.4 ms
[2020-11-22 12:17:20	                main:574]	:	INFO	:	Epoch 36 | loss: 7.59127e-05 | val_loss: 7.97466e-05 | Time: 57711.4 ms
[2020-11-22 12:18:17	                main:574]	:	INFO	:	Epoch 37 | loss: 7.5114e-05 | val_loss: 7.9267e-05 | Time: 57561.3 ms
[2020-11-22 12:19:14	                main:574]	:	INFO	:	Epoch 38 | loss: 7.4184e-05 | val_loss: 7.94743e-05 | Time: 56588.6 ms
[2020-11-22 12:20:10	                main:574]	:	INFO	:	Epoch 39 | loss: 7.36764e-05 | val_loss: 7.81373e-05 | Time: 56157.4 ms
[2020-11-22 12:21:06	                main:574]	:	INFO	:	Epoch 40 | loss: 7.35718e-05 | val_loss: 7.79236e-05 | Time: 56094.4 ms
[2020-11-22 12:22:02	                main:574]	:	INFO	:	Epoch 41 | loss: 7.28451e-05 | val_loss: 7.7499e-05 | Time: 56208.6 ms
[2020-11-22 12:22:58	                main:574]	:	INFO	:	Epoch 42 | loss: 7.2019e-05 | val_loss: 7.60465e-05 | Time: 56039.3 ms
[2020-11-22 12:23:55	                main:574]	:	INFO	:	Epoch 43 | loss: 7.16135e-05 | val_loss: 7.67069e-05 | Time: 56993.7 ms
[2020-11-22 12:24:54	                main:574]	:	INFO	:	Epoch 44 | loss: 7.10833e-05 | val_loss: 7.51032e-05 | Time: 58880.4 ms
[2020-11-22 12:25:53	                main:574]	:	INFO	:	Epoch 45 | loss: 7.0969e-05 | val_loss: 7.50755e-05 | Time: 58582 ms
[2020-11-22 12:26:51	                main:574]	:	INFO	:	Epoch 46 | loss: 7.03433e-05 | val_loss: 7.51765e-05 | Time: 58100 ms
[2020-11-22 12:27:48	                main:574]	:	INFO	:	Epoch 47 | loss: 6.96553e-05 | val_loss: 7.46183e-05 | Time: 57480.3 ms
[2020-11-22 12:28:47	                main:574]	:	INFO	:	Epoch 48 | loss: 6.93279e-05 | val_loss: 7.31717e-05 | Time: 58302.1 ms
[2020-11-22 12:29:44	                main:574]	:	INFO	:	Epoch 49 | loss: 6.86254e-05 | val_loss: 7.3183e-05 | Time: 57186.6 ms
[2020-11-22 12:30:41	                main:574]	:	INFO	:	Epoch 50 | loss: 6.81543e-05 | val_loss: 7.26053e-05 | Time: 56760 ms
[2020-11-22 12:31:37	                main:574]	:	INFO	:	Epoch 51 | loss: 6.77844e-05 | val_loss: 7.13689e-05 | Time: 56641.3 ms
[2020-11-22 12:32:37	                main:574]	:	INFO	:	Epoch 52 | loss: 6.69841e-05 | val_loss: 7.14074e-05 | Time: 59192.1 ms
[2020-11-22 12:33:34	                main:574]	:	INFO	:	Epoch 53 | loss: 6.692e-05 | val_loss: 7.03478e-05 | Time: 57465.3 ms
[2020-11-22 12:34:31	                main:574]	:	INFO	:	Epoch 54 | loss: 6.63161e-05 | val_loss: 7.07945e-05 | Time: 56766.3 ms
[2020-11-22 12:35:27	                main:574]	:	INFO	:	Epoch 55 | loss: 6.58956e-05 | val_loss: 6.96373e-05 | Time: 56643.4 ms
[2020-11-22 12:36:25	                main:574]	:	INFO	:	Epoch 56 | loss: 6.53663e-05 | val_loss: 6.90289e-05 | Time: 57198.4 ms
[2020-11-22 12:37:21	                main:574]	:	INFO	:	Epoch 57 | loss: 6.48227e-05 | val_loss: 6.82595e-05 | Time: 56766.1 ms
[2020-11-22 12:38:18	                main:574]	:	INFO	:	Epoch 58 | loss: 6.46142e-05 | val_loss: 6.88654e-05 | Time: 56482.8 ms
[2020-11-22 12:39:14	                main:574]	:	INFO	:	Epoch 59 | loss: 6.40784e-05 | val_loss: 7.04007e-05 | Time: 56368 ms
[2020-11-22 12:40:11	                main:574]	:	INFO	:	Epoch 60 | loss: 6.36496e-05 | val_loss: 6.87115e-05 | Time: 56275 ms
[2020-11-22 12:41:08	                main:574]	:	INFO	:	Epoch 61 | loss: 6.32991e-05 | val_loss: 6.7531e-05 | Time: 57485.2 ms
[2020-11-22 12:42:06	                main:574]	:	INFO	:	Epoch 62 | loss: 6.26372e-05 | val_loss: 6.52839e-05 | Time: 57940.8 ms
[2020-11-22 12:43:03	                main:574]	:	INFO	:	Epoch 63 | loss: 6.23312e-05 | val_loss: 6.60609e-05 | Time: 56638.5 ms
[2020-11-22 12:43:59	                main:574]	:	INFO	:	Epoch 64 | loss: 6.17885e-05 | val_loss: 6.58434e-05 | Time: 56488.8 ms
[2020-11-22 12:44:56	                main:574]	:	INFO	:	Epoch 65 | loss: 6.1614e-05 | val_loss: 6.50732e-05 | Time: 56438.4 ms
[2020-11-22 12:45:52	                main:574]	:	INFO	:	Epoch 66 | loss: 6.12488e-05 | val_loss: 6.44864e-05 | Time: 56537.3 ms
[2020-11-22 12:46:49	                main:574]	:	INFO	:	Epoch 67 | loss: 6.08758e-05 | val_loss: 6.45893e-05 | Time: 56424.8 ms
[2020-11-22 12:47:45	                main:574]	:	INFO	:	Epoch 68 | loss: 6.04234e-05 | val_loss: 6.45632e-05 | Time: 56307 ms
[2020-11-22 12:48:42	                main:574]	:	INFO	:	Epoch 69 | loss: 5.99142e-05 | val_loss: 6.37719e-05 | Time: 56666.7 ms
[2020-11-22 12:49:38	                main:574]	:	INFO	:	Epoch 70 | loss: 5.97587e-05 | val_loss: 6.32857e-05 | Time: 56373.4 ms
[2020-11-22 12:50:35	                main:574]	:	INFO	:	Epoch 71 | loss: 5.9428e-05 | val_loss: 6.27828e-05 | Time: 56759.2 ms
[2020-11-22 12:51:31	                main:574]	:	INFO	:	Epoch 72 | loss: 5.89356e-05 | val_loss: 6.27076e-05 | Time: 56466.3 ms
[2020-11-22 12:52:28	                main:574]	:	INFO	:	Epoch 73 | loss: 5.84666e-05 | val_loss: 6.20646e-05 | Time: 56436 ms
[2020-11-22 12:53:24	                main:574]	:	INFO	:	Epoch 74 | loss: 5.81212e-05 | val_loss: 6.15751e-05 | Time: 56550.9 ms
[2020-11-22 12:54:21	                main:574]	:	INFO	:	Epoch 75 | loss: 5.78061e-05 | val_loss: 6.08606e-05 | Time: 56433.6 ms
[2020-11-22 12:55:17	                main:574]	:	INFO	:	Epoch 76 | loss: 5.75356e-05 | val_loss: 6.09672e-05 | Time: 56469.8 ms
[2020-11-22 12:56:14	                main:574]	:	INFO	:	Epoch 77 | loss: 5.74802e-05 | val_loss: 6.05596e-05 | Time: 56326.7 ms
[2020-11-22 12:57:10	                main:574]	:	INFO	:	Epoch 78 | loss: 5.70618e-05 | val_loss: 6.16672e-05 | Time: 56446.5 ms
[2020-11-22 12:58:07	                main:574]	:	INFO	:	Epoch 79 | loss: 5.65746e-05 | val_loss: 5.98718e-05 | Time: 56365.3 ms
[2020-11-22 12:59:03	                main:574]	:	INFO	:	Epoch 80 | loss: 5.59626e-05 | val_loss: 5.93335e-05 | Time: 56453.6 ms
[2020-11-22 12:59:59	                main:574]	:	INFO	:	Epoch 81 | loss: 5.58947e-05 | val_loss: 5.83277e-05 | Time: 56354.2 ms
[2020-11-22 13:00:56	                main:574]	:	INFO	:	Epoch 82 | loss: 5.58441e-05 | val_loss: 5.94516e-05 | Time: 56474 ms
[2020-11-22 13:01:52	                main:574]	:	INFO	:	Epoch 83 | loss: 5.54606e-05 | val_loss: 5.80657e-05 | Time: 56509.6 ms
[2020-11-22 13:02:49	                main:574]	:	INFO	:	Epoch 84 | loss: 5.48287e-05 | val_loss: 5.78694e-05 | Time: 56479.9 ms
[2020-11-22 13:03:45	                main:574]	:	INFO	:	Epoch 85 | loss: 5.46871e-05 | val_loss: 5.82643e-05 | Time: 56486 ms
[2020-11-22 13:04:42	                main:574]	:	INFO	:	Epoch 86 | loss: 5.43386e-05 | val_loss: 5.77837e-05 | Time: 56556.4 ms
[2020-11-22 13:05:46	                main:574]	:	INFO	:	Epoch 87 | loss: 5.42837e-05 | val_loss: 5.77525e-05 | Time: 63801 ms
[2020-11-22 13:06:51	                main:574]	:	INFO	:	Epoch 88 | loss: 5.38491e-05 | val_loss: 5.72503e-05 | Time: 65721.5 ms
[2020-11-22 13:07:55	                main:574]	:	INFO	:	Epoch 89 | loss: 5.35636e-05 | val_loss: 5.6849e-05 | Time: 63182 ms
[2020-11-22 13:08:59	                main:574]	:	INFO	:	Epoch 90 | loss: 5.30092e-05 | val_loss: 5.58545e-05 | Time: 64106.3 ms
[2020-11-22 13:09:59	                main:574]	:	INFO	:	Epoch 91 | loss: 5.2771e-05 | val_loss: 5.5992e-05 | Time: 60154.3 ms
[2020-11-22 13:11:03	                main:574]	:	INFO	:	Epoch 92 | loss: 5.27943e-05 | val_loss: 5.61508e-05 | Time: 64140.4 ms
[2020-11-22 13:12:03	                main:574]	:	INFO	:	Epoch 93 | loss: 5.22663e-05 | val_loss: 5.53402e-05 | Time: 60109.3 ms
[2020-11-22 13:13:02	                main:574]	:	INFO	:	Epoch 94 | loss: 5.18742e-05 | val_loss: 5.55577e-05 | Time: 58390 ms
[2020-11-22 13:14:03	                main:574]	:	INFO	:	Epoch 95 | loss: 5.19457e-05 | val_loss: 5.53155e-05 | Time: 60842.6 ms
[2020-11-22 13:15:04	                main:574]	:	INFO	:	Epoch 96 | loss: 5.16851e-05 | val_loss: 5.44726e-05 | Time: 61602.7 ms
[2020-11-22 13:16:08	                main:574]	:	INFO	:	Epoch 97 | loss: 5.13283e-05 | val_loss: 5.42562e-05 | Time: 64264.6 ms
[2020-11-22 13:17:13	                main:574]	:	INFO	:	Epoch 98 | loss: 5.10595e-05 | val_loss: 5.37331e-05 | Time: 64665.7 ms
[2020-11-22 13:18:22	                main:574]	:	INFO	:	Epoch 99 | loss: 5.07937e-05 | val_loss: 5.36221e-05 | Time: 68848.2 ms
[2020-11-22 13:19:22	                main:574]	:	INFO	:	Epoch 100 | loss: 5.05114e-05 | val_loss: 5.42773e-05 | Time: 59727.6 ms
[2020-11-22 13:20:19	                main:574]	:	INFO	:	Epoch 101 | loss: 5.02124e-05 | val_loss: 5.31134e-05 | Time: 57309.1 ms
[2020-11-22 13:21:16	                main:574]	:	INFO	:	Epoch 102 | loss: 5.00509e-05 | val_loss: 5.2854e-05 | Time: 57346 ms
[2020-11-22 13:22:14	                main:574]	:	INFO	:	Epoch 103 | loss: 4.98962e-05 | val_loss: 5.35023e-05 | Time: 57209 ms
[2020-11-22 13:23:12	                main:574]	:	INFO	:	Epoch 104 | loss: 4.94277e-05 | val_loss: 5.24891e-05 | Time: 58261.2 ms
[2020-11-22 13:24:09	                main:574]	:	INFO	:	Epoch 105 | loss: 4.89439e-05 | val_loss: 5.20669e-05 | Time: 56774.8 ms
[2020-11-22 13:25:08	                main:574]	:	INFO	:	Epoch 106 | loss: 4.89951e-05 | val_loss: 5.17628e-05 | Time: 59592.2 ms
[2020-11-22 13:26:08	                main:574]	:	INFO	:	Epoch 107 | loss: 4.87165e-05 | val_loss: 5.18674e-05 | Time: 59553 ms
[2020-11-22 13:27:09	                main:574]	:	INFO	:	Epoch 108 | loss: 4.86975e-05 | val_loss: 5.11631e-05 | Time: 61387.7 ms
[2020-11-22 13:28:08	                main:574]	:	INFO	:	Epoch 109 | loss: 4.78441e-05 | val_loss: 5.17675e-05 | Time: 58290 ms
[2020-11-22 13:29:07	                main:574]	:	INFO	:	Epoch 110 | loss: 4.80272e-05 | val_loss: 5.01066e-05 | Time: 59190.9 ms
[2020-11-22 13:30:07	                main:574]	:	INFO	:	Epoch 111 | loss: 4.77943e-05 | val_loss: 5.14684e-05 | Time: 60016.8 ms
[2020-11-22 13:31:09	                main:574]	:	INFO	:	Epoch 112 | loss: 4.77269e-05 | val_loss: 5.12618e-05 | Time: 62378.1 ms
[2020-11-22 13:32:12	                main:574]	:	INFO	:	Epoch 113 | loss: 4.73635e-05 | val_loss: 4.97571e-05 | Time: 63029.4 ms
[2020-11-22 13:33:13	                main:574]	:	INFO	:	Epoch 114 | loss: 4.69754e-05 | val_loss: 4.93144e-05 | Time: 60956.5 ms
[2020-11-22 13:34:12	                main:574]	:	INFO	:	Epoch 115 | loss: 4.6662e-05 | val_loss: 4.94582e-05 | Time: 58849.7 ms
[2020-11-22 13:35:11	                main:574]	:	INFO	:	Epoch 116 | loss: 4.66663e-05 | val_loss: 4.99039e-05 | Time: 58695.1 ms
[2020-11-22 13:36:09	                main:574]	:	INFO	:	Epoch 117 | loss: 4.64097e-05 | val_loss: 4.9414e-05 | Time: 58292.6 ms
[2020-11-22 13:37:08	                main:574]	:	INFO	:	Epoch 118 | loss: 4.62653e-05 | val_loss: 4.96645e-05 | Time: 58916.2 ms
[2020-11-22 13:38:07	                main:574]	:	INFO	:	Epoch 119 | loss: 4.60062e-05 | val_loss: 4.90017e-05 | Time: 59298.6 ms
[2020-11-22 13:39:07	                main:574]	:	INFO	:	Epoch 120 | loss: 4.58426e-05 | val_loss: 4.89712e-05 | Time: 59436 ms
[2020-11-22 13:40:06	                main:574]	:	INFO	:	Epoch 121 | loss: 4.55869e-05 | val_loss: 4.79113e-05 | Time: 59186 ms
[2020-11-22 13:41:07	                main:574]	:	INFO	:	Epoch 122 | loss: 4.53429e-05 | val_loss: 4.7764e-05 | Time: 60636.8 ms
[2020-11-22 13:42:06	                main:574]	:	INFO	:	Epoch 123 | loss: 4.52408e-05 | val_loss: 4.83104e-05 | Time: 59497.3 ms
[2020-11-22 13:43:09	                main:574]	:	INFO	:	Epoch 124 | loss: 4.49226e-05 | val_loss: 4.85426e-05 | Time: 62665.6 ms
[2020-11-22 13:44:07	                main:574]	:	INFO	:	Epoch 125 | loss: 4.48109e-05 | val_loss: 4.72865e-05 | Time: 58447.3 ms
[2020-11-22 13:45:08	                main:574]	:	INFO	:	Epoch 126 | loss: 4.4597e-05 | val_loss: 4.76321e-05 | Time: 60714.3 ms
[2020-11-22 13:46:09	                main:574]	:	INFO	:	Epoch 127 | loss: 4.44304e-05 | val_loss: 4.72391e-05 | Time: 60858.4 ms
[2020-11-22 13:47:07	                main:574]	:	INFO	:	Epoch 128 | loss: 4.41852e-05 | val_loss: 4.65624e-05 | Time: 57539.2 ms
[2020-11-22 13:48:04	                main:574]	:	INFO	:	Epoch 129 | loss: 4.40143e-05 | val_loss: 4.62225e-05 | Time: 57234.3 ms
[2020-11-22 13:49:01	                main:574]	:	INFO	:	Epoch 130 | loss: 4.37732e-05 | val_loss: 4.64891e-05 | Time: 57009.2 ms
[2020-11-22 13:49:58	                main:574]	:	INFO	:	Epoch 131 | loss: 4.37961e-05 | val_loss: 4.64405e-05 | Time: 56940.9 ms
[2020-11-22 13:50:55	                main:574]	:	INFO	:	Epoch 132 | loss: 4.33722e-05 | val_loss: 4.5923e-05 | Time: 56896.3 ms
[2020-11-22 13:51:55	                main:574]	:	INFO	:	Epoch 133 | loss: 4.31241e-05 | val_loss: 4.60174e-05 | Time: 59824.6 ms
[2020-11-22 13:52:52	                main:574]	:	INFO	:	Epoch 134 | loss: 4.30416e-05 | val_loss: 4.60155e-05 | Time: 57753 ms
[2020-11-22 13:53:49	                main:574]	:	INFO	:	Epoch 135 | loss: 4.28418e-05 | val_loss: 4.54709e-05 | Time: 56395.4 ms
[2020-11-22 13:54:45	                main:574]	:	INFO	:	Epoch 136 | loss: 4.24591e-05 | val_loss: 4.57533e-05 | Time: 56070.4 ms
[2020-11-22 13:55:41	                main:574]	:	INFO	:	Epoch 137 | loss: 4.26382e-05 | val_loss: 4.47193e-05 | Time: 56346.8 ms
[2020-11-22 13:56:38	                main:574]	:	INFO	:	Epoch 138 | loss: 4.23051e-05 | val_loss: 4.52874e-05 | Time: 56573.9 ms
[2020-11-22 13:57:34	                main:574]	:	INFO	:	Epoch 139 | loss: 4.22702e-05 | val_loss: 4.46472e-05 | Time: 56212.5 ms
[2020-11-22 13:58:30	                main:574]	:	INFO	:	Epoch 140 | loss: 4.20759e-05 | val_loss: 4.43329e-05 | Time: 56182.6 ms
[2020-11-22 13:59:27	                main:574]	:	INFO	:	Epoch 141 | loss: 4.17751e-05 | val_loss: 4.40827e-05 | Time: 56416.4 ms
[2020-11-22 14:00:23	                main:574]	:	INFO	:	Epoch 142 | loss: 4.15965e-05 | val_loss: 4.31418e-05 | Time: 56374 ms
[2020-11-22 14:01:22	                main:574]	:	INFO	:	Epoch 143 | loss: 4.15267e-05 | val_loss: 4.49159e-05 | Time: 59036.5 ms
[2020-11-22 14:02:22	                main:574]	:	INFO	:	Epoch 144 | loss: 4.1257e-05 | val_loss: 4.40796e-05 | Time: 59451.1 ms
[2020-11-22 14:03:19	                main:574]	:	INFO	:	Epoch 145 | loss: 4.10034e-05 | val_loss: 4.36447e-05 | Time: 57062.4 ms
[2020-11-22 14:04:16	                main:574]	:	INFO	:	Epoch 146 | loss: 4.09493e-05 | val_loss: 4.38757e-05 | Time: 57782.4 ms
[2020-11-22 14:05:14	                main:574]	:	INFO	:	Epoch 147 | loss: 4.08197e-05 | val_loss: 4.36135e-05 | Time: 57210.2 ms
[2020-11-22 14:06:11	                main:574]	:	INFO	:	Epoch 148 | loss: 4.06083e-05 | val_loss: 4.35952e-05 | Time: 57264.4 ms
[2020-11-22 14:07:08	                main:574]	:	INFO	:	Epoch 149 | loss: 4.04745e-05 | val_loss: 4.28175e-05 | Time: 56888.5 ms
[2020-11-22 14:08:05	                main:574]	:	INFO	:	Epoch 150 | loss: 4.03162e-05 | val_loss: 4.30853e-05 | Time: 57290.6 ms
[2020-11-22 14:09:02	                main:574]	:	INFO	:	Epoch 151 | loss: 4.00379e-05 | val_loss: 4.34087e-05 | Time: 56741.7 ms
[2020-11-22 14:09:58	                main:574]	:	INFO	:	Epoch 152 | loss: 4.00488e-05 | val_loss: 4.2995e-05 | Time: 56092.6 ms
[2020-11-22 14:10:54	                main:574]	:	INFO	:	Epoch 153 | loss: 3.98347e-05 | val_loss: 4.27103e-05 | Time: 56389 ms
[2020-11-22 14:11:51	                main:574]	:	INFO	:	Epoch 154 | loss: 3.9628e-05 | val_loss: 4.27904e-05 | Time: 56200 ms
[2020-11-22 14:12:47	                main:574]	:	INFO	:	Epoch 155 | loss: 3.94164e-05 | val_loss: 4.18392e-05 | Time: 56466.5 ms
[2020-11-22 14:13:44	                main:574]	:	INFO	:	Epoch 156 | loss: 3.93411e-05 | val_loss: 4.21565e-05 | Time: 56464.2 ms
[2020-11-22 14:14:40	                main:574]	:	INFO	:	Epoch 157 | loss: 3.91129e-05 | val_loss: 4.17531e-05 | Time: 56343 ms
[2020-11-22 14:15:36	                main:574]	:	INFO	:	Epoch 158 | loss: 3.90277e-05 | val_loss: 4.1933e-05 | Time: 56108.7 ms
[2020-11-22 14:16:32	                main:574]	:	INFO	:	Epoch 159 | loss: 3.86226e-05 | val_loss: 4.09767e-05 | Time: 56098.8 ms
[2020-11-22 14:17:28	                main:574]	:	INFO	:	Epoch 160 | loss: 3.87429e-05 | val_loss: 4.14219e-05 | Time: 56177.8 ms
[2020-11-22 14:18:25	                main:574]	:	INFO	:	Epoch 161 | loss: 3.83801e-05 | val_loss: 4.16716e-05 | Time: 56279.8 ms
[2020-11-22 14:19:21	                main:574]	:	INFO	:	Epoch 162 | loss: 3.8313e-05 | val_loss: 4.07381e-05 | Time: 56370.6 ms
[2020-11-22 14:20:17	                main:574]	:	INFO	:	Epoch 163 | loss: 3.82374e-05 | val_loss: 4.05882e-05 | Time: 56038 ms
[2020-11-22 14:21:13	                main:574]	:	INFO	:	Epoch 164 | loss: 3.8204e-05 | val_loss: 4.11767e-05 | Time: 56205.3 ms
[2020-11-22 14:22:10	                main:574]	:	INFO	:	Epoch 165 | loss: 3.78778e-05 | val_loss: 4.04562e-05 | Time: 56414.5 ms
[2020-11-22 14:23:06	                main:574]	:	INFO	:	Epoch 166 | loss: 3.79528e-05 | val_loss: 4.03717e-05 | Time: 56227.9 ms
[2020-11-22 14:24:02	                main:574]	:	INFO	:	Epoch 167 | loss: 3.74777e-05 | val_loss: 3.9872e-05 | Time: 56169.9 ms
[2020-11-22 14:24:59	                main:574]	:	INFO	:	Epoch 168 | loss: 3.74744e-05 | val_loss: 4.0192e-05 | Time: 56278.2 ms
[2020-11-22 14:25:55	                main:574]	:	INFO	:	Epoch 169 | loss: 3.74517e-05 | val_loss: 4.13998e-05 | Time: 56274.8 ms
[2020-11-22 14:26:51	                main:574]	:	INFO	:	Epoch 170 | loss: 3.74405e-05 | val_loss: 4.02699e-05 | Time: 56081.4 ms
[2020-11-22 14:27:47	                main:574]	:	INFO	:	Epoch 171 | loss: 3.70166e-05 | val_loss: 3.96914e-05 | Time: 56332.8 ms
[2020-11-22 14:28:44	                main:574]	:	INFO	:	Epoch 172 | loss: 3.69462e-05 | val_loss: 3.91381e-05 | Time: 56329.4 ms
[2020-11-22 14:29:40	                main:574]	:	INFO	:	Epoch 173 | loss: 3.69625e-05 | val_loss: 4.03989e-05 | Time: 56361.2 ms
[2020-11-22 14:30:36	                main:574]	:	INFO	:	Epoch 174 | loss: 3.65952e-05 | val_loss: 3.8677e-05 | Time: 56219.2 ms
[2020-11-22 14:31:33	                main:574]	:	INFO	:	Epoch 175 | loss: 3.6576e-05 | val_loss: 3.9121e-05 | Time: 56367.5 ms
[2020-11-22 14:32:29	                main:574]	:	INFO	:	Epoch 176 | loss: 3.64213e-05 | val_loss: 3.91792e-05 | Time: 56198.4 ms
[2020-11-22 14:33:25	                main:574]	:	INFO	:	Epoch 177 | loss: 3.61998e-05 | val_loss: 3.84989e-05 | Time: 56367.9 ms
[2020-11-22 14:34:21	                main:574]	:	INFO	:	Epoch 178 | loss: 3.63851e-05 | val_loss: 3.8927e-05 | Time: 56103 ms
[2020-11-22 14:35:18	                main:574]	:	INFO	:	Epoch 179 | loss: 3.60211e-05 | val_loss: 3.85094e-05 | Time: 56247.8 ms
[2020-11-22 14:36:14	                main:574]	:	INFO	:	Epoch 180 | loss: 3.59135e-05 | val_loss: 3.8424e-05 | Time: 56193.3 ms
[2020-11-22 14:37:10	                main:574]	:	INFO	:	Epoch 181 | loss: 3.58584e-05 | val_loss: 3.81223e-05 | Time: 56199.4 ms
[2020-11-22 14:38:06	                main:574]	:	INFO	:	Epoch 182 | loss: 3.57499e-05 | val_loss: 3.823e-05 | Time: 56216 ms
[2020-11-22 14:39:03	                main:574]	:	INFO	:	Epoch 183 | loss: 3.54471e-05 | val_loss: 3.75606e-05 | Time: 56416.7 ms
[2020-11-22 14:39:59	                main:574]	:	INFO	:	Epoch 184 | loss: 3.54107e-05 | val_loss: 3.83282e-05 | Time: 56586.8 ms
[2020-11-22 14:40:56	                main:574]	:	INFO	:	Epoch 185 | loss: 3.54962e-05 | val_loss: 3.77183e-05 | Time: 57179.1 ms
[2020-11-22 14:41:54	                main:574]	:	INFO	:	Epoch 186 | loss: 3.50768e-05 | val_loss: 3.78303e-05 | Time: 57757.6 ms
[2020-11-22 14:42:52	                main:574]	:	INFO	:	Epoch 187 | loss: 3.51045e-05 | val_loss: 3.72188e-05 | Time: 57767.5 ms
[2020-11-22 14:43:50	                main:574]	:	INFO	:	Epoch 188 | loss: 3.48269e-05 | val_loss: 3.73247e-05 | Time: 57943.8 ms
[2020-11-22 14:44:48	                main:574]	:	INFO	:	Epoch 189 | loss: 3.45926e-05 | val_loss: 3.76945e-05 | Time: 57695.1 ms
[2020-11-22 14:45:46	                main:574]	:	INFO	:	Epoch 190 | loss: 3.48117e-05 | val_loss: 3.73675e-05 | Time: 57793.9 ms
[2020-11-22 14:46:43	                main:574]	:	INFO	:	Epoch 191 | loss: 3.45183e-05 | val_loss: 3.70419e-05 | Time: 57735.1 ms
[2020-11-22 14:47:41	                main:574]	:	INFO	:	Epoch 192 | loss: 3.44222e-05 | val_loss: 3.75106e-05 | Time: 57771.2 ms
[2020-11-22 14:47:41	                main:597]	:	INFO	:	Saving trained model to model-final.pt, val_loss 3.75106e-05
[2020-11-22 14:47:41	                main:603]	:	INFO	:	Saving end state to config to file
[2020-11-22 14:47:41	                main:608]	:	INFO	:	Success, exiting..
14:47:41 (9584): called boinc_finish(0)

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)