Task 2868267

Name rand_automata_0005-1605109696-16486-0_0
Workunit 1293836
Created 11 Nov 2020, 15:48:20 UTC
Sent 11 Nov 2020, 21:54:27 UTC
Report deadline 19 Nov 2020, 21:54:27 UTC
Received 12 Nov 2020, 6:21:44 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 4439
Run time 50 min 21 sec
CPU time 50 min 7 sec
Validate state Valid
Credit 959.40
Device peak FLOPS 1,476.13 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.42 GB
Peak swap size 2.53 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.11</core_client_version>
<![CDATA[
<stderr_txt>
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 750 Ti)
[2020-11-12 00:28:56	                main:435]	:	INFO	:	Set logging level to 1
[2020-11-12 00:28:56	                main:441]	:	INFO	:	Running in BOINC Client mode
[2020-11-12 00:28:56	                main:444]	:	INFO	:	Resolving all filenames
[2020-11-12 00:28:56	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0005-train-val-dataset.hdf5 (exists = 1)
[2020-11-12 00:28:56	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0005-1605109696-16486-0_0_r1493303898_1 (exists = 0)
[2020-11-12 00:28:56	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0005-1605109696-16486-0_0_r1493303898_0 (exists = 0)
[2020-11-12 00:28:56	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 0)
[2020-11-12 00:28:56	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2020-11-12 00:28:56	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/rand_automata_0005-train-val-dataset.hdf5
[2020-11-12 00:28:56	                main:474]	:	INFO	:	Configuration: 
[2020-11-12 00:28:56	                main:475]	:	INFO	:	    Model type: LSTM
[2020-11-12 00:28:56	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2020-11-12 00:28:56	                main:477]	:	INFO	:	    Max Epochs: 192
[2020-11-12 00:28:56	                main:478]	:	INFO	:	    Batch Size: 32
[2020-11-12 00:28:56	                main:479]	:	INFO	:	    Learning Rate: 0.001
[2020-11-12 00:28:56	                main:480]	:	INFO	:	    Patience: 10
[2020-11-12 00:28:56	                main:481]	:	INFO	:	    Hidden Width: 64
[2020-11-12 00:28:56	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2020-11-12 00:28:56	                main:483]	:	INFO	:	    # Backend Layers: 2
[2020-11-12 00:28:56	                main:484]	:	INFO	:	    # Threads: 1
[2020-11-12 00:28:56	                main:486]	:	INFO	:	Preparing Dataset
[2020-11-12 00:28:56	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0005-train-val-dataset.hdf5 into memory
[2020-11-12 00:28:56	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0005-train-val-dataset.hdf5 into memory
[2020-11-12 00:28:58	                load:106]	:	INFO	:	Successfully loaded dataset of 4096 examples into memory.
[2020-11-12 00:28:58	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0005-train-val-dataset.hdf5 into memory
[2020-11-12 00:28:58	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0005-train-val-dataset.hdf5 into memory
[2020-11-12 00:28:58	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2020-11-12 00:28:58	                main:494]	:	INFO	:	Creating Model
[2020-11-12 00:28:58	                main:507]	:	INFO	:	Preparing config file
[2020-11-12 00:28:58	                main:519]	:	INFO	:	Creating new config file
[2020-11-12 00:28:59	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2020-11-12 00:28:59	                main:562]	:	INFO	:	Starting Training
[2020-11-12 00:29:15	                main:574]	:	INFO	:	Epoch 1 | loss: 0.0664447 | val_loss: 0.0661268 | Time: 15997.6 ms
[2020-11-12 00:29:30	                main:574]	:	INFO	:	Epoch 2 | loss: 0.0655438 | val_loss: 0.0642286 | Time: 15753.9 ms
[2020-11-12 00:29:46	                main:574]	:	INFO	:	Epoch 3 | loss: 0.0630423 | val_loss: 0.061338 | Time: 15731.5 ms
[2020-11-12 00:30:02	                main:574]	:	INFO	:	Epoch 4 | loss: 0.0599698 | val_loss: 0.0589677 | Time: 16042.3 ms
[2020-11-12 00:30:18	                main:574]	:	INFO	:	Epoch 5 | loss: 0.0579721 | val_loss: 0.0573553 | Time: 15904.9 ms
[2020-11-12 00:30:34	                main:574]	:	INFO	:	Epoch 6 | loss: 0.0565456 | val_loss: 0.055981 | Time: 15547.4 ms
[2020-11-12 00:30:49	                main:574]	:	INFO	:	Epoch 7 | loss: 0.0553406 | val_loss: 0.0548088 | Time: 15575.1 ms
[2020-11-12 00:31:05	                main:574]	:	INFO	:	Epoch 8 | loss: 0.0542071 | val_loss: 0.0537876 | Time: 15576.9 ms
[2020-11-12 00:31:20	                main:574]	:	INFO	:	Epoch 9 | loss: 0.0531246 | val_loss: 0.0528499 | Time: 15563.5 ms
[2020-11-12 00:31:36	                main:574]	:	INFO	:	Epoch 10 | loss: 0.0520414 | val_loss: 0.0516478 | Time: 15564.2 ms
[2020-11-12 00:31:51	                main:574]	:	INFO	:	Epoch 11 | loss: 0.0510185 | val_loss: 0.0505286 | Time: 15553.3 ms
[2020-11-12 00:32:07	                main:574]	:	INFO	:	Epoch 12 | loss: 0.0497899 | val_loss: 0.0494125 | Time: 15572 ms
[2020-11-12 00:32:23	                main:574]	:	INFO	:	Epoch 13 | loss: 0.0485286 | val_loss: 0.0484166 | Time: 15568.3 ms
[2020-11-12 00:32:38	                main:574]	:	INFO	:	Epoch 14 | loss: 0.0472566 | val_loss: 0.0468656 | Time: 15567.1 ms
[2020-11-12 00:32:54	                main:574]	:	INFO	:	Epoch 15 | loss: 0.0455976 | val_loss: 0.045239 | Time: 15588 ms
[2020-11-12 00:33:09	                main:574]	:	INFO	:	Epoch 16 | loss: 0.0438406 | val_loss: 0.0436688 | Time: 15573.7 ms
[2020-11-12 00:33:25	                main:574]	:	INFO	:	Epoch 17 | loss: 0.0417675 | val_loss: 0.0416342 | Time: 15534.4 ms
[2020-11-12 00:33:41	                main:574]	:	INFO	:	Epoch 18 | loss: 0.0394126 | val_loss: 0.0394168 | Time: 15544.7 ms
[2020-11-12 00:33:56	                main:574]	:	INFO	:	Epoch 19 | loss: 0.0365879 | val_loss: 0.0367609 | Time: 15555.1 ms
[2020-11-12 00:34:12	                main:574]	:	INFO	:	Epoch 20 | loss: 0.0339173 | val_loss: 0.0329154 | Time: 15555 ms
[2020-11-12 00:34:27	                main:574]	:	INFO	:	Epoch 21 | loss: 0.0307531 | val_loss: 0.0313651 | Time: 15547.6 ms
[2020-11-12 00:34:43	                main:574]	:	INFO	:	Epoch 22 | loss: 0.0280371 | val_loss: 0.0276828 | Time: 15594 ms
[2020-11-12 00:34:58	                main:574]	:	INFO	:	Epoch 23 | loss: 0.029132 | val_loss: 0.0282809 | Time: 15560.4 ms
[2020-11-12 00:35:14	                main:574]	:	INFO	:	Epoch 24 | loss: 0.0292614 | val_loss: 0.0285361 | Time: 15521.1 ms
[2020-11-12 00:35:29	                main:574]	:	INFO	:	Epoch 25 | loss: 0.0222952 | val_loss: 0.0238111 | Time: 15541.9 ms
[2020-11-12 00:35:45	                main:574]	:	INFO	:	Epoch 26 | loss: 0.0198697 | val_loss: 0.0258247 | Time: 15550.2 ms
[2020-11-12 00:36:01	                main:574]	:	INFO	:	Epoch 27 | loss: 0.0183817 | val_loss: 0.0335756 | Time: 15612 ms
[2020-11-12 00:36:16	                main:574]	:	INFO	:	Epoch 28 | loss: 0.0217945 | val_loss: 0.0160213 | Time: 15538.9 ms
[2020-11-12 00:36:32	                main:574]	:	INFO	:	Epoch 29 | loss: 0.0128198 | val_loss: 0.0134855 | Time: 15552.2 ms
[2020-11-12 00:36:47	                main:574]	:	INFO	:	Epoch 30 | loss: 0.0144462 | val_loss: 0.0143067 | Time: 15579.9 ms
[2020-11-12 00:37:03	                main:574]	:	INFO	:	Epoch 31 | loss: 0.0113971 | val_loss: 0.0112096 | Time: 15527.8 ms
[2020-11-12 00:37:18	                main:574]	:	INFO	:	Epoch 32 | loss: 0.0100258 | val_loss: 0.0100394 | Time: 15538.7 ms
[2020-11-12 00:37:34	                main:574]	:	INFO	:	Epoch 33 | loss: 0.00937428 | val_loss: 0.00929288 | Time: 15530.7 ms
[2020-11-12 00:37:50	                main:574]	:	INFO	:	Epoch 34 | loss: 0.00912143 | val_loss: 0.00946663 | Time: 15517.4 ms
[2020-11-12 00:38:05	                main:574]	:	INFO	:	Epoch 35 | loss: 0.00909237 | val_loss: 0.0091232 | Time: 15550.7 ms
[2020-11-12 00:38:21	                main:574]	:	INFO	:	Epoch 36 | loss: 0.00826786 | val_loss: 0.00822086 | Time: 15523 ms
[2020-11-12 00:38:36	                main:574]	:	INFO	:	Epoch 37 | loss: 0.00791272 | val_loss: 0.00801982 | Time: 15555.3 ms
[2020-11-12 00:38:52	                main:574]	:	INFO	:	Epoch 38 | loss: 0.00757361 | val_loss: 0.00759192 | Time: 15552.8 ms
[2020-11-12 00:39:07	                main:574]	:	INFO	:	Epoch 39 | loss: 0.0120505 | val_loss: 0.00847169 | Time: 15533.1 ms
[2020-11-12 00:39:23	                main:574]	:	INFO	:	Epoch 40 | loss: 0.0206797 | val_loss: 0.0106938 | Time: 15567.8 ms
[2020-11-12 00:39:38	                main:574]	:	INFO	:	Epoch 41 | loss: 0.00868342 | val_loss: 0.00796171 | Time: 15553.2 ms
[2020-11-12 00:39:54	                main:574]	:	INFO	:	Epoch 42 | loss: 0.00744532 | val_loss: 0.00733813 | Time: 15545.3 ms
[2020-11-12 00:40:10	                main:574]	:	INFO	:	Epoch 43 | loss: 0.00701619 | val_loss: 0.0070694 | Time: 15550.6 ms
[2020-11-12 00:40:25	                main:574]	:	INFO	:	Epoch 44 | loss: 0.0067144 | val_loss: 0.00666045 | Time: 15580.6 ms
[2020-11-12 00:40:41	                main:574]	:	INFO	:	Epoch 45 | loss: 0.00645002 | val_loss: 0.00638298 | Time: 15543.1 ms
[2020-11-12 00:40:56	                main:574]	:	INFO	:	Epoch 46 | loss: 0.00622885 | val_loss: 0.00660178 | Time: 15555.9 ms
[2020-11-12 00:41:12	                main:574]	:	INFO	:	Epoch 47 | loss: 0.00689526 | val_loss: 0.00611585 | Time: 15573.8 ms
[2020-11-12 00:41:28	                main:574]	:	INFO	:	Epoch 48 | loss: 0.00590167 | val_loss: 0.00579629 | Time: 15774 ms
[2020-11-12 00:41:43	                main:574]	:	INFO	:	Epoch 49 | loss: 0.00567614 | val_loss: 0.0055981 | Time: 15719.2 ms
[2020-11-12 00:41:59	                main:574]	:	INFO	:	Epoch 50 | loss: 0.00549254 | val_loss: 0.00541622 | Time: 15728.7 ms
[2020-11-12 00:42:15	                main:574]	:	INFO	:	Epoch 51 | loss: 0.00532095 | val_loss: 0.00524932 | Time: 15711.1 ms
[2020-11-12 00:42:31	                main:574]	:	INFO	:	Epoch 52 | loss: 0.00515588 | val_loss: 0.00508341 | Time: 15724.6 ms
[2020-11-12 00:42:46	                main:574]	:	INFO	:	Epoch 53 | loss: 0.00534009 | val_loss: 0.00494828 | Time: 15767.4 ms
[2020-11-12 00:43:02	                main:574]	:	INFO	:	Epoch 54 | loss: 0.00485935 | val_loss: 0.00477146 | Time: 15581.3 ms
[2020-11-12 00:43:18	                main:574]	:	INFO	:	Epoch 55 | loss: 0.00470712 | val_loss: 0.00624615 | Time: 15568.3 ms
[2020-11-12 00:43:33	                main:574]	:	INFO	:	Epoch 56 | loss: 0.00504467 | val_loss: 0.00451045 | Time: 15538.7 ms
[2020-11-12 00:43:49	                main:574]	:	INFO	:	Epoch 57 | loss: 0.00443331 | val_loss: 0.00434097 | Time: 15540.6 ms
[2020-11-12 00:44:04	                main:574]	:	INFO	:	Epoch 58 | loss: 0.00428277 | val_loss: 0.00421423 | Time: 15588 ms
[2020-11-12 00:44:20	                main:574]	:	INFO	:	Epoch 59 | loss: 0.00413662 | val_loss: 0.00405187 | Time: 15533.6 ms
[2020-11-12 00:44:35	                main:574]	:	INFO	:	Epoch 60 | loss: 0.00399653 | val_loss: 0.00391466 | Time: 15563 ms
[2020-11-12 00:44:51	                main:574]	:	INFO	:	Epoch 61 | loss: 0.00386322 | val_loss: 0.00377987 | Time: 15543.7 ms
[2020-11-12 00:45:07	                main:574]	:	INFO	:	Epoch 62 | loss: 0.0037325 | val_loss: 0.00365247 | Time: 15686.3 ms
[2020-11-12 00:45:22	                main:574]	:	INFO	:	Epoch 63 | loss: 0.00360446 | val_loss: 0.00352928 | Time: 15585.6 ms
[2020-11-12 00:45:38	                main:574]	:	INFO	:	Epoch 64 | loss: 0.00348705 | val_loss: 0.0033975 | Time: 15621.2 ms
[2020-11-12 00:45:54	                main:574]	:	INFO	:	Epoch 65 | loss: 0.00335718 | val_loss: 0.00327952 | Time: 15729.8 ms
[2020-11-12 00:46:09	                main:574]	:	INFO	:	Epoch 66 | loss: 0.00324882 | val_loss: 0.00317174 | Time: 15631.1 ms
[2020-11-12 00:46:25	                main:574]	:	INFO	:	Epoch 67 | loss: 0.00312956 | val_loss: 0.0030413 | Time: 15554 ms
[2020-11-12 00:46:40	                main:574]	:	INFO	:	Epoch 68 | loss: 0.00300422 | val_loss: 0.0029278 | Time: 15543.1 ms
[2020-11-12 00:46:56	                main:574]	:	INFO	:	Epoch 69 | loss: 0.00291396 | val_loss: 0.00281799 | Time: 15760.7 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 750 Ti)
[2020-11-12 00:47:49	                main:435]	:	INFO	:	Set logging level to 1
[2020-11-12 00:47:49	                main:441]	:	INFO	:	Running in BOINC Client mode
[2020-11-12 00:47:49	                main:444]	:	INFO	:	Resolving all filenames
[2020-11-12 00:47:49	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0005-train-val-dataset.hdf5 (exists = 1)
[2020-11-12 00:47:49	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0005-1605109696-16486-0_0_r1493303898_1 (exists = 1)
[2020-11-12 00:47:49	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0005-1605109696-16486-0_0_r1493303898_0 (exists = 0)
[2020-11-12 00:47:49	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 0)
[2020-11-12 00:47:49	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2020-11-12 00:47:49	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/rand_automata_0005-train-val-dataset.hdf5
[2020-11-12 00:47:49	                main:474]	:	INFO	:	Configuration: 
[2020-11-12 00:47:49	                main:475]	:	INFO	:	    Model type: LSTM
[2020-11-12 00:47:49	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2020-11-12 00:47:49	                main:477]	:	INFO	:	    Max Epochs: 192
[2020-11-12 00:47:49	                main:478]	:	INFO	:	    Batch Size: 32
[2020-11-12 00:47:49	                main:479]	:	INFO	:	    Learning Rate: 0.001
[2020-11-12 00:47:49	                main:480]	:	INFO	:	    Patience: 10
[2020-11-12 00:47:49	                main:481]	:	INFO	:	    Hidden Width: 64
[2020-11-12 00:47:49	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2020-11-12 00:47:49	                main:483]	:	INFO	:	    # Backend Layers: 2
[2020-11-12 00:47:49	                main:484]	:	INFO	:	    # Threads: 1
[2020-11-12 00:47:49	                main:486]	:	INFO	:	Preparing Dataset
[2020-11-12 00:47:49	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0005-train-val-dataset.hdf5 into memory
[2020-11-12 00:47:49	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0005-train-val-dataset.hdf5 into memory
[2020-11-12 00:47:52	                load:106]	:	INFO	:	Successfully loaded dataset of 4096 examples into memory.
[2020-11-12 00:47:52	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0005-train-val-dataset.hdf5 into memory
[2020-11-12 00:47:52	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0005-train-val-dataset.hdf5 into memory
[2020-11-12 00:47:52	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2020-11-12 00:47:52	                main:494]	:	INFO	:	Creating Model
[2020-11-12 00:47:52	                main:507]	:	INFO	:	Preparing config file
[2020-11-12 00:47:52	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2020-11-12 00:47:52	                main:512]	:	INFO	:	Loading config
[2020-11-12 00:47:52	                main:514]	:	INFO	:	Loading state
[2020-11-12 00:47:53	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2020-11-12 00:47:53	                main:562]	:	INFO	:	Starting Training
[2020-11-12 00:48:11	                main:574]	:	INFO	:	Epoch 65 | loss: 0.00319683 | val_loss: 0.00284326 | Time: 17822.6 ms
[2020-11-12 00:48:27	                main:574]	:	INFO	:	Epoch 66 | loss: 0.00263395 | val_loss: 0.00239133 | Time: 16696.7 ms
[2020-11-12 00:48:44	                main:574]	:	INFO	:	Epoch 67 | loss: 0.00224344 | val_loss: 0.00205662 | Time: 16563.7 ms
[2020-11-12 00:49:01	                main:574]	:	INFO	:	Epoch 68 | loss: 0.00194573 | val_loss: 0.0017955 | Time: 16537.4 ms
[2020-11-12 00:49:18	                main:574]	:	INFO	:	Epoch 69 | loss: 0.00171131 | val_loss: 0.00158621 | Time: 17274.4 ms
[2020-11-12 00:49:34	                main:574]	:	INFO	:	Epoch 70 | loss: 0.00152284 | val_loss: 0.00141925 | Time: 16150.7 ms
[2020-11-12 00:49:50	                main:574]	:	INFO	:	Epoch 71 | loss: 0.00136921 | val_loss: 0.00128247 | Time: 15949 ms
[2020-11-12 00:50:06	                main:574]	:	INFO	:	Epoch 72 | loss: 0.00124054 | val_loss: 0.00116625 | Time: 15902.2 ms
[2020-11-12 00:50:22	                main:574]	:	INFO	:	Epoch 73 | loss: 0.0011306 | val_loss: 0.00106785 | Time: 16101.3 ms
[2020-11-12 00:50:38	                main:574]	:	INFO	:	Epoch 74 | loss: 0.00104012 | val_loss: 0.000984866 | Time: 15694.4 ms
[2020-11-12 00:50:53	                main:574]	:	INFO	:	Epoch 75 | loss: 0.000959834 | val_loss: 0.000907592 | Time: 15770.7 ms
[2020-11-12 00:51:09	                main:574]	:	INFO	:	Epoch 76 | loss: 0.000889868 | val_loss: 0.000847588 | Time: 15653.8 ms
[2020-11-12 00:51:25	                main:574]	:	INFO	:	Epoch 77 | loss: 0.000828617 | val_loss: 0.000791047 | Time: 16032.8 ms
[2020-11-12 00:51:42	                main:574]	:	INFO	:	Epoch 78 | loss: 0.00077551 | val_loss: 0.000738906 | Time: 17104 ms
[2020-11-12 00:51:59	                main:574]	:	INFO	:	Epoch 79 | loss: 0.000726803 | val_loss: 0.000696883 | Time: 17163.7 ms
[2020-11-12 00:52:16	                main:574]	:	INFO	:	Epoch 80 | loss: 0.000683521 | val_loss: 0.000654269 | Time: 16753.6 ms
[2020-11-12 00:52:33	                main:574]	:	INFO	:	Epoch 81 | loss: 0.000642368 | val_loss: 0.000616707 | Time: 16760.3 ms
[2020-11-12 00:52:49	                main:574]	:	INFO	:	Epoch 82 | loss: 0.000606995 | val_loss: 0.00058251 | Time: 16108 ms
[2020-11-12 00:53:06	                main:574]	:	INFO	:	Epoch 83 | loss: 0.000574872 | val_loss: 0.000556641 | Time: 16975.9 ms
[2020-11-12 00:53:22	                main:574]	:	INFO	:	Epoch 84 | loss: 0.000545124 | val_loss: 0.000524309 | Time: 16162.8 ms
[2020-11-12 00:53:39	                main:574]	:	INFO	:	Epoch 85 | loss: 0.000517861 | val_loss: 0.000501405 | Time: 16280.2 ms
[2020-11-12 00:53:55	                main:574]	:	INFO	:	Epoch 86 | loss: 0.000494367 | val_loss: 0.000482683 | Time: 16033.4 ms
[2020-11-12 00:54:11	                main:574]	:	INFO	:	Epoch 87 | loss: 0.00047192 | val_loss: 0.000457372 | Time: 15836 ms
[2020-11-12 00:54:27	                main:574]	:	INFO	:	Epoch 88 | loss: 0.000450668 | val_loss: 0.000438483 | Time: 16156.3 ms
[2020-11-12 00:54:43	                main:574]	:	INFO	:	Epoch 89 | loss: 0.000431044 | val_loss: 0.000422176 | Time: 15925.1 ms
[2020-11-12 00:54:59	                main:574]	:	INFO	:	Epoch 90 | loss: 0.000413688 | val_loss: 0.000402563 | Time: 16666.1 ms
[2020-11-12 00:55:15	                main:574]	:	INFO	:	Epoch 91 | loss: 0.000397961 | val_loss: 0.000387553 | Time: 15935.9 ms
[2020-11-12 00:55:31	                main:574]	:	INFO	:	Epoch 92 | loss: 0.000381405 | val_loss: 0.000371243 | Time: 15829.7 ms
[2020-11-12 00:55:47	                main:574]	:	INFO	:	Epoch 93 | loss: 0.00036739 | val_loss: 0.000358433 | Time: 15661.1 ms
[2020-11-12 00:56:03	                main:574]	:	INFO	:	Epoch 94 | loss: 0.000354331 | val_loss: 0.000344862 | Time: 16222.1 ms
[2020-11-12 00:56:20	                main:574]	:	INFO	:	Epoch 95 | loss: 0.000341135 | val_loss: 0.000329956 | Time: 16671.4 ms
[2020-11-12 00:56:36	                main:574]	:	INFO	:	Epoch 96 | loss: 0.00032961 | val_loss: 0.000320938 | Time: 15887.6 ms
[2020-11-12 00:56:51	                main:574]	:	INFO	:	Epoch 97 | loss: 0.000318459 | val_loss: 0.000313919 | Time: 15497.4 ms
[2020-11-12 00:57:07	                main:574]	:	INFO	:	Epoch 98 | loss: 0.000307062 | val_loss: 0.000300729 | Time: 15491.3 ms
[2020-11-12 00:57:22	                main:574]	:	INFO	:	Epoch 99 | loss: 0.000297065 | val_loss: 0.00028888 | Time: 15491.6 ms
[2020-11-12 00:57:39	                main:574]	:	INFO	:	Epoch 100 | loss: 0.00028779 | val_loss: 0.000282756 | Time: 17287.4 ms
[2020-11-12 00:57:55	                main:574]	:	INFO	:	Epoch 101 | loss: 0.000278044 | val_loss: 0.000272544 | Time: 15765.4 ms
[2020-11-12 00:58:11	                main:574]	:	INFO	:	Epoch 102 | loss: 0.00026986 | val_loss: 0.000261811 | Time: 15434.7 ms
[2020-11-12 00:58:26	                main:574]	:	INFO	:	Epoch 103 | loss: 0.000260897 | val_loss: 0.000254149 | Time: 15453.5 ms
[2020-11-12 00:58:42	                main:574]	:	INFO	:	Epoch 104 | loss: 0.000253117 | val_loss: 0.00024799 | Time: 15419 ms
[2020-11-12 00:58:57	                main:574]	:	INFO	:	Epoch 105 | loss: 0.000246183 | val_loss: 0.000240574 | Time: 15412.8 ms
[2020-11-12 00:59:12	                main:574]	:	INFO	:	Epoch 106 | loss: 0.000238488 | val_loss: 0.000232448 | Time: 15401.8 ms
[2020-11-12 00:59:28	                main:574]	:	INFO	:	Epoch 107 | loss: 0.000231727 | val_loss: 0.000226946 | Time: 15404.6 ms
[2020-11-12 00:59:43	                main:574]	:	INFO	:	Epoch 108 | loss: 0.000225518 | val_loss: 0.000219196 | Time: 15446.3 ms
[2020-11-12 00:59:59	                main:574]	:	INFO	:	Epoch 109 | loss: 0.000219474 | val_loss: 0.00021419 | Time: 15428.6 ms
[2020-11-12 01:00:14	                main:574]	:	INFO	:	Epoch 110 | loss: 0.000213227 | val_loss: 0.000208844 | Time: 15500.2 ms
[2020-11-12 01:00:30	                main:574]	:	INFO	:	Epoch 111 | loss: 0.000207546 | val_loss: 0.000202213 | Time: 15435.9 ms
[2020-11-12 01:00:45	                main:574]	:	INFO	:	Epoch 112 | loss: 0.000201914 | val_loss: 0.000196511 | Time: 15441.2 ms
[2020-11-12 01:01:01	                main:574]	:	INFO	:	Epoch 113 | loss: 0.000196792 | val_loss: 0.000194702 | Time: 15463.3 ms
[2020-11-12 01:01:16	                main:574]	:	INFO	:	Epoch 114 | loss: 0.000192016 | val_loss: 0.000187825 | Time: 15425.7 ms
[2020-11-12 01:01:31	                main:574]	:	INFO	:	Epoch 115 | loss: 0.000187522 | val_loss: 0.00018314 | Time: 15407.6 ms
[2020-11-12 01:01:47	                main:574]	:	INFO	:	Epoch 116 | loss: 0.00018266 | val_loss: 0.000179262 | Time: 15407.4 ms
[2020-11-12 01:02:02	                main:574]	:	INFO	:	Epoch 117 | loss: 0.000179144 | val_loss: 0.000175635 | Time: 15477.9 ms
[2020-11-12 01:02:18	                main:574]	:	INFO	:	Epoch 118 | loss: 0.000174564 | val_loss: 0.000171046 | Time: 15429.6 ms
[2020-11-12 01:02:33	                main:574]	:	INFO	:	Epoch 119 | loss: 0.000171186 | val_loss: 0.000169508 | Time: 15437.3 ms
[2020-11-12 01:02:49	                main:574]	:	INFO	:	Epoch 120 | loss: 0.000167422 | val_loss: 0.000166852 | Time: 15683.8 ms
[2020-11-12 01:03:04	                main:574]	:	INFO	:	Epoch 121 | loss: 0.000162872 | val_loss: 0.00015999 | Time: 15485.9 ms
[2020-11-12 01:03:20	                main:574]	:	INFO	:	Epoch 122 | loss: 0.000159485 | val_loss: 0.000157077 | Time: 15418.4 ms
[2020-11-12 01:03:35	                main:574]	:	INFO	:	Epoch 123 | loss: 0.000156464 | val_loss: 0.000153965 | Time: 15390.7 ms
[2020-11-12 01:03:51	                main:574]	:	INFO	:	Epoch 124 | loss: 0.000153526 | val_loss: 0.000152354 | Time: 15418.4 ms
[2020-11-12 01:04:06	                main:574]	:	INFO	:	Epoch 125 | loss: 0.000150573 | val_loss: 0.000147263 | Time: 15401.8 ms
[2020-11-12 01:04:22	                main:574]	:	INFO	:	Epoch 126 | loss: 0.000147577 | val_loss: 0.000144399 | Time: 15406.6 ms
[2020-11-12 01:04:37	                main:574]	:	INFO	:	Epoch 127 | loss: 0.00014481 | val_loss: 0.000142802 | Time: 15425.3 ms
[2020-11-12 01:04:52	                main:574]	:	INFO	:	Epoch 128 | loss: 0.000141976 | val_loss: 0.00013977 | Time: 15426.3 ms
[2020-11-12 01:05:08	                main:574]	:	INFO	:	Epoch 129 | loss: 0.000139312 | val_loss: 0.000136584 | Time: 15416.2 ms
[2020-11-12 01:05:23	                main:574]	:	INFO	:	Epoch 130 | loss: 0.00013617 | val_loss: 0.000133995 | Time: 15398.4 ms
[2020-11-12 01:05:39	                main:574]	:	INFO	:	Epoch 131 | loss: 0.000134245 | val_loss: 0.000131306 | Time: 15429.3 ms
[2020-11-12 01:05:54	                main:574]	:	INFO	:	Epoch 132 | loss: 0.00013213 | val_loss: 0.000130131 | Time: 15434.7 ms
[2020-11-12 01:06:10	                main:574]	:	INFO	:	Epoch 133 | loss: 0.000129432 | val_loss: 0.000127248 | Time: 15416.3 ms
[2020-11-12 01:06:25	                main:574]	:	INFO	:	Epoch 134 | loss: 0.000127485 | val_loss: 0.000125202 | Time: 15425.5 ms
[2020-11-12 01:06:41	                main:574]	:	INFO	:	Epoch 135 | loss: 0.000124887 | val_loss: 0.000122692 | Time: 15455.2 ms
[2020-11-12 01:06:56	                main:574]	:	INFO	:	Epoch 136 | loss: 0.000123413 | val_loss: 0.000122254 | Time: 15433.9 ms
[2020-11-12 01:07:11	                main:574]	:	INFO	:	Epoch 137 | loss: 0.000121349 | val_loss: 0.000120339 | Time: 15414.1 ms
[2020-11-12 01:07:27	                main:574]	:	INFO	:	Epoch 138 | loss: 0.000119326 | val_loss: 0.000116947 | Time: 15386.5 ms
[2020-11-12 01:07:42	                main:574]	:	INFO	:	Epoch 139 | loss: 0.000117602 | val_loss: 0.000116247 | Time: 15428.7 ms
[2020-11-12 01:07:58	                main:574]	:	INFO	:	Epoch 140 | loss: 0.000116295 | val_loss: 0.000113863 | Time: 15447.7 ms
[2020-11-12 01:08:13	                main:574]	:	INFO	:	Epoch 141 | loss: 0.00011352 | val_loss: 0.000111546 | Time: 15402.6 ms
[2020-11-12 01:08:29	                main:574]	:	INFO	:	Epoch 142 | loss: 0.000112946 | val_loss: 0.000109554 | Time: 15445.2 ms
[2020-11-12 01:08:44	                main:574]	:	INFO	:	Epoch 143 | loss: 0.00011092 | val_loss: 0.000108849 | Time: 15413.6 ms
[2020-11-12 01:08:59	                main:574]	:	INFO	:	Epoch 144 | loss: 0.000108743 | val_loss: 0.000108035 | Time: 15418.9 ms
[2020-11-12 01:09:15	                main:574]	:	INFO	:	Epoch 145 | loss: 0.000107313 | val_loss: 0.000105621 | Time: 15407.5 ms
[2020-11-12 01:09:30	                main:574]	:	INFO	:	Epoch 146 | loss: 0.000105522 | val_loss: 0.000103816 | Time: 15448.8 ms
[2020-11-12 01:09:46	                main:574]	:	INFO	:	Epoch 147 | loss: 0.000104361 | val_loss: 0.000103712 | Time: 15408.3 ms
[2020-11-12 01:10:01	                main:574]	:	INFO	:	Epoch 148 | loss: 0.000103215 | val_loss: 0.000100362 | Time: 15419.4 ms
[2020-11-12 01:10:17	                main:574]	:	INFO	:	Epoch 149 | loss: 0.000101668 | val_loss: 0.000101982 | Time: 15425.1 ms
[2020-11-12 01:10:32	                main:574]	:	INFO	:	Epoch 150 | loss: 9.98787e-05 | val_loss: 9.93823e-05 | Time: 15451.4 ms
[2020-11-12 01:10:47	                main:574]	:	INFO	:	Epoch 151 | loss: 9.89093e-05 | val_loss: 9.79148e-05 | Time: 15394 ms
[2020-11-12 01:11:03	                main:574]	:	INFO	:	Epoch 152 | loss: 9.75212e-05 | val_loss: 9.64106e-05 | Time: 15435.3 ms
[2020-11-12 01:11:18	                main:574]	:	INFO	:	Epoch 153 | loss: 9.61012e-05 | val_loss: 9.50633e-05 | Time: 15409.3 ms
[2020-11-12 01:11:34	                main:574]	:	INFO	:	Epoch 154 | loss: 9.5339e-05 | val_loss: 9.42309e-05 | Time: 15423 ms
[2020-11-12 01:11:49	                main:574]	:	INFO	:	Epoch 155 | loss: 9.40458e-05 | val_loss: 9.33316e-05 | Time: 15409.9 ms
[2020-11-12 01:12:05	                main:574]	:	INFO	:	Epoch 156 | loss: 9.27115e-05 | val_loss: 9.08966e-05 | Time: 15429.7 ms
[2020-11-12 01:12:20	                main:574]	:	INFO	:	Epoch 157 | loss: 9.14577e-05 | val_loss: 9.09426e-05 | Time: 15416.5 ms
[2020-11-12 01:12:36	                main:574]	:	INFO	:	Epoch 158 | loss: 9.06901e-05 | val_loss: 8.81277e-05 | Time: 15445 ms
[2020-11-12 01:12:51	                main:574]	:	INFO	:	Epoch 159 | loss: 8.91487e-05 | val_loss: 8.89203e-05 | Time: 15438.8 ms
[2020-11-12 01:13:06	                main:574]	:	INFO	:	Epoch 160 | loss: 8.83377e-05 | val_loss: 8.75743e-05 | Time: 15427.1 ms
[2020-11-12 01:13:22	                main:574]	:	INFO	:	Epoch 161 | loss: 8.6862e-05 | val_loss: 8.59641e-05 | Time: 15490.7 ms
[2020-11-12 01:13:37	                main:574]	:	INFO	:	Epoch 162 | loss: 8.59324e-05 | val_loss: 8.48677e-05 | Time: 15395.3 ms
[2020-11-12 01:13:53	                main:574]	:	INFO	:	Epoch 163 | loss: 8.50357e-05 | val_loss: 8.41452e-05 | Time: 15419.6 ms
[2020-11-12 01:14:08	                main:574]	:	INFO	:	Epoch 164 | loss: 8.46954e-05 | val_loss: 8.26685e-05 | Time: 15450.4 ms
[2020-11-12 01:14:24	                main:574]	:	INFO	:	Epoch 165 | loss: 8.29673e-05 | val_loss: 8.29134e-05 | Time: 15429.7 ms
[2020-11-12 01:14:39	                main:574]	:	INFO	:	Epoch 166 | loss: 8.2105e-05 | val_loss: 8.13946e-05 | Time: 15431.4 ms
[2020-11-12 01:14:55	                main:574]	:	INFO	:	Epoch 167 | loss: 8.10563e-05 | val_loss: 8.12758e-05 | Time: 15403.9 ms
[2020-11-12 01:15:10	                main:574]	:	INFO	:	Epoch 168 | loss: 8.09702e-05 | val_loss: 8.07028e-05 | Time: 15434.2 ms
[2020-11-12 01:15:25	                main:574]	:	INFO	:	Epoch 169 | loss: 7.93242e-05 | val_loss: 7.99378e-05 | Time: 15413.2 ms
[2020-11-12 01:15:41	                main:574]	:	INFO	:	Epoch 170 | loss: 7.8804e-05 | val_loss: 7.90758e-05 | Time: 15424.9 ms
[2020-11-12 01:15:56	                main:574]	:	INFO	:	Epoch 171 | loss: 7.7632e-05 | val_loss: 7.59824e-05 | Time: 15415.2 ms
[2020-11-12 01:16:12	                main:574]	:	INFO	:	Epoch 172 | loss: 7.67404e-05 | val_loss: 7.68417e-05 | Time: 15444.2 ms
[2020-11-12 01:16:27	                main:574]	:	INFO	:	Epoch 173 | loss: 7.64156e-05 | val_loss: 7.55413e-05 | Time: 15422.2 ms
[2020-11-12 01:16:43	                main:574]	:	INFO	:	Epoch 174 | loss: 7.53995e-05 | val_loss: 7.35647e-05 | Time: 15406.7 ms
[2020-11-12 01:16:58	                main:574]	:	INFO	:	Epoch 175 | loss: 7.44343e-05 | val_loss: 7.37682e-05 | Time: 15434.1 ms
[2020-11-12 01:17:13	                main:574]	:	INFO	:	Epoch 176 | loss: 7.39182e-05 | val_loss: 7.25638e-05 | Time: 15409.4 ms
[2020-11-12 01:17:29	                main:574]	:	INFO	:	Epoch 177 | loss: 7.27486e-05 | val_loss: 7.31083e-05 | Time: 15425.6 ms
[2020-11-12 01:17:44	                main:574]	:	INFO	:	Epoch 178 | loss: 7.27952e-05 | val_loss: 7.39044e-05 | Time: 15456.5 ms
[2020-11-12 01:18:00	                main:574]	:	INFO	:	Epoch 179 | loss: 7.12395e-05 | val_loss: 6.98478e-05 | Time: 15890.7 ms
[2020-11-12 01:18:16	                main:574]	:	INFO	:	Epoch 180 | loss: 7.10762e-05 | val_loss: 6.94819e-05 | Time: 15429 ms
[2020-11-12 01:18:31	                main:574]	:	INFO	:	Epoch 181 | loss: 7.01793e-05 | val_loss: 7.1015e-05 | Time: 15413 ms
[2020-11-12 01:18:47	                main:574]	:	INFO	:	Epoch 182 | loss: 6.95654e-05 | val_loss: 6.88307e-05 | Time: 15410.4 ms
[2020-11-12 01:19:02	                main:574]	:	INFO	:	Epoch 183 | loss: 6.8607e-05 | val_loss: 6.82319e-05 | Time: 15446 ms
[2020-11-12 01:19:17	                main:574]	:	INFO	:	Epoch 184 | loss: 6.81474e-05 | val_loss: 6.73337e-05 | Time: 15419.2 ms
[2020-11-12 01:19:33	                main:574]	:	INFO	:	Epoch 185 | loss: 6.77033e-05 | val_loss: 6.75624e-05 | Time: 15399.8 ms
[2020-11-12 01:19:48	                main:574]	:	INFO	:	Epoch 186 | loss: 6.69843e-05 | val_loss: 6.76095e-05 | Time: 15433.4 ms
[2020-11-12 01:20:04	                main:574]	:	INFO	:	Epoch 187 | loss: 6.65139e-05 | val_loss: 6.57139e-05 | Time: 15790 ms
[2020-11-12 01:20:20	                main:574]	:	INFO	:	Epoch 188 | loss: 6.54566e-05 | val_loss: 6.56997e-05 | Time: 15434.9 ms
[2020-11-12 01:20:35	                main:574]	:	INFO	:	Epoch 189 | loss: 6.49677e-05 | val_loss: 6.47109e-05 | Time: 15415.6 ms
[2020-11-12 01:20:50	                main:574]	:	INFO	:	Epoch 190 | loss: 6.44261e-05 | val_loss: 6.31162e-05 | Time: 15410.6 ms
[2020-11-12 01:21:06	                main:574]	:	INFO	:	Epoch 191 | loss: 6.3441e-05 | val_loss: 6.38137e-05 | Time: 15441.9 ms
[2020-11-12 01:21:21	                main:574]	:	INFO	:	Epoch 192 | loss: 6.33061e-05 | val_loss: 6.26658e-05 | Time: 15437.9 ms
[2020-11-12 01:21:21	                main:597]	:	INFO	:	Saving trained model to model-final.pt, val_loss 6.26658e-05
[2020-11-12 01:21:21	                main:603]	:	INFO	:	Saving end state to config to file
[2020-11-12 01:21:21	                main:608]	:	INFO	:	Success, exiting..
01:21:21 (5312): called boinc_finish(0)

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)