Task 2825016

Name rand_automata_0004-1604983406-880-0_2
Workunit 1263802
Created 10 Nov 2020, 23:31:35 UTC
Sent 10 Nov 2020, 23:35:37 UTC
Report deadline 11 Nov 2020, 22:05:37 UTC
Received 11 Nov 2020, 3:10:41 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 443
Run time 50 min 21 sec
CPU time 28 min 41 sec
Validate state Valid
Credit 959.40
Device peak FLOPS 9,073.48 GFLOPS
Application version Machine Learning Dataset Generator (test) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.49 GB
Peak swap size 3.22 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 1080)
[2020-11-11 03:20:13	                main:435]	:	INFO	:	Set logging level to 1
[2020-11-11 03:20:13	                main:441]	:	INFO	:	Running in BOINC Client mode
[2020-11-11 03:20:13	                main:444]	:	INFO	:	Resolving all filenames
[2020-11-11 03:20:13	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0004-train-val-dataset.hdf5 (exists = 1)
[2020-11-11 03:20:13	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0004-1604983406-880-0_2_r155609760_1 (exists = 0)
[2020-11-11 03:20:13	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0004-1604983406-880-0_2_r155609760_0 (exists = 0)
[2020-11-11 03:20:13	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 0)
[2020-11-11 03:20:13	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2020-11-11 03:20:13	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/rand_automata_0004-train-val-dataset.hdf5
[2020-11-11 03:20:13	                main:474]	:	INFO	:	Configuration: 
[2020-11-11 03:20:13	                main:475]	:	INFO	:	    Model type: LSTM
[2020-11-11 03:20:13	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2020-11-11 03:20:13	                main:477]	:	INFO	:	    Max Epochs: 192
[2020-11-11 03:20:13	                main:478]	:	INFO	:	    Batch Size: 32
[2020-11-11 03:20:13	                main:479]	:	INFO	:	    Learning Rate: 0.001
[2020-11-11 03:20:13	                main:480]	:	INFO	:	    Patience: 10
[2020-11-11 03:20:13	                main:481]	:	INFO	:	    Hidden Width: 64
[2020-11-11 03:20:13	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2020-11-11 03:20:13	                main:483]	:	INFO	:	    # Backend Layers: 2
[2020-11-11 03:20:13	                main:484]	:	INFO	:	    # Threads: 1
[2020-11-11 03:20:13	                main:486]	:	INFO	:	Preparing Dataset
[2020-11-11 03:20:13	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0004-train-val-dataset.hdf5 into memory
[2020-11-11 03:20:13	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0004-train-val-dataset.hdf5 into memory
[2020-11-11 03:20:34	                load:106]	:	INFO	:	Successfully loaded dataset of 4096 examples into memory.
[2020-11-11 03:20:34	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0004-train-val-dataset.hdf5 into memory
[2020-11-11 03:20:34	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0004-train-val-dataset.hdf5 into memory
[2020-11-11 03:20:34	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2020-11-11 03:20:34	                main:494]	:	INFO	:	Creating Model
[2020-11-11 03:20:34	                main:507]	:	INFO	:	Preparing config file
[2020-11-11 03:20:34	                main:519]	:	INFO	:	Creating new config file
[2020-11-11 03:20:44	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2020-11-11 03:20:44	                main:562]	:	INFO	:	Starting Training
[2020-11-11 03:21:04	                main:574]	:	INFO	:	Epoch 1 | loss: 0.0658459 | val_loss: 0.0654295 | Time: 19995.4 ms
[2020-11-11 03:21:21	                main:574]	:	INFO	:	Epoch 2 | loss: 0.0652791 | val_loss: 0.0643295 | Time: 16745.9 ms
[2020-11-11 03:21:39	                main:574]	:	INFO	:	Epoch 3 | loss: 0.0631224 | val_loss: 0.0613643 | Time: 17801.6 ms
[2020-11-11 03:21:57	                main:574]	:	INFO	:	Epoch 4 | loss: 0.0600023 | val_loss: 0.058627 | Time: 18402.4 ms
[2020-11-11 03:22:13	                main:574]	:	INFO	:	Epoch 5 | loss: 0.0573503 | val_loss: 0.0564393 | Time: 16093 ms
[2020-11-11 03:22:29	                main:574]	:	INFO	:	Epoch 6 | loss: 0.0554748 | val_loss: 0.0549741 | Time: 16036.9 ms
[2020-11-11 03:22:47	                main:574]	:	INFO	:	Epoch 7 | loss: 0.0539579 | val_loss: 0.0535716 | Time: 18162.5 ms
[2020-11-11 03:23:04	                main:574]	:	INFO	:	Epoch 8 | loss: 0.0525957 | val_loss: 0.0522855 | Time: 16539.3 ms
[2020-11-11 03:23:22	                main:574]	:	INFO	:	Epoch 9 | loss: 0.0511493 | val_loss: 0.05073 | Time: 17653.5 ms
[2020-11-11 03:23:38	                main:574]	:	INFO	:	Epoch 10 | loss: 0.0495529 | val_loss: 0.0491073 | Time: 16245.3 ms
[2020-11-11 03:23:54	                main:574]	:	INFO	:	Epoch 11 | loss: 0.0476924 | val_loss: 0.0471278 | Time: 16268 ms
[2020-11-11 03:24:11	                main:574]	:	INFO	:	Epoch 12 | loss: 0.0455711 | val_loss: 0.0447112 | Time: 16364.6 ms
[2020-11-11 03:24:28	                main:574]	:	INFO	:	Epoch 13 | loss: 0.0430839 | val_loss: 0.0425966 | Time: 17214.2 ms
[2020-11-11 03:24:44	                main:574]	:	INFO	:	Epoch 14 | loss: 0.0405504 | val_loss: 0.0403898 | Time: 16708.6 ms
[2020-11-11 03:25:01	                main:574]	:	INFO	:	Epoch 15 | loss: 0.037669 | val_loss: 0.0374098 | Time: 16100.8 ms
[2020-11-11 03:25:16	                main:574]	:	INFO	:	Epoch 16 | loss: 0.0347109 | val_loss: 0.0346928 | Time: 15079.1 ms
[2020-11-11 03:25:30	                main:574]	:	INFO	:	Epoch 17 | loss: 0.0324514 | val_loss: 0.0324792 | Time: 14196.6 ms
[2020-11-11 03:25:46	                main:574]	:	INFO	:	Epoch 18 | loss: 0.0307308 | val_loss: 0.0495957 | Time: 15882.9 ms
[2020-11-11 03:26:03	                main:574]	:	INFO	:	Epoch 19 | loss: 0.0319974 | val_loss: 0.0466475 | Time: 16960.5 ms
[2020-11-11 03:26:18	                main:574]	:	INFO	:	Epoch 20 | loss: 0.0338671 | val_loss: 0.0294155 | Time: 15189.9 ms
[2020-11-11 03:26:35	                main:574]	:	INFO	:	Epoch 21 | loss: 0.0252528 | val_loss: 0.0237759 | Time: 16694.5 ms
[2020-11-11 03:26:50	                main:574]	:	INFO	:	Epoch 22 | loss: 0.0235957 | val_loss: 0.0249962 | Time: 15482.1 ms
[2020-11-11 03:27:07	                main:574]	:	INFO	:	Epoch 23 | loss: 0.0219841 | val_loss: 0.030625 | Time: 16530.3 ms
[2020-11-11 03:27:23	                main:574]	:	INFO	:	Epoch 24 | loss: 0.021933 | val_loss: 0.0201112 | Time: 16196.5 ms
[2020-11-11 03:27:39	                main:574]	:	INFO	:	Epoch 25 | loss: 0.0216989 | val_loss: 0.0192562 | Time: 15981.9 ms
[2020-11-11 03:27:52	                main:574]	:	INFO	:	Epoch 26 | loss: 0.0176525 | val_loss: 0.0195557 | Time: 13213.7 ms
[2020-11-11 03:28:08	                main:574]	:	INFO	:	Epoch 27 | loss: 0.021193 | val_loss: 0.0176967 | Time: 16000.2 ms
[2020-11-11 03:28:23	                main:574]	:	INFO	:	Epoch 28 | loss: 0.02037 | val_loss: 0.0190291 | Time: 14956 ms
[2020-11-11 03:28:39	                main:574]	:	INFO	:	Epoch 29 | loss: 0.0140566 | val_loss: 0.0138698 | Time: 15883.1 ms
[2020-11-11 03:28:55	                main:574]	:	INFO	:	Epoch 30 | loss: 0.0171929 | val_loss: 0.0555778 | Time: 15990.7 ms
[2020-11-11 03:29:10	                main:574]	:	INFO	:	Epoch 31 | loss: 0.0419201 | val_loss: 0.023487 | Time: 14911.3 ms
[2020-11-11 03:29:24	                main:574]	:	INFO	:	Epoch 32 | loss: 0.0218272 | val_loss: 0.0458807 | Time: 14098.5 ms
[2020-11-11 03:29:40	                main:574]	:	INFO	:	Epoch 33 | loss: 0.0245728 | val_loss: 0.0160787 | Time: 15746.5 ms
[2020-11-11 03:29:57	                main:574]	:	INFO	:	Epoch 34 | loss: 0.0136953 | val_loss: 0.0121665 | Time: 16419.1 ms
[2020-11-11 03:30:13	                main:574]	:	INFO	:	Epoch 35 | loss: 0.0124226 | val_loss: 0.0250469 | Time: 16152.1 ms
[2020-11-11 03:30:28	                main:574]	:	INFO	:	Epoch 36 | loss: 0.016886 | val_loss: 0.0117946 | Time: 15572.9 ms
[2020-11-11 03:30:45	                main:574]	:	INFO	:	Epoch 37 | loss: 0.0106424 | val_loss: 0.011056 | Time: 16179 ms
[2020-11-11 03:31:00	                main:574]	:	INFO	:	Epoch 38 | loss: 0.0123143 | val_loss: 0.0151032 | Time: 15728.3 ms
[2020-11-11 03:31:16	                main:574]	:	INFO	:	Epoch 39 | loss: 0.0109146 | val_loss: 0.0096262 | Time: 15392.9 ms
[2020-11-11 03:31:32	                main:574]	:	INFO	:	Epoch 40 | loss: 0.00875278 | val_loss: 0.00899788 | Time: 15836.2 ms
[2020-11-11 03:31:47	                main:574]	:	INFO	:	Epoch 41 | loss: 0.00813559 | val_loss: 0.00851684 | Time: 15863.6 ms
[2020-11-11 03:32:05	                main:574]	:	INFO	:	Epoch 42 | loss: 0.00770214 | val_loss: 0.00798917 | Time: 17135.6 ms
[2020-11-11 03:32:19	                main:574]	:	INFO	:	Epoch 43 | loss: 0.00754434 | val_loss: 0.00777772 | Time: 14848.2 ms
[2020-11-11 03:32:35	                main:574]	:	INFO	:	Epoch 44 | loss: 0.00708708 | val_loss: 0.00735201 | Time: 15689.7 ms
[2020-11-11 03:32:51	                main:574]	:	INFO	:	Epoch 45 | loss: 0.00690181 | val_loss: 0.00842161 | Time: 16129.2 ms
[2020-11-11 03:33:07	                main:574]	:	INFO	:	Epoch 46 | loss: 0.0191997 | val_loss: 0.0105158 | Time: 15638.9 ms
[2020-11-11 03:33:21	                main:574]	:	INFO	:	Epoch 47 | loss: 0.00945175 | val_loss: 0.00806828 | Time: 14226.7 ms
[2020-11-11 03:33:35	                main:574]	:	INFO	:	Epoch 48 | loss: 0.00798815 | val_loss: 0.00744569 | Time: 14161.3 ms
[2020-11-11 03:33:52	                main:574]	:	INFO	:	Epoch 49 | loss: 0.00666013 | val_loss: 0.0086829 | Time: 16212.1 ms
[2020-11-11 03:34:05	                main:574]	:	INFO	:	Epoch 50 | loss: 0.0090888 | val_loss: 0.00831599 | Time: 13502.6 ms
[2020-11-11 03:34:21	                main:574]	:	INFO	:	Epoch 51 | loss: 0.00685318 | val_loss: 0.00662717 | Time: 15669.2 ms
[2020-11-11 03:34:36	                main:574]	:	INFO	:	Epoch 52 | loss: 0.00630428 | val_loss: 0.00622706 | Time: 14952 ms
[2020-11-11 03:34:53	                main:574]	:	INFO	:	Epoch 53 | loss: 0.00585351 | val_loss: 0.00580826 | Time: 17261.3 ms
[2020-11-11 03:35:10	                main:574]	:	INFO	:	Epoch 54 | loss: 0.00552894 | val_loss: 0.00559047 | Time: 16796.1 ms
[2020-11-11 03:35:26	                main:574]	:	INFO	:	Epoch 55 | loss: 0.0053485 | val_loss: 0.00543655 | Time: 15817.3 ms
[2020-11-11 03:35:42	                main:574]	:	INFO	:	Epoch 56 | loss: 0.00516786 | val_loss: 0.00520552 | Time: 15939.3 ms
[2020-11-11 03:35:58	                main:574]	:	INFO	:	Epoch 57 | loss: 0.00500356 | val_loss: 0.00502817 | Time: 16852 ms
[2020-11-11 03:36:13	                main:574]	:	INFO	:	Epoch 58 | loss: 0.00484501 | val_loss: 0.00483786 | Time: 14579.3 ms
[2020-11-11 03:36:27	                main:574]	:	INFO	:	Epoch 59 | loss: 0.0046993 | val_loss: 0.00468728 | Time: 14207.6 ms
[2020-11-11 03:36:43	                main:574]	:	INFO	:	Epoch 60 | loss: 0.00454781 | val_loss: 0.00453073 | Time: 15747.4 ms
[2020-11-11 03:36:59	                main:574]	:	INFO	:	Epoch 61 | loss: 0.00440578 | val_loss: 0.00438786 | Time: 15651.4 ms
[2020-11-11 03:37:16	                main:574]	:	INFO	:	Epoch 62 | loss: 0.00426884 | val_loss: 0.00424368 | Time: 16926.6 ms
[2020-11-11 03:37:30	                main:574]	:	INFO	:	Epoch 63 | loss: 0.00413277 | val_loss: 0.00410034 | Time: 14604.1 ms
[2020-11-11 03:37:44	                main:574]	:	INFO	:	Epoch 64 | loss: 0.00399756 | val_loss: 0.00396344 | Time: 13926.1 ms
[2020-11-11 03:37:58	                main:574]	:	INFO	:	Epoch 65 | loss: 0.00386599 | val_loss: 0.00382326 | Time: 13557.9 ms
[2020-11-11 03:38:13	                main:574]	:	INFO	:	Epoch 66 | loss: 0.00373541 | val_loss: 0.00369037 | Time: 15375.2 ms
[2020-11-11 03:38:28	                main:574]	:	INFO	:	Epoch 67 | loss: 0.00360731 | val_loss: 0.00356043 | Time: 15121.6 ms
[2020-11-11 03:38:43	                main:574]	:	INFO	:	Epoch 68 | loss: 0.00348013 | val_loss: 0.00343033 | Time: 14580.7 ms
[2020-11-11 03:38:58	                main:574]	:	INFO	:	Epoch 69 | loss: 0.00335465 | val_loss: 0.00330457 | Time: 14852.6 ms
[2020-11-11 03:39:13	                main:574]	:	INFO	:	Epoch 70 | loss: 0.00323327 | val_loss: 0.00317938 | Time: 15267.9 ms
[2020-11-11 03:39:29	                main:574]	:	INFO	:	Epoch 71 | loss: 0.0031075 | val_loss: 0.00305818 | Time: 16138.3 ms
[2020-11-11 03:39:45	                main:574]	:	INFO	:	Epoch 72 | loss: 0.00298923 | val_loss: 0.00293989 | Time: 15694.3 ms
[2020-11-11 03:39:59	                main:574]	:	INFO	:	Epoch 73 | loss: 0.00287304 | val_loss: 0.0028215 | Time: 13637 ms
[2020-11-11 03:40:15	                main:574]	:	INFO	:	Epoch 74 | loss: 0.00275829 | val_loss: 0.0027099 | Time: 16740.4 ms
[2020-11-11 03:40:29	                main:574]	:	INFO	:	Epoch 75 | loss: 0.00264666 | val_loss: 0.00259672 | Time: 13699.1 ms
[2020-11-11 03:40:46	                main:574]	:	INFO	:	Epoch 76 | loss: 0.00253808 | val_loss: 0.00248987 | Time: 16988.1 ms
[2020-11-11 03:41:02	                main:574]	:	INFO	:	Epoch 77 | loss: 0.00243151 | val_loss: 0.00238586 | Time: 15642 ms
[2020-11-11 03:41:17	                main:574]	:	INFO	:	Epoch 78 | loss: 0.00232758 | val_loss: 0.00228309 | Time: 15108.5 ms
[2020-11-11 03:41:34	                main:574]	:	INFO	:	Epoch 79 | loss: 0.00222703 | val_loss: 0.00218493 | Time: 16747.9 ms
[2020-11-11 03:41:50	                main:574]	:	INFO	:	Epoch 80 | loss: 0.00212933 | val_loss: 0.00208649 | Time: 16257.8 ms
[2020-11-11 03:42:05	                main:574]	:	INFO	:	Epoch 81 | loss: 0.00203557 | val_loss: 0.00199421 | Time: 15072.2 ms
[2020-11-11 03:42:20	                main:574]	:	INFO	:	Epoch 82 | loss: 0.00194456 | val_loss: 0.00190655 | Time: 15127 ms
[2020-11-11 03:42:35	                main:574]	:	INFO	:	Epoch 83 | loss: 0.00185709 | val_loss: 0.00181734 | Time: 14703.4 ms
[2020-11-11 03:42:51	                main:574]	:	INFO	:	Epoch 84 | loss: 0.00177253 | val_loss: 0.0017348 | Time: 16448.4 ms
[2020-11-11 03:43:07	                main:574]	:	INFO	:	Epoch 85 | loss: 0.00169117 | val_loss: 0.00165408 | Time: 15554.1 ms
[2020-11-11 03:43:23	                main:574]	:	INFO	:	Epoch 86 | loss: 0.00161202 | val_loss: 0.00157759 | Time: 16321.1 ms
[2020-11-11 03:43:38	                main:574]	:	INFO	:	Epoch 87 | loss: 0.00153708 | val_loss: 0.00150409 | Time: 14741.6 ms
[2020-11-11 03:43:55	                main:574]	:	INFO	:	Epoch 88 | loss: 0.00146434 | val_loss: 0.00143363 | Time: 17232.4 ms
[2020-11-11 03:44:11	                main:574]	:	INFO	:	Epoch 89 | loss: 0.00139511 | val_loss: 0.00136446 | Time: 15564.6 ms
[2020-11-11 03:44:22	                main:574]	:	INFO	:	Epoch 90 | loss: 0.00132847 | val_loss: 0.00130116 | Time: 11143.9 ms
[2020-11-11 03:44:37	                main:574]	:	INFO	:	Epoch 91 | loss: 0.00126516 | val_loss: 0.00123848 | Time: 14679.9 ms
[2020-11-11 03:44:52	                main:574]	:	INFO	:	Epoch 92 | loss: 0.00120431 | val_loss: 0.00117937 | Time: 15245.6 ms
[2020-11-11 03:45:08	                main:574]	:	INFO	:	Epoch 93 | loss: 0.00114685 | val_loss: 0.00112355 | Time: 16306.5 ms
[2020-11-11 03:45:24	                main:574]	:	INFO	:	Epoch 94 | loss: 0.00109167 | val_loss: 0.00106809 | Time: 15859.3 ms
[2020-11-11 03:45:41	                main:574]	:	INFO	:	Epoch 95 | loss: 0.00103917 | val_loss: 0.00101753 | Time: 17233.9 ms
[2020-11-11 03:45:55	                main:574]	:	INFO	:	Epoch 96 | loss: 0.000988809 | val_loss: 0.000968639 | Time: 14106.9 ms
[2020-11-11 03:46:11	                main:574]	:	INFO	:	Epoch 97 | loss: 0.000941425 | val_loss: 0.000920851 | Time: 15678.6 ms
[2020-11-11 03:46:26	                main:574]	:	INFO	:	Epoch 98 | loss: 0.000895714 | val_loss: 0.000877313 | Time: 14933 ms
[2020-11-11 03:46:43	                main:574]	:	INFO	:	Epoch 99 | loss: 0.000852741 | val_loss: 0.000836423 | Time: 16744.8 ms
[2020-11-11 03:46:58	                main:574]	:	INFO	:	Epoch 100 | loss: 0.000811521 | val_loss: 0.000797523 | Time: 15246.9 ms
[2020-11-11 03:47:14	                main:574]	:	INFO	:	Epoch 101 | loss: 0.000772599 | val_loss: 0.000755945 | Time: 15944.9 ms
[2020-11-11 03:47:29	                main:574]	:	INFO	:	Epoch 102 | loss: 0.000734865 | val_loss: 0.000720326 | Time: 15163 ms
[2020-11-11 03:47:45	                main:574]	:	INFO	:	Epoch 103 | loss: 0.000699994 | val_loss: 0.000686429 | Time: 15960.7 ms
[2020-11-11 03:48:01	                main:574]	:	INFO	:	Epoch 104 | loss: 0.000666165 | val_loss: 0.000653492 | Time: 15972.8 ms
[2020-11-11 03:48:18	                main:574]	:	INFO	:	Epoch 105 | loss: 0.000633815 | val_loss: 0.000622766 | Time: 16754 ms
[2020-11-11 03:48:34	                main:574]	:	INFO	:	Epoch 106 | loss: 0.000603199 | val_loss: 0.000594025 | Time: 15630.3 ms
[2020-11-11 03:48:50	                main:574]	:	INFO	:	Epoch 107 | loss: 0.000574498 | val_loss: 0.000563759 | Time: 16475.2 ms
[2020-11-11 03:49:06	                main:574]	:	INFO	:	Epoch 108 | loss: 0.000546539 | val_loss: 0.000535657 | Time: 15862.3 ms
[2020-11-11 03:49:22	                main:574]	:	INFO	:	Epoch 109 | loss: 0.000520304 | val_loss: 0.000512794 | Time: 16243.2 ms
[2020-11-11 03:49:39	                main:574]	:	INFO	:	Epoch 110 | loss: 0.000495475 | val_loss: 0.000487101 | Time: 16564 ms
[2020-11-11 03:49:55	                main:574]	:	INFO	:	Epoch 111 | loss: 0.000471589 | val_loss: 0.000463872 | Time: 15995.8 ms
[2020-11-11 03:50:12	                main:574]	:	INFO	:	Epoch 112 | loss: 0.000449238 | val_loss: 0.000442829 | Time: 16681.3 ms
[2020-11-11 03:50:27	                main:574]	:	INFO	:	Epoch 113 | loss: 0.000427651 | val_loss: 0.000420711 | Time: 15102.6 ms
[2020-11-11 03:50:45	                main:574]	:	INFO	:	Epoch 114 | loss: 0.000407647 | val_loss: 0.000399216 | Time: 18069.9 ms
[2020-11-11 03:51:01	                main:574]	:	INFO	:	Epoch 115 | loss: 0.000388046 | val_loss: 0.000382361 | Time: 15998.6 ms
[2020-11-11 03:51:19	                main:574]	:	INFO	:	Epoch 116 | loss: 0.000369757 | val_loss: 0.000364435 | Time: 17563.5 ms
[2020-11-11 03:51:31	                main:574]	:	INFO	:	Epoch 117 | loss: 0.000352853 | val_loss: 0.00035025 | Time: 12858.3 ms
[2020-11-11 03:51:50	                main:574]	:	INFO	:	Epoch 118 | loss: 0.000336209 | val_loss: 0.0003307 | Time: 18254.1 ms
[2020-11-11 03:52:06	                main:574]	:	INFO	:	Epoch 119 | loss: 0.000320357 | val_loss: 0.00031473 | Time: 16561 ms
[2020-11-11 03:52:20	                main:574]	:	INFO	:	Epoch 120 | loss: 0.000305892 | val_loss: 0.000300019 | Time: 14093.9 ms
[2020-11-11 03:52:35	                main:574]	:	INFO	:	Epoch 121 | loss: 0.000292148 | val_loss: 0.000286515 | Time: 14914.7 ms
[2020-11-11 03:52:53	                main:574]	:	INFO	:	Epoch 122 | loss: 0.000278857 | val_loss: 0.000275578 | Time: 18075.7 ms
[2020-11-11 03:53:09	                main:574]	:	INFO	:	Epoch 123 | loss: 0.000266346 | val_loss: 0.000263415 | Time: 16009.7 ms
[2020-11-11 03:53:26	                main:574]	:	INFO	:	Epoch 124 | loss: 0.000254358 | val_loss: 0.00025112 | Time: 16800.5 ms
[2020-11-11 03:53:41	                main:574]	:	INFO	:	Epoch 125 | loss: 0.000243508 | val_loss: 0.000239384 | Time: 14984.7 ms
[2020-11-11 03:53:55	                main:574]	:	INFO	:	Epoch 126 | loss: 0.000232773 | val_loss: 0.000228297 | Time: 13874.9 ms
[2020-11-11 03:54:12	                main:574]	:	INFO	:	Epoch 127 | loss: 0.000222435 | val_loss: 0.000217576 | Time: 16815.2 ms
[2020-11-11 03:54:25	                main:574]	:	INFO	:	Epoch 128 | loss: 0.000212621 | val_loss: 0.00020844 | Time: 13427.4 ms
[2020-11-11 03:54:41	                main:574]	:	INFO	:	Epoch 129 | loss: 0.00020401 | val_loss: 0.000200184 | Time: 15671.6 ms
[2020-11-11 03:54:57	                main:574]	:	INFO	:	Epoch 130 | loss: 0.000195182 | val_loss: 0.000194025 | Time: 16093.2 ms
[2020-11-11 03:55:13	                main:574]	:	INFO	:	Epoch 131 | loss: 0.000186666 | val_loss: 0.000183891 | Time: 15381 ms
[2020-11-11 03:55:29	                main:574]	:	INFO	:	Epoch 132 | loss: 0.000179283 | val_loss: 0.000176352 | Time: 16484.1 ms
[2020-11-11 03:55:45	                main:574]	:	INFO	:	Epoch 133 | loss: 0.00017186 | val_loss: 0.000170297 | Time: 15506.6 ms
[2020-11-11 03:56:00	                main:574]	:	INFO	:	Epoch 134 | loss: 0.000165185 | val_loss: 0.000161861 | Time: 15038 ms
[2020-11-11 03:56:16	                main:574]	:	INFO	:	Epoch 135 | loss: 0.000157771 | val_loss: 0.000156285 | Time: 15847.5 ms
[2020-11-11 03:56:32	                main:574]	:	INFO	:	Epoch 136 | loss: 0.00015171 | val_loss: 0.00014953 | Time: 16143.1 ms
[2020-11-11 03:56:47	                main:574]	:	INFO	:	Epoch 137 | loss: 0.000145449 | val_loss: 0.000144757 | Time: 15763 ms
[2020-11-11 03:57:02	                main:574]	:	INFO	:	Epoch 138 | loss: 0.000139813 | val_loss: 0.000137161 | Time: 14923 ms
[2020-11-11 03:57:19	                main:574]	:	INFO	:	Epoch 139 | loss: 0.000134406 | val_loss: 0.000133699 | Time: 16712 ms
[2020-11-11 03:57:34	                main:574]	:	INFO	:	Epoch 140 | loss: 0.000130015 | val_loss: 0.000129045 | Time: 15186.8 ms
[2020-11-11 03:57:50	                main:574]	:	INFO	:	Epoch 141 | loss: 0.000124732 | val_loss: 0.000123629 | Time: 16076.8 ms
[2020-11-11 03:58:04	                main:574]	:	INFO	:	Epoch 142 | loss: 0.000120048 | val_loss: 0.000118143 | Time: 13724.1 ms
[2020-11-11 03:58:21	                main:574]	:	INFO	:	Epoch 143 | loss: 0.000115857 | val_loss: 0.000114961 | Time: 17032.6 ms
[2020-11-11 03:58:35	                main:574]	:	INFO	:	Epoch 144 | loss: 0.000112387 | val_loss: 0.000112105 | Time: 13374.2 ms
[2020-11-11 03:58:50	                main:574]	:	INFO	:	Epoch 145 | loss: 0.00010769 | val_loss: 0.000107944 | Time: 15531.6 ms
[2020-11-11 03:59:06	                main:574]	:	INFO	:	Epoch 146 | loss: 0.000104301 | val_loss: 0.000102637 | Time: 16086.6 ms
[2020-11-11 03:59:22	                main:574]	:	INFO	:	Epoch 147 | loss: 0.000100674 | val_loss: 9.96373e-05 | Time: 15691.5 ms
[2020-11-11 03:59:38	                main:574]	:	INFO	:	Epoch 148 | loss: 9.78486e-05 | val_loss: 9.77039e-05 | Time: 16410.6 ms
[2020-11-11 03:59:52	                main:574]	:	INFO	:	Epoch 149 | loss: 9.48148e-05 | val_loss: 9.28704e-05 | Time: 13576.4 ms
[2020-11-11 04:00:09	                main:574]	:	INFO	:	Epoch 150 | loss: 9.12599e-05 | val_loss: 8.99375e-05 | Time: 16641.3 ms
[2020-11-11 04:00:24	                main:574]	:	INFO	:	Epoch 151 | loss: 8.88101e-05 | val_loss: 8.97325e-05 | Time: 15030.7 ms
[2020-11-11 04:00:38	                main:574]	:	INFO	:	Epoch 152 | loss: 8.6423e-05 | val_loss: 8.58229e-05 | Time: 13801.7 ms
[2020-11-11 04:00:54	                main:574]	:	INFO	:	Epoch 153 | loss: 8.37497e-05 | val_loss: 8.28364e-05 | Time: 16308.8 ms
[2020-11-11 04:01:08	                main:574]	:	INFO	:	Epoch 154 | loss: 8.15288e-05 | val_loss: 7.99985e-05 | Time: 13774.9 ms
[2020-11-11 04:01:22	                main:574]	:	INFO	:	Epoch 155 | loss: 7.965e-05 | val_loss: 7.96126e-05 | Time: 13900.9 ms
[2020-11-11 04:01:36	                main:574]	:	INFO	:	Epoch 156 | loss: 7.67806e-05 | val_loss: 7.7234e-05 | Time: 14064.3 ms
[2020-11-11 04:01:53	                main:574]	:	INFO	:	Epoch 157 | loss: 7.46545e-05 | val_loss: 7.55294e-05 | Time: 17696.8 ms
[2020-11-11 04:02:10	                main:574]	:	INFO	:	Epoch 158 | loss: 7.29592e-05 | val_loss: 7.25113e-05 | Time: 16529.9 ms
[2020-11-11 04:02:25	                main:574]	:	INFO	:	Epoch 159 | loss: 7.09999e-05 | val_loss: 7.08998e-05 | Time: 15401.4 ms
[2020-11-11 04:02:39	                main:574]	:	INFO	:	Epoch 160 | loss: 6.89514e-05 | val_loss: 6.89661e-05 | Time: 13845 ms
[2020-11-11 04:02:54	                main:574]	:	INFO	:	Epoch 161 | loss: 6.70858e-05 | val_loss: 6.6404e-05 | Time: 14469 ms
[2020-11-11 04:03:10	                main:574]	:	INFO	:	Epoch 162 | loss: 6.57416e-05 | val_loss: 6.49161e-05 | Time: 16594.4 ms
[2020-11-11 04:03:26	                main:574]	:	INFO	:	Epoch 163 | loss: 6.39408e-05 | val_loss: 6.38544e-05 | Time: 16086.2 ms
[2020-11-11 04:03:42	                main:574]	:	INFO	:	Epoch 164 | loss: 6.2457e-05 | val_loss: 6.18707e-05 | Time: 15383.9 ms
[2020-11-11 04:03:57	                main:574]	:	INFO	:	Epoch 165 | loss: 6.09159e-05 | val_loss: 6.1338e-05 | Time: 15409.2 ms
[2020-11-11 04:04:12	                main:574]	:	INFO	:	Epoch 166 | loss: 5.98819e-05 | val_loss: 5.9281e-05 | Time: 14612.3 ms
[2020-11-11 04:04:27	                main:574]	:	INFO	:	Epoch 167 | loss: 5.84802e-05 | val_loss: 5.77644e-05 | Time: 15360.6 ms
[2020-11-11 04:04:42	                main:574]	:	INFO	:	Epoch 168 | loss: 5.69449e-05 | val_loss: 5.67958e-05 | Time: 14414.1 ms
[2020-11-11 04:04:57	                main:574]	:	INFO	:	Epoch 169 | loss: 5.54125e-05 | val_loss: 5.51761e-05 | Time: 15676.3 ms
[2020-11-11 04:05:12	                main:574]	:	INFO	:	Epoch 170 | loss: 5.46769e-05 | val_loss: 5.60704e-05 | Time: 14899 ms
[2020-11-11 04:05:27	                main:574]	:	INFO	:	Epoch 171 | loss: 5.37777e-05 | val_loss: 5.32143e-05 | Time: 14442.8 ms
[2020-11-11 04:05:43	                main:574]	:	INFO	:	Epoch 172 | loss: 5.23716e-05 | val_loss: 5.27313e-05 | Time: 15882.9 ms
[2020-11-11 04:05:58	                main:574]	:	INFO	:	Epoch 173 | loss: 5.11321e-05 | val_loss: 5.21328e-05 | Time: 15114.6 ms
[2020-11-11 04:06:13	                main:574]	:	INFO	:	Epoch 174 | loss: 5.02353e-05 | val_loss: 5.04474e-05 | Time: 15553.3 ms
[2020-11-11 04:06:26	                main:574]	:	INFO	:	Epoch 175 | loss: 4.90844e-05 | val_loss: 4.86056e-05 | Time: 12616.2 ms
[2020-11-11 04:06:40	                main:574]	:	INFO	:	Epoch 176 | loss: 4.82525e-05 | val_loss: 4.95616e-05 | Time: 14156.5 ms
[2020-11-11 04:06:53	                main:574]	:	INFO	:	Epoch 177 | loss: 4.71708e-05 | val_loss: 4.66014e-05 | Time: 12659.4 ms
[2020-11-11 04:07:04	                main:574]	:	INFO	:	Epoch 178 | loss: 4.60178e-05 | val_loss: 4.57766e-05 | Time: 11301.4 ms
[2020-11-11 04:07:20	                main:574]	:	INFO	:	Epoch 179 | loss: 4.53331e-05 | val_loss: 4.63521e-05 | Time: 15867.9 ms
[2020-11-11 04:07:37	                main:574]	:	INFO	:	Epoch 180 | loss: 4.46897e-05 | val_loss: 4.50837e-05 | Time: 16721.1 ms
[2020-11-11 04:07:53	                main:574]	:	INFO	:	Epoch 181 | loss: 4.37444e-05 | val_loss: 4.40106e-05 | Time: 16046.7 ms
[2020-11-11 04:08:07	                main:574]	:	INFO	:	Epoch 182 | loss: 4.29086e-05 | val_loss: 4.27825e-05 | Time: 13843.4 ms
[2020-11-11 04:08:23	                main:574]	:	INFO	:	Epoch 183 | loss: 4.21962e-05 | val_loss: 4.25446e-05 | Time: 16127.6 ms
[2020-11-11 04:08:38	                main:574]	:	INFO	:	Epoch 184 | loss: 4.18928e-05 | val_loss: 4.11293e-05 | Time: 15511.2 ms
[2020-11-11 04:08:54	                main:574]	:	INFO	:	Epoch 185 | loss: 4.0791e-05 | val_loss: 4.08745e-05 | Time: 15354 ms
[2020-11-11 04:09:07	                main:574]	:	INFO	:	Epoch 186 | loss: 4.00891e-05 | val_loss: 4.18544e-05 | Time: 12944.1 ms
[2020-11-11 04:09:18	                main:574]	:	INFO	:	Epoch 187 | loss: 3.92769e-05 | val_loss: 4.06282e-05 | Time: 11227 ms
[2020-11-11 04:09:28	                main:574]	:	INFO	:	Epoch 188 | loss: 3.88911e-05 | val_loss: 4.19388e-05 | Time: 10505.7 ms
[2020-11-11 04:09:43	                main:574]	:	INFO	:	Epoch 189 | loss: 3.80634e-05 | val_loss: 3.84926e-05 | Time: 14398.3 ms
[2020-11-11 04:09:58	                main:574]	:	INFO	:	Epoch 190 | loss: 3.76164e-05 | val_loss: 3.69868e-05 | Time: 15035.4 ms
[2020-11-11 04:10:12	                main:574]	:	INFO	:	Epoch 191 | loss: 3.69368e-05 | val_loss: 3.7303e-05 | Time: 14226.4 ms
[2020-11-11 04:10:28	                main:574]	:	INFO	:	Epoch 192 | loss: 3.65867e-05 | val_loss: 3.62386e-05 | Time: 15981.7 ms
[2020-11-11 04:10:28	                main:597]	:	INFO	:	Saving trained model to model-final.pt, val_loss 3.62386e-05
[2020-11-11 04:10:28	                main:603]	:	INFO	:	Saving end state to config to file
[2020-11-11 04:10:28	                main:608]	:	INFO	:	Success, exiting..
04:10:28 (52248): called boinc_finish(0)

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)