Task 2825014

Name rand_automata_0002-1604983405-821-0_2
Workunit 1263800
Created 10 Nov 2020, 23:31:35 UTC
Sent 10 Nov 2020, 23:35:37 UTC
Report deadline 11 Nov 2020, 22:05:37 UTC
Received 11 Nov 2020, 1:07:19 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 443
Run time 33 min 34 sec
CPU time 30 min 4 sec
Validate state Valid
Credit 959.40
Device peak FLOPS 9,073.48 GFLOPS
Application version Machine Learning Dataset Generator (test) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.49 GB
Peak swap size 3.22 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 1080)
[2020-11-11 01:33:29	                main:435]	:	INFO	:	Set logging level to 1
[2020-11-11 01:33:29	                main:441]	:	INFO	:	Running in BOINC Client mode
[2020-11-11 01:33:29	                main:444]	:	INFO	:	Resolving all filenames
[2020-11-11 01:33:29	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0002-train-val-dataset.hdf5 (exists = 1)
[2020-11-11 01:33:29	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0002-1604983405-821-0_2_r456353496_1 (exists = 0)
[2020-11-11 01:33:29	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0002-1604983405-821-0_2_r456353496_0 (exists = 0)
[2020-11-11 01:33:29	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 0)
[2020-11-11 01:33:29	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2020-11-11 01:33:29	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/rand_automata_0002-train-val-dataset.hdf5
[2020-11-11 01:33:29	                main:474]	:	INFO	:	Configuration: 
[2020-11-11 01:33:29	                main:475]	:	INFO	:	    Model type: LSTM
[2020-11-11 01:33:29	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2020-11-11 01:33:29	                main:477]	:	INFO	:	    Max Epochs: 192
[2020-11-11 01:33:29	                main:478]	:	INFO	:	    Batch Size: 32
[2020-11-11 01:33:29	                main:479]	:	INFO	:	    Learning Rate: 0.001
[2020-11-11 01:33:29	                main:480]	:	INFO	:	    Patience: 10
[2020-11-11 01:33:29	                main:481]	:	INFO	:	    Hidden Width: 64
[2020-11-11 01:33:29	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2020-11-11 01:33:29	                main:483]	:	INFO	:	    # Backend Layers: 2
[2020-11-11 01:33:29	                main:484]	:	INFO	:	    # Threads: 1
[2020-11-11 01:33:29	                main:486]	:	INFO	:	Preparing Dataset
[2020-11-11 01:33:29	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0002-train-val-dataset.hdf5 into memory
[2020-11-11 01:33:30	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0002-train-val-dataset.hdf5 into memory
[2020-11-11 01:33:35	                load:106]	:	INFO	:	Successfully loaded dataset of 4096 examples into memory.
[2020-11-11 01:33:35	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0002-train-val-dataset.hdf5 into memory
[2020-11-11 01:33:35	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0002-train-val-dataset.hdf5 into memory
[2020-11-11 01:33:35	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2020-11-11 01:33:35	                main:494]	:	INFO	:	Creating Model
[2020-11-11 01:33:35	                main:507]	:	INFO	:	Preparing config file
[2020-11-11 01:33:35	                main:519]	:	INFO	:	Creating new config file
[2020-11-11 01:33:38	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2020-11-11 01:33:38	                main:562]	:	INFO	:	Starting Training
[2020-11-11 01:33:48	                main:574]	:	INFO	:	Epoch 1 | loss: 0.0660643 | val_loss: 0.0657765 | Time: 9387.21 ms
[2020-11-11 01:33:57	                main:574]	:	INFO	:	Epoch 2 | loss: 0.0650223 | val_loss: 0.0633754 | Time: 8858.68 ms
[2020-11-11 01:34:06	                main:574]	:	INFO	:	Epoch 3 | loss: 0.0611762 | val_loss: 0.0593415 | Time: 9010.71 ms
[2020-11-11 01:34:15	                main:574]	:	INFO	:	Epoch 4 | loss: 0.0578056 | val_loss: 0.0565647 | Time: 9219.37 ms
[2020-11-11 01:34:24	                main:574]	:	INFO	:	Epoch 5 | loss: 0.0556872 | val_loss: 0.0549599 | Time: 8735.18 ms
[2020-11-11 01:34:33	                main:574]	:	INFO	:	Epoch 6 | loss: 0.0542494 | val_loss: 0.0536995 | Time: 9431.65 ms
[2020-11-11 01:34:42	                main:574]	:	INFO	:	Epoch 7 | loss: 0.0529608 | val_loss: 0.0524148 | Time: 8942.18 ms
[2020-11-11 01:34:51	                main:574]	:	INFO	:	Epoch 8 | loss: 0.0517349 | val_loss: 0.0512908 | Time: 8928.99 ms
[2020-11-11 01:35:00	                main:574]	:	INFO	:	Epoch 9 | loss: 0.0505241 | val_loss: 0.0500125 | Time: 9176.35 ms
[2020-11-11 01:35:09	                main:574]	:	INFO	:	Epoch 10 | loss: 0.0491613 | val_loss: 0.0486652 | Time: 9089.2 ms
[2020-11-11 01:35:18	                main:574]	:	INFO	:	Epoch 11 | loss: 0.0476012 | val_loss: 0.0470477 | Time: 8924.61 ms
[2020-11-11 01:35:27	                main:574]	:	INFO	:	Epoch 12 | loss: 0.045787 | val_loss: 0.0452627 | Time: 8485.51 ms
[2020-11-11 01:35:36	                main:574]	:	INFO	:	Epoch 13 | loss: 0.0435623 | val_loss: 0.0429295 | Time: 8832.34 ms
[2020-11-11 01:35:45	                main:574]	:	INFO	:	Epoch 14 | loss: 0.0408754 | val_loss: 0.0404781 | Time: 9065.47 ms
[2020-11-11 01:35:53	                main:574]	:	INFO	:	Epoch 15 | loss: 0.0377054 | val_loss: 0.0371242 | Time: 8173.29 ms
[2020-11-11 01:36:02	                main:574]	:	INFO	:	Epoch 16 | loss: 0.0342685 | val_loss: 0.0332861 | Time: 8979.39 ms
[2020-11-11 01:36:10	                main:574]	:	INFO	:	Epoch 17 | loss: 0.0303067 | val_loss: 0.028333 | Time: 8631.84 ms
[2020-11-11 01:36:20	                main:574]	:	INFO	:	Epoch 18 | loss: 0.0269782 | val_loss: 0.0262595 | Time: 9354.43 ms
[2020-11-11 01:36:28	                main:574]	:	INFO	:	Epoch 19 | loss: 0.0507853 | val_loss: 0.0500923 | Time: 8658.15 ms
[2020-11-11 01:36:37	                main:574]	:	INFO	:	Epoch 20 | loss: 0.0381407 | val_loss: 0.0280258 | Time: 8724.34 ms
[2020-11-11 01:36:46	                main:574]	:	INFO	:	Epoch 21 | loss: 0.0249158 | val_loss: 0.0248199 | Time: 8805.03 ms
[2020-11-11 01:36:55	                main:574]	:	INFO	:	Epoch 22 | loss: 0.0492116 | val_loss: 0.0505738 | Time: 8827.31 ms
[2020-11-11 01:37:04	                main:574]	:	INFO	:	Epoch 23 | loss: 0.0401803 | val_loss: 0.0270244 | Time: 9006.96 ms
[2020-11-11 01:37:13	                main:574]	:	INFO	:	Epoch 24 | loss: 0.0259402 | val_loss: 0.0603332 | Time: 8796.14 ms
[2020-11-11 01:37:21	                main:574]	:	INFO	:	Epoch 25 | loss: 0.0533718 | val_loss: 0.0466547 | Time: 8714.55 ms
[2020-11-11 01:37:30	                main:574]	:	INFO	:	Epoch 26 | loss: 0.0323864 | val_loss: 0.0236196 | Time: 8756.38 ms
[2020-11-11 01:37:39	                main:574]	:	INFO	:	Epoch 27 | loss: 0.0211903 | val_loss: 0.0191751 | Time: 8965.84 ms
[2020-11-11 01:37:48	                main:574]	:	INFO	:	Epoch 28 | loss: 0.0171825 | val_loss: 0.0156172 | Time: 8557.88 ms
[2020-11-11 01:37:56	                main:574]	:	INFO	:	Epoch 29 | loss: 0.0159619 | val_loss: 0.0139568 | Time: 8596.29 ms
[2020-11-11 01:38:05	                main:574]	:	INFO	:	Epoch 30 | loss: 0.0151082 | val_loss: 0.058869 | Time: 8981.87 ms
[2020-11-11 01:38:14	                main:574]	:	INFO	:	Epoch 31 | loss: 0.0517838 | val_loss: 0.0449573 | Time: 8738.6 ms
[2020-11-11 01:38:23	                main:574]	:	INFO	:	Epoch 32 | loss: 0.0322851 | val_loss: 0.0201257 | Time: 8943.45 ms
[2020-11-11 01:38:32	                main:574]	:	INFO	:	Epoch 33 | loss: 0.0173891 | val_loss: 0.0144689 | Time: 8909.35 ms
[2020-11-11 01:38:41	                main:574]	:	INFO	:	Epoch 34 | loss: 0.0128141 | val_loss: 0.012232 | Time: 8829.44 ms
[2020-11-11 01:38:50	                main:574]	:	INFO	:	Epoch 35 | loss: 0.0108026 | val_loss: 0.0109547 | Time: 9126.89 ms
[2020-11-11 01:38:59	                main:574]	:	INFO	:	Epoch 36 | loss: 0.0100518 | val_loss: 0.0100419 | Time: 8724.91 ms
[2020-11-11 01:39:08	                main:574]	:	INFO	:	Epoch 37 | loss: 0.00947489 | val_loss: 0.00963904 | Time: 8981.24 ms
[2020-11-11 01:39:17	                main:574]	:	INFO	:	Epoch 38 | loss: 0.00894943 | val_loss: 0.00923878 | Time: 8994.9 ms
[2020-11-11 01:39:25	                main:574]	:	INFO	:	Epoch 39 | loss: 0.00859557 | val_loss: 0.00927766 | Time: 8685 ms
[2020-11-11 01:39:34	                main:574]	:	INFO	:	Epoch 40 | loss: 0.0082591 | val_loss: 0.00852781 | Time: 8874.46 ms
[2020-11-11 01:39:43	                main:574]	:	INFO	:	Epoch 41 | loss: 0.00807449 | val_loss: 0.00822067 | Time: 8714.26 ms
[2020-11-11 01:39:52	                main:574]	:	INFO	:	Epoch 42 | loss: 0.00758187 | val_loss: 0.007785 | Time: 8643.54 ms
[2020-11-11 01:40:01	                main:574]	:	INFO	:	Epoch 43 | loss: 0.00730008 | val_loss: 0.00748479 | Time: 9067.97 ms
[2020-11-11 01:40:10	                main:574]	:	INFO	:	Epoch 44 | loss: 0.00702169 | val_loss: 0.00714651 | Time: 8798.95 ms
[2020-11-11 01:40:18	                main:574]	:	INFO	:	Epoch 45 | loss: 0.00676822 | val_loss: 0.00681051 | Time: 8864.72 ms
[2020-11-11 01:40:27	                main:574]	:	INFO	:	Epoch 46 | loss: 0.00652133 | val_loss: 0.00657935 | Time: 8564.61 ms
[2020-11-11 01:40:36	                main:574]	:	INFO	:	Epoch 47 | loss: 0.00628781 | val_loss: 0.00631512 | Time: 8857.14 ms
[2020-11-11 01:40:44	                main:574]	:	INFO	:	Epoch 48 | loss: 0.00606507 | val_loss: 0.0060516 | Time: 8623.63 ms
[2020-11-11 01:40:54	                main:574]	:	INFO	:	Epoch 49 | loss: 0.00585424 | val_loss: 0.0058388 | Time: 9289.6 ms
[2020-11-11 01:41:03	                main:574]	:	INFO	:	Epoch 50 | loss: 0.00563085 | val_loss: 0.00561695 | Time: 9064.26 ms
[2020-11-11 01:41:12	                main:574]	:	INFO	:	Epoch 51 | loss: 0.00542523 | val_loss: 0.00540951 | Time: 8766.87 ms
[2020-11-11 01:41:20	                main:574]	:	INFO	:	Epoch 52 | loss: 0.00522525 | val_loss: 0.00520576 | Time: 8852 ms
[2020-11-11 01:41:30	                main:574]	:	INFO	:	Epoch 53 | loss: 0.00502939 | val_loss: 0.00500931 | Time: 9481.78 ms
[2020-11-11 01:41:39	                main:574]	:	INFO	:	Epoch 54 | loss: 0.00483868 | val_loss: 0.00481609 | Time: 8717.98 ms
[2020-11-11 01:41:48	                main:574]	:	INFO	:	Epoch 55 | loss: 0.00465212 | val_loss: 0.00463207 | Time: 9027.71 ms
[2020-11-11 01:41:57	                main:574]	:	INFO	:	Epoch 56 | loss: 0.00447096 | val_loss: 0.00445001 | Time: 9057.26 ms
[2020-11-11 01:42:06	                main:574]	:	INFO	:	Epoch 57 | loss: 0.0042943 | val_loss: 0.00427173 | Time: 8766.19 ms
[2020-11-11 01:42:14	                main:574]	:	INFO	:	Epoch 58 | loss: 0.00412089 | val_loss: 0.00409743 | Time: 8761.83 ms
[2020-11-11 01:42:23	                main:574]	:	INFO	:	Epoch 59 | loss: 0.00395288 | val_loss: 0.00393384 | Time: 9003.49 ms
[2020-11-11 01:42:32	                main:574]	:	INFO	:	Epoch 60 | loss: 0.00378835 | val_loss: 0.00376444 | Time: 8891.82 ms
[2020-11-11 01:42:41	                main:574]	:	INFO	:	Epoch 61 | loss: 0.00362902 | val_loss: 0.00360521 | Time: 9186.94 ms
[2020-11-11 01:42:50	                main:574]	:	INFO	:	Epoch 62 | loss: 0.003475 | val_loss: 0.00345136 | Time: 8854.26 ms
[2020-11-11 01:42:59	                main:574]	:	INFO	:	Epoch 63 | loss: 0.00332899 | val_loss: 0.0033027 | Time: 8831.91 ms
[2020-11-11 01:43:08	                main:574]	:	INFO	:	Epoch 64 | loss: 0.00317654 | val_loss: 0.00315964 | Time: 8821.59 ms
[2020-11-11 01:43:17	                main:574]	:	INFO	:	Epoch 65 | loss: 0.00303625 | val_loss: 0.00301851 | Time: 8829.34 ms
[2020-11-11 01:43:26	                main:574]	:	INFO	:	Epoch 66 | loss: 0.00290113 | val_loss: 0.00288439 | Time: 9118.9 ms
[2020-11-11 01:43:35	                main:574]	:	INFO	:	Epoch 67 | loss: 0.00277151 | val_loss: 0.00275897 | Time: 9236.71 ms
[2020-11-11 01:43:45	                main:574]	:	INFO	:	Epoch 68 | loss: 0.00264604 | val_loss: 0.0026333 | Time: 9943.95 ms
[2020-11-11 01:43:55	                main:574]	:	INFO	:	Epoch 69 | loss: 0.00252567 | val_loss: 0.00251016 | Time: 9901.47 ms
[2020-11-11 01:44:05	                main:574]	:	INFO	:	Epoch 70 | loss: 0.00240881 | val_loss: 0.0023979 | Time: 9706.67 ms
[2020-11-11 01:44:15	                main:574]	:	INFO	:	Epoch 71 | loss: 0.00229724 | val_loss: 0.00228474 | Time: 9687.29 ms
[2020-11-11 01:44:24	                main:574]	:	INFO	:	Epoch 72 | loss: 0.00218932 | val_loss: 0.00217817 | Time: 9743.05 ms
[2020-11-11 01:44:34	                main:574]	:	INFO	:	Epoch 73 | loss: 0.00208586 | val_loss: 0.0020781 | Time: 9917.47 ms
[2020-11-11 01:44:44	                main:574]	:	INFO	:	Epoch 74 | loss: 0.00198601 | val_loss: 0.00197666 | Time: 9741.67 ms
[2020-11-11 01:44:53	                main:574]	:	INFO	:	Epoch 75 | loss: 0.00189135 | val_loss: 0.0018788 | Time: 9051.68 ms
[2020-11-11 01:45:02	                main:574]	:	INFO	:	Epoch 76 | loss: 0.00179918 | val_loss: 0.00179089 | Time: 9132.69 ms
[2020-11-11 01:45:11	                main:574]	:	INFO	:	Epoch 77 | loss: 0.00171138 | val_loss: 0.00170201 | Time: 9200.36 ms
[2020-11-11 01:45:20	                main:574]	:	INFO	:	Epoch 78 | loss: 0.00162758 | val_loss: 0.00161727 | Time: 8879.31 ms
[2020-11-11 01:45:29	                main:574]	:	INFO	:	Epoch 79 | loss: 0.00154617 | val_loss: 0.001537 | Time: 8858.29 ms
[2020-11-11 01:45:38	                main:574]	:	INFO	:	Epoch 80 | loss: 0.0014689 | val_loss: 0.00145999 | Time: 9159.6 ms
[2020-11-11 01:45:47	                main:574]	:	INFO	:	Epoch 81 | loss: 0.00139487 | val_loss: 0.00138608 | Time: 8960.94 ms
[2020-11-11 01:45:56	                main:574]	:	INFO	:	Epoch 82 | loss: 0.00132507 | val_loss: 0.00131626 | Time: 8541.77 ms
[2020-11-11 01:46:05	                main:574]	:	INFO	:	Epoch 83 | loss: 0.00125785 | val_loss: 0.00124867 | Time: 8730.33 ms
[2020-11-11 01:46:14	                main:574]	:	INFO	:	Epoch 84 | loss: 0.00119369 | val_loss: 0.0011877 | Time: 9011.07 ms
[2020-11-11 01:46:22	                main:574]	:	INFO	:	Epoch 85 | loss: 0.00113242 | val_loss: 0.00112435 | Time: 8745.42 ms
[2020-11-11 01:46:31	                main:574]	:	INFO	:	Epoch 86 | loss: 0.00107406 | val_loss: 0.00106584 | Time: 8642.04 ms
[2020-11-11 01:46:40	                main:574]	:	INFO	:	Epoch 87 | loss: 0.0010189 | val_loss: 0.0010139 | Time: 9008.62 ms
[2020-11-11 01:46:49	                main:574]	:	INFO	:	Epoch 88 | loss: 0.000966213 | val_loss: 0.000959396 | Time: 8949.72 ms
[2020-11-11 01:46:58	                main:574]	:	INFO	:	Epoch 89 | loss: 0.000916171 | val_loss: 0.000910109 | Time: 8908.37 ms
[2020-11-11 01:47:07	                main:574]	:	INFO	:	Epoch 90 | loss: 0.000868415 | val_loss: 0.000862397 | Time: 9131.34 ms
[2020-11-11 01:47:16	                main:574]	:	INFO	:	Epoch 91 | loss: 0.000822853 | val_loss: 0.000815945 | Time: 8870.41 ms
[2020-11-11 01:47:25	                main:574]	:	INFO	:	Epoch 92 | loss: 0.000779931 | val_loss: 0.000774845 | Time: 9377 ms
[2020-11-11 01:47:34	                main:574]	:	INFO	:	Epoch 93 | loss: 0.000739492 | val_loss: 0.000732145 | Time: 8379.07 ms
[2020-11-11 01:47:43	                main:574]	:	INFO	:	Epoch 94 | loss: 0.000700571 | val_loss: 0.000692932 | Time: 8802.55 ms
[2020-11-11 01:47:51	                main:574]	:	INFO	:	Epoch 95 | loss: 0.000663835 | val_loss: 0.000661484 | Time: 8807.49 ms
[2020-11-11 01:48:00	                main:574]	:	INFO	:	Epoch 96 | loss: 0.000629917 | val_loss: 0.000625035 | Time: 8636.53 ms
[2020-11-11 01:48:09	                main:574]	:	INFO	:	Epoch 97 | loss: 0.000596171 | val_loss: 0.000591949 | Time: 8829.23 ms
[2020-11-11 01:48:18	                main:574]	:	INFO	:	Epoch 98 | loss: 0.000565216 | val_loss: 0.000559357 | Time: 8950.86 ms
[2020-11-11 01:48:27	                main:574]	:	INFO	:	Epoch 99 | loss: 0.000535664 | val_loss: 0.000529997 | Time: 9207.42 ms
[2020-11-11 01:48:36	                main:574]	:	INFO	:	Epoch 100 | loss: 0.000507718 | val_loss: 0.000503719 | Time: 9307.52 ms
[2020-11-11 01:48:47	                main:574]	:	INFO	:	Epoch 101 | loss: 0.000481568 | val_loss: 0.000478581 | Time: 10118.7 ms
[2020-11-11 01:48:56	                main:574]	:	INFO	:	Epoch 102 | loss: 0.000456855 | val_loss: 0.000451537 | Time: 9222.47 ms
[2020-11-11 01:49:05	                main:574]	:	INFO	:	Epoch 103 | loss: 0.000433812 | val_loss: 0.000428103 | Time: 9600.53 ms
[2020-11-11 01:49:15	                main:574]	:	INFO	:	Epoch 104 | loss: 0.000411566 | val_loss: 0.000408047 | Time: 9788.35 ms
[2020-11-11 01:49:25	                main:574]	:	INFO	:	Epoch 105 | loss: 0.000390231 | val_loss: 0.000385924 | Time: 9673.03 ms
[2020-11-11 01:49:34	                main:574]	:	INFO	:	Epoch 106 | loss: 0.000370087 | val_loss: 0.000366661 | Time: 9194.06 ms
[2020-11-11 01:49:44	                main:574]	:	INFO	:	Epoch 107 | loss: 0.000351324 | val_loss: 0.000348194 | Time: 9871.46 ms
[2020-11-11 01:49:55	                main:574]	:	INFO	:	Epoch 108 | loss: 0.00033397 | val_loss: 0.000331151 | Time: 10806.4 ms
[2020-11-11 01:50:06	                main:574]	:	INFO	:	Epoch 109 | loss: 0.000317936 | val_loss: 0.000315396 | Time: 10859.2 ms
[2020-11-11 01:50:16	                main:574]	:	INFO	:	Epoch 110 | loss: 0.000302029 | val_loss: 0.000300796 | Time: 10463.1 ms
[2020-11-11 01:50:27	                main:574]	:	INFO	:	Epoch 111 | loss: 0.000287661 | val_loss: 0.000285626 | Time: 11036 ms
[2020-11-11 01:50:38	                main:574]	:	INFO	:	Epoch 112 | loss: 0.000273542 | val_loss: 0.000273927 | Time: 10472.7 ms
[2020-11-11 01:50:48	                main:574]	:	INFO	:	Epoch 113 | loss: 0.000260974 | val_loss: 0.00025951 | Time: 10846.4 ms
[2020-11-11 01:50:59	                main:574]	:	INFO	:	Epoch 114 | loss: 0.000248435 | val_loss: 0.000246622 | Time: 10478.5 ms
[2020-11-11 01:51:10	                main:574]	:	INFO	:	Epoch 115 | loss: 0.000236815 | val_loss: 0.000236417 | Time: 11071.9 ms
[2020-11-11 01:51:21	                main:574]	:	INFO	:	Epoch 116 | loss: 0.000226187 | val_loss: 0.000224147 | Time: 10605.3 ms
[2020-11-11 01:51:31	                main:574]	:	INFO	:	Epoch 117 | loss: 0.000215532 | val_loss: 0.000215264 | Time: 10526.6 ms
[2020-11-11 01:51:42	                main:574]	:	INFO	:	Epoch 118 | loss: 0.000206128 | val_loss: 0.000206821 | Time: 10827.5 ms
[2020-11-11 01:51:52	                main:574]	:	INFO	:	Epoch 119 | loss: 0.000196968 | val_loss: 0.00019811 | Time: 10362.9 ms
[2020-11-11 01:52:03	                main:574]	:	INFO	:	Epoch 120 | loss: 0.000188648 | val_loss: 0.000188569 | Time: 10606.9 ms
[2020-11-11 01:52:14	                main:574]	:	INFO	:	Epoch 121 | loss: 0.000180777 | val_loss: 0.000180408 | Time: 10834.7 ms
[2020-11-11 01:52:24	                main:574]	:	INFO	:	Epoch 122 | loss: 0.000173084 | val_loss: 0.00017263 | Time: 10335.7 ms
[2020-11-11 01:52:35	                main:574]	:	INFO	:	Epoch 123 | loss: 0.000165555 | val_loss: 0.000166533 | Time: 10489.8 ms
[2020-11-11 01:52:45	                main:574]	:	INFO	:	Epoch 124 | loss: 0.000159008 | val_loss: 0.000159272 | Time: 10358.7 ms
[2020-11-11 01:52:56	                main:574]	:	INFO	:	Epoch 125 | loss: 0.000152663 | val_loss: 0.000152689 | Time: 10667 ms
[2020-11-11 01:53:07	                main:574]	:	INFO	:	Epoch 126 | loss: 0.000146778 | val_loss: 0.000148127 | Time: 10988.3 ms
[2020-11-11 01:53:17	                main:574]	:	INFO	:	Epoch 127 | loss: 0.000140978 | val_loss: 0.000141825 | Time: 10623.2 ms
[2020-11-11 01:53:28	                main:574]	:	INFO	:	Epoch 128 | loss: 0.000135279 | val_loss: 0.000135719 | Time: 10686.4 ms
[2020-11-11 01:53:38	                main:574]	:	INFO	:	Epoch 129 | loss: 0.000130691 | val_loss: 0.00013157 | Time: 10134.4 ms
[2020-11-11 01:53:49	                main:574]	:	INFO	:	Epoch 130 | loss: 0.000125632 | val_loss: 0.000126528 | Time: 10910.6 ms
[2020-11-11 01:54:00	                main:574]	:	INFO	:	Epoch 131 | loss: 0.00012117 | val_loss: 0.000123847 | Time: 10387.5 ms
[2020-11-11 01:54:11	                main:574]	:	INFO	:	Epoch 132 | loss: 0.000116546 | val_loss: 0.000115791 | Time: 11011.8 ms
[2020-11-11 01:54:22	                main:574]	:	INFO	:	Epoch 133 | loss: 0.000112365 | val_loss: 0.000112545 | Time: 11161.6 ms
[2020-11-11 01:54:33	                main:574]	:	INFO	:	Epoch 134 | loss: 0.000108271 | val_loss: 0.0001088 | Time: 10890 ms
[2020-11-11 01:54:43	                main:574]	:	INFO	:	Epoch 135 | loss: 0.00010482 | val_loss: 0.000105968 | Time: 10523.1 ms
[2020-11-11 01:54:53	                main:574]	:	INFO	:	Epoch 136 | loss: 0.000101565 | val_loss: 0.000101161 | Time: 10014.2 ms
[2020-11-11 01:55:03	                main:574]	:	INFO	:	Epoch 137 | loss: 9.75889e-05 | val_loss: 9.87989e-05 | Time: 9848.08 ms
[2020-11-11 01:55:12	                main:574]	:	INFO	:	Epoch 138 | loss: 9.50362e-05 | val_loss: 9.57737e-05 | Time: 8933.2 ms
[2020-11-11 01:55:21	                main:574]	:	INFO	:	Epoch 139 | loss: 9.20587e-05 | val_loss: 9.24163e-05 | Time: 8820.27 ms
[2020-11-11 01:55:31	                main:574]	:	INFO	:	Epoch 140 | loss: 8.89007e-05 | val_loss: 8.99181e-05 | Time: 10085.2 ms
[2020-11-11 01:55:41	                main:574]	:	INFO	:	Epoch 141 | loss: 8.63632e-05 | val_loss: 8.68877e-05 | Time: 10417.7 ms
[2020-11-11 01:55:52	                main:574]	:	INFO	:	Epoch 142 | loss: 8.38863e-05 | val_loss: 8.4407e-05 | Time: 10289.1 ms
[2020-11-11 01:56:02	                main:574]	:	INFO	:	Epoch 143 | loss: 8.0721e-05 | val_loss: 8.16733e-05 | Time: 10217.8 ms
[2020-11-11 01:56:12	                main:574]	:	INFO	:	Epoch 144 | loss: 7.88179e-05 | val_loss: 7.85589e-05 | Time: 10284.7 ms
[2020-11-11 01:56:23	                main:574]	:	INFO	:	Epoch 145 | loss: 7.62061e-05 | val_loss: 7.7992e-05 | Time: 10350.5 ms
[2020-11-11 01:56:33	                main:574]	:	INFO	:	Epoch 146 | loss: 7.41973e-05 | val_loss: 7.66403e-05 | Time: 10175.6 ms
[2020-11-11 01:56:43	                main:574]	:	INFO	:	Epoch 147 | loss: 7.2302e-05 | val_loss: 7.18397e-05 | Time: 10137.4 ms
[2020-11-11 01:56:53	                main:574]	:	INFO	:	Epoch 148 | loss: 7.0314e-05 | val_loss: 7.03987e-05 | Time: 10369.4 ms
[2020-11-11 01:57:05	                main:574]	:	INFO	:	Epoch 149 | loss: 6.82813e-05 | val_loss: 6.75796e-05 | Time: 11369.9 ms
[2020-11-11 01:57:17	                main:574]	:	INFO	:	Epoch 150 | loss: 6.63687e-05 | val_loss: 6.62522e-05 | Time: 12669.8 ms
[2020-11-11 01:57:30	                main:574]	:	INFO	:	Epoch 151 | loss: 6.49354e-05 | val_loss: 6.54764e-05 | Time: 12426.7 ms
[2020-11-11 01:57:44	                main:574]	:	INFO	:	Epoch 152 | loss: 6.30157e-05 | val_loss: 6.37266e-05 | Time: 13879.2 ms
[2020-11-11 01:57:58	                main:574]	:	INFO	:	Epoch 153 | loss: 6.14267e-05 | val_loss: 6.10889e-05 | Time: 14073.4 ms
[2020-11-11 01:58:12	                main:574]	:	INFO	:	Epoch 154 | loss: 5.98879e-05 | val_loss: 6.04187e-05 | Time: 13905.7 ms
[2020-11-11 01:58:25	                main:574]	:	INFO	:	Epoch 155 | loss: 5.80522e-05 | val_loss: 5.83385e-05 | Time: 13744.2 ms
[2020-11-11 01:58:39	                main:574]	:	INFO	:	Epoch 156 | loss: 5.70773e-05 | val_loss: 5.94703e-05 | Time: 13567.4 ms
[2020-11-11 01:58:53	                main:574]	:	INFO	:	Epoch 157 | loss: 5.55004e-05 | val_loss: 5.52663e-05 | Time: 14141.1 ms
[2020-11-11 01:59:08	                main:574]	:	INFO	:	Epoch 158 | loss: 5.45245e-05 | val_loss: 5.52275e-05 | Time: 14464.4 ms
[2020-11-11 01:59:22	                main:574]	:	INFO	:	Epoch 159 | loss: 5.31827e-05 | val_loss: 5.49807e-05 | Time: 14367.7 ms
[2020-11-11 01:59:36	                main:574]	:	INFO	:	Epoch 160 | loss: 5.17127e-05 | val_loss: 5.10999e-05 | Time: 13620.3 ms
[2020-11-11 01:59:50	                main:574]	:	INFO	:	Epoch 161 | loss: 5.04272e-05 | val_loss: 4.97547e-05 | Time: 14184 ms
[2020-11-11 02:00:04	                main:574]	:	INFO	:	Epoch 162 | loss: 4.91393e-05 | val_loss: 5.19256e-05 | Time: 14061.7 ms
[2020-11-11 02:00:18	                main:574]	:	INFO	:	Epoch 163 | loss: 4.82751e-05 | val_loss: 4.91441e-05 | Time: 13942.7 ms
[2020-11-11 02:00:32	                main:574]	:	INFO	:	Epoch 164 | loss: 4.73334e-05 | val_loss: 4.68437e-05 | Time: 13875.3 ms
[2020-11-11 02:00:46	                main:574]	:	INFO	:	Epoch 165 | loss: 4.60797e-05 | val_loss: 4.67606e-05 | Time: 13676.6 ms
[2020-11-11 02:00:59	                main:574]	:	INFO	:	Epoch 166 | loss: 4.50257e-05 | val_loss: 4.45554e-05 | Time: 13800.7 ms
[2020-11-11 02:01:13	                main:574]	:	INFO	:	Epoch 167 | loss: 4.40376e-05 | val_loss: 4.53613e-05 | Time: 13936.3 ms
[2020-11-11 02:01:27	                main:574]	:	INFO	:	Epoch 168 | loss: 4.32088e-05 | val_loss: 4.399e-05 | Time: 13748.1 ms
[2020-11-11 02:01:41	                main:574]	:	INFO	:	Epoch 169 | loss: 4.21405e-05 | val_loss: 4.2385e-05 | Time: 13820.1 ms
[2020-11-11 02:01:55	                main:574]	:	INFO	:	Epoch 170 | loss: 4.14985e-05 | val_loss: 4.11938e-05 | Time: 13989.8 ms
[2020-11-11 02:02:09	                main:574]	:	INFO	:	Epoch 171 | loss: 4.02694e-05 | val_loss: 4.03199e-05 | Time: 13920.1 ms
[2020-11-11 02:02:22	                main:574]	:	INFO	:	Epoch 172 | loss: 3.97199e-05 | val_loss: 3.98108e-05 | Time: 13383.8 ms
[2020-11-11 02:02:37	                main:574]	:	INFO	:	Epoch 173 | loss: 3.85617e-05 | val_loss: 3.86818e-05 | Time: 14277.1 ms
[2020-11-11 02:02:51	                main:574]	:	INFO	:	Epoch 174 | loss: 3.79021e-05 | val_loss: 3.79934e-05 | Time: 13892.7 ms
[2020-11-11 02:03:04	                main:574]	:	INFO	:	Epoch 175 | loss: 3.74043e-05 | val_loss: 3.72978e-05 | Time: 13863.7 ms
[2020-11-11 02:03:18	                main:574]	:	INFO	:	Epoch 176 | loss: 3.66563e-05 | val_loss: 3.76143e-05 | Time: 13700.3 ms
[2020-11-11 02:03:32	                main:574]	:	INFO	:	Epoch 177 | loss: 3.58648e-05 | val_loss: 3.56391e-05 | Time: 13730 ms
[2020-11-11 02:03:46	                main:574]	:	INFO	:	Epoch 178 | loss: 3.50235e-05 | val_loss: 3.59084e-05 | Time: 13937.8 ms
[2020-11-11 02:04:00	                main:574]	:	INFO	:	Epoch 179 | loss: 3.45576e-05 | val_loss: 3.63746e-05 | Time: 14066.7 ms
[2020-11-11 02:04:14	                main:574]	:	INFO	:	Epoch 180 | loss: 3.40974e-05 | val_loss: 3.50578e-05 | Time: 14092.2 ms
[2020-11-11 02:04:28	                main:574]	:	INFO	:	Epoch 181 | loss: 3.36598e-05 | val_loss: 3.36044e-05 | Time: 13750.9 ms
[2020-11-11 02:04:41	                main:574]	:	INFO	:	Epoch 182 | loss: 3.26769e-05 | val_loss: 3.35495e-05 | Time: 13395.6 ms
[2020-11-11 02:04:55	                main:574]	:	INFO	:	Epoch 183 | loss: 3.20793e-05 | val_loss: 3.3338e-05 | Time: 13718.8 ms
[2020-11-11 02:05:08	                main:574]	:	INFO	:	Epoch 184 | loss: 3.15928e-05 | val_loss: 3.14415e-05 | Time: 13290.9 ms
[2020-11-11 02:05:21	                main:574]	:	INFO	:	Epoch 185 | loss: 3.08814e-05 | val_loss: 3.1039e-05 | Time: 13136.4 ms
[2020-11-11 02:05:35	                main:574]	:	INFO	:	Epoch 186 | loss: 3.05307e-05 | val_loss: 3.0666e-05 | Time: 13874.8 ms
[2020-11-11 02:05:50	                main:574]	:	INFO	:	Epoch 187 | loss: 2.98744e-05 | val_loss: 3.04032e-05 | Time: 14639.9 ms
[2020-11-11 02:06:04	                main:574]	:	INFO	:	Epoch 188 | loss: 2.93189e-05 | val_loss: 3.12471e-05 | Time: 14212.3 ms
[2020-11-11 02:06:18	                main:574]	:	INFO	:	Epoch 189 | loss: 2.89127e-05 | val_loss: 2.90965e-05 | Time: 13772.9 ms
[2020-11-11 02:06:32	                main:574]	:	INFO	:	Epoch 190 | loss: 2.85814e-05 | val_loss: 2.93101e-05 | Time: 14024.1 ms
[2020-11-11 02:06:46	                main:574]	:	INFO	:	Epoch 191 | loss: 2.80429e-05 | val_loss: 2.8203e-05 | Time: 13913.6 ms
[2020-11-11 02:07:00	                main:574]	:	INFO	:	Epoch 192 | loss: 2.77117e-05 | val_loss: 2.79323e-05 | Time: 14147.6 ms
[2020-11-11 02:07:00	                main:597]	:	INFO	:	Saving trained model to model-final.pt, val_loss 2.79323e-05
[2020-11-11 02:07:00	                main:603]	:	INFO	:	Saving end state to config to file
[2020-11-11 02:07:00	                main:608]	:	INFO	:	Success, exiting..
02:07:00 (36736): called boinc_finish(0)

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)