Task 2868235

Name rand_automata_0001-1605109694-16391-0_0
Workunit 1293831
Created 11 Nov 2020, 15:48:15 UTC
Sent 11 Nov 2020, 21:54:27 UTC
Report deadline 19 Nov 2020, 21:54:27 UTC
Received 12 Nov 2020, 8:51:33 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 4439
Run time 49 min 3 sec
CPU time 48 min 50 sec
Validate state Valid
Credit 959.40
Device peak FLOPS 1,476.13 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.41 GB
Peak swap size 2.53 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.11</core_client_version>
<![CDATA[
<stderr_txt>
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 750 Ti)
[2020-11-12 03:02:13	                main:435]	:	INFO	:	Set logging level to 1
[2020-11-12 03:02:13	                main:441]	:	INFO	:	Running in BOINC Client mode
[2020-11-12 03:02:13	                main:444]	:	INFO	:	Resolving all filenames
[2020-11-12 03:02:13	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0001-train-val-dataset.hdf5 (exists = 1)
[2020-11-12 03:02:13	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0001-1605109694-16391-0_0_r660397658_1 (exists = 0)
[2020-11-12 03:02:13	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0001-1605109694-16391-0_0_r660397658_0 (exists = 0)
[2020-11-12 03:02:13	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 0)
[2020-11-12 03:02:13	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2020-11-12 03:02:13	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/rand_automata_0001-train-val-dataset.hdf5
[2020-11-12 03:02:13	                main:474]	:	INFO	:	Configuration: 
[2020-11-12 03:02:13	                main:475]	:	INFO	:	    Model type: LSTM
[2020-11-12 03:02:13	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2020-11-12 03:02:13	                main:477]	:	INFO	:	    Max Epochs: 192
[2020-11-12 03:02:13	                main:478]	:	INFO	:	    Batch Size: 32
[2020-11-12 03:02:13	                main:479]	:	INFO	:	    Learning Rate: 0.001
[2020-11-12 03:02:13	                main:480]	:	INFO	:	    Patience: 10
[2020-11-12 03:02:13	                main:481]	:	INFO	:	    Hidden Width: 64
[2020-11-12 03:02:13	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2020-11-12 03:02:13	                main:483]	:	INFO	:	    # Backend Layers: 2
[2020-11-12 03:02:13	                main:484]	:	INFO	:	    # Threads: 1
[2020-11-12 03:02:13	                main:486]	:	INFO	:	Preparing Dataset
[2020-11-12 03:02:13	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0001-train-val-dataset.hdf5 into memory
[2020-11-12 03:02:13	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0001-train-val-dataset.hdf5 into memory
[2020-11-12 03:02:14	                load:106]	:	INFO	:	Successfully loaded dataset of 4096 examples into memory.
[2020-11-12 03:02:14	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0001-train-val-dataset.hdf5 into memory
[2020-11-12 03:02:14	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0001-train-val-dataset.hdf5 into memory
[2020-11-12 03:02:14	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2020-11-12 03:02:14	                main:494]	:	INFO	:	Creating Model
[2020-11-12 03:02:14	                main:507]	:	INFO	:	Preparing config file
[2020-11-12 03:02:14	                main:519]	:	INFO	:	Creating new config file
[2020-11-12 03:02:15	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2020-11-12 03:02:15	                main:562]	:	INFO	:	Starting Training
[2020-11-12 03:02:31	                main:574]	:	INFO	:	Epoch 1 | loss: 0.0662529 | val_loss: 0.0659462 | Time: 15476.3 ms
[2020-11-12 03:02:46	                main:574]	:	INFO	:	Epoch 2 | loss: 0.0655184 | val_loss: 0.0646686 | Time: 15251.6 ms
[2020-11-12 03:03:01	                main:574]	:	INFO	:	Epoch 3 | loss: 0.0632491 | val_loss: 0.061493 | Time: 15294.3 ms
[2020-11-12 03:03:16	                main:574]	:	INFO	:	Epoch 4 | loss: 0.0601845 | val_loss: 0.0588102 | Time: 15170.8 ms
[2020-11-12 03:03:31	                main:574]	:	INFO	:	Epoch 5 | loss: 0.0576855 | val_loss: 0.0565181 | Time: 15136.5 ms
[2020-11-12 03:03:47	                main:574]	:	INFO	:	Epoch 6 | loss: 0.055838 | val_loss: 0.0549973 | Time: 15169.8 ms
[2020-11-12 03:04:02	                main:574]	:	INFO	:	Epoch 7 | loss: 0.0543961 | val_loss: 0.0537736 | Time: 15160.6 ms
[2020-11-12 03:04:17	                main:574]	:	INFO	:	Epoch 8 | loss: 0.0531356 | val_loss: 0.0525712 | Time: 15182 ms
[2020-11-12 03:04:32	                main:574]	:	INFO	:	Epoch 9 | loss: 0.0519797 | val_loss: 0.0514638 | Time: 15154.2 ms
[2020-11-12 03:04:47	                main:574]	:	INFO	:	Epoch 10 | loss: 0.0508135 | val_loss: 0.0502222 | Time: 15192.6 ms
[2020-11-12 03:05:03	                main:574]	:	INFO	:	Epoch 11 | loss: 0.0496606 | val_loss: 0.0491298 | Time: 15182.7 ms
[2020-11-12 03:05:18	                main:574]	:	INFO	:	Epoch 12 | loss: 0.0483578 | val_loss: 0.047878 | Time: 15149.4 ms
[2020-11-12 03:05:33	                main:574]	:	INFO	:	Epoch 13 | loss: 0.046959 | val_loss: 0.0465384 | Time: 15147.3 ms
[2020-11-12 03:05:48	                main:574]	:	INFO	:	Epoch 14 | loss: 0.0452829 | val_loss: 0.0449122 | Time: 15179.1 ms
[2020-11-12 03:06:03	                main:574]	:	INFO	:	Epoch 15 | loss: 0.0435812 | val_loss: 0.0431706 | Time: 15165.6 ms
[2020-11-12 03:06:18	                main:574]	:	INFO	:	Epoch 16 | loss: 0.0414329 | val_loss: 0.0411191 | Time: 15184.1 ms
[2020-11-12 03:06:34	                main:574]	:	INFO	:	Epoch 17 | loss: 0.03921 | val_loss: 0.038385 | Time: 15167.4 ms
[2020-11-12 03:06:49	                main:574]	:	INFO	:	Epoch 18 | loss: 0.0367445 | val_loss: 0.0360605 | Time: 15136.1 ms
[2020-11-12 03:07:04	                main:574]	:	INFO	:	Epoch 19 | loss: 0.0340848 | val_loss: 0.033603 | Time: 15235.3 ms
[2020-11-12 03:07:19	                main:574]	:	INFO	:	Epoch 20 | loss: 0.0317936 | val_loss: 0.0317336 | Time: 15143.8 ms
[2020-11-12 03:07:34	                main:574]	:	INFO	:	Epoch 21 | loss: 0.0288279 | val_loss: 0.0297757 | Time: 15156.1 ms
[2020-11-12 03:07:50	                main:574]	:	INFO	:	Epoch 22 | loss: 0.0269436 | val_loss: 0.03131 | Time: 15144 ms
[2020-11-12 03:08:05	                main:574]	:	INFO	:	Epoch 23 | loss: 0.0255147 | val_loss: 0.024396 | Time: 15178.8 ms
[2020-11-12 03:08:20	                main:574]	:	INFO	:	Epoch 24 | loss: 0.0234151 | val_loss: 0.0233638 | Time: 15132 ms
[2020-11-12 03:08:35	                main:574]	:	INFO	:	Epoch 25 | loss: 0.020195 | val_loss: 0.0200694 | Time: 15164.5 ms
[2020-11-12 03:08:50	                main:574]	:	INFO	:	Epoch 26 | loss: 0.0237188 | val_loss: 0.021327 | Time: 15146.1 ms
[2020-11-12 03:09:05	                main:574]	:	INFO	:	Epoch 27 | loss: 0.0192736 | val_loss: 0.0193335 | Time: 15131.2 ms
[2020-11-12 03:09:20	                main:574]	:	INFO	:	Epoch 28 | loss: 0.0358542 | val_loss: 0.0503085 | Time: 15139.9 ms
[2020-11-12 03:09:36	                main:574]	:	INFO	:	Epoch 29 | loss: 0.0370877 | val_loss: 0.0232891 | Time: 15200.1 ms
[2020-11-12 03:09:51	                main:574]	:	INFO	:	Epoch 30 | loss: 0.0190718 | val_loss: 0.0164697 | Time: 15167.1 ms
[2020-11-12 03:10:06	                main:574]	:	INFO	:	Epoch 31 | loss: 0.0193013 | val_loss: 0.0140189 | Time: 15159.8 ms
[2020-11-12 03:10:21	                main:574]	:	INFO	:	Epoch 32 | loss: 0.0328578 | val_loss: 0.0454321 | Time: 15139.2 ms
[2020-11-12 03:10:36	                main:574]	:	INFO	:	Epoch 33 | loss: 0.0288162 | val_loss: 0.0187687 | Time: 15153 ms
[2020-11-12 03:10:52	                main:574]	:	INFO	:	Epoch 34 | loss: 0.0220194 | val_loss: 0.0309915 | Time: 15143.4 ms
[2020-11-12 03:11:07	                main:574]	:	INFO	:	Epoch 35 | loss: 0.0174628 | val_loss: 0.0134252 | Time: 15146.1 ms
[2020-11-12 03:11:22	                main:574]	:	INFO	:	Epoch 36 | loss: 0.0149484 | val_loss: 0.0136407 | Time: 15164 ms
[2020-11-12 03:11:37	                main:574]	:	INFO	:	Epoch 37 | loss: 0.0108624 | val_loss: 0.0105488 | Time: 15161.3 ms
[2020-11-12 03:11:52	                main:574]	:	INFO	:	Epoch 38 | loss: 0.0108995 | val_loss: 0.0129825 | Time: 15181.9 ms
[2020-11-12 03:12:07	                main:574]	:	INFO	:	Epoch 39 | loss: 0.0124823 | val_loss: 0.00974101 | Time: 15134.5 ms
[2020-11-12 03:12:23	                main:574]	:	INFO	:	Epoch 40 | loss: 0.00945825 | val_loss: 0.00946521 | Time: 15153.7 ms
[2020-11-12 03:12:38	                main:574]	:	INFO	:	Epoch 41 | loss: 0.00853899 | val_loss: 0.00872606 | Time: 15217.3 ms
[2020-11-12 03:12:53	                main:574]	:	INFO	:	Epoch 42 | loss: 0.0080086 | val_loss: 0.0083354 | Time: 15172.5 ms
[2020-11-12 03:13:08	                main:574]	:	INFO	:	Epoch 43 | loss: 0.00767122 | val_loss: 0.00799433 | Time: 15162 ms
[2020-11-12 03:13:23	                main:574]	:	INFO	:	Epoch 44 | loss: 0.00742112 | val_loss: 0.0078081 | Time: 15156 ms
[2020-11-12 03:13:38	                main:574]	:	INFO	:	Epoch 45 | loss: 0.00715068 | val_loss: 0.0074861 | Time: 15137.3 ms
[2020-11-12 03:13:54	                main:574]	:	INFO	:	Epoch 46 | loss: 0.00692447 | val_loss: 0.00736247 | Time: 15159.6 ms
[2020-11-12 03:14:09	                main:574]	:	INFO	:	Epoch 47 | loss: 0.0095821 | val_loss: 0.00735825 | Time: 15163 ms
[2020-11-12 03:14:24	                main:574]	:	INFO	:	Epoch 48 | loss: 0.00678877 | val_loss: 0.00684665 | Time: 15166.7 ms
[2020-11-12 03:14:39	                main:574]	:	INFO	:	Epoch 49 | loss: 0.0064182 | val_loss: 0.00659941 | Time: 15140.5 ms
[2020-11-12 03:14:54	                main:574]	:	INFO	:	Epoch 50 | loss: 0.00617618 | val_loss: 0.00631762 | Time: 15135.4 ms
[2020-11-12 03:15:09	                main:574]	:	INFO	:	Epoch 51 | loss: 0.00597555 | val_loss: 0.00612906 | Time: 15135.9 ms
[2020-11-12 03:15:25	                main:574]	:	INFO	:	Epoch 52 | loss: 0.00578207 | val_loss: 0.00588513 | Time: 15177 ms
[2020-11-12 03:15:40	                main:574]	:	INFO	:	Epoch 53 | loss: 0.00559423 | val_loss: 0.00571175 | Time: 15164.6 ms
[2020-11-12 03:15:55	                main:574]	:	INFO	:	Epoch 54 | loss: 0.00541277 | val_loss: 0.0054925 | Time: 15147.9 ms
[2020-11-12 03:16:10	                main:574]	:	INFO	:	Epoch 55 | loss: 0.00523466 | val_loss: 0.00530511 | Time: 15156 ms
[2020-11-12 03:16:25	                main:574]	:	INFO	:	Epoch 56 | loss: 0.00506162 | val_loss: 0.00513049 | Time: 15142 ms
[2020-11-12 03:16:41	                main:574]	:	INFO	:	Epoch 57 | loss: 0.00489006 | val_loss: 0.00494613 | Time: 15165 ms
[2020-11-12 03:16:56	                main:574]	:	INFO	:	Epoch 58 | loss: 0.00472278 | val_loss: 0.00477066 | Time: 15173 ms
[2020-11-12 03:17:11	                main:574]	:	INFO	:	Epoch 59 | loss: 0.00454776 | val_loss: 0.00459258 | Time: 15162.3 ms
[2020-11-12 03:17:26	                main:574]	:	INFO	:	Epoch 60 | loss: 0.00438312 | val_loss: 0.00443758 | Time: 15164 ms
[2020-11-12 03:17:41	                main:574]	:	INFO	:	Epoch 61 | loss: 0.00422056 | val_loss: 0.00425511 | Time: 15173.6 ms
[2020-11-12 03:17:57	                main:574]	:	INFO	:	Epoch 62 | loss: 0.00405854 | val_loss: 0.00408774 | Time: 15449.6 ms
[2020-11-12 03:18:12	                main:574]	:	INFO	:	Epoch 63 | loss: 0.00389871 | val_loss: 0.00393264 | Time: 15697.1 ms
[2020-11-12 03:18:28	                main:574]	:	INFO	:	Epoch 64 | loss: 0.00374328 | val_loss: 0.00377062 | Time: 15218 ms
[2020-11-12 03:18:43	                main:574]	:	INFO	:	Epoch 65 | loss: 0.00359104 | val_loss: 0.00361275 | Time: 15184 ms
[2020-11-12 03:18:58	                main:574]	:	INFO	:	Epoch 66 | loss: 0.00344002 | val_loss: 0.00346016 | Time: 15228.2 ms
[2020-11-12 03:19:13	                main:574]	:	INFO	:	Epoch 67 | loss: 0.00329173 | val_loss: 0.0033161 | Time: 15207.5 ms
[2020-11-12 03:19:29	                main:574]	:	INFO	:	Epoch 68 | loss: 0.0031486 | val_loss: 0.00316492 | Time: 15199.9 ms
[2020-11-12 03:19:44	                main:574]	:	INFO	:	Epoch 69 | loss: 0.00300676 | val_loss: 0.00302453 | Time: 15198.4 ms
[2020-11-12 03:19:59	                main:574]	:	INFO	:	Epoch 70 | loss: 0.0028694 | val_loss: 0.00288449 | Time: 15186.7 ms
[2020-11-12 03:20:14	                main:574]	:	INFO	:	Epoch 71 | loss: 0.00273609 | val_loss: 0.00274897 | Time: 15189.4 ms
[2020-11-12 03:20:29	                main:574]	:	INFO	:	Epoch 72 | loss: 0.00260537 | val_loss: 0.0026169 | Time: 15186.9 ms
[2020-11-12 03:20:45	                main:574]	:	INFO	:	Epoch 73 | loss: 0.00248007 | val_loss: 0.00249478 | Time: 15216.2 ms
[2020-11-12 03:21:00	                main:574]	:	INFO	:	Epoch 74 | loss: 0.00235742 | val_loss: 0.00236869 | Time: 15220.7 ms
[2020-11-12 03:21:15	                main:574]	:	INFO	:	Epoch 75 | loss: 0.00223977 | val_loss: 0.00225182 | Time: 15228.8 ms
[2020-11-12 03:21:30	                main:574]	:	INFO	:	Epoch 76 | loss: 0.00212645 | val_loss: 0.00213118 | Time: 15207.5 ms
[2020-11-12 03:21:45	                main:574]	:	INFO	:	Epoch 77 | loss: 0.00201731 | val_loss: 0.00200546 | Time: 15177.5 ms
[2020-11-12 03:22:01	                main:574]	:	INFO	:	Epoch 78 | loss: 0.00191192 | val_loss: 0.00190338 | Time: 15208.6 ms
[2020-11-12 03:22:16	                main:574]	:	INFO	:	Epoch 79 | loss: 0.00181187 | val_loss: 0.00180225 | Time: 15176.4 ms
[2020-11-12 03:22:31	                main:574]	:	INFO	:	Epoch 80 | loss: 0.00171528 | val_loss: 0.00170376 | Time: 15215.7 ms
[2020-11-12 03:22:46	                main:574]	:	INFO	:	Epoch 81 | loss: 0.00162331 | val_loss: 0.00161348 | Time: 15223.6 ms
[2020-11-12 03:23:02	                main:574]	:	INFO	:	Epoch 82 | loss: 0.00153618 | val_loss: 0.0015284 | Time: 15193.3 ms
[2020-11-12 03:23:17	                main:574]	:	INFO	:	Epoch 83 | loss: 0.00145248 | val_loss: 0.00144466 | Time: 15171.2 ms
[2020-11-12 03:23:32	                main:574]	:	INFO	:	Epoch 84 | loss: 0.00137203 | val_loss: 0.0013664 | Time: 15179.4 ms
[2020-11-12 03:23:47	                main:574]	:	INFO	:	Epoch 85 | loss: 0.0012966 | val_loss: 0.00128973 | Time: 15211.1 ms
[2020-11-12 03:24:02	                main:574]	:	INFO	:	Epoch 86 | loss: 0.00122509 | val_loss: 0.00122244 | Time: 15216.9 ms
[2020-11-12 03:24:18	                main:574]	:	INFO	:	Epoch 87 | loss: 0.00115663 | val_loss: 0.00115273 | Time: 15209.6 ms
[2020-11-12 03:24:33	                main:574]	:	INFO	:	Epoch 88 | loss: 0.00109203 | val_loss: 0.00109352 | Time: 15213.3 ms
[2020-11-12 03:24:48	                main:574]	:	INFO	:	Epoch 89 | loss: 0.00103181 | val_loss: 0.00102875 | Time: 15203 ms
[2020-11-12 03:25:03	                main:574]	:	INFO	:	Epoch 90 | loss: 0.000973032 | val_loss: 0.000972771 | Time: 15200.1 ms
[2020-11-12 03:25:19	                main:574]	:	INFO	:	Epoch 91 | loss: 0.00091868 | val_loss: 0.00091793 | Time: 15202.9 ms
[2020-11-12 03:25:34	                main:574]	:	INFO	:	Epoch 92 | loss: 0.00086624 | val_loss: 0.000864792 | Time: 15203.9 ms
[2020-11-12 03:25:49	                main:574]	:	INFO	:	Epoch 93 | loss: 0.000817505 | val_loss: 0.000820261 | Time: 15215.7 ms
[2020-11-12 03:26:04	                main:574]	:	INFO	:	Epoch 94 | loss: 0.000770946 | val_loss: 0.000770429 | Time: 15202.4 ms
[2020-11-12 03:26:19	                main:574]	:	INFO	:	Epoch 95 | loss: 0.000727049 | val_loss: 0.000725951 | Time: 15206.6 ms
[2020-11-12 03:26:35	                main:574]	:	INFO	:	Epoch 96 | loss: 0.000684966 | val_loss: 0.000684567 | Time: 15191.9 ms
[2020-11-12 03:26:50	                main:574]	:	INFO	:	Epoch 97 | loss: 0.000645222 | val_loss: 0.0006307 | Time: 15201.9 ms
[2020-11-12 03:27:05	                main:574]	:	INFO	:	Epoch 98 | loss: 0.000608548 | val_loss: 0.000600543 | Time: 15213.5 ms
[2020-11-12 03:27:20	                main:574]	:	INFO	:	Epoch 99 | loss: 0.00057322 | val_loss: 0.0005575 | Time: 15206.9 ms
[2020-11-12 03:27:35	                main:574]	:	INFO	:	Epoch 100 | loss: 0.0005407 | val_loss: 0.000528833 | Time: 15189 ms
[2020-11-12 03:27:51	                main:574]	:	INFO	:	Epoch 101 | loss: 0.000509978 | val_loss: 0.000496832 | Time: 15216.2 ms
[2020-11-12 03:28:06	                main:574]	:	INFO	:	Epoch 102 | loss: 0.000480927 | val_loss: 0.000471159 | Time: 15207.5 ms
[2020-11-12 03:28:21	                main:574]	:	INFO	:	Epoch 103 | loss: 0.000453454 | val_loss: 0.000443009 | Time: 15241 ms
[2020-11-12 03:28:36	                main:574]	:	INFO	:	Epoch 104 | loss: 0.000427136 | val_loss: 0.000416217 | Time: 15200.9 ms
[2020-11-12 03:28:52	                main:574]	:	INFO	:	Epoch 105 | loss: 0.00040283 | val_loss: 0.000392067 | Time: 15181.9 ms
[2020-11-12 03:29:07	                main:574]	:	INFO	:	Epoch 106 | loss: 0.000380791 | val_loss: 0.000372852 | Time: 15188.5 ms
[2020-11-12 03:29:22	                main:574]	:	INFO	:	Epoch 107 | loss: 0.000358957 | val_loss: 0.000350977 | Time: 15198.9 ms
[2020-11-12 03:29:37	                main:574]	:	INFO	:	Epoch 108 | loss: 0.000339624 | val_loss: 0.000332761 | Time: 15236.4 ms
[2020-11-12 03:29:53	                main:574]	:	INFO	:	Epoch 109 | loss: 0.000321067 | val_loss: 0.000312471 | Time: 15595.9 ms
[2020-11-12 03:30:09	                main:574]	:	INFO	:	Epoch 110 | loss: 0.000303427 | val_loss: 0.000296175 | Time: 16414.4 ms
[2020-11-12 03:30:25	                main:574]	:	INFO	:	Epoch 111 | loss: 0.000287418 | val_loss: 0.000281159 | Time: 15274.2 ms
[2020-11-12 03:30:40	                main:574]	:	INFO	:	Epoch 112 | loss: 0.000272198 | val_loss: 0.000266272 | Time: 15264.5 ms
[2020-11-12 03:30:55	                main:574]	:	INFO	:	Epoch 113 | loss: 0.000257579 | val_loss: 0.000252483 | Time: 15241.7 ms
[2020-11-12 03:31:10	                main:574]	:	INFO	:	Epoch 114 | loss: 0.000244174 | val_loss: 0.000239642 | Time: 15200.1 ms
[2020-11-12 03:31:26	                main:574]	:	INFO	:	Epoch 115 | loss: 0.000233076 | val_loss: 0.000229663 | Time: 15220.3 ms
[2020-11-12 03:31:41	                main:574]	:	INFO	:	Epoch 116 | loss: 0.000219954 | val_loss: 0.000217181 | Time: 15222.1 ms
[2020-11-12 03:31:56	                main:574]	:	INFO	:	Epoch 117 | loss: 0.000209713 | val_loss: 0.000204909 | Time: 15229.1 ms
[2020-11-12 03:32:11	                main:574]	:	INFO	:	Epoch 118 | loss: 0.000199268 | val_loss: 0.000195744 | Time: 15220.5 ms
[2020-11-12 03:32:27	                main:574]	:	INFO	:	Epoch 119 | loss: 0.000189646 | val_loss: 0.000188086 | Time: 15228.8 ms
[2020-11-12 03:32:42	                main:574]	:	INFO	:	Epoch 120 | loss: 0.000180683 | val_loss: 0.000177346 | Time: 15233.2 ms
[2020-11-12 03:32:57	                main:574]	:	INFO	:	Epoch 121 | loss: 0.000172811 | val_loss: 0.000170437 | Time: 15278.2 ms
[2020-11-12 03:33:12	                main:574]	:	INFO	:	Epoch 122 | loss: 0.000164507 | val_loss: 0.00016329 | Time: 15195 ms
[2020-11-12 03:33:27	                main:574]	:	INFO	:	Epoch 123 | loss: 0.000157757 | val_loss: 0.000155381 | Time: 15188.5 ms
[2020-11-12 03:33:43	                main:574]	:	INFO	:	Epoch 124 | loss: 0.000149935 | val_loss: 0.000147032 | Time: 15197.6 ms
[2020-11-12 03:33:58	                main:574]	:	INFO	:	Epoch 125 | loss: 0.000143603 | val_loss: 0.00014219 | Time: 15205.5 ms
[2020-11-12 03:34:13	                main:574]	:	INFO	:	Epoch 126 | loss: 0.000137727 | val_loss: 0.00013591 | Time: 15171.5 ms
[2020-11-12 03:34:28	                main:574]	:	INFO	:	Epoch 127 | loss: 0.000131553 | val_loss: 0.000131256 | Time: 15159.4 ms
[2020-11-12 03:34:43	                main:574]	:	INFO	:	Epoch 128 | loss: 0.000126183 | val_loss: 0.000124586 | Time: 15164.4 ms
[2020-11-12 03:34:59	                main:574]	:	INFO	:	Epoch 129 | loss: 0.000121062 | val_loss: 0.000120186 | Time: 15176.8 ms
[2020-11-12 03:35:14	                main:574]	:	INFO	:	Epoch 130 | loss: 0.000116326 | val_loss: 0.000116079 | Time: 15201.8 ms
[2020-11-12 03:35:29	                main:574]	:	INFO	:	Epoch 131 | loss: 0.000111308 | val_loss: 0.000109768 | Time: 15233.6 ms
[2020-11-12 03:35:44	                main:574]	:	INFO	:	Epoch 132 | loss: 0.000107173 | val_loss: 0.000104973 | Time: 15158 ms
[2020-11-12 03:35:59	                main:574]	:	INFO	:	Epoch 133 | loss: 0.000103197 | val_loss: 0.000105488 | Time: 15176.5 ms
[2020-11-12 03:36:15	                main:574]	:	INFO	:	Epoch 134 | loss: 9.93201e-05 | val_loss: 0.000100334 | Time: 15174 ms
[2020-11-12 03:36:30	                main:574]	:	INFO	:	Epoch 135 | loss: 9.59894e-05 | val_loss: 9.46055e-05 | Time: 15225.7 ms
[2020-11-12 03:36:45	                main:574]	:	INFO	:	Epoch 136 | loss: 9.32489e-05 | val_loss: 9.1563e-05 | Time: 15165.8 ms
[2020-11-12 03:37:00	                main:574]	:	INFO	:	Epoch 137 | loss: 8.9603e-05 | val_loss: 8.77809e-05 | Time: 15193 ms
[2020-11-12 03:37:15	                main:574]	:	INFO	:	Epoch 138 | loss: 8.57376e-05 | val_loss: 8.54529e-05 | Time: 15168.8 ms
[2020-11-12 03:37:31	                main:574]	:	INFO	:	Epoch 139 | loss: 8.27381e-05 | val_loss: 8.27996e-05 | Time: 15192.4 ms
[2020-11-12 03:37:46	                main:574]	:	INFO	:	Epoch 140 | loss: 8.10633e-05 | val_loss: 8.00594e-05 | Time: 15174 ms
[2020-11-12 03:38:01	                main:574]	:	INFO	:	Epoch 141 | loss: 7.74664e-05 | val_loss: 7.98117e-05 | Time: 15176.1 ms
[2020-11-12 03:38:16	                main:574]	:	INFO	:	Epoch 142 | loss: 7.55524e-05 | val_loss: 7.32332e-05 | Time: 15158.3 ms
[2020-11-12 03:38:31	                main:574]	:	INFO	:	Epoch 143 | loss: 7.30254e-05 | val_loss: 7.44179e-05 | Time: 15168.6 ms
[2020-11-12 03:38:47	                main:574]	:	INFO	:	Epoch 144 | loss: 7.07762e-05 | val_loss: 7.02263e-05 | Time: 15199 ms
[2020-11-12 03:39:02	                main:574]	:	INFO	:	Epoch 145 | loss: 6.83563e-05 | val_loss: 6.81248e-05 | Time: 15182.9 ms
[2020-11-12 03:39:17	                main:574]	:	INFO	:	Epoch 146 | loss: 6.66059e-05 | val_loss: 6.62034e-05 | Time: 15206 ms
[2020-11-12 03:39:32	                main:574]	:	INFO	:	Epoch 147 | loss: 6.46664e-05 | val_loss: 6.59639e-05 | Time: 15165.8 ms
[2020-11-12 03:39:47	                main:574]	:	INFO	:	Epoch 148 | loss: 6.29222e-05 | val_loss: 6.26041e-05 | Time: 15174.6 ms
[2020-11-12 03:40:03	                main:574]	:	INFO	:	Epoch 149 | loss: 6.18015e-05 | val_loss: 6.19435e-05 | Time: 15195.2 ms
[2020-11-12 03:40:18	                main:574]	:	INFO	:	Epoch 150 | loss: 5.89181e-05 | val_loss: 6.21621e-05 | Time: 15247.9 ms
[2020-11-12 03:40:33	                main:574]	:	INFO	:	Epoch 151 | loss: 5.76439e-05 | val_loss: 6.01621e-05 | Time: 15220.5 ms
[2020-11-12 03:40:48	                main:574]	:	INFO	:	Epoch 152 | loss: 5.68363e-05 | val_loss: 5.5258e-05 | Time: 15237.4 ms
[2020-11-12 03:41:04	                main:574]	:	INFO	:	Epoch 153 | loss: 5.46666e-05 | val_loss: 5.50509e-05 | Time: 15221.4 ms
[2020-11-12 03:41:19	                main:574]	:	INFO	:	Epoch 154 | loss: 5.3189e-05 | val_loss: 5.37174e-05 | Time: 15217.8 ms
[2020-11-12 03:41:34	                main:574]	:	INFO	:	Epoch 155 | loss: 5.21587e-05 | val_loss: 5.22938e-05 | Time: 15215.1 ms
[2020-11-12 03:41:49	                main:574]	:	INFO	:	Epoch 156 | loss: 5.02615e-05 | val_loss: 4.98312e-05 | Time: 15231 ms
[2020-11-12 03:42:05	                main:574]	:	INFO	:	Epoch 157 | loss: 4.99604e-05 | val_loss: 4.87223e-05 | Time: 15233.6 ms
[2020-11-12 03:42:20	                main:574]	:	INFO	:	Epoch 158 | loss: 4.84198e-05 | val_loss: 4.81446e-05 | Time: 15202.1 ms
[2020-11-12 03:42:35	                main:574]	:	INFO	:	Epoch 159 | loss: 4.76082e-05 | val_loss: 4.71048e-05 | Time: 15218.3 ms
[2020-11-12 03:42:50	                main:574]	:	INFO	:	Epoch 160 | loss: 4.60265e-05 | val_loss: 4.49713e-05 | Time: 15243.7 ms
[2020-11-12 03:43:05	                main:574]	:	INFO	:	Epoch 161 | loss: 4.57593e-05 | val_loss: 4.68359e-05 | Time: 15258.1 ms
[2020-11-12 03:43:21	                main:574]	:	INFO	:	Epoch 162 | loss: 4.397e-05 | val_loss: 4.35884e-05 | Time: 15201.7 ms
[2020-11-12 03:43:36	                main:574]	:	INFO	:	Epoch 163 | loss: 4.31868e-05 | val_loss: 4.36997e-05 | Time: 15280.7 ms
[2020-11-12 03:43:51	                main:574]	:	INFO	:	Epoch 164 | loss: 4.23783e-05 | val_loss: 4.1851e-05 | Time: 15213.8 ms
[2020-11-12 03:44:06	                main:574]	:	INFO	:	Epoch 165 | loss: 4.18412e-05 | val_loss: 4.23279e-05 | Time: 15225.4 ms
[2020-11-12 03:44:22	                main:574]	:	INFO	:	Epoch 166 | loss: 4.05322e-05 | val_loss: 4.20445e-05 | Time: 15188.8 ms
[2020-11-12 03:44:37	                main:574]	:	INFO	:	Epoch 167 | loss: 4.02445e-05 | val_loss: 3.87552e-05 | Time: 15214.4 ms
[2020-11-12 03:44:52	                main:574]	:	INFO	:	Epoch 168 | loss: 3.89967e-05 | val_loss: 4.10214e-05 | Time: 15245.9 ms
[2020-11-12 03:45:07	                main:574]	:	INFO	:	Epoch 169 | loss: 3.86448e-05 | val_loss: 3.91402e-05 | Time: 15261.5 ms
[2020-11-12 03:45:23	                main:574]	:	INFO	:	Epoch 170 | loss: 3.82869e-05 | val_loss: 3.68546e-05 | Time: 15204.3 ms
[2020-11-12 03:45:38	                main:574]	:	INFO	:	Epoch 171 | loss: 3.67172e-05 | val_loss: 3.6613e-05 | Time: 15291.9 ms
[2020-11-12 03:45:54	                main:574]	:	INFO	:	Epoch 172 | loss: 3.62495e-05 | val_loss: 3.93164e-05 | Time: 15908 ms
[2020-11-12 03:46:10	                main:574]	:	INFO	:	Epoch 173 | loss: 3.53259e-05 | val_loss: 3.49295e-05 | Time: 15727.4 ms
[2020-11-12 03:46:26	                main:574]	:	INFO	:	Epoch 174 | loss: 3.60005e-05 | val_loss: 3.49684e-05 | Time: 16253.8 ms
[2020-11-12 03:46:42	                main:574]	:	INFO	:	Epoch 175 | loss: 3.43987e-05 | val_loss: 3.46464e-05 | Time: 16283.7 ms
[2020-11-12 03:46:58	                main:574]	:	INFO	:	Epoch 176 | loss: 3.33237e-05 | val_loss: 3.3016e-05 | Time: 15977.5 ms
[2020-11-12 03:47:14	                main:574]	:	INFO	:	Epoch 177 | loss: 3.33304e-05 | val_loss: 3.38799e-05 | Time: 15991.8 ms
[2020-11-12 03:47:30	                main:574]	:	INFO	:	Epoch 178 | loss: 3.29627e-05 | val_loss: 3.37267e-05 | Time: 16002 ms
[2020-11-12 03:47:46	                main:574]	:	INFO	:	Epoch 179 | loss: 3.22216e-05 | val_loss: 3.15859e-05 | Time: 16054.5 ms
[2020-11-12 03:48:03	                main:574]	:	INFO	:	Epoch 180 | loss: 3.18862e-05 | val_loss: 3.10487e-05 | Time: 17056.4 ms
[2020-11-12 03:48:20	                main:574]	:	INFO	:	Epoch 181 | loss: 3.09864e-05 | val_loss: 3.34874e-05 | Time: 16532.5 ms
[2020-11-12 03:48:36	                main:574]	:	INFO	:	Epoch 182 | loss: 3.05004e-05 | val_loss: 3.14798e-05 | Time: 16449.1 ms
[2020-11-12 03:48:52	                main:574]	:	INFO	:	Epoch 183 | loss: 3.05217e-05 | val_loss: 2.93468e-05 | Time: 15713.1 ms
[2020-11-12 03:49:08	                main:574]	:	INFO	:	Epoch 184 | loss: 3.10339e-05 | val_loss: 3.02502e-05 | Time: 15442.4 ms
[2020-11-12 03:49:23	                main:574]	:	INFO	:	Epoch 185 | loss: 2.91274e-05 | val_loss: 2.95849e-05 | Time: 15464.1 ms
[2020-11-12 03:49:38	                main:574]	:	INFO	:	Epoch 186 | loss: 2.85891e-05 | val_loss: 2.86739e-05 | Time: 15303.8 ms
[2020-11-12 03:49:54	                main:574]	:	INFO	:	Epoch 187 | loss: 2.90048e-05 | val_loss: 2.9294e-05 | Time: 15337.2 ms
[2020-11-12 03:50:09	                main:574]	:	INFO	:	Epoch 188 | loss: 2.77707e-05 | val_loss: 2.90202e-05 | Time: 15280 ms
[2020-11-12 03:50:24	                main:574]	:	INFO	:	Epoch 189 | loss: 2.77239e-05 | val_loss: 2.65856e-05 | Time: 15261.5 ms
[2020-11-12 03:50:40	                main:574]	:	INFO	:	Epoch 190 | loss: 2.73582e-05 | val_loss: 2.79811e-05 | Time: 15247.8 ms
[2020-11-12 03:50:55	                main:574]	:	INFO	:	Epoch 191 | loss: 2.68995e-05 | val_loss: 2.86987e-05 | Time: 15309.1 ms
[2020-11-12 03:51:10	                main:574]	:	INFO	:	Epoch 192 | loss: 2.66558e-05 | val_loss: 2.65928e-05 | Time: 15244.5 ms
[2020-11-12 03:51:10	                main:597]	:	INFO	:	Saving trained model to model-final.pt, val_loss 2.65928e-05
[2020-11-12 03:51:10	                main:603]	:	INFO	:	Saving end state to config to file
[2020-11-12 03:51:10	                main:608]	:	INFO	:	Success, exiting..
03:51:10 (7016): called boinc_finish(0)

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)