Task 2824981

Name rand_automata_0018-1604983200-28840-0_2
Workunit 1263704
Created 10 Nov 2020, 23:31:35 UTC
Sent 10 Nov 2020, 23:35:48 UTC
Report deadline 11 Nov 2020, 22:05:48 UTC
Received 11 Nov 2020, 3:19:41 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 3985
Run time 14 min 8 sec
CPU time 14 min 2 sec
Validate state Valid
Credit 959.40
Device peak FLOPS 3,338.19 GFLOPS
Application version Machine Learning Dataset Generator (test) v9.75 (cuda10200)
x86_64-pc-linux-gnu
Peak working set size 2.26 GB
Peak swap size 9.65 GB
Peak disk usage 0.60 MB

Stderr output

<core_client_version>7.16.11</core_client_version>
<![CDATA[
<stderr_txt>
DEBUG: Args: ../../projects/www.mlcathome.org_mlcathome/mldstest_9.75_x86_64-pc-linux-gnu__cuda10200 -a LSTM -w 64 -b 2 -s 32 --lr 0.001 --maxepoch 192 --device 0 
nthreads: 1 gpudev: 0
Re-exec()-ing to set number of threads correctly...
Machine Learning Dataset Generator v9.75 (Linux/x86_64) (libTorch: release/1.6 GPU: GeForce GTX 1650)
device already set
[2020-11-10 22:05:21	                main:435]	:	INFO	:	Set logging level to 1
[2020-11-10 22:05:21	                main:441]	:	INFO	:	Running in BOINC Client mode
[2020-11-10 22:05:21	                main:444]	:	INFO	:	Resolving all filenames
[2020-11-10 22:05:21	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0018-train-val-dataset.hdf5 (exists = 1)
[2020-11-10 22:05:21	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0018-1604983200-28840-0_2_r890969911_1 (exists = 0)
[2020-11-10 22:05:21	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0018-1604983200-28840-0_2_r890969911_0 (exists = 0)
[2020-11-10 22:05:21	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 0)
[2020-11-10 22:05:21	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2020-11-10 22:05:21	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/rand_automata_0018-train-val-dataset.hdf5
[2020-11-10 22:05:21	                main:474]	:	INFO	:	Configuration: 
[2020-11-10 22:05:21	                main:475]	:	INFO	:	    Model type: LSTM
[2020-11-10 22:05:21	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2020-11-10 22:05:21	                main:477]	:	INFO	:	    Max Epochs: 192
[2020-11-10 22:05:21	                main:478]	:	INFO	:	    Batch Size: 32
[2020-11-10 22:05:21	                main:479]	:	INFO	:	    Learning Rate: 0.001
[2020-11-10 22:05:21	                main:480]	:	INFO	:	    Patience: 10
[2020-11-10 22:05:21	                main:481]	:	INFO	:	    Hidden Width: 64
[2020-11-10 22:05:21	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2020-11-10 22:05:21	                main:483]	:	INFO	:	    # Backend Layers: 2
[2020-11-10 22:05:21	                main:484]	:	INFO	:	    # Threads: 1
[2020-11-10 22:05:21	                main:486]	:	INFO	:	Preparing Dataset
[2020-11-10 22:05:21	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0018-train-val-dataset.hdf5 into memory
[2020-11-10 22:05:21	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0018-train-val-dataset.hdf5 into memory
[2020-11-10 22:05:24	                load:106]	:	INFO	:	Successfully loaded dataset of 4096 examples into memory.
[2020-11-10 22:05:24	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0018-train-val-dataset.hdf5 into memory
[2020-11-10 22:05:24	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0018-train-val-dataset.hdf5 into memory
[2020-11-10 22:05:24	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2020-11-10 22:05:24	                main:494]	:	INFO	:	Creating Model
[2020-11-10 22:05:24	                main:507]	:	INFO	:	Preparing config file
[2020-11-10 22:05:24	                main:519]	:	INFO	:	Creating new config file
[2020-11-10 22:05:27	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2020-11-10 22:05:27	                main:562]	:	INFO	:	Starting Training
[2020-11-10 22:05:32	                main:574]	:	INFO	:	Epoch 1 | loss: 0.0665554 | val_loss: 0.0660275 | Time: 5300.26 ms
[2020-11-10 22:05:36	                main:574]	:	INFO	:	Epoch 2 | loss: 0.0656943 | val_loss: 0.0648748 | Time: 4460.77 ms
[2020-11-10 22:05:41	                main:574]	:	INFO	:	Epoch 3 | loss: 0.0632331 | val_loss: 0.0617784 | Time: 4523 ms
[2020-11-10 22:05:45	                main:574]	:	INFO	:	Epoch 4 | loss: 0.0605675 | val_loss: 0.0594342 | Time: 4244.05 ms
[2020-11-10 22:05:49	                main:574]	:	INFO	:	Epoch 5 | loss: 0.0584114 | val_loss: 0.057689 | Time: 4250.9 ms
[2020-11-10 22:05:54	                main:574]	:	INFO	:	Epoch 6 | loss: 0.0570136 | val_loss: 0.0566151 | Time: 4536.17 ms
[2020-11-10 22:05:58	                main:574]	:	INFO	:	Epoch 7 | loss: 0.0560219 | val_loss: 0.0557621 | Time: 4464.73 ms
[2020-11-10 22:06:03	                main:574]	:	INFO	:	Epoch 8 | loss: 0.0551475 | val_loss: 0.0549256 | Time: 4468.43 ms
[2020-11-10 22:06:07	                main:574]	:	INFO	:	Epoch 9 | loss: 0.0543057 | val_loss: 0.0541558 | Time: 4493.94 ms
[2020-11-10 22:06:12	                main:574]	:	INFO	:	Epoch 10 | loss: 0.0535021 | val_loss: 0.0533315 | Time: 4365.2 ms
[2020-11-10 22:06:16	                main:574]	:	INFO	:	Epoch 11 | loss: 0.0526474 | val_loss: 0.052548 | Time: 4270.75 ms
[2020-11-10 22:06:20	                main:574]	:	INFO	:	Epoch 12 | loss: 0.0517099 | val_loss: 0.0517236 | Time: 4354.8 ms
[2020-11-10 22:06:25	                main:574]	:	INFO	:	Epoch 13 | loss: 0.0507699 | val_loss: 0.0508413 | Time: 4480.12 ms
[2020-11-10 22:06:29	                main:574]	:	INFO	:	Epoch 14 | loss: 0.0496862 | val_loss: 0.0497518 | Time: 4385.04 ms
[2020-11-10 22:06:34	                main:574]	:	INFO	:	Epoch 15 | loss: 0.0484002 | val_loss: 0.0484452 | Time: 4455.93 ms
[2020-11-10 22:06:38	                main:574]	:	INFO	:	Epoch 16 | loss: 0.0470696 | val_loss: 0.0471885 | Time: 4503.82 ms
[2020-11-10 22:06:43	                main:574]	:	INFO	:	Epoch 17 | loss: 0.0452654 | val_loss: 0.0452852 | Time: 4422.83 ms
[2020-11-10 22:06:47	                main:574]	:	INFO	:	Epoch 18 | loss: 0.0431711 | val_loss: 0.0435966 | Time: 4499.25 ms
[2020-11-10 22:06:52	                main:574]	:	INFO	:	Epoch 19 | loss: 0.0405321 | val_loss: 0.0404468 | Time: 4393.78 ms
[2020-11-10 22:06:56	                main:574]	:	INFO	:	Epoch 20 | loss: 0.0374588 | val_loss: 0.0376493 | Time: 4467.59 ms
[2020-11-10 22:07:01	                main:574]	:	INFO	:	Epoch 21 | loss: 0.0340928 | val_loss: 0.0365308 | Time: 4598.39 ms
[2020-11-10 22:07:05	                main:574]	:	INFO	:	Epoch 22 | loss: 0.0310493 | val_loss: 0.0322616 | Time: 4498.43 ms
[2020-11-10 22:07:10	                main:574]	:	INFO	:	Epoch 23 | loss: 0.0320274 | val_loss: 0.0419825 | Time: 4522.54 ms
[2020-11-10 22:07:14	                main:574]	:	INFO	:	Epoch 24 | loss: 0.0284527 | val_loss: 0.023769 | Time: 4235.39 ms
[2020-11-10 22:07:18	                main:574]	:	INFO	:	Epoch 25 | loss: 0.0234331 | val_loss: 0.0258244 | Time: 4341.75 ms
[2020-11-10 22:07:23	                main:574]	:	INFO	:	Epoch 26 | loss: 0.0267312 | val_loss: 0.0218091 | Time: 4450.84 ms
[2020-11-10 22:07:27	                main:574]	:	INFO	:	Epoch 27 | loss: 0.0321285 | val_loss: 0.0234762 | Time: 4320.84 ms
[2020-11-10 22:07:31	                main:574]	:	INFO	:	Epoch 28 | loss: 0.0216163 | val_loss: 0.0182715 | Time: 4221.09 ms
[2020-11-10 22:07:35	                main:574]	:	INFO	:	Epoch 29 | loss: 0.0206906 | val_loss: 0.0185761 | Time: 4283.56 ms
[2020-11-10 22:07:40	                main:574]	:	INFO	:	Epoch 30 | loss: 0.014158 | val_loss: 0.0156113 | Time: 4204.64 ms
[2020-11-10 22:07:44	                main:574]	:	INFO	:	Epoch 31 | loss: 0.0125519 | val_loss: 0.0130977 | Time: 4216.17 ms
[2020-11-10 22:07:48	                main:574]	:	INFO	:	Epoch 32 | loss: 0.0187151 | val_loss: 0.0260703 | Time: 4317.41 ms
[2020-11-10 22:07:53	                main:574]	:	INFO	:	Epoch 33 | loss: 0.0166292 | val_loss: 0.0170254 | Time: 4457.4 ms
[2020-11-10 22:07:57	                main:574]	:	INFO	:	Epoch 34 | loss: 0.0126494 | val_loss: 0.0149735 | Time: 4431.32 ms
[2020-11-10 22:08:02	                main:574]	:	INFO	:	Epoch 35 | loss: 0.0107811 | val_loss: 0.0102948 | Time: 4518.47 ms
[2020-11-10 22:08:06	                main:574]	:	INFO	:	Epoch 36 | loss: 0.00960939 | val_loss: 0.00982026 | Time: 4449.46 ms
[2020-11-10 22:08:11	                main:574]	:	INFO	:	Epoch 37 | loss: 0.0113388 | val_loss: 0.0136482 | Time: 4465.27 ms
[2020-11-10 22:08:15	                main:574]	:	INFO	:	Epoch 38 | loss: 0.0112764 | val_loss: 0.0101744 | Time: 4519.26 ms
[2020-11-10 22:08:19	                main:574]	:	INFO	:	Epoch 39 | loss: 0.00901622 | val_loss: 0.00894375 | Time: 4343.91 ms
[2020-11-10 22:08:24	                main:574]	:	INFO	:	Epoch 40 | loss: 0.00849288 | val_loss: 0.00843377 | Time: 4331.29 ms
[2020-11-10 22:08:28	                main:574]	:	INFO	:	Epoch 41 | loss: 0.00812739 | val_loss: 0.00834331 | Time: 4288.09 ms
[2020-11-10 22:08:32	                main:574]	:	INFO	:	Epoch 42 | loss: 0.00794881 | val_loss: 0.00792398 | Time: 4343.59 ms
[2020-11-10 22:08:37	                main:574]	:	INFO	:	Epoch 43 | loss: 0.00760118 | val_loss: 0.00764771 | Time: 4237.28 ms
[2020-11-10 22:08:41	                main:574]	:	INFO	:	Epoch 44 | loss: 0.00739283 | val_loss: 0.00741839 | Time: 4377.81 ms
[2020-11-10 22:08:45	                main:574]	:	INFO	:	Epoch 45 | loss: 0.00714231 | val_loss: 0.00717512 | Time: 4492.1 ms
[2020-11-10 22:08:50	                main:574]	:	INFO	:	Epoch 46 | loss: 0.00692503 | val_loss: 0.00694915 | Time: 4209.24 ms
[2020-11-10 22:08:54	                main:574]	:	INFO	:	Epoch 47 | loss: 0.006715 | val_loss: 0.00675171 | Time: 4522.52 ms
[2020-11-10 22:08:59	                main:574]	:	INFO	:	Epoch 48 | loss: 0.00651063 | val_loss: 0.0064893 | Time: 4515.73 ms
[2020-11-10 22:09:03	                main:574]	:	INFO	:	Epoch 49 | loss: 0.00630902 | val_loss: 0.00632864 | Time: 4340.84 ms
[2020-11-10 22:09:07	                main:574]	:	INFO	:	Epoch 50 | loss: 0.00611264 | val_loss: 0.00612105 | Time: 4395.66 ms
[2020-11-10 22:09:12	                main:574]	:	INFO	:	Epoch 51 | loss: 0.00591888 | val_loss: 0.00587919 | Time: 4350.75 ms
[2020-11-10 22:09:16	                main:574]	:	INFO	:	Epoch 52 | loss: 0.0057271 | val_loss: 0.00568667 | Time: 4345.41 ms
[2020-11-10 22:09:21	                main:574]	:	INFO	:	Epoch 53 | loss: 0.00554052 | val_loss: 0.00549614 | Time: 4435.24 ms
[2020-11-10 22:09:25	                main:574]	:	INFO	:	Epoch 54 | loss: 0.00535618 | val_loss: 0.00530451 | Time: 4477.15 ms
[2020-11-10 22:09:29	                main:574]	:	INFO	:	Epoch 55 | loss: 0.00517639 | val_loss: 0.00511986 | Time: 4367.16 ms
[2020-11-10 22:09:34	                main:574]	:	INFO	:	Epoch 56 | loss: 0.00499888 | val_loss: 0.00493928 | Time: 4243.64 ms
[2020-11-10 22:09:38	                main:574]	:	INFO	:	Epoch 57 | loss: 0.00484556 | val_loss: 0.00477907 | Time: 4413.22 ms
[2020-11-10 22:09:42	                main:574]	:	INFO	:	Epoch 58 | loss: 0.00465765 | val_loss: 0.00459747 | Time: 4312.34 ms
[2020-11-10 22:09:47	                main:574]	:	INFO	:	Epoch 59 | loss: 0.00449005 | val_loss: 0.00443733 | Time: 4441.95 ms
[2020-11-10 22:09:51	                main:574]	:	INFO	:	Epoch 60 | loss: 0.00432647 | val_loss: 0.00427186 | Time: 4355.49 ms
[2020-11-10 22:09:56	                main:574]	:	INFO	:	Epoch 61 | loss: 0.00416817 | val_loss: 0.00411511 | Time: 4483.97 ms
[2020-11-10 22:10:00	                main:574]	:	INFO	:	Epoch 62 | loss: 0.00401233 | val_loss: 0.00395242 | Time: 4309.67 ms
[2020-11-10 22:10:04	                main:574]	:	INFO	:	Epoch 63 | loss: 0.00386026 | val_loss: 0.00379784 | Time: 4405.04 ms
[2020-11-10 22:10:09	                main:574]	:	INFO	:	Epoch 64 | loss: 0.00371716 | val_loss: 0.00369014 | Time: 4351.55 ms
[2020-11-10 22:10:13	                main:574]	:	INFO	:	Epoch 65 | loss: 0.00357307 | val_loss: 0.00351358 | Time: 3956.81 ms
[2020-11-10 22:10:17	                main:574]	:	INFO	:	Epoch 66 | loss: 0.00343061 | val_loss: 0.00336859 | Time: 4387.05 ms
[2020-11-10 22:10:21	                main:574]	:	INFO	:	Epoch 67 | loss: 0.00329583 | val_loss: 0.00323879 | Time: 4270.82 ms
[2020-11-10 22:10:26	                main:574]	:	INFO	:	Epoch 68 | loss: 0.00316171 | val_loss: 0.00310784 | Time: 4446.57 ms
[2020-11-10 22:10:30	                main:574]	:	INFO	:	Epoch 69 | loss: 0.00303325 | val_loss: 0.00297604 | Time: 4226.91 ms
[2020-11-10 22:10:34	                main:574]	:	INFO	:	Epoch 70 | loss: 0.00291159 | val_loss: 0.0028526 | Time: 4414.32 ms
[2020-11-10 22:10:39	                main:574]	:	INFO	:	Epoch 71 | loss: 0.00279131 | val_loss: 0.00273662 | Time: 4493.1 ms
[2020-11-10 22:10:43	                main:574]	:	INFO	:	Epoch 72 | loss: 0.00267653 | val_loss: 0.00262568 | Time: 4315.02 ms
[2020-11-10 22:10:48	                main:574]	:	INFO	:	Epoch 73 | loss: 0.00256545 | val_loss: 0.00251017 | Time: 4464.63 ms
[2020-11-10 22:10:52	                main:574]	:	INFO	:	Epoch 74 | loss: 0.00245882 | val_loss: 0.00240843 | Time: 4571.24 ms
[2020-11-10 22:10:57	                main:574]	:	INFO	:	Epoch 75 | loss: 0.00235667 | val_loss: 0.00230633 | Time: 4298.34 ms
[2020-11-10 22:11:01	                main:574]	:	INFO	:	Epoch 76 | loss: 0.0022573 | val_loss: 0.00220833 | Time: 4401.57 ms
[2020-11-10 22:11:05	                main:574]	:	INFO	:	Epoch 77 | loss: 0.00216222 | val_loss: 0.0021163 | Time: 4328.53 ms
[2020-11-10 22:11:10	                main:574]	:	INFO	:	Epoch 78 | loss: 0.00207106 | val_loss: 0.0020293 | Time: 4506.56 ms
[2020-11-10 22:11:14	                main:574]	:	INFO	:	Epoch 79 | loss: 0.0019835 | val_loss: 0.00194338 | Time: 4337.87 ms
[2020-11-10 22:11:19	                main:574]	:	INFO	:	Epoch 80 | loss: 0.00189874 | val_loss: 0.00185676 | Time: 4409.44 ms
[2020-11-10 22:11:23	                main:574]	:	INFO	:	Epoch 81 | loss: 0.00181796 | val_loss: 0.00178013 | Time: 4295.24 ms
[2020-11-10 22:11:27	                main:574]	:	INFO	:	Epoch 82 | loss: 0.00174101 | val_loss: 0.00170492 | Time: 4380.25 ms
[2020-11-10 22:11:31	                main:574]	:	INFO	:	Epoch 83 | loss: 0.00166628 | val_loss: 0.00163201 | Time: 4238.64 ms
[2020-11-10 22:11:36	                main:574]	:	INFO	:	Epoch 84 | loss: 0.0015947 | val_loss: 0.00156013 | Time: 4370.37 ms
[2020-11-10 22:11:40	                main:574]	:	INFO	:	Epoch 85 | loss: 0.00152451 | val_loss: 0.00149256 | Time: 4406.68 ms
[2020-11-10 22:11:45	                main:574]	:	INFO	:	Epoch 86 | loss: 0.00145864 | val_loss: 0.00142451 | Time: 4427.52 ms
[2020-11-10 22:11:49	                main:574]	:	INFO	:	Epoch 87 | loss: 0.00139559 | val_loss: 0.00136511 | Time: 4336.08 ms
[2020-11-10 22:11:53	                main:574]	:	INFO	:	Epoch 88 | loss: 0.00133421 | val_loss: 0.0013058 | Time: 4234.13 ms
[2020-11-10 22:11:58	                main:574]	:	INFO	:	Epoch 89 | loss: 0.00127633 | val_loss: 0.00124874 | Time: 4489.57 ms
[2020-11-10 22:12:02	                main:574]	:	INFO	:	Epoch 90 | loss: 0.00122079 | val_loss: 0.00119347 | Time: 4498.96 ms
[2020-11-10 22:12:07	                main:574]	:	INFO	:	Epoch 91 | loss: 0.00116734 | val_loss: 0.00114304 | Time: 4288.37 ms
[2020-11-10 22:12:11	                main:574]	:	INFO	:	Epoch 92 | loss: 0.00111719 | val_loss: 0.00109389 | Time: 4382.41 ms
[2020-11-10 22:12:15	                main:574]	:	INFO	:	Epoch 93 | loss: 0.00106755 | val_loss: 0.00104757 | Time: 4375.18 ms
[2020-11-10 22:12:20	                main:574]	:	INFO	:	Epoch 94 | loss: 0.00102203 | val_loss: 0.00099813 | Time: 4380.19 ms
[2020-11-10 22:12:24	                main:574]	:	INFO	:	Epoch 95 | loss: 0.000978026 | val_loss: 0.000956605 | Time: 4421.59 ms
[2020-11-10 22:12:29	                main:574]	:	INFO	:	Epoch 96 | loss: 0.000936533 | val_loss: 0.000916734 | Time: 4468.4 ms
[2020-11-10 22:12:33	                main:574]	:	INFO	:	Epoch 97 | loss: 0.000896454 | val_loss: 0.000879253 | Time: 4170.56 ms
[2020-11-10 22:12:37	                main:574]	:	INFO	:	Epoch 98 | loss: 0.000858105 | val_loss: 0.000838437 | Time: 4472.58 ms
[2020-11-10 22:12:42	                main:574]	:	INFO	:	Epoch 99 | loss: 0.000821788 | val_loss: 0.000807475 | Time: 4448.8 ms
[2020-11-10 22:12:46	                main:574]	:	INFO	:	Epoch 100 | loss: 0.00078779 | val_loss: 0.000775219 | Time: 4269.09 ms
[2020-11-10 22:12:50	                main:574]	:	INFO	:	Epoch 101 | loss: 0.000755079 | val_loss: 0.0007405 | Time: 4427.23 ms
[2020-11-10 22:12:55	                main:574]	:	INFO	:	Epoch 102 | loss: 0.000723199 | val_loss: 0.000708504 | Time: 4438.37 ms
[2020-11-10 22:12:59	                main:574]	:	INFO	:	Epoch 103 | loss: 0.000692396 | val_loss: 0.000679023 | Time: 4447.45 ms
[2020-11-10 22:13:04	                main:574]	:	INFO	:	Epoch 104 | loss: 0.000663385 | val_loss: 0.000651369 | Time: 4440.04 ms
[2020-11-10 22:13:08	                main:574]	:	INFO	:	Epoch 105 | loss: 0.000636761 | val_loss: 0.000625762 | Time: 4216.26 ms
[2020-11-10 22:13:12	                main:574]	:	INFO	:	Epoch 106 | loss: 0.000610792 | val_loss: 0.000599882 | Time: 4404.09 ms
[2020-11-10 22:13:17	                main:574]	:	INFO	:	Epoch 107 | loss: 0.000586731 | val_loss: 0.000578976 | Time: 4381.31 ms
[2020-11-10 22:13:21	                main:574]	:	INFO	:	Epoch 108 | loss: 0.000563416 | val_loss: 0.000557603 | Time: 4202.69 ms
[2020-11-10 22:13:25	                main:574]	:	INFO	:	Epoch 109 | loss: 0.00054224 | val_loss: 0.000532598 | Time: 4260.65 ms
[2020-11-10 22:13:30	                main:574]	:	INFO	:	Epoch 110 | loss: 0.000521356 | val_loss: 0.00051691 | Time: 4360.37 ms
[2020-11-10 22:13:34	                main:574]	:	INFO	:	Epoch 111 | loss: 0.000502479 | val_loss: 0.000495758 | Time: 4649.34 ms
[2020-11-10 22:13:39	                main:574]	:	INFO	:	Epoch 112 | loss: 0.000483088 | val_loss: 0.00047717 | Time: 4421.03 ms
[2020-11-10 22:13:43	                main:574]	:	INFO	:	Epoch 113 | loss: 0.000465546 | val_loss: 0.000458951 | Time: 4368.3 ms
[2020-11-10 22:13:47	                main:574]	:	INFO	:	Epoch 114 | loss: 0.000449919 | val_loss: 0.000441677 | Time: 4451.65 ms
[2020-11-10 22:13:52	                main:574]	:	INFO	:	Epoch 115 | loss: 0.000433439 | val_loss: 0.000425449 | Time: 4195.71 ms
[2020-11-10 22:13:56	                main:574]	:	INFO	:	Epoch 116 | loss: 0.000418346 | val_loss: 0.000413453 | Time: 4324.19 ms
[2020-11-10 22:14:00	                main:574]	:	INFO	:	Epoch 117 | loss: 0.000403906 | val_loss: 0.000398527 | Time: 4326.34 ms
[2020-11-10 22:14:04	                main:574]	:	INFO	:	Epoch 118 | loss: 0.000390145 | val_loss: 0.000385532 | Time: 4178.52 ms
[2020-11-10 22:14:09	                main:574]	:	INFO	:	Epoch 119 | loss: 0.000376833 | val_loss: 0.000374654 | Time: 4128.98 ms
[2020-11-10 22:14:13	                main:574]	:	INFO	:	Epoch 120 | loss: 0.000364801 | val_loss: 0.000361896 | Time: 4575.84 ms
[2020-11-10 22:14:18	                main:574]	:	INFO	:	Epoch 121 | loss: 0.000352755 | val_loss: 0.000348289 | Time: 4436.32 ms
[2020-11-10 22:14:22	                main:574]	:	INFO	:	Epoch 122 | loss: 0.000341632 | val_loss: 0.000338132 | Time: 4267.23 ms
[2020-11-10 22:14:26	                main:574]	:	INFO	:	Epoch 123 | loss: 0.000330484 | val_loss: 0.000326363 | Time: 4335.92 ms
[2020-11-10 22:14:31	                main:574]	:	INFO	:	Epoch 124 | loss: 0.000320439 | val_loss: 0.000317515 | Time: 4323.57 ms
[2020-11-10 22:14:35	                main:574]	:	INFO	:	Epoch 125 | loss: 0.000310965 | val_loss: 0.000307615 | Time: 4495.91 ms
[2020-11-10 22:14:39	                main:574]	:	INFO	:	Epoch 126 | loss: 0.000302508 | val_loss: 0.000300389 | Time: 4283.15 ms
[2020-11-10 22:14:44	                main:574]	:	INFO	:	Epoch 127 | loss: 0.000292897 | val_loss: 0.000289871 | Time: 4620.96 ms
[2020-11-10 22:14:48	                main:574]	:	INFO	:	Epoch 128 | loss: 0.000284415 | val_loss: 0.00028248 | Time: 4383.53 ms
[2020-11-10 22:14:53	                main:574]	:	INFO	:	Epoch 129 | loss: 0.000276306 | val_loss: 0.000274986 | Time: 4414.12 ms
[2020-11-10 22:14:57	                main:574]	:	INFO	:	Epoch 130 | loss: 0.000269057 | val_loss: 0.000265662 | Time: 4183.2 ms
[2020-11-10 22:15:01	                main:574]	:	INFO	:	Epoch 131 | loss: 0.000261443 | val_loss: 0.00025887 | Time: 4186.08 ms
[2020-11-10 22:15:05	                main:574]	:	INFO	:	Epoch 132 | loss: 0.000253618 | val_loss: 0.000252675 | Time: 4221.31 ms
[2020-11-10 22:15:10	                main:574]	:	INFO	:	Epoch 133 | loss: 0.000247133 | val_loss: 0.000246284 | Time: 4478.63 ms
[2020-11-10 22:15:14	                main:574]	:	INFO	:	Epoch 134 | loss: 0.000240898 | val_loss: 0.000237731 | Time: 4494.18 ms
[2020-11-10 22:15:19	                main:574]	:	INFO	:	Epoch 135 | loss: 0.000234314 | val_loss: 0.000232795 | Time: 4269.6 ms
[2020-11-10 22:15:23	                main:574]	:	INFO	:	Epoch 136 | loss: 0.000228956 | val_loss: 0.000227482 | Time: 4352.39 ms
[2020-11-10 22:15:27	                main:574]	:	INFO	:	Epoch 137 | loss: 0.000222931 | val_loss: 0.000220947 | Time: 4376.67 ms
[2020-11-10 22:15:32	                main:574]	:	INFO	:	Epoch 138 | loss: 0.00021692 | val_loss: 0.000217379 | Time: 4274.96 ms
[2020-11-10 22:15:36	                main:574]	:	INFO	:	Epoch 139 | loss: 0.000211626 | val_loss: 0.00020866 | Time: 4334.62 ms
[2020-11-10 22:15:40	                main:574]	:	INFO	:	Epoch 140 | loss: 0.000207154 | val_loss: 0.000203841 | Time: 4276.57 ms
[2020-11-10 22:15:45	                main:574]	:	INFO	:	Epoch 141 | loss: 0.000201759 | val_loss: 0.000199386 | Time: 4498.07 ms
[2020-11-10 22:15:49	                main:574]	:	INFO	:	Epoch 142 | loss: 0.000197092 | val_loss: 0.000196278 | Time: 4485.85 ms
[2020-11-10 22:15:53	                main:574]	:	INFO	:	Epoch 143 | loss: 0.000192391 | val_loss: 0.000191356 | Time: 4197.46 ms
[2020-11-10 22:15:58	                main:574]	:	INFO	:	Epoch 144 | loss: 0.000188383 | val_loss: 0.000186768 | Time: 4347.12 ms
[2020-11-10 22:16:02	                main:574]	:	INFO	:	Epoch 145 | loss: 0.000183519 | val_loss: 0.000182073 | Time: 4494.35 ms
[2020-11-10 22:16:07	                main:574]	:	INFO	:	Epoch 146 | loss: 0.000179467 | val_loss: 0.00017856 | Time: 4332.52 ms
[2020-11-10 22:16:11	                main:574]	:	INFO	:	Epoch 147 | loss: 0.000175708 | val_loss: 0.000175309 | Time: 4387.36 ms
[2020-11-10 22:16:15	                main:574]	:	INFO	:	Epoch 148 | loss: 0.000172813 | val_loss: 0.000170859 | Time: 4267.03 ms
[2020-11-10 22:16:19	                main:574]	:	INFO	:	Epoch 149 | loss: 0.000168318 | val_loss: 0.0001675 | Time: 4227.51 ms
[2020-11-10 22:16:24	                main:574]	:	INFO	:	Epoch 150 | loss: 0.000164604 | val_loss: 0.000165018 | Time: 4360.58 ms
[2020-11-10 22:16:28	                main:574]	:	INFO	:	Epoch 151 | loss: 0.000160883 | val_loss: 0.000160409 | Time: 4255.94 ms
[2020-11-10 22:16:32	                main:574]	:	INFO	:	Epoch 152 | loss: 0.000158272 | val_loss: 0.000158649 | Time: 4316.58 ms
[2020-11-10 22:16:37	                main:574]	:	INFO	:	Epoch 153 | loss: 0.000155206 | val_loss: 0.000154223 | Time: 4357.19 ms
[2020-11-10 22:16:41	                main:574]	:	INFO	:	Epoch 154 | loss: 0.000151996 | val_loss: 0.000152217 | Time: 4360.56 ms
[2020-11-10 22:16:46	                main:574]	:	INFO	:	Epoch 155 | loss: 0.000149047 | val_loss: 0.000149817 | Time: 4512.57 ms
[2020-11-10 22:16:50	                main:574]	:	INFO	:	Epoch 156 | loss: 0.000146437 | val_loss: 0.000146484 | Time: 4205.33 ms
[2020-11-10 22:16:54	                main:574]	:	INFO	:	Epoch 157 | loss: 0.000143703 | val_loss: 0.000144625 | Time: 4308.21 ms
[2020-11-10 22:16:58	                main:574]	:	INFO	:	Epoch 158 | loss: 0.00014119 | val_loss: 0.000140182 | Time: 4384.08 ms
[2020-11-10 22:17:03	                main:574]	:	INFO	:	Epoch 159 | loss: 0.000138374 | val_loss: 0.000137525 | Time: 4524.67 ms
[2020-11-10 22:17:07	                main:574]	:	INFO	:	Epoch 160 | loss: 0.000136364 | val_loss: 0.000135462 | Time: 4378.35 ms
[2020-11-10 22:17:12	                main:574]	:	INFO	:	Epoch 161 | loss: 0.000133707 | val_loss: 0.000132895 | Time: 4547.49 ms
[2020-11-10 22:17:16	                main:574]	:	INFO	:	Epoch 162 | loss: 0.000130998 | val_loss: 0.000131264 | Time: 4292.4 ms
[2020-11-10 22:17:20	                main:574]	:	INFO	:	Epoch 163 | loss: 0.000128616 | val_loss: 0.000128918 | Time: 4263.04 ms
[2020-11-10 22:17:25	                main:574]	:	INFO	:	Epoch 164 | loss: 0.000127032 | val_loss: 0.000126925 | Time: 4341.52 ms
[2020-11-10 22:17:29	                main:574]	:	INFO	:	Epoch 165 | loss: 0.000125055 | val_loss: 0.000125276 | Time: 4297.71 ms
[2020-11-10 22:17:34	                main:574]	:	INFO	:	Epoch 166 | loss: 0.000123812 | val_loss: 0.000121529 | Time: 4391.11 ms
[2020-11-10 22:17:38	                main:574]	:	INFO	:	Epoch 167 | loss: 0.000120375 | val_loss: 0.000120109 | Time: 4370.77 ms
[2020-11-10 22:17:42	                main:574]	:	INFO	:	Epoch 168 | loss: 0.000119036 | val_loss: 0.00011814 | Time: 4490.57 ms
[2020-11-10 22:17:47	                main:574]	:	INFO	:	Epoch 169 | loss: 0.000117042 | val_loss: 0.000117687 | Time: 4405.97 ms
[2020-11-10 22:17:51	                main:574]	:	INFO	:	Epoch 170 | loss: 0.000115102 | val_loss: 0.000114603 | Time: 4303.68 ms
[2020-11-10 22:17:55	                main:574]	:	INFO	:	Epoch 171 | loss: 0.000113359 | val_loss: 0.000113526 | Time: 4250.05 ms
[2020-11-10 22:18:00	                main:574]	:	INFO	:	Epoch 172 | loss: 0.000111613 | val_loss: 0.000113659 | Time: 4672.23 ms
[2020-11-10 22:18:04	                main:574]	:	INFO	:	Epoch 173 | loss: 0.000110255 | val_loss: 0.000112226 | Time: 4279.01 ms
[2020-11-10 22:18:09	                main:574]	:	INFO	:	Epoch 174 | loss: 0.000108494 | val_loss: 0.000107894 | Time: 4277.13 ms
[2020-11-10 22:18:13	                main:574]	:	INFO	:	Epoch 175 | loss: 0.000106585 | val_loss: 0.000107411 | Time: 4387.41 ms
[2020-11-10 22:18:17	                main:574]	:	INFO	:	Epoch 176 | loss: 0.000105237 | val_loss: 0.000106577 | Time: 4466.77 ms
[2020-11-10 22:18:22	                main:574]	:	INFO	:	Epoch 177 | loss: 0.000103556 | val_loss: 0.000105242 | Time: 4425.86 ms
[2020-11-10 22:18:26	                main:574]	:	INFO	:	Epoch 178 | loss: 0.000102371 | val_loss: 0.000102834 | Time: 4446.04 ms
[2020-11-10 22:18:31	                main:574]	:	INFO	:	Epoch 179 | loss: 0.000100981 | val_loss: 0.000102172 | Time: 4412.92 ms
[2020-11-10 22:18:35	                main:574]	:	INFO	:	Epoch 180 | loss: 9.95586e-05 | val_loss: 9.95894e-05 | Time: 4270.28 ms
[2020-11-10 22:18:39	                main:574]	:	INFO	:	Epoch 181 | loss: 9.84141e-05 | val_loss: 9.80175e-05 | Time: 4427.82 ms
[2020-11-10 22:18:44	                main:574]	:	INFO	:	Epoch 182 | loss: 9.67729e-05 | val_loss: 9.79883e-05 | Time: 4363.41 ms
[2020-11-10 22:18:48	                main:574]	:	INFO	:	Epoch 183 | loss: 9.59874e-05 | val_loss: 9.59925e-05 | Time: 4266.98 ms
[2020-11-10 22:18:53	                main:574]	:	INFO	:	Epoch 184 | loss: 9.43694e-05 | val_loss: 9.47491e-05 | Time: 4495.56 ms
[2020-11-10 22:18:57	                main:574]	:	INFO	:	Epoch 185 | loss: 9.29919e-05 | val_loss: 9.26941e-05 | Time: 4351.17 ms
[2020-11-10 22:19:01	                main:574]	:	INFO	:	Epoch 186 | loss: 9.20936e-05 | val_loss: 9.14461e-05 | Time: 4344.1 ms
[2020-11-10 22:19:05	                main:574]	:	INFO	:	Epoch 187 | loss: 9.09818e-05 | val_loss: 9.08903e-05 | Time: 4060.64 ms
[2020-11-10 22:19:09	                main:574]	:	INFO	:	Epoch 188 | loss: 8.97282e-05 | val_loss: 8.94997e-05 | Time: 4215.99 ms
[2020-11-10 22:19:14	                main:574]	:	INFO	:	Epoch 189 | loss: 8.85429e-05 | val_loss: 8.82204e-05 | Time: 4304.03 ms
[2020-11-10 22:19:18	                main:574]	:	INFO	:	Epoch 190 | loss: 8.78649e-05 | val_loss: 8.8749e-05 | Time: 4328.34 ms
[2020-11-10 22:19:22	                main:574]	:	INFO	:	Epoch 191 | loss: 8.64423e-05 | val_loss: 8.71881e-05 | Time: 4193.13 ms
[2020-11-10 22:19:27	                main:574]	:	INFO	:	Epoch 192 | loss: 8.57447e-05 | val_loss: 8.50374e-05 | Time: 4415.2 ms
[2020-11-10 22:19:27	                main:597]	:	INFO	:	Saving trained model to model-final.pt, val_loss 8.50374e-05
[2020-11-10 22:19:27	                main:603]	:	INFO	:	Saving end state to config to file
[2020-11-10 22:19:27	                main:608]	:	INFO	:	Success, exiting..
22:19:27 (14032): called boinc_finish(0)

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)