Task 2824984
| Name | rand_automata_0022-1604983202-28920-0_3 |
| Workunit | 1263709 |
| Created | 10 Nov 2020, 23:31:35 UTC |
| Sent | 10 Nov 2020, 23:34:32 UTC |
| Report deadline | 11 Nov 2020, 22:04:32 UTC |
| Received | 11 Nov 2020, 0:58:34 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 3985 |
| Run time | 14 min |
| CPU time | 13 min 54 sec |
| Validate state | Valid |
| Credit | 959.40 |
| Device peak FLOPS | 3,338.19 GFLOPS |
| Application version | Machine Learning Dataset Generator (test) v9.75 (cuda10200) x86_64-pc-linux-gnu |
| Peak working set size | 2.26 GB |
| Peak swap size | 9.65 GB |
| Peak disk usage | 0.59 MB |
Stderr output
<core_client_version>7.16.11</core_client_version> <![CDATA[ <stderr_txt> DEBUG: Args: ../../projects/www.mlcathome.org_mlcathome/mldstest_9.75_x86_64-pc-linux-gnu__cuda10200 -a LSTM -w 64 -b 2 -s 32 --lr 0.001 --maxepoch 192 --device 0 nthreads: 1 gpudev: 0 Re-exec()-ing to set number of threads correctly... Machine Learning Dataset Generator v9.75 (Linux/x86_64) (libTorch: release/1.6 GPU: GeForce GTX 1650) device already set [2020-11-10 19:44:18 main:435] : INFO : Set logging level to 1 [2020-11-10 19:44:18 main:441] : INFO : Running in BOINC Client mode [2020-11-10 19:44:18 main:444] : INFO : Resolving all filenames [2020-11-10 19:44:18 main:452] : INFO : Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0022-train-val-dataset.hdf5 (exists = 1) [2020-11-10 19:44:18 main:452] : INFO : Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0022-1604983202-28920-0_3_r584790180_1 (exists = 0) [2020-11-10 19:44:18 main:452] : INFO : Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0022-1604983202-28920-0_3_r584790180_0 (exists = 0) [2020-11-10 19:44:18 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 0) [2020-11-10 19:44:18 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 0) [2020-11-10 19:44:18 main:472] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/rand_automata_0022-train-val-dataset.hdf5 [2020-11-10 19:44:18 main:474] : INFO : Configuration: [2020-11-10 19:44:18 main:475] : INFO : Model type: LSTM [2020-11-10 19:44:18 main:476] : INFO : Validation Loss Threshold: 0.0001 [2020-11-10 19:44:18 main:477] : INFO : Max Epochs: 192 [2020-11-10 19:44:18 main:478] : INFO : Batch Size: 32 [2020-11-10 19:44:18 main:479] : INFO : Learning Rate: 0.001 [2020-11-10 19:44:18 main:480] : INFO : Patience: 10 [2020-11-10 19:44:18 main:481] : INFO : Hidden Width: 64 [2020-11-10 19:44:18 main:482] : INFO : # Recurrent Layers: 4 [2020-11-10 19:44:18 main:483] : INFO : # Backend Layers: 2 [2020-11-10 19:44:18 main:484] : INFO : # Threads: 1 [2020-11-10 19:44:18 main:486] : INFO : Preparing Dataset [2020-11-10 19:44:18 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0022-train-val-dataset.hdf5 into memory [2020-11-10 19:44:18 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0022-train-val-dataset.hdf5 into memory [2020-11-10 19:44:21 load:106] : INFO : Successfully loaded dataset of 4096 examples into memory. [2020-11-10 19:44:21 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0022-train-val-dataset.hdf5 into memory [2020-11-10 19:44:21 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0022-train-val-dataset.hdf5 into memory [2020-11-10 19:44:21 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2020-11-10 19:44:21 main:494] : INFO : Creating Model [2020-11-10 19:44:21 main:507] : INFO : Preparing config file [2020-11-10 19:44:21 main:519] : INFO : Creating new config file [2020-11-10 19:44:24 main:559] : INFO : Loading DataLoader into Memory [2020-11-10 19:44:24 main:562] : INFO : Starting Training [2020-11-10 19:44:29 main:574] : INFO : Epoch 1 | loss: 0.0665615 | val_loss: 0.0659972 | Time: 5198.31 ms [2020-11-10 19:44:33 main:574] : INFO : Epoch 2 | loss: 0.0656936 | val_loss: 0.0646964 | Time: 4219.52 ms [2020-11-10 19:44:37 main:574] : INFO : Epoch 3 | loss: 0.063017 | val_loss: 0.0606592 | Time: 4433.92 ms [2020-11-10 19:44:42 main:574] : INFO : Epoch 4 | loss: 0.0586986 | val_loss: 0.0568645 | Time: 4284.49 ms [2020-11-10 19:44:46 main:574] : INFO : Epoch 5 | loss: 0.0554616 | val_loss: 0.0541074 | Time: 4237.24 ms [2020-11-10 19:44:50 main:574] : INFO : Epoch 6 | loss: 0.0531757 | val_loss: 0.0520653 | Time: 4409.11 ms [2020-11-10 19:44:55 main:574] : INFO : Epoch 7 | loss: 0.0513189 | val_loss: 0.0503505 | Time: 4362.8 ms [2020-11-10 19:44:59 main:574] : INFO : Epoch 8 | loss: 0.0495938 | val_loss: 0.0486489 | Time: 4177.06 ms [2020-11-10 19:45:03 main:574] : INFO : Epoch 9 | loss: 0.0479833 | val_loss: 0.047123 | Time: 4228.8 ms [2020-11-10 19:45:07 main:574] : INFO : Epoch 10 | loss: 0.0461292 | val_loss: 0.0455599 | Time: 4296.13 ms [2020-11-10 19:45:12 main:574] : INFO : Epoch 11 | loss: 0.0440028 | val_loss: 0.0428162 | Time: 4227.54 ms [2020-11-10 19:45:16 main:574] : INFO : Epoch 12 | loss: 0.0415008 | val_loss: 0.040282 | Time: 4287.22 ms [2020-11-10 19:45:20 main:574] : INFO : Epoch 13 | loss: 0.0386169 | val_loss: 0.0372286 | Time: 4436.39 ms [2020-11-10 19:45:25 main:574] : INFO : Epoch 14 | loss: 0.035476 | val_loss: 0.0344911 | Time: 4341.77 ms [2020-11-10 19:45:29 main:574] : INFO : Epoch 15 | loss: 0.0320191 | val_loss: 0.0306861 | Time: 4247.27 ms [2020-11-10 19:45:33 main:574] : INFO : Epoch 16 | loss: 0.0285747 | val_loss: 0.0278789 | Time: 4235.64 ms [2020-11-10 19:45:37 main:574] : INFO : Epoch 17 | loss: 0.0254683 | val_loss: 0.0261884 | Time: 4245.13 ms [2020-11-10 19:45:42 main:574] : INFO : Epoch 18 | loss: 0.022433 | val_loss: 0.0232763 | Time: 4371.96 ms [2020-11-10 19:45:46 main:574] : INFO : Epoch 19 | loss: 0.0211803 | val_loss: 0.0206367 | Time: 4250.54 ms [2020-11-10 19:45:50 main:574] : INFO : Epoch 20 | loss: 0.0306442 | val_loss: 0.0352207 | Time: 4376.34 ms [2020-11-10 19:45:55 main:574] : INFO : Epoch 21 | loss: 0.0202405 | val_loss: 0.0178753 | Time: 4314.14 ms [2020-11-10 19:45:59 main:574] : INFO : Epoch 22 | loss: 0.032546 | val_loss: 0.0612841 | Time: 4271.93 ms [2020-11-10 19:46:03 main:574] : INFO : Epoch 23 | loss: 0.0598293 | val_loss: 0.0586311 | Time: 4302.9 ms [2020-11-10 19:46:08 main:574] : INFO : Epoch 24 | loss: 0.057143 | val_loss: 0.0554515 | Time: 4357.58 ms [2020-11-10 19:46:12 main:574] : INFO : Epoch 25 | loss: 0.0531124 | val_loss: 0.0504358 | Time: 4212.29 ms [2020-11-10 19:46:16 main:574] : INFO : Epoch 26 | loss: 0.0469085 | val_loss: 0.0425667 | Time: 4277.63 ms [2020-11-10 19:46:21 main:574] : INFO : Epoch 27 | loss: 0.0358136 | val_loss: 0.0285099 | Time: 4326.37 ms [2020-11-10 19:46:25 main:574] : INFO : Epoch 28 | loss: 0.0226235 | val_loss: 0.0196932 | Time: 4225.25 ms [2020-11-10 19:46:29 main:574] : INFO : Epoch 29 | loss: 0.017673 | val_loss: 0.0158738 | Time: 4393.53 ms [2020-11-10 19:46:33 main:574] : INFO : Epoch 30 | loss: 0.0147784 | val_loss: 0.0142257 | Time: 4296.27 ms [2020-11-10 19:46:38 main:574] : INFO : Epoch 31 | loss: 0.0134065 | val_loss: 0.0237882 | Time: 4473.4 ms [2020-11-10 19:46:42 main:574] : INFO : Epoch 32 | loss: 0.0129636 | val_loss: 0.0136213 | Time: 4229.2 ms [2020-11-10 19:46:46 main:574] : INFO : Epoch 33 | loss: 0.0352849 | val_loss: 0.0330949 | Time: 4366.64 ms [2020-11-10 19:46:51 main:574] : INFO : Epoch 34 | loss: 0.0177028 | val_loss: 0.013634 | Time: 4341.84 ms [2020-11-10 19:46:55 main:574] : INFO : Epoch 35 | loss: 0.0105055 | val_loss: 0.0100378 | Time: 4307.68 ms [2020-11-10 19:46:59 main:574] : INFO : Epoch 36 | loss: 0.00960737 | val_loss: 0.0114813 | Time: 4322.72 ms [2020-11-10 19:47:04 main:574] : INFO : Epoch 37 | loss: 0.015267 | val_loss: 0.0100433 | Time: 4247.57 ms [2020-11-10 19:47:08 main:574] : INFO : Epoch 38 | loss: 0.0088566 | val_loss: 0.00879287 | Time: 4356.08 ms [2020-11-10 19:47:13 main:574] : INFO : Epoch 39 | loss: 0.00808883 | val_loss: 0.00820162 | Time: 4558.06 ms [2020-11-10 19:47:17 main:574] : INFO : Epoch 40 | loss: 0.0075784 | val_loss: 0.00765155 | Time: 4270.37 ms [2020-11-10 19:47:21 main:574] : INFO : Epoch 41 | loss: 0.00728008 | val_loss: 0.0077849 | Time: 4300.51 ms [2020-11-10 19:47:26 main:574] : INFO : Epoch 42 | loss: 0.00703831 | val_loss: 0.00710866 | Time: 4426.92 ms [2020-11-10 19:47:30 main:574] : INFO : Epoch 43 | loss: 0.00671966 | val_loss: 0.00680399 | Time: 4522.07 ms [2020-11-10 19:47:34 main:574] : INFO : Epoch 44 | loss: 0.00647505 | val_loss: 0.00658203 | Time: 4253.09 ms [2020-11-10 19:47:39 main:574] : INFO : Epoch 45 | loss: 0.00626975 | val_loss: 0.00637017 | Time: 4297.19 ms [2020-11-10 19:47:43 main:574] : INFO : Epoch 46 | loss: 0.00606707 | val_loss: 0.00616557 | Time: 4257.61 ms [2020-11-10 19:47:47 main:574] : INFO : Epoch 47 | loss: 0.00587602 | val_loss: 0.0059418 | Time: 4464.37 ms [2020-11-10 19:47:52 main:574] : INFO : Epoch 48 | loss: 0.00568179 | val_loss: 0.00574677 | Time: 4228.39 ms [2020-11-10 19:47:56 main:574] : INFO : Epoch 49 | loss: 0.00549429 | val_loss: 0.00552455 | Time: 4272.21 ms [2020-11-10 19:48:00 main:574] : INFO : Epoch 50 | loss: 0.00532366 | val_loss: 0.00534773 | Time: 4189.16 ms [2020-11-10 19:48:04 main:574] : INFO : Epoch 51 | loss: 0.00514587 | val_loss: 0.00519941 | Time: 4300.07 ms [2020-11-10 19:48:09 main:574] : INFO : Epoch 52 | loss: 0.00496825 | val_loss: 0.0049848 | Time: 4422.65 ms [2020-11-10 19:48:13 main:574] : INFO : Epoch 53 | loss: 0.00480692 | val_loss: 0.00482298 | Time: 4444.13 ms [2020-11-10 19:48:18 main:574] : INFO : Epoch 54 | loss: 0.004639 | val_loss: 0.00464056 | Time: 4369.46 ms [2020-11-10 19:48:22 main:574] : INFO : Epoch 55 | loss: 0.00448275 | val_loss: 0.00447452 | Time: 4292.45 ms [2020-11-10 19:48:26 main:574] : INFO : Epoch 56 | loss: 0.00474101 | val_loss: 0.0044952 | Time: 4285.54 ms [2020-11-10 19:48:30 main:574] : INFO : Epoch 57 | loss: 0.00425083 | val_loss: 0.0041925 | Time: 4201.72 ms [2020-11-10 19:48:35 main:574] : INFO : Epoch 58 | loss: 0.00403794 | val_loss: 0.00402217 | Time: 4336.48 ms [2020-11-10 19:48:39 main:574] : INFO : Epoch 59 | loss: 0.00388273 | val_loss: 0.00386301 | Time: 4434.61 ms [2020-11-10 19:48:44 main:574] : INFO : Epoch 60 | loss: 0.00373874 | val_loss: 0.00371388 | Time: 4304.94 ms [2020-11-10 19:48:48 main:574] : INFO : Epoch 61 | loss: 0.00360295 | val_loss: 0.00359391 | Time: 4484.09 ms [2020-11-10 19:48:52 main:574] : INFO : Epoch 62 | loss: 0.0034576 | val_loss: 0.00343862 | Time: 4370.42 ms [2020-11-10 19:48:57 main:574] : INFO : Epoch 63 | loss: 0.00332052 | val_loss: 0.00330211 | Time: 4181.99 ms [2020-11-10 19:49:01 main:574] : INFO : Epoch 64 | loss: 0.00318991 | val_loss: 0.00316828 | Time: 4373.09 ms [2020-11-10 19:49:05 main:574] : INFO : Epoch 65 | loss: 0.00306169 | val_loss: 0.00303974 | Time: 4224.32 ms [2020-11-10 19:49:10 main:574] : INFO : Epoch 66 | loss: 0.00293801 | val_loss: 0.00291152 | Time: 4487.05 ms [2020-11-10 19:49:14 main:574] : INFO : Epoch 67 | loss: 0.00281507 | val_loss: 0.00278822 | Time: 4448.81 ms [2020-11-10 19:49:19 main:574] : INFO : Epoch 68 | loss: 0.00269705 | val_loss: 0.00267044 | Time: 4441.76 ms [2020-11-10 19:49:23 main:574] : INFO : Epoch 69 | loss: 0.00258199 | val_loss: 0.0025561 | Time: 4459.29 ms [2020-11-10 19:49:27 main:574] : INFO : Epoch 70 | loss: 0.00247023 | val_loss: 0.0024413 | Time: 4259.97 ms [2020-11-10 19:49:32 main:574] : INFO : Epoch 71 | loss: 0.00236235 | val_loss: 0.00233626 | Time: 4402.79 ms [2020-11-10 19:49:36 main:574] : INFO : Epoch 72 | loss: 0.00225714 | val_loss: 0.00222883 | Time: 4354.49 ms [2020-11-10 19:49:40 main:574] : INFO : Epoch 73 | loss: 0.00215603 | val_loss: 0.00212611 | Time: 4390.11 ms [2020-11-10 19:49:45 main:574] : INFO : Epoch 74 | loss: 0.00205842 | val_loss: 0.0020284 | Time: 4281.56 ms [2020-11-10 19:49:49 main:574] : INFO : Epoch 75 | loss: 0.00196284 | val_loss: 0.00193709 | Time: 4205.18 ms [2020-11-10 19:49:53 main:574] : INFO : Epoch 76 | loss: 0.00187209 | val_loss: 0.00184695 | Time: 4313.43 ms [2020-11-10 19:49:58 main:574] : INFO : Epoch 77 | loss: 0.00178357 | val_loss: 0.0017565 | Time: 4495.35 ms [2020-11-10 19:50:02 main:574] : INFO : Epoch 78 | loss: 0.00169772 | val_loss: 0.00167089 | Time: 4237.39 ms [2020-11-10 19:50:06 main:574] : INFO : Epoch 79 | loss: 0.00161561 | val_loss: 0.00158776 | Time: 4277.17 ms [2020-11-10 19:50:11 main:574] : INFO : Epoch 80 | loss: 0.00153712 | val_loss: 0.0015119 | Time: 4330.15 ms [2020-11-10 19:50:15 main:574] : INFO : Epoch 81 | loss: 0.00146072 | val_loss: 0.00143627 | Time: 4398.1 ms [2020-11-10 19:50:19 main:574] : INFO : Epoch 82 | loss: 0.00138786 | val_loss: 0.00136475 | Time: 4248.66 ms [2020-11-10 19:50:23 main:574] : INFO : Epoch 83 | loss: 0.00131727 | val_loss: 0.00129214 | Time: 4200.47 ms [2020-11-10 19:50:28 main:574] : INFO : Epoch 84 | loss: 0.00125058 | val_loss: 0.00122778 | Time: 4284.66 ms [2020-11-10 19:50:32 main:574] : INFO : Epoch 85 | loss: 0.00118563 | val_loss: 0.00116502 | Time: 3918.57 ms [2020-11-10 19:50:36 main:574] : INFO : Epoch 86 | loss: 0.00112603 | val_loss: 0.00110578 | Time: 4248.22 ms [2020-11-10 19:50:40 main:574] : INFO : Epoch 87 | loss: 0.00106673 | val_loss: 0.00104737 | Time: 4292.46 ms [2020-11-10 19:50:45 main:574] : INFO : Epoch 88 | loss: 0.00101217 | val_loss: 0.00099269 | Time: 4405.42 ms [2020-11-10 19:50:49 main:574] : INFO : Epoch 89 | loss: 0.000958713 | val_loss: 0.000940907 | Time: 4352.79 ms [2020-11-10 19:50:53 main:574] : INFO : Epoch 90 | loss: 0.000908891 | val_loss: 0.000888841 | Time: 4230.11 ms [2020-11-10 19:50:57 main:574] : INFO : Epoch 91 | loss: 0.000860259 | val_loss: 0.000841488 | Time: 4275.52 ms [2020-11-10 19:51:02 main:574] : INFO : Epoch 92 | loss: 0.000815586 | val_loss: 0.000797268 | Time: 4148.36 ms [2020-11-10 19:51:06 main:574] : INFO : Epoch 93 | loss: 0.000772323 | val_loss: 0.000756642 | Time: 4355.55 ms [2020-11-10 19:51:10 main:574] : INFO : Epoch 94 | loss: 0.000731986 | val_loss: 0.000716917 | Time: 4406 ms [2020-11-10 19:51:15 main:574] : INFO : Epoch 95 | loss: 0.000692781 | val_loss: 0.000677338 | Time: 4349.4 ms [2020-11-10 19:51:19 main:574] : INFO : Epoch 96 | loss: 0.000656384 | val_loss: 0.000642571 | Time: 4490.06 ms [2020-11-10 19:51:24 main:574] : INFO : Epoch 97 | loss: 0.000621519 | val_loss: 0.000607824 | Time: 4382.25 ms [2020-11-10 19:51:28 main:574] : INFO : Epoch 98 | loss: 0.00058873 | val_loss: 0.000576661 | Time: 4135.75 ms [2020-11-10 19:51:32 main:574] : INFO : Epoch 99 | loss: 0.000556665 | val_loss: 0.00054423 | Time: 4237.36 ms [2020-11-10 19:51:36 main:574] : INFO : Epoch 100 | loss: 0.000527947 | val_loss: 0.000515326 | Time: 4304.17 ms [2020-11-10 19:51:40 main:574] : INFO : Epoch 101 | loss: 0.000500124 | val_loss: 0.000489834 | Time: 4235.81 ms [2020-11-10 19:51:45 main:574] : INFO : Epoch 102 | loss: 0.000474285 | val_loss: 0.0004652 | Time: 4245.87 ms [2020-11-10 19:51:49 main:574] : INFO : Epoch 103 | loss: 0.000448855 | val_loss: 0.000438667 | Time: 4268.27 ms [2020-11-10 19:51:53 main:574] : INFO : Epoch 104 | loss: 0.000425743 | val_loss: 0.000417782 | Time: 4307.53 ms [2020-11-10 19:51:58 main:574] : INFO : Epoch 105 | loss: 0.000404335 | val_loss: 0.000396577 | Time: 4229.84 ms [2020-11-10 19:52:02 main:574] : INFO : Epoch 106 | loss: 0.00038363 | val_loss: 0.000375207 | Time: 4240.4 ms [2020-11-10 19:52:06 main:574] : INFO : Epoch 107 | loss: 0.000364094 | val_loss: 0.00035594 | Time: 4245.49 ms [2020-11-10 19:52:10 main:574] : INFO : Epoch 108 | loss: 0.00034606 | val_loss: 0.000337317 | Time: 4414.34 ms [2020-11-10 19:52:15 main:574] : INFO : Epoch 109 | loss: 0.000328968 | val_loss: 0.000322982 | Time: 4296.19 ms [2020-11-10 19:52:19 main:574] : INFO : Epoch 110 | loss: 0.000312678 | val_loss: 0.00030803 | Time: 4360.86 ms [2020-11-10 19:52:23 main:574] : INFO : Epoch 111 | loss: 0.00029706 | val_loss: 0.000292246 | Time: 4336.4 ms [2020-11-10 19:52:28 main:574] : INFO : Epoch 112 | loss: 0.000283339 | val_loss: 0.000278666 | Time: 4252.42 ms [2020-11-10 19:52:32 main:574] : INFO : Epoch 113 | loss: 0.000268968 | val_loss: 0.000263033 | Time: 4141.95 ms [2020-11-10 19:52:36 main:574] : INFO : Epoch 114 | loss: 0.000256062 | val_loss: 0.000249111 | Time: 4376.33 ms [2020-11-10 19:52:41 main:574] : INFO : Epoch 115 | loss: 0.000244219 | val_loss: 0.000241345 | Time: 4464.63 ms [2020-11-10 19:52:45 main:574] : INFO : Epoch 116 | loss: 0.000232893 | val_loss: 0.000229967 | Time: 4346.13 ms [2020-11-10 19:52:49 main:574] : INFO : Epoch 117 | loss: 0.000221441 | val_loss: 0.000217308 | Time: 4302.19 ms [2020-11-10 19:52:54 main:574] : INFO : Epoch 118 | loss: 0.000211004 | val_loss: 0.000206698 | Time: 4387.93 ms [2020-11-10 19:52:58 main:574] : INFO : Epoch 119 | loss: 0.000201418 | val_loss: 0.000196637 | Time: 4334.45 ms [2020-11-10 19:53:02 main:574] : INFO : Epoch 120 | loss: 0.000191881 | val_loss: 0.000188222 | Time: 4383 ms [2020-11-10 19:53:07 main:574] : INFO : Epoch 121 | loss: 0.000183811 | val_loss: 0.000181102 | Time: 4293.07 ms [2020-11-10 19:53:11 main:574] : INFO : Epoch 122 | loss: 0.000175262 | val_loss: 0.000172906 | Time: 4383.5 ms [2020-11-10 19:53:15 main:574] : INFO : Epoch 123 | loss: 0.000167641 | val_loss: 0.000164599 | Time: 4364.88 ms [2020-11-10 19:53:20 main:574] : INFO : Epoch 124 | loss: 0.000160316 | val_loss: 0.000160669 | Time: 4317.7 ms [2020-11-10 19:53:24 main:574] : INFO : Epoch 125 | loss: 0.000153608 | val_loss: 0.000150505 | Time: 4533.3 ms [2020-11-10 19:53:28 main:574] : INFO : Epoch 126 | loss: 0.000147163 | val_loss: 0.000144899 | Time: 4205.88 ms [2020-11-10 19:53:33 main:574] : INFO : Epoch 127 | loss: 0.000140487 | val_loss: 0.000137595 | Time: 4282.15 ms [2020-11-10 19:53:37 main:574] : INFO : Epoch 128 | loss: 0.000134747 | val_loss: 0.000131523 | Time: 4246.84 ms [2020-11-10 19:53:41 main:574] : INFO : Epoch 129 | loss: 0.000128503 | val_loss: 0.000126182 | Time: 4327.06 ms [2020-11-10 19:53:46 main:574] : INFO : Epoch 130 | loss: 0.000123627 | val_loss: 0.000122578 | Time: 4248.45 ms [2020-11-10 19:53:50 main:574] : INFO : Epoch 131 | loss: 0.000118886 | val_loss: 0.000117908 | Time: 4313.4 ms [2020-11-10 19:53:54 main:574] : INFO : Epoch 132 | loss: 0.000113887 | val_loss: 0.000112404 | Time: 4257.58 ms [2020-11-10 19:53:58 main:574] : INFO : Epoch 133 | loss: 0.000109799 | val_loss: 0.000107636 | Time: 4177.88 ms [2020-11-10 19:54:03 main:574] : INFO : Epoch 134 | loss: 0.000105818 | val_loss: 0.000104545 | Time: 4607.31 ms [2020-11-10 19:54:08 main:574] : INFO : Epoch 135 | loss: 0.000101487 | val_loss: 0.000100483 | Time: 4571.6 ms [2020-11-10 19:54:12 main:574] : INFO : Epoch 136 | loss: 9.78557e-05 | val_loss: 9.75564e-05 | Time: 4340.29 ms [2020-11-10 19:54:16 main:574] : INFO : Epoch 137 | loss: 9.43652e-05 | val_loss: 9.37496e-05 | Time: 4425.48 ms [2020-11-10 19:54:21 main:574] : INFO : Epoch 138 | loss: 9.15909e-05 | val_loss: 8.97843e-05 | Time: 4476.98 ms [2020-11-10 19:54:25 main:574] : INFO : Epoch 139 | loss: 8.74476e-05 | val_loss: 8.60473e-05 | Time: 4522.87 ms [2020-11-10 19:54:30 main:574] : INFO : Epoch 140 | loss: 8.48265e-05 | val_loss: 8.45417e-05 | Time: 4395.9 ms [2020-11-10 19:54:34 main:574] : INFO : Epoch 141 | loss: 8.22713e-05 | val_loss: 8.06892e-05 | Time: 4412.48 ms [2020-11-10 19:54:38 main:574] : INFO : Epoch 142 | loss: 7.91971e-05 | val_loss: 7.92596e-05 | Time: 4336.1 ms [2020-11-10 19:54:43 main:574] : INFO : Epoch 143 | loss: 7.6833e-05 | val_loss: 7.62438e-05 | Time: 4289.72 ms [2020-11-10 19:54:47 main:574] : INFO : Epoch 144 | loss: 7.42769e-05 | val_loss: 7.50358e-05 | Time: 4415.92 ms [2020-11-10 19:54:51 main:574] : INFO : Epoch 145 | loss: 7.2263e-05 | val_loss: 7.15904e-05 | Time: 4271.19 ms [2020-11-10 19:54:56 main:574] : INFO : Epoch 146 | loss: 6.91711e-05 | val_loss: 6.96367e-05 | Time: 4147.6 ms [2020-11-10 19:55:00 main:574] : INFO : Epoch 147 | loss: 6.77009e-05 | val_loss: 6.73876e-05 | Time: 4370.05 ms [2020-11-10 19:55:04 main:574] : INFO : Epoch 148 | loss: 6.55805e-05 | val_loss: 6.54353e-05 | Time: 4342.02 ms [2020-11-10 19:55:09 main:574] : INFO : Epoch 149 | loss: 6.34641e-05 | val_loss: 6.34987e-05 | Time: 4414.68 ms [2020-11-10 19:55:13 main:574] : INFO : Epoch 150 | loss: 6.16228e-05 | val_loss: 6.24948e-05 | Time: 4333.39 ms [2020-11-10 19:55:17 main:574] : INFO : Epoch 151 | loss: 6.00965e-05 | val_loss: 5.99524e-05 | Time: 4197.76 ms [2020-11-10 19:55:22 main:574] : INFO : Epoch 152 | loss: 5.84542e-05 | val_loss: 5.83414e-05 | Time: 4407.98 ms [2020-11-10 19:55:26 main:574] : INFO : Epoch 153 | loss: 5.67769e-05 | val_loss: 5.69621e-05 | Time: 4252.78 ms [2020-11-10 19:55:30 main:574] : INFO : Epoch 154 | loss: 5.60454e-05 | val_loss: 5.47278e-05 | Time: 4451.88 ms [2020-11-10 19:55:35 main:574] : INFO : Epoch 155 | loss: 5.36819e-05 | val_loss: 5.40752e-05 | Time: 4406.49 ms [2020-11-10 19:55:39 main:574] : INFO : Epoch 156 | loss: 5.25505e-05 | val_loss: 5.33697e-05 | Time: 4314.22 ms [2020-11-10 19:55:43 main:574] : INFO : Epoch 157 | loss: 5.14437e-05 | val_loss: 5.25382e-05 | Time: 4287.07 ms [2020-11-10 19:55:48 main:574] : INFO : Epoch 158 | loss: 5.08565e-05 | val_loss: 5.05691e-05 | Time: 4318.37 ms [2020-11-10 19:55:52 main:574] : INFO : Epoch 159 | loss: 4.87407e-05 | val_loss: 4.87019e-05 | Time: 4431.27 ms [2020-11-10 19:55:56 main:574] : INFO : Epoch 160 | loss: 4.7759e-05 | val_loss: 4.85734e-05 | Time: 4283.63 ms [2020-11-10 19:56:01 main:574] : INFO : Epoch 161 | loss: 4.69199e-05 | val_loss: 5.16841e-05 | Time: 4402.25 ms [2020-11-10 19:56:05 main:574] : INFO : Epoch 162 | loss: 4.61369e-05 | val_loss: 4.53248e-05 | Time: 4490 ms [2020-11-10 19:56:10 main:574] : INFO : Epoch 163 | loss: 4.48192e-05 | val_loss: 4.51929e-05 | Time: 4490.96 ms [2020-11-10 19:56:14 main:574] : INFO : Epoch 164 | loss: 4.35951e-05 | val_loss: 4.46639e-05 | Time: 4253.25 ms [2020-11-10 19:56:18 main:574] : INFO : Epoch 165 | loss: 4.28907e-05 | val_loss: 4.27836e-05 | Time: 4310.65 ms [2020-11-10 19:56:23 main:574] : INFO : Epoch 166 | loss: 4.15652e-05 | val_loss: 4.23548e-05 | Time: 4270.19 ms [2020-11-10 19:56:27 main:574] : INFO : Epoch 167 | loss: 4.1112e-05 | val_loss: 4.16616e-05 | Time: 4421.71 ms [2020-11-10 19:56:31 main:574] : INFO : Epoch 168 | loss: 4.04332e-05 | val_loss: 4.02472e-05 | Time: 4282.91 ms [2020-11-10 19:56:36 main:574] : INFO : Epoch 169 | loss: 3.94083e-05 | val_loss: 3.9506e-05 | Time: 4359.69 ms [2020-11-10 19:56:40 main:574] : INFO : Epoch 170 | loss: 3.87528e-05 | val_loss: 3.9104e-05 | Time: 4283.31 ms [2020-11-10 19:56:44 main:574] : INFO : Epoch 171 | loss: 3.79066e-05 | val_loss: 3.82711e-05 | Time: 4398.33 ms [2020-11-10 19:56:49 main:574] : INFO : Epoch 172 | loss: 3.75648e-05 | val_loss: 3.81812e-05 | Time: 4257.45 ms [2020-11-10 19:56:53 main:574] : INFO : Epoch 173 | loss: 3.68843e-05 | val_loss: 3.69625e-05 | Time: 4235.81 ms [2020-11-10 19:56:57 main:574] : INFO : Epoch 174 | loss: 3.54714e-05 | val_loss: 3.57721e-05 | Time: 4332.55 ms [2020-11-10 19:57:02 main:574] : INFO : Epoch 175 | loss: 3.54393e-05 | val_loss: 3.68556e-05 | Time: 4335.94 ms [2020-11-10 19:57:06 main:574] : INFO : Epoch 176 | loss: 3.45008e-05 | val_loss: 3.55749e-05 | Time: 4308.29 ms [2020-11-10 19:57:10 main:574] : INFO : Epoch 177 | loss: 3.41615e-05 | val_loss: 3.54679e-05 | Time: 4450.6 ms [2020-11-10 19:57:15 main:574] : INFO : Epoch 178 | loss: 3.36829e-05 | val_loss: 3.29175e-05 | Time: 4322.22 ms [2020-11-10 19:57:19 main:574] : INFO : Epoch 179 | loss: 3.29001e-05 | val_loss: 3.31435e-05 | Time: 4292.78 ms [2020-11-10 19:57:23 main:574] : INFO : Epoch 180 | loss: 3.24136e-05 | val_loss: 3.25883e-05 | Time: 4261.17 ms [2020-11-10 19:57:27 main:574] : INFO : Epoch 181 | loss: 3.20709e-05 | val_loss: 3.20032e-05 | Time: 4270.64 ms [2020-11-10 19:57:32 main:574] : INFO : Epoch 182 | loss: 3.11023e-05 | val_loss: 3.16278e-05 | Time: 4426.26 ms [2020-11-10 19:57:36 main:574] : INFO : Epoch 183 | loss: 3.057e-05 | val_loss: 3.2129e-05 | Time: 4367.17 ms [2020-11-10 19:57:40 main:574] : INFO : Epoch 184 | loss: 3.07262e-05 | val_loss: 2.99009e-05 | Time: 4118.8 ms [2020-11-10 19:57:45 main:574] : INFO : Epoch 185 | loss: 3.00389e-05 | val_loss: 2.97976e-05 | Time: 4317.69 ms [2020-11-10 19:57:49 main:574] : INFO : Epoch 186 | loss: 2.94737e-05 | val_loss: 3.21221e-05 | Time: 4298.95 ms [2020-11-10 19:57:53 main:574] : INFO : Epoch 187 | loss: 2.93571e-05 | val_loss: 3.0485e-05 | Time: 4368.97 ms [2020-11-10 19:57:58 main:574] : INFO : Epoch 188 | loss: 2.89975e-05 | val_loss: 2.85807e-05 | Time: 4342.41 ms [2020-11-10 19:58:02 main:574] : INFO : Epoch 189 | loss: 2.84662e-05 | val_loss: 2.83956e-05 | Time: 4398.73 ms [2020-11-10 19:58:06 main:574] : INFO : Epoch 190 | loss: 2.76169e-05 | val_loss: 2.74135e-05 | Time: 4398.4 ms [2020-11-10 19:58:11 main:574] : INFO : Epoch 191 | loss: 2.75797e-05 | val_loss: 2.77161e-05 | Time: 4465.53 ms [2020-11-10 19:58:15 main:574] : INFO : Epoch 192 | loss: 2.79189e-05 | val_loss: 2.7124e-05 | Time: 4269.48 ms [2020-11-10 19:58:15 main:597] : INFO : Saving trained model to model-final.pt, val_loss 2.7124e-05 [2020-11-10 19:58:15 main:603] : INFO : Saving end state to config to file [2020-11-10 19:58:15 main:608] : INFO : Success, exiting.. 19:58:15 (13377): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)