Task 3051081
| Name | rand_automata_0042-1606118278-31839-0_2 |
| Workunit | 1376585 |
| Created | 24 Nov 2020, 14:35:58 UTC |
| Sent | 24 Nov 2020, 14:49:48 UTC |
| Report deadline | 25 Nov 2020, 13:19:48 UTC |
| Received | 24 Nov 2020, 21:32:36 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 4379 |
| Run time | 15 min 39 sec |
| CPU time | 15 min 35 sec |
| Validate state | Valid |
| Credit | 959.40 |
| Device peak FLOPS | 4,493.80 GFLOPS |
| Application version | Machine Learning Dataset Generator (test) v9.80 (cuda10200) x86_64-pc-linux-gnu |
| Peak working set size | 2.19 GB |
| Peak swap size | 10.01 GB |
| Peak disk usage | 2.98 GB |
Stderr output
<core_client_version>7.16.11</core_client_version> <![CDATA[ <stderr_txt> DEBUG: Args: ../../projects/www.mlcathome.org_mlcathome/mlds-gpu_9.80_x86_64-pc-linux-gnu__cuda10200 -a LSTM -w 64 -b 2 -s 32 --lr 0.001 --maxepoch 192 nthreads: 1 gpudev: 0 Re-exec()-ing to set environment correctly Machine Learning Dataset Generator v9.80 (Linux/x86_64) (libTorch: release/1.7 GPU: GeForce GTX 1650 SUPER) [2020-11-24 16:16:45 main:442] : INFO : Set logging level to 1 [2020-11-24 16:16:45 main:448] : INFO : Running in BOINC Client mode [2020-11-24 16:16:45 main:451] : INFO : Resolving all filenames [2020-11-24 16:16:45 main:459] : INFO : Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0042-train-val-dataset.hdf5 (exists = 1) [2020-11-24 16:16:45 main:459] : INFO : Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0042-1606118278-31839-0_2_r895293523_1 (exists = 0) [2020-11-24 16:16:45 main:459] : INFO : Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0042-1606118278-31839-0_2_r895293523_0 (exists = 0) [2020-11-24 16:16:45 main:459] : INFO : Resolved: model-input.pt => model-input.pt (exists = 0) [2020-11-24 16:16:45 main:459] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 0) [2020-11-24 16:16:45 main:479] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/rand_automata_0042-train-val-dataset.hdf5 [2020-11-24 16:16:45 main:481] : INFO : Configuration: [2020-11-24 16:16:45 main:482] : INFO : Model type: LSTM [2020-11-24 16:16:45 main:483] : INFO : Validation Loss Threshold: 0.0001 [2020-11-24 16:16:45 main:484] : INFO : Max Epochs: 192 [2020-11-24 16:16:45 main:485] : INFO : Batch Size: 32 [2020-11-24 16:16:45 main:486] : INFO : Learning Rate: 0.001 [2020-11-24 16:16:45 main:487] : INFO : Patience: 10 [2020-11-24 16:16:45 main:488] : INFO : Hidden Width: 64 [2020-11-24 16:16:45 main:489] : INFO : # Recurrent Layers: 4 [2020-11-24 16:16:45 main:490] : INFO : # Backend Layers: 2 [2020-11-24 16:16:45 main:491] : INFO : # Threads: 1 [2020-11-24 16:16:45 main:493] : INFO : Preparing Dataset [2020-11-24 16:16:45 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0042-train-val-dataset.hdf5 into memory [2020-11-24 16:16:46 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0042-train-val-dataset.hdf5 into memory [2020-11-24 16:16:47 load:106] : INFO : Successfully loaded dataset of 4096 examples into memory. [2020-11-24 16:16:47 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0042-train-val-dataset.hdf5 into memory [2020-11-24 16:16:47 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0042-train-val-dataset.hdf5 into memory [2020-11-24 16:16:47 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2020-11-24 16:16:47 main:501] : INFO : Creating Model [2020-11-24 16:16:47 main:514] : INFO : Preparing config file [2020-11-24 16:16:47 main:526] : INFO : Creating new config file [2020-11-24 16:16:47 main:566] : INFO : Loading DataLoader into Memory [2020-11-24 16:16:47 main:569] : INFO : Starting Training [2020-11-24 16:16:53 main:581] : INFO : Epoch 1 | loss: 0.066047 | val_loss: 0.0656287 | Time: 5379.15 ms [2020-11-24 16:16:57 main:581] : INFO : Epoch 2 | loss: 0.0651751 | val_loss: 0.0642191 | Time: 4747.02 ms [2020-11-24 16:17:02 main:581] : INFO : Epoch 3 | loss: 0.0632199 | val_loss: 0.0618962 | Time: 4753.01 ms [2020-11-24 16:17:07 main:581] : INFO : Epoch 4 | loss: 0.0604338 | val_loss: 0.0590662 | Time: 4711.7 ms [2020-11-24 16:17:12 main:581] : INFO : Epoch 5 | loss: 0.0579691 | val_loss: 0.0569356 | Time: 4755.77 ms [2020-11-24 16:17:16 main:581] : INFO : Epoch 6 | loss: 0.0562903 | val_loss: 0.0557053 | Time: 4726.68 ms [2020-11-24 16:17:21 main:581] : INFO : Epoch 7 | loss: 0.055015 | val_loss: 0.0544525 | Time: 4743.14 ms [2020-11-24 16:17:26 main:581] : INFO : Epoch 8 | loss: 0.0538438 | val_loss: 0.0531635 | Time: 4769.98 ms [2020-11-24 16:17:31 main:581] : INFO : Epoch 9 | loss: 0.0526791 | val_loss: 0.052309 | Time: 4795.79 ms [2020-11-24 16:17:35 main:581] : INFO : Epoch 10 | loss: 0.0514968 | val_loss: 0.050993 | Time: 4798.49 ms [2020-11-24 16:17:40 main:581] : INFO : Epoch 11 | loss: 0.0501797 | val_loss: 0.04948 | Time: 4774.42 ms [2020-11-24 16:17:45 main:581] : INFO : Epoch 12 | loss: 0.0486641 | val_loss: 0.0480276 | Time: 4762.9 ms [2020-11-24 16:17:50 main:581] : INFO : Epoch 13 | loss: 0.046892 | val_loss: 0.0461547 | Time: 4796.83 ms [2020-11-24 16:17:55 main:581] : INFO : Epoch 14 | loss: 0.0447702 | val_loss: 0.043824 | Time: 4923.57 ms [2020-11-24 16:18:00 main:581] : INFO : Epoch 15 | loss: 0.0421425 | val_loss: 0.041192 | Time: 5317.47 ms [2020-11-24 16:18:05 main:581] : INFO : Epoch 16 | loss: 0.0390275 | val_loss: 0.0381285 | Time: 5185.01 ms [2020-11-24 16:18:10 main:581] : INFO : Epoch 17 | loss: 0.0365525 | val_loss: 0.0358269 | Time: 4798.29 ms [2020-11-24 16:18:15 main:581] : INFO : Epoch 18 | loss: 0.0369714 | val_loss: 0.0339971 | Time: 5239.96 ms [2020-11-24 16:18:20 main:581] : INFO : Epoch 19 | loss: 0.0299005 | val_loss: 0.0300244 | Time: 4772.78 ms [2020-11-24 16:18:25 main:581] : INFO : Epoch 20 | loss: 0.0394539 | val_loss: 0.0519546 | Time: 4800.04 ms [2020-11-24 16:18:30 main:581] : INFO : Epoch 21 | loss: 0.035031 | val_loss: 0.0267195 | Time: 4831.41 ms [2020-11-24 16:18:34 main:581] : INFO : Epoch 22 | loss: 0.0241421 | val_loss: 0.0246799 | Time: 4804.67 ms [2020-11-24 16:18:39 main:581] : INFO : Epoch 23 | loss: 0.0244872 | val_loss: 0.0297168 | Time: 4782.17 ms [2020-11-24 16:18:44 main:581] : INFO : Epoch 24 | loss: 0.0224763 | val_loss: 0.0211771 | Time: 4791.73 ms [2020-11-24 16:18:49 main:581] : INFO : Epoch 25 | loss: 0.0258503 | val_loss: 0.0257762 | Time: 4787.94 ms [2020-11-24 16:18:54 main:581] : INFO : Epoch 26 | loss: 0.0255594 | val_loss: 0.0590942 | Time: 4749.58 ms [2020-11-24 16:18:58 main:581] : INFO : Epoch 27 | loss: 0.0529015 | val_loss: 0.0445094 | Time: 4702.87 ms [2020-11-24 16:19:03 main:581] : INFO : Epoch 28 | loss: 0.0308851 | val_loss: 0.027044 | Time: 4770.71 ms [2020-11-24 16:19:08 main:581] : INFO : Epoch 29 | loss: 0.0279654 | val_loss: 0.0498873 | Time: 4769.81 ms [2020-11-24 16:19:13 main:581] : INFO : Epoch 30 | loss: 0.0309805 | val_loss: 0.0239435 | Time: 4759.17 ms [2020-11-24 16:19:17 main:581] : INFO : Epoch 31 | loss: 0.0193211 | val_loss: 0.0171305 | Time: 4765.02 ms [2020-11-24 16:19:22 main:581] : INFO : Epoch 32 | loss: 0.0214962 | val_loss: 0.0199069 | Time: 4775.31 ms [2020-11-24 16:19:27 main:581] : INFO : Epoch 33 | loss: 0.0187744 | val_loss: 0.0204056 | Time: 4816.4 ms [2020-11-24 16:19:32 main:581] : INFO : Epoch 34 | loss: 0.0158457 | val_loss: 0.0157557 | Time: 4791.18 ms [2020-11-24 16:19:37 main:581] : INFO : Epoch 35 | loss: 0.013318 | val_loss: 0.01275 | Time: 4747.95 ms [2020-11-24 16:19:41 main:581] : INFO : Epoch 36 | loss: 0.0204757 | val_loss: 0.0176311 | Time: 4768.57 ms [2020-11-24 16:19:46 main:581] : INFO : Epoch 37 | loss: 0.0242875 | val_loss: 0.0171908 | Time: 4748.98 ms [2020-11-24 16:19:51 main:581] : INFO : Epoch 38 | loss: 0.0143014 | val_loss: 0.0136579 | Time: 4754.19 ms [2020-11-24 16:19:56 main:581] : INFO : Epoch 39 | loss: 0.0346499 | val_loss: 0.0547934 | Time: 4784.3 ms [2020-11-24 16:20:00 main:581] : INFO : Epoch 40 | loss: 0.048451 | val_loss: 0.0376434 | Time: 4787.62 ms [2020-11-24 16:20:05 main:581] : INFO : Epoch 41 | loss: 0.0238176 | val_loss: 0.0161479 | Time: 4757.92 ms [2020-11-24 16:20:10 main:581] : INFO : Epoch 42 | loss: 0.0289143 | val_loss: 0.0476426 | Time: 4751.85 ms [2020-11-24 16:20:15 main:581] : INFO : Epoch 43 | loss: 0.0275866 | val_loss: 0.0158128 | Time: 4785.14 ms [2020-11-24 16:20:19 main:581] : INFO : Epoch 44 | loss: 0.0185593 | val_loss: 0.0164866 | Time: 4779.65 ms [2020-11-24 16:20:24 main:581] : INFO : Epoch 45 | loss: 0.0203473 | val_loss: 0.0255619 | Time: 4800.62 ms [2020-11-24 16:20:29 main:581] : INFO : Epoch 46 | loss: 0.0191944 | val_loss: 0.0131163 | Time: 4797.09 ms [2020-11-24 16:20:34 main:581] : INFO : Epoch 47 | loss: 0.011707 | val_loss: 0.0113447 | Time: 4793.72 ms [2020-11-24 16:20:39 main:581] : INFO : Epoch 48 | loss: 0.0106305 | val_loss: 0.010446 | Time: 4765.17 ms [2020-11-24 16:20:43 main:581] : INFO : Epoch 49 | loss: 0.0126771 | val_loss: 0.0153425 | Time: 4768.43 ms [2020-11-24 16:20:48 main:581] : INFO : Epoch 50 | loss: 0.0123209 | val_loss: 0.0189756 | Time: 4771.73 ms [2020-11-24 16:20:53 main:581] : INFO : Epoch 51 | loss: 0.0409737 | val_loss: 0.0247765 | Time: 4798.23 ms [2020-11-24 16:20:58 main:581] : INFO : Epoch 52 | loss: 0.0191704 | val_loss: 0.0150079 | Time: 4790.85 ms [2020-11-24 16:21:03 main:581] : INFO : Epoch 53 | loss: 0.0136211 | val_loss: 0.014688 | Time: 4810.73 ms [2020-11-24 16:21:07 main:581] : INFO : Epoch 54 | loss: 0.0115406 | val_loss: 0.010721 | Time: 4912.09 ms [2020-11-24 16:21:12 main:581] : INFO : Epoch 55 | loss: 0.0100685 | val_loss: 0.0106994 | Time: 4943.58 ms [2020-11-24 16:21:17 main:581] : INFO : Epoch 56 | loss: 0.0107046 | val_loss: 0.0157225 | Time: 4741.05 ms [2020-11-24 16:21:22 main:581] : INFO : Epoch 57 | loss: 0.010238 | val_loss: 0.00948056 | Time: 4785.89 ms [2020-11-24 16:21:27 main:581] : INFO : Epoch 58 | loss: 0.00889089 | val_loss: 0.00886067 | Time: 4760.48 ms [2020-11-24 16:21:32 main:581] : INFO : Epoch 59 | loss: 0.00840077 | val_loss: 0.00845963 | Time: 4938.72 ms [2020-11-24 16:21:37 main:581] : INFO : Epoch 60 | loss: 0.00835275 | val_loss: 0.00885525 | Time: 5287.91 ms [2020-11-24 16:21:42 main:581] : INFO : Epoch 61 | loss: 0.00809285 | val_loss: 0.00815074 | Time: 5302.26 ms [2020-11-24 16:21:47 main:581] : INFO : Epoch 62 | loss: 0.0076542 | val_loss: 0.00777817 | Time: 5299.54 ms [2020-11-24 16:21:53 main:581] : INFO : Epoch 63 | loss: 0.00747469 | val_loss: 0.00764694 | Time: 5314.4 ms [2020-11-24 16:21:58 main:581] : INFO : Epoch 64 | loss: 0.00726983 | val_loss: 0.00739254 | Time: 5408.36 ms [2020-11-24 16:22:04 main:581] : INFO : Epoch 65 | loss: 0.00706356 | val_loss: 0.00719297 | Time: 5378.49 ms [2020-11-24 16:22:09 main:581] : INFO : Epoch 66 | loss: 0.00690631 | val_loss: 0.00708204 | Time: 5391.72 ms [2020-11-24 16:22:14 main:581] : INFO : Epoch 67 | loss: 0.00682829 | val_loss: 0.00689916 | Time: 5478.28 ms [2020-11-24 16:22:20 main:581] : INFO : Epoch 68 | loss: 0.00663418 | val_loss: 0.00673465 | Time: 5121.29 ms [2020-11-24 16:22:24 main:581] : INFO : Epoch 69 | loss: 0.00671431 | val_loss: 0.00676933 | Time: 4803.51 ms [2020-11-24 16:22:29 main:581] : INFO : Epoch 70 | loss: 0.00643363 | val_loss: 0.0064809 | Time: 4798.99 ms [2020-11-24 16:22:34 main:581] : INFO : Epoch 71 | loss: 0.00619498 | val_loss: 0.00624146 | Time: 4865.29 ms [2020-11-24 16:22:39 main:581] : INFO : Epoch 72 | loss: 0.00600938 | val_loss: 0.00612872 | Time: 5267.74 ms [2020-11-24 16:22:44 main:581] : INFO : Epoch 73 | loss: 0.0058587 | val_loss: 0.00593444 | Time: 5096.91 ms [2020-11-24 16:22:49 main:581] : INFO : Epoch 74 | loss: 0.00571047 | val_loss: 0.00576022 | Time: 4801.12 ms [2020-11-24 16:22:54 main:581] : INFO : Epoch 75 | loss: 0.00555337 | val_loss: 0.00558814 | Time: 4783.57 ms [2020-11-24 16:22:59 main:581] : INFO : Epoch 76 | loss: 0.00585606 | val_loss: 0.00561077 | Time: 4802.25 ms [2020-11-24 16:23:04 main:581] : INFO : Epoch 77 | loss: 0.00662608 | val_loss: 0.00559003 | Time: 4791.13 ms [2020-11-24 16:23:08 main:581] : INFO : Epoch 78 | loss: 0.00531618 | val_loss: 0.00525646 | Time: 4795.75 ms [2020-11-24 16:23:13 main:581] : INFO : Epoch 79 | loss: 0.00507376 | val_loss: 0.00507617 | Time: 4819.1 ms [2020-11-24 16:23:18 main:581] : INFO : Epoch 80 | loss: 0.00490376 | val_loss: 0.00492044 | Time: 4818.67 ms [2020-11-24 16:23:23 main:581] : INFO : Epoch 81 | loss: 0.0047642 | val_loss: 0.00479587 | Time: 4809.94 ms [2020-11-24 16:23:28 main:581] : INFO : Epoch 82 | loss: 0.00460509 | val_loss: 0.0046559 | Time: 4834.57 ms [2020-11-24 16:23:33 main:581] : INFO : Epoch 83 | loss: 0.00444954 | val_loss: 0.00451866 | Time: 4832.82 ms [2020-11-24 16:23:38 main:581] : INFO : Epoch 84 | loss: 0.00432798 | val_loss: 0.00438326 | Time: 5032.74 ms [2020-11-24 16:23:43 main:581] : INFO : Epoch 85 | loss: 0.00417449 | val_loss: 0.00423095 | Time: 5369.47 ms [2020-11-24 16:23:48 main:581] : INFO : Epoch 86 | loss: 0.00403727 | val_loss: 0.00408852 | Time: 5362.36 ms [2020-11-24 16:23:54 main:581] : INFO : Epoch 87 | loss: 0.00390358 | val_loss: 0.00396184 | Time: 5326.13 ms [2020-11-24 16:23:58 main:581] : INFO : Epoch 88 | loss: 0.00377188 | val_loss: 0.00382448 | Time: 4824.7 ms [2020-11-24 16:24:03 main:581] : INFO : Epoch 89 | loss: 0.00364068 | val_loss: 0.0037039 | Time: 4745.5 ms [2020-11-24 16:24:08 main:581] : INFO : Epoch 90 | loss: 0.00351506 | val_loss: 0.00359234 | Time: 4822.28 ms [2020-11-24 16:24:13 main:581] : INFO : Epoch 91 | loss: 0.00338299 | val_loss: 0.00344251 | Time: 4825.19 ms [2020-11-24 16:24:18 main:581] : INFO : Epoch 92 | loss: 0.00326311 | val_loss: 0.00333973 | Time: 4818.37 ms [2020-11-24 16:24:22 main:581] : INFO : Epoch 93 | loss: 0.00313373 | val_loss: 0.0032125 | Time: 4792.59 ms [2020-11-24 16:24:28 main:581] : INFO : Epoch 94 | loss: 0.0030141 | val_loss: 0.00308758 | Time: 5199.28 ms [2020-11-24 16:24:33 main:581] : INFO : Epoch 95 | loss: 0.00289474 | val_loss: 0.00295707 | Time: 5239.76 ms [2020-11-24 16:24:38 main:581] : INFO : Epoch 96 | loss: 0.00277582 | val_loss: 0.0028245 | Time: 5234.76 ms [2020-11-24 16:24:43 main:581] : INFO : Epoch 97 | loss: 0.00266408 | val_loss: 0.00270918 | Time: 5244.31 ms [2020-11-24 16:24:49 main:581] : INFO : Epoch 98 | loss: 0.00255019 | val_loss: 0.00259236 | Time: 5273.64 ms [2020-11-24 16:24:54 main:581] : INFO : Epoch 99 | loss: 0.00245618 | val_loss: 0.00247855 | Time: 5295.09 ms [2020-11-24 16:24:59 main:581] : INFO : Epoch 100 | loss: 0.00233304 | val_loss: 0.00236362 | Time: 4869.46 ms [2020-11-24 16:25:04 main:581] : INFO : Epoch 101 | loss: 0.00223354 | val_loss: 0.0022718 | Time: 4763.6 ms [2020-11-24 16:25:08 main:581] : INFO : Epoch 102 | loss: 0.00212795 | val_loss: 0.00216045 | Time: 4770.66 ms [2020-11-24 16:25:13 main:581] : INFO : Epoch 103 | loss: 0.00202948 | val_loss: 0.00203857 | Time: 4797.6 ms [2020-11-24 16:25:18 main:581] : INFO : Epoch 104 | loss: 0.00193445 | val_loss: 0.00195241 | Time: 4797.46 ms [2020-11-24 16:25:23 main:581] : INFO : Epoch 105 | loss: 0.00184307 | val_loss: 0.00185401 | Time: 4777.65 ms [2020-11-24 16:25:27 main:581] : INFO : Epoch 106 | loss: 0.00175449 | val_loss: 0.00176008 | Time: 4787.96 ms [2020-11-24 16:25:32 main:581] : INFO : Epoch 107 | loss: 0.00166958 | val_loss: 0.00167606 | Time: 4811.79 ms [2020-11-24 16:25:37 main:581] : INFO : Epoch 108 | loss: 0.00158875 | val_loss: 0.00159318 | Time: 4785.22 ms [2020-11-24 16:25:42 main:581] : INFO : Epoch 109 | loss: 0.00151031 | val_loss: 0.00151537 | Time: 4764.3 ms [2020-11-24 16:25:47 main:581] : INFO : Epoch 110 | loss: 0.0014365 | val_loss: 0.00143934 | Time: 4776.5 ms [2020-11-24 16:25:51 main:581] : INFO : Epoch 111 | loss: 0.00136825 | val_loss: 0.00136835 | Time: 4805.61 ms [2020-11-24 16:25:56 main:581] : INFO : Epoch 112 | loss: 0.001297 | val_loss: 0.0013004 | Time: 4781.02 ms [2020-11-24 16:26:01 main:581] : INFO : Epoch 113 | loss: 0.00123227 | val_loss: 0.00123371 | Time: 4834.71 ms [2020-11-24 16:26:06 main:581] : INFO : Epoch 114 | loss: 0.00117079 | val_loss: 0.00117319 | Time: 4771.42 ms [2020-11-24 16:26:11 main:581] : INFO : Epoch 115 | loss: 0.00111239 | val_loss: 0.0011166 | Time: 4756.03 ms [2020-11-24 16:26:15 main:581] : INFO : Epoch 116 | loss: 0.00105665 | val_loss: 0.00105803 | Time: 4761.5 ms [2020-11-24 16:26:20 main:581] : INFO : Epoch 117 | loss: 0.0010029 | val_loss: 0.00100439 | Time: 4796.29 ms [2020-11-24 16:26:25 main:581] : INFO : Epoch 118 | loss: 0.000952924 | val_loss: 0.000953462 | Time: 4794.56 ms [2020-11-24 16:26:30 main:581] : INFO : Epoch 119 | loss: 0.000905136 | val_loss: 0.000905638 | Time: 4748.98 ms [2020-11-24 16:26:34 main:581] : INFO : Epoch 120 | loss: 0.00085985 | val_loss: 0.000860642 | Time: 4800.67 ms [2020-11-24 16:26:39 main:581] : INFO : Epoch 121 | loss: 0.000817042 | val_loss: 0.000818385 | Time: 4823.94 ms [2020-11-24 16:26:44 main:581] : INFO : Epoch 122 | loss: 0.000775995 | val_loss: 0.000775947 | Time: 4812.38 ms [2020-11-24 16:26:49 main:581] : INFO : Epoch 123 | loss: 0.000736967 | val_loss: 0.00073848 | Time: 4817.27 ms [2020-11-24 16:26:54 main:581] : INFO : Epoch 124 | loss: 0.000700269 | val_loss: 0.000701344 | Time: 4811.53 ms [2020-11-24 16:26:59 main:581] : INFO : Epoch 125 | loss: 0.000665632 | val_loss: 0.000667806 | Time: 4805.81 ms [2020-11-24 16:27:03 main:581] : INFO : Epoch 126 | loss: 0.000631854 | val_loss: 0.000633575 | Time: 4829.88 ms [2020-11-24 16:27:08 main:581] : INFO : Epoch 127 | loss: 0.00060032 | val_loss: 0.000601342 | Time: 4832.64 ms [2020-11-24 16:27:13 main:581] : INFO : Epoch 128 | loss: 0.000570221 | val_loss: 0.000573672 | Time: 4806.38 ms [2020-11-24 16:27:18 main:581] : INFO : Epoch 129 | loss: 0.000541768 | val_loss: 0.000541953 | Time: 4790.18 ms [2020-11-24 16:27:23 main:581] : INFO : Epoch 130 | loss: 0.000514493 | val_loss: 0.000516663 | Time: 4781.19 ms [2020-11-24 16:27:27 main:581] : INFO : Epoch 131 | loss: 0.000489128 | val_loss: 0.000491311 | Time: 4820.8 ms [2020-11-24 16:27:32 main:581] : INFO : Epoch 132 | loss: 0.00046457 | val_loss: 0.000467692 | Time: 4830.51 ms [2020-11-24 16:27:37 main:581] : INFO : Epoch 133 | loss: 0.000441972 | val_loss: 0.000444471 | Time: 4792.64 ms [2020-11-24 16:27:42 main:581] : INFO : Epoch 134 | loss: 0.000420052 | val_loss: 0.000422871 | Time: 4991.17 ms [2020-11-24 16:27:47 main:581] : INFO : Epoch 135 | loss: 0.000399525 | val_loss: 0.000402664 | Time: 4809.68 ms [2020-11-24 16:27:52 main:581] : INFO : Epoch 136 | loss: 0.0003807 | val_loss: 0.000384201 | Time: 4776.52 ms [2020-11-24 16:27:56 main:581] : INFO : Epoch 137 | loss: 0.000361936 | val_loss: 0.000365995 | Time: 4812.69 ms [2020-11-24 16:28:01 main:581] : INFO : Epoch 138 | loss: 0.000344633 | val_loss: 0.000350921 | Time: 4816.29 ms [2020-11-24 16:28:06 main:581] : INFO : Epoch 139 | loss: 0.000328076 | val_loss: 0.000329966 | Time: 4828.84 ms [2020-11-24 16:28:11 main:581] : INFO : Epoch 140 | loss: 0.000312245 | val_loss: 0.000314606 | Time: 4833.82 ms [2020-11-24 16:28:16 main:581] : INFO : Epoch 141 | loss: 0.000297264 | val_loss: 0.000299577 | Time: 4836.34 ms [2020-11-24 16:28:21 main:581] : INFO : Epoch 142 | loss: 0.000283382 | val_loss: 0.000286293 | Time: 4797.18 ms [2020-11-24 16:28:25 main:581] : INFO : Epoch 143 | loss: 0.000270641 | val_loss: 0.00027319 | Time: 4777.88 ms [2020-11-24 16:28:30 main:581] : INFO : Epoch 144 | loss: 0.000258588 | val_loss: 0.000262277 | Time: 4789.18 ms [2020-11-24 16:28:35 main:581] : INFO : Epoch 145 | loss: 0.000247206 | val_loss: 0.000249507 | Time: 4833.72 ms [2020-11-24 16:28:40 main:581] : INFO : Epoch 146 | loss: 0.000236698 | val_loss: 0.000240671 | Time: 4821.51 ms [2020-11-24 16:28:45 main:581] : INFO : Epoch 147 | loss: 0.00022591 | val_loss: 0.000227931 | Time: 4851.89 ms [2020-11-24 16:28:49 main:581] : INFO : Epoch 148 | loss: 0.000216473 | val_loss: 0.000219519 | Time: 4797.74 ms [2020-11-24 16:28:54 main:581] : INFO : Epoch 149 | loss: 0.000208079 | val_loss: 0.000211224 | Time: 4833.29 ms [2020-11-24 16:28:59 main:581] : INFO : Epoch 150 | loss: 0.000199168 | val_loss: 0.000202438 | Time: 4823.36 ms [2020-11-24 16:29:04 main:581] : INFO : Epoch 151 | loss: 0.000191407 | val_loss: 0.000195515 | Time: 4852.01 ms [2020-11-24 16:29:09 main:581] : INFO : Epoch 152 | loss: 0.000184076 | val_loss: 0.000186346 | Time: 4820.13 ms [2020-11-24 16:29:14 main:581] : INFO : Epoch 153 | loss: 0.000176715 | val_loss: 0.000181158 | Time: 4839.08 ms [2020-11-24 16:29:18 main:581] : INFO : Epoch 154 | loss: 0.00017048 | val_loss: 0.000172056 | Time: 4822.57 ms [2020-11-24 16:29:23 main:581] : INFO : Epoch 155 | loss: 0.000163766 | val_loss: 0.000165963 | Time: 4792.27 ms [2020-11-24 16:29:28 main:581] : INFO : Epoch 156 | loss: 0.000158058 | val_loss: 0.000159734 | Time: 5056.08 ms [2020-11-24 16:29:34 main:581] : INFO : Epoch 157 | loss: 0.000152344 | val_loss: 0.000155345 | Time: 5374.78 ms [2020-11-24 16:29:39 main:581] : INFO : Epoch 158 | loss: 0.000147167 | val_loss: 0.000149639 | Time: 5199.8 ms [2020-11-24 16:29:44 main:581] : INFO : Epoch 159 | loss: 0.000141422 | val_loss: 0.000144424 | Time: 4770.14 ms [2020-11-24 16:29:48 main:581] : INFO : Epoch 160 | loss: 0.000136665 | val_loss: 0.000139647 | Time: 4813.72 ms [2020-11-24 16:29:53 main:581] : INFO : Epoch 161 | loss: 0.000132535 | val_loss: 0.000135973 | Time: 4816.78 ms [2020-11-24 16:29:58 main:581] : INFO : Epoch 162 | loss: 0.000127785 | val_loss: 0.00013045 | Time: 4805.36 ms [2020-11-24 16:30:03 main:581] : INFO : Epoch 163 | loss: 0.000123468 | val_loss: 0.000126288 | Time: 4817.06 ms [2020-11-24 16:30:08 main:581] : INFO : Epoch 164 | loss: 0.000119565 | val_loss: 0.000122759 | Time: 4777.43 ms [2020-11-24 16:30:12 main:581] : INFO : Epoch 165 | loss: 0.000116262 | val_loss: 0.000118751 | Time: 4813.51 ms [2020-11-24 16:30:17 main:581] : INFO : Epoch 166 | loss: 0.000112511 | val_loss: 0.000115279 | Time: 4774.47 ms [2020-11-24 16:30:22 main:581] : INFO : Epoch 167 | loss: 0.000108743 | val_loss: 0.00011143 | Time: 4759.43 ms [2020-11-24 16:30:27 main:581] : INFO : Epoch 168 | loss: 0.000105844 | val_loss: 0.000108449 | Time: 4763.89 ms [2020-11-24 16:30:32 main:581] : INFO : Epoch 169 | loss: 0.000102506 | val_loss: 0.000106458 | Time: 4757.35 ms [2020-11-24 16:30:36 main:581] : INFO : Epoch 170 | loss: 0.000100004 | val_loss: 0.000102458 | Time: 4763.47 ms [2020-11-24 16:30:41 main:581] : INFO : Epoch 171 | loss: 9.6878e-05 | val_loss: 0.000100014 | Time: 4818.01 ms [2020-11-24 16:30:46 main:581] : INFO : Epoch 172 | loss: 9.4182e-05 | val_loss: 9.69754e-05 | Time: 4773.82 ms [2020-11-24 16:30:51 main:581] : INFO : Epoch 173 | loss: 9.16153e-05 | val_loss: 9.41114e-05 | Time: 4774 ms [2020-11-24 16:30:55 main:581] : INFO : Epoch 174 | loss: 8.91955e-05 | val_loss: 9.28152e-05 | Time: 4810.48 ms [2020-11-24 16:31:00 main:581] : INFO : Epoch 175 | loss: 8.67451e-05 | val_loss: 8.93209e-05 | Time: 4846.49 ms [2020-11-24 16:31:05 main:581] : INFO : Epoch 176 | loss: 8.4484e-05 | val_loss: 8.84217e-05 | Time: 4842.57 ms [2020-11-24 16:31:10 main:581] : INFO : Epoch 177 | loss: 8.24891e-05 | val_loss: 8.6136e-05 | Time: 4822.31 ms [2020-11-24 16:31:15 main:581] : INFO : Epoch 178 | loss: 8.05445e-05 | val_loss: 8.22054e-05 | Time: 4784.39 ms [2020-11-24 16:31:20 main:581] : INFO : Epoch 179 | loss: 7.84518e-05 | val_loss: 8.11082e-05 | Time: 4768.97 ms [2020-11-24 16:31:24 main:581] : INFO : Epoch 180 | loss: 7.64042e-05 | val_loss: 7.88982e-05 | Time: 4778.66 ms [2020-11-24 16:31:29 main:581] : INFO : Epoch 181 | loss: 7.44683e-05 | val_loss: 7.78491e-05 | Time: 4768.07 ms [2020-11-24 16:31:34 main:581] : INFO : Epoch 182 | loss: 7.28147e-05 | val_loss: 7.62294e-05 | Time: 4775.63 ms [2020-11-24 16:31:39 main:581] : INFO : Epoch 183 | loss: 7.1313e-05 | val_loss: 7.42169e-05 | Time: 4779.12 ms [2020-11-24 16:31:43 main:581] : INFO : Epoch 184 | loss: 6.94426e-05 | val_loss: 7.20321e-05 | Time: 4811.89 ms [2020-11-24 16:31:48 main:581] : INFO : Epoch 185 | loss: 6.83419e-05 | val_loss: 7.00082e-05 | Time: 4802.86 ms [2020-11-24 16:31:53 main:581] : INFO : Epoch 186 | loss: 6.67975e-05 | val_loss: 7.05003e-05 | Time: 4803.56 ms [2020-11-24 16:31:58 main:581] : INFO : Epoch 187 | loss: 6.50977e-05 | val_loss: 6.69358e-05 | Time: 4800.24 ms [2020-11-24 16:32:03 main:581] : INFO : Epoch 188 | loss: 6.32601e-05 | val_loss: 6.5815e-05 | Time: 4811.89 ms [2020-11-24 16:32:07 main:581] : INFO : Epoch 189 | loss: 6.22757e-05 | val_loss: 6.60452e-05 | Time: 4803.03 ms [2020-11-24 16:32:12 main:581] : INFO : Epoch 190 | loss: 6.1221e-05 | val_loss: 6.41607e-05 | Time: 4826.58 ms [2020-11-24 16:32:17 main:581] : INFO : Epoch 191 | loss: 5.98586e-05 | val_loss: 6.23901e-05 | Time: 4855.01 ms [2020-11-24 16:32:22 main:581] : INFO : Epoch 192 | loss: 5.84251e-05 | val_loss: 6.16798e-05 | Time: 4876.23 ms [2020-11-24 16:32:22 main:604] : INFO : Saving trained model to model-final.pt, val_loss 6.16798e-05 [2020-11-24 16:32:22 main:610] : INFO : Saving end state to config to file [2020-11-24 16:32:22 main:615] : INFO : Success, exiting.. 16:32:22 (3655845): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)