Task 3040118
| Name | rand_automata_0002-1606118199-29258-0_0 |
| Workunit | 1376438 |
| Created | 23 Nov 2020, 7:56:43 UTC |
| Sent | 23 Nov 2020, 15:15:10 UTC |
| Report deadline | 24 Nov 2020, 13:45:10 UTC |
| Received | 23 Nov 2020, 15:25:21 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 4754 |
| Run time | 9 min 44 sec |
| CPU time | 9 min 35 sec |
| Validate state | Valid |
| Credit | 959.40 |
| Device peak FLOPS | 3,339.24 GFLOPS |
| Application version | Machine Learning Dataset Generator (test) v9.80 (cuda10200) x86_64-pc-linux-gnu |
| Peak working set size | 2.18 GB |
| Peak swap size | 9.98 GB |
| Peak disk usage | 2.98 GB |
Stderr output
<core_client_version>7.14.2</core_client_version> <![CDATA[ <stderr_txt> DEBUG: Args: ../../projects/www.mlcathome.org_mlcathome/mlds-gpu_9.80_x86_64-pc-linux-gnu__cuda10200 -a LSTM -w 64 -b 2 -s 32 --lr 0.001 --maxepoch 192 nthreads: 1 gpudev: 0 Re-exec()-ing to set environment correctly Machine Learning Dataset Generator v9.80 (Linux/x86_64) (libTorch: release/1.7 GPU: GeForce GTX 1650) [2020-11-23 10:15:28 main:442] : INFO : Set logging level to 1 [2020-11-23 10:15:28 main:448] : INFO : Running in BOINC Client mode [2020-11-23 10:15:28 main:451] : INFO : Resolving all filenames [2020-11-23 10:15:28 main:459] : INFO : Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0002-train-val-dataset.hdf5 (exists = 1) [2020-11-23 10:15:28 main:459] : INFO : Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0002-1606118199-29258-0_0_r1762474995_1 (exists = 0) [2020-11-23 10:15:28 main:459] : INFO : Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/rand_automata_0002-1606118199-29258-0_0_r1762474995_0 (exists = 0) [2020-11-23 10:15:28 main:459] : INFO : Resolved: model-input.pt => model-input.pt (exists = 0) [2020-11-23 10:15:28 main:459] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 0) [2020-11-23 10:15:28 main:479] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/rand_automata_0002-train-val-dataset.hdf5 [2020-11-23 10:15:28 main:481] : INFO : Configuration: [2020-11-23 10:15:28 main:482] : INFO : Model type: LSTM [2020-11-23 10:15:28 main:483] : INFO : Validation Loss Threshold: 0.0001 [2020-11-23 10:15:28 main:484] : INFO : Max Epochs: 192 [2020-11-23 10:15:28 main:485] : INFO : Batch Size: 32 [2020-11-23 10:15:28 main:486] : INFO : Learning Rate: 0.001 [2020-11-23 10:15:28 main:487] : INFO : Patience: 10 [2020-11-23 10:15:28 main:488] : INFO : Hidden Width: 64 [2020-11-23 10:15:28 main:489] : INFO : # Recurrent Layers: 4 [2020-11-23 10:15:28 main:490] : INFO : # Backend Layers: 2 [2020-11-23 10:15:28 main:491] : INFO : # Threads: 1 [2020-11-23 10:15:28 main:493] : INFO : Preparing Dataset [2020-11-23 10:15:28 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0002-train-val-dataset.hdf5 into memory [2020-11-23 10:15:29 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0002-train-val-dataset.hdf5 into memory [2020-11-23 10:15:36 load:106] : INFO : Successfully loaded dataset of 4096 examples into memory. [2020-11-23 10:15:36 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0002-train-val-dataset.hdf5 into memory [2020-11-23 10:15:36 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/rand_automata_0002-train-val-dataset.hdf5 into memory [2020-11-23 10:15:36 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2020-11-23 10:15:36 main:501] : INFO : Creating Model [2020-11-23 10:15:36 main:514] : INFO : Preparing config file [2020-11-23 10:15:36 main:526] : INFO : Creating new config file [2020-11-23 10:15:37 main:566] : INFO : Loading DataLoader into Memory [2020-11-23 10:15:37 main:569] : INFO : Starting Training [2020-11-23 10:15:40 main:581] : INFO : Epoch 1 | loss: 0.0661165 | val_loss: 0.0657832 | Time: 3561.12 ms [2020-11-23 10:15:43 main:581] : INFO : Epoch 2 | loss: 0.0648429 | val_loss: 0.0629689 | Time: 2972.75 ms [2020-11-23 10:15:46 main:581] : INFO : Epoch 3 | loss: 0.0613624 | val_loss: 0.0598437 | Time: 2940.67 ms [2020-11-23 10:15:49 main:581] : INFO : Epoch 4 | loss: 0.0582099 | val_loss: 0.0569546 | Time: 3034.24 ms [2020-11-23 10:15:52 main:581] : INFO : Epoch 5 | loss: 0.0560097 | val_loss: 0.0552855 | Time: 2963.33 ms [2020-11-23 10:15:55 main:581] : INFO : Epoch 6 | loss: 0.0545684 | val_loss: 0.0540588 | Time: 2965.78 ms [2020-11-23 10:15:58 main:581] : INFO : Epoch 7 | loss: 0.0534007 | val_loss: 0.0531887 | Time: 2947.73 ms [2020-11-23 10:16:01 main:581] : INFO : Epoch 8 | loss: 0.052241 | val_loss: 0.051777 | Time: 2971.62 ms [2020-11-23 10:16:04 main:581] : INFO : Epoch 9 | loss: 0.0510453 | val_loss: 0.0508687 | Time: 2940.09 ms [2020-11-23 10:16:07 main:581] : INFO : Epoch 10 | loss: 0.049675 | val_loss: 0.0491309 | Time: 2935.09 ms [2020-11-23 10:16:10 main:581] : INFO : Epoch 11 | loss: 0.0480962 | val_loss: 0.0474622 | Time: 2938.38 ms [2020-11-23 10:16:13 main:581] : INFO : Epoch 12 | loss: 0.0462963 | val_loss: 0.0456895 | Time: 2956.64 ms [2020-11-23 10:16:16 main:581] : INFO : Epoch 13 | loss: 0.0442145 | val_loss: 0.0440765 | Time: 2955.86 ms [2020-11-23 10:16:19 main:581] : INFO : Epoch 14 | loss: 0.0417163 | val_loss: 0.0408716 | Time: 2948.98 ms [2020-11-23 10:16:22 main:581] : INFO : Epoch 15 | loss: 0.0388846 | val_loss: 0.0382746 | Time: 2962.41 ms [2020-11-23 10:16:25 main:581] : INFO : Epoch 16 | loss: 0.0354446 | val_loss: 0.0352603 | Time: 2943.23 ms [2020-11-23 10:16:27 main:581] : INFO : Epoch 17 | loss: 0.0322024 | val_loss: 0.0316005 | Time: 2937.49 ms [2020-11-23 10:16:30 main:581] : INFO : Epoch 18 | loss: 0.0298253 | val_loss: 0.0290065 | Time: 2967.56 ms [2020-11-23 10:16:33 main:581] : INFO : Epoch 19 | loss: 0.0277338 | val_loss: 0.0290901 | Time: 2938.1 ms [2020-11-23 10:16:36 main:581] : INFO : Epoch 20 | loss: 0.0232049 | val_loss: 0.0222913 | Time: 2964.69 ms [2020-11-23 10:16:39 main:581] : INFO : Epoch 21 | loss: 0.0218954 | val_loss: 0.0180925 | Time: 2946.03 ms [2020-11-23 10:16:42 main:581] : INFO : Epoch 22 | loss: 0.0145844 | val_loss: 0.0142303 | Time: 2966.96 ms [2020-11-23 10:16:45 main:581] : INFO : Epoch 23 | loss: 0.0136484 | val_loss: 0.016128 | Time: 2986.78 ms [2020-11-23 10:16:48 main:581] : INFO : Epoch 24 | loss: 0.0155585 | val_loss: 0.0140715 | Time: 2972.46 ms [2020-11-23 10:16:51 main:581] : INFO : Epoch 25 | loss: 0.0408997 | val_loss: 0.0518651 | Time: 3029.3 ms [2020-11-23 10:16:54 main:581] : INFO : Epoch 26 | loss: 0.0385301 | val_loss: 0.0229985 | Time: 2969.54 ms [2020-11-23 10:16:57 main:581] : INFO : Epoch 27 | loss: 0.0138463 | val_loss: 0.0117913 | Time: 2997.38 ms [2020-11-23 10:17:00 main:581] : INFO : Epoch 28 | loss: 0.0144977 | val_loss: 0.0331139 | Time: 2975.83 ms [2020-11-23 10:17:03 main:581] : INFO : Epoch 29 | loss: 0.0146857 | val_loss: 0.0129057 | Time: 2996.73 ms [2020-11-23 10:17:06 main:581] : INFO : Epoch 30 | loss: 0.0218775 | val_loss: 0.0113874 | Time: 3114.2 ms [2020-11-23 10:17:09 main:581] : INFO : Epoch 31 | loss: 0.00922259 | val_loss: 0.00901823 | Time: 2996.61 ms [2020-11-23 10:17:12 main:581] : INFO : Epoch 32 | loss: 0.00866316 | val_loss: 0.0086407 | Time: 3047.61 ms [2020-11-23 10:17:15 main:581] : INFO : Epoch 33 | loss: 0.00764944 | val_loss: 0.00790274 | Time: 3045.34 ms [2020-11-23 10:17:18 main:581] : INFO : Epoch 34 | loss: 0.00727683 | val_loss: 0.00741253 | Time: 3028.76 ms [2020-11-23 10:17:21 main:581] : INFO : Epoch 35 | loss: 0.00684428 | val_loss: 0.00713591 | Time: 2997.11 ms [2020-11-23 10:17:24 main:581] : INFO : Epoch 36 | loss: 0.0065737 | val_loss: 0.00685843 | Time: 3010.96 ms [2020-11-23 10:17:27 main:581] : INFO : Epoch 37 | loss: 0.00632654 | val_loss: 0.00661561 | Time: 2935.66 ms [2020-11-23 10:17:30 main:581] : INFO : Epoch 38 | loss: 0.0061007 | val_loss: 0.00631411 | Time: 3015.15 ms [2020-11-23 10:17:33 main:581] : INFO : Epoch 39 | loss: 0.0058949 | val_loss: 0.00617365 | Time: 2961.24 ms [2020-11-23 10:17:36 main:581] : INFO : Epoch 40 | loss: 0.00569653 | val_loss: 0.0058852 | Time: 2957.76 ms [2020-11-23 10:17:39 main:581] : INFO : Epoch 41 | loss: 0.0055036 | val_loss: 0.00567281 | Time: 2963.4 ms [2020-11-23 10:17:42 main:581] : INFO : Epoch 42 | loss: 0.00531407 | val_loss: 0.00546217 | Time: 2961.96 ms [2020-11-23 10:17:45 main:581] : INFO : Epoch 43 | loss: 0.0051292 | val_loss: 0.0052154 | Time: 2962.91 ms [2020-11-23 10:17:48 main:581] : INFO : Epoch 44 | loss: 0.00495099 | val_loss: 0.00501022 | Time: 3048.47 ms [2020-11-23 10:17:51 main:581] : INFO : Epoch 45 | loss: 0.00478281 | val_loss: 0.00482872 | Time: 2937.65 ms [2020-11-23 10:17:54 main:581] : INFO : Epoch 46 | loss: 0.00460544 | val_loss: 0.00463153 | Time: 3003.56 ms [2020-11-23 10:17:57 main:581] : INFO : Epoch 47 | loss: 0.00443721 | val_loss: 0.00445003 | Time: 2931.97 ms [2020-11-23 10:18:00 main:581] : INFO : Epoch 48 | loss: 0.00427294 | val_loss: 0.00428186 | Time: 3053.67 ms [2020-11-23 10:18:03 main:581] : INFO : Epoch 49 | loss: 0.00411321 | val_loss: 0.00411661 | Time: 3021.76 ms [2020-11-23 10:18:06 main:581] : INFO : Epoch 50 | loss: 0.00395522 | val_loss: 0.00395043 | Time: 2939.54 ms [2020-11-23 10:18:09 main:581] : INFO : Epoch 51 | loss: 0.00380198 | val_loss: 0.00379565 | Time: 2998.35 ms [2020-11-23 10:18:12 main:581] : INFO : Epoch 52 | loss: 0.00365101 | val_loss: 0.00364236 | Time: 3095.68 ms [2020-11-23 10:18:15 main:581] : INFO : Epoch 53 | loss: 0.00350363 | val_loss: 0.00349123 | Time: 2940.01 ms [2020-11-23 10:18:18 main:581] : INFO : Epoch 54 | loss: 0.00336065 | val_loss: 0.00334817 | Time: 2963.78 ms [2020-11-23 10:18:21 main:581] : INFO : Epoch 55 | loss: 0.00322227 | val_loss: 0.00320475 | Time: 2936.24 ms [2020-11-23 10:18:24 main:581] : INFO : Epoch 56 | loss: 0.00308796 | val_loss: 0.00307084 | Time: 2940.83 ms [2020-11-23 10:18:27 main:581] : INFO : Epoch 57 | loss: 0.00295649 | val_loss: 0.0029394 | Time: 2938.71 ms [2020-11-23 10:18:30 main:581] : INFO : Epoch 58 | loss: 0.00282979 | val_loss: 0.00281138 | Time: 3034.14 ms [2020-11-23 10:18:33 main:581] : INFO : Epoch 59 | loss: 0.00270643 | val_loss: 0.00268978 | Time: 2972.35 ms [2020-11-23 10:18:36 main:581] : INFO : Epoch 60 | loss: 0.00258839 | val_loss: 0.0025704 | Time: 2974.8 ms [2020-11-23 10:18:39 main:581] : INFO : Epoch 61 | loss: 0.0024738 | val_loss: 0.00245547 | Time: 2981.18 ms [2020-11-23 10:18:42 main:581] : INFO : Epoch 62 | loss: 0.00236384 | val_loss: 0.00234994 | Time: 2982.75 ms [2020-11-23 10:18:45 main:581] : INFO : Epoch 63 | loss: 0.00225783 | val_loss: 0.00224276 | Time: 2983.86 ms [2020-11-23 10:18:48 main:581] : INFO : Epoch 64 | loss: 0.00215575 | val_loss: 0.00213878 | Time: 2940.94 ms [2020-11-23 10:18:51 main:581] : INFO : Epoch 65 | loss: 0.00205644 | val_loss: 0.00204216 | Time: 2964.99 ms [2020-11-23 10:18:54 main:581] : INFO : Epoch 66 | loss: 0.0019618 | val_loss: 0.00194712 | Time: 2970.28 ms [2020-11-23 10:18:57 main:581] : INFO : Epoch 67 | loss: 0.0018712 | val_loss: 0.00185823 | Time: 2970.29 ms [2020-11-23 10:19:00 main:581] : INFO : Epoch 68 | loss: 0.00178325 | val_loss: 0.00177176 | Time: 2972.14 ms [2020-11-23 10:19:03 main:581] : INFO : Epoch 69 | loss: 0.00169868 | val_loss: 0.00168556 | Time: 2970.73 ms [2020-11-23 10:19:06 main:581] : INFO : Epoch 70 | loss: 0.00161692 | val_loss: 0.00160542 | Time: 2972.98 ms [2020-11-23 10:19:09 main:581] : INFO : Epoch 71 | loss: 0.00153827 | val_loss: 0.0015265 | Time: 2969.56 ms [2020-11-23 10:19:12 main:581] : INFO : Epoch 72 | loss: 0.0014618 | val_loss: 0.00145276 | Time: 2968.52 ms [2020-11-23 10:19:15 main:581] : INFO : Epoch 73 | loss: 0.00138887 | val_loss: 0.0013801 | Time: 2984.71 ms [2020-11-23 10:19:18 main:581] : INFO : Epoch 74 | loss: 0.00131936 | val_loss: 0.0013105 | Time: 2992.76 ms [2020-11-23 10:19:21 main:581] : INFO : Epoch 75 | loss: 0.00125285 | val_loss: 0.00124101 | Time: 3002.35 ms [2020-11-23 10:19:24 main:581] : INFO : Epoch 76 | loss: 0.00118954 | val_loss: 0.00117713 | Time: 2971.3 ms [2020-11-23 10:19:26 main:581] : INFO : Epoch 77 | loss: 0.00112746 | val_loss: 0.00112069 | Time: 2965.68 ms [2020-11-23 10:19:29 main:581] : INFO : Epoch 78 | loss: 0.00106925 | val_loss: 0.00105885 | Time: 2966.3 ms [2020-11-23 10:19:32 main:581] : INFO : Epoch 79 | loss: 0.00101419 | val_loss: 0.00100611 | Time: 2962.47 ms [2020-11-23 10:19:35 main:581] : INFO : Epoch 80 | loss: 0.000962991 | val_loss: 0.000952462 | Time: 2967.8 ms [2020-11-23 10:19:38 main:581] : INFO : Epoch 81 | loss: 0.000912041 | val_loss: 0.000906828 | Time: 2966.62 ms [2020-11-23 10:19:41 main:581] : INFO : Epoch 82 | loss: 0.000865643 | val_loss: 0.000855313 | Time: 2971.16 ms [2020-11-23 10:19:44 main:581] : INFO : Epoch 83 | loss: 0.000819578 | val_loss: 0.000810584 | Time: 2990.91 ms [2020-11-23 10:19:47 main:581] : INFO : Epoch 84 | loss: 0.000776032 | val_loss: 0.000770746 | Time: 2972.35 ms [2020-11-23 10:19:50 main:581] : INFO : Epoch 85 | loss: 0.000735659 | val_loss: 0.000727353 | Time: 2959.9 ms [2020-11-23 10:19:53 main:581] : INFO : Epoch 86 | loss: 0.000697002 | val_loss: 0.000692067 | Time: 2976.11 ms [2020-11-23 10:19:56 main:581] : INFO : Epoch 87 | loss: 0.000661396 | val_loss: 0.000652595 | Time: 2994.14 ms [2020-11-23 10:19:59 main:581] : INFO : Epoch 88 | loss: 0.000626155 | val_loss: 0.000620278 | Time: 2967.23 ms [2020-11-23 10:20:02 main:581] : INFO : Epoch 89 | loss: 0.000593095 | val_loss: 0.000586688 | Time: 2990.66 ms [2020-11-23 10:20:05 main:581] : INFO : Epoch 90 | loss: 0.000563175 | val_loss: 0.000556748 | Time: 2965.76 ms [2020-11-23 10:20:08 main:581] : INFO : Epoch 91 | loss: 0.000533395 | val_loss: 0.000531619 | Time: 2961.05 ms [2020-11-23 10:20:11 main:581] : INFO : Epoch 92 | loss: 0.000506135 | val_loss: 0.000501139 | Time: 2955.16 ms [2020-11-23 10:20:14 main:581] : INFO : Epoch 93 | loss: 0.000479866 | val_loss: 0.000475967 | Time: 2983.34 ms [2020-11-23 10:20:17 main:581] : INFO : Epoch 94 | loss: 0.000455508 | val_loss: 0.00045061 | Time: 2994.65 ms [2020-11-23 10:20:20 main:581] : INFO : Epoch 95 | loss: 0.000431738 | val_loss: 0.000425244 | Time: 2953.21 ms [2020-11-23 10:20:23 main:581] : INFO : Epoch 96 | loss: 0.000409302 | val_loss: 0.000405873 | Time: 2945.5 ms [2020-11-23 10:20:26 main:581] : INFO : Epoch 97 | loss: 0.000388947 | val_loss: 0.000384146 | Time: 2959.75 ms [2020-11-23 10:20:29 main:581] : INFO : Epoch 98 | loss: 0.000369514 | val_loss: 0.000364849 | Time: 2989.1 ms [2020-11-23 10:20:32 main:581] : INFO : Epoch 99 | loss: 0.000351845 | val_loss: 0.0003464 | Time: 2956.67 ms [2020-11-23 10:20:35 main:581] : INFO : Epoch 100 | loss: 0.000333898 | val_loss: 0.000330992 | Time: 2975.65 ms [2020-11-23 10:20:38 main:581] : INFO : Epoch 101 | loss: 0.000317284 | val_loss: 0.000312235 | Time: 2964.28 ms [2020-11-23 10:20:41 main:581] : INFO : Epoch 102 | loss: 0.000301912 | val_loss: 0.000299929 | Time: 2966.26 ms [2020-11-23 10:20:44 main:581] : INFO : Epoch 103 | loss: 0.000287594 | val_loss: 0.000284521 | Time: 2961.74 ms [2020-11-23 10:20:47 main:581] : INFO : Epoch 104 | loss: 0.000274646 | val_loss: 0.000271045 | Time: 2964.66 ms [2020-11-23 10:20:50 main:581] : INFO : Epoch 105 | loss: 0.000261082 | val_loss: 0.0002587 | Time: 2982.77 ms [2020-11-23 10:20:53 main:581] : INFO : Epoch 106 | loss: 0.000248925 | val_loss: 0.000246629 | Time: 2971.62 ms [2020-11-23 10:20:56 main:581] : INFO : Epoch 107 | loss: 0.000237928 | val_loss: 0.000236023 | Time: 2977.57 ms [2020-11-23 10:20:59 main:581] : INFO : Epoch 108 | loss: 0.000227206 | val_loss: 0.000225687 | Time: 2976.58 ms [2020-11-23 10:21:02 main:581] : INFO : Epoch 109 | loss: 0.000216832 | val_loss: 0.000213526 | Time: 2977.38 ms [2020-11-23 10:21:05 main:581] : INFO : Epoch 110 | loss: 0.00020727 | val_loss: 0.00020939 | Time: 2975.28 ms [2020-11-23 10:21:08 main:581] : INFO : Epoch 111 | loss: 0.000199189 | val_loss: 0.000196204 | Time: 2972.69 ms [2020-11-23 10:21:11 main:581] : INFO : Epoch 112 | loss: 0.000189822 | val_loss: 0.000189969 | Time: 3005.51 ms [2020-11-23 10:21:14 main:581] : INFO : Epoch 113 | loss: 0.000181964 | val_loss: 0.000180881 | Time: 3072.73 ms [2020-11-23 10:21:17 main:581] : INFO : Epoch 114 | loss: 0.000175131 | val_loss: 0.000176613 | Time: 2999.61 ms [2020-11-23 10:21:20 main:581] : INFO : Epoch 115 | loss: 0.000167662 | val_loss: 0.000165891 | Time: 2977.3 ms [2020-11-23 10:21:23 main:581] : INFO : Epoch 116 | loss: 0.000160647 | val_loss: 0.000160896 | Time: 3285.2 ms [2020-11-23 10:21:26 main:581] : INFO : Epoch 117 | loss: 0.000154945 | val_loss: 0.00015397 | Time: 3024.71 ms [2020-11-23 10:21:29 main:581] : INFO : Epoch 118 | loss: 0.000148653 | val_loss: 0.000146841 | Time: 3158.32 ms [2020-11-23 10:21:32 main:581] : INFO : Epoch 119 | loss: 0.000143343 | val_loss: 0.000142513 | Time: 3095.71 ms [2020-11-23 10:21:35 main:581] : INFO : Epoch 120 | loss: 0.000138045 | val_loss: 0.000136849 | Time: 3112.15 ms [2020-11-23 10:21:38 main:581] : INFO : Epoch 121 | loss: 0.000132458 | val_loss: 0.00013274 | Time: 3042.67 ms [2020-11-23 10:21:41 main:581] : INFO : Epoch 122 | loss: 0.000127436 | val_loss: 0.000128491 | Time: 3016.22 ms [2020-11-23 10:21:44 main:581] : INFO : Epoch 123 | loss: 0.000123253 | val_loss: 0.000124001 | Time: 2965.05 ms [2020-11-23 10:21:47 main:581] : INFO : Epoch 124 | loss: 0.000118859 | val_loss: 0.00011874 | Time: 2970.48 ms [2020-11-23 10:21:50 main:581] : INFO : Epoch 125 | loss: 0.000115143 | val_loss: 0.000114075 | Time: 2965.73 ms [2020-11-23 10:21:53 main:581] : INFO : Epoch 126 | loss: 0.000110733 | val_loss: 0.000112086 | Time: 2988.62 ms [2020-11-23 10:21:56 main:581] : INFO : Epoch 127 | loss: 0.000107385 | val_loss: 0.00011109 | Time: 2965.51 ms [2020-11-23 10:21:59 main:581] : INFO : Epoch 128 | loss: 0.000104239 | val_loss: 0.000103635 | Time: 2965.45 ms [2020-11-23 10:22:02 main:581] : INFO : Epoch 129 | loss: 0.000100185 | val_loss: 0.000100258 | Time: 2977.71 ms [2020-11-23 10:22:05 main:581] : INFO : Epoch 130 | loss: 9.76428e-05 | val_loss: 9.75054e-05 | Time: 2969.61 ms [2020-11-23 10:22:08 main:581] : INFO : Epoch 131 | loss: 9.44562e-05 | val_loss: 9.56955e-05 | Time: 2995.37 ms [2020-11-23 10:22:11 main:581] : INFO : Epoch 132 | loss: 9.12252e-05 | val_loss: 9.20282e-05 | Time: 2975.41 ms [2020-11-23 10:22:14 main:581] : INFO : Epoch 133 | loss: 8.91432e-05 | val_loss: 8.87881e-05 | Time: 2987.5 ms [2020-11-23 10:22:17 main:581] : INFO : Epoch 134 | loss: 8.61258e-05 | val_loss: 8.69216e-05 | Time: 2994.95 ms [2020-11-23 10:22:20 main:581] : INFO : Epoch 135 | loss: 8.35836e-05 | val_loss: 8.44616e-05 | Time: 2989.14 ms [2020-11-23 10:22:23 main:581] : INFO : Epoch 136 | loss: 8.11539e-05 | val_loss: 8.17793e-05 | Time: 2979.27 ms [2020-11-23 10:22:26 main:581] : INFO : Epoch 137 | loss: 7.9667e-05 | val_loss: 7.95076e-05 | Time: 2973.33 ms [2020-11-23 10:22:29 main:581] : INFO : Epoch 138 | loss: 7.66891e-05 | val_loss: 7.66588e-05 | Time: 2973.46 ms [2020-11-23 10:22:32 main:581] : INFO : Epoch 139 | loss: 7.43317e-05 | val_loss: 7.42725e-05 | Time: 2972.05 ms [2020-11-23 10:22:35 main:581] : INFO : Epoch 140 | loss: 7.27217e-05 | val_loss: 7.32115e-05 | Time: 2988.68 ms [2020-11-23 10:22:38 main:581] : INFO : Epoch 141 | loss: 7.09267e-05 | val_loss: 7.22357e-05 | Time: 2975.36 ms [2020-11-23 10:22:41 main:581] : INFO : Epoch 142 | loss: 6.95057e-05 | val_loss: 6.99401e-05 | Time: 2986.59 ms [2020-11-23 10:22:44 main:581] : INFO : Epoch 143 | loss: 6.72167e-05 | val_loss: 6.82356e-05 | Time: 2972.82 ms [2020-11-23 10:22:47 main:581] : INFO : Epoch 144 | loss: 6.61788e-05 | val_loss: 6.51229e-05 | Time: 2980.25 ms [2020-11-23 10:22:50 main:581] : INFO : Epoch 145 | loss: 6.38535e-05 | val_loss: 6.43692e-05 | Time: 2977.85 ms [2020-11-23 10:22:53 main:581] : INFO : Epoch 146 | loss: 6.25933e-05 | val_loss: 6.2313e-05 | Time: 2979.92 ms [2020-11-23 10:22:56 main:581] : INFO : Epoch 147 | loss: 6.12475e-05 | val_loss: 6.24023e-05 | Time: 2986.62 ms [2020-11-23 10:22:59 main:581] : INFO : Epoch 148 | loss: 5.97411e-05 | val_loss: 6.08217e-05 | Time: 2977.46 ms [2020-11-23 10:23:02 main:581] : INFO : Epoch 149 | loss: 5.86775e-05 | val_loss: 5.86195e-05 | Time: 2991.33 ms [2020-11-23 10:23:05 main:581] : INFO : Epoch 150 | loss: 5.67847e-05 | val_loss: 5.67218e-05 | Time: 2981.99 ms [2020-11-23 10:23:08 main:581] : INFO : Epoch 151 | loss: 5.54975e-05 | val_loss: 5.64418e-05 | Time: 3016.46 ms [2020-11-23 10:23:11 main:581] : INFO : Epoch 152 | loss: 5.43568e-05 | val_loss: 5.46645e-05 | Time: 2986.16 ms [2020-11-23 10:23:14 main:581] : INFO : Epoch 153 | loss: 5.31287e-05 | val_loss: 5.28323e-05 | Time: 2975.94 ms [2020-11-23 10:23:17 main:581] : INFO : Epoch 154 | loss: 5.20337e-05 | val_loss: 5.20813e-05 | Time: 2977.51 ms [2020-11-23 10:23:20 main:581] : INFO : Epoch 155 | loss: 5.07779e-05 | val_loss: 5.08456e-05 | Time: 2982.66 ms [2020-11-23 10:23:23 main:581] : INFO : Epoch 156 | loss: 4.98425e-05 | val_loss: 5.01077e-05 | Time: 2969.26 ms [2020-11-23 10:23:26 main:581] : INFO : Epoch 157 | loss: 4.88744e-05 | val_loss: 5.00212e-05 | Time: 2969.94 ms [2020-11-23 10:23:29 main:581] : INFO : Epoch 158 | loss: 4.80046e-05 | val_loss: 4.96192e-05 | Time: 2968.73 ms [2020-11-23 10:23:32 main:581] : INFO : Epoch 159 | loss: 4.70634e-05 | val_loss: 4.79674e-05 | Time: 2980.98 ms [2020-11-23 10:23:35 main:581] : INFO : Epoch 160 | loss: 4.57534e-05 | val_loss: 4.69958e-05 | Time: 2974.37 ms [2020-11-23 10:23:37 main:581] : INFO : Epoch 161 | loss: 4.46189e-05 | val_loss: 4.42825e-05 | Time: 2984.96 ms [2020-11-23 10:23:40 main:581] : INFO : Epoch 162 | loss: 4.41194e-05 | val_loss: 4.54103e-05 | Time: 2977.97 ms [2020-11-23 10:23:43 main:581] : INFO : Epoch 163 | loss: 4.36635e-05 | val_loss: 4.32152e-05 | Time: 3018.32 ms [2020-11-23 10:23:47 main:581] : INFO : Epoch 164 | loss: 4.2972e-05 | val_loss: 4.32533e-05 | Time: 3008.13 ms [2020-11-23 10:23:49 main:581] : INFO : Epoch 165 | loss: 4.14614e-05 | val_loss: 4.19328e-05 | Time: 2977.54 ms [2020-11-23 10:23:52 main:581] : INFO : Epoch 166 | loss: 4.08454e-05 | val_loss: 4.23821e-05 | Time: 2981.68 ms [2020-11-23 10:23:55 main:581] : INFO : Epoch 167 | loss: 4.04536e-05 | val_loss: 4.00945e-05 | Time: 2974.08 ms [2020-11-23 10:23:59 main:581] : INFO : Epoch 168 | loss: 3.9444e-05 | val_loss: 4.13865e-05 | Time: 3088.7 ms [2020-11-23 10:24:02 main:581] : INFO : Epoch 169 | loss: 3.86292e-05 | val_loss: 3.87246e-05 | Time: 2972.6 ms [2020-11-23 10:24:04 main:581] : INFO : Epoch 170 | loss: 3.81627e-05 | val_loss: 3.82602e-05 | Time: 2978.5 ms [2020-11-23 10:24:07 main:581] : INFO : Epoch 171 | loss: 3.77207e-05 | val_loss: 3.82951e-05 | Time: 2961.19 ms [2020-11-23 10:24:10 main:581] : INFO : Epoch 172 | loss: 3.69849e-05 | val_loss: 3.67044e-05 | Time: 2966.85 ms [2020-11-23 10:24:13 main:581] : INFO : Epoch 173 | loss: 3.60337e-05 | val_loss: 3.55986e-05 | Time: 2969.38 ms [2020-11-23 10:24:16 main:581] : INFO : Epoch 174 | loss: 3.58874e-05 | val_loss: 3.64413e-05 | Time: 2996.32 ms [2020-11-23 10:24:19 main:581] : INFO : Epoch 175 | loss: 3.46716e-05 | val_loss: 3.49848e-05 | Time: 2988.42 ms [2020-11-23 10:24:22 main:581] : INFO : Epoch 176 | loss: 3.46809e-05 | val_loss: 3.43575e-05 | Time: 2978.39 ms [2020-11-23 10:24:25 main:581] : INFO : Epoch 177 | loss: 3.39796e-05 | val_loss: 3.42624e-05 | Time: 2987.44 ms [2020-11-23 10:24:28 main:581] : INFO : Epoch 178 | loss: 3.37164e-05 | val_loss: 3.4819e-05 | Time: 2993.89 ms [2020-11-23 10:24:31 main:581] : INFO : Epoch 179 | loss: 3.27213e-05 | val_loss: 3.32245e-05 | Time: 2950.9 ms [2020-11-23 10:24:34 main:581] : INFO : Epoch 180 | loss: 3.25637e-05 | val_loss: 3.20688e-05 | Time: 2964.65 ms [2020-11-23 10:24:37 main:581] : INFO : Epoch 181 | loss: 3.15811e-05 | val_loss: 3.16872e-05 | Time: 2991.5 ms [2020-11-23 10:24:40 main:581] : INFO : Epoch 182 | loss: 3.14551e-05 | val_loss: 3.18737e-05 | Time: 3001.05 ms [2020-11-23 10:24:43 main:581] : INFO : Epoch 183 | loss: 3.05938e-05 | val_loss: 3.09344e-05 | Time: 2990.49 ms [2020-11-23 10:24:46 main:581] : INFO : Epoch 184 | loss: 3.08481e-05 | val_loss: 3.07154e-05 | Time: 3002.9 ms [2020-11-23 10:24:49 main:581] : INFO : Epoch 185 | loss: 2.99967e-05 | val_loss: 3.00683e-05 | Time: 2975.93 ms [2020-11-23 10:24:52 main:581] : INFO : Epoch 186 | loss: 2.95072e-05 | val_loss: 2.96003e-05 | Time: 2979.7 ms [2020-11-23 10:24:55 main:581] : INFO : Epoch 187 | loss: 2.94411e-05 | val_loss: 2.95154e-05 | Time: 2982.38 ms [2020-11-23 10:24:58 main:581] : INFO : Epoch 188 | loss: 2.91501e-05 | val_loss: 2.92369e-05 | Time: 3004.94 ms [2020-11-23 10:25:01 main:581] : INFO : Epoch 189 | loss: 2.84042e-05 | val_loss: 3.18904e-05 | Time: 2984.43 ms [2020-11-23 10:25:04 main:581] : INFO : Epoch 190 | loss: 2.78729e-05 | val_loss: 2.88809e-05 | Time: 2995.51 ms [2020-11-23 10:25:07 main:581] : INFO : Epoch 191 | loss: 2.77711e-05 | val_loss: 2.88322e-05 | Time: 2977.9 ms [2020-11-23 10:25:10 main:581] : INFO : Epoch 192 | loss: 2.74661e-05 | val_loss: 2.76197e-05 | Time: 2960.99 ms [2020-11-23 10:25:10 main:604] : INFO : Saving trained model to model-final.pt, val_loss 2.76197e-05 [2020-11-23 10:25:10 main:610] : INFO : Saving end state to config to file [2020-11-23 10:25:10 main:615] : INFO : Success, exiting.. 10:25:10 (5376): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)