Task 14596028
| Name | ParityModified-1647048863-4143-3-0_0 |
| Workunit | 11617829 |
| Created | 10 Apr 2022, 19:33:08 UTC |
| Sent | 11 Apr 2022, 1:06:58 UTC |
| Report deadline | 19 Apr 2022, 1:06:58 UTC |
| Received | 11 Apr 2022, 4:49:50 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 6260 |
| Run time | 1 hours 47 min 36 sec |
| CPU time | 1 hours 38 min 12 sec |
| Validate state | Valid |
| Credit | 4,160.00 |
| Device peak FLOPS | 11,157.01 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 2.08 GB |
| Peak swap size | 4.37 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version> <![CDATA[ <stderr_txt> :40 main:574] : INFO : Epoch 1832 | loss: 0.0311333 | val_loss: 0.0311514 | Time: 3185.86 ms [2022-04-10 20:29:43 main:574] : INFO : Epoch 1833 | loss: 0.0311321 | val_loss: 0.0311529 | Time: 3229.06 ms [2022-04-10 20:29:46 main:574] : INFO : Epoch 1834 | loss: 0.0311325 | val_loss: 0.0311502 | Time: 3255.81 ms [2022-04-10 20:29:49 main:574] : INFO : Epoch 1835 | loss: 0.0311316 | val_loss: 0.0311507 | Time: 3254.56 ms [2022-04-10 20:29:53 main:574] : INFO : Epoch 1836 | loss: 0.0311306 | val_loss: 0.0311534 | Time: 3218.5 ms [2022-04-10 20:29:56 main:574] : INFO : Epoch 1837 | loss: 0.0311305 | val_loss: 0.0311515 | Time: 3311.66 ms [2022-04-10 20:29:59 main:574] : INFO : Epoch 1838 | loss: 0.0311284 | val_loss: 0.0311507 | Time: 3283.49 ms [2022-04-10 20:30:02 main:574] : INFO : Epoch 1839 | loss: 0.0311288 | val_loss: 0.0311548 | Time: 3277.88 ms [2022-04-10 20:30:06 main:574] : INFO : Epoch 1840 | loss: 0.0311298 | val_loss: 0.0311518 | Time: 3234.79 ms [2022-04-10 20:30:09 main:574] : INFO : Epoch 1841 | loss: 0.0311297 | val_loss: 0.031151 | Time: 3354.03 ms [2022-04-10 20:30:12 main:574] : INFO : Epoch 1842 | loss: 0.0311281 | val_loss: 0.0311509 | Time: 3157.72 ms [2022-04-10 20:30:15 main:574] : INFO : Epoch 1843 | loss: 0.0311281 | val_loss: 0.0311502 | Time: 3225.22 ms [2022-04-10 20:30:19 main:574] : INFO : Epoch 1844 | loss: 0.0311267 | val_loss: 0.0311519 | Time: 3220.51 ms [2022-04-10 20:30:22 main:574] : INFO : Epoch 1845 | loss: 0.0311263 | val_loss: 0.0311524 | Time: 3170.37 ms [2022-04-10 20:30:25 main:574] : INFO : Epoch 1846 | loss: 0.031128 | val_loss: 0.0311576 | Time: 3302.94 ms [2022-04-10 20:30:28 main:574] : INFO : Epoch 1847 | loss: 0.0311259 | val_loss: 0.0311573 | Time: 3115.73 ms [2022-04-10 20:30:32 main:574] : INFO : Epoch 1848 | loss: 0.031127 | val_loss: 0.0311507 | Time: 3251.58 ms [2022-04-10 20:30:35 main:574] : INFO : Epoch 1849 | loss: 0.0311264 | val_loss: 0.0311534 | Time: 3235.19 ms [2022-04-10 20:30:38 main:574] : INFO : Epoch 1850 | loss: 0.0311249 | val_loss: 0.0311536 | Time: 3205.56 ms [2022-04-10 20:30:41 main:574] : INFO : Epoch 1851 | loss: 0.0311273 | val_loss: 0.0311517 | Time: 3298.99 ms [2022-04-10 20:30:44 main:574] : INFO : Epoch 1852 | loss: 0.0311261 | val_loss: 0.0311515 | Time: 3185.73 ms [2022-04-10 20:30:48 main:574] : INFO : Epoch 1853 | loss: 0.0311247 | val_loss: 0.0311574 | Time: 3215.26 ms [2022-04-10 20:30:51 main:574] : INFO : Epoch 1854 | loss: 0.0311253 | val_loss: 0.0311542 | Time: 3261.25 ms [2022-04-10 20:30:54 main:574] : INFO : Epoch 1855 | loss: 0.0311257 | val_loss: 0.0311615 | Time: 3369.44 ms [2022-04-10 20:30:58 main:574] : INFO : Epoch 1856 | loss: 0.0311292 | val_loss: 0.0311569 | Time: 3201.93 ms [2022-04-10 20:31:01 main:574] : INFO : Epoch 1857 | loss: 0.0311316 | val_loss: 0.031152 | Time: 3255.7 ms [2022-04-10 20:31:04 main:574] : INFO : Epoch 1858 | loss: 0.0311305 | val_loss: 0.0311512 | Time: 3272.83 ms [2022-04-10 20:31:07 main:574] : INFO : Epoch 1859 | loss: 0.0311283 | val_loss: 0.0311471 | Time: 3275.19 ms [2022-04-10 20:31:11 main:574] : INFO : Epoch 1860 | loss: 0.0311302 | val_loss: 0.0311475 | Time: 3187.65 ms [2022-04-10 20:31:14 main:574] : INFO : Epoch 1861 | loss: 0.0311294 | val_loss: 0.0311453 | Time: 3211.48 ms [2022-04-10 20:31:17 main:574] : INFO : Epoch 1862 | loss: 0.0311278 | val_loss: 0.0311481 | Time: 3355.31 ms [2022-04-10 20:31:20 main:574] : INFO : Epoch 1863 | loss: 0.0311261 | val_loss: 0.031146 | Time: 3246.02 ms [2022-04-10 20:31:24 main:574] : INFO : Epoch 1864 | loss: 0.0311274 | val_loss: 0.0311451 | Time: 3183.2 ms [2022-04-10 20:31:27 main:574] : INFO : Epoch 1865 | loss: 0.0311281 | val_loss: 0.0311572 | Time: 3208.48 ms [2022-04-10 20:31:30 main:574] : INFO : Epoch 1866 | loss: 0.0311361 | val_loss: 0.0311489 | Time: 3215.04 ms [2022-04-10 20:31:33 main:574] : INFO : Epoch 1867 | loss: 0.031134 | val_loss: 0.0311506 | Time: 3239.61 ms [2022-04-10 20:31:36 main:574] : INFO : Epoch 1868 | loss: 0.0311329 | val_loss: 0.0311615 | Time: 3233.63 ms [2022-04-10 20:31:40 main:574] : INFO : Epoch 1869 | loss: 0.0311334 | val_loss: 0.0311532 | Time: 3224.17 ms [2022-04-10 20:31:43 main:574] : INFO : Epoch 1870 | loss: 0.0311304 | val_loss: 0.0311513 | Time: 3210.29 ms [2022-04-10 20:31:46 main:574] : INFO : Epoch 1871 | loss: 0.0311312 | val_loss: 0.0311495 | Time: 3226.21 ms [2022-04-10 20:31:49 main:574] : INFO : Epoch 1872 | loss: 0.03113 | val_loss: 0.031151 | Time: 3247.7 ms [2022-04-10 20:31:53 main:574] : INFO : Epoch 1873 | loss: 0.0311293 | val_loss: 0.0311471 | Time: 3250.16 ms [2022-04-10 20:31:56 main:574] : INFO : Epoch 1874 | loss: 0.0311282 | val_loss: 0.031149 | Time: 3169.96 ms [2022-04-10 20:31:59 main:574] : INFO : Epoch 1875 | loss: 0.0311289 | val_loss: 0.0311481 | Time: 3261.15 ms [2022-04-10 20:32:02 main:574] : INFO : Epoch 1876 | loss: 0.0311289 | val_loss: 0.0311557 | Time: 3212 ms [2022-04-10 20:32:06 main:574] : INFO : Epoch 1877 | loss: 0.0311391 | val_loss: 0.0311525 | Time: 3256.26 ms [2022-04-10 20:32:09 main:574] : INFO : Epoch 1878 | loss: 0.031141 | val_loss: 0.0311517 | Time: 3253.34 ms [2022-04-10 20:32:12 main:574] : INFO : Epoch 1879 | loss: 0.0311357 | val_loss: 0.0311502 | Time: 3186.71 ms [2022-04-10 20:32:15 main:574] : INFO : Epoch 1880 | loss: 0.0311367 | val_loss: 0.0311506 | Time: 3176.18 ms [2022-04-10 20:32:18 main:574] : INFO : Epoch 1881 | loss: 0.0311382 | val_loss: 0.0311515 | Time: 3195.9 ms [2022-04-10 20:32:22 main:574] : INFO : Epoch 1882 | loss: 0.0311355 | val_loss: 0.0311492 | Time: 3204.54 ms [2022-04-10 20:32:25 main:574] : INFO : Epoch 1883 | loss: 0.0311351 | val_loss: 0.0311508 | Time: 3177.69 ms [2022-04-10 20:32:28 main:574] : INFO : Epoch 1884 | loss: 0.0311336 | val_loss: 0.0311526 | Time: 3150.2 ms [2022-04-10 20:32:31 main:574] : INFO : Epoch 1885 | loss: 0.0311334 | val_loss: 0.0311542 | Time: 3127.55 ms [2022-04-10 20:32:34 main:574] : INFO : Epoch 1886 | loss: 0.0311337 | val_loss: 0.0311535 | Time: 3306.13 ms [2022-04-10 20:32:38 main:574] : INFO : Epoch 1887 | loss: 0.0311321 | val_loss: 0.0311522 | Time: 3285.62 ms [2022-04-10 20:32:41 main:574] : INFO : Epoch 1888 | loss: 0.0311305 | val_loss: 0.0311495 | Time: 3311.34 ms [2022-04-10 20:32:44 main:574] : INFO : Epoch 1889 | loss: 0.03113 | val_loss: 0.0311485 | Time: 3237.88 ms [2022-04-10 20:32:47 main:574] : INFO : Epoch 1890 | loss: 0.0311291 | val_loss: 0.0311494 | Time: 3309.58 ms [2022-04-10 20:32:51 main:574] : INFO : Epoch 1891 | loss: 0.0311311 | val_loss: 0.031153 | Time: 3211.73 ms [2022-04-10 20:32:54 main:574] : INFO : Epoch 1892 | loss: 0.0311308 | val_loss: 0.031148 | Time: 3272.31 ms [2022-04-10 20:32:57 main:574] : INFO : Epoch 1893 | loss: 0.0311278 | val_loss: 0.031147 | Time: 3212.29 ms [2022-04-10 20:33:00 main:574] : INFO : Epoch 1894 | loss: 0.0311263 | val_loss: 0.0311471 | Time: 3260.01 ms [2022-04-10 20:33:04 main:574] : INFO : Epoch 1895 | loss: 0.0311263 | val_loss: 0.0311486 | Time: 3227.79 ms [2022-04-10 20:33:07 main:574] : INFO : Epoch 1896 | loss: 0.0311264 | val_loss: 0.0311492 | Time: 3273.52 ms [2022-04-10 20:33:10 main:574] : INFO : Epoch 1897 | loss: 0.0311259 | val_loss: 0.031149 | Time: 3244.51 ms [2022-04-10 20:33:13 main:574] : INFO : Epoch 1898 | loss: 0.0311266 | val_loss: 0.0311538 | Time: 3207.93 ms [2022-04-10 20:33:17 main:574] : INFO : Epoch 1899 | loss: 0.0311252 | val_loss: 0.0311529 | Time: 3283.26 ms [2022-04-10 20:33:20 main:574] : INFO : Epoch 1900 | loss: 0.0311287 | val_loss: 0.0311528 | Time: 3272.43 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 2080 SUPER) [2022-04-10 20:38:33 main:435] : INFO : Set logging level to 1 [2022-04-10 20:38:33 main:441] : INFO : Running in BOINC Client mode [2022-04-10 20:38:33 main:444] : INFO : Resolving all filenames [2022-04-10 20:38:33 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-10 20:38:33 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-10 20:38:33 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-10 20:38:33 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-10 20:38:33 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-10 20:38:33 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-10 20:38:33 main:474] : INFO : Configuration: [2022-04-10 20:38:33 main:475] : INFO : Model type: GRU [2022-04-10 20:38:33 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-10 20:38:33 main:477] : INFO : Max Epochs: 2048 [2022-04-10 20:38:33 main:478] : INFO : Batch Size: 128 [2022-04-10 20:38:33 main:479] : INFO : Learning Rate: 0.01 [2022-04-10 20:38:33 main:480] : INFO : Patience: 10 [2022-04-10 20:38:33 main:481] : INFO : Hidden Width: 12 [2022-04-10 20:38:33 main:482] : INFO : # Recurrent Layers: 4 [2022-04-10 20:38:33 main:483] : INFO : # Backend Layers: 4 [2022-04-10 20:38:33 main:484] : INFO : # Threads: 1 [2022-04-10 20:38:33 main:486] : INFO : Preparing Dataset [2022-04-10 20:38:33 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-10 20:38:33 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-10 20:38:34 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-10 20:38:34 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-10 20:38:34 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-10 20:38:34 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-10 20:38:34 main:494] : INFO : Creating Model [2022-04-10 20:38:34 main:507] : INFO : Preparing config file [2022-04-10 20:38:34 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-10 20:38:34 main:512] : INFO : Loading config [2022-04-10 20:38:34 main:514] : INFO : Loading state [2022-04-10 20:38:35 main:559] : INFO : Loading DataLoader into Memory [2022-04-10 20:38:35 main:562] : INFO : Starting Training [2022-04-10 20:38:38 main:574] : INFO : Epoch 1844 | loss: 0.0313103 | val_loss: 0.0312203 | Time: 3242.88 ms [2022-04-10 20:38:41 main:574] : INFO : Epoch 1845 | loss: 0.0311639 | val_loss: 0.031169 | Time: 3104.31 ms [2022-04-10 20:38:45 main:574] : INFO : Epoch 1846 | loss: 0.031136 | val_loss: 0.0311505 | Time: 3182.86 ms [2022-04-10 20:38:48 main:574] : INFO : Epoch 1847 | loss: 0.0311317 | val_loss: 0.0311538 | Time: 3314.22 ms [2022-04-10 20:38:51 main:574] : INFO : Epoch 1848 | loss: 0.0311314 | val_loss: 0.0311518 | Time: 3205.91 ms [2022-04-10 20:38:54 main:574] : INFO : Epoch 1849 | loss: 0.0311296 | val_loss: 0.031155 | Time: 3290.38 ms [2022-04-10 20:38:58 main:574] : INFO : Epoch 1850 | loss: 0.0311281 | val_loss: 0.0311495 | Time: 3244.5 ms [2022-04-10 20:39:01 main:574] : INFO : Epoch 1851 | loss: 0.0311289 | val_loss: 0.0311514 | Time: 3276.68 ms [2022-04-10 20:39:04 main:574] : INFO : Epoch 1852 | loss: 0.0311303 | val_loss: 0.0311517 | Time: 3253.97 ms [2022-04-10 20:39:07 main:574] : INFO : Epoch 1853 | loss: 0.0311299 | val_loss: 0.0311529 | Time: 3255.22 ms [2022-04-10 20:39:11 main:574] : INFO : Epoch 1854 | loss: 0.0311278 | val_loss: 0.0311533 | Time: 3184.25 ms [2022-04-10 20:39:14 main:574] : INFO : Epoch 1855 | loss: 0.0311275 | val_loss: 0.0311523 | Time: 3254.77 ms [2022-04-10 20:39:17 main:574] : INFO : Epoch 1856 | loss: 0.031135 | val_loss: 0.0311537 | Time: 3260.72 ms [2022-04-10 20:39:20 main:574] : INFO : Epoch 1857 | loss: 0.031134 | val_loss: 0.0311503 | Time: 3257.04 ms [2022-04-10 20:39:24 main:574] : INFO : Epoch 1858 | loss: 0.03113 | val_loss: 0.031148 | Time: 3204.53 ms [2022-04-10 20:39:27 main:574] : INFO : Epoch 1859 | loss: 0.03113 | val_loss: 0.0311489 | Time: 3346.04 ms [2022-04-10 20:39:30 main:574] : INFO : Epoch 1860 | loss: 0.0311288 | val_loss: 0.0311487 | Time: 3221.49 ms [2022-04-10 20:39:34 main:574] : INFO : Epoch 1861 | loss: 0.0311272 | val_loss: 0.0311515 | Time: 3309.23 ms [2022-04-10 20:39:37 main:574] : INFO : Epoch 1862 | loss: 0.0311294 | val_loss: 0.0311569 | Time: 3158.2 ms [2022-04-10 20:39:40 main:574] : INFO : Epoch 1863 | loss: 0.0311282 | val_loss: 0.0311481 | Time: 3232.94 ms [2022-04-10 20:39:43 main:574] : INFO : Epoch 1864 | loss: 0.0311275 | val_loss: 0.0311504 | Time: 3178.21 ms [2022-04-10 20:39:46 main:574] : INFO : Epoch 1865 | loss: 0.0311257 | val_loss: 0.0311487 | Time: 3373.06 ms [2022-04-10 20:39:50 main:574] : INFO : Epoch 1866 | loss: 0.0311247 | val_loss: 0.0311523 | Time: 3314.1 ms [2022-04-10 20:39:53 main:574] : INFO : Epoch 1867 | loss: 0.0311256 | val_loss: 0.0311516 | Time: 3266.48 ms [2022-04-10 20:39:56 main:574] : INFO : Epoch 1868 | loss: 0.0311291 | val_loss: 0.031152 | Time: 3169.06 ms [2022-04-10 20:39:59 main:574] : INFO : Epoch 1869 | loss: 0.0311332 | val_loss: 0.0311513 | Time: 3260.17 ms [2022-04-10 20:40:03 main:574] : INFO : Epoch 1870 | loss: 0.031133 | val_loss: 0.0311483 | Time: 3211.44 ms [2022-04-10 20:40:06 main:574] : INFO : Epoch 1871 | loss: 0.0311326 | val_loss: 0.0311496 | Time: 3222.96 ms [2022-04-10 20:40:09 main:574] : INFO : Epoch 1872 | loss: 0.0311304 | val_loss: 0.0311468 | Time: 3205.37 ms [2022-04-10 20:40:12 main:574] : INFO : Epoch 1873 | loss: 0.0311316 | val_loss: 0.0311469 | Time: 3243.41 ms [2022-04-10 20:40:16 main:574] : INFO : Epoch 1874 | loss: 0.0311334 | val_loss: 0.0311486 | Time: 3272.34 ms [2022-04-10 20:40:19 main:574] : INFO : Epoch 1875 | loss: 0.0311376 | val_loss: 0.0311503 | Time: 3338.36 ms [2022-04-10 20:40:22 main:574] : INFO : Epoch 1876 | loss: 0.0311351 | val_loss: 0.0311473 | Time: 3270.85 ms [2022-04-10 20:40:25 main:574] : INFO : Epoch 1877 | loss: 0.0311312 | val_loss: 0.0311475 | Time: 3212.2 ms [2022-04-10 20:40:29 main:574] : INFO : Epoch 1878 | loss: 0.0311302 | val_loss: 0.0311494 | Time: 3249.31 ms [2022-04-10 20:40:32 main:574] : INFO : Epoch 1879 | loss: 0.0311288 | val_loss: 0.0311494 | Time: 3308.32 ms [2022-04-10 20:40:35 main:574] : INFO : Epoch 1880 | loss: 0.0311282 | val_loss: 0.0311498 | Time: 3373.87 ms [2022-04-10 20:40:39 main:574] : INFO : Epoch 1881 | loss: 0.0311267 | val_loss: 0.031148 | Time: 3262.99 ms [2022-04-10 20:40:42 main:574] : INFO : Epoch 1882 | loss: 0.0311256 | val_loss: 0.0311482 | Time: 3169.92 ms [2022-04-10 20:40:45 main:574] : INFO : Epoch 1883 | loss: 0.0311285 | val_loss: 0.0311505 | Time: 3254.85 ms [2022-04-10 20:40:48 main:574] : INFO : Epoch 1884 | loss: 0.0311285 | val_loss: 0.0311499 | Time: 3219.36 ms [2022-04-10 20:40:52 main:574] : INFO : Epoch 1885 | loss: 0.0311273 | val_loss: 0.0311512 | Time: 3211.78 ms [2022-04-10 20:40:55 main:574] : INFO : Epoch 1886 | loss: 0.03113 | val_loss: 0.03115 | Time: 3223.85 ms [2022-04-10 20:40:58 main:574] : INFO : Epoch 1887 | loss: 0.0311293 | val_loss: 0.0311478 | Time: 3290.97 ms [2022-04-10 20:41:01 main:574] : INFO : Epoch 1888 | loss: 0.031129 | val_loss: 0.031149 | Time: 3174.36 ms [2022-04-10 20:41:04 main:574] : INFO : Epoch 1889 | loss: 0.0311295 | val_loss: 0.0311496 | Time: 3213.34 ms [2022-04-10 20:41:08 main:574] : INFO : Epoch 1890 | loss: 0.0311296 | val_loss: 0.0311496 | Time: 3213.48 ms [2022-04-10 20:41:11 main:574] : INFO : Epoch 1891 | loss: 0.031129 | val_loss: 0.0311461 | Time: 3283.2 ms [2022-04-10 20:41:14 main:574] : INFO : Epoch 1892 | loss: 0.0311291 | val_loss: 0.0311451 | Time: 3122.06 ms [2022-04-10 20:41:17 main:574] : INFO : Epoch 1893 | loss: 0.0311288 | val_loss: 0.0311461 | Time: 3205.33 ms [2022-04-10 20:41:20 main:574] : INFO : Epoch 1894 | loss: 0.0311281 | val_loss: 0.0311492 | Time: 3049.53 ms [2022-04-10 20:41:24 main:574] : INFO : Epoch 1895 | loss: 0.031126 | val_loss: 0.0311484 | Time: 3231.81 ms [2022-04-10 20:41:27 main:574] : INFO : Epoch 1896 | loss: 0.0311253 | val_loss: 0.0311497 | Time: 3201.47 ms [2022-04-10 20:41:30 main:574] : INFO : Epoch 1897 | loss: 0.0311254 | val_loss: 0.0311478 | Time: 3168.92 ms [2022-04-10 20:41:33 main:574] : INFO : Epoch 1898 | loss: 0.0311284 | val_loss: 0.0311449 | Time: 3201.34 ms [2022-04-10 20:41:36 main:574] : INFO : Epoch 1899 | loss: 0.0311267 | val_loss: 0.0311467 | Time: 3127.37 ms [2022-04-10 20:41:39 main:574] : INFO : Epoch 1900 | loss: 0.0311255 | val_loss: 0.03115 | Time: 3123.08 ms [2022-04-10 20:41:43 main:574] : INFO : Epoch 1901 | loss: 0.0311255 | val_loss: 0.0311484 | Time: 3158.91 ms [2022-04-10 20:41:46 main:574] : INFO : Epoch 1902 | loss: 0.0311279 | val_loss: 0.0311501 | Time: 3082.69 ms [2022-04-10 20:41:49 main:574] : INFO : Epoch 1903 | loss: 0.0311282 | val_loss: 0.031147 | Time: 3218.83 ms [2022-04-10 20:41:52 main:574] : INFO : Epoch 1904 | loss: 0.0311327 | val_loss: 0.0311539 | Time: 3187.01 ms [2022-04-10 20:41:55 main:574] : INFO : Epoch 1905 | loss: 0.0311309 | val_loss: 0.0311547 | Time: 3148.73 ms [2022-04-10 20:41:58 main:574] : INFO : Epoch 1906 | loss: 0.0311332 | val_loss: 0.0311519 | Time: 3105.24 ms [2022-04-10 20:42:02 main:574] : INFO : Epoch 1907 | loss: 0.0311297 | val_loss: 0.0311495 | Time: 3158.06 ms [2022-04-10 20:42:05 main:574] : INFO : Epoch 1908 | loss: 0.0311268 | val_loss: 0.0311528 | Time: 3375.86 ms [2022-04-10 20:42:08 main:574] : INFO : Epoch 1909 | loss: 0.0311259 | val_loss: 0.0311476 | Time: 3280.71 ms [2022-04-10 20:42:11 main:574] : INFO : Epoch 1910 | loss: 0.031125 | val_loss: 0.0311503 | Time: 3180.94 ms [2022-04-10 20:42:15 main:574] : INFO : Epoch 1911 | loss: 0.0311266 | val_loss: 0.0311457 | Time: 3281.13 ms [2022-04-10 20:42:18 main:574] : INFO : Epoch 1912 | loss: 0.0311283 | val_loss: 0.0311475 | Time: 3141.78 ms [2022-04-10 20:42:21 main:574] : INFO : Epoch 1913 | loss: 0.0311275 | val_loss: 0.0311498 | Time: 3203.76 ms [2022-04-10 20:42:24 main:574] : INFO : Epoch 1914 | loss: 0.0311256 | val_loss: 0.0311497 | Time: 3161.74 ms [2022-04-10 20:42:27 main:574] : INFO : Epoch 1915 | loss: 0.0311266 | val_loss: 0.0311489 | Time: 3181.42 ms [2022-04-10 20:42:31 main:574] : INFO : Epoch 1916 | loss: 0.0311242 | val_loss: 0.0311504 | Time: 3268.97 ms [2022-04-10 20:42:34 main:574] : INFO : Epoch 1917 | loss: 0.031124 | val_loss: 0.0311489 | Time: 3206.33 ms [2022-04-10 20:42:37 main:574] : INFO : Epoch 1918 | loss: 0.0311295 | val_loss: 0.0311472 | Time: 3203 ms [2022-04-10 20:42:40 main:574] : INFO : Epoch 1919 | loss: 0.0311275 | val_loss: 0.0311478 | Time: 3108.36 ms [2022-04-10 20:42:43 main:574] : INFO : Epoch 1920 | loss: 0.0311273 | val_loss: 0.0311449 | Time: 3233.26 ms [2022-04-10 20:42:47 main:574] : INFO : Epoch 1921 | loss: 0.0311292 | val_loss: 0.0311474 | Time: 3203.67 ms [2022-04-10 20:42:50 main:574] : INFO : Epoch 1922 | loss: 0.0311277 | val_loss: 0.0311481 | Time: 3228.98 ms [2022-04-10 20:42:53 main:574] : INFO : Epoch 1923 | loss: 0.0311264 | val_loss: 0.0311477 | Time: 3247.33 ms [2022-04-10 20:42:56 main:574] : INFO : Epoch 1924 | loss: 0.031123 | val_loss: 0.0311534 | Time: 3147.19 ms [2022-04-10 20:42:59 main:574] : INFO : Epoch 1925 | loss: 0.0311294 | val_loss: 0.0311506 | Time: 3213.93 ms [2022-04-10 20:43:03 main:574] : INFO : Epoch 1926 | loss: 0.0311333 | val_loss: 0.0311482 | Time: 3196.95 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 2080 SUPER) [2022-04-10 20:46:07 main:435] : INFO : Set logging level to 1 [2022-04-10 20:46:07 main:441] : INFO : Running in BOINC Client mode [2022-04-10 20:46:07 main:444] : INFO : Resolving all filenames [2022-04-10 20:46:07 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-10 20:46:07 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-10 20:46:07 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-10 20:46:07 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-10 20:46:07 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-10 20:46:07 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-10 20:46:07 main:474] : INFO : Configuration: [2022-04-10 20:46:07 main:475] : INFO : Model type: GRU [2022-04-10 20:46:07 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-10 20:46:07 main:477] : INFO : Max Epochs: 2048 [2022-04-10 20:46:07 main:478] : INFO : Batch Size: 128 [2022-04-10 20:46:07 main:479] : INFO : Learning Rate: 0.01 [2022-04-10 20:46:07 main:480] : INFO : Patience: 10 [2022-04-10 20:46:07 main:481] : INFO : Hidden Width: 12 [2022-04-10 20:46:07 main:482] : INFO : # Recurrent Layers: 4 [2022-04-10 20:46:07 main:483] : INFO : # Backend Layers: 4 [2022-04-10 20:46:07 main:484] : INFO : # Threads: 1 [2022-04-10 20:46:07 main:486] : INFO : Preparing Dataset [2022-04-10 20:46:07 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-10 20:46:07 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-10 20:46:09 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-10 20:46:09 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-10 20:46:09 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-10 20:46:09 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-10 20:46:09 main:494] : INFO : Creating Model [2022-04-10 20:46:09 main:507] : INFO : Preparing config file [2022-04-10 20:46:09 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-10 20:46:09 main:512] : INFO : Loading config [2022-04-10 20:46:09 main:514] : INFO : Loading state [2022-04-10 20:46:10 main:559] : INFO : Loading DataLoader into Memory [2022-04-10 20:46:10 main:562] : INFO : Starting Training [2022-04-10 20:46:13 main:574] : INFO : Epoch 1904 | loss: 0.0312137 | val_loss: 0.0311633 | Time: 3303.54 ms [2022-04-10 20:46:16 main:574] : INFO : Epoch 1905 | loss: 0.0311392 | val_loss: 0.0311497 | Time: 3095.53 ms [2022-04-10 20:46:19 main:574] : INFO : Epoch 1906 | loss: 0.0311325 | val_loss: 0.0311462 | Time: 3094.72 ms [2022-04-10 20:46:22 main:574] : INFO : Epoch 1907 | loss: 0.0311292 | val_loss: 0.0311498 | Time: 3298.16 ms [2022-04-10 20:46:26 main:574] : INFO : Epoch 1908 | loss: 0.031128 | val_loss: 0.031149 | Time: 3199.64 ms [2022-04-10 20:46:29 main:574] : INFO : Epoch 1909 | loss: 0.0311286 | val_loss: 0.0311477 | Time: 3253.1 ms [2022-04-10 20:46:32 main:574] : INFO : Epoch 1910 | loss: 0.0311278 | val_loss: 0.0311473 | Time: 3272.14 ms [2022-04-10 20:46:35 main:574] : INFO : Epoch 1911 | loss: 0.031129 | val_loss: 0.0311485 | Time: 3253.15 ms [2022-04-10 20:46:39 main:574] : INFO : Epoch 1912 | loss: 0.0311271 | val_loss: 0.0311515 | Time: 3243.69 ms [2022-04-10 20:46:42 main:574] : INFO : Epoch 1913 | loss: 0.0311266 | val_loss: 0.0311482 | Time: 3201.93 ms [2022-04-10 20:46:45 main:574] : INFO : Epoch 1914 | loss: 0.0311284 | val_loss: 0.0311541 | Time: 3386.17 ms [2022-04-10 20:46:49 main:574] : INFO : Epoch 1915 | loss: 0.0311265 | val_loss: 0.0311448 | Time: 3254.57 ms [2022-04-10 20:46:52 main:574] : INFO : Epoch 1916 | loss: 0.0311248 | val_loss: 0.0311479 | Time: 3247.62 ms [2022-04-10 20:46:55 main:574] : INFO : Epoch 1917 | loss: 0.0311275 | val_loss: 0.0311474 | Time: 3197.75 ms [2022-04-10 20:46:58 main:574] : INFO : Epoch 1918 | loss: 0.0311295 | val_loss: 0.0311481 | Time: 3294.1 ms [2022-04-10 20:47:01 main:574] : INFO : Epoch 1919 | loss: 0.0311264 | val_loss: 0.0311481 | Time: 3173.67 ms [2022-04-10 20:47:05 main:574] : INFO : Epoch 1920 | loss: 0.0311254 | val_loss: 0.0311466 | Time: 3277.83 ms [2022-04-10 20:47:08 main:574] : INFO : Epoch 1921 | loss: 0.0311253 | val_loss: 0.0311494 | Time: 3257.65 ms [2022-04-10 20:47:11 main:574] : INFO : Epoch 1922 | loss: 0.031126 | val_loss: 0.0311457 | Time: 3287.51 ms [2022-04-10 20:47:15 main:574] : INFO : Epoch 1923 | loss: 0.031125 | val_loss: 0.0311466 | Time: 3264.94 ms [2022-04-10 20:47:18 main:574] : INFO : Epoch 1924 | loss: 0.0311249 | val_loss: 0.0311427 | Time: 3236.51 ms [2022-04-10 20:47:21 main:574] : INFO : Epoch 1925 | loss: 0.0311222 | val_loss: 0.0311457 | Time: 3217.96 ms [2022-04-10 20:47:24 main:574] : INFO : Epoch 1926 | loss: 0.0311216 | val_loss: 0.0311445 | Time: 3267.45 ms [2022-04-10 20:47:28 main:574] : INFO : Epoch 1927 | loss: 0.0311279 | val_loss: 0.0311479 | Time: 3302.08 ms [2022-04-10 20:47:31 main:574] : INFO : Epoch 1928 | loss: 0.0311243 | val_loss: 0.0311502 | Time: 3264.12 ms [2022-04-10 20:47:34 main:574] : INFO : Epoch 1929 | loss: 0.0311265 | val_loss: 0.0311502 | Time: 3292.05 ms [2022-04-10 20:47:37 main:574] : INFO : Epoch 1930 | loss: 0.0311255 | val_loss: 0.0311493 | Time: 3310.86 ms [2022-04-10 20:47:41 main:574] : INFO : Epoch 1931 | loss: 0.031127 | val_loss: 0.0311496 | Time: 3222.72 ms [2022-04-10 20:47:44 main:574] : INFO : Epoch 1932 | loss: 0.0311281 | val_loss: 0.0311439 | Time: 3238.98 ms [2022-04-10 20:47:47 main:574] : INFO : Epoch 1933 | loss: 0.0311256 | val_loss: 0.0311469 | Time: 3204.1 ms [2022-04-10 20:47:50 main:574] : INFO : Epoch 1934 | loss: 0.0311246 | val_loss: 0.0311473 | Time: 3167.71 ms [2022-04-10 20:47:54 main:574] : INFO : Epoch 1935 | loss: 0.0311278 | val_loss: 0.0311501 | Time: 3279.56 ms [2022-04-10 20:47:57 main:574] : INFO : Epoch 1936 | loss: 0.0311248 | val_loss: 0.0311476 | Time: 3222.75 ms [2022-04-10 20:48:00 main:574] : INFO : Epoch 1937 | loss: 0.0311247 | val_loss: 0.0311487 | Time: 3375.08 ms [2022-04-10 20:48:03 main:574] : INFO : Epoch 1938 | loss: 0.0311242 | val_loss: 0.0311466 | Time: 3177.91 ms [2022-04-10 20:48:07 main:574] : INFO : Epoch 1939 | loss: 0.0311231 | val_loss: 0.0311479 | Time: 3243.14 ms [2022-04-10 20:48:10 main:574] : INFO : Epoch 1940 | loss: 0.0311244 | val_loss: 0.0311469 | Time: 3212.38 ms [2022-04-10 20:48:13 main:574] : INFO : Epoch 1941 | loss: 0.0311256 | val_loss: 0.0311499 | Time: 3279.58 ms [2022-04-10 20:48:16 main:574] : INFO : Epoch 1942 | loss: 0.0311268 | val_loss: 0.031153 | Time: 3270.21 ms [2022-04-10 20:48:20 main:574] : INFO : Epoch 1943 | loss: 0.0311279 | val_loss: 0.0311509 | Time: 3138.98 ms [2022-04-10 20:48:23 main:574] : INFO : Epoch 1944 | loss: 0.0311303 | val_loss: 0.0311467 | Time: 3233.19 ms [2022-04-10 20:48:26 main:574] : INFO : Epoch 1945 | loss: 0.0311276 | val_loss: 0.0311483 | Time: 3251.11 ms [2022-04-10 20:48:29 main:574] : INFO : Epoch 1946 | loss: 0.031127 | val_loss: 0.0311473 | Time: 3177.97 ms [2022-04-10 20:48:32 main:574] : INFO : Epoch 1947 | loss: 0.0311256 | val_loss: 0.0311457 | Time: 3219.54 ms [2022-04-10 20:48:36 main:574] : INFO : Epoch 1948 | loss: 0.0311281 | val_loss: 0.0311478 | Time: 3263.31 ms [2022-04-10 20:48:39 main:574] : INFO : Epoch 1949 | loss: 0.0311264 | val_loss: 0.0311504 | Time: 3195.14 ms [2022-04-10 20:48:42 main:574] : INFO : Epoch 1950 | loss: 0.0311256 | val_loss: 0.0311496 | Time: 3177.51 ms [2022-04-10 20:48:45 main:574] : INFO : Epoch 1951 | loss: 0.0311262 | val_loss: 0.0311568 | Time: 3223.38 ms [2022-04-10 20:48:49 main:574] : INFO : Epoch 1952 | loss: 0.0311266 | val_loss: 0.0311507 | Time: 3185.74 ms [2022-04-10 20:48:52 main:574] : INFO : Epoch 1953 | loss: 0.0311228 | val_loss: 0.0311477 | Time: 3290.93 ms [2022-04-10 20:48:55 main:574] : INFO : Epoch 1954 | loss: 0.0311243 | val_loss: 0.0311481 | Time: 3256.26 ms [2022-04-10 20:48:58 main:574] : INFO : Epoch 1955 | loss: 0.0311243 | val_loss: 0.0311478 | Time: 3159.23 ms [2022-04-10 20:49:01 main:574] : INFO : Epoch 1956 | loss: 0.0311233 | val_loss: 0.0311449 | Time: 3228.33 ms [2022-04-10 20:49:05 main:574] : INFO : Epoch 1957 | loss: 0.0311215 | val_loss: 0.0311459 | Time: 3285.84 ms [2022-04-10 20:49:08 main:574] : INFO : Epoch 1958 | loss: 0.0311231 | val_loss: 0.0311473 | Time: 3215.52 ms [2022-04-10 20:49:11 main:574] : INFO : Epoch 1959 | loss: 0.031121 | val_loss: 0.031148 | Time: 3228.9 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 2080 SUPER) [2022-04-10 20:52:12 main:435] : INFO : Set logging level to 1 [2022-04-10 20:52:12 main:441] : INFO : Running in BOINC Client mode [2022-04-10 20:52:12 main:444] : INFO : Resolving all filenames [2022-04-10 20:52:12 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-10 20:52:12 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-10 20:52:12 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-10 20:52:12 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-10 20:52:12 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-10 20:52:12 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-10 20:52:12 main:474] : INFO : Configuration: [2022-04-10 20:52:12 main:475] : INFO : Model type: GRU [2022-04-10 20:52:12 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-10 20:52:12 main:477] : INFO : Max Epochs: 2048 [2022-04-10 20:52:12 main:478] : INFO : Batch Size: 128 [2022-04-10 20:52:12 main:479] : INFO : Learning Rate: 0.01 [2022-04-10 20:52:12 main:480] : INFO : Patience: 10 [2022-04-10 20:52:12 main:481] : INFO : Hidden Width: 12 [2022-04-10 20:52:12 main:482] : INFO : # Recurrent Layers: 4 [2022-04-10 20:52:12 main:483] : INFO : # Backend Layers: 4 [2022-04-10 20:52:12 main:484] : INFO : # Threads: 1 [2022-04-10 20:52:12 main:486] : INFO : Preparing Dataset [2022-04-10 20:52:12 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-10 20:52:12 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-10 20:52:13 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-10 20:52:13 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-10 20:52:13 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-10 20:52:13 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-10 20:52:13 main:494] : INFO : Creating Model [2022-04-10 20:52:13 main:507] : INFO : Preparing config file [2022-04-10 20:52:13 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-10 20:52:13 main:512] : INFO : Loading config [2022-04-10 20:52:13 main:514] : INFO : Loading state [2022-04-10 20:52:14 main:559] : INFO : Loading DataLoader into Memory [2022-04-10 20:52:14 main:562] : INFO : Starting Training [2022-04-10 20:52:17 main:574] : INFO : Epoch 1904 | loss: 0.0312174 | val_loss: 0.0311581 | Time: 3098.34 ms [2022-04-10 20:52:20 main:574] : INFO : Epoch 1905 | loss: 0.0311376 | val_loss: 0.0311511 | Time: 2972.68 ms [2022-04-10 20:52:23 main:574] : INFO : Epoch 1906 | loss: 0.0311294 | val_loss: 0.0311481 | Time: 2991.93 ms [2022-04-10 20:52:26 main:574] : INFO : Epoch 1907 | loss: 0.0311281 | val_loss: 0.0311489 | Time: 2981.46 ms [2022-04-10 20:52:29 main:574] : INFO : Epoch 1908 | loss: 0.0311298 | val_loss: 0.0311515 | Time: 2899.08 ms [2022-04-10 20:52:32 main:574] : INFO : Epoch 1909 | loss: 0.0311281 | val_loss: 0.0311507 | Time: 3074.58 ms [2022-04-10 20:52:35 main:574] : INFO : Epoch 1910 | loss: 0.031128 | val_loss: 0.0311508 | Time: 3052.27 ms [2022-04-10 20:52:38 main:574] : INFO : Epoch 1911 | loss: 0.031127 | val_loss: 0.0311478 | Time: 3108.13 ms [2022-04-10 20:52:41 main:574] : INFO : Epoch 1912 | loss: 0.0311248 | val_loss: 0.0311504 | Time: 3085.75 ms [2022-04-10 20:52:44 main:574] : INFO : Epoch 1913 | loss: 0.0311276 | val_loss: 0.0311514 | Time: 3062.24 ms [2022-04-10 20:52:47 main:574] : INFO : Epoch 1914 | loss: 0.0311252 | val_loss: 0.0311494 | Time: 3013.56 ms [2022-04-10 20:52:50 main:574] : INFO : Epoch 1915 | loss: 0.0311281 | val_loss: 0.0311493 | Time: 3136.41 ms [2022-04-10 20:52:54 main:574] : INFO : Epoch 1916 | loss: 0.0311282 | val_loss: 0.0311507 | Time: 3061.63 ms [2022-04-10 20:52:57 main:574] : INFO : Epoch 1917 | loss: 0.0311276 | val_loss: 0.0311525 | Time: 3120.87 ms [2022-04-10 20:53:00 main:574] : INFO : Epoch 1918 | loss: 0.0311249 | val_loss: 0.0311489 | Time: 3012.55 ms [2022-04-10 20:53:03 main:574] : INFO : Epoch 1919 | loss: 0.0311232 | val_loss: 0.0311495 | Time: 3086.2 ms [2022-04-10 20:53:06 main:574] : INFO : Epoch 1920 | loss: 0.0311254 | val_loss: 0.0311483 | Time: 3157.51 ms [2022-04-10 20:53:09 main:574] : INFO : Epoch 1921 | loss: 0.0311257 | val_loss: 0.0311491 | Time: 3149.67 ms [2022-04-10 20:53:12 main:574] : INFO : Epoch 1922 | loss: 0.0311264 | val_loss: 0.0311495 | Time: 3105.71 ms [2022-04-10 20:53:15 main:574] : INFO : Epoch 1923 | loss: 0.0311254 | val_loss: 0.0311484 | Time: 3108.02 ms [2022-04-10 20:53:18 main:574] : INFO : Epoch 1924 | loss: 0.0311255 | val_loss: 0.0311489 | Time: 3112.73 ms [2022-04-10 20:53:22 main:574] : INFO : Epoch 1925 | loss: 0.031124 | val_loss: 0.0311481 | Time: 3094.29 ms [2022-04-10 20:53:25 main:574] : INFO : Epoch 1926 | loss: 0.0311355 | val_loss: 0.0311506 | Time: 3026.39 ms [2022-04-10 20:53:28 main:574] : INFO : Epoch 1927 | loss: 0.0311375 | val_loss: 0.0311522 | Time: 3141.9 ms [2022-04-10 20:53:31 main:574] : INFO : Epoch 1928 | loss: 0.0311351 | val_loss: 0.0311565 | Time: 3039.14 ms [2022-04-10 20:53:34 main:574] : INFO : Epoch 1929 | loss: 0.0311359 | val_loss: 0.0311547 | Time: 3148.28 ms [2022-04-10 20:53:37 main:574] : INFO : Epoch 1930 | loss: 0.0311339 | val_loss: 0.031153 | Time: 3052.58 ms [2022-04-10 20:53:40 main:574] : INFO : Epoch 1931 | loss: 0.0311315 | val_loss: 0.0311522 | Time: 3039.2 ms [2022-04-10 20:53:43 main:574] : INFO : Epoch 1932 | loss: 0.031131 | val_loss: 0.03115 | Time: 3096.77 ms [2022-04-10 20:53:46 main:574] : INFO : Epoch 1933 | loss: 0.0311293 | val_loss: 0.0311546 | Time: 3108.33 ms [2022-04-10 20:53:49 main:574] : INFO : Epoch 1934 | loss: 0.0311312 | val_loss: 0.0311514 | Time: 3137.18 ms [2022-04-10 20:53:52 main:574] : INFO : Epoch 1935 | loss: 0.0311299 | val_loss: 0.0311566 | Time: 3111.37 ms [2022-04-10 20:53:56 main:574] : INFO : Epoch 1936 | loss: 0.0311304 | val_loss: 0.0311507 | Time: 3124.97 ms [2022-04-10 20:53:59 main:574] : INFO : Epoch 1937 | loss: 0.0311317 | val_loss: 0.0311537 | Time: 3006.97 ms [2022-04-10 20:54:02 main:574] : INFO : Epoch 1938 | loss: 0.0311309 | val_loss: 0.0311511 | Time: 3094.42 ms [2022-04-10 20:54:05 main:574] : INFO : Epoch 1939 | loss: 0.031129 | val_loss: 0.0311517 | Time: 3146.45 ms [2022-04-10 20:54:08 main:574] : INFO : Epoch 1940 | loss: 0.0311308 | val_loss: 0.0311536 | Time: 3057.1 ms [2022-04-10 20:54:11 main:574] : INFO : Epoch 1941 | loss: 0.031129 | val_loss: 0.0311516 | Time: 3103.6 ms [2022-04-10 20:54:14 main:574] : INFO : Epoch 1942 | loss: 0.0311294 | val_loss: 0.031154 | Time: 3337.22 ms [2022-04-10 20:54:17 main:574] : INFO : Epoch 1943 | loss: 0.0311292 | val_loss: 0.0311541 | Time: 3125.13 ms [2022-04-10 20:54:21 main:574] : INFO : Epoch 1944 | loss: 0.0311261 | val_loss: 0.0311519 | Time: 3156.29 ms [2022-04-10 20:54:24 main:574] : INFO : Epoch 1945 | loss: 0.0311264 | val_loss: 0.0311518 | Time: 3014.21 ms [2022-04-10 20:54:27 main:574] : INFO : Epoch 1946 | loss: 0.0311264 | val_loss: 0.0311518 | Time: 3014.12 ms [2022-04-10 20:54:30 main:574] : INFO : Epoch 1947 | loss: 0.0311262 | val_loss: 0.0311519 | Time: 3075.31 ms [2022-04-10 20:54:33 main:574] : INFO : Epoch 1948 | loss: 0.0311276 | val_loss: 0.0311541 | Time: 3012.93 ms [2022-04-10 20:54:36 main:574] : INFO : Epoch 1949 | loss: 0.0311282 | val_loss: 0.0311533 | Time: 3022.33 ms [2022-04-10 20:54:39 main:574] : INFO : Epoch 1950 | loss: 0.0311296 | val_loss: 0.0311546 | Time: 3129.19 ms [2022-04-10 20:54:42 main:574] : INFO : Epoch 1951 | loss: 0.0311309 | val_loss: 0.031155 | Time: 3055.2 ms [2022-04-10 20:54:45 main:574] : INFO : Epoch 1952 | loss: 0.0311325 | val_loss: 0.0311513 | Time: 3086.22 ms [2022-04-10 20:54:48 main:574] : INFO : Epoch 1953 | loss: 0.0311304 | val_loss: 0.0311552 | Time: 3046.47 ms [2022-04-10 20:54:51 main:574] : INFO : Epoch 1954 | loss: 0.0311299 | val_loss: 0.0311513 | Time: 3124.57 ms [2022-04-10 20:54:54 main:574] : INFO : Epoch 1955 | loss: 0.0311287 | val_loss: 0.0311518 | Time: 3059.74 ms [2022-04-10 20:54:57 main:574] : INFO : Epoch 1956 | loss: 0.0311293 | val_loss: 0.0311581 | Time: 3045.03 ms [2022-04-10 20:55:00 main:574] : INFO : Epoch 1957 | loss: 0.0311321 | val_loss: 0.0311576 | Time: 3082.2 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 2080 SUPER) [2022-04-10 21:00:19 main:435] : INFO : Set logging level to 1 [2022-04-10 21:00:19 main:441] : INFO : Running in BOINC Client mode [2022-04-10 21:00:19 main:444] : INFO : Resolving all filenames [2022-04-10 21:00:19 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-10 21:00:19 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-10 21:00:19 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-10 21:00:19 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-10 21:00:19 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-10 21:00:19 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-10 21:00:19 main:474] : INFO : Configuration: [2022-04-10 21:00:19 main:475] : INFO : Model type: GRU [2022-04-10 21:00:19 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-10 21:00:19 main:477] : INFO : Max Epochs: 2048 [2022-04-10 21:00:19 main:478] : INFO : Batch Size: 128 [2022-04-10 21:00:19 main:479] : INFO : Learning Rate: 0.01 [2022-04-10 21:00:19 main:480] : INFO : Patience: 10 [2022-04-10 21:00:19 main:481] : INFO : Hidden Width: 12 [2022-04-10 21:00:19 main:482] : INFO : # Recurrent Layers: 4 [2022-04-10 21:00:19 main:483] : INFO : # Backend Layers: 4 [2022-04-10 21:00:19 main:484] : INFO : # Threads: 1 [2022-04-10 21:00:19 main:486] : INFO : Preparing Dataset [2022-04-10 21:00:19 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-10 21:00:20 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-10 21:00:21 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-10 21:00:21 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-10 21:00:21 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-10 21:00:21 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-10 21:00:21 main:494] : INFO : Creating Model [2022-04-10 21:00:21 main:507] : INFO : Preparing config file [2022-04-10 21:00:21 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-10 21:00:21 main:512] : INFO : Loading config [2022-04-10 21:00:21 main:514] : INFO : Loading state [2022-04-10 21:00:22 main:559] : INFO : Loading DataLoader into Memory [2022-04-10 21:00:22 main:562] : INFO : Starting Training [2022-04-10 21:00:25 main:574] : INFO : Epoch 1904 | loss: 0.0312039 | val_loss: 0.0311669 | Time: 3330.61 ms [2022-04-10 21:00:28 main:574] : INFO : Epoch 1905 | loss: 0.0311438 | val_loss: 0.0311499 | Time: 3113.72 ms [2022-04-10 21:00:32 main:574] : INFO : Epoch 1906 | loss: 0.0311343 | val_loss: 0.0311492 | Time: 3300.61 ms [2022-04-10 21:00:35 main:574] : INFO : Epoch 1907 | loss: 0.0311328 | val_loss: 0.0311477 | Time: 3359.83 ms [2022-04-10 21:00:38 main:574] : INFO : Epoch 1908 | loss: 0.0311306 | val_loss: 0.0311487 | Time: 3280.17 ms [2022-04-10 21:00:42 main:574] : INFO : Epoch 1909 | loss: 0.0311311 | val_loss: 0.0311489 | Time: 3272.59 ms [2022-04-10 21:00:45 main:574] : INFO : Epoch 1910 | loss: 0.0311306 | val_loss: 0.0311502 | Time: 3265.45 ms [2022-04-10 21:00:48 main:574] : INFO : Epoch 1911 | loss: 0.0311287 | val_loss: 0.0311482 | Time: 3332.61 ms [2022-04-10 21:00:51 main:574] : INFO : Epoch 1912 | loss: 0.0311278 | val_loss: 0.0311496 | Time: 3280.59 ms [2022-04-10 21:00:55 main:574] : INFO : Epoch 1913 | loss: 0.0311273 | val_loss: 0.0311487 | Time: 3206.72 ms [2022-04-10 21:00:58 main:574] : INFO : Epoch 1914 | loss: 0.031128 | val_loss: 0.0311511 | Time: 3228.41 ms [2022-04-10 21:01:01 main:574] : INFO : Epoch 1915 | loss: 0.0311278 | val_loss: 0.0311515 | Time: 3310.97 ms [2022-04-10 21:01:04 main:574] : INFO : Epoch 1916 | loss: 0.031126 | val_loss: 0.0311482 | Time: 3283.28 ms [2022-04-10 21:01:08 main:574] : INFO : Epoch 1917 | loss: 0.0311251 | val_loss: 0.03115 | Time: 3316.05 ms [2022-04-10 21:01:11 main:574] : INFO : Epoch 1918 | loss: 0.0311254 | val_loss: 0.0311498 | Time: 3313.1 ms [2022-04-10 21:01:14 main:574] : INFO : Epoch 1919 | loss: 0.0311252 | val_loss: 0.031152 | Time: 3294.16 ms [2022-04-10 21:01:18 main:574] : INFO : Epoch 1920 | loss: 0.0311248 | val_loss: 0.0311517 | Time: 3257.25 ms [2022-04-10 21:01:21 main:574] : INFO : Epoch 1921 | loss: 0.0311249 | val_loss: 0.0311467 | Time: 3241.22 ms [2022-04-10 21:01:24 main:574] : INFO : Epoch 1922 | loss: 0.0311265 | val_loss: 0.0311491 | Time: 3206.46 ms [2022-04-10 21:01:27 main:574] : INFO : Epoch 1923 | loss: 0.0311277 | val_loss: 0.0311506 | Time: 3248.98 ms [2022-04-10 21:01:31 main:574] : INFO : Epoch 1924 | loss: 0.0311248 | val_loss: 0.031152 | Time: 3223.05 ms [2022-04-10 21:01:34 main:574] : INFO : Epoch 1925 | loss: 0.0311258 | val_loss: 0.031149 | Time: 3234.54 ms [2022-04-10 21:01:37 main:574] : INFO : Epoch 1926 | loss: 0.031126 | val_loss: 0.0311525 | Time: 3373.4 ms [2022-04-10 21:01:40 main:574] : INFO : Epoch 1927 | loss: 0.0311244 | val_loss: 0.0311502 | Time: 3314.11 ms [2022-04-10 21:01:44 main:574] : INFO : Epoch 1928 | loss: 0.0311262 | val_loss: 0.0311518 | Time: 3270.1 ms [2022-04-10 21:01:47 main:574] : INFO : Epoch 1929 | loss: 0.0311255 | val_loss: 0.031152 | Time: 3313.37 ms [2022-04-10 21:01:50 main:574] : INFO : Epoch 1930 | loss: 0.0311239 | val_loss: 0.0311525 | Time: 3232.9 ms [2022-04-10 21:01:54 main:574] : INFO : Epoch 1931 | loss: 0.0311252 | val_loss: 0.0311497 | Time: 3266.93 ms [2022-04-10 21:01:57 main:574] : INFO : Epoch 1932 | loss: 0.0311256 | val_loss: 0.0311496 | Time: 3313.2 ms [2022-04-10 21:02:00 main:574] : INFO : Epoch 1933 | loss: 0.0311261 | val_loss: 0.0311514 | Time: 3201.75 ms [2022-04-10 21:02:03 main:574] : INFO : Epoch 1934 | loss: 0.0311266 | val_loss: 0.0311533 | Time: 3288.72 ms [2022-04-10 21:02:07 main:574] : INFO : Epoch 1935 | loss: 0.0311286 | val_loss: 0.0311489 | Time: 3365.33 ms [2022-04-10 21:02:10 main:574] : INFO : Epoch 1936 | loss: 0.0311283 | val_loss: 0.0311507 | Time: 3247.4 ms [2022-04-10 21:02:13 main:574] : INFO : Epoch 1937 | loss: 0.031128 | val_loss: 0.0311521 | Time: 3180.77 ms [2022-04-10 21:02:16 main:574] : INFO : Epoch 1938 | loss: 0.0311284 | val_loss: 0.0311506 | Time: 3251.1 ms [2022-04-10 21:02:20 main:574] : INFO : Epoch 1939 | loss: 0.03113 | val_loss: 0.0311586 | Time: 3249.26 ms [2022-04-10 21:02:23 main:574] : INFO : Epoch 1940 | loss: 0.031135 | val_loss: 0.0311557 | Time: 3277.26 ms [2022-04-10 21:02:26 main:574] : INFO : Epoch 1941 | loss: 0.0311372 | val_loss: 0.0311503 | Time: 3254.46 ms [2022-04-10 21:02:29 main:574] : INFO : Epoch 1942 | loss: 0.0311328 | val_loss: 0.0311457 | Time: 3213.84 ms [2022-04-10 21:02:33 main:574] : INFO : Epoch 1943 | loss: 0.0311321 | val_loss: 0.031149 | Time: 3327.59 ms [2022-04-10 21:02:36 main:574] : INFO : Epoch 1944 | loss: 0.0311288 | val_loss: 0.0311494 | Time: 3236.49 ms [2022-04-10 21:02:39 main:574] : INFO : Epoch 1945 | loss: 0.03113 | val_loss: 0.0311501 | Time: 3200.06 ms [2022-04-10 21:02:42 main:574] : INFO : Epoch 1946 | loss: 0.0311291 | val_loss: 0.0311545 | Time: 3236.59 ms [2022-04-10 21:02:46 main:574] : INFO : Epoch 1947 | loss: 0.031134 | val_loss: 0.031151 | Time: 3357.93 ms [2022-04-10 21:02:49 main:574] : INFO : Epoch 1948 | loss: 0.0311315 | val_loss: 0.0311537 | Time: 3253.84 ms [2022-04-10 21:02:52 main:574] : INFO : Epoch 1949 | loss: 0.0311335 | val_loss: 0.0311524 | Time: 3305.69 ms [2022-04-10 21:02:56 main:574] : INFO : Epoch 1950 | loss: 0.0311325 | val_loss: 0.031156 | Time: 3302.94 ms [2022-04-10 21:02:59 main:574] : INFO : Epoch 1951 | loss: 0.0311324 | val_loss: 0.031151 | Time: 3344.02 ms [2022-04-10 21:03:02 main:574] : INFO : Epoch 1952 | loss: 0.0311289 | val_loss: 0.0311524 | Time: 3267.77 ms [2022-04-10 21:03:06 main:574] : INFO : Epoch 1953 | loss: 0.0311279 | val_loss: 0.0311524 | Time: 3261.43 ms [2022-04-10 21:03:09 main:574] : INFO : Epoch 1954 | loss: 0.0311302 | val_loss: 0.0311489 | Time: 3258.56 ms [2022-04-10 21:03:12 main:574] : INFO : Epoch 1955 | loss: 0.0311344 | val_loss: 0.0311502 | Time: 3239.86 ms [2022-04-10 21:03:15 main:574] : INFO : Epoch 1956 | loss: 0.0311343 | val_loss: 0.0311484 | Time: 3314.28 ms [2022-04-10 21:03:19 main:574] : INFO : Epoch 1957 | loss: 0.031133 | val_loss: 0.0311534 | Time: 3254.87 ms [2022-04-10 21:03:22 main:574] : INFO : Epoch 1958 | loss: 0.0311335 | val_loss: 0.0311494 | Time: 3343.84 ms [2022-04-10 21:03:25 main:574] : INFO : Epoch 1959 | loss: 0.031135 | val_loss: 0.0311486 | Time: 3311.26 ms [2022-04-10 21:03:29 main:574] : INFO : Epoch 1960 | loss: 0.0311315 | val_loss: 0.0311457 | Time: 3277.8 ms [2022-04-10 21:03:32 main:574] : INFO : Epoch 1961 | loss: 0.0311321 | val_loss: 0.0311499 | Time: 3337.64 ms [2022-04-10 21:03:35 main:574] : INFO : Epoch 1962 | loss: 0.0311354 | val_loss: 0.0311502 | Time: 3289.01 ms [2022-04-10 21:03:38 main:574] : INFO : Epoch 1963 | loss: 0.0311333 | val_loss: 0.0311473 | Time: 3244.32 ms [2022-04-10 21:03:42 main:574] : INFO : Epoch 1964 | loss: 0.0311298 | val_loss: 0.0311499 | Time: 3236.87 ms [2022-04-10 21:03:45 main:574] : INFO : Epoch 1965 | loss: 0.0311314 | val_loss: 0.0311488 | Time: 3327.22 ms [2022-04-10 21:03:48 main:574] : INFO : Epoch 1966 | loss: 0.0311391 | val_loss: 0.0311577 | Time: 3309.79 ms [2022-04-10 21:03:52 main:574] : INFO : Epoch 1967 | loss: 0.0311436 | val_loss: 0.0311603 | Time: 3290.17 ms [2022-04-10 21:03:55 main:574] : INFO : Epoch 1968 | loss: 0.0311388 | val_loss: 0.0311537 | Time: 3297.25 ms [2022-04-10 21:03:58 main:574] : INFO : Epoch 1969 | loss: 0.0311361 | val_loss: 0.0311599 | Time: 3248.81 ms [2022-04-10 21:04:02 main:574] : INFO : Epoch 1970 | loss: 0.0311375 | val_loss: 0.0311507 | Time: 3330.25 ms [2022-04-10 21:04:05 main:574] : INFO : Epoch 1971 | loss: 0.0311359 | val_loss: 0.0311502 | Time: 3215.94 ms [2022-04-10 21:04:08 main:574] : INFO : Epoch 1972 | loss: 0.0311412 | val_loss: 0.0311646 | Time: 3253.38 ms [2022-04-10 21:04:11 main:574] : INFO : Epoch 1973 | loss: 0.0311539 | val_loss: 0.0311633 | Time: 3351.95 ms [2022-04-10 21:04:15 main:574] : INFO : Epoch 1974 | loss: 0.0311503 | val_loss: 0.0311557 | Time: 3244.04 ms [2022-04-10 21:04:18 main:574] : INFO : Epoch 1975 | loss: 0.0311446 | val_loss: 0.0311572 | Time: 3212.11 ms [2022-04-10 21:04:21 main:574] : INFO : Epoch 1976 | loss: 0.0311427 | val_loss: 0.0311551 | Time: 3313.18 ms [2022-04-10 21:04:24 main:574] : INFO : Epoch 1977 | loss: 0.0311442 | val_loss: 0.0311514 | Time: 3299.84 ms [2022-04-10 21:04:28 main:574] : INFO : Epoch 1978 | loss: 0.0311434 | val_loss: 0.0311516 | Time: 3235.9 ms [2022-04-10 21:04:31 main:574] : INFO : Epoch 1979 | loss: 0.0311407 | val_loss: 0.0311518 | Time: 3296.53 ms [2022-04-10 21:04:34 main:574] : INFO : Epoch 1980 | loss: 0.0311412 | val_loss: 0.0311519 | Time: 3304.77 ms [2022-04-10 21:04:38 main:574] : INFO : Epoch 1981 | loss: 0.0311439 | val_loss: 0.0311585 | Time: 3226.61 ms [2022-04-10 21:04:41 main:574] : INFO : Epoch 1982 | loss: 0.0311471 | val_loss: 0.031156 | Time: 3194.31 ms [2022-04-10 21:04:44 main:574] : INFO : Epoch 1983 | loss: 0.0311509 | val_loss: 0.0311611 | Time: 3207.13 ms [2022-04-10 21:04:47 main:574] : INFO : Epoch 1984 | loss: 0.0311553 | val_loss: 0.0311653 | Time: 3355.67 ms [2022-04-10 21:04:51 main:574] : INFO : Epoch 1985 | loss: 0.0311459 | val_loss: 0.031155 | Time: 3250.01 ms [2022-04-10 21:04:54 main:574] : INFO : Epoch 1986 | loss: 0.031141 | val_loss: 0.0311536 | Time: 3334.25 ms [2022-04-10 21:04:57 main:574] : INFO : Epoch 1987 | loss: 0.03114 | val_loss: 0.0311511 | Time: 3349.36 ms [2022-04-10 21:05:01 main:574] : INFO : Epoch 1988 | loss: 0.0311374 | val_loss: 0.0311521 | Time: 3338.96 ms [2022-04-10 21:05:04 main:574] : INFO : Epoch 1989 | loss: 0.0311374 | val_loss: 0.0311524 | Time: 3311.68 ms [2022-04-10 21:05:07 main:574] : INFO : Epoch 1990 | loss: 0.0311388 | val_loss: 0.0311531 | Time: 3331.75 ms [2022-04-10 21:05:11 main:574] : INFO : Epoch 1991 | loss: 0.0311389 | val_loss: 0.0311521 | Time: 3284.1 ms [2022-04-10 21:05:14 main:574] : INFO : Epoch 1992 | loss: 0.0311394 | val_loss: 0.0311533 | Time: 3229.98 ms [2022-04-10 21:05:17 main:574] : INFO : Epoch 1993 | loss: 0.0311357 | val_loss: 0.0311525 | Time: 3292.74 ms [2022-04-10 21:05:20 main:574] : INFO : Epoch 1994 | loss: 0.0311348 | val_loss: 0.0311533 | Time: 3257 ms [2022-04-10 21:05:24 main:574] : INFO : Epoch 1995 | loss: 0.0311348 | val_loss: 0.0311507 | Time: 3251.9 ms [2022-04-10 21:05:27 main:574] : INFO : Epoch 1996 | loss: 0.0311345 | val_loss: 0.0311491 | Time: 3265.44 ms [2022-04-10 21:05:30 main:574] : INFO : Epoch 1997 | loss: 0.0311339 | val_loss: 0.0311521 | Time: 3201.52 ms [2022-04-10 21:05:33 main:574] : INFO : Epoch 1998 | loss: 0.0311338 | val_loss: 0.031152 | Time: 3261.99 ms [2022-04-10 21:05:37 main:574] : INFO : Epoch 1999 | loss: 0.0311331 | val_loss: 0.0311527 | Time: 3272.2 ms [2022-04-10 21:05:40 main:574] : INFO : Epoch 2000 | loss: 0.0311321 | val_loss: 0.0311538 | Time: 3248.56 ms [2022-04-10 21:05:43 main:574] : INFO : Epoch 2001 | loss: 0.0311351 | val_loss: 0.0311526 | Time: 3345.08 ms [2022-04-10 21:05:47 main:574] : INFO : Epoch 2002 | loss: 0.0311396 | val_loss: 0.0311544 | Time: 3352.36 ms [2022-04-10 21:05:50 main:574] : INFO : Epoch 2003 | loss: 0.0311408 | val_loss: 0.0311589 | Time: 3301.9 ms [2022-04-10 21:05:53 main:574] : INFO : Epoch 2004 | loss: 0.0311351 | val_loss: 0.0311525 | Time: 3354.34 ms [2022-04-10 21:05:56 main:574] : INFO : Epoch 2005 | loss: 0.0311345 | val_loss: 0.0311499 | Time: 3316.59 ms [2022-04-10 21:06:00 main:574] : INFO : Epoch 2006 | loss: 0.0311321 | val_loss: 0.0311475 | Time: 3349.02 ms [2022-04-10 21:06:03 main:574] : INFO : Epoch 2007 | loss: 0.0311319 | val_loss: 0.0311526 | Time: 3230.25 ms [2022-04-10 21:06:06 main:574] : INFO : Epoch 2008 | loss: 0.0311303 | val_loss: 0.0311522 | Time: 3265.47 ms [2022-04-10 21:06:10 main:574] : INFO : Epoch 2009 | loss: 0.0311303 | val_loss: 0.0311516 | Time: 3316.59 ms [2022-04-10 21:06:13 main:574] : INFO : Epoch 2010 | loss: 0.0311295 | val_loss: 0.0311503 | Time: 3259.87 ms [2022-04-10 21:06:16 main:574] : INFO : Epoch 2011 | loss: 0.0311294 | val_loss: 0.0311531 | Time: 3282 ms [2022-04-10 21:06:20 main:574] : INFO : Epoch 2012 | loss: 0.0311287 | val_loss: 0.0311523 | Time: 3303.49 ms [2022-04-10 21:06:23 main:574] : INFO : Epoch 2013 | loss: 0.0311288 | val_loss: 0.0311538 | Time: 3289.11 ms [2022-04-10 21:06:26 main:574] : INFO : Epoch 2014 | loss: 0.0311306 | val_loss: 0.0311536 | Time: 3269.35 ms [2022-04-10 21:06:29 main:574] : INFO : Epoch 2015 | loss: 0.0311294 | val_loss: 0.031148 | Time: 3262.52 ms [2022-04-10 21:06:33 main:574] : INFO : Epoch 2016 | loss: 0.0311303 | val_loss: 0.0311475 | Time: 3358.85 ms [2022-04-10 21:06:36 main:574] : INFO : Epoch 2017 | loss: 0.03113 | val_loss: 0.0311476 | Time: 3319.27 ms [2022-04-10 21:06:39 main:574] : INFO : Epoch 2018 | loss: 0.0311286 | val_loss: 0.0311486 | Time: 3338.38 ms [2022-04-10 21:06:43 main:574] : INFO : Epoch 2019 | loss: 0.0311282 | val_loss: 0.0311485 | Time: 3304.43 ms [2022-04-10 21:06:46 main:574] : INFO : Epoch 2020 | loss: 0.031127 | val_loss: 0.0311513 | Time: 3235.91 ms [2022-04-10 21:06:49 main:574] : INFO : Epoch 2021 | loss: 0.0311291 | val_loss: 0.0311534 | Time: 3288.93 ms [2022-04-10 21:06:53 main:574] : INFO : Epoch 2022 | loss: 0.0311318 | val_loss: 0.0311494 | Time: 3352.16 ms [2022-04-10 21:06:56 main:574] : INFO : Epoch 2023 | loss: 0.0311281 | val_loss: 0.0311537 | Time: 3280.71 ms [2022-04-10 21:06:59 main:574] : INFO : Epoch 2024 | loss: 0.0311305 | val_loss: 0.0311497 | Time: 3278.48 ms [2022-04-10 21:07:02 main:574] : INFO : Epoch 2025 | loss: 0.0311328 | val_loss: 0.0311485 | Time: 3265.05 ms [2022-04-10 21:07:06 main:574] : INFO : Epoch 2026 | loss: 0.0311397 | val_loss: 0.0311495 | Time: 3303.27 ms [2022-04-10 21:07:09 main:574] : INFO : Epoch 2027 | loss: 0.0311545 | val_loss: 0.0311832 | Time: 3251.88 ms [2022-04-10 21:07:12 main:574] : INFO : Epoch 2028 | loss: 0.0311811 | val_loss: 0.0311758 | Time: 3272.12 ms [2022-04-10 21:07:16 main:574] : INFO : Epoch 2029 | loss: 0.0311741 | val_loss: 0.0311775 | Time: 3355.42 ms [2022-04-10 21:07:19 main:574] : INFO : Epoch 2030 | loss: 0.0311677 | val_loss: 0.0311661 | Time: 3290.84 ms [2022-04-10 21:07:22 main:574] : INFO : Epoch 2031 | loss: 0.0311625 | val_loss: 0.0311629 | Time: 3302.79 ms [2022-04-10 21:07:26 main:574] : INFO : Epoch 2032 | loss: 0.0311597 | val_loss: 0.0311624 | Time: 3385.23 ms [2022-04-10 21:07:29 main:574] : INFO : Epoch 2033 | loss: 0.0311557 | val_loss: 0.0311642 | Time: 3293.01 ms [2022-04-10 21:07:32 main:574] : INFO : Epoch 2034 | loss: 0.0311562 | val_loss: 0.0311637 | Time: 3337.89 ms [2022-04-10 21:07:36 main:574] : INFO : Epoch 2035 | loss: 0.0311557 | val_loss: 0.0311638 | Time: 3283.41 ms [2022-04-10 21:07:39 main:574] : INFO : Epoch 2036 | loss: 0.0311543 | val_loss: 0.0311611 | Time: 3258.53 ms [2022-04-10 21:07:42 main:574] : INFO : Epoch 2037 | loss: 0.0311536 | val_loss: 0.0311607 | Time: 3296.96 ms [2022-04-10 21:07:45 main:574] : INFO : Epoch 2038 | loss: 0.0311496 | val_loss: 0.0311583 | Time: 3290.41 ms [2022-04-10 21:07:49 main:574] : INFO : Epoch 2039 | loss: 0.0311477 | val_loss: 0.0311598 | Time: 3349.26 ms [2022-04-10 21:07:52 main:574] : INFO : Epoch 2040 | loss: 0.0311472 | val_loss: 0.0311584 | Time: 3300.85 ms [2022-04-10 21:07:55 main:574] : INFO : Epoch 2041 | loss: 0.0311462 | val_loss: 0.0311565 | Time: 3318.33 ms [2022-04-10 21:07:59 main:574] : INFO : Epoch 2042 | loss: 0.0311447 | val_loss: 0.0311576 | Time: 3252.41 ms [2022-04-10 21:08:02 main:574] : INFO : Epoch 2043 | loss: 0.0311435 | val_loss: 0.0311578 | Time: 3254.79 ms [2022-04-10 21:08:05 main:574] : INFO : Epoch 2044 | loss: 0.0311447 | val_loss: 0.0311571 | Time: 3340.83 ms [2022-04-10 21:08:08 main:574] : INFO : Epoch 2045 | loss: 0.0311446 | val_loss: 0.0311558 | Time: 3262.25 ms [2022-04-10 21:08:12 main:574] : INFO : Epoch 2046 | loss: 0.0311425 | val_loss: 0.031158 | Time: 3358.96 ms [2022-04-10 21:08:15 main:574] : INFO : Epoch 2047 | loss: 0.0311436 | val_loss: 0.0311572 | Time: 3257.06 ms [2022-04-10 21:08:18 main:574] : INFO : Epoch 2048 | loss: 0.0311428 | val_loss: 0.0311524 | Time: 3255.53 ms [2022-04-10 21:08:18 main:597] : INFO : Saving trained model to model-final.pt, val_loss 0.0311524 [2022-04-10 21:08:18 main:603] : INFO : Saving end state to config to file [2022-04-10 21:08:18 main:608] : INFO : Success, exiting.. 21:08:18 (7500): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)