Task 10211921
| Name | ParityModified-1638638560-6633-2-0_0 |
| Workunit | 7575823 |
| Created | 26 Dec 2021, 17:33:08 UTC |
| Sent | 13 Jan 2022, 20:26:20 UTC |
| Report deadline | 21 Jan 2022, 20:26:20 UTC |
| Received | 26 Jan 2022, 18:27:35 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 6180 |
| Run time | 3 hours 41 min 46 sec |
| CPU time | 3 hours 4 min 59 sec |
| Validate state | Task was reported too late to validate |
| Credit | 0.00 |
| Device peak FLOPS | 884.73 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.54 GB |
| Peak swap size | 3.44 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version> <![CDATA[ <stderr_txt> :17 main:494] : INFO : Creating Model [2022-01-26 18:38:17 main:507] : INFO : Preparing config file [2022-01-26 18:38:17 main:511] : INFO : Found checkpoint, attempting to load... [2022-01-26 18:38:17 main:512] : INFO : Loading config [2022-01-26 18:38:17 main:514] : INFO : Loading state [2022-01-26 18:38:18 main:559] : INFO : Loading DataLoader into Memory [2022-01-26 18:38:19 main:562] : INFO : Starting Training [2022-01-26 18:38:25 main:574] : INFO : Epoch 1702 | loss: 0.0311052 | val_loss: 0.0312421 | Time: 6467.13 ms [2022-01-26 18:38:31 main:574] : INFO : Epoch 1703 | loss: 0.0310748 | val_loss: 0.0312196 | Time: 6216.83 ms [2022-01-26 18:38:37 main:574] : INFO : Epoch 1704 | loss: 0.0310508 | val_loss: 0.0312208 | Time: 6271.97 ms [2022-01-26 18:38:44 main:574] : INFO : Epoch 1705 | loss: 0.031047 | val_loss: 0.0312269 | Time: 6318.93 ms [2022-01-26 18:38:50 main:574] : INFO : Epoch 1706 | loss: 0.0310483 | val_loss: 0.0312276 | Time: 6349.85 ms [2022-01-26 18:38:57 main:574] : INFO : Epoch 1707 | loss: 0.0310504 | val_loss: 0.0312403 | Time: 6347.61 ms [2022-01-26 18:39:03 main:574] : INFO : Epoch 1708 | loss: 0.0310499 | val_loss: 0.0312325 | Time: 6302.86 ms [2022-01-26 18:39:09 main:574] : INFO : Epoch 1709 | loss: 0.0310435 | val_loss: 0.0312306 | Time: 6305.15 ms [2022-01-26 18:39:15 main:574] : INFO : Epoch 1710 | loss: 0.031044 | val_loss: 0.0312394 | Time: 6337.38 ms [2022-01-26 18:39:22 main:574] : INFO : Epoch 1711 | loss: 0.0310406 | val_loss: 0.0312518 | Time: 6326.68 ms [2022-01-26 18:39:28 main:574] : INFO : Epoch 1712 | loss: 0.031037 | val_loss: 0.0312385 | Time: 6284.7 ms [2022-01-26 18:39:34 main:574] : INFO : Epoch 1713 | loss: 0.0310414 | val_loss: 0.0312224 | Time: 6312.37 ms [2022-01-26 18:39:41 main:574] : INFO : Epoch 1714 | loss: 0.0310392 | val_loss: 0.031234 | Time: 6431.21 ms [2022-01-26 18:39:47 main:574] : INFO : Epoch 1715 | loss: 0.0310482 | val_loss: 0.0312235 | Time: 6345 ms [2022-01-26 18:39:54 main:574] : INFO : Epoch 1716 | loss: 0.0310495 | val_loss: 0.0312565 | Time: 6361.59 ms [2022-01-26 18:40:00 main:574] : INFO : Epoch 1717 | loss: 0.0310438 | val_loss: 0.0312188 | Time: 6353.08 ms [2022-01-26 18:40:06 main:574] : INFO : Epoch 1718 | loss: 0.0310416 | val_loss: 0.0312302 | Time: 6382.47 ms [2022-01-26 18:40:13 main:574] : INFO : Epoch 1719 | loss: 0.0310955 | val_loss: 0.0312192 | Time: 6770.44 ms [2022-01-26 18:40:20 main:574] : INFO : Epoch 1720 | loss: 0.0310972 | val_loss: 0.0312011 | Time: 6417.1 ms [2022-01-26 18:40:26 main:574] : INFO : Epoch 1721 | loss: 0.0310788 | val_loss: 0.0312009 | Time: 6359.43 ms [2022-01-26 18:40:32 main:574] : INFO : Epoch 1722 | loss: 0.0310655 | val_loss: 0.0312352 | Time: 6257.87 ms [2022-01-26 18:40:38 main:574] : INFO : Epoch 1723 | loss: 0.0310529 | val_loss: 0.0312208 | Time: 6254.19 ms [2022-01-26 18:40:45 main:574] : INFO : Epoch 1724 | loss: 0.0310462 | val_loss: 0.0312255 | Time: 6322.02 ms [2022-01-26 18:40:51 main:574] : INFO : Epoch 1725 | loss: 0.0310452 | val_loss: 0.0312387 | Time: 6291.81 ms [2022-01-26 18:40:57 main:574] : INFO : Epoch 1726 | loss: 0.0310415 | val_loss: 0.0312245 | Time: 6296.56 ms [2022-01-26 18:41:04 main:574] : INFO : Epoch 1727 | loss: 0.0310431 | val_loss: 0.0312348 | Time: 6360.33 ms [2022-01-26 18:41:10 main:574] : INFO : Epoch 1728 | loss: 0.0310505 | val_loss: 0.0312252 | Time: 6333.75 ms [2022-01-26 18:41:16 main:574] : INFO : Epoch 1729 | loss: 0.031045 | val_loss: 0.03124 | Time: 6310.49 ms [2022-01-26 18:41:23 main:574] : INFO : Epoch 1730 | loss: 0.0310429 | val_loss: 0.0312208 | Time: 6323.2 ms [2022-01-26 18:41:29 main:574] : INFO : Epoch 1731 | loss: 0.0310403 | val_loss: 0.0312436 | Time: 6273.69 ms [2022-01-26 18:41:35 main:574] : INFO : Epoch 1732 | loss: 0.0310357 | val_loss: 0.0312292 | Time: 6355.5 ms [2022-01-26 18:41:42 main:574] : INFO : Epoch 1733 | loss: 0.0310378 | val_loss: 0.031223 | Time: 6427.18 ms [2022-01-26 18:41:49 main:574] : INFO : Epoch 1734 | loss: 0.0310377 | val_loss: 0.0312408 | Time: 6941.46 ms [2022-01-26 18:41:55 main:574] : INFO : Epoch 1735 | loss: 0.0310378 | val_loss: 0.0312406 | Time: 6565.06 ms [2022-01-26 18:42:23 main:574] : INFO : Epoch 1736 | loss: 0.0310431 | val_loss: 0.0312308 | Time: 27349.1 ms [2022-01-26 18:42:29 main:574] : INFO : Epoch 1737 | loss: 0.0310425 | val_loss: 0.0312122 | Time: 6337.38 ms [2022-01-26 18:42:35 main:574] : INFO : Epoch 1738 | loss: 0.0310623 | val_loss: 0.0312329 | Time: 6361.12 ms [2022-01-26 18:42:42 main:574] : INFO : Epoch 1739 | loss: 0.0310553 | val_loss: 0.0312086 | Time: 6394.72 ms [2022-01-26 18:42:48 main:574] : INFO : Epoch 1740 | loss: 0.0310405 | val_loss: 0.0312462 | Time: 6286.44 ms [2022-01-26 18:42:54 main:574] : INFO : Epoch 1741 | loss: 0.0310385 | val_loss: 0.0312365 | Time: 6279.3 ms [2022-01-26 18:43:01 main:574] : INFO : Epoch 1742 | loss: 0.0310472 | val_loss: 0.0312442 | Time: 6398.03 ms [2022-01-26 18:43:07 main:574] : INFO : Epoch 1743 | loss: 0.0310609 | val_loss: 0.0312056 | Time: 6328.33 ms [2022-01-26 18:43:14 main:574] : INFO : Epoch 1744 | loss: 0.0310845 | val_loss: 0.0312181 | Time: 6431.78 ms [2022-01-26 18:43:20 main:574] : INFO : Epoch 1745 | loss: 0.0310665 | val_loss: 0.0312161 | Time: 6339.21 ms [2022-01-26 18:43:26 main:574] : INFO : Epoch 1746 | loss: 0.0310587 | val_loss: 0.031227 | Time: 6313.67 ms [2022-01-26 18:43:33 main:574] : INFO : Epoch 1747 | loss: 0.0310519 | val_loss: 0.0312377 | Time: 6323.86 ms [2022-01-26 18:43:39 main:574] : INFO : Epoch 1748 | loss: 0.0310442 | val_loss: 0.031224 | Time: 6316.06 ms [2022-01-26 18:43:45 main:574] : INFO : Epoch 1749 | loss: 0.0310439 | val_loss: 0.0312221 | Time: 6432.05 ms [2022-01-26 18:43:52 main:574] : INFO : Epoch 1750 | loss: 0.0310438 | val_loss: 0.0312599 | Time: 6338.14 ms [2022-01-26 18:43:58 main:574] : INFO : Epoch 1751 | loss: 0.0310383 | val_loss: 0.031255 | Time: 6329.85 ms [2022-01-26 18:44:04 main:574] : INFO : Epoch 1752 | loss: 0.0310381 | val_loss: 0.0312472 | Time: 6386.68 ms [2022-01-26 18:44:11 main:574] : INFO : Epoch 1753 | loss: 0.0310434 | val_loss: 0.0312229 | Time: 6348.44 ms [2022-01-26 18:44:17 main:574] : INFO : Epoch 1754 | loss: 0.0310423 | val_loss: 0.0312441 | Time: 6395.53 ms [2022-01-26 18:44:24 main:574] : INFO : Epoch 1755 | loss: 0.0310369 | val_loss: 0.0312308 | Time: 6396.5 ms [2022-01-26 18:44:30 main:574] : INFO : Epoch 1756 | loss: 0.0310379 | val_loss: 0.0312127 | Time: 6422.78 ms [2022-01-26 18:44:36 main:574] : INFO : Epoch 1757 | loss: 0.0310494 | val_loss: 0.0312498 | Time: 6344.62 ms [2022-01-26 18:44:43 main:574] : INFO : Epoch 1758 | loss: 0.0310513 | val_loss: 0.0312309 | Time: 6248.62 ms [2022-01-26 18:44:49 main:574] : INFO : Epoch 1759 | loss: 0.0310495 | val_loss: 0.0312262 | Time: 6339.19 ms [2022-01-26 18:45:05 main:574] : INFO : Epoch 1760 | loss: 0.0310447 | val_loss: 0.0312357 | Time: 16505 ms [2022-01-26 18:45:12 main:574] : INFO : Epoch 1761 | loss: 0.0310502 | val_loss: 0.0312204 | Time: 6396.87 ms [2022-01-26 18:45:18 main:574] : INFO : Epoch 1762 | loss: 0.0310523 | val_loss: 0.0312303 | Time: 6462.57 ms [2022-01-26 18:45:25 main:574] : INFO : Epoch 1763 | loss: 0.0310428 | val_loss: 0.0312406 | Time: 6394.52 ms [2022-01-26 18:45:31 main:574] : INFO : Epoch 1764 | loss: 0.0310526 | val_loss: 0.0312387 | Time: 6409.74 ms [2022-01-26 18:45:37 main:574] : INFO : Epoch 1765 | loss: 0.0310532 | val_loss: 0.0312411 | Time: 6421.94 ms [2022-01-26 18:45:44 main:574] : INFO : Epoch 1766 | loss: 0.0310526 | val_loss: 0.0312412 | Time: 6394.66 ms [2022-01-26 18:45:51 main:574] : INFO : Epoch 1767 | loss: 0.0311117 | val_loss: 0.0312105 | Time: 6479.65 ms [2022-01-26 18:45:57 main:574] : INFO : Epoch 1768 | loss: 0.031102 | val_loss: 0.031205 | Time: 6534.39 ms [2022-01-26 18:46:04 main:574] : INFO : Epoch 1769 | loss: 0.0310833 | val_loss: 0.0312164 | Time: 6436.99 ms [2022-01-26 18:46:10 main:574] : INFO : Epoch 1770 | loss: 0.0310681 | val_loss: 0.0312306 | Time: 6480.08 ms [2022-01-26 18:46:16 main:574] : INFO : Epoch 1771 | loss: 0.0310662 | val_loss: 0.0312205 | Time: 6410.4 ms [2022-01-26 18:46:23 main:574] : INFO : Epoch 1772 | loss: 0.0310532 | val_loss: 0.0312234 | Time: 6453.66 ms [2022-01-26 18:46:29 main:574] : INFO : Epoch 1773 | loss: 0.031045 | val_loss: 0.0312308 | Time: 6392.05 ms [2022-01-26 18:46:36 main:574] : INFO : Epoch 1774 | loss: 0.0310375 | val_loss: 0.0312382 | Time: 6329.86 ms [2022-01-26 18:46:42 main:574] : INFO : Epoch 1775 | loss: 0.0310413 | val_loss: 0.0312213 | Time: 6318.91 ms [2022-01-26 18:46:48 main:574] : INFO : Epoch 1776 | loss: 0.031038 | val_loss: 0.0312488 | Time: 6402.73 ms [2022-01-26 18:46:55 main:574] : INFO : Epoch 1777 | loss: 0.0310328 | val_loss: 0.03125 | Time: 6399.32 ms [2022-01-26 18:47:01 main:574] : INFO : Epoch 1778 | loss: 0.0310358 | val_loss: 0.0312396 | Time: 6444.09 ms [2022-01-26 18:47:08 main:574] : INFO : Epoch 1779 | loss: 0.0310373 | val_loss: 0.0312287 | Time: 6430.69 ms [2022-01-26 18:47:14 main:574] : INFO : Epoch 1780 | loss: 0.0310388 | val_loss: 0.0312495 | Time: 6367.1 ms [2022-01-26 18:47:20 main:574] : INFO : Epoch 1781 | loss: 0.0310436 | val_loss: 0.031215 | Time: 6338.83 ms [2022-01-26 18:47:27 main:574] : INFO : Epoch 1782 | loss: 0.0310623 | val_loss: 0.0312424 | Time: 6382.25 ms [2022-01-26 18:47:33 main:574] : INFO : Epoch 1783 | loss: 0.0310484 | val_loss: 0.0312241 | Time: 6402.95 ms [2022-01-26 18:47:40 main:574] : INFO : Epoch 1784 | loss: 0.0310437 | val_loss: 0.0312279 | Time: 6481.46 ms [2022-01-26 18:47:46 main:574] : INFO : Epoch 1785 | loss: 0.031048 | val_loss: 0.0312252 | Time: 6390.93 ms [2022-01-26 18:47:52 main:574] : INFO : Epoch 1786 | loss: 0.0310412 | val_loss: 0.0312394 | Time: 6440.03 ms [2022-01-26 18:47:59 main:574] : INFO : Epoch 1787 | loss: 0.0310474 | val_loss: 0.0312436 | Time: 6371.31 ms [2022-01-26 18:48:05 main:574] : INFO : Epoch 1788 | loss: 0.0310412 | val_loss: 0.0312325 | Time: 6418.96 ms [2022-01-26 18:48:12 main:574] : INFO : Epoch 1789 | loss: 0.0310393 | val_loss: 0.031225 | Time: 6445.91 ms [2022-01-26 18:48:18 main:574] : INFO : Epoch 1790 | loss: 0.0310457 | val_loss: 0.031238 | Time: 6384.75 ms [2022-01-26 18:48:24 main:574] : INFO : Epoch 1791 | loss: 0.0310497 | val_loss: 0.0312239 | Time: 6411.64 ms [2022-01-26 18:48:31 main:574] : INFO : Epoch 1792 | loss: 0.0310503 | val_loss: 0.0312547 | Time: 6338.43 ms [2022-01-26 18:48:37 main:574] : INFO : Epoch 1793 | loss: 0.0310628 | val_loss: 0.0312278 | Time: 6315.43 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-01-26 18:49:44 main:435] : INFO : Set logging level to 1 [2022-01-26 18:49:44 main:441] : INFO : Running in BOINC Client mode [2022-01-26 18:49:44 main:444] : INFO : Resolving all filenames [2022-01-26 18:49:44 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-01-26 18:49:44 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-01-26 18:49:44 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-01-26 18:49:44 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-01-26 18:49:44 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-01-26 18:49:44 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-01-26 18:49:44 main:474] : INFO : Configuration: [2022-01-26 18:49:44 main:475] : INFO : Model type: GRU [2022-01-26 18:49:44 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-01-26 18:49:44 main:477] : INFO : Max Epochs: 2048 [2022-01-26 18:49:44 main:478] : INFO : Batch Size: 128 [2022-01-26 18:49:44 main:479] : INFO : Learning Rate: 0.01 [2022-01-26 18:49:44 main:480] : INFO : Patience: 10 [2022-01-26 18:49:44 main:481] : INFO : Hidden Width: 12 [2022-01-26 18:49:44 main:482] : INFO : # Recurrent Layers: 4 [2022-01-26 18:49:44 main:483] : INFO : # Backend Layers: 4 [2022-01-26 18:49:44 main:484] : INFO : # Threads: 1 [2022-01-26 18:49:44 main:486] : INFO : Preparing Dataset [2022-01-26 18:49:44 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-01-26 18:49:45 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-01-26 18:49:47 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-01-26 18:49:47 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-01-26 18:49:48 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-01-26 18:49:48 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-01-26 18:49:48 main:494] : INFO : Creating Model [2022-01-26 18:49:48 main:507] : INFO : Preparing config file [2022-01-26 18:49:48 main:511] : INFO : Found checkpoint, attempting to load... [2022-01-26 18:49:48 main:512] : INFO : Loading config [2022-01-26 18:49:48 main:514] : INFO : Loading state [2022-01-26 18:49:48 main:559] : INFO : Loading DataLoader into Memory [2022-01-26 18:49:49 main:562] : INFO : Starting Training [2022-01-26 18:49:55 main:574] : INFO : Epoch 1785 | loss: 0.0311018 | val_loss: 0.0312468 | Time: 6584.27 ms [2022-01-26 18:50:01 main:574] : INFO : Epoch 1786 | loss: 0.0310675 | val_loss: 0.0312117 | Time: 6239.22 ms [2022-01-26 18:50:08 main:574] : INFO : Epoch 1787 | loss: 0.0310542 | val_loss: 0.031223 | Time: 6256.72 ms [2022-01-26 18:50:14 main:574] : INFO : Epoch 1788 | loss: 0.031052 | val_loss: 0.0312359 | Time: 6282.15 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-01-26 18:51:37 main:435] : INFO : Set logging level to 1 [2022-01-26 18:51:37 main:441] : INFO : Running in BOINC Client mode [2022-01-26 18:51:37 main:444] : INFO : Resolving all filenames [2022-01-26 18:51:37 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-01-26 18:51:37 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-01-26 18:51:37 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-01-26 18:51:37 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-01-26 18:51:37 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-01-26 18:51:37 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-01-26 18:51:37 main:474] : INFO : Configuration: [2022-01-26 18:51:37 main:475] : INFO : Model type: GRU [2022-01-26 18:51:37 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-01-26 18:51:37 main:477] : INFO : Max Epochs: 2048 [2022-01-26 18:51:37 main:478] : INFO : Batch Size: 128 [2022-01-26 18:51:37 main:479] : INFO : Learning Rate: 0.01 [2022-01-26 18:51:37 main:480] : INFO : Patience: 10 [2022-01-26 18:51:37 main:481] : INFO : Hidden Width: 12 [2022-01-26 18:51:37 main:482] : INFO : # Recurrent Layers: 4 [2022-01-26 18:51:37 main:483] : INFO : # Backend Layers: 4 [2022-01-26 18:51:37 main:484] : INFO : # Threads: 1 [2022-01-26 18:51:37 main:486] : INFO : Preparing Dataset [2022-01-26 18:51:37 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-01-26 18:51:38 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-01-26 18:51:40 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-01-26 18:51:40 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-01-26 18:51:41 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-01-26 18:51:41 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-01-26 18:51:41 main:494] : INFO : Creating Model [2022-01-26 18:51:41 main:507] : INFO : Preparing config file [2022-01-26 18:51:41 main:511] : INFO : Found checkpoint, attempting to load... [2022-01-26 18:51:41 main:512] : INFO : Loading config [2022-01-26 18:51:41 main:514] : INFO : Loading state [2022-01-26 18:51:42 main:559] : INFO : Loading DataLoader into Memory [2022-01-26 18:51:42 main:562] : INFO : Starting Training [2022-01-26 18:51:48 main:574] : INFO : Epoch 1785 | loss: 0.0311089 | val_loss: 0.0312499 | Time: 6669.91 ms [2022-01-26 18:51:54 main:574] : INFO : Epoch 1786 | loss: 0.0310577 | val_loss: 0.0312395 | Time: 6271.98 ms [2022-01-26 18:52:01 main:574] : INFO : Epoch 1787 | loss: 0.0310542 | val_loss: 0.0312238 | Time: 6261.43 ms [2022-01-26 18:52:07 main:574] : INFO : Epoch 1788 | loss: 0.0310506 | val_loss: 0.0312227 | Time: 6260.38 ms [2022-01-26 18:52:13 main:574] : INFO : Epoch 1789 | loss: 0.0310442 | val_loss: 0.031221 | Time: 6262.19 ms [2022-01-26 18:52:20 main:574] : INFO : Epoch 1790 | loss: 0.0310376 | val_loss: 0.0312436 | Time: 6263.7 ms [2022-01-26 18:52:26 main:574] : INFO : Epoch 1791 | loss: 0.031043 | val_loss: 0.0312333 | Time: 6307.61 ms [2022-01-26 18:52:32 main:574] : INFO : Epoch 1792 | loss: 0.0310542 | val_loss: 0.0312254 | Time: 6313.94 ms [2022-01-26 18:52:39 main:574] : INFO : Epoch 1793 | loss: 0.0310506 | val_loss: 0.0312365 | Time: 6349.35 ms [2022-01-26 18:52:45 main:574] : INFO : Epoch 1794 | loss: 0.0310524 | val_loss: 0.0312312 | Time: 6377.92 ms [2022-01-26 18:52:51 main:574] : INFO : Epoch 1795 | loss: 0.0310547 | val_loss: 0.0312343 | Time: 6250.69 ms [2022-01-26 18:52:57 main:574] : INFO : Epoch 1796 | loss: 0.0310524 | val_loss: 0.0312227 | Time: 6259.67 ms [2022-01-26 18:53:04 main:574] : INFO : Epoch 1797 | loss: 0.0310479 | val_loss: 0.0312499 | Time: 6266.87 ms [2022-01-26 18:53:10 main:574] : INFO : Epoch 1798 | loss: 0.0310468 | val_loss: 0.0312343 | Time: 6266.02 ms [2022-01-26 18:53:16 main:574] : INFO : Epoch 1799 | loss: 0.0310497 | val_loss: 0.0312432 | Time: 6296.59 ms [2022-01-26 18:53:23 main:574] : INFO : Epoch 1800 | loss: 0.0310437 | val_loss: 0.031244 | Time: 6278.67 ms [2022-01-26 18:53:29 main:574] : INFO : Epoch 1801 | loss: 0.0310472 | val_loss: 0.0312377 | Time: 6332.32 ms [2022-01-26 18:53:35 main:574] : INFO : Epoch 1802 | loss: 0.0310513 | val_loss: 0.0312349 | Time: 6257.73 ms [2022-01-26 18:53:41 main:574] : INFO : Epoch 1803 | loss: 0.0310463 | val_loss: 0.0312266 | Time: 6288.92 ms [2022-01-26 18:53:48 main:574] : INFO : Epoch 1804 | loss: 0.0310437 | val_loss: 0.0312346 | Time: 6264.23 ms [2022-01-26 18:53:54 main:574] : INFO : Epoch 1805 | loss: 0.0310411 | val_loss: 0.0312414 | Time: 6287.02 ms [2022-01-26 18:54:00 main:574] : INFO : Epoch 1806 | loss: 0.0310414 | val_loss: 0.0312397 | Time: 6272.88 ms [2022-01-26 18:54:07 main:574] : INFO : Epoch 1807 | loss: 0.0310394 | val_loss: 0.031235 | Time: 6272.07 ms [2022-01-26 18:54:13 main:574] : INFO : Epoch 1808 | loss: 0.0310357 | val_loss: 0.031232 | Time: 6301.07 ms [2022-01-26 18:54:19 main:574] : INFO : Epoch 1809 | loss: 0.0310283 | val_loss: 0.0312494 | Time: 6289.03 ms [2022-01-26 18:54:25 main:574] : INFO : Epoch 1810 | loss: 0.031043 | val_loss: 0.0312192 | Time: 6273.67 ms [2022-01-26 18:54:32 main:574] : INFO : Epoch 1811 | loss: 0.0310495 | val_loss: 0.0312515 | Time: 6281.85 ms [2022-01-26 18:54:39 main:574] : INFO : Epoch 1812 | loss: 0.0310426 | val_loss: 0.0312218 | Time: 6928.22 ms [2022-01-26 18:54:46 main:574] : INFO : Epoch 1813 | loss: 0.0310502 | val_loss: 0.031221 | Time: 7079.31 ms [2022-01-26 18:55:02 main:574] : INFO : Epoch 1814 | loss: 0.0310581 | val_loss: 0.0312457 | Time: 16646.7 ms [2022-01-26 18:55:09 main:574] : INFO : Epoch 1815 | loss: 0.0310589 | val_loss: 0.0312363 | Time: 6399.47 ms [2022-01-26 18:55:15 main:574] : INFO : Epoch 1816 | loss: 0.0310473 | val_loss: 0.0312331 | Time: 6333.13 ms [2022-01-26 18:55:22 main:574] : INFO : Epoch 1817 | loss: 0.0310374 | val_loss: 0.0312421 | Time: 6407.92 ms [2022-01-26 18:55:28 main:574] : INFO : Epoch 1818 | loss: 0.0310449 | val_loss: 0.0312438 | Time: 6449.6 ms [2022-01-26 18:55:34 main:574] : INFO : Epoch 1819 | loss: 0.0310381 | val_loss: 0.0312434 | Time: 6444.95 ms [2022-01-26 18:55:41 main:574] : INFO : Epoch 1820 | loss: 0.0310331 | val_loss: 0.0312501 | Time: 6443.37 ms [2022-01-26 18:55:47 main:574] : INFO : Epoch 1821 | loss: 0.0310505 | val_loss: 0.031232 | Time: 6353.65 ms [2022-01-26 18:55:54 main:574] : INFO : Epoch 1822 | loss: 0.0310476 | val_loss: 0.0312185 | Time: 6625.91 ms [2022-01-26 18:56:00 main:574] : INFO : Epoch 1823 | loss: 0.0310441 | val_loss: 0.0312373 | Time: 6581.34 ms [2022-01-26 18:56:07 main:574] : INFO : Epoch 1824 | loss: 0.0310538 | val_loss: 0.0312246 | Time: 6624.38 ms [2022-01-26 18:56:13 main:574] : INFO : Epoch 1825 | loss: 0.0310569 | val_loss: 0.0312256 | Time: 6354.16 ms [2022-01-26 18:56:20 main:574] : INFO : Epoch 1826 | loss: 0.0310592 | val_loss: 0.0312186 | Time: 6384.4 ms [2022-01-26 18:56:26 main:574] : INFO : Epoch 1827 | loss: 0.0310481 | val_loss: 0.0312205 | Time: 6357.75 ms [2022-01-26 18:56:33 main:574] : INFO : Epoch 1828 | loss: 0.0310475 | val_loss: 0.0312478 | Time: 6450.55 ms [2022-01-26 18:56:39 main:574] : INFO : Epoch 1829 | loss: 0.0310691 | val_loss: 0.0312213 | Time: 6410.33 ms [2022-01-26 18:56:45 main:574] : INFO : Epoch 1830 | loss: 0.0310635 | val_loss: 0.0312345 | Time: 6376.85 ms [2022-01-26 18:56:52 main:574] : INFO : Epoch 1831 | loss: 0.0310485 | val_loss: 0.0312245 | Time: 6328.22 ms [2022-01-26 18:56:58 main:574] : INFO : Epoch 1832 | loss: 0.0310465 | val_loss: 0.0312416 | Time: 6339.64 ms [2022-01-26 18:57:05 main:574] : INFO : Epoch 1833 | loss: 0.0310437 | val_loss: 0.0312302 | Time: 6423.33 ms [2022-01-26 18:57:11 main:574] : INFO : Epoch 1834 | loss: 0.0310445 | val_loss: 0.0312361 | Time: 6421.47 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-01-26 18:58:44 main:435] : INFO : Set logging level to 1 [2022-01-26 18:58:44 main:441] : INFO : Running in BOINC Client mode [2022-01-26 18:58:44 main:444] : INFO : Resolving all filenames [2022-01-26 18:58:44 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-01-26 18:58:44 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-01-26 18:58:44 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-01-26 18:58:44 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-01-26 18:58:44 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-01-26 18:58:44 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-01-26 18:58:44 main:474] : INFO : Configuration: [2022-01-26 18:58:44 main:475] : INFO : Model type: GRU [2022-01-26 18:58:44 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-01-26 18:58:44 main:477] : INFO : Max Epochs: 2048 [2022-01-26 18:58:44 main:478] : INFO : Batch Size: 128 [2022-01-26 18:58:44 main:479] : INFO : Learning Rate: 0.01 [2022-01-26 18:58:44 main:480] : INFO : Patience: 10 [2022-01-26 18:58:44 main:481] : INFO : Hidden Width: 12 [2022-01-26 18:58:44 main:482] : INFO : # Recurrent Layers: 4 [2022-01-26 18:58:44 main:483] : INFO : # Backend Layers: 4 [2022-01-26 18:58:44 main:484] : INFO : # Threads: 1 [2022-01-26 18:58:44 main:486] : INFO : Preparing Dataset [2022-01-26 18:58:44 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-01-26 18:58:44 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-01-26 18:58:47 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-01-26 18:58:47 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-01-26 18:58:47 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-01-26 18:58:47 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-01-26 18:58:47 main:494] : INFO : Creating Model [2022-01-26 18:58:47 main:507] : INFO : Preparing config file [2022-01-26 18:58:47 main:511] : INFO : Found checkpoint, attempting to load... [2022-01-26 18:58:47 main:512] : INFO : Loading config [2022-01-26 18:58:47 main:514] : INFO : Loading state [2022-01-26 18:58:48 main:559] : INFO : Loading DataLoader into Memory [2022-01-26 18:58:48 main:562] : INFO : Starting Training [2022-01-26 18:58:55 main:574] : INFO : Epoch 1826 | loss: 0.0311012 | val_loss: 0.0312179 | Time: 6476 ms [2022-01-26 18:59:01 main:574] : INFO : Epoch 1827 | loss: 0.0310595 | val_loss: 0.0312197 | Time: 6240.02 ms [2022-01-26 18:59:07 main:574] : INFO : Epoch 1828 | loss: 0.0310516 | val_loss: 0.0312337 | Time: 6308.49 ms [2022-01-26 18:59:13 main:574] : INFO : Epoch 1829 | loss: 0.0310431 | val_loss: 0.0312254 | Time: 6276.24 ms [2022-01-26 18:59:20 main:574] : INFO : Epoch 1830 | loss: 0.0310457 | val_loss: 0.0312492 | Time: 6271.3 ms [2022-01-26 18:59:26 main:574] : INFO : Epoch 1831 | loss: 0.031048 | val_loss: 0.0312336 | Time: 6274.51 ms [2022-01-26 18:59:32 main:574] : INFO : Epoch 1832 | loss: 0.0310518 | val_loss: 0.031219 | Time: 6292.42 ms [2022-01-26 18:59:39 main:574] : INFO : Epoch 1833 | loss: 0.0310499 | val_loss: 0.0312511 | Time: 6342.76 ms [2022-01-26 18:59:45 main:574] : INFO : Epoch 1834 | loss: 0.0310447 | val_loss: 0.0312099 | Time: 6280.76 ms [2022-01-26 18:59:51 main:574] : INFO : Epoch 1835 | loss: 0.0310788 | val_loss: 0.0312107 | Time: 6295.62 ms [2022-01-26 18:59:57 main:574] : INFO : Epoch 1836 | loss: 0.0310618 | val_loss: 0.0312375 | Time: 6264.79 ms [2022-01-26 19:00:04 main:574] : INFO : Epoch 1837 | loss: 0.0310449 | val_loss: 0.0312331 | Time: 6258.93 ms [2022-01-26 19:00:10 main:574] : INFO : Epoch 1838 | loss: 0.0310359 | val_loss: 0.0312238 | Time: 6290.3 ms [2022-01-26 19:00:16 main:574] : INFO : Epoch 1839 | loss: 0.0310459 | val_loss: 0.031238 | Time: 6328.54 ms [2022-01-26 19:00:23 main:574] : INFO : Epoch 1840 | loss: 0.0310453 | val_loss: 0.0312403 | Time: 6289.33 ms [2022-01-26 19:00:29 main:574] : INFO : Epoch 1841 | loss: 0.0310452 | val_loss: 0.0312187 | Time: 6288.39 ms [2022-01-26 19:00:35 main:574] : INFO : Epoch 1842 | loss: 0.0310456 | val_loss: 0.0312221 | Time: 6297.65 ms [2022-01-26 19:00:42 main:574] : INFO : Epoch 1843 | loss: 0.0310422 | val_loss: 0.0312266 | Time: 6282.32 ms [2022-01-26 19:00:48 main:574] : INFO : Epoch 1844 | loss: 0.03104 | val_loss: 0.0312331 | Time: 6266.94 ms [2022-01-26 19:00:54 main:574] : INFO : Epoch 1845 | loss: 0.0310413 | val_loss: 0.0312286 | Time: 6283.74 ms [2022-01-26 19:01:00 main:574] : INFO : Epoch 1846 | loss: 0.031033 | val_loss: 0.0312374 | Time: 6296.1 ms [2022-01-26 19:01:07 main:574] : INFO : Epoch 1847 | loss: 0.0310259 | val_loss: 0.0312374 | Time: 6253.07 ms [2022-01-26 19:01:13 main:574] : INFO : Epoch 1848 | loss: 0.0310363 | val_loss: 0.0312436 | Time: 6260.36 ms [2022-01-26 19:01:19 main:574] : INFO : Epoch 1849 | loss: 0.031044 | val_loss: 0.0312202 | Time: 6287.09 ms [2022-01-26 19:01:25 main:574] : INFO : Epoch 1850 | loss: 0.0310443 | val_loss: 0.0312359 | Time: 6294.18 ms [2022-01-26 19:01:32 main:574] : INFO : Epoch 1851 | loss: 0.031044 | val_loss: 0.0312298 | Time: 6303.81 ms [2022-01-26 19:01:38 main:574] : INFO : Epoch 1852 | loss: 0.0310361 | val_loss: 0.0312493 | Time: 6285.1 ms [2022-01-26 19:01:45 main:574] : INFO : Epoch 1853 | loss: 0.0310365 | val_loss: 0.03123 | Time: 6937.48 ms [2022-01-26 19:01:52 main:574] : INFO : Epoch 1854 | loss: 0.0310857 | val_loss: 0.0312054 | Time: 6759.2 ms [2022-01-26 19:02:09 main:574] : INFO : Epoch 1855 | loss: 0.0311129 | val_loss: 0.0311942 | Time: 17070.2 ms [2022-01-26 19:02:15 main:574] : INFO : Epoch 1856 | loss: 0.031095 | val_loss: 0.0311972 | Time: 6446.68 ms [2022-01-26 19:02:22 main:574] : INFO : Epoch 1857 | loss: 0.0310734 | val_loss: 0.0312329 | Time: 6366.78 ms [2022-01-26 19:02:28 main:574] : INFO : Epoch 1858 | loss: 0.0310585 | val_loss: 0.0312001 | Time: 6568.77 ms [2022-01-26 19:02:35 main:574] : INFO : Epoch 1859 | loss: 0.03105 | val_loss: 0.0312202 | Time: 6435.86 ms [2022-01-26 19:02:41 main:574] : INFO : Epoch 1860 | loss: 0.031041 | val_loss: 0.0312475 | Time: 6385.11 ms [2022-01-26 19:02:58 main:574] : INFO : Epoch 1861 | loss: 0.0310408 | val_loss: 0.0312351 | Time: 16724.6 ms [2022-01-26 19:03:04 main:574] : INFO : Epoch 1862 | loss: 0.0310374 | val_loss: 0.0312393 | Time: 6412.4 ms [2022-01-26 19:03:21 main:574] : INFO : Epoch 1863 | loss: 0.03104 | val_loss: 0.0312399 | Time: 16965.9 ms [2022-01-26 19:03:28 main:574] : INFO : Epoch 1864 | loss: 0.0310451 | val_loss: 0.0312361 | Time: 6325.86 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-01-26 19:04:35 main:435] : INFO : Set logging level to 1 [2022-01-26 19:04:35 main:441] : INFO : Running in BOINC Client mode [2022-01-26 19:04:35 main:444] : INFO : Resolving all filenames [2022-01-26 19:04:35 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-01-26 19:04:35 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-01-26 19:04:35 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-01-26 19:04:35 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-01-26 19:04:35 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-01-26 19:04:35 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-01-26 19:04:35 main:474] : INFO : Configuration: [2022-01-26 19:04:35 main:475] : INFO : Model type: GRU [2022-01-26 19:04:36 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-01-26 19:04:36 main:477] : INFO : Max Epochs: 2048 [2022-01-26 19:04:36 main:478] : INFO : Batch Size: 128 [2022-01-26 19:04:36 main:479] : INFO : Learning Rate: 0.01 [2022-01-26 19:04:36 main:480] : INFO : Patience: 10 [2022-01-26 19:04:36 main:481] : INFO : Hidden Width: 12 [2022-01-26 19:04:36 main:482] : INFO : # Recurrent Layers: 4 [2022-01-26 19:04:36 main:483] : INFO : # Backend Layers: 4 [2022-01-26 19:04:36 main:484] : INFO : # Threads: 1 [2022-01-26 19:04:36 main:486] : INFO : Preparing Dataset [2022-01-26 19:04:36 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-01-26 19:04:36 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-01-26 19:04:38 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-01-26 19:04:38 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-01-26 19:04:39 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-01-26 19:04:39 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-01-26 19:04:39 main:494] : INFO : Creating Model [2022-01-26 19:04:39 main:507] : INFO : Preparing config file [2022-01-26 19:04:39 main:511] : INFO : Found checkpoint, attempting to load... [2022-01-26 19:04:39 main:512] : INFO : Loading config [2022-01-26 19:04:39 main:514] : INFO : Loading state [2022-01-26 19:04:40 main:559] : INFO : Loading DataLoader into Memory [2022-01-26 19:04:40 main:562] : INFO : Starting Training [2022-01-26 19:04:46 main:574] : INFO : Epoch 1864 | loss: 0.0311181 | val_loss: 0.0312151 | Time: 6462.9 ms [2022-01-26 19:04:52 main:574] : INFO : Epoch 1865 | loss: 0.0310795 | val_loss: 0.0312309 | Time: 6261.71 ms [2022-01-26 19:04:59 main:574] : INFO : Epoch 1866 | loss: 0.031062 | val_loss: 0.0312236 | Time: 6259.28 ms [2022-01-26 19:05:05 main:574] : INFO : Epoch 1867 | loss: 0.0310516 | val_loss: 0.0312252 | Time: 6253.08 ms [2022-01-26 19:05:11 main:574] : INFO : Epoch 1868 | loss: 0.0310477 | val_loss: 0.0312229 | Time: 6269.94 ms [2022-01-26 19:05:17 main:574] : INFO : Epoch 1869 | loss: 0.0310465 | val_loss: 0.0312307 | Time: 6309.91 ms [2022-01-26 19:05:24 main:574] : INFO : Epoch 1870 | loss: 0.0310406 | val_loss: 0.031237 | Time: 6283.74 ms [2022-01-26 19:05:30 main:574] : INFO : Epoch 1871 | loss: 0.0310458 | val_loss: 0.0312461 | Time: 6285.71 ms [2022-01-26 19:05:36 main:574] : INFO : Epoch 1872 | loss: 0.0310517 | val_loss: 0.0312162 | Time: 6267.21 ms [2022-01-26 19:05:43 main:574] : INFO : Epoch 1873 | loss: 0.0310477 | val_loss: 0.0312593 | Time: 6291.36 ms [2022-01-26 19:05:49 main:574] : INFO : Epoch 1874 | loss: 0.0310576 | val_loss: 0.031213 | Time: 6266.93 ms [2022-01-26 19:05:55 main:574] : INFO : Epoch 1875 | loss: 0.0310576 | val_loss: 0.0312257 | Time: 6269.37 ms [2022-01-26 19:06:01 main:574] : INFO : Epoch 1876 | loss: 0.0310524 | val_loss: 0.0312337 | Time: 6269.9 ms [2022-01-26 19:06:08 main:574] : INFO : Epoch 1877 | loss: 0.031047 | val_loss: 0.0312175 | Time: 6304.96 ms [2022-01-26 19:06:14 main:574] : INFO : Epoch 1878 | loss: 0.0310404 | val_loss: 0.0312443 | Time: 6285.55 ms [2022-01-26 19:06:20 main:574] : INFO : Epoch 1879 | loss: 0.0310401 | val_loss: 0.0312265 | Time: 6297.92 ms [2022-01-26 19:06:27 main:574] : INFO : Epoch 1880 | loss: 0.0310496 | val_loss: 0.0312147 | Time: 6303.25 ms [2022-01-26 19:06:33 main:574] : INFO : Epoch 1881 | loss: 0.0310545 | val_loss: 0.0312283 | Time: 6286.14 ms [2022-01-26 19:06:39 main:574] : INFO : Epoch 1882 | loss: 0.0310511 | val_loss: 0.0312249 | Time: 6292.09 ms [2022-01-26 19:06:46 main:574] : INFO : Epoch 1883 | loss: 0.0310454 | val_loss: 0.0312438 | Time: 6292.48 ms [2022-01-26 19:06:52 main:574] : INFO : Epoch 1884 | loss: 0.0310393 | val_loss: 0.0312448 | Time: 6291.15 ms [2022-01-26 19:06:58 main:574] : INFO : Epoch 1885 | loss: 0.0310473 | val_loss: 0.0312288 | Time: 6304.58 ms [2022-01-26 19:07:05 main:574] : INFO : Epoch 1886 | loss: 0.0310409 | val_loss: 0.031232 | Time: 6322.05 ms [2022-01-26 19:07:11 main:574] : INFO : Epoch 1887 | loss: 0.031036 | val_loss: 0.0312396 | Time: 6291.36 ms [2022-01-26 19:07:17 main:574] : INFO : Epoch 1888 | loss: 0.0310363 | val_loss: 0.031231 | Time: 6277.91 ms [2022-01-26 19:07:23 main:574] : INFO : Epoch 1889 | loss: 0.0310408 | val_loss: 0.0312252 | Time: 6291.26 ms [2022-01-26 19:07:30 main:574] : INFO : Epoch 1890 | loss: 0.0310393 | val_loss: 0.0312362 | Time: 6264.09 ms [2022-01-26 19:07:37 main:574] : INFO : Epoch 1891 | loss: 0.0310607 | val_loss: 0.0312217 | Time: 7025.15 ms [2022-01-26 19:07:44 main:574] : INFO : Epoch 1892 | loss: 0.031057 | val_loss: 0.0312327 | Time: 6965.78 ms [2022-01-26 19:08:00 main:574] : INFO : Epoch 1893 | loss: 0.0310424 | val_loss: 0.0312298 | Time: 16485.7 ms [2022-01-26 19:08:07 main:574] : INFO : Epoch 1894 | loss: 0.0310339 | val_loss: 0.031231 | Time: 6462.4 ms [2022-01-26 19:08:13 main:574] : INFO : Epoch 1895 | loss: 0.0310329 | val_loss: 0.0312324 | Time: 6454.02 ms [2022-01-26 19:08:20 main:574] : INFO : Epoch 1896 | loss: 0.0310331 | val_loss: 0.0312339 | Time: 6477.31 ms [2022-01-26 19:08:26 main:574] : INFO : Epoch 1897 | loss: 0.0310345 | val_loss: 0.0312572 | Time: 6343.64 ms [2022-01-26 19:08:32 main:574] : INFO : Epoch 1898 | loss: 0.0310335 | val_loss: 0.0312349 | Time: 6352.74 ms [2022-01-26 19:08:39 main:574] : INFO : Epoch 1899 | loss: 0.0310403 | val_loss: 0.0312502 | Time: 6405.02 ms [2022-01-26 19:08:45 main:574] : INFO : Epoch 1900 | loss: 0.0310419 | val_loss: 0.0312351 | Time: 6713.65 ms [2022-01-26 19:09:02 main:574] : INFO : Epoch 1901 | loss: 0.0310366 | val_loss: 0.0312478 | Time: 16706.8 ms [2022-01-26 19:09:09 main:574] : INFO : Epoch 1902 | loss: 0.0310308 | val_loss: 0.0312434 | Time: 6395.02 ms [2022-01-26 19:09:15 main:574] : INFO : Epoch 1903 | loss: 0.0310354 | val_loss: 0.0312624 | Time: 6421.04 ms [2022-01-26 19:09:32 main:574] : INFO : Epoch 1904 | loss: 0.0310348 | val_loss: 0.0312365 | Time: 16653.7 ms [2022-01-26 19:09:38 main:574] : INFO : Epoch 1905 | loss: 0.0310367 | val_loss: 0.0312558 | Time: 6376.08 ms [2022-01-26 19:09:44 main:574] : INFO : Epoch 1906 | loss: 0.0310429 | val_loss: 0.0312177 | Time: 6420.73 ms [2022-01-26 19:09:51 main:574] : INFO : Epoch 1907 | loss: 0.0310622 | val_loss: 0.031229 | Time: 6498.77 ms [2022-01-26 19:09:57 main:574] : INFO : Epoch 1908 | loss: 0.0310467 | val_loss: 0.0312343 | Time: 6414.59 ms [2022-01-26 19:10:04 main:574] : INFO : Epoch 1909 | loss: 0.0310409 | val_loss: 0.0312349 | Time: 6395.37 ms [2022-01-26 19:10:10 main:574] : INFO : Epoch 1910 | loss: 0.0310375 | val_loss: 0.0312416 | Time: 6672.75 ms [2022-01-26 19:10:17 main:574] : INFO : Epoch 1911 | loss: 0.031048 | val_loss: 0.0312154 | Time: 6384.24 ms [2022-01-26 19:10:23 main:574] : INFO : Epoch 1912 | loss: 0.0310472 | val_loss: 0.0312632 | Time: 6392.05 ms [2022-01-26 19:10:40 main:574] : INFO : Epoch 1913 | loss: 0.0310442 | val_loss: 0.0312117 | Time: 16378.6 ms [2022-01-26 19:10:46 main:574] : INFO : Epoch 1914 | loss: 0.0310462 | val_loss: 0.0312343 | Time: 6422.96 ms [2022-01-26 19:10:53 main:574] : INFO : Epoch 1915 | loss: 0.0310381 | val_loss: 0.0312476 | Time: 6480.43 ms [2022-01-26 19:10:59 main:574] : INFO : Epoch 1916 | loss: 0.0310339 | val_loss: 0.0312295 | Time: 6410.11 ms [2022-01-26 19:11:05 main:574] : INFO : Epoch 1917 | loss: 0.0310372 | val_loss: 0.031255 | Time: 6445.04 ms [2022-01-26 19:11:23 main:574] : INFO : Epoch 1918 | loss: 0.031038 | val_loss: 0.0312365 | Time: 17079.1 ms [2022-01-26 19:11:29 main:574] : INFO : Epoch 1919 | loss: 0.0310504 | val_loss: 0.0312422 | Time: 6463.48 ms [2022-01-26 19:11:35 main:574] : INFO : Epoch 1920 | loss: 0.0310421 | val_loss: 0.0312293 | Time: 6414.83 ms [2022-01-26 19:11:42 main:574] : INFO : Epoch 1921 | loss: 0.0310287 | val_loss: 0.0312353 | Time: 6323.59 ms [2022-01-26 19:11:48 main:574] : INFO : Epoch 1922 | loss: 0.0310409 | val_loss: 0.0312463 | Time: 6542.55 ms [2022-01-26 19:12:05 main:574] : INFO : Epoch 1923 | loss: 0.0310324 | val_loss: 0.0312462 | Time: 16452.8 ms [2022-01-26 19:12:11 main:574] : INFO : Epoch 1924 | loss: 0.0310342 | val_loss: 0.0312255 | Time: 6348.67 ms [2022-01-26 19:12:17 main:574] : INFO : Epoch 1925 | loss: 0.0310403 | val_loss: 0.031254 | Time: 6386.82 ms [2022-01-26 19:12:24 main:574] : INFO : Epoch 1926 | loss: 0.0310351 | val_loss: 0.0312282 | Time: 6394.4 ms [2022-01-26 19:12:30 main:574] : INFO : Epoch 1927 | loss: 0.0310397 | val_loss: 0.0312319 | Time: 6334.89 ms [2022-01-26 19:12:37 main:574] : INFO : Epoch 1928 | loss: 0.0310409 | val_loss: 0.0312361 | Time: 6389 ms [2022-01-26 19:12:43 main:574] : INFO : Epoch 1929 | loss: 0.0310295 | val_loss: 0.031229 | Time: 6378.38 ms [2022-01-26 19:12:49 main:574] : INFO : Epoch 1930 | loss: 0.0310322 | val_loss: 0.0312464 | Time: 6410.63 ms [2022-01-26 19:12:56 main:574] : INFO : Epoch 1931 | loss: 0.0310357 | val_loss: 0.0312326 | Time: 6377.01 ms [2022-01-26 19:13:02 main:574] : INFO : Epoch 1932 | loss: 0.0310614 | val_loss: 0.0312403 | Time: 6404.7 ms [2022-01-26 19:13:09 main:574] : INFO : Epoch 1933 | loss: 0.0310759 | val_loss: 0.0312168 | Time: 6404.11 ms [2022-01-26 19:13:15 main:574] : INFO : Epoch 1934 | loss: 0.0310766 | val_loss: 0.0312146 | Time: 6376.82 ms [2022-01-26 19:13:21 main:574] : INFO : Epoch 1935 | loss: 0.0310636 | val_loss: 0.0312173 | Time: 6390.27 ms [2022-01-26 19:13:28 main:574] : INFO : Epoch 1936 | loss: 0.0310605 | val_loss: 0.0312288 | Time: 6332.28 ms [2022-01-26 19:13:34 main:574] : INFO : Epoch 1937 | loss: 0.0310538 | val_loss: 0.031223 | Time: 6302.81 ms [2022-01-26 19:13:40 main:574] : INFO : Epoch 1938 | loss: 0.0310473 | val_loss: 0.0312306 | Time: 6293.5 ms [2022-01-26 19:13:47 main:574] : INFO : Epoch 1939 | loss: 0.0310445 | val_loss: 0.0312161 | Time: 6367.59 ms [2022-01-26 19:13:53 main:574] : INFO : Epoch 1940 | loss: 0.0310371 | val_loss: 0.0312435 | Time: 6363.64 ms [2022-01-26 19:13:59 main:574] : INFO : Epoch 1941 | loss: 0.0310326 | val_loss: 0.0312441 | Time: 6358.47 ms [2022-01-26 19:14:06 main:574] : INFO : Epoch 1942 | loss: 0.031047 | val_loss: 0.0312494 | Time: 6409 ms [2022-01-26 19:14:12 main:574] : INFO : Epoch 1943 | loss: 0.031034 | val_loss: 0.0312449 | Time: 6365.71 ms [2022-01-26 19:14:19 main:574] : INFO : Epoch 1944 | loss: 0.0310353 | val_loss: 0.0312169 | Time: 6305.28 ms [2022-01-26 19:14:25 main:574] : INFO : Epoch 1945 | loss: 0.0310366 | val_loss: 0.0312626 | Time: 6359.02 ms [2022-01-26 19:14:31 main:574] : INFO : Epoch 1946 | loss: 0.0310289 | val_loss: 0.0312249 | Time: 6346.22 ms [2022-01-26 19:14:38 main:574] : INFO : Epoch 1947 | loss: 0.0310279 | val_loss: 0.0312422 | Time: 6349.2 ms [2022-01-26 19:14:44 main:574] : INFO : Epoch 1948 | loss: 0.0310292 | val_loss: 0.0312189 | Time: 6388.2 ms [2022-01-26 19:14:50 main:574] : INFO : Epoch 1949 | loss: 0.0310484 | val_loss: 0.031239 | Time: 6426.01 ms [2022-01-26 19:14:57 main:574] : INFO : Epoch 1950 | loss: 0.0310564 | val_loss: 0.0312212 | Time: 6394.9 ms [2022-01-26 19:15:03 main:574] : INFO : Epoch 1951 | loss: 0.0310631 | val_loss: 0.0312117 | Time: 6387.16 ms [2022-01-26 19:15:10 main:574] : INFO : Epoch 1952 | loss: 0.0310662 | val_loss: 0.0312154 | Time: 6317.09 ms [2022-01-26 19:15:16 main:574] : INFO : Epoch 1953 | loss: 0.0310777 | val_loss: 0.031217 | Time: 6347.19 ms [2022-01-26 19:15:22 main:574] : INFO : Epoch 1954 | loss: 0.0310826 | val_loss: 0.0312235 | Time: 6303.16 ms [2022-01-26 19:15:29 main:574] : INFO : Epoch 1955 | loss: 0.0310747 | val_loss: 0.0312367 | Time: 6380.3 ms [2022-01-26 19:15:35 main:574] : INFO : Epoch 1956 | loss: 0.0310581 | val_loss: 0.0312207 | Time: 6382.66 ms [2022-01-26 19:15:41 main:574] : INFO : Epoch 1957 | loss: 0.0310407 | val_loss: 0.0312256 | Time: 6366.73 ms [2022-01-26 19:15:48 main:574] : INFO : Epoch 1958 | loss: 0.0310393 | val_loss: 0.0312401 | Time: 6368.3 ms [2022-01-26 19:15:54 main:574] : INFO : Epoch 1959 | loss: 0.0310378 | val_loss: 0.0312572 | Time: 6353.84 ms [2022-01-26 19:16:00 main:574] : INFO : Epoch 1960 | loss: 0.0310368 | val_loss: 0.0312474 | Time: 6352.25 ms [2022-01-26 19:16:07 main:574] : INFO : Epoch 1961 | loss: 0.031034 | val_loss: 0.0312308 | Time: 6400.08 ms [2022-01-26 19:16:13 main:574] : INFO : Epoch 1962 | loss: 0.0310397 | val_loss: 0.0312309 | Time: 6424.87 ms [2022-01-26 19:16:20 main:574] : INFO : Epoch 1963 | loss: 0.0310387 | val_loss: 0.0312379 | Time: 6274.36 ms [2022-01-26 19:16:26 main:574] : INFO : Epoch 1964 | loss: 0.0310416 | val_loss: 0.0312156 | Time: 6346.6 ms [2022-01-26 19:16:32 main:574] : INFO : Epoch 1965 | loss: 0.0310379 | val_loss: 0.0312561 | Time: 6426.58 ms [2022-01-26 19:16:39 main:574] : INFO : Epoch 1966 | loss: 0.0310311 | val_loss: 0.0312563 | Time: 6435.47 ms [2022-01-26 19:16:45 main:574] : INFO : Epoch 1967 | loss: 0.0310295 | val_loss: 0.031238 | Time: 6432.09 ms [2022-01-26 19:16:52 main:574] : INFO : Epoch 1968 | loss: 0.0310316 | val_loss: 0.0312286 | Time: 6364.98 ms [2022-01-26 19:16:58 main:574] : INFO : Epoch 1969 | loss: 0.0310302 | val_loss: 0.0312711 | Time: 6302.34 ms [2022-01-26 19:17:04 main:574] : INFO : Epoch 1970 | loss: 0.0310275 | val_loss: 0.0312441 | Time: 6382.85 ms [2022-01-26 19:17:11 main:574] : INFO : Epoch 1971 | loss: 0.0310387 | val_loss: 0.031219 | Time: 6365.53 ms [2022-01-26 19:17:17 main:574] : INFO : Epoch 1972 | loss: 0.0310479 | val_loss: 0.0312401 | Time: 6402.36 ms [2022-01-26 19:17:23 main:574] : INFO : Epoch 1973 | loss: 0.0310418 | val_loss: 0.031247 | Time: 6411.55 ms [2022-01-26 19:17:30 main:574] : INFO : Epoch 1974 | loss: 0.0310358 | val_loss: 0.0312309 | Time: 6348.41 ms [2022-01-26 19:17:36 main:574] : INFO : Epoch 1975 | loss: 0.0310364 | val_loss: 0.031222 | Time: 6323.34 ms [2022-01-26 19:17:43 main:574] : INFO : Epoch 1976 | loss: 0.0310355 | val_loss: 0.0312518 | Time: 6356.13 ms [2022-01-26 19:17:49 main:574] : INFO : Epoch 1977 | loss: 0.0310349 | val_loss: 0.0312504 | Time: 6456.72 ms [2022-01-26 19:17:55 main:574] : INFO : Epoch 1978 | loss: 0.0310794 | val_loss: 0.0312161 | Time: 6455.67 ms [2022-01-26 19:18:02 main:574] : INFO : Epoch 1979 | loss: 0.0310875 | val_loss: 0.0312336 | Time: 6358.66 ms [2022-01-26 19:18:08 main:574] : INFO : Epoch 1980 | loss: 0.03106 | val_loss: 0.0312263 | Time: 6340.06 ms [2022-01-26 19:18:15 main:574] : INFO : Epoch 1981 | loss: 0.0310509 | val_loss: 0.0312396 | Time: 6365.18 ms [2022-01-26 19:18:21 main:574] : INFO : Epoch 1982 | loss: 0.0310506 | val_loss: 0.0312242 | Time: 6348.69 ms [2022-01-26 19:18:27 main:574] : INFO : Epoch 1983 | loss: 0.0310405 | val_loss: 0.0312249 | Time: 6347.2 ms [2022-01-26 19:18:34 main:574] : INFO : Epoch 1984 | loss: 0.0310333 | val_loss: 0.0312306 | Time: 6423.7 ms [2022-01-26 19:18:40 main:574] : INFO : Epoch 1985 | loss: 0.0310295 | val_loss: 0.0312395 | Time: 6337.68 ms [2022-01-26 19:18:46 main:574] : INFO : Epoch 1986 | loss: 0.0310308 | val_loss: 0.0312626 | Time: 6406.02 ms [2022-01-26 19:18:53 main:574] : INFO : Epoch 1987 | loss: 0.0310394 | val_loss: 0.0312228 | Time: 6389.47 ms [2022-01-26 19:18:59 main:574] : INFO : Epoch 1988 | loss: 0.0310453 | val_loss: 0.031265 | Time: 6338.73 ms [2022-01-26 19:19:06 main:574] : INFO : Epoch 1989 | loss: 0.0310761 | val_loss: 0.0312328 | Time: 6388.76 ms [2022-01-26 19:19:12 main:574] : INFO : Epoch 1990 | loss: 0.0310534 | val_loss: 0.0312446 | Time: 6416.39 ms [2022-01-26 19:19:18 main:574] : INFO : Epoch 1991 | loss: 0.0310446 | val_loss: 0.0312632 | Time: 6379.4 ms [2022-01-26 19:19:25 main:574] : INFO : Epoch 1992 | loss: 0.0310387 | val_loss: 0.0312329 | Time: 6387.89 ms [2022-01-26 19:19:31 main:574] : INFO : Epoch 1993 | loss: 0.0310308 | val_loss: 0.0312414 | Time: 6366.9 ms [2022-01-26 19:19:38 main:574] : INFO : Epoch 1994 | loss: 0.0310258 | val_loss: 0.0312544 | Time: 6395.13 ms [2022-01-26 19:19:44 main:574] : INFO : Epoch 1995 | loss: 0.0310271 | val_loss: 0.0312371 | Time: 6379.4 ms [2022-01-26 19:19:50 main:574] : INFO : Epoch 1996 | loss: 0.0310306 | val_loss: 0.0312469 | Time: 6379.06 ms [2022-01-26 19:19:57 main:574] : INFO : Epoch 1997 | loss: 0.0310435 | val_loss: 0.0312385 | Time: 6376.81 ms [2022-01-26 19:20:03 main:574] : INFO : Epoch 1998 | loss: 0.0310528 | val_loss: 0.0312219 | Time: 6373.11 ms [2022-01-26 19:20:09 main:574] : INFO : Epoch 1999 | loss: 0.0310537 | val_loss: 0.0312675 | Time: 6347.22 ms [2022-01-26 19:20:16 main:574] : INFO : Epoch 2000 | loss: 0.0310438 | val_loss: 0.0312371 | Time: 6324.17 ms [2022-01-26 19:20:22 main:574] : INFO : Epoch 2001 | loss: 0.0310502 | val_loss: 0.0312444 | Time: 6349.94 ms [2022-01-26 19:20:29 main:574] : INFO : Epoch 2002 | loss: 0.0310577 | val_loss: 0.0312236 | Time: 6456.08 ms [2022-01-26 19:20:35 main:574] : INFO : Epoch 2003 | loss: 0.031042 | val_loss: 0.0312517 | Time: 6365.44 ms [2022-01-26 19:20:41 main:574] : INFO : Epoch 2004 | loss: 0.0310431 | val_loss: 0.0312385 | Time: 6421.23 ms [2022-01-26 19:20:48 main:574] : INFO : Epoch 2005 | loss: 0.0310425 | val_loss: 0.0312317 | Time: 6364.24 ms [2022-01-26 19:20:54 main:574] : INFO : Epoch 2006 | loss: 0.0310438 | val_loss: 0.0312525 | Time: 6430.02 ms [2022-01-26 19:21:01 main:574] : INFO : Epoch 2007 | loss: 0.0310385 | val_loss: 0.0312311 | Time: 6392.42 ms [2022-01-26 19:21:07 main:574] : INFO : Epoch 2008 | loss: 0.031041 | val_loss: 0.0312278 | Time: 6506.82 ms [2022-01-26 19:21:14 main:574] : INFO : Epoch 2009 | loss: 0.0310334 | val_loss: 0.0312331 | Time: 6483.44 ms [2022-01-26 19:21:20 main:574] : INFO : Epoch 2010 | loss: 0.0310281 | val_loss: 0.0312404 | Time: 6323.31 ms [2022-01-26 19:21:26 main:574] : INFO : Epoch 2011 | loss: 0.0310345 | val_loss: 0.0312334 | Time: 6299.97 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX) [2022-01-26 19:22:33 main:435] : INFO : Set logging level to 1 [2022-01-26 19:22:33 main:441] : INFO : Running in BOINC Client mode [2022-01-26 19:22:33 main:444] : INFO : Resolving all filenames [2022-01-26 19:22:33 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-01-26 19:22:33 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-01-26 19:22:33 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-01-26 19:22:33 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-01-26 19:22:33 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-01-26 19:22:33 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-01-26 19:22:33 main:474] : INFO : Configuration: [2022-01-26 19:22:33 main:475] : INFO : Model type: GRU [2022-01-26 19:22:33 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-01-26 19:22:33 main:477] : INFO : Max Epochs: 2048 [2022-01-26 19:22:33 main:478] : INFO : Batch Size: 128 [2022-01-26 19:22:33 main:479] : INFO : Learning Rate: 0.01 [2022-01-26 19:22:33 main:480] : INFO : Patience: 10 [2022-01-26 19:22:33 main:481] : INFO : Hidden Width: 12 [2022-01-26 19:22:33 main:482] : INFO : # Recurrent Layers: 4 [2022-01-26 19:22:33 main:483] : INFO : # Backend Layers: 4 [2022-01-26 19:22:33 main:484] : INFO : # Threads: 1 [2022-01-26 19:22:33 main:486] : INFO : Preparing Dataset [2022-01-26 19:22:33 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-01-26 19:22:34 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-01-26 19:22:37 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-01-26 19:22:37 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-01-26 19:22:37 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-01-26 19:22:37 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-01-26 19:22:37 main:494] : INFO : Creating Model [2022-01-26 19:22:37 main:507] : INFO : Preparing config file [2022-01-26 19:22:37 main:511] : INFO : Found checkpoint, attempting to load... [2022-01-26 19:22:37 main:512] : INFO : Loading config [2022-01-26 19:22:37 main:514] : INFO : Loading state [2022-01-26 19:22:38 main:559] : INFO : Loading DataLoader into Memory [2022-01-26 19:22:38 main:562] : INFO : Starting Training [2022-01-26 19:22:45 main:574] : INFO : Epoch 2004 | loss: 0.0310937 | val_loss: 0.0312374 | Time: 6419.98 ms [2022-01-26 19:22:51 main:574] : INFO : Epoch 2005 | loss: 0.0310507 | val_loss: 0.0312488 | Time: 6238.27 ms [2022-01-26 19:22:57 main:574] : INFO : Epoch 2006 | loss: 0.0310415 | val_loss: 0.0312431 | Time: 6322.87 ms [2022-01-26 19:23:04 main:574] : INFO : Epoch 2007 | loss: 0.0310342 | val_loss: 0.0312476 | Time: 6303.31 ms [2022-01-26 19:23:10 main:574] : INFO : Epoch 2008 | loss: 0.031039 | val_loss: 0.0312576 | Time: 6277.92 ms [2022-01-26 19:23:16 main:574] : INFO : Epoch 2009 | loss: 0.031042 | val_loss: 0.0312383 | Time: 6290.32 ms [2022-01-26 19:23:22 main:574] : INFO : Epoch 2010 | loss: 0.0310435 | val_loss: 0.031237 | Time: 6316.11 ms [2022-01-26 19:23:29 main:574] : INFO : Epoch 2011 | loss: 0.0310469 | val_loss: 0.0312262 | Time: 6299.67 ms [2022-01-26 19:23:35 main:574] : INFO : Epoch 2012 | loss: 0.0310411 | val_loss: 0.0312502 | Time: 6266.98 ms [2022-01-26 19:23:41 main:574] : INFO : Epoch 2013 | loss: 0.0310437 | val_loss: 0.0312329 | Time: 6270.89 ms [2022-01-26 19:23:48 main:574] : INFO : Epoch 2014 | loss: 0.0310455 | val_loss: 0.0312438 | Time: 6254.99 ms [2022-01-26 19:23:54 main:574] : INFO : Epoch 2015 | loss: 0.0310371 | val_loss: 0.0312516 | Time: 6268.88 ms [2022-01-26 19:24:00 main:574] : INFO : Epoch 2016 | loss: 0.031038 | val_loss: 0.0312512 | Time: 6266.19 ms [2022-01-26 19:24:06 main:574] : INFO : Epoch 2017 | loss: 0.0310342 | val_loss: 0.0312353 | Time: 6303.27 ms [2022-01-26 19:24:13 main:574] : INFO : Epoch 2018 | loss: 0.0310356 | val_loss: 0.0312325 | Time: 6270.81 ms [2022-01-26 19:24:19 main:574] : INFO : Epoch 2019 | loss: 0.0310395 | val_loss: 0.0312654 | Time: 6279.07 ms [2022-01-26 19:24:25 main:574] : INFO : Epoch 2020 | loss: 0.0310369 | val_loss: 0.0312124 | Time: 6271.94 ms [2022-01-26 19:24:32 main:574] : INFO : Epoch 2021 | loss: 0.031044 | val_loss: 0.031237 | Time: 6293.46 ms [2022-01-26 19:24:38 main:574] : INFO : Epoch 2022 | loss: 0.0310468 | val_loss: 0.0312567 | Time: 6292.69 ms [2022-01-26 19:24:44 main:574] : INFO : Epoch 2023 | loss: 0.0310431 | val_loss: 0.0312493 | Time: 6266.93 ms [2022-01-26 19:24:50 main:574] : INFO : Epoch 2024 | loss: 0.0310431 | val_loss: 0.0312515 | Time: 6298.79 ms [2022-01-26 19:24:57 main:574] : INFO : Epoch 2025 | loss: 0.0310368 | val_loss: 0.031232 | Time: 6254.05 ms [2022-01-26 19:25:03 main:574] : INFO : Epoch 2026 | loss: 0.0310382 | val_loss: 0.0312525 | Time: 6285.74 ms [2022-01-26 19:25:09 main:574] : INFO : Epoch 2027 | loss: 0.0310358 | val_loss: 0.0312506 | Time: 6286.63 ms [2022-01-26 19:25:16 main:574] : INFO : Epoch 2028 | loss: 0.031035 | val_loss: 0.0312282 | Time: 6273.79 ms [2022-01-26 19:25:22 main:574] : INFO : Epoch 2029 | loss: 0.0310356 | val_loss: 0.0312727 | Time: 6266.57 ms [2022-01-26 19:25:28 main:574] : INFO : Epoch 2030 | loss: 0.0310431 | val_loss: 0.0312106 | Time: 6281.82 ms [2022-01-26 19:25:35 main:574] : INFO : Epoch 2031 | loss: 0.0310427 | val_loss: 0.031243 | Time: 6540.98 ms [2022-01-26 19:25:41 main:574] : INFO : Epoch 2032 | loss: 0.0310437 | val_loss: 0.0312263 | Time: 6346.5 ms [2022-01-26 19:25:47 main:574] : INFO : Epoch 2033 | loss: 0.0310445 | val_loss: 0.0312201 | Time: 6349.03 ms [2022-01-26 19:25:54 main:574] : INFO : Epoch 2034 | loss: 0.0310356 | val_loss: 0.0312386 | Time: 6319.05 ms [2022-01-26 19:26:00 main:574] : INFO : Epoch 2035 | loss: 0.0310295 | val_loss: 0.0312553 | Time: 6364.21 ms [2022-01-26 19:26:06 main:574] : INFO : Epoch 2036 | loss: 0.0310341 | val_loss: 0.0312448 | Time: 6331.09 ms [2022-01-26 19:26:13 main:574] : INFO : Epoch 2037 | loss: 0.0310554 | val_loss: 0.0312318 | Time: 6314.18 ms [2022-01-26 19:26:19 main:574] : INFO : Epoch 2038 | loss: 0.0310573 | val_loss: 0.0312533 | Time: 6392.79 ms [2022-01-26 19:26:25 main:574] : INFO : Epoch 2039 | loss: 0.0310403 | val_loss: 0.0312324 | Time: 6335.55 ms [2022-01-26 19:26:32 main:574] : INFO : Epoch 2040 | loss: 0.0310379 | val_loss: 0.0312377 | Time: 6327.28 ms [2022-01-26 19:26:38 main:574] : INFO : Epoch 2041 | loss: 0.0310353 | val_loss: 0.0312171 | Time: 6406.16 ms [2022-01-26 19:26:45 main:574] : INFO : Epoch 2042 | loss: 0.0310342 | val_loss: 0.0312485 | Time: 6418.93 ms [2022-01-26 19:26:51 main:574] : INFO : Epoch 2043 | loss: 0.0310285 | val_loss: 0.0312439 | Time: 6419.53 ms [2022-01-26 19:26:57 main:574] : INFO : Epoch 2044 | loss: 0.0310301 | val_loss: 0.0312404 | Time: 6383.93 ms [2022-01-26 19:27:04 main:574] : INFO : Epoch 2045 | loss: 0.031038 | val_loss: 0.0312443 | Time: 6311.82 ms [2022-01-26 19:27:10 main:574] : INFO : Epoch 2046 | loss: 0.0310409 | val_loss: 0.0312521 | Time: 6406.91 ms [2022-01-26 19:27:17 main:574] : INFO : Epoch 2047 | loss: 0.031033 | val_loss: 0.0312455 | Time: 6354.89 ms [2022-01-26 19:27:23 main:574] : INFO : Epoch 2048 | loss: 0.0310296 | val_loss: 0.0312557 | Time: 6316.89 ms [2022-01-26 19:27:23 main:597] : INFO : Saving trained model to model-final.pt, val_loss 0.0312557 [2022-01-26 19:27:23 main:603] : INFO : Saving end state to config to file [2022-01-26 19:27:23 main:608] : INFO : Success, exiting.. 19:27:23 (2848): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)