Task 8932855
| Name | ParityModified-1636177570-11023-1-0_0 |
| Workunit | 6394254 |
| Created | 14 Nov 2021, 3:14:30 UTC |
| Sent | 20 Nov 2021, 18:48:38 UTC |
| Report deadline | 28 Nov 2021, 18:48:38 UTC |
| Received | 2 Jan 2022, 20:31:44 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 7979 |
| Run time | 4 hours 8 min 58 sec |
| CPU time | 3 hours 25 min 20 sec |
| Validate state | Task was reported too late to validate |
| Credit | 0.00 |
| Device peak FLOPS | 4,734.15 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.62 GB |
| Peak swap size | 3.61 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.11</core_client_version> <![CDATA[ <stderr_txt> [2021-12-31 19:13:08 main:476] : INFO : Validation Loss Threshold: 0.0001 [2021-12-31 19:13:08 main:477] : INFO : Max Epochs: 2048 [2021-12-31 19:13:08 main:478] : INFO : Batch Size: 128 [2021-12-31 19:13:08 main:479] : INFO : Learning Rate: 0.01 [2021-12-31 19:13:08 main:480] : INFO : Patience: 10 [2021-12-31 19:13:08 main:481] : INFO : Hidden Width: 12 [2021-12-31 19:13:08 main:482] : INFO : # Recurrent Layers: 4 [2021-12-31 19:13:08 main:483] : INFO : # Backend Layers: 4 [2021-12-31 19:13:08 main:484] : INFO : # Threads: 1 [2021-12-31 19:13:08 main:486] : INFO : Preparing Dataset [2021-12-31 19:13:08 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2021-12-31 19:13:09 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2021-12-31 19:13:10 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2021-12-31 19:13:10 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2021-12-31 19:13:10 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2021-12-31 19:13:11 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2021-12-31 19:13:11 main:494] : INFO : Creating Model [2021-12-31 19:13:11 main:507] : INFO : Preparing config file [2021-12-31 19:13:11 main:511] : INFO : Found checkpoint, attempting to load... [2021-12-31 19:13:11 main:512] : INFO : Loading config [2021-12-31 19:13:11 main:514] : INFO : Loading state [2021-12-31 19:13:11 main:559] : INFO : Loading DataLoader into Memory [2021-12-31 19:13:11 main:562] : INFO : Starting Training [2021-12-31 19:13:20 main:574] : INFO : Epoch 1668 | loss: 0.0311705 | val_loss: 0.0311589 | Time: 8361.56 ms [2021-12-31 19:13:28 main:574] : INFO : Epoch 1669 | loss: 0.0311467 | val_loss: 0.0311545 | Time: 7733.58 ms [2021-12-31 19:13:35 main:574] : INFO : Epoch 1670 | loss: 0.0311421 | val_loss: 0.0311524 | Time: 7565.92 ms [2021-12-31 19:13:43 main:574] : INFO : Epoch 1671 | loss: 0.0311395 | val_loss: 0.0311525 | Time: 7805.18 ms [2021-12-31 19:13:51 main:574] : INFO : Epoch 1672 | loss: 0.0311368 | val_loss: 0.031155 | Time: 8067.25 ms [2021-12-31 19:13:59 main:574] : INFO : Epoch 1673 | loss: 0.0311375 | val_loss: 0.0311592 | Time: 7864.57 ms [2021-12-31 19:14:07 main:574] : INFO : Epoch 1674 | loss: 0.0311352 | val_loss: 0.0311542 | Time: 7636.53 ms [2021-12-31 19:14:14 main:574] : INFO : Epoch 1675 | loss: 0.0311336 | val_loss: 0.0311594 | Time: 7707.16 ms [2021-12-31 19:14:22 main:574] : INFO : Epoch 1676 | loss: 0.0311347 | val_loss: 0.0311558 | Time: 7782.8 ms [2021-12-31 19:14:29 main:574] : INFO : Epoch 1677 | loss: 0.0311348 | val_loss: 0.031157 | Time: 6628.48 ms [2021-12-31 19:14:36 main:574] : INFO : Epoch 1678 | loss: 0.0311351 | val_loss: 0.0311581 | Time: 6578.88 ms [2021-12-31 19:14:42 main:574] : INFO : Epoch 1679 | loss: 0.0311306 | val_loss: 0.0311564 | Time: 6798.65 ms [2021-12-31 19:14:49 main:574] : INFO : Epoch 1680 | loss: 0.0311283 | val_loss: 0.0311551 | Time: 6690.44 ms [2021-12-31 19:14:56 main:574] : INFO : Epoch 1681 | loss: 0.0311307 | val_loss: 0.0311565 | Time: 6799.37 ms [2021-12-31 19:15:03 main:574] : INFO : Epoch 1682 | loss: 0.0311288 | val_loss: 0.0311545 | Time: 6916.14 ms [2021-12-31 19:15:10 main:574] : INFO : Epoch 1683 | loss: 0.0311257 | val_loss: 0.0311534 | Time: 7091.07 ms [2021-12-31 19:15:17 main:574] : INFO : Epoch 1684 | loss: 0.0311267 | val_loss: 0.0311593 | Time: 7217.65 ms [2021-12-31 19:15:24 main:574] : INFO : Epoch 1685 | loss: 0.0311276 | val_loss: 0.0311565 | Time: 6748.34 ms [2021-12-31 19:15:31 main:574] : INFO : Epoch 1686 | loss: 0.0311275 | val_loss: 0.0311559 | Time: 6860.07 ms [2021-12-31 19:15:38 main:574] : INFO : Epoch 1687 | loss: 0.0311233 | val_loss: 0.0311567 | Time: 6716.35 ms [2021-12-31 19:15:45 main:574] : INFO : Epoch 1688 | loss: 0.0311249 | val_loss: 0.0311613 | Time: 6622.45 ms [2021-12-31 19:15:51 main:574] : INFO : Epoch 1689 | loss: 0.0311318 | val_loss: 0.0311671 | Time: 6539.36 ms [2021-12-31 19:15:58 main:574] : INFO : Epoch 1690 | loss: 0.0311316 | val_loss: 0.0311591 | Time: 6625.8 ms [2021-12-31 19:16:04 main:574] : INFO : Epoch 1691 | loss: 0.031131 | val_loss: 0.0311581 | Time: 6539.81 ms [2021-12-31 19:16:11 main:574] : INFO : Epoch 1692 | loss: 0.0311265 | val_loss: 0.0311556 | Time: 6982.51 ms [2021-12-31 19:16:19 main:574] : INFO : Epoch 1693 | loss: 0.0311275 | val_loss: 0.0311616 | Time: 7258.63 ms [2021-12-31 19:16:25 main:574] : INFO : Epoch 1694 | loss: 0.0311283 | val_loss: 0.0311572 | Time: 6439.56 ms [2021-12-31 19:16:32 main:574] : INFO : Epoch 1695 | loss: 0.0311251 | val_loss: 0.0311588 | Time: 6885.49 ms [2021-12-31 19:16:39 main:574] : INFO : Epoch 1696 | loss: 0.0311231 | val_loss: 0.0311586 | Time: 6721.01 ms [2021-12-31 19:16:46 main:574] : INFO : Epoch 1697 | loss: 0.0311233 | val_loss: 0.0311596 | Time: 6723.16 ms [2021-12-31 19:16:53 main:574] : INFO : Epoch 1698 | loss: 0.0311206 | val_loss: 0.0311581 | Time: 6898.26 ms [2021-12-31 19:16:59 main:574] : INFO : Epoch 1699 | loss: 0.0311205 | val_loss: 0.0311613 | Time: 6816.22 ms [2021-12-31 19:17:06 main:574] : INFO : Epoch 1700 | loss: 0.031119 | val_loss: 0.0311585 | Time: 6715.07 ms [2021-12-31 19:17:13 main:574] : INFO : Epoch 1701 | loss: 0.0311197 | val_loss: 0.0311579 | Time: 7127.94 ms [2021-12-31 19:17:21 main:574] : INFO : Epoch 1702 | loss: 0.0311192 | val_loss: 0.0311593 | Time: 7731.03 ms [2021-12-31 19:17:28 main:574] : INFO : Epoch 1703 | loss: 0.0311319 | val_loss: 0.0311648 | Time: 6858.63 ms [2021-12-31 19:17:35 main:574] : INFO : Epoch 1704 | loss: 0.0311337 | val_loss: 0.0311605 | Time: 6995.97 ms [2021-12-31 19:17:42 main:574] : INFO : Epoch 1705 | loss: 0.0311276 | val_loss: 0.0311625 | Time: 6544.36 ms [2021-12-31 19:17:48 main:574] : INFO : Epoch 1706 | loss: 0.031124 | val_loss: 0.0311615 | Time: 6692.27 ms [2021-12-31 19:17:55 main:574] : INFO : Epoch 1707 | loss: 0.0311227 | val_loss: 0.0311577 | Time: 6616.93 ms [2021-12-31 19:18:02 main:574] : INFO : Epoch 1708 | loss: 0.0311237 | val_loss: 0.0311655 | Time: 6847.85 ms [2021-12-31 19:18:09 main:574] : INFO : Epoch 1709 | loss: 0.0311224 | val_loss: 0.0311576 | Time: 6939.96 ms [2021-12-31 19:18:16 main:574] : INFO : Epoch 1710 | loss: 0.0311228 | val_loss: 0.0311555 | Time: 7224.41 ms [2021-12-31 19:18:23 main:574] : INFO : Epoch 1711 | loss: 0.0311206 | val_loss: 0.0311585 | Time: 7024.84 ms [2021-12-31 19:18:30 main:574] : INFO : Epoch 1712 | loss: 0.0311188 | val_loss: 0.0311578 | Time: 6691.98 ms [2021-12-31 19:18:37 main:574] : INFO : Epoch 1713 | loss: 0.0311187 | val_loss: 0.0311589 | Time: 6550.9 ms [2021-12-31 19:18:43 main:574] : INFO : Epoch 1714 | loss: 0.0311202 | val_loss: 0.031157 | Time: 6870.63 ms [2021-12-31 19:18:50 main:574] : INFO : Epoch 1715 | loss: 0.0311285 | val_loss: 0.0311605 | Time: 6958.02 ms [2021-12-31 19:18:57 main:574] : INFO : Epoch 1716 | loss: 0.0311344 | val_loss: 0.0311605 | Time: 6601.7 ms [2021-12-31 19:19:04 main:574] : INFO : Epoch 1717 | loss: 0.0311301 | val_loss: 0.0311593 | Time: 6711.06 ms [2021-12-31 19:19:11 main:574] : INFO : Epoch 1718 | loss: 0.0311278 | val_loss: 0.0311562 | Time: 6730.41 ms [2021-12-31 19:19:18 main:574] : INFO : Epoch 1719 | loss: 0.0311257 | val_loss: 0.0311632 | Time: 7115.97 ms [2021-12-31 19:19:24 main:574] : INFO : Epoch 1720 | loss: 0.0311233 | val_loss: 0.0311556 | Time: 6689.33 ms [2021-12-31 19:19:31 main:574] : INFO : Epoch 1721 | loss: 0.0311226 | val_loss: 0.0311575 | Time: 6875.9 ms [2021-12-31 19:19:38 main:574] : INFO : Epoch 1722 | loss: 0.0311203 | val_loss: 0.031156 | Time: 6797.18 ms [2021-12-31 19:19:45 main:574] : INFO : Epoch 1723 | loss: 0.0311162 | val_loss: 0.0311595 | Time: 6546.88 ms [2021-12-31 19:19:52 main:574] : INFO : Epoch 1724 | loss: 0.0311165 | val_loss: 0.0311639 | Time: 6730.56 ms [2021-12-31 19:19:58 main:574] : INFO : Epoch 1725 | loss: 0.0311149 | val_loss: 0.0311621 | Time: 6788.82 ms [2021-12-31 19:20:05 main:574] : INFO : Epoch 1726 | loss: 0.0311129 | val_loss: 0.031163 | Time: 6506.95 ms [2021-12-31 19:20:12 main:574] : INFO : Epoch 1727 | loss: 0.0311146 | val_loss: 0.031162 | Time: 6838.65 ms [2021-12-31 19:20:19 main:574] : INFO : Epoch 1728 | loss: 0.0311143 | val_loss: 0.0311619 | Time: 7185.55 ms [2021-12-31 19:20:26 main:574] : INFO : Epoch 1729 | loss: 0.0311135 | val_loss: 0.031162 | Time: 6752.61 ms [2021-12-31 19:20:32 main:574] : INFO : Epoch 1730 | loss: 0.0311132 | val_loss: 0.0311642 | Time: 6583.07 ms [2021-12-31 19:20:39 main:574] : INFO : Epoch 1731 | loss: 0.0311153 | val_loss: 0.0311598 | Time: 6591.36 ms [2021-12-31 19:20:46 main:574] : INFO : Epoch 1732 | loss: 0.0311166 | val_loss: 0.0311633 | Time: 6589.29 ms [2021-12-31 19:20:52 main:574] : INFO : Epoch 1733 | loss: 0.0311157 | val_loss: 0.031166 | Time: 6673.62 ms [2021-12-31 19:20:59 main:574] : INFO : Epoch 1734 | loss: 0.0311151 | val_loss: 0.031165 | Time: 6630.71 ms [2021-12-31 19:21:06 main:574] : INFO : Epoch 1735 | loss: 0.0311106 | val_loss: 0.0311656 | Time: 6705.04 ms [2021-12-31 19:21:13 main:574] : INFO : Epoch 1736 | loss: 0.031131 | val_loss: 0.0311679 | Time: 6604.89 ms [2021-12-31 19:21:20 main:574] : INFO : Epoch 1737 | loss: 0.0311389 | val_loss: 0.0311651 | Time: 6993.81 ms [2021-12-31 19:21:26 main:574] : INFO : Epoch 1738 | loss: 0.0311412 | val_loss: 0.0311678 | Time: 6867.18 ms [2021-12-31 19:21:33 main:574] : INFO : Epoch 1739 | loss: 0.0311441 | val_loss: 0.031162 | Time: 6907.91 ms [2021-12-31 19:21:40 main:574] : INFO : Epoch 1740 | loss: 0.031137 | val_loss: 0.0311651 | Time: 6903.74 ms [2021-12-31 19:21:47 main:574] : INFO : Epoch 1741 | loss: 0.0311331 | val_loss: 0.0311627 | Time: 6552.14 ms [2021-12-31 19:21:54 main:574] : INFO : Epoch 1742 | loss: 0.03113 | val_loss: 0.0311647 | Time: 6771.67 ms [2021-12-31 19:22:01 main:574] : INFO : Epoch 1743 | loss: 0.031126 | val_loss: 0.0311649 | Time: 6993.25 ms [2021-12-31 19:22:08 main:574] : INFO : Epoch 1744 | loss: 0.0311244 | val_loss: 0.0311617 | Time: 6666.63 ms [2021-12-31 19:22:14 main:574] : INFO : Epoch 1745 | loss: 0.0311207 | val_loss: 0.0311608 | Time: 6532.24 ms [2021-12-31 19:22:21 main:574] : INFO : Epoch 1746 | loss: 0.0311222 | val_loss: 0.0311625 | Time: 7026.54 ms [2021-12-31 19:22:28 main:574] : INFO : Epoch 1747 | loss: 0.0311187 | val_loss: 0.031163 | Time: 6852.01 ms [2021-12-31 19:22:35 main:574] : INFO : Epoch 1748 | loss: 0.0311163 | val_loss: 0.0311628 | Time: 6768.77 ms [2021-12-31 19:22:42 main:574] : INFO : Epoch 1749 | loss: 0.0311151 | val_loss: 0.0311619 | Time: 6909.11 ms [2021-12-31 19:22:49 main:574] : INFO : Epoch 1750 | loss: 0.0311163 | val_loss: 0.031171 | Time: 6846.73 ms [2021-12-31 19:22:55 main:574] : INFO : Epoch 1751 | loss: 0.0311153 | val_loss: 0.0311605 | Time: 6564.56 ms [2021-12-31 19:23:02 main:574] : INFO : Epoch 1752 | loss: 0.0311128 | val_loss: 0.0311634 | Time: 6724.61 ms [2021-12-31 19:23:09 main:574] : INFO : Epoch 1753 | loss: 0.0311113 | val_loss: 0.0311592 | Time: 6845.24 ms [2021-12-31 19:23:16 main:574] : INFO : Epoch 1754 | loss: 0.0311118 | val_loss: 0.03116 | Time: 6722.82 ms [2021-12-31 19:23:23 main:574] : INFO : Epoch 1755 | loss: 0.0311103 | val_loss: 0.0311682 | Time: 6785.25 ms [2021-12-31 19:23:30 main:574] : INFO : Epoch 1756 | loss: 0.0311102 | val_loss: 0.0311564 | Time: 6736.25 ms [2021-12-31 19:23:36 main:574] : INFO : Epoch 1757 | loss: 0.0311106 | val_loss: 0.0311627 | Time: 6570.33 ms [2021-12-31 19:23:43 main:574] : INFO : Epoch 1758 | loss: 0.0311096 | val_loss: 0.0311651 | Time: 6688.1 ms [2021-12-31 19:23:50 main:574] : INFO : Epoch 1759 | loss: 0.0311089 | val_loss: 0.0311642 | Time: 6904.93 ms [2021-12-31 19:23:57 main:574] : INFO : Epoch 1760 | loss: 0.0311086 | val_loss: 0.0311711 | Time: 6820.34 ms [2021-12-31 19:24:04 main:574] : INFO : Epoch 1761 | loss: 0.0311144 | val_loss: 0.0311607 | Time: 6941.98 ms [2021-12-31 19:24:11 main:574] : INFO : Epoch 1762 | loss: 0.031115 | val_loss: 0.0311648 | Time: 6778.82 ms [2021-12-31 19:24:17 main:574] : INFO : Epoch 1763 | loss: 0.0311125 | val_loss: 0.0311613 | Time: 6781.75 ms [2021-12-31 19:24:24 main:574] : INFO : Epoch 1764 | loss: 0.0311136 | val_loss: 0.0311637 | Time: 7045.47 ms [2021-12-31 19:24:31 main:574] : INFO : Epoch 1765 | loss: 0.0311135 | val_loss: 0.0311592 | Time: 6769.71 ms [2021-12-31 19:24:38 main:574] : INFO : Epoch 1766 | loss: 0.0311135 | val_loss: 0.0311652 | Time: 6710.27 ms [2021-12-31 19:24:45 main:574] : INFO : Epoch 1767 | loss: 0.0311131 | val_loss: 0.0311638 | Time: 6754.78 ms [2021-12-31 19:24:52 main:574] : INFO : Epoch 1768 | loss: 0.0311123 | val_loss: 0.0311751 | Time: 6942.46 ms [2021-12-31 19:24:59 main:574] : INFO : Epoch 1769 | loss: 0.0311173 | val_loss: 0.0311634 | Time: 6728.05 ms [2021-12-31 19:25:05 main:574] : INFO : Epoch 1770 | loss: 0.0311227 | val_loss: 0.0311666 | Time: 6621.41 ms [2021-12-31 19:25:12 main:574] : INFO : Epoch 1771 | loss: 0.0311281 | val_loss: 0.0311588 | Time: 6635.55 ms [2021-12-31 19:25:19 main:574] : INFO : Epoch 1772 | loss: 0.0311193 | val_loss: 0.0311608 | Time: 6676.28 ms [2021-12-31 19:25:25 main:574] : INFO : Epoch 1773 | loss: 0.0311132 | val_loss: 0.0311587 | Time: 6643.41 ms [2021-12-31 19:25:32 main:574] : INFO : Epoch 1774 | loss: 0.0311119 | val_loss: 0.0311678 | Time: 6778.79 ms [2021-12-31 19:25:39 main:574] : INFO : Epoch 1775 | loss: 0.0311098 | val_loss: 0.0311637 | Time: 7062.46 ms [2021-12-31 19:25:46 main:574] : INFO : Epoch 1776 | loss: 0.0311116 | val_loss: 0.0311637 | Time: 6736.68 ms [2021-12-31 19:25:53 main:574] : INFO : Epoch 1777 | loss: 0.0311092 | val_loss: 0.0311663 | Time: 6580.32 ms [2021-12-31 19:25:59 main:574] : INFO : Epoch 1778 | loss: 0.0311101 | val_loss: 0.0311626 | Time: 6648.85 ms [2021-12-31 19:26:06 main:574] : INFO : Epoch 1779 | loss: 0.0311107 | val_loss: 0.0311746 | Time: 6728.74 ms [2021-12-31 19:26:13 main:574] : INFO : Epoch 1780 | loss: 0.0311094 | val_loss: 0.0311658 | Time: 6658.02 ms [2021-12-31 19:26:20 main:574] : INFO : Epoch 1781 | loss: 0.0311071 | val_loss: 0.0311704 | Time: 6806.34 ms [2021-12-31 19:26:26 main:574] : INFO : Epoch 1782 | loss: 0.0311049 | val_loss: 0.0311692 | Time: 6558.4 ms [2021-12-31 19:26:33 main:574] : INFO : Epoch 1783 | loss: 0.0311053 | val_loss: 0.0311652 | Time: 6662.07 ms [2021-12-31 19:26:40 main:574] : INFO : Epoch 1784 | loss: 0.0311068 | val_loss: 0.0311661 | Time: 6841.21 ms [2021-12-31 19:26:47 main:574] : INFO : Epoch 1785 | loss: 0.0311052 | val_loss: 0.0311661 | Time: 6709.66 ms [2021-12-31 19:26:54 main:574] : INFO : Epoch 1786 | loss: 0.0311052 | val_loss: 0.0311691 | Time: 6822.55 ms [2021-12-31 19:27:00 main:574] : INFO : Epoch 1787 | loss: 0.0311074 | val_loss: 0.0311774 | Time: 6501.67 ms [2021-12-31 19:27:07 main:574] : INFO : Epoch 1788 | loss: 0.0311078 | val_loss: 0.0311701 | Time: 6679.7 ms [2021-12-31 19:27:14 main:574] : INFO : Epoch 1789 | loss: 0.0311049 | val_loss: 0.0311687 | Time: 6662.27 ms [2021-12-31 19:27:21 main:574] : INFO : Epoch 1790 | loss: 0.031124 | val_loss: 0.0311698 | Time: 6895.49 ms [2021-12-31 19:27:28 main:574] : INFO : Epoch 1791 | loss: 0.031132 | val_loss: 0.0311737 | Time: 7074.73 ms [2021-12-31 19:27:34 main:574] : INFO : Epoch 1792 | loss: 0.0311232 | val_loss: 0.0311623 | Time: 6695.03 ms [2021-12-31 19:27:41 main:574] : INFO : Epoch 1793 | loss: 0.0311168 | val_loss: 0.0311659 | Time: 6761.54 ms [2021-12-31 19:27:48 main:574] : INFO : Epoch 1794 | loss: 0.0311113 | val_loss: 0.0311664 | Time: 6632.28 ms [2021-12-31 19:27:55 main:574] : INFO : Epoch 1795 | loss: 0.0311075 | val_loss: 0.0311635 | Time: 6926.14 ms [2021-12-31 19:28:02 main:574] : INFO : Epoch 1796 | loss: 0.0311058 | val_loss: 0.0311668 | Time: 6988.27 ms [2021-12-31 19:28:09 main:574] : INFO : Epoch 1797 | loss: 0.0311026 | val_loss: 0.0311698 | Time: 6887.74 ms [2021-12-31 19:28:16 main:574] : INFO : Epoch 1798 | loss: 0.0311009 | val_loss: 0.0311672 | Time: 6771.96 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1060 6GB) [2021-12-31 20:02:54 main:435] : INFO : Set logging level to 1 [2021-12-31 20:02:54 main:441] : INFO : Running in BOINC Client mode [2021-12-31 20:02:54 main:444] : INFO : Resolving all filenames [2021-12-31 20:02:54 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2021-12-31 20:02:54 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2021-12-31 20:02:54 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2021-12-31 20:02:54 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2021-12-31 20:02:54 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2021-12-31 20:02:54 main:472] : INFO : Dataset filename: dataset.hdf5 [2021-12-31 20:02:54 main:474] : INFO : Configuration: [2021-12-31 20:02:54 main:475] : INFO : Model type: GRU [2021-12-31 20:02:54 main:476] : INFO : Validation Loss Threshold: 0.0001 [2021-12-31 20:02:54 main:477] : INFO : Max Epochs: 2048 [2021-12-31 20:02:54 main:478] : INFO : Batch Size: 128 [2021-12-31 20:02:54 main:479] : INFO : Learning Rate: 0.01 [2021-12-31 20:02:54 main:480] : INFO : Patience: 10 [2021-12-31 20:02:54 main:481] : INFO : Hidden Width: 12 [2021-12-31 20:02:54 main:482] : INFO : # Recurrent Layers: 4 [2021-12-31 20:02:55 main:483] : INFO : # Backend Layers: 4 [2021-12-31 20:02:55 main:484] : INFO : # Threads: 1 [2021-12-31 20:02:55 main:486] : INFO : Preparing Dataset [2021-12-31 20:02:55 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2021-12-31 20:02:55 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2021-12-31 20:02:57 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2021-12-31 20:02:57 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2021-12-31 20:02:57 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2021-12-31 20:02:57 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2021-12-31 20:02:57 main:494] : INFO : Creating Model [2021-12-31 20:02:57 main:507] : INFO : Preparing config file [2021-12-31 20:02:57 main:511] : INFO : Found checkpoint, attempting to load... [2021-12-31 20:02:57 main:512] : INFO : Loading config [2021-12-31 20:02:57 main:514] : INFO : Loading state [2021-12-31 20:02:58 main:559] : INFO : Loading DataLoader into Memory [2021-12-31 20:02:58 main:562] : INFO : Starting Training [2021-12-31 20:03:06 main:574] : INFO : Epoch 1796 | loss: 0.0311381 | val_loss: 0.0311742 | Time: 8271.92 ms [2021-12-31 20:04:11 main:574] : INFO : Epoch 1797 | loss: 0.0311113 | val_loss: 0.0311673 | Time: 65015.8 ms [2021-12-31 20:04:44 main:574] : INFO : Epoch 1798 | loss: 0.0311098 | val_loss: 0.0311664 | Time: 32815 ms [2021-12-31 20:04:56 main:574] : INFO : Epoch 1799 | loss: 0.0311064 | val_loss: 0.0311647 | Time: 11325.1 ms [2021-12-31 20:05:07 main:574] : INFO : Epoch 1800 | loss: 0.0311059 | val_loss: 0.0311659 | Time: 11110.9 ms [2021-12-31 20:05:18 main:574] : INFO : Epoch 1801 | loss: 0.0311077 | val_loss: 0.031167 | Time: 10863.1 ms [2021-12-31 20:05:29 main:574] : INFO : Epoch 1802 | loss: 0.0311053 | val_loss: 0.0311699 | Time: 10785.9 ms [2021-12-31 20:05:40 main:574] : INFO : Epoch 1803 | loss: 0.0311028 | val_loss: 0.0311634 | Time: 11096.5 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1060 6GB) [2022-01-01 17:27:16 main:435] : INFO : Set logging level to 1 [2022-01-01 17:27:16 main:441] : INFO : Running in BOINC Client mode [2022-01-01 17:27:16 main:444] : INFO : Resolving all filenames [2022-01-01 17:27:16 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-01-01 17:27:16 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-01-01 17:27:16 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-01-01 17:27:16 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-01-01 17:27:16 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-01-01 17:27:17 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-01-01 17:27:17 main:474] : INFO : Configuration: [2022-01-01 17:27:17 main:475] : INFO : Model type: GRU [2022-01-01 17:27:17 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-01-01 17:27:17 main:477] : INFO : Max Epochs: 2048 [2022-01-01 17:27:17 main:478] : INFO : Batch Size: 128 [2022-01-01 17:27:17 main:479] : INFO : Learning Rate: 0.01 [2022-01-01 17:27:17 main:480] : INFO : Patience: 10 [2022-01-01 17:27:17 main:481] : INFO : Hidden Width: 12 [2022-01-01 17:27:17 main:482] : INFO : # Recurrent Layers: 4 [2022-01-01 17:27:17 main:483] : INFO : # Backend Layers: 4 [2022-01-01 17:27:17 main:484] : INFO : # Threads: 1 [2022-01-01 17:27:17 main:486] : INFO : Preparing Dataset [2022-01-01 17:27:17 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-01-01 17:27:18 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-01-01 17:27:29 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-01-01 17:27:29 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-01-01 17:27:29 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-01-01 17:27:29 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-01-01 17:27:29 main:494] : INFO : Creating Model [2022-01-01 17:27:29 main:507] : INFO : Preparing config file [2022-01-01 17:27:29 main:511] : INFO : Found checkpoint, attempting to load... [2022-01-01 17:27:29 main:512] : INFO : Loading config [2022-01-01 17:27:29 main:514] : INFO : Loading state [2022-01-01 17:27:37 main:559] : INFO : Loading DataLoader into Memory [2022-01-01 17:27:38 main:562] : INFO : Starting Training [2022-01-01 17:27:47 main:574] : INFO : Epoch 1803 | loss: 0.0311514 | val_loss: 0.0311695 | Time: 9222.62 ms [2022-01-01 17:27:54 main:574] : INFO : Epoch 1804 | loss: 0.0311118 | val_loss: 0.0311684 | Time: 7245.29 ms [2022-01-01 17:28:01 main:574] : INFO : Epoch 1805 | loss: 0.0311066 | val_loss: 0.0311661 | Time: 7031.12 ms [2022-01-01 17:28:08 main:574] : INFO : Epoch 1806 | loss: 0.0311042 | val_loss: 0.0311675 | Time: 7042.38 ms [2022-01-01 17:28:16 main:574] : INFO : Epoch 1807 | loss: 0.0311016 | val_loss: 0.0311655 | Time: 7436.84 ms [2022-01-01 17:28:23 main:574] : INFO : Epoch 1808 | loss: 0.0311044 | val_loss: 0.0311624 | Time: 7287.29 ms [2022-01-01 17:28:30 main:574] : INFO : Epoch 1809 | loss: 0.0311041 | val_loss: 0.0311644 | Time: 7000.68 ms [2022-01-01 17:28:37 main:574] : INFO : Epoch 1810 | loss: 0.0311024 | val_loss: 0.0311677 | Time: 6976.4 ms [2022-01-01 17:28:45 main:574] : INFO : Epoch 1811 | loss: 0.0311022 | val_loss: 0.0311658 | Time: 7256.2 ms [2022-01-01 17:28:52 main:574] : INFO : Epoch 1812 | loss: 0.0311043 | val_loss: 0.0311658 | Time: 6917.86 ms [2022-01-01 17:28:59 main:574] : INFO : Epoch 1813 | loss: 0.031102 | val_loss: 0.0311651 | Time: 7200.64 ms [2022-01-01 17:29:06 main:574] : INFO : Epoch 1814 | loss: 0.0311018 | val_loss: 0.0311635 | Time: 7160.4 ms [2022-01-01 17:29:13 main:574] : INFO : Epoch 1815 | loss: 0.031103 | val_loss: 0.0311671 | Time: 7307.33 ms [2022-01-01 17:29:20 main:574] : INFO : Epoch 1816 | loss: 0.0311022 | val_loss: 0.0311642 | Time: 6943.11 ms [2022-01-01 17:29:28 main:574] : INFO : Epoch 1817 | loss: 0.0311052 | val_loss: 0.0311655 | Time: 7072.76 ms [2022-01-01 17:29:35 main:574] : INFO : Epoch 1818 | loss: 0.031103 | val_loss: 0.0311653 | Time: 7094 ms [2022-01-01 17:29:42 main:574] : INFO : Epoch 1819 | loss: 0.0311021 | val_loss: 0.0311675 | Time: 7044.69 ms [2022-01-01 17:29:49 main:574] : INFO : Epoch 1820 | loss: 0.0310989 | val_loss: 0.0311653 | Time: 6934.51 ms [2022-01-01 17:29:56 main:574] : INFO : Epoch 1821 | loss: 0.0310971 | val_loss: 0.0311665 | Time: 6976.61 ms [2022-01-01 17:30:03 main:574] : INFO : Epoch 1822 | loss: 0.0310979 | val_loss: 0.0311669 | Time: 7061.81 ms [2022-01-01 17:30:10 main:574] : INFO : Epoch 1823 | loss: 0.0311 | val_loss: 0.031174 | Time: 6951.45 ms [2022-01-01 17:30:17 main:574] : INFO : Epoch 1824 | loss: 0.0311051 | val_loss: 0.0311657 | Time: 7087.9 ms [2022-01-01 17:30:24 main:574] : INFO : Epoch 1825 | loss: 0.0311023 | val_loss: 0.0311687 | Time: 7233.27 ms [2022-01-01 17:30:32 main:574] : INFO : Epoch 1826 | loss: 0.0311006 | val_loss: 0.0311699 | Time: 7191.09 ms [2022-01-01 17:30:39 main:574] : INFO : Epoch 1827 | loss: 0.0310982 | val_loss: 0.0311733 | Time: 7074.71 ms [2022-01-01 17:30:46 main:574] : INFO : Epoch 1828 | loss: 0.0310959 | val_loss: 0.0311735 | Time: 6930.09 ms [2022-01-01 17:30:53 main:574] : INFO : Epoch 1829 | loss: 0.0310965 | val_loss: 0.0311643 | Time: 7562.12 ms [2022-01-01 17:31:01 main:574] : INFO : Epoch 1830 | loss: 0.0310976 | val_loss: 0.0311654 | Time: 7239.43 ms [2022-01-01 17:31:08 main:574] : INFO : Epoch 1831 | loss: 0.0310972 | val_loss: 0.0311721 | Time: 7079.76 ms [2022-01-01 17:31:15 main:574] : INFO : Epoch 1832 | loss: 0.0311013 | val_loss: 0.0311665 | Time: 7650.91 ms [2022-01-01 17:31:23 main:574] : INFO : Epoch 1833 | loss: 0.0310997 | val_loss: 0.0311713 | Time: 7056.23 ms [2022-01-01 17:31:30 main:574] : INFO : Epoch 1834 | loss: 0.0311002 | val_loss: 0.0311713 | Time: 7189.2 ms [2022-01-01 17:31:37 main:574] : INFO : Epoch 1835 | loss: 0.0311001 | val_loss: 0.0311698 | Time: 7097.51 ms [2022-01-01 17:31:44 main:574] : INFO : Epoch 1836 | loss: 0.0310978 | val_loss: 0.0311682 | Time: 7172.81 ms [2022-01-01 17:31:51 main:574] : INFO : Epoch 1837 | loss: 0.0310959 | val_loss: 0.0311701 | Time: 7104.04 ms [2022-01-01 17:31:59 main:574] : INFO : Epoch 1838 | loss: 0.0310954 | val_loss: 0.0311704 | Time: 7378.7 ms [2022-01-01 17:32:06 main:574] : INFO : Epoch 1839 | loss: 0.0310938 | val_loss: 0.0311696 | Time: 7099.8 ms [2022-01-01 17:32:13 main:574] : INFO : Epoch 1840 | loss: 0.0310926 | val_loss: 0.0311675 | Time: 7029.7 ms [2022-01-01 17:32:20 main:574] : INFO : Epoch 1841 | loss: 0.0310937 | val_loss: 0.0311708 | Time: 7091.66 ms [2022-01-01 17:32:27 main:574] : INFO : Epoch 1842 | loss: 0.031095 | val_loss: 0.031165 | Time: 7164.17 ms [2022-01-01 17:32:35 main:574] : INFO : Epoch 1843 | loss: 0.0310934 | val_loss: 0.0311709 | Time: 7192.03 ms [2022-01-01 17:32:42 main:574] : INFO : Epoch 1844 | loss: 0.0310938 | val_loss: 0.0311706 | Time: 7061.17 ms [2022-01-01 17:32:49 main:574] : INFO : Epoch 1845 | loss: 0.0310946 | val_loss: 0.031173 | Time: 6935.59 ms [2022-01-01 17:32:56 main:574] : INFO : Epoch 1846 | loss: 0.0311038 | val_loss: 0.0311674 | Time: 7019.96 ms [2022-01-01 17:33:03 main:574] : INFO : Epoch 1847 | loss: 0.0311019 | val_loss: 0.0311732 | Time: 7095.71 ms [2022-01-01 17:33:10 main:574] : INFO : Epoch 1848 | loss: 0.031097 | val_loss: 0.0311678 | Time: 7064.01 ms [2022-01-01 17:33:17 main:574] : INFO : Epoch 1849 | loss: 0.0310965 | val_loss: 0.0311697 | Time: 7209.29 ms [2022-01-01 17:33:24 main:574] : INFO : Epoch 1850 | loss: 0.0310964 | val_loss: 0.0311785 | Time: 7095.7 ms [2022-01-01 17:33:32 main:574] : INFO : Epoch 1851 | loss: 0.0310949 | val_loss: 0.031177 | Time: 7291.44 ms [2022-01-01 17:33:39 main:574] : INFO : Epoch 1852 | loss: 0.0310961 | val_loss: 0.0311722 | Time: 7089.93 ms [2022-01-01 17:33:46 main:574] : INFO : Epoch 1853 | loss: 0.0310967 | val_loss: 0.0311766 | Time: 7027 ms [2022-01-01 17:33:53 main:574] : INFO : Epoch 1854 | loss: 0.0310998 | val_loss: 0.0311731 | Time: 7033.46 ms [2022-01-01 17:34:00 main:574] : INFO : Epoch 1855 | loss: 0.031096 | val_loss: 0.0311753 | Time: 7027.26 ms [2022-01-01 17:34:07 main:574] : INFO : Epoch 1856 | loss: 0.0310963 | val_loss: 0.0311728 | Time: 7176.53 ms [2022-01-01 17:34:15 main:574] : INFO : Epoch 1857 | loss: 0.0310924 | val_loss: 0.031167 | Time: 7321.5 ms [2022-01-01 17:34:22 main:574] : INFO : Epoch 1858 | loss: 0.0310922 | val_loss: 0.0311723 | Time: 7208.9 ms [2022-01-01 17:34:29 main:574] : INFO : Epoch 1859 | loss: 0.031092 | val_loss: 0.0311736 | Time: 6998.41 ms [2022-01-01 17:34:36 main:574] : INFO : Epoch 1860 | loss: 0.0310926 | val_loss: 0.0311673 | Time: 7223.83 ms [2022-01-01 17:34:43 main:574] : INFO : Epoch 1861 | loss: 0.0310927 | val_loss: 0.0311771 | Time: 7059.4 ms [2022-01-01 17:34:51 main:574] : INFO : Epoch 1862 | loss: 0.0310907 | val_loss: 0.0311637 | Time: 7155.44 ms [2022-01-01 17:34:58 main:574] : INFO : Epoch 1863 | loss: 0.0310908 | val_loss: 0.0311775 | Time: 7023.05 ms [2022-01-01 17:35:05 main:574] : INFO : Epoch 1864 | loss: 0.0310905 | val_loss: 0.031171 | Time: 7096.15 ms [2022-01-01 17:35:12 main:574] : INFO : Epoch 1865 | loss: 0.0310902 | val_loss: 0.0311806 | Time: 7004.71 ms [2022-01-01 17:35:19 main:574] : INFO : Epoch 1866 | loss: 0.03109 | val_loss: 0.0311728 | Time: 6994.61 ms [2022-01-01 17:35:26 main:574] : INFO : Epoch 1867 | loss: 0.0310901 | val_loss: 0.0311759 | Time: 7064.79 ms [2022-01-01 17:35:33 main:574] : INFO : Epoch 1868 | loss: 0.0310921 | val_loss: 0.0311661 | Time: 7028.64 ms [2022-01-01 17:35:40 main:574] : INFO : Epoch 1869 | loss: 0.0310933 | val_loss: 0.031178 | Time: 7122.51 ms [2022-01-01 17:35:47 main:574] : INFO : Epoch 1870 | loss: 0.0310942 | val_loss: 0.0311735 | Time: 7119.64 ms [2022-01-01 17:35:55 main:574] : INFO : Epoch 1871 | loss: 0.0310992 | val_loss: 0.0311753 | Time: 7005.15 ms [2022-01-01 17:36:02 main:574] : INFO : Epoch 1872 | loss: 0.0310991 | val_loss: 0.0311677 | Time: 7404.24 ms [2022-01-01 17:36:09 main:574] : INFO : Epoch 1873 | loss: 0.0310996 | val_loss: 0.0311774 | Time: 7419.63 ms [2022-01-01 17:36:17 main:574] : INFO : Epoch 1874 | loss: 0.0310969 | val_loss: 0.031173 | Time: 7066.63 ms [2022-01-01 17:36:24 main:574] : INFO : Epoch 1875 | loss: 0.0311021 | val_loss: 0.031169 | Time: 7845.36 ms [2022-01-01 17:36:31 main:574] : INFO : Epoch 1876 | loss: 0.0311041 | val_loss: 0.0311749 | Time: 6917.79 ms [2022-01-01 17:36:39 main:574] : INFO : Epoch 1877 | loss: 0.0311046 | val_loss: 0.0311709 | Time: 7067.2 ms [2022-01-01 17:36:46 main:574] : INFO : Epoch 1878 | loss: 0.0310972 | val_loss: 0.031171 | Time: 7128.36 ms [2022-01-01 17:36:53 main:574] : INFO : Epoch 1879 | loss: 0.0310937 | val_loss: 0.0311733 | Time: 6773.32 ms [2022-01-01 17:37:00 main:574] : INFO : Epoch 1880 | loss: 0.0310952 | val_loss: 0.0311773 | Time: 7004.86 ms [2022-01-01 17:37:07 main:574] : INFO : Epoch 1881 | loss: 0.0310953 | val_loss: 0.0311819 | Time: 7009.51 ms [2022-01-01 17:37:14 main:574] : INFO : Epoch 1882 | loss: 0.0310958 | val_loss: 0.0311708 | Time: 7059.34 ms [2022-01-01 17:37:21 main:574] : INFO : Epoch 1883 | loss: 0.0310925 | val_loss: 0.031177 | Time: 7433.99 ms [2022-01-01 17:37:29 main:574] : INFO : Epoch 1884 | loss: 0.0310944 | val_loss: 0.0311697 | Time: 7345.09 ms [2022-01-01 17:37:36 main:574] : INFO : Epoch 1885 | loss: 0.0310984 | val_loss: 0.0311719 | Time: 7014.58 ms [2022-01-01 17:37:43 main:574] : INFO : Epoch 1886 | loss: 0.0311292 | val_loss: 0.0311648 | Time: 7517.52 ms [2022-01-01 17:37:50 main:574] : INFO : Epoch 1887 | loss: 0.0311368 | val_loss: 0.0311564 | Time: 7138.85 ms [2022-01-01 17:37:58 main:574] : INFO : Epoch 1888 | loss: 0.0311307 | val_loss: 0.0311579 | Time: 7212.92 ms [2022-01-01 17:38:05 main:574] : INFO : Epoch 1889 | loss: 0.0312073 | val_loss: 0.0312604 | Time: 7079.34 ms [2022-01-01 17:38:12 main:574] : INFO : Epoch 1890 | loss: 0.03127 | val_loss: 0.0312554 | Time: 6981.95 ms [2022-01-01 17:38:19 main:574] : INFO : Epoch 1891 | loss: 0.0312529 | val_loss: 0.0312478 | Time: 7214.55 ms [2022-01-01 17:38:27 main:574] : INFO : Epoch 1892 | loss: 0.0312479 | val_loss: 0.0312465 | Time: 7418.63 ms [2022-01-01 17:38:34 main:574] : INFO : Epoch 1893 | loss: 0.0312465 | val_loss: 0.0312454 | Time: 7054.96 ms [2022-01-01 17:38:41 main:574] : INFO : Epoch 1894 | loss: 0.0312457 | val_loss: 0.0312448 | Time: 7313.79 ms [2022-01-01 17:38:48 main:574] : INFO : Epoch 1895 | loss: 0.0312447 | val_loss: 0.0312434 | Time: 7057.96 ms [2022-01-01 17:38:55 main:574] : INFO : Epoch 1896 | loss: 0.0312448 | val_loss: 0.0312429 | Time: 7026.15 ms [2022-01-01 17:39:02 main:574] : INFO : Epoch 1897 | loss: 0.0312434 | val_loss: 0.0312415 | Time: 7052.23 ms [2022-01-01 17:39:10 main:574] : INFO : Epoch 1898 | loss: 0.0312435 | val_loss: 0.0312416 | Time: 7111.45 ms [2022-01-01 17:39:17 main:574] : INFO : Epoch 1899 | loss: 0.0312412 | val_loss: 0.0312401 | Time: 7031.38 ms [2022-01-01 17:39:24 main:574] : INFO : Epoch 1900 | loss: 0.0312416 | val_loss: 0.0312399 | Time: 7696.38 ms [2022-01-01 17:39:32 main:574] : INFO : Epoch 1901 | loss: 0.0312397 | val_loss: 0.0312393 | Time: 7360.71 ms [2022-01-01 17:39:39 main:574] : INFO : Epoch 1902 | loss: 0.0312395 | val_loss: 0.0312386 | Time: 7196.17 ms [2022-01-01 17:39:46 main:574] : INFO : Epoch 1903 | loss: 0.031237 | val_loss: 0.0312378 | Time: 6968.28 ms [2022-01-01 17:39:53 main:574] : INFO : Epoch 1904 | loss: 0.0312384 | val_loss: 0.0312358 | Time: 7197.17 ms [2022-01-01 17:40:01 main:574] : INFO : Epoch 1905 | loss: 0.0312359 | val_loss: 0.0312369 | Time: 7186.33 ms [2022-01-01 17:40:08 main:574] : INFO : Epoch 1906 | loss: 0.0312363 | val_loss: 0.0312326 | Time: 7108.69 ms [2022-01-01 17:40:15 main:574] : INFO : Epoch 1907 | loss: 0.0312336 | val_loss: 0.0312332 | Time: 7266.85 ms [2022-01-01 17:40:23 main:574] : INFO : Epoch 1908 | loss: 0.031234 | val_loss: 0.0312317 | Time: 7647.83 ms [2022-01-01 17:40:30 main:574] : INFO : Epoch 1909 | loss: 0.0312333 | val_loss: 0.0312304 | Time: 7126.98 ms [2022-01-01 17:40:37 main:574] : INFO : Epoch 1910 | loss: 0.0312322 | val_loss: 0.0312325 | Time: 7185.13 ms [2022-01-01 17:40:44 main:574] : INFO : Epoch 1911 | loss: 0.0312351 | val_loss: 0.0312317 | Time: 7101.88 ms [2022-01-01 17:40:51 main:574] : INFO : Epoch 1912 | loss: 0.0312349 | val_loss: 0.0312379 | Time: 7173.94 ms [2022-01-01 17:40:59 main:574] : INFO : Epoch 1913 | loss: 0.0312329 | val_loss: 0.0312348 | Time: 7274.81 ms [2022-01-01 17:41:06 main:574] : INFO : Epoch 1914 | loss: 0.0312309 | val_loss: 0.0312289 | Time: 7165.03 ms [2022-01-01 17:41:13 main:574] : INFO : Epoch 1915 | loss: 0.0312271 | val_loss: 0.0312252 | Time: 6899.34 ms [2022-01-01 17:41:20 main:574] : INFO : Epoch 1916 | loss: 0.0312267 | val_loss: 0.0312268 | Time: 7321.91 ms [2022-01-01 17:41:28 main:574] : INFO : Epoch 1917 | loss: 0.031226 | val_loss: 0.031226 | Time: 7405.69 ms [2022-01-01 17:41:35 main:574] : INFO : Epoch 1918 | loss: 0.0312254 | val_loss: 0.0312234 | Time: 6953 ms [2022-01-01 17:41:42 main:574] : INFO : Epoch 1919 | loss: 0.0312237 | val_loss: 0.0312221 | Time: 7172.69 ms [2022-01-01 17:41:49 main:574] : INFO : Epoch 1920 | loss: 0.0312247 | val_loss: 0.0312237 | Time: 7184.67 ms [2022-01-01 17:41:57 main:574] : INFO : Epoch 1921 | loss: 0.0312232 | val_loss: 0.0312213 | Time: 7275.5 ms [2022-01-01 17:42:04 main:574] : INFO : Epoch 1922 | loss: 0.0312228 | val_loss: 0.0312216 | Time: 6938.61 ms [2022-01-01 17:42:11 main:574] : INFO : Epoch 1923 | loss: 0.0312231 | val_loss: 0.0312236 | Time: 7112.26 ms [2022-01-01 17:42:18 main:574] : INFO : Epoch 1924 | loss: 0.0312218 | val_loss: 0.0312199 | Time: 7078.87 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1060 6GB) [2022-01-01 18:45:31 main:435] : INFO : Set logging level to 1 [2022-01-01 18:45:31 main:441] : INFO : Running in BOINC Client mode [2022-01-01 18:45:31 main:444] : INFO : Resolving all filenames [2022-01-01 18:45:32 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-01-01 18:45:32 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-01-01 18:45:32 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-01-01 18:45:32 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-01-01 18:45:32 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-01-01 18:45:32 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-01-01 18:45:32 main:474] : INFO : Configuration: [2022-01-01 18:45:32 main:475] : INFO : Model type: GRU [2022-01-01 18:45:32 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-01-01 18:45:32 main:477] : INFO : Max Epochs: 2048 [2022-01-01 18:45:32 main:478] : INFO : Batch Size: 128 [2022-01-01 18:45:32 main:479] : INFO : Learning Rate: 0.01 [2022-01-01 18:45:32 main:480] : INFO : Patience: 10 [2022-01-01 18:45:32 main:481] : INFO : Hidden Width: 12 [2022-01-01 18:45:32 main:482] : INFO : # Recurrent Layers: 4 [2022-01-01 18:45:32 main:483] : INFO : # Backend Layers: 4 [2022-01-01 18:45:32 main:484] : INFO : # Threads: 1 [2022-01-01 18:45:32 main:486] : INFO : Preparing Dataset [2022-01-01 18:45:32 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-01-01 18:45:33 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-01-01 18:45:34 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-01-01 18:45:34 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-01-01 18:45:35 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-01-01 18:45:35 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-01-01 18:45:35 main:494] : INFO : Creating Model [2022-01-01 18:45:35 main:507] : INFO : Preparing config file [2022-01-01 18:45:35 main:511] : INFO : Found checkpoint, attempting to load... [2022-01-01 18:45:35 main:512] : INFO : Loading config [2022-01-01 18:45:35 main:514] : INFO : Loading state [2022-01-01 18:45:36 main:559] : INFO : Loading DataLoader into Memory [2022-01-01 18:45:36 main:562] : INFO : Starting Training Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1060 6GB) [2022-01-02 17:16:19 main:435] : INFO : Set logging level to 1 [2022-01-02 17:16:20 main:441] : INFO : Running in BOINC Client mode [2022-01-02 17:16:20 main:444] : INFO : Resolving all filenames [2022-01-02 17:16:20 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-01-02 17:16:20 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-01-02 17:16:20 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-01-02 17:16:20 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-01-02 17:16:20 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-01-02 17:16:20 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-01-02 17:16:20 main:474] : INFO : Configuration: [2022-01-02 17:16:20 main:475] : INFO : Model type: GRU [2022-01-02 17:16:21 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-01-02 17:16:21 main:477] : INFO : Max Epochs: 2048 [2022-01-02 17:16:21 main:478] : INFO : Batch Size: 128 [2022-01-02 17:16:21 main:479] : INFO : Learning Rate: 0.01 [2022-01-02 17:16:21 main:480] : INFO : Patience: 10 [2022-01-02 17:16:21 main:481] : INFO : Hidden Width: 12 [2022-01-02 17:16:21 main:482] : INFO : # Recurrent Layers: 4 [2022-01-02 17:16:21 main:483] : INFO : # Backend Layers: 4 [2022-01-02 17:16:21 main:484] : INFO : # Threads: 1 [2022-01-02 17:16:21 main:486] : INFO : Preparing Dataset [2022-01-02 17:16:21 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-01-02 17:16:21 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-01-02 17:16:25 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-01-02 17:16:25 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-01-02 17:16:25 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-01-02 17:16:25 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-01-02 17:16:25 main:494] : INFO : Creating Model [2022-01-02 17:16:25 main:507] : INFO : Preparing config file [2022-01-02 17:16:25 main:511] : INFO : Found checkpoint, attempting to load... [2022-01-02 17:16:25 main:512] : INFO : Loading config [2022-01-02 17:16:25 main:514] : INFO : Loading state [2022-01-02 17:16:45 main:559] : INFO : Loading DataLoader into Memory [2022-01-02 17:16:45 main:562] : INFO : Starting Training [2022-01-02 17:16:57 main:574] : INFO : Epoch 1919 | loss: 0.0312506 | val_loss: 0.0312215 | Time: 12288.2 ms [2022-01-02 17:17:05 main:574] : INFO : Epoch 1920 | loss: 0.0312165 | val_loss: 0.0312065 | Time: 7693.47 ms [2022-01-02 17:17:13 main:574] : INFO : Epoch 1921 | loss: 0.0312063 | val_loss: 0.0312026 | Time: 7459.97 ms [2022-01-02 17:17:20 main:574] : INFO : Epoch 1922 | loss: 0.031202 | val_loss: 0.0311992 | Time: 7481.58 ms [2022-01-02 17:17:27 main:574] : INFO : Epoch 1923 | loss: 0.0311996 | val_loss: 0.0311974 | Time: 6539.42 ms [2022-01-02 17:17:34 main:574] : INFO : Epoch 1924 | loss: 0.0311979 | val_loss: 0.031196 | Time: 6620.82 ms [2022-01-02 17:17:40 main:574] : INFO : Epoch 1925 | loss: 0.031196 | val_loss: 0.0311888 | Time: 6722.81 ms [2022-01-02 17:17:47 main:574] : INFO : Epoch 1926 | loss: 0.0311921 | val_loss: 0.0311892 | Time: 6851.99 ms [2022-01-02 17:17:55 main:574] : INFO : Epoch 1927 | loss: 0.0311894 | val_loss: 0.0311865 | Time: 7351.94 ms [2022-01-02 17:18:02 main:574] : INFO : Epoch 1928 | loss: 0.0311885 | val_loss: 0.0311873 | Time: 6901.19 ms [2022-01-02 17:18:08 main:574] : INFO : Epoch 1929 | loss: 0.031189 | val_loss: 0.0311926 | Time: 6808.86 ms [2022-01-02 17:18:15 main:574] : INFO : Epoch 1930 | loss: 0.0311941 | val_loss: 0.0311899 | Time: 6624.75 ms [2022-01-02 17:18:22 main:574] : INFO : Epoch 1931 | loss: 0.0311916 | val_loss: 0.0311866 | Time: 6702.53 ms [2022-01-02 17:18:29 main:574] : INFO : Epoch 1932 | loss: 0.0311881 | val_loss: 0.0311869 | Time: 6607.81 ms [2022-01-02 17:18:35 main:574] : INFO : Epoch 1933 | loss: 0.0311853 | val_loss: 0.0311849 | Time: 6632.23 ms [2022-01-02 17:18:42 main:574] : INFO : Epoch 1934 | loss: 0.0311844 | val_loss: 0.0311861 | Time: 6795.97 ms [2022-01-02 17:18:49 main:574] : INFO : Epoch 1935 | loss: 0.0311827 | val_loss: 0.0311834 | Time: 6973.67 ms [2022-01-02 17:18:56 main:574] : INFO : Epoch 1936 | loss: 0.0311819 | val_loss: 0.031184 | Time: 6718.31 ms [2022-01-02 17:19:03 main:574] : INFO : Epoch 1937 | loss: 0.0311804 | val_loss: 0.0311833 | Time: 6827.29 ms [2022-01-02 17:19:10 main:574] : INFO : Epoch 1938 | loss: 0.0311799 | val_loss: 0.0311826 | Time: 6724.84 ms [2022-01-02 17:19:16 main:574] : INFO : Epoch 1939 | loss: 0.0311796 | val_loss: 0.0311804 | Time: 6768.61 ms [2022-01-02 17:19:23 main:574] : INFO : Epoch 1940 | loss: 0.0311783 | val_loss: 0.0311807 | Time: 6756.73 ms [2022-01-02 17:19:30 main:574] : INFO : Epoch 1941 | loss: 0.0311785 | val_loss: 0.0311829 | Time: 6410.13 ms [2022-01-02 17:19:36 main:574] : INFO : Epoch 1942 | loss: 0.031177 | val_loss: 0.0311797 | Time: 6531.07 ms [2022-01-02 17:19:43 main:574] : INFO : Epoch 1943 | loss: 0.0311754 | val_loss: 0.0311784 | Time: 6540.54 ms [2022-01-02 17:19:50 main:574] : INFO : Epoch 1944 | loss: 0.031175 | val_loss: 0.0311794 | Time: 6878.86 ms [2022-01-02 17:19:57 main:574] : INFO : Epoch 1945 | loss: 0.0311737 | val_loss: 0.0311768 | Time: 6679.82 ms [2022-01-02 17:20:03 main:574] : INFO : Epoch 1946 | loss: 0.031173 | val_loss: 0.0311773 | Time: 6651.28 ms [2022-01-02 17:20:10 main:574] : INFO : Epoch 1947 | loss: 0.0311732 | val_loss: 0.0311778 | Time: 6738.09 ms [2022-01-02 17:20:17 main:574] : INFO : Epoch 1948 | loss: 0.0311739 | val_loss: 0.031177 | Time: 6709.74 ms [2022-01-02 17:20:24 main:574] : INFO : Epoch 1949 | loss: 0.0311716 | val_loss: 0.0311772 | Time: 6738.34 ms [2022-01-02 17:20:30 main:574] : INFO : Epoch 1950 | loss: 0.0311716 | val_loss: 0.0311772 | Time: 6434.86 ms [2022-01-02 17:20:37 main:574] : INFO : Epoch 1951 | loss: 0.0311718 | val_loss: 0.0311795 | Time: 6947.55 ms [2022-01-02 17:20:44 main:574] : INFO : Epoch 1952 | loss: 0.0311709 | val_loss: 0.031176 | Time: 6479.18 ms [2022-01-02 17:20:50 main:574] : INFO : Epoch 1953 | loss: 0.0311692 | val_loss: 0.0311754 | Time: 6711.55 ms [2022-01-02 17:20:57 main:574] : INFO : Epoch 1954 | loss: 0.0311678 | val_loss: 0.0311755 | Time: 6709.26 ms [2022-01-02 17:21:04 main:574] : INFO : Epoch 1955 | loss: 0.0311681 | val_loss: 0.031178 | Time: 6815.58 ms [2022-01-02 17:21:11 main:574] : INFO : Epoch 1956 | loss: 0.0311686 | val_loss: 0.0311751 | Time: 6790.65 ms [2022-01-02 17:21:18 main:574] : INFO : Epoch 1957 | loss: 0.0311685 | val_loss: 0.0311749 | Time: 6866.93 ms [2022-01-02 17:21:25 main:574] : INFO : Epoch 1958 | loss: 0.0311698 | val_loss: 0.0311819 | Time: 6750.46 ms [2022-01-02 17:21:31 main:574] : INFO : Epoch 1959 | loss: 0.0311685 | val_loss: 0.0311777 | Time: 6757.04 ms [2022-01-02 17:21:38 main:574] : INFO : Epoch 1960 | loss: 0.0311676 | val_loss: 0.0311755 | Time: 6667.23 ms [2022-01-02 17:21:45 main:574] : INFO : Epoch 1961 | loss: 0.0311674 | val_loss: 0.0311769 | Time: 6817.93 ms [2022-01-02 17:21:52 main:574] : INFO : Epoch 1962 | loss: 0.03117 | val_loss: 0.0311746 | Time: 6671.27 ms [2022-01-02 17:21:58 main:574] : INFO : Epoch 1963 | loss: 0.0311681 | val_loss: 0.0311727 | Time: 6573.17 ms [2022-01-02 17:22:05 main:574] : INFO : Epoch 1964 | loss: 0.0311676 | val_loss: 0.0311745 | Time: 6652.26 ms [2022-01-02 17:22:12 main:574] : INFO : Epoch 1965 | loss: 0.0311662 | val_loss: 0.0311718 | Time: 6789 ms [2022-01-02 17:22:18 main:574] : INFO : Epoch 1966 | loss: 0.0311646 | val_loss: 0.0311769 | Time: 6364.32 ms [2022-01-02 17:22:25 main:574] : INFO : Epoch 1967 | loss: 0.0311655 | val_loss: 0.0311755 | Time: 6502.15 ms [2022-01-02 17:22:32 main:574] : INFO : Epoch 1968 | loss: 0.0311656 | val_loss: 0.031172 | Time: 6771.79 ms [2022-01-02 17:22:38 main:574] : INFO : Epoch 1969 | loss: 0.031165 | val_loss: 0.0311716 | Time: 6620.21 ms [2022-01-02 17:22:45 main:574] : INFO : Epoch 1970 | loss: 0.0311661 | val_loss: 0.0311702 | Time: 6343.17 ms [2022-01-02 17:22:51 main:574] : INFO : Epoch 1971 | loss: 0.0311667 | val_loss: 0.0311824 | Time: 6500 ms [2022-01-02 17:22:58 main:574] : INFO : Epoch 1972 | loss: 0.0311662 | val_loss: 0.0311725 | Time: 6789.81 ms [2022-01-02 17:23:05 main:574] : INFO : Epoch 1973 | loss: 0.0311634 | val_loss: 0.031173 | Time: 6829.14 ms [2022-01-02 17:23:12 main:574] : INFO : Epoch 1974 | loss: 0.0311623 | val_loss: 0.031171 | Time: 6676.85 ms [2022-01-02 17:23:18 main:574] : INFO : Epoch 1975 | loss: 0.031161 | val_loss: 0.0311714 | Time: 6551.82 ms [2022-01-02 17:23:25 main:574] : INFO : Epoch 1976 | loss: 0.0311626 | val_loss: 0.0311715 | Time: 6773.54 ms [2022-01-02 17:23:32 main:574] : INFO : Epoch 1977 | loss: 0.0311624 | val_loss: 0.0311711 | Time: 6492.65 ms [2022-01-02 17:23:38 main:574] : INFO : Epoch 1978 | loss: 0.0311622 | val_loss: 0.0311733 | Time: 6495.08 ms [2022-01-02 17:23:45 main:574] : INFO : Epoch 1979 | loss: 0.0311631 | val_loss: 0.0311698 | Time: 6593.9 ms [2022-01-02 17:23:51 main:574] : INFO : Epoch 1980 | loss: 0.0311626 | val_loss: 0.0311699 | Time: 6381.98 ms [2022-01-02 17:23:58 main:574] : INFO : Epoch 1981 | loss: 0.0311614 | val_loss: 0.0311683 | Time: 6590.36 ms [2022-01-02 17:24:05 main:574] : INFO : Epoch 1982 | loss: 0.0311609 | val_loss: 0.0311695 | Time: 6662.96 ms [2022-01-02 17:24:11 main:574] : INFO : Epoch 1983 | loss: 0.031161 | val_loss: 0.031171 | Time: 6616.56 ms [2022-01-02 17:24:18 main:574] : INFO : Epoch 1984 | loss: 0.0311605 | val_loss: 0.0311679 | Time: 6602.06 ms [2022-01-02 17:24:25 main:574] : INFO : Epoch 1985 | loss: 0.0311585 | val_loss: 0.0311707 | Time: 6885.8 ms [2022-01-02 17:24:32 main:574] : INFO : Epoch 1986 | loss: 0.0311607 | val_loss: 0.0311706 | Time: 6822.62 ms [2022-01-02 17:24:38 main:574] : INFO : Epoch 1987 | loss: 0.0311672 | val_loss: 0.0311733 | Time: 6439.27 ms [2022-01-02 17:24:45 main:574] : INFO : Epoch 1988 | loss: 0.0311705 | val_loss: 0.0311741 | Time: 6781.4 ms [2022-01-02 17:24:52 main:574] : INFO : Epoch 1989 | loss: 0.0311701 | val_loss: 0.0311766 | Time: 6638.12 ms [2022-01-02 17:24:58 main:574] : INFO : Epoch 1990 | loss: 0.0311704 | val_loss: 0.0311733 | Time: 6591.72 ms [2022-01-02 17:25:05 main:574] : INFO : Epoch 1991 | loss: 0.0311698 | val_loss: 0.0311768 | Time: 6883.46 ms [2022-01-02 17:25:12 main:574] : INFO : Epoch 1992 | loss: 0.0311811 | val_loss: 0.0311775 | Time: 6663.65 ms [2022-01-02 17:25:19 main:574] : INFO : Epoch 1993 | loss: 0.0311775 | val_loss: 0.0311756 | Time: 6334.07 ms [2022-01-02 17:25:25 main:574] : INFO : Epoch 1994 | loss: 0.031175 | val_loss: 0.0311731 | Time: 6527.11 ms [2022-01-02 17:25:32 main:574] : INFO : Epoch 1995 | loss: 0.031172 | val_loss: 0.0311712 | Time: 6411.87 ms [2022-01-02 17:25:38 main:574] : INFO : Epoch 1996 | loss: 0.0311704 | val_loss: 0.0311707 | Time: 6581.23 ms [2022-01-02 17:25:45 main:574] : INFO : Epoch 1997 | loss: 0.0311683 | val_loss: 0.0311717 | Time: 6613.86 ms [2022-01-02 17:25:52 main:574] : INFO : Epoch 1998 | loss: 0.031168 | val_loss: 0.03117 | Time: 6760.5 ms [2022-01-02 17:25:59 main:574] : INFO : Epoch 1999 | loss: 0.0311659 | val_loss: 0.0311722 | Time: 7193.47 ms [2022-01-02 17:26:06 main:574] : INFO : Epoch 2000 | loss: 0.0311659 | val_loss: 0.0311708 | Time: 6820.36 ms [2022-01-02 17:26:12 main:574] : INFO : Epoch 2001 | loss: 0.0311659 | val_loss: 0.0311694 | Time: 6513.91 ms [2022-01-02 17:26:19 main:574] : INFO : Epoch 2002 | loss: 0.0311651 | val_loss: 0.0311697 | Time: 7069.95 ms [2022-01-02 17:26:26 main:574] : INFO : Epoch 2003 | loss: 0.031163 | val_loss: 0.0311698 | Time: 6661.1 ms [2022-01-02 17:26:33 main:574] : INFO : Epoch 2004 | loss: 0.0311622 | val_loss: 0.0311701 | Time: 6596.38 ms [2022-01-02 17:26:39 main:574] : INFO : Epoch 2005 | loss: 0.0311616 | val_loss: 0.0311707 | Time: 6542.77 ms [2022-01-02 17:26:46 main:574] : INFO : Epoch 2006 | loss: 0.0311613 | val_loss: 0.0311689 | Time: 6721.82 ms [2022-01-02 17:26:53 main:574] : INFO : Epoch 2007 | loss: 0.0311615 | val_loss: 0.0311691 | Time: 6524.69 ms [2022-01-02 17:27:00 main:574] : INFO : Epoch 2008 | loss: 0.0311634 | val_loss: 0.0311696 | Time: 7125.61 ms [2022-01-02 17:27:07 main:574] : INFO : Epoch 2009 | loss: 0.0311655 | val_loss: 0.0311695 | Time: 6665.64 ms [2022-01-02 17:27:13 main:574] : INFO : Epoch 2010 | loss: 0.0311633 | val_loss: 0.0311692 | Time: 6638.23 ms [2022-01-02 17:27:20 main:574] : INFO : Epoch 2011 | loss: 0.0311614 | val_loss: 0.0311682 | Time: 6434.52 ms [2022-01-02 17:27:26 main:574] : INFO : Epoch 2012 | loss: 0.0311611 | val_loss: 0.0311669 | Time: 6486.82 ms [2022-01-02 17:27:33 main:574] : INFO : Epoch 2013 | loss: 0.0311587 | val_loss: 0.0311677 | Time: 6592.93 ms [2022-01-02 17:27:40 main:574] : INFO : Epoch 2014 | loss: 0.031158 | val_loss: 0.031169 | Time: 6553.83 ms [2022-01-02 17:27:46 main:574] : INFO : Epoch 2015 | loss: 0.0311576 | val_loss: 0.0311697 | Time: 6595.24 ms [2022-01-02 17:27:53 main:574] : INFO : Epoch 2016 | loss: 0.0311587 | val_loss: 0.0311738 | Time: 6561.62 ms [2022-01-02 17:28:00 main:574] : INFO : Epoch 2017 | loss: 0.0311594 | val_loss: 0.0311696 | Time: 7276.04 ms [2022-01-02 17:28:08 main:574] : INFO : Epoch 2018 | loss: 0.0311586 | val_loss: 0.0311688 | Time: 6826.3 ms [2022-01-02 17:28:15 main:574] : INFO : Epoch 2019 | loss: 0.0311575 | val_loss: 0.0311669 | Time: 6627.04 ms [2022-01-02 17:28:22 main:574] : INFO : Epoch 2020 | loss: 0.0311572 | val_loss: 0.0311677 | Time: 6636.75 ms [2022-01-02 17:28:28 main:574] : INFO : Epoch 2021 | loss: 0.0311569 | val_loss: 0.0311664 | Time: 6418.19 ms [2022-01-02 17:28:35 main:574] : INFO : Epoch 2022 | loss: 0.0311561 | val_loss: 0.031167 | Time: 6561.06 ms [2022-01-02 17:28:42 main:574] : INFO : Epoch 2023 | loss: 0.0311579 | val_loss: 0.0311727 | Time: 6651.38 ms [2022-01-02 17:28:48 main:574] : INFO : Epoch 2024 | loss: 0.0311593 | val_loss: 0.03117 | Time: 6492.46 ms [2022-01-02 17:28:55 main:574] : INFO : Epoch 2025 | loss: 0.0311553 | val_loss: 0.0311676 | Time: 6465.03 ms [2022-01-02 17:29:02 main:574] : INFO : Epoch 2026 | loss: 0.0311537 | val_loss: 0.0311695 | Time: 7084.4 ms [2022-01-02 17:29:08 main:574] : INFO : Epoch 2027 | loss: 0.0311541 | val_loss: 0.03117 | Time: 6518.45 ms [2022-01-02 17:29:15 main:574] : INFO : Epoch 2028 | loss: 0.031153 | val_loss: 0.0311692 | Time: 6601.41 ms [2022-01-02 17:29:22 main:574] : INFO : Epoch 2029 | loss: 0.0311542 | val_loss: 0.0311694 | Time: 6544.07 ms [2022-01-02 17:29:28 main:574] : INFO : Epoch 2030 | loss: 0.0311542 | val_loss: 0.031169 | Time: 6672.8 ms [2022-01-02 17:29:35 main:574] : INFO : Epoch 2031 | loss: 0.0311534 | val_loss: 0.0311695 | Time: 6570.1 ms [2022-01-02 17:29:42 main:574] : INFO : Epoch 2032 | loss: 0.0311534 | val_loss: 0.0311711 | Time: 6571.37 ms [2022-01-02 17:29:48 main:574] : INFO : Epoch 2033 | loss: 0.0311534 | val_loss: 0.0311673 | Time: 6601.85 ms [2022-01-02 17:29:55 main:574] : INFO : Epoch 2034 | loss: 0.0311538 | val_loss: 0.0311704 | Time: 6593.24 ms [2022-01-02 17:30:02 main:574] : INFO : Epoch 2035 | loss: 0.0311545 | val_loss: 0.0311673 | Time: 7031.68 ms [2022-01-02 17:30:09 main:574] : INFO : Epoch 2036 | loss: 0.0311549 | val_loss: 0.0311675 | Time: 6576.4 ms [2022-01-02 17:30:15 main:574] : INFO : Epoch 2037 | loss: 0.0311532 | val_loss: 0.031168 | Time: 6650.7 ms [2022-01-02 17:30:22 main:574] : INFO : Epoch 2038 | loss: 0.0311546 | val_loss: 0.0311666 | Time: 6688.16 ms [2022-01-02 17:30:29 main:574] : INFO : Epoch 2039 | loss: 0.0311521 | val_loss: 0.0311669 | Time: 6593.63 ms [2022-01-02 17:30:35 main:574] : INFO : Epoch 2040 | loss: 0.0311521 | val_loss: 0.0311661 | Time: 6528.6 ms [2022-01-02 17:30:42 main:574] : INFO : Epoch 2041 | loss: 0.0311522 | val_loss: 0.0311693 | Time: 6637.06 ms [2022-01-02 17:30:49 main:574] : INFO : Epoch 2042 | loss: 0.031152 | val_loss: 0.0311675 | Time: 6741.2 ms [2022-01-02 17:30:56 main:574] : INFO : Epoch 2043 | loss: 0.0311519 | val_loss: 0.0311671 | Time: 6745.32 ms [2022-01-02 17:31:03 main:574] : INFO : Epoch 2044 | loss: 0.0311498 | val_loss: 0.0311677 | Time: 7016.36 ms [2022-01-02 17:31:10 main:574] : INFO : Epoch 2045 | loss: 0.0311498 | val_loss: 0.0311688 | Time: 6936.69 ms [2022-01-02 17:31:17 main:574] : INFO : Epoch 2046 | loss: 0.0311515 | val_loss: 0.0311684 | Time: 7396.86 ms [2022-01-02 17:31:25 main:574] : INFO : Epoch 2047 | loss: 0.0311516 | val_loss: 0.031167 | Time: 7504.68 ms [2022-01-02 17:31:33 main:574] : INFO : Epoch 2048 | loss: 0.0311521 | val_loss: 0.0311663 | Time: 7767.77 ms [2022-01-02 17:31:33 main:597] : INFO : Saving trained model to model-final.pt, val_loss 0.0311663 [2022-01-02 17:31:33 main:603] : INFO : Saving end state to config to file [2022-01-02 17:31:33 main:608] : INFO : Success, exiting.. 17:31:33 (15596): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)