Task 14551890
| Name | ParityModified-1647046930-26406-3-0_0 |
| Workunit | 11576063 |
| Created | 8 Apr 2022, 23:08:22 UTC |
| Sent | 11 Apr 2022, 0:18:14 UTC |
| Report deadline | 19 Apr 2022, 0:18:14 UTC |
| Received | 18 Apr 2022, 10:14:53 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 21717 |
| Run time | 3 hours 20 min 35 sec |
| CPU time | 3 hours 9 min 35 sec |
| Validate state | Valid |
| Credit | 4,160.00 |
| Device peak FLOPS | 4,277.48 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.82 GB |
| Peak swap size | 3.60 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version> <![CDATA[ <stderr_txt> main:574] : INFO : Epoch 1650 | loss: 0.0311043 | val_loss: 0.0311369 | Time: 5958.04 ms [2022-04-18 09:19:12 main:574] : INFO : Epoch 1651 | loss: 0.0310982 | val_loss: 0.0311349 | Time: 5544.93 ms [2022-04-18 09:19:18 main:574] : INFO : Epoch 1652 | loss: 0.031097 | val_loss: 0.031136 | Time: 5603.76 ms [2022-04-18 09:19:24 main:574] : INFO : Epoch 1653 | loss: 0.0310954 | val_loss: 0.0311362 | Time: 5978.31 ms [2022-04-18 09:19:30 main:574] : INFO : Epoch 1654 | loss: 0.0310962 | val_loss: 0.0311369 | Time: 5534.72 ms [2022-04-18 09:19:35 main:574] : INFO : Epoch 1655 | loss: 0.0310915 | val_loss: 0.0311361 | Time: 5909.24 ms [2022-04-18 09:19:41 main:574] : INFO : Epoch 1656 | loss: 0.031093 | val_loss: 0.0311422 | Time: 5428.57 ms [2022-04-18 09:19:47 main:574] : INFO : Epoch 1657 | loss: 0.0310948 | val_loss: 0.0311375 | Time: 5996.35 ms [2022-04-18 09:19:52 main:574] : INFO : Epoch 1658 | loss: 0.0310977 | val_loss: 0.0311351 | Time: 5574.04 ms [2022-04-18 09:19:58 main:574] : INFO : Epoch 1659 | loss: 0.0310964 | val_loss: 0.0311301 | Time: 5447.6 ms [2022-04-18 09:20:04 main:574] : INFO : Epoch 1660 | loss: 0.0310931 | val_loss: 0.0311343 | Time: 6409.24 ms [2022-04-18 09:20:10 main:574] : INFO : Epoch 1661 | loss: 0.0310945 | val_loss: 0.0311404 | Time: 5554.35 ms [2022-04-18 09:20:16 main:574] : INFO : Epoch 1662 | loss: 0.031098 | val_loss: 0.0311279 | Time: 5854.53 ms [2022-04-18 09:20:21 main:574] : INFO : Epoch 1663 | loss: 0.0310947 | val_loss: 0.0311257 | Time: 5375.3 ms [2022-04-18 09:20:27 main:574] : INFO : Epoch 1664 | loss: 0.0310962 | val_loss: 0.0311234 | Time: 5718.86 ms [2022-04-18 09:20:33 main:574] : INFO : Epoch 1665 | loss: 0.0310941 | val_loss: 0.0311257 | Time: 5655.87 ms [2022-04-18 09:20:38 main:574] : INFO : Epoch 1666 | loss: 0.031092 | val_loss: 0.0311228 | Time: 5414.07 ms [2022-04-18 09:20:44 main:574] : INFO : Epoch 1667 | loss: 0.0310877 | val_loss: 0.0311243 | Time: 6054.91 ms [2022-04-18 09:20:50 main:574] : INFO : Epoch 1668 | loss: 0.0310839 | val_loss: 0.0311328 | Time: 5547.2 ms [2022-04-18 09:20:56 main:574] : INFO : Epoch 1669 | loss: 0.0310838 | val_loss: 0.0311294 | Time: 5898.51 ms [2022-04-18 09:21:01 main:574] : INFO : Epoch 1670 | loss: 0.0310814 | val_loss: 0.0311294 | Time: 5686.8 ms [2022-04-18 09:21:07 main:574] : INFO : Epoch 1671 | loss: 0.0310797 | val_loss: 0.0311298 | Time: 5755.17 ms [2022-04-18 09:21:13 main:574] : INFO : Epoch 1672 | loss: 0.0310821 | val_loss: 0.0311329 | Time: 5686.75 ms [2022-04-18 09:21:18 main:574] : INFO : Epoch 1673 | loss: 0.0310783 | val_loss: 0.0311286 | Time: 5511.13 ms [2022-04-18 09:21:24 main:574] : INFO : Epoch 1674 | loss: 0.0310779 | val_loss: 0.0311321 | Time: 6284.95 ms [2022-04-18 09:21:32 main:574] : INFO : Epoch 1675 | loss: 0.0310791 | val_loss: 0.031138 | Time: 7663.27 ms [2022-04-18 09:21:38 main:574] : INFO : Epoch 1676 | loss: 0.0310921 | val_loss: 0.0311306 | Time: 6001.56 ms [2022-04-18 09:21:44 main:574] : INFO : Epoch 1677 | loss: 0.031095 | val_loss: 0.0311308 | Time: 6235.58 ms [2022-04-18 09:21:50 main:574] : INFO : Epoch 1678 | loss: 0.031085 | val_loss: 0.0311279 | Time: 5546.42 ms [2022-04-18 09:21:56 main:574] : INFO : Epoch 1679 | loss: 0.0310799 | val_loss: 0.0311319 | Time: 6144.45 ms [2022-04-18 09:22:02 main:574] : INFO : Epoch 1680 | loss: 0.0310771 | val_loss: 0.0311316 | Time: 5368.07 ms [2022-04-18 09:22:07 main:574] : INFO : Epoch 1681 | loss: 0.0310773 | val_loss: 0.0311241 | Time: 5981.97 ms [2022-04-18 09:22:13 main:574] : INFO : Epoch 1682 | loss: 0.0310783 | val_loss: 0.0311353 | Time: 5609.84 ms [2022-04-18 09:22:19 main:574] : INFO : Epoch 1683 | loss: 0.0310741 | val_loss: 0.0311336 | Time: 5491.85 ms [2022-04-18 09:22:25 main:574] : INFO : Epoch 1684 | loss: 0.0310733 | val_loss: 0.0311282 | Time: 5967.56 ms [2022-04-18 09:22:31 main:574] : INFO : Epoch 1685 | loss: 0.0310711 | val_loss: 0.0311342 | Time: 6180.25 ms [2022-04-18 09:22:37 main:574] : INFO : Epoch 1686 | loss: 0.0310697 | val_loss: 0.0311329 | Time: 5907.86 ms [2022-04-18 09:22:42 main:574] : INFO : Epoch 1687 | loss: 0.0310686 | val_loss: 0.0311306 | Time: 5539.29 ms [2022-04-18 09:22:48 main:574] : INFO : Epoch 1688 | loss: 0.0310723 | val_loss: 0.0311328 | Time: 5988.93 ms [2022-04-18 09:22:54 main:574] : INFO : Epoch 1689 | loss: 0.0310784 | val_loss: 0.0311327 | Time: 5487.28 ms [2022-04-18 09:23:00 main:574] : INFO : Epoch 1690 | loss: 0.0310768 | val_loss: 0.0311356 | Time: 5839.65 ms [2022-04-18 09:23:05 main:574] : INFO : Epoch 1691 | loss: 0.0310787 | val_loss: 0.0311337 | Time: 5677.36 ms [2022-04-18 09:23:11 main:574] : INFO : Epoch 1692 | loss: 0.0310851 | val_loss: 0.0311377 | Time: 5435.98 ms [2022-04-18 09:23:17 main:574] : INFO : Epoch 1693 | loss: 0.0310871 | val_loss: 0.0311374 | Time: 5963.75 ms [2022-04-18 09:23:23 main:574] : INFO : Epoch 1694 | loss: 0.0310904 | val_loss: 0.0311294 | Time: 5596.76 ms [2022-04-18 09:23:29 main:574] : INFO : Epoch 1695 | loss: 0.0310847 | val_loss: 0.0311357 | Time: 6495.84 ms [2022-04-18 09:23:34 main:574] : INFO : Epoch 1696 | loss: 0.0310787 | val_loss: 0.0311321 | Time: 5370.45 ms [2022-04-18 09:23:40 main:574] : INFO : Epoch 1697 | loss: 0.0310766 | val_loss: 0.0311314 | Time: 6027.02 ms [2022-04-18 09:23:46 main:574] : INFO : Epoch 1698 | loss: 0.0310749 | val_loss: 0.0311338 | Time: 5478.62 ms [2022-04-18 09:23:52 main:574] : INFO : Epoch 1699 | loss: 0.0310748 | val_loss: 0.031144 | Time: 5776.91 ms [2022-04-18 09:23:58 main:574] : INFO : Epoch 1700 | loss: 0.0310729 | val_loss: 0.0311352 | Time: 5814.54 ms [2022-04-18 09:24:03 main:574] : INFO : Epoch 1701 | loss: 0.0310716 | val_loss: 0.0311397 | Time: 5568.77 ms [2022-04-18 09:24:09 main:574] : INFO : Epoch 1702 | loss: 0.0310737 | val_loss: 0.0311285 | Time: 6041.59 ms [2022-04-18 09:24:15 main:574] : INFO : Epoch 1703 | loss: 0.0310791 | val_loss: 0.0311331 | Time: 5478.45 ms [2022-04-18 09:24:21 main:574] : INFO : Epoch 1704 | loss: 0.0310928 | val_loss: 0.0311398 | Time: 6038.79 ms [2022-04-18 09:24:26 main:574] : INFO : Epoch 1705 | loss: 0.0310825 | val_loss: 0.031141 | Time: 5402.31 ms [2022-04-18 09:24:33 main:574] : INFO : Epoch 1706 | loss: 0.0310778 | val_loss: 0.0311412 | Time: 6308.25 ms [2022-04-18 09:24:38 main:574] : INFO : Epoch 1707 | loss: 0.0310782 | val_loss: 0.0311316 | Time: 5614.37 ms [2022-04-18 09:24:44 main:574] : INFO : Epoch 1708 | loss: 0.0310839 | val_loss: 0.0311328 | Time: 5583.69 ms [2022-04-18 09:24:49 main:574] : INFO : Epoch 1709 | loss: 0.0310806 | val_loss: 0.0311296 | Time: 5695.94 ms [2022-04-18 09:24:55 main:574] : INFO : Epoch 1710 | loss: 0.0310793 | val_loss: 0.0311308 | Time: 5396.69 ms [2022-04-18 09:25:01 main:574] : INFO : Epoch 1711 | loss: 0.0310767 | val_loss: 0.0311367 | Time: 6002.22 ms [2022-04-18 09:25:06 main:574] : INFO : Epoch 1712 | loss: 0.0310782 | val_loss: 0.0311265 | Time: 5500.52 ms [2022-04-18 09:25:12 main:574] : INFO : Epoch 1713 | loss: 0.031075 | val_loss: 0.0311387 | Time: 5685.09 ms [2022-04-18 09:25:18 main:574] : INFO : Epoch 1714 | loss: 0.0310783 | val_loss: 0.0311312 | Time: 5699.21 ms [2022-04-18 09:25:23 main:574] : INFO : Epoch 1715 | loss: 0.0310793 | val_loss: 0.0311343 | Time: 5575.14 ms [2022-04-18 09:25:30 main:574] : INFO : Epoch 1716 | loss: 0.0310743 | val_loss: 0.0311403 | Time: 6154.11 ms [2022-04-18 09:25:35 main:574] : INFO : Epoch 1717 | loss: 0.0310712 | val_loss: 0.031136 | Time: 5549.52 ms [2022-04-18 09:25:41 main:574] : INFO : Epoch 1718 | loss: 0.0310729 | val_loss: 0.0311278 | Time: 6019.37 ms [2022-04-18 09:25:47 main:574] : INFO : Epoch 1719 | loss: 0.0310724 | val_loss: 0.0311437 | Time: 5349.62 ms [2022-04-18 09:25:53 main:574] : INFO : Epoch 1720 | loss: 0.03107 | val_loss: 0.0311297 | Time: 6040.21 ms [2022-04-18 09:25:58 main:574] : INFO : Epoch 1721 | loss: 0.0310684 | val_loss: 0.0311376 | Time: 5438.29 ms [2022-04-18 09:26:04 main:574] : INFO : Epoch 1722 | loss: 0.0310672 | val_loss: 0.0311355 | Time: 5484.11 ms [2022-04-18 09:26:10 main:574] : INFO : Epoch 1723 | loss: 0.0310648 | val_loss: 0.0311413 | Time: 5953.94 ms [2022-04-18 09:26:15 main:574] : INFO : Epoch 1724 | loss: 0.0310647 | val_loss: 0.0311376 | Time: 5259.96 ms [2022-04-18 09:26:21 main:574] : INFO : Epoch 1725 | loss: 0.0310614 | val_loss: 0.0311376 | Time: 5995.34 ms [2022-04-18 09:26:26 main:574] : INFO : Epoch 1726 | loss: 0.0310636 | val_loss: 0.0311386 | Time: 5368.34 ms [2022-04-18 09:26:32 main:574] : INFO : Epoch 1727 | loss: 0.0310625 | val_loss: 0.0311354 | Time: 5417.43 ms [2022-04-18 09:26:38 main:574] : INFO : Epoch 1728 | loss: 0.0310616 | val_loss: 0.0311339 | Time: 5832.02 ms [2022-04-18 09:26:43 main:574] : INFO : Epoch 1729 | loss: 0.0310645 | val_loss: 0.0311303 | Time: 5496.47 ms [2022-04-18 09:26:49 main:574] : INFO : Epoch 1730 | loss: 0.0310654 | val_loss: 0.03114 | Time: 6055.71 ms [2022-04-18 09:26:55 main:574] : INFO : Epoch 1731 | loss: 0.0310631 | val_loss: 0.031144 | Time: 5557.38 ms [2022-04-18 09:27:00 main:574] : INFO : Epoch 1732 | loss: 0.0310629 | val_loss: 0.0311405 | Time: 5671.5 ms [2022-04-18 09:27:06 main:574] : INFO : Epoch 1733 | loss: 0.0310643 | val_loss: 0.0311432 | Time: 5660.74 ms [2022-04-18 09:27:12 main:574] : INFO : Epoch 1734 | loss: 0.0310612 | val_loss: 0.0311391 | Time: 6003.92 ms [2022-04-18 09:27:18 main:574] : INFO : Epoch 1735 | loss: 0.0310597 | val_loss: 0.0311351 | Time: 5815.44 ms [2022-04-18 09:27:24 main:574] : INFO : Epoch 1736 | loss: 0.0310581 | val_loss: 0.0311342 | Time: 5605.59 ms [2022-04-18 09:27:30 main:574] : INFO : Epoch 1737 | loss: 0.0310774 | val_loss: 0.0311297 | Time: 5853.22 ms [2022-04-18 09:27:35 main:574] : INFO : Epoch 1738 | loss: 0.031076 | val_loss: 0.0311369 | Time: 5442.47 ms [2022-04-18 09:27:41 main:574] : INFO : Epoch 1739 | loss: 0.0310783 | val_loss: 0.031133 | Time: 5870.76 ms [2022-04-18 09:27:46 main:574] : INFO : Epoch 1740 | loss: 0.0310793 | val_loss: 0.0311381 | Time: 5482.87 ms [2022-04-18 09:27:52 main:574] : INFO : Epoch 1741 | loss: 0.0310782 | val_loss: 0.0311397 | Time: 5565.94 ms [2022-04-18 09:27:59 main:574] : INFO : Epoch 1742 | loss: 0.031074 | val_loss: 0.0311354 | Time: 7252.39 ms [2022-04-18 09:28:05 main:574] : INFO : Epoch 1743 | loss: 0.0310707 | val_loss: 0.0311471 | Time: 6053.03 ms [2022-04-18 09:28:11 main:574] : INFO : Epoch 1744 | loss: 0.0310682 | val_loss: 0.0311433 | Time: 5643.16 ms [2022-04-18 09:28:17 main:574] : INFO : Epoch 1745 | loss: 0.0310711 | val_loss: 0.0311419 | Time: 5810.55 ms [2022-04-18 09:28:22 main:574] : INFO : Epoch 1746 | loss: 0.031069 | val_loss: 0.0311413 | Time: 5538.48 ms [2022-04-18 09:28:28 main:574] : INFO : Epoch 1747 | loss: 0.0310663 | val_loss: 0.0311434 | Time: 5332.82 ms [2022-04-18 09:28:34 main:574] : INFO : Epoch 1748 | loss: 0.031067 | val_loss: 0.0311448 | Time: 5950.95 ms [2022-04-18 09:28:39 main:574] : INFO : Epoch 1749 | loss: 0.0310681 | val_loss: 0.0311401 | Time: 5398.02 ms [2022-04-18 09:28:45 main:574] : INFO : Epoch 1750 | loss: 0.0310655 | val_loss: 0.0311431 | Time: 5957.67 ms [2022-04-18 09:28:51 main:574] : INFO : Epoch 1751 | loss: 0.0310699 | val_loss: 0.0311366 | Time: 5583.28 ms [2022-04-18 09:28:58 main:574] : INFO : Epoch 1752 | loss: 0.0310708 | val_loss: 0.0311331 | Time: 6886.25 ms [2022-04-18 09:29:03 main:574] : INFO : Epoch 1753 | loss: 0.0310691 | val_loss: 0.0311508 | Time: 5444.73 ms [2022-04-18 09:29:09 main:574] : INFO : Epoch 1754 | loss: 0.0310854 | val_loss: 0.0311514 | Time: 5874.35 ms [2022-04-18 09:29:15 main:574] : INFO : Epoch 1755 | loss: 0.0310711 | val_loss: 0.0311468 | Time: 5721.76 ms [2022-04-18 09:29:20 main:574] : INFO : Epoch 1756 | loss: 0.0310678 | val_loss: 0.0311386 | Time: 5461.61 ms [2022-04-18 09:29:26 main:574] : INFO : Epoch 1757 | loss: 0.031071 | val_loss: 0.0311395 | Time: 6080.11 ms [2022-04-18 09:29:32 main:574] : INFO : Epoch 1758 | loss: 0.0310668 | val_loss: 0.0311517 | Time: 5342.45 ms [2022-04-18 09:29:38 main:574] : INFO : Epoch 1759 | loss: 0.0310664 | val_loss: 0.0311433 | Time: 6009.63 ms [2022-04-18 09:29:44 main:574] : INFO : Epoch 1760 | loss: 0.0310636 | val_loss: 0.0311445 | Time: 5907.28 ms [2022-04-18 09:29:50 main:574] : INFO : Epoch 1761 | loss: 0.0310635 | val_loss: 0.0311445 | Time: 6079.88 ms [2022-04-18 09:29:56 main:574] : INFO : Epoch 1762 | loss: 0.0310705 | val_loss: 0.0311426 | Time: 5754.81 ms [2022-04-18 09:30:03 main:574] : INFO : Epoch 1763 | loss: 0.0310788 | val_loss: 0.031141 | Time: 7177.51 ms [2022-04-18 09:30:09 main:574] : INFO : Epoch 1764 | loss: 0.0310714 | val_loss: 0.0311295 | Time: 5746.17 ms [2022-04-18 09:30:15 main:574] : INFO : Epoch 1765 | loss: 0.0310688 | val_loss: 0.0311379 | Time: 6046.43 ms [2022-04-18 09:30:20 main:574] : INFO : Epoch 1766 | loss: 0.0310719 | val_loss: 0.0311477 | Time: 5371.85 ms [2022-04-18 09:30:26 main:574] : INFO : Epoch 1767 | loss: 0.0310715 | val_loss: 0.0311413 | Time: 6045.23 ms [2022-04-18 09:30:32 main:574] : INFO : Epoch 1768 | loss: 0.031081 | val_loss: 0.0311265 | Time: 5513.38 ms [2022-04-18 09:30:37 main:574] : INFO : Epoch 1769 | loss: 0.03109 | val_loss: 0.031124 | Time: 5571.65 ms [2022-04-18 09:30:44 main:574] : INFO : Epoch 1770 | loss: 0.0310822 | val_loss: 0.0311346 | Time: 6440.05 ms [2022-04-18 09:30:50 main:574] : INFO : Epoch 1771 | loss: 0.0310858 | val_loss: 0.0311334 | Time: 6227.87 ms [2022-04-18 09:30:56 main:574] : INFO : Epoch 1772 | loss: 0.0310824 | val_loss: 0.0311357 | Time: 5847.67 ms [2022-04-18 09:31:02 main:574] : INFO : Epoch 1773 | loss: 0.0310779 | val_loss: 0.0311328 | Time: 6461.5 ms [2022-04-18 09:31:08 main:574] : INFO : Epoch 1774 | loss: 0.0310741 | val_loss: 0.0311328 | Time: 5435.12 ms [2022-04-18 09:31:13 main:574] : INFO : Epoch 1775 | loss: 0.0310707 | val_loss: 0.0311284 | Time: 5676.22 ms [2022-04-18 09:31:19 main:574] : INFO : Epoch 1776 | loss: 0.0310686 | val_loss: 0.0311382 | Time: 5859.79 ms [2022-04-18 09:31:25 main:574] : INFO : Epoch 1777 | loss: 0.0310697 | val_loss: 0.0311317 | Time: 5581.65 ms [2022-04-18 09:31:31 main:574] : INFO : Epoch 1778 | loss: 0.0310713 | val_loss: 0.0311322 | Time: 6032.31 ms [2022-04-18 09:31:36 main:574] : INFO : Epoch 1779 | loss: 0.0310693 | val_loss: 0.0311346 | Time: 5369 ms [2022-04-18 09:31:42 main:574] : INFO : Epoch 1780 | loss: 0.0310689 | val_loss: 0.0311306 | Time: 6032.37 ms [2022-04-18 09:31:48 main:574] : INFO : Epoch 1781 | loss: 0.0310685 | val_loss: 0.0311415 | Time: 5367.11 ms [2022-04-18 09:31:53 main:574] : INFO : Epoch 1782 | loss: 0.031066 | val_loss: 0.0311413 | Time: 5483.96 ms [2022-04-18 09:32:00 main:574] : INFO : Epoch 1783 | loss: 0.0310645 | val_loss: 0.0311412 | Time: 6473.79 ms [2022-04-18 09:32:05 main:574] : INFO : Epoch 1784 | loss: 0.0310635 | val_loss: 0.0311413 | Time: 5516.34 ms [2022-04-18 09:32:11 main:574] : INFO : Epoch 1785 | loss: 0.0310633 | val_loss: 0.0311376 | Time: 5921.49 ms [2022-04-18 09:32:17 main:574] : INFO : Epoch 1786 | loss: 0.0310619 | val_loss: 0.0311359 | Time: 5453.9 ms [2022-04-18 09:32:23 main:574] : INFO : Epoch 1787 | loss: 0.0310616 | val_loss: 0.031136 | Time: 5873.94 ms [2022-04-18 09:32:28 main:574] : INFO : Epoch 1788 | loss: 0.0310635 | val_loss: 0.0311324 | Time: 5486.32 ms [2022-04-18 09:32:34 main:574] : INFO : Epoch 1789 | loss: 0.0310671 | val_loss: 0.0311349 | Time: 5679.83 ms [2022-04-18 09:32:40 main:574] : INFO : Epoch 1790 | loss: 0.0310671 | val_loss: 0.0311329 | Time: 5799.1 ms [2022-04-18 09:32:45 main:574] : INFO : Epoch 1791 | loss: 0.0310689 | val_loss: 0.0311397 | Time: 5572.65 ms [2022-04-18 09:32:51 main:574] : INFO : Epoch 1792 | loss: 0.031071 | val_loss: 0.0311436 | Time: 5958.34 ms [2022-04-18 09:32:57 main:574] : INFO : Epoch 1793 | loss: 0.0310663 | val_loss: 0.0311332 | Time: 5853.95 ms [2022-04-18 09:33:03 main:574] : INFO : Epoch 1794 | loss: 0.0310645 | val_loss: 0.0311362 | Time: 6050.27 ms [2022-04-18 09:33:09 main:574] : INFO : Epoch 1795 | loss: 0.0310632 | val_loss: 0.0311318 | Time: 6024.93 ms [2022-04-18 09:33:16 main:574] : INFO : Epoch 1796 | loss: 0.0310611 | val_loss: 0.0311361 | Time: 6895.03 ms [2022-04-18 09:33:23 main:574] : INFO : Epoch 1797 | loss: 0.0310651 | val_loss: 0.031136 | Time: 7275.71 ms [2022-04-18 09:33:41 main:574] : INFO : Epoch 1798 | loss: 0.0310643 | val_loss: 0.0311344 | Time: 17739.6 ms [2022-04-18 09:33:47 main:574] : INFO : Epoch 1799 | loss: 0.0310614 | val_loss: 0.0311342 | Time: 6390.4 ms [2022-04-18 09:33:54 main:574] : INFO : Epoch 1800 | loss: 0.0310604 | val_loss: 0.0311427 | Time: 6437.63 ms [2022-04-18 09:34:00 main:574] : INFO : Epoch 1801 | loss: 0.0310604 | val_loss: 0.0311476 | Time: 6228.69 ms [2022-04-18 09:34:06 main:574] : INFO : Epoch 1802 | loss: 0.031062 | val_loss: 0.0311453 | Time: 5962.34 ms [2022-04-18 09:34:12 main:574] : INFO : Epoch 1803 | loss: 0.0310689 | val_loss: 0.0311307 | Time: 5779.13 ms [2022-04-18 09:34:18 main:574] : INFO : Epoch 1804 | loss: 0.0310685 | val_loss: 0.0311311 | Time: 6047.64 ms [2022-04-18 09:34:23 main:574] : INFO : Epoch 1805 | loss: 0.0310682 | val_loss: 0.0311346 | Time: 5530.36 ms [2022-04-18 09:34:30 main:574] : INFO : Epoch 1806 | loss: 0.0310671 | val_loss: 0.0311368 | Time: 6096.38 ms [2022-04-18 09:34:36 main:574] : INFO : Epoch 1807 | loss: 0.0310667 | val_loss: 0.0311353 | Time: 6827.44 ms [2022-04-18 09:34:43 main:574] : INFO : Epoch 1808 | loss: 0.0310674 | val_loss: 0.0311332 | Time: 6272.6 ms [2022-04-18 09:34:50 main:574] : INFO : Epoch 1809 | loss: 0.0310713 | val_loss: 0.0311326 | Time: 6805.39 ms [2022-04-18 09:34:55 main:574] : INFO : Epoch 1810 | loss: 0.0310739 | val_loss: 0.0311326 | Time: 5583.63 ms [2022-04-18 09:35:01 main:574] : INFO : Epoch 1811 | loss: 0.0310701 | val_loss: 0.0311474 | Time: 6110.46 ms [2022-04-18 09:35:07 main:574] : INFO : Epoch 1812 | loss: 0.031069 | val_loss: 0.0311336 | Time: 5533.61 ms [2022-04-18 09:35:13 main:574] : INFO : Epoch 1813 | loss: 0.0310778 | val_loss: 0.0311503 | Time: 6341.65 ms [2022-04-18 09:35:19 main:574] : INFO : Epoch 1814 | loss: 0.0310966 | val_loss: 0.031134 | Time: 5647.25 ms [2022-04-18 09:35:25 main:574] : INFO : Epoch 1815 | loss: 0.0310935 | val_loss: 0.0311351 | Time: 6351.96 ms [2022-04-18 09:35:31 main:574] : INFO : Epoch 1816 | loss: 0.0310871 | val_loss: 0.0311323 | Time: 5803.63 ms [2022-04-18 09:35:38 main:574] : INFO : Epoch 1817 | loss: 0.031088 | val_loss: 0.0311315 | Time: 6976.94 ms [2022-04-18 09:35:45 main:574] : INFO : Epoch 1818 | loss: 0.031083 | val_loss: 0.0311278 | Time: 7363.39 ms [2022-04-18 09:35:51 main:574] : INFO : Epoch 1819 | loss: 0.0310826 | val_loss: 0.0311343 | Time: 5604.33 ms [2022-04-18 09:35:57 main:574] : INFO : Epoch 1820 | loss: 0.0310802 | val_loss: 0.0311237 | Time: 6176.96 ms [2022-04-18 09:36:03 main:574] : INFO : Epoch 1821 | loss: 0.0310805 | val_loss: 0.0311297 | Time: 5699.9 ms [2022-04-18 09:36:09 main:574] : INFO : Epoch 1822 | loss: 0.0310825 | val_loss: 0.0311255 | Time: 6494.03 ms [2022-04-18 09:36:15 main:574] : INFO : Epoch 1823 | loss: 0.0310804 | val_loss: 0.0311267 | Time: 5770.12 ms [2022-04-18 09:36:21 main:574] : INFO : Epoch 1824 | loss: 0.0310903 | val_loss: 0.031131 | Time: 6166.28 ms [2022-04-18 09:36:27 main:574] : INFO : Epoch 1825 | loss: 0.0310896 | val_loss: 0.031136 | Time: 5655.17 ms [2022-04-18 09:36:34 main:574] : INFO : Epoch 1826 | loss: 0.0310832 | val_loss: 0.0311282 | Time: 6447.94 ms [2022-04-18 09:36:41 main:574] : INFO : Epoch 1827 | loss: 0.0310806 | val_loss: 0.0311383 | Time: 7501.73 ms [2022-04-18 09:36:48 main:574] : INFO : Epoch 1828 | loss: 0.0310819 | val_loss: 0.031135 | Time: 6528.65 ms [2022-04-18 09:36:55 main:574] : INFO : Epoch 1829 | loss: 0.0310829 | val_loss: 0.031131 | Time: 7001.53 ms [2022-04-18 09:37:01 main:574] : INFO : Epoch 1830 | loss: 0.0310793 | val_loss: 0.0311367 | Time: 6855.33 ms [2022-04-18 09:37:19 main:574] : INFO : Epoch 1831 | loss: 0.0310776 | val_loss: 0.0311325 | Time: 17955 ms [2022-04-18 09:37:25 main:574] : INFO : Epoch 1832 | loss: 0.0310782 | val_loss: 0.0311356 | Time: 5957.77 ms [2022-04-18 09:37:32 main:574] : INFO : Epoch 1833 | loss: 0.0310761 | val_loss: 0.0311385 | Time: 6383.17 ms [2022-04-18 09:37:38 main:574] : INFO : Epoch 1834 | loss: 0.0310735 | val_loss: 0.0311247 | Time: 5969.03 ms [2022-04-18 09:37:45 main:574] : INFO : Epoch 1835 | loss: 0.0310723 | val_loss: 0.0311347 | Time: 6779.46 ms [2022-04-18 09:37:51 main:574] : INFO : Epoch 1836 | loss: 0.0310701 | val_loss: 0.0311346 | Time: 6488.83 ms [2022-04-18 09:37:58 main:574] : INFO : Epoch 1837 | loss: 0.0310706 | val_loss: 0.0311358 | Time: 6386.29 ms [2022-04-18 09:38:04 main:574] : INFO : Epoch 1838 | loss: 0.0310699 | val_loss: 0.0311326 | Time: 6847.55 ms [2022-04-18 09:38:11 main:574] : INFO : Epoch 1839 | loss: 0.0310688 | val_loss: 0.0311314 | Time: 6146.37 ms [2022-04-18 09:38:18 main:574] : INFO : Epoch 1840 | loss: 0.0310691 | val_loss: 0.0311363 | Time: 7397.17 ms [2022-04-18 09:38:25 main:574] : INFO : Epoch 1841 | loss: 0.0310683 | val_loss: 0.0311401 | Time: 7095.36 ms [2022-04-18 09:38:32 main:574] : INFO : Epoch 1842 | loss: 0.0310687 | val_loss: 0.031135 | Time: 6914.48 ms [2022-04-18 09:38:38 main:574] : INFO : Epoch 1843 | loss: 0.0310731 | val_loss: 0.0311441 | Time: 6164.67 ms [2022-04-18 09:38:45 main:574] : INFO : Epoch 1844 | loss: 0.0310714 | val_loss: 0.031137 | Time: 6802.82 ms [2022-04-18 09:38:52 main:574] : INFO : Epoch 1845 | loss: 0.0310696 | val_loss: 0.0311404 | Time: 6690.77 ms [2022-04-18 09:38:58 main:574] : INFO : Epoch 1846 | loss: 0.0310723 | val_loss: 0.031129 | Time: 6190.13 ms [2022-04-18 09:39:05 main:574] : INFO : Epoch 1847 | loss: 0.0310715 | val_loss: 0.0311347 | Time: 6613.89 ms [2022-04-18 09:39:11 main:574] : INFO : Epoch 1848 | loss: 0.0310674 | val_loss: 0.0311295 | Time: 6242.88 ms [2022-04-18 09:39:18 main:574] : INFO : Epoch 1849 | loss: 0.0310668 | val_loss: 0.0311293 | Time: 7351.43 ms [2022-04-18 09:39:25 main:574] : INFO : Epoch 1850 | loss: 0.0310676 | val_loss: 0.0311327 | Time: 7074.69 ms [2022-04-18 09:39:32 main:574] : INFO : Epoch 1851 | loss: 0.0310727 | val_loss: 0.0311396 | Time: 6668.07 ms [2022-04-18 09:39:38 main:574] : INFO : Epoch 1852 | loss: 0.0310755 | val_loss: 0.03113 | Time: 6357.49 ms [2022-04-18 09:39:45 main:574] : INFO : Epoch 1853 | loss: 0.0310722 | val_loss: 0.0311303 | Time: 6673.9 ms [2022-04-18 09:39:52 main:574] : INFO : Epoch 1854 | loss: 0.0310707 | val_loss: 0.031134 | Time: 6620.98 ms [2022-04-18 09:39:58 main:574] : INFO : Epoch 1855 | loss: 0.0310727 | val_loss: 0.0311397 | Time: 6582.63 ms [2022-04-18 09:40:05 main:574] : INFO : Epoch 1856 | loss: 0.0310752 | val_loss: 0.0311329 | Time: 6860.98 ms [2022-04-18 09:40:12 main:574] : INFO : Epoch 1857 | loss: 0.0310782 | val_loss: 0.0311357 | Time: 6912.86 ms [2022-04-18 09:40:20 main:574] : INFO : Epoch 1858 | loss: 0.0310747 | val_loss: 0.0311316 | Time: 7498.34 ms [2022-04-18 09:40:26 main:574] : INFO : Epoch 1859 | loss: 0.0310715 | val_loss: 0.0311281 | Time: 6765.28 ms [2022-04-18 09:40:33 main:574] : INFO : Epoch 1860 | loss: 0.0310682 | val_loss: 0.0311391 | Time: 6656.2 ms [2022-04-18 09:40:39 main:574] : INFO : Epoch 1861 | loss: 0.0310679 | val_loss: 0.0311411 | Time: 5695.41 ms [2022-04-18 09:40:45 main:574] : INFO : Epoch 1862 | loss: 0.0310697 | val_loss: 0.0311342 | Time: 6134.06 ms [2022-04-18 09:40:51 main:574] : INFO : Epoch 1863 | loss: 0.0310713 | val_loss: 0.0311368 | Time: 5649.09 ms [2022-04-18 09:40:57 main:574] : INFO : Epoch 1864 | loss: 0.0310803 | val_loss: 0.0311362 | Time: 6541.93 ms [2022-04-18 09:41:03 main:574] : INFO : Epoch 1865 | loss: 0.0310794 | val_loss: 0.0311401 | Time: 5639.36 ms [2022-04-18 09:41:09 main:574] : INFO : Epoch 1866 | loss: 0.0310792 | val_loss: 0.031139 | Time: 6616.56 ms [2022-04-18 09:41:15 main:574] : INFO : Epoch 1867 | loss: 0.031105 | val_loss: 0.0311309 | Time: 5902 ms [2022-04-18 09:41:21 main:574] : INFO : Epoch 1868 | loss: 0.0311065 | val_loss: 0.0311289 | Time: 6025.54 ms [2022-04-18 09:41:28 main:574] : INFO : Epoch 1869 | loss: 0.0311011 | val_loss: 0.0311247 | Time: 6184.07 ms [2022-04-18 09:41:34 main:574] : INFO : Epoch 1870 | loss: 0.0310961 | val_loss: 0.03113 | Time: 6063.27 ms [2022-04-18 09:41:40 main:574] : INFO : Epoch 1871 | loss: 0.0310943 | val_loss: 0.0311301 | Time: 6078.98 ms [2022-04-18 09:41:46 main:574] : INFO : Epoch 1872 | loss: 0.0310927 | val_loss: 0.0311277 | Time: 5864.9 ms [2022-04-18 09:41:53 main:574] : INFO : Epoch 1873 | loss: 0.031088 | val_loss: 0.0311282 | Time: 7631.55 ms [2022-04-18 09:41:59 main:574] : INFO : Epoch 1874 | loss: 0.0310883 | val_loss: 0.0311313 | Time: 5432.1 ms [2022-04-18 09:42:05 main:574] : INFO : Epoch 1875 | loss: 0.0310888 | val_loss: 0.031128 | Time: 6057.89 ms [2022-04-18 09:42:10 main:574] : INFO : Epoch 1876 | loss: 0.0310812 | val_loss: 0.0311296 | Time: 5485.36 ms [2022-04-18 09:42:16 main:574] : INFO : Epoch 1877 | loss: 0.0310843 | val_loss: 0.0311277 | Time: 5713.95 ms [2022-04-18 09:42:22 main:574] : INFO : Epoch 1878 | loss: 0.0310851 | val_loss: 0.0311315 | Time: 5804.99 ms [2022-04-18 09:42:27 main:574] : INFO : Epoch 1879 | loss: 0.0310921 | val_loss: 0.0311327 | Time: 5545.58 ms [2022-04-18 09:42:33 main:574] : INFO : Epoch 1880 | loss: 0.0310919 | val_loss: 0.0311336 | Time: 5948.97 ms [2022-04-18 09:42:39 main:574] : INFO : Epoch 1881 | loss: 0.0310869 | val_loss: 0.0311288 | Time: 5409.67 ms [2022-04-18 09:42:45 main:574] : INFO : Epoch 1882 | loss: 0.0310824 | val_loss: 0.0311305 | Time: 5942.5 ms [2022-04-18 09:42:51 main:574] : INFO : Epoch 1883 | loss: 0.0310795 | val_loss: 0.0311379 | Time: 6292.78 ms [2022-04-18 09:42:57 main:574] : INFO : Epoch 1884 | loss: 0.0310819 | val_loss: 0.0311327 | Time: 6260.45 ms [2022-04-18 09:43:03 main:574] : INFO : Epoch 1885 | loss: 0.0310874 | val_loss: 0.0311314 | Time: 5475.71 ms [2022-04-18 09:43:09 main:574] : INFO : Epoch 1886 | loss: 0.0310836 | val_loss: 0.0311311 | Time: 6076.08 ms [2022-04-18 09:43:15 main:574] : INFO : Epoch 1887 | loss: 0.0311185 | val_loss: 0.0311612 | Time: 5460.57 ms [2022-04-18 09:43:20 main:574] : INFO : Epoch 1888 | loss: 0.0311556 | val_loss: 0.0311616 | Time: 5560.45 ms [2022-04-18 09:43:26 main:574] : INFO : Epoch 1889 | loss: 0.0311503 | val_loss: 0.0311527 | Time: 5904.39 ms [2022-04-18 09:43:32 main:574] : INFO : Epoch 1890 | loss: 0.0311458 | val_loss: 0.0311512 | Time: 5598.9 ms [2022-04-18 09:43:38 main:574] : INFO : Epoch 1891 | loss: 0.031146 | val_loss: 0.0311543 | Time: 5852.84 ms [2022-04-18 09:43:43 main:574] : INFO : Epoch 1892 | loss: 0.031151 | val_loss: 0.0311573 | Time: 5490.38 ms [2022-04-18 09:43:49 main:574] : INFO : Epoch 1893 | loss: 0.0311378 | val_loss: 0.0311507 | Time: 6082.37 ms [2022-04-18 09:43:55 main:574] : INFO : Epoch 1894 | loss: 0.0311301 | val_loss: 0.0311509 | Time: 6279.74 ms [2022-04-18 09:44:01 main:574] : INFO : Epoch 1895 | loss: 0.0311263 | val_loss: 0.0311468 | Time: 5894.98 ms [2022-04-18 09:44:07 main:574] : INFO : Epoch 1896 | loss: 0.0311241 | val_loss: 0.0311467 | Time: 5585.28 ms [2022-04-18 09:44:13 main:574] : INFO : Epoch 1897 | loss: 0.0311236 | val_loss: 0.0311439 | Time: 5896.8 ms [2022-04-18 09:44:19 main:574] : INFO : Epoch 1898 | loss: 0.0311224 | val_loss: 0.0311474 | Time: 5636.49 ms [2022-04-18 09:44:24 main:574] : INFO : Epoch 1899 | loss: 0.0311212 | val_loss: 0.0311465 | Time: 5404.77 ms [2022-04-18 09:44:30 main:574] : INFO : Epoch 1900 | loss: 0.0311158 | val_loss: 0.0311408 | Time: 6034.42 ms [2022-04-18 09:44:35 main:574] : INFO : Epoch 1901 | loss: 0.0311104 | val_loss: 0.0311378 | Time: 5417.58 ms [2022-04-18 09:44:42 main:574] : INFO : Epoch 1902 | loss: 0.0311105 | val_loss: 0.0311391 | Time: 6048.91 ms [2022-04-18 09:44:47 main:574] : INFO : Epoch 1903 | loss: 0.0311149 | val_loss: 0.0311371 | Time: 5505.4 ms [2022-04-18 09:44:55 main:574] : INFO : Epoch 1904 | loss: 0.031113 | val_loss: 0.0311398 | Time: 7465.21 ms [2022-04-18 09:45:01 main:574] : INFO : Epoch 1905 | loss: 0.0311101 | val_loss: 0.031137 | Time: 6783.58 ms [2022-04-18 09:45:08 main:574] : INFO : Epoch 1906 | loss: 0.0311081 | val_loss: 0.0311403 | Time: 6885.22 ms [2022-04-18 09:45:26 main:574] : INFO : Epoch 1907 | loss: 0.0311086 | val_loss: 0.0311415 | Time: 17465 ms [2022-04-18 09:45:32 main:574] : INFO : Epoch 1908 | loss: 0.0311087 | val_loss: 0.0311406 | Time: 6048.16 ms [2022-04-18 09:45:37 main:574] : INFO : Epoch 1909 | loss: 0.0311084 | val_loss: 0.0311434 | Time: 4992.89 ms [2022-04-18 09:45:42 main:574] : INFO : Epoch 1910 | loss: 0.0311067 | val_loss: 0.0311388 | Time: 5068.13 ms [2022-04-18 09:45:48 main:574] : INFO : Epoch 1911 | loss: 0.031105 | val_loss: 0.0311428 | Time: 5995.78 ms [2022-04-18 09:45:53 main:574] : INFO : Epoch 1912 | loss: 0.0311055 | val_loss: 0.0311442 | Time: 5264.82 ms [2022-04-18 09:45:59 main:574] : INFO : Epoch 1913 | loss: 0.0311057 | val_loss: 0.0311417 | Time: 5647.18 ms [2022-04-18 09:46:04 main:574] : INFO : Epoch 1914 | loss: 0.0311049 | val_loss: 0.031145 | Time: 5578.8 ms [2022-04-18 09:46:10 main:574] : INFO : Epoch 1915 | loss: 0.0311122 | val_loss: 0.0311432 | Time: 5308.03 ms [2022-04-18 09:46:17 main:574] : INFO : Epoch 1916 | loss: 0.0311086 | val_loss: 0.0311414 | Time: 7241.96 ms [2022-04-18 09:46:24 main:574] : INFO : Epoch 1917 | loss: 0.0311074 | val_loss: 0.0311376 | Time: 7238.88 ms [2022-04-18 09:46:42 main:574] : INFO : Epoch 1918 | loss: 0.0311013 | val_loss: 0.0311433 | Time: 18133.2 ms [2022-04-18 09:46:52 main:574] : INFO : Epoch 1919 | loss: 0.0310984 | val_loss: 0.0311309 | Time: 9147.17 ms [2022-04-18 09:46:57 main:574] : INFO : Epoch 1920 | loss: 0.0311071 | val_loss: 0.0311413 | Time: 5561.01 ms [2022-04-18 09:47:03 main:574] : INFO : Epoch 1921 | loss: 0.0311052 | val_loss: 0.0311377 | Time: 5686.2 ms [2022-04-18 09:47:09 main:574] : INFO : Epoch 1922 | loss: 0.0311006 | val_loss: 0.0311321 | Time: 5993.64 ms [2022-04-18 09:47:15 main:574] : INFO : Epoch 1923 | loss: 0.0310975 | val_loss: 0.0311323 | Time: 5741.12 ms [2022-04-18 09:47:21 main:574] : INFO : Epoch 1924 | loss: 0.0310985 | val_loss: 0.0311332 | Time: 6147.18 ms [2022-04-18 09:47:26 main:574] : INFO : Epoch 1925 | loss: 0.0310952 | val_loss: 0.0311344 | Time: 5666.75 ms [2022-04-18 09:47:33 main:574] : INFO : Epoch 1926 | loss: 0.0310951 | val_loss: 0.0311332 | Time: 6220.1 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1060) [2022-04-18 10:00:51 main:435] : INFO : Set logging level to 1 [2022-04-18 10:00:51 main:441] : INFO : Running in BOINC Client mode [2022-04-18 10:00:51 main:444] : INFO : Resolving all filenames [2022-04-18 10:00:51 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-18 10:00:51 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-18 10:00:51 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-18 10:00:51 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-18 10:00:51 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-18 10:00:51 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-18 10:00:51 main:474] : INFO : Configuration: [2022-04-18 10:00:51 main:475] : INFO : Model type: GRU [2022-04-18 10:00:51 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-18 10:00:51 main:477] : INFO : Max Epochs: 2048 [2022-04-18 10:00:51 main:478] : INFO : Batch Size: 128 [2022-04-18 10:00:51 main:479] : INFO : Learning Rate: 0.01 [2022-04-18 10:00:51 main:480] : INFO : Patience: 10 [2022-04-18 10:00:51 main:481] : INFO : Hidden Width: 12 [2022-04-18 10:00:51 main:482] : INFO : # Recurrent Layers: 4 [2022-04-18 10:00:51 main:483] : INFO : # Backend Layers: 4 [2022-04-18 10:00:51 main:484] : INFO : # Threads: 1 [2022-04-18 10:00:51 main:486] : INFO : Preparing Dataset [2022-04-18 10:00:51 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-18 10:00:51 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-18 10:00:54 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-18 10:00:54 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-18 10:00:54 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-18 10:00:54 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-18 10:00:54 main:494] : INFO : Creating Model [2022-04-18 10:00:54 main:507] : INFO : Preparing config file [2022-04-18 10:00:54 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-18 10:00:54 main:512] : INFO : Loading config [2022-04-18 10:00:54 main:514] : INFO : Loading state [2022-04-18 10:00:55 main:559] : INFO : Loading DataLoader into Memory [2022-04-18 10:00:56 main:562] : INFO : Starting Training [2022-04-18 10:01:03 main:574] : INFO : Epoch 1902 | loss: 0.0311421 | val_loss: 0.0311383 | Time: 7714.18 ms [2022-04-18 10:01:08 main:574] : INFO : Epoch 1903 | loss: 0.0311145 | val_loss: 0.0311414 | Time: 5040.88 ms [2022-04-18 10:01:13 main:574] : INFO : Epoch 1904 | loss: 0.0311064 | val_loss: 0.0311313 | Time: 5066.01 ms [2022-04-18 10:01:19 main:574] : INFO : Epoch 1905 | loss: 0.0311022 | val_loss: 0.0311367 | Time: 5651.06 ms [2022-04-18 10:01:24 main:574] : INFO : Epoch 1906 | loss: 0.0310994 | val_loss: 0.0311313 | Time: 5218.7 ms [2022-04-18 10:01:29 main:574] : INFO : Epoch 1907 | loss: 0.0310946 | val_loss: 0.0311326 | Time: 5174.55 ms [2022-04-18 10:01:35 main:574] : INFO : Epoch 1908 | loss: 0.0310939 | val_loss: 0.0311245 | Time: 5659.97 ms [2022-04-18 10:01:40 main:574] : INFO : Epoch 1909 | loss: 0.0310939 | val_loss: 0.0311345 | Time: 5100.61 ms [2022-04-18 10:01:45 main:574] : INFO : Epoch 1910 | loss: 0.0310918 | val_loss: 0.0311274 | Time: 5116.62 ms [2022-04-18 10:01:51 main:574] : INFO : Epoch 1911 | loss: 0.0310902 | val_loss: 0.0311269 | Time: 5797.59 ms [2022-04-18 10:01:56 main:574] : INFO : Epoch 1912 | loss: 0.0310861 | val_loss: 0.0311307 | Time: 5326.66 ms [2022-04-18 10:02:02 main:574] : INFO : Epoch 1913 | loss: 0.0310848 | val_loss: 0.0311286 | Time: 5329.27 ms [2022-04-18 10:02:08 main:574] : INFO : Epoch 1914 | loss: 0.0310827 | val_loss: 0.031129 | Time: 5766.97 ms [2022-04-18 10:02:13 main:574] : INFO : Epoch 1915 | loss: 0.031082 | val_loss: 0.0311271 | Time: 5131.46 ms [2022-04-18 10:02:19 main:574] : INFO : Epoch 1916 | loss: 0.031083 | val_loss: 0.0311249 | Time: 5825.86 ms [2022-04-18 10:02:24 main:574] : INFO : Epoch 1917 | loss: 0.0310858 | val_loss: 0.0311267 | Time: 5643.29 ms [2022-04-18 10:02:30 main:574] : INFO : Epoch 1918 | loss: 0.0310857 | val_loss: 0.0311276 | Time: 5348.43 ms [2022-04-18 10:02:36 main:574] : INFO : Epoch 1919 | loss: 0.0310837 | val_loss: 0.0311244 | Time: 5791.62 ms [2022-04-18 10:02:41 main:574] : INFO : Epoch 1920 | loss: 0.0310798 | val_loss: 0.0311224 | Time: 5460.11 ms [2022-04-18 10:02:47 main:574] : INFO : Epoch 1921 | loss: 0.0310809 | val_loss: 0.0311268 | Time: 5986.62 ms [2022-04-18 10:02:52 main:574] : INFO : Epoch 1922 | loss: 0.0310842 | val_loss: 0.0311282 | Time: 5314.48 ms [2022-04-18 10:02:58 main:574] : INFO : Epoch 1923 | loss: 0.0310842 | val_loss: 0.0311279 | Time: 5243.61 ms [2022-04-18 10:03:04 main:574] : INFO : Epoch 1924 | loss: 0.0310837 | val_loss: 0.03113 | Time: 5885.14 ms [2022-04-18 10:03:09 main:574] : INFO : Epoch 1925 | loss: 0.031083 | val_loss: 0.0311286 | Time: 5443.99 ms [2022-04-18 10:03:15 main:574] : INFO : Epoch 1926 | loss: 0.0310835 | val_loss: 0.0311273 | Time: 5861.17 ms [2022-04-18 10:03:20 main:574] : INFO : Epoch 1927 | loss: 0.0310862 | val_loss: 0.031138 | Time: 5415.1 ms [2022-04-18 10:03:26 main:574] : INFO : Epoch 1928 | loss: 0.0310852 | val_loss: 0.0311343 | Time: 5231.86 ms [2022-04-18 10:03:32 main:574] : INFO : Epoch 1929 | loss: 0.0310843 | val_loss: 0.0311315 | Time: 6019.24 ms [2022-04-18 10:03:37 main:574] : INFO : Epoch 1930 | loss: 0.0310803 | val_loss: 0.0311328 | Time: 5440.37 ms [2022-04-18 10:03:43 main:574] : INFO : Epoch 1931 | loss: 0.0310784 | val_loss: 0.0311335 | Time: 6012.67 ms [2022-04-18 10:03:48 main:574] : INFO : Epoch 1932 | loss: 0.0310822 | val_loss: 0.0311331 | Time: 5263.74 ms [2022-04-18 10:03:54 main:574] : INFO : Epoch 1933 | loss: 0.0310835 | val_loss: 0.0311314 | Time: 5319.06 ms [2022-04-18 10:04:00 main:574] : INFO : Epoch 1934 | loss: 0.0310789 | val_loss: 0.0311257 | Time: 5838.36 ms [2022-04-18 10:04:05 main:574] : INFO : Epoch 1935 | loss: 0.0310782 | val_loss: 0.0311274 | Time: 5337.21 ms [2022-04-18 10:04:11 main:574] : INFO : Epoch 1936 | loss: 0.0310781 | val_loss: 0.0311265 | Time: 5529.73 ms [2022-04-18 10:04:16 main:574] : INFO : Epoch 1937 | loss: 0.0310777 | val_loss: 0.0311285 | Time: 5830.87 ms [2022-04-18 10:04:22 main:574] : INFO : Epoch 1938 | loss: 0.0310746 | val_loss: 0.0311275 | Time: 5285.29 ms [2022-04-18 10:04:28 main:574] : INFO : Epoch 1939 | loss: 0.031076 | val_loss: 0.031126 | Time: 5995.74 ms [2022-04-18 10:04:33 main:574] : INFO : Epoch 1940 | loss: 0.0310788 | val_loss: 0.0311249 | Time: 5480.45 ms [2022-04-18 10:04:39 main:574] : INFO : Epoch 1941 | loss: 0.0310778 | val_loss: 0.0311288 | Time: 5385.71 ms [2022-04-18 10:04:44 main:574] : INFO : Epoch 1942 | loss: 0.0310813 | val_loss: 0.0311278 | Time: 5695.62 ms [2022-04-18 10:04:50 main:574] : INFO : Epoch 1943 | loss: 0.031077 | val_loss: 0.0311322 | Time: 5372.44 ms [2022-04-18 10:04:56 main:574] : INFO : Epoch 1944 | loss: 0.0310749 | val_loss: 0.0311254 | Time: 6280.96 ms [2022-04-18 10:05:01 main:574] : INFO : Epoch 1945 | loss: 0.0310768 | val_loss: 0.0311345 | Time: 5392.46 ms [2022-04-18 10:05:07 main:574] : INFO : Epoch 1946 | loss: 0.0310791 | val_loss: 0.0311302 | Time: 5970.27 ms [2022-04-18 10:05:13 main:574] : INFO : Epoch 1947 | loss: 0.0310814 | val_loss: 0.0311269 | Time: 5398.55 ms [2022-04-18 10:05:18 main:574] : INFO : Epoch 1948 | loss: 0.0310974 | val_loss: 0.0311234 | Time: 5347.39 ms [2022-04-18 10:05:24 main:574] : INFO : Epoch 1949 | loss: 0.0310893 | val_loss: 0.0311226 | Time: 5999.89 ms [2022-04-18 10:05:29 main:574] : INFO : Epoch 1950 | loss: 0.0310844 | val_loss: 0.0311283 | Time: 5185.32 ms [2022-04-18 10:05:35 main:574] : INFO : Epoch 1951 | loss: 0.0310812 | val_loss: 0.0311241 | Time: 5697.72 ms [2022-04-18 10:05:41 main:574] : INFO : Epoch 1952 | loss: 0.0310801 | val_loss: 0.0311253 | Time: 5560.06 ms [2022-04-18 10:05:46 main:574] : INFO : Epoch 1953 | loss: 0.0310781 | val_loss: 0.0311307 | Time: 5405.08 ms [2022-04-18 10:05:52 main:574] : INFO : Epoch 1954 | loss: 0.0310796 | val_loss: 0.0311285 | Time: 6143.88 ms [2022-04-18 10:05:58 main:574] : INFO : Epoch 1955 | loss: 0.0310859 | val_loss: 0.0311254 | Time: 6096.92 ms [2022-04-18 10:06:04 main:574] : INFO : Epoch 1956 | loss: 0.0310789 | val_loss: 0.031126 | Time: 6021.66 ms [2022-04-18 10:06:10 main:574] : INFO : Epoch 1957 | loss: 0.0310768 | val_loss: 0.0311224 | Time: 5534.33 ms [2022-04-18 10:06:16 main:574] : INFO : Epoch 1958 | loss: 0.0310742 | val_loss: 0.031129 | Time: 6146.23 ms [2022-04-18 10:06:22 main:574] : INFO : Epoch 1959 | loss: 0.0310777 | val_loss: 0.031125 | Time: 5524.87 ms [2022-04-18 10:06:27 main:574] : INFO : Epoch 1960 | loss: 0.0310741 | val_loss: 0.0311302 | Time: 5838.04 ms [2022-04-18 10:06:33 main:574] : INFO : Epoch 1961 | loss: 0.0310741 | val_loss: 0.0311279 | Time: 5862.1 ms [2022-04-18 10:06:39 main:574] : INFO : Epoch 1962 | loss: 0.031074 | val_loss: 0.0311248 | Time: 5606.67 ms [2022-04-18 10:06:45 main:574] : INFO : Epoch 1963 | loss: 0.0310727 | val_loss: 0.0311304 | Time: 5767.02 ms [2022-04-18 10:06:50 main:574] : INFO : Epoch 1964 | loss: 0.0310728 | val_loss: 0.0311404 | Time: 5450.71 ms [2022-04-18 10:06:58 main:574] : INFO : Epoch 1965 | loss: 0.0310717 | val_loss: 0.0311274 | Time: 7296.88 ms [2022-04-18 10:07:03 main:574] : INFO : Epoch 1966 | loss: 0.0310702 | val_loss: 0.0311252 | Time: 5772.13 ms [2022-04-18 10:07:09 main:574] : INFO : Epoch 1967 | loss: 0.0310706 | val_loss: 0.03113 | Time: 5809.62 ms [2022-04-18 10:07:15 main:574] : INFO : Epoch 1968 | loss: 0.0310691 | val_loss: 0.0311303 | Time: 5636.85 ms [2022-04-18 10:07:21 main:574] : INFO : Epoch 1969 | loss: 0.0310685 | val_loss: 0.0311295 | Time: 6025.8 ms [2022-04-18 10:07:27 main:574] : INFO : Epoch 1970 | loss: 0.0310756 | val_loss: 0.0311309 | Time: 5688.37 ms [2022-04-18 10:07:33 main:574] : INFO : Epoch 1971 | loss: 0.0310756 | val_loss: 0.0311311 | Time: 6195.12 ms [2022-04-18 10:07:38 main:574] : INFO : Epoch 1972 | loss: 0.0310747 | val_loss: 0.0311314 | Time: 5561.02 ms [2022-04-18 10:07:44 main:574] : INFO : Epoch 1973 | loss: 0.0310731 | val_loss: 0.0311302 | Time: 5998.35 ms [2022-04-18 10:07:50 main:574] : INFO : Epoch 1974 | loss: 0.0310706 | val_loss: 0.0311327 | Time: 5491.59 ms [2022-04-18 10:07:57 main:574] : INFO : Epoch 1975 | loss: 0.0310725 | val_loss: 0.0311234 | Time: 7105.42 ms [2022-04-18 10:08:03 main:574] : INFO : Epoch 1976 | loss: 0.0310806 | val_loss: 0.0311359 | Time: 5540.85 ms [2022-04-18 10:08:09 main:574] : INFO : Epoch 1977 | loss: 0.0310812 | val_loss: 0.0311215 | Time: 5975.44 ms [2022-04-18 10:08:14 main:574] : INFO : Epoch 1978 | loss: 0.0310787 | val_loss: 0.0311298 | Time: 5497.64 ms [2022-04-18 10:08:20 main:574] : INFO : Epoch 1979 | loss: 0.0310776 | val_loss: 0.0311247 | Time: 5937.48 ms [2022-04-18 10:08:26 main:574] : INFO : Epoch 1980 | loss: 0.0310758 | val_loss: 0.0311266 | Time: 5531.04 ms [2022-04-18 10:08:31 main:574] : INFO : Epoch 1981 | loss: 0.0310766 | val_loss: 0.031126 | Time: 5581.41 ms [2022-04-18 10:08:37 main:574] : INFO : Epoch 1982 | loss: 0.0310764 | val_loss: 0.0311211 | Time: 6069.08 ms [2022-04-18 10:08:43 main:574] : INFO : Epoch 1983 | loss: 0.0310735 | val_loss: 0.0311291 | Time: 5463.79 ms [2022-04-18 10:08:49 main:574] : INFO : Epoch 1984 | loss: 0.0310705 | val_loss: 0.0311348 | Time: 6064.51 ms [2022-04-18 10:08:55 main:574] : INFO : Epoch 1985 | loss: 0.0310747 | val_loss: 0.0311261 | Time: 6426.01 ms [2022-04-18 10:09:01 main:574] : INFO : Epoch 1986 | loss: 0.0310949 | val_loss: 0.0311323 | Time: 5884.23 ms [2022-04-18 10:09:07 main:574] : INFO : Epoch 1987 | loss: 0.0310901 | val_loss: 0.0311255 | Time: 5449.12 ms [2022-04-18 10:09:13 main:574] : INFO : Epoch 1988 | loss: 0.0310835 | val_loss: 0.0311271 | Time: 5924.14 ms [2022-04-18 10:09:18 main:574] : INFO : Epoch 1989 | loss: 0.0310817 | val_loss: 0.0311272 | Time: 5443.33 ms [2022-04-18 10:09:24 main:574] : INFO : Epoch 1990 | loss: 0.0310787 | val_loss: 0.0311208 | Time: 5860.79 ms [2022-04-18 10:09:30 main:574] : INFO : Epoch 1991 | loss: 0.0310763 | val_loss: 0.031129 | Time: 5780.56 ms [2022-04-18 10:09:35 main:574] : INFO : Epoch 1992 | loss: 0.0310761 | val_loss: 0.0311278 | Time: 5587.39 ms [2022-04-18 10:09:41 main:574] : INFO : Epoch 1993 | loss: 0.0310734 | val_loss: 0.0311284 | Time: 6048.58 ms [2022-04-18 10:09:47 main:574] : INFO : Epoch 1994 | loss: 0.031071 | val_loss: 0.0311299 | Time: 5518.45 ms [2022-04-18 10:09:53 main:574] : INFO : Epoch 1995 | loss: 0.0310722 | val_loss: 0.0311292 | Time: 6021.07 ms [2022-04-18 10:09:59 main:574] : INFO : Epoch 1996 | loss: 0.0310727 | val_loss: 0.0311337 | Time: 6248.76 ms [2022-04-18 10:10:06 main:574] : INFO : Epoch 1997 | loss: 0.0310805 | val_loss: 0.0311297 | Time: 6195.39 ms [2022-04-18 10:10:11 main:574] : INFO : Epoch 1998 | loss: 0.0310786 | val_loss: 0.0311305 | Time: 5513.39 ms [2022-04-18 10:10:17 main:574] : INFO : Epoch 1999 | loss: 0.0310798 | val_loss: 0.031157 | Time: 5969.85 ms [2022-04-18 10:10:22 main:574] : INFO : Epoch 2000 | loss: 0.0311912 | val_loss: 0.0312254 | Time: 5359.35 ms [2022-04-18 10:10:29 main:574] : INFO : Epoch 2001 | loss: 0.0312321 | val_loss: 0.0312454 | Time: 6198 ms [2022-04-18 10:10:34 main:574] : INFO : Epoch 2002 | loss: 0.0312362 | val_loss: 0.031227 | Time: 5544.07 ms [2022-04-18 10:10:40 main:574] : INFO : Epoch 2003 | loss: 0.0312261 | val_loss: 0.0312284 | Time: 5635.73 ms [2022-04-18 10:10:46 main:574] : INFO : Epoch 2004 | loss: 0.031221 | val_loss: 0.031222 | Time: 5895.22 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1060) [2022-04-18 12:07:27 main:435] : INFO : Set logging level to 1 [2022-04-18 12:07:27 main:441] : INFO : Running in BOINC Client mode [2022-04-18 12:07:27 main:444] : INFO : Resolving all filenames [2022-04-18 12:07:27 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-18 12:07:27 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-18 12:07:27 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-18 12:07:27 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-18 12:07:27 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-18 12:07:27 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-18 12:07:27 main:474] : INFO : Configuration: [2022-04-18 12:07:27 main:475] : INFO : Model type: GRU [2022-04-18 12:07:27 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-18 12:07:27 main:477] : INFO : Max Epochs: 2048 [2022-04-18 12:07:27 main:478] : INFO : Batch Size: 128 [2022-04-18 12:07:27 main:479] : INFO : Learning Rate: 0.01 [2022-04-18 12:07:27 main:480] : INFO : Patience: 10 [2022-04-18 12:07:27 main:481] : INFO : Hidden Width: 12 [2022-04-18 12:07:27 main:482] : INFO : # Recurrent Layers: 4 [2022-04-18 12:07:27 main:483] : INFO : # Backend Layers: 4 [2022-04-18 12:07:27 main:484] : INFO : # Threads: 1 [2022-04-18 12:07:27 main:486] : INFO : Preparing Dataset [2022-04-18 12:07:27 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-18 12:07:28 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-18 12:07:32 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-18 12:07:32 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-18 12:07:32 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-18 12:07:32 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-18 12:07:32 main:494] : INFO : Creating Model [2022-04-18 12:07:32 main:507] : INFO : Preparing config file [2022-04-18 12:07:32 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-18 12:07:32 main:512] : INFO : Loading config [2022-04-18 12:07:32 main:514] : INFO : Loading state [2022-04-18 12:07:34 main:559] : INFO : Loading DataLoader into Memory [2022-04-18 12:07:34 main:562] : INFO : Starting Training [2022-04-18 12:07:43 main:574] : INFO : Epoch 1972 | loss: 0.0311076 | val_loss: 0.0311375 | Time: 8853.13 ms [2022-04-18 12:07:52 main:574] : INFO : Epoch 1973 | loss: 0.0310803 | val_loss: 0.0311352 | Time: 8629.66 ms [2022-04-18 12:07:58 main:574] : INFO : Epoch 1974 | loss: 0.0310826 | val_loss: 0.0311456 | Time: 6711.03 ms [2022-04-18 12:08:03 main:574] : INFO : Epoch 1975 | loss: 0.031105 | val_loss: 0.031153 | Time: 5106.46 ms [2022-04-18 12:08:08 main:574] : INFO : Epoch 1976 | loss: 0.0311165 | val_loss: 0.031157 | Time: 4995.6 ms [2022-04-18 12:08:14 main:574] : INFO : Epoch 1977 | loss: 0.0311171 | val_loss: 0.0311536 | Time: 5281.25 ms [2022-04-18 12:08:19 main:574] : INFO : Epoch 1978 | loss: 0.0311161 | val_loss: 0.0311545 | Time: 5423.3 ms [2022-04-18 12:08:24 main:574] : INFO : Epoch 1979 | loss: 0.0311177 | val_loss: 0.0311523 | Time: 4910.42 ms [2022-04-18 12:08:29 main:574] : INFO : Epoch 1980 | loss: 0.0311177 | val_loss: 0.0311553 | Time: 5199.93 ms [2022-04-18 12:08:35 main:574] : INFO : Epoch 1981 | loss: 0.0311165 | val_loss: 0.0311574 | Time: 5300.12 ms [2022-04-18 12:08:39 main:574] : INFO : Epoch 1982 | loss: 0.0311173 | val_loss: 0.0311552 | Time: 4870.27 ms [2022-04-18 12:08:45 main:574] : INFO : Epoch 1983 | loss: 0.0311148 | val_loss: 0.0311565 | Time: 5069.47 ms [2022-04-18 12:08:50 main:574] : INFO : Epoch 1984 | loss: 0.0311156 | val_loss: 0.0311527 | Time: 5256.94 ms [2022-04-18 12:08:55 main:574] : INFO : Epoch 1985 | loss: 0.0311145 | val_loss: 0.0311495 | Time: 5387.95 ms [2022-04-18 12:09:00 main:574] : INFO : Epoch 1986 | loss: 0.0311157 | val_loss: 0.0311499 | Time: 5013.99 ms [2022-04-18 12:09:05 main:574] : INFO : Epoch 1987 | loss: 0.031115 | val_loss: 0.0311532 | Time: 4969.48 ms [2022-04-18 12:09:11 main:574] : INFO : Epoch 1988 | loss: 0.0311139 | val_loss: 0.0311518 | Time: 5545.39 ms [2022-04-18 12:09:16 main:574] : INFO : Epoch 1989 | loss: 0.0311141 | val_loss: 0.0311479 | Time: 4893.45 ms [2022-04-18 12:09:21 main:574] : INFO : Epoch 1990 | loss: 0.0311139 | val_loss: 0.0311489 | Time: 5020.84 ms [2022-04-18 12:09:27 main:574] : INFO : Epoch 1991 | loss: 0.0311147 | val_loss: 0.0311486 | Time: 5718.3 ms [2022-04-18 12:09:32 main:574] : INFO : Epoch 1992 | loss: 0.0311155 | val_loss: 0.0311499 | Time: 4952.89 ms [2022-04-18 12:09:36 main:574] : INFO : Epoch 1993 | loss: 0.0311145 | val_loss: 0.0311523 | Time: 4846.19 ms [2022-04-18 12:09:41 main:574] : INFO : Epoch 1994 | loss: 0.0311151 | val_loss: 0.0311521 | Time: 5005.85 ms [2022-04-18 12:09:47 main:574] : INFO : Epoch 1995 | loss: 0.0311162 | val_loss: 0.0311505 | Time: 5550.1 ms [2022-04-18 12:09:52 main:574] : INFO : Epoch 1996 | loss: 0.0311153 | val_loss: 0.0311494 | Time: 5153.68 ms [2022-04-18 12:09:57 main:574] : INFO : Epoch 1997 | loss: 0.0311134 | val_loss: 0.0311496 | Time: 5220.29 ms [2022-04-18 12:10:03 main:574] : INFO : Epoch 1998 | loss: 0.0311135 | val_loss: 0.031147 | Time: 5634.53 ms [2022-04-18 12:10:08 main:574] : INFO : Epoch 1999 | loss: 0.0311137 | val_loss: 0.0311483 | Time: 5091.61 ms [2022-04-18 12:10:13 main:574] : INFO : Epoch 2000 | loss: 0.0311138 | val_loss: 0.031152 | Time: 5046.8 ms [2022-04-18 12:10:19 main:574] : INFO : Epoch 2001 | loss: 0.031114 | val_loss: 0.0311514 | Time: 5525.87 ms [2022-04-18 12:10:24 main:574] : INFO : Epoch 2002 | loss: 0.031114 | val_loss: 0.0311494 | Time: 5139.34 ms [2022-04-18 12:10:29 main:574] : INFO : Epoch 2003 | loss: 0.0311155 | val_loss: 0.0311525 | Time: 4867.23 ms [2022-04-18 12:10:34 main:574] : INFO : Epoch 2004 | loss: 0.031116 | val_loss: 0.0311521 | Time: 5315.6 ms [2022-04-18 12:10:40 main:574] : INFO : Epoch 2005 | loss: 0.031114 | val_loss: 0.0311475 | Time: 5312.34 ms [2022-04-18 12:10:45 main:574] : INFO : Epoch 2006 | loss: 0.031115 | val_loss: 0.0311571 | Time: 5139.31 ms [2022-04-18 12:10:50 main:574] : INFO : Epoch 2007 | loss: 0.0311152 | val_loss: 0.0311492 | Time: 5089.14 ms [2022-04-18 12:10:55 main:574] : INFO : Epoch 2008 | loss: 0.0311138 | val_loss: 0.031147 | Time: 5565.8 ms [2022-04-18 12:11:00 main:574] : INFO : Epoch 2009 | loss: 0.0311136 | val_loss: 0.0311504 | Time: 5006.85 ms [2022-04-18 12:11:05 main:574] : INFO : Epoch 2010 | loss: 0.0311134 | val_loss: 0.0311467 | Time: 4957.46 ms [2022-04-18 12:11:11 main:574] : INFO : Epoch 2011 | loss: 0.0311141 | val_loss: 0.0311546 | Time: 5444.54 ms [2022-04-18 12:11:16 main:574] : INFO : Epoch 2012 | loss: 0.0311146 | val_loss: 0.0311512 | Time: 5211.01 ms [2022-04-18 12:11:21 main:574] : INFO : Epoch 2013 | loss: 0.0311137 | val_loss: 0.0311476 | Time: 5017.8 ms [2022-04-18 12:11:26 main:574] : INFO : Epoch 2014 | loss: 0.0311146 | val_loss: 0.0311538 | Time: 5092.86 ms [2022-04-18 12:11:32 main:574] : INFO : Epoch 2015 | loss: 0.0311152 | val_loss: 0.0311486 | Time: 5893.13 ms [2022-04-18 12:11:38 main:574] : INFO : Epoch 2016 | loss: 0.0311141 | val_loss: 0.0311519 | Time: 6020.55 ms [2022-04-18 12:11:45 main:574] : INFO : Epoch 2017 | loss: 0.0311144 | val_loss: 0.031152 | Time: 7128.7 ms [2022-04-18 12:11:51 main:574] : INFO : Epoch 2018 | loss: 0.0311145 | val_loss: 0.0311511 | Time: 5841.04 ms [2022-04-18 12:11:56 main:574] : INFO : Epoch 2019 | loss: 0.0311142 | val_loss: 0.0311523 | Time: 5152.64 ms [2022-04-18 12:12:04 main:574] : INFO : Epoch 2020 | loss: 0.0311144 | val_loss: 0.0311506 | Time: 7418.13 ms [2022-04-18 12:12:09 main:574] : INFO : Epoch 2021 | loss: 0.0311134 | val_loss: 0.0311486 | Time: 5676.67 ms [2022-04-18 12:12:16 main:574] : INFO : Epoch 2022 | loss: 0.0311131 | val_loss: 0.0311486 | Time: 6108.43 ms [2022-04-18 12:12:21 main:574] : INFO : Epoch 2023 | loss: 0.0311138 | val_loss: 0.0311506 | Time: 5640.48 ms [2022-04-18 12:12:27 main:574] : INFO : Epoch 2024 | loss: 0.0311141 | val_loss: 0.0311471 | Time: 5635.54 ms [2022-04-18 12:12:33 main:574] : INFO : Epoch 2025 | loss: 0.0311136 | val_loss: 0.0311492 | Time: 5816.21 ms [2022-04-18 12:12:39 main:574] : INFO : Epoch 2026 | loss: 0.0311146 | val_loss: 0.0311481 | Time: 6266.53 ms [2022-04-18 12:12:45 main:574] : INFO : Epoch 2027 | loss: 0.0311135 | val_loss: 0.0311509 | Time: 6037.12 ms [2022-04-18 12:12:50 main:574] : INFO : Epoch 2028 | loss: 0.0311136 | val_loss: 0.031147 | Time: 5470.64 ms [2022-04-18 12:12:57 main:574] : INFO : Epoch 2029 | loss: 0.0311138 | val_loss: 0.0311483 | Time: 7051.58 ms [2022-04-18 12:13:05 main:574] : INFO : Epoch 2030 | loss: 0.0311134 | val_loss: 0.0311488 | Time: 7357.25 ms [2022-04-18 12:13:10 main:574] : INFO : Epoch 2031 | loss: 0.0311148 | val_loss: 0.0311466 | Time: 4957.88 ms [2022-04-18 12:13:14 main:574] : INFO : Epoch 2032 | loss: 0.0311149 | val_loss: 0.0311521 | Time: 4478.28 ms [2022-04-18 12:13:19 main:574] : INFO : Epoch 2033 | loss: 0.0311142 | val_loss: 0.0311496 | Time: 4868.71 ms [2022-04-18 12:13:24 main:574] : INFO : Epoch 2034 | loss: 0.0311137 | val_loss: 0.0311493 | Time: 4666.48 ms [2022-04-18 12:13:29 main:574] : INFO : Epoch 2035 | loss: 0.031114 | val_loss: 0.0311487 | Time: 4784.01 ms [2022-04-18 12:13:34 main:574] : INFO : Epoch 2036 | loss: 0.0311156 | val_loss: 0.0311496 | Time: 5134.96 ms [2022-04-18 12:13:39 main:574] : INFO : Epoch 2037 | loss: 0.031114 | val_loss: 0.0311483 | Time: 4991.01 ms [2022-04-18 12:13:44 main:574] : INFO : Epoch 2038 | loss: 0.0311131 | val_loss: 0.0311475 | Time: 4817.05 ms [2022-04-18 12:13:48 main:574] : INFO : Epoch 2039 | loss: 0.0311148 | val_loss: 0.0311495 | Time: 4497.96 ms [2022-04-18 12:13:52 main:574] : INFO : Epoch 2040 | loss: 0.031115 | val_loss: 0.031148 | Time: 4321.87 ms [2022-04-18 12:13:57 main:574] : INFO : Epoch 2041 | loss: 0.0311139 | val_loss: 0.0311516 | Time: 4523.21 ms [2022-04-18 12:14:02 main:574] : INFO : Epoch 2042 | loss: 0.0311133 | val_loss: 0.0311512 | Time: 4546.35 ms [2022-04-18 12:14:06 main:574] : INFO : Epoch 2043 | loss: 0.0311154 | val_loss: 0.0311524 | Time: 4465.57 ms [2022-04-18 12:14:11 main:574] : INFO : Epoch 2044 | loss: 0.0311152 | val_loss: 0.0311529 | Time: 4506.14 ms [2022-04-18 12:14:15 main:574] : INFO : Epoch 2045 | loss: 0.0311143 | val_loss: 0.031149 | Time: 4628.8 ms [2022-04-18 12:14:20 main:574] : INFO : Epoch 2046 | loss: 0.0311151 | val_loss: 0.0311517 | Time: 4666.13 ms [2022-04-18 12:14:24 main:574] : INFO : Epoch 2047 | loss: 0.0311138 | val_loss: 0.0311484 | Time: 4492.33 ms [2022-04-18 12:14:29 main:574] : INFO : Epoch 2048 | loss: 0.0311132 | val_loss: 0.0311505 | Time: 4483.53 ms [2022-04-18 12:14:29 main:597] : INFO : Saving trained model to model-final.pt, val_loss 0.0311505 [2022-04-18 12:14:29 main:603] : INFO : Saving end state to config to file [2022-04-18 12:14:29 main:608] : INFO : Success, exiting.. 12:14:29 (6020): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)