Task 11355573
| Name | ParityModified-1639956412-12854-2-0_1 |
| Workunit | 8174093 |
| Created | 4 Feb 2022, 22:38:49 UTC |
| Sent | 4 Feb 2022, 23:30:17 UTC |
| Report deadline | 12 Feb 2022, 23:30:17 UTC |
| Received | 7 Feb 2022, 14:04:01 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 18852 |
| Run time | 1 hours 49 min 24 sec |
| CPU time | 1 hours 44 min 9 sec |
| Validate state | Valid |
| Credit | 4,160.00 |
| Device peak FLOPS | 2,823.40 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 2.08 GB |
| Peak swap size | 4.29 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version> <![CDATA[ <stderr_txt> examples into memory. [2022-02-06 18:55:10 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-06 18:55:10 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-06 18:55:10 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-06 18:55:10 main:494] : INFO : Creating Model [2022-02-06 18:55:10 main:507] : INFO : Preparing config file [2022-02-06 18:55:10 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-06 18:55:10 main:512] : INFO : Loading config [2022-02-06 18:55:10 main:514] : INFO : Loading state [2022-02-06 18:55:11 main:559] : INFO : Loading DataLoader into Memory [2022-02-06 18:55:11 main:562] : INFO : Starting Training [2022-02-06 18:55:14 main:574] : INFO : Epoch 1644 | loss: 0.0311186 | val_loss: 0.0312037 | Time: 3245.81 ms [2022-02-06 18:55:17 main:574] : INFO : Epoch 1645 | loss: 0.0310817 | val_loss: 0.0312085 | Time: 3084.91 ms [2022-02-06 18:55:20 main:574] : INFO : Epoch 1646 | loss: 0.0310818 | val_loss: 0.0312064 | Time: 3082.07 ms [2022-02-06 18:55:24 main:574] : INFO : Epoch 1647 | loss: 0.0310842 | val_loss: 0.0311889 | Time: 3232.49 ms [2022-02-06 18:55:27 main:574] : INFO : Epoch 1648 | loss: 0.0310841 | val_loss: 0.0311987 | Time: 3077.08 ms [2022-02-06 18:55:30 main:574] : INFO : Epoch 1649 | loss: 0.0310825 | val_loss: 0.0312041 | Time: 3238.7 ms [2022-02-06 18:55:33 main:574] : INFO : Epoch 1650 | loss: 0.0310844 | val_loss: 0.0312082 | Time: 3095.84 ms [2022-02-06 18:55:36 main:574] : INFO : Epoch 1651 | loss: 0.0310892 | val_loss: 0.0311903 | Time: 3235.65 ms [2022-02-06 18:55:39 main:574] : INFO : Epoch 1652 | loss: 0.0310949 | val_loss: 0.0311941 | Time: 3080.76 ms [2022-02-06 18:55:43 main:574] : INFO : Epoch 1653 | loss: 0.0310903 | val_loss: 0.0312022 | Time: 3248.73 ms [2022-02-06 18:55:46 main:574] : INFO : Epoch 1654 | loss: 0.0310872 | val_loss: 0.0312093 | Time: 3095.71 ms [2022-02-06 18:55:49 main:574] : INFO : Epoch 1655 | loss: 0.0310805 | val_loss: 0.031206 | Time: 3089.68 ms [2022-02-06 18:55:52 main:574] : INFO : Epoch 1656 | loss: 0.0310882 | val_loss: 0.0311834 | Time: 3181.12 ms [2022-02-06 18:55:55 main:574] : INFO : Epoch 1657 | loss: 0.0310905 | val_loss: 0.0312128 | Time: 3011.06 ms [2022-02-06 18:55:58 main:574] : INFO : Epoch 1658 | loss: 0.0310843 | val_loss: 0.0311892 | Time: 3245.12 ms [2022-02-06 18:56:01 main:574] : INFO : Epoch 1659 | loss: 0.0310882 | val_loss: 0.0311959 | Time: 3038.24 ms [2022-02-06 18:56:04 main:574] : INFO : Epoch 1660 | loss: 0.031081 | val_loss: 0.0311873 | Time: 3253.25 ms [2022-02-06 18:56:08 main:574] : INFO : Epoch 1661 | loss: 0.0310968 | val_loss: 0.0311909 | Time: 3079.87 ms [2022-02-06 18:56:11 main:574] : INFO : Epoch 1662 | loss: 0.031092 | val_loss: 0.0311982 | Time: 3198.67 ms [2022-02-06 18:56:14 main:574] : INFO : Epoch 1663 | loss: 0.0310857 | val_loss: 0.0311965 | Time: 3100.37 ms [2022-02-06 18:56:17 main:574] : INFO : Epoch 1664 | loss: 0.0310841 | val_loss: 0.0311971 | Time: 3199.49 ms [2022-02-06 18:56:20 main:574] : INFO : Epoch 1665 | loss: 0.0310925 | val_loss: 0.0311874 | Time: 3138.06 ms [2022-02-06 18:56:23 main:574] : INFO : Epoch 1666 | loss: 0.0310934 | val_loss: 0.0311949 | Time: 3235.39 ms [2022-02-06 18:56:27 main:574] : INFO : Epoch 1667 | loss: 0.031087 | val_loss: 0.0311973 | Time: 3103.81 ms [2022-02-06 18:56:30 main:574] : INFO : Epoch 1668 | loss: 0.0310824 | val_loss: 0.0311929 | Time: 3257.6 ms [2022-02-06 18:56:33 main:574] : INFO : Epoch 1669 | loss: 0.0310781 | val_loss: 0.0311984 | Time: 3069.79 ms [2022-02-06 18:56:36 main:574] : INFO : Epoch 1670 | loss: 0.0310786 | val_loss: 0.0311995 | Time: 3226.5 ms [2022-02-06 18:56:39 main:574] : INFO : Epoch 1671 | loss: 0.0310788 | val_loss: 0.0312012 | Time: 3116.9 ms [2022-02-06 18:56:42 main:574] : INFO : Epoch 1672 | loss: 0.0310759 | val_loss: 0.0312084 | Time: 3137.95 ms [2022-02-06 18:56:46 main:574] : INFO : Epoch 1673 | loss: 0.0310893 | val_loss: 0.0311956 | Time: 3214.94 ms [2022-02-06 18:56:49 main:574] : INFO : Epoch 1674 | loss: 0.0310861 | val_loss: 0.031205 | Time: 3049.73 ms [2022-02-06 18:56:52 main:574] : INFO : Epoch 1675 | loss: 0.0310812 | val_loss: 0.0311999 | Time: 3251.63 ms [2022-02-06 18:56:55 main:574] : INFO : Epoch 1676 | loss: 0.0310825 | val_loss: 0.0311942 | Time: 3056.53 ms [2022-02-06 18:56:58 main:574] : INFO : Epoch 1677 | loss: 0.0310776 | val_loss: 0.0312168 | Time: 3255.55 ms [2022-02-06 18:57:01 main:574] : INFO : Epoch 1678 | loss: 0.0310781 | val_loss: 0.0311966 | Time: 3054.25 ms [2022-02-06 18:57:05 main:574] : INFO : Epoch 1679 | loss: 0.0310746 | val_loss: 0.0311984 | Time: 3282.07 ms [2022-02-06 18:57:08 main:574] : INFO : Epoch 1680 | loss: 0.0310735 | val_loss: 0.0312066 | Time: 3075.86 ms [2022-02-06 18:57:11 main:574] : INFO : Epoch 1681 | loss: 0.0310801 | val_loss: 0.0311963 | Time: 3329.76 ms [2022-02-06 18:57:15 main:574] : INFO : Epoch 1682 | loss: 0.0310902 | val_loss: 0.0311962 | Time: 3800.29 ms [2022-02-06 18:57:18 main:574] : INFO : Epoch 1683 | loss: 0.0310942 | val_loss: 0.0312049 | Time: 3382.88 ms [2022-02-06 18:57:21 main:574] : INFO : Epoch 1684 | loss: 0.0310926 | val_loss: 0.0311821 | Time: 3043.71 ms [2022-02-06 18:57:24 main:574] : INFO : Epoch 1685 | loss: 0.0310973 | val_loss: 0.0312001 | Time: 3207.54 ms [2022-02-06 18:57:27 main:574] : INFO : Epoch 1686 | loss: 0.0310969 | val_loss: 0.0311888 | Time: 3047.9 ms [2022-02-06 18:57:31 main:574] : INFO : Epoch 1687 | loss: 0.0311037 | val_loss: 0.0312003 | Time: 3275.79 ms [2022-02-06 18:57:34 main:574] : INFO : Epoch 1688 | loss: 0.0311131 | val_loss: 0.0311871 | Time: 3071.6 ms [2022-02-06 18:57:37 main:574] : INFO : Epoch 1689 | loss: 0.0310972 | val_loss: 0.0311954 | Time: 3254.07 ms [2022-02-06 18:57:40 main:574] : INFO : Epoch 1690 | loss: 0.0310915 | val_loss: 0.031184 | Time: 3066.25 ms [2022-02-06 18:57:43 main:574] : INFO : Epoch 1691 | loss: 0.0310878 | val_loss: 0.0312017 | Time: 3344.37 ms [2022-02-06 18:57:47 main:574] : INFO : Epoch 1692 | loss: 0.0310828 | val_loss: 0.031199 | Time: 3075.68 ms [2022-02-06 18:57:50 main:574] : INFO : Epoch 1693 | loss: 0.0310807 | val_loss: 0.0311982 | Time: 3180.1 ms [2022-02-06 18:57:53 main:574] : INFO : Epoch 1694 | loss: 0.0310768 | val_loss: 0.0312141 | Time: 3090.48 ms [2022-02-06 18:57:56 main:574] : INFO : Epoch 1695 | loss: 0.0310783 | val_loss: 0.0312084 | Time: 3116.62 ms [2022-02-06 18:57:59 main:574] : INFO : Epoch 1696 | loss: 0.0310777 | val_loss: 0.0312075 | Time: 3088.07 ms [2022-02-06 18:58:02 main:574] : INFO : Epoch 1697 | loss: 0.0310776 | val_loss: 0.0312045 | Time: 3095.67 ms [2022-02-06 18:58:05 main:574] : INFO : Epoch 1698 | loss: 0.0310781 | val_loss: 0.0312088 | Time: 3275.15 ms [2022-02-06 18:58:08 main:574] : INFO : Epoch 1699 | loss: 0.0311056 | val_loss: 0.0312225 | Time: 3054.26 ms [2022-02-06 18:58:12 main:574] : INFO : Epoch 1700 | loss: 0.03121 | val_loss: 0.0312384 | Time: 3420.39 ms [2022-02-06 18:58:16 main:574] : INFO : Epoch 1701 | loss: 0.0311913 | val_loss: 0.0311891 | Time: 3626.04 ms [2022-02-06 18:58:19 main:574] : INFO : Epoch 1702 | loss: 0.0311744 | val_loss: 0.0311836 | Time: 3200.74 ms [2022-02-06 18:58:22 main:574] : INFO : Epoch 1703 | loss: 0.0311653 | val_loss: 0.0311771 | Time: 3054.72 ms [2022-02-06 18:58:25 main:574] : INFO : Epoch 1704 | loss: 0.0311598 | val_loss: 0.0311743 | Time: 3255.17 ms [2022-02-06 18:58:28 main:574] : INFO : Epoch 1705 | loss: 0.0311555 | val_loss: 0.0311795 | Time: 3106.54 ms [2022-02-06 18:58:31 main:574] : INFO : Epoch 1706 | loss: 0.0311528 | val_loss: 0.0311747 | Time: 3254.22 ms [2022-02-06 18:58:35 main:574] : INFO : Epoch 1707 | loss: 0.0311487 | val_loss: 0.031173 | Time: 3107.81 ms [2022-02-06 18:58:38 main:574] : INFO : Epoch 1708 | loss: 0.031146 | val_loss: 0.0311737 | Time: 3304.61 ms [2022-02-06 18:58:41 main:574] : INFO : Epoch 1709 | loss: 0.0311436 | val_loss: 0.0311746 | Time: 3047.33 ms [2022-02-06 18:58:44 main:574] : INFO : Epoch 1710 | loss: 0.0311424 | val_loss: 0.0311769 | Time: 3271.78 ms [2022-02-06 18:58:47 main:574] : INFO : Epoch 1711 | loss: 0.0311406 | val_loss: 0.0311735 | Time: 3060.28 ms [2022-02-06 18:58:50 main:574] : INFO : Epoch 1712 | loss: 0.031138 | val_loss: 0.0311788 | Time: 3232.54 ms [2022-02-06 18:58:54 main:574] : INFO : Epoch 1713 | loss: 0.0311374 | val_loss: 0.031174 | Time: 3078.52 ms [2022-02-06 18:58:57 main:574] : INFO : Epoch 1714 | loss: 0.0311369 | val_loss: 0.0311761 | Time: 3250.52 ms [2022-02-06 18:59:00 main:574] : INFO : Epoch 1715 | loss: 0.0311386 | val_loss: 0.0311689 | Time: 3036.64 ms [2022-02-06 18:59:03 main:574] : INFO : Epoch 1716 | loss: 0.0311357 | val_loss: 0.0311775 | Time: 3269.14 ms [2022-02-06 18:59:06 main:574] : INFO : Epoch 1717 | loss: 0.0311305 | val_loss: 0.0311752 | Time: 3105.59 ms [2022-02-06 18:59:09 main:574] : INFO : Epoch 1718 | loss: 0.0311328 | val_loss: 0.0311751 | Time: 3114.76 ms [2022-02-06 18:59:13 main:574] : INFO : Epoch 1719 | loss: 0.0311316 | val_loss: 0.0311759 | Time: 3424.48 ms [2022-02-06 18:59:16 main:574] : INFO : Epoch 1720 | loss: 0.03113 | val_loss: 0.0311764 | Time: 3623.23 ms [2022-02-06 18:59:20 main:574] : INFO : Epoch 1721 | loss: 0.0311272 | val_loss: 0.0311777 | Time: 3148.86 ms [2022-02-06 18:59:23 main:574] : INFO : Epoch 1722 | loss: 0.0311273 | val_loss: 0.0311733 | Time: 3057.29 ms [2022-02-06 18:59:26 main:574] : INFO : Epoch 1723 | loss: 0.0311253 | val_loss: 0.0311783 | Time: 3232.45 ms [2022-02-06 18:59:29 main:574] : INFO : Epoch 1724 | loss: 0.0311246 | val_loss: 0.0311755 | Time: 3034.22 ms [2022-02-06 18:59:32 main:574] : INFO : Epoch 1725 | loss: 0.0311223 | val_loss: 0.0311841 | Time: 3165.18 ms [2022-02-06 18:59:35 main:574] : INFO : Epoch 1726 | loss: 0.0311267 | val_loss: 0.031174 | Time: 3043.43 ms [2022-02-06 18:59:38 main:574] : INFO : Epoch 1727 | loss: 0.0311405 | val_loss: 0.0311759 | Time: 3274.25 ms [2022-02-06 18:59:42 main:574] : INFO : Epoch 1728 | loss: 0.0311399 | val_loss: 0.0311709 | Time: 3185.56 ms [2022-02-06 18:59:45 main:574] : INFO : Epoch 1729 | loss: 0.0311413 | val_loss: 0.0311672 | Time: 3355.68 ms [2022-02-06 18:59:48 main:574] : INFO : Epoch 1730 | loss: 0.0311374 | val_loss: 0.0311681 | Time: 3111.71 ms [2022-02-06 18:59:51 main:574] : INFO : Epoch 1731 | loss: 0.0311363 | val_loss: 0.031166 | Time: 3298.68 ms [2022-02-06 18:59:54 main:574] : INFO : Epoch 1732 | loss: 0.0311322 | val_loss: 0.0311827 | Time: 3078.16 ms [2022-02-06 18:59:58 main:574] : INFO : Epoch 1733 | loss: 0.0311314 | val_loss: 0.0311707 | Time: 3343.46 ms [2022-02-06 19:00:01 main:574] : INFO : Epoch 1734 | loss: 0.0311257 | val_loss: 0.0311699 | Time: 3131.2 ms [2022-02-06 19:00:04 main:574] : INFO : Epoch 1735 | loss: 0.0311267 | val_loss: 0.0311753 | Time: 3216.29 ms [2022-02-06 19:00:07 main:574] : INFO : Epoch 1736 | loss: 0.031127 | val_loss: 0.0311716 | Time: 3048.76 ms [2022-02-06 19:00:10 main:574] : INFO : Epoch 1737 | loss: 0.0311279 | val_loss: 0.0311751 | Time: 3235.26 ms [2022-02-06 19:00:14 main:574] : INFO : Epoch 1738 | loss: 0.0311265 | val_loss: 0.031182 | Time: 3570.91 ms [2022-02-06 19:00:18 main:574] : INFO : Epoch 1739 | loss: 0.0311265 | val_loss: 0.0311735 | Time: 3960.88 ms [2022-02-06 19:00:21 main:574] : INFO : Epoch 1740 | loss: 0.0311261 | val_loss: 0.0311778 | Time: 3119.67 ms [2022-02-06 19:00:24 main:574] : INFO : Epoch 1741 | loss: 0.0311309 | val_loss: 0.0311793 | Time: 3306.91 ms [2022-02-06 19:00:27 main:574] : INFO : Epoch 1742 | loss: 0.031126 | val_loss: 0.0311692 | Time: 3075.76 ms [2022-02-06 19:00:31 main:574] : INFO : Epoch 1743 | loss: 0.0311245 | val_loss: 0.0311755 | Time: 3358.61 ms [2022-02-06 19:00:34 main:574] : INFO : Epoch 1744 | loss: 0.0311191 | val_loss: 0.0311738 | Time: 3144.74 ms [2022-02-06 19:00:37 main:574] : INFO : Epoch 1745 | loss: 0.0311176 | val_loss: 0.03118 | Time: 3329.55 ms [2022-02-06 19:00:40 main:574] : INFO : Epoch 1746 | loss: 0.0311199 | val_loss: 0.0311777 | Time: 3146.9 ms [2022-02-06 19:00:44 main:574] : INFO : Epoch 1747 | loss: 0.0311172 | val_loss: 0.0311871 | Time: 3347.84 ms [2022-02-06 19:00:47 main:574] : INFO : Epoch 1748 | loss: 0.0311186 | val_loss: 0.031175 | Time: 3085.34 ms [2022-02-06 19:00:50 main:574] : INFO : Epoch 1749 | loss: 0.0311182 | val_loss: 0.0311738 | Time: 3354.54 ms [2022-02-06 19:00:53 main:574] : INFO : Epoch 1750 | loss: 0.0311192 | val_loss: 0.0311766 | Time: 3213.73 ms [2022-02-06 19:00:57 main:574] : INFO : Epoch 1751 | loss: 0.0311211 | val_loss: 0.0311783 | Time: 3223.7 ms [2022-02-06 19:01:00 main:574] : INFO : Epoch 1752 | loss: 0.0311256 | val_loss: 0.0311761 | Time: 3187.2 ms [2022-02-06 19:01:03 main:574] : INFO : Epoch 1753 | loss: 0.0311226 | val_loss: 0.0311705 | Time: 3235.23 ms [2022-02-06 19:01:06 main:574] : INFO : Epoch 1754 | loss: 0.0311243 | val_loss: 0.0311724 | Time: 3208.46 ms [2022-02-06 19:01:09 main:574] : INFO : Epoch 1755 | loss: 0.0311245 | val_loss: 0.0311742 | Time: 3095.66 ms [2022-02-06 19:01:13 main:574] : INFO : Epoch 1756 | loss: 0.0311241 | val_loss: 0.0311836 | Time: 3316.89 ms [2022-02-06 19:01:17 main:574] : INFO : Epoch 1757 | loss: 0.0311185 | val_loss: 0.0311839 | Time: 4382.97 ms [2022-02-06 19:01:20 main:574] : INFO : Epoch 1758 | loss: 0.0311185 | val_loss: 0.0311761 | Time: 3221.74 ms [2022-02-06 19:01:24 main:574] : INFO : Epoch 1759 | loss: 0.0311142 | val_loss: 0.0311871 | Time: 3375.69 ms [2022-02-06 19:01:27 main:574] : INFO : Epoch 1760 | loss: 0.0311099 | val_loss: 0.0311822 | Time: 3103.66 ms [2022-02-06 19:01:30 main:574] : INFO : Epoch 1761 | loss: 0.0311126 | val_loss: 0.0311825 | Time: 3327.07 ms [2022-02-06 19:01:33 main:574] : INFO : Epoch 1762 | loss: 0.0311146 | val_loss: 0.0311837 | Time: 3231.03 ms [2022-02-06 19:01:37 main:574] : INFO : Epoch 1763 | loss: 0.0311164 | val_loss: 0.031192 | Time: 3363.43 ms [2022-02-06 19:01:40 main:574] : INFO : Epoch 1764 | loss: 0.0311235 | val_loss: 0.0311777 | Time: 3249.48 ms [2022-02-06 19:01:43 main:574] : INFO : Epoch 1765 | loss: 0.0311187 | val_loss: 0.0311821 | Time: 3237.68 ms [2022-02-06 19:01:47 main:574] : INFO : Epoch 1766 | loss: 0.0311119 | val_loss: 0.0311796 | Time: 3282.94 ms [2022-02-06 19:01:50 main:574] : INFO : Epoch 1767 | loss: 0.0311122 | val_loss: 0.03118 | Time: 3255.83 ms [2022-02-06 19:01:53 main:574] : INFO : Epoch 1768 | loss: 0.0311113 | val_loss: 0.0311749 | Time: 3329.23 ms [2022-02-06 19:01:56 main:574] : INFO : Epoch 1769 | loss: 0.0311067 | val_loss: 0.0312004 | Time: 3236.9 ms [2022-02-06 19:02:00 main:574] : INFO : Epoch 1770 | loss: 0.0311054 | val_loss: 0.031192 | Time: 3364.27 ms [2022-02-06 19:02:03 main:574] : INFO : Epoch 1771 | loss: 0.0311075 | val_loss: 0.0311846 | Time: 3113.5 ms [2022-02-06 19:02:06 main:574] : INFO : Epoch 1772 | loss: 0.0311056 | val_loss: 0.031185 | Time: 3381.32 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce MX450) [2022-02-07 03:30:33 main:435] : INFO : Set logging level to 1 [2022-02-07 03:30:33 main:441] : INFO : Running in BOINC Client mode [2022-02-07 03:30:33 main:444] : INFO : Resolving all filenames [2022-02-07 03:30:33 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-07 03:30:33 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-07 03:30:33 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-07 03:30:33 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-07 03:30:33 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-07 03:30:33 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-07 03:30:33 main:474] : INFO : Configuration: [2022-02-07 03:30:33 main:475] : INFO : Model type: GRU [2022-02-07 03:30:33 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-07 03:30:33 main:477] : INFO : Max Epochs: 2048 [2022-02-07 03:30:33 main:478] : INFO : Batch Size: 128 [2022-02-07 03:30:33 main:479] : INFO : Learning Rate: 0.01 [2022-02-07 03:30:33 main:480] : INFO : Patience: 10 [2022-02-07 03:30:33 main:481] : INFO : Hidden Width: 12 [2022-02-07 03:30:33 main:482] : INFO : # Recurrent Layers: 4 [2022-02-07 03:30:33 main:483] : INFO : # Backend Layers: 4 [2022-02-07 03:30:33 main:484] : INFO : # Threads: 1 [2022-02-07 03:30:33 main:486] : INFO : Preparing Dataset [2022-02-07 03:30:33 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-07 03:30:33 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-07 03:30:34 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-07 03:30:34 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-07 03:30:34 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-07 03:30:34 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-07 03:30:34 main:494] : INFO : Creating Model [2022-02-07 03:30:34 main:507] : INFO : Preparing config file [2022-02-07 03:30:34 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-07 03:30:34 main:512] : INFO : Loading config [2022-02-07 03:30:34 main:514] : INFO : Loading state [2022-02-07 03:30:35 main:559] : INFO : Loading DataLoader into Memory [2022-02-07 03:30:35 main:562] : INFO : Starting Training [2022-02-07 03:30:38 main:574] : INFO : Epoch 1767 | loss: 0.0311519 | val_loss: 0.0311788 | Time: 3094.36 ms [2022-02-07 03:30:41 main:574] : INFO : Epoch 1768 | loss: 0.0311194 | val_loss: 0.0311874 | Time: 2846.6 ms [2022-02-07 03:30:44 main:574] : INFO : Epoch 1769 | loss: 0.0311136 | val_loss: 0.0311783 | Time: 3278.99 ms [2022-02-07 03:30:47 main:574] : INFO : Epoch 1770 | loss: 0.031119 | val_loss: 0.031179 | Time: 3011.03 ms [2022-02-07 03:30:51 main:574] : INFO : Epoch 1771 | loss: 0.0311147 | val_loss: 0.0311772 | Time: 3117.28 ms [2022-02-07 03:30:54 main:574] : INFO : Epoch 1772 | loss: 0.0311139 | val_loss: 0.0311799 | Time: 3122.17 ms [2022-02-07 03:30:57 main:574] : INFO : Epoch 1773 | loss: 0.0311114 | val_loss: 0.0311867 | Time: 3020.56 ms [2022-02-07 03:31:00 main:574] : INFO : Epoch 1774 | loss: 0.0311114 | val_loss: 0.0311731 | Time: 3264.39 ms [2022-02-07 03:31:03 main:574] : INFO : Epoch 1775 | loss: 0.03111 | val_loss: 0.0311856 | Time: 3020.02 ms [2022-02-07 03:31:06 main:574] : INFO : Epoch 1776 | loss: 0.0311069 | val_loss: 0.0311868 | Time: 3257.68 ms [2022-02-07 03:31:09 main:574] : INFO : Epoch 1777 | loss: 0.0311046 | val_loss: 0.0311767 | Time: 3044.81 ms [2022-02-07 03:31:13 main:574] : INFO : Epoch 1778 | loss: 0.0311133 | val_loss: 0.0311706 | Time: 3241.37 ms [2022-02-07 03:31:15 main:574] : INFO : Epoch 1779 | loss: 0.0311132 | val_loss: 0.031182 | Time: 2968.93 ms [2022-02-07 03:31:19 main:574] : INFO : Epoch 1780 | loss: 0.0311054 | val_loss: 0.0311866 | Time: 3171.19 ms [2022-02-07 03:31:22 main:574] : INFO : Epoch 1781 | loss: 0.0311071 | val_loss: 0.0311833 | Time: 2932.56 ms [2022-02-07 03:31:25 main:574] : INFO : Epoch 1782 | loss: 0.0311162 | val_loss: 0.0311738 | Time: 3176.55 ms [2022-02-07 03:31:28 main:574] : INFO : Epoch 1783 | loss: 0.03111 | val_loss: 0.0311793 | Time: 2992.98 ms [2022-02-07 03:31:31 main:574] : INFO : Epoch 1784 | loss: 0.0311044 | val_loss: 0.0311796 | Time: 3162.8 ms [2022-02-07 03:31:34 main:574] : INFO : Epoch 1785 | loss: 0.0311035 | val_loss: 0.0311876 | Time: 3522.44 ms [2022-02-07 03:31:38 main:574] : INFO : Epoch 1786 | loss: 0.03111 | val_loss: 0.0311764 | Time: 3844.47 ms [2022-02-07 03:31:41 main:574] : INFO : Epoch 1787 | loss: 0.0311232 | val_loss: 0.0311808 | Time: 3009.06 ms [2022-02-07 03:31:45 main:574] : INFO : Epoch 1788 | loss: 0.0311344 | val_loss: 0.0311647 | Time: 3283.76 ms [2022-02-07 03:31:48 main:574] : INFO : Epoch 1789 | loss: 0.0311254 | val_loss: 0.0311679 | Time: 3018.37 ms [2022-02-07 03:31:51 main:574] : INFO : Epoch 1790 | loss: 0.0311246 | val_loss: 0.0311695 | Time: 3089.96 ms [2022-02-07 03:31:54 main:574] : INFO : Epoch 1791 | loss: 0.0311323 | val_loss: 0.0311696 | Time: 3044.1 ms [2022-02-07 03:31:57 main:574] : INFO : Epoch 1792 | loss: 0.0311268 | val_loss: 0.0311687 | Time: 2997.59 ms [2022-02-07 03:32:00 main:574] : INFO : Epoch 1793 | loss: 0.0311226 | val_loss: 0.0311679 | Time: 3227.38 ms [2022-02-07 03:32:03 main:574] : INFO : Epoch 1794 | loss: 0.0311198 | val_loss: 0.0311698 | Time: 2946.67 ms [2022-02-07 03:32:06 main:574] : INFO : Epoch 1795 | loss: 0.0311137 | val_loss: 0.031176 | Time: 3258.57 ms [2022-02-07 03:32:09 main:574] : INFO : Epoch 1796 | loss: 0.0311121 | val_loss: 0.0311717 | Time: 3060.81 ms [2022-02-07 03:32:12 main:574] : INFO : Epoch 1797 | loss: 0.0311096 | val_loss: 0.031174 | Time: 3212.01 ms [2022-02-07 03:32:15 main:574] : INFO : Epoch 1798 | loss: 0.031116 | val_loss: 0.0311797 | Time: 3000.3 ms [2022-02-07 03:32:19 main:574] : INFO : Epoch 1799 | loss: 0.0311108 | val_loss: 0.0311726 | Time: 3151.7 ms [2022-02-07 03:32:22 main:574] : INFO : Epoch 1800 | loss: 0.0311148 | val_loss: 0.0311814 | Time: 2919.85 ms [2022-02-07 03:32:25 main:574] : INFO : Epoch 1801 | loss: 0.0311141 | val_loss: 0.0311834 | Time: 3207 ms [2022-02-07 03:32:28 main:574] : INFO : Epoch 1802 | loss: 0.0311072 | val_loss: 0.0311802 | Time: 3007.12 ms [2022-02-07 03:32:31 main:574] : INFO : Epoch 1803 | loss: 0.0311037 | val_loss: 0.0311811 | Time: 3111.21 ms [2022-02-07 03:32:34 main:574] : INFO : Epoch 1804 | loss: 0.0311022 | val_loss: 0.0311851 | Time: 3207.77 ms [2022-02-07 03:32:38 main:574] : INFO : Epoch 1805 | loss: 0.0310987 | val_loss: 0.0311809 | Time: 3935.09 ms [2022-02-07 03:32:41 main:574] : INFO : Epoch 1806 | loss: 0.0310995 | val_loss: 0.0311795 | Time: 2936.98 ms [2022-02-07 03:32:44 main:574] : INFO : Epoch 1807 | loss: 0.0311021 | val_loss: 0.0311729 | Time: 3061.14 ms [2022-02-07 03:32:47 main:574] : INFO : Epoch 1808 | loss: 0.0311038 | val_loss: 0.0311807 | Time: 3164.2 ms [2022-02-07 03:32:50 main:574] : INFO : Epoch 1809 | loss: 0.0310978 | val_loss: 0.0311873 | Time: 2897.64 ms [2022-02-07 03:32:53 main:574] : INFO : Epoch 1810 | loss: 0.0310983 | val_loss: 0.031182 | Time: 3284.35 ms [2022-02-07 03:32:56 main:574] : INFO : Epoch 1811 | loss: 0.0310995 | val_loss: 0.0311895 | Time: 2965.15 ms [2022-02-07 03:33:00 main:574] : INFO : Epoch 1812 | loss: 0.0310991 | val_loss: 0.0311818 | Time: 3175.56 ms [2022-02-07 03:33:03 main:574] : INFO : Epoch 1813 | loss: 0.0311005 | val_loss: 0.0311823 | Time: 3025.2 ms [2022-02-07 03:33:06 main:574] : INFO : Epoch 1814 | loss: 0.0311102 | val_loss: 0.0311771 | Time: 3222.03 ms [2022-02-07 03:33:09 main:574] : INFO : Epoch 1815 | loss: 0.0311065 | val_loss: 0.03118 | Time: 2977.74 ms [2022-02-07 03:33:12 main:574] : INFO : Epoch 1816 | loss: 0.0311035 | val_loss: 0.0311835 | Time: 3290.12 ms [2022-02-07 03:33:15 main:574] : INFO : Epoch 1817 | loss: 0.0311127 | val_loss: 0.0311817 | Time: 2992.85 ms [2022-02-07 03:33:18 main:574] : INFO : Epoch 1818 | loss: 0.0311074 | val_loss: 0.0311777 | Time: 3215.9 ms [2022-02-07 03:33:21 main:574] : INFO : Epoch 1819 | loss: 0.031107 | val_loss: 0.031184 | Time: 2987.89 ms [2022-02-07 03:33:24 main:574] : INFO : Epoch 1820 | loss: 0.0311049 | val_loss: 0.0311833 | Time: 3153.41 ms [2022-02-07 03:33:28 main:574] : INFO : Epoch 1821 | loss: 0.0311042 | val_loss: 0.0311876 | Time: 3046.81 ms [2022-02-07 03:33:31 main:574] : INFO : Epoch 1822 | loss: 0.0310973 | val_loss: 0.0311871 | Time: 3032.09 ms [2022-02-07 03:33:34 main:574] : INFO : Epoch 1823 | loss: 0.0311022 | val_loss: 0.0311846 | Time: 3296.03 ms [2022-02-07 03:33:38 main:574] : INFO : Epoch 1824 | loss: 0.03111 | val_loss: 0.0311925 | Time: 3981.79 ms [2022-02-07 03:33:41 main:574] : INFO : Epoch 1825 | loss: 0.0311046 | val_loss: 0.0311781 | Time: 3031.06 ms [2022-02-07 03:33:44 main:574] : INFO : Epoch 1826 | loss: 0.0311059 | val_loss: 0.0311843 | Time: 3025.86 ms [2022-02-07 03:33:47 main:574] : INFO : Epoch 1827 | loss: 0.0311074 | val_loss: 0.0311828 | Time: 3280.34 ms [2022-02-07 03:33:51 main:574] : INFO : Epoch 1828 | loss: 0.0311114 | val_loss: 0.0311845 | Time: 3771.11 ms [2022-02-07 03:33:55 main:574] : INFO : Epoch 1829 | loss: 0.0311081 | val_loss: 0.0311747 | Time: 4511.07 ms [2022-02-07 03:34:00 main:574] : INFO : Epoch 1830 | loss: 0.0311123 | val_loss: 0.0311816 | Time: 4946.85 ms [2022-02-07 03:34:05 main:574] : INFO : Epoch 1831 | loss: 0.0311138 | val_loss: 0.0311823 | Time: 4820.53 ms [2022-02-07 03:34:10 main:574] : INFO : Epoch 1832 | loss: 0.0311112 | val_loss: 0.0311818 | Time: 4950.03 ms [2022-02-07 03:34:15 main:574] : INFO : Epoch 1833 | loss: 0.0311101 | val_loss: 0.0311853 | Time: 4609.23 ms [2022-02-07 03:34:19 main:574] : INFO : Epoch 1834 | loss: 0.0311083 | val_loss: 0.0311782 | Time: 4047.23 ms [2022-02-07 03:34:23 main:574] : INFO : Epoch 1835 | loss: 0.0311014 | val_loss: 0.031179 | Time: 3960.12 ms [2022-02-07 03:34:27 main:574] : INFO : Epoch 1836 | loss: 0.0310989 | val_loss: 0.0311898 | Time: 3990.1 ms [2022-02-07 03:34:31 main:574] : INFO : Epoch 1837 | loss: 0.0311316 | val_loss: 0.0311765 | Time: 3936.53 ms [2022-02-07 03:34:34 main:574] : INFO : Epoch 1838 | loss: 0.0311382 | val_loss: 0.0311785 | Time: 3425.39 ms [2022-02-07 03:34:38 main:574] : INFO : Epoch 1839 | loss: 0.0311322 | val_loss: 0.031173 | Time: 4035.39 ms [2022-02-07 03:34:41 main:574] : INFO : Epoch 1840 | loss: 0.031124 | val_loss: 0.0311739 | Time: 3027.29 ms [2022-02-07 03:34:44 main:574] : INFO : Epoch 1841 | loss: 0.0311193 | val_loss: 0.031176 | Time: 3109.28 ms [2022-02-07 03:34:48 main:574] : INFO : Epoch 1842 | loss: 0.0311239 | val_loss: 0.0311728 | Time: 3165.57 ms [2022-02-07 03:34:51 main:574] : INFO : Epoch 1843 | loss: 0.0311161 | val_loss: 0.0311743 | Time: 3010.29 ms [2022-02-07 03:34:54 main:574] : INFO : Epoch 1844 | loss: 0.031115 | val_loss: 0.0311788 | Time: 3168.51 ms [2022-02-07 03:34:57 main:574] : INFO : Epoch 1845 | loss: 0.0311141 | val_loss: 0.0311748 | Time: 2985.74 ms [2022-02-07 03:35:00 main:574] : INFO : Epoch 1846 | loss: 0.0311093 | val_loss: 0.0311934 | Time: 3212.57 ms [2022-02-07 03:35:03 main:574] : INFO : Epoch 1847 | loss: 0.0311058 | val_loss: 0.0311851 | Time: 2942.15 ms [2022-02-07 03:35:06 main:574] : INFO : Epoch 1848 | loss: 0.0311057 | val_loss: 0.0311882 | Time: 3286.7 ms [2022-02-07 03:35:09 main:574] : INFO : Epoch 1849 | loss: 0.031111 | val_loss: 0.031189 | Time: 2977.75 ms [2022-02-07 03:35:12 main:574] : INFO : Epoch 1850 | loss: 0.0311541 | val_loss: 0.0311805 | Time: 3289.47 ms [2022-02-07 03:35:15 main:574] : INFO : Epoch 1851 | loss: 0.0311406 | val_loss: 0.0311724 | Time: 3060.03 ms [2022-02-07 03:35:19 main:574] : INFO : Epoch 1852 | loss: 0.0311304 | val_loss: 0.0311735 | Time: 3318.59 ms [2022-02-07 03:35:22 main:574] : INFO : Epoch 1853 | loss: 0.0311232 | val_loss: 0.0311761 | Time: 3013.62 ms [2022-02-07 03:35:25 main:574] : INFO : Epoch 1854 | loss: 0.0311145 | val_loss: 0.0311734 | Time: 3250.8 ms [2022-02-07 03:35:28 main:574] : INFO : Epoch 1855 | loss: 0.0311081 | val_loss: 0.0311821 | Time: 3121.49 ms [2022-02-07 03:35:31 main:574] : INFO : Epoch 1856 | loss: 0.0311086 | val_loss: 0.0311833 | Time: 3224.59 ms [2022-02-07 03:35:35 main:574] : INFO : Epoch 1857 | loss: 0.031112 | val_loss: 0.0311839 | Time: 3074.5 ms [2022-02-07 03:35:38 main:574] : INFO : Epoch 1858 | loss: 0.0311017 | val_loss: 0.0311796 | Time: 3730.57 ms [2022-02-07 03:35:41 main:574] : INFO : Epoch 1859 | loss: 0.0311011 | val_loss: 0.0311823 | Time: 3107.59 ms [2022-02-07 03:35:44 main:574] : INFO : Epoch 1860 | loss: 0.0311047 | val_loss: 0.0311805 | Time: 3136.14 ms [2022-02-07 03:35:48 main:574] : INFO : Epoch 1861 | loss: 0.0310971 | val_loss: 0.031191 | Time: 3178.68 ms [2022-02-07 03:35:51 main:574] : INFO : Epoch 1862 | loss: 0.0310926 | val_loss: 0.0311869 | Time: 3072.53 ms [2022-02-07 03:35:54 main:574] : INFO : Epoch 1863 | loss: 0.031091 | val_loss: 0.0311868 | Time: 3266.38 ms [2022-02-07 03:35:57 main:574] : INFO : Epoch 1864 | loss: 0.0310911 | val_loss: 0.031196 | Time: 3018.14 ms [2022-02-07 03:36:00 main:574] : INFO : Epoch 1865 | loss: 0.0310974 | val_loss: 0.0311867 | Time: 3271.48 ms [2022-02-07 03:36:03 main:574] : INFO : Epoch 1866 | loss: 0.0310964 | val_loss: 0.0311911 | Time: 3064.55 ms [2022-02-07 03:36:07 main:574] : INFO : Epoch 1867 | loss: 0.0310958 | val_loss: 0.0311821 | Time: 3151.93 ms [2022-02-07 03:36:10 main:574] : INFO : Epoch 1868 | loss: 0.0310914 | val_loss: 0.0311997 | Time: 3043.33 ms [2022-02-07 03:36:13 main:574] : INFO : Epoch 1869 | loss: 0.031103 | val_loss: 0.0311859 | Time: 3176.12 ms [2022-02-07 03:36:16 main:574] : INFO : Epoch 1870 | loss: 0.0311084 | val_loss: 0.0311851 | Time: 3056.89 ms [2022-02-07 03:36:19 main:574] : INFO : Epoch 1871 | loss: 0.0311309 | val_loss: 0.0313504 | Time: 3187.75 ms [2022-02-07 03:36:22 main:574] : INFO : Epoch 1872 | loss: 0.0327854 | val_loss: 0.0467819 | Time: 2996.75 ms [2022-02-07 03:36:25 main:574] : INFO : Epoch 1873 | loss: 0.0343659 | val_loss: 0.0318453 | Time: 3226.8 ms [2022-02-07 03:36:28 main:574] : INFO : Epoch 1874 | loss: 0.031601 | val_loss: 0.0314124 | Time: 3088.9 ms [2022-02-07 03:36:31 main:574] : INFO : Epoch 1875 | loss: 0.031306 | val_loss: 0.0312773 | Time: 3128.03 ms [2022-02-07 03:36:35 main:574] : INFO : Epoch 1876 | loss: 0.031256 | val_loss: 0.0312478 | Time: 3233.16 ms [2022-02-07 03:36:38 main:574] : INFO : Epoch 1877 | loss: 0.031246 | val_loss: 0.0312441 | Time: 3426.01 ms [2022-02-07 03:36:41 main:574] : INFO : Epoch 1878 | loss: 0.0312437 | val_loss: 0.0312411 | Time: 3034.21 ms [2022-02-07 03:36:44 main:574] : INFO : Epoch 1879 | loss: 0.0312419 | val_loss: 0.0312402 | Time: 3047.81 ms [2022-02-07 03:36:47 main:574] : INFO : Epoch 1880 | loss: 0.0312408 | val_loss: 0.0312397 | Time: 3144.45 ms [2022-02-07 03:36:50 main:574] : INFO : Epoch 1881 | loss: 0.0312383 | val_loss: 0.0312388 | Time: 3081.68 ms [2022-02-07 03:36:54 main:574] : INFO : Epoch 1882 | loss: 0.0312368 | val_loss: 0.0312372 | Time: 3194.33 ms [2022-02-07 03:36:57 main:574] : INFO : Epoch 1883 | loss: 0.031235 | val_loss: 0.0312374 | Time: 3064.27 ms [2022-02-07 03:37:00 main:574] : INFO : Epoch 1884 | loss: 0.0312344 | val_loss: 0.0312363 | Time: 3257.12 ms [2022-02-07 03:37:03 main:574] : INFO : Epoch 1885 | loss: 0.0312328 | val_loss: 0.0312363 | Time: 3065.76 ms [2022-02-07 03:37:06 main:574] : INFO : Epoch 1886 | loss: 0.0312344 | val_loss: 0.0312379 | Time: 3156.69 ms [2022-02-07 03:37:09 main:574] : INFO : Epoch 1887 | loss: 0.031231 | val_loss: 0.0312351 | Time: 3145.12 ms [2022-02-07 03:37:13 main:574] : INFO : Epoch 1888 | loss: 0.0312291 | val_loss: 0.0312354 | Time: 3179.77 ms [2022-02-07 03:37:16 main:574] : INFO : Epoch 1889 | loss: 0.0312286 | val_loss: 0.0312347 | Time: 3076.22 ms [2022-02-07 03:37:19 main:574] : INFO : Epoch 1890 | loss: 0.0312288 | val_loss: 0.0312344 | Time: 3111.6 ms [2022-02-07 03:37:22 main:574] : INFO : Epoch 1891 | loss: 0.031227 | val_loss: 0.0312327 | Time: 3018.63 ms [2022-02-07 03:37:25 main:574] : INFO : Epoch 1892 | loss: 0.0312255 | val_loss: 0.0312316 | Time: 3219.73 ms [2022-02-07 03:37:28 main:574] : INFO : Epoch 1893 | loss: 0.0312256 | val_loss: 0.0312389 | Time: 3016.03 ms [2022-02-07 03:37:31 main:574] : INFO : Epoch 1894 | loss: 0.0312252 | val_loss: 0.0312325 | Time: 3092.87 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce MX450) [2022-02-07 14:17:36 main:435] : INFO : Set logging level to 1 [2022-02-07 14:17:36 main:441] : INFO : Running in BOINC Client mode [2022-02-07 14:17:36 main:444] : INFO : Resolving all filenames [2022-02-07 14:17:36 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-07 14:17:36 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-07 14:17:36 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-07 14:17:36 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-07 14:17:36 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-07 14:17:36 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-07 14:17:36 main:474] : INFO : Configuration: [2022-02-07 14:17:36 main:475] : INFO : Model type: GRU [2022-02-07 14:17:36 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-07 14:17:36 main:477] : INFO : Max Epochs: 2048 [2022-02-07 14:17:36 main:478] : INFO : Batch Size: 128 [2022-02-07 14:17:36 main:479] : INFO : Learning Rate: 0.01 [2022-02-07 14:17:36 main:480] : INFO : Patience: 10 [2022-02-07 14:17:36 main:481] : INFO : Hidden Width: 12 [2022-02-07 14:17:36 main:482] : INFO : # Recurrent Layers: 4 [2022-02-07 14:17:36 main:483] : INFO : # Backend Layers: 4 [2022-02-07 14:17:36 main:484] : INFO : # Threads: 1 [2022-02-07 14:17:36 main:486] : INFO : Preparing Dataset [2022-02-07 14:17:36 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-07 14:17:36 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-07 14:17:37 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-07 14:17:37 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-07 14:17:37 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-07 14:17:37 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-07 14:17:37 main:494] : INFO : Creating Model [2022-02-07 14:17:37 main:507] : INFO : Preparing config file [2022-02-07 14:17:37 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-07 14:17:37 main:512] : INFO : Loading config [2022-02-07 14:17:37 main:514] : INFO : Loading state [2022-02-07 14:17:39 main:559] : INFO : Loading DataLoader into Memory [2022-02-07 14:17:39 main:562] : INFO : Starting Training [2022-02-07 14:17:42 main:574] : INFO : Epoch 1888 | loss: 0.0316892 | val_loss: 0.0312551 | Time: 3444.88 ms [2022-02-07 14:17:45 main:574] : INFO : Epoch 1889 | loss: 0.0312689 | val_loss: 0.0312545 | Time: 3080.86 ms [2022-02-07 14:17:49 main:574] : INFO : Epoch 1890 | loss: 0.0312449 | val_loss: 0.0312378 | Time: 3291.64 ms [2022-02-07 14:17:52 main:574] : INFO : Epoch 1891 | loss: 0.031232 | val_loss: 0.0312308 | Time: 3430.02 ms [2022-02-07 14:17:55 main:574] : INFO : Epoch 1892 | loss: 0.0312229 | val_loss: 0.0312213 | Time: 3375.77 ms [2022-02-07 14:17:59 main:574] : INFO : Epoch 1893 | loss: 0.0312108 | val_loss: 0.0312061 | Time: 3288.82 ms [2022-02-07 14:18:02 main:574] : INFO : Epoch 1894 | loss: 0.0312026 | val_loss: 0.031201 | Time: 3293.12 ms [2022-02-07 14:18:05 main:574] : INFO : Epoch 1895 | loss: 0.0312003 | val_loss: 0.0312022 | Time: 3290.12 ms [2022-02-07 14:18:09 main:574] : INFO : Epoch 1896 | loss: 0.0311997 | val_loss: 0.0312041 | Time: 3769.3 ms [2022-02-07 14:18:13 main:574] : INFO : Epoch 1897 | loss: 0.0311968 | val_loss: 0.031194 | Time: 3890.4 ms [2022-02-07 14:18:17 main:574] : INFO : Epoch 1898 | loss: 0.0311945 | val_loss: 0.0311918 | Time: 4288.18 ms [2022-02-07 14:18:22 main:574] : INFO : Epoch 1899 | loss: 0.0311939 | val_loss: 0.0311901 | Time: 4360.94 ms [2022-02-07 14:18:26 main:574] : INFO : Epoch 1900 | loss: 0.0311933 | val_loss: 0.0311883 | Time: 4239.33 ms [2022-02-07 14:18:30 main:574] : INFO : Epoch 1901 | loss: 0.0311886 | val_loss: 0.0311868 | Time: 4402.55 ms [2022-02-07 14:18:55 main:574] : INFO : Epoch 1902 | loss: 0.0311884 | val_loss: 0.0311932 | Time: 24676.5 ms [2022-02-07 14:18:58 main:574] : INFO : Epoch 1903 | loss: 0.0311905 | val_loss: 0.0311874 | Time: 3301.61 ms [2022-02-07 14:19:02 main:574] : INFO : Epoch 1904 | loss: 0.0311862 | val_loss: 0.0311969 | Time: 3405.57 ms [2022-02-07 14:19:05 main:574] : INFO : Epoch 1905 | loss: 0.0311844 | val_loss: 0.0311845 | Time: 3509.17 ms [2022-02-07 14:19:09 main:574] : INFO : Epoch 1906 | loss: 0.0311829 | val_loss: 0.0311842 | Time: 4114.4 ms [2022-02-07 14:19:13 main:574] : INFO : Epoch 1907 | loss: 0.0311844 | val_loss: 0.0311825 | Time: 4035.56 ms [2022-02-07 14:19:17 main:574] : INFO : Epoch 1908 | loss: 0.031181 | val_loss: 0.0311845 | Time: 3993.14 ms [2022-02-07 14:19:21 main:574] : INFO : Epoch 1909 | loss: 0.0311838 | val_loss: 0.0311843 | Time: 3750.08 ms [2022-02-07 14:19:25 main:574] : INFO : Epoch 1910 | loss: 0.0311823 | val_loss: 0.0311793 | Time: 4150.46 ms [2022-02-07 14:19:30 main:574] : INFO : Epoch 1911 | loss: 0.0311798 | val_loss: 0.0311866 | Time: 4173.81 ms [2022-02-07 14:19:33 main:574] : INFO : Epoch 1912 | loss: 0.0311812 | val_loss: 0.0311806 | Time: 3948.31 ms [2022-02-07 14:19:38 main:574] : INFO : Epoch 1913 | loss: 0.0311819 | val_loss: 0.0311844 | Time: 4071.83 ms [2022-02-07 14:19:42 main:574] : INFO : Epoch 1914 | loss: 0.0311828 | val_loss: 0.0311855 | Time: 4161.07 ms [2022-02-07 14:19:45 main:574] : INFO : Epoch 1915 | loss: 0.0311837 | val_loss: 0.031184 | Time: 3754.72 ms [2022-02-07 14:19:50 main:574] : INFO : Epoch 1916 | loss: 0.0311843 | val_loss: 0.0311855 | Time: 4094.53 ms [2022-02-07 14:19:54 main:574] : INFO : Epoch 1917 | loss: 0.0311858 | val_loss: 0.0311843 | Time: 4131.61 ms [2022-02-07 14:19:58 main:574] : INFO : Epoch 1918 | loss: 0.0311852 | val_loss: 0.0311813 | Time: 4138.04 ms [2022-02-07 14:20:02 main:574] : INFO : Epoch 1919 | loss: 0.0311824 | val_loss: 0.0311829 | Time: 4002.21 ms [2022-02-07 14:20:06 main:574] : INFO : Epoch 1920 | loss: 0.0311798 | val_loss: 0.0311771 | Time: 4042.55 ms [2022-02-07 14:20:11 main:574] : INFO : Epoch 1921 | loss: 0.031179 | val_loss: 0.0311806 | Time: 4968.11 ms [2022-02-07 14:20:45 main:574] : INFO : Epoch 1922 | loss: 0.0311798 | val_loss: 0.0311805 | Time: 34596.9 ms [2022-02-07 14:20:48 main:574] : INFO : Epoch 1923 | loss: 0.0311797 | val_loss: 0.0311838 | Time: 2949.97 ms [2022-02-07 14:20:52 main:574] : INFO : Epoch 1924 | loss: 0.0311746 | val_loss: 0.0311761 | Time: 3157.16 ms [2022-02-07 14:20:55 main:574] : INFO : Epoch 1925 | loss: 0.0311729 | val_loss: 0.0311716 | Time: 3086.88 ms [2022-02-07 14:20:59 main:574] : INFO : Epoch 1926 | loss: 0.0311767 | val_loss: 0.0311746 | Time: 3908.19 ms [2022-02-07 14:21:03 main:574] : INFO : Epoch 1927 | loss: 0.0311735 | val_loss: 0.0311752 | Time: 3966.8 ms [2022-02-07 14:21:07 main:574] : INFO : Epoch 1928 | loss: 0.0311715 | val_loss: 0.0311713 | Time: 4313.8 ms [2022-02-07 14:21:11 main:574] : INFO : Epoch 1929 | loss: 0.03117 | val_loss: 0.0311712 | Time: 4242.84 ms [2022-02-07 14:21:16 main:574] : INFO : Epoch 1930 | loss: 0.0311742 | val_loss: 0.0311686 | Time: 4402.28 ms [2022-02-07 14:21:20 main:574] : INFO : Epoch 1931 | loss: 0.0311778 | val_loss: 0.0311789 | Time: 4520.44 ms [2022-02-07 14:21:25 main:574] : INFO : Epoch 1932 | loss: 0.0311798 | val_loss: 0.031179 | Time: 4863.12 ms [2022-02-07 14:21:29 main:574] : INFO : Epoch 1933 | loss: 0.0311781 | val_loss: 0.0311782 | Time: 4337.17 ms [2022-02-07 14:21:33 main:574] : INFO : Epoch 1934 | loss: 0.0311777 | val_loss: 0.0311771 | Time: 3739.96 ms [2022-02-07 14:21:36 main:574] : INFO : Epoch 1935 | loss: 0.0311755 | val_loss: 0.0311747 | Time: 3345.61 ms [2022-02-07 14:21:40 main:574] : INFO : Epoch 1936 | loss: 0.0311757 | val_loss: 0.0311754 | Time: 3782.39 ms [2022-02-07 14:21:44 main:574] : INFO : Epoch 1937 | loss: 0.0311731 | val_loss: 0.0311749 | Time: 3476.08 ms [2022-02-07 14:21:49 main:574] : INFO : Epoch 1938 | loss: 0.0311733 | val_loss: 0.0311753 | Time: 5018.1 ms [2022-02-07 14:21:53 main:574] : INFO : Epoch 1939 | loss: 0.0311722 | val_loss: 0.0311731 | Time: 4750.49 ms [2022-02-07 14:21:57 main:574] : INFO : Epoch 1940 | loss: 0.0311708 | val_loss: 0.0311708 | Time: 3368.67 ms [2022-02-07 14:22:01 main:574] : INFO : Epoch 1941 | loss: 0.0311712 | val_loss: 0.0311754 | Time: 3935.31 ms [2022-02-07 14:22:05 main:574] : INFO : Epoch 1942 | loss: 0.0311727 | val_loss: 0.031172 | Time: 3864.2 ms [2022-02-07 14:22:08 main:574] : INFO : Epoch 1943 | loss: 0.0311736 | val_loss: 0.0311717 | Time: 3514.72 ms [2022-02-07 14:22:13 main:574] : INFO : Epoch 1944 | loss: 0.0311725 | val_loss: 0.0311875 | Time: 4754.83 ms [2022-02-07 14:22:17 main:574] : INFO : Epoch 1945 | loss: 0.0311756 | val_loss: 0.0311772 | Time: 4052.91 ms [2022-02-07 14:22:20 main:574] : INFO : Epoch 1946 | loss: 0.0311716 | val_loss: 0.0311736 | Time: 3589.53 ms [2022-02-07 14:22:23 main:574] : INFO : Epoch 1947 | loss: 0.0311717 | val_loss: 0.031177 | Time: 2976.41 ms [2022-02-07 14:22:27 main:574] : INFO : Epoch 1948 | loss: 0.0311724 | val_loss: 0.0311738 | Time: 3563.62 ms [2022-02-07 14:22:30 main:574] : INFO : Epoch 1949 | loss: 0.0311679 | val_loss: 0.0311708 | Time: 3161.88 ms [2022-02-07 14:22:34 main:574] : INFO : Epoch 1950 | loss: 0.0311668 | val_loss: 0.0311725 | Time: 3541.11 ms [2022-02-07 14:22:37 main:574] : INFO : Epoch 1951 | loss: 0.031168 | val_loss: 0.0311725 | Time: 3078.39 ms [2022-02-07 14:22:40 main:574] : INFO : Epoch 1952 | loss: 0.0311733 | val_loss: 0.0311756 | Time: 3503.14 ms [2022-02-07 14:22:43 main:574] : INFO : Epoch 1953 | loss: 0.0311723 | val_loss: 0.031173 | Time: 3106.76 ms [2022-02-07 14:22:48 main:574] : INFO : Epoch 1954 | loss: 0.0311678 | val_loss: 0.0311714 | Time: 4490.51 ms [2022-02-07 14:22:52 main:574] : INFO : Epoch 1955 | loss: 0.0311647 | val_loss: 0.0311707 | Time: 4423.14 ms [2022-02-07 14:22:55 main:574] : INFO : Epoch 1956 | loss: 0.0311636 | val_loss: 0.0311714 | Time: 3118.01 ms [2022-02-07 14:22:59 main:574] : INFO : Epoch 1957 | loss: 0.0311661 | val_loss: 0.0311721 | Time: 3521.22 ms [2022-02-07 14:23:02 main:574] : INFO : Epoch 1958 | loss: 0.0311655 | val_loss: 0.0311701 | Time: 3171.99 ms [2022-02-07 14:23:06 main:574] : INFO : Epoch 1959 | loss: 0.0311635 | val_loss: 0.031175 | Time: 3669.48 ms [2022-02-07 14:23:09 main:574] : INFO : Epoch 1960 | loss: 0.0311693 | val_loss: 0.0311718 | Time: 3192.02 ms [2022-02-07 14:23:13 main:574] : INFO : Epoch 1961 | loss: 0.0311627 | val_loss: 0.0311707 | Time: 3747.87 ms [2022-02-07 14:23:16 main:574] : INFO : Epoch 1962 | loss: 0.0311602 | val_loss: 0.0311709 | Time: 3315.22 ms [2022-02-07 14:23:20 main:574] : INFO : Epoch 1963 | loss: 0.0311619 | val_loss: 0.0311713 | Time: 3938.75 ms [2022-02-07 14:23:23 main:574] : INFO : Epoch 1964 | loss: 0.031161 | val_loss: 0.0311691 | Time: 3061.88 ms [2022-02-07 14:23:27 main:574] : INFO : Epoch 1965 | loss: 0.0311631 | val_loss: 0.0311686 | Time: 3622.76 ms [2022-02-07 14:23:30 main:574] : INFO : Epoch 1966 | loss: 0.031168 | val_loss: 0.0311743 | Time: 3305.22 ms [2022-02-07 14:23:34 main:574] : INFO : Epoch 1967 | loss: 0.0311683 | val_loss: 0.031186 | Time: 3646.87 ms [2022-02-07 14:23:37 main:574] : INFO : Epoch 1968 | loss: 0.0311657 | val_loss: 0.0311758 | Time: 3286.85 ms [2022-02-07 14:23:41 main:574] : INFO : Epoch 1969 | loss: 0.0311619 | val_loss: 0.0311709 | Time: 3596.33 ms [2022-02-07 14:23:44 main:574] : INFO : Epoch 1970 | loss: 0.0311617 | val_loss: 0.0311701 | Time: 3330.2 ms [2022-02-07 14:23:48 main:574] : INFO : Epoch 1971 | loss: 0.0311622 | val_loss: 0.0311707 | Time: 4484.14 ms [2022-02-07 14:23:53 main:574] : INFO : Epoch 1972 | loss: 0.0311623 | val_loss: 0.0311705 | Time: 4469 ms [2022-02-07 14:23:56 main:574] : INFO : Epoch 1973 | loss: 0.0311607 | val_loss: 0.0311687 | Time: 3391.29 ms [2022-02-07 14:24:00 main:574] : INFO : Epoch 1974 | loss: 0.0311617 | val_loss: 0.0311701 | Time: 3836.27 ms [2022-02-07 14:24:04 main:574] : INFO : Epoch 1975 | loss: 0.0311617 | val_loss: 0.031169 | Time: 3411.09 ms [2022-02-07 14:24:07 main:574] : INFO : Epoch 1976 | loss: 0.0311615 | val_loss: 0.0311693 | Time: 3679.19 ms [2022-02-07 14:24:11 main:574] : INFO : Epoch 1977 | loss: 0.0311619 | val_loss: 0.0311689 | Time: 3284.55 ms [2022-02-07 14:24:15 main:574] : INFO : Epoch 1978 | loss: 0.0311616 | val_loss: 0.0311734 | Time: 4218.68 ms [2022-02-07 14:24:19 main:574] : INFO : Epoch 1979 | loss: 0.0311622 | val_loss: 0.0311706 | Time: 3943.64 ms [2022-02-07 14:24:22 main:574] : INFO : Epoch 1980 | loss: 0.0311642 | val_loss: 0.0311706 | Time: 3485.26 ms [2022-02-07 14:24:26 main:574] : INFO : Epoch 1981 | loss: 0.0311615 | val_loss: 0.0311697 | Time: 3943.54 ms [2022-02-07 14:24:30 main:574] : INFO : Epoch 1982 | loss: 0.0311615 | val_loss: 0.0311693 | Time: 3492.92 ms [2022-02-07 14:24:34 main:574] : INFO : Epoch 1983 | loss: 0.0311623 | val_loss: 0.0311702 | Time: 3914.69 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce MX450) [2022-02-07 14:59:15 main:435] : INFO : Set logging level to 1 [2022-02-07 14:59:15 main:441] : INFO : Running in BOINC Client mode [2022-02-07 14:59:15 main:444] : INFO : Resolving all filenames [2022-02-07 14:59:15 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-07 14:59:15 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-07 14:59:15 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-07 14:59:15 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-07 14:59:15 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-07 14:59:15 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-07 14:59:15 main:474] : INFO : Configuration: [2022-02-07 14:59:15 main:475] : INFO : Model type: GRU [2022-02-07 14:59:15 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-07 14:59:15 main:477] : INFO : Max Epochs: 2048 [2022-02-07 14:59:15 main:478] : INFO : Batch Size: 128 [2022-02-07 14:59:15 main:479] : INFO : Learning Rate: 0.01 [2022-02-07 14:59:15 main:480] : INFO : Patience: 10 [2022-02-07 14:59:15 main:481] : INFO : Hidden Width: 12 [2022-02-07 14:59:15 main:482] : INFO : # Recurrent Layers: 4 [2022-02-07 14:59:15 main:483] : INFO : # Backend Layers: 4 [2022-02-07 14:59:15 main:484] : INFO : # Threads: 1 [2022-02-07 14:59:15 main:486] : INFO : Preparing Dataset [2022-02-07 14:59:15 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-07 14:59:16 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-07 14:59:17 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-07 14:59:17 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-07 14:59:17 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-07 14:59:17 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-07 14:59:17 main:494] : INFO : Creating Model [2022-02-07 14:59:17 main:507] : INFO : Preparing config file [2022-02-07 14:59:17 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-07 14:59:17 main:512] : INFO : Loading config [2022-02-07 14:59:17 main:514] : INFO : Loading state [2022-02-07 14:59:18 main:559] : INFO : Loading DataLoader into Memory [2022-02-07 14:59:18 main:562] : INFO : Starting Training [2022-02-07 14:59:21 main:574] : INFO : Epoch 1977 | loss: 0.031363 | val_loss: 0.0312517 | Time: 3190.05 ms [2022-02-07 14:59:24 main:574] : INFO : Epoch 1978 | loss: 0.0312192 | val_loss: 0.0311919 | Time: 2891.4 ms [2022-02-07 14:59:27 main:574] : INFO : Epoch 1979 | loss: 0.0311721 | val_loss: 0.0311706 | Time: 2952.7 ms [2022-02-07 14:59:30 main:574] : INFO : Epoch 1980 | loss: 0.0311663 | val_loss: 0.0311737 | Time: 3137.45 ms [2022-02-07 14:59:33 main:574] : INFO : Epoch 1981 | loss: 0.0311664 | val_loss: 0.0311681 | Time: 3057.45 ms [2022-02-07 14:59:36 main:574] : INFO : Epoch 1982 | loss: 0.0311651 | val_loss: 0.0311674 | Time: 3092.7 ms [2022-02-07 14:59:39 main:574] : INFO : Epoch 1983 | loss: 0.0311614 | val_loss: 0.031167 | Time: 2983.12 ms [2022-02-07 14:59:42 main:574] : INFO : Epoch 1984 | loss: 0.0311627 | val_loss: 0.0311708 | Time: 3142.61 ms [2022-02-07 14:59:45 main:574] : INFO : Epoch 1985 | loss: 0.0311616 | val_loss: 0.031168 | Time: 3013.21 ms [2022-02-07 14:59:48 main:574] : INFO : Epoch 1986 | loss: 0.0311609 | val_loss: 0.0311714 | Time: 3174.29 ms [2022-02-07 14:59:51 main:574] : INFO : Epoch 1987 | loss: 0.0311629 | val_loss: 0.0311671 | Time: 2986.4 ms [2022-02-07 14:59:54 main:574] : INFO : Epoch 1988 | loss: 0.031164 | val_loss: 0.0311725 | Time: 3205.61 ms [2022-02-07 14:59:58 main:574] : INFO : Epoch 1989 | loss: 0.0311663 | val_loss: 0.0311756 | Time: 3390.83 ms [2022-02-07 15:00:01 main:574] : INFO : Epoch 1990 | loss: 0.0311623 | val_loss: 0.0311681 | Time: 3386.11 ms [2022-02-07 15:00:04 main:574] : INFO : Epoch 1991 | loss: 0.031158 | val_loss: 0.0311652 | Time: 3002.96 ms [2022-02-07 15:00:07 main:574] : INFO : Epoch 1992 | loss: 0.0311579 | val_loss: 0.031166 | Time: 3109.52 ms [2022-02-07 15:00:10 main:574] : INFO : Epoch 1993 | loss: 0.031163 | val_loss: 0.0311693 | Time: 3120.09 ms [2022-02-07 15:00:13 main:574] : INFO : Epoch 1994 | loss: 0.031158 | val_loss: 0.0311639 | Time: 2998.7 ms [2022-02-07 15:00:17 main:574] : INFO : Epoch 1995 | loss: 0.0311569 | val_loss: 0.0311645 | Time: 3544.16 ms [2022-02-07 15:00:21 main:574] : INFO : Epoch 1996 | loss: 0.03116 | val_loss: 0.0311656 | Time: 3813.3 ms [2022-02-07 15:00:24 main:574] : INFO : Epoch 1997 | loss: 0.0311584 | val_loss: 0.0311641 | Time: 3448.68 ms [2022-02-07 15:00:28 main:574] : INFO : Epoch 1998 | loss: 0.0311606 | val_loss: 0.0311662 | Time: 3859.45 ms [2022-02-07 15:00:33 main:574] : INFO : Epoch 1999 | loss: 0.0311577 | val_loss: 0.0311662 | Time: 5050.28 ms [2022-02-07 15:01:19 main:574] : INFO : Epoch 2000 | loss: 0.031159 | val_loss: 0.0311652 | Time: 45551 ms [2022-02-07 15:01:22 main:574] : INFO : Epoch 2001 | loss: 0.0311592 | val_loss: 0.0311655 | Time: 3686.85 ms [2022-02-07 15:01:26 main:574] : INFO : Epoch 2002 | loss: 0.0311578 | val_loss: 0.0311632 | Time: 3102.7 ms [2022-02-07 15:01:29 main:574] : INFO : Epoch 2003 | loss: 0.031157 | val_loss: 0.0311658 | Time: 3284.55 ms [2022-02-07 15:01:32 main:574] : INFO : Epoch 2004 | loss: 0.0311578 | val_loss: 0.0311639 | Time: 3003.6 ms [2022-02-07 15:01:35 main:574] : INFO : Epoch 2005 | loss: 0.0311558 | val_loss: 0.0311616 | Time: 3257.07 ms [2022-02-07 15:01:38 main:574] : INFO : Epoch 2006 | loss: 0.0311546 | val_loss: 0.0311623 | Time: 2996.83 ms [2022-02-07 15:01:41 main:574] : INFO : Epoch 2007 | loss: 0.0311561 | val_loss: 0.031165 | Time: 3231.09 ms [2022-02-07 15:01:44 main:574] : INFO : Epoch 2008 | loss: 0.0311552 | val_loss: 0.0311684 | Time: 2984.06 ms [2022-02-07 15:01:47 main:574] : INFO : Epoch 2009 | loss: 0.0311579 | val_loss: 0.0311639 | Time: 3086.01 ms [2022-02-07 15:01:51 main:574] : INFO : Epoch 2010 | loss: 0.0311549 | val_loss: 0.0311633 | Time: 3157.76 ms [2022-02-07 15:01:54 main:574] : INFO : Epoch 2011 | loss: 0.0311539 | val_loss: 0.0311643 | Time: 3030.94 ms [2022-02-07 15:01:57 main:574] : INFO : Epoch 2012 | loss: 0.0311575 | val_loss: 0.0311609 | Time: 3222.58 ms [2022-02-07 15:02:00 main:574] : INFO : Epoch 2013 | loss: 0.0311549 | val_loss: 0.0311668 | Time: 2993.28 ms [2022-02-07 15:02:03 main:574] : INFO : Epoch 2014 | loss: 0.0311536 | val_loss: 0.0311628 | Time: 3270.49 ms [2022-02-07 15:02:06 main:574] : INFO : Epoch 2015 | loss: 0.0311589 | val_loss: 0.0311685 | Time: 3030.34 ms [2022-02-07 15:02:09 main:574] : INFO : Epoch 2016 | loss: 0.0311617 | val_loss: 0.0311618 | Time: 3292.47 ms [2022-02-07 15:02:12 main:574] : INFO : Epoch 2017 | loss: 0.0311577 | val_loss: 0.0311648 | Time: 3002.56 ms [2022-02-07 15:02:16 main:574] : INFO : Epoch 2018 | loss: 0.0311548 | val_loss: 0.0311617 | Time: 3202.69 ms [2022-02-07 15:02:19 main:574] : INFO : Epoch 2019 | loss: 0.0311519 | val_loss: 0.0311666 | Time: 3175.68 ms [2022-02-07 15:02:22 main:574] : INFO : Epoch 2020 | loss: 0.0311558 | val_loss: 0.0311639 | Time: 3418.67 ms [2022-02-07 15:02:25 main:574] : INFO : Epoch 2021 | loss: 0.0311538 | val_loss: 0.031161 | Time: 3045.17 ms [2022-02-07 15:02:29 main:574] : INFO : Epoch 2022 | loss: 0.0311522 | val_loss: 0.0311748 | Time: 3217.64 ms [2022-02-07 15:02:32 main:574] : INFO : Epoch 2023 | loss: 0.0311525 | val_loss: 0.0311607 | Time: 2995.86 ms [2022-02-07 15:02:35 main:574] : INFO : Epoch 2024 | loss: 0.0311469 | val_loss: 0.0311603 | Time: 3211.11 ms [2022-02-07 15:02:38 main:574] : INFO : Epoch 2025 | loss: 0.0311469 | val_loss: 0.0311665 | Time: 3092.62 ms [2022-02-07 15:02:41 main:574] : INFO : Epoch 2026 | loss: 0.0311495 | val_loss: 0.0311703 | Time: 3067 ms [2022-02-07 15:02:44 main:574] : INFO : Epoch 2027 | loss: 0.03115 | val_loss: 0.0311603 | Time: 3120.92 ms [2022-02-07 15:02:47 main:574] : INFO : Epoch 2028 | loss: 0.0311478 | val_loss: 0.0311612 | Time: 3016.66 ms [2022-02-07 15:02:50 main:574] : INFO : Epoch 2029 | loss: 0.0311468 | val_loss: 0.031165 | Time: 3247.18 ms [2022-02-07 15:02:53 main:574] : INFO : Epoch 2030 | loss: 0.0311511 | val_loss: 0.0311623 | Time: 2998.97 ms [2022-02-07 15:02:57 main:574] : INFO : Epoch 2031 | loss: 0.0311502 | val_loss: 0.0311608 | Time: 3234.04 ms [2022-02-07 15:03:00 main:574] : INFO : Epoch 2032 | loss: 0.0311459 | val_loss: 0.0311623 | Time: 3019.83 ms [2022-02-07 15:03:03 main:574] : INFO : Epoch 2033 | loss: 0.0311468 | val_loss: 0.0311647 | Time: 3324.05 ms [2022-02-07 15:03:06 main:574] : INFO : Epoch 2034 | loss: 0.0311457 | val_loss: 0.0311658 | Time: 3059.69 ms [2022-02-07 15:03:09 main:574] : INFO : Epoch 2035 | loss: 0.0311476 | val_loss: 0.0311623 | Time: 3275 ms [2022-02-07 15:03:12 main:574] : INFO : Epoch 2036 | loss: 0.031146 | val_loss: 0.0311626 | Time: 3056.91 ms [2022-02-07 15:03:16 main:574] : INFO : Epoch 2037 | loss: 0.0311462 | val_loss: 0.0311638 | Time: 3239.95 ms [2022-02-07 15:03:19 main:574] : INFO : Epoch 2038 | loss: 0.0311469 | val_loss: 0.0311702 | Time: 3023.68 ms [2022-02-07 15:03:22 main:574] : INFO : Epoch 2039 | loss: 0.0311449 | val_loss: 0.0311613 | Time: 3531.49 ms [2022-02-07 15:03:25 main:574] : INFO : Epoch 2040 | loss: 0.0311436 | val_loss: 0.031164 | Time: 2984.89 ms [2022-02-07 15:03:28 main:574] : INFO : Epoch 2041 | loss: 0.0311479 | val_loss: 0.031164 | Time: 3280.32 ms [2022-02-07 15:03:31 main:574] : INFO : Epoch 2042 | loss: 0.031154 | val_loss: 0.0311617 | Time: 3024.61 ms [2022-02-07 15:03:35 main:574] : INFO : Epoch 2043 | loss: 0.0311577 | val_loss: 0.0311733 | Time: 3168.38 ms [2022-02-07 15:03:38 main:574] : INFO : Epoch 2044 | loss: 0.0311866 | val_loss: 0.0311919 | Time: 3072.76 ms [2022-02-07 15:03:41 main:574] : INFO : Epoch 2045 | loss: 0.0311954 | val_loss: 0.031193 | Time: 3041.9 ms [2022-02-07 15:03:44 main:574] : INFO : Epoch 2046 | loss: 0.031193 | val_loss: 0.0311902 | Time: 3178.6 ms [2022-02-07 15:03:47 main:574] : INFO : Epoch 2047 | loss: 0.0311909 | val_loss: 0.0311907 | Time: 3039.8 ms [2022-02-07 15:03:50 main:574] : INFO : Epoch 2048 | loss: 0.0311879 | val_loss: 0.0311865 | Time: 3306.8 ms [2022-02-07 15:03:50 main:597] : INFO : Saving trained model to model-final.pt, val_loss 0.0311865 [2022-02-07 15:03:50 main:603] : INFO : Saving end state to config to file [2022-02-07 15:03:50 main:608] : INFO : Success, exiting.. 15:03:50 (27552): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)