Task 14387139

Name ParityModified-1647045358-3212-3-0_0
Workunit 11431407
Created 5 Apr 2022, 19:37:48 UTC
Sent 10 Apr 2022, 4:26:11 UTC
Report deadline 18 Apr 2022, 4:26:11 UTC
Received 11 Apr 2022, 5:00:31 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 21344
Run time 1 hours 44 min 10 sec
CPU time 1 hours 34 min 42 sec
Validate state Valid
Credit 4,160.00
Device peak FLOPS 6,456.47 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 2.08 GB
Peak swap size 4.33 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.20</core_client_version>
<![CDATA[
<stderr_txt>
4-10 08:53:33	                main:574]	:	INFO	:	Epoch 1617 | loss: 0.0310342 | val_loss: 0.0311205 | Time: 2994.13 ms
[2022-04-10 08:53:36	                main:574]	:	INFO	:	Epoch 1618 | loss: 0.0310329 | val_loss: 0.031119 | Time: 2964.65 ms
[2022-04-10 08:53:39	                main:574]	:	INFO	:	Epoch 1619 | loss: 0.031034 | val_loss: 0.0311262 | Time: 3019.47 ms
[2022-04-10 08:53:42	                main:574]	:	INFO	:	Epoch 1620 | loss: 0.0310319 | val_loss: 0.031125 | Time: 3021.74 ms
[2022-04-10 08:53:45	                main:574]	:	INFO	:	Epoch 1621 | loss: 0.0310371 | val_loss: 0.0311165 | Time: 2990.1 ms
[2022-04-10 08:53:48	                main:574]	:	INFO	:	Epoch 1622 | loss: 0.0310382 | val_loss: 0.0311231 | Time: 2972.88 ms
[2022-04-10 08:53:51	                main:574]	:	INFO	:	Epoch 1623 | loss: 0.0310361 | val_loss: 0.0311292 | Time: 2996.05 ms
[2022-04-10 08:53:53	                main:574]	:	INFO	:	Epoch 1624 | loss: 0.031036 | val_loss: 0.0311206 | Time: 2896.02 ms
[2022-04-10 08:53:56	                main:574]	:	INFO	:	Epoch 1625 | loss: 0.0310367 | val_loss: 0.0311294 | Time: 2988.04 ms
[2022-04-10 08:53:59	                main:574]	:	INFO	:	Epoch 1626 | loss: 0.0310378 | val_loss: 0.0311315 | Time: 2910.92 ms
[2022-04-10 08:54:02	                main:574]	:	INFO	:	Epoch 1627 | loss: 0.0310395 | val_loss: 0.0311178 | Time: 3048.58 ms
[2022-04-10 08:54:05	                main:574]	:	INFO	:	Epoch 1628 | loss: 0.0310408 | val_loss: 0.0311231 | Time: 2945.85 ms
[2022-04-10 08:54:09	                main:574]	:	INFO	:	Epoch 1629 | loss: 0.0310395 | val_loss: 0.0311254 | Time: 3156.98 ms
[2022-04-10 08:54:12	                main:574]	:	INFO	:	Epoch 1630 | loss: 0.0310377 | val_loss: 0.0311194 | Time: 3061.82 ms
[2022-04-10 08:54:15	                main:574]	:	INFO	:	Epoch 1631 | loss: 0.0310359 | val_loss: 0.0311178 | Time: 3032.32 ms
[2022-04-10 08:54:18	                main:574]	:	INFO	:	Epoch 1632 | loss: 0.0310407 | val_loss: 0.0311193 | Time: 2929 ms
[2022-04-10 08:54:21	                main:574]	:	INFO	:	Epoch 1633 | loss: 0.0310468 | val_loss: 0.0311119 | Time: 3004.04 ms
[2022-04-10 08:54:24	                main:574]	:	INFO	:	Epoch 1634 | loss: 0.0310463 | val_loss: 0.0311088 | Time: 3016.02 ms
[2022-04-10 08:54:27	                main:574]	:	INFO	:	Epoch 1635 | loss: 0.0310421 | val_loss: 0.0311167 | Time: 2995.04 ms
[2022-04-10 08:54:30	                main:574]	:	INFO	:	Epoch 1636 | loss: 0.0310419 | val_loss: 0.0311138 | Time: 2990.48 ms
[2022-04-10 08:54:33	                main:574]	:	INFO	:	Epoch 1637 | loss: 0.0310415 | val_loss: 0.0311142 | Time: 2941.18 ms
[2022-04-10 08:54:36	                main:574]	:	INFO	:	Epoch 1638 | loss: 0.0310391 | val_loss: 0.0311166 | Time: 3000.44 ms
[2022-04-10 08:54:38	                main:574]	:	INFO	:	Epoch 1639 | loss: 0.0310364 | val_loss: 0.0311226 | Time: 2937.12 ms
[2022-04-10 08:54:42	                main:574]	:	INFO	:	Epoch 1640 | loss: 0.0310397 | val_loss: 0.0311148 | Time: 3031.82 ms
[2022-04-10 08:54:44	                main:574]	:	INFO	:	Epoch 1641 | loss: 0.0310379 | val_loss: 0.0311249 | Time: 2938.28 ms
[2022-04-10 08:54:47	                main:574]	:	INFO	:	Epoch 1642 | loss: 0.0310429 | val_loss: 0.0311336 | Time: 2919.67 ms
[2022-04-10 08:54:50	                main:574]	:	INFO	:	Epoch 1643 | loss: 0.0310401 | val_loss: 0.0311165 | Time: 2950.2 ms
[2022-04-10 08:54:53	                main:574]	:	INFO	:	Epoch 1644 | loss: 0.0310431 | val_loss: 0.0311242 | Time: 2921.37 ms
[2022-04-10 08:54:56	                main:574]	:	INFO	:	Epoch 1645 | loss: 0.0310449 | val_loss: 0.0311219 | Time: 2963.75 ms
[2022-04-10 08:54:59	                main:574]	:	INFO	:	Epoch 1646 | loss: 0.0310447 | val_loss: 0.0311224 | Time: 3012.67 ms
[2022-04-10 08:55:02	                main:574]	:	INFO	:	Epoch 1647 | loss: 0.0310436 | val_loss: 0.0311154 | Time: 3008.28 ms
[2022-04-10 08:55:05	                main:574]	:	INFO	:	Epoch 1648 | loss: 0.0310396 | val_loss: 0.0311237 | Time: 2993.77 ms
[2022-04-10 08:55:08	                main:574]	:	INFO	:	Epoch 1649 | loss: 0.0310414 | val_loss: 0.0311145 | Time: 2968.26 ms
[2022-04-10 08:55:11	                main:574]	:	INFO	:	Epoch 1650 | loss: 0.031038 | val_loss: 0.0311188 | Time: 2991.49 ms
[2022-04-10 08:55:14	                main:574]	:	INFO	:	Epoch 1651 | loss: 0.031039 | val_loss: 0.0311199 | Time: 3010.46 ms
[2022-04-10 08:55:17	                main:574]	:	INFO	:	Epoch 1652 | loss: 0.0310391 | val_loss: 0.0311142 | Time: 2991.09 ms
[2022-04-10 08:55:20	                main:574]	:	INFO	:	Epoch 1653 | loss: 0.0310436 | val_loss: 0.0311173 | Time: 2938.48 ms
[2022-04-10 08:55:23	                main:574]	:	INFO	:	Epoch 1654 | loss: 0.0310603 | val_loss: 0.0311264 | Time: 3046.64 ms
[2022-04-10 08:55:26	                main:574]	:	INFO	:	Epoch 1655 | loss: 0.0310534 | val_loss: 0.0311213 | Time: 3018.95 ms
[2022-04-10 08:55:29	                main:574]	:	INFO	:	Epoch 1656 | loss: 0.0310482 | val_loss: 0.0311171 | Time: 2986.54 ms
[2022-04-10 08:55:32	                main:574]	:	INFO	:	Epoch 1657 | loss: 0.0310435 | val_loss: 0.0311183 | Time: 2963.49 ms
[2022-04-10 08:55:35	                main:574]	:	INFO	:	Epoch 1658 | loss: 0.0310759 | val_loss: 0.0311444 | Time: 3040.19 ms
[2022-04-10 08:55:38	                main:574]	:	INFO	:	Epoch 1659 | loss: 0.0311492 | val_loss: 0.0311458 | Time: 2947.18 ms
[2022-04-10 08:55:41	                main:574]	:	INFO	:	Epoch 1660 | loss: 0.0311449 | val_loss: 0.031139 | Time: 3012.39 ms
[2022-04-10 08:55:44	                main:574]	:	INFO	:	Epoch 1661 | loss: 0.031134 | val_loss: 0.0311345 | Time: 2942.88 ms
[2022-04-10 08:55:47	                main:574]	:	INFO	:	Epoch 1662 | loss: 0.0311334 | val_loss: 0.0311441 | Time: 2994.69 ms
[2022-04-10 08:55:50	                main:574]	:	INFO	:	Epoch 1663 | loss: 0.031124 | val_loss: 0.03114 | Time: 2958.09 ms
[2022-04-10 08:55:53	                main:574]	:	INFO	:	Epoch 1664 | loss: 0.0311189 | val_loss: 0.0311318 | Time: 2955.57 ms
[2022-04-10 08:55:56	                main:574]	:	INFO	:	Epoch 1665 | loss: 0.0311144 | val_loss: 0.031132 | Time: 3092.36 ms
[2022-04-10 08:55:59	                main:574]	:	INFO	:	Epoch 1666 | loss: 0.0311113 | val_loss: 0.031131 | Time: 2994 ms
[2022-04-10 08:56:02	                main:574]	:	INFO	:	Epoch 1667 | loss: 0.0311079 | val_loss: 0.0311305 | Time: 2941.23 ms
[2022-04-10 08:56:05	                main:574]	:	INFO	:	Epoch 1668 | loss: 0.0311059 | val_loss: 0.0311292 | Time: 2971.87 ms
[2022-04-10 08:56:08	                main:574]	:	INFO	:	Epoch 1669 | loss: 0.0311046 | val_loss: 0.0311282 | Time: 2993.23 ms
[2022-04-10 08:56:11	                main:574]	:	INFO	:	Epoch 1670 | loss: 0.0311039 | val_loss: 0.0311315 | Time: 3061.38 ms
[2022-04-10 08:56:14	                main:574]	:	INFO	:	Epoch 1671 | loss: 0.0311013 | val_loss: 0.0311295 | Time: 3016.22 ms
[2022-04-10 08:56:17	                main:574]	:	INFO	:	Epoch 1672 | loss: 0.0310998 | val_loss: 0.0311275 | Time: 3004.72 ms
[2022-04-10 08:56:20	                main:574]	:	INFO	:	Epoch 1673 | loss: 0.0310948 | val_loss: 0.0311283 | Time: 3017.87 ms
[2022-04-10 08:56:23	                main:574]	:	INFO	:	Epoch 1674 | loss: 0.0310924 | val_loss: 0.0311252 | Time: 3007.04 ms
[2022-04-10 08:56:26	                main:574]	:	INFO	:	Epoch 1675 | loss: 0.0310908 | val_loss: 0.0311295 | Time: 2981.31 ms
[2022-04-10 08:56:29	                main:574]	:	INFO	:	Epoch 1676 | loss: 0.031092 | val_loss: 0.0311303 | Time: 2940.8 ms
[2022-04-10 08:56:32	                main:574]	:	INFO	:	Epoch 1677 | loss: 0.0310917 | val_loss: 0.0311244 | Time: 2975.37 ms
[2022-04-10 08:56:35	                main:574]	:	INFO	:	Epoch 1678 | loss: 0.0310886 | val_loss: 0.0311282 | Time: 2964.11 ms
[2022-04-10 08:56:38	                main:574]	:	INFO	:	Epoch 1679 | loss: 0.0310893 | val_loss: 0.0311297 | Time: 2969.93 ms
[2022-04-10 08:56:41	                main:574]	:	INFO	:	Epoch 1680 | loss: 0.0310879 | val_loss: 0.0311229 | Time: 3046.01 ms
[2022-04-10 08:56:44	                main:574]	:	INFO	:	Epoch 1681 | loss: 0.0310891 | val_loss: 0.0311222 | Time: 2963.45 ms
[2022-04-10 08:56:47	                main:574]	:	INFO	:	Epoch 1682 | loss: 0.0310885 | val_loss: 0.031128 | Time: 2970.55 ms
[2022-04-10 08:56:50	                main:574]	:	INFO	:	Epoch 1683 | loss: 0.0310864 | val_loss: 0.0311264 | Time: 3049.28 ms
[2022-04-10 08:56:53	                main:574]	:	INFO	:	Epoch 1684 | loss: 0.0310874 | val_loss: 0.0311238 | Time: 3041.65 ms
[2022-04-10 08:56:56	                main:574]	:	INFO	:	Epoch 1685 | loss: 0.0310879 | val_loss: 0.0311265 | Time: 2939.98 ms
[2022-04-10 08:56:59	                main:574]	:	INFO	:	Epoch 1686 | loss: 0.0310855 | val_loss: 0.0311186 | Time: 2899.63 ms
[2022-04-10 08:57:02	                main:574]	:	INFO	:	Epoch 1687 | loss: 0.031084 | val_loss: 0.0311202 | Time: 3074.78 ms
[2022-04-10 08:57:05	                main:574]	:	INFO	:	Epoch 1688 | loss: 0.0310886 | val_loss: 0.0311197 | Time: 2931.32 ms
[2022-04-10 08:57:08	                main:574]	:	INFO	:	Epoch 1689 | loss: 0.031086 | val_loss: 0.0311238 | Time: 2993.28 ms
[2022-04-10 08:57:11	                main:574]	:	INFO	:	Epoch 1690 | loss: 0.0310883 | val_loss: 0.0311253 | Time: 3027.24 ms
[2022-04-10 08:57:14	                main:574]	:	INFO	:	Epoch 1691 | loss: 0.031084 | val_loss: 0.0311219 | Time: 3051.31 ms
[2022-04-10 08:57:17	                main:574]	:	INFO	:	Epoch 1692 | loss: 0.031087 | val_loss: 0.0311303 | Time: 3015.75 ms
[2022-04-10 08:57:20	                main:574]	:	INFO	:	Epoch 1693 | loss: 0.0310858 | val_loss: 0.0311216 | Time: 3002.46 ms
[2022-04-10 08:57:23	                main:574]	:	INFO	:	Epoch 1694 | loss: 0.0310826 | val_loss: 0.0311262 | Time: 3084.75 ms
[2022-04-10 08:57:26	                main:574]	:	INFO	:	Epoch 1695 | loss: 0.0310795 | val_loss: 0.0311353 | Time: 2938.4 ms
[2022-04-10 08:57:29	                main:574]	:	INFO	:	Epoch 1696 | loss: 0.0310813 | val_loss: 0.0311284 | Time: 3065.26 ms
[2022-04-10 08:57:32	                main:574]	:	INFO	:	Epoch 1697 | loss: 0.0310814 | val_loss: 0.0311266 | Time: 2954.38 ms
[2022-04-10 08:57:35	                main:574]	:	INFO	:	Epoch 1698 | loss: 0.0310828 | val_loss: 0.0311248 | Time: 3028.06 ms
[2022-04-10 08:57:38	                main:574]	:	INFO	:	Epoch 1699 | loss: 0.0310824 | val_loss: 0.0311277 | Time: 3021.32 ms
[2022-04-10 08:57:41	                main:574]	:	INFO	:	Epoch 1700 | loss: 0.0310788 | val_loss: 0.0311314 | Time: 2980.63 ms
[2022-04-10 08:57:44	                main:574]	:	INFO	:	Epoch 1701 | loss: 0.0310774 | val_loss: 0.0311271 | Time: 2979.36 ms
[2022-04-10 08:57:47	                main:574]	:	INFO	:	Epoch 1702 | loss: 0.0310767 | val_loss: 0.0311311 | Time: 3017.69 ms
[2022-04-10 08:57:50	                main:574]	:	INFO	:	Epoch 1703 | loss: 0.0310752 | val_loss: 0.0311231 | Time: 3010.5 ms
[2022-04-10 08:57:53	                main:574]	:	INFO	:	Epoch 1704 | loss: 0.0310739 | val_loss: 0.0311181 | Time: 3063.22 ms
[2022-04-10 08:57:56	                main:574]	:	INFO	:	Epoch 1705 | loss: 0.031075 | val_loss: 0.0311235 | Time: 2986.46 ms
[2022-04-10 08:57:59	                main:574]	:	INFO	:	Epoch 1706 | loss: 0.031073 | val_loss: 0.0311259 | Time: 2938.63 ms
[2022-04-10 08:58:02	                main:574]	:	INFO	:	Epoch 1707 | loss: 0.0310716 | val_loss: 0.0311196 | Time: 3155.61 ms
[2022-04-10 08:58:05	                main:574]	:	INFO	:	Epoch 1708 | loss: 0.0310704 | val_loss: 0.0311151 | Time: 2953.64 ms
[2022-04-10 08:58:08	                main:574]	:	INFO	:	Epoch 1709 | loss: 0.0310713 | val_loss: 0.0311254 | Time: 2986.51 ms
[2022-04-10 08:58:11	                main:574]	:	INFO	:	Epoch 1710 | loss: 0.0310749 | val_loss: 0.031123 | Time: 2979.37 ms
[2022-04-10 08:58:14	                main:574]	:	INFO	:	Epoch 1711 | loss: 0.0310783 | val_loss: 0.0311199 | Time: 2988.03 ms
[2022-04-10 08:58:17	                main:574]	:	INFO	:	Epoch 1712 | loss: 0.031081 | val_loss: 0.031124 | Time: 3002.38 ms
[2022-04-10 08:58:20	                main:574]	:	INFO	:	Epoch 1713 | loss: 0.0310821 | val_loss: 0.0311204 | Time: 2946.68 ms
[2022-04-10 08:58:23	                main:574]	:	INFO	:	Epoch 1714 | loss: 0.0310839 | val_loss: 0.0311145 | Time: 3073.23 ms
[2022-04-10 08:58:26	                main:574]	:	INFO	:	Epoch 1715 | loss: 0.0310792 | val_loss: 0.0311095 | Time: 3034.61 ms
[2022-04-10 08:58:29	                main:574]	:	INFO	:	Epoch 1716 | loss: 0.0310797 | val_loss: 0.0311167 | Time: 2945.16 ms
[2022-04-10 08:58:32	                main:574]	:	INFO	:	Epoch 1717 | loss: 0.0310778 | val_loss: 0.031117 | Time: 3043.19 ms
[2022-04-10 08:58:35	                main:574]	:	INFO	:	Epoch 1718 | loss: 0.0310765 | val_loss: 0.0311157 | Time: 3043.04 ms
[2022-04-10 08:58:38	                main:574]	:	INFO	:	Epoch 1719 | loss: 0.0310714 | val_loss: 0.0311136 | Time: 3078.17 ms
[2022-04-10 08:58:42	                main:574]	:	INFO	:	Epoch 1720 | loss: 0.0310706 | val_loss: 0.0311176 | Time: 3083.08 ms
[2022-04-10 08:58:44	                main:574]	:	INFO	:	Epoch 1721 | loss: 0.0310688 | val_loss: 0.031116 | Time: 2872.48 ms
[2022-04-10 08:58:47	                main:574]	:	INFO	:	Epoch 1722 | loss: 0.0310686 | val_loss: 0.0311161 | Time: 2919.27 ms
[2022-04-10 08:58:50	                main:574]	:	INFO	:	Epoch 1723 | loss: 0.0310659 | val_loss: 0.0311138 | Time: 2877.1 ms
[2022-04-10 08:58:53	                main:574]	:	INFO	:	Epoch 1724 | loss: 0.0310656 | val_loss: 0.0311193 | Time: 2873.75 ms
[2022-04-10 08:58:56	                main:574]	:	INFO	:	Epoch 1725 | loss: 0.0310662 | val_loss: 0.0311234 | Time: 2925.75 ms
[2022-04-10 08:58:59	                main:574]	:	INFO	:	Epoch 1726 | loss: 0.0310741 | val_loss: 0.0311197 | Time: 2917.45 ms
[2022-04-10 08:59:02	                main:574]	:	INFO	:	Epoch 1727 | loss: 0.0310748 | val_loss: 0.0311296 | Time: 3044.46 ms
[2022-04-10 08:59:05	                main:574]	:	INFO	:	Epoch 1728 | loss: 0.0310824 | val_loss: 0.0311213 | Time: 2948.33 ms
[2022-04-10 08:59:08	                main:574]	:	INFO	:	Epoch 1729 | loss: 0.0310765 | val_loss: 0.0311238 | Time: 2898.91 ms
[2022-04-10 08:59:11	                main:574]	:	INFO	:	Epoch 1730 | loss: 0.0310764 | val_loss: 0.0311169 | Time: 2894.19 ms
[2022-04-10 08:59:14	                main:574]	:	INFO	:	Epoch 1731 | loss: 0.0310746 | val_loss: 0.0311173 | Time: 2955.08 ms
[2022-04-10 08:59:17	                main:574]	:	INFO	:	Epoch 1732 | loss: 0.0310769 | val_loss: 0.0311202 | Time: 2864.38 ms
[2022-04-10 08:59:20	                main:574]	:	INFO	:	Epoch 1733 | loss: 0.0310714 | val_loss: 0.0311215 | Time: 2977.2 ms
[2022-04-10 08:59:23	                main:574]	:	INFO	:	Epoch 1734 | loss: 0.031068 | val_loss: 0.0311224 | Time: 2991.08 ms
[2022-04-10 08:59:25	                main:574]	:	INFO	:	Epoch 1735 | loss: 0.0310677 | val_loss: 0.0311204 | Time: 2894.79 ms
[2022-04-10 08:59:28	                main:574]	:	INFO	:	Epoch 1736 | loss: 0.0310664 | val_loss: 0.031119 | Time: 2901.45 ms
[2022-04-10 08:59:31	                main:574]	:	INFO	:	Epoch 1737 | loss: 0.031068 | val_loss: 0.0311207 | Time: 2942.71 ms
[2022-04-10 08:59:34	                main:574]	:	INFO	:	Epoch 1738 | loss: 0.0310752 | val_loss: 0.0311204 | Time: 2886.68 ms
[2022-04-10 08:59:37	                main:574]	:	INFO	:	Epoch 1739 | loss: 0.031076 | val_loss: 0.0311351 | Time: 2870.48 ms
[2022-04-10 08:59:40	                main:574]	:	INFO	:	Epoch 1740 | loss: 0.0310761 | val_loss: 0.0311242 | Time: 2985.49 ms
[2022-04-10 08:59:43	                main:574]	:	INFO	:	Epoch 1741 | loss: 0.0310692 | val_loss: 0.0311253 | Time: 2970.48 ms
[2022-04-10 08:59:46	                main:574]	:	INFO	:	Epoch 1742 | loss: 0.0310662 | val_loss: 0.0311217 | Time: 2881.52 ms
[2022-04-10 08:59:49	                main:574]	:	INFO	:	Epoch 1743 | loss: 0.0310649 | val_loss: 0.0311254 | Time: 2821.11 ms
[2022-04-10 08:59:52	                main:574]	:	INFO	:	Epoch 1744 | loss: 0.0310644 | val_loss: 0.0311261 | Time: 2879.67 ms
[2022-04-10 08:59:55	                main:574]	:	INFO	:	Epoch 1745 | loss: 0.0310622 | val_loss: 0.0311227 | Time: 2904.87 ms
[2022-04-10 08:59:57	                main:574]	:	INFO	:	Epoch 1746 | loss: 0.0310607 | val_loss: 0.0311275 | Time: 2915.73 ms
[2022-04-10 09:00:00	                main:574]	:	INFO	:	Epoch 1747 | loss: 0.0310594 | val_loss: 0.0311244 | Time: 2858.45 ms
[2022-04-10 09:00:03	                main:574]	:	INFO	:	Epoch 1748 | loss: 0.0310595 | val_loss: 0.031122 | Time: 3006.27 ms
[2022-04-10 09:00:06	                main:574]	:	INFO	:	Epoch 1749 | loss: 0.0310608 | val_loss: 0.031128 | Time: 2856.45 ms
[2022-04-10 09:00:09	                main:574]	:	INFO	:	Epoch 1750 | loss: 0.0310576 | val_loss: 0.0311251 | Time: 2904.92 ms
[2022-04-10 09:00:12	                main:574]	:	INFO	:	Epoch 1751 | loss: 0.0310577 | val_loss: 0.0311345 | Time: 2867.79 ms
[2022-04-10 09:00:15	                main:574]	:	INFO	:	Epoch 1752 | loss: 0.0310622 | val_loss: 0.0311247 | Time: 2929.26 ms
[2022-04-10 09:00:18	                main:574]	:	INFO	:	Epoch 1753 | loss: 0.0310652 | val_loss: 0.0311203 | Time: 2869.1 ms
[2022-04-10 09:00:21	                main:574]	:	INFO	:	Epoch 1754 | loss: 0.0310634 | val_loss: 0.0311155 | Time: 2780.42 ms
[2022-04-10 09:00:24	                main:574]	:	INFO	:	Epoch 1755 | loss: 0.0310629 | val_loss: 0.0311097 | Time: 3106.48 ms
[2022-04-10 09:00:27	                main:574]	:	INFO	:	Epoch 1756 | loss: 0.0310631 | val_loss: 0.031119 | Time: 3229.56 ms
[2022-04-10 09:00:30	                main:574]	:	INFO	:	Epoch 1757 | loss: 0.0310605 | val_loss: 0.0311185 | Time: 3226.56 ms
[2022-04-10 09:00:33	                main:574]	:	INFO	:	Epoch 1758 | loss: 0.0310596 | val_loss: 0.0311242 | Time: 3293.5 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 2060)
[2022-04-10 10:58:04	                main:435]	:	INFO	:	Set logging level to 1
[2022-04-10 10:58:04	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-04-10 10:58:04	                main:444]	:	INFO	:	Resolving all filenames
[2022-04-10 10:58:04	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-10 10:58:04	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-10 10:58:04	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-10 10:58:04	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-10 10:58:04	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-10 10:58:04	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-04-10 10:58:04	                main:474]	:	INFO	:	Configuration: 
[2022-04-10 10:58:04	                main:475]	:	INFO	:	    Model type: GRU
[2022-04-10 10:58:04	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-04-10 10:58:04	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-04-10 10:58:04	                main:478]	:	INFO	:	    Batch Size: 128
[2022-04-10 10:58:04	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-04-10 10:58:04	                main:480]	:	INFO	:	    Patience: 10
[2022-04-10 10:58:04	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-04-10 10:58:04	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-04-10 10:58:04	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-04-10 10:58:04	                main:484]	:	INFO	:	    # Threads: 1
[2022-04-10 10:58:04	                main:486]	:	INFO	:	Preparing Dataset
[2022-04-10 10:58:04	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-10 10:58:04	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-10 10:58:05	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-04-10 10:58:05	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-10 10:58:05	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-10 10:58:06	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-04-10 10:58:06	                main:494]	:	INFO	:	Creating Model
[2022-04-10 10:58:06	                main:507]	:	INFO	:	Preparing config file
[2022-04-10 10:58:06	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-04-10 10:58:06	                main:512]	:	INFO	:	Loading config
[2022-04-10 10:58:06	                main:514]	:	INFO	:	Loading state
[2022-04-10 10:58:06	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2022-04-10 10:58:06	                main:562]	:	INFO	:	Starting Training
[2022-04-10 10:58:10	                main:574]	:	INFO	:	Epoch 1759 | loss: 0.0310936 | val_loss: 0.0311215 | Time: 3239.5 ms
[2022-04-10 10:58:13	                main:574]	:	INFO	:	Epoch 1760 | loss: 0.0310675 | val_loss: 0.0311124 | Time: 3021.07 ms
[2022-04-10 10:58:16	                main:574]	:	INFO	:	Epoch 1761 | loss: 0.0310641 | val_loss: 0.0311117 | Time: 3050.27 ms
[2022-04-10 10:58:19	                main:574]	:	INFO	:	Epoch 1762 | loss: 0.0310612 | val_loss: 0.0311167 | Time: 2953.9 ms
[2022-04-10 10:58:22	                main:574]	:	INFO	:	Epoch 1763 | loss: 0.0310606 | val_loss: 0.0311136 | Time: 3000.64 ms
[2022-04-10 10:58:25	                main:574]	:	INFO	:	Epoch 1764 | loss: 0.0310615 | val_loss: 0.0311202 | Time: 3020.05 ms
[2022-04-10 10:58:28	                main:574]	:	INFO	:	Epoch 1765 | loss: 0.0310593 | val_loss: 0.031114 | Time: 2976.96 ms
[2022-04-10 10:58:31	                main:574]	:	INFO	:	Epoch 1766 | loss: 0.031059 | val_loss: 0.0311199 | Time: 2998.6 ms
[2022-04-10 10:58:34	                main:574]	:	INFO	:	Epoch 1767 | loss: 0.0310573 | val_loss: 0.0311161 | Time: 2975.37 ms
[2022-04-10 10:58:37	                main:574]	:	INFO	:	Epoch 1768 | loss: 0.0310572 | val_loss: 0.0311123 | Time: 2992.33 ms
[2022-04-10 10:58:40	                main:574]	:	INFO	:	Epoch 1769 | loss: 0.0310556 | val_loss: 0.0311175 | Time: 3090.57 ms
[2022-04-10 10:58:43	                main:574]	:	INFO	:	Epoch 1770 | loss: 0.0310556 | val_loss: 0.0311113 | Time: 3050.89 ms
[2022-04-10 10:58:46	                main:574]	:	INFO	:	Epoch 1771 | loss: 0.0310583 | val_loss: 0.0311149 | Time: 2988.2 ms
[2022-04-10 10:58:49	                main:574]	:	INFO	:	Epoch 1772 | loss: 0.0310572 | val_loss: 0.0311174 | Time: 3009.91 ms
[2022-04-10 10:58:52	                main:574]	:	INFO	:	Epoch 1773 | loss: 0.0310541 | val_loss: 0.0311198 | Time: 3080.62 ms
[2022-04-10 10:58:55	                main:574]	:	INFO	:	Epoch 1774 | loss: 0.0310535 | val_loss: 0.0311252 | Time: 3011.16 ms
[2022-04-10 10:58:58	                main:574]	:	INFO	:	Epoch 1775 | loss: 0.0310522 | val_loss: 0.0311189 | Time: 2996.99 ms
[2022-04-10 10:59:01	                main:574]	:	INFO	:	Epoch 1776 | loss: 0.0310511 | val_loss: 0.0311184 | Time: 3025.46 ms
[2022-04-10 10:59:04	                main:574]	:	INFO	:	Epoch 1777 | loss: 0.0310566 | val_loss: 0.0311185 | Time: 3062.59 ms
[2022-04-10 10:59:07	                main:574]	:	INFO	:	Epoch 1778 | loss: 0.0310566 | val_loss: 0.0311184 | Time: 3117.57 ms
[2022-04-10 10:59:10	                main:574]	:	INFO	:	Epoch 1779 | loss: 0.0310556 | val_loss: 0.0311147 | Time: 2972.65 ms
[2022-04-10 10:59:13	                main:574]	:	INFO	:	Epoch 1780 | loss: 0.0310532 | val_loss: 0.0311188 | Time: 3006.34 ms
[2022-04-10 10:59:16	                main:574]	:	INFO	:	Epoch 1781 | loss: 0.031053 | val_loss: 0.0311172 | Time: 3002.18 ms
[2022-04-10 10:59:19	                main:574]	:	INFO	:	Epoch 1782 | loss: 0.0310553 | val_loss: 0.0311191 | Time: 3113.16 ms
[2022-04-10 10:59:22	                main:574]	:	INFO	:	Epoch 1783 | loss: 0.0310536 | val_loss: 0.0311104 | Time: 3004.44 ms
[2022-04-10 10:59:25	                main:574]	:	INFO	:	Epoch 1784 | loss: 0.0310612 | val_loss: 0.0311232 | Time: 2953.15 ms
[2022-04-10 10:59:28	                main:574]	:	INFO	:	Epoch 1785 | loss: 0.0310685 | val_loss: 0.0311201 | Time: 3043.09 ms
[2022-04-10 10:59:31	                main:574]	:	INFO	:	Epoch 1786 | loss: 0.0310685 | val_loss: 0.0311172 | Time: 3017.35 ms
[2022-04-10 10:59:34	                main:574]	:	INFO	:	Epoch 1787 | loss: 0.0310641 | val_loss: 0.0311128 | Time: 3066.37 ms
[2022-04-10 10:59:37	                main:574]	:	INFO	:	Epoch 1788 | loss: 0.0310609 | val_loss: 0.0311207 | Time: 2930.62 ms
[2022-04-10 10:59:40	                main:574]	:	INFO	:	Epoch 1789 | loss: 0.0310592 | val_loss: 0.0311179 | Time: 2998.04 ms
[2022-04-10 10:59:43	                main:574]	:	INFO	:	Epoch 1790 | loss: 0.0310557 | val_loss: 0.0311227 | Time: 3043.01 ms
[2022-04-10 10:59:46	                main:574]	:	INFO	:	Epoch 1791 | loss: 0.0310559 | val_loss: 0.031119 | Time: 3020.56 ms
[2022-04-10 10:59:49	                main:574]	:	INFO	:	Epoch 1792 | loss: 0.0310541 | val_loss: 0.0311274 | Time: 2988.12 ms
[2022-04-10 10:59:52	                main:574]	:	INFO	:	Epoch 1793 | loss: 0.0310566 | val_loss: 0.0311199 | Time: 3048.86 ms
[2022-04-10 10:59:55	                main:574]	:	INFO	:	Epoch 1794 | loss: 0.0310532 | val_loss: 0.0311158 | Time: 3021.42 ms
[2022-04-10 10:59:58	                main:574]	:	INFO	:	Epoch 1795 | loss: 0.0310529 | val_loss: 0.03112 | Time: 3028.98 ms
[2022-04-10 11:00:02	                main:574]	:	INFO	:	Epoch 1796 | loss: 0.0310504 | val_loss: 0.0311258 | Time: 3131.34 ms
[2022-04-10 11:00:04	                main:574]	:	INFO	:	Epoch 1797 | loss: 0.0310521 | val_loss: 0.031116 | Time: 2978.71 ms
[2022-04-10 11:00:08	                main:574]	:	INFO	:	Epoch 1798 | loss: 0.0310543 | val_loss: 0.0311231 | Time: 3038.62 ms
[2022-04-10 11:00:11	                main:574]	:	INFO	:	Epoch 1799 | loss: 0.031051 | val_loss: 0.0311203 | Time: 3022.77 ms
[2022-04-10 11:00:13	                main:574]	:	INFO	:	Epoch 1800 | loss: 0.0310562 | val_loss: 0.0311159 | Time: 2918.84 ms
[2022-04-10 11:00:16	                main:574]	:	INFO	:	Epoch 1801 | loss: 0.0310562 | val_loss: 0.0311258 | Time: 2954.9 ms
[2022-04-10 11:00:19	                main:574]	:	INFO	:	Epoch 1802 | loss: 0.0310554 | val_loss: 0.0311233 | Time: 2962.42 ms
[2022-04-10 11:00:22	                main:574]	:	INFO	:	Epoch 1803 | loss: 0.0310506 | val_loss: 0.0311201 | Time: 2957.32 ms
[2022-04-10 11:00:26	                main:574]	:	INFO	:	Epoch 1804 | loss: 0.0310514 | val_loss: 0.031127 | Time: 3198.76 ms
[2022-04-10 11:00:29	                main:574]	:	INFO	:	Epoch 1805 | loss: 0.0310504 | val_loss: 0.0311285 | Time: 3400.87 ms
[2022-04-10 11:33:24	                main:574]	:	INFO	:	Epoch 1806 | loss: 0.0310524 | val_loss: 0.0311249 | Time: 1.97539e+06 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 2060)
[2022-04-10 11:55:24	                main:435]	:	INFO	:	Set logging level to 1
[2022-04-10 11:55:24	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-04-10 11:55:24	                main:444]	:	INFO	:	Resolving all filenames
[2022-04-10 11:55:24	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-10 11:55:24	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-10 11:55:24	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-10 11:55:24	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-10 11:55:24	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-10 11:55:24	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-04-10 11:55:24	                main:474]	:	INFO	:	Configuration: 
[2022-04-10 11:55:24	                main:475]	:	INFO	:	    Model type: GRU
[2022-04-10 11:55:24	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-04-10 11:55:24	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-04-10 11:55:24	                main:478]	:	INFO	:	    Batch Size: 128
[2022-04-10 11:55:24	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-04-10 11:55:24	                main:480]	:	INFO	:	    Patience: 10
[2022-04-10 11:55:24	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-04-10 11:55:24	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-04-10 11:55:24	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-04-10 11:55:24	                main:484]	:	INFO	:	    # Threads: 1
[2022-04-10 11:55:24	                main:486]	:	INFO	:	Preparing Dataset
[2022-04-10 11:55:24	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-10 11:55:24	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-10 11:55:25	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-04-10 11:55:25	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-10 11:55:25	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-10 11:55:25	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-04-10 11:55:25	                main:494]	:	INFO	:	Creating Model
[2022-04-10 11:55:25	                main:507]	:	INFO	:	Preparing config file
[2022-04-10 11:55:25	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-04-10 11:55:25	                main:512]	:	INFO	:	Loading config
[2022-04-10 11:55:25	                main:514]	:	INFO	:	Loading state
[2022-04-10 11:55:26	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2022-04-10 11:55:26	                main:562]	:	INFO	:	Starting Training
[2022-04-10 11:55:30	                main:574]	:	INFO	:	Epoch 1807 | loss: 0.0310806 | val_loss: 0.031128 | Time: 3461.8 ms
[2022-04-10 11:55:33	                main:574]	:	INFO	:	Epoch 1808 | loss: 0.0310564 | val_loss: 0.0311226 | Time: 3052.41 ms
[2022-04-10 11:55:36	                main:574]	:	INFO	:	Epoch 1809 | loss: 0.0310517 | val_loss: 0.0311258 | Time: 3015.9 ms
[2022-04-10 11:55:39	                main:574]	:	INFO	:	Epoch 1810 | loss: 0.0310507 | val_loss: 0.031121 | Time: 3038.77 ms
[2022-04-10 11:55:42	                main:574]	:	INFO	:	Epoch 1811 | loss: 0.0310526 | val_loss: 0.0311194 | Time: 3102.02 ms
[2022-04-10 11:55:45	                main:574]	:	INFO	:	Epoch 1812 | loss: 0.0310484 | val_loss: 0.0311276 | Time: 3019.51 ms
[2022-04-10 11:55:48	                main:574]	:	INFO	:	Epoch 1813 | loss: 0.0310497 | val_loss: 0.031114 | Time: 3001.45 ms
[2022-04-10 11:55:51	                main:574]	:	INFO	:	Epoch 1814 | loss: 0.0310521 | val_loss: 0.0311223 | Time: 3035.85 ms
[2022-04-10 11:55:54	                main:574]	:	INFO	:	Epoch 1815 | loss: 0.0310518 | val_loss: 0.0311241 | Time: 3123.5 ms
[2022-04-10 11:55:57	                main:574]	:	INFO	:	Epoch 1816 | loss: 0.0310493 | val_loss: 0.0311207 | Time: 3019.09 ms
[2022-04-10 11:56:00	                main:574]	:	INFO	:	Epoch 1817 | loss: 0.0310533 | val_loss: 0.0311258 | Time: 3168.06 ms
[2022-04-10 11:56:03	                main:574]	:	INFO	:	Epoch 1818 | loss: 0.0310537 | val_loss: 0.0311199 | Time: 3099.93 ms
[2022-04-10 11:56:06	                main:574]	:	INFO	:	Epoch 1819 | loss: 0.0310547 | val_loss: 0.0311243 | Time: 3200.8 ms
[2022-04-10 11:56:10	                main:574]	:	INFO	:	Epoch 1820 | loss: 0.0310495 | val_loss: 0.0311256 | Time: 3094.03 ms
[2022-04-10 11:56:13	                main:574]	:	INFO	:	Epoch 1821 | loss: 0.0310504 | val_loss: 0.0311283 | Time: 3083.94 ms
[2022-04-10 11:56:16	                main:574]	:	INFO	:	Epoch 1822 | loss: 0.0310528 | val_loss: 0.0311304 | Time: 2966.41 ms
[2022-04-10 11:56:19	                main:574]	:	INFO	:	Epoch 1823 | loss: 0.0310557 | val_loss: 0.0311382 | Time: 3097.42 ms
[2022-04-10 11:56:22	                main:574]	:	INFO	:	Epoch 1824 | loss: 0.0310465 | val_loss: 0.0311244 | Time: 3044.4 ms
[2022-04-10 11:56:25	                main:574]	:	INFO	:	Epoch 1825 | loss: 0.0310482 | val_loss: 0.0311244 | Time: 3162.58 ms
[2022-04-10 11:56:28	                main:574]	:	INFO	:	Epoch 1826 | loss: 0.0310451 | val_loss: 0.0311263 | Time: 3056.3 ms
[2022-04-10 11:56:31	                main:574]	:	INFO	:	Epoch 1827 | loss: 0.0310423 | val_loss: 0.0311361 | Time: 3121.45 ms
[2022-04-10 11:56:34	                main:574]	:	INFO	:	Epoch 1828 | loss: 0.0310405 | val_loss: 0.031127 | Time: 3130.59 ms
[2022-04-10 11:56:37	                main:574]	:	INFO	:	Epoch 1829 | loss: 0.0310532 | val_loss: 0.0311294 | Time: 3037.53 ms
[2022-04-10 11:56:40	                main:574]	:	INFO	:	Epoch 1830 | loss: 0.0310587 | val_loss: 0.0311307 | Time: 3056.71 ms
[2022-04-10 11:56:43	                main:574]	:	INFO	:	Epoch 1831 | loss: 0.0310532 | val_loss: 0.0311263 | Time: 2882.59 ms
[2022-04-10 11:56:46	                main:574]	:	INFO	:	Epoch 1832 | loss: 0.0310558 | val_loss: 0.0311247 | Time: 2941.82 ms
[2022-04-10 11:56:49	                main:574]	:	INFO	:	Epoch 1833 | loss: 0.0310552 | val_loss: 0.0311359 | Time: 2930.28 ms
[2022-04-10 11:56:52	                main:574]	:	INFO	:	Epoch 1834 | loss: 0.0310567 | val_loss: 0.0311226 | Time: 2868.07 ms
[2022-04-10 11:56:55	                main:574]	:	INFO	:	Epoch 1835 | loss: 0.0310505 | val_loss: 0.0311315 | Time: 2975.85 ms
[2022-04-10 11:56:58	                main:574]	:	INFO	:	Epoch 1836 | loss: 0.0310486 | val_loss: 0.0311247 | Time: 2963.36 ms
[2022-04-10 11:57:01	                main:574]	:	INFO	:	Epoch 1837 | loss: 0.0310517 | val_loss: 0.0311256 | Time: 3049.43 ms
[2022-04-10 11:57:04	                main:574]	:	INFO	:	Epoch 1838 | loss: 0.0310484 | val_loss: 0.0311252 | Time: 3059.35 ms
[2022-04-10 11:57:07	                main:574]	:	INFO	:	Epoch 1839 | loss: 0.0310472 | val_loss: 0.0311285 | Time: 2968.81 ms
[2022-04-10 11:57:10	                main:574]	:	INFO	:	Epoch 1840 | loss: 0.0310456 | val_loss: 0.031134 | Time: 3012.27 ms
[2022-04-10 11:57:13	                main:574]	:	INFO	:	Epoch 1841 | loss: 0.0310429 | val_loss: 0.0311201 | Time: 3025.98 ms
[2022-04-10 11:57:16	                main:574]	:	INFO	:	Epoch 1842 | loss: 0.0310443 | val_loss: 0.0311276 | Time: 2882.2 ms
[2022-04-10 11:57:19	                main:574]	:	INFO	:	Epoch 1843 | loss: 0.0310514 | val_loss: 0.0311255 | Time: 2932.6 ms
[2022-04-10 11:57:22	                main:574]	:	INFO	:	Epoch 1844 | loss: 0.0310489 | val_loss: 0.0311312 | Time: 3010.21 ms
[2022-04-10 11:57:25	                main:574]	:	INFO	:	Epoch 1845 | loss: 0.0310474 | val_loss: 0.0311245 | Time: 3007.33 ms
[2022-04-10 11:57:28	                main:574]	:	INFO	:	Epoch 1846 | loss: 0.0310473 | val_loss: 0.0311293 | Time: 2912.66 ms
[2022-04-10 11:57:31	                main:574]	:	INFO	:	Epoch 1847 | loss: 0.0310424 | val_loss: 0.0311261 | Time: 2877.06 ms
[2022-04-10 11:57:34	                main:574]	:	INFO	:	Epoch 1848 | loss: 0.0310447 | val_loss: 0.0311269 | Time: 2915.18 ms
[2022-04-10 11:57:37	                main:574]	:	INFO	:	Epoch 1849 | loss: 0.0310541 | val_loss: 0.0311158 | Time: 2955.22 ms
[2022-04-10 11:57:40	                main:574]	:	INFO	:	Epoch 1850 | loss: 0.0310587 | val_loss: 0.0311233 | Time: 2933.9 ms
[2022-04-10 11:57:43	                main:574]	:	INFO	:	Epoch 1851 | loss: 0.0310591 | val_loss: 0.0311266 | Time: 2984.98 ms
[2022-04-10 11:57:46	                main:574]	:	INFO	:	Epoch 1852 | loss: 0.031052 | val_loss: 0.0311289 | Time: 3010.49 ms
[2022-04-10 11:57:49	                main:574]	:	INFO	:	Epoch 1853 | loss: 0.0310512 | val_loss: 0.0311267 | Time: 2999.26 ms
[2022-04-10 11:57:52	                main:574]	:	INFO	:	Epoch 1854 | loss: 0.0310457 | val_loss: 0.0311295 | Time: 2968.53 ms
[2022-04-10 11:57:55	                main:574]	:	INFO	:	Epoch 1855 | loss: 0.031043 | val_loss: 0.0311325 | Time: 3070.87 ms
[2022-04-10 11:57:58	                main:574]	:	INFO	:	Epoch 1856 | loss: 0.0310425 | val_loss: 0.0311182 | Time: 2990.43 ms
[2022-04-10 11:58:01	                main:574]	:	INFO	:	Epoch 1857 | loss: 0.0310443 | val_loss: 0.031135 | Time: 3077.51 ms
[2022-04-10 11:58:04	                main:574]	:	INFO	:	Epoch 1858 | loss: 0.0310461 | val_loss: 0.0311281 | Time: 3006.06 ms
[2022-04-10 11:58:07	                main:574]	:	INFO	:	Epoch 1859 | loss: 0.0310544 | val_loss: 0.0311146 | Time: 3036.59 ms
[2022-04-10 11:58:10	                main:574]	:	INFO	:	Epoch 1860 | loss: 0.0310573 | val_loss: 0.0311248 | Time: 3029.06 ms
[2022-04-10 11:58:13	                main:574]	:	INFO	:	Epoch 1861 | loss: 0.0310529 | val_loss: 0.0311258 | Time: 3037.87 ms
[2022-04-10 11:58:16	                main:574]	:	INFO	:	Epoch 1862 | loss: 0.0310474 | val_loss: 0.0311342 | Time: 2987.75 ms
[2022-04-10 11:58:19	                main:574]	:	INFO	:	Epoch 1863 | loss: 0.0310449 | val_loss: 0.0311303 | Time: 3021.1 ms
[2022-04-10 11:58:22	                main:574]	:	INFO	:	Epoch 1864 | loss: 0.0310421 | val_loss: 0.0311301 | Time: 3069.84 ms
[2022-04-10 11:58:25	                main:574]	:	INFO	:	Epoch 1865 | loss: 0.0310406 | val_loss: 0.0311301 | Time: 3053.19 ms
[2022-04-10 11:58:28	                main:574]	:	INFO	:	Epoch 1866 | loss: 0.03104 | val_loss: 0.0311318 | Time: 3046.64 ms
[2022-04-10 11:58:31	                main:574]	:	INFO	:	Epoch 1867 | loss: 0.0310423 | val_loss: 0.0311346 | Time: 2970.97 ms
[2022-04-10 11:58:34	                main:574]	:	INFO	:	Epoch 1868 | loss: 0.0310419 | val_loss: 0.0311224 | Time: 3009.35 ms
[2022-04-10 11:58:37	                main:574]	:	INFO	:	Epoch 1869 | loss: 0.0310398 | val_loss: 0.0311312 | Time: 2996.08 ms
[2022-04-10 11:58:40	                main:574]	:	INFO	:	Epoch 1870 | loss: 0.0310413 | val_loss: 0.0311252 | Time: 3022.47 ms
[2022-04-10 11:58:43	                main:574]	:	INFO	:	Epoch 1871 | loss: 0.0310422 | val_loss: 0.0311337 | Time: 2979.9 ms
[2022-04-10 11:58:46	                main:574]	:	INFO	:	Epoch 1872 | loss: 0.0310432 | val_loss: 0.0311251 | Time: 2967.62 ms
[2022-04-10 11:58:49	                main:574]	:	INFO	:	Epoch 1873 | loss: 0.0310451 | val_loss: 0.0311296 | Time: 3024.12 ms
[2022-04-10 11:58:52	                main:574]	:	INFO	:	Epoch 1874 | loss: 0.0310419 | val_loss: 0.0311285 | Time: 3043.98 ms
[2022-04-10 11:58:55	                main:574]	:	INFO	:	Epoch 1875 | loss: 0.0310392 | val_loss: 0.0311334 | Time: 3060.97 ms
[2022-04-10 11:58:58	                main:574]	:	INFO	:	Epoch 1876 | loss: 0.0310407 | val_loss: 0.0311329 | Time: 3008.61 ms
[2022-04-10 11:59:01	                main:574]	:	INFO	:	Epoch 1877 | loss: 0.0310384 | val_loss: 0.031123 | Time: 3114.93 ms
[2022-04-10 11:59:04	                main:574]	:	INFO	:	Epoch 1878 | loss: 0.0310384 | val_loss: 0.0311247 | Time: 2967.58 ms
[2022-04-10 11:59:07	                main:574]	:	INFO	:	Epoch 1879 | loss: 0.0310384 | val_loss: 0.0311345 | Time: 3066.54 ms
[2022-04-10 11:59:10	                main:574]	:	INFO	:	Epoch 1880 | loss: 0.0310397 | val_loss: 0.0311221 | Time: 3025.94 ms
[2022-04-10 11:59:13	                main:574]	:	INFO	:	Epoch 1881 | loss: 0.0310397 | val_loss: 0.0311259 | Time: 3079.62 ms
[2022-04-10 11:59:16	                main:574]	:	INFO	:	Epoch 1882 | loss: 0.0310414 | val_loss: 0.0311334 | Time: 3070.56 ms
[2022-04-10 11:59:19	                main:574]	:	INFO	:	Epoch 1883 | loss: 0.0310413 | val_loss: 0.0311246 | Time: 3004.64 ms
[2022-04-10 11:59:23	                main:574]	:	INFO	:	Epoch 1884 | loss: 0.0310396 | val_loss: 0.0311262 | Time: 3076.28 ms
[2022-04-10 11:59:26	                main:574]	:	INFO	:	Epoch 1885 | loss: 0.0310388 | val_loss: 0.0311263 | Time: 3123.9 ms
[2022-04-10 11:59:29	                main:574]	:	INFO	:	Epoch 1886 | loss: 0.0310378 | val_loss: 0.0311335 | Time: 2998.99 ms
[2022-04-10 11:59:32	                main:574]	:	INFO	:	Epoch 1887 | loss: 0.0310385 | val_loss: 0.0311291 | Time: 3000.83 ms
[2022-04-10 11:59:35	                main:574]	:	INFO	:	Epoch 1888 | loss: 0.0310402 | val_loss: 0.031124 | Time: 3045.66 ms
[2022-04-10 11:59:38	                main:574]	:	INFO	:	Epoch 1889 | loss: 0.0310523 | val_loss: 0.0311229 | Time: 3080.52 ms
[2022-04-10 11:59:41	                main:574]	:	INFO	:	Epoch 1890 | loss: 0.0310512 | val_loss: 0.0311136 | Time: 3035.61 ms
[2022-04-10 11:59:44	                main:574]	:	INFO	:	Epoch 1891 | loss: 0.0310524 | val_loss: 0.0311352 | Time: 3028.56 ms
[2022-04-10 11:59:47	                main:574]	:	INFO	:	Epoch 1892 | loss: 0.0310792 | val_loss: 0.0311534 | Time: 3024.56 ms
[2022-04-10 11:59:50	                main:574]	:	INFO	:	Epoch 1893 | loss: 0.0320532 | val_loss: 0.0321506 | Time: 3044.01 ms
[2022-04-10 11:59:53	                main:574]	:	INFO	:	Epoch 1894 | loss: 0.0321235 | val_loss: 0.0314446 | Time: 3058.6 ms
[2022-04-10 11:59:56	                main:574]	:	INFO	:	Epoch 1895 | loss: 0.0312994 | val_loss: 0.0311832 | Time: 3063.66 ms
[2022-04-10 11:59:59	                main:574]	:	INFO	:	Epoch 1896 | loss: 0.0311628 | val_loss: 0.0311538 | Time: 3000.73 ms
[2022-04-10 12:00:02	                main:574]	:	INFO	:	Epoch 1897 | loss: 0.0311299 | val_loss: 0.0311293 | Time: 3117.74 ms
[2022-04-10 12:00:05	                main:574]	:	INFO	:	Epoch 1898 | loss: 0.03111 | val_loss: 0.0311269 | Time: 2998.71 ms
[2022-04-10 12:00:08	                main:574]	:	INFO	:	Epoch 1899 | loss: 0.0311036 | val_loss: 0.031128 | Time: 3007.62 ms
[2022-04-10 12:00:11	                main:574]	:	INFO	:	Epoch 1900 | loss: 0.0311026 | val_loss: 0.0311492 | Time: 3078.46 ms
[2022-04-10 12:00:14	                main:574]	:	INFO	:	Epoch 1901 | loss: 0.0311165 | val_loss: 0.0311171 | Time: 3001.51 ms
[2022-04-10 12:00:17	                main:574]	:	INFO	:	Epoch 1902 | loss: 0.0311001 | val_loss: 0.0311205 | Time: 3051.2 ms
[2022-04-10 12:00:20	                main:574]	:	INFO	:	Epoch 1903 | loss: 0.0310916 | val_loss: 0.031117 | Time: 3033 ms
[2022-04-10 12:00:23	                main:574]	:	INFO	:	Epoch 1904 | loss: 0.0310878 | val_loss: 0.0311175 | Time: 2960.25 ms
[2022-04-10 12:34:31	                main:574]	:	INFO	:	Epoch 1905 | loss: 0.0310874 | val_loss: 0.0311197 | Time: 2.04764e+06 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 2060)
[2022-04-10 20:36:03	                main:435]	:	INFO	:	Set logging level to 1
[2022-04-10 20:36:03	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-04-10 20:36:03	                main:444]	:	INFO	:	Resolving all filenames
[2022-04-10 20:36:03	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-10 20:36:03	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-10 20:36:03	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-10 20:36:03	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-10 20:36:03	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-10 20:36:03	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-04-10 20:36:03	                main:474]	:	INFO	:	Configuration: 
[2022-04-10 20:36:03	                main:475]	:	INFO	:	    Model type: GRU
[2022-04-10 20:36:03	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-04-10 20:36:03	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-04-10 20:36:03	                main:478]	:	INFO	:	    Batch Size: 128
[2022-04-10 20:36:03	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-04-10 20:36:03	                main:480]	:	INFO	:	    Patience: 10
[2022-04-10 20:36:03	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-04-10 20:36:03	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-04-10 20:36:03	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-04-10 20:36:03	                main:484]	:	INFO	:	    # Threads: 1
[2022-04-10 20:36:03	                main:486]	:	INFO	:	Preparing Dataset
[2022-04-10 20:36:03	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-10 20:36:03	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-10 20:36:04	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-04-10 20:36:04	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-10 20:36:04	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-10 20:36:04	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-04-10 20:36:04	                main:494]	:	INFO	:	Creating Model
[2022-04-10 20:36:04	                main:507]	:	INFO	:	Preparing config file
[2022-04-10 20:36:04	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-04-10 20:36:04	                main:512]	:	INFO	:	Loading config
[2022-04-10 20:36:04	                main:514]	:	INFO	:	Loading state
[2022-04-10 20:36:05	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2022-04-10 20:36:05	                main:562]	:	INFO	:	Starting Training
[2022-04-10 20:36:09	                main:574]	:	INFO	:	Epoch 1906 | loss: 0.0314265 | val_loss: 0.0311605 | Time: 3495.59 ms
[2022-04-10 20:52:38	                main:574]	:	INFO	:	Epoch 1907 | loss: 0.0311092 | val_loss: 0.0311333 | Time: 989794 ms
[2022-04-10 20:52:42	                main:574]	:	INFO	:	Epoch 1908 | loss: 0.031076 | val_loss: 0.0311258 | Time: 3157.22 ms
[2022-04-10 20:52:45	                main:574]	:	INFO	:	Epoch 1909 | loss: 0.0310586 | val_loss: 0.0311182 | Time: 3236.05 ms
[2022-04-10 20:52:48	                main:574]	:	INFO	:	Epoch 1910 | loss: 0.0310527 | val_loss: 0.0311212 | Time: 3126.83 ms
[2022-04-10 20:52:51	                main:574]	:	INFO	:	Epoch 1911 | loss: 0.0310508 | val_loss: 0.0311225 | Time: 3114.85 ms
[2022-04-10 20:52:54	                main:574]	:	INFO	:	Epoch 1912 | loss: 0.0310473 | val_loss: 0.0311216 | Time: 3146.23 ms
[2022-04-10 20:52:57	                main:574]	:	INFO	:	Epoch 1913 | loss: 0.0310464 | val_loss: 0.031136 | Time: 2983.31 ms
[2022-04-10 20:53:00	                main:574]	:	INFO	:	Epoch 1914 | loss: 0.0310467 | val_loss: 0.0311289 | Time: 2939.51 ms
[2022-04-10 20:53:03	                main:574]	:	INFO	:	Epoch 1915 | loss: 0.0310443 | val_loss: 0.031122 | Time: 3061.89 ms
[2022-04-10 20:53:06	                main:574]	:	INFO	:	Epoch 1916 | loss: 0.0310451 | val_loss: 0.0311189 | Time: 2960.89 ms
[2022-04-10 20:53:09	                main:574]	:	INFO	:	Epoch 1917 | loss: 0.031045 | val_loss: 0.0311301 | Time: 3030.74 ms
[2022-04-10 20:53:12	                main:574]	:	INFO	:	Epoch 1918 | loss: 0.0310463 | val_loss: 0.0311297 | Time: 3012.66 ms
[2022-04-10 20:53:15	                main:574]	:	INFO	:	Epoch 1919 | loss: 0.0310452 | val_loss: 0.0311172 | Time: 2932.74 ms
[2022-04-10 20:53:18	                main:574]	:	INFO	:	Epoch 1920 | loss: 0.0310448 | val_loss: 0.0311228 | Time: 2934.69 ms
[2022-04-10 20:53:21	                main:574]	:	INFO	:	Epoch 1921 | loss: 0.0310465 | val_loss: 0.0311266 | Time: 2975.01 ms
[2022-04-10 20:53:24	                main:574]	:	INFO	:	Epoch 1922 | loss: 0.0310479 | val_loss: 0.0311236 | Time: 2986.91 ms
[2022-04-10 20:53:27	                main:574]	:	INFO	:	Epoch 1923 | loss: 0.0310447 | val_loss: 0.0311251 | Time: 2941.99 ms
[2022-04-10 20:53:30	                main:574]	:	INFO	:	Epoch 1924 | loss: 0.0310426 | val_loss: 0.0311297 | Time: 3011.73 ms
[2022-04-10 20:53:33	                main:574]	:	INFO	:	Epoch 1925 | loss: 0.0310421 | val_loss: 0.0311237 | Time: 2999.28 ms
[2022-04-10 20:53:36	                main:574]	:	INFO	:	Epoch 1926 | loss: 0.0310438 | val_loss: 0.0311352 | Time: 2976.22 ms
[2022-04-10 20:53:39	                main:574]	:	INFO	:	Epoch 1927 | loss: 0.0310426 | val_loss: 0.0311263 | Time: 3024.29 ms
[2022-04-10 20:53:42	                main:574]	:	INFO	:	Epoch 1928 | loss: 0.0310394 | val_loss: 0.0311333 | Time: 2996.89 ms
[2022-04-10 20:53:45	                main:574]	:	INFO	:	Epoch 1929 | loss: 0.0310433 | val_loss: 0.0311286 | Time: 2965.46 ms
[2022-04-10 20:53:48	                main:574]	:	INFO	:	Epoch 1930 | loss: 0.0310448 | val_loss: 0.0311299 | Time: 2997.78 ms
[2022-04-10 20:53:51	                main:574]	:	INFO	:	Epoch 1931 | loss: 0.031045 | val_loss: 0.0311321 | Time: 3035.3 ms
[2022-04-10 20:53:54	                main:574]	:	INFO	:	Epoch 1932 | loss: 0.031043 | val_loss: 0.0311376 | Time: 2992.82 ms
[2022-04-10 20:53:57	                main:574]	:	INFO	:	Epoch 1933 | loss: 0.031039 | val_loss: 0.0311238 | Time: 3050.84 ms
[2022-04-10 20:54:00	                main:574]	:	INFO	:	Epoch 1934 | loss: 0.0310378 | val_loss: 0.0311245 | Time: 3082.59 ms
[2022-04-10 20:54:03	                main:574]	:	INFO	:	Epoch 1935 | loss: 0.0310373 | val_loss: 0.0311207 | Time: 3059.66 ms
[2022-04-10 20:54:06	                main:574]	:	INFO	:	Epoch 1936 | loss: 0.0310397 | val_loss: 0.031134 | Time: 2973.37 ms
[2022-04-10 20:54:09	                main:574]	:	INFO	:	Epoch 1937 | loss: 0.0310426 | val_loss: 0.0311276 | Time: 3082.72 ms
[2022-04-10 20:54:12	                main:574]	:	INFO	:	Epoch 1938 | loss: 0.0310451 | val_loss: 0.0311133 | Time: 3025.05 ms
[2022-04-10 20:54:15	                main:574]	:	INFO	:	Epoch 1939 | loss: 0.0310483 | val_loss: 0.0311208 | Time: 2988.24 ms
[2022-04-10 20:54:18	                main:574]	:	INFO	:	Epoch 1940 | loss: 0.0310428 | val_loss: 0.0311149 | Time: 3007.8 ms
[2022-04-10 20:54:21	                main:574]	:	INFO	:	Epoch 1941 | loss: 0.0310447 | val_loss: 0.0311181 | Time: 2980.92 ms
[2022-04-10 20:54:24	                main:574]	:	INFO	:	Epoch 1942 | loss: 0.0310435 | val_loss: 0.0311207 | Time: 2954.8 ms
[2022-04-10 20:54:27	                main:574]	:	INFO	:	Epoch 1943 | loss: 0.031041 | val_loss: 0.0311221 | Time: 3069.8 ms
[2022-04-10 20:54:30	                main:574]	:	INFO	:	Epoch 1944 | loss: 0.0310444 | val_loss: 0.0311259 | Time: 3038.29 ms
[2022-04-10 20:54:34	                main:574]	:	INFO	:	Epoch 1945 | loss: 0.0310439 | val_loss: 0.031124 | Time: 3054.5 ms
[2022-04-10 20:54:37	                main:574]	:	INFO	:	Epoch 1946 | loss: 0.0310439 | val_loss: 0.0311256 | Time: 3014.73 ms
[2022-04-10 20:54:39	                main:574]	:	INFO	:	Epoch 1947 | loss: 0.0310416 | val_loss: 0.0311277 | Time: 2950.29 ms
[2022-04-10 20:54:42	                main:574]	:	INFO	:	Epoch 1948 | loss: 0.0310385 | val_loss: 0.0311193 | Time: 2934.8 ms
[2022-04-10 20:54:45	                main:574]	:	INFO	:	Epoch 1949 | loss: 0.0310348 | val_loss: 0.0311209 | Time: 3035.18 ms
[2022-04-10 20:54:49	                main:574]	:	INFO	:	Epoch 1950 | loss: 0.0310376 | val_loss: 0.0311275 | Time: 3043.96 ms
[2022-04-10 20:54:52	                main:574]	:	INFO	:	Epoch 1951 | loss: 0.0310427 | val_loss: 0.0311193 | Time: 3004.92 ms
[2022-04-10 20:54:55	                main:574]	:	INFO	:	Epoch 1952 | loss: 0.0310367 | val_loss: 0.0311318 | Time: 3049.4 ms
[2022-04-10 20:54:58	                main:574]	:	INFO	:	Epoch 1953 | loss: 0.0310359 | val_loss: 0.0311243 | Time: 3041.05 ms
[2022-04-10 20:55:01	                main:574]	:	INFO	:	Epoch 1954 | loss: 0.0310408 | val_loss: 0.0311354 | Time: 3293.96 ms
[2022-04-10 20:55:04	                main:574]	:	INFO	:	Epoch 1955 | loss: 0.0310397 | val_loss: 0.0311288 | Time: 3050.92 ms
[2022-04-10 20:55:07	                main:574]	:	INFO	:	Epoch 1956 | loss: 0.0310387 | val_loss: 0.03112 | Time: 3176.08 ms
[2022-04-10 20:55:10	                main:574]	:	INFO	:	Epoch 1957 | loss: 0.0310414 | val_loss: 0.0311288 | Time: 3047.88 ms
[2022-04-10 20:55:13	                main:574]	:	INFO	:	Epoch 1958 | loss: 0.0310627 | val_loss: 0.0311254 | Time: 3106.03 ms
[2022-04-10 20:55:16	                main:574]	:	INFO	:	Epoch 1959 | loss: 0.0310576 | val_loss: 0.0311199 | Time: 2990.55 ms
[2022-04-10 20:55:19	                main:574]	:	INFO	:	Epoch 1960 | loss: 0.0310498 | val_loss: 0.0311125 | Time: 2998.4 ms
[2022-04-10 20:55:22	                main:574]	:	INFO	:	Epoch 1961 | loss: 0.0310454 | val_loss: 0.0311342 | Time: 3027.63 ms
[2022-04-10 20:55:25	                main:574]	:	INFO	:	Epoch 1962 | loss: 0.0310434 | val_loss: 0.0311214 | Time: 3033.91 ms
[2022-04-10 20:55:28	                main:574]	:	INFO	:	Epoch 1963 | loss: 0.0310415 | val_loss: 0.0311315 | Time: 2953.66 ms
[2022-04-10 20:55:31	                main:574]	:	INFO	:	Epoch 1964 | loss: 0.0310403 | val_loss: 0.0311238 | Time: 2965.26 ms
[2022-04-10 20:55:34	                main:574]	:	INFO	:	Epoch 1965 | loss: 0.0310409 | val_loss: 0.0311266 | Time: 2958.64 ms
[2022-04-10 20:55:37	                main:574]	:	INFO	:	Epoch 1966 | loss: 0.0310426 | val_loss: 0.0311197 | Time: 3068.9 ms
[2022-04-10 20:55:40	                main:574]	:	INFO	:	Epoch 1967 | loss: 0.0310469 | val_loss: 0.0311338 | Time: 3037.88 ms
[2022-04-10 20:55:43	                main:574]	:	INFO	:	Epoch 1968 | loss: 0.0310485 | val_loss: 0.0311214 | Time: 3071.8 ms
[2022-04-10 20:55:47	                main:574]	:	INFO	:	Epoch 1969 | loss: 0.031071 | val_loss: 0.0311228 | Time: 3153.97 ms
[2022-04-10 20:55:50	                main:574]	:	INFO	:	Epoch 1970 | loss: 0.0310736 | val_loss: 0.0311212 | Time: 3003.66 ms
[2022-04-10 20:55:53	                main:574]	:	INFO	:	Epoch 1971 | loss: 0.0310771 | val_loss: 0.0311216 | Time: 2978.8 ms
[2022-04-10 20:55:56	                main:574]	:	INFO	:	Epoch 1972 | loss: 0.0310767 | val_loss: 0.0311181 | Time: 2940.91 ms
[2022-04-10 20:55:59	                main:574]	:	INFO	:	Epoch 1973 | loss: 0.0310724 | val_loss: 0.0311277 | Time: 3081.04 ms
[2022-04-10 20:56:02	                main:574]	:	INFO	:	Epoch 1974 | loss: 0.0310689 | val_loss: 0.0311095 | Time: 3109.66 ms
[2022-04-10 20:56:05	                main:574]	:	INFO	:	Epoch 1975 | loss: 0.0310634 | val_loss: 0.0311115 | Time: 3031.85 ms
[2022-04-10 20:56:08	                main:574]	:	INFO	:	Epoch 1976 | loss: 0.0310652 | val_loss: 0.0311042 | Time: 2953.71 ms
[2022-04-10 20:56:11	                main:574]	:	INFO	:	Epoch 1977 | loss: 0.0310581 | val_loss: 0.0311056 | Time: 3128.53 ms
[2022-04-10 20:56:14	                main:574]	:	INFO	:	Epoch 1978 | loss: 0.0310574 | val_loss: 0.0311045 | Time: 3108.1 ms
[2022-04-10 20:56:17	                main:574]	:	INFO	:	Epoch 1979 | loss: 0.0310573 | val_loss: 0.0311176 | Time: 3000.92 ms
[2022-04-10 20:56:20	                main:574]	:	INFO	:	Epoch 1980 | loss: 0.0310591 | val_loss: 0.0311191 | Time: 3024.62 ms
[2022-04-10 20:56:23	                main:574]	:	INFO	:	Epoch 1981 | loss: 0.0310625 | val_loss: 0.0311173 | Time: 2961.76 ms
[2022-04-10 20:56:26	                main:574]	:	INFO	:	Epoch 1982 | loss: 0.031061 | val_loss: 0.0311194 | Time: 2986.95 ms
[2022-04-10 20:56:29	                main:574]	:	INFO	:	Epoch 1983 | loss: 0.0310749 | val_loss: 0.0311114 | Time: 3017.51 ms
[2022-04-10 20:56:32	                main:574]	:	INFO	:	Epoch 1984 | loss: 0.0310732 | val_loss: 0.031117 | Time: 2985.05 ms
[2022-04-10 20:56:35	                main:574]	:	INFO	:	Epoch 1985 | loss: 0.0310672 | val_loss: 0.0311177 | Time: 3022.64 ms
[2022-04-10 20:56:38	                main:574]	:	INFO	:	Epoch 1986 | loss: 0.0310583 | val_loss: 0.0311152 | Time: 2978.29 ms
[2022-04-10 20:56:41	                main:574]	:	INFO	:	Epoch 1987 | loss: 0.0310549 | val_loss: 0.0311146 | Time: 2994.19 ms
[2022-04-10 20:56:44	                main:574]	:	INFO	:	Epoch 1988 | loss: 0.0310532 | val_loss: 0.0311194 | Time: 2971.35 ms
[2022-04-10 20:56:47	                main:574]	:	INFO	:	Epoch 1989 | loss: 0.0310507 | val_loss: 0.031119 | Time: 2941.35 ms
[2022-04-10 20:56:50	                main:574]	:	INFO	:	Epoch 1990 | loss: 0.03105 | val_loss: 0.031128 | Time: 2975.35 ms
[2022-04-10 20:56:53	                main:574]	:	INFO	:	Epoch 1991 | loss: 0.031048 | val_loss: 0.0311185 | Time: 3049.18 ms
[2022-04-10 20:56:56	                main:574]	:	INFO	:	Epoch 1992 | loss: 0.0310457 | val_loss: 0.0311106 | Time: 3038.09 ms
[2022-04-10 20:56:59	                main:574]	:	INFO	:	Epoch 1993 | loss: 0.0310463 | val_loss: 0.0311144 | Time: 2960.99 ms
[2022-04-10 20:57:02	                main:574]	:	INFO	:	Epoch 1994 | loss: 0.0310445 | val_loss: 0.0311293 | Time: 3164.44 ms
[2022-04-10 20:57:05	                main:574]	:	INFO	:	Epoch 1995 | loss: 0.031047 | val_loss: 0.0311147 | Time: 2995.81 ms
[2022-04-10 20:57:08	                main:574]	:	INFO	:	Epoch 1996 | loss: 0.0310482 | val_loss: 0.0311268 | Time: 3011.94 ms
[2022-04-10 20:57:11	                main:574]	:	INFO	:	Epoch 1997 | loss: 0.0310531 | val_loss: 0.0311199 | Time: 3029.98 ms
[2022-04-10 20:57:14	                main:574]	:	INFO	:	Epoch 1998 | loss: 0.0310493 | val_loss: 0.0311083 | Time: 2992.4 ms
[2022-04-10 20:57:17	                main:574]	:	INFO	:	Epoch 1999 | loss: 0.0310499 | val_loss: 0.0311202 | Time: 3029.35 ms
[2022-04-10 20:57:20	                main:574]	:	INFO	:	Epoch 2000 | loss: 0.0310459 | val_loss: 0.031113 | Time: 3034.18 ms
[2022-04-10 20:57:23	                main:574]	:	INFO	:	Epoch 2001 | loss: 0.0310511 | val_loss: 0.0311156 | Time: 3084.2 ms
[2022-04-10 20:57:26	                main:574]	:	INFO	:	Epoch 2002 | loss: 0.0310496 | val_loss: 0.0311175 | Time: 2999.6 ms
[2022-04-10 20:57:29	                main:574]	:	INFO	:	Epoch 2003 | loss: 0.0310516 | val_loss: 0.0311192 | Time: 3021.82 ms
[2022-04-10 20:57:32	                main:574]	:	INFO	:	Epoch 2004 | loss: 0.03105 | val_loss: 0.031118 | Time: 3048.39 ms
[2022-04-10 20:57:35	                main:574]	:	INFO	:	Epoch 2005 | loss: 0.0310464 | val_loss: 0.0311216 | Time: 3001.05 ms
[2022-04-10 20:57:38	                main:574]	:	INFO	:	Epoch 2006 | loss: 0.0310617 | val_loss: 0.0311085 | Time: 3020.35 ms
[2022-04-10 20:57:42	                main:574]	:	INFO	:	Epoch 2007 | loss: 0.0310545 | val_loss: 0.0311167 | Time: 3146.33 ms
[2022-04-10 20:57:45	                main:574]	:	INFO	:	Epoch 2008 | loss: 0.0310528 | val_loss: 0.031123 | Time: 2971.53 ms
[2022-04-10 20:57:48	                main:574]	:	INFO	:	Epoch 2009 | loss: 0.0310511 | val_loss: 0.031107 | Time: 3031.36 ms
[2022-04-10 20:57:51	                main:574]	:	INFO	:	Epoch 2010 | loss: 0.031048 | val_loss: 0.0311156 | Time: 3092.53 ms
[2022-04-10 20:57:54	                main:574]	:	INFO	:	Epoch 2011 | loss: 0.0310499 | val_loss: 0.0311219 | Time: 2964.99 ms
[2022-04-10 20:57:57	                main:574]	:	INFO	:	Epoch 2012 | loss: 0.0310558 | val_loss: 0.0311142 | Time: 3024.52 ms
[2022-04-10 20:58:00	                main:574]	:	INFO	:	Epoch 2013 | loss: 0.0310494 | val_loss: 0.0311179 | Time: 3026.25 ms
[2022-04-10 20:58:03	                main:574]	:	INFO	:	Epoch 2014 | loss: 0.0310465 | val_loss: 0.0311156 | Time: 3204.94 ms
[2022-04-10 20:58:06	                main:574]	:	INFO	:	Epoch 2015 | loss: 0.0310457 | val_loss: 0.031122 | Time: 3020.53 ms
[2022-04-10 20:58:09	                main:574]	:	INFO	:	Epoch 2016 | loss: 0.031044 | val_loss: 0.0311181 | Time: 2977.13 ms
[2022-04-10 20:58:12	                main:574]	:	INFO	:	Epoch 2017 | loss: 0.031042 | val_loss: 0.0311189 | Time: 3022.97 ms
[2022-04-10 20:58:15	                main:574]	:	INFO	:	Epoch 2018 | loss: 0.0310408 | val_loss: 0.0311213 | Time: 3105.65 ms
[2022-04-10 20:58:18	                main:574]	:	INFO	:	Epoch 2019 | loss: 0.031039 | val_loss: 0.0311249 | Time: 2964.5 ms
[2022-04-10 20:58:21	                main:574]	:	INFO	:	Epoch 2020 | loss: 0.0310403 | val_loss: 0.0311151 | Time: 2992.1 ms
[2022-04-10 20:58:24	                main:574]	:	INFO	:	Epoch 2021 | loss: 0.031048 | val_loss: 0.0311166 | Time: 2992.36 ms
[2022-04-10 20:58:27	                main:574]	:	INFO	:	Epoch 2022 | loss: 0.0310527 | val_loss: 0.031126 | Time: 2985.76 ms
[2022-04-10 20:58:30	                main:574]	:	INFO	:	Epoch 2023 | loss: 0.0310473 | val_loss: 0.0311274 | Time: 3045.28 ms
[2022-04-10 20:58:33	                main:574]	:	INFO	:	Epoch 2024 | loss: 0.0310482 | val_loss: 0.0311159 | Time: 3051.71 ms
[2022-04-10 20:58:36	                main:574]	:	INFO	:	Epoch 2025 | loss: 0.0310475 | val_loss: 0.031134 | Time: 3012.96 ms
[2022-04-10 20:58:39	                main:574]	:	INFO	:	Epoch 2026 | loss: 0.0310449 | val_loss: 0.0311198 | Time: 2959.7 ms
[2022-04-10 20:58:42	                main:574]	:	INFO	:	Epoch 2027 | loss: 0.0310468 | val_loss: 0.0311236 | Time: 3106.44 ms
[2022-04-10 20:58:45	                main:574]	:	INFO	:	Epoch 2028 | loss: 0.0310449 | val_loss: 0.0311236 | Time: 3008.86 ms
[2022-04-10 20:58:48	                main:574]	:	INFO	:	Epoch 2029 | loss: 0.0310432 | val_loss: 0.0311296 | Time: 3017.97 ms
[2022-04-10 20:58:51	                main:574]	:	INFO	:	Epoch 2030 | loss: 0.0310404 | val_loss: 0.031122 | Time: 3023.54 ms
[2022-04-10 20:58:54	                main:574]	:	INFO	:	Epoch 2031 | loss: 0.0310406 | val_loss: 0.0311318 | Time: 3118.42 ms
[2022-04-10 20:58:57	                main:574]	:	INFO	:	Epoch 2032 | loss: 0.0310414 | val_loss: 0.0311244 | Time: 3042.52 ms
[2022-04-10 20:59:00	                main:574]	:	INFO	:	Epoch 2033 | loss: 0.0310394 | val_loss: 0.0311264 | Time: 2992.95 ms
[2022-04-10 20:59:03	                main:574]	:	INFO	:	Epoch 2034 | loss: 0.0310398 | val_loss: 0.0311157 | Time: 3067.6 ms
[2022-04-10 20:59:07	                main:574]	:	INFO	:	Epoch 2035 | loss: 0.0310393 | val_loss: 0.0311156 | Time: 3049.72 ms
[2022-04-10 20:59:10	                main:574]	:	INFO	:	Epoch 2036 | loss: 0.0310434 | val_loss: 0.031138 | Time: 3034.2 ms
[2022-04-10 20:59:13	                main:574]	:	INFO	:	Epoch 2037 | loss: 0.0310417 | val_loss: 0.0311192 | Time: 3053.4 ms
[2022-04-10 20:59:16	                main:574]	:	INFO	:	Epoch 2038 | loss: 0.0310429 | val_loss: 0.0311241 | Time: 3009.1 ms
[2022-04-10 20:59:19	                main:574]	:	INFO	:	Epoch 2039 | loss: 0.0310427 | val_loss: 0.0311263 | Time: 3050.02 ms
[2022-04-10 20:59:22	                main:574]	:	INFO	:	Epoch 2040 | loss: 0.0310438 | val_loss: 0.0311197 | Time: 3099.38 ms
[2022-04-10 20:59:25	                main:574]	:	INFO	:	Epoch 2041 | loss: 0.0310428 | val_loss: 0.0311273 | Time: 3055.76 ms
[2022-04-10 20:59:28	                main:574]	:	INFO	:	Epoch 2042 | loss: 0.0310426 | val_loss: 0.0311159 | Time: 3012.17 ms
[2022-04-10 20:59:31	                main:574]	:	INFO	:	Epoch 2043 | loss: 0.0310622 | val_loss: 0.0311199 | Time: 3041.14 ms
[2022-04-10 20:59:34	                main:574]	:	INFO	:	Epoch 2044 | loss: 0.0310615 | val_loss: 0.0311168 | Time: 3057.18 ms
[2022-04-10 20:59:37	                main:574]	:	INFO	:	Epoch 2045 | loss: 0.0310587 | val_loss: 0.0311162 | Time: 2918.56 ms
[2022-04-10 20:59:40	                main:574]	:	INFO	:	Epoch 2046 | loss: 0.0310527 | val_loss: 0.0311225 | Time: 3038.43 ms
[2022-04-10 20:59:43	                main:574]	:	INFO	:	Epoch 2047 | loss: 0.0310517 | val_loss: 0.0311204 | Time: 3041.54 ms
[2022-04-10 20:59:46	                main:574]	:	INFO	:	Epoch 2048 | loss: 0.031048 | val_loss: 0.0311164 | Time: 2947.57 ms
[2022-04-10 20:59:46	                main:597]	:	INFO	:	Saving trained model to model-final.pt, val_loss 0.0311164
[2022-04-10 20:59:46	                main:603]	:	INFO	:	Saving end state to config to file
[2022-04-10 20:59:46	                main:608]	:	INFO	:	Success, exiting..
20:59:46 (31672): called boinc_finish(0)

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)