Task 5789276

Name ParityMachine-1625432400-21043-2_0
Workunit 3618222
Created 11 Jul 2021, 21:07:37 UTC
Sent 16 Jul 2021, 18:44:58 UTC
Report deadline 23 Jul 2021, 18:44:58 UTC
Received 17 Jul 2021, 2:15:03 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 13546
Run time 1 hours 10 min
CPU time 1 hours 9 min 41 sec
Validate state Valid
Credit 4,160.00
Device peak FLOPS 15,412.34 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.80 (cuda10200)
x86_64-pc-linux-gnu
Peak working set size 2.33 GB
Peak swap size 10.57 GB
Peak disk usage 2.98 GB

Stderr output

<core_client_version>7.14.2</core_client_version>
<![CDATA[
<stderr_txt>
in:581]	:	INFO	:	Epoch 1604 | loss: 0.0311213 | val_loss: 0.0311687 | Time: 1843.09 ms
[2021-07-17 03:33:10	                main:581]	:	INFO	:	Epoch 1605 | loss: 0.0311271 | val_loss: 0.0311713 | Time: 1711.37 ms
[2021-07-17 03:33:12	                main:581]	:	INFO	:	Epoch 1606 | loss: 0.0311211 | val_loss: 0.0311662 | Time: 1756.68 ms
[2021-07-17 03:33:13	                main:581]	:	INFO	:	Epoch 1607 | loss: 0.0311214 | val_loss: 0.0311678 | Time: 1599.1 ms
[2021-07-17 03:33:15	                main:581]	:	INFO	:	Epoch 1608 | loss: 0.0311234 | val_loss: 0.031165 | Time: 1593.79 ms
[2021-07-17 03:33:17	                main:581]	:	INFO	:	Epoch 1609 | loss: 0.0311197 | val_loss: 0.0311702 | Time: 1583.82 ms
[2021-07-17 03:33:18	                main:581]	:	INFO	:	Epoch 1610 | loss: 0.031119 | val_loss: 0.0311724 | Time: 1878.85 ms
[2021-07-17 03:33:20	                main:581]	:	INFO	:	Epoch 1611 | loss: 0.0311164 | val_loss: 0.0311745 | Time: 1703.66 ms
[2021-07-17 03:33:22	                main:581]	:	INFO	:	Epoch 1612 | loss: 0.0311178 | val_loss: 0.0311705 | Time: 1525 ms
[2021-07-17 03:33:23	                main:581]	:	INFO	:	Epoch 1613 | loss: 0.0311187 | val_loss: 0.0311724 | Time: 1739.07 ms
[2021-07-17 03:33:25	                main:581]	:	INFO	:	Epoch 1614 | loss: 0.0311209 | val_loss: 0.0311695 | Time: 1718.45 ms
[2021-07-17 03:33:27	                main:581]	:	INFO	:	Epoch 1615 | loss: 0.0311211 | val_loss: 0.0311702 | Time: 1682.23 ms
[2021-07-17 03:33:28	                main:581]	:	INFO	:	Epoch 1616 | loss: 0.031119 | val_loss: 0.0311759 | Time: 1623.21 ms
[2021-07-17 03:33:30	                main:581]	:	INFO	:	Epoch 1617 | loss: 0.0311252 | val_loss: 0.0311775 | Time: 2071.9 ms
[2021-07-17 03:33:33	                main:581]	:	INFO	:	Epoch 1618 | loss: 0.0311232 | val_loss: 0.0311742 | Time: 2651.26 ms
[2021-07-17 03:33:36	                main:581]	:	INFO	:	Epoch 1619 | loss: 0.0311211 | val_loss: 0.0311797 | Time: 2500.57 ms
[2021-07-17 03:33:37	                main:581]	:	INFO	:	Epoch 1620 | loss: 0.031121 | val_loss: 0.031171 | Time: 1794.95 ms
[2021-07-17 03:33:39	                main:581]	:	INFO	:	Epoch 1621 | loss: 0.0311187 | val_loss: 0.0311755 | Time: 1849.46 ms
[2021-07-17 03:33:41	                main:581]	:	INFO	:	Epoch 1622 | loss: 0.0311143 | val_loss: 0.0311774 | Time: 1813.48 ms
[2021-07-17 03:33:43	                main:581]	:	INFO	:	Epoch 1623 | loss: 0.0311144 | val_loss: 0.0311748 | Time: 1793.07 ms
[2021-07-17 03:33:45	                main:581]	:	INFO	:	Epoch 1624 | loss: 0.0311148 | val_loss: 0.0311706 | Time: 1744.85 ms
[2021-07-17 03:33:46	                main:581]	:	INFO	:	Epoch 1625 | loss: 0.0311151 | val_loss: 0.0311734 | Time: 1695.36 ms
[2021-07-17 03:33:48	                main:581]	:	INFO	:	Epoch 1626 | loss: 0.0311156 | val_loss: 0.0311761 | Time: 1778.63 ms
[2021-07-17 03:33:50	                main:581]	:	INFO	:	Epoch 1627 | loss: 0.031125 | val_loss: 0.0311706 | Time: 1874.88 ms
[2021-07-17 03:33:52	                main:581]	:	INFO	:	Epoch 1628 | loss: 0.0311245 | val_loss: 0.0311753 | Time: 1973.28 ms
[2021-07-17 03:33:54	                main:581]	:	INFO	:	Epoch 1629 | loss: 0.0311241 | val_loss: 0.0311695 | Time: 1995.83 ms
[2021-07-17 03:33:56	                main:581]	:	INFO	:	Epoch 1630 | loss: 0.0311281 | val_loss: 0.0311778 | Time: 1965.66 ms
[2021-07-17 03:33:58	                main:581]	:	INFO	:	Epoch 1631 | loss: 0.0311233 | val_loss: 0.0311766 | Time: 1846.31 ms
[2021-07-17 03:34:00	                main:581]	:	INFO	:	Epoch 1632 | loss: 0.0311258 | val_loss: 0.031177 | Time: 1949.02 ms
[2021-07-17 03:34:02	                main:581]	:	INFO	:	Epoch 1633 | loss: 0.0311228 | val_loss: 0.0311801 | Time: 1932.05 ms
[2021-07-17 03:34:04	                main:581]	:	INFO	:	Epoch 1634 | loss: 0.0311229 | val_loss: 0.0311744 | Time: 1950.71 ms
[2021-07-17 03:34:05	                main:581]	:	INFO	:	Epoch 1635 | loss: 0.0311237 | val_loss: 0.0311743 | Time: 1882.96 ms
[2021-07-17 03:34:07	                main:581]	:	INFO	:	Epoch 1636 | loss: 0.0311236 | val_loss: 0.0311745 | Time: 1761.09 ms
[2021-07-17 03:34:09	                main:581]	:	INFO	:	Epoch 1637 | loss: 0.0311228 | val_loss: 0.0311745 | Time: 1808.94 ms
[2021-07-17 03:34:11	                main:581]	:	INFO	:	Epoch 1638 | loss: 0.031121 | val_loss: 0.0311738 | Time: 1630.48 ms
[2021-07-17 03:34:12	                main:581]	:	INFO	:	Epoch 1639 | loss: 0.031125 | val_loss: 0.0311741 | Time: 1731.15 ms
[2021-07-17 03:34:14	                main:581]	:	INFO	:	Epoch 1640 | loss: 0.0311264 | val_loss: 0.0311696 | Time: 1861.46 ms
[2021-07-17 03:34:16	                main:581]	:	INFO	:	Epoch 1641 | loss: 0.03113 | val_loss: 0.0311909 | Time: 1788.88 ms
[2021-07-17 03:34:18	                main:581]	:	INFO	:	Epoch 1642 | loss: 0.0311279 | val_loss: 0.0311741 | Time: 1754.79 ms
[2021-07-17 03:34:19	                main:581]	:	INFO	:	Epoch 1643 | loss: 0.0311244 | val_loss: 0.0311744 | Time: 1663.26 ms
[2021-07-17 03:34:21	                main:581]	:	INFO	:	Epoch 1644 | loss: 0.0311257 | val_loss: 0.0311717 | Time: 1828.52 ms
[2021-07-17 03:34:23	                main:581]	:	INFO	:	Epoch 1645 | loss: 0.0311219 | val_loss: 0.0311731 | Time: 1840.04 ms
[2021-07-17 03:34:25	                main:581]	:	INFO	:	Epoch 1646 | loss: 0.0311212 | val_loss: 0.0311687 | Time: 1859.36 ms
[2021-07-17 03:34:27	                main:581]	:	INFO	:	Epoch 1647 | loss: 0.0311197 | val_loss: 0.031179 | Time: 1989.36 ms
[2021-07-17 03:34:29	                main:581]	:	INFO	:	Epoch 1648 | loss: 0.0311191 | val_loss: 0.0311723 | Time: 1970.73 ms
[2021-07-17 03:34:31	                main:581]	:	INFO	:	Epoch 1649 | loss: 0.0311189 | val_loss: 0.0311687 | Time: 1890.74 ms
[2021-07-17 03:34:33	                main:581]	:	INFO	:	Epoch 1650 | loss: 0.0311182 | val_loss: 0.0311686 | Time: 1965.71 ms
[2021-07-17 03:34:35	                main:581]	:	INFO	:	Epoch 1651 | loss: 0.0311248 | val_loss: 0.0311682 | Time: 1967.04 ms
[2021-07-17 03:34:37	                main:581]	:	INFO	:	Epoch 1652 | loss: 0.0311244 | val_loss: 0.0311707 | Time: 1849.11 ms
[2021-07-17 03:34:38	                main:581]	:	INFO	:	Epoch 1653 | loss: 0.0311186 | val_loss: 0.031173 | Time: 1654.81 ms
[2021-07-17 03:34:40	                main:581]	:	INFO	:	Epoch 1654 | loss: 0.0311171 | val_loss: 0.031171 | Time: 1847.48 ms
[2021-07-17 03:34:42	                main:581]	:	INFO	:	Epoch 1655 | loss: 0.0311187 | val_loss: 0.0311748 | Time: 1760.56 ms
[2021-07-17 03:34:44	                main:581]	:	INFO	:	Epoch 1656 | loss: 0.0311275 | val_loss: 0.0311682 | Time: 1828.57 ms
[2021-07-17 03:34:46	                main:581]	:	INFO	:	Epoch 1657 | loss: 0.0311253 | val_loss: 0.0311716 | Time: 1824.5 ms
[2021-07-17 03:34:47	                main:581]	:	INFO	:	Epoch 1658 | loss: 0.0311242 | val_loss: 0.0311721 | Time: 1919.13 ms
[2021-07-17 03:34:49	                main:581]	:	INFO	:	Epoch 1659 | loss: 0.0311262 | val_loss: 0.0311699 | Time: 1863.37 ms
[2021-07-17 03:34:51	                main:581]	:	INFO	:	Epoch 1660 | loss: 0.031127 | val_loss: 0.0311728 | Time: 1940.22 ms
[2021-07-17 03:34:53	                main:581]	:	INFO	:	Epoch 1661 | loss: 0.031124 | val_loss: 0.0311616 | Time: 1915.1 ms
[2021-07-17 03:34:55	                main:581]	:	INFO	:	Epoch 1662 | loss: 0.0311266 | val_loss: 0.031174 | Time: 1990.67 ms
[2021-07-17 03:34:57	                main:581]	:	INFO	:	Epoch 1663 | loss: 0.0311275 | val_loss: 0.0311711 | Time: 1998.05 ms
[2021-07-17 03:34:59	                main:581]	:	INFO	:	Epoch 1664 | loss: 0.0311268 | val_loss: 0.0311662 | Time: 1996.25 ms
[2021-07-17 03:35:01	                main:581]	:	INFO	:	Epoch 1665 | loss: 0.0311461 | val_loss: 0.0311853 | Time: 1961.31 ms
[2021-07-17 03:35:03	                main:581]	:	INFO	:	Epoch 1666 | loss: 0.031167 | val_loss: 0.0311822 | Time: 1836.92 ms
[2021-07-17 03:35:05	                main:581]	:	INFO	:	Epoch 1667 | loss: 0.0311653 | val_loss: 0.0311822 | Time: 1906.25 ms
[2021-07-17 03:35:07	                main:581]	:	INFO	:	Epoch 1668 | loss: 0.0311617 | val_loss: 0.0311827 | Time: 1862.92 ms
[2021-07-17 03:35:09	                main:581]	:	INFO	:	Epoch 1669 | loss: 0.0311594 | val_loss: 0.0311814 | Time: 1846.03 ms
[2021-07-17 03:35:10	                main:581]	:	INFO	:	Epoch 1670 | loss: 0.0311578 | val_loss: 0.031179 | Time: 1727.25 ms
[2021-07-17 03:35:12	                main:581]	:	INFO	:	Epoch 1671 | loss: 0.0311534 | val_loss: 0.0311764 | Time: 1874.97 ms
[2021-07-17 03:35:14	                main:581]	:	INFO	:	Epoch 1672 | loss: 0.0311494 | val_loss: 0.0311752 | Time: 1957.48 ms
[2021-07-17 03:35:16	                main:581]	:	INFO	:	Epoch 1673 | loss: 0.0311514 | val_loss: 0.0311721 | Time: 1979.41 ms
[2021-07-17 03:35:18	                main:581]	:	INFO	:	Epoch 1674 | loss: 0.0311464 | val_loss: 0.031172 | Time: 1986.47 ms
[2021-07-17 03:35:20	                main:581]	:	INFO	:	Epoch 1675 | loss: 0.0311461 | val_loss: 0.0311717 | Time: 1867.04 ms
[2021-07-17 03:35:22	                main:581]	:	INFO	:	Epoch 1676 | loss: 0.0311455 | val_loss: 0.0311712 | Time: 1800.34 ms
[2021-07-17 03:35:24	                main:581]	:	INFO	:	Epoch 1677 | loss: 0.031147 | val_loss: 0.0311693 | Time: 1816.89 ms
[2021-07-17 03:35:25	                main:581]	:	INFO	:	Epoch 1678 | loss: 0.0311418 | val_loss: 0.0311636 | Time: 1690.59 ms
[2021-07-17 03:35:27	                main:581]	:	INFO	:	Epoch 1679 | loss: 0.031141 | val_loss: 0.0311686 | Time: 1786.12 ms
[2021-07-17 03:35:29	                main:581]	:	INFO	:	Epoch 1680 | loss: 0.031137 | val_loss: 0.0311635 | Time: 1861.87 ms
[2021-07-17 03:35:31	                main:581]	:	INFO	:	Epoch 1681 | loss: 0.031136 | val_loss: 0.0311679 | Time: 1924.09 ms
[2021-07-17 03:35:33	                main:581]	:	INFO	:	Epoch 1682 | loss: 0.0311378 | val_loss: 0.0311709 | Time: 1754.69 ms
[2021-07-17 03:35:34	                main:581]	:	INFO	:	Epoch 1683 | loss: 0.0311369 | val_loss: 0.0311702 | Time: 1809.97 ms
[2021-07-17 03:35:36	                main:581]	:	INFO	:	Epoch 1684 | loss: 0.0311354 | val_loss: 0.0311672 | Time: 1705.59 ms
[2021-07-17 03:35:38	                main:581]	:	INFO	:	Epoch 1685 | loss: 0.0311348 | val_loss: 0.0311701 | Time: 1854.61 ms
[2021-07-17 03:35:40	                main:581]	:	INFO	:	Epoch 1686 | loss: 0.0311332 | val_loss: 0.0311678 | Time: 1843.92 ms
[2021-07-17 03:35:42	                main:581]	:	INFO	:	Epoch 1687 | loss: 0.0311399 | val_loss: 0.0311695 | Time: 1789 ms
[2021-07-17 03:35:43	                main:581]	:	INFO	:	Epoch 1688 | loss: 0.0311399 | val_loss: 0.0311664 | Time: 1648.29 ms
[2021-07-17 03:35:45	                main:581]	:	INFO	:	Epoch 1689 | loss: 0.0311366 | val_loss: 0.0311669 | Time: 1690.87 ms
[2021-07-17 03:35:47	                main:581]	:	INFO	:	Epoch 1690 | loss: 0.0311352 | val_loss: 0.0311675 | Time: 1891.78 ms
[2021-07-17 03:35:49	                main:581]	:	INFO	:	Epoch 1691 | loss: 0.0311351 | val_loss: 0.0311641 | Time: 1944.47 ms
[2021-07-17 03:35:51	                main:581]	:	INFO	:	Epoch 1692 | loss: 0.0311327 | val_loss: 0.031177 | Time: 1917.86 ms
[2021-07-17 03:35:53	                main:581]	:	INFO	:	Epoch 1693 | loss: 0.0311306 | val_loss: 0.0311701 | Time: 1929.7 ms
[2021-07-17 03:35:54	                main:581]	:	INFO	:	Epoch 1694 | loss: 0.0311288 | val_loss: 0.0311683 | Time: 1844.7 ms
[2021-07-17 03:35:56	                main:581]	:	INFO	:	Epoch 1695 | loss: 0.0311316 | val_loss: 0.0311671 | Time: 1660.96 ms
[2021-07-17 03:35:58	                main:581]	:	INFO	:	Epoch 1696 | loss: 0.0311279 | val_loss: 0.0311647 | Time: 1797.43 ms
[2021-07-17 03:36:00	                main:581]	:	INFO	:	Epoch 1697 | loss: 0.0311276 | val_loss: 0.0311669 | Time: 1760.66 ms
[2021-07-17 03:36:01	                main:581]	:	INFO	:	Epoch 1698 | loss: 0.0311265 | val_loss: 0.0311695 | Time: 1756.83 ms
[2021-07-17 03:36:03	                main:581]	:	INFO	:	Epoch 1699 | loss: 0.0311381 | val_loss: 0.0311678 | Time: 1828.46 ms
[2021-07-17 03:36:05	                main:581]	:	INFO	:	Epoch 1700 | loss: 0.0311421 | val_loss: 0.0311687 | Time: 1837.01 ms
[2021-07-17 03:36:07	                main:581]	:	INFO	:	Epoch 1701 | loss: 0.0311392 | val_loss: 0.0311793 | Time: 2111.51 ms
[2021-07-17 03:36:09	                main:581]	:	INFO	:	Epoch 1702 | loss: 0.031139 | val_loss: 0.0311782 | Time: 1989.66 ms
[2021-07-17 03:36:11	                main:581]	:	INFO	:	Epoch 1703 | loss: 0.0311422 | val_loss: 0.0311815 | Time: 1955.12 ms
[2021-07-17 03:36:13	                main:581]	:	INFO	:	Epoch 1704 | loss: 0.0311379 | val_loss: 0.0311756 | Time: 1932.96 ms
[2021-07-17 03:36:15	                main:581]	:	INFO	:	Epoch 1705 | loss: 0.0311355 | val_loss: 0.0311727 | Time: 1917.12 ms
[2021-07-17 03:36:17	                main:581]	:	INFO	:	Epoch 1706 | loss: 0.0311335 | val_loss: 0.0311709 | Time: 2061.2 ms
[2021-07-17 03:36:19	                main:581]	:	INFO	:	Epoch 1707 | loss: 0.0311318 | val_loss: 0.0311702 | Time: 1847.88 ms
[2021-07-17 03:36:21	                main:581]	:	INFO	:	Epoch 1708 | loss: 0.0311299 | val_loss: 0.0311736 | Time: 1828.46 ms
[2021-07-17 03:36:23	                main:581]	:	INFO	:	Epoch 1709 | loss: 0.031128 | val_loss: 0.0311682 | Time: 1924.49 ms
[2021-07-17 03:36:24	                main:581]	:	INFO	:	Epoch 1710 | loss: 0.0311347 | val_loss: 0.0311696 | Time: 1663.17 ms
[2021-07-17 03:36:26	                main:581]	:	INFO	:	Epoch 1711 | loss: 0.0311383 | val_loss: 0.0311678 | Time: 1747.94 ms
[2021-07-17 03:36:28	                main:581]	:	INFO	:	Epoch 1712 | loss: 0.0311376 | val_loss: 0.0311689 | Time: 1872.46 ms
[2021-07-17 03:36:30	                main:581]	:	INFO	:	Epoch 1713 | loss: 0.0311385 | val_loss: 0.0311676 | Time: 1803.72 ms
[2021-07-17 03:36:32	                main:581]	:	INFO	:	Epoch 1714 | loss: 0.0311355 | val_loss: 0.0311687 | Time: 1782.19 ms
[2021-07-17 03:36:33	                main:581]	:	INFO	:	Epoch 1715 | loss: 0.0311348 | val_loss: 0.0311672 | Time: 1842.1 ms
[2021-07-17 03:36:35	                main:581]	:	INFO	:	Epoch 1716 | loss: 0.0311333 | val_loss: 0.031169 | Time: 1804.76 ms
[2021-07-17 03:36:37	                main:581]	:	INFO	:	Epoch 1717 | loss: 0.0311317 | val_loss: 0.0311673 | Time: 1811.99 ms
[2021-07-17 03:36:39	                main:581]	:	INFO	:	Epoch 1718 | loss: 0.0311297 | val_loss: 0.0311691 | Time: 1708.34 ms
[2021-07-17 03:36:41	                main:581]	:	INFO	:	Epoch 1719 | loss: 0.0311306 | val_loss: 0.0311683 | Time: 1868.4 ms
[2021-07-17 03:36:43	                main:581]	:	INFO	:	Epoch 1720 | loss: 0.0311311 | val_loss: 0.0311694 | Time: 1928.45 ms
[2021-07-17 03:36:44	                main:581]	:	INFO	:	Epoch 1721 | loss: 0.0311303 | val_loss: 0.0311716 | Time: 1699.7 ms
[2021-07-17 03:36:46	                main:581]	:	INFO	:	Epoch 1722 | loss: 0.0311299 | val_loss: 0.031171 | Time: 1856.92 ms
[2021-07-17 03:36:48	                main:581]	:	INFO	:	Epoch 1723 | loss: 0.0311276 | val_loss: 0.0311727 | Time: 1847.05 ms
[2021-07-17 03:36:50	                main:581]	:	INFO	:	Epoch 1724 | loss: 0.0311276 | val_loss: 0.031172 | Time: 1940.76 ms
[2021-07-17 03:36:52	                main:581]	:	INFO	:	Epoch 1725 | loss: 0.0311248 | val_loss: 0.031177 | Time: 1908.88 ms
[2021-07-17 03:36:54	                main:581]	:	INFO	:	Epoch 1726 | loss: 0.0311248 | val_loss: 0.0311718 | Time: 1763.12 ms
[2021-07-17 03:36:55	                main:581]	:	INFO	:	Epoch 1727 | loss: 0.0311257 | val_loss: 0.0311775 | Time: 1715.83 ms
[2021-07-17 03:36:57	                main:581]	:	INFO	:	Epoch 1728 | loss: 0.0311284 | val_loss: 0.0311709 | Time: 1694.05 ms
[2021-07-17 03:36:59	                main:581]	:	INFO	:	Epoch 1729 | loss: 0.0311282 | val_loss: 0.0311765 | Time: 1810.67 ms
[2021-07-17 03:37:01	                main:581]	:	INFO	:	Epoch 1730 | loss: 0.0311248 | val_loss: 0.0311791 | Time: 1867.74 ms
[2021-07-17 03:37:03	                main:581]	:	INFO	:	Epoch 1731 | loss: 0.0311271 | val_loss: 0.0311757 | Time: 1903.1 ms
[2021-07-17 03:37:04	                main:581]	:	INFO	:	Epoch 1732 | loss: 0.0311256 | val_loss: 0.0311723 | Time: 1898.58 ms
[2021-07-17 03:37:06	                main:581]	:	INFO	:	Epoch 1733 | loss: 0.0311226 | val_loss: 0.0311699 | Time: 1807.71 ms
[2021-07-17 03:37:08	                main:581]	:	INFO	:	Epoch 1734 | loss: 0.031122 | val_loss: 0.031172 | Time: 1721.01 ms
[2021-07-17 03:37:10	                main:581]	:	INFO	:	Epoch 1735 | loss: 0.0311241 | val_loss: 0.0311686 | Time: 1625.34 ms
[2021-07-17 03:37:11	                main:581]	:	INFO	:	Epoch 1736 | loss: 0.0311221 | val_loss: 0.0311717 | Time: 1717.51 ms
[2021-07-17 03:37:13	                main:581]	:	INFO	:	Epoch 1737 | loss: 0.0311234 | val_loss: 0.0311723 | Time: 1707.23 ms
[2021-07-17 03:37:15	                main:581]	:	INFO	:	Epoch 1738 | loss: 0.0311242 | val_loss: 0.0311719 | Time: 1885.97 ms
[2021-07-17 03:37:17	                main:581]	:	INFO	:	Epoch 1739 | loss: 0.0311261 | val_loss: 0.0311781 | Time: 1911.83 ms
[2021-07-17 03:37:19	                main:581]	:	INFO	:	Epoch 1740 | loss: 0.0311245 | val_loss: 0.0311736 | Time: 1903.21 ms
[2021-07-17 03:37:21	                main:581]	:	INFO	:	Epoch 1741 | loss: 0.0311208 | val_loss: 0.0311715 | Time: 1845.67 ms
[2021-07-17 03:37:22	                main:581]	:	INFO	:	Epoch 1742 | loss: 0.0311257 | val_loss: 0.0311681 | Time: 1704.79 ms
[2021-07-17 03:37:24	                main:581]	:	INFO	:	Epoch 1743 | loss: 0.0311238 | val_loss: 0.0311737 | Time: 1769.86 ms
[2021-07-17 03:37:26	                main:581]	:	INFO	:	Epoch 1744 | loss: 0.0311218 | val_loss: 0.0311762 | Time: 1672 ms
[2021-07-17 03:37:28	                main:581]	:	INFO	:	Epoch 1745 | loss: 0.0311232 | val_loss: 0.0311772 | Time: 1772.29 ms
[2021-07-17 03:37:29	                main:581]	:	INFO	:	Epoch 1746 | loss: 0.03113 | val_loss: 0.0311914 | Time: 1910.46 ms
[2021-07-17 03:37:31	                main:581]	:	INFO	:	Epoch 1747 | loss: 0.0311503 | val_loss: 0.0311976 | Time: 1609.92 ms
[2021-07-17 03:37:33	                main:581]	:	INFO	:	Epoch 1748 | loss: 0.0354806 | val_loss: 0.0455843 | Time: 1709.29 ms
[2021-07-17 03:37:35	                main:581]	:	INFO	:	Epoch 1749 | loss: 0.0354495 | val_loss: 0.0317994 | Time: 1918.55 ms
[2021-07-17 03:37:37	                main:581]	:	INFO	:	Epoch 1750 | loss: 0.0316461 | val_loss: 0.0313028 | Time: 1900.53 ms
[2021-07-17 03:37:38	                main:581]	:	INFO	:	Epoch 1751 | loss: 0.0312751 | val_loss: 0.0312313 | Time: 1636.92 ms
[2021-07-17 03:37:40	                main:581]	:	INFO	:	Epoch 1752 | loss: 0.0312209 | val_loss: 0.0312106 | Time: 1603.83 ms
[2021-07-17 03:37:41	                main:581]	:	INFO	:	Epoch 1753 | loss: 0.0312065 | val_loss: 0.0312054 | Time: 1539.13 ms
[2021-07-17 03:37:43	                main:581]	:	INFO	:	Epoch 1754 | loss: 0.0312028 | val_loss: 0.0312036 | Time: 1913.95 ms
[2021-07-17 03:37:45	                main:581]	:	INFO	:	Epoch 1755 | loss: 0.0311985 | val_loss: 0.0312015 | Time: 1909.92 ms
[2021-07-17 03:37:47	                main:581]	:	INFO	:	Epoch 1756 | loss: 0.0311963 | val_loss: 0.0312002 | Time: 1530.04 ms
[2021-07-17 03:37:48	                main:581]	:	INFO	:	Epoch 1757 | loss: 0.031194 | val_loss: 0.0311966 | Time: 1719.22 ms
[2021-07-17 03:37:50	                main:581]	:	INFO	:	Epoch 1758 | loss: 0.0311912 | val_loss: 0.0311943 | Time: 1830.45 ms
[2021-07-17 03:37:52	                main:581]	:	INFO	:	Epoch 1759 | loss: 0.0311892 | val_loss: 0.0311921 | Time: 1541.24 ms
[2021-07-17 03:37:53	                main:581]	:	INFO	:	Epoch 1760 | loss: 0.0311869 | val_loss: 0.0311902 | Time: 1692.43 ms
[2021-07-17 03:37:55	                main:581]	:	INFO	:	Epoch 1761 | loss: 0.031185 | val_loss: 0.0311896 | Time: 1718.63 ms
[2021-07-17 03:37:57	                main:581]	:	INFO	:	Epoch 1762 | loss: 0.0311834 | val_loss: 0.0311878 | Time: 1841.8 ms
[2021-07-17 03:37:59	                main:581]	:	INFO	:	Epoch 1763 | loss: 0.0311819 | val_loss: 0.0311873 | Time: 1875.14 ms
[2021-07-17 03:38:01	                main:581]	:	INFO	:	Epoch 1764 | loss: 0.0311812 | val_loss: 0.0311862 | Time: 1788.28 ms
[2021-07-17 03:38:02	                main:581]	:	INFO	:	Epoch 1765 | loss: 0.0311806 | val_loss: 0.0311878 | Time: 1600.08 ms
[2021-07-17 03:38:04	                main:581]	:	INFO	:	Epoch 1766 | loss: 0.0311814 | val_loss: 0.0311907 | Time: 1693.75 ms
[2021-07-17 03:38:06	                main:581]	:	INFO	:	Epoch 1767 | loss: 0.0311786 | val_loss: 0.0311862 | Time: 1593.75 ms
[2021-07-17 03:38:07	                main:581]	:	INFO	:	Epoch 1768 | loss: 0.0311762 | val_loss: 0.0311832 | Time: 1639.13 ms
[2021-07-17 03:38:09	                main:581]	:	INFO	:	Epoch 1769 | loss: 0.0311751 | val_loss: 0.0311825 | Time: 1771.87 ms
[2021-07-17 03:38:11	                main:581]	:	INFO	:	Epoch 1770 | loss: 0.0311722 | val_loss: 0.0311796 | Time: 1813.52 ms
[2021-07-17 03:38:13	                main:581]	:	INFO	:	Epoch 1771 | loss: 0.0311705 | val_loss: 0.0311798 | Time: 1809.04 ms
[2021-07-17 03:38:15	                main:581]	:	INFO	:	Epoch 1772 | loss: 0.0311694 | val_loss: 0.0311788 | Time: 1992.99 ms
[2021-07-17 03:38:17	                main:581]	:	INFO	:	Epoch 1773 | loss: 0.0311677 | val_loss: 0.0311762 | Time: 2001.74 ms
[2021-07-17 03:38:19	                main:581]	:	INFO	:	Epoch 1774 | loss: 0.0311649 | val_loss: 0.0311753 | Time: 1918 ms
[2021-07-17 03:38:20	                main:581]	:	INFO	:	Epoch 1775 | loss: 0.0311643 | val_loss: 0.0311736 | Time: 1904.64 ms
[2021-07-17 03:38:22	                main:581]	:	INFO	:	Epoch 1776 | loss: 0.0311633 | val_loss: 0.0311767 | Time: 1744.64 ms
[2021-07-17 03:38:24	                main:581]	:	INFO	:	Epoch 1777 | loss: 0.0311632 | val_loss: 0.0311734 | Time: 1670.63 ms
[2021-07-17 03:38:26	                main:581]	:	INFO	:	Epoch 1778 | loss: 0.0311614 | val_loss: 0.0311729 | Time: 1879.37 ms
[2021-07-17 03:38:28	                main:581]	:	INFO	:	Epoch 1779 | loss: 0.031161 | val_loss: 0.0311778 | Time: 1836.97 ms
[2021-07-17 03:38:29	                main:581]	:	INFO	:	Epoch 1780 | loss: 0.0311627 | val_loss: 0.0311722 | Time: 1859.89 ms
[2021-07-17 03:38:31	                main:581]	:	INFO	:	Epoch 1781 | loss: 0.0311651 | val_loss: 0.0311718 | Time: 1953.65 ms
[2021-07-17 03:38:33	                main:581]	:	INFO	:	Epoch 1782 | loss: 0.0311622 | val_loss: 0.0311722 | Time: 1895.55 ms
[2021-07-17 03:38:35	                main:581]	:	INFO	:	Epoch 1783 | loss: 0.0311601 | val_loss: 0.0311741 | Time: 1926.42 ms
[2021-07-17 03:38:37	                main:581]	:	INFO	:	Epoch 1784 | loss: 0.0311605 | val_loss: 0.0311712 | Time: 1898.99 ms
[2021-07-17 03:38:39	                main:581]	:	INFO	:	Epoch 1785 | loss: 0.0311595 | val_loss: 0.0311726 | Time: 1940.7 ms
[2021-07-17 03:38:41	                main:581]	:	INFO	:	Epoch 1786 | loss: 0.031159 | val_loss: 0.031173 | Time: 1729.79 ms
[2021-07-17 03:38:43	                main:581]	:	INFO	:	Epoch 1787 | loss: 0.031159 | val_loss: 0.0311718 | Time: 1849.5 ms
[2021-07-17 03:38:44	                main:581]	:	INFO	:	Epoch 1788 | loss: 0.0311596 | val_loss: 0.03118 | Time: 1842.87 ms
[2021-07-17 03:38:46	                main:581]	:	INFO	:	Epoch 1789 | loss: 0.0311606 | val_loss: 0.0311708 | Time: 1836.53 ms
[2021-07-17 03:38:48	                main:581]	:	INFO	:	Epoch 1790 | loss: 0.0311603 | val_loss: 0.0311717 | Time: 1988.8 ms
[2021-07-17 03:38:50	                main:581]	:	INFO	:	Epoch 1791 | loss: 0.0311587 | val_loss: 0.0311717 | Time: 2042.82 ms
[2021-07-17 03:38:52	                main:581]	:	INFO	:	Epoch 1792 | loss: 0.0311581 | val_loss: 0.0311727 | Time: 1889.4 ms
[2021-07-17 03:38:54	                main:581]	:	INFO	:	Epoch 1793 | loss: 0.0311587 | val_loss: 0.0311736 | Time: 1784.21 ms
[2021-07-17 03:38:56	                main:581]	:	INFO	:	Epoch 1794 | loss: 0.031158 | val_loss: 0.0311768 | Time: 1768.29 ms
[2021-07-17 03:38:58	                main:581]	:	INFO	:	Epoch 1795 | loss: 0.0311614 | val_loss: 0.0311723 | Time: 1895.04 ms
[2021-07-17 03:39:00	                main:581]	:	INFO	:	Epoch 1796 | loss: 0.0311605 | val_loss: 0.0311697 | Time: 1917.29 ms
[2021-07-17 03:39:01	                main:581]	:	INFO	:	Epoch 1797 | loss: 0.0311592 | val_loss: 0.0311708 | Time: 1787.99 ms
[2021-07-17 03:39:03	                main:581]	:	INFO	:	Epoch 1798 | loss: 0.0311598 | val_loss: 0.0311691 | Time: 1851.86 ms
[2021-07-17 03:39:05	                main:581]	:	INFO	:	Epoch 1799 | loss: 0.031159 | val_loss: 0.0311754 | Time: 1908.47 ms
[2021-07-17 03:39:07	                main:581]	:	INFO	:	Epoch 1800 | loss: 0.0311585 | val_loss: 0.0311693 | Time: 1789.15 ms
[2021-07-17 03:39:09	                main:581]	:	INFO	:	Epoch 1801 | loss: 0.031156 | val_loss: 0.0311693 | Time: 1712.53 ms
[2021-07-17 03:39:10	                main:581]	:	INFO	:	Epoch 1802 | loss: 0.0311556 | val_loss: 0.0311689 | Time: 1637.81 ms
[2021-07-17 03:39:12	                main:581]	:	INFO	:	Epoch 1803 | loss: 0.0311573 | val_loss: 0.0311711 | Time: 1669.75 ms
[2021-07-17 03:39:14	                main:581]	:	INFO	:	Epoch 1804 | loss: 0.0311571 | val_loss: 0.0311681 | Time: 1939.7 ms
[2021-07-17 03:39:16	                main:581]	:	INFO	:	Epoch 1805 | loss: 0.0311569 | val_loss: 0.031167 | Time: 1967.29 ms
[2021-07-17 03:39:18	                main:581]	:	INFO	:	Epoch 1806 | loss: 0.0311566 | val_loss: 0.0311661 | Time: 1778.12 ms
[2021-07-17 03:39:19	                main:581]	:	INFO	:	Epoch 1807 | loss: 0.0311549 | val_loss: 0.0311665 | Time: 1787.79 ms
[2021-07-17 03:39:21	                main:581]	:	INFO	:	Epoch 1808 | loss: 0.031155 | val_loss: 0.0311659 | Time: 2000.12 ms
[2021-07-17 03:39:23	                main:581]	:	INFO	:	Epoch 1809 | loss: 0.0311542 | val_loss: 0.0311697 | Time: 1904.19 ms
[2021-07-17 03:39:25	                main:581]	:	INFO	:	Epoch 1810 | loss: 0.0311552 | val_loss: 0.0311679 | Time: 1840.65 ms
[2021-07-17 03:39:27	                main:581]	:	INFO	:	Epoch 1811 | loss: 0.031155 | val_loss: 0.0311656 | Time: 1873.12 ms
[2021-07-17 03:39:29	                main:581]	:	INFO	:	Epoch 1812 | loss: 0.0311554 | val_loss: 0.0311662 | Time: 1858.36 ms
[2021-07-17 03:39:31	                main:581]	:	INFO	:	Epoch 1813 | loss: 0.0311606 | val_loss: 0.03117 | Time: 2413.35 ms
[2021-07-17 03:39:34	                main:581]	:	INFO	:	Epoch 1814 | loss: 0.0311567 | val_loss: 0.0311664 | Time: 2512.38 ms
[2021-07-17 03:39:36	                main:581]	:	INFO	:	Epoch 1815 | loss: 0.0311545 | val_loss: 0.031166 | Time: 2089.92 ms
[2021-07-17 03:39:38	                main:581]	:	INFO	:	Epoch 1816 | loss: 0.0311529 | val_loss: 0.0311663 | Time: 1943.33 ms
[2021-07-17 03:39:40	                main:581]	:	INFO	:	Epoch 1817 | loss: 0.0311525 | val_loss: 0.0311668 | Time: 1874.76 ms
[2021-07-17 03:39:42	                main:581]	:	INFO	:	Epoch 1818 | loss: 0.0311535 | val_loss: 0.0311664 | Time: 1945.61 ms
[2021-07-17 03:39:44	                main:581]	:	INFO	:	Epoch 1819 | loss: 0.0311531 | val_loss: 0.0311673 | Time: 1863.24 ms
[2021-07-17 03:39:45	                main:581]	:	INFO	:	Epoch 1820 | loss: 0.0311542 | val_loss: 0.0311669 | Time: 1828.72 ms
[2021-07-17 03:39:47	                main:581]	:	INFO	:	Epoch 1821 | loss: 0.0311525 | val_loss: 0.0311697 | Time: 1765.39 ms
[2021-07-17 03:39:49	                main:581]	:	INFO	:	Epoch 1822 | loss: 0.0311516 | val_loss: 0.0311665 | Time: 1878.45 ms
[2021-07-17 03:39:51	                main:581]	:	INFO	:	Epoch 1823 | loss: 0.0311513 | val_loss: 0.0311674 | Time: 1934.2 ms
[2021-07-17 03:39:53	                main:581]	:	INFO	:	Epoch 1824 | loss: 0.0311525 | val_loss: 0.0311675 | Time: 1829.31 ms
[2021-07-17 03:39:55	                main:581]	:	INFO	:	Epoch 1825 | loss: 0.0311517 | val_loss: 0.0311665 | Time: 1910.12 ms
[2021-07-17 03:39:57	                main:581]	:	INFO	:	Epoch 1826 | loss: 0.0311513 | val_loss: 0.031167 | Time: 1914.08 ms
[2021-07-17 03:39:59	                main:581]	:	INFO	:	Epoch 1827 | loss: 0.0311502 | val_loss: 0.0311677 | Time: 1902.26 ms
[2021-07-17 03:40:00	                main:581]	:	INFO	:	Epoch 1828 | loss: 0.0311531 | val_loss: 0.0311761 | Time: 1849.96 ms
[2021-07-17 03:40:02	                main:581]	:	INFO	:	Epoch 1829 | loss: 0.0311599 | val_loss: 0.0311741 | Time: 1854.4 ms
[2021-07-17 03:40:04	                main:581]	:	INFO	:	Epoch 1830 | loss: 0.031157 | val_loss: 0.0311768 | Time: 1857.27 ms
[2021-07-17 03:40:06	                main:581]	:	INFO	:	Epoch 1831 | loss: 0.0311539 | val_loss: 0.031166 | Time: 1821.07 ms
[2021-07-17 03:40:08	                main:581]	:	INFO	:	Epoch 1832 | loss: 0.0311508 | val_loss: 0.0311681 | Time: 1911.78 ms
[2021-07-17 03:40:10	                main:581]	:	INFO	:	Epoch 1833 | loss: 0.0311501 | val_loss: 0.0311688 | Time: 1855.38 ms
[2021-07-17 03:40:12	                main:581]	:	INFO	:	Epoch 1834 | loss: 0.0311497 | val_loss: 0.0311671 | Time: 1899.77 ms
[2021-07-17 03:40:13	                main:581]	:	INFO	:	Epoch 1835 | loss: 0.0311502 | val_loss: 0.031168 | Time: 1889.19 ms
[2021-07-17 03:40:15	                main:581]	:	INFO	:	Epoch 1836 | loss: 0.0311496 | val_loss: 0.0311711 | Time: 1909.87 ms
[2021-07-17 03:40:17	                main:581]	:	INFO	:	Epoch 1837 | loss: 0.0311513 | val_loss: 0.0311681 | Time: 1891.51 ms
[2021-07-17 03:40:19	                main:581]	:	INFO	:	Epoch 1838 | loss: 0.0311499 | val_loss: 0.0311736 | Time: 1857.73 ms
[2021-07-17 03:40:21	                main:581]	:	INFO	:	Epoch 1839 | loss: 0.03115 | val_loss: 0.0311707 | Time: 1886.17 ms
[2021-07-17 03:40:23	                main:581]	:	INFO	:	Epoch 1840 | loss: 0.031152 | val_loss: 0.0311673 | Time: 1938.86 ms
[2021-07-17 03:40:25	                main:581]	:	INFO	:	Epoch 1841 | loss: 0.0311507 | val_loss: 0.0311686 | Time: 1850.86 ms
[2021-07-17 03:40:27	                main:581]	:	INFO	:	Epoch 1842 | loss: 0.0311533 | val_loss: 0.0311702 | Time: 1942.65 ms
[2021-07-17 03:40:29	                main:581]	:	INFO	:	Epoch 1843 | loss: 0.031158 | val_loss: 0.0311715 | Time: 1881.8 ms
[2021-07-17 03:40:30	                main:581]	:	INFO	:	Epoch 1844 | loss: 0.0311616 | val_loss: 0.0311788 | Time: 1861.13 ms
[2021-07-17 03:40:32	                main:581]	:	INFO	:	Epoch 1845 | loss: 0.031159 | val_loss: 0.0311679 | Time: 1912.72 ms
[2021-07-17 03:40:34	                main:581]	:	INFO	:	Epoch 1846 | loss: 0.0311609 | val_loss: 0.0311675 | Time: 1874.68 ms
[2021-07-17 03:40:36	                main:581]	:	INFO	:	Epoch 1847 | loss: 0.0311569 | val_loss: 0.0311712 | Time: 1891.61 ms
[2021-07-17 03:40:38	                main:581]	:	INFO	:	Epoch 1848 | loss: 0.0311546 | val_loss: 0.0311694 | Time: 1894.41 ms
[2021-07-17 03:40:40	                main:581]	:	INFO	:	Epoch 1849 | loss: 0.0311533 | val_loss: 0.031165 | Time: 1882.63 ms
[2021-07-17 03:40:42	                main:581]	:	INFO	:	Epoch 1850 | loss: 0.0311514 | val_loss: 0.0311661 | Time: 1840.49 ms
[2021-07-17 03:40:44	                main:581]	:	INFO	:	Epoch 1851 | loss: 0.0311523 | val_loss: 0.0311654 | Time: 1927.28 ms
[2021-07-17 03:40:46	                main:581]	:	INFO	:	Epoch 1852 | loss: 0.031151 | val_loss: 0.031166 | Time: 1795.04 ms
SIGSEGV: segmentation violation
Stack trace (47 frames):
../../projects/www.mlcathome.org_mlcathome/mlds-gpu_9.80_x86_64-pc-linux-gnu__cuda10200(+0x37df9c)[0x55efb628df9c]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x12730)[0x7f83676ac730]
/lib/x86_64-linux-gnu/libc.so.6(+0x39d57)[0x7f82e8fc6d57]
/lib/x86_64-linux-gnu/libc.so.6(+0x39eba)[0x7f82e8fc6eba]
../../projects/www.mlcathome.org_mlcathome/mlds-gpu_9.80_x86_64-pc-linux-gnu__cuda10200(+0x379b25)[0x55efb6289b25]
../../projects/www.mlcathome.org_mlcathome/mlds-gpu_9.80_x86_64-pc-linux-gnu__cuda10200(+0x379bee)[0x55efb6289bee]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x12730)[0x7f83676ac730]
/lib/x86_64-linux-gnu/libcuda.so.1(+0x216152)[0x7f82cb7eb152]
/lib/x86_64-linux-gnu/libcuda.so.1(+0x2164ef)[0x7f82cb7eb4ef]
/lib/x86_64-linux-gnu/libcuda.so.1(+0x1aa17b)[0x7f82cb77f17b]
/lib/x86_64-linux-gnu/libcuda.so.1(+0x1aa4e8)[0x7f82cb77f4e8]
/lib/x86_64-linux-gnu/libcuda.so.1(+0x400f77)[0x7f82cb9d5f77]
/lib/x86_64-linux-gnu/libcuda.so.1(+0x4014e2)[0x7f82cb9d64e2]
/lib/x86_64-linux-gnu/libcuda.so.1(+0x1c2f4a)[0x7f82cb797f4a]
/lib/x86_64-linux-gnu/libcuda.so.1(+0x406cc0)[0x7f82cb9dbcc0]
/lib/x86_64-linux-gnu/libcuda.so.1(+0x17bc13)[0x7f82cb750c13]
/lib/x86_64-linux-gnu/libcuda.so.1(+0x17cf25)[0x7f82cb751f25]
/lib/x86_64-linux-gnu/libcuda.so.1(cuLaunchKernel+0x83)[0x7f82cb7f83a3]
./libcudnn_adv_infer.so.8(+0x33277b)[0x7f824b74277b]
./libcudnn_adv_infer.so.8(+0x3784d6)[0x7f824b7884d6]
./libcudnn_adv_infer.so.8(+0x59238)[0x7f824b469238]
./libcudnn_adv_infer.so.8(+0x79dce)[0x7f824b489dce]
./libcudnn_adv_infer.so.8(+0xe89f)[0x7f824b41e89f]
./libcudnn_adv_infer.so.8(_Z18RNN_forwardGenericP12cudnnContextP14cudnnRNNStructiPKP17cudnnTensorStructPKvS4_S8_S4_S8_P17cudnnFilterStructS8_S6_PvS4_SB_S4_SB_SB_mSB_m18cudnnForwardMode_t+0x5d7)[0x7f824b4628c7]
./libcudnn_adv_train.so.8(cudnnRNNForwardTraining+0x20e)[0x7f823661661e]
./libtorch_cuda.so(_ZN2at6native10_cudnn_rnnERKNS_6TensorEN3c108ArrayRefIS1_EElS3_S3_S3_lllbdbbNS5_IlEES3_+0x2214)[0x7f82e9d94a64]
./libtorch_cuda.so(+0x85face)[0x7f82e9ddeace]
./libtorch_cuda.so(+0x895988)[0x7f82e9e14988]
./libtorch_cpu.so(_ZN2at10_cudnn_rnnERKNS_6TensorEN3c108ArrayRefIS0_EElS2_S2_S2_lllbdbbNS4_IlEES2_+0x2bc)[0x7f836234d51c]
./libtorch_cpu.so(+0x21cf2d4)[0x7f83637172d4]
./libtorch_cpu.so(+0x21edb28)[0x7f8363735b28]
./libtorch_cpu.so(_ZN2at10_cudnn_rnnERKNS_6TensorEN3c108ArrayRefIS0_EElS2_S2_S2_lllbdbbNS4_IlEES2_+0x2bc)[0x7f836234d51c]
./libtorch_cuda.so(+0x80f0fd)[0x7f82e9d8e0fd]
./libtorch_cuda.so(+0x80fb0a)[0x7f82e9d8eb0a]
./libtorch_cpu.so(+0x97fe93)[0x7f8361ec7e93]
./libtorch_cpu.so(_ZN2at6native3gruERKNS_6TensorES3_N3c108ArrayRefIS1_EEbldbbb+0xea)[0x7f8361eab9ba]
./libtorch_cpu.so(+0xeb0a96)[0x7f83623f8a96]
./libtorch_cpu.so(+0x22e3c92)[0x7f836382bc92]
./libtorch_cpu.so(+0xedd579)[0x7f8362425579]
./libtorch_cpu.so(_ZN2at3gruERKNS_6TensorES2_N3c108ArrayRefIS0_EEbldbbb+0x1b1)[0x7f836232aee1]
./libtorch_cpu.so(_ZN5torch2nn7GRUImpl14forward_helperERKN2at6TensorES5_S5_lS3_+0x43a)[0x7f83642944ca]
./libtorch_cpu.so(_ZN5torch2nn7GRUImpl7forwardERKN2at6TensorES3_+0xb0)[0x7f8364294630]
../../projects/www.mlcathome.org_mlcathome/mlds-gpu_9.80_x86_64-pc-linux-gnu__cuda10200(+0x92fa8)[0x55efb5fa2fa8]
../../projects/www.mlcathome.org_mlcathome/mlds-gpu_9.80_x86_64-pc-linux-gnu__cuda10200(+0x9a0e6)[0x55efb5faa0e6]
../../projects/www.mlcathome.org_mlcathome/mlds-gpu_9.80_x86_64-pc-linux-gnu__cuda10200(+0x8ad10)[0x55efb5f9ad10]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xeb)[0x7f82e8fb109b]
../../projects/www.mlcathome.org_mlcathome/mlds-gpu_9.80_x86_64-pc-linux-gnu__cuda10200(+0x8675a)[0x55efb5f9675a]

Exiting...
DEBUG: Args: ../../projects/www.mlcathome.org_mlcathome/mlds-gpu_9.80_x86_64-pc-linux-gnu__cuda10200 -c --maxepoch 2048 
nthreads: 1 gpudev: 0
Re-exec()-ing to set environment correctly
Machine Learning Dataset Generator v9.80 (Linux/x86_64) (libTorch: release/1.7 GPU: GeForce RTX 2080 Ti)
[2021-07-17 04:05:30	                main:442]	:	INFO	:	Set logging level to 1
[2021-07-17 04:05:30	                main:448]	:	INFO	:	Running in BOINC Client mode
[2021-07-17 04:05:30	                main:451]	:	INFO	:	Resolving all filenames
[2021-07-17 04:05:30	                main:459]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 (exists = 1)
[2021-07-17 04:05:30	                main:459]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityMachine-1625432400-21043-2_0_r1934600935_1 (exists = 1)
[2021-07-17 04:05:30	                main:459]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityMachine-1625432400-21043-2_0_r1934600935_0 (exists = 0)
[2021-07-17 04:05:30	                main:459]	:	INFO	:	Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityMachine-1625432400-21043-2 (exists = 1)
[2021-07-17 04:05:30	                main:459]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2021-07-17 04:05:30	                main:479]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5
[2021-07-17 04:05:30	                main:481]	:	INFO	:	Configuration: 
[2021-07-17 04:05:30	                main:482]	:	INFO	:	    Model type: GRU
[2021-07-17 04:05:30	                main:483]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2021-07-17 04:05:30	                main:484]	:	INFO	:	    Max Epochs: 2048
[2021-07-17 04:05:30	                main:485]	:	INFO	:	    Batch Size: 128
[2021-07-17 04:05:30	                main:486]	:	INFO	:	    Learning Rate: 0.01
[2021-07-17 04:05:30	                main:487]	:	INFO	:	    Patience: 10
[2021-07-17 04:05:30	                main:488]	:	INFO	:	    Hidden Width: 12
[2021-07-17 04:05:30	                main:489]	:	INFO	:	    # Recurrent Layers: 4
[2021-07-17 04:05:30	                main:490]	:	INFO	:	    # Backend Layers: 4
[2021-07-17 04:05:30	                main:491]	:	INFO	:	    # Threads: 1
[2021-07-17 04:05:30	                main:493]	:	INFO	:	Preparing Dataset
[2021-07-17 04:05:30	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 into memory
[2021-07-17 04:05:31	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 into memory
[2021-07-17 04:05:40	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2021-07-17 04:05:40	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 into memory
[2021-07-17 04:05:40	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 into memory
[2021-07-17 04:05:40	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2021-07-17 04:05:40	                main:501]	:	INFO	:	Creating Model
[2021-07-17 04:05:40	                main:514]	:	INFO	:	Preparing config file
[2021-07-17 04:05:40	                main:518]	:	INFO	:	Found checkpoint, attempting to load... 
[2021-07-17 04:05:40	                main:519]	:	INFO	:	Loading config
[2021-07-17 04:05:40	                main:521]	:	INFO	:	Loading state
[2021-07-17 04:05:41	                main:566]	:	INFO	:	Loading DataLoader into Memory
[2021-07-17 04:05:41	                main:569]	:	INFO	:	Starting Training
[2021-07-17 04:05:45	                main:581]	:	INFO	:	Epoch 1847 | loss: 0.0324027 | val_loss: 0.0314547 | Time: 4591.41 ms
[2021-07-17 04:05:49	                main:581]	:	INFO	:	Epoch 1848 | loss: 0.0313378 | val_loss: 0.0312809 | Time: 3350.45 ms
[2021-07-17 04:05:51	                main:581]	:	INFO	:	Epoch 1849 | loss: 0.0312551 | val_loss: 0.0312405 | Time: 2592.17 ms
[2021-07-17 04:05:53	                main:581]	:	INFO	:	Epoch 1850 | loss: 0.0312255 | val_loss: 0.0312166 | Time: 1955.83 ms
[2021-07-17 04:05:55	                main:581]	:	INFO	:	Epoch 1851 | loss: 0.0312033 | val_loss: 0.0311954 | Time: 1942.05 ms
[2021-07-17 04:05:57	                main:581]	:	INFO	:	Epoch 1852 | loss: 0.0311814 | val_loss: 0.0311851 | Time: 1949.4 ms
[2021-07-17 04:05:59	                main:581]	:	INFO	:	Epoch 1853 | loss: 0.0311719 | val_loss: 0.0311805 | Time: 2022.02 ms
[2021-07-17 04:06:02	                main:581]	:	INFO	:	Epoch 1854 | loss: 0.0311686 | val_loss: 0.0311783 | Time: 2329.21 ms
[2021-07-17 04:06:04	                main:581]	:	INFO	:	Epoch 1855 | loss: 0.0311696 | val_loss: 0.0311753 | Time: 2329.66 ms
[2021-07-17 04:06:06	                main:581]	:	INFO	:	Epoch 1856 | loss: 0.0311664 | val_loss: 0.0311743 | Time: 2386.64 ms
[2021-07-17 04:06:09	                main:581]	:	INFO	:	Epoch 1857 | loss: 0.031163 | val_loss: 0.0311739 | Time: 2387.06 ms
[2021-07-17 04:06:11	                main:581]	:	INFO	:	Epoch 1858 | loss: 0.0311607 | val_loss: 0.0311742 | Time: 2315.68 ms
[2021-07-17 04:06:13	                main:581]	:	INFO	:	Epoch 1859 | loss: 0.0311593 | val_loss: 0.0311683 | Time: 2354.49 ms
[2021-07-17 04:06:16	                main:581]	:	INFO	:	Epoch 1860 | loss: 0.0311575 | val_loss: 0.031169 | Time: 2367.59 ms
[2021-07-17 04:06:18	                main:581]	:	INFO	:	Epoch 1861 | loss: 0.0311558 | val_loss: 0.0311701 | Time: 2278.13 ms
[2021-07-17 04:06:20	                main:581]	:	INFO	:	Epoch 1862 | loss: 0.0311548 | val_loss: 0.0311706 | Time: 2294.97 ms
[2021-07-17 04:06:23	                main:581]	:	INFO	:	Epoch 1863 | loss: 0.0311549 | val_loss: 0.0311701 | Time: 2224.84 ms
[2021-07-17 04:06:25	                main:581]	:	INFO	:	Epoch 1864 | loss: 0.031155 | val_loss: 0.0311668 | Time: 2282.31 ms
[2021-07-17 04:06:27	                main:581]	:	INFO	:	Epoch 1865 | loss: 0.0311534 | val_loss: 0.0311678 | Time: 2250.8 ms
[2021-07-17 04:06:29	                main:581]	:	INFO	:	Epoch 1866 | loss: 0.0311527 | val_loss: 0.0311711 | Time: 2207.96 ms
[2021-07-17 04:06:32	                main:581]	:	INFO	:	Epoch 1867 | loss: 0.0311517 | val_loss: 0.0311663 | Time: 2420.6 ms
[2021-07-17 04:06:34	                main:581]	:	INFO	:	Epoch 1868 | loss: 0.0311518 | val_loss: 0.031167 | Time: 2394.33 ms
[2021-07-17 04:06:37	                main:581]	:	INFO	:	Epoch 1869 | loss: 0.0311515 | val_loss: 0.0311699 | Time: 2408.59 ms
[2021-07-17 04:06:39	                main:581]	:	INFO	:	Epoch 1870 | loss: 0.0311514 | val_loss: 0.0311669 | Time: 2356.13 ms
[2021-07-17 04:06:41	                main:581]	:	INFO	:	Epoch 1871 | loss: 0.0311473 | val_loss: 0.0311661 | Time: 2360.38 ms
[2021-07-17 04:06:44	                main:581]	:	INFO	:	Epoch 1872 | loss: 0.0311459 | val_loss: 0.031166 | Time: 2409.17 ms
[2021-07-17 04:06:46	                main:581]	:	INFO	:	Epoch 1873 | loss: 0.0311489 | val_loss: 0.0311659 | Time: 2399.79 ms
[2021-07-17 04:06:48	                main:581]	:	INFO	:	Epoch 1874 | loss: 0.0311434 | val_loss: 0.0311653 | Time: 2372.26 ms
[2021-07-17 04:06:51	                main:581]	:	INFO	:	Epoch 1875 | loss: 0.0311432 | val_loss: 0.0311659 | Time: 2302.83 ms
[2021-07-17 04:06:53	                main:581]	:	INFO	:	Epoch 1876 | loss: 0.0311424 | val_loss: 0.0311676 | Time: 2361.57 ms
[2021-07-17 04:06:56	                main:581]	:	INFO	:	Epoch 1877 | loss: 0.0311422 | val_loss: 0.0311619 | Time: 2389.88 ms
[2021-07-17 04:06:58	                main:581]	:	INFO	:	Epoch 1878 | loss: 0.0311417 | val_loss: 0.0311649 | Time: 2356.74 ms
[2021-07-17 04:07:00	                main:581]	:	INFO	:	Epoch 1879 | loss: 0.0311424 | val_loss: 0.0311655 | Time: 2436.25 ms
[2021-07-17 04:07:03	                main:581]	:	INFO	:	Epoch 1880 | loss: 0.0311453 | val_loss: 0.0311663 | Time: 2432.07 ms
[2021-07-17 04:07:05	                main:581]	:	INFO	:	Epoch 1881 | loss: 0.0311431 | val_loss: 0.0311641 | Time: 2421.04 ms
[2021-07-17 04:07:07	                main:581]	:	INFO	:	Epoch 1882 | loss: 0.0311417 | val_loss: 0.0311666 | Time: 2235.72 ms
[2021-07-17 04:07:10	                main:581]	:	INFO	:	Epoch 1883 | loss: 0.0311444 | val_loss: 0.0311669 | Time: 2250.88 ms
[2021-07-17 04:07:12	                main:581]	:	INFO	:	Epoch 1884 | loss: 0.0311513 | val_loss: 0.0311706 | Time: 2442.12 ms
[2021-07-17 04:07:15	                main:581]	:	INFO	:	Epoch 1885 | loss: 0.0311645 | val_loss: 0.0311708 | Time: 2677.94 ms
[2021-07-17 04:07:18	                main:581]	:	INFO	:	Epoch 1886 | loss: 0.0311619 | val_loss: 0.0311666 | Time: 3441.05 ms
[2021-07-17 04:07:21	                main:581]	:	INFO	:	Epoch 1887 | loss: 0.0311599 | val_loss: 0.0311664 | Time: 2868.53 ms
[2021-07-17 04:07:24	                main:581]	:	INFO	:	Epoch 1888 | loss: 0.03116 | val_loss: 0.0311639 | Time: 2758.3 ms
[2021-07-17 04:07:27	                main:581]	:	INFO	:	Epoch 1889 | loss: 0.0311609 | val_loss: 0.0311685 | Time: 2793.18 ms
[2021-07-17 04:07:29	                main:581]	:	INFO	:	Epoch 1890 | loss: 0.0311623 | val_loss: 0.0311687 | Time: 2471.91 ms
[2021-07-17 04:07:31	                main:581]	:	INFO	:	Epoch 1891 | loss: 0.0311616 | val_loss: 0.03117 | Time: 2376.97 ms
[2021-07-17 04:07:34	                main:581]	:	INFO	:	Epoch 1892 | loss: 0.0311615 | val_loss: 0.031172 | Time: 2775.39 ms
[2021-07-17 04:07:37	                main:581]	:	INFO	:	Epoch 1893 | loss: 0.0311638 | val_loss: 0.0311722 | Time: 2795.32 ms
[2021-07-17 04:07:40	                main:581]	:	INFO	:	Epoch 1894 | loss: 0.0311646 | val_loss: 0.0311707 | Time: 2497.91 ms
[2021-07-17 04:07:43	                main:581]	:	INFO	:	Epoch 1895 | loss: 0.0311628 | val_loss: 0.03117 | Time: 3059.47 ms
[2021-07-17 04:07:45	                main:581]	:	INFO	:	Epoch 1896 | loss: 0.0311606 | val_loss: 0.03117 | Time: 2019.33 ms
[2021-07-17 04:07:47	                main:581]	:	INFO	:	Epoch 1897 | loss: 0.0311591 | val_loss: 0.0311724 | Time: 1989.43 ms
[2021-07-17 04:07:49	                main:581]	:	INFO	:	Epoch 1898 | loss: 0.0311614 | val_loss: 0.0311718 | Time: 1988.37 ms
[2021-07-17 04:07:51	                main:581]	:	INFO	:	Epoch 1899 | loss: 0.0311591 | val_loss: 0.0311693 | Time: 1921.55 ms
[2021-07-17 04:07:53	                main:581]	:	INFO	:	Epoch 1900 | loss: 0.0311574 | val_loss: 0.0311694 | Time: 2314.02 ms
[2021-07-17 04:07:56	                main:581]	:	INFO	:	Epoch 1901 | loss: 0.0311573 | val_loss: 0.0311699 | Time: 2794.91 ms
[2021-07-17 04:08:00	                main:581]	:	INFO	:	Epoch 1902 | loss: 0.0311569 | val_loss: 0.0311678 | Time: 4045.4 ms
[2021-07-17 04:08:03	                main:581]	:	INFO	:	Epoch 1903 | loss: 0.031155 | val_loss: 0.0311676 | Time: 3724.71 ms
[2021-07-17 04:08:06	                main:581]	:	INFO	:	Epoch 1904 | loss: 0.0311557 | val_loss: 0.0311677 | Time: 2574.16 ms
[2021-07-17 04:08:08	                main:581]	:	INFO	:	Epoch 1905 | loss: 0.0311539 | val_loss: 0.0311676 | Time: 2396.57 ms
[2021-07-17 04:08:11	                main:581]	:	INFO	:	Epoch 1906 | loss: 0.0311537 | val_loss: 0.0311672 | Time: 2758.55 ms
[2021-07-17 04:08:14	                main:581]	:	INFO	:	Epoch 1907 | loss: 0.0311531 | val_loss: 0.0311681 | Time: 3085.03 ms
[2021-07-17 04:08:18	                main:581]	:	INFO	:	Epoch 1908 | loss: 0.031153 | val_loss: 0.0311657 | Time: 3497.12 ms
[2021-07-17 04:08:21	                main:581]	:	INFO	:	Epoch 1909 | loss: 0.0311515 | val_loss: 0.0311688 | Time: 3278.98 ms
[2021-07-17 04:08:24	                main:581]	:	INFO	:	Epoch 1910 | loss: 0.0311546 | val_loss: 0.0311675 | Time: 2678.58 ms
[2021-07-17 04:08:26	                main:581]	:	INFO	:	Epoch 1911 | loss: 0.0311534 | val_loss: 0.0311673 | Time: 2656.77 ms
[2021-07-17 04:08:30	                main:581]	:	INFO	:	Epoch 1912 | loss: 0.0311533 | val_loss: 0.0311675 | Time: 3235.75 ms
[2021-07-17 04:08:32	                main:581]	:	INFO	:	Epoch 1913 | loss: 0.0311538 | val_loss: 0.0311713 | Time: 2840.31 ms
[2021-07-17 04:08:36	                main:581]	:	INFO	:	Epoch 1914 | loss: 0.0311539 | val_loss: 0.0311709 | Time: 3459.14 ms
[2021-07-17 04:08:40	                main:581]	:	INFO	:	Epoch 1915 | loss: 0.0311592 | val_loss: 0.0311716 | Time: 3879.87 ms
[2021-07-17 04:08:43	                main:581]	:	INFO	:	Epoch 1916 | loss: 0.0311596 | val_loss: 0.0311732 | Time: 3413.8 ms
[2021-07-17 04:08:46	                main:581]	:	INFO	:	Epoch 1917 | loss: 0.0311561 | val_loss: 0.0311672 | Time: 2880 ms
[2021-07-17 04:08:49	                main:581]	:	INFO	:	Epoch 1918 | loss: 0.0311561 | val_loss: 0.0311665 | Time: 2713.63 ms
[2021-07-17 04:08:52	                main:581]	:	INFO	:	Epoch 1919 | loss: 0.0311658 | val_loss: 0.0311806 | Time: 3280.78 ms
[2021-07-17 04:08:56	                main:581]	:	INFO	:	Epoch 1920 | loss: 0.0311759 | val_loss: 0.0311781 | Time: 3722.92 ms
[2021-07-17 04:08:59	                main:581]	:	INFO	:	Epoch 1921 | loss: 0.0311793 | val_loss: 0.0311898 | Time: 3277.95 ms
[2021-07-17 04:09:02	                main:581]	:	INFO	:	Epoch 1922 | loss: 0.0311963 | val_loss: 0.0311946 | Time: 3001.74 ms
[2021-07-17 04:09:05	                main:581]	:	INFO	:	Epoch 1923 | loss: 0.0311949 | val_loss: 0.0311928 | Time: 2774.31 ms
[2021-07-17 04:09:07	                main:581]	:	INFO	:	Epoch 1924 | loss: 0.0311916 | val_loss: 0.0311911 | Time: 2500.71 ms
[2021-07-17 04:09:11	                main:581]	:	INFO	:	Epoch 1925 | loss: 0.031189 | val_loss: 0.0311894 | Time: 3482.25 ms
[2021-07-17 04:09:14	                main:581]	:	INFO	:	Epoch 1926 | loss: 0.0311869 | val_loss: 0.0311895 | Time: 3415.46 ms
[2021-07-17 04:09:17	                main:581]	:	INFO	:	Epoch 1927 | loss: 0.0311874 | val_loss: 0.0311931 | Time: 3121.27 ms
[2021-07-17 04:09:21	                main:581]	:	INFO	:	Epoch 1928 | loss: 0.0311923 | val_loss: 0.0311941 | Time: 3940.29 ms
[2021-07-17 04:09:24	                main:581]	:	INFO	:	Epoch 1929 | loss: 0.0311913 | val_loss: 0.0311971 | Time: 2884.47 ms
[2021-07-17 04:09:27	                main:581]	:	INFO	:	Epoch 1930 | loss: 0.0311908 | val_loss: 0.0311926 | Time: 2967.81 ms
[2021-07-17 04:09:30	                main:581]	:	INFO	:	Epoch 1931 | loss: 0.0311872 | val_loss: 0.0311887 | Time: 2588.26 ms
[2021-07-17 04:09:32	                main:581]	:	INFO	:	Epoch 1932 | loss: 0.0311834 | val_loss: 0.0311864 | Time: 2496.24 ms
[2021-07-17 04:09:35	                main:581]	:	INFO	:	Epoch 1933 | loss: 0.0311819 | val_loss: 0.0311864 | Time: 2588.36 ms
[2021-07-17 04:09:37	                main:581]	:	INFO	:	Epoch 1934 | loss: 0.0311809 | val_loss: 0.0311862 | Time: 2408.04 ms
[2021-07-17 04:09:40	                main:581]	:	INFO	:	Epoch 1935 | loss: 0.0311816 | val_loss: 0.0311843 | Time: 2383.66 ms
[2021-07-17 04:09:42	                main:581]	:	INFO	:	Epoch 1936 | loss: 0.0311788 | val_loss: 0.0311827 | Time: 2477.15 ms
[2021-07-17 04:09:45	                main:581]	:	INFO	:	Epoch 1937 | loss: 0.0311782 | val_loss: 0.0311827 | Time: 2454.43 ms
[2021-07-17 04:09:48	                main:581]	:	INFO	:	Epoch 1938 | loss: 0.0311792 | val_loss: 0.031185 | Time: 3384.68 ms
[2021-07-17 04:09:51	                main:581]	:	INFO	:	Epoch 1939 | loss: 0.0311783 | val_loss: 0.0311837 | Time: 3455.23 ms
[2021-07-17 04:09:55	                main:581]	:	INFO	:	Epoch 1940 | loss: 0.0311826 | val_loss: 0.0311911 | Time: 4019.1 ms
[2021-07-17 04:09:59	                main:581]	:	INFO	:	Epoch 1941 | loss: 0.0311836 | val_loss: 0.031187 | Time: 3391.15 ms
[2021-07-17 04:10:01	                main:581]	:	INFO	:	Epoch 1942 | loss: 0.0311795 | val_loss: 0.0311833 | Time: 2160.06 ms
[2021-07-17 04:10:03	                main:581]	:	INFO	:	Epoch 1943 | loss: 0.0311775 | val_loss: 0.031182 | Time: 2212.02 ms
[2021-07-17 04:10:06	                main:581]	:	INFO	:	Epoch 1944 | loss: 0.031176 | val_loss: 0.031181 | Time: 2437.26 ms
[2021-07-17 04:10:08	                main:581]	:	INFO	:	Epoch 1945 | loss: 0.031175 | val_loss: 0.031182 | Time: 2456.67 ms
[2021-07-17 04:10:11	                main:581]	:	INFO	:	Epoch 1946 | loss: 0.0311747 | val_loss: 0.0311796 | Time: 3116.18 ms
[2021-07-17 04:10:15	                main:581]	:	INFO	:	Epoch 1947 | loss: 0.0311749 | val_loss: 0.0311803 | Time: 3892.63 ms
[2021-07-17 04:10:19	                main:581]	:	INFO	:	Epoch 1948 | loss: 0.0311747 | val_loss: 0.0311801 | Time: 3604.56 ms
[2021-07-17 04:10:22	                main:581]	:	INFO	:	Epoch 1949 | loss: 0.0311756 | val_loss: 0.0311776 | Time: 3282.8 ms
[2021-07-17 04:10:24	                main:581]	:	INFO	:	Epoch 1950 | loss: 0.0311756 | val_loss: 0.0311771 | Time: 2499.17 ms
[2021-07-17 04:10:27	                main:581]	:	INFO	:	Epoch 1951 | loss: 0.0311719 | val_loss: 0.0311774 | Time: 2445.31 ms
[2021-07-17 04:10:30	                main:581]	:	INFO	:	Epoch 1952 | loss: 0.0311723 | val_loss: 0.0311803 | Time: 2759.12 ms
[2021-07-17 04:10:32	                main:581]	:	INFO	:	Epoch 1953 | loss: 0.0311716 | val_loss: 0.0311795 | Time: 2399.04 ms
[2021-07-17 04:10:35	                main:581]	:	INFO	:	Epoch 1954 | loss: 0.0311712 | val_loss: 0.0311785 | Time: 2451.71 ms
[2021-07-17 04:10:38	                main:581]	:	INFO	:	Epoch 1955 | loss: 0.03117 | val_loss: 0.0311778 | Time: 3449.45 ms
[2021-07-17 04:10:41	                main:581]	:	INFO	:	Epoch 1956 | loss: 0.0311702 | val_loss: 0.0311776 | Time: 2993.45 ms
[2021-07-17 04:10:44	                main:581]	:	INFO	:	Epoch 1957 | loss: 0.0311712 | val_loss: 0.0311807 | Time: 2917.91 ms
[2021-07-17 04:10:46	                main:581]	:	INFO	:	Epoch 1958 | loss: 0.0311714 | val_loss: 0.0311778 | Time: 2358.02 ms
[2021-07-17 04:10:48	                main:581]	:	INFO	:	Epoch 1959 | loss: 0.03117 | val_loss: 0.0311781 | Time: 2232.86 ms
[2021-07-17 04:10:51	                main:581]	:	INFO	:	Epoch 1960 | loss: 0.0311694 | val_loss: 0.0311768 | Time: 2708.6 ms
[2021-07-17 04:10:54	                main:581]	:	INFO	:	Epoch 1961 | loss: 0.0311692 | val_loss: 0.0311765 | Time: 2779.86 ms
[2021-07-17 04:10:56	                main:581]	:	INFO	:	Epoch 1962 | loss: 0.0311694 | val_loss: 0.031178 | Time: 2212.08 ms
[2021-07-17 04:10:58	                main:581]	:	INFO	:	Epoch 1963 | loss: 0.03117 | val_loss: 0.0311809 | Time: 2259.44 ms
[2021-07-17 04:11:01	                main:581]	:	INFO	:	Epoch 1964 | loss: 0.0311682 | val_loss: 0.0311774 | Time: 2860.33 ms
[2021-07-17 04:11:04	                main:581]	:	INFO	:	Epoch 1965 | loss: 0.0311683 | val_loss: 0.0311785 | Time: 2783.54 ms
[2021-07-17 04:11:06	                main:581]	:	INFO	:	Epoch 1966 | loss: 0.0311698 | val_loss: 0.0311787 | Time: 2221.5 ms
[2021-07-17 04:11:10	                main:581]	:	INFO	:	Epoch 1967 | loss: 0.0311678 | val_loss: 0.031178 | Time: 3320.78 ms
[2021-07-17 04:11:13	                main:581]	:	INFO	:	Epoch 1968 | loss: 0.0311671 | val_loss: 0.0311762 | Time: 3059.45 ms
[2021-07-17 04:11:15	                main:581]	:	INFO	:	Epoch 1969 | loss: 0.0311668 | val_loss: 0.0311767 | Time: 2641.77 ms
[2021-07-17 04:11:18	                main:581]	:	INFO	:	Epoch 1970 | loss: 0.0311688 | val_loss: 0.0311807 | Time: 2478.71 ms
[2021-07-17 04:11:20	                main:581]	:	INFO	:	Epoch 1971 | loss: 0.0311736 | val_loss: 0.0311793 | Time: 2460.27 ms
[2021-07-17 04:11:23	                main:581]	:	INFO	:	Epoch 1972 | loss: 0.0311725 | val_loss: 0.0311773 | Time: 2321.15 ms
[2021-07-17 04:11:26	                main:581]	:	INFO	:	Epoch 1973 | loss: 0.031172 | val_loss: 0.0311774 | Time: 3082.56 ms
[2021-07-17 04:11:28	                main:581]	:	INFO	:	Epoch 1974 | loss: 0.0311704 | val_loss: 0.0311801 | Time: 2253.17 ms
[2021-07-17 04:11:30	                main:581]	:	INFO	:	Epoch 1975 | loss: 0.0311704 | val_loss: 0.0311776 | Time: 2269.83 ms
[2021-07-17 04:11:34	                main:581]	:	INFO	:	Epoch 1976 | loss: 0.0311677 | val_loss: 0.0311787 | Time: 3413.79 ms
[2021-07-17 04:11:36	                main:581]	:	INFO	:	Epoch 1977 | loss: 0.0311668 | val_loss: 0.0311778 | Time: 2639.08 ms
[2021-07-17 04:11:39	                main:581]	:	INFO	:	Epoch 1978 | loss: 0.0311661 | val_loss: 0.0311777 | Time: 2352.77 ms
[2021-07-17 04:11:41	                main:581]	:	INFO	:	Epoch 1979 | loss: 0.0311668 | val_loss: 0.0311856 | Time: 2093.3 ms
[2021-07-17 04:11:43	                main:581]	:	INFO	:	Epoch 1980 | loss: 0.0311702 | val_loss: 0.0311786 | Time: 2412.85 ms
[2021-07-17 04:11:45	                main:581]	:	INFO	:	Epoch 1981 | loss: 0.0311656 | val_loss: 0.0311772 | Time: 2342.43 ms
[2021-07-17 04:11:49	                main:581]	:	INFO	:	Epoch 1982 | loss: 0.031164 | val_loss: 0.0311781 | Time: 3079.14 ms
[2021-07-17 04:11:52	                main:581]	:	INFO	:	Epoch 1983 | loss: 0.0311645 | val_loss: 0.0311787 | Time: 3558.5 ms
[2021-07-17 04:11:54	                main:581]	:	INFO	:	Epoch 1984 | loss: 0.0311642 | val_loss: 0.0311804 | Time: 2210.49 ms
[2021-07-17 04:11:57	                main:581]	:	INFO	:	Epoch 1985 | loss: 0.0311701 | val_loss: 0.0311813 | Time: 2430.91 ms
[2021-07-17 04:12:00	                main:581]	:	INFO	:	Epoch 1986 | loss: 0.0311703 | val_loss: 0.0311864 | Time: 2935.76 ms
[2021-07-17 04:12:02	                main:581]	:	INFO	:	Epoch 1987 | loss: 0.0311703 | val_loss: 0.0311823 | Time: 2033.09 ms
[2021-07-17 04:12:04	                main:581]	:	INFO	:	Epoch 1988 | loss: 0.0311721 | val_loss: 0.0311776 | Time: 2313.84 ms
[2021-07-17 04:12:06	                main:581]	:	INFO	:	Epoch 1989 | loss: 0.0311685 | val_loss: 0.0311777 | Time: 2332.87 ms
[2021-07-17 04:12:09	                main:581]	:	INFO	:	Epoch 1990 | loss: 0.0311694 | val_loss: 0.0311781 | Time: 3087.92 ms
[2021-07-17 04:12:12	                main:581]	:	INFO	:	Epoch 1991 | loss: 0.0311695 | val_loss: 0.0311806 | Time: 2878.66 ms
[2021-07-17 04:12:15	                main:581]	:	INFO	:	Epoch 1992 | loss: 0.031168 | val_loss: 0.0311748 | Time: 2746.22 ms
[2021-07-17 04:12:17	                main:581]	:	INFO	:	Epoch 1993 | loss: 0.0311659 | val_loss: 0.031178 | Time: 2151.96 ms
[2021-07-17 04:12:20	                main:581]	:	INFO	:	Epoch 1994 | loss: 0.0311666 | val_loss: 0.0311757 | Time: 2727.45 ms
[2021-07-17 04:12:22	                main:581]	:	INFO	:	Epoch 1995 | loss: 0.0311642 | val_loss: 0.0311761 | Time: 2473.36 ms
[2021-07-17 04:12:25	                main:581]	:	INFO	:	Epoch 1996 | loss: 0.0311644 | val_loss: 0.031176 | Time: 2290.15 ms
[2021-07-17 04:12:27	                main:581]	:	INFO	:	Epoch 1997 | loss: 0.0311671 | val_loss: 0.0311766 | Time: 2385.84 ms
[2021-07-17 04:12:30	                main:581]	:	INFO	:	Epoch 1998 | loss: 0.0311648 | val_loss: 0.0311753 | Time: 2760.34 ms
[2021-07-17 04:12:33	                main:581]	:	INFO	:	Epoch 1999 | loss: 0.0311671 | val_loss: 0.0311766 | Time: 2870.25 ms
[2021-07-17 04:12:36	                main:581]	:	INFO	:	Epoch 2000 | loss: 0.0311667 | val_loss: 0.0311803 | Time: 2854.81 ms
[2021-07-17 04:12:38	                main:581]	:	INFO	:	Epoch 2001 | loss: 0.0311665 | val_loss: 0.0311779 | Time: 2769.5 ms
[2021-07-17 04:12:40	                main:581]	:	INFO	:	Epoch 2002 | loss: 0.0311652 | val_loss: 0.0311777 | Time: 2070.76 ms
[2021-07-17 04:12:43	                main:581]	:	INFO	:	Epoch 2003 | loss: 0.031166 | val_loss: 0.0311822 | Time: 2189.71 ms
[2021-07-17 04:12:45	                main:581]	:	INFO	:	Epoch 2004 | loss: 0.0311652 | val_loss: 0.0311789 | Time: 2145.51 ms
[2021-07-17 04:12:47	                main:581]	:	INFO	:	Epoch 2005 | loss: 0.0311634 | val_loss: 0.0311781 | Time: 2375.58 ms
[2021-07-17 04:12:50	                main:581]	:	INFO	:	Epoch 2006 | loss: 0.0311619 | val_loss: 0.0311773 | Time: 3168.51 ms
[2021-07-17 04:12:54	                main:581]	:	INFO	:	Epoch 2007 | loss: 0.0311643 | val_loss: 0.0311772 | Time: 3176.52 ms
[2021-07-17 04:12:56	                main:581]	:	INFO	:	Epoch 2008 | loss: 0.0311661 | val_loss: 0.0311795 | Time: 2978.2 ms
[2021-07-17 04:12:59	                main:581]	:	INFO	:	Epoch 2009 | loss: 0.031165 | val_loss: 0.0311798 | Time: 2682.55 ms
[2021-07-17 04:13:01	                main:581]	:	INFO	:	Epoch 2010 | loss: 0.0311676 | val_loss: 0.0311788 | Time: 2200.67 ms
[2021-07-17 04:13:04	                main:581]	:	INFO	:	Epoch 2011 | loss: 0.0311726 | val_loss: 0.0311807 | Time: 2452.66 ms
[2021-07-17 04:13:06	                main:581]	:	INFO	:	Epoch 2012 | loss: 0.0311782 | val_loss: 0.0311777 | Time: 2372.81 ms
[2021-07-17 04:13:09	                main:581]	:	INFO	:	Epoch 2013 | loss: 0.0311697 | val_loss: 0.031179 | Time: 2731.42 ms
[2021-07-17 04:13:11	                main:581]	:	INFO	:	Epoch 2014 | loss: 0.0311678 | val_loss: 0.0311786 | Time: 2091.68 ms
[2021-07-17 04:13:14	                main:581]	:	INFO	:	Epoch 2015 | loss: 0.0311657 | val_loss: 0.0311775 | Time: 3333.5 ms
[2021-07-17 04:13:17	                main:581]	:	INFO	:	Epoch 2016 | loss: 0.0311664 | val_loss: 0.0311794 | Time: 2981.66 ms
[2021-07-17 04:13:20	                main:581]	:	INFO	:	Epoch 2017 | loss: 0.031164 | val_loss: 0.0311785 | Time: 2815.52 ms
[2021-07-17 04:13:23	                main:581]	:	INFO	:	Epoch 2018 | loss: 0.0311636 | val_loss: 0.0311817 | Time: 2685.22 ms
[2021-07-17 04:13:25	                main:581]	:	INFO	:	Epoch 2019 | loss: 0.0311629 | val_loss: 0.0311806 | Time: 2326.5 ms
[2021-07-17 04:13:28	                main:581]	:	INFO	:	Epoch 2020 | loss: 0.0311649 | val_loss: 0.0311799 | Time: 2359.09 ms
[2021-07-17 04:13:31	                main:581]	:	INFO	:	Epoch 2021 | loss: 0.031162 | val_loss: 0.0311798 | Time: 3007.94 ms
[2021-07-17 04:13:33	                main:581]	:	INFO	:	Epoch 2022 | loss: 0.0311609 | val_loss: 0.0311791 | Time: 2906.86 ms
[2021-07-17 04:13:36	                main:581]	:	INFO	:	Epoch 2023 | loss: 0.0311612 | val_loss: 0.0311819 | Time: 2131.17 ms
[2021-07-17 04:13:38	                main:581]	:	INFO	:	Epoch 2024 | loss: 0.0311636 | val_loss: 0.0311788 | Time: 2819.65 ms
[2021-07-17 04:13:41	                main:581]	:	INFO	:	Epoch 2025 | loss: 0.0311666 | val_loss: 0.0311856 | Time: 2745.73 ms
[2021-07-17 04:13:44	                main:581]	:	INFO	:	Epoch 2026 | loss: 0.0311685 | val_loss: 0.0311812 | Time: 2759.37 ms
[2021-07-17 04:13:46	                main:581]	:	INFO	:	Epoch 2027 | loss: 0.0311626 | val_loss: 0.0311792 | Time: 2037.63 ms
[2021-07-17 04:13:48	                main:581]	:	INFO	:	Epoch 2028 | loss: 0.0311618 | val_loss: 0.0311785 | Time: 2466.37 ms
[2021-07-17 04:13:51	                main:581]	:	INFO	:	Epoch 2029 | loss: 0.0311645 | val_loss: 0.0311799 | Time: 2901.62 ms
[2021-07-17 04:13:55	                main:581]	:	INFO	:	Epoch 2030 | loss: 0.0311631 | val_loss: 0.0311757 | Time: 3366.9 ms
[2021-07-17 04:13:58	                main:581]	:	INFO	:	Epoch 2031 | loss: 0.0311649 | val_loss: 0.0311794 | Time: 2863.04 ms
[2021-07-17 04:14:00	                main:581]	:	INFO	:	Epoch 2032 | loss: 0.0311674 | val_loss: 0.0311767 | Time: 2262 ms
[2021-07-17 04:14:03	                main:581]	:	INFO	:	Epoch 2033 | loss: 0.0311644 | val_loss: 0.0311763 | Time: 2959.79 ms
[2021-07-17 04:14:05	                main:581]	:	INFO	:	Epoch 2034 | loss: 0.031164 | val_loss: 0.0311746 | Time: 2361.52 ms
[2021-07-17 04:14:07	                main:581]	:	INFO	:	Epoch 2035 | loss: 0.0311644 | val_loss: 0.0311745 | Time: 2146.67 ms
[2021-07-17 04:14:09	                main:581]	:	INFO	:	Epoch 2036 | loss: 0.0311609 | val_loss: 0.0311775 | Time: 2134.21 ms
[2021-07-17 04:14:12	                main:581]	:	INFO	:	Epoch 2037 | loss: 0.0311609 | val_loss: 0.031177 | Time: 2909.9 ms
[2021-07-17 04:14:15	                main:581]	:	INFO	:	Epoch 2038 | loss: 0.0311605 | val_loss: 0.0311773 | Time: 3160.97 ms
[2021-07-17 04:14:19	                main:581]	:	INFO	:	Epoch 2039 | loss: 0.0311603 | val_loss: 0.0311769 | Time: 3553.51 ms
[2021-07-17 04:14:22	                main:581]	:	INFO	:	Epoch 2040 | loss: 0.0311595 | val_loss: 0.0311762 | Time: 2954.28 ms
[2021-07-17 04:14:24	                main:581]	:	INFO	:	Epoch 2041 | loss: 0.0311621 | val_loss: 0.03118 | Time: 2246.48 ms
[2021-07-17 04:14:27	                main:581]	:	INFO	:	Epoch 2042 | loss: 0.0311601 | val_loss: 0.0311775 | Time: 2655.94 ms
[2021-07-17 04:14:29	                main:581]	:	INFO	:	Epoch 2043 | loss: 0.0311589 | val_loss: 0.0311794 | Time: 2208.64 ms
[2021-07-17 04:14:31	                main:581]	:	INFO	:	Epoch 2044 | loss: 0.0311582 | val_loss: 0.0311779 | Time: 2174.98 ms
[2021-07-17 04:14:34	                main:581]	:	INFO	:	Epoch 2045 | loss: 0.0311574 | val_loss: 0.0311782 | Time: 2350.52 ms
[2021-07-17 04:14:37	                main:581]	:	INFO	:	Epoch 2046 | loss: 0.0311573 | val_loss: 0.0311768 | Time: 3140.09 ms
[2021-07-17 04:14:40	                main:581]	:	INFO	:	Epoch 2047 | loss: 0.0311592 | val_loss: 0.0311802 | Time: 3453.22 ms
[2021-07-17 04:14:43	                main:581]	:	INFO	:	Epoch 2048 | loss: 0.0311602 | val_loss: 0.0311788 | Time: 3030.52 ms
[2021-07-17 04:14:43	                main:604]	:	INFO	:	Saving trained model to model-final.pt, val_loss 0.0311788
[2021-07-17 04:14:43	                main:610]	:	INFO	:	Saving end state to config to file
[2021-07-17 04:14:43	                main:615]	:	INFO	:	Success, exiting..
04:14:43 (17304): called boinc_finish(0)

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)