Task 12954133

Name ParityModified-1647041059-17734-0_0
Workunit 10086457
Created 11 Mar 2022, 23:24:23 UTC
Sent 15 Mar 2022, 7:56:22 UTC
Report deadline 23 Mar 2022, 7:56:22 UTC
Received 15 Mar 2022, 17:22:22 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 13797
Run time 1 hours 8 min 18 sec
CPU time 1 hours 8 min 14 sec
Validate state Valid
Credit 4,160.00
Device peak FLOPS 5,488.38 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.80 (cuda10200)
x86_64-pc-linux-gnu
Peak working set size 2.32 GB
Peak swap size 10.45 GB
Peak disk usage 2.99 GB

Stderr output

<core_client_version>7.14.2</core_client_version>
<![CDATA[
<stderr_txt>
2022-03-15 17:13:55	                main:581]	:	INFO	:	Epoch 1581 | loss: 0.0310237 | val_loss: 0.0313116 | Time: 1934.16 ms
[2022-03-15 17:13:56	                main:581]	:	INFO	:	Epoch 1582 | loss: 0.0310295 | val_loss: 0.0313151 | Time: 1934.6 ms
[2022-03-15 17:13:58	                main:581]	:	INFO	:	Epoch 1583 | loss: 0.0310342 | val_loss: 0.03127 | Time: 1956.55 ms
[2022-03-15 17:14:01	                main:581]	:	INFO	:	Epoch 1584 | loss: 0.0310406 | val_loss: 0.0312483 | Time: 2401.97 ms
[2022-03-15 17:14:03	                main:581]	:	INFO	:	Epoch 1585 | loss: 0.0310265 | val_loss: 0.0312923 | Time: 2359.53 ms
[2022-03-15 17:14:05	                main:581]	:	INFO	:	Epoch 1586 | loss: 0.0310167 | val_loss: 0.0313091 | Time: 1945.78 ms
[2022-03-15 17:14:07	                main:581]	:	INFO	:	Epoch 1587 | loss: 0.0310121 | val_loss: 0.0312849 | Time: 1941.5 ms
[2022-03-15 17:14:09	                main:581]	:	INFO	:	Epoch 1588 | loss: 0.0310162 | val_loss: 0.031297 | Time: 1939.57 ms
[2022-03-15 17:14:11	                main:581]	:	INFO	:	Epoch 1589 | loss: 0.031018 | val_loss: 0.0312753 | Time: 1938.62 ms
[2022-03-15 17:14:13	                main:581]	:	INFO	:	Epoch 1590 | loss: 0.0310217 | val_loss: 0.0313197 | Time: 1941.7 ms
[2022-03-15 17:14:15	                main:581]	:	INFO	:	Epoch 1591 | loss: 0.0310186 | val_loss: 0.0312746 | Time: 1938.16 ms
[2022-03-15 17:14:17	                main:581]	:	INFO	:	Epoch 1592 | loss: 0.0310258 | val_loss: 0.0312832 | Time: 1939.15 ms
[2022-03-15 17:14:19	                main:581]	:	INFO	:	Epoch 1593 | loss: 0.0310174 | val_loss: 0.0313019 | Time: 1935.3 ms
[2022-03-15 17:14:21	                main:581]	:	INFO	:	Epoch 1594 | loss: 0.0310348 | val_loss: 0.031285 | Time: 1936.21 ms
[2022-03-15 17:14:23	                main:581]	:	INFO	:	Epoch 1595 | loss: 0.0310239 | val_loss: 0.0312896 | Time: 1937.97 ms
[2022-03-15 17:14:25	                main:581]	:	INFO	:	Epoch 1596 | loss: 0.0310193 | val_loss: 0.0312675 | Time: 1935.03 ms
[2022-03-15 17:14:26	                main:581]	:	INFO	:	Epoch 1597 | loss: 0.0310247 | val_loss: 0.0312808 | Time: 1937.16 ms
[2022-03-15 17:14:28	                main:581]	:	INFO	:	Epoch 1598 | loss: 0.0310302 | val_loss: 0.0313028 | Time: 1936.07 ms
[2022-03-15 17:14:30	                main:581]	:	INFO	:	Epoch 1599 | loss: 0.0310258 | val_loss: 0.0312806 | Time: 1933.77 ms
[2022-03-15 17:14:32	                main:581]	:	INFO	:	Epoch 1600 | loss: 0.0310164 | val_loss: 0.0313108 | Time: 1937.55 ms
[2022-03-15 17:14:34	                main:581]	:	INFO	:	Epoch 1601 | loss: 0.0310202 | val_loss: 0.0312775 | Time: 1936.35 ms
[2022-03-15 17:14:36	                main:581]	:	INFO	:	Epoch 1602 | loss: 0.0310152 | val_loss: 0.0312892 | Time: 1935.08 ms
[2022-03-15 17:14:38	                main:581]	:	INFO	:	Epoch 1603 | loss: 0.0310084 | val_loss: 0.0312652 | Time: 1935.65 ms
[2022-03-15 17:14:40	                main:581]	:	INFO	:	Epoch 1604 | loss: 0.0310193 | val_loss: 0.031283 | Time: 1934.95 ms
[2022-03-15 17:14:42	                main:581]	:	INFO	:	Epoch 1605 | loss: 0.0310225 | val_loss: 0.03128 | Time: 1959.62 ms
[2022-03-15 17:14:44	                main:581]	:	INFO	:	Epoch 1606 | loss: 0.0310193 | val_loss: 0.0312765 | Time: 1933.48 ms
[2022-03-15 17:14:46	                main:581]	:	INFO	:	Epoch 1607 | loss: 0.0310163 | val_loss: 0.0312831 | Time: 1934.13 ms
[2022-03-15 17:14:48	                main:581]	:	INFO	:	Epoch 1608 | loss: 0.0310213 | val_loss: 0.031291 | Time: 1934.59 ms
[2022-03-15 17:14:50	                main:581]	:	INFO	:	Epoch 1609 | loss: 0.0310246 | val_loss: 0.0312666 | Time: 1935.26 ms
[2022-03-15 17:14:52	                main:581]	:	INFO	:	Epoch 1610 | loss: 0.0310184 | val_loss: 0.031281 | Time: 1935.95 ms
[2022-03-15 17:14:54	                main:581]	:	INFO	:	Epoch 1611 | loss: 0.0310128 | val_loss: 0.0312876 | Time: 1937.71 ms
[2022-03-15 17:14:56	                main:581]	:	INFO	:	Epoch 1612 | loss: 0.0310266 | val_loss: 0.0313037 | Time: 1933.85 ms
[2022-03-15 17:14:57	                main:581]	:	INFO	:	Epoch 1613 | loss: 0.0310211 | val_loss: 0.0312751 | Time: 1935.75 ms
[2022-03-15 17:14:59	                main:581]	:	INFO	:	Epoch 1614 | loss: 0.0310265 | val_loss: 0.0312707 | Time: 1933.64 ms
[2022-03-15 17:15:01	                main:581]	:	INFO	:	Epoch 1615 | loss: 0.0310263 | val_loss: 0.0312957 | Time: 1958.36 ms
[2022-03-15 17:15:03	                main:581]	:	INFO	:	Epoch 1616 | loss: 0.0310177 | val_loss: 0.0312895 | Time: 1936.72 ms
[2022-03-15 17:15:05	                main:581]	:	INFO	:	Epoch 1617 | loss: 0.0310169 | val_loss: 0.0312802 | Time: 1936.58 ms
[2022-03-15 17:15:07	                main:581]	:	INFO	:	Epoch 1618 | loss: 0.031022 | val_loss: 0.0312759 | Time: 1936.34 ms
[2022-03-15 17:15:09	                main:581]	:	INFO	:	Epoch 1619 | loss: 0.0310179 | val_loss: 0.0312603 | Time: 1935.43 ms
[2022-03-15 17:15:11	                main:581]	:	INFO	:	Epoch 1620 | loss: 0.0310176 | val_loss: 0.0312823 | Time: 1934.4 ms
[2022-03-15 17:15:13	                main:581]	:	INFO	:	Epoch 1621 | loss: 0.031022 | val_loss: 0.0312824 | Time: 1936.11 ms
[2022-03-15 17:15:15	                main:581]	:	INFO	:	Epoch 1622 | loss: 0.0310182 | val_loss: 0.0312988 | Time: 1934.41 ms
[2022-03-15 17:15:17	                main:581]	:	INFO	:	Epoch 1623 | loss: 0.0310184 | val_loss: 0.0312746 | Time: 1934.65 ms
[2022-03-15 17:15:19	                main:581]	:	INFO	:	Epoch 1624 | loss: 0.0310154 | val_loss: 0.0313097 | Time: 1934.83 ms
[2022-03-15 17:15:21	                main:581]	:	INFO	:	Epoch 1625 | loss: 0.031022 | val_loss: 0.0313024 | Time: 1936.39 ms
[2022-03-15 17:15:23	                main:581]	:	INFO	:	Epoch 1626 | loss: 0.0310413 | val_loss: 0.0312842 | Time: 1938.58 ms
[2022-03-15 17:15:25	                main:581]	:	INFO	:	Epoch 1627 | loss: 0.031051 | val_loss: 0.0312518 | Time: 1935.6 ms
[2022-03-15 17:15:27	                main:581]	:	INFO	:	Epoch 1628 | loss: 0.0310454 | val_loss: 0.0312468 | Time: 1933.78 ms
[2022-03-15 17:15:28	                main:581]	:	INFO	:	Epoch 1629 | loss: 0.0310319 | val_loss: 0.0312828 | Time: 1934.29 ms
[2022-03-15 17:15:30	                main:581]	:	INFO	:	Epoch 1630 | loss: 0.0310193 | val_loss: 0.0312762 | Time: 1933.81 ms
[2022-03-15 17:15:32	                main:581]	:	INFO	:	Epoch 1631 | loss: 0.031015 | val_loss: 0.0312848 | Time: 1936.73 ms
[2022-03-15 17:15:34	                main:581]	:	INFO	:	Epoch 1632 | loss: 0.0310153 | val_loss: 0.0313202 | Time: 1935.17 ms
[2022-03-15 17:15:36	                main:581]	:	INFO	:	Epoch 1633 | loss: 0.0310189 | val_loss: 0.0312876 | Time: 1934.57 ms
[2022-03-15 17:15:38	                main:581]	:	INFO	:	Epoch 1634 | loss: 0.0310048 | val_loss: 0.0312916 | Time: 1934.21 ms
[2022-03-15 17:15:40	                main:581]	:	INFO	:	Epoch 1635 | loss: 0.0310097 | val_loss: 0.0312738 | Time: 1932.74 ms
[2022-03-15 17:15:42	                main:581]	:	INFO	:	Epoch 1636 | loss: 0.0310145 | val_loss: 0.0312867 | Time: 1933.74 ms
[2022-03-15 17:15:44	                main:581]	:	INFO	:	Epoch 1637 | loss: 0.0310142 | val_loss: 0.0312806 | Time: 1935.32 ms
[2022-03-15 17:15:46	                main:581]	:	INFO	:	Epoch 1638 | loss: 0.0310169 | val_loss: 0.0312768 | Time: 1933.16 ms
[2022-03-15 17:15:48	                main:581]	:	INFO	:	Epoch 1639 | loss: 0.031014 | val_loss: 0.0313041 | Time: 1934.75 ms
[2022-03-15 17:15:50	                main:581]	:	INFO	:	Epoch 1640 | loss: 0.0310117 | val_loss: 0.0313212 | Time: 1935.26 ms
[2022-03-15 17:15:52	                main:581]	:	INFO	:	Epoch 1641 | loss: 0.0310174 | val_loss: 0.0312857 | Time: 1934.04 ms
[2022-03-15 17:15:54	                main:581]	:	INFO	:	Epoch 1642 | loss: 0.0310188 | val_loss: 0.0312955 | Time: 1937.78 ms
[2022-03-15 17:15:56	                main:581]	:	INFO	:	Epoch 1643 | loss: 0.0310165 | val_loss: 0.031261 | Time: 1935.12 ms
[2022-03-15 17:15:57	                main:581]	:	INFO	:	Epoch 1644 | loss: 0.0310157 | val_loss: 0.0312986 | Time: 1934.47 ms
[2022-03-15 17:15:59	                main:581]	:	INFO	:	Epoch 1645 | loss: 0.0310176 | val_loss: 0.0313154 | Time: 1934.04 ms
[2022-03-15 17:16:02	                main:581]	:	INFO	:	Epoch 1646 | loss: 0.0310163 | val_loss: 0.0312904 | Time: 2403.76 ms
[2022-03-15 17:16:04	                main:581]	:	INFO	:	Epoch 1647 | loss: 0.031019 | val_loss: 0.0312852 | Time: 1936.92 ms
[2022-03-15 17:16:06	                main:581]	:	INFO	:	Epoch 1648 | loss: 0.0310225 | val_loss: 0.0312763 | Time: 1935.9 ms
[2022-03-15 17:16:08	                main:581]	:	INFO	:	Epoch 1649 | loss: 0.0310321 | val_loss: 0.0312828 | Time: 1936.62 ms
[2022-03-15 17:16:10	                main:581]	:	INFO	:	Epoch 1650 | loss: 0.0310262 | val_loss: 0.0312624 | Time: 1936.06 ms
[2022-03-15 17:16:11	                main:581]	:	INFO	:	Epoch 1651 | loss: 0.0310269 | val_loss: 0.0312779 | Time: 1935.62 ms
[2022-03-15 17:16:13	                main:581]	:	INFO	:	Epoch 1652 | loss: 0.0310272 | val_loss: 0.0312608 | Time: 1936.97 ms
[2022-03-15 17:16:15	                main:581]	:	INFO	:	Epoch 1653 | loss: 0.0310151 | val_loss: 0.0312963 | Time: 1934.32 ms
[2022-03-15 17:16:17	                main:581]	:	INFO	:	Epoch 1654 | loss: 0.031008 | val_loss: 0.0313064 | Time: 1932.64 ms
[2022-03-15 17:16:20	                main:581]	:	INFO	:	Epoch 1655 | loss: 0.0310172 | val_loss: 0.031268 | Time: 2456.1 ms
[2022-03-15 17:16:23	                main:581]	:	INFO	:	Epoch 1656 | loss: 0.0310135 | val_loss: 0.031299 | Time: 3289.62 ms
[2022-03-15 17:16:26	                main:581]	:	INFO	:	Epoch 1657 | loss: 0.0310118 | val_loss: 0.031282 | Time: 3285.43 ms
[2022-03-15 17:16:29	                main:581]	:	INFO	:	Epoch 1658 | loss: 0.0310236 | val_loss: 0.0312691 | Time: 2245.46 ms
[2022-03-15 17:16:31	                main:581]	:	INFO	:	Epoch 1659 | loss: 0.0310275 | val_loss: 0.0312625 | Time: 1939.66 ms
[2022-03-15 17:16:32	                main:581]	:	INFO	:	Epoch 1660 | loss: 0.0310314 | val_loss: 0.0312997 | Time: 1937.96 ms
[2022-03-15 17:16:34	                main:581]	:	INFO	:	Epoch 1661 | loss: 0.0310225 | val_loss: 0.0312906 | Time: 1937.51 ms
[2022-03-15 17:16:36	                main:581]	:	INFO	:	Epoch 1662 | loss: 0.0310202 | val_loss: 0.0312673 | Time: 1937.86 ms
[2022-03-15 17:16:38	                main:581]	:	INFO	:	Epoch 1663 | loss: 0.0310253 | val_loss: 0.0312837 | Time: 1933.97 ms
[2022-03-15 17:16:40	                main:581]	:	INFO	:	Epoch 1664 | loss: 0.0310235 | val_loss: 0.0312781 | Time: 1935 ms
[2022-03-15 17:16:42	                main:581]	:	INFO	:	Epoch 1665 | loss: 0.0310624 | val_loss: 0.0313213 | Time: 1935.27 ms
[2022-03-15 17:16:44	                main:581]	:	INFO	:	Epoch 1666 | loss: 0.0329954 | val_loss: 0.0327144 | Time: 1936.83 ms
[2022-03-15 17:16:46	                main:581]	:	INFO	:	Epoch 1667 | loss: 0.0347039 | val_loss: 0.035268 | Time: 1935.3 ms
[2022-03-15 17:16:48	                main:581]	:	INFO	:	Epoch 1668 | loss: 0.0344349 | val_loss: 0.0321578 | Time: 1934.11 ms
[2022-03-15 17:16:50	                main:581]	:	INFO	:	Epoch 1669 | loss: 0.0316186 | val_loss: 0.031432 | Time: 1932.96 ms
[2022-03-15 17:16:52	                main:581]	:	INFO	:	Epoch 1670 | loss: 0.0313207 | val_loss: 0.0312757 | Time: 1933.92 ms
[2022-03-15 17:16:54	                main:581]	:	INFO	:	Epoch 1671 | loss: 0.0312658 | val_loss: 0.0312535 | Time: 1937.1 ms
[2022-03-15 17:16:56	                main:581]	:	INFO	:	Epoch 1672 | loss: 0.0312551 | val_loss: 0.0312538 | Time: 1935.4 ms
[2022-03-15 17:16:58	                main:581]	:	INFO	:	Epoch 1673 | loss: 0.0312527 | val_loss: 0.0312535 | Time: 1935.62 ms
[2022-03-15 17:17:00	                main:581]	:	INFO	:	Epoch 1674 | loss: 0.0312526 | val_loss: 0.0312516 | Time: 1934.89 ms
[2022-03-15 17:17:02	                main:581]	:	INFO	:	Epoch 1675 | loss: 0.0312513 | val_loss: 0.0312509 | Time: 2938.13 ms
[2022-03-15 17:17:05	                main:581]	:	INFO	:	Epoch 1676 | loss: 0.0312511 | val_loss: 0.0312507 | Time: 2849.31 ms
[2022-03-15 17:17:07	                main:581]	:	INFO	:	Epoch 1677 | loss: 0.0312507 | val_loss: 0.0312515 | Time: 1933.88 ms
[2022-03-15 17:17:09	                main:581]	:	INFO	:	Epoch 1678 | loss: 0.0312514 | val_loss: 0.0312508 | Time: 1937.12 ms
[2022-03-15 17:17:11	                main:581]	:	INFO	:	Epoch 1679 | loss: 0.0312514 | val_loss: 0.0312509 | Time: 1935.87 ms
[2022-03-15 17:17:13	                main:581]	:	INFO	:	Epoch 1680 | loss: 0.0312509 | val_loss: 0.0312508 | Time: 1937.6 ms
[2022-03-15 17:17:15	                main:581]	:	INFO	:	Epoch 1681 | loss: 0.0312508 | val_loss: 0.0312503 | Time: 1935.56 ms
[2022-03-15 17:17:17	                main:581]	:	INFO	:	Epoch 1682 | loss: 0.0312506 | val_loss: 0.0312507 | Time: 1936.66 ms
[2022-03-15 17:17:19	                main:581]	:	INFO	:	Epoch 1683 | loss: 0.0312507 | val_loss: 0.0312506 | Time: 1935.14 ms
[2022-03-15 17:17:21	                main:581]	:	INFO	:	Epoch 1684 | loss: 0.0312504 | val_loss: 0.0312504 | Time: 1934.74 ms
[2022-03-15 17:17:23	                main:581]	:	INFO	:	Epoch 1685 | loss: 0.0312506 | val_loss: 0.0312515 | Time: 1936.38 ms
[2022-03-15 17:17:25	                main:581]	:	INFO	:	Epoch 1686 | loss: 0.0312521 | val_loss: 0.0312542 | Time: 1938.18 ms
[2022-03-15 17:17:27	                main:581]	:	INFO	:	Epoch 1687 | loss: 0.031251 | val_loss: 0.0312502 | Time: 1935.7 ms
[2022-03-15 17:17:29	                main:581]	:	INFO	:	Epoch 1688 | loss: 0.0312506 | val_loss: 0.0312526 | Time: 1936.76 ms
[2022-03-15 17:17:31	                main:581]	:	INFO	:	Epoch 1689 | loss: 0.0312512 | val_loss: 0.0312503 | Time: 1935.87 ms
[2022-03-15 17:17:32	                main:581]	:	INFO	:	Epoch 1690 | loss: 0.0312508 | val_loss: 0.0312516 | Time: 1934.98 ms
[2022-03-15 17:17:34	                main:581]	:	INFO	:	Epoch 1691 | loss: 0.0312502 | val_loss: 0.0312503 | Time: 1937.09 ms
[2022-03-15 17:17:36	                main:581]	:	INFO	:	Epoch 1692 | loss: 0.0312503 | val_loss: 0.0312503 | Time: 1935.26 ms
[2022-03-15 17:17:38	                main:581]	:	INFO	:	Epoch 1693 | loss: 0.0312505 | val_loss: 0.0312506 | Time: 1935.6 ms
[2022-03-15 17:17:40	                main:581]	:	INFO	:	Epoch 1694 | loss: 0.0312503 | val_loss: 0.0312511 | Time: 1935.33 ms
[2022-03-15 17:17:42	                main:581]	:	INFO	:	Epoch 1695 | loss: 0.0312503 | val_loss: 0.0312501 | Time: 1934.58 ms
[2022-03-15 17:17:44	                main:581]	:	INFO	:	Epoch 1696 | loss: 0.0312501 | val_loss: 0.0312501 | Time: 1937.63 ms
[2022-03-15 17:17:46	                main:581]	:	INFO	:	Epoch 1697 | loss: 0.03125 | val_loss: 0.0312505 | Time: 1934.14 ms
[2022-03-15 17:17:48	                main:581]	:	INFO	:	Epoch 1698 | loss: 0.0312504 | val_loss: 0.0312505 | Time: 1936.21 ms
[2022-03-15 17:17:50	                main:581]	:	INFO	:	Epoch 1699 | loss: 0.0312502 | val_loss: 0.0312503 | Time: 1934.24 ms
[2022-03-15 17:17:52	                main:581]	:	INFO	:	Epoch 1700 | loss: 0.03125 | val_loss: 0.0312509 | Time: 1934.15 ms
[2022-03-15 17:17:54	                main:581]	:	INFO	:	Epoch 1701 | loss: 0.0312508 | val_loss: 0.0312509 | Time: 1937.61 ms
[2022-03-15 17:17:56	                main:581]	:	INFO	:	Epoch 1702 | loss: 0.0312508 | val_loss: 0.0312502 | Time: 1935.22 ms
[2022-03-15 17:17:58	                main:581]	:	INFO	:	Epoch 1703 | loss: 0.0312502 | val_loss: 0.0312501 | Time: 1935.18 ms
[2022-03-15 17:18:00	                main:581]	:	INFO	:	Epoch 1704 | loss: 0.0312501 | val_loss: 0.0312501 | Time: 1933.44 ms
[2022-03-15 17:18:02	                main:581]	:	INFO	:	Epoch 1705 | loss: 0.0312506 | val_loss: 0.031251 | Time: 1968.67 ms
[2022-03-15 17:18:03	                main:581]	:	INFO	:	Epoch 1706 | loss: 0.0312504 | val_loss: 0.031251 | Time: 1936.82 ms
[2022-03-15 17:18:05	                main:581]	:	INFO	:	Epoch 1707 | loss: 0.0312512 | val_loss: 0.0312505 | Time: 1934.41 ms
[2022-03-15 17:18:07	                main:581]	:	INFO	:	Epoch 1708 | loss: 0.03125 | val_loss: 0.0312501 | Time: 1935.72 ms
[2022-03-15 17:18:09	                main:581]	:	INFO	:	Epoch 1709 | loss: 0.0312503 | val_loss: 0.0312501 | Time: 1935.41 ms
[2022-03-15 17:18:11	                main:581]	:	INFO	:	Epoch 1710 | loss: 0.03125 | val_loss: 0.0312502 | Time: 1935.4 ms
[2022-03-15 17:18:13	                main:581]	:	INFO	:	Epoch 1711 | loss: 0.0312502 | val_loss: 0.0312503 | Time: 1934.45 ms
[2022-03-15 17:18:15	                main:581]	:	INFO	:	Epoch 1712 | loss: 0.0312504 | val_loss: 0.0312513 | Time: 1938.2 ms
[2022-03-15 17:18:17	                main:581]	:	INFO	:	Epoch 1713 | loss: 0.03125 | val_loss: 0.0312505 | Time: 1936.15 ms
[2022-03-15 17:18:19	                main:581]	:	INFO	:	Epoch 1714 | loss: 0.0312505 | val_loss: 0.0312505 | Time: 1935.6 ms
[2022-03-15 17:18:21	                main:581]	:	INFO	:	Epoch 1715 | loss: 0.0312504 | val_loss: 0.0312508 | Time: 1933.62 ms
[2022-03-15 17:18:23	                main:581]	:	INFO	:	Epoch 1716 | loss: 0.0312501 | val_loss: 0.0312499 | Time: 1935.46 ms
[2022-03-15 17:18:25	                main:581]	:	INFO	:	Epoch 1717 | loss: 0.0312499 | val_loss: 0.031251 | Time: 1938.41 ms
[2022-03-15 17:18:27	                main:581]	:	INFO	:	Epoch 1718 | loss: 0.0312511 | val_loss: 0.0312504 | Time: 1935.88 ms
[2022-03-15 17:18:29	                main:581]	:	INFO	:	Epoch 1719 | loss: 0.0312501 | val_loss: 0.03125 | Time: 1935.08 ms
[2022-03-15 17:18:31	                main:581]	:	INFO	:	Epoch 1720 | loss: 0.0312502 | val_loss: 0.0312511 | Time: 1933.59 ms
[2022-03-15 17:18:32	                main:581]	:	INFO	:	Epoch 1721 | loss: 0.0312508 | val_loss: 0.0312505 | Time: 1934.36 ms
[2022-03-15 17:18:34	                main:581]	:	INFO	:	Epoch 1722 | loss: 0.03125 | val_loss: 0.0312508 | Time: 1936.26 ms
[2022-03-15 17:18:36	                main:581]	:	INFO	:	Epoch 1723 | loss: 0.0312503 | val_loss: 0.0312505 | Time: 1934.25 ms
[2022-03-15 17:18:38	                main:581]	:	INFO	:	Epoch 1724 | loss: 0.0312506 | val_loss: 0.0312506 | Time: 1933.16 ms
[2022-03-15 17:18:40	                main:581]	:	INFO	:	Epoch 1725 | loss: 0.0312499 | val_loss: 0.0312499 | Time: 1936.72 ms
[2022-03-15 17:18:42	                main:581]	:	INFO	:	Epoch 1726 | loss: 0.0312502 | val_loss: 0.03125 | Time: 1936.21 ms
[2022-03-15 17:18:44	                main:581]	:	INFO	:	Epoch 1727 | loss: 0.0312509 | val_loss: 0.0312526 | Time: 1938.07 ms
[2022-03-15 17:18:46	                main:581]	:	INFO	:	Epoch 1728 | loss: 0.0312511 | val_loss: 0.0312499 | Time: 1934.82 ms
[2022-03-15 17:18:48	                main:581]	:	INFO	:	Epoch 1729 | loss: 0.0312508 | val_loss: 0.0312511 | Time: 1933.54 ms
[2022-03-15 17:18:50	                main:581]	:	INFO	:	Epoch 1730 | loss: 0.0312509 | val_loss: 0.0312507 | Time: 1933.31 ms
[2022-03-15 17:18:52	                main:581]	:	INFO	:	Epoch 1731 | loss: 0.0312508 | val_loss: 0.0312505 | Time: 1936 ms
[2022-03-15 17:18:54	                main:581]	:	INFO	:	Epoch 1732 | loss: 0.0312499 | val_loss: 0.0312504 | Time: 1937.67 ms
[2022-03-15 17:18:56	                main:581]	:	INFO	:	Epoch 1733 | loss: 0.0312499 | val_loss: 0.0312504 | Time: 1934.5 ms
[2022-03-15 17:18:58	                main:581]	:	INFO	:	Epoch 1734 | loss: 0.03125 | val_loss: 0.0312505 | Time: 1934.43 ms
[2022-03-15 17:19:00	                main:581]	:	INFO	:	Epoch 1735 | loss: 0.0312499 | val_loss: 0.0312504 | Time: 1934.35 ms
[2022-03-15 17:19:02	                main:581]	:	INFO	:	Epoch 1736 | loss: 0.0312498 | val_loss: 0.03125 | Time: 2858.11 ms
[2022-03-15 17:19:05	                main:581]	:	INFO	:	Epoch 1737 | loss: 0.0312502 | val_loss: 0.0312501 | Time: 2243.64 ms
[2022-03-15 17:19:07	                main:581]	:	INFO	:	Epoch 1738 | loss: 0.0312504 | val_loss: 0.0312512 | Time: 1934.54 ms
[2022-03-15 17:19:09	                main:581]	:	INFO	:	Epoch 1739 | loss: 0.0312502 | val_loss: 0.0312501 | Time: 1935.4 ms
[2022-03-15 17:19:11	                main:581]	:	INFO	:	Epoch 1740 | loss: 0.0312505 | val_loss: 0.0312505 | Time: 1934.85 ms
[2022-03-15 17:19:12	                main:581]	:	INFO	:	Epoch 1741 | loss: 0.031251 | val_loss: 0.0312503 | Time: 1935.64 ms
[2022-03-15 17:19:14	                main:581]	:	INFO	:	Epoch 1742 | loss: 0.0312509 | val_loss: 0.0312499 | Time: 1938.82 ms
[2022-03-15 17:19:16	                main:581]	:	INFO	:	Epoch 1743 | loss: 0.0312506 | val_loss: 0.0312506 | Time: 1936.91 ms
[2022-03-15 17:19:18	                main:581]	:	INFO	:	Epoch 1744 | loss: 0.0312506 | val_loss: 0.0312505 | Time: 1935.05 ms
[2022-03-15 17:19:20	                main:581]	:	INFO	:	Epoch 1745 | loss: 0.0312512 | val_loss: 0.0312528 | Time: 1933.43 ms
[2022-03-15 17:19:22	                main:581]	:	INFO	:	Epoch 1746 | loss: 0.031251 | val_loss: 0.0312505 | Time: 1935.81 ms
[2022-03-15 17:19:24	                main:581]	:	INFO	:	Epoch 1747 | loss: 0.0312501 | val_loss: 0.0312499 | Time: 1937.08 ms
[2022-03-15 17:19:26	                main:581]	:	INFO	:	Epoch 1748 | loss: 0.0312507 | val_loss: 0.0312521 | Time: 1934.9 ms
[2022-03-15 17:19:28	                main:581]	:	INFO	:	Epoch 1749 | loss: 0.0312504 | val_loss: 0.0312499 | Time: 1935.43 ms
[2022-03-15 17:19:30	                main:581]	:	INFO	:	Epoch 1750 | loss: 0.0312506 | val_loss: 0.0312517 | Time: 1935.51 ms
[2022-03-15 17:19:32	                main:581]	:	INFO	:	Epoch 1751 | loss: 0.0312515 | val_loss: 0.0312507 | Time: 1934.88 ms
[2022-03-15 17:19:34	                main:581]	:	INFO	:	Epoch 1752 | loss: 0.0312508 | val_loss: 0.0312503 | Time: 1937.11 ms
[2022-03-15 17:19:36	                main:581]	:	INFO	:	Epoch 1753 | loss: 0.0312503 | val_loss: 0.03125 | Time: 1934.4 ms
[2022-03-15 17:19:38	                main:581]	:	INFO	:	Epoch 1754 | loss: 0.0312504 | val_loss: 0.0312509 | Time: 1934.73 ms
[2022-03-15 17:19:40	                main:581]	:	INFO	:	Epoch 1755 | loss: 0.031251 | val_loss: 0.0312499 | Time: 1935.26 ms
[2022-03-15 17:19:41	                main:581]	:	INFO	:	Epoch 1756 | loss: 0.0312498 | val_loss: 0.0312498 | Time: 1933.42 ms
[2022-03-15 17:19:43	                main:581]	:	INFO	:	Epoch 1757 | loss: 0.0312501 | val_loss: 0.031251 | Time: 1935.89 ms
[2022-03-15 17:19:45	                main:581]	:	INFO	:	Epoch 1758 | loss: 0.0312505 | val_loss: 0.0312509 | Time: 1936.09 ms
[2022-03-15 17:19:47	                main:581]	:	INFO	:	Epoch 1759 | loss: 0.0312508 | val_loss: 0.0312505 | Time: 1934.38 ms
[2022-03-15 17:19:49	                main:581]	:	INFO	:	Epoch 1760 | loss: 0.03125 | val_loss: 0.0312506 | Time: 1934.37 ms
[2022-03-15 17:19:51	                main:581]	:	INFO	:	Epoch 1761 | loss: 0.0312506 | val_loss: 0.0312517 | Time: 1935.54 ms
[2022-03-15 17:19:53	                main:581]	:	INFO	:	Epoch 1762 | loss: 0.0312502 | val_loss: 0.0312499 | Time: 1935.94 ms
[2022-03-15 17:19:55	                main:581]	:	INFO	:	Epoch 1763 | loss: 0.0312499 | val_loss: 0.0312509 | Time: 1937.55 ms
[2022-03-15 17:19:57	                main:581]	:	INFO	:	Epoch 1764 | loss: 0.0312511 | val_loss: 0.0312507 | Time: 1935.54 ms
[2022-03-15 17:19:59	                main:581]	:	INFO	:	Epoch 1765 | loss: 0.03125 | val_loss: 0.0312502 | Time: 1935.94 ms
[2022-03-15 17:20:01	                main:581]	:	INFO	:	Epoch 1766 | loss: 0.0312503 | val_loss: 0.0312523 | Time: 2305.69 ms
[2022-03-15 17:20:03	                main:581]	:	INFO	:	Epoch 1767 | loss: 0.0312507 | val_loss: 0.0312504 | Time: 2032.95 ms
[2022-03-15 17:20:05	                main:581]	:	INFO	:	Epoch 1768 | loss: 0.0312503 | val_loss: 0.0312501 | Time: 1936.35 ms
[2022-03-15 17:20:07	                main:581]	:	INFO	:	Epoch 1769 | loss: 0.03125 | val_loss: 0.0312498 | Time: 1935.58 ms
[2022-03-15 17:20:09	                main:581]	:	INFO	:	Epoch 1770 | loss: 0.03125 | val_loss: 0.03125 | Time: 1934.24 ms
[2022-03-15 17:20:11	                main:581]	:	INFO	:	Epoch 1771 | loss: 0.0312505 | val_loss: 0.03125 | Time: 1935.44 ms
[2022-03-15 17:20:13	                main:581]	:	INFO	:	Epoch 1772 | loss: 0.0312505 | val_loss: 0.0312507 | Time: 1936.45 ms
[2022-03-15 17:20:15	                main:581]	:	INFO	:	Epoch 1773 | loss: 0.0312505 | val_loss: 0.0312505 | Time: 1937.35 ms
[2022-03-15 17:20:17	                main:581]	:	INFO	:	Epoch 1774 | loss: 0.0312499 | val_loss: 0.0312498 | Time: 1934.59 ms
[2022-03-15 17:20:19	                main:581]	:	INFO	:	Epoch 1775 | loss: 0.03125 | val_loss: 0.0312499 | Time: 1934.54 ms
[2022-03-15 17:20:21	                main:581]	:	INFO	:	Epoch 1776 | loss: 0.03125 | val_loss: 0.0312498 | Time: 1934.81 ms
[2022-03-15 17:20:23	                main:581]	:	INFO	:	Epoch 1777 | loss: 0.0312498 | val_loss: 0.0312508 | Time: 1936.37 ms
[2022-03-15 17:20:25	                main:581]	:	INFO	:	Epoch 1778 | loss: 0.0312511 | val_loss: 0.0312512 | Time: 1939.45 ms
[2022-03-15 17:20:26	                main:581]	:	INFO	:	Epoch 1779 | loss: 0.03125 | val_loss: 0.0312527 | Time: 1934.48 ms
[2022-03-15 17:20:28	                main:581]	:	INFO	:	Epoch 1780 | loss: 0.0312508 | val_loss: 0.0312519 | Time: 1935.81 ms
[2022-03-15 17:20:30	                main:581]	:	INFO	:	Epoch 1781 | loss: 0.0312505 | val_loss: 0.0312514 | Time: 1935.87 ms
[2022-03-15 17:20:32	                main:581]	:	INFO	:	Epoch 1782 | loss: 0.0312506 | val_loss: 0.0312501 | Time: 1934.1 ms
[2022-03-15 17:20:34	                main:581]	:	INFO	:	Epoch 1783 | loss: 0.0312498 | val_loss: 0.0312498 | Time: 1937.19 ms
[2022-03-15 17:20:36	                main:581]	:	INFO	:	Epoch 1784 | loss: 0.0312499 | val_loss: 0.0312498 | Time: 1934.89 ms
[2022-03-15 17:20:38	                main:581]	:	INFO	:	Epoch 1785 | loss: 0.0312499 | val_loss: 0.0312509 | Time: 1935.94 ms
[2022-03-15 17:20:40	                main:581]	:	INFO	:	Epoch 1786 | loss: 0.0312498 | val_loss: 0.0312509 | Time: 1936.38 ms
[2022-03-15 17:20:42	                main:581]	:	INFO	:	Epoch 1787 | loss: 0.0312505 | val_loss: 0.031252 | Time: 1935.2 ms
[2022-03-15 17:20:44	                main:581]	:	INFO	:	Epoch 1788 | loss: 0.0312504 | val_loss: 0.0312503 | Time: 1934.87 ms
[2022-03-15 17:20:46	                main:581]	:	INFO	:	Epoch 1789 | loss: 0.0312499 | val_loss: 0.0312502 | Time: 1936.12 ms
[2022-03-15 17:20:48	                main:581]	:	INFO	:	Epoch 1790 | loss: 0.0312505 | val_loss: 0.0312503 | Time: 1933.42 ms
[2022-03-15 17:20:50	                main:581]	:	INFO	:	Epoch 1791 | loss: 0.0312503 | val_loss: 0.0312506 | Time: 1934.55 ms
[2022-03-15 17:20:52	                main:581]	:	INFO	:	Epoch 1792 | loss: 0.0312505 | val_loss: 0.0312522 | Time: 1936.27 ms
[2022-03-15 17:20:54	                main:581]	:	INFO	:	Epoch 1793 | loss: 0.031251 | val_loss: 0.0312501 | Time: 1935.42 ms
[2022-03-15 17:20:56	                main:581]	:	INFO	:	Epoch 1794 | loss: 0.0312508 | val_loss: 0.0312509 | Time: 1937.36 ms
[2022-03-15 17:20:57	                main:581]	:	INFO	:	Epoch 1795 | loss: 0.0312505 | val_loss: 0.0312534 | Time: 1935.72 ms
[2022-03-15 17:20:59	                main:581]	:	INFO	:	Epoch 1796 | loss: 0.031251 | val_loss: 0.0312497 | Time: 1935.62 ms
[2022-03-15 17:21:01	                main:581]	:	INFO	:	Epoch 1797 | loss: 0.0312499 | val_loss: 0.0312509 | Time: 2059.08 ms
[2022-03-15 17:21:03	                main:581]	:	INFO	:	Epoch 1798 | loss: 0.0312501 | val_loss: 0.0312518 | Time: 1935.42 ms
[2022-03-15 17:21:05	                main:581]	:	INFO	:	Epoch 1799 | loss: 0.03125 | val_loss: 0.03125 | Time: 1938.39 ms
[2022-03-15 17:21:07	                main:581]	:	INFO	:	Epoch 1800 | loss: 0.0312504 | val_loss: 0.0312509 | Time: 1934.45 ms
[2022-03-15 17:21:09	                main:581]	:	INFO	:	Epoch 1801 | loss: 0.0312498 | val_loss: 0.0312513 | Time: 1936.27 ms
[2022-03-15 17:21:11	                main:581]	:	INFO	:	Epoch 1802 | loss: 0.0312507 | val_loss: 0.0312517 | Time: 1935.39 ms
[2022-03-15 17:21:13	                main:581]	:	INFO	:	Epoch 1803 | loss: 0.0312501 | val_loss: 0.031251 | Time: 1934.57 ms
[2022-03-15 17:21:15	                main:581]	:	INFO	:	Epoch 1804 | loss: 0.0312505 | val_loss: 0.03125 | Time: 1936.16 ms
[2022-03-15 17:21:17	                main:581]	:	INFO	:	Epoch 1805 | loss: 0.0312501 | val_loss: 0.0312541 | Time: 1934.84 ms
[2022-03-15 17:21:19	                main:581]	:	INFO	:	Epoch 1806 | loss: 0.0312521 | val_loss: 0.0312518 | Time: 1933.22 ms
[2022-03-15 17:21:21	                main:581]	:	INFO	:	Epoch 1807 | loss: 0.0312513 | val_loss: 0.0312506 | Time: 1935.65 ms
[2022-03-15 17:21:23	                main:581]	:	INFO	:	Epoch 1808 | loss: 0.0312519 | val_loss: 0.0312506 | Time: 1934.88 ms
[2022-03-15 17:21:25	                main:581]	:	INFO	:	Epoch 1809 | loss: 0.0312512 | val_loss: 0.0312557 | Time: 1937.08 ms
[2022-03-15 17:21:27	                main:581]	:	INFO	:	Epoch 1810 | loss: 0.0312519 | val_loss: 0.031251 | Time: 1936.57 ms
[2022-03-15 17:21:29	                main:581]	:	INFO	:	Epoch 1811 | loss: 0.0312514 | val_loss: 0.0312506 | Time: 1935.39 ms
[2022-03-15 17:21:30	                main:581]	:	INFO	:	Epoch 1812 | loss: 0.0312524 | val_loss: 0.0312502 | Time: 1935.16 ms
[2022-03-15 17:21:32	                main:581]	:	INFO	:	Epoch 1813 | loss: 0.0312497 | val_loss: 0.0312499 | Time: 1933.42 ms
[2022-03-15 17:21:34	                main:581]	:	INFO	:	Epoch 1814 | loss: 0.0312503 | val_loss: 0.0312505 | Time: 1936.93 ms
[2022-03-15 17:21:36	                main:581]	:	INFO	:	Epoch 1815 | loss: 0.0312508 | val_loss: 0.0312501 | Time: 1935.71 ms
[2022-03-15 17:21:38	                main:581]	:	INFO	:	Epoch 1816 | loss: 0.0312507 | val_loss: 0.03125 | Time: 1934.34 ms
[2022-03-15 17:21:40	                main:581]	:	INFO	:	Epoch 1817 | loss: 0.03125 | val_loss: 0.0312499 | Time: 1934.78 ms
[2022-03-15 17:21:42	                main:581]	:	INFO	:	Epoch 1818 | loss: 0.0312504 | val_loss: 0.0312498 | Time: 1935.85 ms
[2022-03-15 17:21:44	                main:581]	:	INFO	:	Epoch 1819 | loss: 0.0312505 | val_loss: 0.0312499 | Time: 1935.06 ms
[2022-03-15 17:21:46	                main:581]	:	INFO	:	Epoch 1820 | loss: 0.0312509 | val_loss: 0.0312504 | Time: 1937.7 ms
[2022-03-15 17:21:48	                main:581]	:	INFO	:	Epoch 1821 | loss: 0.0312523 | val_loss: 0.0312499 | Time: 1933.75 ms
[2022-03-15 17:21:50	                main:581]	:	INFO	:	Epoch 1822 | loss: 0.0312506 | val_loss: 0.0312507 | Time: 1933.22 ms
[2022-03-15 17:21:52	                main:581]	:	INFO	:	Epoch 1823 | loss: 0.0312502 | val_loss: 0.0312497 | Time: 1936.4 ms
[2022-03-15 17:21:54	                main:581]	:	INFO	:	Epoch 1824 | loss: 0.0312502 | val_loss: 0.0312517 | Time: 1934.59 ms
[2022-03-15 17:21:56	                main:581]	:	INFO	:	Epoch 1825 | loss: 0.0312508 | val_loss: 0.0312503 | Time: 1937.98 ms
[2022-03-15 17:21:58	                main:581]	:	INFO	:	Epoch 1826 | loss: 0.0312498 | val_loss: 0.0312509 | Time: 1935.65 ms
[2022-03-15 17:22:00	                main:581]	:	INFO	:	Epoch 1827 | loss: 0.0312502 | val_loss: 0.0312498 | Time: 1935.71 ms
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/www.mlcathome.org_mlcathome/mlds-gpu_9.80_x86_64-pc-linux-gnu__cuda10200(+0x37df9c)[0x55592cec1f9c]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x12730)[0x7f533256b730]
/lib/x86_64-linux-gnu/libc.so.6(+0x39d57)[0x7f52b3e85d57]
/lib/x86_64-linux-gnu/libc.so.6(+0x39eba)[0x7f52b3e85eba]
../../projects/www.mlcathome.org_mlcathome/mlds-gpu_9.80_x86_64-pc-linux-gnu__cuda10200(+0x379b25)[0x55592cebdb25]
../../projects/www.mlcathome.org_mlcathome/mlds-gpu_9.80_x86_64-pc-linux-gnu__cuda10200(+0x379bee)[0x55592cebdbee]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x12730)[0x7f533256b730]
/lib/x86_64-linux-gnu/libpthread.so.0(pthread_cond_wait+0x1fa)[0x7f533256700a]
../../projects/www.mlcathome.org_mlcathome/mlds-gpu_9.80_x86_64-pc-linux-gnu__cuda10200(_ZNSt18condition_variable4waitERSt11unique_lockISt5mutexE+0xc)[0x55592cf58abc]
./libtorch_cpu.so(+0x275d0c3)[0x7f532eb640c3]
./libtorch_cpu.so(_ZN5torch8autograd6Engine11thread_mainERKSt10shared_ptrINS0_9GraphTaskEE+0xfc)[0x7f532eb68c8c]
./libtorch_cpu.so(_ZN5torch8autograd6Engine23execute_with_graph_taskERKSt10shared_ptrINS0_9GraphTaskEES2_INS0_4NodeEE+0x490)[0x7f532eb667c0]
./libtorch_cpu.so(_ZN5torch8autograd6Engine7executeERKSt6vectorINS0_4EdgeESaIS3_EERKS2_IN2at6TensorESaIS9_EEbbS7_+0x82f)[0x7f532eb659af]
./libtorch_cpu.so(+0x274c935)[0x7f532eb53935]
./libtorch_cpu.so(_ZN5torch8autograd8backwardERKSt6vectorIN2at6TensorESaIS3_EES7_N3c108optionalIbEEb+0x87)[0x7f532eb548b7]
./libtorch_cpu.so(+0x2c15b10)[0x7f532f01cb10]
./libtorch_cpu.so(+0x2407072)[0x7f532e80e072]
./libtorch_cpu.so(_ZNK2at6Tensor8backwardERKS0_N3c108optionalIbEEb+0x155)[0x7f532d36a065]
../../projects/www.mlcathome.org_mlcathome/mlds-gpu_9.80_x86_64-pc-linux-gnu__cuda10200(+0x9a27f)[0x55592cbde27f]
../../projects/www.mlcathome.org_mlcathome/mlds-gpu_9.80_x86_64-pc-linux-gnu__cuda10200(+0x8ad10)[0x55592cbced10]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xeb)[0x7f52b3e7009b]
../../projects/www.mlcathome.org_mlcathome/mlds-gpu_9.80_x86_64-pc-linux-gnu__cuda10200(+0x8675a)[0x55592cbca75a]

Exiting...
DEBUG: Args: ../../projects/www.mlcathome.org_mlcathome/mlds-gpu_9.80_x86_64-pc-linux-gnu__cuda10200 --maxepoch 2048 
nthreads: 1 gpudev: 0
Re-exec()-ing to set environment correctly
Machine Learning Dataset Generator v9.80 (Linux/x86_64) (libTorch: release/1.7 GPU: NVIDIA GeForce GTX 1660 Ti)
[2022-03-15 18:14:35	                main:442]	:	INFO	:	Set logging level to 1
[2022-03-15 18:14:35	                main:448]	:	INFO	:	Running in BOINC Client mode
[2022-03-15 18:14:35	                main:451]	:	INFO	:	Resolving all filenames
[2022-03-15 18:14:35	                main:459]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-15 18:14:35	                main:459]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-15 18:14:35	                main:459]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-15 18:14:35	                main:459]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 0)
[2022-03-15 18:14:35	                main:459]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-15 18:14:35	                main:479]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-03-15 18:14:35	                main:481]	:	INFO	:	Configuration: 
[2022-03-15 18:14:35	                main:482]	:	INFO	:	    Model type: GRU
[2022-03-15 18:14:35	                main:483]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-03-15 18:14:35	                main:484]	:	INFO	:	    Max Epochs: 2048
[2022-03-15 18:14:35	                main:485]	:	INFO	:	    Batch Size: 128
[2022-03-15 18:14:35	                main:486]	:	INFO	:	    Learning Rate: 0.01
[2022-03-15 18:14:35	                main:487]	:	INFO	:	    Patience: 10
[2022-03-15 18:14:35	                main:488]	:	INFO	:	    Hidden Width: 12
[2022-03-15 18:14:35	                main:489]	:	INFO	:	    # Recurrent Layers: 4
[2022-03-15 18:14:35	                main:490]	:	INFO	:	    # Backend Layers: 4
[2022-03-15 18:14:35	                main:491]	:	INFO	:	    # Threads: 1
[2022-03-15 18:14:35	                main:493]	:	INFO	:	Preparing Dataset
[2022-03-15 18:14:35	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-15 18:14:35	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-03-15 18:14:37	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-03-15 18:14:37	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-03-15 18:14:37	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-03-15 18:14:37	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-03-15 18:14:37	                main:501]	:	INFO	:	Creating Model
[2022-03-15 18:14:37	                main:514]	:	INFO	:	Preparing config file
[2022-03-15 18:14:37	                main:518]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-03-15 18:14:37	                main:519]	:	INFO	:	Loading config
[2022-03-15 18:14:37	                main:521]	:	INFO	:	Loading state
[2022-03-15 18:14:37	                main:566]	:	INFO	:	Loading DataLoader into Memory
[2022-03-15 18:14:37	                main:569]	:	INFO	:	Starting Training
[2022-03-15 18:14:41	                main:581]	:	INFO	:	Epoch 1828 | loss: 0.0314114 | val_loss: 0.0312648 | Time: 3368.79 ms
[2022-03-15 18:14:44	                main:581]	:	INFO	:	Epoch 1829 | loss: 0.0312602 | val_loss: 0.0312526 | Time: 3363.84 ms
[2022-03-15 18:14:47	                main:581]	:	INFO	:	Epoch 1830 | loss: 0.0312505 | val_loss: 0.0312487 | Time: 3134.78 ms
[2022-03-15 18:14:49	                main:581]	:	INFO	:	Epoch 1831 | loss: 0.0312463 | val_loss: 0.0312416 | Time: 1981.19 ms
[2022-03-15 18:14:51	                main:581]	:	INFO	:	Epoch 1832 | loss: 0.0312369 | val_loss: 0.0312252 | Time: 1972.9 ms
[2022-03-15 18:14:53	                main:581]	:	INFO	:	Epoch 1833 | loss: 0.0312785 | val_loss: 0.0312489 | Time: 1972.4 ms
[2022-03-15 18:14:55	                main:581]	:	INFO	:	Epoch 1834 | loss: 0.0312561 | val_loss: 0.0312511 | Time: 1973.59 ms
[2022-03-15 18:14:57	                main:581]	:	INFO	:	Epoch 1835 | loss: 0.0312363 | val_loss: 0.0312199 | Time: 1975.53 ms
[2022-03-15 18:14:59	                main:581]	:	INFO	:	Epoch 1836 | loss: 0.0312138 | val_loss: 0.0312566 | Time: 1974.76 ms
[2022-03-15 18:15:01	                main:581]	:	INFO	:	Epoch 1837 | loss: 0.0312152 | val_loss: 0.0312008 | Time: 2484.68 ms
[2022-03-15 18:15:03	                main:581]	:	INFO	:	Epoch 1838 | loss: 0.0311981 | val_loss: 0.0312029 | Time: 1973.18 ms
[2022-03-15 18:15:05	                main:581]	:	INFO	:	Epoch 1839 | loss: 0.0311989 | val_loss: 0.0312161 | Time: 1974.41 ms
[2022-03-15 18:15:07	                main:581]	:	INFO	:	Epoch 1840 | loss: 0.0312119 | val_loss: 0.0311958 | Time: 1971.95 ms
[2022-03-15 18:15:09	                main:581]	:	INFO	:	Epoch 1841 | loss: 0.0311983 | val_loss: 0.0311911 | Time: 1972.25 ms
[2022-03-15 18:15:11	                main:581]	:	INFO	:	Epoch 1842 | loss: 0.0311881 | val_loss: 0.0311864 | Time: 1972.28 ms
[2022-03-15 18:15:13	                main:581]	:	INFO	:	Epoch 1843 | loss: 0.0311882 | val_loss: 0.0311828 | Time: 1972.91 ms
[2022-03-15 18:15:15	                main:581]	:	INFO	:	Epoch 1844 | loss: 0.0311842 | val_loss: 0.0311791 | Time: 1973.55 ms
[2022-03-15 18:15:17	                main:581]	:	INFO	:	Epoch 1845 | loss: 0.031179 | val_loss: 0.031176 | Time: 1975.66 ms
[2022-03-15 18:15:19	                main:581]	:	INFO	:	Epoch 1846 | loss: 0.0311761 | val_loss: 0.0311793 | Time: 1974.34 ms
[2022-03-15 18:15:21	                main:581]	:	INFO	:	Epoch 1847 | loss: 0.0311767 | val_loss: 0.031174 | Time: 1973.66 ms
[2022-03-15 18:15:23	                main:581]	:	INFO	:	Epoch 1848 | loss: 0.0311744 | val_loss: 0.0311732 | Time: 1972.01 ms
[2022-03-15 18:15:25	                main:581]	:	INFO	:	Epoch 1849 | loss: 0.0311711 | val_loss: 0.031178 | Time: 1971.58 ms
[2022-03-15 18:15:27	                main:581]	:	INFO	:	Epoch 1850 | loss: 0.0311712 | val_loss: 0.0311719 | Time: 1974.64 ms
[2022-03-15 18:15:29	                main:581]	:	INFO	:	Epoch 1851 | loss: 0.0311703 | val_loss: 0.0311716 | Time: 1975.58 ms
[2022-03-15 18:15:31	                main:581]	:	INFO	:	Epoch 1852 | loss: 0.0311688 | val_loss: 0.0311709 | Time: 1972.22 ms
[2022-03-15 18:15:33	                main:581]	:	INFO	:	Epoch 1853 | loss: 0.03117 | val_loss: 0.0311754 | Time: 1971.79 ms
[2022-03-15 18:15:35	                main:581]	:	INFO	:	Epoch 1854 | loss: 0.031167 | val_loss: 0.0311708 | Time: 1974.11 ms
[2022-03-15 18:15:37	                main:581]	:	INFO	:	Epoch 1855 | loss: 0.0311696 | val_loss: 0.0311704 | Time: 1974.21 ms
[2022-03-15 18:15:39	                main:581]	:	INFO	:	Epoch 1856 | loss: 0.0311687 | val_loss: 0.0311706 | Time: 1977.22 ms
[2022-03-15 18:15:41	                main:581]	:	INFO	:	Epoch 1857 | loss: 0.0311657 | val_loss: 0.031169 | Time: 1973.24 ms
[2022-03-15 18:15:43	                main:581]	:	INFO	:	Epoch 1858 | loss: 0.0311636 | val_loss: 0.0311718 | Time: 1973.46 ms
[2022-03-15 18:15:45	                main:581]	:	INFO	:	Epoch 1859 | loss: 0.031165 | val_loss: 0.0311658 | Time: 1973.85 ms
[2022-03-15 18:15:47	                main:581]	:	INFO	:	Epoch 1860 | loss: 0.0311626 | val_loss: 0.0311676 | Time: 1973.27 ms
[2022-03-15 18:15:49	                main:581]	:	INFO	:	Epoch 1861 | loss: 0.0311611 | val_loss: 0.0311661 | Time: 1976.68 ms
[2022-03-15 18:15:51	                main:581]	:	INFO	:	Epoch 1862 | loss: 0.031161 | val_loss: 0.031165 | Time: 1973.2 ms
[2022-03-15 18:15:53	                main:581]	:	INFO	:	Epoch 1863 | loss: 0.0311619 | val_loss: 0.0311686 | Time: 1973.01 ms
[2022-03-15 18:15:55	                main:581]	:	INFO	:	Epoch 1864 | loss: 0.0311608 | val_loss: 0.0311713 | Time: 1971.24 ms
[2022-03-15 18:15:58	                main:581]	:	INFO	:	Epoch 1865 | loss: 0.0311629 | val_loss: 0.0311795 | Time: 2790.14 ms
[2022-03-15 18:16:00	                main:581]	:	INFO	:	Epoch 1866 | loss: 0.0311632 | val_loss: 0.0311718 | Time: 2715.3 ms
[2022-03-15 18:16:02	                main:581]	:	INFO	:	Epoch 1867 | loss: 0.0311605 | val_loss: 0.0311667 | Time: 1972.42 ms
[2022-03-15 18:16:04	                main:581]	:	INFO	:	Epoch 1868 | loss: 0.0311568 | val_loss: 0.0311683 | Time: 1971.48 ms
[2022-03-15 18:16:06	                main:581]	:	INFO	:	Epoch 1869 | loss: 0.0311547 | val_loss: 0.0311682 | Time: 1971.17 ms
[2022-03-15 18:16:08	                main:581]	:	INFO	:	Epoch 1870 | loss: 0.0311531 | val_loss: 0.0311681 | Time: 1976.65 ms
[2022-03-15 18:16:10	                main:581]	:	INFO	:	Epoch 1871 | loss: 0.0311534 | val_loss: 0.0311679 | Time: 1971.65 ms
[2022-03-15 18:16:12	                main:581]	:	INFO	:	Epoch 1872 | loss: 0.0311551 | val_loss: 0.0311678 | Time: 1972.33 ms
[2022-03-15 18:16:14	                main:581]	:	INFO	:	Epoch 1873 | loss: 0.0311533 | val_loss: 0.0311691 | Time: 1971.92 ms
[2022-03-15 18:16:16	                main:581]	:	INFO	:	Epoch 1874 | loss: 0.0311552 | val_loss: 0.0311667 | Time: 1972.86 ms
[2022-03-15 18:16:18	                main:581]	:	INFO	:	Epoch 1875 | loss: 0.0311565 | val_loss: 0.0311703 | Time: 1974.76 ms
[2022-03-15 18:16:20	                main:581]	:	INFO	:	Epoch 1876 | loss: 0.0311593 | val_loss: 0.0311743 | Time: 1974.44 ms
[2022-03-15 18:16:22	                main:581]	:	INFO	:	Epoch 1877 | loss: 0.0311554 | val_loss: 0.031166 | Time: 1972.47 ms
[2022-03-15 18:16:24	                main:581]	:	INFO	:	Epoch 1878 | loss: 0.0311506 | val_loss: 0.0311678 | Time: 1971.41 ms
[2022-03-15 18:16:26	                main:581]	:	INFO	:	Epoch 1879 | loss: 0.0311503 | val_loss: 0.0311673 | Time: 1971.71 ms
[2022-03-15 18:16:28	                main:581]	:	INFO	:	Epoch 1880 | loss: 0.0311513 | val_loss: 0.0311739 | Time: 1972.78 ms
[2022-03-15 18:16:30	                main:581]	:	INFO	:	Epoch 1881 | loss: 0.0311487 | val_loss: 0.0311671 | Time: 1973.37 ms
[2022-03-15 18:16:32	                main:581]	:	INFO	:	Epoch 1882 | loss: 0.0311487 | val_loss: 0.0311689 | Time: 1971.89 ms
[2022-03-15 18:16:34	                main:581]	:	INFO	:	Epoch 1883 | loss: 0.0311465 | val_loss: 0.0311669 | Time: 1972.12 ms
[2022-03-15 18:16:36	                main:581]	:	INFO	:	Epoch 1884 | loss: 0.0311465 | val_loss: 0.0311731 | Time: 1972.08 ms
[2022-03-15 18:16:38	                main:581]	:	INFO	:	Epoch 1885 | loss: 0.0311474 | val_loss: 0.0311674 | Time: 1971.03 ms
[2022-03-15 18:16:40	                main:581]	:	INFO	:	Epoch 1886 | loss: 0.0311504 | val_loss: 0.0311689 | Time: 1975.88 ms
[2022-03-15 18:16:42	                main:581]	:	INFO	:	Epoch 1887 | loss: 0.0311492 | val_loss: 0.0311715 | Time: 1971.65 ms
[2022-03-15 18:16:44	                main:581]	:	INFO	:	Epoch 1888 | loss: 0.0311471 | val_loss: 0.0311718 | Time: 1971.02 ms
[2022-03-15 18:16:46	                main:581]	:	INFO	:	Epoch 1889 | loss: 0.0311463 | val_loss: 0.0311693 | Time: 1972.57 ms
[2022-03-15 18:16:48	                main:581]	:	INFO	:	Epoch 1890 | loss: 0.0311464 | val_loss: 0.031172 | Time: 1973.4 ms
[2022-03-15 18:16:50	                main:581]	:	INFO	:	Epoch 1891 | loss: 0.0311454 | val_loss: 0.0311673 | Time: 1977.13 ms
[2022-03-15 18:16:52	                main:581]	:	INFO	:	Epoch 1892 | loss: 0.0311417 | val_loss: 0.031168 | Time: 1971.89 ms
[2022-03-15 18:16:54	                main:581]	:	INFO	:	Epoch 1893 | loss: 0.0311401 | val_loss: 0.0311712 | Time: 1971.41 ms
[2022-03-15 18:16:56	                main:581]	:	INFO	:	Epoch 1894 | loss: 0.0311394 | val_loss: 0.0311748 | Time: 1972.33 ms
[2022-03-15 18:16:57	                main:581]	:	INFO	:	Epoch 1895 | loss: 0.0311443 | val_loss: 0.0311911 | Time: 1972.48 ms
[2022-03-15 18:16:59	                main:581]	:	INFO	:	Epoch 1896 | loss: 0.0311458 | val_loss: 0.0311695 | Time: 1976.98 ms
[2022-03-15 18:17:02	                main:581]	:	INFO	:	Epoch 1897 | loss: 0.0311434 | val_loss: 0.03117 | Time: 2219.07 ms
[2022-03-15 18:17:04	                main:581]	:	INFO	:	Epoch 1898 | loss: 0.0311397 | val_loss: 0.0311765 | Time: 1971.43 ms
[2022-03-15 18:17:06	                main:581]	:	INFO	:	Epoch 1899 | loss: 0.0311432 | val_loss: 0.0311735 | Time: 1972.94 ms
[2022-03-15 18:17:08	                main:581]	:	INFO	:	Epoch 1900 | loss: 0.0311461 | val_loss: 0.0311732 | Time: 1974.15 ms
[2022-03-15 18:17:10	                main:581]	:	INFO	:	Epoch 1901 | loss: 0.0311404 | val_loss: 0.0311775 | Time: 1975.79 ms
[2022-03-15 18:17:12	                main:581]	:	INFO	:	Epoch 1902 | loss: 0.0311382 | val_loss: 0.0311782 | Time: 1971.86 ms
[2022-03-15 18:17:14	                main:581]	:	INFO	:	Epoch 1903 | loss: 0.031141 | val_loss: 0.0311723 | Time: 1971.53 ms
[2022-03-15 18:17:15	                main:581]	:	INFO	:	Epoch 1904 | loss: 0.0311384 | val_loss: 0.0311732 | Time: 1971.29 ms
[2022-03-15 18:17:17	                main:581]	:	INFO	:	Epoch 1905 | loss: 0.0311392 | val_loss: 0.0311743 | Time: 1970.99 ms
[2022-03-15 18:17:19	                main:581]	:	INFO	:	Epoch 1906 | loss: 0.0311374 | val_loss: 0.0311749 | Time: 1975.34 ms
[2022-03-15 18:17:21	                main:581]	:	INFO	:	Epoch 1907 | loss: 0.0311352 | val_loss: 0.0311729 | Time: 1975.15 ms
[2022-03-15 18:17:23	                main:581]	:	INFO	:	Epoch 1908 | loss: 0.0311347 | val_loss: 0.0311703 | Time: 1971.75 ms
[2022-03-15 18:17:25	                main:581]	:	INFO	:	Epoch 1909 | loss: 0.0311351 | val_loss: 0.0311695 | Time: 1971.12 ms
[2022-03-15 18:17:27	                main:581]	:	INFO	:	Epoch 1910 | loss: 0.0311361 | val_loss: 0.0311693 | Time: 1971.96 ms
[2022-03-15 18:17:29	                main:581]	:	INFO	:	Epoch 1911 | loss: 0.0311337 | val_loss: 0.0311762 | Time: 1973.18 ms
[2022-03-15 18:17:31	                main:581]	:	INFO	:	Epoch 1912 | loss: 0.0311396 | val_loss: 0.0311762 | Time: 1975.58 ms
[2022-03-15 18:17:33	                main:581]	:	INFO	:	Epoch 1913 | loss: 0.0311379 | val_loss: 0.0311702 | Time: 1973.39 ms
[2022-03-15 18:17:35	                main:581]	:	INFO	:	Epoch 1914 | loss: 0.0311319 | val_loss: 0.0311707 | Time: 1971.32 ms
[2022-03-15 18:17:37	                main:581]	:	INFO	:	Epoch 1915 | loss: 0.0311343 | val_loss: 0.0311671 | Time: 1971.78 ms
[2022-03-15 18:17:39	                main:581]	:	INFO	:	Epoch 1916 | loss: 0.0311319 | val_loss: 0.0311695 | Time: 1974.04 ms
[2022-03-15 18:17:41	                main:581]	:	INFO	:	Epoch 1917 | loss: 0.0311459 | val_loss: 0.0311707 | Time: 1972.3 ms
[2022-03-15 18:17:43	                main:581]	:	INFO	:	Epoch 1918 | loss: 0.0311461 | val_loss: 0.0311683 | Time: 1970.84 ms
[2022-03-15 18:17:45	                main:581]	:	INFO	:	Epoch 1919 | loss: 0.0311406 | val_loss: 0.0311647 | Time: 1973.16 ms
[2022-03-15 18:17:47	                main:581]	:	INFO	:	Epoch 1920 | loss: 0.0311378 | val_loss: 0.0311714 | Time: 1972.83 ms
[2022-03-15 18:17:49	                main:581]	:	INFO	:	Epoch 1921 | loss: 0.0311378 | val_loss: 0.0311731 | Time: 1973.78 ms
[2022-03-15 18:17:51	                main:581]	:	INFO	:	Epoch 1922 | loss: 0.031134 | val_loss: 0.0311685 | Time: 1974.93 ms
[2022-03-15 18:17:53	                main:581]	:	INFO	:	Epoch 1923 | loss: 0.031131 | val_loss: 0.0311789 | Time: 1972.46 ms
[2022-03-15 18:17:55	                main:581]	:	INFO	:	Epoch 1924 | loss: 0.0311287 | val_loss: 0.031178 | Time: 1972.94 ms
[2022-03-15 18:17:57	                main:581]	:	INFO	:	Epoch 1925 | loss: 0.0311268 | val_loss: 0.0311773 | Time: 1970.38 ms
[2022-03-15 18:17:59	                main:581]	:	INFO	:	Epoch 1926 | loss: 0.0311287 | val_loss: 0.0311768 | Time: 1972.88 ms
[2022-03-15 18:18:01	                main:581]	:	INFO	:	Epoch 1927 | loss: 0.0311296 | val_loss: 0.0311759 | Time: 2485.38 ms
[2022-03-15 18:18:04	                main:581]	:	INFO	:	Epoch 1928 | loss: 0.0311297 | val_loss: 0.0311809 | Time: 2415.37 ms
[2022-03-15 18:18:06	                main:581]	:	INFO	:	Epoch 1929 | loss: 0.0311303 | val_loss: 0.0311895 | Time: 1972.45 ms
[2022-03-15 18:18:08	                main:581]	:	INFO	:	Epoch 1930 | loss: 0.0311274 | val_loss: 0.0311819 | Time: 1969.94 ms
[2022-03-15 18:18:10	                main:581]	:	INFO	:	Epoch 1931 | loss: 0.031127 | val_loss: 0.0311776 | Time: 1973.66 ms
[2022-03-15 18:18:12	                main:581]	:	INFO	:	Epoch 1932 | loss: 0.0311265 | val_loss: 0.0311753 | Time: 1975.02 ms
[2022-03-15 18:18:14	                main:581]	:	INFO	:	Epoch 1933 | loss: 0.0311264 | val_loss: 0.0311691 | Time: 1971.68 ms
[2022-03-15 18:18:16	                main:581]	:	INFO	:	Epoch 1934 | loss: 0.0311263 | val_loss: 0.0311796 | Time: 1972.46 ms
[2022-03-15 18:18:18	                main:581]	:	INFO	:	Epoch 1935 | loss: 0.0311261 | val_loss: 0.0311805 | Time: 1970.66 ms
[2022-03-15 18:18:20	                main:581]	:	INFO	:	Epoch 1936 | loss: 0.0311262 | val_loss: 0.0311729 | Time: 1972.92 ms
[2022-03-15 18:18:22	                main:581]	:	INFO	:	Epoch 1937 | loss: 0.031127 | val_loss: 0.0311841 | Time: 1974.31 ms
[2022-03-15 18:18:24	                main:581]	:	INFO	:	Epoch 1938 | loss: 0.0311297 | val_loss: 0.031172 | Time: 1971.73 ms
[2022-03-15 18:18:25	                main:581]	:	INFO	:	Epoch 1939 | loss: 0.0311284 | val_loss: 0.0311787 | Time: 1972.39 ms
[2022-03-15 18:18:27	                main:581]	:	INFO	:	Epoch 1940 | loss: 0.0311279 | val_loss: 0.0311804 | Time: 1971.67 ms
[2022-03-15 18:18:29	                main:581]	:	INFO	:	Epoch 1941 | loss: 0.031128 | val_loss: 0.0311797 | Time: 1973.63 ms
[2022-03-15 18:18:31	                main:581]	:	INFO	:	Epoch 1942 | loss: 0.0311213 | val_loss: 0.0311836 | Time: 1974.96 ms
[2022-03-15 18:18:33	                main:581]	:	INFO	:	Epoch 1943 | loss: 0.03112 | val_loss: 0.0311835 | Time: 1971.76 ms
[2022-03-15 18:18:35	                main:581]	:	INFO	:	Epoch 1944 | loss: 0.0311208 | val_loss: 0.0311857 | Time: 1974.6 ms
[2022-03-15 18:18:37	                main:581]	:	INFO	:	Epoch 1945 | loss: 0.0311204 | val_loss: 0.0311903 | Time: 1973.01 ms
[2022-03-15 18:18:39	                main:581]	:	INFO	:	Epoch 1946 | loss: 0.0311225 | val_loss: 0.0311777 | Time: 1974 ms
[2022-03-15 18:18:41	                main:581]	:	INFO	:	Epoch 1947 | loss: 0.0311205 | val_loss: 0.0311806 | Time: 1971.38 ms
[2022-03-15 18:18:43	                main:581]	:	INFO	:	Epoch 1948 | loss: 0.0311196 | val_loss: 0.0311887 | Time: 1973.67 ms
[2022-03-15 18:18:45	                main:581]	:	INFO	:	Epoch 1949 | loss: 0.031118 | val_loss: 0.0311847 | Time: 1971.6 ms
[2022-03-15 18:18:47	                main:581]	:	INFO	:	Epoch 1950 | loss: 0.0311214 | val_loss: 0.0311855 | Time: 1974.28 ms
[2022-03-15 18:18:49	                main:581]	:	INFO	:	Epoch 1951 | loss: 0.0311195 | val_loss: 0.0311873 | Time: 1974.28 ms
[2022-03-15 18:18:51	                main:581]	:	INFO	:	Epoch 1952 | loss: 0.0311197 | val_loss: 0.0311853 | Time: 1971.75 ms
[2022-03-15 18:18:53	                main:581]	:	INFO	:	Epoch 1953 | loss: 0.0311224 | val_loss: 0.0311843 | Time: 1972.55 ms
[2022-03-15 18:18:55	                main:581]	:	INFO	:	Epoch 1954 | loss: 0.0311206 | val_loss: 0.0311878 | Time: 1972.41 ms
[2022-03-15 18:18:57	                main:581]	:	INFO	:	Epoch 1955 | loss: 0.0311222 | val_loss: 0.031184 | Time: 1972.79 ms
[2022-03-15 18:18:59	                main:581]	:	INFO	:	Epoch 1956 | loss: 0.0311243 | val_loss: 0.0311783 | Time: 1974.8 ms
[2022-03-15 18:19:01	                main:581]	:	INFO	:	Epoch 1957 | loss: 0.031122 | val_loss: 0.0311844 | Time: 2403.06 ms
[2022-03-15 18:19:03	                main:581]	:	INFO	:	Epoch 1958 | loss: 0.0311253 | val_loss: 0.0311792 | Time: 1974.46 ms
[2022-03-15 18:19:05	                main:581]	:	INFO	:	Epoch 1959 | loss: 0.0311315 | val_loss: 0.0311715 | Time: 1973.52 ms
[2022-03-15 18:19:07	                main:581]	:	INFO	:	Epoch 1960 | loss: 0.0311314 | val_loss: 0.0311795 | Time: 1971.42 ms
[2022-03-15 18:19:09	                main:581]	:	INFO	:	Epoch 1961 | loss: 0.0311236 | val_loss: 0.0311757 | Time: 1972.85 ms
[2022-03-15 18:19:11	                main:581]	:	INFO	:	Epoch 1962 | loss: 0.0311236 | val_loss: 0.0311823 | Time: 1971.94 ms
[2022-03-15 18:19:13	                main:581]	:	INFO	:	Epoch 1963 | loss: 0.0311229 | val_loss: 0.0311877 | Time: 1974 ms
[2022-03-15 18:19:15	                main:581]	:	INFO	:	Epoch 1964 | loss: 0.0311281 | val_loss: 0.0311846 | Time: 1970.47 ms
[2022-03-15 18:19:17	                main:581]	:	INFO	:	Epoch 1965 | loss: 0.0311217 | val_loss: 0.0311812 | Time: 1972.37 ms
[2022-03-15 18:19:19	                main:581]	:	INFO	:	Epoch 1966 | loss: 0.0311187 | val_loss: 0.0311794 | Time: 1974.16 ms
[2022-03-15 18:19:21	                main:581]	:	INFO	:	Epoch 1967 | loss: 0.0311174 | val_loss: 0.0311788 | Time: 1973.06 ms
[2022-03-15 18:19:23	                main:581]	:	INFO	:	Epoch 1968 | loss: 0.0311163 | val_loss: 0.0311746 | Time: 1975.63 ms
[2022-03-15 18:19:25	                main:581]	:	INFO	:	Epoch 1969 | loss: 0.0311148 | val_loss: 0.0311857 | Time: 1972.89 ms
[2022-03-15 18:19:27	                main:581]	:	INFO	:	Epoch 1970 | loss: 0.0311172 | val_loss: 0.0311879 | Time: 1972.03 ms
[2022-03-15 18:19:29	                main:581]	:	INFO	:	Epoch 1971 | loss: 0.0311161 | val_loss: 0.0311807 | Time: 1974.24 ms
[2022-03-15 18:19:31	                main:581]	:	INFO	:	Epoch 1972 | loss: 0.0311146 | val_loss: 0.0311805 | Time: 1972.93 ms
[2022-03-15 18:19:33	                main:581]	:	INFO	:	Epoch 1973 | loss: 0.0311155 | val_loss: 0.0311894 | Time: 1974 ms
[2022-03-15 18:19:35	                main:581]	:	INFO	:	Epoch 1974 | loss: 0.0311129 | val_loss: 0.0311963 | Time: 1972.09 ms
[2022-03-15 18:19:37	                main:581]	:	INFO	:	Epoch 1975 | loss: 0.0311139 | val_loss: 0.0311928 | Time: 1972.24 ms
[2022-03-15 18:19:39	                main:581]	:	INFO	:	Epoch 1976 | loss: 0.0311117 | val_loss: 0.0312025 | Time: 1974.3 ms
[2022-03-15 18:19:41	                main:581]	:	INFO	:	Epoch 1977 | loss: 0.0311169 | val_loss: 0.0311765 | Time: 1972.13 ms
[2022-03-15 18:19:43	                main:581]	:	INFO	:	Epoch 1978 | loss: 0.031127 | val_loss: 0.0311837 | Time: 1970.66 ms
[2022-03-15 18:19:45	                main:581]	:	INFO	:	Epoch 1979 | loss: 0.0311193 | val_loss: 0.0311932 | Time: 1973.1 ms
[2022-03-15 18:19:47	                main:581]	:	INFO	:	Epoch 1980 | loss: 0.0311187 | val_loss: 0.0311966 | Time: 1972.12 ms
[2022-03-15 18:19:49	                main:581]	:	INFO	:	Epoch 1981 | loss: 0.031116 | val_loss: 0.0311872 | Time: 1973.27 ms
[2022-03-15 18:19:51	                main:581]	:	INFO	:	Epoch 1982 | loss: 0.0311141 | val_loss: 0.0311813 | Time: 1974.84 ms
[2022-03-15 18:19:53	                main:581]	:	INFO	:	Epoch 1983 | loss: 0.0311148 | val_loss: 0.0311783 | Time: 1972.26 ms
[2022-03-15 18:19:55	                main:581]	:	INFO	:	Epoch 1984 | loss: 0.0311146 | val_loss: 0.0311928 | Time: 1975.6 ms
[2022-03-15 18:19:57	                main:581]	:	INFO	:	Epoch 1985 | loss: 0.0311141 | val_loss: 0.031193 | Time: 1973.43 ms
[2022-03-15 18:19:59	                main:581]	:	INFO	:	Epoch 1986 | loss: 0.0311128 | val_loss: 0.031179 | Time: 1971.16 ms
[2022-03-15 18:20:01	                main:581]	:	INFO	:	Epoch 1987 | loss: 0.0311132 | val_loss: 0.0311868 | Time: 2080.06 ms
[2022-03-15 18:20:03	                main:581]	:	INFO	:	Epoch 1988 | loss: 0.0311133 | val_loss: 0.0311901 | Time: 1973.55 ms
[2022-03-15 18:20:05	                main:581]	:	INFO	:	Epoch 1989 | loss: 0.031109 | val_loss: 0.0311881 | Time: 1974.49 ms
[2022-03-15 18:20:07	                main:581]	:	INFO	:	Epoch 1990 | loss: 0.0311111 | val_loss: 0.0311877 | Time: 1971.54 ms
[2022-03-15 18:20:09	                main:581]	:	INFO	:	Epoch 1991 | loss: 0.0311126 | val_loss: 0.0311899 | Time: 1972.4 ms
[2022-03-15 18:20:11	                main:581]	:	INFO	:	Epoch 1992 | loss: 0.031114 | val_loss: 0.0311874 | Time: 1975.03 ms
[2022-03-15 18:20:13	                main:581]	:	INFO	:	Epoch 1993 | loss: 0.031113 | val_loss: 0.0311837 | Time: 1970.88 ms
[2022-03-15 18:20:15	                main:581]	:	INFO	:	Epoch 1994 | loss: 0.0311168 | val_loss: 0.031193 | Time: 1974.38 ms
[2022-03-15 18:20:17	                main:581]	:	INFO	:	Epoch 1995 | loss: 0.0311125 | val_loss: 0.03119 | Time: 1972.37 ms
[2022-03-15 18:20:19	                main:581]	:	INFO	:	Epoch 1996 | loss: 0.0311106 | val_loss: 0.0311945 | Time: 1973.19 ms
[2022-03-15 18:20:20	                main:581]	:	INFO	:	Epoch 1997 | loss: 0.0311136 | val_loss: 0.0311877 | Time: 1972.4 ms
[2022-03-15 18:20:22	                main:581]	:	INFO	:	Epoch 1998 | loss: 0.0311092 | val_loss: 0.0311802 | Time: 1971.03 ms
[2022-03-15 18:20:24	                main:581]	:	INFO	:	Epoch 1999 | loss: 0.0311069 | val_loss: 0.0311871 | Time: 1972.14 ms
[2022-03-15 18:20:26	                main:581]	:	INFO	:	Epoch 2000 | loss: 0.0311058 | val_loss: 0.031195 | Time: 1971.8 ms
[2022-03-15 18:20:28	                main:581]	:	INFO	:	Epoch 2001 | loss: 0.0311104 | val_loss: 0.0311927 | Time: 1971.62 ms
[2022-03-15 18:20:30	                main:581]	:	INFO	:	Epoch 2002 | loss: 0.0311116 | val_loss: 0.0311858 | Time: 1973.03 ms
[2022-03-15 18:20:32	                main:581]	:	INFO	:	Epoch 2003 | loss: 0.0311211 | val_loss: 0.0311822 | Time: 1972.75 ms
[2022-03-15 18:20:34	                main:581]	:	INFO	:	Epoch 2004 | loss: 0.0311211 | val_loss: 0.0311963 | Time: 1974.61 ms
[2022-03-15 18:20:36	                main:581]	:	INFO	:	Epoch 2005 | loss: 0.0311124 | val_loss: 0.0311916 | Time: 1972.94 ms
[2022-03-15 18:20:38	                main:581]	:	INFO	:	Epoch 2006 | loss: 0.0311125 | val_loss: 0.0312 | Time: 1972.8 ms
[2022-03-15 18:20:40	                main:581]	:	INFO	:	Epoch 2007 | loss: 0.0311114 | val_loss: 0.0311942 | Time: 1974.63 ms
[2022-03-15 18:20:42	                main:581]	:	INFO	:	Epoch 2008 | loss: 0.0311217 | val_loss: 0.0311876 | Time: 1971.93 ms
[2022-03-15 18:20:44	                main:581]	:	INFO	:	Epoch 2009 | loss: 0.0311214 | val_loss: 0.0311821 | Time: 1970.92 ms
[2022-03-15 18:20:46	                main:581]	:	INFO	:	Epoch 2010 | loss: 0.0311123 | val_loss: 0.0311999 | Time: 1971.75 ms
[2022-03-15 18:20:48	                main:581]	:	INFO	:	Epoch 2011 | loss: 0.0311064 | val_loss: 0.0311964 | Time: 1972.82 ms
[2022-03-15 18:20:50	                main:581]	:	INFO	:	Epoch 2012 | loss: 0.0311081 | val_loss: 0.0311889 | Time: 1974.28 ms
[2022-03-15 18:20:52	                main:581]	:	INFO	:	Epoch 2013 | loss: 0.0311059 | val_loss: 0.0311987 | Time: 1972.68 ms
[2022-03-15 18:20:54	                main:581]	:	INFO	:	Epoch 2014 | loss: 0.0311044 | val_loss: 0.0311994 | Time: 1973.52 ms
[2022-03-15 18:20:56	                main:581]	:	INFO	:	Epoch 2015 | loss: 0.031105 | val_loss: 0.0311982 | Time: 1974.09 ms
[2022-03-15 18:20:58	                main:581]	:	INFO	:	Epoch 2016 | loss: 0.0311034 | val_loss: 0.0312083 | Time: 1971.73 ms
[2022-03-15 18:21:00	                main:581]	:	INFO	:	Epoch 2017 | loss: 0.0311033 | val_loss: 0.0312018 | Time: 1972.75 ms
[2022-03-15 18:21:03	                main:581]	:	INFO	:	Epoch 2018 | loss: 0.031104 | val_loss: 0.031192 | Time: 2975.88 ms
[2022-03-15 18:21:06	                main:581]	:	INFO	:	Epoch 2019 | loss: 0.0311033 | val_loss: 0.0311956 | Time: 3331.78 ms
[2022-03-15 18:21:10	                main:581]	:	INFO	:	Epoch 2020 | loss: 0.0311031 | val_loss: 0.0312052 | Time: 3316.56 ms
[2022-03-15 18:21:12	                main:581]	:	INFO	:	Epoch 2021 | loss: 0.0311035 | val_loss: 0.0311869 | Time: 2320.86 ms
[2022-03-15 18:21:14	                main:581]	:	INFO	:	Epoch 2022 | loss: 0.0311073 | val_loss: 0.031184 | Time: 1972.24 ms
[2022-03-15 18:21:16	                main:581]	:	INFO	:	Epoch 2023 | loss: 0.0311119 | val_loss: 0.0311902 | Time: 1973.34 ms
[2022-03-15 18:21:18	                main:581]	:	INFO	:	Epoch 2024 | loss: 0.0311067 | val_loss: 0.0312038 | Time: 1972.68 ms
[2022-03-15 18:21:20	                main:581]	:	INFO	:	Epoch 2025 | loss: 0.0311068 | val_loss: 0.0311934 | Time: 1974.08 ms
[2022-03-15 18:21:22	                main:581]	:	INFO	:	Epoch 2026 | loss: 0.0311025 | val_loss: 0.0311951 | Time: 1974.01 ms
[2022-03-15 18:21:24	                main:581]	:	INFO	:	Epoch 2027 | loss: 0.0311031 | val_loss: 0.0311861 | Time: 1972.51 ms
[2022-03-15 18:21:26	                main:581]	:	INFO	:	Epoch 2028 | loss: 0.0311066 | val_loss: 0.0311947 | Time: 1974.42 ms
[2022-03-15 18:21:28	                main:581]	:	INFO	:	Epoch 2029 | loss: 0.0311043 | val_loss: 0.0311979 | Time: 1970.77 ms
[2022-03-15 18:21:30	                main:581]	:	INFO	:	Epoch 2030 | loss: 0.0311029 | val_loss: 0.0311904 | Time: 1974.29 ms
[2022-03-15 18:21:32	                main:581]	:	INFO	:	Epoch 2031 | loss: 0.0311055 | val_loss: 0.0311976 | Time: 1971.24 ms
[2022-03-15 18:21:34	                main:581]	:	INFO	:	Epoch 2032 | loss: 0.0311011 | val_loss: 0.0311999 | Time: 1970.62 ms
[2022-03-15 18:21:36	                main:581]	:	INFO	:	Epoch 2033 | loss: 0.0311036 | val_loss: 0.0311852 | Time: 1972.25 ms
[2022-03-15 18:21:38	                main:581]	:	INFO	:	Epoch 2034 | loss: 0.0311023 | val_loss: 0.0311839 | Time: 1971.97 ms
[2022-03-15 18:21:40	                main:581]	:	INFO	:	Epoch 2035 | loss: 0.0311032 | val_loss: 0.0311936 | Time: 1972.74 ms
[2022-03-15 18:21:41	                main:581]	:	INFO	:	Epoch 2036 | loss: 0.031108 | val_loss: 0.0311979 | Time: 1971.59 ms
[2022-03-15 18:21:43	                main:581]	:	INFO	:	Epoch 2037 | loss: 0.0311058 | val_loss: 0.0311956 | Time: 1972.45 ms
[2022-03-15 18:21:45	                main:581]	:	INFO	:	Epoch 2038 | loss: 0.0311057 | val_loss: 0.0311984 | Time: 1973.18 ms
[2022-03-15 18:21:47	                main:581]	:	INFO	:	Epoch 2039 | loss: 0.0311015 | val_loss: 0.0311936 | Time: 1972.56 ms
[2022-03-15 18:21:49	                main:581]	:	INFO	:	Epoch 2040 | loss: 0.0311022 | val_loss: 0.0311913 | Time: 1969.73 ms
[2022-03-15 18:21:51	                main:581]	:	INFO	:	Epoch 2041 | loss: 0.0311092 | val_loss: 0.0311862 | Time: 1973.4 ms
[2022-03-15 18:21:53	                main:581]	:	INFO	:	Epoch 2042 | loss: 0.0311033 | val_loss: 0.0311934 | Time: 1970.56 ms
[2022-03-15 18:21:55	                main:581]	:	INFO	:	Epoch 2043 | loss: 0.0311046 | val_loss: 0.0311932 | Time: 1970.88 ms
[2022-03-15 18:21:57	                main:581]	:	INFO	:	Epoch 2044 | loss: 0.0311135 | val_loss: 0.0311819 | Time: 1968.36 ms
[2022-03-15 18:21:59	                main:581]	:	INFO	:	Epoch 2045 | loss: 0.0311083 | val_loss: 0.0311948 | Time: 1967.15 ms
[2022-03-15 18:22:02	                main:581]	:	INFO	:	Epoch 2046 | loss: 0.0311074 | val_loss: 0.0311929 | Time: 2441.67 ms
[2022-03-15 18:22:05	                main:581]	:	INFO	:	Epoch 2047 | loss: 0.031112 | val_loss: 0.031189 | Time: 3285.01 ms
[2022-03-15 18:22:08	                main:581]	:	INFO	:	Epoch 2048 | loss: 0.0311145 | val_loss: 0.0311855 | Time: 3270.18 ms
[2022-03-15 18:22:08	                main:604]	:	INFO	:	Saving trained model to model-final.pt, val_loss 0.0311855
[2022-03-15 18:22:08	                main:610]	:	INFO	:	Saving end state to config to file
[2022-03-15 18:22:08	                main:615]	:	INFO	:	Success, exiting..
18:22:08 (29842): called boinc_finish(0)

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)