Task 9427611
| Name | ParityModified-1638636621-25064-0_0 |
| Workunit | 6843766 |
| Created | 4 Dec 2021, 16:50:23 UTC |
| Sent | 13 Dec 2021, 7:09:47 UTC |
| Report deadline | 21 Dec 2021, 7:09:47 UTC |
| Received | 21 Dec 2021, 17:45:09 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 17440 |
| Run time | 7 hours 4 min 57 sec |
| CPU time | 6 hours 49 min 38 sec |
| Validate state | Valid |
| Credit | 4,160.00 |
| Device peak FLOPS | 2,491.89 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.62 GB |
| Peak swap size | 3.59 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version> <![CDATA[ <stderr_txt> [2021-12-21 03:26:52 main:574] : INFO : Epoch 1606 | loss: 0.0311185 | val_loss: 0.0311676 | Time: 6927.52 ms [2021-12-21 03:26:59 main:574] : INFO : Epoch 1607 | loss: 0.0311131 | val_loss: 0.0311758 | Time: 6966.15 ms [2021-12-21 03:27:07 main:574] : INFO : Epoch 1608 | loss: 0.0311074 | val_loss: 0.0311749 | Time: 8254.65 ms [2021-12-21 03:27:14 main:574] : INFO : Epoch 1609 | loss: 0.0311067 | val_loss: 0.03117 | Time: 7229.15 ms [2021-12-21 03:27:22 main:574] : INFO : Epoch 1610 | loss: 0.0311083 | val_loss: 0.0311761 | Time: 7498.32 ms [2021-12-21 03:27:31 main:574] : INFO : Epoch 1611 | loss: 0.0311063 | val_loss: 0.0311747 | Time: 8915.6 ms [2021-12-21 03:27:40 main:574] : INFO : Epoch 1612 | loss: 0.0311065 | val_loss: 0.0311733 | Time: 9469.63 ms [2021-12-21 03:27:50 main:574] : INFO : Epoch 1613 | loss: 0.0311062 | val_loss: 0.0311727 | Time: 9952.49 ms [2021-12-21 03:27:59 main:574] : INFO : Epoch 1614 | loss: 0.0311011 | val_loss: 0.0311789 | Time: 8735.5 ms [2021-12-21 03:28:12 main:574] : INFO : Epoch 1615 | loss: 0.0311003 | val_loss: 0.0311777 | Time: 13178.4 ms [2021-12-21 03:28:22 main:574] : INFO : Epoch 1616 | loss: 0.0311031 | val_loss: 0.031184 | Time: 9615.95 ms [2021-12-21 03:28:30 main:574] : INFO : Epoch 1617 | loss: 0.0311033 | val_loss: 0.0311802 | Time: 8440.73 ms [2021-12-21 03:28:39 main:574] : INFO : Epoch 1618 | loss: 0.0311019 | val_loss: 0.0311789 | Time: 9213.43 ms [2021-12-21 03:28:53 main:574] : INFO : Epoch 1619 | loss: 0.0310994 | val_loss: 0.0311755 | Time: 13912.9 ms [2021-12-21 03:29:04 main:574] : INFO : Epoch 1620 | loss: 0.0310949 | val_loss: 0.0311795 | Time: 10877.6 ms [2021-12-21 03:29:14 main:574] : INFO : Epoch 1621 | loss: 0.0310978 | val_loss: 0.0311785 | Time: 9329.85 ms [2021-12-21 03:29:23 main:574] : INFO : Epoch 1622 | loss: 0.031101 | val_loss: 0.0311797 | Time: 9105.41 ms [2021-12-21 03:29:34 main:574] : INFO : Epoch 1623 | loss: 0.0311031 | val_loss: 0.0311784 | Time: 11366.1 ms [2021-12-21 03:29:47 main:574] : INFO : Epoch 1624 | loss: 0.0311005 | val_loss: 0.0311757 | Time: 13057.8 ms [2021-12-21 03:29:56 main:574] : INFO : Epoch 1625 | loss: 0.0310993 | val_loss: 0.031182 | Time: 9023.39 ms [2021-12-21 03:30:06 main:574] : INFO : Epoch 1626 | loss: 0.0311016 | val_loss: 0.0311857 | Time: 10006.4 ms [2021-12-21 03:30:17 main:574] : INFO : Epoch 1627 | loss: 0.0311013 | val_loss: 0.0311772 | Time: 10558.2 ms [2021-12-21 03:30:31 main:574] : INFO : Epoch 1628 | loss: 0.0311004 | val_loss: 0.0311714 | Time: 13917.3 ms [2021-12-21 03:30:41 main:574] : INFO : Epoch 1629 | loss: 0.0311018 | val_loss: 0.0311816 | Time: 10725.7 ms [2021-12-21 03:30:50 main:574] : INFO : Epoch 1630 | loss: 0.0311065 | val_loss: 0.0311837 | Time: 8735.16 ms [2021-12-21 03:30:59 main:574] : INFO : Epoch 1631 | loss: 0.0310986 | val_loss: 0.0311778 | Time: 8890.16 ms [2021-12-21 03:31:13 main:574] : INFO : Epoch 1632 | loss: 0.0310947 | val_loss: 0.0311812 | Time: 13542.2 ms [2021-12-21 03:31:27 main:574] : INFO : Epoch 1633 | loss: 0.0310961 | val_loss: 0.0311773 | Time: 13941.7 ms [2021-12-21 03:31:35 main:574] : INFO : Epoch 1634 | loss: 0.0310967 | val_loss: 0.0311983 | Time: 8504.69 ms [2021-12-21 03:31:44 main:574] : INFO : Epoch 1635 | loss: 0.031103 | val_loss: 0.031182 | Time: 8899.71 ms [2021-12-21 03:32:34 main:574] : INFO : Epoch 1636 | loss: 0.0310991 | val_loss: 0.0311809 | Time: 50140.4 ms [2021-12-21 03:34:00 main:574] : INFO : Epoch 1637 | loss: 0.0310947 | val_loss: 0.0311842 | Time: 86225.4 ms [2021-12-21 03:35:11 main:574] : INFO : Epoch 1638 | loss: 0.0310918 | val_loss: 0.0311829 | Time: 70833.5 ms [2021-12-21 03:35:20 main:574] : INFO : Epoch 1639 | loss: 0.0311008 | val_loss: 0.0312215 | Time: 8726.08 ms [2021-12-21 03:35:34 main:574] : INFO : Epoch 1640 | loss: 0.0312006 | val_loss: 0.0312056 | Time: 13829.6 ms [2021-12-21 03:35:44 main:574] : INFO : Epoch 1641 | loss: 0.0311944 | val_loss: 0.0311892 | Time: 10522.9 ms [2021-12-21 03:35:53 main:574] : INFO : Epoch 1642 | loss: 0.0311804 | val_loss: 0.0311904 | Time: 8395.38 ms [2021-12-21 03:36:06 main:574] : INFO : Epoch 1643 | loss: 0.0311718 | val_loss: 0.0311738 | Time: 13062 ms [2021-12-21 03:36:20 main:574] : INFO : Epoch 1644 | loss: 0.0311611 | val_loss: 0.0311698 | Time: 13720.3 ms [2021-12-21 03:36:30 main:574] : INFO : Epoch 1645 | loss: 0.0311567 | val_loss: 0.0311679 | Time: 9923.5 ms [2021-12-21 03:36:38 main:574] : INFO : Epoch 1646 | loss: 0.0311549 | val_loss: 0.0311681 | Time: 8118.23 ms [2021-12-21 03:36:49 main:574] : INFO : Epoch 1647 | loss: 0.0311516 | val_loss: 0.0311668 | Time: 11525 ms [2021-12-21 03:37:03 main:574] : INFO : Epoch 1648 | loss: 0.0311497 | val_loss: 0.0311697 | Time: 14135.6 ms [2021-12-21 03:37:18 main:574] : INFO : Epoch 1649 | loss: 0.0311499 | val_loss: 0.0311676 | Time: 14586.1 ms [2021-12-21 03:37:28 main:574] : INFO : Epoch 1650 | loss: 0.031149 | val_loss: 0.0311668 | Time: 10045.4 ms [2021-12-21 03:37:38 main:574] : INFO : Epoch 1651 | loss: 0.0311436 | val_loss: 0.0311642 | Time: 10052 ms [2021-12-21 03:37:51 main:574] : INFO : Epoch 1652 | loss: 0.0311499 | val_loss: 0.0311651 | Time: 13393.2 ms [2021-12-21 03:38:05 main:574] : INFO : Epoch 1653 | loss: 0.0311584 | val_loss: 0.031158 | Time: 13596.5 ms [2021-12-21 03:38:16 main:574] : INFO : Epoch 1654 | loss: 0.0311489 | val_loss: 0.0311563 | Time: 11158.2 ms [2021-12-21 03:38:25 main:574] : INFO : Epoch 1655 | loss: 0.0311437 | val_loss: 0.0311545 | Time: 8841.01 ms [2021-12-21 03:38:36 main:574] : INFO : Epoch 1656 | loss: 0.0311432 | val_loss: 0.031157 | Time: 10782.9 ms [2021-12-21 03:38:49 main:574] : INFO : Epoch 1657 | loss: 0.0311404 | val_loss: 0.0311539 | Time: 13008.2 ms [2021-12-21 03:39:03 main:574] : INFO : Epoch 1658 | loss: 0.0311368 | val_loss: 0.0311551 | Time: 13742.5 ms [2021-12-21 03:39:14 main:574] : INFO : Epoch 1659 | loss: 0.0311342 | val_loss: 0.0311523 | Time: 10903.2 ms [2021-12-21 03:39:22 main:574] : INFO : Epoch 1660 | loss: 0.0311325 | val_loss: 0.0311553 | Time: 8709.24 ms [2021-12-21 03:39:33 main:574] : INFO : Epoch 1661 | loss: 0.0311319 | val_loss: 0.0311533 | Time: 10735.7 ms [2021-12-21 03:39:46 main:574] : INFO : Epoch 1662 | loss: 0.0311308 | val_loss: 0.0311563 | Time: 13274 ms [2021-12-21 03:40:00 main:574] : INFO : Epoch 1663 | loss: 0.03113 | val_loss: 0.0311628 | Time: 13897.3 ms [2021-12-21 03:40:11 main:574] : INFO : Epoch 1664 | loss: 0.0311307 | val_loss: 0.0311582 | Time: 11307.4 ms [2021-12-21 03:40:20 main:574] : INFO : Epoch 1665 | loss: 0.0311269 | val_loss: 0.031157 | Time: 8874.88 ms [2021-12-21 03:40:30 main:574] : INFO : Epoch 1666 | loss: 0.0311254 | val_loss: 0.0311595 | Time: 9292.74 ms [2021-12-21 03:40:43 main:574] : INFO : Epoch 1667 | loss: 0.0311237 | val_loss: 0.0311596 | Time: 13053.7 ms [2021-12-21 03:40:57 main:574] : INFO : Epoch 1668 | loss: 0.0311244 | val_loss: 0.0311596 | Time: 13877.3 ms [2021-12-21 03:41:10 main:574] : INFO : Epoch 1669 | loss: 0.0311237 | val_loss: 0.0311618 | Time: 13739.8 ms [2021-12-21 03:41:19 main:574] : INFO : Epoch 1670 | loss: 0.0311253 | val_loss: 0.0311598 | Time: 8665.58 ms [2021-12-21 03:41:28 main:574] : INFO : Epoch 1671 | loss: 0.031121 | val_loss: 0.0311581 | Time: 8935.39 ms [2021-12-21 03:41:41 main:574] : INFO : Epoch 1672 | loss: 0.0311252 | val_loss: 0.0311594 | Time: 13416.3 ms [2021-12-21 03:41:55 main:574] : INFO : Epoch 1673 | loss: 0.0311225 | val_loss: 0.031159 | Time: 13590.3 ms [2021-12-21 03:42:08 main:574] : INFO : Epoch 1674 | loss: 0.0311209 | val_loss: 0.0311572 | Time: 13114.2 ms [2021-12-21 03:42:16 main:574] : INFO : Epoch 1675 | loss: 0.031119 | val_loss: 0.0311601 | Time: 8192.08 ms [2021-12-21 03:42:25 main:574] : INFO : Epoch 1676 | loss: 0.0311179 | val_loss: 0.0311586 | Time: 8846.52 ms [2021-12-21 03:42:39 main:574] : INFO : Epoch 1677 | loss: 0.0311192 | val_loss: 0.0311613 | Time: 13853.5 ms [2021-12-21 03:42:53 main:574] : INFO : Epoch 1678 | loss: 0.0311196 | val_loss: 0.0311608 | Time: 13640.7 ms [2021-12-21 03:43:06 main:574] : INFO : Epoch 1679 | loss: 0.0311209 | val_loss: 0.0311654 | Time: 12839 ms [2021-12-21 03:43:17 main:574] : INFO : Epoch 1680 | loss: 0.0311177 | val_loss: 0.0311586 | Time: 11143 ms [2021-12-21 03:43:29 main:574] : INFO : Epoch 1681 | loss: 0.0311183 | val_loss: 0.0311581 | Time: 12605.7 ms [2021-12-21 03:43:44 main:574] : INFO : Epoch 1682 | loss: 0.0311186 | val_loss: 0.0311609 | Time: 14946.7 ms [2021-12-21 03:43:58 main:574] : INFO : Epoch 1683 | loss: 0.0311164 | val_loss: 0.0311598 | Time: 13296.5 ms [2021-12-21 03:44:07 main:574] : INFO : Epoch 1684 | loss: 0.0311129 | val_loss: 0.0311639 | Time: 9011.74 ms [2021-12-21 03:44:16 main:574] : INFO : Epoch 1685 | loss: 0.0311164 | val_loss: 0.031162 | Time: 9004.78 ms [2021-12-21 03:44:29 main:574] : INFO : Epoch 1686 | loss: 0.031117 | val_loss: 0.0311673 | Time: 13748.6 ms [2021-12-21 03:44:43 main:574] : INFO : Epoch 1687 | loss: 0.0311145 | val_loss: 0.0311664 | Time: 13976 ms [2021-12-21 03:44:54 main:574] : INFO : Epoch 1688 | loss: 0.0311128 | val_loss: 0.0311661 | Time: 11116.4 ms [2021-12-21 03:45:03 main:574] : INFO : Epoch 1689 | loss: 0.0311131 | val_loss: 0.0311676 | Time: 8228.25 ms [2021-12-21 03:45:13 main:574] : INFO : Epoch 1690 | loss: 0.0311111 | val_loss: 0.0311679 | Time: 9903.84 ms [2021-12-21 03:45:26 main:574] : INFO : Epoch 1691 | loss: 0.0311097 | val_loss: 0.0311692 | Time: 13615.9 ms [2021-12-21 03:45:40 main:574] : INFO : Epoch 1692 | loss: 0.0311164 | val_loss: 0.0311674 | Time: 13733.1 ms [2021-12-21 03:45:50 main:574] : INFO : Epoch 1693 | loss: 0.0311152 | val_loss: 0.0311726 | Time: 9869.5 ms [2021-12-21 03:45:59 main:574] : INFO : Epoch 1694 | loss: 0.0311177 | val_loss: 0.0311653 | Time: 8983.49 ms [2021-12-21 03:46:10 main:574] : INFO : Epoch 1695 | loss: 0.0311105 | val_loss: 0.0311664 | Time: 11515.2 ms [2021-12-21 03:46:24 main:574] : INFO : Epoch 1696 | loss: 0.0311097 | val_loss: 0.0311674 | Time: 13353.6 ms [2021-12-21 03:46:38 main:574] : INFO : Epoch 1697 | loss: 0.0311109 | val_loss: 0.0311691 | Time: 14572.5 ms [2021-12-21 03:46:48 main:574] : INFO : Epoch 1698 | loss: 0.0311093 | val_loss: 0.0311667 | Time: 9626.46 ms [2021-12-21 03:46:57 main:574] : INFO : Epoch 1699 | loss: 0.0311095 | val_loss: 0.0311677 | Time: 8806.41 ms [2021-12-21 03:47:09 main:574] : INFO : Epoch 1700 | loss: 0.0311086 | val_loss: 0.0311728 | Time: 12648.3 ms [2021-12-21 03:47:23 main:574] : INFO : Epoch 1701 | loss: 0.0311084 | val_loss: 0.0311716 | Time: 13600.2 ms [2021-12-21 03:47:35 main:574] : INFO : Epoch 1702 | loss: 0.031107 | val_loss: 0.0311744 | Time: 12197.2 ms [2021-12-21 03:47:44 main:574] : INFO : Epoch 1703 | loss: 0.0311065 | val_loss: 0.0311725 | Time: 8684.59 ms [2021-12-21 03:47:53 main:574] : INFO : Epoch 1704 | loss: 0.0311066 | val_loss: 0.0311687 | Time: 8701.06 ms [2021-12-21 03:48:05 main:574] : INFO : Epoch 1705 | loss: 0.0311063 | val_loss: 0.031166 | Time: 12411.6 ms [2021-12-21 03:48:19 main:574] : INFO : Epoch 1706 | loss: 0.0311046 | val_loss: 0.0311703 | Time: 13820.1 ms [2021-12-21 03:48:31 main:574] : INFO : Epoch 1707 | loss: 0.0311288 | val_loss: 0.0311672 | Time: 12236.5 ms [2021-12-21 03:48:40 main:574] : INFO : Epoch 1708 | loss: 0.0311352 | val_loss: 0.0311616 | Time: 9140.37 ms [2021-12-21 03:48:50 main:574] : INFO : Epoch 1709 | loss: 0.0311258 | val_loss: 0.0311649 | Time: 9780.31 ms [2021-12-21 03:49:04 main:574] : INFO : Epoch 1710 | loss: 0.0311205 | val_loss: 0.0311648 | Time: 13868 ms [2021-12-21 03:49:18 main:574] : INFO : Epoch 1711 | loss: 0.0311189 | val_loss: 0.0311614 | Time: 14398.8 ms [2021-12-21 03:49:27 main:574] : INFO : Epoch 1712 | loss: 0.0311159 | val_loss: 0.0311693 | Time: 9047.36 ms [2021-12-21 03:49:36 main:574] : INFO : Epoch 1713 | loss: 0.0311122 | val_loss: 0.0311695 | Time: 8507.06 ms [2021-12-21 03:49:49 main:574] : INFO : Epoch 1714 | loss: 0.0311118 | val_loss: 0.0311741 | Time: 12802.3 ms [2021-12-21 03:50:03 main:574] : INFO : Epoch 1715 | loss: 0.0311107 | val_loss: 0.0311723 | Time: 13780.5 ms [2021-12-21 03:50:15 main:574] : INFO : Epoch 1716 | loss: 0.0311076 | val_loss: 0.0311674 | Time: 12814 ms [2021-12-21 03:50:24 main:574] : INFO : Epoch 1717 | loss: 0.0311052 | val_loss: 0.0311753 | Time: 8610.59 ms [2021-12-21 03:50:33 main:574] : INFO : Epoch 1718 | loss: 0.0311064 | val_loss: 0.0311734 | Time: 9308 ms [2021-12-21 03:50:47 main:574] : INFO : Epoch 1719 | loss: 0.0311078 | val_loss: 0.0311647 | Time: 13400.2 ms [2021-12-21 03:51:01 main:574] : INFO : Epoch 1720 | loss: 0.0311143 | val_loss: 0.0311686 | Time: 14744.7 ms [2021-12-21 03:51:12 main:574] : INFO : Epoch 1721 | loss: 0.0311093 | val_loss: 0.0311775 | Time: 10785.4 ms [2021-12-21 03:51:21 main:574] : INFO : Epoch 1722 | loss: 0.0311052 | val_loss: 0.0311717 | Time: 8696.77 ms [2021-12-21 03:51:33 main:574] : INFO : Epoch 1723 | loss: 0.0311055 | val_loss: 0.0311733 | Time: 12199.3 ms [2021-12-21 03:51:46 main:574] : INFO : Epoch 1724 | loss: 0.0311035 | val_loss: 0.0311719 | Time: 13208.9 ms [2021-12-21 03:52:00 main:574] : INFO : Epoch 1725 | loss: 0.0311015 | val_loss: 0.0311754 | Time: 14053.5 ms [2021-12-21 03:52:11 main:574] : INFO : Epoch 1726 | loss: 0.0311008 | val_loss: 0.0311695 | Time: 10512.4 ms [2021-12-21 03:52:21 main:574] : INFO : Epoch 1727 | loss: 0.0311013 | val_loss: 0.0311721 | Time: 10378.1 ms [2021-12-21 03:52:36 main:574] : INFO : Epoch 1728 | loss: 0.0311037 | val_loss: 0.0311758 | Time: 14282.4 ms [2021-12-21 03:52:49 main:574] : INFO : Epoch 1729 | loss: 0.0311019 | val_loss: 0.0311819 | Time: 13393.3 ms [2021-12-21 03:52:59 main:574] : INFO : Epoch 1730 | loss: 0.0311084 | val_loss: 0.0311738 | Time: 10403.9 ms [2021-12-21 03:53:10 main:574] : INFO : Epoch 1731 | loss: 0.0311053 | val_loss: 0.0311709 | Time: 10666.1 ms [2021-12-21 03:53:23 main:574] : INFO : Epoch 1732 | loss: 0.0311014 | val_loss: 0.0311708 | Time: 13259.4 ms [2021-12-21 03:53:37 main:574] : INFO : Epoch 1733 | loss: 0.031105 | val_loss: 0.031181 | Time: 14048.7 ms [2021-12-21 03:53:49 main:574] : INFO : Epoch 1734 | loss: 0.0311006 | val_loss: 0.0311736 | Time: 11394.4 ms [2021-12-21 03:53:58 main:574] : INFO : Epoch 1735 | loss: 0.0311038 | val_loss: 0.0311679 | Time: 9033.02 ms [2021-12-21 03:54:12 main:574] : INFO : Epoch 1736 | loss: 0.0311031 | val_loss: 0.0311745 | Time: 13896.4 ms [2021-12-21 03:54:25 main:574] : INFO : Epoch 1737 | loss: 0.0311 | val_loss: 0.0311717 | Time: 13504.6 ms [2021-12-21 03:54:39 main:574] : INFO : Epoch 1738 | loss: 0.0311547 | val_loss: 0.0311716 | Time: 13969.5 ms [2021-12-21 03:54:49 main:574] : INFO : Epoch 1739 | loss: 0.0311618 | val_loss: 0.0311635 | Time: 9762.02 ms [2021-12-21 03:54:59 main:574] : INFO : Epoch 1740 | loss: 0.0311495 | val_loss: 0.031161 | Time: 9501.37 ms [2021-12-21 03:55:12 main:574] : INFO : Epoch 1741 | loss: 0.0311448 | val_loss: 0.0311605 | Time: 13716.8 ms [2021-12-21 03:55:27 main:574] : INFO : Epoch 1742 | loss: 0.031141 | val_loss: 0.0311554 | Time: 14892.4 ms [2021-12-21 03:55:40 main:574] : INFO : Epoch 1743 | loss: 0.0311397 | val_loss: 0.0311625 | Time: 12718.5 ms [2021-12-21 03:55:49 main:574] : INFO : Epoch 1744 | loss: 0.0311357 | val_loss: 0.0311595 | Time: 8809.58 ms [2021-12-21 03:56:00 main:574] : INFO : Epoch 1745 | loss: 0.0311317 | val_loss: 0.031155 | Time: 10830.7 ms [2021-12-21 03:56:15 main:574] : INFO : Epoch 1746 | loss: 0.0311302 | val_loss: 0.0311574 | Time: 15395.2 ms [2021-12-21 03:56:29 main:574] : INFO : Epoch 1747 | loss: 0.0311293 | val_loss: 0.0311562 | Time: 14121.6 ms [2021-12-21 03:56:41 main:574] : INFO : Epoch 1748 | loss: 0.0311285 | val_loss: 0.031155 | Time: 11710.3 ms [2021-12-21 03:56:50 main:574] : INFO : Epoch 1749 | loss: 0.0311246 | val_loss: 0.0311575 | Time: 9365.71 ms [2021-12-21 03:57:02 main:574] : INFO : Epoch 1750 | loss: 0.0311242 | val_loss: 0.0311601 | Time: 11808.4 ms [2021-12-21 03:57:16 main:574] : INFO : Epoch 1751 | loss: 0.0311239 | val_loss: 0.0311564 | Time: 14150.3 ms [2021-12-21 03:57:30 main:574] : INFO : Epoch 1752 | loss: 0.0311219 | val_loss: 0.0311565 | Time: 14152.8 ms [2021-12-21 03:57:40 main:574] : INFO : Epoch 1753 | loss: 0.0311219 | val_loss: 0.0311601 | Time: 9187.09 ms [2021-12-21 03:57:48 main:574] : INFO : Epoch 1754 | loss: 0.0311224 | val_loss: 0.0311582 | Time: 8752.21 ms [2021-12-21 03:58:02 main:574] : INFO : Epoch 1755 | loss: 0.0311215 | val_loss: 0.0311576 | Time: 13412.7 ms [2021-12-21 03:58:16 main:574] : INFO : Epoch 1756 | loss: 0.0311209 | val_loss: 0.0311568 | Time: 14672.4 ms [2021-12-21 03:58:30 main:574] : INFO : Epoch 1757 | loss: 0.0311207 | val_loss: 0.0311591 | Time: 13637.8 ms [2021-12-21 03:58:39 main:574] : INFO : Epoch 1758 | loss: 0.0311174 | val_loss: 0.0311586 | Time: 8944.96 ms [2021-12-21 03:58:49 main:574] : INFO : Epoch 1759 | loss: 0.0311171 | val_loss: 0.0311601 | Time: 9722.2 ms [2021-12-21 03:59:02 main:574] : INFO : Epoch 1760 | loss: 0.0311159 | val_loss: 0.0311576 | Time: 13691.1 ms [2021-12-21 03:59:17 main:574] : INFO : Epoch 1761 | loss: 0.0311146 | val_loss: 0.0311619 | Time: 14474.6 ms [2021-12-21 03:59:29 main:574] : INFO : Epoch 1762 | loss: 0.0311155 | val_loss: 0.0311628 | Time: 11568 ms [2021-12-21 03:59:38 main:574] : INFO : Epoch 1763 | loss: 0.031115 | val_loss: 0.0311607 | Time: 9211.85 ms [2021-12-21 03:59:50 main:574] : INFO : Epoch 1764 | loss: 0.0311184 | val_loss: 0.0311633 | Time: 12194.3 ms [2021-12-21 04:00:05 main:574] : INFO : Epoch 1765 | loss: 0.0311152 | val_loss: 0.0311615 | Time: 14904.7 ms [2021-12-21 04:00:43 main:574] : INFO : Epoch 1766 | loss: 0.031116 | val_loss: 0.0311581 | Time: 38265.1 ms [2021-12-21 04:01:00 main:574] : INFO : Epoch 1767 | loss: 0.0311135 | val_loss: 0.0311628 | Time: 16412.1 ms [2021-12-21 04:01:45 main:574] : INFO : Epoch 1768 | loss: 0.0311123 | val_loss: 0.0311593 | Time: 45811.1 ms [2021-12-21 04:01:55 main:574] : INFO : Epoch 1769 | loss: 0.0311146 | val_loss: 0.0311589 | Time: 9192 ms [2021-12-21 04:02:07 main:574] : INFO : Epoch 1770 | loss: 0.0311146 | val_loss: 0.0311586 | Time: 12703.5 ms [2021-12-21 04:02:30 main:574] : INFO : Epoch 1771 | loss: 0.0311122 | val_loss: 0.0311649 | Time: 22737.4 ms [2021-12-21 04:02:43 main:574] : INFO : Epoch 1772 | loss: 0.0311155 | val_loss: 0.0311587 | Time: 12433.1 ms [2021-12-21 04:02:57 main:574] : INFO : Epoch 1773 | loss: 0.0311172 | val_loss: 0.0311625 | Time: 14282.9 ms [2021-12-21 04:03:10 main:574] : INFO : Epoch 1774 | loss: 0.0311172 | val_loss: 0.0311608 | Time: 13442.5 ms [2021-12-21 04:03:22 main:574] : INFO : Epoch 1775 | loss: 0.0311134 | val_loss: 0.0311654 | Time: 12148.7 ms [2021-12-21 04:03:37 main:574] : INFO : Epoch 1776 | loss: 0.0311089 | val_loss: 0.0311624 | Time: 14133.4 ms [2021-12-21 04:03:50 main:574] : INFO : Epoch 1777 | loss: 0.0311121 | val_loss: 0.0311617 | Time: 12964.1 ms [2021-12-21 04:03:59 main:574] : INFO : Epoch 1778 | loss: 0.0311287 | val_loss: 0.0311556 | Time: 9657.46 ms [2021-12-21 04:04:13 main:574] : INFO : Epoch 1779 | loss: 0.0311303 | val_loss: 0.031166 | Time: 13980.6 ms [2021-12-21 04:04:27 main:574] : INFO : Epoch 1780 | loss: 0.0311216 | val_loss: 0.0311591 | Time: 14156.4 ms [2021-12-21 04:04:42 main:574] : INFO : Epoch 1781 | loss: 0.031115 | val_loss: 0.031157 | Time: 14627.8 ms [2021-12-21 04:05:16 main:574] : INFO : Epoch 1782 | loss: 0.0311124 | val_loss: 0.0311566 | Time: 33464.5 ms [2021-12-21 04:05:32 main:574] : INFO : Epoch 1783 | loss: 0.0311112 | val_loss: 0.0311599 | Time: 16197.8 ms [2021-12-21 04:05:42 main:574] : INFO : Epoch 1784 | loss: 0.0311096 | val_loss: 0.0311604 | Time: 10013.5 ms [2021-12-21 04:05:51 main:574] : INFO : Epoch 1785 | loss: 0.0311098 | val_loss: 0.03116 | Time: 9565.44 ms [2021-12-21 04:06:05 main:574] : INFO : Epoch 1786 | loss: 0.0311078 | val_loss: 0.0311627 | Time: 14056.1 ms [2021-12-21 04:06:22 main:574] : INFO : Epoch 1787 | loss: 0.0311061 | val_loss: 0.0311605 | Time: 16180.2 ms [2021-12-21 04:06:36 main:574] : INFO : Epoch 1788 | loss: 0.031105 | val_loss: 0.0311652 | Time: 14395.6 ms [2021-12-21 04:06:46 main:574] : INFO : Epoch 1789 | loss: 0.0311039 | val_loss: 0.0311639 | Time: 9517.48 ms [2021-12-21 04:06:57 main:574] : INFO : Epoch 1790 | loss: 0.0311044 | val_loss: 0.0311713 | Time: 11920.8 ms [2021-12-21 04:07:23 main:574] : INFO : Epoch 1791 | loss: 0.0311027 | val_loss: 0.0311652 | Time: 25813.7 ms [2021-12-21 04:07:37 main:574] : INFO : Epoch 1792 | loss: 0.0310998 | val_loss: 0.0311673 | Time: 13640.7 ms [2021-12-21 04:07:47 main:574] : INFO : Epoch 1793 | loss: 0.031099 | val_loss: 0.0311659 | Time: 10247.5 ms [2021-12-21 04:08:02 main:574] : INFO : Epoch 1794 | loss: 0.0310979 | val_loss: 0.0311671 | Time: 14766.5 ms [2021-12-21 04:08:18 main:574] : INFO : Epoch 1795 | loss: 0.0310964 | val_loss: 0.0311691 | Time: 15573.2 ms [2021-12-21 04:08:32 main:574] : INFO : Epoch 1796 | loss: 0.0311016 | val_loss: 0.0311703 | Time: 14201.2 ms [2021-12-21 04:08:41 main:574] : INFO : Epoch 1797 | loss: 0.0311045 | val_loss: 0.0311758 | Time: 9106.83 ms [2021-12-21 04:08:55 main:574] : INFO : Epoch 1798 | loss: 0.0311019 | val_loss: 0.0311658 | Time: 13963.8 ms [2021-12-21 04:09:10 main:574] : INFO : Epoch 1799 | loss: 0.0311008 | val_loss: 0.0311674 | Time: 15398.8 ms [2021-12-21 04:09:25 main:574] : INFO : Epoch 1800 | loss: 0.0311034 | val_loss: 0.0311741 | Time: 14712.9 ms [2021-12-21 04:09:36 main:574] : INFO : Epoch 1801 | loss: 0.0311014 | val_loss: 0.031166 | Time: 10538.8 ms [2021-12-21 04:09:45 main:574] : INFO : Epoch 1802 | loss: 0.0311001 | val_loss: 0.0311667 | Time: 9779.2 ms [2021-12-21 04:10:00 main:574] : INFO : Epoch 1803 | loss: 0.0310984 | val_loss: 0.0311722 | Time: 14317.9 ms [2021-12-21 04:10:15 main:574] : INFO : Epoch 1804 | loss: 0.0310983 | val_loss: 0.0311701 | Time: 15751.5 ms [2021-12-21 04:10:30 main:574] : INFO : Epoch 1805 | loss: 0.0310956 | val_loss: 0.0311713 | Time: 14353.7 ms [2021-12-21 04:10:40 main:574] : INFO : Epoch 1806 | loss: 0.031099 | val_loss: 0.0311698 | Time: 10132.1 ms [2021-12-21 04:10:54 main:574] : INFO : Epoch 1807 | loss: 0.0311011 | val_loss: 0.0311724 | Time: 14016.2 ms [2021-12-21 04:11:10 main:574] : INFO : Epoch 1808 | loss: 0.0310985 | val_loss: 0.0311732 | Time: 16052.3 ms [2021-12-21 04:11:22 main:574] : INFO : Epoch 1809 | loss: 0.0310962 | val_loss: 0.0311703 | Time: 12192.5 ms [2021-12-21 04:11:34 main:574] : INFO : Epoch 1810 | loss: 0.0310976 | val_loss: 0.031174 | Time: 11724 ms [2021-12-21 04:11:48 main:574] : INFO : Epoch 1811 | loss: 0.0310967 | val_loss: 0.0311827 | Time: 14394.2 ms [2021-12-21 04:12:03 main:574] : INFO : Epoch 1812 | loss: 0.0310941 | val_loss: 0.031177 | Time: 14846.6 ms [2021-12-21 04:12:24 main:574] : INFO : Epoch 1813 | loss: 0.0311021 | val_loss: 0.0311742 | Time: 21211.7 ms [2021-12-21 04:12:36 main:574] : INFO : Epoch 1814 | loss: 0.0311018 | val_loss: 0.0311756 | Time: 11295.7 ms [2021-12-21 04:12:50 main:574] : INFO : Epoch 1815 | loss: 0.0310946 | val_loss: 0.0311723 | Time: 14212 ms [2021-12-21 04:13:05 main:574] : INFO : Epoch 1816 | loss: 0.031095 | val_loss: 0.0311778 | Time: 15058.7 ms [2021-12-21 04:13:19 main:574] : INFO : Epoch 1817 | loss: 0.0310918 | val_loss: 0.0311763 | Time: 13753.9 ms [2021-12-21 04:13:29 main:574] : INFO : Epoch 1818 | loss: 0.0310966 | val_loss: 0.0311811 | Time: 10156 ms [2021-12-21 04:13:42 main:574] : INFO : Epoch 1819 | loss: 0.0311025 | val_loss: 0.0311698 | Time: 13138.6 ms [2021-12-21 04:13:55 main:574] : INFO : Epoch 1820 | loss: 0.0311075 | val_loss: 0.0311656 | Time: 13245.2 ms [2021-12-21 04:14:10 main:574] : INFO : Epoch 1821 | loss: 0.0311032 | val_loss: 0.031176 | Time: 14266.5 ms [2021-12-21 04:14:22 main:574] : INFO : Epoch 1822 | loss: 0.031097 | val_loss: 0.0311738 | Time: 12489.6 ms [2021-12-21 04:14:45 main:574] : INFO : Epoch 1823 | loss: 0.0310928 | val_loss: 0.0311769 | Time: 23308.3 ms [2021-12-21 04:14:59 main:574] : INFO : Epoch 1824 | loss: 0.0310903 | val_loss: 0.0311739 | Time: 13665.6 ms [2021-12-21 04:15:13 main:574] : INFO : Epoch 1825 | loss: 0.0310954 | val_loss: 0.0311742 | Time: 14233.9 ms [2021-12-21 04:15:24 main:574] : INFO : Epoch 1826 | loss: 0.0310957 | val_loss: 0.0311789 | Time: 10797.6 ms [2021-12-21 04:15:38 main:574] : INFO : Epoch 1827 | loss: 0.0310962 | val_loss: 0.0311677 | Time: 14167 ms [2021-12-21 04:15:52 main:574] : INFO : Epoch 1828 | loss: 0.0310912 | val_loss: 0.0311759 | Time: 13164.1 ms [2021-12-21 04:16:06 main:574] : INFO : Epoch 1829 | loss: 0.0310897 | val_loss: 0.031179 | Time: 14937 ms [2021-12-21 04:16:21 main:574] : INFO : Epoch 1830 | loss: 0.0310921 | val_loss: 0.0311776 | Time: 14869 ms [2021-12-21 04:16:31 main:574] : INFO : Epoch 1831 | loss: 0.0310929 | val_loss: 0.0311714 | Time: 9760.65 ms [2021-12-21 04:16:44 main:574] : INFO : Epoch 1832 | loss: 0.0310896 | val_loss: 0.0311746 | Time: 12599.7 ms [2021-12-21 04:16:58 main:574] : INFO : Epoch 1833 | loss: 0.0310907 | val_loss: 0.0311776 | Time: 14428.1 ms [2021-12-21 04:17:24 main:574] : INFO : Epoch 1834 | loss: 0.0310875 | val_loss: 0.0311831 | Time: 25546.1 ms [2021-12-21 04:17:49 main:574] : INFO : Epoch 1835 | loss: 0.0310899 | val_loss: 0.0311851 | Time: 25131.6 ms [2021-12-21 04:18:08 main:574] : INFO : Epoch 1836 | loss: 0.0310894 | val_loss: 0.031177 | Time: 19288.8 ms [2021-12-21 04:18:33 main:574] : INFO : Epoch 1837 | loss: 0.0310846 | val_loss: 0.0311864 | Time: 24834.4 ms [2021-12-21 04:18:47 main:574] : INFO : Epoch 1838 | loss: 0.0310853 | val_loss: 0.0311805 | Time: 14044.1 ms [2021-12-21 04:19:00 main:574] : INFO : Epoch 1839 | loss: 0.0310884 | val_loss: 0.0311782 | Time: 12625.1 ms [2021-12-21 04:19:24 main:574] : INFO : Epoch 1840 | loss: 0.0310841 | val_loss: 0.0311849 | Time: 24556.4 ms [2021-12-21 04:19:40 main:574] : INFO : Epoch 1841 | loss: 0.0310849 | val_loss: 0.0311831 | Time: 15676 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050 Ti) [2021-12-21 04:23:42 main:435] : INFO : Set logging level to 1 [2021-12-21 04:23:42 main:441] : INFO : Running in BOINC Client mode [2021-12-21 04:23:42 main:444] : INFO : Resolving all filenames [2021-12-21 04:23:42 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2021-12-21 04:23:42 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2021-12-21 04:23:42 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2021-12-21 04:23:42 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 0) [2021-12-21 04:23:42 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2021-12-21 04:23:42 main:472] : INFO : Dataset filename: dataset.hdf5 [2021-12-21 04:23:42 main:474] : INFO : Configuration: [2021-12-21 04:23:42 main:475] : INFO : Model type: GRU [2021-12-21 04:23:42 main:476] : INFO : Validation Loss Threshold: 0.0001 [2021-12-21 04:23:42 main:477] : INFO : Max Epochs: 2048 [2021-12-21 04:23:42 main:478] : INFO : Batch Size: 128 [2021-12-21 04:23:42 main:479] : INFO : Learning Rate: 0.01 [2021-12-21 04:23:42 main:480] : INFO : Patience: 10 [2021-12-21 04:23:42 main:481] : INFO : Hidden Width: 12 [2021-12-21 04:23:42 main:482] : INFO : # Recurrent Layers: 4 [2021-12-21 04:23:42 main:483] : INFO : # Backend Layers: 4 [2021-12-21 04:23:42 main:484] : INFO : # Threads: 1 [2021-12-21 04:23:42 main:486] : INFO : Preparing Dataset [2021-12-21 04:23:42 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2021-12-21 04:23:43 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2021-12-21 04:23:46 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2021-12-21 04:23:46 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2021-12-21 04:23:47 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2021-12-21 04:23:47 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2021-12-21 04:23:47 main:494] : INFO : Creating Model [2021-12-21 04:23:47 main:507] : INFO : Preparing config file [2021-12-21 04:23:47 main:511] : INFO : Found checkpoint, attempting to load... [2021-12-21 04:23:47 main:512] : INFO : Loading config [2021-12-21 04:23:47 main:514] : INFO : Loading state [2021-12-21 04:23:50 main:559] : INFO : Loading DataLoader into Memory [2021-12-21 04:23:50 main:562] : INFO : Starting Training [2021-12-21 04:24:09 main:574] : INFO : Epoch 1841 | loss: 0.0311287 | val_loss: 0.0311734 | Time: 19155.6 ms [2021-12-21 04:24:35 main:574] : INFO : Epoch 1842 | loss: 0.0310991 | val_loss: 0.0311754 | Time: 25440.2 ms [2021-12-21 04:24:57 main:574] : INFO : Epoch 1843 | loss: 0.031089 | val_loss: 0.0311803 | Time: 22612.5 ms [2021-12-21 04:25:28 main:574] : INFO : Epoch 1844 | loss: 0.0310982 | val_loss: 0.0311738 | Time: 30932.7 ms [2021-12-21 04:25:53 main:574] : INFO : Epoch 1845 | loss: 0.0310906 | val_loss: 0.0311727 | Time: 24218.6 ms [2021-12-21 04:26:17 main:574] : INFO : Epoch 1846 | loss: 0.0310894 | val_loss: 0.0311735 | Time: 24123.7 ms [2021-12-21 04:26:26 main:574] : INFO : Epoch 1847 | loss: 0.0310851 | val_loss: 0.0311822 | Time: 9224.19 ms [2021-12-21 04:26:36 main:574] : INFO : Epoch 1848 | loss: 0.0310823 | val_loss: 0.031178 | Time: 10546.1 ms [2021-12-21 04:27:26 main:574] : INFO : Epoch 1849 | loss: 0.0310804 | val_loss: 0.0311902 | Time: 49916.7 ms [2021-12-21 04:27:36 main:574] : INFO : Epoch 1850 | loss: 0.0310807 | val_loss: 0.0311765 | Time: 9567.69 ms [2021-12-21 04:27:48 main:574] : INFO : Epoch 1851 | loss: 0.0310797 | val_loss: 0.0311822 | Time: 12215.8 ms [2021-12-21 04:28:04 main:574] : INFO : Epoch 1852 | loss: 0.0310764 | val_loss: 0.0311841 | Time: 15693.5 ms [2021-12-21 04:28:19 main:574] : INFO : Epoch 1853 | loss: 0.0310771 | val_loss: 0.0311794 | Time: 15199.9 ms [2021-12-21 04:28:32 main:574] : INFO : Epoch 1854 | loss: 0.0310785 | val_loss: 0.0311863 | Time: 12555.8 ms [2021-12-21 04:28:40 main:574] : INFO : Epoch 1855 | loss: 0.0310776 | val_loss: 0.0311843 | Time: 8842.83 ms [2021-12-21 04:28:55 main:574] : INFO : Epoch 1856 | loss: 0.0310785 | val_loss: 0.031189 | Time: 14125.3 ms [2021-12-21 04:29:10 main:574] : INFO : Epoch 1857 | loss: 0.0310763 | val_loss: 0.0311897 | Time: 15285.2 ms [2021-12-21 04:29:24 main:574] : INFO : Epoch 1858 | loss: 0.0310774 | val_loss: 0.0311827 | Time: 14192 ms [2021-12-21 04:29:37 main:574] : INFO : Epoch 1859 | loss: 0.0310804 | val_loss: 0.0311924 | Time: 12775.6 ms [2021-12-21 04:29:47 main:574] : INFO : Epoch 1860 | loss: 0.0310794 | val_loss: 0.0311889 | Time: 10250.9 ms [2021-12-21 04:30:01 main:574] : INFO : Epoch 1861 | loss: 0.0310831 | val_loss: 0.0311828 | Time: 14109.4 ms [2021-12-21 04:30:16 main:574] : INFO : Epoch 1862 | loss: 0.0310798 | val_loss: 0.0311908 | Time: 15048.8 ms [2021-12-21 04:30:31 main:574] : INFO : Epoch 1863 | loss: 0.0310777 | val_loss: 0.0311853 | Time: 14813.4 ms [2021-12-21 04:30:41 main:574] : INFO : Epoch 1864 | loss: 0.0310803 | val_loss: 0.0311808 | Time: 10001.1 ms [2021-12-21 04:31:27 main:574] : INFO : Epoch 1865 | loss: 0.0310837 | val_loss: 0.0311806 | Time: 46307.8 ms [2021-12-21 04:31:36 main:574] : INFO : Epoch 1866 | loss: 0.0310813 | val_loss: 0.0311858 | Time: 8676.77 ms [2021-12-21 04:31:48 main:574] : INFO : Epoch 1867 | loss: 0.0310826 | val_loss: 0.0311874 | Time: 11755.1 ms [2021-12-21 04:32:03 main:574] : INFO : Epoch 1868 | loss: 0.0310831 | val_loss: 0.0311795 | Time: 15059.5 ms [2021-12-21 04:32:18 main:574] : INFO : Epoch 1869 | loss: 0.0310821 | val_loss: 0.0311877 | Time: 14914.1 ms [2021-12-21 04:32:33 main:574] : INFO : Epoch 1870 | loss: 0.0310827 | val_loss: 0.0311859 | Time: 15282.5 ms [2021-12-21 04:32:47 main:574] : INFO : Epoch 1871 | loss: 0.031085 | val_loss: 0.031185 | Time: 13347.2 ms [2021-12-21 04:32:56 main:574] : INFO : Epoch 1872 | loss: 0.0310846 | val_loss: 0.0311898 | Time: 9744.76 ms [2021-12-21 04:33:12 main:574] : INFO : Epoch 1873 | loss: 0.0310869 | val_loss: 0.031184 | Time: 15918.9 ms [2021-12-21 04:33:27 main:574] : INFO : Epoch 1874 | loss: 0.0310901 | val_loss: 0.0311759 | Time: 14862 ms [2021-12-21 04:33:41 main:574] : INFO : Epoch 1875 | loss: 0.0310863 | val_loss: 0.0311825 | Time: 14300.7 ms [2021-12-21 04:33:53 main:574] : INFO : Epoch 1876 | loss: 0.0310832 | val_loss: 0.0311759 | Time: 11921.1 ms [2021-12-21 04:34:17 main:574] : INFO : Epoch 1877 | loss: 0.0310847 | val_loss: 0.0311847 | Time: 23711.4 ms [2021-12-21 04:34:31 main:574] : INFO : Epoch 1878 | loss: 0.0310838 | val_loss: 0.0311855 | Time: 13572.7 ms [2021-12-21 04:34:40 main:574] : INFO : Epoch 1879 | loss: 0.0310835 | val_loss: 0.0311816 | Time: 9350.3 ms [2021-12-21 04:34:54 main:574] : INFO : Epoch 1880 | loss: 0.0310865 | val_loss: 0.0311905 | Time: 13812.7 ms [2021-12-21 04:35:20 main:574] : INFO : Epoch 1881 | loss: 0.0310784 | val_loss: 0.0311826 | Time: 25762.3 ms [2021-12-21 04:35:30 main:574] : INFO : Epoch 1882 | loss: 0.0310774 | val_loss: 0.0311881 | Time: 9999.92 ms [2021-12-21 04:35:41 main:574] : INFO : Epoch 1883 | loss: 0.0310844 | val_loss: 0.0311849 | Time: 11772.4 ms [2021-12-21 04:35:56 main:574] : INFO : Epoch 1884 | loss: 0.0310805 | val_loss: 0.0311834 | Time: 14491.7 ms [2021-12-21 04:36:11 main:574] : INFO : Epoch 1885 | loss: 0.0310804 | val_loss: 0.031193 | Time: 14988.6 ms [2021-12-21 04:36:24 main:574] : INFO : Epoch 1886 | loss: 0.0310921 | val_loss: 0.0311872 | Time: 13485.2 ms [2021-12-21 04:36:33 main:574] : INFO : Epoch 1887 | loss: 0.0310794 | val_loss: 0.0311944 | Time: 9110.84 ms [2021-12-21 04:36:46 main:574] : INFO : Epoch 1888 | loss: 0.0310826 | val_loss: 0.0311818 | Time: 12223.7 ms [2021-12-21 04:37:00 main:574] : INFO : Epoch 1889 | loss: 0.0310797 | val_loss: 0.0311843 | Time: 13985.4 ms [2021-12-21 04:37:14 main:574] : INFO : Epoch 1890 | loss: 0.03108 | val_loss: 0.0311806 | Time: 14520 ms [2021-12-21 04:37:27 main:574] : INFO : Epoch 1891 | loss: 0.0310762 | val_loss: 0.0311858 | Time: 13057.6 ms [2021-12-21 04:37:36 main:574] : INFO : Epoch 1892 | loss: 0.0310857 | val_loss: 0.0311817 | Time: 8866.05 ms [2021-12-21 04:37:43 main:574] : INFO : Epoch 1893 | loss: 0.0310839 | val_loss: 0.0311833 | Time: 6690.35 ms [2021-12-21 04:37:55 main:574] : INFO : Epoch 1894 | loss: 0.0310944 | val_loss: 0.0311804 | Time: 12444.5 ms [2021-12-21 04:38:14 main:574] : INFO : Epoch 1895 | loss: 0.0310997 | val_loss: 0.0311793 | Time: 18265.2 ms [2021-12-21 04:38:21 main:574] : INFO : Epoch 1896 | loss: 0.031091 | val_loss: 0.0311824 | Time: 7474.9 ms [2021-12-21 04:38:28 main:574] : INFO : Epoch 1897 | loss: 0.0310858 | val_loss: 0.0311778 | Time: 6749.72 ms [2021-12-21 04:38:38 main:574] : INFO : Epoch 1898 | loss: 0.0310823 | val_loss: 0.0311874 | Time: 10285 ms [2021-12-21 04:38:49 main:574] : INFO : Epoch 1899 | loss: 0.031076 | val_loss: 0.0311945 | Time: 10987.4 ms [2021-12-21 04:39:00 main:574] : INFO : Epoch 1900 | loss: 0.0310762 | val_loss: 0.0311846 | Time: 11215.2 ms [2021-12-21 04:39:12 main:574] : INFO : Epoch 1901 | loss: 0.0310774 | val_loss: 0.031188 | Time: 11423 ms [2021-12-21 04:39:18 main:574] : INFO : Epoch 1902 | loss: 0.031084 | val_loss: 0.0311931 | Time: 6523.76 ms [2021-12-21 04:39:29 main:574] : INFO : Epoch 1903 | loss: 0.0310835 | val_loss: 0.031186 | Time: 10369.3 ms [2021-12-21 04:39:39 main:574] : INFO : Epoch 1904 | loss: 0.0310805 | val_loss: 0.0311896 | Time: 10751.6 ms [2021-12-21 04:39:51 main:574] : INFO : Epoch 1905 | loss: 0.0310861 | val_loss: 0.0311916 | Time: 11102.8 ms [2021-12-21 04:39:59 main:574] : INFO : Epoch 1906 | loss: 0.0310832 | val_loss: 0.0311798 | Time: 8970.68 ms [2021-12-21 04:40:05 main:574] : INFO : Epoch 1907 | loss: 0.0310751 | val_loss: 0.0311973 | Time: 5803.22 ms [2021-12-21 04:40:12 main:574] : INFO : Epoch 1908 | loss: 0.0310719 | val_loss: 0.0311872 | Time: 6244.23 ms [2021-12-21 04:40:23 main:574] : INFO : Epoch 1909 | loss: 0.031074 | val_loss: 0.0311803 | Time: 11037.5 ms [2021-12-21 04:40:34 main:574] : INFO : Epoch 1910 | loss: 0.0310908 | val_loss: 0.0311815 | Time: 11685.2 ms [2021-12-21 04:40:46 main:574] : INFO : Epoch 1911 | loss: 0.0310856 | val_loss: 0.0311834 | Time: 11368.6 ms [2021-12-21 04:40:56 main:574] : INFO : Epoch 1912 | loss: 0.0310775 | val_loss: 0.0312015 | Time: 10210 ms [2021-12-21 04:41:05 main:574] : INFO : Epoch 1913 | loss: 0.0310746 | val_loss: 0.0311878 | Time: 9215.68 ms [2021-12-21 04:41:12 main:574] : INFO : Epoch 1914 | loss: 0.0310738 | val_loss: 0.0311874 | Time: 6448.47 ms [2021-12-21 04:41:22 main:574] : INFO : Epoch 1915 | loss: 0.0310961 | val_loss: 0.0311802 | Time: 10552.5 ms [2021-12-21 04:41:33 main:574] : INFO : Epoch 1916 | loss: 0.0310911 | val_loss: 0.0311847 | Time: 11203.4 ms [2021-12-21 04:41:44 main:574] : INFO : Epoch 1917 | loss: 0.0310856 | val_loss: 0.0311861 | Time: 10804.9 ms [2021-12-21 04:41:53 main:574] : INFO : Epoch 1918 | loss: 0.0310828 | val_loss: 0.031186 | Time: 8935.91 ms [2021-12-21 04:41:58 main:574] : INFO : Epoch 1919 | loss: 0.0310823 | val_loss: 0.0311782 | Time: 5137.85 ms [2021-12-21 04:42:09 main:574] : INFO : Epoch 1920 | loss: 0.0310783 | val_loss: 0.0311981 | Time: 10806.8 ms [2021-12-21 04:42:20 main:574] : INFO : Epoch 1921 | loss: 0.0310734 | val_loss: 0.0311973 | Time: 11036.3 ms [2021-12-21 04:42:33 main:574] : INFO : Epoch 1922 | loss: 0.0310722 | val_loss: 0.031199 | Time: 13151.3 ms [2021-12-21 04:42:44 main:574] : INFO : Epoch 1923 | loss: 0.0310805 | val_loss: 0.0311804 | Time: 10501 ms [2021-12-21 04:42:50 main:574] : INFO : Epoch 1924 | loss: 0.0310849 | val_loss: 0.0311866 | Time: 6512.04 ms [2021-12-21 04:42:56 main:574] : INFO : Epoch 1925 | loss: 0.0310768 | val_loss: 0.0311879 | Time: 5629.21 ms [2021-12-21 04:43:10 main:574] : INFO : Epoch 1926 | loss: 0.0310758 | val_loss: 0.0311782 | Time: 14106.9 ms [2021-12-21 04:43:31 main:574] : INFO : Epoch 1927 | loss: 0.0310792 | val_loss: 0.0311891 | Time: 21412.2 ms [2021-12-21 04:43:43 main:574] : INFO : Epoch 1928 | loss: 0.031083 | val_loss: 0.0311893 | Time: 11564.5 ms [2021-12-21 04:43:49 main:574] : INFO : Epoch 1929 | loss: 0.0310849 | val_loss: 0.0311874 | Time: 5715.78 ms [2021-12-21 04:43:57 main:574] : INFO : Epoch 1930 | loss: 0.0310759 | val_loss: 0.0311877 | Time: 8011.19 ms [2021-12-21 04:44:10 main:574] : INFO : Epoch 1931 | loss: 0.0310765 | val_loss: 0.0311909 | Time: 13112 ms [2021-12-21 04:44:22 main:574] : INFO : Epoch 1932 | loss: 0.0310777 | val_loss: 0.0311874 | Time: 11723.3 ms [2021-12-21 04:44:33 main:574] : INFO : Epoch 1933 | loss: 0.031077 | val_loss: 0.0311952 | Time: 11877.9 ms [2021-12-21 04:44:45 main:574] : INFO : Epoch 1934 | loss: 0.0310799 | val_loss: 0.0311895 | Time: 11474.7 ms [2021-12-21 04:44:52 main:574] : INFO : Epoch 1935 | loss: 0.0310798 | val_loss: 0.0311921 | Time: 6587.12 ms [2021-12-21 04:44:56 main:574] : INFO : Epoch 1936 | loss: 0.0310777 | val_loss: 0.0311828 | Time: 4843.85 ms [2021-12-21 04:45:03 main:574] : INFO : Epoch 1937 | loss: 0.0310749 | val_loss: 0.0311957 | Time: 6851.91 ms [2021-12-21 04:45:13 main:574] : INFO : Epoch 1938 | loss: 0.0310807 | val_loss: 0.0311901 | Time: 9997.38 ms [2021-12-21 04:45:23 main:574] : INFO : Epoch 1939 | loss: 0.0310781 | val_loss: 0.0311785 | Time: 9322.53 ms [2021-12-21 04:45:32 main:574] : INFO : Epoch 1940 | loss: 0.0310741 | val_loss: 0.0312011 | Time: 9475.81 ms [2021-12-21 04:45:40 main:574] : INFO : Epoch 1941 | loss: 0.0310711 | val_loss: 0.0311942 | Time: 8126.52 ms [2021-12-21 04:45:45 main:574] : INFO : Epoch 1942 | loss: 0.0310807 | val_loss: 0.0311834 | Time: 4615.93 ms [2021-12-21 04:45:50 main:574] : INFO : Epoch 1943 | loss: 0.0311133 | val_loss: 0.0311723 | Time: 4675.12 ms [2021-12-21 04:45:58 main:574] : INFO : Epoch 1944 | loss: 0.0311026 | val_loss: 0.0311778 | Time: 8932.29 ms [2021-12-21 04:46:09 main:574] : INFO : Epoch 1945 | loss: 0.031092 | val_loss: 0.031179 | Time: 10584 ms [2021-12-21 04:46:19 main:574] : INFO : Epoch 1946 | loss: 0.0310833 | val_loss: 0.031178 | Time: 9990.95 ms [2021-12-21 04:46:29 main:574] : INFO : Epoch 1947 | loss: 0.0310834 | val_loss: 0.0311847 | Time: 9847.72 ms [2021-12-21 04:46:35 main:574] : INFO : Epoch 1948 | loss: 0.0310887 | val_loss: 0.0311863 | Time: 6429.37 ms [2021-12-21 04:46:40 main:574] : INFO : Epoch 1949 | loss: 0.0310854 | val_loss: 0.0311751 | Time: 4478.48 ms [2021-12-21 04:46:45 main:574] : INFO : Epoch 1950 | loss: 0.031084 | val_loss: 0.0311875 | Time: 4681.74 ms [2021-12-21 04:46:53 main:574] : INFO : Epoch 1951 | loss: 0.0310783 | val_loss: 0.0311811 | Time: 8456.28 ms [2021-12-21 04:47:05 main:574] : INFO : Epoch 1952 | loss: 0.0310744 | val_loss: 0.0311825 | Time: 11939.1 ms [2021-12-21 04:47:15 main:574] : INFO : Epoch 1953 | loss: 0.0310801 | val_loss: 0.0311891 | Time: 10284.4 ms [2021-12-21 04:47:25 main:574] : INFO : Epoch 1954 | loss: 0.0310724 | val_loss: 0.0311986 | Time: 10224.2 ms [2021-12-21 04:47:34 main:574] : INFO : Epoch 1955 | loss: 0.0310685 | val_loss: 0.0311881 | Time: 8880.04 ms [2021-12-21 04:47:38 main:574] : INFO : Epoch 1956 | loss: 0.0310673 | val_loss: 0.0311994 | Time: 4015.82 ms [2021-12-21 04:47:42 main:574] : INFO : Epoch 1957 | loss: 0.0310693 | val_loss: 0.031189 | Time: 4059.84 ms [2021-12-21 04:47:46 main:574] : INFO : Epoch 1958 | loss: 0.0310701 | val_loss: 0.0312037 | Time: 3806.87 ms [2021-12-21 04:47:53 main:574] : INFO : Epoch 1959 | loss: 0.031069 | val_loss: 0.0311915 | Time: 7068.51 ms [2021-12-21 04:48:00 main:574] : INFO : Epoch 1960 | loss: 0.0310744 | val_loss: 0.0311766 | Time: 6101.8 ms [2021-12-21 04:48:07 main:574] : INFO : Epoch 1961 | loss: 0.0310716 | val_loss: 0.0311919 | Time: 7766.94 ms [2021-12-21 04:48:16 main:574] : INFO : Epoch 1962 | loss: 0.0310873 | val_loss: 0.0311848 | Time: 8601.76 ms [2021-12-21 04:48:24 main:574] : INFO : Epoch 1963 | loss: 0.0310865 | val_loss: 0.0311836 | Time: 8163.18 ms [2021-12-21 04:48:38 main:574] : INFO : Epoch 1964 | loss: 0.0310748 | val_loss: 0.0311899 | Time: 13467.8 ms [2021-12-21 04:48:52 main:574] : INFO : Epoch 1965 | loss: 0.0310711 | val_loss: 0.0311937 | Time: 13973.1 ms [2021-12-21 04:49:07 main:574] : INFO : Epoch 1966 | loss: 0.0310789 | val_loss: 0.0311867 | Time: 15109.4 ms [2021-12-21 04:49:20 main:574] : INFO : Epoch 1967 | loss: 0.0310831 | val_loss: 0.0311874 | Time: 12886.8 ms [2021-12-21 04:49:30 main:574] : INFO : Epoch 1968 | loss: 0.0310755 | val_loss: 0.0311982 | Time: 10617.5 ms [2021-12-21 04:49:44 main:574] : INFO : Epoch 1969 | loss: 0.031073 | val_loss: 0.0311885 | Time: 13920.3 ms [2021-12-21 04:49:59 main:574] : INFO : Epoch 1970 | loss: 0.0310735 | val_loss: 0.0311945 | Time: 14649 ms [2021-12-21 04:50:20 main:574] : INFO : Epoch 1971 | loss: 0.0310733 | val_loss: 0.0311928 | Time: 21630.3 ms [2021-12-21 04:50:29 main:574] : INFO : Epoch 1972 | loss: 0.0310659 | val_loss: 0.0311927 | Time: 8352.81 ms [2021-12-21 04:50:42 main:574] : INFO : Epoch 1973 | loss: 0.0310661 | val_loss: 0.0311945 | Time: 12903.7 ms [2021-12-21 04:50:55 main:574] : INFO : Epoch 1974 | loss: 0.0310665 | val_loss: 0.0311928 | Time: 13658.7 ms [2021-12-21 04:51:11 main:574] : INFO : Epoch 1975 | loss: 0.0310654 | val_loss: 0.0312067 | Time: 15344.2 ms [2021-12-21 04:51:26 main:574] : INFO : Epoch 1976 | loss: 0.031065 | val_loss: 0.031192 | Time: 15268.1 ms [2021-12-21 04:51:41 main:574] : INFO : Epoch 1977 | loss: 0.0310705 | val_loss: 0.0311876 | Time: 14617.7 ms [2021-12-21 04:51:50 main:574] : INFO : Epoch 1978 | loss: 0.0310767 | val_loss: 0.0311881 | Time: 9480.66 ms [2021-12-21 04:52:02 main:574] : INFO : Epoch 1979 | loss: 0.0310702 | val_loss: 0.0312004 | Time: 12356.2 ms [2021-12-21 04:52:17 main:574] : INFO : Epoch 1980 | loss: 0.0310658 | val_loss: 0.0311931 | Time: 14852.5 ms [2021-12-21 04:52:32 main:574] : INFO : Epoch 1981 | loss: 0.0310671 | val_loss: 0.0311981 | Time: 14382.9 ms [2021-12-21 04:52:42 main:574] : INFO : Epoch 1982 | loss: 0.0310678 | val_loss: 0.0311924 | Time: 9935.58 ms [2021-12-21 04:52:55 main:574] : INFO : Epoch 1983 | loss: 0.0310755 | val_loss: 0.031195 | Time: 13460.2 ms [2021-12-21 04:53:22 main:574] : INFO : Epoch 1984 | loss: 0.0310696 | val_loss: 0.0311834 | Time: 27213.9 ms [2021-12-21 04:53:27 main:574] : INFO : Epoch 1985 | loss: 0.0310673 | val_loss: 0.0312092 | Time: 4276.02 ms [2021-12-21 04:53:30 main:574] : INFO : Epoch 1986 | loss: 0.0310661 | val_loss: 0.0312029 | Time: 3771.25 ms [2021-12-21 04:53:35 main:574] : INFO : Epoch 1987 | loss: 0.0310765 | val_loss: 0.0311853 | Time: 4437.93 ms [2021-12-21 04:53:41 main:574] : INFO : Epoch 1988 | loss: 0.031076 | val_loss: 0.0311948 | Time: 6452.17 ms [2021-12-21 04:53:55 main:574] : INFO : Epoch 1989 | loss: 0.031081 | val_loss: 0.0311883 | Time: 13522.7 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050 Ti) [2021-12-21 12:29:31 main:435] : INFO : Set logging level to 1 [2021-12-21 12:29:31 main:441] : INFO : Running in BOINC Client mode [2021-12-21 12:29:31 main:444] : INFO : Resolving all filenames [2021-12-21 12:29:31 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2021-12-21 12:29:31 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2021-12-21 12:29:31 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2021-12-21 12:29:31 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 0) [2021-12-21 12:29:31 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2021-12-21 12:29:31 main:472] : INFO : Dataset filename: dataset.hdf5 [2021-12-21 12:29:31 main:474] : INFO : Configuration: [2021-12-21 12:29:31 main:475] : INFO : Model type: GRU [2021-12-21 12:29:31 main:476] : INFO : Validation Loss Threshold: 0.0001 [2021-12-21 12:29:31 main:477] : INFO : Max Epochs: 2048 [2021-12-21 12:29:31 main:478] : INFO : Batch Size: 128 [2021-12-21 12:29:31 main:479] : INFO : Learning Rate: 0.01 [2021-12-21 12:29:31 main:480] : INFO : Patience: 10 [2021-12-21 12:29:31 main:481] : INFO : Hidden Width: 12 [2021-12-21 12:29:31 main:482] : INFO : # Recurrent Layers: 4 [2021-12-21 12:29:31 main:483] : INFO : # Backend Layers: 4 [2021-12-21 12:29:31 main:484] : INFO : # Threads: 1 [2021-12-21 12:29:31 main:486] : INFO : Preparing Dataset [2021-12-21 12:29:31 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2021-12-21 12:29:32 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2021-12-21 12:29:36 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2021-12-21 12:29:36 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2021-12-21 12:29:36 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2021-12-21 12:29:37 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2021-12-21 12:29:37 main:494] : INFO : Creating Model [2021-12-21 12:29:37 main:507] : INFO : Preparing config file [2021-12-21 12:29:37 main:511] : INFO : Found checkpoint, attempting to load... [2021-12-21 12:29:37 main:512] : INFO : Loading config [2021-12-21 12:29:37 main:514] : INFO : Loading state [2021-12-21 12:30:01 main:559] : INFO : Loading DataLoader into Memory [2021-12-21 12:30:01 main:562] : INFO : Starting Training [2021-12-21 12:30:08 main:574] : INFO : Epoch 1977 | loss: 0.0311246 | val_loss: 0.0312058 | Time: 7602.03 ms [2021-12-21 12:30:27 main:574] : INFO : Epoch 1978 | loss: 0.0310845 | val_loss: 0.0312009 | Time: 19104.8 ms [2021-12-21 12:30:46 main:574] : INFO : Epoch 1979 | loss: 0.0310723 | val_loss: 0.0312057 | Time: 18147.3 ms [2021-12-21 12:30:55 main:574] : INFO : Epoch 1980 | loss: 0.0310717 | val_loss: 0.0311953 | Time: 9470.03 ms [2021-12-21 12:31:06 main:574] : INFO : Epoch 1981 | loss: 0.031084 | val_loss: 0.0311892 | Time: 10675.4 ms [2021-12-21 12:31:24 main:574] : INFO : Epoch 1982 | loss: 0.0310831 | val_loss: 0.0311953 | Time: 17911.9 ms [2021-12-21 12:31:31 main:574] : INFO : Epoch 1983 | loss: 0.0310794 | val_loss: 0.0311931 | Time: 7148.39 ms [2021-12-21 12:31:39 main:574] : INFO : Epoch 1984 | loss: 0.0310698 | val_loss: 0.031196 | Time: 8415.86 ms [2021-12-21 12:31:47 main:574] : INFO : Epoch 1985 | loss: 0.0310675 | val_loss: 0.0311894 | Time: 7738.51 ms [2021-12-21 12:31:53 main:574] : INFO : Epoch 1986 | loss: 0.0310668 | val_loss: 0.0311988 | Time: 6216.07 ms [2021-12-21 12:32:00 main:574] : INFO : Epoch 1987 | loss: 0.0310645 | val_loss: 0.0312069 | Time: 6666.98 ms [2021-12-21 12:32:08 main:574] : INFO : Epoch 1988 | loss: 0.0310658 | val_loss: 0.0311946 | Time: 8078.01 ms [2021-12-21 12:32:15 main:574] : INFO : Epoch 1989 | loss: 0.031066 | val_loss: 0.0311938 | Time: 7116.02 ms [2021-12-21 12:32:22 main:574] : INFO : Epoch 1990 | loss: 0.0310712 | val_loss: 0.0311938 | Time: 6435.5 ms [2021-12-21 12:32:30 main:574] : INFO : Epoch 1991 | loss: 0.0310736 | val_loss: 0.031195 | Time: 8185.75 ms [2021-12-21 12:32:40 main:574] : INFO : Epoch 1992 | loss: 0.0310711 | val_loss: 0.0312086 | Time: 9957.5 ms [2021-12-21 12:32:49 main:574] : INFO : Epoch 1993 | loss: 0.031072 | val_loss: 0.0311858 | Time: 9074.63 ms [2021-12-21 12:32:58 main:574] : INFO : Epoch 1994 | loss: 0.0310683 | val_loss: 0.0311958 | Time: 9295.94 ms [2021-12-21 12:33:08 main:574] : INFO : Epoch 1995 | loss: 0.0310631 | val_loss: 0.0312113 | Time: 10175.1 ms [2021-12-21 12:33:20 main:574] : INFO : Epoch 1996 | loss: 0.0310696 | val_loss: 0.0311866 | Time: 12124.4 ms [2021-12-21 12:33:31 main:574] : INFO : Epoch 1997 | loss: 0.0310657 | val_loss: 0.0312011 | Time: 10839 ms [2021-12-21 12:33:53 main:574] : INFO : Epoch 1998 | loss: 0.0310658 | val_loss: 0.0311954 | Time: 21862.1 ms [2021-12-21 12:34:02 main:574] : INFO : Epoch 1999 | loss: 0.0310678 | val_loss: 0.0311989 | Time: 9107.46 ms [2021-12-21 12:34:39 main:574] : INFO : Epoch 2000 | loss: 0.03108 | val_loss: 0.0311957 | Time: 36391.4 ms [2021-12-21 12:34:50 main:574] : INFO : Epoch 2001 | loss: 0.03107 | val_loss: 0.0312128 | Time: 11295 ms [2021-12-21 12:35:04 main:574] : INFO : Epoch 2002 | loss: 0.0310643 | val_loss: 0.0311911 | Time: 13529.8 ms [2021-12-21 12:35:45 main:574] : INFO : Epoch 2003 | loss: 0.0310663 | val_loss: 0.0311941 | Time: 41605.7 ms [2021-12-21 12:35:57 main:574] : INFO : Epoch 2004 | loss: 0.0310635 | val_loss: 0.0311965 | Time: 11548.3 ms [2021-12-21 12:36:09 main:574] : INFO : Epoch 2005 | loss: 0.0310605 | val_loss: 0.0312111 | Time: 12692 ms [2021-12-21 12:36:18 main:574] : INFO : Epoch 2006 | loss: 0.031064 | val_loss: 0.0312006 | Time: 8337.08 ms [2021-12-21 12:36:29 main:574] : INFO : Epoch 2007 | loss: 0.0310657 | val_loss: 0.0311898 | Time: 10811 ms [2021-12-21 12:36:41 main:574] : INFO : Epoch 2008 | loss: 0.0310645 | val_loss: 0.0311986 | Time: 12844.5 ms [2021-12-21 12:36:52 main:574] : INFO : Epoch 2009 | loss: 0.031065 | val_loss: 0.0311983 | Time: 10671.8 ms [2021-12-21 12:37:15 main:574] : INFO : Epoch 2010 | loss: 0.0310666 | val_loss: 0.0312027 | Time: 22870.4 ms [2021-12-21 12:37:23 main:574] : INFO : Epoch 2011 | loss: 0.0310657 | val_loss: 0.0311918 | Time: 8462.05 ms [2021-12-21 12:37:33 main:574] : INFO : Epoch 2012 | loss: 0.0310659 | val_loss: 0.0312042 | Time: 9284.09 ms [2021-12-21 12:37:47 main:574] : INFO : Epoch 2013 | loss: 0.0310671 | val_loss: 0.0311898 | Time: 14309.2 ms [2021-12-21 12:37:57 main:574] : INFO : Epoch 2014 | loss: 0.0310624 | val_loss: 0.0312068 | Time: 10439.9 ms [2021-12-21 12:38:08 main:574] : INFO : Epoch 2015 | loss: 0.0310627 | val_loss: 0.0311959 | Time: 10300.1 ms [2021-12-21 12:38:19 main:574] : INFO : Epoch 2016 | loss: 0.0311007 | val_loss: 0.0311822 | Time: 11282.4 ms [2021-12-21 12:38:33 main:574] : INFO : Epoch 2017 | loss: 0.0311736 | val_loss: 0.0311853 | Time: 14083.7 ms [2021-12-21 12:38:45 main:574] : INFO : Epoch 2018 | loss: 0.0311659 | val_loss: 0.0311637 | Time: 11403.9 ms [2021-12-21 12:38:54 main:574] : INFO : Epoch 2019 | loss: 0.0311527 | val_loss: 0.0311664 | Time: 9327.1 ms [2021-12-21 12:39:07 main:574] : INFO : Epoch 2020 | loss: 0.0311495 | val_loss: 0.031155 | Time: 12737.5 ms [2021-12-21 12:39:21 main:574] : INFO : Epoch 2021 | loss: 0.031142 | val_loss: 0.0311573 | Time: 14707.5 ms [2021-12-21 12:39:33 main:574] : INFO : Epoch 2022 | loss: 0.0311367 | val_loss: 0.0311573 | Time: 11543.8 ms [2021-12-21 12:39:43 main:574] : INFO : Epoch 2023 | loss: 0.0311331 | val_loss: 0.0311576 | Time: 10144.8 ms [2021-12-21 12:39:55 main:574] : INFO : Epoch 2024 | loss: 0.0311299 | val_loss: 0.031158 | Time: 12191.6 ms [2021-12-21 12:40:10 main:574] : INFO : Epoch 2025 | loss: 0.0311264 | val_loss: 0.0311555 | Time: 14752.2 ms [2021-12-21 12:40:20 main:574] : INFO : Epoch 2026 | loss: 0.0311251 | val_loss: 0.0311568 | Time: 9779.58 ms [2021-12-21 12:40:32 main:574] : INFO : Epoch 2027 | loss: 0.0311242 | val_loss: 0.0311564 | Time: 12444.6 ms [2021-12-21 12:40:46 main:574] : INFO : Epoch 2028 | loss: 0.0311216 | val_loss: 0.0311583 | Time: 13608.3 ms [2021-12-21 12:41:01 main:574] : INFO : Epoch 2029 | loss: 0.0311182 | val_loss: 0.0311597 | Time: 14942.3 ms [2021-12-21 12:41:24 main:574] : INFO : Epoch 2030 | loss: 0.0311169 | val_loss: 0.0311603 | Time: 22904.1 ms [2021-12-21 12:41:37 main:574] : INFO : Epoch 2031 | loss: 0.0311197 | val_loss: 0.0311641 | Time: 13394 ms [2021-12-21 12:41:50 main:574] : INFO : Epoch 2032 | loss: 0.0311167 | val_loss: 0.0311628 | Time: 13330.7 ms [2021-12-21 12:42:04 main:574] : INFO : Epoch 2033 | loss: 0.0311133 | val_loss: 0.0311653 | Time: 13306.4 ms [2021-12-21 12:42:13 main:574] : INFO : Epoch 2034 | loss: 0.0311095 | val_loss: 0.0311698 | Time: 9176.65 ms [2021-12-21 12:42:27 main:574] : INFO : Epoch 2035 | loss: 0.0311088 | val_loss: 0.0311669 | Time: 13706.4 ms [2021-12-21 12:42:42 main:574] : INFO : Epoch 2036 | loss: 0.0311087 | val_loss: 0.0311671 | Time: 15012.4 ms [2021-12-21 12:42:57 main:574] : INFO : Epoch 2037 | loss: 0.0311094 | val_loss: 0.0311649 | Time: 15008.1 ms [2021-12-21 12:43:07 main:574] : INFO : Epoch 2038 | loss: 0.0311072 | val_loss: 0.0311669 | Time: 10470.1 ms [2021-12-21 12:43:16 main:574] : INFO : Epoch 2039 | loss: 0.0311067 | val_loss: 0.0311729 | Time: 8896.58 ms [2021-12-21 12:43:30 main:574] : INFO : Epoch 2040 | loss: 0.0311037 | val_loss: 0.0311707 | Time: 13609.5 ms [2021-12-21 12:43:45 main:574] : INFO : Epoch 2041 | loss: 0.0311025 | val_loss: 0.0311696 | Time: 14748.1 ms [2021-12-21 12:43:53 main:574] : INFO : Epoch 2042 | loss: 0.0310994 | val_loss: 0.0311691 | Time: 8898.62 ms [2021-12-21 12:44:02 main:574] : INFO : Epoch 2043 | loss: 0.0311022 | val_loss: 0.0311728 | Time: 8126.7 ms [2021-12-21 12:44:15 main:574] : INFO : Epoch 2044 | loss: 0.0310983 | val_loss: 0.0311701 | Time: 13422.7 ms [2021-12-21 12:44:28 main:574] : INFO : Epoch 2045 | loss: 0.0310984 | val_loss: 0.0311737 | Time: 13174.2 ms [2021-12-21 12:44:42 main:574] : INFO : Epoch 2046 | loss: 0.0310985 | val_loss: 0.0311738 | Time: 14111.8 ms [2021-12-21 12:44:51 main:574] : INFO : Epoch 2047 | loss: 0.0310967 | val_loss: 0.0311741 | Time: 8266.05 ms [2021-12-21 12:44:59 main:574] : INFO : Epoch 2048 | loss: 0.0310953 | val_loss: 0.031176 | Time: 8347.37 ms [2021-12-21 12:44:59 main:597] : INFO : Saving trained model to model-final.pt, val_loss 0.031176 [2021-12-21 12:44:59 main:603] : INFO : Saving end state to config to file [2021-12-21 12:44:59 main:608] : INFO : Success, exiting.. 12:44:59 (20076): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)