Task 11455092
| Name | ParityModified-1639959060-10573-2-0_0 |
| Workunit | 8687403 |
| Created | 9 Feb 2022, 15:49:40 UTC |
| Sent | 27 Feb 2022, 13:25:54 UTC |
| Report deadline | 7 Mar 2022, 13:25:54 UTC |
| Received | 28 Feb 2022, 16:21:31 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 1150 |
| Run time | 57 min 5 sec |
| CPU time | 55 min 19 sec |
| Validate state | Valid |
| Credit | 4,160.00 |
| Device peak FLOPS | 4,174.91 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 2.10 GB |
| Peak swap size | 3.48 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version> <![CDATA[ <stderr_txt> 22-02-28 09:07:14 main:574] : INFO : Epoch 1596 | loss: 0.0311121 | val_loss: 0.0311405 | Time: 1636.53 ms [2022-02-28 09:07:15 main:574] : INFO : Epoch 1597 | loss: 0.0311124 | val_loss: 0.031138 | Time: 1635.04 ms [2022-02-28 09:07:17 main:574] : INFO : Epoch 1598 | loss: 0.0311145 | val_loss: 0.0311387 | Time: 1644.18 ms [2022-02-28 09:07:19 main:574] : INFO : Epoch 1599 | loss: 0.031112 | val_loss: 0.0311393 | Time: 1650.34 ms [2022-02-28 09:07:20 main:574] : INFO : Epoch 1600 | loss: 0.0311103 | val_loss: 0.0311408 | Time: 1646.38 ms [2022-02-28 09:07:22 main:574] : INFO : Epoch 1601 | loss: 0.0311107 | val_loss: 0.03114 | Time: 1648.2 ms [2022-02-28 09:07:24 main:574] : INFO : Epoch 1602 | loss: 0.0311116 | val_loss: 0.0311387 | Time: 1639.08 ms [2022-02-28 09:07:25 main:574] : INFO : Epoch 1603 | loss: 0.0311098 | val_loss: 0.0311385 | Time: 1632.56 ms [2022-02-28 09:07:27 main:574] : INFO : Epoch 1604 | loss: 0.0311105 | val_loss: 0.0311439 | Time: 1642.63 ms [2022-02-28 09:07:29 main:574] : INFO : Epoch 1605 | loss: 0.0311099 | val_loss: 0.0311407 | Time: 1645.9 ms [2022-02-28 09:07:30 main:574] : INFO : Epoch 1606 | loss: 0.0311103 | val_loss: 0.0311438 | Time: 1658.85 ms [2022-02-28 09:07:32 main:574] : INFO : Epoch 1607 | loss: 0.03111 | val_loss: 0.0311436 | Time: 1639.27 ms [2022-02-28 09:07:34 main:574] : INFO : Epoch 1608 | loss: 0.03111 | val_loss: 0.0311413 | Time: 1639.95 ms [2022-02-28 09:07:35 main:574] : INFO : Epoch 1609 | loss: 0.0311098 | val_loss: 0.0311429 | Time: 1637.92 ms [2022-02-28 09:07:37 main:574] : INFO : Epoch 1610 | loss: 0.0311105 | val_loss: 0.031143 | Time: 1634.52 ms [2022-02-28 09:07:39 main:574] : INFO : Epoch 1611 | loss: 0.0311094 | val_loss: 0.0311429 | Time: 1645.62 ms [2022-02-28 09:07:40 main:574] : INFO : Epoch 1612 | loss: 0.0311086 | val_loss: 0.0311395 | Time: 1655.07 ms [2022-02-28 09:07:42 main:574] : INFO : Epoch 1613 | loss: 0.0311118 | val_loss: 0.0311523 | Time: 1644.34 ms [2022-02-28 09:07:43 main:574] : INFO : Epoch 1614 | loss: 0.0311174 | val_loss: 0.031146 | Time: 1643.99 ms [2022-02-28 09:07:45 main:574] : INFO : Epoch 1615 | loss: 0.0311158 | val_loss: 0.0311457 | Time: 1639.94 ms [2022-02-28 09:07:47 main:574] : INFO : Epoch 1616 | loss: 0.0311151 | val_loss: 0.031146 | Time: 1632.6 ms [2022-02-28 09:07:48 main:574] : INFO : Epoch 1617 | loss: 0.0311147 | val_loss: 0.03114 | Time: 1651.62 ms [2022-02-28 09:07:50 main:574] : INFO : Epoch 1618 | loss: 0.0311131 | val_loss: 0.0311468 | Time: 1651.78 ms [2022-02-28 09:07:52 main:574] : INFO : Epoch 1619 | loss: 0.0311135 | val_loss: 0.0311434 | Time: 1630.83 ms [2022-02-28 09:07:53 main:574] : INFO : Epoch 1620 | loss: 0.0311211 | val_loss: 0.0311406 | Time: 1634.76 ms [2022-02-28 09:07:55 main:574] : INFO : Epoch 1621 | loss: 0.031124 | val_loss: 0.031141 | Time: 1640.12 ms [2022-02-28 09:07:57 main:574] : INFO : Epoch 1622 | loss: 0.0311247 | val_loss: 0.0311472 | Time: 1637.8 ms [2022-02-28 09:07:58 main:574] : INFO : Epoch 1623 | loss: 0.0311272 | val_loss: 0.0311412 | Time: 1640.26 ms [2022-02-28 09:08:00 main:574] : INFO : Epoch 1624 | loss: 0.0311226 | val_loss: 0.0311394 | Time: 1650.23 ms [2022-02-28 09:08:02 main:574] : INFO : Epoch 1625 | loss: 0.0311196 | val_loss: 0.0311398 | Time: 1655.76 ms [2022-02-28 09:08:03 main:574] : INFO : Epoch 1626 | loss: 0.0311188 | val_loss: 0.0311388 | Time: 1685.81 ms [2022-02-28 09:08:05 main:574] : INFO : Epoch 1627 | loss: 0.0311204 | val_loss: 0.0311413 | Time: 1639.45 ms [2022-02-28 09:08:07 main:574] : INFO : Epoch 1628 | loss: 0.0311276 | val_loss: 0.0311461 | Time: 1640.09 ms [2022-02-28 09:08:08 main:574] : INFO : Epoch 1629 | loss: 0.0311323 | val_loss: 0.0311489 | Time: 1656.43 ms [2022-02-28 09:08:10 main:574] : INFO : Epoch 1630 | loss: 0.0311395 | val_loss: 0.0311474 | Time: 1647.71 ms [2022-02-28 09:08:12 main:574] : INFO : Epoch 1631 | loss: 0.0311412 | val_loss: 0.0311526 | Time: 1649.93 ms [2022-02-28 09:08:13 main:574] : INFO : Epoch 1632 | loss: 0.031141 | val_loss: 0.0311546 | Time: 1639.96 ms [2022-02-28 09:08:15 main:574] : INFO : Epoch 1633 | loss: 0.031143 | val_loss: 0.0311491 | Time: 1646.86 ms [2022-02-28 09:08:17 main:574] : INFO : Epoch 1634 | loss: 0.0311386 | val_loss: 0.0311505 | Time: 1645.61 ms [2022-02-28 09:08:18 main:574] : INFO : Epoch 1635 | loss: 0.0311353 | val_loss: 0.0311487 | Time: 1649.55 ms [2022-02-28 09:08:20 main:574] : INFO : Epoch 1636 | loss: 0.0311327 | val_loss: 0.0311465 | Time: 1641.75 ms [2022-02-28 09:08:21 main:574] : INFO : Epoch 1637 | loss: 0.0311314 | val_loss: 0.031145 | Time: 1659.8 ms [2022-02-28 09:08:23 main:574] : INFO : Epoch 1638 | loss: 0.0311312 | val_loss: 0.0311455 | Time: 1645.69 ms [2022-02-28 09:08:25 main:574] : INFO : Epoch 1639 | loss: 0.0311303 | val_loss: 0.0311429 | Time: 1635.03 ms [2022-02-28 09:08:26 main:574] : INFO : Epoch 1640 | loss: 0.0311287 | val_loss: 0.0311425 | Time: 1637.82 ms [2022-02-28 09:08:28 main:574] : INFO : Epoch 1641 | loss: 0.0311263 | val_loss: 0.0311439 | Time: 1650.99 ms [2022-02-28 09:08:30 main:574] : INFO : Epoch 1642 | loss: 0.0311302 | val_loss: 0.0311467 | Time: 1644.25 ms [2022-02-28 09:08:31 main:574] : INFO : Epoch 1643 | loss: 0.0311289 | val_loss: 0.0311454 | Time: 1641.98 ms [2022-02-28 09:08:33 main:574] : INFO : Epoch 1644 | loss: 0.0311275 | val_loss: 0.0311444 | Time: 1630.19 ms [2022-02-28 09:08:35 main:574] : INFO : Epoch 1645 | loss: 0.0311331 | val_loss: 0.0311462 | Time: 1649.01 ms [2022-02-28 09:08:36 main:574] : INFO : Epoch 1646 | loss: 0.0311297 | val_loss: 0.0311448 | Time: 1632.8 ms [2022-02-28 09:08:38 main:574] : INFO : Epoch 1647 | loss: 0.0311261 | val_loss: 0.0311423 | Time: 1650.32 ms [2022-02-28 09:08:40 main:574] : INFO : Epoch 1648 | loss: 0.0311252 | val_loss: 0.0311442 | Time: 1641.87 ms [2022-02-28 09:08:41 main:574] : INFO : Epoch 1649 | loss: 0.0311238 | val_loss: 0.0311454 | Time: 1653.72 ms [2022-02-28 09:08:43 main:574] : INFO : Epoch 1650 | loss: 0.0311238 | val_loss: 0.0311455 | Time: 1642.48 ms [2022-02-28 09:08:45 main:574] : INFO : Epoch 1651 | loss: 0.0311218 | val_loss: 0.0311428 | Time: 1642.37 ms [2022-02-28 09:08:46 main:574] : INFO : Epoch 1652 | loss: 0.0311206 | val_loss: 0.0311441 | Time: 1634.68 ms [2022-02-28 09:08:48 main:574] : INFO : Epoch 1653 | loss: 0.0311211 | val_loss: 0.031141 | Time: 1642.5 ms [2022-02-28 09:08:50 main:574] : INFO : Epoch 1654 | loss: 0.0311207 | val_loss: 0.0311402 | Time: 1651.12 ms [2022-02-28 09:08:51 main:574] : INFO : Epoch 1655 | loss: 0.0311194 | val_loss: 0.0311377 | Time: 1650.39 ms [2022-02-28 09:08:53 main:574] : INFO : Epoch 1656 | loss: 0.0311209 | val_loss: 0.0311362 | Time: 1629.76 ms [2022-02-28 09:08:54 main:574] : INFO : Epoch 1657 | loss: 0.0311161 | val_loss: 0.0311333 | Time: 1642.21 ms [2022-02-28 09:08:56 main:574] : INFO : Epoch 1658 | loss: 0.031115 | val_loss: 0.0311348 | Time: 1629.22 ms [2022-02-28 09:08:58 main:574] : INFO : Epoch 1659 | loss: 0.0311124 | val_loss: 0.0311333 | Time: 1647.11 ms [2022-02-28 09:08:59 main:574] : INFO : Epoch 1660 | loss: 0.0311134 | val_loss: 0.0311343 | Time: 1643.55 ms [2022-02-28 09:09:01 main:574] : INFO : Epoch 1661 | loss: 0.0311122 | val_loss: 0.0311369 | Time: 1656.58 ms [2022-02-28 09:09:03 main:574] : INFO : Epoch 1662 | loss: 0.0311175 | val_loss: 0.0311329 | Time: 1637.87 ms [2022-02-28 09:09:04 main:574] : INFO : Epoch 1663 | loss: 0.0311136 | val_loss: 0.0311348 | Time: 1640.5 ms [2022-02-28 09:09:06 main:574] : INFO : Epoch 1664 | loss: 0.0311118 | val_loss: 0.031132 | Time: 1632 ms [2022-02-28 09:09:08 main:574] : INFO : Epoch 1665 | loss: 0.0311121 | val_loss: 0.0311347 | Time: 1649.73 ms [2022-02-28 09:09:09 main:574] : INFO : Epoch 1666 | loss: 0.0311111 | val_loss: 0.0311327 | Time: 1638.14 ms [2022-02-28 09:09:11 main:574] : INFO : Epoch 1667 | loss: 0.0311116 | val_loss: 0.0311319 | Time: 1654.59 ms [2022-02-28 09:09:13 main:574] : INFO : Epoch 1668 | loss: 0.0311131 | val_loss: 0.0311334 | Time: 1630.54 ms [2022-02-28 09:09:14 main:574] : INFO : Epoch 1669 | loss: 0.0311167 | val_loss: 0.0311375 | Time: 1640.13 ms [2022-02-28 09:09:16 main:574] : INFO : Epoch 1670 | loss: 0.0311191 | val_loss: 0.0311327 | Time: 1643.96 ms [2022-02-28 09:09:18 main:574] : INFO : Epoch 1671 | loss: 0.0311258 | val_loss: 0.0311414 | Time: 1650.37 ms [2022-02-28 09:09:19 main:574] : INFO : Epoch 1672 | loss: 0.0311265 | val_loss: 0.0311408 | Time: 1658.1 ms [2022-02-28 09:09:21 main:574] : INFO : Epoch 1673 | loss: 0.0311197 | val_loss: 0.0311469 | Time: 1651.23 ms [2022-02-28 09:09:22 main:574] : INFO : Epoch 1674 | loss: 0.0311192 | val_loss: 0.0311385 | Time: 1639.19 ms [2022-02-28 09:09:24 main:574] : INFO : Epoch 1675 | loss: 0.0311155 | val_loss: 0.0311436 | Time: 1641.21 ms [2022-02-28 09:09:26 main:574] : INFO : Epoch 1676 | loss: 0.0311137 | val_loss: 0.031135 | Time: 1643.46 ms [2022-02-28 09:09:27 main:574] : INFO : Epoch 1677 | loss: 0.031112 | val_loss: 0.0311329 | Time: 1642.77 ms [2022-02-28 09:09:29 main:574] : INFO : Epoch 1678 | loss: 0.0311094 | val_loss: 0.0311332 | Time: 1648.05 ms [2022-02-28 09:09:31 main:574] : INFO : Epoch 1679 | loss: 0.0311099 | val_loss: 0.0311339 | Time: 1647.3 ms [2022-02-28 09:09:32 main:574] : INFO : Epoch 1680 | loss: 0.0311111 | val_loss: 0.0311313 | Time: 1643.09 ms [2022-02-28 09:09:34 main:574] : INFO : Epoch 1681 | loss: 0.0311099 | val_loss: 0.0311366 | Time: 1637.13 ms [2022-02-28 09:09:36 main:574] : INFO : Epoch 1682 | loss: 0.0311105 | val_loss: 0.0311323 | Time: 1635.96 ms [2022-02-28 09:09:37 main:574] : INFO : Epoch 1683 | loss: 0.0311096 | val_loss: 0.0311345 | Time: 1644.3 ms [2022-02-28 09:09:39 main:574] : INFO : Epoch 1684 | loss: 0.0311107 | val_loss: 0.0311343 | Time: 1651.82 ms [2022-02-28 09:09:41 main:574] : INFO : Epoch 1685 | loss: 0.0311106 | val_loss: 0.0311343 | Time: 1645.26 ms [2022-02-28 09:09:42 main:574] : INFO : Epoch 1686 | loss: 0.0311096 | val_loss: 0.031135 | Time: 1644.2 ms [2022-02-28 09:09:44 main:574] : INFO : Epoch 1687 | loss: 0.0311087 | val_loss: 0.0311337 | Time: 1643.01 ms [2022-02-28 09:09:46 main:574] : INFO : Epoch 1688 | loss: 0.0311088 | val_loss: 0.0311353 | Time: 1640.62 ms [2022-02-28 09:09:47 main:574] : INFO : Epoch 1689 | loss: 0.0311094 | val_loss: 0.0311356 | Time: 1632.21 ms [2022-02-28 09:09:49 main:574] : INFO : Epoch 1690 | loss: 0.0311086 | val_loss: 0.0311343 | Time: 1647.7 ms [2022-02-28 09:09:51 main:574] : INFO : Epoch 1691 | loss: 0.0311078 | val_loss: 0.0311321 | Time: 1646.2 ms [2022-02-28 09:09:52 main:574] : INFO : Epoch 1692 | loss: 0.0311071 | val_loss: 0.0311338 | Time: 1641.71 ms [2022-02-28 09:09:54 main:574] : INFO : Epoch 1693 | loss: 0.0311094 | val_loss: 0.0311322 | Time: 1630.69 ms [2022-02-28 09:09:55 main:574] : INFO : Epoch 1694 | loss: 0.0311068 | val_loss: 0.0311303 | Time: 1647.92 ms [2022-02-28 09:09:57 main:574] : INFO : Epoch 1695 | loss: 0.0311076 | val_loss: 0.0311304 | Time: 1634.06 ms [2022-02-28 09:09:59 main:574] : INFO : Epoch 1696 | loss: 0.031106 | val_loss: 0.0311307 | Time: 1651.09 ms [2022-02-28 09:10:00 main:574] : INFO : Epoch 1697 | loss: 0.0311053 | val_loss: 0.0311315 | Time: 1650.03 ms [2022-02-28 09:10:02 main:574] : INFO : Epoch 1698 | loss: 0.0311054 | val_loss: 0.0311303 | Time: 1648.29 ms [2022-02-28 09:10:04 main:574] : INFO : Epoch 1699 | loss: 0.0311058 | val_loss: 0.0311292 | Time: 1633.92 ms [2022-02-28 09:10:05 main:574] : INFO : Epoch 1700 | loss: 0.0311056 | val_loss: 0.0311287 | Time: 1642.62 ms [2022-02-28 09:10:07 main:574] : INFO : Epoch 1701 | loss: 0.0311047 | val_loss: 0.031128 | Time: 1634.79 ms [2022-02-28 09:10:09 main:574] : INFO : Epoch 1702 | loss: 0.031106 | val_loss: 0.0311348 | Time: 1653.3 ms [2022-02-28 09:10:10 main:574] : INFO : Epoch 1703 | loss: 0.0311061 | val_loss: 0.0311309 | Time: 1650.58 ms [2022-02-28 09:10:12 main:574] : INFO : Epoch 1704 | loss: 0.0311061 | val_loss: 0.03113 | Time: 1640.14 ms [2022-02-28 09:10:14 main:574] : INFO : Epoch 1705 | loss: 0.0311074 | val_loss: 0.0311312 | Time: 1628.06 ms [2022-02-28 09:10:15 main:574] : INFO : Epoch 1706 | loss: 0.0311154 | val_loss: 0.0311347 | Time: 1644.49 ms [2022-02-28 09:10:17 main:574] : INFO : Epoch 1707 | loss: 0.0311167 | val_loss: 0.0311328 | Time: 1624.01 ms [2022-02-28 09:10:19 main:574] : INFO : Epoch 1708 | loss: 0.0311105 | val_loss: 0.0311323 | Time: 1656.97 ms [2022-02-28 09:10:20 main:574] : INFO : Epoch 1709 | loss: 0.0311095 | val_loss: 0.0311329 | Time: 1654.7 ms [2022-02-28 09:10:22 main:574] : INFO : Epoch 1710 | loss: 0.031108 | val_loss: 0.0311306 | Time: 1645.17 ms [2022-02-28 09:10:24 main:574] : INFO : Epoch 1711 | loss: 0.0311085 | val_loss: 0.0311313 | Time: 1652.46 ms [2022-02-28 09:10:25 main:574] : INFO : Epoch 1712 | loss: 0.0311076 | val_loss: 0.031131 | Time: 1641.92 ms [2022-02-28 09:10:27 main:574] : INFO : Epoch 1713 | loss: 0.0311163 | val_loss: 0.0311357 | Time: 1630.96 ms [2022-02-28 09:10:28 main:574] : INFO : Epoch 1714 | loss: 0.0311666 | val_loss: 0.0356192 | Time: 1653.15 ms [2022-02-28 09:10:30 main:574] : INFO : Epoch 1715 | loss: 0.0334347 | val_loss: 0.0342771 | Time: 1645.62 ms [2022-02-28 09:10:32 main:574] : INFO : Epoch 1716 | loss: 0.0316937 | val_loss: 0.0312763 | Time: 1652.58 ms [2022-02-28 09:10:33 main:574] : INFO : Epoch 1717 | loss: 0.031189 | val_loss: 0.0311495 | Time: 1654.46 ms [2022-02-28 09:10:35 main:574] : INFO : Epoch 1718 | loss: 0.0311393 | val_loss: 0.0311382 | Time: 1640.56 ms [2022-02-28 09:10:37 main:574] : INFO : Epoch 1719 | loss: 0.0311277 | val_loss: 0.0311331 | Time: 1635.72 ms [2022-02-28 09:10:38 main:574] : INFO : Epoch 1720 | loss: 0.0311233 | val_loss: 0.0311322 | Time: 1647.57 ms [2022-02-28 09:10:40 main:574] : INFO : Epoch 1721 | loss: 0.0311227 | val_loss: 0.0311321 | Time: 1639.55 ms [2022-02-28 09:10:42 main:574] : INFO : Epoch 1722 | loss: 0.0311202 | val_loss: 0.0311364 | Time: 1652.25 ms [2022-02-28 09:10:43 main:574] : INFO : Epoch 1723 | loss: 0.0311187 | val_loss: 0.0311315 | Time: 1639.09 ms [2022-02-28 09:10:45 main:574] : INFO : Epoch 1724 | loss: 0.0311183 | val_loss: 0.0311301 | Time: 1642.98 ms [2022-02-28 09:10:47 main:574] : INFO : Epoch 1725 | loss: 0.0311248 | val_loss: 0.0311417 | Time: 1632.36 ms [2022-02-28 09:10:48 main:574] : INFO : Epoch 1726 | loss: 0.0311268 | val_loss: 0.0311365 | Time: 1638.02 ms [2022-02-28 09:10:50 main:574] : INFO : Epoch 1727 | loss: 0.0311241 | val_loss: 0.0311346 | Time: 1650.38 ms [2022-02-28 09:10:52 main:574] : INFO : Epoch 1728 | loss: 0.031134 | val_loss: 0.031144 | Time: 1649.46 ms [2022-02-28 09:10:53 main:574] : INFO : Epoch 1729 | loss: 0.0311407 | val_loss: 0.0311446 | Time: 1625.75 ms [2022-02-28 09:10:55 main:574] : INFO : Epoch 1730 | loss: 0.0311385 | val_loss: 0.0311427 | Time: 1641.18 ms [2022-02-28 09:10:56 main:574] : INFO : Epoch 1731 | loss: 0.0311355 | val_loss: 0.0311435 | Time: 1636.17 ms [2022-02-28 09:10:58 main:574] : INFO : Epoch 1732 | loss: 0.0311355 | val_loss: 0.0311444 | Time: 1639.03 ms [2022-02-28 09:11:00 main:574] : INFO : Epoch 1733 | loss: 0.0311366 | val_loss: 0.0311439 | Time: 1640.59 ms [2022-02-28 09:11:01 main:574] : INFO : Epoch 1734 | loss: 0.0311339 | val_loss: 0.0311382 | Time: 1652.01 ms [2022-02-28 09:11:03 main:574] : INFO : Epoch 1735 | loss: 0.0311299 | val_loss: 0.0311404 | Time: 1637.48 ms [2022-02-28 09:11:05 main:574] : INFO : Epoch 1736 | loss: 0.0311311 | val_loss: 0.0311413 | Time: 1640.82 ms [2022-02-28 09:11:06 main:574] : INFO : Epoch 1737 | loss: 0.0311284 | val_loss: 0.0311383 | Time: 1634.44 ms [2022-02-28 09:11:08 main:574] : INFO : Epoch 1738 | loss: 0.0311286 | val_loss: 0.03114 | Time: 1642.86 ms [2022-02-28 09:11:10 main:574] : INFO : Epoch 1739 | loss: 0.0311284 | val_loss: 0.0311375 | Time: 1661.33 ms [2022-02-28 09:11:11 main:574] : INFO : Epoch 1740 | loss: 0.0311269 | val_loss: 0.0311367 | Time: 1645.57 ms [2022-02-28 09:11:13 main:574] : INFO : Epoch 1741 | loss: 0.0311242 | val_loss: 0.0311335 | Time: 1638.68 ms [2022-02-28 09:11:15 main:574] : INFO : Epoch 1742 | loss: 0.0311233 | val_loss: 0.0311331 | Time: 1635.77 ms [2022-02-28 09:11:16 main:574] : INFO : Epoch 1743 | loss: 0.0311217 | val_loss: 0.031133 | Time: 1647.35 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 970) [2022-02-28 09:12:03 main:435] : INFO : Set logging level to 1 [2022-02-28 09:12:03 main:441] : INFO : Running in BOINC Client mode [2022-02-28 09:12:03 main:444] : INFO : Resolving all filenames [2022-02-28 09:12:03 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-28 09:12:03 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-28 09:12:03 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-28 09:12:03 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-28 09:12:03 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-28 09:12:03 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-28 09:12:03 main:474] : INFO : Configuration: [2022-02-28 09:12:03 main:475] : INFO : Model type: GRU [2022-02-28 09:12:03 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-28 09:12:03 main:477] : INFO : Max Epochs: 2048 [2022-02-28 09:12:03 main:478] : INFO : Batch Size: 128 [2022-02-28 09:12:03 main:479] : INFO : Learning Rate: 0.01 [2022-02-28 09:12:03 main:480] : INFO : Patience: 10 [2022-02-28 09:12:03 main:481] : INFO : Hidden Width: 12 [2022-02-28 09:12:03 main:482] : INFO : # Recurrent Layers: 4 [2022-02-28 09:12:03 main:483] : INFO : # Backend Layers: 4 [2022-02-28 09:12:03 main:484] : INFO : # Threads: 1 [2022-02-28 09:12:03 main:486] : INFO : Preparing Dataset [2022-02-28 09:12:03 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-28 09:12:03 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-28 09:12:04 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-28 09:12:04 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-28 09:12:05 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-28 09:12:05 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-28 09:12:05 main:494] : INFO : Creating Model [2022-02-28 09:12:05 main:507] : INFO : Preparing config file [2022-02-28 09:12:05 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-28 09:12:05 main:512] : INFO : Loading config [2022-02-28 09:12:05 main:514] : INFO : Loading state [2022-02-28 09:12:05 main:559] : INFO : Loading DataLoader into Memory [2022-02-28 09:12:05 main:562] : INFO : Starting Training [2022-02-28 09:12:07 main:574] : INFO : Epoch 1744 | loss: 0.031271 | val_loss: 0.0311599 | Time: 1832.74 ms [2022-02-28 09:12:09 main:574] : INFO : Epoch 1745 | loss: 0.0311372 | val_loss: 0.0311364 | Time: 1624.16 ms [2022-02-28 09:12:10 main:574] : INFO : Epoch 1746 | loss: 0.0311244 | val_loss: 0.0311353 | Time: 1634.2 ms [2022-02-28 09:12:12 main:574] : INFO : Epoch 1747 | loss: 0.0311208 | val_loss: 0.0311355 | Time: 1630.8 ms [2022-02-28 09:12:14 main:574] : INFO : Epoch 1748 | loss: 0.0311221 | val_loss: 0.0311371 | Time: 1627.23 ms [2022-02-28 09:12:15 main:574] : INFO : Epoch 1749 | loss: 0.0311221 | val_loss: 0.031138 | Time: 1638.69 ms [2022-02-28 09:12:17 main:574] : INFO : Epoch 1750 | loss: 0.0311234 | val_loss: 0.0311384 | Time: 1628.45 ms [2022-02-28 09:12:18 main:574] : INFO : Epoch 1751 | loss: 0.0311255 | val_loss: 0.0311403 | Time: 1643.18 ms [2022-02-28 09:12:20 main:574] : INFO : Epoch 1752 | loss: 0.0311232 | val_loss: 0.031142 | Time: 1661.28 ms [2022-02-28 09:12:22 main:574] : INFO : Epoch 1753 | loss: 0.0311217 | val_loss: 0.031142 | Time: 1633.55 ms [2022-02-28 09:12:23 main:574] : INFO : Epoch 1754 | loss: 0.0311231 | val_loss: 0.0311455 | Time: 1639.92 ms [2022-02-28 09:12:25 main:574] : INFO : Epoch 1755 | loss: 0.0311247 | val_loss: 0.0311488 | Time: 1630.87 ms [2022-02-28 09:12:27 main:574] : INFO : Epoch 1756 | loss: 0.0311281 | val_loss: 0.0311405 | Time: 1633.37 ms [2022-02-28 09:12:28 main:574] : INFO : Epoch 1757 | loss: 0.0311264 | val_loss: 0.0311435 | Time: 1643.03 ms [2022-02-28 09:12:30 main:574] : INFO : Epoch 1758 | loss: 0.0311284 | val_loss: 0.0311367 | Time: 1653.36 ms [2022-02-28 09:12:32 main:574] : INFO : Epoch 1759 | loss: 0.0311241 | val_loss: 0.0311369 | Time: 1628.66 ms [2022-02-28 09:12:33 main:574] : INFO : Epoch 1760 | loss: 0.0311199 | val_loss: 0.0311384 | Time: 1643.06 ms [2022-02-28 09:12:35 main:574] : INFO : Epoch 1761 | loss: 0.0311203 | val_loss: 0.0311369 | Time: 1646.71 ms [2022-02-28 09:12:37 main:574] : INFO : Epoch 1762 | loss: 0.0311211 | val_loss: 0.0311373 | Time: 1635.33 ms [2022-02-28 09:12:38 main:574] : INFO : Epoch 1763 | loss: 0.031121 | val_loss: 0.0311406 | Time: 1637.09 ms [2022-02-28 09:12:40 main:574] : INFO : Epoch 1764 | loss: 0.0311232 | val_loss: 0.0311427 | Time: 1659.35 ms [2022-02-28 09:12:42 main:574] : INFO : Epoch 1765 | loss: 0.0311213 | val_loss: 0.0311416 | Time: 1637.13 ms [2022-02-28 09:12:43 main:574] : INFO : Epoch 1766 | loss: 0.0311261 | val_loss: 0.0311455 | Time: 1633.05 ms [2022-02-28 09:12:45 main:574] : INFO : Epoch 1767 | loss: 0.0311235 | val_loss: 0.0311412 | Time: 1628.08 ms [2022-02-28 09:12:46 main:574] : INFO : Epoch 1768 | loss: 0.0311215 | val_loss: 0.0311361 | Time: 1638.88 ms [2022-02-28 09:12:48 main:574] : INFO : Epoch 1769 | loss: 0.0311218 | val_loss: 0.0311502 | Time: 1641.71 ms [2022-02-28 09:12:50 main:574] : INFO : Epoch 1770 | loss: 0.0311315 | val_loss: 0.0311458 | Time: 1639.29 ms [2022-02-28 09:12:51 main:574] : INFO : Epoch 1771 | loss: 0.031132 | val_loss: 0.031149 | Time: 1641.38 ms [2022-02-28 09:12:53 main:574] : INFO : Epoch 1772 | loss: 0.0311346 | val_loss: 0.0311523 | Time: 1638.87 ms [2022-02-28 09:12:55 main:574] : INFO : Epoch 1773 | loss: 0.0311366 | val_loss: 0.0311543 | Time: 1625.56 ms [2022-02-28 09:12:56 main:574] : INFO : Epoch 1774 | loss: 0.0311342 | val_loss: 0.0311485 | Time: 1634.66 ms [2022-02-28 09:12:58 main:574] : INFO : Epoch 1775 | loss: 0.0311313 | val_loss: 0.0311488 | Time: 1635.93 ms [2022-02-28 09:13:00 main:574] : INFO : Epoch 1776 | loss: 0.0311283 | val_loss: 0.0311467 | Time: 1652.64 ms [2022-02-28 09:13:01 main:574] : INFO : Epoch 1777 | loss: 0.0311279 | val_loss: 0.03115 | Time: 1651.07 ms [2022-02-28 09:13:03 main:574] : INFO : Epoch 1778 | loss: 0.0311299 | val_loss: 0.031149 | Time: 1634.28 ms [2022-02-28 09:13:05 main:574] : INFO : Epoch 1779 | loss: 0.0311327 | val_loss: 0.0311504 | Time: 1640.98 ms [2022-02-28 09:13:06 main:574] : INFO : Epoch 1780 | loss: 0.0311322 | val_loss: 0.0311522 | Time: 1639.12 ms [2022-02-28 09:13:08 main:574] : INFO : Epoch 1781 | loss: 0.0311329 | val_loss: 0.0311504 | Time: 1635.38 ms [2022-02-28 09:13:09 main:574] : INFO : Epoch 1782 | loss: 0.0311308 | val_loss: 0.031149 | Time: 1646.49 ms [2022-02-28 09:13:11 main:574] : INFO : Epoch 1783 | loss: 0.0311301 | val_loss: 0.0311468 | Time: 1637.44 ms [2022-02-28 09:13:13 main:574] : INFO : Epoch 1784 | loss: 0.0311303 | val_loss: 0.0311502 | Time: 1638.16 ms [2022-02-28 09:13:14 main:574] : INFO : Epoch 1785 | loss: 0.0311326 | val_loss: 0.0311495 | Time: 1627.02 ms [2022-02-28 09:13:16 main:574] : INFO : Epoch 1786 | loss: 0.0311352 | val_loss: 0.0311511 | Time: 1646.89 ms [2022-02-28 09:13:18 main:574] : INFO : Epoch 1787 | loss: 0.0311334 | val_loss: 0.0311478 | Time: 1643.7 ms [2022-02-28 09:13:19 main:574] : INFO : Epoch 1788 | loss: 0.0311302 | val_loss: 0.0311434 | Time: 1657.32 ms [2022-02-28 09:13:21 main:574] : INFO : Epoch 1789 | loss: 0.0311297 | val_loss: 0.0311446 | Time: 1649.87 ms [2022-02-28 09:13:23 main:574] : INFO : Epoch 1790 | loss: 0.0311281 | val_loss: 0.0311445 | Time: 1655.76 ms [2022-02-28 09:13:24 main:574] : INFO : Epoch 1791 | loss: 0.0311282 | val_loss: 0.0311475 | Time: 1630.7 ms [2022-02-28 09:13:26 main:574] : INFO : Epoch 1792 | loss: 0.0311267 | val_loss: 0.0311443 | Time: 1637.53 ms [2022-02-28 09:13:28 main:574] : INFO : Epoch 1793 | loss: 0.0311266 | val_loss: 0.0311466 | Time: 1635.54 ms [2022-02-28 09:13:29 main:574] : INFO : Epoch 1794 | loss: 0.0311252 | val_loss: 0.0311473 | Time: 1655.54 ms [2022-02-28 09:13:31 main:574] : INFO : Epoch 1795 | loss: 0.0311264 | val_loss: 0.0311454 | Time: 1657.4 ms [2022-02-28 09:13:33 main:574] : INFO : Epoch 1796 | loss: 0.031124 | val_loss: 0.0311426 | Time: 1633.14 ms [2022-02-28 09:13:34 main:574] : INFO : Epoch 1797 | loss: 0.0311233 | val_loss: 0.0311435 | Time: 1640.15 ms [2022-02-28 09:13:36 main:574] : INFO : Epoch 1798 | loss: 0.031123 | val_loss: 0.031145 | Time: 1639.3 ms [2022-02-28 09:13:37 main:574] : INFO : Epoch 1799 | loss: 0.0311225 | val_loss: 0.031142 | Time: 1642.61 ms [2022-02-28 09:13:39 main:574] : INFO : Epoch 1800 | loss: 0.0311217 | val_loss: 0.0311399 | Time: 1646.09 ms [2022-02-28 09:13:41 main:574] : INFO : Epoch 1801 | loss: 0.031123 | val_loss: 0.0311409 | Time: 1652.4 ms [2022-02-28 09:13:42 main:574] : INFO : Epoch 1802 | loss: 0.0311235 | val_loss: 0.0311419 | Time: 1637.11 ms [2022-02-28 09:13:44 main:574] : INFO : Epoch 1803 | loss: 0.0311238 | val_loss: 0.0311416 | Time: 1637.13 ms [2022-02-28 09:13:46 main:574] : INFO : Epoch 1804 | loss: 0.0311273 | val_loss: 0.031148 | Time: 1636.46 ms [2022-02-28 09:13:47 main:574] : INFO : Epoch 1805 | loss: 0.0311367 | val_loss: 0.0311482 | Time: 1638.09 ms [2022-02-28 09:13:49 main:574] : INFO : Epoch 1806 | loss: 0.0311334 | val_loss: 0.0311419 | Time: 1640.41 ms [2022-02-28 09:13:51 main:574] : INFO : Epoch 1807 | loss: 0.0311312 | val_loss: 0.0311419 | Time: 1644.61 ms [2022-02-28 09:13:52 main:574] : INFO : Epoch 1808 | loss: 0.0311316 | val_loss: 0.0311426 | Time: 1641.24 ms [2022-02-28 09:13:54 main:574] : INFO : Epoch 1809 | loss: 0.0311297 | val_loss: 0.0311434 | Time: 1636.72 ms [2022-02-28 09:13:56 main:574] : INFO : Epoch 1810 | loss: 0.0311296 | val_loss: 0.0311457 | Time: 1637.81 ms [2022-02-28 09:13:57 main:574] : INFO : Epoch 1811 | loss: 0.031134 | val_loss: 0.0311407 | Time: 1641.53 ms [2022-02-28 09:13:59 main:574] : INFO : Epoch 1812 | loss: 0.0311325 | val_loss: 0.0311398 | Time: 1643.73 ms [2022-02-28 09:14:01 main:574] : INFO : Epoch 1813 | loss: 0.0311314 | val_loss: 0.0311402 | Time: 1652.34 ms [2022-02-28 09:14:02 main:574] : INFO : Epoch 1814 | loss: 0.0311326 | val_loss: 0.0311377 | Time: 1633.93 ms [2022-02-28 09:14:04 main:574] : INFO : Epoch 1815 | loss: 0.0311311 | val_loss: 0.031137 | Time: 1636.83 ms [2022-02-28 09:14:05 main:574] : INFO : Epoch 1816 | loss: 0.031128 | val_loss: 0.0311364 | Time: 1640.22 ms [2022-02-28 09:14:07 main:574] : INFO : Epoch 1817 | loss: 0.0311277 | val_loss: 0.0311396 | Time: 1630.95 ms [2022-02-28 09:14:09 main:574] : INFO : Epoch 1818 | loss: 0.0311257 | val_loss: 0.0311402 | Time: 1647.23 ms [2022-02-28 09:14:10 main:574] : INFO : Epoch 1819 | loss: 0.031126 | val_loss: 0.0311399 | Time: 1652.41 ms [2022-02-28 09:14:12 main:574] : INFO : Epoch 1820 | loss: 0.0311246 | val_loss: 0.031139 | Time: 1637.19 ms [2022-02-28 09:14:14 main:574] : INFO : Epoch 1821 | loss: 0.0311238 | val_loss: 0.0311384 | Time: 1632.51 ms [2022-02-28 09:14:15 main:574] : INFO : Epoch 1822 | loss: 0.0311252 | val_loss: 0.0311397 | Time: 1638.57 ms [2022-02-28 09:14:17 main:574] : INFO : Epoch 1823 | loss: 0.0311244 | val_loss: 0.0311438 | Time: 1631.49 ms [2022-02-28 09:14:19 main:574] : INFO : Epoch 1824 | loss: 0.0311269 | val_loss: 0.0311396 | Time: 1639.53 ms [2022-02-28 09:14:20 main:574] : INFO : Epoch 1825 | loss: 0.0311249 | val_loss: 0.0311375 | Time: 1652.85 ms [2022-02-28 09:14:22 main:574] : INFO : Epoch 1826 | loss: 0.0311239 | val_loss: 0.0311435 | Time: 1627.07 ms [2022-02-28 09:14:24 main:574] : INFO : Epoch 1827 | loss: 0.0311257 | val_loss: 0.0311424 | Time: 1641.44 ms [2022-02-28 09:14:25 main:574] : INFO : Epoch 1828 | loss: 0.0311249 | val_loss: 0.0311401 | Time: 1645.81 ms [2022-02-28 09:14:27 main:574] : INFO : Epoch 1829 | loss: 0.0311238 | val_loss: 0.0311398 | Time: 1637.82 ms [2022-02-28 09:14:29 main:574] : INFO : Epoch 1830 | loss: 0.031126 | val_loss: 0.0311477 | Time: 1642.18 ms [2022-02-28 09:14:30 main:574] : INFO : Epoch 1831 | loss: 0.0311263 | val_loss: 0.0311436 | Time: 1659.11 ms [2022-02-28 09:14:32 main:574] : INFO : Epoch 1832 | loss: 0.0311247 | val_loss: 0.0311423 | Time: 1635.45 ms [2022-02-28 09:14:33 main:574] : INFO : Epoch 1833 | loss: 0.0311249 | val_loss: 0.0311409 | Time: 1634.75 ms [2022-02-28 09:14:35 main:574] : INFO : Epoch 1834 | loss: 0.0311276 | val_loss: 0.0311423 | Time: 1635.83 ms [2022-02-28 09:14:37 main:574] : INFO : Epoch 1835 | loss: 0.0311219 | val_loss: 0.0311444 | Time: 1640.92 ms [2022-02-28 09:14:38 main:574] : INFO : Epoch 1836 | loss: 0.0311186 | val_loss: 0.0311424 | Time: 1643.28 ms [2022-02-28 09:14:40 main:574] : INFO : Epoch 1837 | loss: 0.0311201 | val_loss: 0.0311495 | Time: 1646.75 ms [2022-02-28 09:14:42 main:574] : INFO : Epoch 1838 | loss: 0.0311199 | val_loss: 0.0311464 | Time: 1642.96 ms [2022-02-28 09:14:43 main:574] : INFO : Epoch 1839 | loss: 0.0311235 | val_loss: 0.031144 | Time: 1638.6 ms [2022-02-28 09:14:45 main:574] : INFO : Epoch 1840 | loss: 0.0311224 | val_loss: 0.0311429 | Time: 1629.61 ms [2022-02-28 09:14:47 main:574] : INFO : Epoch 1841 | loss: 0.0311235 | val_loss: 0.0311406 | Time: 1644.8 ms [2022-02-28 09:14:48 main:574] : INFO : Epoch 1842 | loss: 0.0311227 | val_loss: 0.0311426 | Time: 1660.17 ms [2022-02-28 09:14:50 main:574] : INFO : Epoch 1843 | loss: 0.0311232 | val_loss: 0.031142 | Time: 1649.31 ms [2022-02-28 09:14:52 main:574] : INFO : Epoch 1844 | loss: 0.0311198 | val_loss: 0.0311415 | Time: 1642.73 ms [2022-02-28 09:14:53 main:574] : INFO : Epoch 1845 | loss: 0.03112 | val_loss: 0.0311413 | Time: 1641.32 ms [2022-02-28 09:14:55 main:574] : INFO : Epoch 1846 | loss: 0.0311245 | val_loss: 0.0311446 | Time: 1634.75 ms [2022-02-28 09:14:57 main:574] : INFO : Epoch 1847 | loss: 0.0311253 | val_loss: 0.0311481 | Time: 1639.12 ms [2022-02-28 09:14:58 main:574] : INFO : Epoch 1848 | loss: 0.0311225 | val_loss: 0.0311401 | Time: 1651.92 ms [2022-02-28 09:15:00 main:574] : INFO : Epoch 1849 | loss: 0.0311235 | val_loss: 0.0311397 | Time: 1645.12 ms [2022-02-28 09:15:02 main:574] : INFO : Epoch 1850 | loss: 0.0311248 | val_loss: 0.0311367 | Time: 1663.7 ms [2022-02-28 09:15:03 main:574] : INFO : Epoch 1851 | loss: 0.0311232 | val_loss: 0.0311362 | Time: 1644.88 ms [2022-02-28 09:15:05 main:574] : INFO : Epoch 1852 | loss: 0.0311221 | val_loss: 0.0311363 | Time: 1636.04 ms [2022-02-28 09:15:06 main:574] : INFO : Epoch 1853 | loss: 0.031121 | val_loss: 0.0311342 | Time: 1646.03 ms [2022-02-28 09:15:08 main:574] : INFO : Epoch 1854 | loss: 0.0311171 | val_loss: 0.0311328 | Time: 1647.18 ms [2022-02-28 09:15:10 main:574] : INFO : Epoch 1855 | loss: 0.0311162 | val_loss: 0.0311333 | Time: 1647.84 ms [2022-02-28 09:15:11 main:574] : INFO : Epoch 1856 | loss: 0.0311134 | val_loss: 0.0311283 | Time: 1641.73 ms [2022-02-28 09:15:13 main:574] : INFO : Epoch 1857 | loss: 0.0311146 | val_loss: 0.0311303 | Time: 1643.39 ms [2022-02-28 09:15:15 main:574] : INFO : Epoch 1858 | loss: 0.0311153 | val_loss: 0.0311302 | Time: 1628.46 ms [2022-02-28 09:15:16 main:574] : INFO : Epoch 1859 | loss: 0.0311147 | val_loss: 0.0311346 | Time: 1638.96 ms [2022-02-28 09:15:18 main:574] : INFO : Epoch 1860 | loss: 0.031117 | val_loss: 0.0311325 | Time: 1643.48 ms [2022-02-28 09:15:20 main:574] : INFO : Epoch 1861 | loss: 0.0311202 | val_loss: 0.0311336 | Time: 1652.91 ms [2022-02-28 09:15:21 main:574] : INFO : Epoch 1862 | loss: 0.0311182 | val_loss: 0.0311352 | Time: 1656.99 ms [2022-02-28 09:15:23 main:574] : INFO : Epoch 1863 | loss: 0.0311186 | val_loss: 0.0311346 | Time: 1656.39 ms [2022-02-28 09:15:25 main:574] : INFO : Epoch 1864 | loss: 0.0311164 | val_loss: 0.0311398 | Time: 1644.02 ms [2022-02-28 09:15:26 main:574] : INFO : Epoch 1865 | loss: 0.0311183 | val_loss: 0.0311342 | Time: 1644.28 ms [2022-02-28 09:15:28 main:574] : INFO : Epoch 1866 | loss: 0.0311198 | val_loss: 0.0311411 | Time: 1645.69 ms [2022-02-28 09:15:30 main:574] : INFO : Epoch 1867 | loss: 0.0311268 | val_loss: 0.0311426 | Time: 1642.31 ms [2022-02-28 09:15:31 main:574] : INFO : Epoch 1868 | loss: 0.0311278 | val_loss: 0.0311424 | Time: 1651.03 ms [2022-02-28 09:15:33 main:574] : INFO : Epoch 1869 | loss: 0.031129 | val_loss: 0.0311435 | Time: 1638.21 ms [2022-02-28 09:15:35 main:574] : INFO : Epoch 1870 | loss: 0.031127 | val_loss: 0.0311417 | Time: 1634.31 ms [2022-02-28 09:15:36 main:574] : INFO : Epoch 1871 | loss: 0.0311271 | val_loss: 0.0311431 | Time: 1634.34 ms [2022-02-28 09:15:38 main:574] : INFO : Epoch 1872 | loss: 0.0311267 | val_loss: 0.0311459 | Time: 1631.84 ms [2022-02-28 09:15:39 main:574] : INFO : Epoch 1873 | loss: 0.0311245 | val_loss: 0.0311427 | Time: 1642.46 ms [2022-02-28 09:15:41 main:574] : INFO : Epoch 1874 | loss: 0.0311234 | val_loss: 0.0311422 | Time: 1653.81 ms [2022-02-28 09:15:43 main:574] : INFO : Epoch 1875 | loss: 0.0311233 | val_loss: 0.0311414 | Time: 1636.1 ms [2022-02-28 09:15:44 main:574] : INFO : Epoch 1876 | loss: 0.031122 | val_loss: 0.0311404 | Time: 1630.48 ms [2022-02-28 09:15:46 main:574] : INFO : Epoch 1877 | loss: 0.0311214 | val_loss: 0.0311377 | Time: 1638.45 ms [2022-02-28 09:15:48 main:574] : INFO : Epoch 1878 | loss: 0.0311223 | val_loss: 0.0311411 | Time: 1639.66 ms [2022-02-28 09:15:49 main:574] : INFO : Epoch 1879 | loss: 0.0311214 | val_loss: 0.0311372 | Time: 1645.62 ms [2022-02-28 09:15:51 main:574] : INFO : Epoch 1880 | loss: 0.0311195 | val_loss: 0.0311422 | Time: 1653.36 ms [2022-02-28 09:15:53 main:574] : INFO : Epoch 1881 | loss: 0.0311205 | val_loss: 0.0311441 | Time: 1644.86 ms [2022-02-28 09:15:54 main:574] : INFO : Epoch 1882 | loss: 0.0311255 | val_loss: 0.0311419 | Time: 1639.88 ms [2022-02-28 09:15:56 main:574] : INFO : Epoch 1883 | loss: 0.0311278 | val_loss: 0.0311419 | Time: 1637.72 ms [2022-02-28 09:15:58 main:574] : INFO : Epoch 1884 | loss: 0.0311237 | val_loss: 0.0311439 | Time: 1642.71 ms [2022-02-28 09:15:59 main:574] : INFO : Epoch 1885 | loss: 0.0311215 | val_loss: 0.0311407 | Time: 1652.82 ms [2022-02-28 09:16:01 main:574] : INFO : Epoch 1886 | loss: 0.0311203 | val_loss: 0.0311366 | Time: 1652.75 ms [2022-02-28 09:16:03 main:574] : INFO : Epoch 1887 | loss: 0.0311194 | val_loss: 0.0311334 | Time: 1641.6 ms [2022-02-28 09:16:04 main:574] : INFO : Epoch 1888 | loss: 0.0311197 | val_loss: 0.0311403 | Time: 1641.1 ms [2022-02-28 09:16:06 main:574] : INFO : Epoch 1889 | loss: 0.0311222 | val_loss: 0.03114 | Time: 1639.72 ms [2022-02-28 09:16:07 main:574] : INFO : Epoch 1890 | loss: 0.0311294 | val_loss: 0.0311391 | Time: 1639.4 ms [2022-02-28 09:16:09 main:574] : INFO : Epoch 1891 | loss: 0.031127 | val_loss: 0.0311353 | Time: 1648.05 ms [2022-02-28 09:16:11 main:574] : INFO : Epoch 1892 | loss: 0.0311251 | val_loss: 0.0311378 | Time: 1654.77 ms [2022-02-28 09:16:12 main:574] : INFO : Epoch 1893 | loss: 0.0311259 | val_loss: 0.0311383 | Time: 1637.98 ms [2022-02-28 09:16:14 main:574] : INFO : Epoch 1894 | loss: 0.0311261 | val_loss: 0.031135 | Time: 1638.27 ms [2022-02-28 09:16:16 main:574] : INFO : Epoch 1895 | loss: 0.031126 | val_loss: 0.0311369 | Time: 1637.12 ms [2022-02-28 09:16:17 main:574] : INFO : Epoch 1896 | loss: 0.0311246 | val_loss: 0.0311383 | Time: 1637.51 ms [2022-02-28 09:16:19 main:574] : INFO : Epoch 1897 | loss: 0.0311317 | val_loss: 0.0311478 | Time: 1664.28 ms [2022-02-28 09:16:21 main:574] : INFO : Epoch 1898 | loss: 0.0311334 | val_loss: 0.0311418 | Time: 1658.35 ms [2022-02-28 09:16:22 main:574] : INFO : Epoch 1899 | loss: 0.0311254 | val_loss: 0.0311363 | Time: 1649.99 ms [2022-02-28 09:16:24 main:574] : INFO : Epoch 1900 | loss: 0.0311212 | val_loss: 0.031134 | Time: 1646.9 ms [2022-02-28 09:16:26 main:574] : INFO : Epoch 1901 | loss: 0.0311204 | val_loss: 0.031134 | Time: 1634.81 ms [2022-02-28 09:16:27 main:574] : INFO : Epoch 1902 | loss: 0.0311173 | val_loss: 0.031135 | Time: 1639.49 ms [2022-02-28 09:16:29 main:574] : INFO : Epoch 1903 | loss: 0.0311202 | val_loss: 0.0311389 | Time: 1644.9 ms [2022-02-28 09:16:31 main:574] : INFO : Epoch 1904 | loss: 0.0311225 | val_loss: 0.0311411 | Time: 1653.35 ms [2022-02-28 09:16:32 main:574] : INFO : Epoch 1905 | loss: 0.0311247 | val_loss: 0.0311436 | Time: 1632.45 ms [2022-02-28 09:16:34 main:574] : INFO : Epoch 1906 | loss: 0.0311259 | val_loss: 0.0311447 | Time: 1647.8 ms [2022-02-28 09:16:36 main:574] : INFO : Epoch 1907 | loss: 0.031126 | val_loss: 0.0311458 | Time: 1630.65 ms [2022-02-28 09:16:37 main:574] : INFO : Epoch 1908 | loss: 0.0311242 | val_loss: 0.0311446 | Time: 1636.6 ms [2022-02-28 09:16:39 main:574] : INFO : Epoch 1909 | loss: 0.0311241 | val_loss: 0.0311465 | Time: 1645.68 ms [2022-02-28 09:16:41 main:574] : INFO : Epoch 1910 | loss: 0.0311224 | val_loss: 0.0311429 | Time: 1651.99 ms [2022-02-28 09:16:42 main:574] : INFO : Epoch 1911 | loss: 0.0311214 | val_loss: 0.0311426 | Time: 1635.62 ms [2022-02-28 09:16:44 main:574] : INFO : Epoch 1912 | loss: 0.0311207 | val_loss: 0.0311435 | Time: 1636 ms [2022-02-28 09:16:45 main:574] : INFO : Epoch 1913 | loss: 0.0311197 | val_loss: 0.0311426 | Time: 1636.02 ms [2022-02-28 09:16:47 main:574] : INFO : Epoch 1914 | loss: 0.031119 | val_loss: 0.0311429 | Time: 1638.1 ms [2022-02-28 09:16:49 main:574] : INFO : Epoch 1915 | loss: 0.0311208 | val_loss: 0.0311433 | Time: 1641.18 ms [2022-02-28 09:16:50 main:574] : INFO : Epoch 1916 | loss: 0.0311189 | val_loss: 0.0311408 | Time: 1658.1 ms [2022-02-28 09:16:52 main:574] : INFO : Epoch 1917 | loss: 0.0311215 | val_loss: 0.0311416 | Time: 1629.99 ms [2022-02-28 09:16:54 main:574] : INFO : Epoch 1918 | loss: 0.031123 | val_loss: 0.031147 | Time: 1640.26 ms [2022-02-28 09:16:55 main:574] : INFO : Epoch 1919 | loss: 0.0311213 | val_loss: 0.031139 | Time: 1628.1 ms [2022-02-28 09:16:57 main:574] : INFO : Epoch 1920 | loss: 0.0311186 | val_loss: 0.0311396 | Time: 1641.81 ms [2022-02-28 09:16:59 main:574] : INFO : Epoch 1921 | loss: 0.0311179 | val_loss: 0.0311391 | Time: 1639.18 ms [2022-02-28 09:17:00 main:574] : INFO : Epoch 1922 | loss: 0.031117 | val_loss: 0.0311392 | Time: 1651.62 ms [2022-02-28 09:17:02 main:574] : INFO : Epoch 1923 | loss: 0.0311153 | val_loss: 0.031139 | Time: 1646.82 ms [2022-02-28 09:17:04 main:574] : INFO : Epoch 1924 | loss: 0.031116 | val_loss: 0.0311386 | Time: 1637.11 ms [2022-02-28 09:17:05 main:574] : INFO : Epoch 1925 | loss: 0.0311163 | val_loss: 0.0311356 | Time: 1633.82 ms [2022-02-28 09:17:07 main:574] : INFO : Epoch 1926 | loss: 0.0311164 | val_loss: 0.031139 | Time: 1638.88 ms [2022-02-28 09:17:08 main:574] : INFO : Epoch 1927 | loss: 0.0311168 | val_loss: 0.0311354 | Time: 1640.67 ms [2022-02-28 09:17:10 main:574] : INFO : Epoch 1928 | loss: 0.0311189 | val_loss: 0.0311361 | Time: 1645.28 ms [2022-02-28 09:17:12 main:574] : INFO : Epoch 1929 | loss: 0.0311195 | val_loss: 0.0311308 | Time: 1642.54 ms [2022-02-28 09:17:13 main:574] : INFO : Epoch 1930 | loss: 0.031119 | val_loss: 0.0311312 | Time: 1635.76 ms [2022-02-28 09:17:15 main:574] : INFO : Epoch 1931 | loss: 0.0311184 | val_loss: 0.0311337 | Time: 1636.65 ms [2022-02-28 09:17:17 main:574] : INFO : Epoch 1932 | loss: 0.0311241 | val_loss: 0.0311419 | Time: 1639.75 ms [2022-02-28 09:17:18 main:574] : INFO : Epoch 1933 | loss: 0.0311257 | val_loss: 0.0311409 | Time: 1640.66 ms [2022-02-28 09:17:20 main:574] : INFO : Epoch 1934 | loss: 0.0311274 | val_loss: 0.0311392 | Time: 1640.66 ms [2022-02-28 09:17:22 main:574] : INFO : Epoch 1935 | loss: 0.0311215 | val_loss: 0.0311344 | Time: 1659.02 ms [2022-02-28 09:17:23 main:574] : INFO : Epoch 1936 | loss: 0.0311163 | val_loss: 0.0311369 | Time: 1636 ms [2022-02-28 09:17:25 main:574] : INFO : Epoch 1937 | loss: 0.0311146 | val_loss: 0.031131 | Time: 1638.17 ms [2022-02-28 09:17:27 main:574] : INFO : Epoch 1938 | loss: 0.0311123 | val_loss: 0.0311324 | Time: 1640.83 ms [2022-02-28 09:17:28 main:574] : INFO : Epoch 1939 | loss: 0.0311109 | val_loss: 0.0311301 | Time: 1644.22 ms [2022-02-28 09:17:30 main:574] : INFO : Epoch 1940 | loss: 0.0311165 | val_loss: 0.03115 | Time: 1641.49 ms [2022-02-28 09:17:32 main:574] : INFO : Epoch 1941 | loss: 0.0311345 | val_loss: 0.0311494 | Time: 1651.28 ms [2022-02-28 09:17:33 main:574] : INFO : Epoch 1942 | loss: 0.0311294 | val_loss: 0.0311436 | Time: 1634.9 ms [2022-02-28 09:17:35 main:574] : INFO : Epoch 1943 | loss: 0.0311253 | val_loss: 0.0311369 | Time: 1639.67 ms [2022-02-28 09:17:36 main:574] : INFO : Epoch 1944 | loss: 0.0311227 | val_loss: 0.0311376 | Time: 1634.36 ms [2022-02-28 09:17:38 main:574] : INFO : Epoch 1945 | loss: 0.0311197 | val_loss: 0.0311335 | Time: 1648.22 ms [2022-02-28 09:17:40 main:574] : INFO : Epoch 1946 | loss: 0.0311176 | val_loss: 0.0311348 | Time: 1652.04 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 970) [2022-02-28 09:18:06 main:435] : INFO : Set logging level to 1 [2022-02-28 09:18:06 main:441] : INFO : Running in BOINC Client mode [2022-02-28 09:18:06 main:444] : INFO : Resolving all filenames [2022-02-28 09:18:06 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-02-28 09:18:06 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-02-28 09:18:06 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-02-28 09:18:06 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-02-28 09:18:06 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-02-28 09:18:06 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-02-28 09:18:06 main:474] : INFO : Configuration: [2022-02-28 09:18:06 main:475] : INFO : Model type: GRU [2022-02-28 09:18:06 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-02-28 09:18:06 main:477] : INFO : Max Epochs: 2048 [2022-02-28 09:18:06 main:478] : INFO : Batch Size: 128 [2022-02-28 09:18:06 main:479] : INFO : Learning Rate: 0.01 [2022-02-28 09:18:06 main:480] : INFO : Patience: 10 [2022-02-28 09:18:06 main:481] : INFO : Hidden Width: 12 [2022-02-28 09:18:06 main:482] : INFO : # Recurrent Layers: 4 [2022-02-28 09:18:06 main:483] : INFO : # Backend Layers: 4 [2022-02-28 09:18:06 main:484] : INFO : # Threads: 1 [2022-02-28 09:18:06 main:486] : INFO : Preparing Dataset [2022-02-28 09:18:06 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-02-28 09:18:06 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-02-28 09:18:08 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-02-28 09:18:08 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-02-28 09:18:08 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-02-28 09:18:08 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-02-28 09:18:08 main:494] : INFO : Creating Model [2022-02-28 09:18:08 main:507] : INFO : Preparing config file [2022-02-28 09:18:08 main:511] : INFO : Found checkpoint, attempting to load... [2022-02-28 09:18:08 main:512] : INFO : Loading config [2022-02-28 09:18:08 main:514] : INFO : Loading state [2022-02-28 09:18:08 main:559] : INFO : Loading DataLoader into Memory [2022-02-28 09:18:08 main:562] : INFO : Starting Training [2022-02-28 09:18:10 main:574] : INFO : Epoch 1943 | loss: 0.0311578 | val_loss: 0.0311438 | Time: 1833.96 ms [2022-02-28 09:18:12 main:574] : INFO : Epoch 1944 | loss: 0.031125 | val_loss: 0.031138 | Time: 1629.93 ms [2022-02-28 09:18:13 main:574] : INFO : Epoch 1945 | loss: 0.0311191 | val_loss: 0.0311404 | Time: 1625.33 ms [2022-02-28 09:18:15 main:574] : INFO : Epoch 1946 | loss: 0.0311191 | val_loss: 0.0311354 | Time: 1624.39 ms [2022-02-28 09:18:17 main:574] : INFO : Epoch 1947 | loss: 0.0311189 | val_loss: 0.0311321 | Time: 1628.99 ms [2022-02-28 09:18:18 main:574] : INFO : Epoch 1948 | loss: 0.0311177 | val_loss: 0.0311326 | Time: 1651.32 ms [2022-02-28 09:18:20 main:574] : INFO : Epoch 1949 | loss: 0.0311157 | val_loss: 0.0311323 | Time: 1635.6 ms [2022-02-28 09:18:22 main:574] : INFO : Epoch 1950 | loss: 0.031117 | val_loss: 0.0311311 | Time: 1646.72 ms [2022-02-28 09:18:23 main:574] : INFO : Epoch 1951 | loss: 0.0311147 | val_loss: 0.0311323 | Time: 1633.4 ms [2022-02-28 09:18:25 main:574] : INFO : Epoch 1952 | loss: 0.0311144 | val_loss: 0.0311305 | Time: 1636.03 ms [2022-02-28 09:18:27 main:574] : INFO : Epoch 1953 | loss: 0.0311138 | val_loss: 0.0311312 | Time: 1631.17 ms [2022-02-28 09:18:28 main:574] : INFO : Epoch 1954 | loss: 0.0311145 | val_loss: 0.0311289 | Time: 1646.84 ms [2022-02-28 09:18:30 main:574] : INFO : Epoch 1955 | loss: 0.0311172 | val_loss: 0.0311293 | Time: 1644.61 ms [2022-02-28 09:18:31 main:574] : INFO : Epoch 1956 | loss: 0.0311145 | val_loss: 0.031127 | Time: 1653.54 ms [2022-02-28 09:18:33 main:574] : INFO : Epoch 1957 | loss: 0.0311149 | val_loss: 0.0311298 | Time: 1632.48 ms [2022-02-28 09:18:35 main:574] : INFO : Epoch 1958 | loss: 0.0311162 | val_loss: 0.0311288 | Time: 1638.74 ms [2022-02-28 09:18:36 main:574] : INFO : Epoch 1959 | loss: 0.0311157 | val_loss: 0.0311288 | Time: 1633.05 ms [2022-02-28 09:18:38 main:574] : INFO : Epoch 1960 | loss: 0.0311128 | val_loss: 0.0311282 | Time: 1647.23 ms [2022-02-28 09:18:40 main:574] : INFO : Epoch 1961 | loss: 0.0311129 | val_loss: 0.031127 | Time: 1633.16 ms [2022-02-28 09:18:41 main:574] : INFO : Epoch 1962 | loss: 0.0311116 | val_loss: 0.0311266 | Time: 1651.78 ms [2022-02-28 09:18:43 main:574] : INFO : Epoch 1963 | loss: 0.0311105 | val_loss: 0.0311251 | Time: 1645.99 ms [2022-02-28 09:18:45 main:574] : INFO : Epoch 1964 | loss: 0.0311106 | val_loss: 0.031128 | Time: 1642.48 ms [2022-02-28 09:18:46 main:574] : INFO : Epoch 1965 | loss: 0.0311114 | val_loss: 0.0311281 | Time: 1643.26 ms [2022-02-28 09:18:48 main:574] : INFO : Epoch 1966 | loss: 0.031111 | val_loss: 0.0311288 | Time: 1641.94 ms [2022-02-28 09:18:50 main:574] : INFO : Epoch 1967 | loss: 0.0311115 | val_loss: 0.0311254 | Time: 1661.13 ms [2022-02-28 09:18:51 main:574] : INFO : Epoch 1968 | loss: 0.0311102 | val_loss: 0.0311284 | Time: 1655.6 ms [2022-02-28 09:18:53 main:574] : INFO : Epoch 1969 | loss: 0.0311117 | val_loss: 0.0311276 | Time: 1628.99 ms [2022-02-28 09:18:55 main:574] : INFO : Epoch 1970 | loss: 0.0311105 | val_loss: 0.0311307 | Time: 1642.09 ms [2022-02-28 09:18:56 main:574] : INFO : Epoch 1971 | loss: 0.0311111 | val_loss: 0.0311293 | Time: 1630.85 ms [2022-02-28 09:18:58 main:574] : INFO : Epoch 1972 | loss: 0.0311129 | val_loss: 0.0311285 | Time: 1646.82 ms [2022-02-28 09:18:59 main:574] : INFO : Epoch 1973 | loss: 0.0311117 | val_loss: 0.0311278 | Time: 1638.4 ms [2022-02-28 09:19:01 main:574] : INFO : Epoch 1974 | loss: 0.0311108 | val_loss: 0.0311302 | Time: 1657.55 ms [2022-02-28 09:19:03 main:574] : INFO : Epoch 1975 | loss: 0.0311121 | val_loss: 0.0311349 | Time: 1629.83 ms [2022-02-28 09:19:04 main:574] : INFO : Epoch 1976 | loss: 0.03112 | val_loss: 0.0311411 | Time: 1651.71 ms [2022-02-28 09:19:06 main:574] : INFO : Epoch 1977 | loss: 0.031118 | val_loss: 0.0311427 | Time: 1632.25 ms [2022-02-28 09:19:08 main:574] : INFO : Epoch 1978 | loss: 0.0311165 | val_loss: 0.0311401 | Time: 1642.72 ms [2022-02-28 09:19:09 main:574] : INFO : Epoch 1979 | loss: 0.0311145 | val_loss: 0.0311373 | Time: 1643.83 ms [2022-02-28 09:19:11 main:574] : INFO : Epoch 1980 | loss: 0.0311145 | val_loss: 0.0311429 | Time: 1650.67 ms [2022-02-28 09:19:13 main:574] : INFO : Epoch 1981 | loss: 0.0311218 | val_loss: 0.0311595 | Time: 1634.41 ms [2022-02-28 09:19:14 main:574] : INFO : Epoch 1982 | loss: 0.0311219 | val_loss: 0.0311438 | Time: 1640.83 ms [2022-02-28 09:19:16 main:574] : INFO : Epoch 1983 | loss: 0.0311155 | val_loss: 0.0311364 | Time: 1634.63 ms [2022-02-28 09:19:18 main:574] : INFO : Epoch 1984 | loss: 0.0311156 | val_loss: 0.0311364 | Time: 1637.96 ms [2022-02-28 09:19:19 main:574] : INFO : Epoch 1985 | loss: 0.0311211 | val_loss: 0.0311372 | Time: 1676.81 ms [2022-02-28 09:19:21 main:574] : INFO : Epoch 1986 | loss: 0.0311206 | val_loss: 0.0311405 | Time: 1721.7 ms [2022-02-28 09:19:23 main:574] : INFO : Epoch 1987 | loss: 0.0311286 | val_loss: 0.0311434 | Time: 1651.27 ms [2022-02-28 09:19:24 main:574] : INFO : Epoch 1988 | loss: 0.0311344 | val_loss: 0.0311471 | Time: 1645.83 ms [2022-02-28 09:19:26 main:574] : INFO : Epoch 1989 | loss: 0.0311348 | val_loss: 0.0311429 | Time: 1656.77 ms [2022-02-28 09:19:28 main:574] : INFO : Epoch 1990 | loss: 0.0311331 | val_loss: 0.0311409 | Time: 1639.46 ms [2022-02-28 09:19:29 main:574] : INFO : Epoch 1991 | loss: 0.0311319 | val_loss: 0.0311422 | Time: 1704.24 ms [2022-02-28 09:19:31 main:574] : INFO : Epoch 1992 | loss: 0.0311317 | val_loss: 0.0311463 | Time: 1670.84 ms [2022-02-28 09:19:33 main:574] : INFO : Epoch 1993 | loss: 0.0311282 | val_loss: 0.0311405 | Time: 1651.1 ms [2022-02-28 09:19:34 main:574] : INFO : Epoch 1994 | loss: 0.0311276 | val_loss: 0.0311419 | Time: 1658.15 ms [2022-02-28 09:19:36 main:574] : INFO : Epoch 1995 | loss: 0.0311272 | val_loss: 0.03114 | Time: 1654.12 ms [2022-02-28 09:19:38 main:574] : INFO : Epoch 1996 | loss: 0.0311272 | val_loss: 0.0311407 | Time: 1656.53 ms [2022-02-28 09:19:39 main:574] : INFO : Epoch 1997 | loss: 0.0311287 | val_loss: 0.0311394 | Time: 1671.24 ms [2022-02-28 09:19:41 main:574] : INFO : Epoch 1998 | loss: 0.0311337 | val_loss: 0.0311427 | Time: 1663.25 ms [2022-02-28 09:19:43 main:574] : INFO : Epoch 1999 | loss: 0.0311363 | val_loss: 0.0311456 | Time: 1663.21 ms [2022-02-28 09:19:44 main:574] : INFO : Epoch 2000 | loss: 0.0311416 | val_loss: 0.0311453 | Time: 1654.04 ms [2022-02-28 09:19:46 main:574] : INFO : Epoch 2001 | loss: 0.0311415 | val_loss: 0.0311499 | Time: 1670.46 ms [2022-02-28 09:19:48 main:574] : INFO : Epoch 2002 | loss: 0.0311389 | val_loss: 0.0311457 | Time: 1646.53 ms [2022-02-28 09:19:50 main:574] : INFO : Epoch 2003 | loss: 0.0311341 | val_loss: 0.0311452 | Time: 2013.68 ms [2022-02-28 09:19:52 main:574] : INFO : Epoch 2004 | loss: 0.031134 | val_loss: 0.0311385 | Time: 2312.31 ms [2022-02-28 09:19:54 main:574] : INFO : Epoch 2005 | loss: 0.0311305 | val_loss: 0.0311327 | Time: 1861.09 ms [2022-02-28 09:19:57 main:574] : INFO : Epoch 2006 | loss: 0.0311267 | val_loss: 0.0311349 | Time: 3378.92 ms [2022-02-28 09:20:01 main:574] : INFO : Epoch 2007 | loss: 0.0311259 | val_loss: 0.031132 | Time: 3396.64 ms [2022-02-28 09:20:13 main:574] : INFO : Epoch 2008 | loss: 0.0311238 | val_loss: 0.0311339 | Time: 11958.4 ms [2022-02-28 09:20:14 main:574] : INFO : Epoch 2009 | loss: 0.0311235 | val_loss: 0.0311339 | Time: 1638.63 ms [2022-02-28 09:20:16 main:574] : INFO : Epoch 2010 | loss: 0.0311234 | val_loss: 0.0311351 | Time: 1638.29 ms [2022-02-28 09:20:18 main:574] : INFO : Epoch 2011 | loss: 0.0311215 | val_loss: 0.0311329 | Time: 1640.88 ms [2022-02-28 09:20:19 main:574] : INFO : Epoch 2012 | loss: 0.0311258 | val_loss: 0.0311341 | Time: 1647.7 ms [2022-02-28 09:20:21 main:574] : INFO : Epoch 2013 | loss: 0.0311264 | val_loss: 0.0311377 | Time: 1653.44 ms [2022-02-28 09:20:23 main:574] : INFO : Epoch 2014 | loss: 0.0311261 | val_loss: 0.0311374 | Time: 1645.75 ms [2022-02-28 09:20:24 main:574] : INFO : Epoch 2015 | loss: 0.0311267 | val_loss: 0.0311362 | Time: 1641.34 ms [2022-02-28 09:20:26 main:574] : INFO : Epoch 2016 | loss: 0.0311321 | val_loss: 0.0311578 | Time: 1641.55 ms [2022-02-28 09:20:27 main:574] : INFO : Epoch 2017 | loss: 0.0311465 | val_loss: 0.0311661 | Time: 1635.93 ms [2022-02-28 09:20:29 main:574] : INFO : Epoch 2018 | loss: 0.031162 | val_loss: 0.0311675 | Time: 1640.28 ms [2022-02-28 09:20:31 main:574] : INFO : Epoch 2019 | loss: 0.0311626 | val_loss: 0.031165 | Time: 1650.48 ms [2022-02-28 09:20:32 main:574] : INFO : Epoch 2020 | loss: 0.0311574 | val_loss: 0.0311606 | Time: 1644.34 ms [2022-02-28 09:20:34 main:574] : INFO : Epoch 2021 | loss: 0.0311572 | val_loss: 0.0311596 | Time: 1646.97 ms [2022-02-28 09:20:36 main:574] : INFO : Epoch 2022 | loss: 0.0311573 | val_loss: 0.0311647 | Time: 1640.09 ms [2022-02-28 09:20:37 main:574] : INFO : Epoch 2023 | loss: 0.0311659 | val_loss: 0.0311763 | Time: 1634.46 ms [2022-02-28 09:20:39 main:574] : INFO : Epoch 2024 | loss: 0.0311722 | val_loss: 0.0311727 | Time: 1648.04 ms [2022-02-28 09:20:41 main:574] : INFO : Epoch 2025 | loss: 0.0311674 | val_loss: 0.0311697 | Time: 1640.72 ms [2022-02-28 09:20:42 main:574] : INFO : Epoch 2026 | loss: 0.0311638 | val_loss: 0.0311666 | Time: 1661.95 ms [2022-02-28 09:20:44 main:574] : INFO : Epoch 2027 | loss: 0.0311636 | val_loss: 0.03117 | Time: 1657.4 ms [2022-02-28 09:20:46 main:574] : INFO : Epoch 2028 | loss: 0.0311611 | val_loss: 0.0311601 | Time: 1648.61 ms [2022-02-28 09:20:47 main:574] : INFO : Epoch 2029 | loss: 0.0311588 | val_loss: 0.0311659 | Time: 1639.17 ms [2022-02-28 09:20:49 main:574] : INFO : Epoch 2030 | loss: 0.0311585 | val_loss: 0.0311612 | Time: 1670.2 ms [2022-02-28 09:20:51 main:574] : INFO : Epoch 2031 | loss: 0.0311571 | val_loss: 0.0311604 | Time: 1638.97 ms [2022-02-28 09:20:52 main:574] : INFO : Epoch 2032 | loss: 0.0311544 | val_loss: 0.0311572 | Time: 1648.23 ms [2022-02-28 09:20:54 main:574] : INFO : Epoch 2033 | loss: 0.0311595 | val_loss: 0.0311614 | Time: 1629.97 ms [2022-02-28 09:20:56 main:574] : INFO : Epoch 2034 | loss: 0.0311601 | val_loss: 0.0311551 | Time: 1634.81 ms [2022-02-28 09:20:57 main:574] : INFO : Epoch 2035 | loss: 0.0311599 | val_loss: 0.0311565 | Time: 1636.59 ms [2022-02-28 09:20:59 main:574] : INFO : Epoch 2036 | loss: 0.0311576 | val_loss: 0.031154 | Time: 1646.31 ms [2022-02-28 09:21:00 main:574] : INFO : Epoch 2037 | loss: 0.0311531 | val_loss: 0.0311528 | Time: 1641.65 ms [2022-02-28 09:21:02 main:574] : INFO : Epoch 2038 | loss: 0.0311513 | val_loss: 0.0311524 | Time: 1669.93 ms [2022-02-28 09:21:04 main:574] : INFO : Epoch 2039 | loss: 0.0311522 | val_loss: 0.0311565 | Time: 1635.91 ms [2022-02-28 09:21:05 main:574] : INFO : Epoch 2040 | loss: 0.0311518 | val_loss: 0.0311497 | Time: 1641.13 ms [2022-02-28 09:21:07 main:574] : INFO : Epoch 2041 | loss: 0.0311501 | val_loss: 0.0311501 | Time: 1637.02 ms [2022-02-28 09:21:09 main:574] : INFO : Epoch 2042 | loss: 0.0311482 | val_loss: 0.0311522 | Time: 1643.01 ms [2022-02-28 09:21:10 main:574] : INFO : Epoch 2043 | loss: 0.0311561 | val_loss: 0.0311566 | Time: 1643.41 ms [2022-02-28 09:21:12 main:574] : INFO : Epoch 2044 | loss: 0.0311535 | val_loss: 0.0311557 | Time: 1652.94 ms [2022-02-28 09:21:14 main:574] : INFO : Epoch 2045 | loss: 0.0311533 | val_loss: 0.0311559 | Time: 1647.46 ms [2022-02-28 09:21:15 main:574] : INFO : Epoch 2046 | loss: 0.0311557 | val_loss: 0.0311614 | Time: 1643.57 ms [2022-02-28 09:21:17 main:574] : INFO : Epoch 2047 | loss: 0.0311539 | val_loss: 0.0311539 | Time: 1651.28 ms [2022-02-28 09:21:19 main:574] : INFO : Epoch 2048 | loss: 0.0311498 | val_loss: 0.0311535 | Time: 1661.15 ms [2022-02-28 09:21:19 main:597] : INFO : Saving trained model to model-final.pt, val_loss 0.0311535 [2022-02-28 09:21:19 main:603] : INFO : Saving end state to config to file [2022-02-28 09:21:19 main:608] : INFO : Success, exiting.. 09:21:19 (4904): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)