Task 12956968
| Name | ParityModified-1647042270-22501-0_0 |
| Workunit | 10089259 |
| Created | 11 Mar 2022, 23:44:32 UTC |
| Sent | 14 Mar 2022, 20:40:09 UTC |
| Report deadline | 22 Mar 2022, 20:40:09 UTC |
| Received | 15 Mar 2022, 5:34:07 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 13797 |
| Run time | 1 hours 11 min 38 sec |
| CPU time | 1 hours 11 min 35 sec |
| Validate state | Valid |
| Credit | 4,160.00 |
| Device peak FLOPS | 5,488.38 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.80 (cuda10200) x86_64-pc-linux-gnu |
| Peak working set size | 2.32 GB |
| Peak swap size | 10.45 GB |
| Peak disk usage | 2.99 GB |
Stderr output
<core_client_version>7.14.2</core_client_version> <![CDATA[ <stderr_txt> -15 05:25:19 main:581] : INFO : Epoch 1591 | loss: 0.0311731 | val_loss: 0.0311955 | Time: 2252.46 ms [2022-03-15 05:25:21 main:581] : INFO : Epoch 1592 | loss: 0.0311696 | val_loss: 0.031192 | Time: 2053.8 ms [2022-03-15 05:25:23 main:581] : INFO : Epoch 1593 | loss: 0.0311683 | val_loss: 0.031197 | Time: 2045.53 ms [2022-03-15 05:25:25 main:581] : INFO : Epoch 1594 | loss: 0.0311874 | val_loss: 0.0312026 | Time: 2045.26 ms [2022-03-15 05:25:27 main:581] : INFO : Epoch 1595 | loss: 0.0311892 | val_loss: 0.0311896 | Time: 2069.92 ms [2022-03-15 05:25:29 main:581] : INFO : Epoch 1596 | loss: 0.0311816 | val_loss: 0.0311836 | Time: 2065.18 ms [2022-03-15 05:25:31 main:581] : INFO : Epoch 1597 | loss: 0.0311785 | val_loss: 0.0311835 | Time: 2066.96 ms [2022-03-15 05:25:33 main:581] : INFO : Epoch 1598 | loss: 0.0311755 | val_loss: 0.0311828 | Time: 2071.04 ms [2022-03-15 05:25:35 main:581] : INFO : Epoch 1599 | loss: 0.0311772 | val_loss: 0.0311907 | Time: 2088.18 ms [2022-03-15 05:25:37 main:581] : INFO : Epoch 1600 | loss: 0.0311755 | val_loss: 0.0311854 | Time: 2088.63 ms [2022-03-15 05:25:39 main:581] : INFO : Epoch 1601 | loss: 0.0311722 | val_loss: 0.0311865 | Time: 2051.02 ms [2022-03-15 05:25:41 main:581] : INFO : Epoch 1602 | loss: 0.0311739 | val_loss: 0.031191 | Time: 2086.95 ms [2022-03-15 05:25:43 main:581] : INFO : Epoch 1603 | loss: 0.0311748 | val_loss: 0.0311924 | Time: 2056.02 ms [2022-03-15 05:25:46 main:581] : INFO : Epoch 1604 | loss: 0.0311717 | val_loss: 0.0311855 | Time: 2085.09 ms [2022-03-15 05:25:48 main:581] : INFO : Epoch 1605 | loss: 0.0311677 | val_loss: 0.031185 | Time: 2047.09 ms [2022-03-15 05:25:50 main:581] : INFO : Epoch 1606 | loss: 0.0311655 | val_loss: 0.03119 | Time: 2043.13 ms [2022-03-15 05:25:52 main:581] : INFO : Epoch 1607 | loss: 0.0311662 | val_loss: 0.0311845 | Time: 2067.03 ms [2022-03-15 05:25:54 main:581] : INFO : Epoch 1608 | loss: 0.0311649 | val_loss: 0.0311974 | Time: 2069.24 ms [2022-03-15 05:25:56 main:581] : INFO : Epoch 1609 | loss: 0.0311668 | val_loss: 0.031195 | Time: 2088.51 ms [2022-03-15 05:25:58 main:581] : INFO : Epoch 1610 | loss: 0.0311663 | val_loss: 0.0311937 | Time: 2052.75 ms [2022-03-15 05:26:00 main:581] : INFO : Epoch 1611 | loss: 0.0311621 | val_loss: 0.0311881 | Time: 2048.41 ms [2022-03-15 05:26:02 main:581] : INFO : Epoch 1612 | loss: 0.0311599 | val_loss: 0.0311923 | Time: 2149.03 ms [2022-03-15 05:26:04 main:581] : INFO : Epoch 1613 | loss: 0.0311586 | val_loss: 0.0311887 | Time: 2138.83 ms [2022-03-15 05:26:06 main:581] : INFO : Epoch 1614 | loss: 0.0311586 | val_loss: 0.0311928 | Time: 2057.06 ms [2022-03-15 05:26:08 main:581] : INFO : Epoch 1615 | loss: 0.0311597 | val_loss: 0.031195 | Time: 2048.57 ms [2022-03-15 05:26:10 main:581] : INFO : Epoch 1616 | loss: 0.0311648 | val_loss: 0.0311898 | Time: 2042.55 ms [2022-03-15 05:26:12 main:581] : INFO : Epoch 1617 | loss: 0.0311604 | val_loss: 0.0311929 | Time: 2042.98 ms [2022-03-15 05:26:14 main:581] : INFO : Epoch 1618 | loss: 0.031157 | val_loss: 0.0311922 | Time: 2043.15 ms [2022-03-15 05:26:17 main:581] : INFO : Epoch 1619 | loss: 0.0311593 | val_loss: 0.0311989 | Time: 2042.22 ms [2022-03-15 05:26:19 main:581] : INFO : Epoch 1620 | loss: 0.031158 | val_loss: 0.0311904 | Time: 2122.18 ms [2022-03-15 05:26:21 main:581] : INFO : Epoch 1621 | loss: 0.0311554 | val_loss: 0.0311939 | Time: 2058.34 ms [2022-03-15 05:26:23 main:581] : INFO : Epoch 1622 | loss: 0.0311547 | val_loss: 0.031198 | Time: 2053.28 ms [2022-03-15 05:26:25 main:581] : INFO : Epoch 1623 | loss: 0.0311613 | val_loss: 0.0311922 | Time: 2105.03 ms [2022-03-15 05:26:27 main:581] : INFO : Epoch 1624 | loss: 0.0311639 | val_loss: 0.031194 | Time: 2066.51 ms [2022-03-15 05:26:29 main:581] : INFO : Epoch 1625 | loss: 0.0311604 | val_loss: 0.0311976 | Time: 2081.06 ms [2022-03-15 05:26:31 main:581] : INFO : Epoch 1626 | loss: 0.0311599 | val_loss: 0.0311934 | Time: 2058.78 ms [2022-03-15 05:26:33 main:581] : INFO : Epoch 1627 | loss: 0.0311561 | val_loss: 0.0312016 | Time: 2046.97 ms [2022-03-15 05:26:35 main:581] : INFO : Epoch 1628 | loss: 0.0311546 | val_loss: 0.0311996 | Time: 2043.28 ms [2022-03-15 05:26:37 main:581] : INFO : Epoch 1629 | loss: 0.0311494 | val_loss: 0.0311947 | Time: 2041.25 ms [2022-03-15 05:26:39 main:581] : INFO : Epoch 1630 | loss: 0.0311502 | val_loss: 0.0311969 | Time: 2041.93 ms [2022-03-15 05:26:41 main:581] : INFO : Epoch 1631 | loss: 0.0311485 | val_loss: 0.0311941 | Time: 2134.83 ms [2022-03-15 05:26:43 main:581] : INFO : Epoch 1632 | loss: 0.0311497 | val_loss: 0.0311914 | Time: 2068.09 ms [2022-03-15 05:26:46 main:581] : INFO : Epoch 1633 | loss: 0.0311519 | val_loss: 0.0311952 | Time: 2087.25 ms [2022-03-15 05:26:48 main:581] : INFO : Epoch 1634 | loss: 0.0311509 | val_loss: 0.0312034 | Time: 2056.98 ms [2022-03-15 05:26:50 main:581] : INFO : Epoch 1635 | loss: 0.0311526 | val_loss: 0.0311953 | Time: 2084.43 ms [2022-03-15 05:26:52 main:581] : INFO : Epoch 1636 | loss: 0.0311507 | val_loss: 0.0311921 | Time: 2047.19 ms [2022-03-15 05:26:54 main:581] : INFO : Epoch 1637 | loss: 0.0311489 | val_loss: 0.0311939 | Time: 2085.07 ms [2022-03-15 05:26:56 main:581] : INFO : Epoch 1638 | loss: 0.0311532 | val_loss: 0.0311991 | Time: 2049.73 ms [2022-03-15 05:26:58 main:581] : INFO : Epoch 1639 | loss: 0.0311499 | val_loss: 0.0311995 | Time: 2047.76 ms [2022-03-15 05:27:00 main:581] : INFO : Epoch 1640 | loss: 0.0311534 | val_loss: 0.0311948 | Time: 2088.16 ms [2022-03-15 05:27:02 main:581] : INFO : Epoch 1641 | loss: 0.0311535 | val_loss: 0.0311996 | Time: 2438.59 ms [2022-03-15 05:27:05 main:581] : INFO : Epoch 1642 | loss: 0.0311545 | val_loss: 0.0311993 | Time: 2167.61 ms [2022-03-15 05:27:07 main:581] : INFO : Epoch 1643 | loss: 0.0311528 | val_loss: 0.0312029 | Time: 2055.37 ms [2022-03-15 05:27:09 main:581] : INFO : Epoch 1644 | loss: 0.0311543 | val_loss: 0.0311987 | Time: 2083.05 ms [2022-03-15 05:27:11 main:581] : INFO : Epoch 1645 | loss: 0.0311498 | val_loss: 0.0311972 | Time: 2050.37 ms [2022-03-15 05:27:13 main:581] : INFO : Epoch 1646 | loss: 0.0311469 | val_loss: 0.031197 | Time: 2044.83 ms [2022-03-15 05:27:15 main:581] : INFO : Epoch 1647 | loss: 0.0311479 | val_loss: 0.0311957 | Time: 2088.22 ms [2022-03-15 05:27:17 main:581] : INFO : Epoch 1648 | loss: 0.0311535 | val_loss: 0.0312023 | Time: 2048.4 ms [2022-03-15 05:27:19 main:581] : INFO : Epoch 1649 | loss: 0.0311522 | val_loss: 0.0311949 | Time: 2066.52 ms [2022-03-15 05:27:21 main:581] : INFO : Epoch 1650 | loss: 0.0311475 | val_loss: 0.0311992 | Time: 2069.87 ms [2022-03-15 05:27:23 main:581] : INFO : Epoch 1651 | loss: 0.0311514 | val_loss: 0.0311906 | Time: 2086.88 ms [2022-03-15 05:27:25 main:581] : INFO : Epoch 1652 | loss: 0.0311522 | val_loss: 0.031197 | Time: 2050.98 ms [2022-03-15 05:27:27 main:581] : INFO : Epoch 1653 | loss: 0.0311465 | val_loss: 0.0311991 | Time: 2046.13 ms [2022-03-15 05:27:29 main:581] : INFO : Epoch 1654 | loss: 0.0311465 | val_loss: 0.0311993 | Time: 2084.62 ms [2022-03-15 05:27:31 main:581] : INFO : Epoch 1655 | loss: 0.0311456 | val_loss: 0.0312008 | Time: 2055.88 ms [2022-03-15 05:27:34 main:581] : INFO : Epoch 1656 | loss: 0.0311451 | val_loss: 0.0311973 | Time: 2123.9 ms [2022-03-15 05:27:36 main:581] : INFO : Epoch 1657 | loss: 0.0311426 | val_loss: 0.0312015 | Time: 2058.06 ms [2022-03-15 05:27:38 main:581] : INFO : Epoch 1658 | loss: 0.0311492 | val_loss: 0.0312017 | Time: 2085.05 ms [2022-03-15 05:27:40 main:581] : INFO : Epoch 1659 | loss: 0.0311449 | val_loss: 0.0311991 | Time: 2084.28 ms [2022-03-15 05:27:42 main:581] : INFO : Epoch 1660 | loss: 0.0311465 | val_loss: 0.0312028 | Time: 2059.06 ms [2022-03-15 05:27:44 main:581] : INFO : Epoch 1661 | loss: 0.0311446 | val_loss: 0.0311981 | Time: 2045.63 ms [2022-03-15 05:27:46 main:581] : INFO : Epoch 1662 | loss: 0.031147 | val_loss: 0.031213 | Time: 2085.49 ms [2022-03-15 05:27:48 main:581] : INFO : Epoch 1663 | loss: 0.0311537 | val_loss: 0.0312051 | Time: 2050.03 ms [2022-03-15 05:27:50 main:581] : INFO : Epoch 1664 | loss: 0.0311473 | val_loss: 0.0312063 | Time: 2074.79 ms [2022-03-15 05:27:52 main:581] : INFO : Epoch 1665 | loss: 0.0311496 | val_loss: 0.0312069 | Time: 2061.75 ms [2022-03-15 05:27:54 main:581] : INFO : Epoch 1666 | loss: 0.0311538 | val_loss: 0.0312031 | Time: 2084.5 ms [2022-03-15 05:27:56 main:581] : INFO : Epoch 1667 | loss: 0.031144 | val_loss: 0.0312047 | Time: 2058 ms [2022-03-15 05:27:58 main:581] : INFO : Epoch 1668 | loss: 0.0311468 | val_loss: 0.0312064 | Time: 2132.33 ms [2022-03-15 05:28:01 main:581] : INFO : Epoch 1669 | loss: 0.0311465 | val_loss: 0.0311976 | Time: 2106.79 ms [2022-03-15 05:28:04 main:581] : INFO : Epoch 1670 | loss: 0.0311435 | val_loss: 0.0312033 | Time: 3215.38 ms [2022-03-15 05:28:06 main:581] : INFO : Epoch 1671 | loss: 0.0311421 | val_loss: 0.031207 | Time: 2256.08 ms [2022-03-15 05:28:08 main:581] : INFO : Epoch 1672 | loss: 0.0311464 | val_loss: 0.0312066 | Time: 2053.16 ms [2022-03-15 05:28:10 main:581] : INFO : Epoch 1673 | loss: 0.0311456 | val_loss: 0.0312022 | Time: 2086.38 ms [2022-03-15 05:28:12 main:581] : INFO : Epoch 1674 | loss: 0.0311456 | val_loss: 0.0312038 | Time: 2047.05 ms [2022-03-15 05:28:14 main:581] : INFO : Epoch 1675 | loss: 0.0311428 | val_loss: 0.0312046 | Time: 2048.81 ms [2022-03-15 05:28:16 main:581] : INFO : Epoch 1676 | loss: 0.0311417 | val_loss: 0.0312009 | Time: 2120.75 ms [2022-03-15 05:28:18 main:581] : INFO : Epoch 1677 | loss: 0.0311489 | val_loss: 0.031207 | Time: 2108.57 ms [2022-03-15 05:28:21 main:581] : INFO : Epoch 1678 | loss: 0.0311412 | val_loss: 0.0312114 | Time: 2077.87 ms [2022-03-15 05:28:23 main:581] : INFO : Epoch 1679 | loss: 0.0311389 | val_loss: 0.0312044 | Time: 2050.62 ms [2022-03-15 05:28:25 main:581] : INFO : Epoch 1680 | loss: 0.0311407 | val_loss: 0.0312106 | Time: 2047.63 ms [2022-03-15 05:28:27 main:581] : INFO : Epoch 1681 | loss: 0.0311399 | val_loss: 0.0312102 | Time: 2080.87 ms [2022-03-15 05:28:29 main:581] : INFO : Epoch 1682 | loss: 0.0311442 | val_loss: 0.031214 | Time: 2052.6 ms [2022-03-15 05:28:31 main:581] : INFO : Epoch 1683 | loss: 0.0311415 | val_loss: 0.0312071 | Time: 2044.71 ms [2022-03-15 05:28:33 main:581] : INFO : Epoch 1684 | loss: 0.0311429 | val_loss: 0.0311999 | Time: 2044.12 ms [2022-03-15 05:28:35 main:581] : INFO : Epoch 1685 | loss: 0.0311457 | val_loss: 0.0312034 | Time: 2089.16 ms [2022-03-15 05:28:37 main:581] : INFO : Epoch 1686 | loss: 0.0311436 | val_loss: 0.0312048 | Time: 2091.61 ms [2022-03-15 05:28:39 main:581] : INFO : Epoch 1687 | loss: 0.0311395 | val_loss: 0.0312032 | Time: 2091.4 ms [2022-03-15 05:28:41 main:581] : INFO : Epoch 1688 | loss: 0.0311406 | val_loss: 0.03121 | Time: 2089.33 ms [2022-03-15 05:28:43 main:581] : INFO : Epoch 1689 | loss: 0.0311397 | val_loss: 0.0312093 | Time: 2054.65 ms [2022-03-15 05:28:45 main:581] : INFO : Epoch 1690 | loss: 0.0311343 | val_loss: 0.0312046 | Time: 2087.43 ms [2022-03-15 05:28:47 main:581] : INFO : Epoch 1691 | loss: 0.0311366 | val_loss: 0.0312014 | Time: 2051.27 ms [2022-03-15 05:28:50 main:581] : INFO : Epoch 1692 | loss: 0.0311475 | val_loss: 0.0312061 | Time: 2084.7 ms [2022-03-15 05:28:52 main:581] : INFO : Epoch 1693 | loss: 0.0311395 | val_loss: 0.0312088 | Time: 2057.04 ms [2022-03-15 05:28:54 main:581] : INFO : Epoch 1694 | loss: 0.031139 | val_loss: 0.0312138 | Time: 2086.49 ms [2022-03-15 05:28:56 main:581] : INFO : Epoch 1695 | loss: 0.0311435 | val_loss: 0.0312065 | Time: 2050.44 ms [2022-03-15 05:28:58 main:581] : INFO : Epoch 1696 | loss: 0.0311459 | val_loss: 0.0312038 | Time: 2051.31 ms [2022-03-15 05:29:00 main:581] : INFO : Epoch 1697 | loss: 0.0311433 | val_loss: 0.031207 | Time: 2084.57 ms [2022-03-15 05:29:03 main:581] : INFO : Epoch 1698 | loss: 0.0311375 | val_loss: 0.0312058 | Time: 2926.5 ms [2022-03-15 05:29:05 main:581] : INFO : Epoch 1699 | loss: 0.0311386 | val_loss: 0.0312173 | Time: 2112.94 ms [2022-03-15 05:29:07 main:581] : INFO : Epoch 1700 | loss: 0.0311388 | val_loss: 0.0312107 | Time: 2052.87 ms [2022-03-15 05:29:09 main:581] : INFO : Epoch 1701 | loss: 0.0311386 | val_loss: 0.0312044 | Time: 2045.43 ms [2022-03-15 05:29:11 main:581] : INFO : Epoch 1702 | loss: 0.0311427 | val_loss: 0.0312075 | Time: 2083.42 ms [2022-03-15 05:29:13 main:581] : INFO : Epoch 1703 | loss: 0.0311422 | val_loss: 0.031203 | Time: 2050.81 ms [2022-03-15 05:29:15 main:581] : INFO : Epoch 1704 | loss: 0.0311406 | val_loss: 0.0312114 | Time: 2045.53 ms [2022-03-15 05:29:17 main:581] : INFO : Epoch 1705 | loss: 0.0311363 | val_loss: 0.0312117 | Time: 2085.53 ms [2022-03-15 05:29:19 main:581] : INFO : Epoch 1706 | loss: 0.0311359 | val_loss: 0.0312124 | Time: 2050.05 ms [2022-03-15 05:29:21 main:581] : INFO : Epoch 1707 | loss: 0.0311348 | val_loss: 0.0312096 | Time: 2053.95 ms [2022-03-15 05:29:24 main:581] : INFO : Epoch 1708 | loss: 0.0311357 | val_loss: 0.0312024 | Time: 2132.93 ms [2022-03-15 05:29:26 main:581] : INFO : Epoch 1709 | loss: 0.0311397 | val_loss: 0.031213 | Time: 2109.41 ms [2022-03-15 05:29:28 main:581] : INFO : Epoch 1710 | loss: 0.031138 | val_loss: 0.03121 | Time: 2074.02 ms [2022-03-15 05:29:30 main:581] : INFO : Epoch 1711 | loss: 0.0311358 | val_loss: 0.0312154 | Time: 2072.42 ms [2022-03-15 05:29:32 main:581] : INFO : Epoch 1712 | loss: 0.0311358 | val_loss: 0.0312123 | Time: 2047.57 ms [2022-03-15 05:29:34 main:581] : INFO : Epoch 1713 | loss: 0.0311396 | val_loss: 0.0312012 | Time: 2042.09 ms [2022-03-15 05:29:36 main:581] : INFO : Epoch 1714 | loss: 0.0311408 | val_loss: 0.031205 | Time: 2042.31 ms [2022-03-15 05:29:38 main:581] : INFO : Epoch 1715 | loss: 0.0311405 | val_loss: 0.0312112 | Time: 2040.85 ms [2022-03-15 05:29:40 main:581] : INFO : Epoch 1716 | loss: 0.0311356 | val_loss: 0.0312045 | Time: 2043.57 ms [2022-03-15 05:29:42 main:581] : INFO : Epoch 1717 | loss: 0.0311372 | val_loss: 0.0312108 | Time: 2147.58 ms [2022-03-15 05:29:44 main:581] : INFO : Epoch 1718 | loss: 0.0311359 | val_loss: 0.031208 | Time: 2076.72 ms [2022-03-15 05:29:46 main:581] : INFO : Epoch 1719 | loss: 0.0311331 | val_loss: 0.0312047 | Time: 2131.33 ms [2022-03-15 05:29:48 main:581] : INFO : Epoch 1720 | loss: 0.0311328 | val_loss: 0.0312154 | Time: 2080.17 ms [2022-03-15 05:29:51 main:581] : INFO : Epoch 1721 | loss: 0.0311352 | val_loss: 0.0312061 | Time: 2086.47 ms [2022-03-15 05:29:53 main:581] : INFO : Epoch 1722 | loss: 0.0311354 | val_loss: 0.0312099 | Time: 2048.12 ms [2022-03-15 05:29:55 main:581] : INFO : Epoch 1723 | loss: 0.0311329 | val_loss: 0.0312065 | Time: 2042.66 ms [2022-03-15 05:29:57 main:581] : INFO : Epoch 1724 | loss: 0.0311368 | val_loss: 0.0312076 | Time: 2043.63 ms [2022-03-15 05:29:59 main:581] : INFO : Epoch 1725 | loss: 0.0311439 | val_loss: 0.0312123 | Time: 2040.65 ms [2022-03-15 05:30:01 main:581] : INFO : Epoch 1726 | loss: 0.0311375 | val_loss: 0.0312018 | Time: 2483.36 ms [2022-03-15 05:30:03 main:581] : INFO : Epoch 1727 | loss: 0.03114 | val_loss: 0.0312061 | Time: 2051.56 ms [2022-03-15 05:30:05 main:581] : INFO : Epoch 1728 | loss: 0.0311329 | val_loss: 0.0312153 | Time: 2088.71 ms [2022-03-15 05:30:07 main:581] : INFO : Epoch 1729 | loss: 0.0311308 | val_loss: 0.0312212 | Time: 2085.37 ms [2022-03-15 05:30:09 main:581] : INFO : Epoch 1730 | loss: 0.0311343 | val_loss: 0.031215 | Time: 2087.34 ms SIGSEGV: segmentation violation Stack trace (41 frames): ../../projects/www.mlcathome.org_mlcathome/mlds-gpu_9.80_x86_64-pc-linux-gnu__cuda10200(+0x37df9c)[0x55f94ae2af9c] /lib/x86_64-linux-gnu/libpthread.so.0(+0x12730)[0x7f6341b3b730] /lib/x86_64-linux-gnu/libc.so.6(+0x39d57)[0x7f62c3455d57] /lib/x86_64-linux-gnu/libc.so.6(+0x39eba)[0x7f62c3455eba] ../../projects/www.mlcathome.org_mlcathome/mlds-gpu_9.80_x86_64-pc-linux-gnu__cuda10200(+0x379b25)[0x55f94ae26b25] ../../projects/www.mlcathome.org_mlcathome/mlds-gpu_9.80_x86_64-pc-linux-gnu__cuda10200(+0x379bee)[0x55f94ae26bee] /lib/x86_64-linux-gnu/libpthread.so.0(+0x12730)[0x7f6341b3b730] ./libcudnn_ops_infer.so.8(+0x15c9512)[0x7f623ce3c512] ./libcudnn_ops_infer.so.8(+0xbfd485)[0x7f623c470485] ./libcudnn_ops_infer.so.8(+0x9ab975)[0x7f623c21e975] ./libcudnn_ops_infer.so.8(+0x9a958f)[0x7f623c21c58f] ./libcudnn_ops_infer.so.8(+0x6ac0db)[0x7f623bf1f0db] ./libcudnn_ops_infer.so.8(+0x68e125)[0x7f623bf01125] ./libcudnn_ops_infer.so.8(+0x68f8ea)[0x7f623bf028ea] ./libcudnn_ops_infer.so.8(_ZN5cudnn12cublasGemmExEP13cublasContext17cublasOperation_tS2_iiiPKvS4_14cudaDataType_tiS4_S5_iS4_PvS5_iS5_16cublasGemmAlgo_t+0x12c)[0x7f623ba9659c] ./libcudnn_adv_infer.so.8(+0x77e31)[0x7f6227487e31] ./libcudnn_adv_infer.so.8(+0xe89f)[0x7f622741e89f] ./libcudnn_adv_infer.so.8(_Z18RNN_forwardGenericP12cudnnContextP14cudnnRNNStructiPKP17cudnnTensorStructPKvS4_S8_S4_S8_P17cudnnFilterStructS8_S6_PvS4_SB_S4_SB_SB_mSB_m18cudnnForwardMode_t+0x5d7)[0x7f62274628c7] ./libcudnn_adv_train.so.8(cudnnRNNForwardTraining+0x20e)[0x7f621261661e] ./libtorch_cuda.so(_ZN2at6native10_cudnn_rnnERKNS_6TensorEN3c108ArrayRefIS1_EElS3_S3_S3_lllbdbbNS5_IlEES3_+0x2214)[0x7f62c4223a64] ./libtorch_cuda.so(+0x85face)[0x7f62c426dace] ./libtorch_cuda.so(+0x895988)[0x7f62c42a3988] ./libtorch_cpu.so(_ZN2at10_cudnn_rnnERKNS_6TensorEN3c108ArrayRefIS0_EElS2_S2_S2_lllbdbbNS4_IlEES2_+0x2bc)[0x7f633c7dc51c] ./libtorch_cpu.so(+0x21cf2d4)[0x7f633dba62d4] ./libtorch_cpu.so(+0x21edb28)[0x7f633dbc4b28] ./libtorch_cpu.so(_ZN2at10_cudnn_rnnERKNS_6TensorEN3c108ArrayRefIS0_EElS2_S2_S2_lllbdbbNS4_IlEES2_+0x2bc)[0x7f633c7dc51c] ./libtorch_cuda.so(+0x80f0fd)[0x7f62c421d0fd] ./libtorch_cuda.so(+0x80fb0a)[0x7f62c421db0a] ./libtorch_cpu.so(+0x97fe93)[0x7f633c356e93] ./libtorch_cpu.so(_ZN2at6native3gruERKNS_6TensorES3_N3c108ArrayRefIS1_EEbldbbb+0xea)[0x7f633c33a9ba] ./libtorch_cpu.so(+0xeb0a96)[0x7f633c887a96] ./libtorch_cpu.so(+0x22e3c92)[0x7f633dcbac92] ./libtorch_cpu.so(+0xedd579)[0x7f633c8b4579] ./libtorch_cpu.so(_ZN2at3gruERKNS_6TensorES2_N3c108ArrayRefIS0_EEbldbbb+0x1b1)[0x7f633c7b9ee1] ./libtorch_cpu.so(_ZN5torch2nn7GRUImpl14forward_helperERKN2at6TensorES5_S5_lS3_+0x43a)[0x7f633e7234ca] ./libtorch_cpu.so(_ZN5torch2nn7GRUImpl7forwardERKN2at6TensorES3_+0xb0)[0x7f633e723630] ../../projects/www.mlcathome.org_mlcathome/mlds-gpu_9.80_x86_64-pc-linux-gnu__cuda10200(+0x92fa8)[0x55f94ab3ffa8] ../../projects/www.mlcathome.org_mlcathome/mlds-gpu_9.80_x86_64-pc-linux-gnu__cuda10200(+0x9a0e6)[0x55f94ab470e6] ../../projects/www.mlcathome.org_mlcathome/mlds-gpu_9.80_x86_64-pc-linux-gnu__cuda10200(+0x8ad10)[0x55f94ab37d10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xeb)[0x7f62c344009b] ../../projects/www.mlcathome.org_mlcathome/mlds-gpu_9.80_x86_64-pc-linux-gnu__cuda10200(+0x8675a)[0x55f94ab3375a] Exiting... DEBUG: Args: ../../projects/www.mlcathome.org_mlcathome/mlds-gpu_9.80_x86_64-pc-linux-gnu__cuda10200 --maxepoch 2048 nthreads: 1 gpudev: 0 Re-exec()-ing to set environment correctly Machine Learning Dataset Generator v9.80 (Linux/x86_64) (libTorch: release/1.7 GPU: NVIDIA GeForce GTX 1660 Ti) [2022-03-15 06:22:47 main:442] : INFO : Set logging level to 1 [2022-03-15 06:22:47 main:448] : INFO : Running in BOINC Client mode [2022-03-15 06:22:47 main:451] : INFO : Resolving all filenames [2022-03-15 06:22:47 main:459] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-03-15 06:22:47 main:459] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-03-15 06:22:47 main:459] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-03-15 06:22:47 main:459] : INFO : Resolved: model-input.pt => model-input.pt (exists = 0) [2022-03-15 06:22:47 main:459] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-03-15 06:22:47 main:479] : INFO : Dataset filename: dataset.hdf5 [2022-03-15 06:22:47 main:481] : INFO : Configuration: [2022-03-15 06:22:47 main:482] : INFO : Model type: GRU [2022-03-15 06:22:47 main:483] : INFO : Validation Loss Threshold: 0.0001 [2022-03-15 06:22:47 main:484] : INFO : Max Epochs: 2048 [2022-03-15 06:22:47 main:485] : INFO : Batch Size: 128 [2022-03-15 06:22:47 main:486] : INFO : Learning Rate: 0.01 [2022-03-15 06:22:47 main:487] : INFO : Patience: 10 [2022-03-15 06:22:47 main:488] : INFO : Hidden Width: 12 [2022-03-15 06:22:47 main:489] : INFO : # Recurrent Layers: 4 [2022-03-15 06:22:47 main:490] : INFO : # Backend Layers: 4 [2022-03-15 06:22:47 main:491] : INFO : # Threads: 1 [2022-03-15 06:22:47 main:493] : INFO : Preparing Dataset [2022-03-15 06:22:47 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-03-15 06:22:47 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-03-15 06:22:48 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-03-15 06:22:48 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-03-15 06:22:48 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-03-15 06:22:48 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-03-15 06:22:48 main:501] : INFO : Creating Model [2022-03-15 06:22:48 main:514] : INFO : Preparing config file [2022-03-15 06:22:48 main:518] : INFO : Found checkpoint, attempting to load... [2022-03-15 06:22:48 main:519] : INFO : Loading config [2022-03-15 06:22:48 main:521] : INFO : Loading state [2022-03-15 06:22:49 main:566] : INFO : Loading DataLoader into Memory [2022-03-15 06:22:49 main:569] : INFO : Starting Training [2022-03-15 06:22:51 main:581] : INFO : Epoch 1731 | loss: 0.0312762 | val_loss: 0.0312415 | Time: 2378.83 ms [2022-03-15 06:22:53 main:581] : INFO : Epoch 1732 | loss: 0.0312 | val_loss: 0.0312025 | Time: 2027.46 ms [2022-03-15 06:22:55 main:581] : INFO : Epoch 1733 | loss: 0.031171 | val_loss: 0.0312084 | Time: 2019.38 ms [2022-03-15 06:22:57 main:581] : INFO : Epoch 1734 | loss: 0.0311579 | val_loss: 0.031205 | Time: 2072.6 ms [2022-03-15 06:22:59 main:581] : INFO : Epoch 1735 | loss: 0.0311438 | val_loss: 0.031202 | Time: 2101.21 ms [2022-03-15 06:23:01 main:581] : INFO : Epoch 1736 | loss: 0.0311539 | val_loss: 0.031201 | Time: 2062.62 ms [2022-03-15 06:23:03 main:581] : INFO : Epoch 1737 | loss: 0.0311569 | val_loss: 0.0312149 | Time: 2052.46 ms [2022-03-15 06:23:05 main:581] : INFO : Epoch 1738 | loss: 0.0311508 | val_loss: 0.0312024 | Time: 2072.79 ms [2022-03-15 06:23:07 main:581] : INFO : Epoch 1739 | loss: 0.0311387 | val_loss: 0.0312017 | Time: 2057.21 ms [2022-03-15 06:23:09 main:581] : INFO : Epoch 1740 | loss: 0.0311378 | val_loss: 0.0312048 | Time: 2025.76 ms [2022-03-15 06:23:11 main:581] : INFO : Epoch 1741 | loss: 0.031144 | val_loss: 0.031202 | Time: 2019.6 ms [2022-03-15 06:23:13 main:581] : INFO : Epoch 1742 | loss: 0.0311402 | val_loss: 0.0312038 | Time: 2036.78 ms [2022-03-15 06:23:16 main:581] : INFO : Epoch 1743 | loss: 0.0311368 | val_loss: 0.0312148 | Time: 2049.7 ms [2022-03-15 06:23:18 main:581] : INFO : Epoch 1744 | loss: 0.0311407 | val_loss: 0.031204 | Time: 2027.27 ms [2022-03-15 06:23:20 main:581] : INFO : Epoch 1745 | loss: 0.0311336 | val_loss: 0.0312019 | Time: 2087.96 ms [2022-03-15 06:23:22 main:581] : INFO : Epoch 1746 | loss: 0.0311399 | val_loss: 0.0312011 | Time: 2066.06 ms [2022-03-15 06:23:24 main:581] : INFO : Epoch 1747 | loss: 0.03114 | val_loss: 0.031205 | Time: 2069.9 ms [2022-03-15 06:23:26 main:581] : INFO : Epoch 1748 | loss: 0.0311423 | val_loss: 0.0312054 | Time: 2034.67 ms [2022-03-15 06:23:28 main:581] : INFO : Epoch 1749 | loss: 0.0311431 | val_loss: 0.0312096 | Time: 2024.35 ms [2022-03-15 06:23:30 main:581] : INFO : Epoch 1750 | loss: 0.0311406 | val_loss: 0.0312224 | Time: 2064.37 ms [2022-03-15 06:23:32 main:581] : INFO : Epoch 1751 | loss: 0.031137 | val_loss: 0.0312065 | Time: 2025.46 ms [2022-03-15 06:23:34 main:581] : INFO : Epoch 1752 | loss: 0.0311357 | val_loss: 0.0312134 | Time: 2019.18 ms [2022-03-15 06:23:36 main:581] : INFO : Epoch 1753 | loss: 0.0311368 | val_loss: 0.0312058 | Time: 2041.95 ms [2022-03-15 06:23:38 main:581] : INFO : Epoch 1754 | loss: 0.0311327 | val_loss: 0.0312018 | Time: 2045.58 ms [2022-03-15 06:23:40 main:581] : INFO : Epoch 1755 | loss: 0.0311344 | val_loss: 0.0312083 | Time: 2036.17 ms [2022-03-15 06:23:42 main:581] : INFO : Epoch 1756 | loss: 0.0311354 | val_loss: 0.031208 | Time: 2088.29 ms [2022-03-15 06:23:44 main:581] : INFO : Epoch 1757 | loss: 0.0311291 | val_loss: 0.0312112 | Time: 2038.44 ms [2022-03-15 06:23:46 main:581] : INFO : Epoch 1758 | loss: 0.0311313 | val_loss: 0.0312107 | Time: 2059.36 ms [2022-03-15 06:23:48 main:581] : INFO : Epoch 1759 | loss: 0.0311298 | val_loss: 0.031209 | Time: 2021.67 ms [2022-03-15 06:23:50 main:581] : INFO : Epoch 1760 | loss: 0.0311261 | val_loss: 0.0312078 | Time: 2023.36 ms [2022-03-15 06:23:52 main:581] : INFO : Epoch 1761 | loss: 0.0311304 | val_loss: 0.0312156 | Time: 2036.15 ms [2022-03-15 06:23:54 main:581] : INFO : Epoch 1762 | loss: 0.0311302 | val_loss: 0.0312101 | Time: 2051 ms [2022-03-15 06:23:56 main:581] : INFO : Epoch 1763 | loss: 0.0311341 | val_loss: 0.0312075 | Time: 2020.64 ms [2022-03-15 06:23:58 main:581] : INFO : Epoch 1764 | loss: 0.0311319 | val_loss: 0.0312029 | Time: 2051.78 ms [2022-03-15 06:24:01 main:581] : INFO : Epoch 1765 | loss: 0.0311285 | val_loss: 0.0312161 | Time: 2346.84 ms [2022-03-15 06:24:03 main:581] : INFO : Epoch 1766 | loss: 0.0311298 | val_loss: 0.0312084 | Time: 2491.73 ms [2022-03-15 06:24:05 main:581] : INFO : Epoch 1767 | loss: 0.0311278 | val_loss: 0.031216 | Time: 2021.71 ms [2022-03-15 06:24:07 main:581] : INFO : Epoch 1768 | loss: 0.0311275 | val_loss: 0.0312209 | Time: 2053.6 ms [2022-03-15 06:24:09 main:581] : INFO : Epoch 1769 | loss: 0.0311287 | val_loss: 0.031211 | Time: 2060.52 ms [2022-03-15 06:24:11 main:581] : INFO : Epoch 1770 | loss: 0.031127 | val_loss: 0.0312117 | Time: 2047.42 ms [2022-03-15 06:24:14 main:581] : INFO : Epoch 1771 | loss: 0.0311255 | val_loss: 0.0312086 | Time: 2023.53 ms [2022-03-15 06:24:16 main:581] : INFO : Epoch 1772 | loss: 0.0311309 | val_loss: 0.0312048 | Time: 2089.25 ms [2022-03-15 06:24:18 main:581] : INFO : Epoch 1773 | loss: 0.0311319 | val_loss: 0.0312059 | Time: 2052.79 ms [2022-03-15 06:24:20 main:581] : INFO : Epoch 1774 | loss: 0.0311313 | val_loss: 0.0312096 | Time: 2064 ms [2022-03-15 06:24:22 main:581] : INFO : Epoch 1775 | loss: 0.0311284 | val_loss: 0.0312143 | Time: 2022.09 ms [2022-03-15 06:24:24 main:581] : INFO : Epoch 1776 | loss: 0.0311259 | val_loss: 0.03121 | Time: 2017.53 ms [2022-03-15 06:24:26 main:581] : INFO : Epoch 1777 | loss: 0.0311264 | val_loss: 0.0312148 | Time: 2058.99 ms [2022-03-15 06:24:28 main:581] : INFO : Epoch 1778 | loss: 0.0311268 | val_loss: 0.0312137 | Time: 2032.41 ms [2022-03-15 06:24:30 main:581] : INFO : Epoch 1779 | loss: 0.0311243 | val_loss: 0.0312189 | Time: 2127.45 ms [2022-03-15 06:24:32 main:581] : INFO : Epoch 1780 | loss: 0.0311266 | val_loss: 0.0312105 | Time: 2043.58 ms [2022-03-15 06:24:34 main:581] : INFO : Epoch 1781 | loss: 0.031127 | val_loss: 0.0312115 | Time: 2060.53 ms [2022-03-15 06:24:36 main:581] : INFO : Epoch 1782 | loss: 0.0311283 | val_loss: 0.0312129 | Time: 2062.91 ms [2022-03-15 06:24:38 main:581] : INFO : Epoch 1783 | loss: 0.0311249 | val_loss: 0.0312232 | Time: 2026.03 ms [2022-03-15 06:24:40 main:581] : INFO : Epoch 1784 | loss: 0.0311286 | val_loss: 0.0312126 | Time: 2065.31 ms [2022-03-15 06:24:42 main:581] : INFO : Epoch 1785 | loss: 0.0311342 | val_loss: 0.0312102 | Time: 2043.6 ms [2022-03-15 06:24:44 main:581] : INFO : Epoch 1786 | loss: 0.0311252 | val_loss: 0.0312197 | Time: 2047.78 ms [2022-03-15 06:24:46 main:581] : INFO : Epoch 1787 | loss: 0.0311241 | val_loss: 0.0312116 | Time: 2043.43 ms [2022-03-15 06:24:48 main:581] : INFO : Epoch 1788 | loss: 0.0311243 | val_loss: 0.0312135 | Time: 2022.77 ms [2022-03-15 06:24:50 main:581] : INFO : Epoch 1789 | loss: 0.0311281 | val_loss: 0.0312117 | Time: 2066.64 ms [2022-03-15 06:24:53 main:581] : INFO : Epoch 1790 | loss: 0.031135 | val_loss: 0.0312122 | Time: 2037.5 ms [2022-03-15 06:24:55 main:581] : INFO : Epoch 1791 | loss: 0.0311348 | val_loss: 0.0312165 | Time: 2097.38 ms [2022-03-15 06:24:57 main:581] : INFO : Epoch 1792 | loss: 0.0311314 | val_loss: 0.0312051 | Time: 2066.72 ms [2022-03-15 06:24:59 main:581] : INFO : Epoch 1793 | loss: 0.031129 | val_loss: 0.0312098 | Time: 2027.42 ms [2022-03-15 06:25:01 main:581] : INFO : Epoch 1794 | loss: 0.0311348 | val_loss: 0.0312229 | Time: 2279.53 ms [2022-03-15 06:25:03 main:581] : INFO : Epoch 1795 | loss: 0.0311328 | val_loss: 0.0312171 | Time: 2507.76 ms [2022-03-15 06:25:06 main:581] : INFO : Epoch 1796 | loss: 0.0311279 | val_loss: 0.0312036 | Time: 2020.31 ms [2022-03-15 06:25:08 main:581] : INFO : Epoch 1797 | loss: 0.0311218 | val_loss: 0.0312257 | Time: 2063.96 ms [2022-03-15 06:25:10 main:581] : INFO : Epoch 1798 | loss: 0.0311206 | val_loss: 0.0312157 | Time: 2041.11 ms [2022-03-15 06:25:12 main:581] : INFO : Epoch 1799 | loss: 0.031122 | val_loss: 0.0312187 | Time: 2049.75 ms [2022-03-15 06:25:14 main:581] : INFO : Epoch 1800 | loss: 0.0311227 | val_loss: 0.0312067 | Time: 2023.21 ms [2022-03-15 06:25:16 main:581] : INFO : Epoch 1801 | loss: 0.0311233 | val_loss: 0.031215 | Time: 2116.09 ms [2022-03-15 06:25:18 main:581] : INFO : Epoch 1802 | loss: 0.0311185 | val_loss: 0.031215 | Time: 2075.53 ms [2022-03-15 06:25:20 main:581] : INFO : Epoch 1803 | loss: 0.0311222 | val_loss: 0.0312104 | Time: 2066.93 ms [2022-03-15 06:25:22 main:581] : INFO : Epoch 1804 | loss: 0.0311262 | val_loss: 0.0312227 | Time: 2026.43 ms [2022-03-15 06:25:24 main:581] : INFO : Epoch 1805 | loss: 0.0311275 | val_loss: 0.0312158 | Time: 2023.75 ms [2022-03-15 06:25:26 main:581] : INFO : Epoch 1806 | loss: 0.0311213 | val_loss: 0.031218 | Time: 2061.84 ms [2022-03-15 06:25:28 main:581] : INFO : Epoch 1807 | loss: 0.0311245 | val_loss: 0.0312181 | Time: 2023.58 ms [2022-03-15 06:25:30 main:581] : INFO : Epoch 1808 | loss: 0.0311219 | val_loss: 0.0312224 | Time: 2064.26 ms [2022-03-15 06:25:32 main:581] : INFO : Epoch 1809 | loss: 0.0311205 | val_loss: 0.0312176 | Time: 2028.71 ms [2022-03-15 06:25:34 main:581] : INFO : Epoch 1810 | loss: 0.0311202 | val_loss: 0.0312162 | Time: 2019.85 ms [2022-03-15 06:25:36 main:581] : INFO : Epoch 1811 | loss: 0.0311229 | val_loss: 0.0312251 | Time: 2080.71 ms [2022-03-15 06:25:38 main:581] : INFO : Epoch 1812 | loss: 0.0311246 | val_loss: 0.0312136 | Time: 2056.8 ms [2022-03-15 06:25:40 main:581] : INFO : Epoch 1813 | loss: 0.03112 | val_loss: 0.0312185 | Time: 2028.54 ms [2022-03-15 06:25:42 main:581] : INFO : Epoch 1814 | loss: 0.0311164 | val_loss: 0.0312187 | Time: 2129.28 ms [2022-03-15 06:25:45 main:581] : INFO : Epoch 1815 | loss: 0.0311184 | val_loss: 0.0312135 | Time: 2071.88 ms [2022-03-15 06:25:47 main:581] : INFO : Epoch 1816 | loss: 0.0311202 | val_loss: 0.0312103 | Time: 2029.3 ms [2022-03-15 06:25:49 main:581] : INFO : Epoch 1817 | loss: 0.0311245 | val_loss: 0.031224 | Time: 2020.57 ms [2022-03-15 06:25:51 main:581] : INFO : Epoch 1818 | loss: 0.0311209 | val_loss: 0.0312089 | Time: 2026.75 ms [2022-03-15 06:25:53 main:581] : INFO : Epoch 1819 | loss: 0.0311326 | val_loss: 0.0312254 | Time: 2061.93 ms [2022-03-15 06:25:55 main:581] : INFO : Epoch 1820 | loss: 0.031131 | val_loss: 0.0312093 | Time: 2017.99 ms [2022-03-15 06:25:57 main:581] : INFO : Epoch 1821 | loss: 0.0311295 | val_loss: 0.0312188 | Time: 2017.36 ms [2022-03-15 06:25:59 main:581] : INFO : Epoch 1822 | loss: 0.0311288 | val_loss: 0.0312016 | Time: 2014.14 ms [2022-03-15 06:26:01 main:581] : INFO : Epoch 1823 | loss: 0.0311323 | val_loss: 0.0312325 | Time: 2291.6 ms [2022-03-15 06:26:03 main:581] : INFO : Epoch 1824 | loss: 0.031121 | val_loss: 0.0312204 | Time: 2194.81 ms [2022-03-15 06:26:05 main:581] : INFO : Epoch 1825 | loss: 0.0311145 | val_loss: 0.0312256 | Time: 2090.96 ms [2022-03-15 06:26:07 main:581] : INFO : Epoch 1826 | loss: 0.0311179 | val_loss: 0.0312115 | Time: 2033.25 ms [2022-03-15 06:26:09 main:581] : INFO : Epoch 1827 | loss: 0.0311239 | val_loss: 0.0312284 | Time: 2062.94 ms [2022-03-15 06:26:11 main:581] : INFO : Epoch 1828 | loss: 0.0311289 | val_loss: 0.0312197 | Time: 2020.74 ms [2022-03-15 06:26:13 main:581] : INFO : Epoch 1829 | loss: 0.031118 | val_loss: 0.0312287 | Time: 2027.38 ms [2022-03-15 06:26:16 main:581] : INFO : Epoch 1830 | loss: 0.0311141 | val_loss: 0.0312207 | Time: 2058.63 ms [2022-03-15 06:26:18 main:581] : INFO : Epoch 1831 | loss: 0.0311203 | val_loss: 0.0312194 | Time: 2021.08 ms [2022-03-15 06:26:20 main:581] : INFO : Epoch 1832 | loss: 0.0311231 | val_loss: 0.031227 | Time: 2064.54 ms [2022-03-15 06:26:22 main:581] : INFO : Epoch 1833 | loss: 0.0311213 | val_loss: 0.031221 | Time: 2027.56 ms [2022-03-15 06:26:24 main:581] : INFO : Epoch 1834 | loss: 0.0311155 | val_loss: 0.0312211 | Time: 2057.46 ms [2022-03-15 06:26:26 main:581] : INFO : Epoch 1835 | loss: 0.0311157 | val_loss: 0.0312143 | Time: 2036.71 ms [2022-03-15 06:26:28 main:581] : INFO : Epoch 1836 | loss: 0.0311213 | val_loss: 0.0312215 | Time: 2070.89 ms [2022-03-15 06:26:30 main:581] : INFO : Epoch 1837 | loss: 0.0311326 | val_loss: 0.0312121 | Time: 2117.31 ms [2022-03-15 06:26:32 main:581] : INFO : Epoch 1838 | loss: 0.0311259 | val_loss: 0.0312217 | Time: 2027.89 ms [2022-03-15 06:26:34 main:581] : INFO : Epoch 1839 | loss: 0.0311216 | val_loss: 0.0312201 | Time: 2021.53 ms [2022-03-15 06:26:36 main:581] : INFO : Epoch 1840 | loss: 0.0311142 | val_loss: 0.0312278 | Time: 2018.87 ms [2022-03-15 06:26:38 main:581] : INFO : Epoch 1841 | loss: 0.0311158 | val_loss: 0.0312181 | Time: 2033.32 ms [2022-03-15 06:26:40 main:581] : INFO : Epoch 1842 | loss: 0.0311167 | val_loss: 0.0312238 | Time: 2070.33 ms [2022-03-15 06:26:42 main:581] : INFO : Epoch 1843 | loss: 0.0311117 | val_loss: 0.0312188 | Time: 2054.08 ms [2022-03-15 06:26:44 main:581] : INFO : Epoch 1844 | loss: 0.0311125 | val_loss: 0.031222 | Time: 2021.23 ms [2022-03-15 06:26:46 main:581] : INFO : Epoch 1845 | loss: 0.0311177 | val_loss: 0.0312125 | Time: 2023.24 ms [2022-03-15 06:26:48 main:581] : INFO : Epoch 1846 | loss: 0.0311223 | val_loss: 0.0312178 | Time: 2097.59 ms [2022-03-15 06:26:50 main:581] : INFO : Epoch 1847 | loss: 0.0311217 | val_loss: 0.0312198 | Time: 2118.32 ms [2022-03-15 06:26:52 main:581] : INFO : Epoch 1848 | loss: 0.0311223 | val_loss: 0.0312364 | Time: 2032.68 ms [2022-03-15 06:26:54 main:581] : INFO : Epoch 1849 | loss: 0.0311261 | val_loss: 0.0312176 | Time: 2022.69 ms [2022-03-15 06:26:57 main:581] : INFO : Epoch 1850 | loss: 0.0311304 | val_loss: 0.0312213 | Time: 2017.89 ms [2022-03-15 06:26:59 main:581] : INFO : Epoch 1851 | loss: 0.03112 | val_loss: 0.0312191 | Time: 2014.16 ms [2022-03-15 06:27:01 main:581] : INFO : Epoch 1852 | loss: 0.0311159 | val_loss: 0.0312314 | Time: 2107.8 ms [2022-03-15 06:27:04 main:581] : INFO : Epoch 1853 | loss: 0.0311124 | val_loss: 0.0312201 | Time: 2925 ms [2022-03-15 06:27:06 main:581] : INFO : Epoch 1854 | loss: 0.0311166 | val_loss: 0.0312114 | Time: 2040.24 ms [2022-03-15 06:27:08 main:581] : INFO : Epoch 1855 | loss: 0.0311193 | val_loss: 0.0312147 | Time: 2112.49 ms [2022-03-15 06:27:10 main:581] : INFO : Epoch 1856 | loss: 0.0311205 | val_loss: 0.0312143 | Time: 2068.55 ms [2022-03-15 06:27:12 main:581] : INFO : Epoch 1857 | loss: 0.0311189 | val_loss: 0.0312228 | Time: 2065.64 ms [2022-03-15 06:27:14 main:581] : INFO : Epoch 1858 | loss: 0.0311156 | val_loss: 0.031222 | Time: 2035.35 ms [2022-03-15 06:27:16 main:581] : INFO : Epoch 1859 | loss: 0.0311154 | val_loss: 0.0312117 | Time: 2061.36 ms [2022-03-15 06:27:18 main:581] : INFO : Epoch 1860 | loss: 0.0311115 | val_loss: 0.0312233 | Time: 2024.46 ms [2022-03-15 06:27:20 main:581] : INFO : Epoch 1861 | loss: 0.0311126 | val_loss: 0.0312159 | Time: 2019.36 ms [2022-03-15 06:27:22 main:581] : INFO : Epoch 1862 | loss: 0.0311127 | val_loss: 0.0312389 | Time: 2018.25 ms [2022-03-15 06:27:24 main:581] : INFO : Epoch 1863 | loss: 0.0311187 | val_loss: 0.0312103 | Time: 2014.36 ms [2022-03-15 06:27:26 main:581] : INFO : Epoch 1864 | loss: 0.0311236 | val_loss: 0.0312225 | Time: 2016 ms [2022-03-15 06:27:28 main:581] : INFO : Epoch 1865 | loss: 0.0311257 | val_loss: 0.0312035 | Time: 2127.42 ms [2022-03-15 06:27:30 main:581] : INFO : Epoch 1866 | loss: 0.0311322 | val_loss: 0.0312189 | Time: 2077.09 ms [2022-03-15 06:27:32 main:581] : INFO : Epoch 1867 | loss: 0.0311262 | val_loss: 0.0312161 | Time: 2014 ms [2022-03-15 06:27:34 main:581] : INFO : Epoch 1868 | loss: 0.0311217 | val_loss: 0.0312311 | Time: 1992.44 ms [2022-03-15 06:27:36 main:581] : INFO : Epoch 1869 | loss: 0.0311151 | val_loss: 0.0312159 | Time: 2218.65 ms [2022-03-15 06:27:39 main:581] : INFO : Epoch 1870 | loss: 0.0311161 | val_loss: 0.0312212 | Time: 2039.93 ms [2022-03-15 06:27:41 main:581] : INFO : Epoch 1871 | loss: 0.0311239 | val_loss: 0.031219 | Time: 1998.32 ms [2022-03-15 06:27:43 main:581] : INFO : Epoch 1872 | loss: 0.0311222 | val_loss: 0.0312097 | Time: 1988.6 ms [2022-03-15 06:27:44 main:581] : INFO : Epoch 1873 | loss: 0.0311169 | val_loss: 0.0312158 | Time: 1976.27 ms [2022-03-15 06:27:46 main:581] : INFO : Epoch 1874 | loss: 0.031111 | val_loss: 0.0312189 | Time: 1976.05 ms [2022-03-15 06:27:48 main:581] : INFO : Epoch 1875 | loss: 0.0311079 | val_loss: 0.0312249 | Time: 2019.53 ms [2022-03-15 06:27:50 main:581] : INFO : Epoch 1876 | loss: 0.0311095 | val_loss: 0.0312192 | Time: 2022.04 ms [2022-03-15 06:27:53 main:581] : INFO : Epoch 1877 | loss: 0.031118 | val_loss: 0.0312283 | Time: 2026.96 ms [2022-03-15 06:27:55 main:581] : INFO : Epoch 1878 | loss: 0.0311207 | val_loss: 0.0312352 | Time: 1987.17 ms [2022-03-15 06:27:57 main:581] : INFO : Epoch 1879 | loss: 0.0311258 | val_loss: 0.0312236 | Time: 2022.28 ms [2022-03-15 06:27:59 main:581] : INFO : Epoch 1880 | loss: 0.0311156 | val_loss: 0.0312172 | Time: 2025.99 ms [2022-03-15 06:28:01 main:581] : INFO : Epoch 1881 | loss: 0.0311094 | val_loss: 0.0312232 | Time: 2072.71 ms [2022-03-15 06:28:04 main:581] : INFO : Epoch 1882 | loss: 0.0311111 | val_loss: 0.0312235 | Time: 2952.32 ms [2022-03-15 06:28:07 main:581] : INFO : Epoch 1883 | loss: 0.0311137 | val_loss: 0.0312202 | Time: 3015.21 ms [2022-03-15 06:28:10 main:581] : INFO : Epoch 1884 | loss: 0.0311179 | val_loss: 0.0312248 | Time: 3008.23 ms [2022-03-15 06:28:13 main:581] : INFO : Epoch 1885 | loss: 0.0311157 | val_loss: 0.0312219 | Time: 3070.99 ms [2022-03-15 06:28:16 main:581] : INFO : Epoch 1886 | loss: 0.0311121 | val_loss: 0.0312266 | Time: 2841.25 ms [2022-03-15 06:28:18 main:581] : INFO : Epoch 1887 | loss: 0.0311144 | val_loss: 0.0312186 | Time: 2066.83 ms [2022-03-15 06:28:20 main:581] : INFO : Epoch 1888 | loss: 0.0311136 | val_loss: 0.0312325 | Time: 2019.05 ms [2022-03-15 06:28:22 main:581] : INFO : Epoch 1889 | loss: 0.0311154 | val_loss: 0.03122 | Time: 1985.23 ms [2022-03-15 06:28:24 main:581] : INFO : Epoch 1890 | loss: 0.031114 | val_loss: 0.0312319 | Time: 1977.67 ms [2022-03-15 06:28:26 main:581] : INFO : Epoch 1891 | loss: 0.0311154 | val_loss: 0.0312245 | Time: 1978.52 ms [2022-03-15 06:28:28 main:581] : INFO : Epoch 1892 | loss: 0.0311179 | val_loss: 0.0312165 | Time: 2020.98 ms [2022-03-15 06:28:30 main:581] : INFO : Epoch 1893 | loss: 0.0311279 | val_loss: 0.0312224 | Time: 1985.55 ms [2022-03-15 06:28:32 main:581] : INFO : Epoch 1894 | loss: 0.0311181 | val_loss: 0.0312124 | Time: 1985.08 ms [2022-03-15 06:28:34 main:581] : INFO : Epoch 1895 | loss: 0.0311168 | val_loss: 0.0312287 | Time: 2022.3 ms [2022-03-15 06:28:36 main:581] : INFO : Epoch 1896 | loss: 0.0311163 | val_loss: 0.0312315 | Time: 1987.26 ms [2022-03-15 06:28:38 main:581] : INFO : Epoch 1897 | loss: 0.0311132 | val_loss: 0.0312174 | Time: 2017.82 ms [2022-03-15 06:28:40 main:581] : INFO : Epoch 1898 | loss: 0.0311177 | val_loss: 0.0312209 | Time: 1988.29 ms [2022-03-15 06:28:42 main:581] : INFO : Epoch 1899 | loss: 0.0311128 | val_loss: 0.0312395 | Time: 2061.73 ms [2022-03-15 06:28:44 main:581] : INFO : Epoch 1900 | loss: 0.0311134 | val_loss: 0.0312179 | Time: 2018.71 ms [2022-03-15 06:28:46 main:581] : INFO : Epoch 1901 | loss: 0.0311214 | val_loss: 0.0312243 | Time: 1994.92 ms [2022-03-15 06:28:48 main:581] : INFO : Epoch 1902 | loss: 0.031124 | val_loss: 0.0312384 | Time: 1981.12 ms [2022-03-15 06:28:50 main:581] : INFO : Epoch 1903 | loss: 0.0311185 | val_loss: 0.0312242 | Time: 1977.56 ms [2022-03-15 06:28:52 main:581] : INFO : Epoch 1904 | loss: 0.0311115 | val_loss: 0.0312193 | Time: 2022.21 ms [2022-03-15 06:28:54 main:581] : INFO : Epoch 1905 | loss: 0.0311099 | val_loss: 0.0312295 | Time: 1986.32 ms [2022-03-15 06:28:56 main:581] : INFO : Epoch 1906 | loss: 0.0311158 | val_loss: 0.0312218 | Time: 1976.44 ms [2022-03-15 06:28:58 main:581] : INFO : Epoch 1907 | loss: 0.0311126 | val_loss: 0.0312233 | Time: 1974.25 ms [2022-03-15 06:29:00 main:581] : INFO : Epoch 1908 | loss: 0.0311082 | val_loss: 0.0312222 | Time: 1986.2 ms [2022-03-15 06:29:03 main:581] : INFO : Epoch 1909 | loss: 0.0311079 | val_loss: 0.0312194 | Time: 3138.21 ms [2022-03-15 06:29:05 main:581] : INFO : Epoch 1910 | loss: 0.0311111 | val_loss: 0.0312205 | Time: 2303.65 ms [2022-03-15 06:29:07 main:581] : INFO : Epoch 1911 | loss: 0.0311076 | val_loss: 0.0312222 | Time: 2021.01 ms [2022-03-15 06:29:09 main:581] : INFO : Epoch 1912 | loss: 0.0311102 | val_loss: 0.0312224 | Time: 1987.14 ms [2022-03-15 06:29:11 main:581] : INFO : Epoch 1913 | loss: 0.0311244 | val_loss: 0.0312156 | Time: 1982.45 ms [2022-03-15 06:29:13 main:581] : INFO : Epoch 1914 | loss: 0.0311264 | val_loss: 0.0312294 | Time: 1983.73 ms [2022-03-15 06:29:15 main:581] : INFO : Epoch 1915 | loss: 0.0311177 | val_loss: 0.0312276 | Time: 2022.26 ms [2022-03-15 06:29:17 main:581] : INFO : Epoch 1916 | loss: 0.031115 | val_loss: 0.0312314 | Time: 2018.8 ms [2022-03-15 06:29:19 main:581] : INFO : Epoch 1917 | loss: 0.0311177 | val_loss: 0.0312215 | Time: 1984.66 ms [2022-03-15 06:29:21 main:581] : INFO : Epoch 1918 | loss: 0.0311199 | val_loss: 0.0312272 | Time: 1981.35 ms [2022-03-15 06:29:23 main:581] : INFO : Epoch 1919 | loss: 0.0311106 | val_loss: 0.0312338 | Time: 1975.88 ms [2022-03-15 06:29:25 main:581] : INFO : Epoch 1920 | loss: 0.0311121 | val_loss: 0.0312071 | Time: 2026.44 ms [2022-03-15 06:29:27 main:581] : INFO : Epoch 1921 | loss: 0.0311116 | val_loss: 0.0312217 | Time: 2023.94 ms [2022-03-15 06:29:29 main:581] : INFO : Epoch 1922 | loss: 0.0311098 | val_loss: 0.0312296 | Time: 1985.72 ms [2022-03-15 06:29:31 main:581] : INFO : Epoch 1923 | loss: 0.0311105 | val_loss: 0.0312358 | Time: 2017.93 ms [2022-03-15 06:29:33 main:581] : INFO : Epoch 1924 | loss: 0.0311073 | val_loss: 0.0312304 | Time: 2005.26 ms [2022-03-15 06:29:35 main:581] : INFO : Epoch 1925 | loss: 0.0311094 | val_loss: 0.0312258 | Time: 2086.59 ms [2022-03-15 06:29:37 main:581] : INFO : Epoch 1926 | loss: 0.0311075 | val_loss: 0.0312198 | Time: 1994.61 ms [2022-03-15 06:29:39 main:581] : INFO : Epoch 1927 | loss: 0.0311128 | val_loss: 0.0312232 | Time: 2012.6 ms [2022-03-15 06:29:41 main:581] : INFO : Epoch 1928 | loss: 0.03111 | val_loss: 0.0312251 | Time: 1980.34 ms [2022-03-15 06:29:43 main:581] : INFO : Epoch 1929 | loss: 0.0311091 | val_loss: 0.0312246 | Time: 1977.55 ms [2022-03-15 06:29:45 main:581] : INFO : Epoch 1930 | loss: 0.0311096 | val_loss: 0.0312302 | Time: 2042.4 ms [2022-03-15 06:29:47 main:581] : INFO : Epoch 1931 | loss: 0.0311126 | val_loss: 0.0312166 | Time: 2009.09 ms [2022-03-15 06:29:49 main:581] : INFO : Epoch 1932 | loss: 0.0311173 | val_loss: 0.0312211 | Time: 1982.36 ms [2022-03-15 06:29:51 main:581] : INFO : Epoch 1933 | loss: 0.0311173 | val_loss: 0.0312205 | Time: 2091.52 ms [2022-03-15 06:29:53 main:581] : INFO : Epoch 1934 | loss: 0.0311269 | val_loss: 0.0312125 | Time: 1994.31 ms [2022-03-15 06:29:55 main:581] : INFO : Epoch 1935 | loss: 0.031126 | val_loss: 0.0312191 | Time: 1987.67 ms [2022-03-15 06:29:57 main:581] : INFO : Epoch 1936 | loss: 0.031117 | val_loss: 0.0312281 | Time: 2094.17 ms [2022-03-15 06:29:59 main:581] : INFO : Epoch 1937 | loss: 0.0311157 | val_loss: 0.0312396 | Time: 1987.82 ms [2022-03-15 06:30:01 main:581] : INFO : Epoch 1938 | loss: 0.0311153 | val_loss: 0.0312148 | Time: 2067.26 ms [2022-03-15 06:30:03 main:581] : INFO : Epoch 1939 | loss: 0.0311116 | val_loss: 0.0312307 | Time: 1976.3 ms [2022-03-15 06:30:05 main:581] : INFO : Epoch 1940 | loss: 0.03111 | val_loss: 0.0312255 | Time: 2020.89 ms [2022-03-15 06:30:07 main:581] : INFO : Epoch 1941 | loss: 0.0311092 | val_loss: 0.0312366 | Time: 1989.16 ms [2022-03-15 06:30:09 main:581] : INFO : Epoch 1942 | loss: 0.0311109 | val_loss: 0.0312214 | Time: 1978.75 ms [2022-03-15 06:30:11 main:581] : INFO : Epoch 1943 | loss: 0.0311091 | val_loss: 0.0312233 | Time: 1976.22 ms [2022-03-15 06:30:13 main:581] : INFO : Epoch 1944 | loss: 0.0311089 | val_loss: 0.0312315 | Time: 1977.41 ms [2022-03-15 06:30:15 main:581] : INFO : Epoch 1945 | loss: 0.0311059 | val_loss: 0.0312198 | Time: 2027.33 ms [2022-03-15 06:30:17 main:581] : INFO : Epoch 1946 | loss: 0.0311107 | val_loss: 0.0312452 | Time: 2022.26 ms [2022-03-15 06:30:19 main:581] : INFO : Epoch 1947 | loss: 0.0311088 | val_loss: 0.0312188 | Time: 2013.22 ms [2022-03-15 06:30:21 main:581] : INFO : Epoch 1948 | loss: 0.0311088 | val_loss: 0.0312255 | Time: 2036.04 ms [2022-03-15 06:30:23 main:581] : INFO : Epoch 1949 | loss: 0.0311098 | val_loss: 0.031227 | Time: 1999.43 ms [2022-03-15 06:30:25 main:581] : INFO : Epoch 1950 | loss: 0.0311047 | val_loss: 0.0312272 | Time: 2021.73 ms [2022-03-15 06:30:27 main:581] : INFO : Epoch 1951 | loss: 0.0311069 | val_loss: 0.0312301 | Time: 1983.24 ms [2022-03-15 06:30:29 main:581] : INFO : Epoch 1952 | loss: 0.0311079 | val_loss: 0.0312316 | Time: 1979.27 ms [2022-03-15 06:30:31 main:581] : INFO : Epoch 1953 | loss: 0.0311114 | val_loss: 0.0312124 | Time: 1978.61 ms [2022-03-15 06:30:33 main:581] : INFO : Epoch 1954 | loss: 0.0311111 | val_loss: 0.0312337 | Time: 1984.58 ms [2022-03-15 06:30:35 main:581] : INFO : Epoch 1955 | loss: 0.0311083 | val_loss: 0.0312248 | Time: 2019.38 ms [2022-03-15 06:30:37 main:581] : INFO : Epoch 1956 | loss: 0.0311142 | val_loss: 0.0312266 | Time: 1991.98 ms [2022-03-15 06:30:39 main:581] : INFO : Epoch 1957 | loss: 0.0311169 | val_loss: 0.0312194 | Time: 2017.55 ms [2022-03-15 06:30:41 main:581] : INFO : Epoch 1958 | loss: 0.0311127 | val_loss: 0.031227 | Time: 2021.57 ms [2022-03-15 06:30:43 main:581] : INFO : Epoch 1959 | loss: 0.0311134 | val_loss: 0.0312304 | Time: 2087.56 ms [2022-03-15 06:30:45 main:581] : INFO : Epoch 1960 | loss: 0.0311109 | val_loss: 0.0312188 | Time: 1989.45 ms [2022-03-15 06:30:47 main:581] : INFO : Epoch 1961 | loss: 0.0311108 | val_loss: 0.0312382 | Time: 1984.8 ms [2022-03-15 06:30:49 main:581] : INFO : Epoch 1962 | loss: 0.0311138 | val_loss: 0.0312228 | Time: 2021.57 ms [2022-03-15 06:30:51 main:581] : INFO : Epoch 1963 | loss: 0.031106 | val_loss: 0.0312275 | Time: 1988.64 ms [2022-03-15 06:30:53 main:581] : INFO : Epoch 1964 | loss: 0.0311105 | val_loss: 0.0312211 | Time: 1988.83 ms [2022-03-15 06:30:55 main:581] : INFO : Epoch 1965 | loss: 0.0311149 | val_loss: 0.0312359 | Time: 2053.22 ms [2022-03-15 06:30:57 main:581] : INFO : Epoch 1966 | loss: 0.0311113 | val_loss: 0.031227 | Time: 1989.46 ms [2022-03-15 06:30:59 main:581] : INFO : Epoch 1967 | loss: 0.0311164 | val_loss: 0.0312208 | Time: 1981.82 ms [2022-03-15 06:31:02 main:581] : INFO : Epoch 1968 | loss: 0.0311206 | val_loss: 0.0312223 | Time: 2404.74 ms [2022-03-15 06:31:04 main:581] : INFO : Epoch 1969 | loss: 0.0311226 | val_loss: 0.0312214 | Time: 1987.32 ms [2022-03-15 06:31:06 main:581] : INFO : Epoch 1970 | loss: 0.0311111 | val_loss: 0.0312197 | Time: 2179.69 ms [2022-03-15 06:31:08 main:581] : INFO : Epoch 1971 | loss: 0.0311073 | val_loss: 0.0312326 | Time: 1992.16 ms [2022-03-15 06:31:10 main:581] : INFO : Epoch 1972 | loss: 0.0311064 | val_loss: 0.0312228 | Time: 1986 ms [2022-03-15 06:31:12 main:581] : INFO : Epoch 1973 | loss: 0.0311044 | val_loss: 0.0312302 | Time: 2014.12 ms [2022-03-15 06:31:14 main:581] : INFO : Epoch 1974 | loss: 0.031102 | val_loss: 0.0312414 | Time: 1990.77 ms [2022-03-15 06:31:16 main:581] : INFO : Epoch 1975 | loss: 0.0311076 | val_loss: 0.0312213 | Time: 1979.41 ms [2022-03-15 06:31:18 main:581] : INFO : Epoch 1976 | loss: 0.0311105 | val_loss: 0.0312325 | Time: 1977.96 ms [2022-03-15 06:31:20 main:581] : INFO : Epoch 1977 | loss: 0.0311145 | val_loss: 0.0312268 | Time: 2022.06 ms [2022-03-15 06:31:22 main:581] : INFO : Epoch 1978 | loss: 0.031107 | val_loss: 0.0312297 | Time: 1983.31 ms [2022-03-15 06:31:24 main:581] : INFO : Epoch 1979 | loss: 0.0311082 | val_loss: 0.0312261 | Time: 1978.52 ms [2022-03-15 06:31:26 main:581] : INFO : Epoch 1980 | loss: 0.0311122 | val_loss: 0.0312197 | Time: 2051.49 ms [2022-03-15 06:31:28 main:581] : INFO : Epoch 1981 | loss: 0.0311097 | val_loss: 0.0312301 | Time: 2013.16 ms [2022-03-15 06:31:30 main:581] : INFO : Epoch 1982 | loss: 0.0311086 | val_loss: 0.0312251 | Time: 2027.72 ms [2022-03-15 06:31:32 main:581] : INFO : Epoch 1983 | loss: 0.0311046 | val_loss: 0.031221 | Time: 2025.99 ms [2022-03-15 06:31:34 main:581] : INFO : Epoch 1984 | loss: 0.0311039 | val_loss: 0.0312348 | Time: 1985.89 ms [2022-03-15 06:31:36 main:581] : INFO : Epoch 1985 | loss: 0.0311074 | val_loss: 0.0312274 | Time: 2024.12 ms [2022-03-15 06:31:38 main:581] : INFO : Epoch 1986 | loss: 0.0311269 | val_loss: 0.0312083 | Time: 1986.23 ms [2022-03-15 06:31:40 main:581] : INFO : Epoch 1987 | loss: 0.0311303 | val_loss: 0.0312165 | Time: 1979.28 ms [2022-03-15 06:31:42 main:581] : INFO : Epoch 1988 | loss: 0.0311213 | val_loss: 0.0312221 | Time: 2016.57 ms [2022-03-15 06:31:44 main:581] : INFO : Epoch 1989 | loss: 0.0311156 | val_loss: 0.0312339 | Time: 1992.68 ms [2022-03-15 06:31:46 main:581] : INFO : Epoch 1990 | loss: 0.0311089 | val_loss: 0.0312357 | Time: 2020.88 ms [2022-03-15 06:31:48 main:581] : INFO : Epoch 1991 | loss: 0.0311069 | val_loss: 0.0312266 | Time: 1990.46 ms [2022-03-15 06:31:50 main:581] : INFO : Epoch 1992 | loss: 0.0311056 | val_loss: 0.0312255 | Time: 2016.54 ms [2022-03-15 06:31:52 main:581] : INFO : Epoch 1993 | loss: 0.0311124 | val_loss: 0.0312307 | Time: 2020.52 ms [2022-03-15 06:31:54 main:581] : INFO : Epoch 1994 | loss: 0.0311125 | val_loss: 0.0312344 | Time: 2013.5 ms [2022-03-15 06:31:56 main:581] : INFO : Epoch 1995 | loss: 0.0311137 | val_loss: 0.0312281 | Time: 2014.9 ms [2022-03-15 06:31:58 main:581] : INFO : Epoch 1996 | loss: 0.0311106 | val_loss: 0.0312267 | Time: 1982.47 ms [2022-03-15 06:32:00 main:581] : INFO : Epoch 1997 | loss: 0.0311232 | val_loss: 0.0312242 | Time: 2130.63 ms [2022-03-15 06:32:03 main:581] : INFO : Epoch 1998 | loss: 0.0311257 | val_loss: 0.0312306 | Time: 3017.97 ms [2022-03-15 06:32:05 main:581] : INFO : Epoch 1999 | loss: 0.0311149 | val_loss: 0.0312224 | Time: 2066.78 ms [2022-03-15 06:32:07 main:581] : INFO : Epoch 2000 | loss: 0.031108 | val_loss: 0.0312477 | Time: 1979.76 ms [2022-03-15 06:32:09 main:581] : INFO : Epoch 2001 | loss: 0.0311048 | val_loss: 0.0312371 | Time: 1980.26 ms [2022-03-15 06:32:11 main:581] : INFO : Epoch 2002 | loss: 0.0311088 | val_loss: 0.0312276 | Time: 2023.17 ms [2022-03-15 06:32:13 main:581] : INFO : Epoch 2003 | loss: 0.0311035 | val_loss: 0.0312424 | Time: 1985.93 ms [2022-03-15 06:32:15 main:581] : INFO : Epoch 2004 | loss: 0.0311027 | val_loss: 0.0312475 | Time: 1976.93 ms [2022-03-15 06:32:17 main:581] : INFO : Epoch 2005 | loss: 0.0311012 | val_loss: 0.031228 | Time: 1998.45 ms [2022-03-15 06:32:19 main:581] : INFO : Epoch 2006 | loss: 0.0311073 | val_loss: 0.0312489 | Time: 2006.08 ms [2022-03-15 06:32:21 main:581] : INFO : Epoch 2007 | loss: 0.0311079 | val_loss: 0.0312477 | Time: 2007.66 ms [2022-03-15 06:32:23 main:581] : INFO : Epoch 2008 | loss: 0.0311212 | val_loss: 0.0312219 | Time: 2002.15 ms [2022-03-15 06:32:25 main:581] : INFO : Epoch 2009 | loss: 0.0311107 | val_loss: 0.0312265 | Time: 2089.08 ms [2022-03-15 06:32:27 main:581] : INFO : Epoch 2010 | loss: 0.0311116 | val_loss: 0.0312392 | Time: 2020.86 ms [2022-03-15 06:32:29 main:581] : INFO : Epoch 2011 | loss: 0.031107 | val_loss: 0.0312279 | Time: 1996.53 ms [2022-03-15 06:32:31 main:581] : INFO : Epoch 2012 | loss: 0.031105 | val_loss: 0.0312355 | Time: 2022.37 ms [2022-03-15 06:32:33 main:581] : INFO : Epoch 2013 | loss: 0.0311096 | val_loss: 0.0312388 | Time: 1983.06 ms [2022-03-15 06:32:35 main:581] : INFO : Epoch 2014 | loss: 0.031106 | val_loss: 0.0312231 | Time: 1978.17 ms [2022-03-15 06:32:37 main:581] : INFO : Epoch 2015 | loss: 0.0311111 | val_loss: 0.0312438 | Time: 1976.35 ms [2022-03-15 06:32:39 main:581] : INFO : Epoch 2016 | loss: 0.03113 | val_loss: 0.0312361 | Time: 2021.49 ms [2022-03-15 06:32:41 main:581] : INFO : Epoch 2017 | loss: 0.0311074 | val_loss: 0.0312322 | Time: 2002.47 ms [2022-03-15 06:32:43 main:581] : INFO : Epoch 2018 | loss: 0.0311058 | val_loss: 0.0312269 | Time: 2023.32 ms [2022-03-15 06:32:45 main:581] : INFO : Epoch 2019 | loss: 0.0311093 | val_loss: 0.0312241 | Time: 2008.15 ms [2022-03-15 06:32:47 main:581] : INFO : Epoch 2020 | loss: 0.0311143 | val_loss: 0.0312259 | Time: 1981.98 ms [2022-03-15 06:32:49 main:581] : INFO : Epoch 2021 | loss: 0.0311062 | val_loss: 0.0312383 | Time: 2006.62 ms [2022-03-15 06:32:52 main:581] : INFO : Epoch 2022 | loss: 0.0311017 | val_loss: 0.0312447 | Time: 2116.29 ms [2022-03-15 06:32:54 main:581] : INFO : Epoch 2023 | loss: 0.0311094 | val_loss: 0.0312172 | Time: 1990.7 ms [2022-03-15 06:32:56 main:581] : INFO : Epoch 2024 | loss: 0.0311054 | val_loss: 0.0312342 | Time: 1981.78 ms [2022-03-15 06:32:57 main:581] : INFO : Epoch 2025 | loss: 0.0311116 | val_loss: 0.0312457 | Time: 1976.52 ms [2022-03-15 06:32:59 main:581] : INFO : Epoch 2026 | loss: 0.0311119 | val_loss: 0.0312261 | Time: 1978.25 ms [2022-03-15 06:33:02 main:581] : INFO : Epoch 2027 | loss: 0.0311075 | val_loss: 0.0312343 | Time: 2810.42 ms [2022-03-15 06:33:05 main:581] : INFO : Epoch 2028 | loss: 0.0311061 | val_loss: 0.0312295 | Time: 3136.8 ms [2022-03-15 06:33:09 main:581] : INFO : Epoch 2029 | loss: 0.0311042 | val_loss: 0.0312282 | Time: 3140.37 ms [2022-03-15 06:33:11 main:581] : INFO : Epoch 2030 | loss: 0.0310986 | val_loss: 0.0312411 | Time: 2288.66 ms [2022-03-15 06:33:13 main:581] : INFO : Epoch 2031 | loss: 0.0311051 | val_loss: 0.0312287 | Time: 2027.77 ms [2022-03-15 06:33:15 main:581] : INFO : Epoch 2032 | loss: 0.0311137 | val_loss: 0.031228 | Time: 1983.31 ms [2022-03-15 06:33:17 main:581] : INFO : Epoch 2033 | loss: 0.0311102 | val_loss: 0.0312371 | Time: 1977.3 ms [2022-03-15 06:33:19 main:581] : INFO : Epoch 2034 | loss: 0.0311105 | val_loss: 0.0312285 | Time: 1972.91 ms [2022-03-15 06:33:21 main:581] : INFO : Epoch 2035 | loss: 0.0311084 | val_loss: 0.0312355 | Time: 1973.41 ms [2022-03-15 06:33:23 main:581] : INFO : Epoch 2036 | loss: 0.0311065 | val_loss: 0.0312282 | Time: 2019.86 ms [2022-03-15 06:33:25 main:581] : INFO : Epoch 2037 | loss: 0.0311037 | val_loss: 0.0312384 | Time: 2007.85 ms [2022-03-15 06:33:27 main:581] : INFO : Epoch 2038 | loss: 0.031104 | val_loss: 0.0312369 | Time: 2002.02 ms [2022-03-15 06:33:29 main:581] : INFO : Epoch 2039 | loss: 0.0311045 | val_loss: 0.0312335 | Time: 1977.36 ms [2022-03-15 06:33:31 main:581] : INFO : Epoch 2040 | loss: 0.0311038 | val_loss: 0.0312387 | Time: 2024.54 ms [2022-03-15 06:33:33 main:581] : INFO : Epoch 2041 | loss: 0.0311033 | val_loss: 0.0312358 | Time: 2027.06 ms [2022-03-15 06:33:35 main:581] : INFO : Epoch 2042 | loss: 0.0311021 | val_loss: 0.0312378 | Time: 2081.59 ms [2022-03-15 06:33:37 main:581] : INFO : Epoch 2043 | loss: 0.0311023 | val_loss: 0.0312454 | Time: 2006.55 ms [2022-03-15 06:33:39 main:581] : INFO : Epoch 2044 | loss: 0.0310985 | val_loss: 0.0312281 | Time: 1981.85 ms [2022-03-15 06:33:41 main:581] : INFO : Epoch 2045 | loss: 0.031103 | val_loss: 0.0312296 | Time: 1983.74 ms [2022-03-15 06:33:43 main:581] : INFO : Epoch 2046 | loss: 0.0311071 | val_loss: 0.0312261 | Time: 1977.45 ms [2022-03-15 06:33:45 main:581] : INFO : Epoch 2047 | loss: 0.0311037 | val_loss: 0.0312485 | Time: 1975.77 ms [2022-03-15 06:33:47 main:581] : INFO : Epoch 2048 | loss: 0.0310978 | val_loss: 0.0312374 | Time: 2013.97 ms [2022-03-15 06:33:47 main:604] : INFO : Saving trained model to model-final.pt, val_loss 0.0312374 [2022-03-15 06:33:47 main:610] : INFO : Saving end state to config to file [2022-03-15 06:33:47 main:615] : INFO : Success, exiting.. 06:33:47 (12353): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)