Task 14547338
| Name | ParityModified-1647042650-11836-3-0_2 |
| Workunit | 11261452 |
| Created | 8 Apr 2022, 0:30:56 UTC |
| Sent | 8 Apr 2022, 6:13:04 UTC |
| Report deadline | 16 Apr 2022, 6:13:04 UTC |
| Received | 8 Apr 2022, 17:13:56 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 21599 |
| Run time | 2 hours 13 min 5 sec |
| CPU time | 2 hours 7 min 35 sec |
| Validate state | Valid |
| Credit | 4,160.00 |
| Device peak FLOPS | 7,880.68 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 2.08 GB |
| Peak swap size | 4.35 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version> <![CDATA[ <stderr_txt> [2022-04-08 09:40:43 main:574] : INFO : Epoch 1652 | loss: 0.0311596 | val_loss: 0.0311742 | Time: 3953.04 ms [2022-04-08 09:40:47 main:574] : INFO : Epoch 1653 | loss: 0.0311579 | val_loss: 0.0311709 | Time: 3975.81 ms [2022-04-08 09:40:51 main:574] : INFO : Epoch 1654 | loss: 0.031159 | val_loss: 0.0311738 | Time: 3982.14 ms [2022-04-08 09:40:55 main:574] : INFO : Epoch 1655 | loss: 0.0311602 | val_loss: 0.0311764 | Time: 3942.46 ms [2022-04-08 09:40:59 main:574] : INFO : Epoch 1656 | loss: 0.031159 | val_loss: 0.0311726 | Time: 3960.76 ms [2022-04-08 09:41:03 main:574] : INFO : Epoch 1657 | loss: 0.0311574 | val_loss: 0.0311738 | Time: 3976.33 ms [2022-04-08 09:41:07 main:574] : INFO : Epoch 1658 | loss: 0.0311589 | val_loss: 0.0311761 | Time: 4142.17 ms [2022-04-08 09:41:11 main:574] : INFO : Epoch 1659 | loss: 0.0311579 | val_loss: 0.0311768 | Time: 3984.84 ms [2022-04-08 09:41:15 main:574] : INFO : Epoch 1660 | loss: 0.0311599 | val_loss: 0.0311726 | Time: 4008.79 ms [2022-04-08 09:41:19 main:574] : INFO : Epoch 1661 | loss: 0.0311587 | val_loss: 0.0311708 | Time: 4007.89 ms [2022-04-08 09:41:23 main:574] : INFO : Epoch 1662 | loss: 0.0311576 | val_loss: 0.0311708 | Time: 3968.21 ms [2022-04-08 09:41:27 main:574] : INFO : Epoch 1663 | loss: 0.0311575 | val_loss: 0.0311726 | Time: 3894.56 ms [2022-04-08 09:41:31 main:574] : INFO : Epoch 1664 | loss: 0.0311577 | val_loss: 0.0311723 | Time: 4016.22 ms [2022-04-08 09:41:35 main:574] : INFO : Epoch 1665 | loss: 0.0311585 | val_loss: 0.031173 | Time: 3973.13 ms [2022-04-08 09:41:39 main:574] : INFO : Epoch 1666 | loss: 0.0311585 | val_loss: 0.0311731 | Time: 3900.96 ms [2022-04-08 09:41:43 main:574] : INFO : Epoch 1667 | loss: 0.0311575 | val_loss: 0.0311733 | Time: 3979 ms [2022-04-08 09:41:47 main:574] : INFO : Epoch 1668 | loss: 0.0311566 | val_loss: 0.0311743 | Time: 4067.31 ms [2022-04-08 09:41:51 main:574] : INFO : Epoch 1669 | loss: 0.0311554 | val_loss: 0.0311713 | Time: 4048.46 ms [2022-04-08 09:41:55 main:574] : INFO : Epoch 1670 | loss: 0.031159 | val_loss: 0.0311765 | Time: 3899.86 ms [2022-04-08 09:41:59 main:574] : INFO : Epoch 1671 | loss: 0.0311597 | val_loss: 0.0311779 | Time: 3953.49 ms [2022-04-08 09:42:03 main:574] : INFO : Epoch 1672 | loss: 0.0311597 | val_loss: 0.0311779 | Time: 3984.66 ms [2022-04-08 09:42:07 main:574] : INFO : Epoch 1673 | loss: 0.0311611 | val_loss: 0.0311762 | Time: 3956.24 ms [2022-04-08 09:42:11 main:574] : INFO : Epoch 1674 | loss: 0.0311568 | val_loss: 0.0311836 | Time: 4069.69 ms [2022-04-08 09:42:15 main:574] : INFO : Epoch 1675 | loss: 0.0311598 | val_loss: 0.0311766 | Time: 3970.45 ms [2022-04-08 09:42:19 main:574] : INFO : Epoch 1676 | loss: 0.031157 | val_loss: 0.0311734 | Time: 4000.43 ms [2022-04-08 09:42:23 main:574] : INFO : Epoch 1677 | loss: 0.0311614 | val_loss: 0.0311799 | Time: 3935.25 ms [2022-04-08 09:42:27 main:574] : INFO : Epoch 1678 | loss: 0.0311614 | val_loss: 0.0311755 | Time: 3889.41 ms [2022-04-08 09:42:31 main:574] : INFO : Epoch 1679 | loss: 0.0311602 | val_loss: 0.0311771 | Time: 3919.81 ms [2022-04-08 09:42:35 main:574] : INFO : Epoch 1680 | loss: 0.0311607 | val_loss: 0.0311722 | Time: 3961.64 ms [2022-04-08 09:42:39 main:574] : INFO : Epoch 1681 | loss: 0.031157 | val_loss: 0.0311749 | Time: 4071.84 ms [2022-04-08 09:42:43 main:574] : INFO : Epoch 1682 | loss: 0.0311554 | val_loss: 0.031176 | Time: 3992.37 ms [2022-04-08 09:42:47 main:574] : INFO : Epoch 1683 | loss: 0.031155 | val_loss: 0.0311739 | Time: 4015.42 ms [2022-04-08 09:42:51 main:574] : INFO : Epoch 1684 | loss: 0.0311569 | val_loss: 0.0311779 | Time: 4050.96 ms [2022-04-08 09:42:55 main:574] : INFO : Epoch 1685 | loss: 0.03116 | val_loss: 0.0311751 | Time: 3922.89 ms [2022-04-08 09:42:59 main:574] : INFO : Epoch 1686 | loss: 0.0311575 | val_loss: 0.0311779 | Time: 4140.8 ms [2022-04-08 09:43:03 main:574] : INFO : Epoch 1687 | loss: 0.0311586 | val_loss: 0.0311749 | Time: 3960.05 ms [2022-04-08 09:43:07 main:574] : INFO : Epoch 1688 | loss: 0.0311592 | val_loss: 0.0311754 | Time: 4003.78 ms [2022-04-08 09:43:11 main:574] : INFO : Epoch 1689 | loss: 0.0311584 | val_loss: 0.0311771 | Time: 4007.14 ms [2022-04-08 09:43:15 main:574] : INFO : Epoch 1690 | loss: 0.0311584 | val_loss: 0.0311755 | Time: 4042 ms [2022-04-08 09:43:19 main:574] : INFO : Epoch 1691 | loss: 0.0311586 | val_loss: 0.0311729 | Time: 3946.61 ms [2022-04-08 09:43:23 main:574] : INFO : Epoch 1692 | loss: 0.0311582 | val_loss: 0.0311756 | Time: 4052.93 ms [2022-04-08 09:43:27 main:574] : INFO : Epoch 1693 | loss: 0.0311615 | val_loss: 0.0311725 | Time: 3960.93 ms [2022-04-08 09:43:31 main:574] : INFO : Epoch 1694 | loss: 0.0311704 | val_loss: 0.0311723 | Time: 4004.44 ms [2022-04-08 09:43:35 main:574] : INFO : Epoch 1695 | loss: 0.0311721 | val_loss: 0.0311734 | Time: 4027 ms [2022-04-08 09:43:39 main:574] : INFO : Epoch 1696 | loss: 0.0311697 | val_loss: 0.0311744 | Time: 4004.08 ms [2022-04-08 09:43:43 main:574] : INFO : Epoch 1697 | loss: 0.0311682 | val_loss: 0.0311728 | Time: 3974.48 ms [2022-04-08 09:43:47 main:574] : INFO : Epoch 1698 | loss: 0.0311656 | val_loss: 0.031172 | Time: 4056.62 ms [2022-04-08 09:43:51 main:574] : INFO : Epoch 1699 | loss: 0.0311645 | val_loss: 0.0311735 | Time: 4174.11 ms [2022-04-08 09:43:55 main:574] : INFO : Epoch 1700 | loss: 0.0311654 | val_loss: 0.0311725 | Time: 4042.6 ms [2022-04-08 09:44:00 main:574] : INFO : Epoch 1701 | loss: 0.0311716 | val_loss: 0.0311834 | Time: 4091.88 ms [2022-04-08 09:44:04 main:574] : INFO : Epoch 1702 | loss: 0.0311728 | val_loss: 0.0311756 | Time: 4265.15 ms [2022-04-08 09:44:08 main:574] : INFO : Epoch 1703 | loss: 0.0311669 | val_loss: 0.0311788 | Time: 3992.92 ms [2022-04-08 09:44:12 main:574] : INFO : Epoch 1704 | loss: 0.0311644 | val_loss: 0.0311765 | Time: 3946.52 ms [2022-04-08 09:44:16 main:574] : INFO : Epoch 1705 | loss: 0.0311638 | val_loss: 0.031175 | Time: 3955.2 ms [2022-04-08 09:44:20 main:574] : INFO : Epoch 1706 | loss: 0.0311645 | val_loss: 0.0311743 | Time: 3991.81 ms [2022-04-08 09:44:24 main:574] : INFO : Epoch 1707 | loss: 0.0311638 | val_loss: 0.0311732 | Time: 3949.04 ms [2022-04-08 09:44:28 main:574] : INFO : Epoch 1708 | loss: 0.0311629 | val_loss: 0.0311746 | Time: 3996.15 ms [2022-04-08 09:44:32 main:574] : INFO : Epoch 1709 | loss: 0.0311627 | val_loss: 0.0311778 | Time: 3942.02 ms [2022-04-08 09:44:36 main:574] : INFO : Epoch 1710 | loss: 0.0311622 | val_loss: 0.0311738 | Time: 3987.71 ms [2022-04-08 09:44:40 main:574] : INFO : Epoch 1711 | loss: 0.0311635 | val_loss: 0.0311725 | Time: 4047.68 ms [2022-04-08 09:44:44 main:574] : INFO : Epoch 1712 | loss: 0.0311599 | val_loss: 0.0311741 | Time: 4118 ms [2022-04-08 09:44:48 main:574] : INFO : Epoch 1713 | loss: 0.0311603 | val_loss: 0.0311726 | Time: 3862.32 ms [2022-04-08 09:44:52 main:574] : INFO : Epoch 1714 | loss: 0.0311608 | val_loss: 0.0311758 | Time: 3958.31 ms [2022-04-08 09:44:56 main:574] : INFO : Epoch 1715 | loss: 0.0311641 | val_loss: 0.0311727 | Time: 3969.83 ms [2022-04-08 09:44:59 main:574] : INFO : Epoch 1716 | loss: 0.0311642 | val_loss: 0.0311759 | Time: 3925.28 ms [2022-04-08 09:45:04 main:574] : INFO : Epoch 1717 | loss: 0.0311644 | val_loss: 0.0311757 | Time: 4075.5 ms [2022-04-08 09:45:08 main:574] : INFO : Epoch 1718 | loss: 0.0311632 | val_loss: 0.0311709 | Time: 4036.25 ms [2022-04-08 09:45:12 main:574] : INFO : Epoch 1719 | loss: 0.0311622 | val_loss: 0.0311726 | Time: 4069.06 ms [2022-04-08 09:45:16 main:574] : INFO : Epoch 1720 | loss: 0.0311643 | val_loss: 0.0311717 | Time: 4011.98 ms [2022-04-08 09:45:20 main:574] : INFO : Epoch 1721 | loss: 0.0311636 | val_loss: 0.0311727 | Time: 4058.71 ms [2022-04-08 09:45:24 main:574] : INFO : Epoch 1722 | loss: 0.0311635 | val_loss: 0.0311734 | Time: 4007.04 ms [2022-04-08 09:45:28 main:574] : INFO : Epoch 1723 | loss: 0.0311623 | val_loss: 0.0311732 | Time: 4060.75 ms [2022-04-08 09:45:32 main:574] : INFO : Epoch 1724 | loss: 0.0311611 | val_loss: 0.0311712 | Time: 4161.49 ms [2022-04-08 09:45:36 main:574] : INFO : Epoch 1725 | loss: 0.0311605 | val_loss: 0.0311749 | Time: 4034.69 ms [2022-04-08 09:45:40 main:574] : INFO : Epoch 1726 | loss: 0.0311611 | val_loss: 0.0311736 | Time: 4084.24 ms [2022-04-08 09:45:44 main:574] : INFO : Epoch 1727 | loss: 0.0311595 | val_loss: 0.0311721 | Time: 4119.24 ms [2022-04-08 09:45:48 main:574] : INFO : Epoch 1728 | loss: 0.0311602 | val_loss: 0.0311739 | Time: 4061.49 ms [2022-04-08 09:45:52 main:574] : INFO : Epoch 1729 | loss: 0.0311594 | val_loss: 0.0311771 | Time: 4110.37 ms [2022-04-08 09:45:56 main:574] : INFO : Epoch 1730 | loss: 0.0311616 | val_loss: 0.0311744 | Time: 4036.62 ms [2022-04-08 09:46:00 main:574] : INFO : Epoch 1731 | loss: 0.0311649 | val_loss: 0.0311744 | Time: 4016.59 ms [2022-04-08 09:46:04 main:574] : INFO : Epoch 1732 | loss: 0.0311658 | val_loss: 0.0311729 | Time: 4020.95 ms [2022-04-08 09:46:08 main:574] : INFO : Epoch 1733 | loss: 0.0311606 | val_loss: 0.0311749 | Time: 3956.93 ms [2022-04-08 09:46:12 main:574] : INFO : Epoch 1734 | loss: 0.0311597 | val_loss: 0.0311709 | Time: 4049.38 ms [2022-04-08 09:46:16 main:574] : INFO : Epoch 1735 | loss: 0.0311604 | val_loss: 0.0311736 | Time: 3909.43 ms [2022-04-08 09:46:20 main:574] : INFO : Epoch 1736 | loss: 0.0311622 | val_loss: 0.0311725 | Time: 4019.24 ms [2022-04-08 09:46:24 main:574] : INFO : Epoch 1737 | loss: 0.0311618 | val_loss: 0.0311742 | Time: 4049.3 ms [2022-04-08 09:46:28 main:574] : INFO : Epoch 1738 | loss: 0.0311657 | val_loss: 0.0311747 | Time: 4007.82 ms [2022-04-08 09:46:33 main:574] : INFO : Epoch 1739 | loss: 0.0311659 | val_loss: 0.0311815 | Time: 4048.03 ms [2022-04-08 09:46:37 main:574] : INFO : Epoch 1740 | loss: 0.0311664 | val_loss: 0.0311801 | Time: 4033.34 ms [2022-04-08 09:46:41 main:574] : INFO : Epoch 1741 | loss: 0.0311659 | val_loss: 0.0311745 | Time: 4062.07 ms [2022-04-08 09:46:45 main:574] : INFO : Epoch 1742 | loss: 0.0311639 | val_loss: 0.031177 | Time: 3990.47 ms [2022-04-08 09:46:49 main:574] : INFO : Epoch 1743 | loss: 0.0311622 | val_loss: 0.0311749 | Time: 4064.33 ms [2022-04-08 09:46:53 main:574] : INFO : Epoch 1744 | loss: 0.0311617 | val_loss: 0.0311736 | Time: 3866.15 ms [2022-04-08 09:46:56 main:574] : INFO : Epoch 1745 | loss: 0.0311607 | val_loss: 0.0311726 | Time: 3727.4 ms [2022-04-08 09:47:00 main:574] : INFO : Epoch 1746 | loss: 0.0311604 | val_loss: 0.0311733 | Time: 3734.95 ms [2022-04-08 09:47:04 main:574] : INFO : Epoch 1747 | loss: 0.0311595 | val_loss: 0.0311752 | Time: 3563.67 ms [2022-04-08 09:47:07 main:574] : INFO : Epoch 1748 | loss: 0.0311597 | val_loss: 0.0311764 | Time: 3761.21 ms [2022-04-08 09:47:11 main:574] : INFO : Epoch 1749 | loss: 0.0311642 | val_loss: 0.0311834 | Time: 3733.87 ms [2022-04-08 09:47:15 main:574] : INFO : Epoch 1750 | loss: 0.0311631 | val_loss: 0.0311807 | Time: 3684.98 ms [2022-04-08 09:47:18 main:574] : INFO : Epoch 1751 | loss: 0.0311632 | val_loss: 0.0311823 | Time: 3703.7 ms [2022-04-08 09:47:22 main:574] : INFO : Epoch 1752 | loss: 0.0311615 | val_loss: 0.031179 | Time: 3624.45 ms [2022-04-08 09:47:26 main:574] : INFO : Epoch 1753 | loss: 0.0311618 | val_loss: 0.0311772 | Time: 3744.41 ms [2022-04-08 09:47:29 main:574] : INFO : Epoch 1754 | loss: 0.0311612 | val_loss: 0.0311779 | Time: 3554.82 ms [2022-04-08 09:47:33 main:574] : INFO : Epoch 1755 | loss: 0.0311629 | val_loss: 0.0311819 | Time: 3614.72 ms [2022-04-08 09:47:37 main:574] : INFO : Epoch 1756 | loss: 0.0311631 | val_loss: 0.0311787 | Time: 3631.86 ms [2022-04-08 09:47:40 main:574] : INFO : Epoch 1757 | loss: 0.0311647 | val_loss: 0.031175 | Time: 3630.84 ms [2022-04-08 09:47:44 main:574] : INFO : Epoch 1758 | loss: 0.0311764 | val_loss: 0.031199 | Time: 3626.69 ms [2022-04-08 09:47:48 main:574] : INFO : Epoch 1759 | loss: 0.0311746 | val_loss: 0.0311769 | Time: 3677.89 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 2070) [2022-04-08 09:50:49 main:435] : INFO : Set logging level to 1 [2022-04-08 09:50:49 main:441] : INFO : Running in BOINC Client mode [2022-04-08 09:50:49 main:444] : INFO : Resolving all filenames [2022-04-08 09:50:49 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-08 09:50:49 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-08 09:50:49 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-08 09:50:49 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-08 09:50:49 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-08 09:50:49 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-08 09:50:49 main:474] : INFO : Configuration: [2022-04-08 09:50:49 main:475] : INFO : Model type: GRU [2022-04-08 09:50:49 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-08 09:50:49 main:477] : INFO : Max Epochs: 2048 [2022-04-08 09:50:49 main:478] : INFO : Batch Size: 128 [2022-04-08 09:50:49 main:479] : INFO : Learning Rate: 0.01 [2022-04-08 09:50:49 main:480] : INFO : Patience: 10 [2022-04-08 09:50:49 main:481] : INFO : Hidden Width: 12 [2022-04-08 09:50:49 main:482] : INFO : # Recurrent Layers: 4 [2022-04-08 09:50:49 main:483] : INFO : # Backend Layers: 4 [2022-04-08 09:50:49 main:484] : INFO : # Threads: 1 [2022-04-08 09:50:49 main:486] : INFO : Preparing Dataset [2022-04-08 09:50:49 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-08 09:50:49 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-08 09:50:50 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-08 09:50:50 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-08 09:50:50 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-08 09:50:50 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-08 09:50:50 main:494] : INFO : Creating Model [2022-04-08 09:50:50 main:507] : INFO : Preparing config file [2022-04-08 09:50:50 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-08 09:50:50 main:512] : INFO : Loading config [2022-04-08 09:50:50 main:514] : INFO : Loading state [2022-04-08 09:50:51 main:559] : INFO : Loading DataLoader into Memory [2022-04-08 09:50:51 main:562] : INFO : Starting Training [2022-04-08 09:50:54 main:574] : INFO : Epoch 1747 | loss: 0.0312708 | val_loss: 0.0311828 | Time: 3323.5 ms [2022-04-08 09:50:58 main:574] : INFO : Epoch 1748 | loss: 0.0311763 | val_loss: 0.0311779 | Time: 3186.12 ms [2022-04-08 09:51:01 main:574] : INFO : Epoch 1749 | loss: 0.0311637 | val_loss: 0.0311779 | Time: 3118.83 ms [2022-04-08 09:51:04 main:574] : INFO : Epoch 1750 | loss: 0.0311638 | val_loss: 0.0311797 | Time: 3175.16 ms [2022-04-08 09:51:07 main:574] : INFO : Epoch 1751 | loss: 0.0311612 | val_loss: 0.0311716 | Time: 3097.09 ms [2022-04-08 09:51:10 main:574] : INFO : Epoch 1752 | loss: 0.0311616 | val_loss: 0.0311742 | Time: 3349.7 ms [2022-04-08 09:51:14 main:574] : INFO : Epoch 1753 | loss: 0.0311625 | val_loss: 0.0311716 | Time: 3621.45 ms [2022-04-08 09:51:18 main:574] : INFO : Epoch 1754 | loss: 0.0311609 | val_loss: 0.0311719 | Time: 3715.01 ms [2022-04-08 09:51:21 main:574] : INFO : Epoch 1755 | loss: 0.0311605 | val_loss: 0.0311743 | Time: 3751.38 ms [2022-04-08 09:51:25 main:574] : INFO : Epoch 1756 | loss: 0.03116 | val_loss: 0.0311741 | Time: 3794.43 ms [2022-04-08 09:51:29 main:574] : INFO : Epoch 1757 | loss: 0.0311597 | val_loss: 0.031172 | Time: 3851.87 ms [2022-04-08 09:51:33 main:574] : INFO : Epoch 1758 | loss: 0.031159 | val_loss: 0.0311778 | Time: 3850.75 ms [2022-04-08 09:51:37 main:574] : INFO : Epoch 1759 | loss: 0.0311586 | val_loss: 0.031173 | Time: 3871.42 ms [2022-04-08 09:51:41 main:574] : INFO : Epoch 1760 | loss: 0.0311584 | val_loss: 0.0311733 | Time: 3843.89 ms [2022-04-08 09:51:44 main:574] : INFO : Epoch 1761 | loss: 0.0311584 | val_loss: 0.0311735 | Time: 3856.72 ms [2022-04-08 09:51:48 main:574] : INFO : Epoch 1762 | loss: 0.0311573 | val_loss: 0.0311749 | Time: 3905.9 ms [2022-04-08 09:51:52 main:574] : INFO : Epoch 1763 | loss: 0.0311573 | val_loss: 0.0311763 | Time: 3884.22 ms [2022-04-08 09:51:56 main:574] : INFO : Epoch 1764 | loss: 0.0311585 | val_loss: 0.0311745 | Time: 3848.48 ms [2022-04-08 09:52:00 main:574] : INFO : Epoch 1765 | loss: 0.031158 | val_loss: 0.0311751 | Time: 3828.43 ms [2022-04-08 09:52:04 main:574] : INFO : Epoch 1766 | loss: 0.0311581 | val_loss: 0.0311749 | Time: 3862.32 ms [2022-04-08 09:52:08 main:574] : INFO : Epoch 1767 | loss: 0.0311589 | val_loss: 0.0311748 | Time: 3770.45 ms [2022-04-08 09:52:11 main:574] : INFO : Epoch 1768 | loss: 0.0311595 | val_loss: 0.0311709 | Time: 3881.76 ms [2022-04-08 09:52:15 main:574] : INFO : Epoch 1769 | loss: 0.0311582 | val_loss: 0.0311748 | Time: 3860.54 ms [2022-04-08 09:52:19 main:574] : INFO : Epoch 1770 | loss: 0.0311572 | val_loss: 0.0311728 | Time: 3968.38 ms [2022-04-08 09:52:23 main:574] : INFO : Epoch 1771 | loss: 0.0311587 | val_loss: 0.0311713 | Time: 3878.72 ms [2022-04-08 09:52:27 main:574] : INFO : Epoch 1772 | loss: 0.0311596 | val_loss: 0.031173 | Time: 3946.63 ms [2022-04-08 09:52:31 main:574] : INFO : Epoch 1773 | loss: 0.0311592 | val_loss: 0.0311731 | Time: 3928.55 ms [2022-04-08 09:52:35 main:574] : INFO : Epoch 1774 | loss: 0.0311584 | val_loss: 0.0311743 | Time: 3793.89 ms [2022-04-08 09:52:39 main:574] : INFO : Epoch 1775 | loss: 0.0311597 | val_loss: 0.0311722 | Time: 3952.62 ms [2022-04-08 09:52:43 main:574] : INFO : Epoch 1776 | loss: 0.0311602 | val_loss: 0.0311747 | Time: 3882.69 ms [2022-04-08 09:52:47 main:574] : INFO : Epoch 1777 | loss: 0.0311612 | val_loss: 0.0311731 | Time: 3918.54 ms [2022-04-08 09:52:50 main:574] : INFO : Epoch 1778 | loss: 0.0311621 | val_loss: 0.0311746 | Time: 3857.1 ms [2022-04-08 09:52:54 main:574] : INFO : Epoch 1779 | loss: 0.0311597 | val_loss: 0.0311729 | Time: 3829.31 ms [2022-04-08 09:52:58 main:574] : INFO : Epoch 1780 | loss: 0.0311582 | val_loss: 0.0311768 | Time: 3796.47 ms [2022-04-08 09:53:02 main:574] : INFO : Epoch 1781 | loss: 0.0311588 | val_loss: 0.0311723 | Time: 3806.5 ms [2022-04-08 09:53:06 main:574] : INFO : Epoch 1782 | loss: 0.0311588 | val_loss: 0.0311699 | Time: 3870.1 ms [2022-04-08 09:53:10 main:574] : INFO : Epoch 1783 | loss: 0.0311585 | val_loss: 0.0311773 | Time: 3862.84 ms [2022-04-08 09:53:14 main:574] : INFO : Epoch 1784 | loss: 0.0311608 | val_loss: 0.0311807 | Time: 3891.8 ms [2022-04-08 09:53:17 main:574] : INFO : Epoch 1785 | loss: 0.0311599 | val_loss: 0.0311792 | Time: 3926.27 ms [2022-04-08 09:53:21 main:574] : INFO : Epoch 1786 | loss: 0.0311624 | val_loss: 0.0311797 | Time: 4006.58 ms [2022-04-08 09:53:26 main:574] : INFO : Epoch 1787 | loss: 0.0311611 | val_loss: 0.0311811 | Time: 4222.51 ms [2022-04-08 09:53:30 main:574] : INFO : Epoch 1788 | loss: 0.0311589 | val_loss: 0.0311746 | Time: 4199.84 ms [2022-04-08 09:53:34 main:574] : INFO : Epoch 1789 | loss: 0.0311575 | val_loss: 0.0311745 | Time: 4207.04 ms [2022-04-08 09:53:38 main:574] : INFO : Epoch 1790 | loss: 0.031159 | val_loss: 0.031176 | Time: 4203.29 ms [2022-04-08 09:53:42 main:574] : INFO : Epoch 1791 | loss: 0.0311587 | val_loss: 0.0311784 | Time: 4202.69 ms [2022-04-08 09:53:47 main:574] : INFO : Epoch 1792 | loss: 0.0311576 | val_loss: 0.0311733 | Time: 4188.1 ms [2022-04-08 09:53:51 main:574] : INFO : Epoch 1793 | loss: 0.0311593 | val_loss: 0.0311761 | Time: 4230.2 ms [2022-04-08 09:53:55 main:574] : INFO : Epoch 1794 | loss: 0.0311604 | val_loss: 0.031176 | Time: 4257.96 ms [2022-04-08 09:53:59 main:574] : INFO : Epoch 1795 | loss: 0.0311588 | val_loss: 0.0311752 | Time: 4206.01 ms [2022-04-08 09:54:04 main:574] : INFO : Epoch 1796 | loss: 0.0311578 | val_loss: 0.031177 | Time: 4234.85 ms [2022-04-08 09:54:08 main:574] : INFO : Epoch 1797 | loss: 0.0311578 | val_loss: 0.0311739 | Time: 4326.44 ms [2022-04-08 09:54:12 main:574] : INFO : Epoch 1798 | loss: 0.0311578 | val_loss: 0.0311755 | Time: 4201.11 ms [2022-04-08 09:54:16 main:574] : INFO : Epoch 1799 | loss: 0.0311552 | val_loss: 0.0311721 | Time: 4202.15 ms [2022-04-08 09:54:21 main:574] : INFO : Epoch 1800 | loss: 0.0311558 | val_loss: 0.0311795 | Time: 4169.38 ms [2022-04-08 09:54:25 main:574] : INFO : Epoch 1801 | loss: 0.0311584 | val_loss: 0.0311799 | Time: 4161.8 ms [2022-04-08 09:54:29 main:574] : INFO : Epoch 1802 | loss: 0.0311579 | val_loss: 0.0311765 | Time: 4125.8 ms [2022-04-08 09:54:33 main:574] : INFO : Epoch 1803 | loss: 0.0311544 | val_loss: 0.0311747 | Time: 4143.84 ms [2022-04-08 09:54:37 main:574] : INFO : Epoch 1804 | loss: 0.0311543 | val_loss: 0.0311741 | Time: 4146.45 ms [2022-04-08 09:54:41 main:574] : INFO : Epoch 1805 | loss: 0.0311565 | val_loss: 0.0311768 | Time: 4162.73 ms [2022-04-08 09:54:46 main:574] : INFO : Epoch 1806 | loss: 0.0311564 | val_loss: 0.031177 | Time: 4249.97 ms [2022-04-08 09:54:50 main:574] : INFO : Epoch 1807 | loss: 0.0311566 | val_loss: 0.031175 | Time: 4180.39 ms [2022-04-08 09:54:54 main:574] : INFO : Epoch 1808 | loss: 0.0311542 | val_loss: 0.0311746 | Time: 4190.66 ms [2022-04-08 09:54:58 main:574] : INFO : Epoch 1809 | loss: 0.0311555 | val_loss: 0.0311728 | Time: 4133.66 ms [2022-04-08 09:55:02 main:574] : INFO : Epoch 1810 | loss: 0.0311564 | val_loss: 0.0311738 | Time: 4182.92 ms [2022-04-08 09:55:06 main:574] : INFO : Epoch 1811 | loss: 0.0311575 | val_loss: 0.0311736 | Time: 4104.62 ms [2022-04-08 09:55:11 main:574] : INFO : Epoch 1812 | loss: 0.0311571 | val_loss: 0.0311728 | Time: 4204.05 ms [2022-04-08 09:55:15 main:574] : INFO : Epoch 1813 | loss: 0.0311571 | val_loss: 0.0311734 | Time: 4163.9 ms [2022-04-08 09:55:19 main:574] : INFO : Epoch 1814 | loss: 0.0311561 | val_loss: 0.0311749 | Time: 4192.43 ms [2022-04-08 09:55:23 main:574] : INFO : Epoch 1815 | loss: 0.0311554 | val_loss: 0.0311722 | Time: 4278.06 ms [2022-04-08 09:55:27 main:574] : INFO : Epoch 1816 | loss: 0.0311561 | val_loss: 0.0311766 | Time: 4306.23 ms [2022-04-08 09:55:32 main:574] : INFO : Epoch 1817 | loss: 0.0311591 | val_loss: 0.0311786 | Time: 4088.6 ms [2022-04-08 09:55:36 main:574] : INFO : Epoch 1818 | loss: 0.0311574 | val_loss: 0.0311746 | Time: 4246.27 ms [2022-04-08 09:55:40 main:574] : INFO : Epoch 1819 | loss: 0.0311556 | val_loss: 0.0311761 | Time: 4171.53 ms [2022-04-08 09:55:44 main:574] : INFO : Epoch 1820 | loss: 0.031156 | val_loss: 0.0311765 | Time: 4161.19 ms [2022-04-08 09:55:48 main:574] : INFO : Epoch 1821 | loss: 0.0311561 | val_loss: 0.0311745 | Time: 4181.17 ms [2022-04-08 09:55:53 main:574] : INFO : Epoch 1822 | loss: 0.0311549 | val_loss: 0.0311752 | Time: 4258.38 ms [2022-04-08 09:55:57 main:574] : INFO : Epoch 1823 | loss: 0.031155 | val_loss: 0.0311761 | Time: 4172.62 ms [2022-04-08 09:56:01 main:574] : INFO : Epoch 1824 | loss: 0.0311559 | val_loss: 0.0311738 | Time: 4171.62 ms [2022-04-08 09:56:05 main:574] : INFO : Epoch 1825 | loss: 0.0311549 | val_loss: 0.0311786 | Time: 4207.81 ms [2022-04-08 09:56:09 main:574] : INFO : Epoch 1826 | loss: 0.0311551 | val_loss: 0.0311757 | Time: 4165.8 ms [2022-04-08 09:56:14 main:574] : INFO : Epoch 1827 | loss: 0.0311564 | val_loss: 0.0311722 | Time: 4169.62 ms [2022-04-08 09:56:18 main:574] : INFO : Epoch 1828 | loss: 0.0311568 | val_loss: 0.0311727 | Time: 4237.7 ms [2022-04-08 09:56:22 main:574] : INFO : Epoch 1829 | loss: 0.0311549 | val_loss: 0.0311755 | Time: 4236.73 ms [2022-04-08 09:56:26 main:574] : INFO : Epoch 1830 | loss: 0.0311545 | val_loss: 0.0311697 | Time: 4265.65 ms [2022-04-08 09:56:31 main:574] : INFO : Epoch 1831 | loss: 0.0311561 | val_loss: 0.0311763 | Time: 4270.79 ms [2022-04-08 09:56:35 main:574] : INFO : Epoch 1832 | loss: 0.0311555 | val_loss: 0.0311747 | Time: 4255.3 ms [2022-04-08 09:56:39 main:574] : INFO : Epoch 1833 | loss: 0.0311549 | val_loss: 0.0311822 | Time: 4241.59 ms [2022-04-08 09:56:43 main:574] : INFO : Epoch 1834 | loss: 0.0311574 | val_loss: 0.0311736 | Time: 4287.33 ms [2022-04-08 09:56:48 main:574] : INFO : Epoch 1835 | loss: 0.0311548 | val_loss: 0.0311728 | Time: 4230.13 ms [2022-04-08 09:56:52 main:574] : INFO : Epoch 1836 | loss: 0.0311544 | val_loss: 0.0311721 | Time: 4310.55 ms [2022-04-08 09:56:56 main:574] : INFO : Epoch 1837 | loss: 0.031155 | val_loss: 0.0311749 | Time: 4290.48 ms [2022-04-08 09:57:00 main:574] : INFO : Epoch 1838 | loss: 0.0311615 | val_loss: 0.0311738 | Time: 4211.71 ms [2022-04-08 09:57:05 main:574] : INFO : Epoch 1839 | loss: 0.0311611 | val_loss: 0.0311731 | Time: 4232.84 ms [2022-04-08 09:57:09 main:574] : INFO : Epoch 1840 | loss: 0.0311623 | val_loss: 0.0311753 | Time: 4259.75 ms [2022-04-08 09:57:13 main:574] : INFO : Epoch 1841 | loss: 0.0311636 | val_loss: 0.0311744 | Time: 4219.78 ms [2022-04-08 09:57:17 main:574] : INFO : Epoch 1842 | loss: 0.0311615 | val_loss: 0.0311767 | Time: 4239.89 ms [2022-04-08 09:57:22 main:574] : INFO : Epoch 1843 | loss: 0.0311597 | val_loss: 0.0311729 | Time: 4194.57 ms [2022-04-08 09:57:26 main:574] : INFO : Epoch 1844 | loss: 0.0311605 | val_loss: 0.0311768 | Time: 4285.12 ms [2022-04-08 09:57:30 main:574] : INFO : Epoch 1845 | loss: 0.0311582 | val_loss: 0.0311738 | Time: 4239.87 ms [2022-04-08 09:57:34 main:574] : INFO : Epoch 1846 | loss: 0.0311584 | val_loss: 0.03117 | Time: 4268.45 ms [2022-04-08 09:57:38 main:574] : INFO : Epoch 1847 | loss: 0.0311577 | val_loss: 0.0311695 | Time: 4159.75 ms [2022-04-08 09:57:43 main:574] : INFO : Epoch 1848 | loss: 0.031159 | val_loss: 0.0311734 | Time: 4256.01 ms [2022-04-08 09:57:47 main:574] : INFO : Epoch 1849 | loss: 0.0311594 | val_loss: 0.0311782 | Time: 4309.02 ms [2022-04-08 09:57:51 main:574] : INFO : Epoch 1850 | loss: 0.0311577 | val_loss: 0.0311704 | Time: 4147.26 ms [2022-04-08 09:57:55 main:574] : INFO : Epoch 1851 | loss: 0.0311561 | val_loss: 0.0311706 | Time: 4273.3 ms [2022-04-08 09:58:00 main:574] : INFO : Epoch 1852 | loss: 0.0311556 | val_loss: 0.0311725 | Time: 4207.88 ms [2022-04-08 09:58:04 main:574] : INFO : Epoch 1853 | loss: 0.0311556 | val_loss: 0.0311724 | Time: 4267.38 ms [2022-04-08 09:58:08 main:574] : INFO : Epoch 1854 | loss: 0.031156 | val_loss: 0.0311738 | Time: 4207.54 ms [2022-04-08 09:58:12 main:574] : INFO : Epoch 1855 | loss: 0.0311587 | val_loss: 0.0311728 | Time: 4238.62 ms [2022-04-08 09:58:17 main:574] : INFO : Epoch 1856 | loss: 0.0311626 | val_loss: 0.0311718 | Time: 4212.79 ms [2022-04-08 09:58:21 main:574] : INFO : Epoch 1857 | loss: 0.0311645 | val_loss: 0.0311774 | Time: 4246.02 ms [2022-04-08 09:58:25 main:574] : INFO : Epoch 1858 | loss: 0.0311639 | val_loss: 0.0311764 | Time: 4286.41 ms [2022-04-08 09:58:29 main:574] : INFO : Epoch 1859 | loss: 0.0311624 | val_loss: 0.0311733 | Time: 4133.81 ms [2022-04-08 09:58:33 main:574] : INFO : Epoch 1860 | loss: 0.0311611 | val_loss: 0.0311763 | Time: 4189.04 ms [2022-04-08 09:58:38 main:574] : INFO : Epoch 1861 | loss: 0.0311607 | val_loss: 0.0311707 | Time: 4189.42 ms [2022-04-08 09:58:42 main:574] : INFO : Epoch 1862 | loss: 0.0311596 | val_loss: 0.0311739 | Time: 4184.69 ms [2022-04-08 09:58:46 main:574] : INFO : Epoch 1863 | loss: 0.0311596 | val_loss: 0.0311708 | Time: 4124.91 ms [2022-04-08 09:58:50 main:574] : INFO : Epoch 1864 | loss: 0.0311648 | val_loss: 0.0311727 | Time: 4165.86 ms [2022-04-08 09:58:54 main:574] : INFO : Epoch 1865 | loss: 0.0311644 | val_loss: 0.0311714 | Time: 4177.93 ms [2022-04-08 09:58:59 main:574] : INFO : Epoch 1866 | loss: 0.0311646 | val_loss: 0.0311721 | Time: 4253.32 ms [2022-04-08 09:59:03 main:574] : INFO : Epoch 1867 | loss: 0.0311627 | val_loss: 0.0311712 | Time: 4271.04 ms [2022-04-08 09:59:07 main:574] : INFO : Epoch 1868 | loss: 0.0311603 | val_loss: 0.0311701 | Time: 4269.35 ms [2022-04-08 09:59:11 main:574] : INFO : Epoch 1869 | loss: 0.0311606 | val_loss: 0.0311723 | Time: 4262.1 ms [2022-04-08 09:59:16 main:574] : INFO : Epoch 1870 | loss: 0.0311599 | val_loss: 0.0311702 | Time: 4290.96 ms [2022-04-08 09:59:20 main:574] : INFO : Epoch 1871 | loss: 0.0311593 | val_loss: 0.0311741 | Time: 4178.28 ms [2022-04-08 09:59:24 main:574] : INFO : Epoch 1872 | loss: 0.0311597 | val_loss: 0.0311715 | Time: 4214.82 ms [2022-04-08 09:59:28 main:574] : INFO : Epoch 1873 | loss: 0.0311598 | val_loss: 0.031173 | Time: 4226.43 ms [2022-04-08 09:59:33 main:574] : INFO : Epoch 1874 | loss: 0.0311626 | val_loss: 0.031176 | Time: 4244.79 ms [2022-04-08 09:59:37 main:574] : INFO : Epoch 1875 | loss: 0.0311617 | val_loss: 0.0311734 | Time: 4407.8 ms [2022-04-08 09:59:41 main:574] : INFO : Epoch 1876 | loss: 0.0311613 | val_loss: 0.0311749 | Time: 4256.1 ms [2022-04-08 09:59:45 main:574] : INFO : Epoch 1877 | loss: 0.0311616 | val_loss: 0.0311743 | Time: 4210.3 ms [2022-04-08 09:59:50 main:574] : INFO : Epoch 1878 | loss: 0.0311618 | val_loss: 0.0311778 | Time: 4318 ms [2022-04-08 09:59:54 main:574] : INFO : Epoch 1879 | loss: 0.0311625 | val_loss: 0.0311741 | Time: 4294.79 ms [2022-04-08 09:59:58 main:574] : INFO : Epoch 1880 | loss: 0.0311618 | val_loss: 0.0311736 | Time: 4243.76 ms [2022-04-08 10:00:03 main:574] : INFO : Epoch 1881 | loss: 0.0311606 | val_loss: 0.0311731 | Time: 4228.64 ms [2022-04-08 10:00:07 main:574] : INFO : Epoch 1882 | loss: 0.0311596 | val_loss: 0.0311737 | Time: 4214.21 ms [2022-04-08 10:00:11 main:574] : INFO : Epoch 1883 | loss: 0.0311611 | val_loss: 0.0311771 | Time: 4222.07 ms [2022-04-08 10:00:15 main:574] : INFO : Epoch 1884 | loss: 0.0311625 | val_loss: 0.0311745 | Time: 4313.99 ms [2022-04-08 10:00:20 main:574] : INFO : Epoch 1885 | loss: 0.0311605 | val_loss: 0.0311783 | Time: 4268.11 ms [2022-04-08 10:00:24 main:574] : INFO : Epoch 1886 | loss: 0.0311599 | val_loss: 0.0311776 | Time: 4261.35 ms [2022-04-08 10:00:28 main:574] : INFO : Epoch 1887 | loss: 0.0311613 | val_loss: 0.031176 | Time: 4350.23 ms [2022-04-08 10:00:32 main:574] : INFO : Epoch 1888 | loss: 0.0311603 | val_loss: 0.0311743 | Time: 4251.75 ms [2022-04-08 10:00:37 main:574] : INFO : Epoch 1889 | loss: 0.0311603 | val_loss: 0.0311768 | Time: 4154.27 ms [2022-04-08 10:00:41 main:574] : INFO : Epoch 1890 | loss: 0.0311615 | val_loss: 0.0311762 | Time: 4285.08 ms [2022-04-08 10:00:45 main:574] : INFO : Epoch 1891 | loss: 0.0311599 | val_loss: 0.031178 | Time: 4276.79 ms [2022-04-08 10:00:49 main:574] : INFO : Epoch 1892 | loss: 0.0311616 | val_loss: 0.031175 | Time: 4270.23 ms [2022-04-08 10:00:54 main:574] : INFO : Epoch 1893 | loss: 0.03116 | val_loss: 0.0311772 | Time: 4253.62 ms [2022-04-08 10:00:58 main:574] : INFO : Epoch 1894 | loss: 0.0311616 | val_loss: 0.0311749 | Time: 4347.8 ms [2022-04-08 10:01:02 main:574] : INFO : Epoch 1895 | loss: 0.0311594 | val_loss: 0.0311783 | Time: 4284.16 ms [2022-04-08 10:01:07 main:574] : INFO : Epoch 1896 | loss: 0.0311615 | val_loss: 0.0311758 | Time: 4322.77 ms [2022-04-08 10:01:11 main:574] : INFO : Epoch 1897 | loss: 0.0311621 | val_loss: 0.0311814 | Time: 4353.07 ms [2022-04-08 10:01:15 main:574] : INFO : Epoch 1898 | loss: 0.0311661 | val_loss: 0.0311808 | Time: 4239.9 ms [2022-04-08 10:01:20 main:574] : INFO : Epoch 1899 | loss: 0.0311613 | val_loss: 0.0311817 | Time: 4259.3 ms [2022-04-08 10:01:24 main:574] : INFO : Epoch 1900 | loss: 0.0311608 | val_loss: 0.0311804 | Time: 4187.86 ms [2022-04-08 10:01:28 main:574] : INFO : Epoch 1901 | loss: 0.0311583 | val_loss: 0.0311807 | Time: 4157.67 ms [2022-04-08 10:01:32 main:574] : INFO : Epoch 1902 | loss: 0.0311595 | val_loss: 0.0311759 | Time: 4134.27 ms [2022-04-08 10:01:36 main:574] : INFO : Epoch 1903 | loss: 0.031158 | val_loss: 0.0311776 | Time: 4244.34 ms [2022-04-08 10:01:40 main:574] : INFO : Epoch 1904 | loss: 0.0311565 | val_loss: 0.0311766 | Time: 4229.08 ms [2022-04-08 10:01:45 main:574] : INFO : Epoch 1905 | loss: 0.0311564 | val_loss: 0.0311797 | Time: 4171.59 ms [2022-04-08 10:01:49 main:574] : INFO : Epoch 1906 | loss: 0.0311563 | val_loss: 0.0311813 | Time: 4228.06 ms [2022-04-08 10:01:53 main:574] : INFO : Epoch 1907 | loss: 0.0311562 | val_loss: 0.0311796 | Time: 4175.6 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 2070) [2022-04-08 10:17:27 main:435] : INFO : Set logging level to 1 [2022-04-08 10:17:27 main:441] : INFO : Running in BOINC Client mode [2022-04-08 10:17:27 main:444] : INFO : Resolving all filenames [2022-04-08 10:17:27 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-08 10:17:27 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-08 10:17:27 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-08 10:17:27 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-08 10:17:27 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-08 10:17:27 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-08 10:17:27 main:474] : INFO : Configuration: [2022-04-08 10:17:27 main:475] : INFO : Model type: GRU [2022-04-08 10:17:27 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-08 10:17:27 main:477] : INFO : Max Epochs: 2048 [2022-04-08 10:17:27 main:478] : INFO : Batch Size: 128 [2022-04-08 10:17:27 main:479] : INFO : Learning Rate: 0.01 [2022-04-08 10:17:27 main:480] : INFO : Patience: 10 [2022-04-08 10:17:27 main:481] : INFO : Hidden Width: 12 [2022-04-08 10:17:27 main:482] : INFO : # Recurrent Layers: 4 [2022-04-08 10:17:27 main:483] : INFO : # Backend Layers: 4 [2022-04-08 10:17:27 main:484] : INFO : # Threads: 1 [2022-04-08 10:17:27 main:486] : INFO : Preparing Dataset [2022-04-08 10:17:27 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-08 10:17:27 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-08 10:17:28 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-08 10:17:28 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-08 10:17:28 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-08 10:17:28 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-08 10:17:28 main:494] : INFO : Creating Model [2022-04-08 10:17:28 main:507] : INFO : Preparing config file [2022-04-08 10:17:28 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-08 10:17:28 main:512] : INFO : Loading config [2022-04-08 10:17:28 main:514] : INFO : Loading state [2022-04-08 10:17:29 main:559] : INFO : Loading DataLoader into Memory [2022-04-08 10:17:29 main:562] : INFO : Starting Training [2022-04-08 10:17:32 main:574] : INFO : Epoch 1894 | loss: 0.0311887 | val_loss: 0.0311815 | Time: 2951.49 ms [2022-04-08 10:17:35 main:574] : INFO : Epoch 1895 | loss: 0.0311645 | val_loss: 0.0311816 | Time: 3005.85 ms [2022-04-08 10:17:38 main:574] : INFO : Epoch 1896 | loss: 0.0311601 | val_loss: 0.0311741 | Time: 2659.49 ms [2022-04-08 10:17:40 main:574] : INFO : Epoch 1897 | loss: 0.0311587 | val_loss: 0.0311761 | Time: 2695.57 ms [2022-04-08 10:17:43 main:574] : INFO : Epoch 1898 | loss: 0.0311581 | val_loss: 0.0311832 | Time: 2820.57 ms [2022-04-08 10:17:46 main:574] : INFO : Epoch 1899 | loss: 0.031158 | val_loss: 0.0311771 | Time: 2763.56 ms [2022-04-08 10:17:49 main:574] : INFO : Epoch 1900 | loss: 0.0311598 | val_loss: 0.0311767 | Time: 2937.49 ms [2022-04-08 10:17:52 main:574] : INFO : Epoch 1901 | loss: 0.0311622 | val_loss: 0.0311775 | Time: 3213.08 ms [2022-04-08 10:17:55 main:574] : INFO : Epoch 1902 | loss: 0.0311611 | val_loss: 0.031179 | Time: 3284.99 ms [2022-04-08 10:17:59 main:574] : INFO : Epoch 1903 | loss: 0.031163 | val_loss: 0.0311784 | Time: 3295.72 ms [2022-04-08 10:18:02 main:574] : INFO : Epoch 1904 | loss: 0.0311606 | val_loss: 0.0311725 | Time: 3506.25 ms [2022-04-08 10:18:06 main:574] : INFO : Epoch 1905 | loss: 0.0311588 | val_loss: 0.0311767 | Time: 3459.52 ms [2022-04-08 10:18:09 main:574] : INFO : Epoch 1906 | loss: 0.0311594 | val_loss: 0.0311743 | Time: 3355.87 ms [2022-04-08 10:18:12 main:574] : INFO : Epoch 1907 | loss: 0.0311634 | val_loss: 0.031175 | Time: 3482.77 ms [2022-04-08 10:18:16 main:574] : INFO : Epoch 1908 | loss: 0.0311625 | val_loss: 0.0311758 | Time: 3546.21 ms [2022-04-08 10:18:20 main:574] : INFO : Epoch 1909 | loss: 0.0311607 | val_loss: 0.0311757 | Time: 3522.6 ms [2022-04-08 10:18:23 main:574] : INFO : Epoch 1910 | loss: 0.0311597 | val_loss: 0.031175 | Time: 3399.05 ms [2022-04-08 10:18:27 main:574] : INFO : Epoch 1911 | loss: 0.0311601 | val_loss: 0.0311724 | Time: 3607.67 ms [2022-04-08 10:18:30 main:574] : INFO : Epoch 1912 | loss: 0.0311608 | val_loss: 0.0311753 | Time: 3769.65 ms [2022-04-08 10:18:34 main:574] : INFO : Epoch 1913 | loss: 0.0311584 | val_loss: 0.0311764 | Time: 3778.84 ms [2022-04-08 10:18:38 main:574] : INFO : Epoch 1914 | loss: 0.0311624 | val_loss: 0.0311798 | Time: 3793.25 ms [2022-04-08 10:18:42 main:574] : INFO : Epoch 1915 | loss: 0.0311623 | val_loss: 0.0311761 | Time: 3793.8 ms [2022-04-08 10:18:46 main:574] : INFO : Epoch 1916 | loss: 0.0311603 | val_loss: 0.031176 | Time: 3850.12 ms [2022-04-08 10:18:49 main:574] : INFO : Epoch 1917 | loss: 0.0311585 | val_loss: 0.0311726 | Time: 3811.14 ms [2022-04-08 10:18:53 main:574] : INFO : Epoch 1918 | loss: 0.0311578 | val_loss: 0.0311762 | Time: 3843.67 ms [2022-04-08 10:18:57 main:574] : INFO : Epoch 1919 | loss: 0.0311571 | val_loss: 0.031172 | Time: 3884.99 ms [2022-04-08 10:19:01 main:574] : INFO : Epoch 1920 | loss: 0.0311569 | val_loss: 0.0311729 | Time: 3827.04 ms [2022-04-08 10:19:05 main:574] : INFO : Epoch 1921 | loss: 0.0311573 | val_loss: 0.0311723 | Time: 3847.34 ms [2022-04-08 10:19:09 main:574] : INFO : Epoch 1922 | loss: 0.0311579 | val_loss: 0.0311767 | Time: 3761.11 ms [2022-04-08 10:19:12 main:574] : INFO : Epoch 1923 | loss: 0.0311571 | val_loss: 0.0311732 | Time: 3826.62 ms [2022-04-08 10:19:16 main:574] : INFO : Epoch 1924 | loss: 0.0311567 | val_loss: 0.0311722 | Time: 3799.24 ms [2022-04-08 10:19:20 main:574] : INFO : Epoch 1925 | loss: 0.0311561 | val_loss: 0.0311758 | Time: 3844.92 ms [2022-04-08 10:19:24 main:574] : INFO : Epoch 1926 | loss: 0.0311563 | val_loss: 0.0311747 | Time: 3694.61 ms [2022-04-08 10:19:28 main:574] : INFO : Epoch 1927 | loss: 0.0311567 | val_loss: 0.0311736 | Time: 3843.03 ms [2022-04-08 10:19:31 main:574] : INFO : Epoch 1928 | loss: 0.031162 | val_loss: 0.0311759 | Time: 3894.21 ms [2022-04-08 10:19:35 main:574] : INFO : Epoch 1929 | loss: 0.0311606 | val_loss: 0.0311745 | Time: 3750.48 ms [2022-04-08 10:19:39 main:574] : INFO : Epoch 1930 | loss: 0.0311575 | val_loss: 0.0311778 | Time: 3759.77 ms [2022-04-08 10:19:43 main:574] : INFO : Epoch 1931 | loss: 0.0311572 | val_loss: 0.0311747 | Time: 3841.86 ms [2022-04-08 10:19:47 main:574] : INFO : Epoch 1932 | loss: 0.031158 | val_loss: 0.0311735 | Time: 3873.09 ms [2022-04-08 10:19:50 main:574] : INFO : Epoch 1933 | loss: 0.031161 | val_loss: 0.0311768 | Time: 3780.59 ms [2022-04-08 10:19:54 main:574] : INFO : Epoch 1934 | loss: 0.03116 | val_loss: 0.0311743 | Time: 3898.02 ms [2022-04-08 10:19:58 main:574] : INFO : Epoch 1935 | loss: 0.0311597 | val_loss: 0.03118 | Time: 3884.05 ms [2022-04-08 10:20:02 main:574] : INFO : Epoch 1936 | loss: 0.0311596 | val_loss: 0.0311741 | Time: 3772.44 ms [2022-04-08 10:20:06 main:574] : INFO : Epoch 1937 | loss: 0.031159 | val_loss: 0.0311752 | Time: 3889.95 ms [2022-04-08 10:20:10 main:574] : INFO : Epoch 1938 | loss: 0.0311564 | val_loss: 0.0311738 | Time: 3867.96 ms [2022-04-08 10:20:14 main:574] : INFO : Epoch 1939 | loss: 0.0311557 | val_loss: 0.0311742 | Time: 3851.06 ms [2022-04-08 10:20:18 main:574] : INFO : Epoch 1940 | loss: 0.0311549 | val_loss: 0.0311725 | Time: 3856.85 ms [2022-04-08 10:20:21 main:574] : INFO : Epoch 1941 | loss: 0.0311557 | val_loss: 0.0311766 | Time: 3954.02 ms [2022-04-08 10:20:25 main:574] : INFO : Epoch 1942 | loss: 0.0311572 | val_loss: 0.0311794 | Time: 3827.74 ms [2022-04-08 10:20:29 main:574] : INFO : Epoch 1943 | loss: 0.031158 | val_loss: 0.0311739 | Time: 3850.97 ms [2022-04-08 10:20:33 main:574] : INFO : Epoch 1944 | loss: 0.0311556 | val_loss: 0.031173 | Time: 3935.72 ms [2022-04-08 10:20:37 main:574] : INFO : Epoch 1945 | loss: 0.0311588 | val_loss: 0.0311729 | Time: 3838.66 ms [2022-04-08 10:20:41 main:574] : INFO : Epoch 1946 | loss: 0.031158 | val_loss: 0.0311794 | Time: 3902.91 ms [2022-04-08 10:20:45 main:574] : INFO : Epoch 1947 | loss: 0.0311581 | val_loss: 0.0311751 | Time: 3854.7 ms [2022-04-08 10:20:49 main:574] : INFO : Epoch 1948 | loss: 0.031158 | val_loss: 0.0311721 | Time: 3882.8 ms [2022-04-08 10:20:52 main:574] : INFO : Epoch 1949 | loss: 0.0311565 | val_loss: 0.0311744 | Time: 3783.16 ms [2022-04-08 10:20:56 main:574] : INFO : Epoch 1950 | loss: 0.0311548 | val_loss: 0.0311722 | Time: 3793.65 ms [2022-04-08 10:21:00 main:574] : INFO : Epoch 1951 | loss: 0.0311544 | val_loss: 0.0311735 | Time: 3807.57 ms [2022-04-08 10:21:04 main:574] : INFO : Epoch 1952 | loss: 0.0311539 | val_loss: 0.0311763 | Time: 3850.91 ms [2022-04-08 10:21:08 main:574] : INFO : Epoch 1953 | loss: 0.0311551 | val_loss: 0.0311786 | Time: 3815.08 ms [2022-04-08 10:21:12 main:574] : INFO : Epoch 1954 | loss: 0.031156 | val_loss: 0.0311807 | Time: 3906.77 ms [2022-04-08 10:21:15 main:574] : INFO : Epoch 1955 | loss: 0.0311568 | val_loss: 0.0311784 | Time: 3772.89 ms [2022-04-08 10:21:19 main:574] : INFO : Epoch 1956 | loss: 0.0311576 | val_loss: 0.0311743 | Time: 3886.92 ms [2022-04-08 10:21:23 main:574] : INFO : Epoch 1957 | loss: 0.031155 | val_loss: 0.0311758 | Time: 3927.56 ms [2022-04-08 10:21:27 main:574] : INFO : Epoch 1958 | loss: 0.0311552 | val_loss: 0.031173 | Time: 3777.46 ms [2022-04-08 10:21:31 main:574] : INFO : Epoch 1959 | loss: 0.0311557 | val_loss: 0.0311766 | Time: 3760.81 ms [2022-04-08 10:21:35 main:574] : INFO : Epoch 1960 | loss: 0.0311559 | val_loss: 0.0311761 | Time: 3910.01 ms [2022-04-08 10:21:38 main:574] : INFO : Epoch 1961 | loss: 0.0311558 | val_loss: 0.0311782 | Time: 3829.92 ms [2022-04-08 10:21:42 main:574] : INFO : Epoch 1962 | loss: 0.0311533 | val_loss: 0.031176 | Time: 3885.21 ms [2022-04-08 10:21:46 main:574] : INFO : Epoch 1963 | loss: 0.0311532 | val_loss: 0.0311754 | Time: 3845.74 ms [2022-04-08 10:21:50 main:574] : INFO : Epoch 1964 | loss: 0.0311527 | val_loss: 0.0311742 | Time: 3919.59 ms [2022-04-08 10:21:54 main:574] : INFO : Epoch 1965 | loss: 0.0311536 | val_loss: 0.0311736 | Time: 3773.76 ms [2022-04-08 10:21:58 main:574] : INFO : Epoch 1966 | loss: 0.0311541 | val_loss: 0.0311732 | Time: 3791.69 ms [2022-04-08 10:22:02 main:574] : INFO : Epoch 1967 | loss: 0.031155 | val_loss: 0.031171 | Time: 3836.04 ms [2022-04-08 10:22:05 main:574] : INFO : Epoch 1968 | loss: 0.0311525 | val_loss: 0.0311738 | Time: 3733.97 ms [2022-04-08 10:22:09 main:574] : INFO : Epoch 1969 | loss: 0.0311515 | val_loss: 0.0311709 | Time: 3842.86 ms [2022-04-08 10:22:13 main:574] : INFO : Epoch 1970 | loss: 0.031151 | val_loss: 0.0311723 | Time: 3848.86 ms [2022-04-08 10:22:17 main:574] : INFO : Epoch 1971 | loss: 0.0311516 | val_loss: 0.0311732 | Time: 3814.46 ms [2022-04-08 10:22:21 main:574] : INFO : Epoch 1972 | loss: 0.0311513 | val_loss: 0.0311767 | Time: 3812.45 ms [2022-04-08 10:22:25 main:574] : INFO : Epoch 1973 | loss: 0.0311529 | val_loss: 0.0311727 | Time: 3941.45 ms [2022-04-08 10:22:28 main:574] : INFO : Epoch 1974 | loss: 0.0311515 | val_loss: 0.0311766 | Time: 3925.44 ms [2022-04-08 10:22:32 main:574] : INFO : Epoch 1975 | loss: 0.0311515 | val_loss: 0.0311746 | Time: 3843.7 ms [2022-04-08 10:22:36 main:574] : INFO : Epoch 1976 | loss: 0.0311503 | val_loss: 0.0311744 | Time: 3843.55 ms [2022-04-08 10:22:40 main:574] : INFO : Epoch 1977 | loss: 0.0311501 | val_loss: 0.0311778 | Time: 3893.86 ms [2022-04-08 10:22:44 main:574] : INFO : Epoch 1978 | loss: 0.0311507 | val_loss: 0.0311744 | Time: 3809.16 ms [2022-04-08 10:22:48 main:574] : INFO : Epoch 1979 | loss: 0.0311505 | val_loss: 0.0311758 | Time: 3857.59 ms [2022-04-08 10:22:52 main:574] : INFO : Epoch 1980 | loss: 0.031152 | val_loss: 0.031175 | Time: 3864.44 ms [2022-04-08 10:22:55 main:574] : INFO : Epoch 1981 | loss: 0.0311501 | val_loss: 0.0311746 | Time: 3845.68 ms [2022-04-08 10:22:59 main:574] : INFO : Epoch 1982 | loss: 0.0311501 | val_loss: 0.0311717 | Time: 3825.92 ms [2022-04-08 10:23:03 main:574] : INFO : Epoch 1983 | loss: 0.0311513 | val_loss: 0.0311793 | Time: 3842.24 ms [2022-04-08 10:23:07 main:574] : INFO : Epoch 1984 | loss: 0.0311514 | val_loss: 0.0311741 | Time: 3850.73 ms [2022-04-08 10:23:11 main:574] : INFO : Epoch 1985 | loss: 0.0311497 | val_loss: 0.0311738 | Time: 3878.39 ms [2022-04-08 10:23:15 main:574] : INFO : Epoch 1986 | loss: 0.0311504 | val_loss: 0.0311767 | Time: 3852.99 ms [2022-04-08 10:23:19 main:574] : INFO : Epoch 1987 | loss: 0.0311505 | val_loss: 0.0311746 | Time: 3926.02 ms [2022-04-08 10:23:23 main:574] : INFO : Epoch 1988 | loss: 0.0311495 | val_loss: 0.0311732 | Time: 3990.42 ms [2022-04-08 10:23:27 main:574] : INFO : Epoch 1989 | loss: 0.0311498 | val_loss: 0.031173 | Time: 3941.75 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 2070) [2022-04-08 11:25:51 main:435] : INFO : Set logging level to 1 [2022-04-08 11:25:51 main:441] : INFO : Running in BOINC Client mode [2022-04-08 11:25:51 main:444] : INFO : Resolving all filenames [2022-04-08 11:25:51 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-04-08 11:25:51 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-04-08 11:25:51 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-04-08 11:25:51 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-04-08 11:25:51 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-04-08 11:25:51 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-04-08 11:25:51 main:474] : INFO : Configuration: [2022-04-08 11:25:51 main:475] : INFO : Model type: GRU [2022-04-08 11:25:51 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-04-08 11:25:51 main:477] : INFO : Max Epochs: 2048 [2022-04-08 11:25:51 main:478] : INFO : Batch Size: 128 [2022-04-08 11:25:51 main:479] : INFO : Learning Rate: 0.01 [2022-04-08 11:25:51 main:480] : INFO : Patience: 10 [2022-04-08 11:25:51 main:481] : INFO : Hidden Width: 12 [2022-04-08 11:25:51 main:482] : INFO : # Recurrent Layers: 4 [2022-04-08 11:25:51 main:483] : INFO : # Backend Layers: 4 [2022-04-08 11:25:51 main:484] : INFO : # Threads: 1 [2022-04-08 11:25:51 main:486] : INFO : Preparing Dataset [2022-04-08 11:25:51 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-04-08 11:25:51 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-04-08 11:34:33 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-04-08 11:34:33 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-04-08 11:34:34 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-04-08 11:34:34 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-04-08 11:34:34 main:494] : INFO : Creating Model [2022-04-08 11:34:34 main:507] : INFO : Preparing config file [2022-04-08 11:34:34 main:511] : INFO : Found checkpoint, attempting to load... [2022-04-08 11:34:34 main:512] : INFO : Loading config [2022-04-08 11:34:34 main:514] : INFO : Loading state [2022-04-08 11:35:42 main:559] : INFO : Loading DataLoader into Memory [2022-04-08 11:35:42 main:562] : INFO : Starting Training [2022-04-08 11:37:54 main:574] : INFO : Epoch 1982 | loss: 0.0311821 | val_loss: 0.0311805 | Time: 132261 ms [2022-04-08 11:40:27 main:574] : INFO : Epoch 1983 | loss: 0.0311561 | val_loss: 0.0311755 | Time: 152691 ms [2022-04-08 11:42:53 main:574] : INFO : Epoch 1984 | loss: 0.0311561 | val_loss: 0.0311787 | Time: 145125 ms [2022-04-08 11:50:38 main:574] : INFO : Epoch 1985 | loss: 0.0311534 | val_loss: 0.0311738 | Time: 464506 ms [2022-04-08 11:50:41 main:574] : INFO : Epoch 1986 | loss: 0.0311525 | val_loss: 0.031176 | Time: 3885.84 ms [2022-04-08 11:50:45 main:574] : INFO : Epoch 1987 | loss: 0.0311531 | val_loss: 0.0311801 | Time: 3732.89 ms [2022-04-08 11:50:49 main:574] : INFO : Epoch 1988 | loss: 0.0311543 | val_loss: 0.0311731 | Time: 3809.45 ms [2022-04-08 11:50:53 main:574] : INFO : Epoch 1989 | loss: 0.0311544 | val_loss: 0.031178 | Time: 3733.56 ms [2022-04-08 11:50:57 main:574] : INFO : Epoch 1990 | loss: 0.0311552 | val_loss: 0.0311733 | Time: 3826.14 ms [2022-04-08 11:51:00 main:574] : INFO : Epoch 1991 | loss: 0.0311557 | val_loss: 0.0311709 | Time: 3665.98 ms [2022-04-08 11:51:04 main:574] : INFO : Epoch 1992 | loss: 0.0311536 | val_loss: 0.031176 | Time: 3780.51 ms [2022-04-08 11:51:08 main:574] : INFO : Epoch 1993 | loss: 0.0311542 | val_loss: 0.0311736 | Time: 3670.4 ms [2022-04-08 11:51:11 main:574] : INFO : Epoch 1994 | loss: 0.0311538 | val_loss: 0.0311728 | Time: 3678.5 ms [2022-04-08 11:51:15 main:574] : INFO : Epoch 1995 | loss: 0.0311532 | val_loss: 0.0311768 | Time: 3779.24 ms [2022-04-08 11:51:19 main:574] : INFO : Epoch 1996 | loss: 0.0311546 | val_loss: 0.0311788 | Time: 3771.38 ms [2022-04-08 11:51:23 main:574] : INFO : Epoch 1997 | loss: 0.0311531 | val_loss: 0.031175 | Time: 3681.77 ms [2022-04-08 11:51:26 main:574] : INFO : Epoch 1998 | loss: 0.0311524 | val_loss: 0.03118 | Time: 3702.24 ms [2022-04-08 11:51:30 main:574] : INFO : Epoch 1999 | loss: 0.0311509 | val_loss: 0.031175 | Time: 3872.2 ms [2022-04-08 11:51:34 main:574] : INFO : Epoch 2000 | loss: 0.0311521 | val_loss: 0.0311723 | Time: 3781.55 ms [2022-04-08 11:51:38 main:574] : INFO : Epoch 2001 | loss: 0.0311546 | val_loss: 0.0311754 | Time: 3971.69 ms [2022-04-08 11:51:42 main:574] : INFO : Epoch 2002 | loss: 0.031154 | val_loss: 0.0311761 | Time: 3979.36 ms [2022-04-08 11:51:46 main:574] : INFO : Epoch 2003 | loss: 0.0311517 | val_loss: 0.0311728 | Time: 3944.52 ms [2022-04-08 11:51:50 main:574] : INFO : Epoch 2004 | loss: 0.031153 | val_loss: 0.0311748 | Time: 4030.63 ms [2022-04-08 11:51:54 main:574] : INFO : Epoch 2005 | loss: 0.0311515 | val_loss: 0.0311772 | Time: 4068.55 ms [2022-04-08 11:51:58 main:574] : INFO : Epoch 2006 | loss: 0.0311511 | val_loss: 0.0311753 | Time: 3889.94 ms [2022-04-08 11:52:02 main:574] : INFO : Epoch 2007 | loss: 0.031151 | val_loss: 0.0311767 | Time: 3891.6 ms [2022-04-08 11:52:06 main:574] : INFO : Epoch 2008 | loss: 0.0311526 | val_loss: 0.0311721 | Time: 4102.46 ms [2022-04-08 11:52:10 main:574] : INFO : Epoch 2009 | loss: 0.0311552 | val_loss: 0.031172 | Time: 4066.7 ms [2022-04-08 11:52:14 main:574] : INFO : Epoch 2010 | loss: 0.0311538 | val_loss: 0.0311724 | Time: 3985 ms [2022-04-08 11:52:18 main:574] : INFO : Epoch 2011 | loss: 0.031153 | val_loss: 0.0311728 | Time: 3965.75 ms [2022-04-08 11:52:22 main:574] : INFO : Epoch 2012 | loss: 0.0311538 | val_loss: 0.0311725 | Time: 3918.22 ms [2022-04-08 11:52:26 main:574] : INFO : Epoch 2013 | loss: 0.0311521 | val_loss: 0.031173 | Time: 3984.83 ms [2022-04-08 11:52:30 main:574] : INFO : Epoch 2014 | loss: 0.0311509 | val_loss: 0.0311731 | Time: 4085.28 ms [2022-04-08 11:52:34 main:574] : INFO : Epoch 2015 | loss: 0.0311532 | val_loss: 0.031174 | Time: 4013.69 ms [2022-04-08 11:52:38 main:574] : INFO : Epoch 2016 | loss: 0.0311534 | val_loss: 0.0311717 | Time: 3988.97 ms [2022-04-08 11:52:42 main:574] : INFO : Epoch 2017 | loss: 0.0311562 | val_loss: 0.0311759 | Time: 4008.49 ms [2022-04-08 11:52:46 main:574] : INFO : Epoch 2018 | loss: 0.031153 | val_loss: 0.0311773 | Time: 4000.24 ms [2022-04-08 11:52:50 main:574] : INFO : Epoch 2019 | loss: 0.0311546 | val_loss: 0.0311719 | Time: 3836.98 ms [2022-04-08 11:52:54 main:574] : INFO : Epoch 2020 | loss: 0.0311574 | val_loss: 0.031178 | Time: 3966.02 ms [2022-04-08 11:52:58 main:574] : INFO : Epoch 2021 | loss: 0.0311618 | val_loss: 0.0311774 | Time: 4000.36 ms [2022-04-08 11:53:02 main:574] : INFO : Epoch 2022 | loss: 0.0311591 | val_loss: 0.0311749 | Time: 3987.01 ms [2022-04-08 11:53:06 main:574] : INFO : Epoch 2023 | loss: 0.0311568 | val_loss: 0.0311777 | Time: 3913.69 ms [2022-04-08 11:53:10 main:574] : INFO : Epoch 2024 | loss: 0.0311574 | val_loss: 0.0311767 | Time: 3977.66 ms [2022-04-08 11:53:14 main:574] : INFO : Epoch 2025 | loss: 0.0311555 | val_loss: 0.0311749 | Time: 3972.95 ms [2022-04-08 11:53:17 main:574] : INFO : Epoch 2026 | loss: 0.031155 | val_loss: 0.0311743 | Time: 3901.39 ms [2022-04-08 11:53:22 main:574] : INFO : Epoch 2027 | loss: 0.0311547 | val_loss: 0.0311741 | Time: 4108.85 ms [2022-04-08 11:53:26 main:574] : INFO : Epoch 2028 | loss: 0.0311549 | val_loss: 0.0311747 | Time: 4020.52 ms [2022-04-08 11:53:29 main:574] : INFO : Epoch 2029 | loss: 0.0311568 | val_loss: 0.0311761 | Time: 3837.67 ms [2022-04-08 11:53:33 main:574] : INFO : Epoch 2030 | loss: 0.0311584 | val_loss: 0.0311769 | Time: 3928.29 ms [2022-04-08 11:53:37 main:574] : INFO : Epoch 2031 | loss: 0.0311612 | val_loss: 0.0311771 | Time: 3995.15 ms [2022-04-08 11:53:41 main:574] : INFO : Epoch 2032 | loss: 0.0311677 | val_loss: 0.0311742 | Time: 3963.93 ms [2022-04-08 11:53:45 main:574] : INFO : Epoch 2033 | loss: 0.0311659 | val_loss: 0.0311723 | Time: 4021.6 ms [2022-04-08 11:53:49 main:574] : INFO : Epoch 2034 | loss: 0.0311629 | val_loss: 0.0311714 | Time: 3909.07 ms [2022-04-08 11:53:53 main:574] : INFO : Epoch 2035 | loss: 0.0311613 | val_loss: 0.0311704 | Time: 4057.33 ms [2022-04-08 11:53:57 main:574] : INFO : Epoch 2036 | loss: 0.0311604 | val_loss: 0.031169 | Time: 4056.72 ms [2022-04-08 11:54:01 main:574] : INFO : Epoch 2037 | loss: 0.0311577 | val_loss: 0.0311692 | Time: 3998.07 ms [2022-04-08 11:54:05 main:574] : INFO : Epoch 2038 | loss: 0.0311573 | val_loss: 0.0311688 | Time: 3974.59 ms [2022-04-08 11:54:09 main:574] : INFO : Epoch 2039 | loss: 0.0311593 | val_loss: 0.0311691 | Time: 4047.57 ms [2022-04-08 11:54:14 main:574] : INFO : Epoch 2040 | loss: 0.0311572 | val_loss: 0.0311703 | Time: 4148.21 ms [2022-04-08 11:54:17 main:574] : INFO : Epoch 2041 | loss: 0.0311559 | val_loss: 0.0311699 | Time: 3944.08 ms [2022-04-08 11:54:21 main:574] : INFO : Epoch 2042 | loss: 0.0311547 | val_loss: 0.0311692 | Time: 3940.42 ms [2022-04-08 11:54:25 main:574] : INFO : Epoch 2043 | loss: 0.0311538 | val_loss: 0.0311693 | Time: 3981.46 ms [2022-04-08 11:54:29 main:574] : INFO : Epoch 2044 | loss: 0.031154 | val_loss: 0.0311708 | Time: 3920.79 ms [2022-04-08 11:54:33 main:574] : INFO : Epoch 2045 | loss: 0.0311539 | val_loss: 0.0311688 | Time: 3996.88 ms [2022-04-08 11:54:37 main:574] : INFO : Epoch 2046 | loss: 0.0311524 | val_loss: 0.0311735 | Time: 3966.82 ms [2022-04-08 11:54:41 main:574] : INFO : Epoch 2047 | loss: 0.0311533 | val_loss: 0.0311686 | Time: 4017.74 ms [2022-04-08 11:54:45 main:574] : INFO : Epoch 2048 | loss: 0.0311523 | val_loss: 0.0311728 | Time: 4022.15 ms [2022-04-08 11:54:45 main:597] : INFO : Saving trained model to model-final.pt, val_loss 0.0311728 [2022-04-08 11:54:45 main:603] : INFO : Saving end state to config to file [2022-04-08 11:54:45 main:608] : INFO : Success, exiting.. 11:54:45 (31464): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)