Task 12831902
| Name | ParityModified-1645991849-17523-2-0_0 |
| Workunit | 9976161 |
| Created | 9 Mar 2022, 16:18:54 UTC |
| Sent | 11 Mar 2022, 5:39:30 UTC |
| Report deadline | 19 Mar 2022, 5:39:30 UTC |
| Received | 28 Mar 2022, 11:47:53 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 12436 |
| Run time | 1 hours 23 min 34 sec |
| CPU time | 1 hours 22 min 9 sec |
| Validate state | Task was reported too late to validate |
| Credit | 0.00 |
| Device peak FLOPS | 2,470.64 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.63 GB |
| Peak swap size | 3.59 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version> <![CDATA[ <stderr_txt> O : Model type: GRU [2022-03-28 13:26:25 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-03-28 13:26:25 main:477] : INFO : Max Epochs: 2048 [2022-03-28 13:26:25 main:478] : INFO : Batch Size: 128 [2022-03-28 13:26:25 main:479] : INFO : Learning Rate: 0.01 [2022-03-28 13:26:25 main:480] : INFO : Patience: 10 [2022-03-28 13:26:25 main:481] : INFO : Hidden Width: 12 [2022-03-28 13:26:25 main:482] : INFO : # Recurrent Layers: 4 [2022-03-28 13:26:25 main:483] : INFO : # Backend Layers: 4 [2022-03-28 13:26:25 main:484] : INFO : # Threads: 1 [2022-03-28 13:26:25 main:486] : INFO : Preparing Dataset [2022-03-28 13:26:25 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-03-28 13:26:25 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-03-28 13:26:28 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-03-28 13:26:28 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-03-28 13:26:28 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-03-28 13:26:28 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-03-28 13:26:28 main:494] : INFO : Creating Model [2022-03-28 13:26:28 main:507] : INFO : Preparing config file [2022-03-28 13:26:28 main:511] : INFO : Found checkpoint, attempting to load... [2022-03-28 13:26:28 main:512] : INFO : Loading config [2022-03-28 13:26:28 main:514] : INFO : Loading state [2022-03-28 13:26:29 main:559] : INFO : Loading DataLoader into Memory [2022-03-28 13:26:29 main:562] : INFO : Starting Training [2022-03-28 13:26:31 main:574] : INFO : Epoch 1747 | loss: 0.0312217 | val_loss: 0.0311911 | Time: 2431.63 ms [2022-03-28 13:26:34 main:574] : INFO : Epoch 1748 | loss: 0.0311311 | val_loss: 0.0311612 | Time: 2254.12 ms [2022-03-28 13:26:36 main:574] : INFO : Epoch 1749 | loss: 0.0311202 | val_loss: 0.0311499 | Time: 2333.95 ms [2022-03-28 13:26:38 main:574] : INFO : Epoch 1750 | loss: 0.0311169 | val_loss: 0.0311539 | Time: 2322.66 ms [2022-03-28 13:26:41 main:574] : INFO : Epoch 1751 | loss: 0.0311148 | val_loss: 0.0311546 | Time: 2596.57 ms [2022-03-28 13:26:43 main:574] : INFO : Epoch 1752 | loss: 0.0311202 | val_loss: 0.0311516 | Time: 2470.74 ms [2022-03-28 13:26:46 main:574] : INFO : Epoch 1753 | loss: 0.0311159 | val_loss: 0.0311491 | Time: 2468.07 ms [2022-03-28 13:26:49 main:574] : INFO : Epoch 1754 | loss: 0.0311133 | val_loss: 0.0311491 | Time: 2928.04 ms [2022-03-28 13:26:52 main:574] : INFO : Epoch 1755 | loss: 0.031114 | val_loss: 0.0311502 | Time: 3035.86 ms [2022-03-28 13:26:54 main:574] : INFO : Epoch 1756 | loss: 0.0311129 | val_loss: 0.0311528 | Time: 2352.51 ms [2022-03-28 13:26:57 main:574] : INFO : Epoch 1757 | loss: 0.0311143 | val_loss: 0.0311487 | Time: 2819.1 ms [2022-03-28 13:27:00 main:574] : INFO : Epoch 1758 | loss: 0.0311162 | val_loss: 0.0311461 | Time: 2811.49 ms [2022-03-28 13:27:02 main:574] : INFO : Epoch 1759 | loss: 0.0311155 | val_loss: 0.0311536 | Time: 2380.37 ms [2022-03-28 13:27:05 main:574] : INFO : Epoch 1760 | loss: 0.031116 | val_loss: 0.0311537 | Time: 2731.56 ms [2022-03-28 13:27:08 main:574] : INFO : Epoch 1761 | loss: 0.0311134 | val_loss: 0.0311475 | Time: 2875.01 ms [2022-03-28 13:27:11 main:574] : INFO : Epoch 1762 | loss: 0.0311126 | val_loss: 0.0311516 | Time: 2632.15 ms [2022-03-28 13:27:14 main:574] : INFO : Epoch 1763 | loss: 0.0311134 | val_loss: 0.0311603 | Time: 2984.62 ms [2022-03-28 13:27:16 main:574] : INFO : Epoch 1764 | loss: 0.0311195 | val_loss: 0.031151 | Time: 2849.74 ms [2022-03-28 13:27:19 main:574] : INFO : Epoch 1765 | loss: 0.0311142 | val_loss: 0.0311481 | Time: 2368.92 ms [2022-03-28 13:27:22 main:574] : INFO : Epoch 1766 | loss: 0.0311124 | val_loss: 0.0311501 | Time: 2928.49 ms [2022-03-28 13:27:25 main:574] : INFO : Epoch 1767 | loss: 0.0311167 | val_loss: 0.0311565 | Time: 2801.08 ms [2022-03-28 13:27:38 main:574] : INFO : Epoch 1768 | loss: 0.0311126 | val_loss: 0.0311532 | Time: 13562.3 ms [2022-03-28 13:27:40 main:574] : INFO : Epoch 1769 | loss: 0.0311113 | val_loss: 0.0311504 | Time: 2303.35 ms [2022-03-28 13:27:43 main:574] : INFO : Epoch 1770 | loss: 0.0311116 | val_loss: 0.0311492 | Time: 2649.39 ms [2022-03-28 13:27:46 main:574] : INFO : Epoch 1771 | loss: 0.0311095 | val_loss: 0.0311498 | Time: 2644.72 ms [2022-03-28 13:27:48 main:574] : INFO : Epoch 1772 | loss: 0.0311101 | val_loss: 0.0311498 | Time: 2662.23 ms [2022-03-28 13:27:51 main:574] : INFO : Epoch 1773 | loss: 0.0311107 | val_loss: 0.031151 | Time: 2727.83 ms [2022-03-28 13:27:54 main:574] : INFO : Epoch 1774 | loss: 0.0311165 | val_loss: 0.0311464 | Time: 2582.1 ms [2022-03-28 13:27:56 main:574] : INFO : Epoch 1775 | loss: 0.0311162 | val_loss: 0.0311497 | Time: 2591.69 ms [2022-03-28 13:27:59 main:574] : INFO : Epoch 1776 | loss: 0.0311125 | val_loss: 0.0311498 | Time: 3097.79 ms [2022-03-28 13:28:02 main:574] : INFO : Epoch 1777 | loss: 0.0311155 | val_loss: 0.0311511 | Time: 2765.29 ms [2022-03-28 13:28:05 main:574] : INFO : Epoch 1778 | loss: 0.0311143 | val_loss: 0.0311503 | Time: 2461.38 ms [2022-03-28 13:28:07 main:574] : INFO : Epoch 1779 | loss: 0.0311135 | val_loss: 0.0311551 | Time: 2846.4 ms [2022-03-28 13:28:10 main:574] : INFO : Epoch 1780 | loss: 0.0311121 | val_loss: 0.0311548 | Time: 2620.52 ms [2022-03-28 13:28:13 main:574] : INFO : Epoch 1781 | loss: 0.0311121 | val_loss: 0.0311505 | Time: 2611.38 ms [2022-03-28 13:28:16 main:574] : INFO : Epoch 1782 | loss: 0.0311111 | val_loss: 0.0311527 | Time: 2920.51 ms [2022-03-28 13:28:19 main:574] : INFO : Epoch 1783 | loss: 0.0311116 | val_loss: 0.0311474 | Time: 2923.92 ms [2022-03-28 13:28:21 main:574] : INFO : Epoch 1784 | loss: 0.0311116 | val_loss: 0.0311491 | Time: 2422.53 ms [2022-03-28 13:28:24 main:574] : INFO : Epoch 1785 | loss: 0.0311136 | val_loss: 0.0311552 | Time: 2834.28 ms [2022-03-28 13:28:37 main:574] : INFO : Epoch 1786 | loss: 0.0311107 | val_loss: 0.0311479 | Time: 13137 ms [2022-03-28 13:28:40 main:574] : INFO : Epoch 1787 | loss: 0.0311072 | val_loss: 0.031151 | Time: 3419.91 ms [2022-03-28 13:28:43 main:574] : INFO : Epoch 1788 | loss: 0.0311074 | val_loss: 0.0311589 | Time: 2320.42 ms [2022-03-28 13:28:46 main:574] : INFO : Epoch 1789 | loss: 0.0311082 | val_loss: 0.031155 | Time: 2760.53 ms [2022-03-28 13:28:48 main:574] : INFO : Epoch 1790 | loss: 0.0311109 | val_loss: 0.03116 | Time: 2776.64 ms [2022-03-28 13:28:51 main:574] : INFO : Epoch 1791 | loss: 0.0311084 | val_loss: 0.0311556 | Time: 3000.17 ms [2022-03-28 13:28:54 main:574] : INFO : Epoch 1792 | loss: 0.0311107 | val_loss: 0.0311488 | Time: 3033.18 ms [2022-03-28 13:28:57 main:574] : INFO : Epoch 1793 | loss: 0.031109 | val_loss: 0.0311569 | Time: 2914.36 ms [2022-03-28 13:29:01 main:574] : INFO : Epoch 1794 | loss: 0.031107 | val_loss: 0.0311545 | Time: 3674.41 ms [2022-03-28 13:29:04 main:574] : INFO : Epoch 1795 | loss: 0.0311068 | val_loss: 0.031155 | Time: 2740.3 ms [2022-03-28 13:29:07 main:574] : INFO : Epoch 1796 | loss: 0.0311072 | val_loss: 0.0311511 | Time: 3150.24 ms [2022-03-28 13:29:10 main:574] : INFO : Epoch 1797 | loss: 0.0311077 | val_loss: 0.0311452 | Time: 2968.1 ms [2022-03-28 13:29:13 main:574] : INFO : Epoch 1798 | loss: 0.0311086 | val_loss: 0.0311467 | Time: 2996.77 ms [2022-03-28 13:29:15 main:574] : INFO : Epoch 1799 | loss: 0.031106 | val_loss: 0.0311518 | Time: 2394.42 ms [2022-03-28 13:29:18 main:574] : INFO : Epoch 1800 | loss: 0.0311073 | val_loss: 0.0311513 | Time: 2944.82 ms [2022-03-28 13:29:21 main:574] : INFO : Epoch 1801 | loss: 0.0311093 | val_loss: 0.0311507 | Time: 2849.82 ms [2022-03-28 13:29:23 main:574] : INFO : Epoch 1802 | loss: 0.0311072 | val_loss: 0.0311547 | Time: 2359.91 ms [2022-03-28 13:29:26 main:574] : INFO : Epoch 1803 | loss: 0.0311077 | val_loss: 0.0311538 | Time: 2826.86 ms [2022-03-28 13:29:39 main:574] : INFO : Epoch 1804 | loss: 0.0311091 | val_loss: 0.0311543 | Time: 12849.8 ms [2022-03-28 13:29:41 main:574] : INFO : Epoch 1805 | loss: 0.0311095 | val_loss: 0.0311497 | Time: 2285.05 ms [2022-03-28 13:29:44 main:574] : INFO : Epoch 1806 | loss: 0.031107 | val_loss: 0.0311562 | Time: 2792.11 ms [2022-03-28 13:29:47 main:574] : INFO : Epoch 1807 | loss: 0.0311082 | val_loss: 0.0311586 | Time: 2926.08 ms [2022-03-28 13:29:50 main:574] : INFO : Epoch 1808 | loss: 0.0311115 | val_loss: 0.0311486 | Time: 2498.21 ms [2022-03-28 13:29:53 main:574] : INFO : Epoch 1809 | loss: 0.0311099 | val_loss: 0.0311512 | Time: 2965.72 ms [2022-03-28 13:29:56 main:574] : INFO : Epoch 1810 | loss: 0.0311224 | val_loss: 0.0311495 | Time: 3037.09 ms [2022-03-28 13:29:58 main:574] : INFO : Epoch 1811 | loss: 0.0311224 | val_loss: 0.0311581 | Time: 2670.3 ms [2022-03-28 13:30:01 main:574] : INFO : Epoch 1812 | loss: 0.0311167 | val_loss: 0.0311502 | Time: 2714.31 ms [2022-03-28 13:30:04 main:574] : INFO : Epoch 1813 | loss: 0.0311199 | val_loss: 0.0311502 | Time: 3044.78 ms [2022-03-28 13:30:07 main:574] : INFO : Epoch 1814 | loss: 0.031129 | val_loss: 0.0311542 | Time: 2953.35 ms [2022-03-28 13:30:09 main:574] : INFO : Epoch 1815 | loss: 0.0311228 | val_loss: 0.0311456 | Time: 2382.83 ms [2022-03-28 13:30:12 main:574] : INFO : Epoch 1816 | loss: 0.0311201 | val_loss: 0.0311461 | Time: 3031.29 ms [2022-03-28 13:30:15 main:574] : INFO : Epoch 1817 | loss: 0.0311171 | val_loss: 0.0311484 | Time: 2786.46 ms [2022-03-28 13:30:18 main:574] : INFO : Epoch 1818 | loss: 0.0311168 | val_loss: 0.0311458 | Time: 2489.01 ms [2022-03-28 13:30:21 main:574] : INFO : Epoch 1819 | loss: 0.0311156 | val_loss: 0.0311436 | Time: 2972.49 ms [2022-03-28 13:30:24 main:574] : INFO : Epoch 1820 | loss: 0.0311141 | val_loss: 0.0311466 | Time: 3004.04 ms [2022-03-28 13:30:27 main:574] : INFO : Epoch 1821 | loss: 0.031113 | val_loss: 0.0311459 | Time: 2879.66 ms [2022-03-28 13:30:40 main:574] : INFO : Epoch 1822 | loss: 0.0311132 | val_loss: 0.0311481 | Time: 13280.5 ms [2022-03-28 13:30:43 main:574] : INFO : Epoch 1823 | loss: 0.0311116 | val_loss: 0.0311493 | Time: 2713.77 ms [2022-03-28 13:30:46 main:574] : INFO : Epoch 1824 | loss: 0.0311115 | val_loss: 0.0311485 | Time: 2981.83 ms [2022-03-28 13:30:48 main:574] : INFO : Epoch 1825 | loss: 0.031112 | val_loss: 0.0311455 | Time: 2608.14 ms [2022-03-28 13:30:51 main:574] : INFO : Epoch 1826 | loss: 0.0311132 | val_loss: 0.0311492 | Time: 3014.6 ms [2022-03-28 13:30:54 main:574] : INFO : Epoch 1827 | loss: 0.0311147 | val_loss: 0.031147 | Time: 2934.54 ms [2022-03-28 13:30:57 main:574] : INFO : Epoch 1828 | loss: 0.0311109 | val_loss: 0.0311507 | Time: 2950.15 ms [2022-03-28 13:30:59 main:574] : INFO : Epoch 1829 | loss: 0.0311087 | val_loss: 0.0311548 | Time: 2407.31 ms [2022-03-28 13:31:03 main:574] : INFO : Epoch 1830 | loss: 0.0311087 | val_loss: 0.0311559 | Time: 3083.02 ms [2022-03-28 13:31:05 main:574] : INFO : Epoch 1831 | loss: 0.0311108 | val_loss: 0.0311506 | Time: 2912.11 ms [2022-03-28 13:31:08 main:574] : INFO : Epoch 1832 | loss: 0.0311085 | val_loss: 0.0311456 | Time: 2398.64 ms [2022-03-28 13:31:11 main:574] : INFO : Epoch 1833 | loss: 0.0311068 | val_loss: 0.0311475 | Time: 3181.74 ms [2022-03-28 13:31:14 main:574] : INFO : Epoch 1834 | loss: 0.0311071 | val_loss: 0.0311478 | Time: 2993.66 ms [2022-03-28 13:31:17 main:574] : INFO : Epoch 1835 | loss: 0.0311074 | val_loss: 0.0311518 | Time: 2581.92 ms [2022-03-28 13:31:19 main:574] : INFO : Epoch 1836 | loss: 0.0311111 | val_loss: 0.0311484 | Time: 2655.39 ms [2022-03-28 13:31:22 main:574] : INFO : Epoch 1837 | loss: 0.0311094 | val_loss: 0.0311507 | Time: 2953.96 ms [2022-03-28 13:31:25 main:574] : INFO : Epoch 1838 | loss: 0.0311087 | val_loss: 0.0311502 | Time: 2948.65 ms [2022-03-28 13:31:28 main:574] : INFO : Epoch 1839 | loss: 0.0311083 | val_loss: 0.0311518 | Time: 2386.98 ms [2022-03-28 13:31:40 main:574] : INFO : Epoch 1840 | loss: 0.0311078 | val_loss: 0.0311555 | Time: 12520.5 ms [2022-03-28 13:31:43 main:574] : INFO : Epoch 1841 | loss: 0.0311084 | val_loss: 0.0311476 | Time: 2737.82 ms [2022-03-28 13:31:45 main:574] : INFO : Epoch 1842 | loss: 0.0311082 | val_loss: 0.0311535 | Time: 2390.55 ms [2022-03-28 13:31:48 main:574] : INFO : Epoch 1843 | loss: 0.03111 | val_loss: 0.0311501 | Time: 3107.65 ms [2022-03-28 13:31:51 main:574] : INFO : Epoch 1844 | loss: 0.0311127 | val_loss: 0.0311511 | Time: 3095.87 ms [2022-03-28 13:31:54 main:574] : INFO : Epoch 1845 | loss: 0.0311103 | val_loss: 0.0311466 | Time: 2465.21 ms [2022-03-28 13:31:57 main:574] : INFO : Epoch 1846 | loss: 0.0311083 | val_loss: 0.0311463 | Time: 3108.6 ms [2022-03-28 13:32:00 main:574] : INFO : Epoch 1847 | loss: 0.0311073 | val_loss: 0.0311453 | Time: 2896.16 ms [2022-03-28 13:32:03 main:574] : INFO : Epoch 1848 | loss: 0.0311068 | val_loss: 0.0311441 | Time: 2573.87 ms [2022-03-28 13:32:05 main:574] : INFO : Epoch 1849 | loss: 0.0311055 | val_loss: 0.0311474 | Time: 2823.86 ms [2022-03-28 13:32:08 main:574] : INFO : Epoch 1850 | loss: 0.0311056 | val_loss: 0.0311506 | Time: 2962.44 ms [2022-03-28 13:32:11 main:574] : INFO : Epoch 1851 | loss: 0.0311052 | val_loss: 0.0311482 | Time: 2808 ms [2022-03-28 13:32:14 main:574] : INFO : Epoch 1852 | loss: 0.0311047 | val_loss: 0.031147 | Time: 2549.12 ms [2022-03-28 13:32:17 main:574] : INFO : Epoch 1853 | loss: 0.0311038 | val_loss: 0.0311507 | Time: 3250.18 ms [2022-03-28 13:32:20 main:574] : INFO : Epoch 1854 | loss: 0.031103 | val_loss: 0.0311484 | Time: 2922.02 ms [2022-03-28 13:32:23 main:574] : INFO : Epoch 1855 | loss: 0.031104 | val_loss: 0.0311544 | Time: 2891.35 ms [2022-03-28 13:32:26 main:574] : INFO : Epoch 1856 | loss: 0.0311051 | val_loss: 0.0311607 | Time: 2965.67 ms [2022-03-28 13:32:29 main:574] : INFO : Epoch 1857 | loss: 0.0311064 | val_loss: 0.0311474 | Time: 2908.02 ms [2022-03-28 13:32:42 main:574] : INFO : Epoch 1858 | loss: 0.0311064 | val_loss: 0.0311529 | Time: 13257.2 ms [2022-03-28 13:32:44 main:574] : INFO : Epoch 1859 | loss: 0.031106 | val_loss: 0.0311535 | Time: 2301.6 ms [2022-03-28 13:32:47 main:574] : INFO : Epoch 1860 | loss: 0.0311057 | val_loss: 0.0311508 | Time: 2877.07 ms [2022-03-28 13:32:50 main:574] : INFO : Epoch 1861 | loss: 0.031108 | val_loss: 0.0311517 | Time: 2849.85 ms [2022-03-28 13:32:52 main:574] : INFO : Epoch 1862 | loss: 0.0311073 | val_loss: 0.0311487 | Time: 2382.72 ms [2022-03-28 13:32:55 main:574] : INFO : Epoch 1863 | loss: 0.0311094 | val_loss: 0.0311438 | Time: 3005.11 ms [2022-03-28 13:32:58 main:574] : INFO : Epoch 1864 | loss: 0.0311072 | val_loss: 0.0311462 | Time: 3019.22 ms [2022-03-28 13:33:01 main:574] : INFO : Epoch 1865 | loss: 0.031109 | val_loss: 0.0311458 | Time: 2623.11 ms [2022-03-28 13:33:04 main:574] : INFO : Epoch 1866 | loss: 0.0311108 | val_loss: 0.031152 | Time: 2640.18 ms [2022-03-28 13:33:07 main:574] : INFO : Epoch 1867 | loss: 0.0311093 | val_loss: 0.0311492 | Time: 2886.12 ms [2022-03-28 13:33:10 main:574] : INFO : Epoch 1868 | loss: 0.0311071 | val_loss: 0.0311531 | Time: 2960.7 ms [2022-03-28 13:33:12 main:574] : INFO : Epoch 1869 | loss: 0.0311039 | val_loss: 0.0311575 | Time: 2441.47 ms [2022-03-28 13:33:15 main:574] : INFO : Epoch 1870 | loss: 0.0311042 | val_loss: 0.0311464 | Time: 3023.83 ms [2022-03-28 13:33:18 main:574] : INFO : Epoch 1871 | loss: 0.0311036 | val_loss: 0.0311492 | Time: 2881.24 ms [2022-03-28 13:33:20 main:574] : INFO : Epoch 1872 | loss: 0.0311055 | val_loss: 0.0311495 | Time: 2491.85 ms [2022-03-28 13:33:23 main:574] : INFO : Epoch 1873 | loss: 0.0311057 | val_loss: 0.0311556 | Time: 3033.92 ms [2022-03-28 13:33:27 main:574] : INFO : Epoch 1874 | loss: 0.0311086 | val_loss: 0.0311503 | Time: 3171.63 ms [2022-03-28 13:33:30 main:574] : INFO : Epoch 1875 | loss: 0.0311077 | val_loss: 0.0311492 | Time: 2887.41 ms [2022-03-28 13:33:43 main:574] : INFO : Epoch 1876 | loss: 0.0311112 | val_loss: 0.0311472 | Time: 13464.3 ms [2022-03-28 13:33:46 main:574] : INFO : Epoch 1877 | loss: 0.0311095 | val_loss: 0.0311469 | Time: 3417.5 ms [2022-03-28 13:33:50 main:574] : INFO : Epoch 1878 | loss: 0.0311095 | val_loss: 0.031154 | Time: 3936.54 ms [2022-03-28 13:33:53 main:574] : INFO : Epoch 1879 | loss: 0.0311104 | val_loss: 0.0311481 | Time: 2789.76 ms [2022-03-28 13:33:56 main:574] : INFO : Epoch 1880 | loss: 0.0311127 | val_loss: 0.0311497 | Time: 2708.98 ms [2022-03-28 13:33:59 main:574] : INFO : Epoch 1881 | loss: 0.0311119 | val_loss: 0.0311534 | Time: 2939.89 ms [2022-03-28 13:34:02 main:574] : INFO : Epoch 1882 | loss: 0.0311103 | val_loss: 0.0311491 | Time: 2849.47 ms [2022-03-28 13:34:04 main:574] : INFO : Epoch 1883 | loss: 0.0311083 | val_loss: 0.0311461 | Time: 2619.67 ms [2022-03-28 13:34:07 main:574] : INFO : Epoch 1884 | loss: 0.0311134 | val_loss: 0.0311515 | Time: 3125.29 ms [2022-03-28 13:34:11 main:574] : INFO : Epoch 1885 | loss: 0.0311142 | val_loss: 0.031151 | Time: 3227.18 ms [2022-03-28 13:34:14 main:574] : INFO : Epoch 1886 | loss: 0.0311136 | val_loss: 0.031153 | Time: 2966.32 ms [2022-03-28 13:34:16 main:574] : INFO : Epoch 1887 | loss: 0.0311121 | val_loss: 0.0311546 | Time: 2508.1 ms [2022-03-28 13:34:19 main:574] : INFO : Epoch 1888 | loss: 0.0311125 | val_loss: 0.0311495 | Time: 2955.56 ms [2022-03-28 13:34:22 main:574] : INFO : Epoch 1889 | loss: 0.0311121 | val_loss: 0.0311506 | Time: 3165.86 ms [2022-03-28 13:34:25 main:574] : INFO : Epoch 1890 | loss: 0.0311184 | val_loss: 0.0311535 | Time: 2363.75 ms [2022-03-28 13:34:28 main:574] : INFO : Epoch 1891 | loss: 0.0311156 | val_loss: 0.0311509 | Time: 3016.02 ms [2022-03-28 13:34:41 main:574] : INFO : Epoch 1892 | loss: 0.0311112 | val_loss: 0.0311525 | Time: 13149.1 ms [2022-03-28 13:34:44 main:574] : INFO : Epoch 1893 | loss: 0.0311116 | val_loss: 0.0311575 | Time: 3299.81 ms [2022-03-28 13:34:46 main:574] : INFO : Epoch 1894 | loss: 0.0311129 | val_loss: 0.0311553 | Time: 2286.16 ms [2022-03-28 13:34:49 main:574] : INFO : Epoch 1895 | loss: 0.0311124 | val_loss: 0.0311465 | Time: 2727.38 ms [2022-03-28 13:34:52 main:574] : INFO : Epoch 1896 | loss: 0.0311082 | val_loss: 0.0311481 | Time: 2787.3 ms [2022-03-28 13:34:54 main:574] : INFO : Epoch 1897 | loss: 0.0311073 | val_loss: 0.031154 | Time: 2560.09 ms [2022-03-28 13:34:58 main:574] : INFO : Epoch 1898 | loss: 0.0311062 | val_loss: 0.0311507 | Time: 3239.59 ms [2022-03-28 13:35:01 main:574] : INFO : Epoch 1899 | loss: 0.0311038 | val_loss: 0.0311467 | Time: 3027.37 ms [2022-03-28 13:35:04 main:574] : INFO : Epoch 1900 | loss: 0.0311037 | val_loss: 0.0311521 | Time: 2906.15 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: Quadro P2000) [2022-03-28 13:59:11 main:435] : INFO : Set logging level to 1 [2022-03-28 13:59:11 main:441] : INFO : Running in BOINC Client mode [2022-03-28 13:59:11 main:444] : INFO : Resolving all filenames [2022-03-28 13:59:11 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-03-28 13:59:11 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-03-28 13:59:11 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-03-28 13:59:11 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-03-28 13:59:11 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-03-28 13:59:11 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-03-28 13:59:11 main:474] : INFO : Configuration: [2022-03-28 13:59:11 main:475] : INFO : Model type: GRU [2022-03-28 13:59:11 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-03-28 13:59:11 main:477] : INFO : Max Epochs: 2048 [2022-03-28 13:59:11 main:478] : INFO : Batch Size: 128 [2022-03-28 13:59:11 main:479] : INFO : Learning Rate: 0.01 [2022-03-28 13:59:11 main:480] : INFO : Patience: 10 [2022-03-28 13:59:11 main:481] : INFO : Hidden Width: 12 [2022-03-28 13:59:11 main:482] : INFO : # Recurrent Layers: 4 [2022-03-28 13:59:11 main:483] : INFO : # Backend Layers: 4 [2022-03-28 13:59:11 main:484] : INFO : # Threads: 1 [2022-03-28 13:59:11 main:486] : INFO : Preparing Dataset [2022-03-28 13:59:11 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-03-28 13:59:12 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-03-28 13:59:14 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-03-28 13:59:14 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-03-28 13:59:14 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-03-28 13:59:14 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-03-28 13:59:14 main:494] : INFO : Creating Model [2022-03-28 13:59:14 main:507] : INFO : Preparing config file [2022-03-28 13:59:14 main:511] : INFO : Found checkpoint, attempting to load... [2022-03-28 13:59:14 main:512] : INFO : Loading config [2022-03-28 13:59:14 main:514] : INFO : Loading state [2022-03-28 13:59:15 main:559] : INFO : Loading DataLoader into Memory [2022-03-28 13:59:15 main:562] : INFO : Starting Training [2022-03-28 13:59:17 main:574] : INFO : Epoch 1862 | loss: 0.031169 | val_loss: 0.0311542 | Time: 2389.05 ms [2022-03-28 13:59:19 main:574] : INFO : Epoch 1863 | loss: 0.0311178 | val_loss: 0.031157 | Time: 2204.27 ms [2022-03-28 13:59:22 main:574] : INFO : Epoch 1864 | loss: 0.0311103 | val_loss: 0.0311578 | Time: 2231.3 ms [2022-03-28 13:59:34 main:574] : INFO : Epoch 1865 | loss: 0.0311112 | val_loss: 0.0311547 | Time: 12559.9 ms [2022-03-28 13:59:37 main:574] : INFO : Epoch 1866 | loss: 0.0311078 | val_loss: 0.0311525 | Time: 2451.34 ms [2022-03-28 13:59:39 main:574] : INFO : Epoch 1867 | loss: 0.0311073 | val_loss: 0.031151 | Time: 2464.66 ms [2022-03-28 13:59:42 main:574] : INFO : Epoch 1868 | loss: 0.0311081 | val_loss: 0.0311537 | Time: 2452.7 ms [2022-03-28 13:59:44 main:574] : INFO : Epoch 1869 | loss: 0.0311072 | val_loss: 0.0311573 | Time: 2487.03 ms [2022-03-28 13:59:46 main:574] : INFO : Epoch 1870 | loss: 0.0311084 | val_loss: 0.0311557 | Time: 2292.64 ms [2022-03-28 13:59:49 main:574] : INFO : Epoch 1871 | loss: 0.0311104 | val_loss: 0.0311545 | Time: 2579.45 ms [2022-03-28 13:59:51 main:574] : INFO : Epoch 1872 | loss: 0.0311128 | val_loss: 0.031149 | Time: 2446.54 ms [2022-03-28 13:59:54 main:574] : INFO : Epoch 1873 | loss: 0.0311129 | val_loss: 0.0311488 | Time: 2409.1 ms [2022-03-28 13:59:56 main:574] : INFO : Epoch 1874 | loss: 0.0311131 | val_loss: 0.0311519 | Time: 2551.24 ms [2022-03-28 13:59:59 main:574] : INFO : Epoch 1875 | loss: 0.0311086 | val_loss: 0.0311523 | Time: 2276.25 ms [2022-03-28 14:00:01 main:574] : INFO : Epoch 1876 | loss: 0.0311121 | val_loss: 0.0311499 | Time: 2765.85 ms [2022-03-28 14:00:05 main:574] : INFO : Epoch 1877 | loss: 0.0311118 | val_loss: 0.0311504 | Time: 2998.96 ms [2022-03-28 14:00:07 main:574] : INFO : Epoch 1878 | loss: 0.0311082 | val_loss: 0.0311484 | Time: 2278.8 ms [2022-03-28 14:00:09 main:574] : INFO : Epoch 1879 | loss: 0.031108 | val_loss: 0.0311518 | Time: 2652.21 ms [2022-03-28 14:00:12 main:574] : INFO : Epoch 1880 | loss: 0.0311095 | val_loss: 0.0311566 | Time: 2819.05 ms [2022-03-28 14:00:15 main:574] : INFO : Epoch 1881 | loss: 0.0311091 | val_loss: 0.0311517 | Time: 2381.43 ms [2022-03-28 14:00:17 main:574] : INFO : Epoch 1882 | loss: 0.0311078 | val_loss: 0.0311495 | Time: 2712.67 ms [2022-03-28 14:00:20 main:574] : INFO : Epoch 1883 | loss: 0.0311058 | val_loss: 0.0311498 | Time: 2648.78 ms [2022-03-28 14:00:22 main:574] : INFO : Epoch 1884 | loss: 0.0311047 | val_loss: 0.0311491 | Time: 2338.23 ms [2022-03-28 14:00:35 main:574] : INFO : Epoch 1885 | loss: 0.0311046 | val_loss: 0.0311477 | Time: 12800.6 ms [2022-03-28 14:00:38 main:574] : INFO : Epoch 1886 | loss: 0.0311081 | val_loss: 0.0311595 | Time: 2500.42 ms [2022-03-28 14:00:40 main:574] : INFO : Epoch 1887 | loss: 0.0311086 | val_loss: 0.0311539 | Time: 2386.33 ms [2022-03-28 14:00:43 main:574] : INFO : Epoch 1888 | loss: 0.0311087 | val_loss: 0.0311526 | Time: 2634.11 ms [2022-03-28 14:00:45 main:574] : INFO : Epoch 1889 | loss: 0.0311074 | val_loss: 0.0311542 | Time: 2441.75 ms [2022-03-28 14:00:48 main:574] : INFO : Epoch 1890 | loss: 0.0311062 | val_loss: 0.0311495 | Time: 2835.84 ms [2022-03-28 14:00:51 main:574] : INFO : Epoch 1891 | loss: 0.0311058 | val_loss: 0.0311482 | Time: 2973.88 ms [2022-03-28 14:00:54 main:574] : INFO : Epoch 1892 | loss: 0.0311081 | val_loss: 0.0311439 | Time: 2548.91 ms [2022-03-28 14:00:56 main:574] : INFO : Epoch 1893 | loss: 0.0311059 | val_loss: 0.0311543 | Time: 2666.52 ms [2022-03-28 14:00:59 main:574] : INFO : Epoch 1894 | loss: 0.0311068 | val_loss: 0.0311541 | Time: 2673.23 ms [2022-03-28 14:01:01 main:574] : INFO : Epoch 1895 | loss: 0.0311051 | val_loss: 0.0311486 | Time: 2531.19 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: Quadro P2000) [2022-03-28 14:32:42 main:435] : INFO : Set logging level to 1 [2022-03-28 14:32:42 main:441] : INFO : Running in BOINC Client mode [2022-03-28 14:32:42 main:444] : INFO : Resolving all filenames [2022-03-28 14:32:42 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-03-28 14:32:42 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-03-28 14:32:42 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-03-28 14:32:42 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-03-28 14:32:42 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-03-28 14:32:42 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-03-28 14:32:42 main:474] : INFO : Configuration: [2022-03-28 14:32:42 main:475] : INFO : Model type: GRU [2022-03-28 14:32:42 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-03-28 14:32:42 main:477] : INFO : Max Epochs: 2048 [2022-03-28 14:32:42 main:478] : INFO : Batch Size: 128 [2022-03-28 14:32:42 main:479] : INFO : Learning Rate: 0.01 [2022-03-28 14:32:42 main:480] : INFO : Patience: 10 [2022-03-28 14:32:42 main:481] : INFO : Hidden Width: 12 [2022-03-28 14:32:42 main:482] : INFO : # Recurrent Layers: 4 [2022-03-28 14:32:42 main:483] : INFO : # Backend Layers: 4 [2022-03-28 14:32:42 main:484] : INFO : # Threads: 1 [2022-03-28 14:32:42 main:486] : INFO : Preparing Dataset [2022-03-28 14:32:42 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-03-28 14:32:42 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-03-28 14:32:45 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-03-28 14:32:45 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-03-28 14:32:45 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-03-28 14:32:45 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-03-28 14:32:45 main:494] : INFO : Creating Model [2022-03-28 14:32:45 main:507] : INFO : Preparing config file [2022-03-28 14:32:45 main:511] : INFO : Found checkpoint, attempting to load... [2022-03-28 14:32:45 main:512] : INFO : Loading config [2022-03-28 14:32:45 main:514] : INFO : Loading state [2022-03-28 14:32:46 main:559] : INFO : Loading DataLoader into Memory [2022-03-28 14:32:46 main:562] : INFO : Starting Training [2022-03-28 14:32:48 main:574] : INFO : Epoch 1862 | loss: 0.0311542 | val_loss: 0.0311578 | Time: 2402.96 ms [2022-03-28 14:32:50 main:574] : INFO : Epoch 1863 | loss: 0.031115 | val_loss: 0.0311484 | Time: 2221.23 ms [2022-03-28 14:32:53 main:574] : INFO : Epoch 1864 | loss: 0.0311091 | val_loss: 0.0311478 | Time: 2291.61 ms [2022-03-28 14:32:55 main:574] : INFO : Epoch 1865 | loss: 0.0311074 | val_loss: 0.0311517 | Time: 2269.45 ms [2022-03-28 14:32:57 main:574] : INFO : Epoch 1866 | loss: 0.0311076 | val_loss: 0.0311496 | Time: 2556.93 ms [2022-03-28 14:33:00 main:574] : INFO : Epoch 1867 | loss: 0.0311064 | val_loss: 0.0311494 | Time: 2471.98 ms [2022-03-28 14:33:02 main:574] : INFO : Epoch 1868 | loss: 0.0311058 | val_loss: 0.0311476 | Time: 2560.28 ms [2022-03-28 14:33:05 main:574] : INFO : Epoch 1869 | loss: 0.0311053 | val_loss: 0.0311543 | Time: 2578.23 ms [2022-03-28 14:33:07 main:574] : INFO : Epoch 1870 | loss: 0.0311045 | val_loss: 0.0311511 | Time: 2330.85 ms [2022-03-28 14:33:10 main:574] : INFO : Epoch 1871 | loss: 0.0311035 | val_loss: 0.0311537 | Time: 2533.81 ms [2022-03-28 14:33:13 main:574] : INFO : Epoch 1872 | loss: 0.0311049 | val_loss: 0.0311531 | Time: 2720.42 ms [2022-03-28 14:33:15 main:574] : INFO : Epoch 1873 | loss: 0.0311062 | val_loss: 0.0311525 | Time: 2336.92 ms [2022-03-28 14:33:18 main:574] : INFO : Epoch 1874 | loss: 0.0311102 | val_loss: 0.0311509 | Time: 2951.55 ms [2022-03-28 14:33:21 main:574] : INFO : Epoch 1875 | loss: 0.0311069 | val_loss: 0.0311483 | Time: 2647.72 ms [2022-03-28 14:33:23 main:574] : INFO : Epoch 1876 | loss: 0.0311059 | val_loss: 0.0311483 | Time: 2450.19 ms [2022-03-28 14:33:26 main:574] : INFO : Epoch 1877 | loss: 0.0311076 | val_loss: 0.0311511 | Time: 2792.42 ms [2022-03-28 14:33:28 main:574] : INFO : Epoch 1878 | loss: 0.0311066 | val_loss: 0.0311485 | Time: 2557.75 ms [2022-03-28 14:33:31 main:574] : INFO : Epoch 1879 | loss: 0.0311051 | val_loss: 0.0311467 | Time: 2444.26 ms [2022-03-28 14:33:43 main:574] : INFO : Epoch 1880 | loss: 0.0311062 | val_loss: 0.0311474 | Time: 12563.1 ms [2022-03-28 14:33:46 main:574] : INFO : Epoch 1881 | loss: 0.031108 | val_loss: 0.0311492 | Time: 2470.69 ms [2022-03-28 14:33:49 main:574] : INFO : Epoch 1882 | loss: 0.0311059 | val_loss: 0.0311501 | Time: 2736.57 ms [2022-03-28 14:33:51 main:574] : INFO : Epoch 1883 | loss: 0.0311078 | val_loss: 0.0311531 | Time: 2616.13 ms [2022-03-28 14:33:54 main:574] : INFO : Epoch 1884 | loss: 0.0311089 | val_loss: 0.0311481 | Time: 2306.16 ms [2022-03-28 14:33:56 main:574] : INFO : Epoch 1885 | loss: 0.0311179 | val_loss: 0.0311514 | Time: 2839.09 ms [2022-03-28 14:33:59 main:574] : INFO : Epoch 1886 | loss: 0.031118 | val_loss: 0.0311495 | Time: 2913.68 ms [2022-03-28 14:34:02 main:574] : INFO : Epoch 1887 | loss: 0.0311175 | val_loss: 0.0311496 | Time: 2417.43 ms [2022-03-28 14:34:05 main:574] : INFO : Epoch 1888 | loss: 0.0311196 | val_loss: 0.031148 | Time: 2836.48 ms [2022-03-28 14:34:07 main:574] : INFO : Epoch 1889 | loss: 0.0311145 | val_loss: 0.0311502 | Time: 2904.69 ms [2022-03-28 14:34:10 main:574] : INFO : Epoch 1890 | loss: 0.0311133 | val_loss: 0.0311463 | Time: 2280.95 ms [2022-03-28 14:34:12 main:574] : INFO : Epoch 1891 | loss: 0.0311109 | val_loss: 0.0311468 | Time: 2706.14 ms [2022-03-28 14:34:15 main:574] : INFO : Epoch 1892 | loss: 0.0311118 | val_loss: 0.0311535 | Time: 2717.64 ms [2022-03-28 14:34:17 main:574] : INFO : Epoch 1893 | loss: 0.0311126 | val_loss: 0.031149 | Time: 2282.75 ms [2022-03-28 14:34:20 main:574] : INFO : Epoch 1894 | loss: 0.0311101 | val_loss: 0.0311536 | Time: 2643.44 ms [2022-03-28 14:34:33 main:574] : INFO : Epoch 1895 | loss: 0.0311094 | val_loss: 0.0311468 | Time: 12546 ms [2022-03-28 14:34:35 main:574] : INFO : Epoch 1896 | loss: 0.0311127 | val_loss: 0.0311529 | Time: 2411.45 ms [2022-03-28 14:34:38 main:574] : INFO : Epoch 1897 | loss: 0.031114 | val_loss: 0.0311638 | Time: 2522.29 ms [2022-03-28 14:34:40 main:574] : INFO : Epoch 1898 | loss: 0.0311129 | val_loss: 0.0311559 | Time: 2699.05 ms [2022-03-28 14:34:43 main:574] : INFO : Epoch 1899 | loss: 0.0311078 | val_loss: 0.0311598 | Time: 2562.88 ms [2022-03-28 14:34:45 main:574] : INFO : Epoch 1900 | loss: 0.0311074 | val_loss: 0.031148 | Time: 2596.85 ms [2022-03-28 14:34:48 main:574] : INFO : Epoch 1901 | loss: 0.031107 | val_loss: 0.0311519 | Time: 2343.63 ms [2022-03-28 14:34:51 main:574] : INFO : Epoch 1902 | loss: 0.0311052 | val_loss: 0.0311503 | Time: 2678.07 ms Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: Quadro P2000) [2022-03-28 14:37:52 main:435] : INFO : Set logging level to 1 [2022-03-28 14:37:52 main:441] : INFO : Running in BOINC Client mode [2022-03-28 14:37:52 main:444] : INFO : Resolving all filenames [2022-03-28 14:37:52 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1) [2022-03-28 14:37:52 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1) [2022-03-28 14:37:52 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0) [2022-03-28 14:37:52 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1) [2022-03-28 14:37:52 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1) [2022-03-28 14:37:52 main:472] : INFO : Dataset filename: dataset.hdf5 [2022-03-28 14:37:52 main:474] : INFO : Configuration: [2022-03-28 14:37:52 main:475] : INFO : Model type: GRU [2022-03-28 14:37:52 main:476] : INFO : Validation Loss Threshold: 0.0001 [2022-03-28 14:37:52 main:477] : INFO : Max Epochs: 2048 [2022-03-28 14:37:52 main:478] : INFO : Batch Size: 128 [2022-03-28 14:37:52 main:479] : INFO : Learning Rate: 0.01 [2022-03-28 14:37:52 main:480] : INFO : Patience: 10 [2022-03-28 14:37:52 main:481] : INFO : Hidden Width: 12 [2022-03-28 14:37:52 main:482] : INFO : # Recurrent Layers: 4 [2022-03-28 14:37:52 main:483] : INFO : # Backend Layers: 4 [2022-03-28 14:37:52 main:484] : INFO : # Threads: 1 [2022-03-28 14:37:52 main:486] : INFO : Preparing Dataset [2022-03-28 14:37:52 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory [2022-03-28 14:37:52 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory [2022-03-28 14:37:55 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory. [2022-03-28 14:37:55 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory [2022-03-28 14:37:55 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory [2022-03-28 14:37:55 load:106] : INFO : Successfully loaded dataset of 512 examples into memory. [2022-03-28 14:37:55 main:494] : INFO : Creating Model [2022-03-28 14:37:55 main:507] : INFO : Preparing config file [2022-03-28 14:37:55 main:511] : INFO : Found checkpoint, attempting to load... [2022-03-28 14:37:55 main:512] : INFO : Loading config [2022-03-28 14:37:55 main:514] : INFO : Loading state [2022-03-28 14:37:55 main:559] : INFO : Loading DataLoader into Memory [2022-03-28 14:37:55 main:562] : INFO : Starting Training [2022-03-28 14:37:58 main:574] : INFO : Epoch 1862 | loss: 0.0311446 | val_loss: 0.0311509 | Time: 2447.71 ms [2022-03-28 14:38:00 main:574] : INFO : Epoch 1863 | loss: 0.0311152 | val_loss: 0.0311489 | Time: 2178.89 ms [2022-03-28 14:38:02 main:574] : INFO : Epoch 1864 | loss: 0.0311109 | val_loss: 0.0311528 | Time: 2252.38 ms [2022-03-28 14:38:05 main:574] : INFO : Epoch 1865 | loss: 0.0311114 | val_loss: 0.0311484 | Time: 2271.09 ms [2022-03-28 14:38:07 main:574] : INFO : Epoch 1866 | loss: 0.0311078 | val_loss: 0.0311492 | Time: 2539.01 ms [2022-03-28 14:38:10 main:574] : INFO : Epoch 1867 | loss: 0.0311077 | val_loss: 0.0311472 | Time: 2538.15 ms [2022-03-28 14:38:12 main:574] : INFO : Epoch 1868 | loss: 0.0311068 | val_loss: 0.0311469 | Time: 2423.26 ms [2022-03-28 14:38:15 main:574] : INFO : Epoch 1869 | loss: 0.0311083 | val_loss: 0.0311477 | Time: 2502.99 ms [2022-03-28 14:38:17 main:574] : INFO : Epoch 1870 | loss: 0.0311078 | val_loss: 0.0311457 | Time: 2444.26 ms [2022-03-28 14:38:20 main:574] : INFO : Epoch 1871 | loss: 0.031111 | val_loss: 0.0311485 | Time: 2570.26 ms [2022-03-28 14:38:23 main:574] : INFO : Epoch 1872 | loss: 0.0311092 | val_loss: 0.0311531 | Time: 3020.31 ms [2022-03-28 14:38:35 main:574] : INFO : Epoch 1873 | loss: 0.0311118 | val_loss: 0.0311514 | Time: 12771.2 ms [2022-03-28 14:38:38 main:574] : INFO : Epoch 1874 | loss: 0.0311103 | val_loss: 0.0311494 | Time: 2430.9 ms [2022-03-28 14:38:40 main:574] : INFO : Epoch 1875 | loss: 0.031109 | val_loss: 0.0311482 | Time: 2535.85 ms [2022-03-28 14:38:43 main:574] : INFO : Epoch 1876 | loss: 0.0311078 | val_loss: 0.0311497 | Time: 2384.08 ms [2022-03-28 14:38:45 main:574] : INFO : Epoch 1877 | loss: 0.0311081 | val_loss: 0.0311485 | Time: 2670.63 ms [2022-03-28 14:38:48 main:574] : INFO : Epoch 1878 | loss: 0.0311058 | val_loss: 0.0311463 | Time: 2550.01 ms [2022-03-28 14:38:50 main:574] : INFO : Epoch 1879 | loss: 0.0311054 | val_loss: 0.0311514 | Time: 2305.08 ms [2022-03-28 14:38:53 main:574] : INFO : Epoch 1880 | loss: 0.0311045 | val_loss: 0.031154 | Time: 2877.07 ms [2022-03-28 14:38:56 main:574] : INFO : Epoch 1881 | loss: 0.0311048 | val_loss: 0.0311524 | Time: 2805.12 ms [2022-03-28 14:38:58 main:574] : INFO : Epoch 1882 | loss: 0.0311058 | val_loss: 0.0311522 | Time: 2337.26 ms [2022-03-28 14:39:01 main:574] : INFO : Epoch 1883 | loss: 0.0311049 | val_loss: 0.0311538 | Time: 2851.48 ms [2022-03-28 14:39:04 main:574] : INFO : Epoch 1884 | loss: 0.0311018 | val_loss: 0.0311497 | Time: 2726.65 ms [2022-03-28 14:39:06 main:574] : INFO : Epoch 1885 | loss: 0.0311032 | val_loss: 0.0311518 | Time: 2557.75 ms [2022-03-28 14:39:09 main:574] : INFO : Epoch 1886 | loss: 0.0311047 | val_loss: 0.0311492 | Time: 2707.89 ms [2022-03-28 14:39:12 main:574] : INFO : Epoch 1887 | loss: 0.031105 | val_loss: 0.0311503 | Time: 2663.14 ms [2022-03-28 14:39:14 main:574] : INFO : Epoch 1888 | loss: 0.0311045 | val_loss: 0.0311571 | Time: 2551.45 ms [2022-03-28 14:39:17 main:574] : INFO : Epoch 1889 | loss: 0.0311115 | val_loss: 0.0311523 | Time: 2772.75 ms [2022-03-28 14:39:20 main:574] : INFO : Epoch 1890 | loss: 0.0311083 | val_loss: 0.0311512 | Time: 2559.23 ms [2022-03-28 14:39:22 main:574] : INFO : Epoch 1891 | loss: 0.0311094 | val_loss: 0.0311513 | Time: 2530.74 ms [2022-03-28 14:39:25 main:574] : INFO : Epoch 1892 | loss: 0.0311079 | val_loss: 0.0311563 | Time: 2660 ms [2022-03-28 14:39:38 main:574] : INFO : Epoch 1893 | loss: 0.0311087 | val_loss: 0.0311525 | Time: 12916.5 ms [2022-03-28 14:39:40 main:574] : INFO : Epoch 1894 | loss: 0.0311178 | val_loss: 0.0311479 | Time: 2407.44 ms [2022-03-28 14:39:43 main:574] : INFO : Epoch 1895 | loss: 0.0311154 | val_loss: 0.0311438 | Time: 2611.35 ms [2022-03-28 14:39:45 main:574] : INFO : Epoch 1896 | loss: 0.0311135 | val_loss: 0.0311501 | Time: 2383.8 ms [2022-03-28 14:39:48 main:574] : INFO : Epoch 1897 | loss: 0.0311104 | val_loss: 0.0311503 | Time: 2596.84 ms [2022-03-28 14:39:50 main:574] : INFO : Epoch 1898 | loss: 0.0311102 | val_loss: 0.0311539 | Time: 2504.06 ms [2022-03-28 14:39:53 main:574] : INFO : Epoch 1899 | loss: 0.0311203 | val_loss: 0.0311521 | Time: 2325.49 ms [2022-03-28 14:39:56 main:574] : INFO : Epoch 1900 | loss: 0.0311203 | val_loss: 0.0311515 | Time: 3025.55 ms [2022-03-28 14:39:58 main:574] : INFO : Epoch 1901 | loss: 0.031116 | val_loss: 0.0311528 | Time: 2718 ms [2022-03-28 14:40:01 main:574] : INFO : Epoch 1902 | loss: 0.0311148 | val_loss: 0.0311509 | Time: 2273.75 ms [2022-03-28 14:40:04 main:574] : INFO : Epoch 1903 | loss: 0.0311119 | val_loss: 0.0311513 | Time: 2812.74 ms [2022-03-28 14:40:06 main:574] : INFO : Epoch 1904 | loss: 0.0311103 | val_loss: 0.0311529 | Time: 2592 ms [2022-03-28 14:40:09 main:574] : INFO : Epoch 1905 | loss: 0.03111 | val_loss: 0.0311499 | Time: 2417.12 ms [2022-03-28 14:40:11 main:574] : INFO : Epoch 1906 | loss: 0.0311098 | val_loss: 0.0311492 | Time: 2687.63 ms [2022-03-28 14:40:14 main:574] : INFO : Epoch 1907 | loss: 0.031118 | val_loss: 0.0311496 | Time: 2440.62 ms [2022-03-28 14:40:16 main:574] : INFO : Epoch 1908 | loss: 0.0311239 | val_loss: 0.031146 | Time: 2546.19 ms [2022-03-28 14:40:19 main:574] : INFO : Epoch 1909 | loss: 0.0311242 | val_loss: 0.0311493 | Time: 2700.87 ms [2022-03-28 14:40:21 main:574] : INFO : Epoch 1910 | loss: 0.03112 | val_loss: 0.0311476 | Time: 2349.28 ms [2022-03-28 14:40:24 main:574] : INFO : Epoch 1911 | loss: 0.0311168 | val_loss: 0.0311532 | Time: 2909.54 ms [2022-03-28 14:40:27 main:574] : INFO : Epoch 1912 | loss: 0.0311137 | val_loss: 0.0311522 | Time: 2765.97 ms [2022-03-28 14:40:29 main:574] : INFO : Epoch 1913 | loss: 0.031115 | val_loss: 0.0311536 | Time: 2276.92 ms [2022-03-28 14:40:32 main:574] : INFO : Epoch 1914 | loss: 0.0311137 | val_loss: 0.0311506 | Time: 2741.74 ms [2022-03-28 14:40:35 main:574] : INFO : Epoch 1915 | loss: 0.0311156 | val_loss: 0.0311475 | Time: 2734.03 ms [2022-03-28 14:40:38 main:574] : INFO : Epoch 1916 | loss: 0.0311114 | val_loss: 0.0311497 | Time: 3079.14 ms [2022-03-28 14:40:40 main:574] : INFO : Epoch 1917 | loss: 0.031111 | val_loss: 0.0311578 | Time: 2544.45 ms [2022-03-28 14:40:43 main:574] : INFO : Epoch 1918 | loss: 0.0311108 | val_loss: 0.0311618 | Time: 2693.46 ms [2022-03-28 14:40:46 main:574] : INFO : Epoch 1919 | loss: 0.0311103 | val_loss: 0.0311569 | Time: 2505.37 ms [2022-03-28 14:40:48 main:574] : INFO : Epoch 1920 | loss: 0.0311086 | val_loss: 0.0311527 | Time: 2573.77 ms [2022-03-28 14:40:51 main:574] : INFO : Epoch 1921 | loss: 0.0311063 | val_loss: 0.0311625 | Time: 2679.63 ms [2022-03-28 14:40:53 main:574] : INFO : Epoch 1922 | loss: 0.031106 | val_loss: 0.0311554 | Time: 2460.14 ms [2022-03-28 14:40:56 main:574] : INFO : Epoch 1923 | loss: 0.031106 | val_loss: 0.0311498 | Time: 2737.54 ms [2022-03-28 14:40:59 main:574] : INFO : Epoch 1924 | loss: 0.0311064 | val_loss: 0.031153 | Time: 2734.21 ms [2022-03-28 14:41:01 main:574] : INFO : Epoch 1925 | loss: 0.0311065 | val_loss: 0.0311526 | Time: 2441.18 ms [2022-03-28 14:41:04 main:574] : INFO : Epoch 1926 | loss: 0.031106 | val_loss: 0.0311557 | Time: 2672.28 ms [2022-03-28 14:41:07 main:574] : INFO : Epoch 1927 | loss: 0.0311041 | val_loss: 0.031156 | Time: 2794.41 ms [2022-03-28 14:41:09 main:574] : INFO : Epoch 1928 | loss: 0.0311043 | val_loss: 0.0311556 | Time: 2302.68 ms [2022-03-28 14:41:12 main:574] : INFO : Epoch 1929 | loss: 0.0311043 | val_loss: 0.0311535 | Time: 2755.15 ms [2022-03-28 14:41:15 main:574] : INFO : Epoch 1930 | loss: 0.0311029 | val_loss: 0.031157 | Time: 2691.18 ms [2022-03-28 14:41:17 main:574] : INFO : Epoch 1931 | loss: 0.0311041 | val_loss: 0.0311583 | Time: 2286.28 ms [2022-03-28 14:41:20 main:574] : INFO : Epoch 1932 | loss: 0.0311062 | val_loss: 0.0311503 | Time: 2881.88 ms [2022-03-28 14:41:23 main:574] : INFO : Epoch 1933 | loss: 0.031111 | val_loss: 0.0311535 | Time: 2837.64 ms [2022-03-28 14:41:25 main:574] : INFO : Epoch 1934 | loss: 0.0311131 | val_loss: 0.0311474 | Time: 2285.57 ms [2022-03-28 14:41:38 main:574] : INFO : Epoch 1935 | loss: 0.03111 | val_loss: 0.031149 | Time: 13029 ms [2022-03-28 14:41:41 main:574] : INFO : Epoch 1936 | loss: 0.0311117 | val_loss: 0.0311587 | Time: 3235.18 ms [2022-03-28 14:41:44 main:574] : INFO : Epoch 1937 | loss: 0.0311177 | val_loss: 0.03116 | Time: 3037.59 ms [2022-03-28 14:41:47 main:574] : INFO : Epoch 1938 | loss: 0.0311163 | val_loss: 0.0311521 | Time: 3007.34 ms [2022-03-28 14:41:50 main:574] : INFO : Epoch 1939 | loss: 0.0311143 | val_loss: 0.0311525 | Time: 2350.31 ms [2022-03-28 14:41:52 main:574] : INFO : Epoch 1940 | loss: 0.0311116 | val_loss: 0.0311526 | Time: 2681.9 ms [2022-03-28 14:41:55 main:574] : INFO : Epoch 1941 | loss: 0.0311108 | val_loss: 0.0311533 | Time: 3003.14 ms [2022-03-28 14:41:58 main:574] : INFO : Epoch 1942 | loss: 0.0311085 | val_loss: 0.0311573 | Time: 2469.3 ms [2022-03-28 14:42:01 main:574] : INFO : Epoch 1943 | loss: 0.0311054 | val_loss: 0.031153 | Time: 2927.28 ms [2022-03-28 14:42:03 main:574] : INFO : Epoch 1944 | loss: 0.0311058 | val_loss: 0.0311459 | Time: 2822.72 ms [2022-03-28 14:42:06 main:574] : INFO : Epoch 1945 | loss: 0.0311062 | val_loss: 0.0311475 | Time: 2489.14 ms [2022-03-28 14:42:09 main:574] : INFO : Epoch 1946 | loss: 0.0311052 | val_loss: 0.0311476 | Time: 2746.82 ms [2022-03-28 14:42:11 main:574] : INFO : Epoch 1947 | loss: 0.0311041 | val_loss: 0.0311532 | Time: 2668.73 ms [2022-03-28 14:42:14 main:574] : INFO : Epoch 1948 | loss: 0.0311049 | val_loss: 0.0311566 | Time: 2382.93 ms [2022-03-28 14:42:17 main:574] : INFO : Epoch 1949 | loss: 0.0311077 | val_loss: 0.031154 | Time: 2997.41 ms [2022-03-28 14:42:20 main:574] : INFO : Epoch 1950 | loss: 0.0311037 | val_loss: 0.0311533 | Time: 2833.77 ms [2022-03-28 14:42:22 main:574] : INFO : Epoch 1951 | loss: 0.0311052 | val_loss: 0.0311568 | Time: 2618.03 ms [2022-03-28 14:42:25 main:574] : INFO : Epoch 1952 | loss: 0.0311049 | val_loss: 0.0311534 | Time: 2668.72 ms [2022-03-28 14:42:38 main:574] : INFO : Epoch 1953 | loss: 0.0311075 | val_loss: 0.0311548 | Time: 13130 ms [2022-03-28 14:42:41 main:574] : INFO : Epoch 1954 | loss: 0.0311115 | val_loss: 0.0311545 | Time: 3040.78 ms [2022-03-28 14:42:43 main:574] : INFO : Epoch 1955 | loss: 0.0311083 | val_loss: 0.0311531 | Time: 2329.52 ms [2022-03-28 14:42:46 main:574] : INFO : Epoch 1956 | loss: 0.0311071 | val_loss: 0.0311569 | Time: 2548.46 ms [2022-03-28 14:42:49 main:574] : INFO : Epoch 1957 | loss: 0.0311066 | val_loss: 0.0311576 | Time: 2558.04 ms [2022-03-28 14:42:51 main:574] : INFO : Epoch 1958 | loss: 0.0311067 | val_loss: 0.0311505 | Time: 2454.12 ms [2022-03-28 14:42:54 main:574] : INFO : Epoch 1959 | loss: 0.0311049 | val_loss: 0.0311521 | Time: 2859.79 ms [2022-03-28 14:42:57 main:574] : INFO : Epoch 1960 | loss: 0.0311034 | val_loss: 0.0311527 | Time: 2913.47 ms [2022-03-28 14:42:59 main:574] : INFO : Epoch 1961 | loss: 0.0311037 | val_loss: 0.031156 | Time: 2414.7 ms [2022-03-28 14:43:02 main:574] : INFO : Epoch 1962 | loss: 0.0311032 | val_loss: 0.0311582 | Time: 2798.77 ms [2022-03-28 14:43:05 main:574] : INFO : Epoch 1963 | loss: 0.0311012 | val_loss: 0.0311595 | Time: 2669.35 ms [2022-03-28 14:43:07 main:574] : INFO : Epoch 1964 | loss: 0.0311014 | val_loss: 0.0311591 | Time: 2408.2 ms [2022-03-28 14:43:10 main:574] : INFO : Epoch 1965 | loss: 0.0311003 | val_loss: 0.0311529 | Time: 2851.83 ms [2022-03-28 14:43:13 main:574] : INFO : Epoch 1966 | loss: 0.0310999 | val_loss: 0.0311544 | Time: 2640.41 ms [2022-03-28 14:43:15 main:574] : INFO : Epoch 1967 | loss: 0.0310988 | val_loss: 0.0311564 | Time: 2449.4 ms [2022-03-28 14:43:18 main:574] : INFO : Epoch 1968 | loss: 0.0310991 | val_loss: 0.0311689 | Time: 2788.23 ms [2022-03-28 14:43:20 main:574] : INFO : Epoch 1969 | loss: 0.0311011 | val_loss: 0.0311562 | Time: 2379.68 ms [2022-03-28 14:43:23 main:574] : INFO : Epoch 1970 | loss: 0.0310989 | val_loss: 0.0311551 | Time: 2663.97 ms [2022-03-28 14:43:26 main:574] : INFO : Epoch 1971 | loss: 0.0310989 | val_loss: 0.031157 | Time: 2770.72 ms [2022-03-28 14:43:38 main:574] : INFO : Epoch 1972 | loss: 0.0310979 | val_loss: 0.031158 | Time: 12582.7 ms [2022-03-28 14:43:41 main:574] : INFO : Epoch 1973 | loss: 0.0310975 | val_loss: 0.0311573 | Time: 2528.5 ms [2022-03-28 14:43:43 main:574] : INFO : Epoch 1974 | loss: 0.0310985 | val_loss: 0.0311629 | Time: 2586.99 ms [2022-03-28 14:43:46 main:574] : INFO : Epoch 1975 | loss: 0.0311005 | val_loss: 0.0311585 | Time: 2321.04 ms [2022-03-28 14:43:48 main:574] : INFO : Epoch 1976 | loss: 0.0310988 | val_loss: 0.0311569 | Time: 2580.79 ms [2022-03-28 14:43:51 main:574] : INFO : Epoch 1977 | loss: 0.0311006 | val_loss: 0.0311595 | Time: 2647.99 ms [2022-03-28 14:43:53 main:574] : INFO : Epoch 1978 | loss: 0.0310995 | val_loss: 0.0311572 | Time: 2392.52 ms [2022-03-28 14:43:56 main:574] : INFO : Epoch 1979 | loss: 0.0311005 | val_loss: 0.0311598 | Time: 2627.49 ms [2022-03-28 14:43:59 main:574] : INFO : Epoch 1980 | loss: 0.0311027 | val_loss: 0.0311624 | Time: 3021.93 ms [2022-03-28 14:44:02 main:574] : INFO : Epoch 1981 | loss: 0.031105 | val_loss: 0.0311516 | Time: 2535.06 ms [2022-03-28 14:44:05 main:574] : INFO : Epoch 1982 | loss: 0.0311078 | val_loss: 0.0311569 | Time: 3029 ms [2022-03-28 14:44:08 main:574] : INFO : Epoch 1983 | loss: 0.0311063 | val_loss: 0.0311483 | Time: 3171.21 ms [2022-03-28 14:44:10 main:574] : INFO : Epoch 1984 | loss: 0.0311017 | val_loss: 0.0311517 | Time: 2344.43 ms [2022-03-28 14:44:13 main:574] : INFO : Epoch 1985 | loss: 0.0311001 | val_loss: 0.0311516 | Time: 2867.66 ms [2022-03-28 14:44:16 main:574] : INFO : Epoch 1986 | loss: 0.0310994 | val_loss: 0.0311526 | Time: 2790.13 ms [2022-03-28 14:44:18 main:574] : INFO : Epoch 1987 | loss: 0.0310991 | val_loss: 0.0311538 | Time: 2574.04 ms [2022-03-28 14:44:21 main:574] : INFO : Epoch 1988 | loss: 0.0311054 | val_loss: 0.0311536 | Time: 2810.38 ms [2022-03-28 14:44:24 main:574] : INFO : Epoch 1989 | loss: 0.0311098 | val_loss: 0.0311611 | Time: 2994.92 ms [2022-03-28 14:44:27 main:574] : INFO : Epoch 1990 | loss: 0.0311103 | val_loss: 0.0311581 | Time: 2687.32 ms [2022-03-28 14:44:40 main:574] : INFO : Epoch 1991 | loss: 0.0311107 | val_loss: 0.0311522 | Time: 13060.2 ms [2022-03-28 14:44:43 main:574] : INFO : Epoch 1992 | loss: 0.0311145 | val_loss: 0.0311501 | Time: 2637.07 ms [2022-03-28 14:44:45 main:574] : INFO : Epoch 1993 | loss: 0.0311099 | val_loss: 0.031155 | Time: 2673.44 ms [2022-03-28 14:44:48 main:574] : INFO : Epoch 1994 | loss: 0.0311093 | val_loss: 0.0311512 | Time: 2338.53 ms [2022-03-28 14:44:50 main:574] : INFO : Epoch 1995 | loss: 0.0311041 | val_loss: 0.0311548 | Time: 2587.5 ms [2022-03-28 14:44:53 main:574] : INFO : Epoch 1996 | loss: 0.0311022 | val_loss: 0.0311507 | Time: 2555.83 ms [2022-03-28 14:44:55 main:574] : INFO : Epoch 1997 | loss: 0.0311028 | val_loss: 0.031154 | Time: 2547.11 ms [2022-03-28 14:44:58 main:574] : INFO : Epoch 1998 | loss: 0.0311037 | val_loss: 0.0311591 | Time: 2890.37 ms [2022-03-28 14:45:01 main:574] : INFO : Epoch 1999 | loss: 0.0311004 | val_loss: 0.0311497 | Time: 3079.95 ms [2022-03-28 14:45:04 main:574] : INFO : Epoch 2000 | loss: 0.031103 | val_loss: 0.0311541 | Time: 2536.39 ms [2022-03-28 14:45:07 main:574] : INFO : Epoch 2001 | loss: 0.0311007 | val_loss: 0.0311524 | Time: 2757.77 ms [2022-03-28 14:45:09 main:574] : INFO : Epoch 2002 | loss: 0.0311033 | val_loss: 0.031158 | Time: 2821.09 ms [2022-03-28 14:45:12 main:574] : INFO : Epoch 2003 | loss: 0.0311022 | val_loss: 0.0311547 | Time: 2662.9 ms [2022-03-28 14:45:15 main:574] : INFO : Epoch 2004 | loss: 0.031102 | val_loss: 0.0311557 | Time: 2898.61 ms [2022-03-28 14:45:18 main:574] : INFO : Epoch 2005 | loss: 0.0311016 | val_loss: 0.0311573 | Time: 2809.1 ms [2022-03-28 14:45:20 main:574] : INFO : Epoch 2006 | loss: 0.0310998 | val_loss: 0.0311542 | Time: 2290.97 ms [2022-03-28 14:45:23 main:574] : INFO : Epoch 2007 | loss: 0.0310982 | val_loss: 0.0311557 | Time: 3003.77 ms [2022-03-28 14:45:26 main:574] : INFO : Epoch 2008 | loss: 0.0310983 | val_loss: 0.0311598 | Time: 2744.09 ms [2022-03-28 14:45:28 main:574] : INFO : Epoch 2009 | loss: 0.0311005 | val_loss: 0.0311566 | Time: 2267.65 ms [2022-03-28 14:45:41 main:574] : INFO : Epoch 2010 | loss: 0.0311015 | val_loss: 0.0311513 | Time: 12726.2 ms [2022-03-28 14:45:44 main:574] : INFO : Epoch 2011 | loss: 0.0311019 | val_loss: 0.0311538 | Time: 2688.58 ms [2022-03-28 14:45:46 main:574] : INFO : Epoch 2012 | loss: 0.0311028 | val_loss: 0.0311521 | Time: 2320.82 ms [2022-03-28 14:45:49 main:574] : INFO : Epoch 2013 | loss: 0.0310994 | val_loss: 0.0311582 | Time: 2696.43 ms [2022-03-28 14:45:51 main:574] : INFO : Epoch 2014 | loss: 0.0311039 | val_loss: 0.0311592 | Time: 2493.23 ms [2022-03-28 14:45:53 main:574] : INFO : Epoch 2015 | loss: 0.0311043 | val_loss: 0.0311656 | Time: 2364.91 ms [2022-03-28 14:45:56 main:574] : INFO : Epoch 2016 | loss: 0.0311002 | val_loss: 0.0311599 | Time: 2737.08 ms [2022-03-28 14:45:59 main:574] : INFO : Epoch 2017 | loss: 0.0311011 | val_loss: 0.0311549 | Time: 2577.93 ms [2022-03-28 14:46:02 main:574] : INFO : Epoch 2018 | loss: 0.0310999 | val_loss: 0.0311586 | Time: 2802.58 ms [2022-03-28 14:46:04 main:574] : INFO : Epoch 2019 | loss: 0.0310992 | val_loss: 0.0311565 | Time: 2845.28 ms [2022-03-28 14:46:07 main:574] : INFO : Epoch 2020 | loss: 0.0310972 | val_loss: 0.0311568 | Time: 2729.88 ms [2022-03-28 14:46:10 main:574] : INFO : Epoch 2021 | loss: 0.0311044 | val_loss: 0.0311543 | Time: 2587.61 ms [2022-03-28 14:46:12 main:574] : INFO : Epoch 2022 | loss: 0.0311095 | val_loss: 0.0311547 | Time: 2698.29 ms [2022-03-28 14:46:15 main:574] : INFO : Epoch 2023 | loss: 0.0311067 | val_loss: 0.0311524 | Time: 2517.74 ms [2022-03-28 14:46:18 main:574] : INFO : Epoch 2024 | loss: 0.0311053 | val_loss: 0.0311527 | Time: 2595.81 ms [2022-03-28 14:46:20 main:574] : INFO : Epoch 2025 | loss: 0.0311057 | val_loss: 0.0311558 | Time: 2740.08 ms [2022-03-28 14:46:23 main:574] : INFO : Epoch 2026 | loss: 0.0311037 | val_loss: 0.0311548 | Time: 2333.29 ms [2022-03-28 14:46:25 main:574] : INFO : Epoch 2027 | loss: 0.0311042 | val_loss: 0.0311571 | Time: 2806.71 ms [2022-03-28 14:46:28 main:574] : INFO : Epoch 2028 | loss: 0.0311041 | val_loss: 0.0311484 | Time: 2800.1 ms [2022-03-28 14:46:41 main:574] : INFO : Epoch 2029 | loss: 0.0311038 | val_loss: 0.0311511 | Time: 12984.8 ms [2022-03-28 14:46:44 main:574] : INFO : Epoch 2030 | loss: 0.0311036 | val_loss: 0.0311653 | Time: 2385.26 ms [2022-03-28 14:46:46 main:574] : INFO : Epoch 2031 | loss: 0.031105 | val_loss: 0.0311628 | Time: 2610.53 ms [2022-03-28 14:46:49 main:574] : INFO : Epoch 2032 | loss: 0.0311031 | val_loss: 0.0311547 | Time: 2319.52 ms [2022-03-28 14:46:51 main:574] : INFO : Epoch 2033 | loss: 0.0311023 | val_loss: 0.0311529 | Time: 2688.11 ms [2022-03-28 14:46:54 main:574] : INFO : Epoch 2034 | loss: 0.031105 | val_loss: 0.0311539 | Time: 3045.36 ms [2022-03-28 14:46:57 main:574] : INFO : Epoch 2035 | loss: 0.0311056 | val_loss: 0.031151 | Time: 2566.14 ms [2022-03-28 14:47:00 main:574] : INFO : Epoch 2036 | loss: 0.0311023 | val_loss: 0.0311573 | Time: 2739.11 ms [2022-03-28 14:47:02 main:574] : INFO : Epoch 2037 | loss: 0.0311025 | val_loss: 0.0311584 | Time: 2814.89 ms [2022-03-28 14:47:05 main:574] : INFO : Epoch 2038 | loss: 0.0311024 | val_loss: 0.031156 | Time: 2823.95 ms [2022-03-28 14:47:08 main:574] : INFO : Epoch 2039 | loss: 0.0311009 | val_loss: 0.0311571 | Time: 2492.55 ms [2022-03-28 14:47:11 main:574] : INFO : Epoch 2040 | loss: 0.0310987 | val_loss: 0.0311563 | Time: 2828.25 ms [2022-03-28 14:47:13 main:574] : INFO : Epoch 2041 | loss: 0.0310991 | val_loss: 0.0311511 | Time: 2676.52 ms [2022-03-28 14:47:16 main:574] : INFO : Epoch 2042 | loss: 0.0310993 | val_loss: 0.0311536 | Time: 2486.33 ms [2022-03-28 14:47:19 main:574] : INFO : Epoch 2043 | loss: 0.0311026 | val_loss: 0.0311502 | Time: 2761.76 ms [2022-03-28 14:47:21 main:574] : INFO : Epoch 2044 | loss: 0.0310997 | val_loss: 0.0311526 | Time: 2329.03 ms [2022-03-28 14:47:24 main:574] : INFO : Epoch 2045 | loss: 0.0311021 | val_loss: 0.0311551 | Time: 2736.93 ms [2022-03-28 14:47:26 main:574] : INFO : Epoch 2046 | loss: 0.0311033 | val_loss: 0.0311548 | Time: 2805.26 ms [2022-03-28 14:47:29 main:574] : INFO : Epoch 2047 | loss: 0.0311039 | val_loss: 0.0311557 | Time: 2344.03 ms [2022-03-28 14:47:42 main:574] : INFO : Epoch 2048 | loss: 0.0311013 | val_loss: 0.0311543 | Time: 13320.2 ms [2022-03-28 14:47:42 main:597] : INFO : Saving trained model to model-final.pt, val_loss 0.0311543 [2022-03-28 14:47:42 main:603] : INFO : Saving end state to config to file [2022-03-28 14:47:42 main:608] : INFO : Success, exiting.. 14:47:42 (27636): called boinc_finish(0) </stderr_txt> ]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)