Task 13231189

Name ParityModified-1647041176-23985-1-0_0
Workunit 10350586
Created 15 Mar 2022, 13:09:23 UTC
Sent 22 Mar 2022, 4:18:15 UTC
Report deadline 30 Mar 2022, 4:18:15 UTC
Received 23 Mar 2022, 6:29:19 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 16991
Run time 7 hours 41 min 4 sec
CPU time 5 hours 57 min 57 sec
Validate state Valid
Credit 4,160.00
Device peak FLOPS 1,305.84 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.54 GB
Peak swap size 3.44 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.20</core_client_version>
<![CDATA[
<stderr_txt>
ss: 0.0313535 | Time: 13141.6 ms
[2022-03-22 21:09:01	                main:574]	:	INFO	:	Epoch 1629 | loss: 0.0309994 | val_loss: 0.0313412 | Time: 13355 ms
[2022-03-22 21:09:14	                main:574]	:	INFO	:	Epoch 1630 | loss: 0.0309957 | val_loss: 0.0313458 | Time: 12640.1 ms
[2022-03-22 21:09:27	                main:574]	:	INFO	:	Epoch 1631 | loss: 0.0310221 | val_loss: 0.031332 | Time: 13500 ms
[2022-03-22 21:09:40	                main:574]	:	INFO	:	Epoch 1632 | loss: 0.0310073 | val_loss: 0.0313484 | Time: 12561.2 ms
[2022-03-22 21:09:52	                main:574]	:	INFO	:	Epoch 1633 | loss: 0.0310045 | val_loss: 0.0313361 | Time: 12608.3 ms
[2022-03-22 21:10:06	                main:574]	:	INFO	:	Epoch 1634 | loss: 0.0310013 | val_loss: 0.0313703 | Time: 13212 ms
[2022-03-22 21:10:19	                main:574]	:	INFO	:	Epoch 1635 | loss: 0.0310031 | val_loss: 0.0313284 | Time: 13556.8 ms
[2022-03-22 21:10:32	                main:574]	:	INFO	:	Epoch 1636 | loss: 0.0309977 | val_loss: 0.0313471 | Time: 13373.3 ms
[2022-03-22 21:10:45	                main:574]	:	INFO	:	Epoch 1637 | loss: 0.0310026 | val_loss: 0.0313398 | Time: 12766.4 ms
[2022-03-22 21:10:58	                main:574]	:	INFO	:	Epoch 1638 | loss: 0.030996 | val_loss: 0.031352 | Time: 13050.6 ms
[2022-03-22 21:11:12	                main:574]	:	INFO	:	Epoch 1639 | loss: 0.0309978 | val_loss: 0.0313325 | Time: 13708.9 ms
[2022-03-22 21:11:25	                main:574]	:	INFO	:	Epoch 1640 | loss: 0.0310011 | val_loss: 0.0313534 | Time: 13170.2 ms
[2022-03-22 21:11:39	                main:574]	:	INFO	:	Epoch 1641 | loss: 0.031 | val_loss: 0.0313566 | Time: 13417.3 ms
[2022-03-22 21:11:51	                main:574]	:	INFO	:	Epoch 1642 | loss: 0.0310041 | val_loss: 0.0313441 | Time: 12636.8 ms
[2022-03-22 21:12:05	                main:574]	:	INFO	:	Epoch 1643 | loss: 0.0310054 | val_loss: 0.0313149 | Time: 13425.8 ms
[2022-03-22 21:12:18	                main:574]	:	INFO	:	Epoch 1644 | loss: 0.0310071 | val_loss: 0.0313495 | Time: 13558.7 ms
[2022-03-22 21:12:31	                main:574]	:	INFO	:	Epoch 1645 | loss: 0.0310048 | val_loss: 0.0313258 | Time: 12962.8 ms
[2022-03-22 21:12:45	                main:574]	:	INFO	:	Epoch 1646 | loss: 0.0309949 | val_loss: 0.0313464 | Time: 13842.5 ms
[2022-03-22 21:12:58	                main:574]	:	INFO	:	Epoch 1647 | loss: 0.0309921 | val_loss: 0.0313458 | Time: 12632.2 ms
[2022-03-22 21:13:12	                main:574]	:	INFO	:	Epoch 1648 | loss: 0.0310066 | val_loss: 0.031362 | Time: 13566.2 ms
[2022-03-22 21:13:25	                main:574]	:	INFO	:	Epoch 1649 | loss: 0.0310038 | val_loss: 0.0313664 | Time: 13176.2 ms
[2022-03-22 21:13:38	                main:574]	:	INFO	:	Epoch 1650 | loss: 0.0309974 | val_loss: 0.0313321 | Time: 13259 ms
[2022-03-22 21:13:51	                main:574]	:	INFO	:	Epoch 1651 | loss: 0.0310002 | val_loss: 0.0313257 | Time: 13222.7 ms
[2022-03-22 21:14:04	                main:574]	:	INFO	:	Epoch 1652 | loss: 0.031007 | val_loss: 0.0313203 | Time: 13127.8 ms
[2022-03-22 21:14:18	                main:574]	:	INFO	:	Epoch 1653 | loss: 0.0310024 | val_loss: 0.0313515 | Time: 13395.8 ms
[2022-03-22 21:14:31	                main:574]	:	INFO	:	Epoch 1654 | loss: 0.0310091 | val_loss: 0.0313461 | Time: 12919 ms
[2022-03-22 21:14:43	                main:574]	:	INFO	:	Epoch 1655 | loss: 0.031003 | val_loss: 0.0313468 | Time: 12518.2 ms
[2022-03-22 21:14:57	                main:574]	:	INFO	:	Epoch 1656 | loss: 0.0310073 | val_loss: 0.0313592 | Time: 13658.9 ms
[2022-03-22 21:15:11	                main:574]	:	INFO	:	Epoch 1657 | loss: 0.0310062 | val_loss: 0.0313153 | Time: 13568.5 ms
[2022-03-22 21:15:24	                main:574]	:	INFO	:	Epoch 1658 | loss: 0.0309983 | val_loss: 0.0313574 | Time: 13513.6 ms
[2022-03-22 21:15:37	                main:574]	:	INFO	:	Epoch 1659 | loss: 0.0309952 | val_loss: 0.0313487 | Time: 13064.8 ms
[2022-03-22 21:15:50	                main:574]	:	INFO	:	Epoch 1660 | loss: 0.0309982 | val_loss: 0.0313285 | Time: 12855.9 ms
[2022-03-22 21:16:04	                main:574]	:	INFO	:	Epoch 1661 | loss: 0.0309987 | val_loss: 0.031323 | Time: 13512.5 ms
[2022-03-22 21:16:17	                main:574]	:	INFO	:	Epoch 1662 | loss: 0.0310019 | val_loss: 0.0313299 | Time: 13155.7 ms
[2022-03-22 21:16:29	                main:574]	:	INFO	:	Epoch 1663 | loss: 0.0310098 | val_loss: 0.0313408 | Time: 12397 ms
[2022-03-22 21:16:42	                main:574]	:	INFO	:	Epoch 1664 | loss: 0.0310059 | val_loss: 0.0313659 | Time: 13251.6 ms
[2022-03-22 21:16:57	                main:574]	:	INFO	:	Epoch 1665 | loss: 0.0310036 | val_loss: 0.0313423 | Time: 14237.3 ms
[2022-03-22 21:17:11	                main:574]	:	INFO	:	Epoch 1666 | loss: 0.0310081 | val_loss: 0.031347 | Time: 13897.6 ms
[2022-03-22 21:17:25	                main:574]	:	INFO	:	Epoch 1667 | loss: 0.0310109 | val_loss: 0.0313251 | Time: 14043 ms
[2022-03-22 21:17:38	                main:574]	:	INFO	:	Epoch 1668 | loss: 0.0310197 | val_loss: 0.0313596 | Time: 12989.5 ms
[2022-03-22 21:17:50	                main:574]	:	INFO	:	Epoch 1669 | loss: 0.0310069 | val_loss: 0.0313146 | Time: 12668.3 ms
[2022-03-22 21:18:03	                main:574]	:	INFO	:	Epoch 1670 | loss: 0.0310034 | val_loss: 0.0313477 | Time: 12941.7 ms
[2022-03-22 21:18:17	                main:574]	:	INFO	:	Epoch 1671 | loss: 0.0310027 | val_loss: 0.0313451 | Time: 13509.3 ms
[2022-03-22 21:18:30	                main:574]	:	INFO	:	Epoch 1672 | loss: 0.0310066 | val_loss: 0.0313272 | Time: 13248.7 ms
[2022-03-22 21:18:42	                main:574]	:	INFO	:	Epoch 1673 | loss: 0.0310104 | val_loss: 0.0313573 | Time: 12327.5 ms
[2022-03-22 21:18:56	                main:574]	:	INFO	:	Epoch 1674 | loss: 0.0310163 | val_loss: 0.0313616 | Time: 13195.8 ms
[2022-03-22 21:19:09	                main:574]	:	INFO	:	Epoch 1675 | loss: 0.0310048 | val_loss: 0.0313276 | Time: 13104.5 ms
[2022-03-22 21:19:22	                main:574]	:	INFO	:	Epoch 1676 | loss: 0.0310007 | val_loss: 0.0313363 | Time: 12830.7 ms
[2022-03-22 21:19:35	                main:574]	:	INFO	:	Epoch 1677 | loss: 0.0309985 | val_loss: 0.0313175 | Time: 13240.6 ms
[2022-03-22 21:19:48	                main:574]	:	INFO	:	Epoch 1678 | loss: 0.0310025 | val_loss: 0.0313423 | Time: 13379 ms
[2022-03-22 21:20:01	                main:574]	:	INFO	:	Epoch 1679 | loss: 0.0310024 | val_loss: 0.0313329 | Time: 13106.5 ms
[2022-03-22 21:20:14	                main:574]	:	INFO	:	Epoch 1680 | loss: 0.0309988 | val_loss: 0.0313345 | Time: 12583.2 ms
[2022-03-22 21:20:28	                main:574]	:	INFO	:	Epoch 1681 | loss: 0.0309977 | val_loss: 0.0313147 | Time: 14152 ms
[2022-03-22 21:20:41	                main:574]	:	INFO	:	Epoch 1682 | loss: 0.0310011 | val_loss: 0.0313541 | Time: 12961.4 ms
[2022-03-22 21:20:55	                main:574]	:	INFO	:	Epoch 1683 | loss: 0.0310011 | val_loss: 0.031329 | Time: 14213.2 ms
[2022-03-22 21:21:10	                main:574]	:	INFO	:	Epoch 1684 | loss: 0.0310073 | val_loss: 0.0313539 | Time: 14173.9 ms
[2022-03-22 21:21:23	                main:574]	:	INFO	:	Epoch 1685 | loss: 0.0310007 | val_loss: 0.0313617 | Time: 13652.2 ms
[2022-03-22 21:21:37	                main:574]	:	INFO	:	Epoch 1686 | loss: 0.0310018 | val_loss: 0.0313403 | Time: 13245.8 ms
[2022-03-22 21:21:50	                main:574]	:	INFO	:	Epoch 1687 | loss: 0.0310072 | val_loss: 0.0313326 | Time: 13152.3 ms
[2022-03-22 21:22:03	                main:574]	:	INFO	:	Epoch 1688 | loss: 0.0309996 | val_loss: 0.0313415 | Time: 12891.1 ms
[2022-03-22 21:22:16	                main:574]	:	INFO	:	Epoch 1689 | loss: 0.0309988 | val_loss: 0.0313238 | Time: 13564.6 ms
[2022-03-22 21:22:30	                main:574]	:	INFO	:	Epoch 1690 | loss: 0.0309991 | val_loss: 0.0313308 | Time: 13626.9 ms
[2022-03-22 21:22:43	                main:574]	:	INFO	:	Epoch 1691 | loss: 0.0310045 | val_loss: 0.03134 | Time: 13141.2 ms
[2022-03-22 21:22:56	                main:574]	:	INFO	:	Epoch 1692 | loss: 0.031006 | val_loss: 0.0313694 | Time: 12615.2 ms
[2022-03-22 21:23:09	                main:574]	:	INFO	:	Epoch 1693 | loss: 0.0310045 | val_loss: 0.0313447 | Time: 13470.9 ms
[2022-03-22 21:23:23	                main:574]	:	INFO	:	Epoch 1694 | loss: 0.0310021 | val_loss: 0.0313268 | Time: 13654 ms
[2022-03-22 21:23:36	                main:574]	:	INFO	:	Epoch 1695 | loss: 0.0310053 | val_loss: 0.0313496 | Time: 13159.2 ms
[2022-03-22 21:23:49	                main:574]	:	INFO	:	Epoch 1696 | loss: 0.0310053 | val_loss: 0.0313214 | Time: 13163.6 ms
[2022-03-22 21:24:03	                main:574]	:	INFO	:	Epoch 1697 | loss: 0.0310015 | val_loss: 0.0313358 | Time: 13342.1 ms
[2022-03-22 21:24:16	                main:574]	:	INFO	:	Epoch 1698 | loss: 0.0310038 | val_loss: 0.0313389 | Time: 13542.6 ms
[2022-03-22 21:24:30	                main:574]	:	INFO	:	Epoch 1699 | loss: 0.031001 | val_loss: 0.0313449 | Time: 13829.2 ms
[2022-03-22 21:24:43	                main:574]	:	INFO	:	Epoch 1700 | loss: 0.0309973 | val_loss: 0.0313315 | Time: 12926.5 ms
[2022-03-22 21:24:56	                main:574]	:	INFO	:	Epoch 1701 | loss: 0.0309982 | val_loss: 0.0313367 | Time: 12485.9 ms
[2022-03-22 21:25:09	                main:574]	:	INFO	:	Epoch 1702 | loss: 0.0309954 | val_loss: 0.031358 | Time: 12943.3 ms
[2022-03-22 21:25:22	                main:574]	:	INFO	:	Epoch 1703 | loss: 0.0310056 | val_loss: 0.0313313 | Time: 13464.2 ms
[2022-03-22 21:25:35	                main:574]	:	INFO	:	Epoch 1704 | loss: 0.031001 | val_loss: 0.031333 | Time: 12809.2 ms
[2022-03-22 21:25:47	                main:574]	:	INFO	:	Epoch 1705 | loss: 0.0310027 | val_loss: 0.0313459 | Time: 12432.5 ms
[2022-03-22 21:26:01	                main:574]	:	INFO	:	Epoch 1706 | loss: 0.0309987 | val_loss: 0.0313352 | Time: 13608.7 ms
[2022-03-22 21:26:14	                main:574]	:	INFO	:	Epoch 1707 | loss: 0.0309972 | val_loss: 0.0313493 | Time: 13230.4 ms
[2022-03-22 21:26:28	                main:574]	:	INFO	:	Epoch 1708 | loss: 0.0310094 | val_loss: 0.0313515 | Time: 13394.1 ms
[2022-03-22 21:26:41	                main:574]	:	INFO	:	Epoch 1709 | loss: 0.0310034 | val_loss: 0.0313526 | Time: 13277 ms
[2022-03-22 21:26:54	                main:574]	:	INFO	:	Epoch 1710 | loss: 0.0310045 | val_loss: 0.0313427 | Time: 13286.4 ms
[2022-03-22 21:27:08	                main:574]	:	INFO	:	Epoch 1711 | loss: 0.0310073 | val_loss: 0.0313412 | Time: 13559.9 ms
[2022-03-22 21:27:22	                main:574]	:	INFO	:	Epoch 1712 | loss: 0.0310043 | val_loss: 0.0313441 | Time: 13791.6 ms
[2022-03-22 21:27:34	                main:574]	:	INFO	:	Epoch 1713 | loss: 0.0310011 | val_loss: 0.0313502 | Time: 12661.8 ms
[2022-03-22 21:27:47	                main:574]	:	INFO	:	Epoch 1714 | loss: 0.0310024 | val_loss: 0.0313311 | Time: 12692.1 ms
[2022-03-22 21:28:01	                main:574]	:	INFO	:	Epoch 1715 | loss: 0.0309974 | val_loss: 0.0313454 | Time: 13511.8 ms
[2022-03-22 21:28:14	                main:574]	:	INFO	:	Epoch 1716 | loss: 0.0310039 | val_loss: 0.0313323 | Time: 13407.6 ms
[2022-03-22 21:28:27	                main:574]	:	INFO	:	Epoch 1717 | loss: 0.0309986 | val_loss: 0.0313423 | Time: 13074.8 ms
[2022-03-22 21:28:40	                main:574]	:	INFO	:	Epoch 1718 | loss: 0.031002 | val_loss: 0.0313475 | Time: 12793.2 ms
[2022-03-22 21:28:53	                main:574]	:	INFO	:	Epoch 1719 | loss: 0.0309983 | val_loss: 0.0313262 | Time: 13188.2 ms
[2022-03-22 21:29:07	                main:574]	:	INFO	:	Epoch 1720 | loss: 0.031004 | val_loss: 0.0313428 | Time: 13914 ms
[2022-03-22 21:29:20	                main:574]	:	INFO	:	Epoch 1721 | loss: 0.0310088 | val_loss: 0.0313562 | Time: 13124.9 ms
[2022-03-22 21:29:33	                main:574]	:	INFO	:	Epoch 1722 | loss: 0.0310072 | val_loss: 0.0313569 | Time: 12948.5 ms
[2022-03-22 21:29:46	                main:574]	:	INFO	:	Epoch 1723 | loss: 0.031 | val_loss: 0.0313394 | Time: 12668.7 ms
[2022-03-22 21:29:59	                main:574]	:	INFO	:	Epoch 1724 | loss: 0.0310013 | val_loss: 0.0313455 | Time: 13408.4 ms
[2022-03-22 21:30:13	                main:574]	:	INFO	:	Epoch 1725 | loss: 0.0310032 | val_loss: 0.0313213 | Time: 13985.5 ms
[2022-03-22 21:30:27	                main:574]	:	INFO	:	Epoch 1726 | loss: 0.031006 | val_loss: 0.0313466 | Time: 13396.6 ms
[2022-03-22 21:30:40	                main:574]	:	INFO	:	Epoch 1727 | loss: 0.0310016 | val_loss: 0.0313165 | Time: 12805.9 ms
[2022-03-22 21:30:53	                main:574]	:	INFO	:	Epoch 1728 | loss: 0.0310017 | val_loss: 0.0313546 | Time: 13212.8 ms
[2022-03-22 21:31:06	                main:574]	:	INFO	:	Epoch 1729 | loss: 0.0310011 | val_loss: 0.0313657 | Time: 13130.3 ms
[2022-03-22 21:31:19	                main:574]	:	INFO	:	Epoch 1730 | loss: 0.0310148 | val_loss: 0.0313204 | Time: 13218.8 ms
[2022-03-22 21:31:33	                main:574]	:	INFO	:	Epoch 1731 | loss: 0.0310012 | val_loss: 0.0313498 | Time: 14250.7 ms
[2022-03-22 21:31:46	                main:574]	:	INFO	:	Epoch 1732 | loss: 0.0310075 | val_loss: 0.0313524 | Time: 12699.6 ms
[2022-03-22 21:32:00	                main:574]	:	INFO	:	Epoch 1733 | loss: 0.0310003 | val_loss: 0.0313247 | Time: 13661.8 ms
[2022-03-22 21:32:14	                main:574]	:	INFO	:	Epoch 1734 | loss: 0.0310033 | val_loss: 0.0313511 | Time: 13980.6 ms
[2022-03-22 21:32:27	                main:574]	:	INFO	:	Epoch 1735 | loss: 0.0309996 | val_loss: 0.0313373 | Time: 13584.2 ms
[2022-03-22 21:32:41	                main:574]	:	INFO	:	Epoch 1736 | loss: 0.0310008 | val_loss: 0.0313214 | Time: 13142.3 ms
[2022-03-22 21:32:54	                main:574]	:	INFO	:	Epoch 1737 | loss: 0.0310037 | val_loss: 0.0313343 | Time: 13137.7 ms
[2022-03-22 21:33:07	                main:574]	:	INFO	:	Epoch 1738 | loss: 0.0309994 | val_loss: 0.0313287 | Time: 12809.7 ms
[2022-03-22 21:33:20	                main:574]	:	INFO	:	Epoch 1739 | loss: 0.0310007 | val_loss: 0.0313647 | Time: 13704.9 ms
[2022-03-22 21:33:34	                main:574]	:	INFO	:	Epoch 1740 | loss: 0.0310008 | val_loss: 0.031355 | Time: 13230.1 ms
[2022-03-22 21:33:46	                main:574]	:	INFO	:	Epoch 1741 | loss: 0.0309995 | val_loss: 0.0313254 | Time: 12626.8 ms
[2022-03-22 21:33:59	                main:574]	:	INFO	:	Epoch 1742 | loss: 0.0310002 | val_loss: 0.0313632 | Time: 12847.6 ms
[2022-03-22 21:34:13	                main:574]	:	INFO	:	Epoch 1743 | loss: 0.0310033 | val_loss: 0.0313361 | Time: 13435 ms
[2022-03-22 21:34:25	                main:574]	:	INFO	:	Epoch 1744 | loss: 0.0310045 | val_loss: 0.0313683 | Time: 12450.2 ms
[2022-03-22 21:34:38	                main:574]	:	INFO	:	Epoch 1745 | loss: 0.0310021 | val_loss: 0.031318 | Time: 13275.7 ms
[2022-03-22 21:34:51	                main:574]	:	INFO	:	Epoch 1746 | loss: 0.0310034 | val_loss: 0.0313242 | Time: 13102.7 ms
[2022-03-22 21:35:05	                main:574]	:	INFO	:	Epoch 1747 | loss: 0.0310066 | val_loss: 0.0313696 | Time: 13734.4 ms
[2022-03-22 21:35:18	                main:574]	:	INFO	:	Epoch 1748 | loss: 0.0310052 | val_loss: 0.0313358 | Time: 12868.3 ms
[2022-03-22 21:35:33	                main:574]	:	INFO	:	Epoch 1749 | loss: 0.0310015 | val_loss: 0.0313359 | Time: 15145.4 ms
[2022-03-22 21:35:46	                main:574]	:	INFO	:	Epoch 1750 | loss: 0.0310054 | val_loss: 0.0313573 | Time: 12689.5 ms
[2022-03-22 21:36:00	                main:574]	:	INFO	:	Epoch 1751 | loss: 0.0310122 | val_loss: 0.0313429 | Time: 13618.7 ms
[2022-03-22 21:36:13	                main:574]	:	INFO	:	Epoch 1752 | loss: 0.0310127 | val_loss: 0.0313452 | Time: 13183.6 ms
[2022-03-22 21:36:27	                main:574]	:	INFO	:	Epoch 1753 | loss: 0.0310062 | val_loss: 0.0313517 | Time: 13651.4 ms
[2022-03-22 21:36:40	                main:574]	:	INFO	:	Epoch 1754 | loss: 0.0310075 | val_loss: 0.0313258 | Time: 12868.5 ms
[2022-03-22 21:36:52	                main:574]	:	INFO	:	Epoch 1755 | loss: 0.0310058 | val_loss: 0.0313191 | Time: 12311.1 ms
[2022-03-22 21:37:05	                main:574]	:	INFO	:	Epoch 1756 | loss: 0.0310035 | val_loss: 0.0313203 | Time: 13481.3 ms
[2022-03-22 21:37:19	                main:574]	:	INFO	:	Epoch 1757 | loss: 0.0309996 | val_loss: 0.031333 | Time: 13921.7 ms
[2022-03-22 21:37:33	                main:574]	:	INFO	:	Epoch 1758 | loss: 0.0310038 | val_loss: 0.0313669 | Time: 14053.3 ms
[2022-03-22 21:37:47	                main:574]	:	INFO	:	Epoch 1759 | loss: 0.0309992 | val_loss: 0.0313353 | Time: 13502.6 ms
[2022-03-22 21:38:00	                main:574]	:	INFO	:	Epoch 1760 | loss: 0.0310047 | val_loss: 0.0313225 | Time: 13045.1 ms
[2022-03-22 21:38:18	                main:574]	:	INFO	:	Epoch 1761 | loss: 0.0309996 | val_loss: 0.0313504 | Time: 18196.9 ms
[2022-03-22 21:38:33	                main:574]	:	INFO	:	Epoch 1762 | loss: 0.031 | val_loss: 0.0313647 | Time: 14542.6 ms
[2022-03-22 21:38:46	                main:574]	:	INFO	:	Epoch 1763 | loss: 0.0309976 | val_loss: 0.0313567 | Time: 12914.4 ms
[2022-03-22 21:39:00	                main:574]	:	INFO	:	Epoch 1764 | loss: 0.0309968 | val_loss: 0.031323 | Time: 13739.2 ms
[2022-03-22 21:39:12	                main:574]	:	INFO	:	Epoch 1765 | loss: 0.0309996 | val_loss: 0.0313489 | Time: 12613.2 ms
[2022-03-22 21:39:25	                main:574]	:	INFO	:	Epoch 1766 | loss: 0.0310088 | val_loss: 0.0313232 | Time: 12576 ms
[2022-03-22 21:39:38	                main:574]	:	INFO	:	Epoch 1767 | loss: 0.0310089 | val_loss: 0.031338 | Time: 13314.8 ms
[2022-03-22 21:39:52	                main:574]	:	INFO	:	Epoch 1768 | loss: 0.0310047 | val_loss: 0.0313605 | Time: 13812.2 ms
[2022-03-22 21:40:06	                main:574]	:	INFO	:	Epoch 1769 | loss: 0.0309989 | val_loss: 0.0313308 | Time: 13673.1 ms
[2022-03-22 21:40:19	                main:574]	:	INFO	:	Epoch 1770 | loss: 0.0310001 | val_loss: 0.031332 | Time: 12915.6 ms
[2022-03-22 21:40:31	                main:574]	:	INFO	:	Epoch 1771 | loss: 0.0309985 | val_loss: 0.0313368 | Time: 12750.3 ms
[2022-03-22 21:40:45	                main:574]	:	INFO	:	Epoch 1772 | loss: 0.0310072 | val_loss: 0.0313429 | Time: 13354.9 ms
[2022-03-22 21:40:58	                main:574]	:	INFO	:	Epoch 1773 | loss: 0.0309984 | val_loss: 0.0313586 | Time: 13241.3 ms
[2022-03-22 21:41:11	                main:574]	:	INFO	:	Epoch 1774 | loss: 0.0310299 | val_loss: 0.0313003 | Time: 13082 ms
[2022-03-22 21:41:24	                main:574]	:	INFO	:	Epoch 1775 | loss: 0.0310319 | val_loss: 0.0313458 | Time: 12919.2 ms
[2022-03-22 21:41:37	                main:574]	:	INFO	:	Epoch 1776 | loss: 0.0310203 | val_loss: 0.0313224 | Time: 13290.4 ms
[2022-03-22 21:41:50	                main:574]	:	INFO	:	Epoch 1777 | loss: 0.0310113 | val_loss: 0.0313531 | Time: 12883.6 ms
[2022-03-22 21:42:04	                main:574]	:	INFO	:	Epoch 1778 | loss: 0.0310084 | val_loss: 0.0313297 | Time: 13323.9 ms
[2022-03-22 21:42:18	                main:574]	:	INFO	:	Epoch 1779 | loss: 0.0310075 | val_loss: 0.0313199 | Time: 14027.6 ms
[2022-03-22 21:42:31	                main:574]	:	INFO	:	Epoch 1780 | loss: 0.0310043 | val_loss: 0.0313592 | Time: 12999.7 ms
[2022-03-22 21:42:44	                main:574]	:	INFO	:	Epoch 1781 | loss: 0.0310001 | val_loss: 0.0313511 | Time: 13566.3 ms
[2022-03-22 21:42:57	                main:574]	:	INFO	:	Epoch 1782 | loss: 0.0310042 | val_loss: 0.0313367 | Time: 12998.5 ms
[2022-03-22 21:43:10	                main:574]	:	INFO	:	Epoch 1783 | loss: 0.0310146 | val_loss: 0.0313243 | Time: 12910.7 ms
[2022-03-22 21:43:24	                main:574]	:	INFO	:	Epoch 1784 | loss: 0.0310008 | val_loss: 0.0313571 | Time: 13452.2 ms
[2022-03-22 21:43:37	                main:574]	:	INFO	:	Epoch 1785 | loss: 0.0310041 | val_loss: 0.0313195 | Time: 13416 ms
[2022-03-22 21:43:51	                main:574]	:	INFO	:	Epoch 1786 | loss: 0.0309953 | val_loss: 0.0313538 | Time: 13563.1 ms
[2022-03-22 21:44:04	                main:574]	:	INFO	:	Epoch 1787 | loss: 0.0309967 | val_loss: 0.0313602 | Time: 12882.7 ms
[2022-03-22 21:44:16	                main:574]	:	INFO	:	Epoch 1788 | loss: 0.030997 | val_loss: 0.03134 | Time: 12498 ms
[2022-03-22 21:44:30	                main:574]	:	INFO	:	Epoch 1789 | loss: 0.0310042 | val_loss: 0.0313444 | Time: 13519.8 ms
[2022-03-22 21:44:44	                main:574]	:	INFO	:	Epoch 1790 | loss: 0.0310031 | val_loss: 0.0313178 | Time: 14096.1 ms
[2022-03-22 21:44:57	                main:574]	:	INFO	:	Epoch 1791 | loss: 0.0310137 | val_loss: 0.031292 | Time: 13135.3 ms
[2022-03-22 21:45:10	                main:574]	:	INFO	:	Epoch 1792 | loss: 0.0310213 | val_loss: 0.0313613 | Time: 13140.2 ms
[2022-03-22 21:45:22	                main:574]	:	INFO	:	Epoch 1793 | loss: 0.0310045 | val_loss: 0.0313202 | Time: 12434.2 ms
[2022-03-22 21:45:36	                main:574]	:	INFO	:	Epoch 1794 | loss: 0.0309997 | val_loss: 0.0313558 | Time: 13482 ms
[2022-03-22 21:45:49	                main:574]	:	INFO	:	Epoch 1795 | loss: 0.031003 | val_loss: 0.0313428 | Time: 13164.4 ms
[2022-03-22 21:46:02	                main:574]	:	INFO	:	Epoch 1796 | loss: 0.0310056 | val_loss: 0.0313326 | Time: 13055.9 ms
[2022-03-22 21:46:15	                main:574]	:	INFO	:	Epoch 1797 | loss: 0.0310052 | val_loss: 0.0313371 | Time: 12773.7 ms
[2022-03-22 21:46:29	                main:574]	:	INFO	:	Epoch 1798 | loss: 0.0310027 | val_loss: 0.0313425 | Time: 13556.3 ms
[2022-03-22 21:46:41	                main:574]	:	INFO	:	Epoch 1799 | loss: 0.0309983 | val_loss: 0.0313178 | Time: 12821.5 ms
[2022-03-22 21:46:55	                main:574]	:	INFO	:	Epoch 1800 | loss: 0.0310058 | val_loss: 0.0313619 | Time: 13887.3 ms
[2022-03-22 21:47:09	                main:574]	:	INFO	:	Epoch 1801 | loss: 0.0310047 | val_loss: 0.0313214 | Time: 13273.9 ms
[2022-03-22 21:47:23	                main:574]	:	INFO	:	Epoch 1802 | loss: 0.0310038 | val_loss: 0.0313243 | Time: 13939.2 ms
[2022-03-22 21:47:37	                main:574]	:	INFO	:	Epoch 1803 | loss: 0.0309999 | val_loss: 0.0313359 | Time: 14661 ms
[2022-03-22 21:47:51	                main:574]	:	INFO	:	Epoch 1804 | loss: 0.0310068 | val_loss: 0.0313766 | Time: 13979.9 ms
[2022-03-22 21:48:05	                main:574]	:	INFO	:	Epoch 1805 | loss: 0.0310072 | val_loss: 0.0313133 | Time: 13484.2 ms
[2022-03-22 21:48:19	                main:574]	:	INFO	:	Epoch 1806 | loss: 0.0309997 | val_loss: 0.0313409 | Time: 13896.5 ms
[2022-03-22 21:48:32	                main:574]	:	INFO	:	Epoch 1807 | loss: 0.0310022 | val_loss: 0.0313515 | Time: 13246.9 ms
[2022-03-22 21:48:45	                main:574]	:	INFO	:	Epoch 1808 | loss: 0.0309962 | val_loss: 0.0313545 | Time: 12883.1 ms
[2022-03-22 21:48:58	                main:574]	:	INFO	:	Epoch 1809 | loss: 0.0310002 | val_loss: 0.0313449 | Time: 12767.3 ms
[2022-03-22 21:49:11	                main:574]	:	INFO	:	Epoch 1810 | loss: 0.0310047 | val_loss: 0.0313355 | Time: 13767.2 ms
[2022-03-22 21:49:26	                main:574]	:	INFO	:	Epoch 1811 | loss: 0.0310217 | val_loss: 0.0313368 | Time: 14221.2 ms
[2022-03-22 21:49:41	                main:574]	:	INFO	:	Epoch 1812 | loss: 0.0310064 | val_loss: 0.0313558 | Time: 15489.1 ms
[2022-03-22 21:49:55	                main:574]	:	INFO	:	Epoch 1813 | loss: 0.0310068 | val_loss: 0.0313312 | Time: 13808.8 ms
[2022-03-22 21:50:09	                main:574]	:	INFO	:	Epoch 1814 | loss: 0.0310042 | val_loss: 0.0313329 | Time: 13807.2 ms
[2022-03-22 21:50:22	                main:574]	:	INFO	:	Epoch 1815 | loss: 0.031002 | val_loss: 0.0313255 | Time: 13469 ms
[2022-03-22 21:50:38	                main:574]	:	INFO	:	Epoch 1816 | loss: 0.0310012 | val_loss: 0.0313352 | Time: 15105 ms
[2022-03-22 21:50:53	                main:574]	:	INFO	:	Epoch 1817 | loss: 0.0310014 | val_loss: 0.0313042 | Time: 15179.9 ms
[2022-03-22 21:51:07	                main:574]	:	INFO	:	Epoch 1818 | loss: 0.0310169 | val_loss: 0.0313418 | Time: 13878.8 ms
[2022-03-22 21:51:20	                main:574]	:	INFO	:	Epoch 1819 | loss: 0.0310099 | val_loss: 0.0313236 | Time: 13606.8 ms
[2022-03-22 21:51:34	                main:574]	:	INFO	:	Epoch 1820 | loss: 0.031002 | val_loss: 0.0313664 | Time: 13493 ms
[2022-03-22 21:51:47	                main:574]	:	INFO	:	Epoch 1821 | loss: 0.0310033 | val_loss: 0.031353 | Time: 13194.5 ms
[2022-03-22 21:52:00	                main:574]	:	INFO	:	Epoch 1822 | loss: 0.0309967 | val_loss: 0.0313382 | Time: 13104.3 ms
[2022-03-22 21:52:13	                main:574]	:	INFO	:	Epoch 1823 | loss: 0.0309961 | val_loss: 0.0313379 | Time: 12997.6 ms
[2022-03-22 21:52:27	                main:574]	:	INFO	:	Epoch 1824 | loss: 0.031 | val_loss: 0.0313356 | Time: 13332.2 ms
[2022-03-22 21:52:40	                main:574]	:	INFO	:	Epoch 1825 | loss: 0.0310041 | val_loss: 0.0313686 | Time: 13651.9 ms
[2022-03-22 21:52:53	                main:574]	:	INFO	:	Epoch 1826 | loss: 0.0309997 | val_loss: 0.0313502 | Time: 13072 ms
[2022-03-22 21:53:07	                main:574]	:	INFO	:	Epoch 1827 | loss: 0.0309997 | val_loss: 0.0313332 | Time: 13442.8 ms
[2022-03-22 21:53:20	                main:574]	:	INFO	:	Epoch 1828 | loss: 0.0310077 | val_loss: 0.0313446 | Time: 13388.6 ms
[2022-03-22 21:53:34	                main:574]	:	INFO	:	Epoch 1829 | loss: 0.0310219 | val_loss: 0.0313043 | Time: 13475.8 ms
[2022-03-22 21:53:47	                main:574]	:	INFO	:	Epoch 1830 | loss: 0.0310142 | val_loss: 0.0313269 | Time: 13500.8 ms
[2022-03-22 21:54:00	                main:574]	:	INFO	:	Epoch 1831 | loss: 0.0310058 | val_loss: 0.0313529 | Time: 12602.5 ms
[2022-03-22 21:54:13	                main:574]	:	INFO	:	Epoch 1832 | loss: 0.0309957 | val_loss: 0.0313267 | Time: 13114 ms
[2022-03-22 21:54:27	                main:574]	:	INFO	:	Epoch 1833 | loss: 0.0309996 | val_loss: 0.0313407 | Time: 13607.8 ms
[2022-03-22 21:54:40	                main:574]	:	INFO	:	Epoch 1834 | loss: 0.0309971 | val_loss: 0.0313314 | Time: 13213.1 ms
[2022-03-22 21:54:52	                main:574]	:	INFO	:	Epoch 1835 | loss: 0.0310046 | val_loss: 0.031329 | Time: 12493.3 ms
[2022-03-22 21:55:05	                main:574]	:	INFO	:	Epoch 1836 | loss: 0.0310058 | val_loss: 0.0313299 | Time: 12900 ms
[2022-03-22 21:55:19	                main:574]	:	INFO	:	Epoch 1837 | loss: 0.0310041 | val_loss: 0.0313513 | Time: 13629.4 ms
[2022-03-22 21:55:32	                main:574]	:	INFO	:	Epoch 1838 | loss: 0.0310028 | val_loss: 0.0312993 | Time: 12923.8 ms
[2022-03-22 21:55:45	                main:574]	:	INFO	:	Epoch 1839 | loss: 0.0310031 | val_loss: 0.0313403 | Time: 12752 ms
[2022-03-22 21:55:58	                main:574]	:	INFO	:	Epoch 1840 | loss: 0.0310023 | val_loss: 0.031338 | Time: 13216.4 ms
[2022-03-22 21:56:11	                main:574]	:	INFO	:	Epoch 1841 | loss: 0.0310054 | val_loss: 0.0313375 | Time: 13192.6 ms
[2022-03-22 21:56:24	                main:574]	:	INFO	:	Epoch 1842 | loss: 0.0310046 | val_loss: 0.0313211 | Time: 12806.2 ms
[2022-03-22 21:56:37	                main:574]	:	INFO	:	Epoch 1843 | loss: 0.0310035 | val_loss: 0.0313214 | Time: 12898.9 ms
[2022-03-22 21:56:50	                main:574]	:	INFO	:	Epoch 1844 | loss: 0.0310031 | val_loss: 0.031328 | Time: 13409 ms
[2022-03-22 21:57:03	                main:574]	:	INFO	:	Epoch 1845 | loss: 0.0309949 | val_loss: 0.0313264 | Time: 13108.4 ms
[2022-03-22 21:57:17	                main:574]	:	INFO	:	Epoch 1846 | loss: 0.0310013 | val_loss: 0.0313374 | Time: 13270.8 ms
[2022-03-22 21:57:29	                main:574]	:	INFO	:	Epoch 1847 | loss: 0.0310078 | val_loss: 0.0313419 | Time: 12702.3 ms
[2022-03-22 21:57:43	                main:574]	:	INFO	:	Epoch 1848 | loss: 0.0309993 | val_loss: 0.031343 | Time: 13789.2 ms
[2022-03-22 21:57:57	                main:574]	:	INFO	:	Epoch 1849 | loss: 0.0310036 | val_loss: 0.0313277 | Time: 13651.5 ms
[2022-03-22 21:58:10	                main:574]	:	INFO	:	Epoch 1850 | loss: 0.0310095 | val_loss: 0.0313273 | Time: 13387 ms
[2022-03-22 21:58:23	                main:574]	:	INFO	:	Epoch 1851 | loss: 0.0310066 | val_loss: 0.0313144 | Time: 13278.1 ms
[2022-03-22 21:58:36	                main:574]	:	INFO	:	Epoch 1852 | loss: 0.0310087 | val_loss: 0.031338 | Time: 12949.4 ms
[2022-03-22 21:58:50	                main:574]	:	INFO	:	Epoch 1853 | loss: 0.0310038 | val_loss: 0.0313293 | Time: 13231.5 ms
[2022-03-22 21:59:03	                main:574]	:	INFO	:	Epoch 1854 | loss: 0.0310001 | val_loss: 0.0313203 | Time: 13712.3 ms
[2022-03-22 21:59:16	                main:574]	:	INFO	:	Epoch 1855 | loss: 0.0309998 | val_loss: 0.0313449 | Time: 12863.8 ms
[2022-03-22 21:59:29	                main:574]	:	INFO	:	Epoch 1856 | loss: 0.0310052 | val_loss: 0.0313249 | Time: 12273.3 ms
[2022-03-22 21:59:42	                main:574]	:	INFO	:	Epoch 1857 | loss: 0.0310007 | val_loss: 0.0313255 | Time: 13290.3 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 860M)
[2022-03-22 23:29:31	                main:435]	:	INFO	:	Set logging level to 1
[2022-03-22 23:29:31	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-03-22 23:29:31	                main:444]	:	INFO	:	Resolving all filenames
[2022-03-22 23:29:31	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-22 23:29:31	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-22 23:29:31	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-22 23:29:31	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-22 23:29:31	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-22 23:29:31	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-03-22 23:29:31	                main:474]	:	INFO	:	Configuration: 
[2022-03-22 23:29:31	                main:475]	:	INFO	:	    Model type: GRU
[2022-03-22 23:29:31	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-03-22 23:29:31	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-03-22 23:29:31	                main:478]	:	INFO	:	    Batch Size: 128
[2022-03-22 23:29:31	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-03-22 23:29:31	                main:480]	:	INFO	:	    Patience: 10
[2022-03-22 23:29:31	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-03-22 23:29:31	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-03-22 23:29:31	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-03-22 23:29:31	                main:484]	:	INFO	:	    # Threads: 1
[2022-03-22 23:29:31	                main:486]	:	INFO	:	Preparing Dataset
[2022-03-22 23:29:31	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-22 23:29:34	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-03-22 23:29:55	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-03-22 23:29:55	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-03-22 23:29:57	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-03-22 23:29:58	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-03-22 23:29:58	                main:494]	:	INFO	:	Creating Model
[2022-03-22 23:29:59	                main:507]	:	INFO	:	Preparing config file
[2022-03-22 23:29:59	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-03-22 23:29:59	                main:512]	:	INFO	:	Loading config
[2022-03-22 23:29:59	                main:514]	:	INFO	:	Loading state
[2022-03-22 23:30:08	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2022-03-22 23:30:08	                main:562]	:	INFO	:	Starting Training
[2022-03-22 23:30:29	                main:574]	:	INFO	:	Epoch 1856 | loss: 0.0310818 | val_loss: 0.0313086 | Time: 20292.5 ms
[2022-03-22 23:30:42	                main:574]	:	INFO	:	Epoch 1857 | loss: 0.031036 | val_loss: 0.0313113 | Time: 13076.3 ms
[2022-03-22 23:30:54	                main:574]	:	INFO	:	Epoch 1858 | loss: 0.0310181 | val_loss: 0.0313008 | Time: 12077.1 ms
[2022-03-22 23:31:07	                main:574]	:	INFO	:	Epoch 1859 | loss: 0.0310166 | val_loss: 0.0313438 | Time: 13273.2 ms
[2022-03-22 23:31:21	                main:574]	:	INFO	:	Epoch 1860 | loss: 0.0310197 | val_loss: 0.0313438 | Time: 13542.2 ms
[2022-03-22 23:31:33	                main:574]	:	INFO	:	Epoch 1861 | loss: 0.031014 | val_loss: 0.031331 | Time: 12691.8 ms
[2022-03-22 23:31:47	                main:574]	:	INFO	:	Epoch 1862 | loss: 0.0310002 | val_loss: 0.0313546 | Time: 13073.5 ms
[2022-03-22 23:31:59	                main:574]	:	INFO	:	Epoch 1863 | loss: 0.0310017 | val_loss: 0.0313424 | Time: 12918.6 ms
[2022-03-22 23:32:12	                main:574]	:	INFO	:	Epoch 1864 | loss: 0.031001 | val_loss: 0.0313354 | Time: 12949.2 ms
[2022-03-22 23:32:25	                main:574]	:	INFO	:	Epoch 1865 | loss: 0.0310026 | val_loss: 0.0313176 | Time: 12689.3 ms
[2022-03-22 23:32:38	                main:574]	:	INFO	:	Epoch 1866 | loss: 0.03101 | val_loss: 0.031309 | Time: 12443.4 ms
[2022-03-22 23:32:51	                main:574]	:	INFO	:	Epoch 1867 | loss: 0.0310146 | val_loss: 0.0313222 | Time: 13024.4 ms
[2022-03-22 23:33:04	                main:574]	:	INFO	:	Epoch 1868 | loss: 0.0310059 | val_loss: 0.0313246 | Time: 12753.9 ms
[2022-03-22 23:33:16	                main:574]	:	INFO	:	Epoch 1869 | loss: 0.0310007 | val_loss: 0.0313333 | Time: 12311.4 ms
[2022-03-22 23:33:29	                main:574]	:	INFO	:	Epoch 1870 | loss: 0.0310024 | val_loss: 0.0313514 | Time: 12864.5 ms
[2022-03-22 23:33:42	                main:574]	:	INFO	:	Epoch 1871 | loss: 0.0310008 | val_loss: 0.0313571 | Time: 13156 ms
[2022-03-22 23:33:55	                main:574]	:	INFO	:	Epoch 1872 | loss: 0.0310057 | val_loss: 0.0313324 | Time: 12491.5 ms
[2022-03-22 23:34:08	                main:574]	:	INFO	:	Epoch 1873 | loss: 0.0310022 | val_loss: 0.0313523 | Time: 13757.2 ms
[2022-03-22 23:34:21	                main:574]	:	INFO	:	Epoch 1874 | loss: 0.0310078 | val_loss: 0.0313274 | Time: 12817.3 ms
[2022-03-22 23:34:34	                main:574]	:	INFO	:	Epoch 1875 | loss: 0.0310073 | val_loss: 0.0313369 | Time: 12566.1 ms
[2022-03-22 23:34:47	                main:574]	:	INFO	:	Epoch 1876 | loss: 0.0310152 | val_loss: 0.0313305 | Time: 12699 ms
[2022-03-22 23:35:00	                main:574]	:	INFO	:	Epoch 1877 | loss: 0.031006 | val_loss: 0.0313328 | Time: 12863.1 ms
[2022-03-22 23:35:12	                main:574]	:	INFO	:	Epoch 1878 | loss: 0.0310012 | val_loss: 0.0313315 | Time: 12706.4 ms
[2022-03-22 23:35:25	                main:574]	:	INFO	:	Epoch 1879 | loss: 0.0309987 | val_loss: 0.031347 | Time: 12608.8 ms
[2022-03-22 23:35:38	                main:574]	:	INFO	:	Epoch 1880 | loss: 0.0309997 | val_loss: 0.0313354 | Time: 12513.8 ms
[2022-03-22 23:35:51	                main:574]	:	INFO	:	Epoch 1881 | loss: 0.0310028 | val_loss: 0.0313093 | Time: 13174.4 ms
[2022-03-22 23:36:05	                main:574]	:	INFO	:	Epoch 1882 | loss: 0.0310183 | val_loss: 0.031316 | Time: 14520.1 ms
[2022-03-22 23:36:18	                main:574]	:	INFO	:	Epoch 1883 | loss: 0.031011 | val_loss: 0.0313258 | Time: 13114.7 ms
[2022-03-22 23:36:32	                main:574]	:	INFO	:	Epoch 1884 | loss: 0.0310063 | val_loss: 0.0313418 | Time: 13374.9 ms
[2022-03-22 23:36:45	                main:574]	:	INFO	:	Epoch 1885 | loss: 0.0310013 | val_loss: 0.0313543 | Time: 13039.2 ms
[2022-03-22 23:36:57	                main:574]	:	INFO	:	Epoch 1886 | loss: 0.0310033 | val_loss: 0.0313404 | Time: 12346.6 ms
[2022-03-22 23:37:10	                main:574]	:	INFO	:	Epoch 1887 | loss: 0.0310031 | val_loss: 0.0313343 | Time: 12737.9 ms
[2022-03-22 23:37:23	                main:574]	:	INFO	:	Epoch 1888 | loss: 0.0310029 | val_loss: 0.031341 | Time: 13271.5 ms
[2022-03-22 23:37:36	                main:574]	:	INFO	:	Epoch 1889 | loss: 0.0310022 | val_loss: 0.0313261 | Time: 12959.3 ms
[2022-03-22 23:37:49	                main:574]	:	INFO	:	Epoch 1890 | loss: 0.0310075 | val_loss: 0.0313388 | Time: 12521.2 ms
[2022-03-22 23:38:02	                main:574]	:	INFO	:	Epoch 1891 | loss: 0.0310062 | val_loss: 0.0313009 | Time: 13320.9 ms
[2022-03-22 23:38:15	                main:574]	:	INFO	:	Epoch 1892 | loss: 0.031006 | val_loss: 0.0313651 | Time: 12587.7 ms
[2022-03-22 23:38:28	                main:574]	:	INFO	:	Epoch 1893 | loss: 0.031004 | val_loss: 0.0313428 | Time: 12922.5 ms
[2022-03-22 23:38:41	                main:574]	:	INFO	:	Epoch 1894 | loss: 0.0310115 | val_loss: 0.0313539 | Time: 13432.1 ms
[2022-03-22 23:38:55	                main:574]	:	INFO	:	Epoch 1895 | loss: 0.0310089 | val_loss: 0.0313443 | Time: 13918.7 ms
[2022-03-22 23:39:08	                main:574]	:	INFO	:	Epoch 1896 | loss: 0.0310075 | val_loss: 0.0313236 | Time: 13283.3 ms
[2022-03-22 23:39:21	                main:574]	:	INFO	:	Epoch 1897 | loss: 0.0309992 | val_loss: 0.0313691 | Time: 12390 ms
[2022-03-22 23:39:33	                main:574]	:	INFO	:	Epoch 1898 | loss: 0.0310028 | val_loss: 0.0313625 | Time: 12652.8 ms
[2022-03-22 23:39:46	                main:574]	:	INFO	:	Epoch 1899 | loss: 0.0310004 | val_loss: 0.0313416 | Time: 13006.9 ms
[2022-03-22 23:39:59	                main:574]	:	INFO	:	Epoch 1900 | loss: 0.0310024 | val_loss: 0.0313374 | Time: 12616.6 ms
[2022-03-22 23:40:12	                main:574]	:	INFO	:	Epoch 1901 | loss: 0.0310016 | val_loss: 0.0313383 | Time: 12715.1 ms
[2022-03-22 23:40:25	                main:574]	:	INFO	:	Epoch 1902 | loss: 0.0310001 | val_loss: 0.0313313 | Time: 13084.9 ms
[2022-03-22 23:40:38	                main:574]	:	INFO	:	Epoch 1903 | loss: 0.0309994 | val_loss: 0.0313367 | Time: 12545.8 ms
[2022-03-22 23:40:50	                main:574]	:	INFO	:	Epoch 1904 | loss: 0.0310013 | val_loss: 0.0313072 | Time: 12595.2 ms
[2022-03-22 23:41:04	                main:574]	:	INFO	:	Epoch 1905 | loss: 0.031004 | val_loss: 0.0313045 | Time: 13425.3 ms
[2022-03-22 23:41:16	                main:574]	:	INFO	:	Epoch 1906 | loss: 0.031001 | val_loss: 0.0313418 | Time: 12771.8 ms
[2022-03-22 23:41:29	                main:574]	:	INFO	:	Epoch 1907 | loss: 0.0310218 | val_loss: 0.0313276 | Time: 12515 ms
[2022-03-22 23:41:43	                main:574]	:	INFO	:	Epoch 1908 | loss: 0.0310144 | val_loss: 0.0313338 | Time: 13692 ms
[2022-03-22 23:41:56	                main:574]	:	INFO	:	Epoch 1909 | loss: 0.0310008 | val_loss: 0.0313363 | Time: 13626.6 ms
[2022-03-22 23:42:09	                main:574]	:	INFO	:	Epoch 1910 | loss: 0.0309995 | val_loss: 0.0313517 | Time: 12808.9 ms
[2022-03-22 23:42:22	                main:574]	:	INFO	:	Epoch 1911 | loss: 0.0310048 | val_loss: 0.0313245 | Time: 12511.5 ms
[2022-03-22 23:42:35	                main:574]	:	INFO	:	Epoch 1912 | loss: 0.0310103 | val_loss: 0.0313087 | Time: 13115.8 ms
[2022-03-22 23:42:47	                main:574]	:	INFO	:	Epoch 1913 | loss: 0.0310093 | val_loss: 0.0313282 | Time: 12380.2 ms
[2022-03-22 23:42:59	                main:574]	:	INFO	:	Epoch 1914 | loss: 0.0310028 | val_loss: 0.0313518 | Time: 12303.4 ms
[2022-03-22 23:43:13	                main:574]	:	INFO	:	Epoch 1915 | loss: 0.0309941 | val_loss: 0.0313379 | Time: 13403 ms
[2022-03-22 23:43:26	                main:574]	:	INFO	:	Epoch 1916 | loss: 0.0310002 | val_loss: 0.0313537 | Time: 12788.6 ms
[2022-03-22 23:43:38	                main:574]	:	INFO	:	Epoch 1917 | loss: 0.030998 | val_loss: 0.0313413 | Time: 12432.6 ms
[2022-03-22 23:43:51	                main:574]	:	INFO	:	Epoch 1918 | loss: 0.0310263 | val_loss: 0.0313362 | Time: 12975.2 ms
[2022-03-22 23:44:04	                main:574]	:	INFO	:	Epoch 1919 | loss: 0.0310167 | val_loss: 0.0313375 | Time: 12779.9 ms
[2022-03-22 23:44:16	                main:574]	:	INFO	:	Epoch 1920 | loss: 0.0310011 | val_loss: 0.0313293 | Time: 12351.1 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 860M)
[2022-03-22 23:52:03	                main:435]	:	INFO	:	Set logging level to 1
[2022-03-22 23:52:03	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-03-22 23:52:03	                main:444]	:	INFO	:	Resolving all filenames
[2022-03-22 23:52:03	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-22 23:52:03	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-22 23:52:03	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-22 23:52:03	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-22 23:52:03	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-22 23:52:03	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-03-22 23:52:03	                main:474]	:	INFO	:	Configuration: 
[2022-03-22 23:52:03	                main:475]	:	INFO	:	    Model type: GRU
[2022-03-22 23:52:03	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-03-22 23:52:03	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-03-22 23:52:03	                main:478]	:	INFO	:	    Batch Size: 128
[2022-03-22 23:52:03	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-03-22 23:52:03	                main:480]	:	INFO	:	    Patience: 10
[2022-03-22 23:52:03	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-03-22 23:52:03	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-03-22 23:52:03	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-03-22 23:52:03	                main:484]	:	INFO	:	    # Threads: 1
[2022-03-22 23:52:03	                main:486]	:	INFO	:	Preparing Dataset
[2022-03-22 23:52:04	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-22 23:52:07	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-03-22 23:52:27	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-03-22 23:52:27	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-03-22 23:52:28	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-03-22 23:52:28	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-03-22 23:52:28	                main:494]	:	INFO	:	Creating Model
[2022-03-22 23:52:29	                main:507]	:	INFO	:	Preparing config file
[2022-03-22 23:52:29	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-03-22 23:52:29	                main:512]	:	INFO	:	Loading config
[2022-03-22 23:52:29	                main:514]	:	INFO	:	Loading state
[2022-03-22 23:52:38	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2022-03-22 23:52:39	                main:562]	:	INFO	:	Starting Training
[2022-03-22 23:52:58	                main:574]	:	INFO	:	Epoch 1916 | loss: 0.0311063 | val_loss: 0.0312924 | Time: 18472.5 ms
[2022-03-22 23:53:13	                main:574]	:	INFO	:	Epoch 1917 | loss: 0.0310445 | val_loss: 0.0313166 | Time: 14615 ms
[2022-03-22 23:53:27	                main:574]	:	INFO	:	Epoch 1918 | loss: 0.0310154 | val_loss: 0.0313332 | Time: 14395.2 ms
[2022-03-22 23:53:45	                main:574]	:	INFO	:	Epoch 1919 | loss: 0.0310021 | val_loss: 0.0313169 | Time: 17403.9 ms
[2022-03-22 23:53:58	                main:574]	:	INFO	:	Epoch 1920 | loss: 0.0310086 | val_loss: 0.0313308 | Time: 13714.1 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 860M)
[2022-03-22 23:57:14	                main:435]	:	INFO	:	Set logging level to 1
[2022-03-22 23:57:14	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-03-22 23:57:14	                main:444]	:	INFO	:	Resolving all filenames
[2022-03-22 23:57:14	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-22 23:57:14	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-22 23:57:14	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-22 23:57:14	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-22 23:57:14	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-22 23:57:14	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-03-22 23:57:14	                main:474]	:	INFO	:	Configuration: 
[2022-03-22 23:57:14	                main:475]	:	INFO	:	    Model type: GRU
[2022-03-22 23:57:14	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-03-22 23:57:14	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-03-22 23:57:14	                main:478]	:	INFO	:	    Batch Size: 128
[2022-03-22 23:57:14	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-03-22 23:57:14	                main:480]	:	INFO	:	    Patience: 10
[2022-03-22 23:57:14	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-03-22 23:57:14	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-03-22 23:57:14	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-03-22 23:57:14	                main:484]	:	INFO	:	    # Threads: 1
[2022-03-22 23:57:14	                main:486]	:	INFO	:	Preparing Dataset
[2022-03-22 23:57:14	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-22 23:57:17	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-03-22 23:57:37	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-03-22 23:57:37	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-03-22 23:57:38	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-03-22 23:57:38	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-03-22 23:57:38	                main:494]	:	INFO	:	Creating Model
[2022-03-22 23:57:38	                main:507]	:	INFO	:	Preparing config file
[2022-03-22 23:57:38	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-03-22 23:57:38	                main:512]	:	INFO	:	Loading config
[2022-03-22 23:57:38	                main:514]	:	INFO	:	Loading state
[2022-03-22 23:57:47	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2022-03-22 23:57:48	                main:562]	:	INFO	:	Starting Training
[2022-03-22 23:58:04	                main:574]	:	INFO	:	Epoch 1916 | loss: 0.0310987 | val_loss: 0.0313137 | Time: 16482.6 ms
[2022-03-22 23:58:18	                main:574]	:	INFO	:	Epoch 1917 | loss: 0.0310387 | val_loss: 0.0313105 | Time: 13511.2 ms
[2022-03-22 23:58:31	                main:574]	:	INFO	:	Epoch 1918 | loss: 0.0310156 | val_loss: 0.0313465 | Time: 13052.6 ms
[2022-03-22 23:58:47	                main:574]	:	INFO	:	Epoch 1919 | loss: 0.0310084 | val_loss: 0.0313462 | Time: 16004.5 ms
[2022-03-22 23:59:02	                main:574]	:	INFO	:	Epoch 1920 | loss: 0.0310098 | val_loss: 0.0313316 | Time: 15145.8 ms
[2022-03-22 23:59:15	                main:574]	:	INFO	:	Epoch 1921 | loss: 0.031012 | val_loss: 0.0313356 | Time: 13097.5 ms
[2022-03-22 23:59:28	                main:574]	:	INFO	:	Epoch 1922 | loss: 0.0310104 | val_loss: 0.0313547 | Time: 12869.7 ms
[2022-03-22 23:59:41	                main:574]	:	INFO	:	Epoch 1923 | loss: 0.0310029 | val_loss: 0.0313525 | Time: 13315.1 ms
[2022-03-22 23:59:54	                main:574]	:	INFO	:	Epoch 1924 | loss: 0.0310079 | val_loss: 0.0313226 | Time: 12842.9 ms
[2022-03-23 00:00:08	                main:574]	:	INFO	:	Epoch 1925 | loss: 0.0310057 | val_loss: 0.0313359 | Time: 14055.1 ms
[2022-03-23 00:00:22	                main:574]	:	INFO	:	Epoch 1926 | loss: 0.0310071 | val_loss: 0.0313372 | Time: 14074.2 ms
[2022-03-23 00:00:39	                main:574]	:	INFO	:	Epoch 1927 | loss: 0.0310064 | val_loss: 0.0313485 | Time: 15973.4 ms
[2022-03-23 00:00:53	                main:574]	:	INFO	:	Epoch 1928 | loss: 0.0310014 | val_loss: 0.0313302 | Time: 14737.9 ms
[2022-03-23 00:01:08	                main:574]	:	INFO	:	Epoch 1929 | loss: 0.0310125 | val_loss: 0.0313413 | Time: 14578.3 ms
[2022-03-23 00:01:23	                main:574]	:	INFO	:	Epoch 1930 | loss: 0.0310062 | val_loss: 0.031353 | Time: 14529.3 ms
[2022-03-23 00:01:37	                main:574]	:	INFO	:	Epoch 1931 | loss: 0.0309972 | val_loss: 0.031324 | Time: 14073.6 ms
[2022-03-23 00:01:51	                main:574]	:	INFO	:	Epoch 1932 | loss: 0.0310033 | val_loss: 0.0313252 | Time: 14325.3 ms
[2022-03-23 00:02:08	                main:574]	:	INFO	:	Epoch 1933 | loss: 0.0310041 | val_loss: 0.0313313 | Time: 16415.7 ms
[2022-03-23 00:02:25	                main:574]	:	INFO	:	Epoch 1934 | loss: 0.0310021 | val_loss: 0.0313282 | Time: 17086.8 ms
[2022-03-23 00:02:49	                main:574]	:	INFO	:	Epoch 1935 | loss: 0.0310037 | val_loss: 0.0313362 | Time: 24025.8 ms
[2022-03-23 00:03:16	                main:574]	:	INFO	:	Epoch 1936 | loss: 0.031002 | val_loss: 0.0313221 | Time: 26809.1 ms
[2022-03-23 00:03:33	                main:574]	:	INFO	:	Epoch 1937 | loss: 0.0310048 | val_loss: 0.0313375 | Time: 17251.2 ms
[2022-03-23 00:03:53	                main:574]	:	INFO	:	Epoch 1938 | loss: 0.031001 | val_loss: 0.0313544 | Time: 19149 ms
[2022-03-23 00:04:12	                main:574]	:	INFO	:	Epoch 1939 | loss: 0.0309979 | val_loss: 0.0313455 | Time: 19400.1 ms
[2022-03-23 00:04:29	                main:574]	:	INFO	:	Epoch 1940 | loss: 0.0310058 | val_loss: 0.0313207 | Time: 16608.7 ms
[2022-03-23 00:04:45	                main:574]	:	INFO	:	Epoch 1941 | loss: 0.0310027 | val_loss: 0.0313339 | Time: 16021.3 ms
[2022-03-23 00:05:02	                main:574]	:	INFO	:	Epoch 1942 | loss: 0.0310056 | val_loss: 0.03135 | Time: 17057.2 ms
[2022-03-23 00:05:16	                main:574]	:	INFO	:	Epoch 1943 | loss: 0.0310009 | val_loss: 0.0313375 | Time: 14439.8 ms
[2022-03-23 00:05:31	                main:574]	:	INFO	:	Epoch 1944 | loss: 0.0310064 | val_loss: 0.0313424 | Time: 14546.5 ms
[2022-03-23 00:05:45	                main:574]	:	INFO	:	Epoch 1945 | loss: 0.0310062 | val_loss: 0.0313295 | Time: 13934.8 ms
[2022-03-23 00:05:59	                main:574]	:	INFO	:	Epoch 1946 | loss: 0.0309998 | val_loss: 0.0313321 | Time: 14383.1 ms
[2022-03-23 00:06:14	                main:574]	:	INFO	:	Epoch 1947 | loss: 0.0309953 | val_loss: 0.0313635 | Time: 14309 ms
[2022-03-23 00:06:28	                main:574]	:	INFO	:	Epoch 1948 | loss: 0.0309999 | val_loss: 0.0313339 | Time: 14046.2 ms
[2022-03-23 00:06:41	                main:574]	:	INFO	:	Epoch 1949 | loss: 0.0310076 | val_loss: 0.0313484 | Time: 13756.6 ms
[2022-03-23 00:06:55	                main:574]	:	INFO	:	Epoch 1950 | loss: 0.0310104 | val_loss: 0.0313297 | Time: 13750.4 ms
[2022-03-23 00:07:09	                main:574]	:	INFO	:	Epoch 1951 | loss: 0.0310007 | val_loss: 0.0313587 | Time: 13743.1 ms
[2022-03-23 00:07:23	                main:574]	:	INFO	:	Epoch 1952 | loss: 0.0309963 | val_loss: 0.0313392 | Time: 14036.3 ms
[2022-03-23 00:07:37	                main:574]	:	INFO	:	Epoch 1953 | loss: 0.0310071 | val_loss: 0.0313144 | Time: 13675.3 ms
[2022-03-23 00:07:51	                main:574]	:	INFO	:	Epoch 1954 | loss: 0.0310071 | val_loss: 0.031324 | Time: 13996.8 ms
[2022-03-23 00:08:05	                main:574]	:	INFO	:	Epoch 1955 | loss: 0.0309986 | val_loss: 0.0313384 | Time: 14085.7 ms
[2022-03-23 00:08:19	                main:574]	:	INFO	:	Epoch 1956 | loss: 0.0309976 | val_loss: 0.0313528 | Time: 13463.5 ms
[2022-03-23 00:08:32	                main:574]	:	INFO	:	Epoch 1957 | loss: 0.0310064 | val_loss: 0.0313465 | Time: 13263.1 ms
[2022-03-23 00:08:46	                main:574]	:	INFO	:	Epoch 1958 | loss: 0.0310051 | val_loss: 0.031324 | Time: 13900.9 ms
[2022-03-23 00:08:58	                main:574]	:	INFO	:	Epoch 1959 | loss: 0.0310085 | val_loss: 0.0313084 | Time: 12576.9 ms
[2022-03-23 00:09:11	                main:574]	:	INFO	:	Epoch 1960 | loss: 0.0310041 | val_loss: 0.0313532 | Time: 12648 ms
[2022-03-23 00:09:25	                main:574]	:	INFO	:	Epoch 1961 | loss: 0.0310027 | val_loss: 0.031339 | Time: 14310.7 ms
[2022-03-23 00:09:39	                main:574]	:	INFO	:	Epoch 1962 | loss: 0.0310014 | val_loss: 0.03135 | Time: 13141.5 ms
[2022-03-23 00:09:52	                main:574]	:	INFO	:	Epoch 1963 | loss: 0.0310054 | val_loss: 0.0313333 | Time: 13205.4 ms
[2022-03-23 00:10:04	                main:574]	:	INFO	:	Epoch 1964 | loss: 0.0310025 | val_loss: 0.0313733 | Time: 12002.3 ms
[2022-03-23 00:10:17	                main:574]	:	INFO	:	Epoch 1965 | loss: 0.0310025 | val_loss: 0.0313399 | Time: 13210.6 ms
[2022-03-23 00:10:29	                main:574]	:	INFO	:	Epoch 1966 | loss: 0.0310001 | val_loss: 0.0313346 | Time: 12237.7 ms
[2022-03-23 00:10:42	                main:574]	:	INFO	:	Epoch 1967 | loss: 0.030998 | val_loss: 0.0313497 | Time: 12487.7 ms
[2022-03-23 00:10:55	                main:574]	:	INFO	:	Epoch 1968 | loss: 0.0310067 | val_loss: 0.0313291 | Time: 12763 ms
[2022-03-23 00:11:07	                main:574]	:	INFO	:	Epoch 1969 | loss: 0.0310063 | val_loss: 0.0313471 | Time: 12422.6 ms
[2022-03-23 00:11:20	                main:574]	:	INFO	:	Epoch 1970 | loss: 0.031001 | val_loss: 0.0313298 | Time: 12642 ms
[2022-03-23 00:11:33	                main:574]	:	INFO	:	Epoch 1971 | loss: 0.0310074 | val_loss: 0.031354 | Time: 12971.5 ms
[2022-03-23 00:11:46	                main:574]	:	INFO	:	Epoch 1972 | loss: 0.0310045 | val_loss: 0.031325 | Time: 12780.8 ms
[2022-03-23 00:11:58	                main:574]	:	INFO	:	Epoch 1973 | loss: 0.0310072 | val_loss: 0.0313492 | Time: 12552.2 ms
[2022-03-23 00:12:11	                main:574]	:	INFO	:	Epoch 1974 | loss: 0.0309976 | val_loss: 0.0313233 | Time: 12842.4 ms
[2022-03-23 00:12:23	                main:574]	:	INFO	:	Epoch 1975 | loss: 0.0310036 | val_loss: 0.0313431 | Time: 11754.9 ms
[2022-03-23 00:12:36	                main:574]	:	INFO	:	Epoch 1976 | loss: 0.0310014 | val_loss: 0.0313351 | Time: 13089.7 ms
[2022-03-23 00:12:48	                main:574]	:	INFO	:	Epoch 1977 | loss: 0.0310019 | val_loss: 0.0313309 | Time: 12381.5 ms
[2022-03-23 00:13:01	                main:574]	:	INFO	:	Epoch 1978 | loss: 0.031001 | val_loss: 0.0313445 | Time: 12285.4 ms
[2022-03-23 00:13:14	                main:574]	:	INFO	:	Epoch 1979 | loss: 0.0310016 | val_loss: 0.0313436 | Time: 13099.5 ms
[2022-03-23 00:13:26	                main:574]	:	INFO	:	Epoch 1980 | loss: 0.0309934 | val_loss: 0.0313326 | Time: 12199.9 ms
[2022-03-23 00:13:39	                main:574]	:	INFO	:	Epoch 1981 | loss: 0.0309955 | val_loss: 0.0313465 | Time: 12814.5 ms
[2022-03-23 00:13:52	                main:574]	:	INFO	:	Epoch 1982 | loss: 0.0310064 | val_loss: 0.0313319 | Time: 13449.5 ms
[2022-03-23 00:14:05	                main:574]	:	INFO	:	Epoch 1983 | loss: 0.0310017 | val_loss: 0.0313484 | Time: 12301.7 ms
[2022-03-23 00:14:18	                main:574]	:	INFO	:	Epoch 1984 | loss: 0.0310013 | val_loss: 0.0313278 | Time: 13889.8 ms
[2022-03-23 00:14:31	                main:574]	:	INFO	:	Epoch 1985 | loss: 0.0310019 | val_loss: 0.0313435 | Time: 12868.1 ms
[2022-03-23 00:14:45	                main:574]	:	INFO	:	Epoch 1986 | loss: 0.0310161 | val_loss: 0.0313506 | Time: 13556.9 ms
[2022-03-23 00:14:58	                main:574]	:	INFO	:	Epoch 1987 | loss: 0.0310135 | val_loss: 0.0313148 | Time: 12866.7 ms
[2022-03-23 00:15:11	                main:574]	:	INFO	:	Epoch 1988 | loss: 0.0310087 | val_loss: 0.03132 | Time: 12801.7 ms
[2022-03-23 00:15:24	                main:574]	:	INFO	:	Epoch 1989 | loss: 0.0310119 | val_loss: 0.0313148 | Time: 13029.6 ms
[2022-03-23 00:15:37	                main:574]	:	INFO	:	Epoch 1990 | loss: 0.0310194 | val_loss: 0.0313186 | Time: 13384.9 ms
[2022-03-23 00:15:50	                main:574]	:	INFO	:	Epoch 1991 | loss: 0.0310081 | val_loss: 0.0313243 | Time: 12450.3 ms
[2022-03-23 00:16:02	                main:574]	:	INFO	:	Epoch 1992 | loss: 0.0310022 | val_loss: 0.0313575 | Time: 12525.1 ms
[2022-03-23 00:16:16	                main:574]	:	INFO	:	Epoch 1993 | loss: 0.0310007 | val_loss: 0.0313101 | Time: 13418.8 ms
[2022-03-23 00:16:29	                main:574]	:	INFO	:	Epoch 1994 | loss: 0.0310083 | val_loss: 0.0313327 | Time: 13656.4 ms
[2022-03-23 00:16:42	                main:574]	:	INFO	:	Epoch 1995 | loss: 0.0310017 | val_loss: 0.0313196 | Time: 12529.1 ms
[2022-03-23 00:16:54	                main:574]	:	INFO	:	Epoch 1996 | loss: 0.0310107 | val_loss: 0.0313437 | Time: 12584 ms
[2022-03-23 00:17:08	                main:574]	:	INFO	:	Epoch 1997 | loss: 0.0310039 | val_loss: 0.0313529 | Time: 13323.6 ms
[2022-03-23 00:17:21	                main:574]	:	INFO	:	Epoch 1998 | loss: 0.0309981 | val_loss: 0.0313377 | Time: 13140 ms
[2022-03-23 00:17:33	                main:574]	:	INFO	:	Epoch 1999 | loss: 0.0309989 | val_loss: 0.0313369 | Time: 12399.8 ms
[2022-03-23 00:17:46	                main:574]	:	INFO	:	Epoch 2000 | loss: 0.0309988 | val_loss: 0.0312994 | Time: 13176.7 ms
[2022-03-23 00:17:59	                main:574]	:	INFO	:	Epoch 2001 | loss: 0.0310032 | val_loss: 0.0313238 | Time: 12698.5 ms
[2022-03-23 00:18:12	                main:574]	:	INFO	:	Epoch 2002 | loss: 0.0309997 | val_loss: 0.0313444 | Time: 12612.1 ms
[2022-03-23 00:18:25	                main:574]	:	INFO	:	Epoch 2003 | loss: 0.0309963 | val_loss: 0.0313724 | Time: 12959.5 ms
[2022-03-23 00:18:38	                main:574]	:	INFO	:	Epoch 2004 | loss: 0.0309933 | val_loss: 0.0313575 | Time: 13078.9 ms
[2022-03-23 00:18:51	                main:574]	:	INFO	:	Epoch 2005 | loss: 0.0309887 | val_loss: 0.0313522 | Time: 13277.1 ms
[2022-03-23 00:19:04	                main:574]	:	INFO	:	Epoch 2006 | loss: 0.0309927 | val_loss: 0.0313472 | Time: 12466.3 ms
[2022-03-23 00:19:17	                main:574]	:	INFO	:	Epoch 2007 | loss: 0.0310054 | val_loss: 0.0313683 | Time: 13356.1 ms
[2022-03-23 00:19:31	                main:574]	:	INFO	:	Epoch 2008 | loss: 0.0310039 | val_loss: 0.0313269 | Time: 14007.9 ms
[2022-03-23 00:19:44	                main:574]	:	INFO	:	Epoch 2009 | loss: 0.0310085 | val_loss: 0.0313097 | Time: 12946.1 ms
[2022-03-23 00:19:57	                main:574]	:	INFO	:	Epoch 2010 | loss: 0.0310153 | val_loss: 0.0313392 | Time: 12731.7 ms
[2022-03-23 00:20:10	                main:574]	:	INFO	:	Epoch 2011 | loss: 0.0310054 | val_loss: 0.031338 | Time: 13234.1 ms
[2022-03-23 00:20:23	                main:574]	:	INFO	:	Epoch 2012 | loss: 0.031001 | val_loss: 0.0313345 | Time: 12988.7 ms
[2022-03-23 00:20:35	                main:574]	:	INFO	:	Epoch 2013 | loss: 0.0310076 | val_loss: 0.0313332 | Time: 12396.6 ms
[2022-03-23 00:20:49	                main:574]	:	INFO	:	Epoch 2014 | loss: 0.0309989 | val_loss: 0.0313183 | Time: 13203.6 ms
[2022-03-23 00:21:03	                main:574]	:	INFO	:	Epoch 2015 | loss: 0.0310071 | val_loss: 0.0313587 | Time: 14117.7 ms
[2022-03-23 00:21:16	                main:574]	:	INFO	:	Epoch 2016 | loss: 0.0310069 | val_loss: 0.0313304 | Time: 13217.9 ms
[2022-03-23 00:21:29	                main:574]	:	INFO	:	Epoch 2017 | loss: 0.0310034 | val_loss: 0.0313259 | Time: 12977.3 ms
[2022-03-23 00:21:42	                main:574]	:	INFO	:	Epoch 2018 | loss: 0.0310005 | val_loss: 0.0313471 | Time: 12457.1 ms
[2022-03-23 00:21:55	                main:574]	:	INFO	:	Epoch 2019 | loss: 0.0309987 | val_loss: 0.0313415 | Time: 13364.3 ms
[2022-03-23 00:22:08	                main:574]	:	INFO	:	Epoch 2020 | loss: 0.0310041 | val_loss: 0.0313377 | Time: 12857.2 ms
[2022-03-23 00:22:20	                main:574]	:	INFO	:	Epoch 2021 | loss: 0.0310002 | val_loss: 0.0313353 | Time: 12653.9 ms
[2022-03-23 00:22:34	                main:574]	:	INFO	:	Epoch 2022 | loss: 0.0310005 | val_loss: 0.0313552 | Time: 13119.6 ms
[2022-03-23 00:22:47	                main:574]	:	INFO	:	Epoch 2023 | loss: 0.0309994 | val_loss: 0.0313487 | Time: 13130.6 ms
[2022-03-23 00:23:00	                main:574]	:	INFO	:	Epoch 2024 | loss: 0.0309949 | val_loss: 0.0313494 | Time: 12880.2 ms
[2022-03-23 00:23:12	                main:574]	:	INFO	:	Epoch 2025 | loss: 0.0310029 | val_loss: 0.0313312 | Time: 12630 ms
[2022-03-23 00:23:26	                main:574]	:	INFO	:	Epoch 2026 | loss: 0.0310013 | val_loss: 0.0313239 | Time: 13837.8 ms
[2022-03-23 00:23:41	                main:574]	:	INFO	:	Epoch 2027 | loss: 0.0310069 | val_loss: 0.0313402 | Time: 14573.3 ms
[2022-03-23 00:23:55	                main:574]	:	INFO	:	Epoch 2028 | loss: 0.0310028 | val_loss: 0.0313379 | Time: 14044.5 ms
[2022-03-23 00:24:10	                main:574]	:	INFO	:	Epoch 2029 | loss: 0.0310018 | val_loss: 0.0313157 | Time: 14576.7 ms
[2022-03-23 00:24:24	                main:574]	:	INFO	:	Epoch 2030 | loss: 0.0310014 | val_loss: 0.0313494 | Time: 14564.8 ms
[2022-03-23 00:24:38	                main:574]	:	INFO	:	Epoch 2031 | loss: 0.030999 | val_loss: 0.0313165 | Time: 13486 ms
[2022-03-23 00:24:52	                main:574]	:	INFO	:	Epoch 2032 | loss: 0.0310076 | val_loss: 0.0313328 | Time: 14111.5 ms
[2022-03-23 00:25:09	                main:574]	:	INFO	:	Epoch 2033 | loss: 0.0310026 | val_loss: 0.0313551 | Time: 17343.4 ms
[2022-03-23 00:25:34	                main:574]	:	INFO	:	Epoch 2034 | loss: 0.0309992 | val_loss: 0.0313668 | Time: 24210.3 ms
[2022-03-23 00:25:58	                main:574]	:	INFO	:	Epoch 2035 | loss: 0.0310088 | val_loss: 0.031327 | Time: 23808.4 ms
[2022-03-23 00:26:21	                main:574]	:	INFO	:	Epoch 2036 | loss: 0.031002 | val_loss: 0.031344 | Time: 23850.5 ms
[2022-03-23 00:26:40	                main:574]	:	INFO	:	Epoch 2037 | loss: 0.0309959 | val_loss: 0.0313354 | Time: 18530.4 ms
[2022-03-23 00:26:53	                main:574]	:	INFO	:	Epoch 2038 | loss: 0.0309957 | val_loss: 0.0313283 | Time: 13233.2 ms
[2022-03-23 00:27:06	                main:574]	:	INFO	:	Epoch 2039 | loss: 0.0310031 | val_loss: 0.0313531 | Time: 12704.4 ms
[2022-03-23 00:27:19	                main:574]	:	INFO	:	Epoch 2040 | loss: 0.0310097 | val_loss: 0.0313163 | Time: 12700.6 ms
[2022-03-23 00:27:31	                main:574]	:	INFO	:	Epoch 2041 | loss: 0.0310111 | val_loss: 0.0313292 | Time: 11741.6 ms
[2022-03-23 00:27:44	                main:574]	:	INFO	:	Epoch 2042 | loss: 0.0310243 | val_loss: 0.0313277 | Time: 12963.4 ms
[2022-03-23 00:27:56	                main:574]	:	INFO	:	Epoch 2043 | loss: 0.0310129 | val_loss: 0.0313219 | Time: 12325 ms
[2022-03-23 00:28:08	                main:574]	:	INFO	:	Epoch 2044 | loss: 0.0310037 | val_loss: 0.031349 | Time: 11995.3 ms
[2022-03-23 00:28:21	                main:574]	:	INFO	:	Epoch 2045 | loss: 0.0309959 | val_loss: 0.0313447 | Time: 13092.7 ms
[2022-03-23 00:28:33	                main:574]	:	INFO	:	Epoch 2046 | loss: 0.0310008 | val_loss: 0.0313525 | Time: 12218 ms
[2022-03-23 00:28:46	                main:574]	:	INFO	:	Epoch 2047 | loss: 0.0310011 | val_loss: 0.0313648 | Time: 12538.1 ms
[2022-03-23 00:29:00	                main:574]	:	INFO	:	Epoch 2048 | loss: 0.0310021 | val_loss: 0.0313337 | Time: 13591.1 ms
[2022-03-23 00:29:00	                main:597]	:	INFO	:	Saving trained model to model-final.pt, val_loss 0.0313337
[2022-03-23 00:29:00	                main:603]	:	INFO	:	Saving end state to config to file
[2022-03-23 00:29:00	                main:608]	:	INFO	:	Success, exiting..
00:29:00 (14516): called boinc_finish(0)

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)