Task 14548705

Name ParityModified-1647046354-28131-3-0_0
Workunit 11575020
Created 8 Apr 2022, 6:01:04 UTC
Sent 10 Apr 2022, 22:39:31 UTC
Report deadline 18 Apr 2022, 22:39:31 UTC
Received 11 Apr 2022, 22:13:38 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 13905
Run time 1 hours 8 min 5 sec
CPU time 1 hours 5 min 35 sec
Validate state Valid
Credit 4,160.00
Device peak FLOPS 4,572.37 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.63 GB
Peak swap size 3.61 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.20</core_client_version>
<![CDATA[
<stderr_txt>
-04-11 12:35:36	                main:574]	:	INFO	:	Epoch 1655 | loss: 0.0311296 | val_loss: 0.0311499 | Time: 3371.18 ms
[2022-04-11 12:35:39	                main:574]	:	INFO	:	Epoch 1656 | loss: 0.0311294 | val_loss: 0.0311521 | Time: 3364.22 ms
[2022-04-11 12:35:42	                main:574]	:	INFO	:	Epoch 1657 | loss: 0.0311276 | val_loss: 0.0311533 | Time: 3414.58 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1060 6GB)
[2022-04-11 12:38:48	                main:435]	:	INFO	:	Set logging level to 1
[2022-04-11 12:38:48	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-04-11 12:38:48	                main:444]	:	INFO	:	Resolving all filenames
[2022-04-11 12:38:48	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-11 12:38:48	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-11 12:38:48	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-11 12:38:48	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-11 12:38:48	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-11 12:38:48	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-04-11 12:38:48	                main:474]	:	INFO	:	Configuration: 
[2022-04-11 12:38:48	                main:475]	:	INFO	:	    Model type: GRU
[2022-04-11 12:38:48	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-04-11 12:38:48	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-04-11 12:38:48	                main:478]	:	INFO	:	    Batch Size: 128
[2022-04-11 12:38:48	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-04-11 12:38:48	                main:480]	:	INFO	:	    Patience: 10
[2022-04-11 12:38:48	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-04-11 12:38:48	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-04-11 12:38:48	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-04-11 12:38:48	                main:484]	:	INFO	:	    # Threads: 1
[2022-04-11 12:38:48	                main:486]	:	INFO	:	Preparing Dataset
[2022-04-11 12:38:48	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-11 12:38:49	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-11 12:38:51	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-04-11 12:38:51	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-11 12:38:51	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-11 12:38:51	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-04-11 12:38:51	                main:494]	:	INFO	:	Creating Model
[2022-04-11 12:38:51	                main:507]	:	INFO	:	Preparing config file
[2022-04-11 12:38:51	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-04-11 12:38:51	                main:512]	:	INFO	:	Loading config
[2022-04-11 12:38:51	                main:514]	:	INFO	:	Loading state
[2022-04-11 12:38:52	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2022-04-11 12:38:52	                main:562]	:	INFO	:	Starting Training
[2022-04-11 12:38:55	                main:574]	:	INFO	:	Epoch 1641 | loss: 0.0311701 | val_loss: 0.0311604 | Time: 3559.27 ms
[2022-04-11 12:38:58	                main:574]	:	INFO	:	Epoch 1642 | loss: 0.0311334 | val_loss: 0.0311497 | Time: 3287.46 ms
[2022-04-11 12:39:02	                main:574]	:	INFO	:	Epoch 1643 | loss: 0.0311304 | val_loss: 0.0311505 | Time: 3325.33 ms
[2022-04-11 12:39:05	                main:574]	:	INFO	:	Epoch 1644 | loss: 0.0311317 | val_loss: 0.0311503 | Time: 3350.97 ms
[2022-04-11 12:39:08	                main:574]	:	INFO	:	Epoch 1645 | loss: 0.0311304 | val_loss: 0.0311516 | Time: 3348.1 ms
[2022-04-11 12:39:12	                main:574]	:	INFO	:	Epoch 1646 | loss: 0.0311271 | val_loss: 0.0311525 | Time: 3368.75 ms
[2022-04-11 12:39:15	                main:574]	:	INFO	:	Epoch 1647 | loss: 0.0311328 | val_loss: 0.031153 | Time: 3365.48 ms
[2022-04-11 12:39:19	                main:574]	:	INFO	:	Epoch 1648 | loss: 0.0311308 | val_loss: 0.0311494 | Time: 3365.36 ms
[2022-04-11 12:39:22	                main:574]	:	INFO	:	Epoch 1649 | loss: 0.031135 | val_loss: 0.0311569 | Time: 3375.2 ms
[2022-04-11 12:39:25	                main:574]	:	INFO	:	Epoch 1650 | loss: 0.0311318 | val_loss: 0.0311525 | Time: 3368.75 ms
[2022-04-11 12:39:29	                main:574]	:	INFO	:	Epoch 1651 | loss: 0.0311326 | val_loss: 0.0311556 | Time: 3373.61 ms
[2022-04-11 12:39:32	                main:574]	:	INFO	:	Epoch 1652 | loss: 0.0311294 | val_loss: 0.0311497 | Time: 3363.71 ms
[2022-04-11 12:39:35	                main:574]	:	INFO	:	Epoch 1653 | loss: 0.0311284 | val_loss: 0.0311522 | Time: 3365.19 ms
[2022-04-11 12:39:39	                main:574]	:	INFO	:	Epoch 1654 | loss: 0.0311324 | val_loss: 0.0311517 | Time: 3374.84 ms
[2022-04-11 12:39:42	                main:574]	:	INFO	:	Epoch 1655 | loss: 0.0311307 | val_loss: 0.0311554 | Time: 3367.87 ms
[2022-04-11 12:39:46	                main:574]	:	INFO	:	Epoch 1656 | loss: 0.0311368 | val_loss: 0.0311486 | Time: 3364.43 ms
[2022-04-11 12:39:49	                main:574]	:	INFO	:	Epoch 1657 | loss: 0.0311352 | val_loss: 0.0311545 | Time: 3366.11 ms
[2022-04-11 12:39:52	                main:574]	:	INFO	:	Epoch 1658 | loss: 0.0311405 | val_loss: 0.0311583 | Time: 3369.41 ms
[2022-04-11 12:39:56	                main:574]	:	INFO	:	Epoch 1659 | loss: 0.0311363 | val_loss: 0.0311473 | Time: 3368.77 ms
[2022-04-11 12:39:59	                main:574]	:	INFO	:	Epoch 1660 | loss: 0.0311321 | val_loss: 0.0311507 | Time: 3377.53 ms
[2022-04-11 12:40:02	                main:574]	:	INFO	:	Epoch 1661 | loss: 0.0311306 | val_loss: 0.0311439 | Time: 3369.06 ms
[2022-04-11 12:40:06	                main:574]	:	INFO	:	Epoch 1662 | loss: 0.0311296 | val_loss: 0.0311463 | Time: 3373.85 ms
[2022-04-11 12:40:09	                main:574]	:	INFO	:	Epoch 1663 | loss: 0.0311288 | val_loss: 0.0311487 | Time: 3385.97 ms
[2022-04-11 12:40:13	                main:574]	:	INFO	:	Epoch 1664 | loss: 0.0311305 | val_loss: 0.0311512 | Time: 3377.23 ms
[2022-04-11 12:40:16	                main:574]	:	INFO	:	Epoch 1665 | loss: 0.0311312 | val_loss: 0.0311504 | Time: 3370.19 ms
[2022-04-11 12:40:19	                main:574]	:	INFO	:	Epoch 1666 | loss: 0.03113 | val_loss: 0.0311551 | Time: 3369.95 ms
[2022-04-11 12:40:23	                main:574]	:	INFO	:	Epoch 1667 | loss: 0.0311365 | val_loss: 0.0311507 | Time: 3367.92 ms
[2022-04-11 12:40:26	                main:574]	:	INFO	:	Epoch 1668 | loss: 0.0311317 | val_loss: 0.0311523 | Time: 3368.8 ms
[2022-04-11 12:40:29	                main:574]	:	INFO	:	Epoch 1669 | loss: 0.0311315 | val_loss: 0.0311591 | Time: 3365.94 ms
[2022-04-11 12:40:33	                main:574]	:	INFO	:	Epoch 1670 | loss: 0.0311369 | val_loss: 0.031156 | Time: 3373.31 ms
[2022-04-11 12:40:36	                main:574]	:	INFO	:	Epoch 1671 | loss: 0.0311328 | val_loss: 0.0311615 | Time: 3364.41 ms
[2022-04-11 12:40:40	                main:574]	:	INFO	:	Epoch 1672 | loss: 0.0311326 | val_loss: 0.0311532 | Time: 3370.12 ms
[2022-04-11 12:40:43	                main:574]	:	INFO	:	Epoch 1673 | loss: 0.0311306 | val_loss: 0.0311565 | Time: 3373.18 ms
[2022-04-11 12:40:46	                main:574]	:	INFO	:	Epoch 1674 | loss: 0.0311301 | val_loss: 0.0311542 | Time: 3372.6 ms
[2022-04-11 12:40:50	                main:574]	:	INFO	:	Epoch 1675 | loss: 0.0311319 | val_loss: 0.0311525 | Time: 3382.76 ms
[2022-04-11 12:40:53	                main:574]	:	INFO	:	Epoch 1676 | loss: 0.0311295 | val_loss: 0.0311499 | Time: 3364.95 ms
[2022-04-11 12:40:56	                main:574]	:	INFO	:	Epoch 1677 | loss: 0.0311301 | val_loss: 0.0311543 | Time: 3369.88 ms
[2022-04-11 12:41:00	                main:574]	:	INFO	:	Epoch 1678 | loss: 0.0311287 | val_loss: 0.0311537 | Time: 3373.16 ms
[2022-04-11 12:41:03	                main:574]	:	INFO	:	Epoch 1679 | loss: 0.03113 | val_loss: 0.0311515 | Time: 3375.79 ms
[2022-04-11 12:41:07	                main:574]	:	INFO	:	Epoch 1680 | loss: 0.0311291 | val_loss: 0.0311496 | Time: 3371.49 ms
[2022-04-11 12:41:10	                main:574]	:	INFO	:	Epoch 1681 | loss: 0.0311273 | val_loss: 0.0311494 | Time: 3367.08 ms
[2022-04-11 12:41:13	                main:574]	:	INFO	:	Epoch 1682 | loss: 0.0311238 | val_loss: 0.0311469 | Time: 3368.22 ms
[2022-04-11 12:41:17	                main:574]	:	INFO	:	Epoch 1683 | loss: 0.0311259 | val_loss: 0.0311485 | Time: 3375.26 ms
[2022-04-11 12:41:20	                main:574]	:	INFO	:	Epoch 1684 | loss: 0.031124 | val_loss: 0.0311475 | Time: 3364.56 ms
[2022-04-11 12:41:23	                main:574]	:	INFO	:	Epoch 1685 | loss: 0.0311262 | val_loss: 0.0311483 | Time: 3365.5 ms
[2022-04-11 12:41:27	                main:574]	:	INFO	:	Epoch 1686 | loss: 0.0311378 | val_loss: 0.0311542 | Time: 3374.91 ms
[2022-04-11 12:41:30	                main:574]	:	INFO	:	Epoch 1687 | loss: 0.0311405 | val_loss: 0.0311508 | Time: 3373.33 ms
[2022-04-11 12:41:34	                main:574]	:	INFO	:	Epoch 1688 | loss: 0.0311336 | val_loss: 0.0311497 | Time: 3362.97 ms
[2022-04-11 12:41:37	                main:574]	:	INFO	:	Epoch 1689 | loss: 0.0311319 | val_loss: 0.0311461 | Time: 3364.75 ms
[2022-04-11 12:41:40	                main:574]	:	INFO	:	Epoch 1690 | loss: 0.0311307 | val_loss: 0.0311481 | Time: 3375 ms
[2022-04-11 12:41:44	                main:574]	:	INFO	:	Epoch 1691 | loss: 0.0311301 | val_loss: 0.0311455 | Time: 3370.77 ms
[2022-04-11 12:41:47	                main:574]	:	INFO	:	Epoch 1692 | loss: 0.0311301 | val_loss: 0.0311471 | Time: 3366.75 ms
[2022-04-11 12:41:50	                main:574]	:	INFO	:	Epoch 1693 | loss: 0.0311324 | val_loss: 0.0311547 | Time: 3372.97 ms
[2022-04-11 12:41:54	                main:574]	:	INFO	:	Epoch 1694 | loss: 0.0311299 | val_loss: 0.0311491 | Time: 3371.2 ms
[2022-04-11 12:41:57	                main:574]	:	INFO	:	Epoch 1695 | loss: 0.0311264 | val_loss: 0.0311443 | Time: 3369.05 ms
[2022-04-11 12:42:01	                main:574]	:	INFO	:	Epoch 1696 | loss: 0.0311292 | val_loss: 0.0311483 | Time: 3365.5 ms
[2022-04-11 12:42:04	                main:574]	:	INFO	:	Epoch 1697 | loss: 0.0311301 | val_loss: 0.0311515 | Time: 3369 ms
[2022-04-11 12:42:07	                main:574]	:	INFO	:	Epoch 1698 | loss: 0.0311298 | val_loss: 0.0311501 | Time: 3374.75 ms
[2022-04-11 12:42:11	                main:574]	:	INFO	:	Epoch 1699 | loss: 0.0311302 | val_loss: 0.0311516 | Time: 3367.19 ms
[2022-04-11 12:42:14	                main:574]	:	INFO	:	Epoch 1700 | loss: 0.0311299 | val_loss: 0.0311458 | Time: 3370.42 ms
[2022-04-11 12:42:17	                main:574]	:	INFO	:	Epoch 1701 | loss: 0.0311272 | val_loss: 0.0311466 | Time: 3373.71 ms
[2022-04-11 12:42:21	                main:574]	:	INFO	:	Epoch 1702 | loss: 0.0311277 | val_loss: 0.0311467 | Time: 3365.02 ms
[2022-04-11 12:42:24	                main:574]	:	INFO	:	Epoch 1703 | loss: 0.0311259 | val_loss: 0.0311501 | Time: 3356.63 ms
[2022-04-11 12:42:28	                main:574]	:	INFO	:	Epoch 1704 | loss: 0.0311266 | val_loss: 0.0311533 | Time: 3371.15 ms
[2022-04-11 12:42:31	                main:574]	:	INFO	:	Epoch 1705 | loss: 0.0311271 | val_loss: 0.0311472 | Time: 3370.3 ms
[2022-04-11 12:42:34	                main:574]	:	INFO	:	Epoch 1706 | loss: 0.031128 | val_loss: 0.0311505 | Time: 3382.74 ms
[2022-04-11 12:42:38	                main:574]	:	INFO	:	Epoch 1707 | loss: 0.0311285 | val_loss: 0.0311542 | Time: 3387.19 ms
[2022-04-11 12:42:41	                main:574]	:	INFO	:	Epoch 1708 | loss: 0.0311273 | val_loss: 0.0311509 | Time: 3366.27 ms
[2022-04-11 12:42:44	                main:574]	:	INFO	:	Epoch 1709 | loss: 0.0311272 | val_loss: 0.0311496 | Time: 3363.94 ms
[2022-04-11 12:42:48	                main:574]	:	INFO	:	Epoch 1710 | loss: 0.0311305 | val_loss: 0.0311468 | Time: 3369.37 ms
[2022-04-11 12:42:51	                main:574]	:	INFO	:	Epoch 1711 | loss: 0.0311273 | val_loss: 0.0311484 | Time: 3369.2 ms
[2022-04-11 12:42:55	                main:574]	:	INFO	:	Epoch 1712 | loss: 0.031128 | val_loss: 0.0311513 | Time: 3367.64 ms
[2022-04-11 12:42:58	                main:574]	:	INFO	:	Epoch 1713 | loss: 0.0311267 | val_loss: 0.031148 | Time: 3367.74 ms
[2022-04-11 12:43:01	                main:574]	:	INFO	:	Epoch 1714 | loss: 0.0311281 | val_loss: 0.0311524 | Time: 3378.84 ms
[2022-04-11 12:43:05	                main:574]	:	INFO	:	Epoch 1715 | loss: 0.0311342 | val_loss: 0.0311512 | Time: 3369.56 ms
[2022-04-11 12:43:08	                main:574]	:	INFO	:	Epoch 1716 | loss: 0.0311355 | val_loss: 0.0311526 | Time: 3368.45 ms
[2022-04-11 12:43:11	                main:574]	:	INFO	:	Epoch 1717 | loss: 0.0311344 | val_loss: 0.0311527 | Time: 3392.87 ms
[2022-04-11 12:43:15	                main:574]	:	INFO	:	Epoch 1718 | loss: 0.0311341 | val_loss: 0.031149 | Time: 3385.2 ms
[2022-04-11 12:43:18	                main:574]	:	INFO	:	Epoch 1719 | loss: 0.0311331 | val_loss: 0.0311513 | Time: 3371.37 ms
[2022-04-11 12:43:22	                main:574]	:	INFO	:	Epoch 1720 | loss: 0.0311306 | val_loss: 0.0311492 | Time: 3369.72 ms
[2022-04-11 12:43:25	                main:574]	:	INFO	:	Epoch 1721 | loss: 0.0311313 | val_loss: 0.0311528 | Time: 3371.95 ms
[2022-04-11 12:43:28	                main:574]	:	INFO	:	Epoch 1722 | loss: 0.031129 | val_loss: 0.031151 | Time: 3365.15 ms
[2022-04-11 12:43:32	                main:574]	:	INFO	:	Epoch 1723 | loss: 0.0311286 | val_loss: 0.0311519 | Time: 3373.45 ms
[2022-04-11 12:43:35	                main:574]	:	INFO	:	Epoch 1724 | loss: 0.0311291 | val_loss: 0.0311497 | Time: 3364.82 ms
[2022-04-11 12:43:38	                main:574]	:	INFO	:	Epoch 1725 | loss: 0.0311301 | val_loss: 0.0311523 | Time: 3370.77 ms
[2022-04-11 12:43:42	                main:574]	:	INFO	:	Epoch 1726 | loss: 0.0311286 | val_loss: 0.0311497 | Time: 3365.16 ms
[2022-04-11 12:43:45	                main:574]	:	INFO	:	Epoch 1727 | loss: 0.0311286 | val_loss: 0.0311497 | Time: 3370.37 ms
[2022-04-11 12:43:49	                main:574]	:	INFO	:	Epoch 1728 | loss: 0.0311294 | val_loss: 0.0311465 | Time: 3368.61 ms
[2022-04-11 12:43:52	                main:574]	:	INFO	:	Epoch 1729 | loss: 0.0311302 | val_loss: 0.0311476 | Time: 3374.42 ms
[2022-04-11 12:43:55	                main:574]	:	INFO	:	Epoch 1730 | loss: 0.0311285 | val_loss: 0.0311515 | Time: 3369.86 ms
[2022-04-11 12:43:59	                main:574]	:	INFO	:	Epoch 1731 | loss: 0.0311288 | val_loss: 0.0311561 | Time: 3366.54 ms
[2022-04-11 12:44:02	                main:574]	:	INFO	:	Epoch 1732 | loss: 0.0311318 | val_loss: 0.0311544 | Time: 3364.96 ms
[2022-04-11 12:44:05	                main:574]	:	INFO	:	Epoch 1733 | loss: 0.0311305 | val_loss: 0.0311519 | Time: 3375.38 ms
[2022-04-11 12:44:09	                main:574]	:	INFO	:	Epoch 1734 | loss: 0.0311293 | val_loss: 0.0311485 | Time: 3366.8 ms
[2022-04-11 12:44:12	                main:574]	:	INFO	:	Epoch 1735 | loss: 0.031129 | val_loss: 0.0311508 | Time: 3364.32 ms
[2022-04-11 12:44:16	                main:574]	:	INFO	:	Epoch 1736 | loss: 0.0311287 | val_loss: 0.0311516 | Time: 3371.01 ms
[2022-04-11 12:44:19	                main:574]	:	INFO	:	Epoch 1737 | loss: 0.0311282 | val_loss: 0.0311499 | Time: 3368.03 ms
[2022-04-11 12:44:22	                main:574]	:	INFO	:	Epoch 1738 | loss: 0.0311284 | val_loss: 0.0311484 | Time: 3359.61 ms
[2022-04-11 12:44:26	                main:574]	:	INFO	:	Epoch 1739 | loss: 0.0311283 | val_loss: 0.0311491 | Time: 3342.82 ms
[2022-04-11 12:44:29	                main:574]	:	INFO	:	Epoch 1740 | loss: 0.031125 | val_loss: 0.0311503 | Time: 3334.56 ms
[2022-04-11 12:44:32	                main:574]	:	INFO	:	Epoch 1741 | loss: 0.0311267 | val_loss: 0.0311484 | Time: 3338.58 ms
[2022-04-11 12:44:36	                main:574]	:	INFO	:	Epoch 1742 | loss: 0.0311326 | val_loss: 0.031153 | Time: 3334.16 ms
[2022-04-11 12:44:39	                main:574]	:	INFO	:	Epoch 1743 | loss: 0.0311319 | val_loss: 0.0311528 | Time: 3339.65 ms
[2022-04-11 12:44:42	                main:574]	:	INFO	:	Epoch 1744 | loss: 0.0311315 | val_loss: 0.0311529 | Time: 3340.15 ms
[2022-04-11 12:44:46	                main:574]	:	INFO	:	Epoch 1745 | loss: 0.0311358 | val_loss: 0.0311492 | Time: 3334.99 ms
[2022-04-11 12:44:49	                main:574]	:	INFO	:	Epoch 1746 | loss: 0.0311427 | val_loss: 0.0311555 | Time: 3338.31 ms
[2022-04-11 12:44:52	                main:574]	:	INFO	:	Epoch 1747 | loss: 0.0311387 | val_loss: 0.0311571 | Time: 3329.48 ms
[2022-04-11 12:44:56	                main:574]	:	INFO	:	Epoch 1748 | loss: 0.0311376 | val_loss: 0.0311564 | Time: 3341.24 ms
[2022-04-11 12:44:59	                main:574]	:	INFO	:	Epoch 1749 | loss: 0.0311364 | val_loss: 0.031153 | Time: 3378.01 ms
[2022-04-11 12:45:02	                main:574]	:	INFO	:	Epoch 1750 | loss: 0.0311352 | val_loss: 0.0311496 | Time: 3339.5 ms
[2022-04-11 12:45:06	                main:574]	:	INFO	:	Epoch 1751 | loss: 0.0311335 | val_loss: 0.0311504 | Time: 3337.27 ms
[2022-04-11 12:45:09	                main:574]	:	INFO	:	Epoch 1752 | loss: 0.0311336 | val_loss: 0.0311479 | Time: 3337.66 ms
[2022-04-11 12:45:12	                main:574]	:	INFO	:	Epoch 1753 | loss: 0.0311346 | val_loss: 0.0311465 | Time: 3342.63 ms
[2022-04-11 12:45:16	                main:574]	:	INFO	:	Epoch 1754 | loss: 0.0311326 | val_loss: 0.0311524 | Time: 3374.84 ms
[2022-04-11 12:45:19	                main:574]	:	INFO	:	Epoch 1755 | loss: 0.0311347 | val_loss: 0.031151 | Time: 3331.03 ms
[2022-04-11 12:45:23	                main:574]	:	INFO	:	Epoch 1756 | loss: 0.0311348 | val_loss: 0.0311515 | Time: 3344.5 ms
[2022-04-11 12:45:26	                main:574]	:	INFO	:	Epoch 1757 | loss: 0.0311351 | val_loss: 0.0311515 | Time: 3334.71 ms
[2022-04-11 12:45:29	                main:574]	:	INFO	:	Epoch 1758 | loss: 0.0311337 | val_loss: 0.0311512 | Time: 3344.25 ms
[2022-04-11 12:45:33	                main:574]	:	INFO	:	Epoch 1759 | loss: 0.0311333 | val_loss: 0.0311558 | Time: 3338.46 ms
[2022-04-11 12:45:36	                main:574]	:	INFO	:	Epoch 1760 | loss: 0.0311346 | val_loss: 0.0311516 | Time: 3343.37 ms
[2022-04-11 12:45:39	                main:574]	:	INFO	:	Epoch 1761 | loss: 0.0311336 | val_loss: 0.0311509 | Time: 3341.95 ms
[2022-04-11 12:45:43	                main:574]	:	INFO	:	Epoch 1762 | loss: 0.0311324 | val_loss: 0.031153 | Time: 3333.7 ms
[2022-04-11 12:45:46	                main:574]	:	INFO	:	Epoch 1763 | loss: 0.0311307 | val_loss: 0.0311504 | Time: 3349.51 ms
[2022-04-11 12:45:49	                main:574]	:	INFO	:	Epoch 1764 | loss: 0.03113 | val_loss: 0.0311512 | Time: 3342.15 ms
[2022-04-11 12:45:53	                main:574]	:	INFO	:	Epoch 1765 | loss: 0.0311298 | val_loss: 0.0311521 | Time: 3343.37 ms
[2022-04-11 12:45:56	                main:574]	:	INFO	:	Epoch 1766 | loss: 0.0311298 | val_loss: 0.0311521 | Time: 3345.25 ms
[2022-04-11 12:45:59	                main:574]	:	INFO	:	Epoch 1767 | loss: 0.031139 | val_loss: 0.0311547 | Time: 3336.87 ms
[2022-04-11 12:46:03	                main:574]	:	INFO	:	Epoch 1768 | loss: 0.0311356 | val_loss: 0.0311544 | Time: 3340.36 ms
[2022-04-11 12:46:06	                main:574]	:	INFO	:	Epoch 1769 | loss: 0.0311336 | val_loss: 0.0311564 | Time: 3340.53 ms
[2022-04-11 12:46:09	                main:574]	:	INFO	:	Epoch 1770 | loss: 0.0311317 | val_loss: 0.0311529 | Time: 3339.01 ms
[2022-04-11 12:46:13	                main:574]	:	INFO	:	Epoch 1771 | loss: 0.0311306 | val_loss: 0.031152 | Time: 3342.74 ms
[2022-04-11 12:46:16	                main:574]	:	INFO	:	Epoch 1772 | loss: 0.0311323 | val_loss: 0.0311542 | Time: 3336.47 ms
[2022-04-11 12:46:19	                main:574]	:	INFO	:	Epoch 1773 | loss: 0.0311303 | val_loss: 0.0311545 | Time: 3327.44 ms
[2022-04-11 12:46:23	                main:574]	:	INFO	:	Epoch 1774 | loss: 0.0311318 | val_loss: 0.0311546 | Time: 3331.41 ms
[2022-04-11 12:46:26	                main:574]	:	INFO	:	Epoch 1775 | loss: 0.0311319 | val_loss: 0.0311544 | Time: 3336.39 ms
[2022-04-11 12:46:29	                main:574]	:	INFO	:	Epoch 1776 | loss: 0.0311328 | val_loss: 0.0311568 | Time: 3338.81 ms
[2022-04-11 12:46:33	                main:574]	:	INFO	:	Epoch 1777 | loss: 0.0311306 | val_loss: 0.031152 | Time: 3337.22 ms
[2022-04-11 12:46:36	                main:574]	:	INFO	:	Epoch 1778 | loss: 0.0311313 | val_loss: 0.0311532 | Time: 3337.35 ms
[2022-04-11 12:46:39	                main:574]	:	INFO	:	Epoch 1779 | loss: 0.0311304 | val_loss: 0.031154 | Time: 3341.91 ms
[2022-04-11 12:46:43	                main:574]	:	INFO	:	Epoch 1780 | loss: 0.0311307 | val_loss: 0.0311554 | Time: 3338.3 ms
[2022-04-11 12:46:46	                main:574]	:	INFO	:	Epoch 1781 | loss: 0.0311285 | val_loss: 0.0311512 | Time: 3338.45 ms
[2022-04-11 12:46:49	                main:574]	:	INFO	:	Epoch 1782 | loss: 0.0311296 | val_loss: 0.0311504 | Time: 3346.38 ms
[2022-04-11 12:46:53	                main:574]	:	INFO	:	Epoch 1783 | loss: 0.0311285 | val_loss: 0.0311504 | Time: 3338.19 ms
[2022-04-11 12:46:56	                main:574]	:	INFO	:	Epoch 1784 | loss: 0.0311276 | val_loss: 0.0311523 | Time: 3338 ms
[2022-04-11 12:47:00	                main:574]	:	INFO	:	Epoch 1785 | loss: 0.0311279 | val_loss: 0.0311499 | Time: 3340.68 ms
[2022-04-11 12:47:03	                main:574]	:	INFO	:	Epoch 1786 | loss: 0.0311342 | val_loss: 0.0311481 | Time: 3337.08 ms
[2022-04-11 12:47:06	                main:574]	:	INFO	:	Epoch 1787 | loss: 0.0311375 | val_loss: 0.031152 | Time: 3339.44 ms
[2022-04-11 12:47:10	                main:574]	:	INFO	:	Epoch 1788 | loss: 0.0311356 | val_loss: 0.0311532 | Time: 3339.88 ms
[2022-04-11 12:47:13	                main:574]	:	INFO	:	Epoch 1789 | loss: 0.0311364 | val_loss: 0.0311496 | Time: 3332.87 ms
[2022-04-11 12:47:16	                main:574]	:	INFO	:	Epoch 1790 | loss: 0.0311324 | val_loss: 0.0311488 | Time: 3343.41 ms
[2022-04-11 12:47:20	                main:574]	:	INFO	:	Epoch 1791 | loss: 0.031133 | val_loss: 0.0311449 | Time: 3343.45 ms
[2022-04-11 12:47:23	                main:574]	:	INFO	:	Epoch 1792 | loss: 0.0311314 | val_loss: 0.0311461 | Time: 3344.56 ms
[2022-04-11 12:47:26	                main:574]	:	INFO	:	Epoch 1793 | loss: 0.031135 | val_loss: 0.0311501 | Time: 3337.83 ms
[2022-04-11 12:47:30	                main:574]	:	INFO	:	Epoch 1794 | loss: 0.0311357 | val_loss: 0.0311518 | Time: 3340.06 ms
[2022-04-11 12:47:33	                main:574]	:	INFO	:	Epoch 1795 | loss: 0.0311339 | val_loss: 0.0311507 | Time: 3339.73 ms
[2022-04-11 12:47:36	                main:574]	:	INFO	:	Epoch 1796 | loss: 0.031134 | val_loss: 0.0311578 | Time: 3337.6 ms
[2022-04-11 12:47:40	                main:574]	:	INFO	:	Epoch 1797 | loss: 0.031136 | val_loss: 0.0311546 | Time: 3344.08 ms
[2022-04-11 12:47:43	                main:574]	:	INFO	:	Epoch 1798 | loss: 0.031135 | val_loss: 0.031152 | Time: 3337.4 ms
[2022-04-11 12:47:46	                main:574]	:	INFO	:	Epoch 1799 | loss: 0.0311353 | val_loss: 0.0311542 | Time: 3336.53 ms
[2022-04-11 12:48:06	                main:574]	:	INFO	:	Epoch 1800 | loss: 0.031133 | val_loss: 0.0311546 | Time: 19341.5 ms
[2022-04-11 12:48:09	                main:574]	:	INFO	:	Epoch 1801 | loss: 0.031134 | val_loss: 0.0311536 | Time: 3345.39 ms
[2022-04-11 12:48:12	                main:574]	:	INFO	:	Epoch 1802 | loss: 0.0311358 | val_loss: 0.0311565 | Time: 3339.36 ms
[2022-04-11 12:48:16	                main:574]	:	INFO	:	Epoch 1803 | loss: 0.0311344 | val_loss: 0.0311505 | Time: 3344.9 ms
[2022-04-11 12:48:19	                main:574]	:	INFO	:	Epoch 1804 | loss: 0.0311312 | val_loss: 0.0311527 | Time: 3339.91 ms
[2022-04-11 12:48:23	                main:574]	:	INFO	:	Epoch 1805 | loss: 0.0311359 | val_loss: 0.0311517 | Time: 3339.79 ms
[2022-04-11 12:48:26	                main:574]	:	INFO	:	Epoch 1806 | loss: 0.0311379 | val_loss: 0.0311511 | Time: 3341.71 ms
[2022-04-11 12:48:29	                main:574]	:	INFO	:	Epoch 1807 | loss: 0.0311377 | val_loss: 0.0311585 | Time: 3343.6 ms
[2022-04-11 12:48:33	                main:574]	:	INFO	:	Epoch 1808 | loss: 0.0311348 | val_loss: 0.0311505 | Time: 3338.69 ms
[2022-04-11 12:48:36	                main:574]	:	INFO	:	Epoch 1809 | loss: 0.0311327 | val_loss: 0.0311493 | Time: 3342.29 ms
[2022-04-11 12:48:39	                main:574]	:	INFO	:	Epoch 1810 | loss: 0.0311299 | val_loss: 0.0311498 | Time: 3333.97 ms
[2022-04-11 12:48:43	                main:574]	:	INFO	:	Epoch 1811 | loss: 0.0311329 | val_loss: 0.0311486 | Time: 3340.22 ms
[2022-04-11 12:48:46	                main:574]	:	INFO	:	Epoch 1812 | loss: 0.0311324 | val_loss: 0.0311484 | Time: 3339.34 ms
[2022-04-11 12:48:49	                main:574]	:	INFO	:	Epoch 1813 | loss: 0.0311303 | val_loss: 0.0311515 | Time: 3333.98 ms
[2022-04-11 12:48:53	                main:574]	:	INFO	:	Epoch 1814 | loss: 0.0311289 | val_loss: 0.0311503 | Time: 3339.35 ms
[2022-04-11 12:48:56	                main:574]	:	INFO	:	Epoch 1815 | loss: 0.0311293 | val_loss: 0.0311496 | Time: 3339.08 ms
[2022-04-11 12:48:59	                main:574]	:	INFO	:	Epoch 1816 | loss: 0.0311292 | val_loss: 0.03115 | Time: 3337.71 ms
[2022-04-11 12:49:03	                main:574]	:	INFO	:	Epoch 1817 | loss: 0.0311287 | val_loss: 0.0311506 | Time: 3343.61 ms
[2022-04-11 12:49:06	                main:574]	:	INFO	:	Epoch 1818 | loss: 0.0311285 | val_loss: 0.0311482 | Time: 3340.39 ms
[2022-04-11 12:49:10	                main:574]	:	INFO	:	Epoch 1819 | loss: 0.031132 | val_loss: 0.0311503 | Time: 3351.37 ms
[2022-04-11 12:49:13	                main:574]	:	INFO	:	Epoch 1820 | loss: 0.0311322 | val_loss: 0.0311458 | Time: 3366.82 ms
[2022-04-11 12:49:16	                main:574]	:	INFO	:	Epoch 1821 | loss: 0.0311334 | val_loss: 0.0311472 | Time: 3361.67 ms
[2022-04-11 12:49:20	                main:574]	:	INFO	:	Epoch 1822 | loss: 0.0311309 | val_loss: 0.031151 | Time: 3356.33 ms
[2022-04-11 12:49:23	                main:574]	:	INFO	:	Epoch 1823 | loss: 0.0311324 | val_loss: 0.0311511 | Time: 3358.37 ms
[2022-04-11 12:49:26	                main:574]	:	INFO	:	Epoch 1824 | loss: 0.0311304 | val_loss: 0.0311495 | Time: 3362.61 ms
[2022-04-11 12:49:30	                main:574]	:	INFO	:	Epoch 1825 | loss: 0.0311285 | val_loss: 0.0311465 | Time: 3348.92 ms
[2022-04-11 12:49:33	                main:574]	:	INFO	:	Epoch 1826 | loss: 0.0311307 | val_loss: 0.0311481 | Time: 3362.87 ms
[2022-04-11 12:49:36	                main:574]	:	INFO	:	Epoch 1827 | loss: 0.0311307 | val_loss: 0.0311502 | Time: 3361.13 ms
[2022-04-11 12:49:40	                main:574]	:	INFO	:	Epoch 1828 | loss: 0.0311311 | val_loss: 0.0311511 | Time: 3354.45 ms
[2022-04-11 12:49:43	                main:574]	:	INFO	:	Epoch 1829 | loss: 0.0311331 | val_loss: 0.0311504 | Time: 3343.26 ms
[2022-04-11 12:49:46	                main:574]	:	INFO	:	Epoch 1830 | loss: 0.0311421 | val_loss: 0.0311625 | Time: 3340.03 ms
[2022-04-11 12:49:50	                main:574]	:	INFO	:	Epoch 1831 | loss: 0.0311415 | val_loss: 0.0311544 | Time: 3338.46 ms
[2022-04-11 12:49:53	                main:574]	:	INFO	:	Epoch 1832 | loss: 0.0311382 | val_loss: 0.0311534 | Time: 3329.26 ms
[2022-04-11 12:49:57	                main:574]	:	INFO	:	Epoch 1833 | loss: 0.0311359 | val_loss: 0.0311505 | Time: 3340.88 ms
[2022-04-11 12:50:00	                main:574]	:	INFO	:	Epoch 1834 | loss: 0.031135 | val_loss: 0.0311495 | Time: 3340.04 ms
[2022-04-11 12:50:03	                main:574]	:	INFO	:	Epoch 1835 | loss: 0.0311368 | val_loss: 0.0311516 | Time: 3345.97 ms
[2022-04-11 12:50:07	                main:574]	:	INFO	:	Epoch 1836 | loss: 0.0311354 | val_loss: 0.0311524 | Time: 3337 ms
[2022-04-11 12:50:10	                main:574]	:	INFO	:	Epoch 1837 | loss: 0.0311325 | val_loss: 0.031153 | Time: 3339.19 ms
[2022-04-11 12:50:13	                main:574]	:	INFO	:	Epoch 1838 | loss: 0.0311376 | val_loss: 0.0311575 | Time: 3337.41 ms
[2022-04-11 12:50:17	                main:574]	:	INFO	:	Epoch 1839 | loss: 0.0311333 | val_loss: 0.0311524 | Time: 3342.42 ms
[2022-04-11 12:50:20	                main:574]	:	INFO	:	Epoch 1840 | loss: 0.031131 | val_loss: 0.0311521 | Time: 3351.13 ms
[2022-04-11 12:50:23	                main:574]	:	INFO	:	Epoch 1841 | loss: 0.03113 | val_loss: 0.0311523 | Time: 3342.34 ms
[2022-04-11 12:50:27	                main:574]	:	INFO	:	Epoch 1842 | loss: 0.0311297 | val_loss: 0.0311515 | Time: 3334.09 ms
[2022-04-11 12:50:30	                main:574]	:	INFO	:	Epoch 1843 | loss: 0.0311321 | val_loss: 0.0311528 | Time: 3339.47 ms
[2022-04-11 12:50:33	                main:574]	:	INFO	:	Epoch 1844 | loss: 0.0311317 | val_loss: 0.0311538 | Time: 3335.34 ms
[2022-04-11 12:50:37	                main:574]	:	INFO	:	Epoch 1845 | loss: 0.0311324 | val_loss: 0.031156 | Time: 3338.61 ms
[2022-04-11 12:50:40	                main:574]	:	INFO	:	Epoch 1846 | loss: 0.0311332 | val_loss: 0.0311542 | Time: 3333.7 ms
[2022-04-11 12:50:43	                main:574]	:	INFO	:	Epoch 1847 | loss: 0.0311348 | val_loss: 0.0311527 | Time: 3335 ms
[2022-04-11 12:50:47	                main:574]	:	INFO	:	Epoch 1848 | loss: 0.0311313 | val_loss: 0.0311487 | Time: 3337.6 ms
[2022-04-11 12:50:50	                main:574]	:	INFO	:	Epoch 1849 | loss: 0.0311408 | val_loss: 0.0311551 | Time: 3368.72 ms
[2022-04-11 12:50:54	                main:574]	:	INFO	:	Epoch 1850 | loss: 0.0311412 | val_loss: 0.0311703 | Time: 3545.42 ms
[2022-04-11 12:50:57	                main:574]	:	INFO	:	Epoch 1851 | loss: 0.031145 | val_loss: 0.0311644 | Time: 3342.3 ms
[2022-04-11 12:51:00	                main:574]	:	INFO	:	Epoch 1852 | loss: 0.0311397 | val_loss: 0.0311565 | Time: 3331.38 ms
[2022-04-11 12:51:04	                main:574]	:	INFO	:	Epoch 1853 | loss: 0.0311385 | val_loss: 0.0311528 | Time: 3340.11 ms
[2022-04-11 12:51:07	                main:574]	:	INFO	:	Epoch 1854 | loss: 0.0311385 | val_loss: 0.0311535 | Time: 3345.28 ms
[2022-04-11 12:51:10	                main:574]	:	INFO	:	Epoch 1855 | loss: 0.0311387 | val_loss: 0.0311563 | Time: 3341.27 ms
[2022-04-11 12:51:14	                main:574]	:	INFO	:	Epoch 1856 | loss: 0.0311369 | val_loss: 0.0311559 | Time: 3340.74 ms
[2022-04-11 12:51:17	                main:574]	:	INFO	:	Epoch 1857 | loss: 0.0311359 | val_loss: 0.0311572 | Time: 3334.93 ms
[2022-04-11 12:51:20	                main:574]	:	INFO	:	Epoch 1858 | loss: 0.0311353 | val_loss: 0.0311555 | Time: 3342.08 ms
[2022-04-11 12:51:24	                main:574]	:	INFO	:	Epoch 1859 | loss: 0.0311321 | val_loss: 0.0311556 | Time: 3339.64 ms
[2022-04-11 12:51:27	                main:574]	:	INFO	:	Epoch 1860 | loss: 0.0311335 | val_loss: 0.031158 | Time: 3338.99 ms
[2022-04-11 12:51:30	                main:574]	:	INFO	:	Epoch 1861 | loss: 0.0311321 | val_loss: 0.0311533 | Time: 3340.48 ms
[2022-04-11 12:51:34	                main:574]	:	INFO	:	Epoch 1862 | loss: 0.0311307 | val_loss: 0.0311554 | Time: 3342.08 ms
[2022-04-11 12:51:37	                main:574]	:	INFO	:	Epoch 1863 | loss: 0.0311324 | val_loss: 0.031155 | Time: 3336.6 ms
[2022-04-11 12:51:40	                main:574]	:	INFO	:	Epoch 1864 | loss: 0.0311328 | val_loss: 0.0311536 | Time: 3338.09 ms
[2022-04-11 12:51:44	                main:574]	:	INFO	:	Epoch 1865 | loss: 0.0311334 | val_loss: 0.0311636 | Time: 3348.07 ms
[2022-04-11 12:51:47	                main:574]	:	INFO	:	Epoch 1866 | loss: 0.0311342 | val_loss: 0.0311543 | Time: 3337.36 ms
[2022-04-11 12:51:50	                main:574]	:	INFO	:	Epoch 1867 | loss: 0.0311349 | val_loss: 0.0311531 | Time: 3334.13 ms
[2022-04-11 12:51:54	                main:574]	:	INFO	:	Epoch 1868 | loss: 0.0311393 | val_loss: 0.031163 | Time: 3341.31 ms
[2022-04-11 12:51:57	                main:574]	:	INFO	:	Epoch 1869 | loss: 0.0311384 | val_loss: 0.0311503 | Time: 3338.06 ms
[2022-04-11 12:52:00	                main:574]	:	INFO	:	Epoch 1870 | loss: 0.0311336 | val_loss: 0.0311512 | Time: 3338.85 ms
[2022-04-11 12:52:04	                main:574]	:	INFO	:	Epoch 1871 | loss: 0.0311365 | val_loss: 0.0311528 | Time: 3329.7 ms
[2022-04-11 12:52:07	                main:574]	:	INFO	:	Epoch 1872 | loss: 0.0311373 | val_loss: 0.0311538 | Time: 3337.49 ms
[2022-04-11 12:52:10	                main:574]	:	INFO	:	Epoch 1873 | loss: 0.0311384 | val_loss: 0.0311498 | Time: 3350.55 ms
[2022-04-11 12:52:14	                main:574]	:	INFO	:	Epoch 1874 | loss: 0.0311342 | val_loss: 0.0311491 | Time: 3337.76 ms
[2022-04-11 12:52:17	                main:574]	:	INFO	:	Epoch 1875 | loss: 0.031134 | val_loss: 0.0311534 | Time: 3337.04 ms
[2022-04-11 12:52:21	                main:574]	:	INFO	:	Epoch 1876 | loss: 0.0311341 | val_loss: 0.0311543 | Time: 3339.03 ms
[2022-04-11 12:52:24	                main:574]	:	INFO	:	Epoch 1877 | loss: 0.0311338 | val_loss: 0.0311507 | Time: 3340.31 ms
[2022-04-11 12:52:27	                main:574]	:	INFO	:	Epoch 1878 | loss: 0.0311327 | val_loss: 0.0311534 | Time: 3340.16 ms
[2022-04-11 12:52:31	                main:574]	:	INFO	:	Epoch 1879 | loss: 0.0311308 | val_loss: 0.0311531 | Time: 3338.96 ms
[2022-04-11 12:52:34	                main:574]	:	INFO	:	Epoch 1880 | loss: 0.0311293 | val_loss: 0.0311554 | Time: 3345.63 ms
[2022-04-11 12:52:37	                main:574]	:	INFO	:	Epoch 1881 | loss: 0.0311293 | val_loss: 0.0311539 | Time: 3336.11 ms
[2022-04-11 12:52:41	                main:574]	:	INFO	:	Epoch 1882 | loss: 0.0311296 | val_loss: 0.0311535 | Time: 3345.16 ms
[2022-04-11 12:52:44	                main:574]	:	INFO	:	Epoch 1883 | loss: 0.031132 | val_loss: 0.0311513 | Time: 3332.89 ms
[2022-04-11 12:52:47	                main:574]	:	INFO	:	Epoch 1884 | loss: 0.0311319 | val_loss: 0.0311515 | Time: 3335.77 ms
[2022-04-11 12:52:51	                main:574]	:	INFO	:	Epoch 1885 | loss: 0.0311318 | val_loss: 0.0311503 | Time: 3328.51 ms
[2022-04-11 12:52:54	                main:574]	:	INFO	:	Epoch 1886 | loss: 0.0311307 | val_loss: 0.031153 | Time: 3346.65 ms
[2022-04-11 12:52:57	                main:574]	:	INFO	:	Epoch 1887 | loss: 0.0311312 | val_loss: 0.0311528 | Time: 3329.36 ms
[2022-04-11 12:53:01	                main:574]	:	INFO	:	Epoch 1888 | loss: 0.0311297 | val_loss: 0.0311559 | Time: 3341.43 ms
[2022-04-11 12:53:04	                main:574]	:	INFO	:	Epoch 1889 | loss: 0.031129 | val_loss: 0.031156 | Time: 3345.56 ms
[2022-04-11 12:53:07	                main:574]	:	INFO	:	Epoch 1890 | loss: 0.0311306 | val_loss: 0.0311555 | Time: 3330.04 ms
[2022-04-11 12:53:11	                main:574]	:	INFO	:	Epoch 1891 | loss: 0.0311294 | val_loss: 0.0311542 | Time: 3344.98 ms
[2022-04-11 12:53:14	                main:574]	:	INFO	:	Epoch 1892 | loss: 0.0311306 | val_loss: 0.0311526 | Time: 3339.76 ms
[2022-04-11 12:53:17	                main:574]	:	INFO	:	Epoch 1893 | loss: 0.0311301 | val_loss: 0.0311534 | Time: 3331.11 ms
[2022-04-11 12:53:21	                main:574]	:	INFO	:	Epoch 1894 | loss: 0.0311324 | val_loss: 0.0311549 | Time: 3342.5 ms
[2022-04-11 12:53:24	                main:574]	:	INFO	:	Epoch 1895 | loss: 0.0311329 | val_loss: 0.0311502 | Time: 3339.85 ms
[2022-04-11 12:53:27	                main:574]	:	INFO	:	Epoch 1896 | loss: 0.0311299 | val_loss: 0.031151 | Time: 3347.67 ms
[2022-04-11 12:53:31	                main:574]	:	INFO	:	Epoch 1897 | loss: 0.031129 | val_loss: 0.0311531 | Time: 3383.97 ms
[2022-04-11 12:53:34	                main:574]	:	INFO	:	Epoch 1898 | loss: 0.0311293 | val_loss: 0.0311561 | Time: 3337.62 ms
[2022-04-11 12:53:37	                main:574]	:	INFO	:	Epoch 1899 | loss: 0.0311317 | val_loss: 0.0311558 | Time: 3341.93 ms
[2022-04-11 12:53:41	                main:574]	:	INFO	:	Epoch 1900 | loss: 0.0311319 | val_loss: 0.0311509 | Time: 3338.7 ms
[2022-04-11 12:53:44	                main:574]	:	INFO	:	Epoch 1901 | loss: 0.0311304 | val_loss: 0.0311512 | Time: 3336.65 ms
[2022-04-11 12:53:47	                main:574]	:	INFO	:	Epoch 1902 | loss: 0.0311315 | val_loss: 0.0311506 | Time: 3337.34 ms
[2022-04-11 12:53:51	                main:574]	:	INFO	:	Epoch 1903 | loss: 0.031132 | val_loss: 0.0311575 | Time: 3340.09 ms
[2022-04-11 12:53:54	                main:574]	:	INFO	:	Epoch 1904 | loss: 0.0311338 | val_loss: 0.0311535 | Time: 3338.38 ms
[2022-04-11 12:53:57	                main:574]	:	INFO	:	Epoch 1905 | loss: 0.0311312 | val_loss: 0.0311525 | Time: 3342.44 ms
[2022-04-11 12:54:01	                main:574]	:	INFO	:	Epoch 1906 | loss: 0.0311303 | val_loss: 0.0311539 | Time: 3339.58 ms
[2022-04-11 12:54:04	                main:574]	:	INFO	:	Epoch 1907 | loss: 0.031131 | val_loss: 0.0311512 | Time: 3343.18 ms
[2022-04-11 12:54:08	                main:574]	:	INFO	:	Epoch 1908 | loss: 0.0311298 | val_loss: 0.0311528 | Time: 3350.42 ms
[2022-04-11 12:54:11	                main:574]	:	INFO	:	Epoch 1909 | loss: 0.031132 | val_loss: 0.0311534 | Time: 3367.98 ms
[2022-04-11 12:54:14	                main:574]	:	INFO	:	Epoch 1910 | loss: 0.0311291 | val_loss: 0.0311526 | Time: 3342.67 ms
[2022-04-11 12:54:18	                main:574]	:	INFO	:	Epoch 1911 | loss: 0.0311317 | val_loss: 0.031151 | Time: 3343.35 ms
[2022-04-11 12:54:21	                main:574]	:	INFO	:	Epoch 1912 | loss: 0.0311351 | val_loss: 0.0311541 | Time: 3346.25 ms
[2022-04-11 12:54:24	                main:574]	:	INFO	:	Epoch 1913 | loss: 0.031135 | val_loss: 0.0311506 | Time: 3339.4 ms
[2022-04-11 12:54:28	                main:574]	:	INFO	:	Epoch 1914 | loss: 0.0311364 | val_loss: 0.0311519 | Time: 3334.69 ms
[2022-04-11 12:54:31	                main:574]	:	INFO	:	Epoch 1915 | loss: 0.0311371 | val_loss: 0.0311554 | Time: 3339.27 ms
[2022-04-11 12:54:34	                main:574]	:	INFO	:	Epoch 1916 | loss: 0.031138 | val_loss: 0.031149 | Time: 3339.12 ms
[2022-04-11 12:54:38	                main:574]	:	INFO	:	Epoch 1917 | loss: 0.0311348 | val_loss: 0.0311558 | Time: 3339.39 ms
[2022-04-11 12:54:41	                main:574]	:	INFO	:	Epoch 1918 | loss: 0.0311362 | val_loss: 0.0311523 | Time: 3340.61 ms
[2022-04-11 12:54:44	                main:574]	:	INFO	:	Epoch 1919 | loss: 0.0311334 | val_loss: 0.0311452 | Time: 3337.38 ms
[2022-04-11 12:54:48	                main:574]	:	INFO	:	Epoch 1920 | loss: 0.0311341 | val_loss: 0.0311518 | Time: 3341.29 ms
[2022-04-11 12:54:51	                main:574]	:	INFO	:	Epoch 1921 | loss: 0.0311354 | val_loss: 0.0311513 | Time: 3335.81 ms
[2022-04-11 12:54:54	                main:574]	:	INFO	:	Epoch 1922 | loss: 0.031135 | val_loss: 0.0311457 | Time: 3345.09 ms
[2022-04-11 12:54:58	                main:574]	:	INFO	:	Epoch 1923 | loss: 0.0311337 | val_loss: 0.0311451 | Time: 3344.41 ms
[2022-04-11 12:55:01	                main:574]	:	INFO	:	Epoch 1924 | loss: 0.0311321 | val_loss: 0.0311445 | Time: 3342.42 ms
[2022-04-11 12:55:04	                main:574]	:	INFO	:	Epoch 1925 | loss: 0.0311325 | val_loss: 0.0311444 | Time: 3342.54 ms
[2022-04-11 12:55:08	                main:574]	:	INFO	:	Epoch 1926 | loss: 0.0311302 | val_loss: 0.0311438 | Time: 3335.1 ms
[2022-04-11 12:55:11	                main:574]	:	INFO	:	Epoch 1927 | loss: 0.0311308 | val_loss: 0.031146 | Time: 3344.6 ms
[2022-04-11 12:55:14	                main:574]	:	INFO	:	Epoch 1928 | loss: 0.0311292 | val_loss: 0.0311454 | Time: 3348.05 ms
[2022-04-11 12:55:18	                main:574]	:	INFO	:	Epoch 1929 | loss: 0.0311294 | val_loss: 0.0311464 | Time: 3343.84 ms
[2022-04-11 12:55:21	                main:574]	:	INFO	:	Epoch 1930 | loss: 0.0311284 | val_loss: 0.0311438 | Time: 3343.54 ms
[2022-04-11 12:55:25	                main:574]	:	INFO	:	Epoch 1931 | loss: 0.031128 | val_loss: 0.0311428 | Time: 3332.56 ms
[2022-04-11 12:55:28	                main:574]	:	INFO	:	Epoch 1932 | loss: 0.0311284 | val_loss: 0.0311483 | Time: 3340.5 ms
[2022-04-11 12:55:31	                main:574]	:	INFO	:	Epoch 1933 | loss: 0.0311307 | val_loss: 0.0311468 | Time: 3335.78 ms
[2022-04-11 12:55:35	                main:574]	:	INFO	:	Epoch 1934 | loss: 0.0311291 | val_loss: 0.0311468 | Time: 3335.63 ms
[2022-04-11 12:55:38	                main:574]	:	INFO	:	Epoch 1935 | loss: 0.0311281 | val_loss: 0.0311454 | Time: 3347.3 ms
[2022-04-11 12:55:41	                main:574]	:	INFO	:	Epoch 1936 | loss: 0.0311267 | val_loss: 0.0311472 | Time: 3332.09 ms
[2022-04-11 12:55:45	                main:574]	:	INFO	:	Epoch 1937 | loss: 0.0311266 | val_loss: 0.0311498 | Time: 3343.98 ms
[2022-04-11 12:55:48	                main:574]	:	INFO	:	Epoch 1938 | loss: 0.0311287 | val_loss: 0.0311526 | Time: 3341.86 ms
[2022-04-11 12:55:51	                main:574]	:	INFO	:	Epoch 1939 | loss: 0.0311306 | val_loss: 0.0311479 | Time: 3344.27 ms
[2022-04-11 12:55:55	                main:574]	:	INFO	:	Epoch 1940 | loss: 0.0311282 | val_loss: 0.0311467 | Time: 3332.2 ms
[2022-04-11 12:55:58	                main:574]	:	INFO	:	Epoch 1941 | loss: 0.0311251 | val_loss: 0.0311475 | Time: 3343.26 ms
[2022-04-11 12:56:01	                main:574]	:	INFO	:	Epoch 1942 | loss: 0.031126 | val_loss: 0.0311503 | Time: 3343.37 ms
[2022-04-11 12:56:05	                main:574]	:	INFO	:	Epoch 1943 | loss: 0.0311275 | val_loss: 0.0311478 | Time: 3342.46 ms
[2022-04-11 12:56:08	                main:574]	:	INFO	:	Epoch 1944 | loss: 0.0311251 | val_loss: 0.0311483 | Time: 3338.8 ms
[2022-04-11 12:56:11	                main:574]	:	INFO	:	Epoch 1945 | loss: 0.0311263 | val_loss: 0.031149 | Time: 3339.69 ms
[2022-04-11 12:56:15	                main:574]	:	INFO	:	Epoch 1946 | loss: 0.0311255 | val_loss: 0.0311462 | Time: 3337.6 ms
[2022-04-11 12:56:18	                main:574]	:	INFO	:	Epoch 1947 | loss: 0.0311234 | val_loss: 0.0311454 | Time: 3337.22 ms
[2022-04-11 12:56:21	                main:574]	:	INFO	:	Epoch 1948 | loss: 0.0311257 | val_loss: 0.0311442 | Time: 3338.81 ms
[2022-04-11 12:56:25	                main:574]	:	INFO	:	Epoch 1949 | loss: 0.0311255 | val_loss: 0.0311422 | Time: 3338.34 ms
[2022-04-11 12:56:28	                main:574]	:	INFO	:	Epoch 1950 | loss: 0.0311244 | val_loss: 0.0311468 | Time: 3343.27 ms
[2022-04-11 12:56:31	                main:574]	:	INFO	:	Epoch 1951 | loss: 0.0311241 | val_loss: 0.0311433 | Time: 3316.96 ms
[2022-04-11 12:56:35	                main:574]	:	INFO	:	Epoch 1952 | loss: 0.0311245 | val_loss: 0.0311466 | Time: 3328.91 ms
[2022-04-11 12:56:38	                main:574]	:	INFO	:	Epoch 1953 | loss: 0.0311311 | val_loss: 0.0311475 | Time: 3335.66 ms
[2022-04-11 12:56:41	                main:574]	:	INFO	:	Epoch 1954 | loss: 0.0311321 | val_loss: 0.0311446 | Time: 3342.25 ms
[2022-04-11 12:56:45	                main:574]	:	INFO	:	Epoch 1955 | loss: 0.031131 | val_loss: 0.031144 | Time: 3345.56 ms
[2022-04-11 12:56:48	                main:574]	:	INFO	:	Epoch 1956 | loss: 0.0311282 | val_loss: 0.0311457 | Time: 3343.01 ms
[2022-04-11 12:56:51	                main:574]	:	INFO	:	Epoch 1957 | loss: 0.0311291 | val_loss: 0.0311482 | Time: 3340 ms
[2022-04-11 12:56:55	                main:574]	:	INFO	:	Epoch 1958 | loss: 0.0311312 | val_loss: 0.0311573 | Time: 3339.43 ms
[2022-04-11 12:56:58	                main:574]	:	INFO	:	Epoch 1959 | loss: 0.0311304 | val_loss: 0.0311499 | Time: 3387.04 ms
[2022-04-11 12:57:02	                main:574]	:	INFO	:	Epoch 1960 | loss: 0.0311301 | val_loss: 0.0311525 | Time: 3337.89 ms
[2022-04-11 12:57:05	                main:574]	:	INFO	:	Epoch 1961 | loss: 0.0311309 | val_loss: 0.0311516 | Time: 3331.06 ms
[2022-04-11 12:57:08	                main:574]	:	INFO	:	Epoch 1962 | loss: 0.0311292 | val_loss: 0.0311508 | Time: 3341.13 ms
[2022-04-11 12:57:12	                main:574]	:	INFO	:	Epoch 1963 | loss: 0.0311288 | val_loss: 0.0311504 | Time: 3347.49 ms
[2022-04-11 12:57:15	                main:574]	:	INFO	:	Epoch 1964 | loss: 0.0311287 | val_loss: 0.0311489 | Time: 3342.85 ms
[2022-04-11 12:57:18	                main:574]	:	INFO	:	Epoch 1965 | loss: 0.0311294 | val_loss: 0.0311494 | Time: 3357.26 ms
[2022-04-11 12:57:22	                main:574]	:	INFO	:	Epoch 1966 | loss: 0.0311282 | val_loss: 0.0311474 | Time: 3343.97 ms
[2022-04-11 12:57:25	                main:574]	:	INFO	:	Epoch 1967 | loss: 0.0311372 | val_loss: 0.0311513 | Time: 3343.27 ms
[2022-04-11 12:57:28	                main:574]	:	INFO	:	Epoch 1968 | loss: 0.0311396 | val_loss: 0.0311489 | Time: 3338.94 ms
[2022-04-11 12:57:32	                main:574]	:	INFO	:	Epoch 1969 | loss: 0.0311374 | val_loss: 0.0311534 | Time: 3331.16 ms
[2022-04-11 12:57:35	                main:574]	:	INFO	:	Epoch 1970 | loss: 0.0311361 | val_loss: 0.0311496 | Time: 3340.2 ms
[2022-04-11 12:57:38	                main:574]	:	INFO	:	Epoch 1971 | loss: 0.0311331 | val_loss: 0.0311475 | Time: 3340.73 ms
[2022-04-11 12:57:42	                main:574]	:	INFO	:	Epoch 1972 | loss: 0.0311328 | val_loss: 0.0311507 | Time: 3338.26 ms
[2022-04-11 12:57:45	                main:574]	:	INFO	:	Epoch 1973 | loss: 0.0311371 | val_loss: 0.0311519 | Time: 3345.56 ms
[2022-04-11 12:57:48	                main:574]	:	INFO	:	Epoch 1974 | loss: 0.0311352 | val_loss: 0.0311529 | Time: 3335.88 ms
[2022-04-11 12:57:52	                main:574]	:	INFO	:	Epoch 1975 | loss: 0.0311369 | val_loss: 0.0311521 | Time: 3339.46 ms
[2022-04-11 12:57:55	                main:574]	:	INFO	:	Epoch 1976 | loss: 0.0311392 | val_loss: 0.0311549 | Time: 3344.26 ms
[2022-04-11 12:57:58	                main:574]	:	INFO	:	Epoch 1977 | loss: 0.0311364 | val_loss: 0.0311505 | Time: 3342.02 ms
[2022-04-11 12:58:02	                main:574]	:	INFO	:	Epoch 1978 | loss: 0.0311356 | val_loss: 0.0311459 | Time: 3343.83 ms
[2022-04-11 12:58:05	                main:574]	:	INFO	:	Epoch 1979 | loss: 0.0311348 | val_loss: 0.0311477 | Time: 3314.27 ms
[2022-04-11 12:58:08	                main:574]	:	INFO	:	Epoch 1980 | loss: 0.0311364 | val_loss: 0.0311533 | Time: 3331.55 ms
[2022-04-11 12:58:12	                main:574]	:	INFO	:	Epoch 1981 | loss: 0.0311394 | val_loss: 0.0311502 | Time: 3324.8 ms
[2022-04-11 12:58:15	                main:574]	:	INFO	:	Epoch 1982 | loss: 0.0311369 | val_loss: 0.0311481 | Time: 3341.87 ms
[2022-04-11 12:58:18	                main:574]	:	INFO	:	Epoch 1983 | loss: 0.0311349 | val_loss: 0.0311476 | Time: 3343.34 ms
[2022-04-11 12:58:22	                main:574]	:	INFO	:	Epoch 1984 | loss: 0.0311343 | val_loss: 0.0311459 | Time: 3341.51 ms
[2022-04-11 12:58:25	                main:574]	:	INFO	:	Epoch 1985 | loss: 0.0311347 | val_loss: 0.0311447 | Time: 3343.1 ms
[2022-04-11 12:58:28	                main:574]	:	INFO	:	Epoch 1986 | loss: 0.0311391 | val_loss: 0.0311476 | Time: 3342.33 ms
[2022-04-11 12:58:32	                main:574]	:	INFO	:	Epoch 1987 | loss: 0.031138 | val_loss: 0.0311461 | Time: 3412.84 ms
[2022-04-11 12:58:35	                main:574]	:	INFO	:	Epoch 1988 | loss: 0.0311341 | val_loss: 0.0311448 | Time: 3339.95 ms
[2022-04-11 12:58:39	                main:574]	:	INFO	:	Epoch 1989 | loss: 0.0311327 | val_loss: 0.031145 | Time: 3344.5 ms
[2022-04-11 12:58:42	                main:574]	:	INFO	:	Epoch 1990 | loss: 0.0311315 | val_loss: 0.0311446 | Time: 3343.01 ms
[2022-04-11 12:58:45	                main:574]	:	INFO	:	Epoch 1991 | loss: 0.0311321 | val_loss: 0.0311449 | Time: 3350.53 ms
[2022-04-11 12:58:49	                main:574]	:	INFO	:	Epoch 1992 | loss: 0.0311306 | val_loss: 0.0311463 | Time: 3373.59 ms
[2022-04-11 12:58:52	                main:574]	:	INFO	:	Epoch 1993 | loss: 0.0311288 | val_loss: 0.0311445 | Time: 3374.37 ms
[2022-04-11 12:58:55	                main:574]	:	INFO	:	Epoch 1994 | loss: 0.031129 | val_loss: 0.0311435 | Time: 3367.76 ms
[2022-04-11 12:58:59	                main:574]	:	INFO	:	Epoch 1995 | loss: 0.0311297 | val_loss: 0.0311471 | Time: 3376.9 ms
[2022-04-11 12:59:02	                main:574]	:	INFO	:	Epoch 1996 | loss: 0.0311313 | val_loss: 0.0311531 | Time: 3372.26 ms
[2022-04-11 12:59:06	                main:574]	:	INFO	:	Epoch 1997 | loss: 0.0311329 | val_loss: 0.0311457 | Time: 3374.53 ms
[2022-04-11 12:59:09	                main:574]	:	INFO	:	Epoch 1998 | loss: 0.0311322 | val_loss: 0.0311421 | Time: 3377.5 ms
[2022-04-11 12:59:12	                main:574]	:	INFO	:	Epoch 1999 | loss: 0.0311335 | val_loss: 0.0311452 | Time: 3370.78 ms
[2022-04-11 12:59:16	                main:574]	:	INFO	:	Epoch 2000 | loss: 0.0311317 | val_loss: 0.031145 | Time: 3374.79 ms
[2022-04-11 12:59:19	                main:574]	:	INFO	:	Epoch 2001 | loss: 0.0311318 | val_loss: 0.0311454 | Time: 3373.72 ms
[2022-04-11 12:59:22	                main:574]	:	INFO	:	Epoch 2002 | loss: 0.03114 | val_loss: 0.0311442 | Time: 3372.51 ms
[2022-04-11 12:59:26	                main:574]	:	INFO	:	Epoch 2003 | loss: 0.0311423 | val_loss: 0.031144 | Time: 3417.44 ms
[2022-04-11 12:59:29	                main:574]	:	INFO	:	Epoch 2004 | loss: 0.0311394 | val_loss: 0.0311436 | Time: 3376.52 ms
[2022-04-11 12:59:33	                main:574]	:	INFO	:	Epoch 2005 | loss: 0.0311362 | val_loss: 0.0311452 | Time: 3376.69 ms
[2022-04-11 12:59:36	                main:574]	:	INFO	:	Epoch 2006 | loss: 0.031137 | val_loss: 0.0311499 | Time: 3381.01 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1060 6GB)
[2022-04-11 15:38:47	                main:435]	:	INFO	:	Set logging level to 1
[2022-04-11 15:38:47	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-04-11 15:38:47	                main:444]	:	INFO	:	Resolving all filenames
[2022-04-11 15:38:47	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-11 15:38:47	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-11 15:38:47	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-11 15:38:47	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-11 15:38:47	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-11 15:38:47	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-04-11 15:38:47	                main:474]	:	INFO	:	Configuration: 
[2022-04-11 15:38:47	                main:475]	:	INFO	:	    Model type: GRU
[2022-04-11 15:38:47	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-04-11 15:38:47	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-04-11 15:38:47	                main:478]	:	INFO	:	    Batch Size: 128
[2022-04-11 15:38:47	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-04-11 15:38:47	                main:480]	:	INFO	:	    Patience: 10
[2022-04-11 15:38:47	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-04-11 15:38:47	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-04-11 15:38:47	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-04-11 15:38:47	                main:484]	:	INFO	:	    # Threads: 1
[2022-04-11 15:38:47	                main:486]	:	INFO	:	Preparing Dataset
[2022-04-11 15:38:47	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-11 15:38:47	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-11 15:38:49	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-04-11 15:38:49	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-11 15:38:49	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-11 15:38:49	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-04-11 15:38:49	                main:494]	:	INFO	:	Creating Model
[2022-04-11 15:38:49	                main:507]	:	INFO	:	Preparing config file
[2022-04-11 15:38:49	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-04-11 15:38:49	                main:512]	:	INFO	:	Loading config
[2022-04-11 15:38:49	                main:514]	:	INFO	:	Loading state
[2022-04-11 15:38:50	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2022-04-11 15:38:50	                main:562]	:	INFO	:	Starting Training
[2022-04-11 15:38:54	                main:574]	:	INFO	:	Epoch 1993 | loss: 0.03117 | val_loss: 0.0311472 | Time: 3487.41 ms
[2022-04-11 15:38:57	                main:574]	:	INFO	:	Epoch 1994 | loss: 0.031135 | val_loss: 0.0311462 | Time: 3294.54 ms
[2022-04-11 15:39:00	                main:574]	:	INFO	:	Epoch 1995 | loss: 0.0311312 | val_loss: 0.0311482 | Time: 3313.7 ms
[2022-04-11 15:39:04	                main:574]	:	INFO	:	Epoch 1996 | loss: 0.0311326 | val_loss: 0.0311452 | Time: 3347.71 ms
[2022-04-11 15:39:07	                main:574]	:	INFO	:	Epoch 1997 | loss: 0.031132 | val_loss: 0.0311461 | Time: 3385 ms
[2022-04-11 15:39:10	                main:574]	:	INFO	:	Epoch 1998 | loss: 0.0311317 | val_loss: 0.0311426 | Time: 3368.03 ms
[2022-04-11 15:39:14	                main:574]	:	INFO	:	Epoch 1999 | loss: 0.0311299 | val_loss: 0.0311408 | Time: 3369.23 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1060 6GB)
[2022-04-11 16:11:28	                main:435]	:	INFO	:	Set logging level to 1
[2022-04-11 16:11:28	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-04-11 16:11:28	                main:444]	:	INFO	:	Resolving all filenames
[2022-04-11 16:11:28	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-11 16:11:28	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-11 16:11:28	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-11 16:11:28	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-11 16:11:28	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-11 16:11:28	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-04-11 16:11:28	                main:474]	:	INFO	:	Configuration: 
[2022-04-11 16:11:28	                main:475]	:	INFO	:	    Model type: GRU
[2022-04-11 16:11:28	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-04-11 16:11:28	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-04-11 16:11:28	                main:478]	:	INFO	:	    Batch Size: 128
[2022-04-11 16:11:28	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-04-11 16:11:28	                main:480]	:	INFO	:	    Patience: 10
[2022-04-11 16:11:28	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-04-11 16:11:28	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-04-11 16:11:28	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-04-11 16:11:28	                main:484]	:	INFO	:	    # Threads: 1
[2022-04-11 16:11:28	                main:486]	:	INFO	:	Preparing Dataset
[2022-04-11 16:11:28	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-11 16:11:29	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-11 16:11:31	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-04-11 16:11:31	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-11 16:11:31	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-11 16:11:31	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-04-11 16:11:31	                main:494]	:	INFO	:	Creating Model
[2022-04-11 16:11:31	                main:507]	:	INFO	:	Preparing config file
[2022-04-11 16:11:31	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-04-11 16:11:31	                main:512]	:	INFO	:	Loading config
[2022-04-11 16:11:31	                main:514]	:	INFO	:	Loading state
[2022-04-11 16:11:32	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2022-04-11 16:11:32	                main:562]	:	INFO	:	Starting Training
[2022-04-11 16:11:33	                main:574]	:	INFO	:	Epoch 1993 | loss: 0.0311655 | val_loss: 0.0311528 | Time: 1841.35 ms
[2022-04-11 16:11:35	                main:574]	:	INFO	:	Epoch 1994 | loss: 0.0311364 | val_loss: 0.0311459 | Time: 1565.87 ms
[2022-04-11 16:11:37	                main:574]	:	INFO	:	Epoch 1995 | loss: 0.0311321 | val_loss: 0.0311468 | Time: 1563.42 ms
[2022-04-11 16:11:38	                main:574]	:	INFO	:	Epoch 1996 | loss: 0.0311349 | val_loss: 0.0311458 | Time: 1556.59 ms
[2022-04-11 16:11:40	                main:574]	:	INFO	:	Epoch 1997 | loss: 0.0311321 | val_loss: 0.0311463 | Time: 1545.43 ms
[2022-04-11 16:11:41	                main:574]	:	INFO	:	Epoch 1998 | loss: 0.0311296 | val_loss: 0.0311448 | Time: 1565.69 ms
[2022-04-11 16:11:43	                main:574]	:	INFO	:	Epoch 1999 | loss: 0.0311284 | val_loss: 0.0311431 | Time: 1556.67 ms
[2022-04-11 16:11:44	                main:574]	:	INFO	:	Epoch 2000 | loss: 0.0311274 | val_loss: 0.0311448 | Time: 1558.61 ms
[2022-04-11 16:11:46	                main:574]	:	INFO	:	Epoch 2001 | loss: 0.0311274 | val_loss: 0.0311452 | Time: 1562.08 ms
[2022-04-11 16:11:48	                main:574]	:	INFO	:	Epoch 2002 | loss: 0.031128 | val_loss: 0.0311452 | Time: 1559.95 ms
[2022-04-11 16:11:49	                main:574]	:	INFO	:	Epoch 2003 | loss: 0.031129 | val_loss: 0.0311426 | Time: 1563.89 ms
[2022-04-11 16:11:51	                main:574]	:	INFO	:	Epoch 2004 | loss: 0.0311281 | val_loss: 0.0311444 | Time: 1572.28 ms
[2022-04-11 16:11:52	                main:574]	:	INFO	:	Epoch 2005 | loss: 0.0311324 | val_loss: 0.0311444 | Time: 1547.63 ms
[2022-04-11 16:11:54	                main:574]	:	INFO	:	Epoch 2006 | loss: 0.0311317 | val_loss: 0.0311498 | Time: 1572.77 ms
[2022-04-11 16:11:55	                main:574]	:	INFO	:	Epoch 2007 | loss: 0.0311357 | val_loss: 0.0311433 | Time: 1581.8 ms
[2022-04-11 16:11:57	                main:574]	:	INFO	:	Epoch 2008 | loss: 0.0311348 | val_loss: 0.0311436 | Time: 1552.38 ms
[2022-04-11 16:11:59	                main:574]	:	INFO	:	Epoch 2009 | loss: 0.0311357 | val_loss: 0.0311492 | Time: 1560.3 ms
[2022-04-11 16:12:00	                main:574]	:	INFO	:	Epoch 2010 | loss: 0.0311324 | val_loss: 0.031142 | Time: 1556.6 ms
[2022-04-11 16:12:02	                main:574]	:	INFO	:	Epoch 2011 | loss: 0.0311296 | val_loss: 0.0311409 | Time: 1558.71 ms
[2022-04-11 16:12:03	                main:574]	:	INFO	:	Epoch 2012 | loss: 0.0311294 | val_loss: 0.0311421 | Time: 1552.2 ms
[2022-04-11 16:12:05	                main:574]	:	INFO	:	Epoch 2013 | loss: 0.0311314 | val_loss: 0.0311403 | Time: 1541.33 ms
[2022-04-11 16:12:06	                main:574]	:	INFO	:	Epoch 2014 | loss: 0.0311311 | val_loss: 0.0311399 | Time: 1599.5 ms
[2022-04-11 16:12:08	                main:574]	:	INFO	:	Epoch 2015 | loss: 0.0311307 | val_loss: 0.0311392 | Time: 1663.28 ms
[2022-04-11 16:12:10	                main:574]	:	INFO	:	Epoch 2016 | loss: 0.0311307 | val_loss: 0.0311409 | Time: 1563.2 ms
[2022-04-11 16:12:11	                main:574]	:	INFO	:	Epoch 2017 | loss: 0.0311304 | val_loss: 0.0311435 | Time: 1575.1 ms
[2022-04-11 16:12:13	                main:574]	:	INFO	:	Epoch 2018 | loss: 0.0311314 | val_loss: 0.0311464 | Time: 1575.51 ms
[2022-04-11 16:12:14	                main:574]	:	INFO	:	Epoch 2019 | loss: 0.0311305 | val_loss: 0.0311438 | Time: 1571.43 ms
[2022-04-11 16:12:16	                main:574]	:	INFO	:	Epoch 2020 | loss: 0.0311301 | val_loss: 0.0311454 | Time: 1585.31 ms
[2022-04-11 16:12:17	                main:574]	:	INFO	:	Epoch 2021 | loss: 0.0311304 | val_loss: 0.0311444 | Time: 1559.92 ms
[2022-04-11 16:12:19	                main:574]	:	INFO	:	Epoch 2022 | loss: 0.0311314 | val_loss: 0.0311464 | Time: 1550.31 ms
[2022-04-11 16:12:21	                main:574]	:	INFO	:	Epoch 2023 | loss: 0.0311296 | val_loss: 0.031145 | Time: 1576.08 ms
[2022-04-11 16:12:22	                main:574]	:	INFO	:	Epoch 2024 | loss: 0.0311293 | val_loss: 0.031145 | Time: 1567.02 ms
[2022-04-11 16:12:24	                main:574]	:	INFO	:	Epoch 2025 | loss: 0.0311279 | val_loss: 0.0311441 | Time: 1567.62 ms
[2022-04-11 16:12:25	                main:574]	:	INFO	:	Epoch 2026 | loss: 0.0311271 | val_loss: 0.0311438 | Time: 1563.67 ms
[2022-04-11 16:12:27	                main:574]	:	INFO	:	Epoch 2027 | loss: 0.0311261 | val_loss: 0.0311419 | Time: 1557.88 ms
[2022-04-11 16:12:28	                main:574]	:	INFO	:	Epoch 2028 | loss: 0.0311268 | val_loss: 0.0311394 | Time: 1560.38 ms
[2022-04-11 16:12:30	                main:574]	:	INFO	:	Epoch 2029 | loss: 0.0311264 | val_loss: 0.031142 | Time: 1974.36 ms
[2022-04-11 16:12:32	                main:574]	:	INFO	:	Epoch 2030 | loss: 0.0311318 | val_loss: 0.0311458 | Time: 1722.51 ms
[2022-04-11 16:12:34	                main:574]	:	INFO	:	Epoch 2031 | loss: 0.0311385 | val_loss: 0.0311475 | Time: 1664.13 ms
[2022-04-11 16:12:35	                main:574]	:	INFO	:	Epoch 2032 | loss: 0.0311364 | val_loss: 0.0311453 | Time: 1635.54 ms
[2022-04-11 16:12:37	                main:574]	:	INFO	:	Epoch 2033 | loss: 0.0311313 | val_loss: 0.0311467 | Time: 1626.44 ms
[2022-04-11 16:12:39	                main:574]	:	INFO	:	Epoch 2034 | loss: 0.0311304 | val_loss: 0.0311463 | Time: 1625.49 ms
[2022-04-11 16:12:40	                main:574]	:	INFO	:	Epoch 2035 | loss: 0.0311314 | val_loss: 0.031145 | Time: 1622.93 ms
[2022-04-11 16:12:42	                main:574]	:	INFO	:	Epoch 2036 | loss: 0.0311317 | val_loss: 0.0311459 | Time: 1629.16 ms
[2022-04-11 16:12:44	                main:574]	:	INFO	:	Epoch 2037 | loss: 0.0311317 | val_loss: 0.0311417 | Time: 1611.85 ms
[2022-04-11 16:12:45	                main:574]	:	INFO	:	Epoch 2038 | loss: 0.0311311 | val_loss: 0.031145 | Time: 1628.24 ms
[2022-04-11 16:12:47	                main:574]	:	INFO	:	Epoch 2039 | loss: 0.0311285 | val_loss: 0.0311419 | Time: 1619.89 ms
[2022-04-11 16:12:48	                main:574]	:	INFO	:	Epoch 2040 | loss: 0.0311269 | val_loss: 0.031145 | Time: 1611.11 ms
[2022-04-11 16:12:50	                main:574]	:	INFO	:	Epoch 2041 | loss: 0.0311316 | val_loss: 0.0311422 | Time: 1619.1 ms
[2022-04-11 16:12:52	                main:574]	:	INFO	:	Epoch 2042 | loss: 0.031128 | val_loss: 0.0311448 | Time: 1633.52 ms
[2022-04-11 16:12:53	                main:574]	:	INFO	:	Epoch 2043 | loss: 0.0311281 | val_loss: 0.0311468 | Time: 1641.35 ms
[2022-04-11 16:12:55	                main:574]	:	INFO	:	Epoch 2044 | loss: 0.0311288 | val_loss: 0.0311457 | Time: 1627.67 ms
[2022-04-11 16:12:57	                main:574]	:	INFO	:	Epoch 2045 | loss: 0.0311274 | val_loss: 0.0311486 | Time: 1654.86 ms
[2022-04-11 16:12:58	                main:574]	:	INFO	:	Epoch 2046 | loss: 0.0311298 | val_loss: 0.0311466 | Time: 1625.83 ms
[2022-04-11 16:13:00	                main:574]	:	INFO	:	Epoch 2047 | loss: 0.0311267 | val_loss: 0.0311441 | Time: 1613.42 ms
[2022-04-11 16:13:02	                main:574]	:	INFO	:	Epoch 2048 | loss: 0.0311256 | val_loss: 0.0311465 | Time: 1636.32 ms
[2022-04-11 16:13:02	                main:597]	:	INFO	:	Saving trained model to model-final.pt, val_loss 0.0311465
[2022-04-11 16:13:02	                main:603]	:	INFO	:	Saving end state to config to file
[2022-04-11 16:13:02	                main:608]	:	INFO	:	Success, exiting..
16:13:02 (13588): called boinc_finish(0)

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)