Task 9117413

Name ParityModified-1636229002-18178-0_1
Workunit 6207038
Created 22 Nov 2021, 20:07:23 UTC
Sent 22 Nov 2021, 21:37:17 UTC
Report deadline 30 Nov 2021, 21:37:17 UTC
Received 25 Nov 2021, 11:01:06 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 6741
Run time 6 hours 8 min 33 sec
CPU time 4 hours 16 min 47 sec
Validate state Valid
Credit 4,160.00
Device peak FLOPS 786.79 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.58 GB
Peak swap size 3.44 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.20</core_client_version>
<![CDATA[
<stderr_txt>
25 17:35:24	                main:514]	:	INFO	:	Loading state
[2021-11-25 17:35:25	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2021-11-25 17:35:26	                main:562]	:	INFO	:	Starting Training
[2021-11-25 17:35:33	                main:574]	:	INFO	:	Epoch 1827 | loss: 0.0314522 | val_loss: 0.0312992 | Time: 7051.95 ms
[2021-11-25 17:35:39	                main:574]	:	INFO	:	Epoch 1828 | loss: 0.0312663 | val_loss: 0.0312549 | Time: 6662.32 ms
[2021-11-25 17:35:50	                main:574]	:	INFO	:	Epoch 1829 | loss: 0.0312525 | val_loss: 0.0312496 | Time: 10479.2 ms
[2021-11-25 17:36:10	                main:574]	:	INFO	:	Epoch 1830 | loss: 0.0312502 | val_loss: 0.0312488 | Time: 20402.7 ms
[2021-11-25 17:36:30	                main:574]	:	INFO	:	Epoch 1831 | loss: 0.0312511 | val_loss: 0.0312489 | Time: 19708 ms
[2021-11-25 17:36:40	                main:574]	:	INFO	:	Epoch 1832 | loss: 0.0312533 | val_loss: 0.0312528 | Time: 9839.12 ms
[2021-11-25 17:37:01	                main:574]	:	INFO	:	Epoch 1833 | loss: 0.0312512 | val_loss: 0.0312489 | Time: 21362 ms
[2021-11-25 17:37:25	                main:574]	:	INFO	:	Epoch 1834 | loss: 0.0312493 | val_loss: 0.0312485 | Time: 24206.1 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 930MX)
[2021-11-25 17:40:38	                main:435]	:	INFO	:	Set logging level to 1
[2021-11-25 17:40:38	                main:441]	:	INFO	:	Running in BOINC Client mode
[2021-11-25 17:40:38	                main:444]	:	INFO	:	Resolving all filenames
[2021-11-25 17:40:38	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1)
[2021-11-25 17:40:38	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636229002-18178-0_1_r134764730_1 (exists = 1)
[2021-11-25 17:40:38	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636229002-18178-0_1_r134764730_0 (exists = 0)
[2021-11-25 17:40:38	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 0)
[2021-11-25 17:40:38	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2021-11-25 17:40:38	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5
[2021-11-25 17:40:38	                main:474]	:	INFO	:	Configuration: 
[2021-11-25 17:40:39	                main:475]	:	INFO	:	    Model type: GRU
[2021-11-25 17:40:39	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2021-11-25 17:40:39	                main:477]	:	INFO	:	    Max Epochs: 2048
[2021-11-25 17:40:39	                main:478]	:	INFO	:	    Batch Size: 128
[2021-11-25 17:40:39	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2021-11-25 17:40:39	                main:480]	:	INFO	:	    Patience: 10
[2021-11-25 17:40:39	                main:481]	:	INFO	:	    Hidden Width: 12
[2021-11-25 17:40:39	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2021-11-25 17:40:39	                main:483]	:	INFO	:	    # Backend Layers: 4
[2021-11-25 17:40:39	                main:484]	:	INFO	:	    # Threads: 1
[2021-11-25 17:40:39	                main:486]	:	INFO	:	Preparing Dataset
[2021-11-25 17:40:39	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-25 17:40:39	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-25 17:40:43	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2021-11-25 17:40:43	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-25 17:40:43	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-25 17:40:43	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2021-11-25 17:40:43	                main:494]	:	INFO	:	Creating Model
[2021-11-25 17:40:43	                main:507]	:	INFO	:	Preparing config file
[2021-11-25 17:40:43	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2021-11-25 17:40:43	                main:512]	:	INFO	:	Loading config
[2021-11-25 17:40:43	                main:514]	:	INFO	:	Loading state
[2021-11-25 17:40:45	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2021-11-25 17:40:45	                main:562]	:	INFO	:	Starting Training
[2021-11-25 17:40:52	                main:574]	:	INFO	:	Epoch 1827 | loss: 0.0315525 | val_loss: 0.0312812 | Time: 7244.95 ms
[2021-11-25 17:40:59	                main:574]	:	INFO	:	Epoch 1828 | loss: 0.0312693 | val_loss: 0.0312592 | Time: 6803.17 ms
[2021-11-25 17:41:10	                main:574]	:	INFO	:	Epoch 1829 | loss: 0.0312543 | val_loss: 0.0312519 | Time: 10718.7 ms
[2021-11-25 17:41:31	                main:574]	:	INFO	:	Epoch 1830 | loss: 0.0312514 | val_loss: 0.0312509 | Time: 21662.2 ms
[2021-11-25 17:43:31	                main:574]	:	INFO	:	Epoch 1831 | loss: 0.0312513 | val_loss: 0.0312519 | Time: 119729 ms
[2021-11-25 17:44:08	                main:574]	:	INFO	:	Epoch 1832 | loss: 0.0312512 | val_loss: 0.0312509 | Time: 36347.9 ms
[2021-11-25 17:44:45	                main:574]	:	INFO	:	Epoch 1833 | loss: 0.0312504 | val_loss: 0.0312499 | Time: 36682.4 ms
[2021-11-25 17:45:33	                main:574]	:	INFO	:	Epoch 1834 | loss: 0.0312497 | val_loss: 0.0312493 | Time: 48387.2 ms
[2021-11-25 17:46:05	                main:574]	:	INFO	:	Epoch 1835 | loss: 0.03125 | val_loss: 0.0312498 | Time: 31991.5 ms
[2021-11-25 17:46:28	                main:574]	:	INFO	:	Epoch 1836 | loss: 0.0312483 | val_loss: 0.0312481 | Time: 22326.7 ms
[2021-11-25 17:46:51	                main:574]	:	INFO	:	Epoch 1837 | loss: 0.031245 | val_loss: 0.0312458 | Time: 22945.3 ms
[2021-11-25 17:47:13	                main:574]	:	INFO	:	Epoch 1838 | loss: 0.0312431 | val_loss: 0.0312382 | Time: 22618.3 ms
[2021-11-25 17:47:46	                main:574]	:	INFO	:	Epoch 1839 | loss: 0.0312366 | val_loss: 0.0312256 | Time: 32717.8 ms
[2021-11-25 17:48:08	                main:574]	:	INFO	:	Epoch 1840 | loss: 0.0312273 | val_loss: 0.0312666 | Time: 22018.2 ms
[2021-11-25 17:48:32	                main:574]	:	INFO	:	Epoch 1841 | loss: 0.031223 | val_loss: 0.0312138 | Time: 23153.3 ms
[2021-11-25 17:48:55	                main:574]	:	INFO	:	Epoch 1842 | loss: 0.0312069 | val_loss: 0.0312362 | Time: 23535.8 ms
[2021-11-25 17:49:16	                main:574]	:	INFO	:	Epoch 1843 | loss: 0.0312156 | val_loss: 0.0311928 | Time: 20928.9 ms
[2021-11-25 17:49:47	                main:574]	:	INFO	:	Epoch 1844 | loss: 0.0311943 | val_loss: 0.0311924 | Time: 31162.9 ms
[2021-11-25 17:50:39	                main:574]	:	INFO	:	Epoch 1845 | loss: 0.0311862 | val_loss: 0.0311849 | Time: 51859.8 ms
[2021-11-25 17:51:00	                main:574]	:	INFO	:	Epoch 1846 | loss: 0.0311852 | val_loss: 0.0311835 | Time: 20788.4 ms
[2021-11-25 17:51:22	                main:574]	:	INFO	:	Epoch 1847 | loss: 0.03118 | val_loss: 0.0311859 | Time: 21627.7 ms
[2021-11-25 17:51:43	                main:574]	:	INFO	:	Epoch 1848 | loss: 0.0311795 | val_loss: 0.0311919 | Time: 20710.9 ms
[2021-11-25 17:51:56	                main:574]	:	INFO	:	Epoch 1849 | loss: 0.0311814 | val_loss: 0.0311806 | Time: 12982.4 ms
[2021-11-25 17:52:18	                main:574]	:	INFO	:	Epoch 1850 | loss: 0.0311794 | val_loss: 0.0311778 | Time: 21924.9 ms
[2021-11-25 17:52:39	                main:574]	:	INFO	:	Epoch 1851 | loss: 0.0311788 | val_loss: 0.0311841 | Time: 20588.8 ms
[2021-11-25 17:53:10	                main:574]	:	INFO	:	Epoch 1852 | loss: 0.0311735 | val_loss: 0.0311777 | Time: 31456.4 ms
[2021-11-25 17:53:31	                main:574]	:	INFO	:	Epoch 1853 | loss: 0.0311774 | val_loss: 0.0311775 | Time: 20926.3 ms
[2021-11-25 17:53:54	                main:574]	:	INFO	:	Epoch 1854 | loss: 0.0311787 | val_loss: 0.0311829 | Time: 22649.2 ms
[2021-11-25 17:54:32	                main:574]	:	INFO	:	Epoch 1855 | loss: 0.0311794 | val_loss: 0.0311825 | Time: 37779.3 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 930MX)
[2021-11-25 17:58:22	                main:435]	:	INFO	:	Set logging level to 1
[2021-11-25 17:58:22	                main:441]	:	INFO	:	Running in BOINC Client mode
[2021-11-25 17:58:22	                main:444]	:	INFO	:	Resolving all filenames
[2021-11-25 17:58:22	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1)
[2021-11-25 17:58:22	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636229002-18178-0_1_r134764730_1 (exists = 1)
[2021-11-25 17:58:22	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636229002-18178-0_1_r134764730_0 (exists = 0)
[2021-11-25 17:58:22	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 0)
[2021-11-25 17:58:22	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2021-11-25 17:58:22	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5
[2021-11-25 17:58:22	                main:474]	:	INFO	:	Configuration: 
[2021-11-25 17:58:22	                main:475]	:	INFO	:	    Model type: GRU
[2021-11-25 17:58:23	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2021-11-25 17:58:23	                main:477]	:	INFO	:	    Max Epochs: 2048
[2021-11-25 17:58:23	                main:478]	:	INFO	:	    Batch Size: 128
[2021-11-25 17:58:23	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2021-11-25 17:58:23	                main:480]	:	INFO	:	    Patience: 10
[2021-11-25 17:58:23	                main:481]	:	INFO	:	    Hidden Width: 12
[2021-11-25 17:58:23	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2021-11-25 17:58:23	                main:483]	:	INFO	:	    # Backend Layers: 4
[2021-11-25 17:58:23	                main:484]	:	INFO	:	    # Threads: 1
[2021-11-25 17:58:23	                main:486]	:	INFO	:	Preparing Dataset
[2021-11-25 17:58:23	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-25 17:58:23	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-25 17:58:26	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2021-11-25 17:58:26	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-25 17:58:27	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-25 17:58:27	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2021-11-25 17:58:27	                main:494]	:	INFO	:	Creating Model
[2021-11-25 17:58:27	                main:507]	:	INFO	:	Preparing config file
[2021-11-25 17:58:27	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2021-11-25 17:58:27	                main:512]	:	INFO	:	Loading config
[2021-11-25 17:58:27	                main:514]	:	INFO	:	Loading state
[2021-11-25 17:58:28	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2021-11-25 17:58:28	                main:562]	:	INFO	:	Starting Training
[2021-11-25 17:58:35	                main:574]	:	INFO	:	Epoch 1848 | loss: 0.0314816 | val_loss: 0.0312958 | Time: 6976.57 ms
[2021-11-25 17:58:42	                main:574]	:	INFO	:	Epoch 1849 | loss: 0.0312569 | val_loss: 0.0312342 | Time: 6697.85 ms
[2021-11-25 17:59:04	                main:574]	:	INFO	:	Epoch 1850 | loss: 0.031217 | val_loss: 0.0311986 | Time: 22009 ms
[2021-11-25 17:59:25	                main:574]	:	INFO	:	Epoch 1851 | loss: 0.0311895 | val_loss: 0.031183 | Time: 20537.3 ms
[2021-11-25 17:59:44	                main:574]	:	INFO	:	Epoch 1852 | loss: 0.0311821 | val_loss: 0.0311815 | Time: 19896.3 ms
[2021-11-25 18:00:06	                main:574]	:	INFO	:	Epoch 1853 | loss: 0.0311772 | val_loss: 0.0311785 | Time: 21701.4 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 930MX)
[2021-11-25 18:03:21	                main:435]	:	INFO	:	Set logging level to 1
[2021-11-25 18:03:21	                main:441]	:	INFO	:	Running in BOINC Client mode
[2021-11-25 18:03:21	                main:444]	:	INFO	:	Resolving all filenames
[2021-11-25 18:03:21	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1)
[2021-11-25 18:03:21	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636229002-18178-0_1_r134764730_1 (exists = 1)
[2021-11-25 18:03:21	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636229002-18178-0_1_r134764730_0 (exists = 0)
[2021-11-25 18:03:21	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 0)
[2021-11-25 18:03:21	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2021-11-25 18:03:21	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5
[2021-11-25 18:03:21	                main:474]	:	INFO	:	Configuration: 
[2021-11-25 18:03:21	                main:475]	:	INFO	:	    Model type: GRU
[2021-11-25 18:03:21	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2021-11-25 18:03:21	                main:477]	:	INFO	:	    Max Epochs: 2048
[2021-11-25 18:03:21	                main:478]	:	INFO	:	    Batch Size: 128
[2021-11-25 18:03:21	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2021-11-25 18:03:21	                main:480]	:	INFO	:	    Patience: 10
[2021-11-25 18:03:21	                main:481]	:	INFO	:	    Hidden Width: 12
[2021-11-25 18:03:21	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2021-11-25 18:03:21	                main:483]	:	INFO	:	    # Backend Layers: 4
[2021-11-25 18:03:21	                main:484]	:	INFO	:	    # Threads: 1
[2021-11-25 18:03:21	                main:486]	:	INFO	:	Preparing Dataset
[2021-11-25 18:03:21	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-25 18:03:21	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-25 18:03:24	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2021-11-25 18:03:24	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-25 18:03:24	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-25 18:03:24	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2021-11-25 18:03:24	                main:494]	:	INFO	:	Creating Model
[2021-11-25 18:03:24	                main:507]	:	INFO	:	Preparing config file
[2021-11-25 18:03:24	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2021-11-25 18:03:24	                main:512]	:	INFO	:	Loading config
[2021-11-25 18:03:24	                main:514]	:	INFO	:	Loading state
[2021-11-25 18:03:26	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2021-11-25 18:03:26	                main:562]	:	INFO	:	Starting Training
[2021-11-25 18:03:33	                main:574]	:	INFO	:	Epoch 1848 | loss: 0.0314877 | val_loss: 0.0313027 | Time: 6992.25 ms
[2021-11-25 18:03:39	                main:574]	:	INFO	:	Epoch 1849 | loss: 0.0312572 | val_loss: 0.0312296 | Time: 6685.46 ms
[2021-11-25 18:03:51	                main:574]	:	INFO	:	Epoch 1850 | loss: 0.0312133 | val_loss: 0.0311942 | Time: 11376.3 ms
[2021-11-25 18:04:12	                main:574]	:	INFO	:	Epoch 1851 | loss: 0.0311846 | val_loss: 0.0311828 | Time: 21669.1 ms
[2021-11-25 18:04:38	                main:574]	:	INFO	:	Epoch 1852 | loss: 0.0311826 | val_loss: 0.0311898 | Time: 25127.5 ms
[2021-11-25 18:04:47	                main:574]	:	INFO	:	Epoch 1853 | loss: 0.0311816 | val_loss: 0.0311799 | Time: 9543.97 ms
[2021-11-25 18:05:02	                main:574]	:	INFO	:	Epoch 1854 | loss: 0.0311747 | val_loss: 0.0311747 | Time: 14488.9 ms
[2021-11-25 18:05:24	                main:574]	:	INFO	:	Epoch 1855 | loss: 0.0311712 | val_loss: 0.0311733 | Time: 22437.5 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 930MX)
[2021-11-25 18:08:38	                main:435]	:	INFO	:	Set logging level to 1
[2021-11-25 18:08:38	                main:441]	:	INFO	:	Running in BOINC Client mode
[2021-11-25 18:08:38	                main:444]	:	INFO	:	Resolving all filenames
[2021-11-25 18:08:38	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1)
[2021-11-25 18:08:38	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636229002-18178-0_1_r134764730_1 (exists = 1)
[2021-11-25 18:08:38	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636229002-18178-0_1_r134764730_0 (exists = 0)
[2021-11-25 18:08:38	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 0)
[2021-11-25 18:08:38	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2021-11-25 18:08:38	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5
[2021-11-25 18:08:38	                main:474]	:	INFO	:	Configuration: 
[2021-11-25 18:08:38	                main:475]	:	INFO	:	    Model type: GRU
[2021-11-25 18:08:38	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2021-11-25 18:08:39	                main:477]	:	INFO	:	    Max Epochs: 2048
[2021-11-25 18:08:39	                main:478]	:	INFO	:	    Batch Size: 128
[2021-11-25 18:08:39	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2021-11-25 18:08:39	                main:480]	:	INFO	:	    Patience: 10
[2021-11-25 18:08:39	                main:481]	:	INFO	:	    Hidden Width: 12
[2021-11-25 18:08:39	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2021-11-25 18:08:39	                main:483]	:	INFO	:	    # Backend Layers: 4
[2021-11-25 18:08:39	                main:484]	:	INFO	:	    # Threads: 1
[2021-11-25 18:08:39	                main:486]	:	INFO	:	Preparing Dataset
[2021-11-25 18:08:39	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-25 18:08:39	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-25 18:08:42	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2021-11-25 18:08:42	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-25 18:08:43	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-25 18:08:43	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2021-11-25 18:08:43	                main:494]	:	INFO	:	Creating Model
[2021-11-25 18:08:43	                main:507]	:	INFO	:	Preparing config file
[2021-11-25 18:08:43	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2021-11-25 18:08:43	                main:512]	:	INFO	:	Loading config
[2021-11-25 18:08:43	                main:514]	:	INFO	:	Loading state
[2021-11-25 18:08:44	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2021-11-25 18:08:44	                main:562]	:	INFO	:	Starting Training
[2021-11-25 18:08:52	                main:574]	:	INFO	:	Epoch 1848 | loss: 0.0314739 | val_loss: 0.0312542 | Time: 7540.75 ms
[2021-11-25 18:08:59	                main:574]	:	INFO	:	Epoch 1849 | loss: 0.0312475 | val_loss: 0.0312253 | Time: 6762.35 ms
[2021-11-25 18:09:22	                main:574]	:	INFO	:	Epoch 1850 | loss: 0.0312111 | val_loss: 0.0312032 | Time: 23388.5 ms
[2021-11-25 18:09:46	                main:574]	:	INFO	:	Epoch 1851 | loss: 0.0311896 | val_loss: 0.0311896 | Time: 23508.6 ms
[2021-11-25 18:11:39	                main:574]	:	INFO	:	Epoch 1852 | loss: 0.0311799 | val_loss: 0.0311762 | Time: 113498 ms
[2021-11-25 18:12:12	                main:574]	:	INFO	:	Epoch 1853 | loss: 0.031183 | val_loss: 0.0311805 | Time: 33012.8 ms
[2021-11-25 18:12:35	                main:574]	:	INFO	:	Epoch 1854 | loss: 0.0311776 | val_loss: 0.0311735 | Time: 22262.4 ms
[2021-11-25 18:12:58	                main:574]	:	INFO	:	Epoch 1855 | loss: 0.0311718 | val_loss: 0.031173 | Time: 22688 ms
[2021-11-25 18:13:32	                main:574]	:	INFO	:	Epoch 1856 | loss: 0.0311705 | val_loss: 0.0311775 | Time: 34045.5 ms
[2021-11-25 18:13:54	                main:574]	:	INFO	:	Epoch 1857 | loss: 0.03117 | val_loss: 0.0311761 | Time: 22494 ms
[2021-11-25 18:14:17	                main:574]	:	INFO	:	Epoch 1858 | loss: 0.0311688 | val_loss: 0.0311761 | Time: 22873.1 ms
[2021-11-25 18:14:42	                main:574]	:	INFO	:	Epoch 1859 | loss: 0.031171 | val_loss: 0.0311707 | Time: 24358.2 ms
[2021-11-25 18:15:15	                main:574]	:	INFO	:	Epoch 1860 | loss: 0.0311648 | val_loss: 0.0311695 | Time: 32900.2 ms
[2021-11-25 18:15:37	                main:574]	:	INFO	:	Epoch 1861 | loss: 0.0311639 | val_loss: 0.0311729 | Time: 22381.8 ms
[2021-11-25 18:16:24	                main:574]	:	INFO	:	Epoch 1862 | loss: 0.0311608 | val_loss: 0.0311715 | Time: 46926.1 ms
[2021-11-25 18:16:47	                main:574]	:	INFO	:	Epoch 1863 | loss: 0.03116 | val_loss: 0.0311712 | Time: 22526.6 ms
[2021-11-25 18:17:09	                main:574]	:	INFO	:	Epoch 1864 | loss: 0.0311603 | val_loss: 0.0311707 | Time: 22421.9 ms
[2021-11-25 18:17:33	                main:574]	:	INFO	:	Epoch 1865 | loss: 0.0311586 | val_loss: 0.0311727 | Time: 23344.1 ms
[2021-11-25 18:18:05	                main:574]	:	INFO	:	Epoch 1866 | loss: 0.0311596 | val_loss: 0.03117 | Time: 32611.3 ms
[2021-11-25 18:18:29	                main:574]	:	INFO	:	Epoch 1867 | loss: 0.031159 | val_loss: 0.0311689 | Time: 23236.3 ms
[2021-11-25 18:18:52	                main:574]	:	INFO	:	Epoch 1868 | loss: 0.0311573 | val_loss: 0.0311695 | Time: 23013 ms
[2021-11-25 18:19:26	                main:574]	:	INFO	:	Epoch 1869 | loss: 0.0311599 | val_loss: 0.0311751 | Time: 33627.8 ms
[2021-11-25 18:19:48	                main:574]	:	INFO	:	Epoch 1870 | loss: 0.0311585 | val_loss: 0.0311797 | Time: 22568.4 ms
[2021-11-25 18:20:12	                main:574]	:	INFO	:	Epoch 1871 | loss: 0.03116 | val_loss: 0.0311834 | Time: 23389.1 ms
[2021-11-25 18:20:34	                main:574]	:	INFO	:	Epoch 1872 | loss: 0.0311546 | val_loss: 0.0311781 | Time: 22079.3 ms
[2021-11-25 18:21:37	                main:574]	:	INFO	:	Epoch 1873 | loss: 0.0311543 | val_loss: 0.0311675 | Time: 63474.2 ms
[2021-11-25 18:21:59	                main:574]	:	INFO	:	Epoch 1874 | loss: 0.0311531 | val_loss: 0.0311658 | Time: 21750.1 ms
[2021-11-25 18:22:23	                main:574]	:	INFO	:	Epoch 1875 | loss: 0.0311493 | val_loss: 0.0311687 | Time: 23203.9 ms
[2021-11-25 18:22:45	                main:574]	:	INFO	:	Epoch 1876 | loss: 0.0311495 | val_loss: 0.0311703 | Time: 22056.5 ms
[2021-11-25 18:23:19	                main:574]	:	INFO	:	Epoch 1877 | loss: 0.0311487 | val_loss: 0.0311721 | Time: 33808.8 ms
[2021-11-25 18:23:42	                main:574]	:	INFO	:	Epoch 1878 | loss: 0.0311568 | val_loss: 0.0311726 | Time: 23121.1 ms
[2021-11-25 18:24:18	                main:574]	:	INFO	:	Epoch 1879 | loss: 0.0311553 | val_loss: 0.0311719 | Time: 35351.6 ms
[2021-11-25 18:24:42	                main:574]	:	INFO	:	Epoch 1880 | loss: 0.0311472 | val_loss: 0.0311702 | Time: 24708.1 ms
[2021-11-25 18:25:07	                main:574]	:	INFO	:	Epoch 1881 | loss: 0.0311487 | val_loss: 0.0311747 | Time: 24700.1 ms
[2021-11-25 18:25:42	                main:574]	:	INFO	:	Epoch 1882 | loss: 0.0311498 | val_loss: 0.0311693 | Time: 34587 ms
[2021-11-25 18:26:05	                main:574]	:	INFO	:	Epoch 1883 | loss: 0.0311465 | val_loss: 0.0311725 | Time: 23225.1 ms
[2021-11-25 18:27:00	                main:574]	:	INFO	:	Epoch 1884 | loss: 0.0311446 | val_loss: 0.0311671 | Time: 53961.8 ms
[2021-11-25 18:27:23	                main:574]	:	INFO	:	Epoch 1885 | loss: 0.0311464 | val_loss: 0.0311792 | Time: 23030.7 ms
[2021-11-25 18:27:46	                main:574]	:	INFO	:	Epoch 1886 | loss: 0.0311455 | val_loss: 0.0311726 | Time: 22973.4 ms
[2021-11-25 18:28:06	                main:574]	:	INFO	:	Epoch 1887 | loss: 0.0311711 | val_loss: 0.0311752 | Time: 20439.9 ms
[2021-11-25 18:28:28	                main:574]	:	INFO	:	Epoch 1888 | loss: 0.0311694 | val_loss: 0.0311713 | Time: 21470.8 ms
[2021-11-25 18:28:49	                main:574]	:	INFO	:	Epoch 1889 | loss: 0.0311635 | val_loss: 0.0311657 | Time: 20557.7 ms
[2021-11-25 18:29:22	                main:574]	:	INFO	:	Epoch 1890 | loss: 0.0311582 | val_loss: 0.0311644 | Time: 33407 ms
[2021-11-25 18:29:43	                main:574]	:	INFO	:	Epoch 1891 | loss: 0.031157 | val_loss: 0.0311679 | Time: 21137.9 ms
[2021-11-25 18:30:05	                main:574]	:	INFO	:	Epoch 1892 | loss: 0.0311568 | val_loss: 0.0311654 | Time: 20883.8 ms
[2021-11-25 18:30:25	                main:574]	:	INFO	:	Epoch 1893 | loss: 0.0311533 | val_loss: 0.0311658 | Time: 20722.4 ms
[2021-11-25 18:30:47	                main:574]	:	INFO	:	Epoch 1894 | loss: 0.0311505 | val_loss: 0.0311665 | Time: 21268.5 ms
[2021-11-25 18:31:07	                main:574]	:	INFO	:	Epoch 1895 | loss: 0.0311469 | val_loss: 0.0311644 | Time: 20334.5 ms
[2021-11-25 18:31:53	                main:574]	:	INFO	:	Epoch 1896 | loss: 0.0311465 | val_loss: 0.0311677 | Time: 46033.5 ms
[2021-11-25 18:32:14	                main:574]	:	INFO	:	Epoch 1897 | loss: 0.0311438 | val_loss: 0.031171 | Time: 21164.6 ms
[2021-11-25 18:32:34	                main:574]	:	INFO	:	Epoch 1898 | loss: 0.0311423 | val_loss: 0.0311692 | Time: 20039.5 ms
[2021-11-25 18:32:55	                main:574]	:	INFO	:	Epoch 1899 | loss: 0.0311432 | val_loss: 0.0311684 | Time: 20246.7 ms
[2021-11-25 18:33:16	                main:574]	:	INFO	:	Epoch 1900 | loss: 0.0311478 | val_loss: 0.0311694 | Time: 21150.1 ms
[2021-11-25 18:33:36	                main:574]	:	INFO	:	Epoch 1901 | loss: 0.0311458 | val_loss: 0.0311715 | Time: 20227.6 ms
[2021-11-25 18:33:57	                main:574]	:	INFO	:	Epoch 1902 | loss: 0.0311415 | val_loss: 0.0311678 | Time: 21184.2 ms
[2021-11-25 18:34:18	                main:574]	:	INFO	:	Epoch 1903 | loss: 0.031146 | val_loss: 0.0311695 | Time: 20928.7 ms
[2021-11-25 18:34:39	                main:574]	:	INFO	:	Epoch 1904 | loss: 0.0311467 | val_loss: 0.0311686 | Time: 20797.2 ms
[2021-11-25 18:35:00	                main:574]	:	INFO	:	Epoch 1905 | loss: 0.0311427 | val_loss: 0.0311695 | Time: 21044.9 ms
[2021-11-25 18:35:21	                main:574]	:	INFO	:	Epoch 1906 | loss: 0.0311418 | val_loss: 0.0311696 | Time: 21052.2 ms
[2021-11-25 18:35:42	                main:574]	:	INFO	:	Epoch 1907 | loss: 0.0311414 | val_loss: 0.0311673 | Time: 20736.6 ms
[2021-11-25 18:36:03	                main:574]	:	INFO	:	Epoch 1908 | loss: 0.0311438 | val_loss: 0.0311661 | Time: 20726.5 ms
[2021-11-25 18:36:24	                main:574]	:	INFO	:	Epoch 1909 | loss: 0.0311407 | val_loss: 0.0311683 | Time: 21290.1 ms
[2021-11-25 18:37:46	                main:574]	:	INFO	:	Epoch 1910 | loss: 0.0311472 | val_loss: 0.0311657 | Time: 81748.7 ms
[2021-11-25 18:38:07	                main:574]	:	INFO	:	Epoch 1911 | loss: 0.0311438 | val_loss: 0.031168 | Time: 20964.9 ms
[2021-11-25 18:38:28	                main:574]	:	INFO	:	Epoch 1912 | loss: 0.0311435 | val_loss: 0.0311757 | Time: 21115.6 ms
[2021-11-25 18:38:50	                main:574]	:	INFO	:	Epoch 1913 | loss: 0.0311427 | val_loss: 0.0311671 | Time: 21138.3 ms
[2021-11-25 18:39:11	                main:574]	:	INFO	:	Epoch 1914 | loss: 0.0311396 | val_loss: 0.0311681 | Time: 20897.9 ms
[2021-11-25 18:39:32	                main:574]	:	INFO	:	Epoch 1915 | loss: 0.0311411 | val_loss: 0.031165 | Time: 21734.1 ms
[2021-11-25 18:40:35	                main:574]	:	INFO	:	Epoch 1916 | loss: 0.0311376 | val_loss: 0.0311707 | Time: 62555.7 ms
[2021-11-25 18:40:57	                main:574]	:	INFO	:	Epoch 1917 | loss: 0.0311361 | val_loss: 0.0311738 | Time: 21706 ms
[2021-11-25 18:41:17	                main:574]	:	INFO	:	Epoch 1918 | loss: 0.0311409 | val_loss: 0.0311689 | Time: 20364.6 ms
[2021-11-25 18:42:20	                main:574]	:	INFO	:	Epoch 1919 | loss: 0.0311402 | val_loss: 0.0311727 | Time: 52087.3 ms
[2021-11-25 18:42:40	                main:574]	:	INFO	:	Epoch 1920 | loss: 0.0311392 | val_loss: 0.0311704 | Time: 20643 ms
[2021-11-25 18:43:01	                main:574]	:	INFO	:	Epoch 1921 | loss: 0.0311396 | val_loss: 0.0311696 | Time: 20538.3 ms
[2021-11-25 18:43:21	                main:574]	:	INFO	:	Epoch 1922 | loss: 0.0311422 | val_loss: 0.0311827 | Time: 20051.6 ms
[2021-11-25 18:43:42	                main:574]	:	INFO	:	Epoch 1923 | loss: 0.0311448 | val_loss: 0.0311718 | Time: 20987.1 ms
[2021-11-25 18:44:04	                main:574]	:	INFO	:	Epoch 1924 | loss: 0.0311384 | val_loss: 0.0311747 | Time: 21452.4 ms
[2021-11-25 18:44:26	                main:574]	:	INFO	:	Epoch 1925 | loss: 0.0311361 | val_loss: 0.0311773 | Time: 21912.3 ms
[2021-11-25 18:45:01	                main:574]	:	INFO	:	Epoch 1926 | loss: 0.031135 | val_loss: 0.0311778 | Time: 35355.6 ms
[2021-11-25 18:45:21	                main:574]	:	INFO	:	Epoch 1927 | loss: 0.0311342 | val_loss: 0.0311745 | Time: 19810.3 ms
[2021-11-25 18:45:41	                main:574]	:	INFO	:	Epoch 1928 | loss: 0.031133 | val_loss: 0.0311686 | Time: 19540.8 ms
[2021-11-25 18:46:01	                main:574]	:	INFO	:	Epoch 1929 | loss: 0.0311341 | val_loss: 0.0311707 | Time: 20224.7 ms
[2021-11-25 18:46:21	                main:574]	:	INFO	:	Epoch 1930 | loss: 0.0311367 | val_loss: 0.0311722 | Time: 20161.7 ms
[2021-11-25 18:46:31	                main:574]	:	INFO	:	Epoch 1931 | loss: 0.0311367 | val_loss: 0.0311705 | Time: 9986.36 ms
[2021-11-25 18:46:55	                main:574]	:	INFO	:	Epoch 1932 | loss: 0.0311376 | val_loss: 0.0311719 | Time: 23850 ms
[2021-11-25 18:47:27	                main:574]	:	INFO	:	Epoch 1933 | loss: 0.0311355 | val_loss: 0.0311856 | Time: 32100.1 ms
[2021-11-25 18:47:48	                main:574]	:	INFO	:	Epoch 1934 | loss: 0.0311382 | val_loss: 0.0311804 | Time: 20600.1 ms
[2021-11-25 18:48:01	                main:574]	:	INFO	:	Epoch 1935 | loss: 0.0311385 | val_loss: 0.0311771 | Time: 13173 ms
[2021-11-25 18:48:21	                main:574]	:	INFO	:	Epoch 1936 | loss: 0.0311318 | val_loss: 0.0311738 | Time: 19416.8 ms
[2021-11-25 18:48:32	                main:574]	:	INFO	:	Epoch 1937 | loss: 0.031132 | val_loss: 0.0311769 | Time: 11654.6 ms
[2021-11-25 18:48:55	                main:574]	:	INFO	:	Epoch 1938 | loss: 0.0311313 | val_loss: 0.0311757 | Time: 22297.8 ms
[2021-11-25 18:49:14	                main:574]	:	INFO	:	Epoch 1939 | loss: 0.031131 | val_loss: 0.0311751 | Time: 19581.5 ms
[2021-11-25 18:49:26	                main:574]	:	INFO	:	Epoch 1940 | loss: 0.03113 | val_loss: 0.031175 | Time: 11065.1 ms
[2021-11-25 18:49:47	                main:574]	:	INFO	:	Epoch 1941 | loss: 0.0311304 | val_loss: 0.0311791 | Time: 21773.1 ms
[2021-11-25 18:50:09	                main:574]	:	INFO	:	Epoch 1942 | loss: 0.0311313 | val_loss: 0.0311826 | Time: 21449.9 ms
[2021-11-25 18:50:30	                main:574]	:	INFO	:	Epoch 1943 | loss: 0.0311323 | val_loss: 0.0311759 | Time: 21455 ms
[2021-11-25 18:50:52	                main:574]	:	INFO	:	Epoch 1944 | loss: 0.0311318 | val_loss: 0.0311725 | Time: 21683.7 ms
[2021-11-25 18:51:13	                main:574]	:	INFO	:	Epoch 1945 | loss: 0.03113 | val_loss: 0.031176 | Time: 20430.7 ms
[2021-11-25 18:51:44	                main:574]	:	INFO	:	Epoch 1946 | loss: 0.0311316 | val_loss: 0.0311779 | Time: 31220.6 ms
[2021-11-25 18:52:37	                main:574]	:	INFO	:	Epoch 1947 | loss: 0.0311329 | val_loss: 0.0311805 | Time: 52872.5 ms
[2021-11-25 18:53:01	                main:574]	:	INFO	:	Epoch 1948 | loss: 0.0311343 | val_loss: 0.0311784 | Time: 23581.8 ms
[2021-11-25 18:53:35	                main:574]	:	INFO	:	Epoch 1949 | loss: 0.0311309 | val_loss: 0.031175 | Time: 34014.2 ms
[2021-11-25 18:53:58	                main:574]	:	INFO	:	Epoch 1950 | loss: 0.0311308 | val_loss: 0.0311802 | Time: 23223 ms
[2021-11-25 18:54:24	                main:574]	:	INFO	:	Epoch 1951 | loss: 0.031132 | val_loss: 0.0311732 | Time: 26429.4 ms
[2021-11-25 18:55:08	                main:574]	:	INFO	:	Epoch 1952 | loss: 0.0311378 | val_loss: 0.0311699 | Time: 43727.4 ms
[2021-11-25 18:55:34	                main:574]	:	INFO	:	Epoch 1953 | loss: 0.031137 | val_loss: 0.031173 | Time: 25643.5 ms
[2021-11-25 18:56:07	                main:574]	:	INFO	:	Epoch 1954 | loss: 0.0311319 | val_loss: 0.0311736 | Time: 32820.2 ms
[2021-11-25 18:56:30	                main:574]	:	INFO	:	Epoch 1955 | loss: 0.0311334 | val_loss: 0.0311829 | Time: 23378.4 ms
[2021-11-25 18:56:54	                main:574]	:	INFO	:	Epoch 1956 | loss: 0.0311312 | val_loss: 0.0311746 | Time: 24008.2 ms
[2021-11-25 18:57:52	                main:574]	:	INFO	:	Epoch 1957 | loss: 0.0311307 | val_loss: 0.0311719 | Time: 57273.4 ms
[2021-11-25 18:58:15	                main:574]	:	INFO	:	Epoch 1958 | loss: 0.0311323 | val_loss: 0.0311847 | Time: 22782.6 ms
[2021-11-25 18:58:37	                main:574]	:	INFO	:	Epoch 1959 | loss: 0.0311332 | val_loss: 0.0311733 | Time: 22381.3 ms
[2021-11-25 18:59:10	                main:574]	:	INFO	:	Epoch 1960 | loss: 0.0311331 | val_loss: 0.0311755 | Time: 32910.3 ms
[2021-11-25 18:59:33	                main:574]	:	INFO	:	Epoch 1961 | loss: 0.0311348 | val_loss: 0.0311753 | Time: 23033 ms
[2021-11-25 18:59:57	                main:574]	:	INFO	:	Epoch 1962 | loss: 0.0311315 | val_loss: 0.0311708 | Time: 23806.6 ms
[2021-11-25 19:00:30	                main:574]	:	INFO	:	Epoch 1963 | loss: 0.0311357 | val_loss: 0.0311818 | Time: 32516.2 ms
[2021-11-25 19:00:54	                main:574]	:	INFO	:	Epoch 1964 | loss: 0.0311324 | val_loss: 0.0311783 | Time: 23887.8 ms
[2021-11-25 19:01:15	                main:574]	:	INFO	:	Epoch 1965 | loss: 0.0311301 | val_loss: 0.0311747 | Time: 21480.4 ms
[2021-11-25 19:01:38	                main:574]	:	INFO	:	Epoch 1966 | loss: 0.0311338 | val_loss: 0.0311778 | Time: 23222 ms
[2021-11-25 19:02:11	                main:574]	:	INFO	:	Epoch 1967 | loss: 0.0311326 | val_loss: 0.0311717 | Time: 32771.7 ms
[2021-11-25 19:02:56	                main:574]	:	INFO	:	Epoch 1968 | loss: 0.0311285 | val_loss: 0.031179 | Time: 44343.4 ms
[2021-11-25 19:03:18	                main:574]	:	INFO	:	Epoch 1969 | loss: 0.0311254 | val_loss: 0.0311767 | Time: 22491.3 ms
[2021-11-25 19:03:52	                main:574]	:	INFO	:	Epoch 1970 | loss: 0.0311281 | val_loss: 0.0311746 | Time: 33364.4 ms
[2021-11-25 19:04:16	                main:574]	:	INFO	:	Epoch 1971 | loss: 0.0311276 | val_loss: 0.0311752 | Time: 24058.8 ms
[2021-11-25 19:04:40	                main:574]	:	INFO	:	Epoch 1972 | loss: 0.0311295 | val_loss: 0.0311797 | Time: 23988.7 ms
[2021-11-25 19:05:05	                main:574]	:	INFO	:	Epoch 1973 | loss: 0.0311296 | val_loss: 0.0311855 | Time: 25336.9 ms
[2021-11-25 19:05:28	                main:574]	:	INFO	:	Epoch 1974 | loss: 0.031132 | val_loss: 0.031172 | Time: 22521.8 ms
[2021-11-25 19:05:50	                main:574]	:	INFO	:	Epoch 1975 | loss: 0.031131 | val_loss: 0.0311865 | Time: 21653.1 ms
[2021-11-25 19:06:12	                main:574]	:	INFO	:	Epoch 1976 | loss: 0.0311319 | val_loss: 0.0311781 | Time: 22276.7 ms
[2021-11-25 19:06:46	                main:574]	:	INFO	:	Epoch 1977 | loss: 0.0311244 | val_loss: 0.0311729 | Time: 33504.1 ms
[2021-11-25 19:07:08	                main:574]	:	INFO	:	Epoch 1978 | loss: 0.0311244 | val_loss: 0.0311786 | Time: 22574 ms
[2021-11-25 19:07:32	                main:574]	:	INFO	:	Epoch 1979 | loss: 0.0311232 | val_loss: 0.0311818 | Time: 23285 ms
[2021-11-25 19:08:46	                main:574]	:	INFO	:	Epoch 1980 | loss: 0.0311267 | val_loss: 0.0311766 | Time: 74251.2 ms
[2021-11-25 19:09:09	                main:574]	:	INFO	:	Epoch 1981 | loss: 0.031125 | val_loss: 0.0311778 | Time: 22869.5 ms
[2021-11-25 19:09:47	                main:574]	:	INFO	:	Epoch 1982 | loss: 0.0311232 | val_loss: 0.0311784 | Time: 38093.1 ms
[2021-11-25 19:10:11	                main:574]	:	INFO	:	Epoch 1983 | loss: 0.0311259 | val_loss: 0.0311713 | Time: 23425.6 ms
[2021-11-25 19:10:34	                main:574]	:	INFO	:	Epoch 1984 | loss: 0.0311303 | val_loss: 0.0311816 | Time: 22603.2 ms
[2021-11-25 19:11:07	                main:574]	:	INFO	:	Epoch 1985 | loss: 0.0311299 | val_loss: 0.0311792 | Time: 33420.4 ms
[2021-11-25 19:11:30	                main:574]	:	INFO	:	Epoch 1986 | loss: 0.0311357 | val_loss: 0.0311841 | Time: 22424.1 ms
[2021-11-25 19:11:52	                main:574]	:	INFO	:	Epoch 1987 | loss: 0.0311286 | val_loss: 0.0311801 | Time: 22674.5 ms
[2021-11-25 19:12:15	                main:574]	:	INFO	:	Epoch 1988 | loss: 0.03113 | val_loss: 0.0311768 | Time: 22896.7 ms
[2021-11-25 19:13:19	                main:574]	:	INFO	:	Epoch 1989 | loss: 0.0311255 | val_loss: 0.0311728 | Time: 63100.7 ms
[2021-11-25 19:13:41	                main:574]	:	INFO	:	Epoch 1990 | loss: 0.0311245 | val_loss: 0.0311856 | Time: 21786 ms
[2021-11-25 19:14:04	                main:574]	:	INFO	:	Epoch 1991 | loss: 0.0311244 | val_loss: 0.0311778 | Time: 22997.9 ms
[2021-11-25 19:14:26	                main:574]	:	INFO	:	Epoch 1992 | loss: 0.0311207 | val_loss: 0.0311801 | Time: 22421.1 ms
[2021-11-25 19:14:47	                main:574]	:	INFO	:	Epoch 1993 | loss: 0.0311236 | val_loss: 0.0311736 | Time: 20889 ms
[2021-11-25 19:15:22	                main:574]	:	INFO	:	Epoch 1994 | loss: 0.0311271 | val_loss: 0.0311747 | Time: 35254.4 ms
[2021-11-25 19:15:43	                main:574]	:	INFO	:	Epoch 1995 | loss: 0.0311245 | val_loss: 0.0311776 | Time: 21007.1 ms
[2021-11-25 19:16:05	                main:574]	:	INFO	:	Epoch 1996 | loss: 0.031123 | val_loss: 0.0311823 | Time: 20961.5 ms
[2021-11-25 19:16:26	                main:574]	:	INFO	:	Epoch 1997 | loss: 0.0311246 | val_loss: 0.0311808 | Time: 21348.7 ms
[2021-11-25 19:16:46	                main:574]	:	INFO	:	Epoch 1998 | loss: 0.0311219 | val_loss: 0.0311856 | Time: 20215.9 ms
[2021-11-25 19:17:08	                main:574]	:	INFO	:	Epoch 1999 | loss: 0.0311238 | val_loss: 0.0311844 | Time: 21652.1 ms
[2021-11-25 19:17:29	                main:574]	:	INFO	:	Epoch 2000 | loss: 0.0311231 | val_loss: 0.0311818 | Time: 20742.2 ms
[2021-11-25 19:18:20	                main:574]	:	INFO	:	Epoch 2001 | loss: 0.0311323 | val_loss: 0.0311778 | Time: 51359.9 ms
[2021-11-25 19:18:41	                main:574]	:	INFO	:	Epoch 2002 | loss: 0.0311335 | val_loss: 0.0311889 | Time: 20925.4 ms
[2021-11-25 19:19:01	                main:574]	:	INFO	:	Epoch 2003 | loss: 0.0311355 | val_loss: 0.0311846 | Time: 20195.8 ms
[2021-11-25 19:19:22	                main:574]	:	INFO	:	Epoch 2004 | loss: 0.0311318 | val_loss: 0.0311775 | Time: 20067.4 ms
[2021-11-25 19:19:43	                main:574]	:	INFO	:	Epoch 2005 | loss: 0.0311279 | val_loss: 0.0311763 | Time: 21434.4 ms
[2021-11-25 19:20:05	                main:574]	:	INFO	:	Epoch 2006 | loss: 0.0311279 | val_loss: 0.0311733 | Time: 21563.9 ms
[2021-11-25 19:20:25	                main:574]	:	INFO	:	Epoch 2007 | loss: 0.0311267 | val_loss: 0.0311813 | Time: 20623.1 ms
[2021-11-25 19:20:47	                main:574]	:	INFO	:	Epoch 2008 | loss: 0.031122 | val_loss: 0.0311806 | Time: 21568.6 ms
[2021-11-25 19:21:07	                main:574]	:	INFO	:	Epoch 2009 | loss: 0.0311211 | val_loss: 0.0311822 | Time: 20004.4 ms
[2021-11-25 19:21:29	                main:574]	:	INFO	:	Epoch 2010 | loss: 0.0311178 | val_loss: 0.0311833 | Time: 21374.3 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 930MX)
[2021-11-25 19:24:59	                main:435]	:	INFO	:	Set logging level to 1
[2021-11-25 19:24:59	                main:441]	:	INFO	:	Running in BOINC Client mode
[2021-11-25 19:24:59	                main:444]	:	INFO	:	Resolving all filenames
[2021-11-25 19:24:59	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1)
[2021-11-25 19:24:59	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636229002-18178-0_1_r134764730_1 (exists = 1)
[2021-11-25 19:24:59	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636229002-18178-0_1_r134764730_0 (exists = 0)
[2021-11-25 19:24:59	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 0)
[2021-11-25 19:24:59	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2021-11-25 19:24:59	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5
[2021-11-25 19:24:59	                main:474]	:	INFO	:	Configuration: 
[2021-11-25 19:24:59	                main:475]	:	INFO	:	    Model type: GRU
[2021-11-25 19:24:59	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2021-11-25 19:24:59	                main:477]	:	INFO	:	    Max Epochs: 2048
[2021-11-25 19:24:59	                main:478]	:	INFO	:	    Batch Size: 128
[2021-11-25 19:24:59	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2021-11-25 19:24:59	                main:480]	:	INFO	:	    Patience: 10
[2021-11-25 19:24:59	                main:481]	:	INFO	:	    Hidden Width: 12
[2021-11-25 19:24:59	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2021-11-25 19:24:59	                main:483]	:	INFO	:	    # Backend Layers: 4
[2021-11-25 19:24:59	                main:484]	:	INFO	:	    # Threads: 1
[2021-11-25 19:24:59	                main:486]	:	INFO	:	Preparing Dataset
[2021-11-25 19:24:59	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-25 19:24:59	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-25 19:25:04	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2021-11-25 19:25:04	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-25 19:25:04	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-25 19:25:04	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2021-11-25 19:25:04	                main:494]	:	INFO	:	Creating Model
[2021-11-25 19:25:04	                main:507]	:	INFO	:	Preparing config file
[2021-11-25 19:25:04	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2021-11-25 19:25:04	                main:512]	:	INFO	:	Loading config
[2021-11-25 19:25:04	                main:514]	:	INFO	:	Loading state
[2021-11-25 19:25:06	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2021-11-25 19:25:06	                main:562]	:	INFO	:	Starting Training
[2021-11-25 19:25:13	                main:574]	:	INFO	:	Epoch 2007 | loss: 0.031311 | val_loss: 0.0312296 | Time: 7215.37 ms
[2021-11-25 19:25:20	                main:574]	:	INFO	:	Epoch 2008 | loss: 0.0311728 | val_loss: 0.0312002 | Time: 6763.81 ms
[2021-11-25 19:25:33	                main:574]	:	INFO	:	Epoch 2009 | loss: 0.0311398 | val_loss: 0.0311715 | Time: 13469 ms
[2021-11-25 19:27:06	                main:574]	:	INFO	:	Epoch 2010 | loss: 0.0311332 | val_loss: 0.0311821 | Time: 92337.5 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 930MX)
[2021-11-25 19:30:16	                main:435]	:	INFO	:	Set logging level to 1
[2021-11-25 19:30:16	                main:441]	:	INFO	:	Running in BOINC Client mode
[2021-11-25 19:30:16	                main:444]	:	INFO	:	Resolving all filenames
[2021-11-25 19:30:16	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1)
[2021-11-25 19:30:16	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636229002-18178-0_1_r134764730_1 (exists = 1)
[2021-11-25 19:30:16	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636229002-18178-0_1_r134764730_0 (exists = 0)
[2021-11-25 19:30:16	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 0)
[2021-11-25 19:30:16	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2021-11-25 19:30:16	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5
[2021-11-25 19:30:16	                main:474]	:	INFO	:	Configuration: 
[2021-11-25 19:30:17	                main:475]	:	INFO	:	    Model type: GRU
[2021-11-25 19:30:17	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2021-11-25 19:30:17	                main:477]	:	INFO	:	    Max Epochs: 2048
[2021-11-25 19:30:17	                main:478]	:	INFO	:	    Batch Size: 128
[2021-11-25 19:30:17	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2021-11-25 19:30:17	                main:480]	:	INFO	:	    Patience: 10
[2021-11-25 19:30:17	                main:481]	:	INFO	:	    Hidden Width: 12
[2021-11-25 19:30:17	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2021-11-25 19:30:17	                main:483]	:	INFO	:	    # Backend Layers: 4
[2021-11-25 19:30:17	                main:484]	:	INFO	:	    # Threads: 1
[2021-11-25 19:30:17	                main:486]	:	INFO	:	Preparing Dataset
[2021-11-25 19:30:17	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-25 19:30:17	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-25 19:30:20	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2021-11-25 19:30:20	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-25 19:30:20	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-25 19:30:20	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2021-11-25 19:30:20	                main:494]	:	INFO	:	Creating Model
[2021-11-25 19:30:20	                main:507]	:	INFO	:	Preparing config file
[2021-11-25 19:30:20	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2021-11-25 19:30:20	                main:512]	:	INFO	:	Loading config
[2021-11-25 19:30:20	                main:514]	:	INFO	:	Loading state
[2021-11-25 19:30:22	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2021-11-25 19:30:22	                main:562]	:	INFO	:	Starting Training
[2021-11-25 19:30:29	                main:574]	:	INFO	:	Epoch 2007 | loss: 0.0313776 | val_loss: 0.0312301 | Time: 6953.2 ms
[2021-11-25 19:30:35	                main:574]	:	INFO	:	Epoch 2008 | loss: 0.0311745 | val_loss: 0.0311889 | Time: 6667.51 ms
[2021-11-25 19:30:58	                main:574]	:	INFO	:	Epoch 2009 | loss: 0.0311403 | val_loss: 0.0311758 | Time: 23060.8 ms
[2021-11-25 19:31:20	                main:574]	:	INFO	:	Epoch 2010 | loss: 0.0311293 | val_loss: 0.0311767 | Time: 21583.1 ms
[2021-11-25 19:31:41	                main:574]	:	INFO	:	Epoch 2011 | loss: 0.0311253 | val_loss: 0.0311764 | Time: 20827.1 ms
[2021-11-25 19:31:52	                main:574]	:	INFO	:	Epoch 2012 | loss: 0.0311224 | val_loss: 0.0311817 | Time: 10640 ms
[2021-11-25 19:32:14	                main:574]	:	INFO	:	Epoch 2013 | loss: 0.0311247 | val_loss: 0.0311828 | Time: 22205.3 ms
[2021-11-25 19:32:27	                main:574]	:	INFO	:	Epoch 2014 | loss: 0.0311264 | val_loss: 0.0311773 | Time: 13152.5 ms
[2021-11-25 19:32:59	                main:574]	:	INFO	:	Epoch 2015 | loss: 0.0311251 | val_loss: 0.0311785 | Time: 31731.7 ms
[2021-11-25 19:33:21	                main:574]	:	INFO	:	Epoch 2016 | loss: 0.031125 | val_loss: 0.0311801 | Time: 21812.1 ms
[2021-11-25 19:34:06	                main:574]	:	INFO	:	Epoch 2017 | loss: 0.0311219 | val_loss: 0.0311844 | Time: 45619.2 ms
[2021-11-25 19:34:27	                main:574]	:	INFO	:	Epoch 2018 | loss: 0.0311225 | val_loss: 0.0311884 | Time: 20756.1 ms
[2021-11-25 19:34:48	                main:574]	:	INFO	:	Epoch 2019 | loss: 0.0311217 | val_loss: 0.0311799 | Time: 21005.6 ms
[2021-11-25 19:35:20	                main:574]	:	INFO	:	Epoch 2020 | loss: 0.0311228 | val_loss: 0.0311819 | Time: 31923.4 ms
[2021-11-25 19:36:53	                main:574]	:	INFO	:	Epoch 2021 | loss: 0.0311217 | val_loss: 0.0311819 | Time: 92325.5 ms
[2021-11-25 19:37:14	                main:574]	:	INFO	:	Epoch 2022 | loss: 0.0311256 | val_loss: 0.0311813 | Time: 21008.9 ms
[2021-11-25 19:37:35	                main:574]	:	INFO	:	Epoch 2023 | loss: 0.0311207 | val_loss: 0.0311864 | Time: 20860 ms
[2021-11-25 19:37:57	                main:574]	:	INFO	:	Epoch 2024 | loss: 0.0311224 | val_loss: 0.0311793 | Time: 21501.6 ms
[2021-11-25 19:38:18	                main:574]	:	INFO	:	Epoch 2025 | loss: 0.031119 | val_loss: 0.031181 | Time: 21634.5 ms
[2021-11-25 19:39:25	                main:574]	:	INFO	:	Epoch 2026 | loss: 0.0311216 | val_loss: 0.0311829 | Time: 67082.7 ms
[2021-11-25 19:40:49	                main:574]	:	INFO	:	Epoch 2027 | loss: 0.0311198 | val_loss: 0.0311818 | Time: 83335.7 ms
[2021-11-25 19:41:10	                main:574]	:	INFO	:	Epoch 2028 | loss: 0.031118 | val_loss: 0.0311844 | Time: 21259.3 ms
[2021-11-25 19:41:32	                main:574]	:	INFO	:	Epoch 2029 | loss: 0.0311179 | val_loss: 0.0311816 | Time: 20983.5 ms
[2021-11-25 19:41:53	                main:574]	:	INFO	:	Epoch 2030 | loss: 0.0311213 | val_loss: 0.0311893 | Time: 20695.5 ms
[2021-11-25 19:42:25	                main:574]	:	INFO	:	Epoch 2031 | loss: 0.0311228 | val_loss: 0.0311855 | Time: 31919.8 ms
[2021-11-25 19:42:45	                main:574]	:	INFO	:	Epoch 2032 | loss: 0.0311214 | val_loss: 0.0311838 | Time: 20298.1 ms
[2021-11-25 19:43:06	                main:574]	:	INFO	:	Epoch 2033 | loss: 0.0311212 | val_loss: 0.0311809 | Time: 20896.4 ms
[2021-11-25 19:43:28	                main:574]	:	INFO	:	Epoch 2034 | loss: 0.031122 | val_loss: 0.0311765 | Time: 21525.5 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 930MX)
[2021-11-25 19:47:28	                main:435]	:	INFO	:	Set logging level to 1
[2021-11-25 19:47:28	                main:441]	:	INFO	:	Running in BOINC Client mode
[2021-11-25 19:47:28	                main:444]	:	INFO	:	Resolving all filenames
[2021-11-25 19:47:28	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1)
[2021-11-25 19:47:28	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636229002-18178-0_1_r134764730_1 (exists = 1)
[2021-11-25 19:47:28	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636229002-18178-0_1_r134764730_0 (exists = 0)
[2021-11-25 19:47:28	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 0)
[2021-11-25 19:47:28	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2021-11-25 19:47:28	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5
[2021-11-25 19:47:28	                main:474]	:	INFO	:	Configuration: 
[2021-11-25 19:47:28	                main:475]	:	INFO	:	    Model type: GRU
[2021-11-25 19:47:28	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2021-11-25 19:47:28	                main:477]	:	INFO	:	    Max Epochs: 2048
[2021-11-25 19:47:28	                main:478]	:	INFO	:	    Batch Size: 128
[2021-11-25 19:47:28	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2021-11-25 19:47:28	                main:480]	:	INFO	:	    Patience: 10
[2021-11-25 19:47:28	                main:481]	:	INFO	:	    Hidden Width: 12
[2021-11-25 19:47:28	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2021-11-25 19:47:28	                main:483]	:	INFO	:	    # Backend Layers: 4
[2021-11-25 19:47:28	                main:484]	:	INFO	:	    # Threads: 1
[2021-11-25 19:47:28	                main:486]	:	INFO	:	Preparing Dataset
[2021-11-25 19:47:28	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-25 19:47:29	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-25 19:47:32	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2021-11-25 19:47:32	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-25 19:47:32	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-25 19:47:32	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2021-11-25 19:47:32	                main:494]	:	INFO	:	Creating Model
[2021-11-25 19:47:32	                main:507]	:	INFO	:	Preparing config file
[2021-11-25 19:47:32	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2021-11-25 19:47:32	                main:512]	:	INFO	:	Loading config
[2021-11-25 19:47:32	                main:514]	:	INFO	:	Loading state
[2021-11-25 19:47:34	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2021-11-25 19:47:34	                main:562]	:	INFO	:	Starting Training
[2021-11-25 19:47:41	                main:574]	:	INFO	:	Epoch 2029 | loss: 0.0313576 | val_loss: 0.0312599 | Time: 7055.1 ms
[2021-11-25 19:47:48	                main:574]	:	INFO	:	Epoch 2030 | loss: 0.0312011 | val_loss: 0.0311821 | Time: 6860.81 ms
[2021-11-25 19:48:10	                main:574]	:	INFO	:	Epoch 2031 | loss: 0.0311378 | val_loss: 0.0311725 | Time: 22792.5 ms
[2021-11-25 19:49:33	                main:574]	:	INFO	:	Epoch 2032 | loss: 0.0311305 | val_loss: 0.0311792 | Time: 82449.5 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 930MX)
[2021-11-25 19:52:45	                main:435]	:	INFO	:	Set logging level to 1
[2021-11-25 19:52:45	                main:441]	:	INFO	:	Running in BOINC Client mode
[2021-11-25 19:52:45	                main:444]	:	INFO	:	Resolving all filenames
[2021-11-25 19:52:45	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1)
[2021-11-25 19:52:45	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636229002-18178-0_1_r134764730_1 (exists = 1)
[2021-11-25 19:52:45	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1636229002-18178-0_1_r134764730_0 (exists = 0)
[2021-11-25 19:52:45	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 0)
[2021-11-25 19:52:45	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2021-11-25 19:52:45	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5
[2021-11-25 19:52:45	                main:474]	:	INFO	:	Configuration: 
[2021-11-25 19:52:45	                main:475]	:	INFO	:	    Model type: GRU
[2021-11-25 19:52:46	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2021-11-25 19:52:46	                main:477]	:	INFO	:	    Max Epochs: 2048
[2021-11-25 19:52:46	                main:478]	:	INFO	:	    Batch Size: 128
[2021-11-25 19:52:46	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2021-11-25 19:52:46	                main:480]	:	INFO	:	    Patience: 10
[2021-11-25 19:52:46	                main:481]	:	INFO	:	    Hidden Width: 12
[2021-11-25 19:52:46	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2021-11-25 19:52:46	                main:483]	:	INFO	:	    # Backend Layers: 4
[2021-11-25 19:52:46	                main:484]	:	INFO	:	    # Threads: 1
[2021-11-25 19:52:46	                main:486]	:	INFO	:	Preparing Dataset
[2021-11-25 19:52:46	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-25 19:52:46	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-25 19:52:49	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2021-11-25 19:52:49	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-25 19:52:49	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-25 19:52:50	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2021-11-25 19:52:50	                main:494]	:	INFO	:	Creating Model
[2021-11-25 19:52:50	                main:507]	:	INFO	:	Preparing config file
[2021-11-25 19:52:50	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2021-11-25 19:52:50	                main:512]	:	INFO	:	Loading config
[2021-11-25 19:52:50	                main:514]	:	INFO	:	Loading state
[2021-11-25 19:52:51	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2021-11-25 19:52:51	                main:562]	:	INFO	:	Starting Training
[2021-11-25 19:52:58	                main:574]	:	INFO	:	Epoch 2029 | loss: 0.0313871 | val_loss: 0.0312794 | Time: 7069.63 ms
[2021-11-25 19:53:05	                main:574]	:	INFO	:	Epoch 2030 | loss: 0.0312209 | val_loss: 0.0311903 | Time: 7055.85 ms
[2021-11-25 19:53:27	                main:574]	:	INFO	:	Epoch 2031 | loss: 0.0311475 | val_loss: 0.0311698 | Time: 21539.8 ms
[2021-11-25 19:53:50	                main:574]	:	INFO	:	Epoch 2032 | loss: 0.0311374 | val_loss: 0.0311709 | Time: 22978 ms
[2021-11-25 19:54:36	                main:574]	:	INFO	:	Epoch 2033 | loss: 0.0311294 | val_loss: 0.0311749 | Time: 46048.2 ms
[2021-11-25 19:55:01	                main:574]	:	INFO	:	Epoch 2034 | loss: 0.0311257 | val_loss: 0.0311757 | Time: 24815.7 ms
[2021-11-25 19:55:57	                main:574]	:	INFO	:	Epoch 2035 | loss: 0.0311242 | val_loss: 0.0311759 | Time: 55914.4 ms
[2021-11-25 19:56:18	                main:574]	:	INFO	:	Epoch 2036 | loss: 0.0311226 | val_loss: 0.0311821 | Time: 20777.9 ms
[2021-11-25 19:56:39	                main:574]	:	INFO	:	Epoch 2037 | loss: 0.0311191 | val_loss: 0.0311786 | Time: 20798 ms
[2021-11-25 19:56:59	                main:574]	:	INFO	:	Epoch 2038 | loss: 0.0311174 | val_loss: 0.0311856 | Time: 20317.4 ms
[2021-11-25 19:57:20	                main:574]	:	INFO	:	Epoch 2039 | loss: 0.0311189 | val_loss: 0.0311811 | Time: 20771.1 ms
[2021-11-25 19:57:40	                main:574]	:	INFO	:	Epoch 2040 | loss: 0.031122 | val_loss: 0.0311827 | Time: 19801.7 ms
[2021-11-25 19:58:02	                main:574]	:	INFO	:	Epoch 2041 | loss: 0.0311201 | val_loss: 0.0311821 | Time: 22713 ms
[2021-11-25 19:58:24	                main:574]	:	INFO	:	Epoch 2042 | loss: 0.0311209 | val_loss: 0.031185 | Time: 21141.6 ms
[2021-11-25 19:58:47	                main:574]	:	INFO	:	Epoch 2043 | loss: 0.0311171 | val_loss: 0.0311839 | Time: 23414.1 ms
[2021-11-25 19:59:07	                main:574]	:	INFO	:	Epoch 2044 | loss: 0.0311184 | val_loss: 0.0311886 | Time: 19747.3 ms
[2021-11-25 19:59:50	                main:574]	:	INFO	:	Epoch 2045 | loss: 0.0311143 | val_loss: 0.0311948 | Time: 43089.3 ms
[2021-11-25 20:00:00	                main:574]	:	INFO	:	Epoch 2046 | loss: 0.0311169 | val_loss: 0.031183 | Time: 9522.37 ms
[2021-11-25 20:00:21	                main:574]	:	INFO	:	Epoch 2047 | loss: 0.0311173 | val_loss: 0.0311881 | Time: 20784.3 ms
[2021-11-25 20:00:41	                main:574]	:	INFO	:	Epoch 2048 | loss: 0.0311165 | val_loss: 0.0311939 | Time: 20063.7 ms
[2021-11-25 20:00:41	                main:597]	:	INFO	:	Saving trained model to model-final.pt, val_loss 0.0311939
[2021-11-25 20:00:41	                main:603]	:	INFO	:	Saving end state to config to file
[2021-11-25 20:00:41	                main:608]	:	INFO	:	Success, exiting..
20:00:41 (24820): called boinc_finish(0)

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)