Task 14335709

Name ParityModified-1647039958-15003-3-0_0
Workunit 11385564
Created 4 Apr 2022, 3:20:17 UTC
Sent 10 Apr 2022, 11:36:44 UTC
Report deadline 18 Apr 2022, 11:36:44 UTC
Received 12 Apr 2022, 16:30:16 UTC
Server state Over
Outcome Computation error
Client state Aborted by user
Exit status 203 (0x000000CB) EXIT_ABORTED_VIA_GUI
Computer ID 21690
Run time 2 hours 1 min 13 sec
CPU time 1 hours 0 min 57 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 11,433.61 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 2.69 GB
Peak swap size 4.44 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
aborted by user</message>
<stderr_txt>
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3070 Ti)
[2022-04-12 19:25:16	                main:435]	:	INFO	:	Set logging level to 1
[2022-04-12 19:25:16	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-04-12 19:25:17	                main:444]	:	INFO	:	Resolving all filenames
[2022-04-12 19:25:17	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-12 19:25:17	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 0)
[2022-04-12 19:25:18	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-12 19:25:18	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-12 19:25:18	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2022-04-12 19:25:18	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-04-12 19:25:19	                main:474]	:	INFO	:	Configuration: 
[2022-04-12 19:25:19	                main:475]	:	INFO	:	    Model type: GRU
[2022-04-12 19:25:19	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-04-12 19:25:19	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-04-12 19:25:19	                main:478]	:	INFO	:	    Batch Size: 128
[2022-04-12 19:25:20	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-04-12 19:25:20	                main:480]	:	INFO	:	    Patience: 10
[2022-04-12 19:25:20	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-04-12 19:25:20	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-04-12 19:25:21	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-04-12 19:25:21	                main:484]	:	INFO	:	    # Threads: 1
[2022-04-12 19:25:21	                main:486]	:	INFO	:	Preparing Dataset
[2022-04-12 19:25:21	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-12 19:25:23	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-12 20:11:17	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-04-12 20:11:17	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-12 20:11:18	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-12 20:11:18	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-04-12 20:11:18	                main:494]	:	INFO	:	Creating Model
[2022-04-12 20:11:19	                main:507]	:	INFO	:	Preparing config file
[2022-04-12 20:11:19	                main:519]	:	INFO	:	Creating new config file
[2022-04-12 20:11:19	                main:538]	:	INFO	:	This is a continuation WU, loading previous network
[2022-04-12 20:47:12	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2022-04-12 20:47:13	                main:562]	:	INFO	:	Starting Training
[2022-04-12 20:49:36	                main:574]	:	INFO	:	Epoch 1 | loss: 0.0311866 | val_loss: 0.0311818 | Time: 143547 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3070 Ti)
[2022-04-12 21:07:11	                main:435]	:	INFO	:	Set logging level to 1
[2022-04-12 21:07:11	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-04-12 21:07:12	                main:444]	:	INFO	:	Resolving all filenames
[2022-04-12 21:07:12	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-12 21:07:12	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-12 21:07:12	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-12 21:07:13	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-12 21:07:13	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-12 21:07:13	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-04-12 21:07:13	                main:474]	:	INFO	:	Configuration: 
[2022-04-12 21:07:13	                main:475]	:	INFO	:	    Model type: GRU
[2022-04-12 21:07:13	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-04-12 21:07:14	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-04-12 21:07:14	                main:478]	:	INFO	:	    Batch Size: 128
[2022-04-12 21:07:14	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-04-12 21:07:14	                main:480]	:	INFO	:	    Patience: 10
[2022-04-12 21:07:14	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-04-12 21:07:15	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-04-12 21:07:15	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-04-12 21:07:15	                main:484]	:	INFO	:	    # Threads: 1
[2022-04-12 21:07:15	                main:486]	:	INFO	:	Preparing Dataset
[2022-04-12 21:07:15	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-12 21:07:16	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3070 Ti)
[2022-04-12 21:07:52	                main:435]	:	INFO	:	Set logging level to 1
[2022-04-12 21:07:52	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-04-12 21:07:53	                main:444]	:	INFO	:	Resolving all filenames
[2022-04-12 21:07:53	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-12 21:07:53	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-12 21:07:53	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-12 21:07:53	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-12 21:07:54	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-12 21:07:54	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-04-12 21:07:54	                main:474]	:	INFO	:	Configuration: 
[2022-04-12 21:07:54	                main:475]	:	INFO	:	    Model type: GRU
[2022-04-12 21:07:54	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-04-12 21:07:55	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-04-12 21:07:55	                main:478]	:	INFO	:	    Batch Size: 128
[2022-04-12 21:07:55	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-04-12 21:07:55	                main:480]	:	INFO	:	    Patience: 10
[2022-04-12 21:07:55	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-04-12 21:07:55	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-04-12 21:07:56	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-04-12 21:07:56	                main:484]	:	INFO	:	    # Threads: 1
[2022-04-12 21:07:56	                main:486]	:	INFO	:	Preparing Dataset
[2022-04-12 21:07:56	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-12 21:07:57	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3070 Ti)
[2022-04-12 21:08:58	                main:435]	:	INFO	:	Set logging level to 1
[2022-04-12 21:08:58	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-04-12 21:08:58	                main:444]	:	INFO	:	Resolving all filenames
[2022-04-12 21:08:58	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-12 21:08:58	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-12 21:08:59	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-12 21:08:59	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-12 21:08:59	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-12 21:08:59	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-04-12 21:08:59	                main:474]	:	INFO	:	Configuration: 
[2022-04-12 21:08:59	                main:475]	:	INFO	:	    Model type: GRU
[2022-04-12 21:08:59	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-04-12 21:08:59	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-04-12 21:08:59	                main:478]	:	INFO	:	    Batch Size: 128
[2022-04-12 21:08:59	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-04-12 21:08:59	                main:480]	:	INFO	:	    Patience: 10
[2022-04-12 21:09:00	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-04-12 21:09:00	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-04-12 21:09:00	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-04-12 21:09:00	                main:484]	:	INFO	:	    # Threads: 1
[2022-04-12 21:09:00	                main:486]	:	INFO	:	Preparing Dataset
[2022-04-12 21:09:00	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-12 21:09:00	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3070 Ti)
[2022-04-12 22:41:16	                main:435]	:	INFO	:	Set logging level to 1
[2022-04-12 22:41:16	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-04-12 22:41:16	                main:444]	:	INFO	:	Resolving all filenames
[2022-04-12 22:41:16	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-12 22:41:16	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-12 22:41:17	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-12 22:41:17	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-12 22:41:17	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-12 22:41:17	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-04-12 22:41:17	                main:474]	:	INFO	:	Configuration: 
[2022-04-12 22:41:18	                main:475]	:	INFO	:	    Model type: GRU
[2022-04-12 22:41:18	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-04-12 22:41:18	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-04-12 22:41:18	                main:478]	:	INFO	:	    Batch Size: 128
[2022-04-12 22:41:18	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-04-12 22:41:19	                main:480]	:	INFO	:	    Patience: 10
[2022-04-12 22:41:19	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-04-12 22:41:19	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-04-12 22:41:19	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-04-12 22:41:19	                main:484]	:	INFO	:	    # Threads: 1
[2022-04-12 22:41:19	                main:486]	:	INFO	:	Preparing Dataset
[2022-04-12 22:41:20	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-12 22:41:20	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)