Task 10249099

Name ParityModified-1639952802-14546-1-0_0
Workunit 7608781
Created 28 Dec 2021, 17:46:56 UTC
Sent 14 Jan 2022, 16:23:02 UTC
Report deadline 22 Jan 2022, 16:23:02 UTC
Received 18 Sep 2022, 8:13:20 UTC
Server state Over
Outcome Computation error
Client state Aborted by user
Exit status 203 (0x000000CB) EXIT_ABORTED_VIA_GUI
Computer ID 17391
Run time 13 min 57 sec
CPU time 13 min 53 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 15,672.22 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.65 GB
Peak swap size 3.15 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.20.2</core_client_version>
<![CDATA[
<message>
aborted by user</message>
<stderr_txt>
hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080)
[2022-01-15 14:05:51	                main:435]	:	INFO	:	Set logging level to 1
[2022-01-15 14:05:51	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-01-15 14:05:51	                main:444]	:	INFO	:	Resolving all filenames
[2022-01-15 14:05:51	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-01-15 14:05:51	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 0)
[2022-01-15 14:05:51	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-01-15 14:05:51	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-01-15 14:05:51	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2022-01-15 14:05:51	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-01-15 14:05:51	                main:474]	:	INFO	:	Configuration: 
[2022-01-15 14:05:51	                main:475]	:	INFO	:	    Model type: GRU
[2022-01-15 14:05:51	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-01-15 14:05:51	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-01-15 14:05:51	                main:478]	:	INFO	:	    Batch Size: 128
[2022-01-15 14:05:51	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-01-15 14:05:51	                main:480]	:	INFO	:	    Patience: 10
[2022-01-15 14:05:51	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-01-15 14:05:51	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-01-15 14:05:51	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-01-15 14:05:51	                main:484]	:	INFO	:	    # Threads: 1
[2022-01-15 14:05:51	                main:486]	:	INFO	:	Preparing Dataset
[2022-01-15 14:05:51	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-01-15 14:05:52	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080)
[2022-01-15 14:19:56	                main:435]	:	INFO	:	Set logging level to 1
[2022-01-15 14:19:56	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-01-15 14:19:56	                main:444]	:	INFO	:	Resolving all filenames
[2022-01-15 14:19:56	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-01-15 14:19:56	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 0)
[2022-01-15 14:19:56	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-01-15 14:19:56	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-01-15 14:19:56	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2022-01-15 14:19:56	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-01-15 14:19:56	                main:474]	:	INFO	:	Configuration: 
[2022-01-15 14:19:56	                main:475]	:	INFO	:	    Model type: GRU
[2022-01-15 14:19:56	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-01-15 14:19:56	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-01-15 14:19:56	                main:478]	:	INFO	:	    Batch Size: 128
[2022-01-15 14:19:56	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-01-15 14:19:56	                main:480]	:	INFO	:	    Patience: 10
[2022-01-15 14:19:56	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-01-15 14:19:56	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-01-15 14:19:56	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-01-15 14:19:56	                main:484]	:	INFO	:	    # Threads: 1
[2022-01-15 14:19:56	                main:486]	:	INFO	:	Preparing Dataset
[2022-01-15 14:19:56	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-01-15 14:19:56	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080)
[2022-01-15 14:23:26	                main:435]	:	INFO	:	Set logging level to 1
[2022-01-15 14:23:26	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-01-15 14:23:26	                main:444]	:	INFO	:	Resolving all filenames
[2022-01-15 14:23:26	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-01-15 14:23:26	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 0)
[2022-01-15 14:23:26	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-01-15 14:23:26	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-01-15 14:23:26	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2022-01-15 14:23:26	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-01-15 14:23:26	                main:474]	:	INFO	:	Configuration: 
[2022-01-15 14:23:26	                main:475]	:	INFO	:	    Model type: GRU
[2022-01-15 14:23:26	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-01-15 14:23:26	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-01-15 14:23:26	                main:478]	:	INFO	:	    Batch Size: 128
[2022-01-15 14:23:26	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-01-15 14:23:26	                main:480]	:	INFO	:	    Patience: 10
[2022-01-15 14:23:26	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-01-15 14:23:26	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-01-15 14:23:26	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-01-15 14:23:26	                main:484]	:	INFO	:	    # Threads: 1
[2022-01-15 14:23:26	                main:486]	:	INFO	:	Preparing Dataset
[2022-01-15 14:23:26	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-01-15 14:23:26	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080)
[2022-01-15 14:39:44	                main:435]	:	INFO	:	Set logging level to 1
[2022-01-15 14:39:44	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-01-15 14:39:44	                main:444]	:	INFO	:	Resolving all filenames
[2022-01-15 14:39:44	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-01-15 14:39:44	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 0)
[2022-01-15 14:39:44	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-01-15 14:39:44	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-01-15 14:39:44	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2022-01-15 14:39:44	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-01-15 14:39:44	                main:474]	:	INFO	:	Configuration: 
[2022-01-15 14:39:44	                main:475]	:	INFO	:	    Model type: GRU
[2022-01-15 14:39:44	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-01-15 14:39:44	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-01-15 14:39:44	                main:478]	:	INFO	:	    Batch Size: 128
[2022-01-15 14:39:44	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-01-15 14:39:44	                main:480]	:	INFO	:	    Patience: 10
[2022-01-15 14:39:44	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-01-15 14:39:44	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-01-15 14:39:44	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-01-15 14:39:44	                main:484]	:	INFO	:	    # Threads: 1
[2022-01-15 14:39:44	                main:486]	:	INFO	:	Preparing Dataset
[2022-01-15 14:39:44	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-01-15 14:39:44	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080)
[2022-01-15 15:23:20	                main:435]	:	INFO	:	Set logging level to 1
[2022-01-15 15:23:20	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-01-15 15:23:20	                main:444]	:	INFO	:	Resolving all filenames
[2022-01-15 15:23:21	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-01-15 15:23:21	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 0)
[2022-01-15 15:23:21	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-01-15 15:23:21	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-01-15 15:23:21	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2022-01-15 15:23:21	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-01-15 15:23:21	                main:474]	:	INFO	:	Configuration: 
[2022-01-15 15:23:21	                main:475]	:	INFO	:	    Model type: GRU
[2022-01-15 15:23:21	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-01-15 15:23:21	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-01-15 15:23:21	                main:478]	:	INFO	:	    Batch Size: 128
[2022-01-15 15:23:21	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-01-15 15:23:21	                main:480]	:	INFO	:	    Patience: 10
[2022-01-15 15:23:21	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-01-15 15:23:21	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-01-15 15:23:21	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-01-15 15:23:21	                main:484]	:	INFO	:	    # Threads: 1
[2022-01-15 15:23:21	                main:486]	:	INFO	:	Preparing Dataset
[2022-01-15 15:23:21	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-01-15 15:23:21	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080)
[2022-01-15 15:48:22	                main:435]	:	INFO	:	Set logging level to 1
[2022-01-15 15:48:22	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-01-15 15:48:22	                main:444]	:	INFO	:	Resolving all filenames
[2022-01-15 15:48:22	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-01-15 15:48:22	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 0)
[2022-01-15 15:48:22	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-01-15 15:48:22	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-01-15 15:48:22	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2022-01-15 15:48:22	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-01-15 15:48:22	                main:474]	:	INFO	:	Configuration: 
[2022-01-15 15:48:22	                main:475]	:	INFO	:	    Model type: GRU
[2022-01-15 15:48:22	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-01-15 15:48:22	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-01-15 15:48:22	                main:478]	:	INFO	:	    Batch Size: 128
[2022-01-15 15:48:22	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-01-15 15:48:22	                main:480]	:	INFO	:	    Patience: 10
[2022-01-15 15:48:22	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-01-15 15:48:22	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-01-15 15:48:22	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-01-15 15:48:22	                main:484]	:	INFO	:	    # Threads: 1
[2022-01-15 15:48:22	                main:486]	:	INFO	:	Preparing Dataset
[2022-01-15 15:48:22	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-01-15 15:48:22	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080)
[2022-01-15 15:58:07	                main:435]	:	INFO	:	Set logging level to 1
[2022-01-15 15:58:07	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-01-15 15:58:07	                main:444]	:	INFO	:	Resolving all filenames
[2022-01-15 15:58:07	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-01-15 15:58:07	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 0)
[2022-01-15 15:58:07	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-01-15 15:58:07	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-01-15 15:58:07	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2022-01-15 15:58:07	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-01-15 15:58:07	                main:474]	:	INFO	:	Configuration: 
[2022-01-15 15:58:07	                main:475]	:	INFO	:	    Model type: GRU
[2022-01-15 15:58:07	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-01-15 15:58:07	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-01-15 15:58:07	                main:478]	:	INFO	:	    Batch Size: 128
[2022-01-15 15:58:07	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-01-15 15:58:07	                main:480]	:	INFO	:	    Patience: 10
[2022-01-15 15:58:07	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-01-15 15:58:07	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-01-15 15:58:07	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-01-15 15:58:07	                main:484]	:	INFO	:	    # Threads: 1
[2022-01-15 15:58:07	                main:486]	:	INFO	:	Preparing Dataset
[2022-01-15 15:58:07	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-01-15 15:58:07	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080)
[2022-01-15 16:14:05	                main:435]	:	INFO	:	Set logging level to 1
[2022-01-15 16:14:05	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-01-15 16:14:05	                main:444]	:	INFO	:	Resolving all filenames
[2022-01-15 16:14:05	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-01-15 16:14:05	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 0)
[2022-01-15 16:14:05	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-01-15 16:14:05	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-01-15 16:14:05	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2022-01-15 16:14:05	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-01-15 16:14:05	                main:474]	:	INFO	:	Configuration: 
[2022-01-15 16:14:05	                main:475]	:	INFO	:	    Model type: GRU
[2022-01-15 16:14:05	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-01-15 16:14:05	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-01-15 16:14:05	                main:478]	:	INFO	:	    Batch Size: 128
[2022-01-15 16:14:05	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-01-15 16:14:05	                main:480]	:	INFO	:	    Patience: 10
[2022-01-15 16:14:05	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-01-15 16:14:05	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-01-15 16:14:05	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-01-15 16:14:05	                main:484]	:	INFO	:	    # Threads: 1
[2022-01-15 16:14:05	                main:486]	:	INFO	:	Preparing Dataset
[2022-01-15 16:14:05	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-01-15 16:14:05	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080)
[2022-01-15 17:43:23	                main:435]	:	INFO	:	Set logging level to 1
[2022-01-15 17:43:23	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-01-15 17:43:23	                main:444]	:	INFO	:	Resolving all filenames
[2022-01-15 17:43:23	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-01-15 17:43:23	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 0)
[2022-01-15 17:43:23	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-01-15 17:43:23	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-01-15 17:43:23	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2022-01-15 17:43:23	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-01-15 17:43:23	                main:474]	:	INFO	:	Configuration: 
[2022-01-15 17:43:23	                main:475]	:	INFO	:	    Model type: GRU
[2022-01-15 17:43:23	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-01-15 17:43:23	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-01-15 17:43:23	                main:478]	:	INFO	:	    Batch Size: 128
[2022-01-15 17:43:23	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-01-15 17:43:23	                main:480]	:	INFO	:	    Patience: 10
[2022-01-15 17:43:23	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-01-15 17:43:23	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-01-15 17:43:23	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-01-15 17:43:23	                main:484]	:	INFO	:	    # Threads: 1
[2022-01-15 17:43:23	                main:486]	:	INFO	:	Preparing Dataset
[2022-01-15 17:43:23	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-01-15 17:43:23	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080)
[2022-01-15 17:48:22	                main:435]	:	INFO	:	Set logging level to 1
[2022-01-15 17:48:22	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-01-15 17:48:22	                main:444]	:	INFO	:	Resolving all filenames
[2022-01-15 17:48:22	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-01-15 17:48:22	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 0)
[2022-01-15 17:48:22	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-01-15 17:48:22	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-01-15 17:48:23	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2022-01-15 17:48:23	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-01-15 17:48:23	                main:474]	:	INFO	:	Configuration: 
[2022-01-15 17:48:23	                main:475]	:	INFO	:	    Model type: GRU
[2022-01-15 17:48:23	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-01-15 17:48:23	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-01-15 17:48:23	                main:478]	:	INFO	:	    Batch Size: 128
[2022-01-15 17:48:23	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-01-15 17:48:23	                main:480]	:	INFO	:	    Patience: 10
[2022-01-15 17:48:23	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-01-15 17:48:23	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-01-15 17:48:23	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-01-15 17:48:23	                main:484]	:	INFO	:	    # Threads: 1
[2022-01-15 17:48:23	                main:486]	:	INFO	:	Preparing Dataset
[2022-01-15 17:48:23	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-01-15 17:48:23	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080)
[2022-01-15 18:07:25	                main:435]	:	INFO	:	Set logging level to 1
[2022-01-15 18:07:25	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-01-15 18:07:25	                main:444]	:	INFO	:	Resolving all filenames
[2022-01-15 18:07:25	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-01-15 18:07:25	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 0)
[2022-01-15 18:07:25	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-01-15 18:07:25	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-01-15 18:07:25	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2022-01-15 18:07:25	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-01-15 18:07:25	                main:474]	:	INFO	:	Configuration: 
[2022-01-15 18:07:25	                main:475]	:	INFO	:	    Model type: GRU
[2022-01-15 18:07:25	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-01-15 18:07:25	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-01-15 18:07:25	                main:478]	:	INFO	:	    Batch Size: 128
[2022-01-15 18:07:25	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-01-15 18:07:25	                main:480]	:	INFO	:	    Patience: 10
[2022-01-15 18:07:25	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-01-15 18:07:25	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-01-15 18:07:25	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-01-15 18:07:25	                main:484]	:	INFO	:	    # Threads: 1
[2022-01-15 18:07:25	                main:486]	:	INFO	:	Preparing Dataset
[2022-01-15 18:07:25	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-01-15 18:07:25	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080)
[2022-01-15 18:11:42	                main:435]	:	INFO	:	Set logging level to 1
[2022-01-15 18:11:42	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-01-15 18:11:42	                main:444]	:	INFO	:	Resolving all filenames
[2022-01-15 18:11:42	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-01-15 18:11:42	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 0)
[2022-01-15 18:11:42	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-01-15 18:11:42	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-01-15 18:11:42	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2022-01-15 18:11:42	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-01-15 18:11:42	                main:474]	:	INFO	:	Configuration: 
[2022-01-15 18:11:42	                main:475]	:	INFO	:	    Model type: GRU
[2022-01-15 18:11:42	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-01-15 18:11:42	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-01-15 18:11:42	                main:478]	:	INFO	:	    Batch Size: 128
[2022-01-15 18:11:42	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-01-15 18:11:42	                main:480]	:	INFO	:	    Patience: 10
[2022-01-15 18:11:42	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-01-15 18:11:42	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-01-15 18:11:42	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-01-15 18:11:42	                main:484]	:	INFO	:	    # Threads: 1
[2022-01-15 18:11:42	                main:486]	:	INFO	:	Preparing Dataset
[2022-01-15 18:11:42	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-01-15 18:11:42	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080)
[2022-01-15 18:49:48	                main:435]	:	INFO	:	Set logging level to 1
[2022-01-15 18:49:48	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-01-15 18:49:48	                main:444]	:	INFO	:	Resolving all filenames
[2022-01-15 18:49:48	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-01-15 18:49:48	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 0)
[2022-01-15 18:49:48	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080)
[2022-01-15 19:46:07	                main:435]	:	INFO	:	Set logging level to 1
[2022-01-15 19:46:07	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-01-15 19:46:07	                main:444]	:	INFO	:	Resolving all filenames
[2022-01-15 19:46:07	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-01-15 19:46:07	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 0)
[2022-01-15 19:46:07	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-01-15 19:46:07	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-01-15 19:46:07	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2022-01-15 19:46:07	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-01-15 19:46:07	                main:474]	:	INFO	:	Configuration: 
[2022-01-15 19:46:07	                main:475]	:	INFO	:	    Model type: GRU
[2022-01-15 19:46:07	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-01-15 19:46:07	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-01-15 19:46:07	                main:478]	:	INFO	:	    Batch Size: 128
[2022-01-15 19:46:07	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-01-15 19:46:07	                main:480]	:	INFO	:	    Patience: 10
[2022-01-15 19:46:07	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-01-15 19:46:07	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-01-15 19:46:07	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-01-15 19:46:07	                main:484]	:	INFO	:	    # Threads: 1
[2022-01-15 19:46:07	                main:486]	:	INFO	:	Preparing Dataset
[2022-01-15 19:46:07	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-01-15 19:46:07	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080)
[2022-01-15 20:24:17	                main:435]	:	INFO	:	Set logging level to 1
[2022-01-15 20:24:17	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-01-15 20:24:17	                main:444]	:	INFO	:	Resolving all filenames
[2022-01-15 20:24:17	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-01-15 20:24:17	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 0)
[2022-01-15 20:24:17	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-01-15 20:24:17	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-01-15 20:24:17	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2022-01-15 20:24:17	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-01-15 20:24:17	                main:474]	:	INFO	:	Configuration: 
[2022-01-15 20:24:17	                main:475]	:	INFO	:	    Model type: GRU
[2022-01-15 20:24:17	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-01-15 20:24:17	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-01-15 20:24:17	                main:478]	:	INFO	:	    Batch Size: 128
[2022-01-15 20:24:17	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-01-15 20:24:17	                main:480]	:	INFO	:	    Patience: 10
[2022-01-15 20:24:17	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-01-15 20:24:17	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-01-15 20:24:17	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-01-15 20:24:17	                main:484]	:	INFO	:	    # Threads: 1
[2022-01-15 20:24:17	                main:486]	:	INFO	:	Preparing Dataset
[2022-01-15 20:24:17	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-01-15 20:24:17	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080)
[2022-09-18 09:59:12	                main:435]	:	INFO	:	Set logging level to 1
[2022-09-18 09:59:12	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-09-18 09:59:12	                main:444]	:	INFO	:	Resolving all filenames
[2022-09-18 09:59:12	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-09-18 09:59:12	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 0)
[2022-09-18 09:59:12	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-09-18 09:59:12	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-09-18 09:59:12	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2022-09-18 09:59:12	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-09-18 09:59:12	                main:474]	:	INFO	:	Configuration: 
[2022-09-18 09:59:12	                main:475]	:	INFO	:	    Model type: GRU
[2022-09-18 09:59:12	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-09-18 09:59:12	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-09-18 09:59:12	                main:478]	:	INFO	:	    Batch Size: 128
[2022-09-18 09:59:12	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-09-18 09:59:12	                main:480]	:	INFO	:	    Patience: 10
[2022-09-18 09:59:12	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-09-18 09:59:12	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-09-18 09:59:12	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-09-18 09:59:12	                main:484]	:	INFO	:	    # Threads: 1
[2022-09-18 09:59:12	                main:486]	:	INFO	:	Preparing Dataset
[2022-09-18 09:59:12	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-09-18 09:59:13	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FF9B4F4D662

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 09/18/22 10:13:08
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\50;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 00000000aaba0000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000b70f0000 00000000001f8000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1949) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.19041.1741 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1741

ModLoad: 00000000b6230000 00000000000bd000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1889) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.19041.1741 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1741

ModLoad: 00000000b4e80000 00000000002ce000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1949) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.19041.1741 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1741

ModLoad: 00000000b1d50000 0000000000090000 C:\WINDOWS\SYSTEM32\apphelp.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : apphelp.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000b62f0000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.19041.1889 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1889

ModLoad: 00000000b4af0000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.2006) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.19041.2006 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.2006

ModLoad: 00000000b5150000 000000000002a000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1620) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.19041.1620 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1620

ModLoad: 00000000b4d70000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.2006) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.19041.2006 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.2006

ModLoad: 00000000b49a0000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 00000000b4810000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 00000000b6ed0000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1682) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000b6d40000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.19041.546

ModLoad: 00000000b5470000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.1865) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000b5340000 0000000000125000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1806) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000964f0000 0000000000058000 C:\ProgramData\BOINC\slots\50\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000095100000 000000000008e000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.32.31332.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a\_work\1\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.32.31332.0
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.32.31332.0

ModLoad: 00000000b2e50000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.867

ModLoad: 0000000095190000 000000000001b000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.32.31332.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a\_work\1\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.32.31332.0
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.32.31332.0

ModLoad: 0000000098d90000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.32.31332.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a\_work\1\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.32.31332.0
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.32.31332.0

ModLoad: 00000000e93f0000 0000000024b49000 C:\ProgramData\BOINC\slots\50\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000a52d0000 0000000000045000 C:\ProgramData\BOINC\slots\50\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000e5f30000 00000000034b2000 C:\ProgramData\BOINC\slots\50\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000e2e80000 00000000030a5000 C:\ProgramData\BOINC\slots\50\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 00000000abe80000 0000000000010000 C:\ProgramData\BOINC\slots\50\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 00000000c7ad0000 000000001b3a4000 C:\ProgramData\BOINC\slots\50\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 00000000be930000 000000000919f000 C:\ProgramData\BOINC\slots\50\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000babd0000 0000000003d5b000 C:\ProgramData\BOINC\slots\50\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 0000000095870000 000000000020d000 C:\ProgramData\BOINC\slots\50\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 000000000e610000 0000000001eca000 C:\ProgramData\BOINC\slots\50\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 000000007cf40000 000000000abe7000 C:\ProgramData\BOINC\slots\50\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000004f2d0000 00000000002db000 C:\ProgramData\BOINC\slots\50\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000aa450000 0000000000040000 C:\ProgramData\BOINC\slots\50\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000b5c90000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000b3070000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000b6490000 000000000046f000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1741) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.19041.1889 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1889

ModLoad: 00000000b4c80000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1620) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.19041.1620 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1620

ModLoad: 00000000b4d40000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000b45c0000 000000000002c000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1620) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.19041.1620 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1620

ModLoad: 00000000b4cd0000 0000000000069000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1949) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.19041.1949 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1949

ModLoad: 00000000b4b20000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1889) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.19041.1889 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1889

ModLoad: 00000000b4400000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000b5520000 0000000000743000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1949) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.19041.1889 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1889

ModLoad: 00000000b25f0000 0000000000795000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1949) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.19041.1889 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1889

ModLoad: 00000000b5ed0000 0000000000354000 C:\WINDOWS\System32\combase.dll (6.2.19041.1949) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.19041.1320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1320

ModLoad: 00000000b4190000 0000000000030000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.1949) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000b5180000 00000000000ad000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1865) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.19041.1889 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1889

ModLoad: 00000000b5cc0000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1706) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.19041.1889 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1889

ModLoad: 0000000093220000 00000000002ed000 C:\WINDOWS\system32\nvcuda.dll (31.0.15.1694) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r515\r516_87\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 31.0.15.1694
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.7.101 driver
    Product Version       : 31.0.15.1694

ModLoad: 0000000091ae0000 0000000001515000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_47917a79b8c7fd22\nvcuda64.dll (31.0.15.1694) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r515\r516_87\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 31.0.15.1694
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.7.101 driver
    Product Version       : 31.0.15.1694

ModLoad: 00000000a9420000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000a93e0000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.19041.906 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.906

ModLoad: 00000000a9290000 0000000000148000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.19041.1949) (-exported- Symbols Loaded)
    Linked PDB Filename   : drvstore.pdb
    File Version          : 10.0.19041.1949 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1949

ModLoad: 00000000b4100000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000a3e20000 0000000000748000 C:\WINDOWS\SYSTEM32\nvapi64.dll (31.0.15.1694) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r515\r516_87\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 31.0.15.1694
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 31.0.15.1694

ModLoad: 000000007c670000 00000000008c3000 C:\WINDOWS\System32\DriverStore\FileRepository\nv_dispi.inf_amd64_47917a79b8c7fd22\nvptxJitCompiler64.dll (31.0.15.1694) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 31.0.15.1694
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows PTX JIT Compiler
    Product Version       : 31.0.15.1694

ModLoad: 00000000b4910000 0000000000082000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.19041.1415 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1415



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3436, Write: 1984, Other 8594

- I/O Transfers Counters -
Read: 8848665, Write: 1177334238, Other 34446

- Paged Pool Usage -
QuotaPagedPoolUsage: 3448312, QuotaPeakPagedPoolUsage: 3549464
QuotaNonPagedPoolUsage: 39296, QuotaPeakNonPagedPoolUsage: 53304

- Virtual Memory Usage -
VirtualSize: -1190699008, PeakVirtualSize: -175529984

- Pagefile Usage -
PagefileUsage: -1190699008, PeakPagefileUsage: -721494016

- Working Set Size -
WorkingSetSize: 1377038336, PeakWorkingSetSize: 1931657216, PageFaultCount: 15564639

*** Dump of thread ID 23388 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 126531.000000

- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FF9B4F4D662

- Registers -
rax=0000000000000000 rbx=0000000000000001 rcx=00000000aae58c40 rdx=00000000026fe770 rsi=0000000000000000 rdi=0000000000000000
r8=00000000026fe770 r9=00000000aae58c30 r10=0000000000000fff r11=0000000000000ff0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000b4f4d662 rsp=00000000026fe748 rbp=0000000000000000
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
026fe740 aabd9100 00000001 026fe770 026fe770 aae58c30 KERNELBASE!DebugBreak+0x0 
026feb80 aabd9ce4 4b000000 026feee3 00000000 00000370 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
026ffae0 aabda084 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
026ffb10 b6247034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
026ffb40 b71426a1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
026ffbc0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 2448 (state: Running): ***

- Information -
Status: Base Priority: Above Normal, Priority: Above Normal, , Kernel Time: 93906248.000000, User Time: 8250312704.000000, Wait Time: 126531.000000

- Registers -
rax=0000000000000072 rbx=00000000889018c0 rcx=0000000000000053 rdx=000000000a01b763 rsi=000000000a01b7b6 rdi=00000000000000c5
r8=000000000a01b763 r9=0000000000000000 r10=000000007c442490 r11=000000007c441b80 r12=0000000000000000 r13=0000000082bf0f20
r14=00000000000000c5 r15=00000000000000c6 rip=000000007cbff38e rsp=0000000001fd0cb0 rbp=0000000001fd0e00
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
01fd0cf0 7cbfb0b8 000000c4 0a01b7b6 000000c4 7cc46134 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0 
01fd1190 7cbea969 00000042 000000b7 01fd2a74 56bab318 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0 
01fd2c30 7c6af978 00000000 01fd2d40 7c688cc0 82bf0f20 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0 
01fd2dd0 7c688d4f 2bb80000 7cc71e20 63b81fd8 7cc0deee nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
01fd2e20 7cc0d45c 88902cc0 b71147b1 b4d5e074 00000000 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
01fd2e50 7c6832d2 0949a4d8 82bf0f20 00000000 7cc1501a nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0 
01fd31f0 7c68677e 0949a4d8 00000005 0949a4d8 00000005 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
01fd3280 7c68f870 63b81fd8 01fd3390 00000000 00000005 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
01fd3450 7c681f9d 7cc61350 00000018 7cc6138c 00000001 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
01fd44c0 91f6e1e2 00000001 00000005 01fd4510 01fd44f0 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
01fd4720 91f6e4b7 01fd47c0 780be678 00000056 7ffef000 nvcuda64!cuProfilerStop+0x0 
01fd48f0 91c70bb4 01fd4b70 00000000 01fd4b70 01fd4b70 nvcuda64!cuProfilerStop+0x0 
01fd49b0 91c7102e 01fd4b70 00000000 2d94c090 013825dd nvcuda64!+0x0 
01fd4a70 91c712e5 01fd4d00 01fd4d01 01fd4b70 01fd4d01 nvcuda64!+0x0 
01fd4b30 91c9353a 00000000 00000000 00000000 00000001 nvcuda64!+0x0 
01fd4c30 91b89321 2d951ef0 0df24948 00000990 01fd4e10 nvcuda64!+0x0 
01fd4ca0 91b89472 0df24948 7c43f8d0 2d951ef0 4d00024f nvcuda64!+0x0 
01fd4dc0 91b89fd1 2d951ef0 01fd4f40 00000000 0df24948 nvcuda64!+0x0 
01fd4ea0 e93f8333 00000000 00000000 0df24948 0faa02f0 nvcuda64!+0x0 
01fd4f20 e93ffd19 2ea01140 2ea055d0 00000000 e93ffd00 torch_cuda!+0x0 
01fd4f50 e93f722b 2ea055d0 2ea05988 2e710101 2e88a8e0 torch_cuda!+0x0 
01fd4f90 e93fa2d9 2e9df3e8 2e9df3e8 00000000 2e9df3d8 torch_cuda!+0x0 
01fd5010 e93f9ef1 00000001 00000001 00000001 2e9f48c0 torch_cuda!+0x0 
01fd5050 e94003d3 00000000 2e710860 00000000 01fd5030 torch_cuda!+0x0 
01fd5080 e93f23c4 00000000 2d6b4180 3b1f0000 00000001 torch_cuda!+0x0 
01fd50d0 e93f2381 2e710860 01fd51e1 00000001 36902040 torch_cuda!+0x0 
01fd5110 e93f5ab0 01fd5280 00000000 04800000 b4eda70b torch_cuda!+0x0 
01fd5230 eb55471e 00000001 00000001 01fd5880 00000001 torch_cuda!+0x0 
01fd5440 8264f058 6d5f0822 01fd7510 878616c0 01fd5880 torch_cuda!at::cuda::CUDAEvent::block+0x0 
01fd5640 826522d2 01fd5880 01fd5778 01fd64b0 01fd64b0 torch_cpu!at::native::conv_tbc_backward+0x0 
01fd5ba0 82651eff 00000000 01fd64b0 14000000 8252bfac torch_cpu!at::native::copy_+0x0 
01fd5c00 82ae4a0d 87860101 87860640 ffffffff 82510231 torch_cpu!at::native::copy_+0x0 
01fd5e20 844115e6 10000000 00000000 85a2ac10 00000000 torch_cpu!at::Tensor::copy_+0x0 
01fd6260 82ae4a0d 87860640 b711b3c7 01fd62e8 87860640 torch_cpu!torch::autograd::VariableType::allCUDATypes+0x0 
01fd6480 827aa38f 01fd6640 9650a8c0 2cf039f0 01fd64b0 torch_cpu!at::Tensor::copy_+0x0 
01fd6530 827a9c19 01fd6ad8 01fd7510 01fd6840 01fd6ad8 torch_cpu!at::native::to_dense_backward+0x0 
01fd6740 82ace363 dc0b2110 00000000 00000002 00000002 torch_cpu!at::native::to+0x0 
01fd6780 83d36573 01fd0000 2d6bce00 01fd67c0 0000657a torch_cpu!at::zeros_out+0x0 
01fd67c0 829102f2 01fd0000 857824d6 6d5f3d22 01fd7510 torch_cpu!torch::autograd::GraphRoot::apply+0x0 
01fd6800 82b01222 01fd0000 00000000 01fd6888 01fd6910 torch_cpu!at::native::mkldnn_sigmoid_+0x0 
01fd6a40 aabbcd74 01fd74a0 01fd74a0 01fd74a0 00000000 torch_cpu!at::Tensor::to+0x0 
01fd6c50 aabbaf96 01fd7530 01fd6dd0 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
01fef9f0 aadfc6f8 2d4e3ef0 00000000 00000000 2cde8980 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
01fefa30 b6247034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
01fefa60 b71426a1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
01fefae0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 3060 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 126526.000000

- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=00000000027ffa40 rsi=0000000000000000 rdi=000000000000000d
r8=00000000027ff6e8 r9=000000002d6403d0 r10=0000000000000000 r11=00000000027ff9b0 r12=0000000000000064 r13=00000000027ffa40
r14=00000000027ff740 r15=0000000000000000 rip=00000000b718db54 rsp=00000000027ff6e8 rbp=000000002d6403d0
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
027ff6e0 b4eccbc0 00000000 02000000 b725c4d0 02000000 ntdll!ZwWaitForMultipleObjects+0x0 
027ff9d0 b4eccabe 2b9c53a0 004e0049 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
027ffa10 91cc4754 2d63cfb0 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
027ffc50 91d6f2dd 00000000 2d6403d0 00000000 00000000 nvcuda64!+0x0 
027ffd00 91cc4123 9a830c71 b36a44e2 2dc4dc50 00000000 nvcuda64!cuProfilerStop+0x0 
027ffd30 92000374 2dc4dc50 00000000 00000000 00000000 nvcuda64!+0x0 
027ffd60 b6247034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
027ffd90 b71426a1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
027ffe10 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 15960 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 73077.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002c8 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002c8
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=000000002d6d7200 r13=0000000000000000
r14=00000000000002c8 r15=0000000000000000 rip=00000000b718d084 rsp=00000000028ff938 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
028ff930 b4ea1ace 00000000 00001f80 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0 
028ff9d0 91eee19e 2dc4d8c0 00000000 00000000 000002c8 KERNELBASE!WaitForSingleObjectEx+0x0 
028ffc10 91cc4123 00000000 2dc4d8c0 91ae0000 2d6f12e0 nvcuda64!cuProfilerStop+0x0 
028ffc40 92000374 2dc4d8c0 00000000 00000000 00000000 nvcuda64!+0x0 
028ffc70 b6247034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
028ffca0 b71426a1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
028ffd20 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)