Task 11662369

Name ParityModified-1639957747-26476-3-0_0
Workunit 8877836
Created 17 Feb 2022, 11:56:31 UTC
Sent 26 Feb 2022, 16:48:20 UTC
Report deadline 6 Mar 2022, 16:48:20 UTC
Received 3 Mar 2022, 8:51:14 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 197 (0x000000C5) EXIT_TIME_LIMIT_EXCEEDED
Computer ID 13205
Run time 4 hours 32 min 42 sec
CPU time 4 hours 31 min 7 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 17,053.64 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 2.84 GB
Peak swap size 4.86 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
exceeded elapsed time limit 16361.60 (4000000.00G/244.47G)</message>
<stderr_txt>
in:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-03-02 19:47:53	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-03-02 19:47:53	                main:478]	:	INFO	:	    Batch Size: 128
[2022-03-02 19:47:53	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-03-02 19:47:53	                main:480]	:	INFO	:	    Patience: 10
[2022-03-02 19:47:53	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-03-02 19:47:53	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-03-02 19:47:53	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-03-02 19:47:53	                main:484]	:	INFO	:	    # Threads: 1
[2022-03-02 19:47:53	                main:486]	:	INFO	:	Preparing Dataset
[2022-03-02 19:47:53	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-02 19:47:53	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080 Ti)
[2022-03-02 19:55:52	                main:435]	:	INFO	:	Set logging level to 1
[2022-03-02 19:55:52	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-03-02 19:55:52	                main:444]	:	INFO	:	Resolving all filenames
[2022-03-02 19:55:52	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-02 19:55:52	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-02 19:55:52	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-02 19:55:52	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-02 19:55:52	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-02 19:55:52	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-03-02 19:55:52	                main:474]	:	INFO	:	Configuration: 
[2022-03-02 19:55:52	                main:475]	:	INFO	:	    Model type: GRU
[2022-03-02 19:55:52	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-03-02 19:55:52	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-03-02 19:55:52	                main:478]	:	INFO	:	    Batch Size: 128
[2022-03-02 19:55:52	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-03-02 19:55:52	                main:480]	:	INFO	:	    Patience: 10
[2022-03-02 19:55:52	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-03-02 19:55:52	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-03-02 19:55:52	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-03-02 19:55:52	                main:484]	:	INFO	:	    # Threads: 1
[2022-03-02 19:55:52	                main:486]	:	INFO	:	Preparing Dataset
[2022-03-02 19:55:52	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-02 19:55:52	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080 Ti)
[2022-03-02 20:07:04	                main:435]	:	INFO	:	Set logging level to 1
[2022-03-02 20:07:04	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-03-02 20:07:04	                main:444]	:	INFO	:	Resolving all filenames
[2022-03-02 20:07:04	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-02 20:07:04	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-02 20:07:04	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-02 20:07:04	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-02 20:07:04	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-02 20:07:04	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-03-02 20:07:04	                main:474]	:	INFO	:	Configuration: 
[2022-03-02 20:07:04	                main:475]	:	INFO	:	    Model type: GRU
[2022-03-02 20:07:04	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-03-02 20:07:04	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-03-02 20:07:04	                main:478]	:	INFO	:	    Batch Size: 128
[2022-03-02 20:07:04	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-03-02 20:07:04	                main:480]	:	INFO	:	    Patience: 10
[2022-03-02 20:07:04	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-03-02 20:07:04	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-03-02 20:07:04	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-03-02 20:07:04	                main:484]	:	INFO	:	    # Threads: 1
[2022-03-02 20:07:04	                main:486]	:	INFO	:	Preparing Dataset
[2022-03-02 20:07:04	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-02 20:07:05	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080 Ti)
[2022-03-02 23:29:17	                main:435]	:	INFO	:	Set logging level to 1
[2022-03-02 23:29:17	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-03-02 23:29:17	                main:444]	:	INFO	:	Resolving all filenames
[2022-03-02 23:29:17	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-02 23:29:17	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-02 23:29:17	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-02 23:29:17	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-02 23:29:17	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-02 23:29:17	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-03-02 23:29:17	                main:474]	:	INFO	:	Configuration: 
[2022-03-02 23:29:17	                main:475]	:	INFO	:	    Model type: GRU
[2022-03-02 23:29:17	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-03-02 23:29:17	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-03-02 23:29:17	                main:478]	:	INFO	:	    Batch Size: 128
[2022-03-02 23:29:17	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-03-02 23:29:17	                main:480]	:	INFO	:	    Patience: 10
[2022-03-02 23:29:17	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-03-02 23:29:17	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-03-02 23:29:17	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-03-02 23:29:17	                main:484]	:	INFO	:	    # Threads: 1
[2022-03-02 23:29:17	                main:486]	:	INFO	:	Preparing Dataset
[2022-03-02 23:29:17	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-02 23:29:17	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080 Ti)
[2022-03-02 23:47:43	                main:435]	:	INFO	:	Set logging level to 1
[2022-03-02 23:47:43	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-03-02 23:47:43	                main:444]	:	INFO	:	Resolving all filenames
[2022-03-02 23:47:43	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-02 23:47:43	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-02 23:47:43	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-02 23:47:43	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-02 23:47:43	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-02 23:47:43	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-03-02 23:47:43	                main:474]	:	INFO	:	Configuration: 
[2022-03-02 23:47:43	                main:475]	:	INFO	:	    Model type: GRU
[2022-03-02 23:47:43	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-03-02 23:47:43	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-03-02 23:47:43	                main:478]	:	INFO	:	    Batch Size: 128
[2022-03-02 23:47:43	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-03-02 23:47:43	                main:480]	:	INFO	:	    Patience: 10
[2022-03-02 23:47:43	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-03-02 23:47:43	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-03-02 23:47:43	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-03-02 23:47:43	                main:484]	:	INFO	:	    # Threads: 1
[2022-03-02 23:47:43	                main:486]	:	INFO	:	Preparing Dataset
[2022-03-02 23:47:43	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-02 23:47:44	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080 Ti)
[2022-03-03 00:07:58	                main:435]	:	INFO	:	Set logging level to 1
[2022-03-03 00:07:58	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-03-03 00:07:58	                main:444]	:	INFO	:	Resolving all filenames
[2022-03-03 00:07:58	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-03 00:07:58	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-03 00:07:58	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-03 00:07:58	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-03 00:07:58	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-03 00:07:58	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-03-03 00:07:58	                main:474]	:	INFO	:	Configuration: 
[2022-03-03 00:07:58	                main:475]	:	INFO	:	    Model type: GRU
[2022-03-03 00:07:58	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-03-03 00:07:58	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-03-03 00:07:58	                main:478]	:	INFO	:	    Batch Size: 128
[2022-03-03 00:07:58	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-03-03 00:07:58	                main:480]	:	INFO	:	    Patience: 10
[2022-03-03 00:07:58	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-03-03 00:07:58	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-03-03 00:07:58	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-03-03 00:07:58	                main:484]	:	INFO	:	    # Threads: 1
[2022-03-03 00:07:58	                main:486]	:	INFO	:	Preparing Dataset
[2022-03-03 00:07:58	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-03 00:07:58	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080 Ti)
[2022-03-03 00:17:44	                main:435]	:	INFO	:	Set logging level to 1
[2022-03-03 00:17:44	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-03-03 00:17:44	                main:444]	:	INFO	:	Resolving all filenames
[2022-03-03 00:17:44	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-03 00:17:44	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-03 00:17:44	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-03 00:17:44	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-03 00:17:44	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-03 00:17:44	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-03-03 00:17:44	                main:474]	:	INFO	:	Configuration: 
[2022-03-03 00:17:44	                main:475]	:	INFO	:	    Model type: GRU
[2022-03-03 00:17:44	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-03-03 00:17:44	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-03-03 00:17:44	                main:478]	:	INFO	:	    Batch Size: 128
[2022-03-03 00:17:44	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-03-03 00:17:44	                main:480]	:	INFO	:	    Patience: 10
[2022-03-03 00:17:44	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-03-03 00:17:44	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-03-03 00:17:44	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-03-03 00:17:44	                main:484]	:	INFO	:	    # Threads: 1
[2022-03-03 00:17:44	                main:486]	:	INFO	:	Preparing Dataset
[2022-03-03 00:17:44	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-03 00:17:45	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080 Ti)
[2022-03-03 08:21:31	                main:435]	:	INFO	:	Set logging level to 1
[2022-03-03 08:21:31	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-03-03 08:21:31	                main:444]	:	INFO	:	Resolving all filenames
[2022-03-03 08:21:31	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-03 08:21:31	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-03 08:21:31	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-03 08:21:31	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-03 08:21:31	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-03 08:21:31	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-03-03 08:21:31	                main:474]	:	INFO	:	Configuration: 
[2022-03-03 08:21:31	                main:475]	:	INFO	:	    Model type: GRU
[2022-03-03 08:21:31	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-03-03 08:21:31	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-03-03 08:21:31	                main:478]	:	INFO	:	    Batch Size: 128
[2022-03-03 08:21:31	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-03-03 08:21:31	                main:480]	:	INFO	:	    Patience: 10
[2022-03-03 08:21:31	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-03-03 08:21:31	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-03-03 08:21:31	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-03-03 08:21:31	                main:484]	:	INFO	:	    # Threads: 1
[2022-03-03 08:21:31	                main:486]	:	INFO	:	Preparing Dataset
[2022-03-03 08:21:31	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-03 08:21:32	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080 Ti)
[2022-03-03 08:32:07	                main:435]	:	INFO	:	Set logging level to 1
[2022-03-03 08:32:07	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-03-03 08:32:07	                main:444]	:	INFO	:	Resolving all filenames
[2022-03-03 08:32:07	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-03 08:32:07	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-03 08:32:07	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-03 08:32:07	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-03 08:32:07	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-03 08:32:07	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-03-03 08:32:07	                main:474]	:	INFO	:	Configuration: 
[2022-03-03 08:32:07	                main:475]	:	INFO	:	    Model type: GRU
[2022-03-03 08:32:07	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-03-03 08:32:07	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-03-03 08:32:07	                main:478]	:	INFO	:	    Batch Size: 128
[2022-03-03 08:32:07	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-03-03 08:32:07	                main:480]	:	INFO	:	    Patience: 10
[2022-03-03 08:32:07	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-03-03 08:32:07	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-03-03 08:32:07	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-03-03 08:32:07	                main:484]	:	INFO	:	    # Threads: 1
[2022-03-03 08:32:07	                main:486]	:	INFO	:	Preparing Dataset
[2022-03-03 08:32:07	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-03 08:32:08	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080 Ti)
[2022-03-03 08:40:44	                main:435]	:	INFO	:	Set logging level to 1
[2022-03-03 08:40:44	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-03-03 08:40:44	                main:444]	:	INFO	:	Resolving all filenames
[2022-03-03 08:40:44	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-03 08:40:44	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-03 08:40:44	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-03 08:40:44	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-03 08:40:44	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-03 08:40:44	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-03-03 08:40:44	                main:474]	:	INFO	:	Configuration: 
[2022-03-03 08:40:44	                main:475]	:	INFO	:	    Model type: GRU
[2022-03-03 08:40:44	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-03-03 08:40:44	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-03-03 08:40:44	                main:478]	:	INFO	:	    Batch Size: 128
[2022-03-03 08:40:44	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-03-03 08:40:44	                main:480]	:	INFO	:	    Patience: 10
[2022-03-03 08:40:44	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-03-03 08:40:44	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-03-03 08:40:44	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-03-03 08:40:44	                main:484]	:	INFO	:	    # Threads: 1
[2022-03-03 08:40:44	                main:486]	:	INFO	:	Preparing Dataset
[2022-03-03 08:40:44	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-03 08:40:44	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080 Ti)
[2022-03-03 08:47:35	                main:435]	:	INFO	:	Set logging level to 1
[2022-03-03 08:47:35	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-03-03 08:47:35	                main:444]	:	INFO	:	Resolving all filenames
[2022-03-03 08:47:35	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-03 08:47:35	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-03 08:47:35	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-03 08:47:35	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-03 08:47:35	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-03 08:47:35	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-03-03 08:47:35	                main:474]	:	INFO	:	Configuration: 
[2022-03-03 08:47:35	                main:475]	:	INFO	:	    Model type: GRU
[2022-03-03 08:47:35	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-03-03 08:47:35	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-03-03 08:47:35	                main:478]	:	INFO	:	    Batch Size: 128
[2022-03-03 08:47:35	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-03-03 08:47:35	                main:480]	:	INFO	:	    Patience: 10
[2022-03-03 08:47:35	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-03-03 08:47:35	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-03-03 08:47:35	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-03-03 08:47:35	                main:484]	:	INFO	:	    # Threads: 1
[2022-03-03 08:47:35	                main:486]	:	INFO	:	Preparing Dataset
[2022-03-03 08:47:35	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-03 08:47:36	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080 Ti)
[2022-03-03 09:02:41	                main:435]	:	INFO	:	Set logging level to 1
[2022-03-03 09:02:41	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-03-03 09:02:41	                main:444]	:	INFO	:	Resolving all filenames
[2022-03-03 09:02:41	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-03 09:02:41	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-03 09:02:41	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-03 09:02:41	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-03 09:02:41	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-03 09:02:41	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-03-03 09:02:41	                main:474]	:	INFO	:	Configuration: 
[2022-03-03 09:02:41	                main:475]	:	INFO	:	    Model type: GRU
[2022-03-03 09:02:41	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-03-03 09:02:41	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-03-03 09:02:41	                main:478]	:	INFO	:	    Batch Size: 128
[2022-03-03 09:02:41	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-03-03 09:02:41	                main:480]	:	INFO	:	    Patience: 10
[2022-03-03 09:02:41	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-03-03 09:02:41	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-03-03 09:02:41	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-03-03 09:02:41	                main:484]	:	INFO	:	    # Threads: 1
[2022-03-03 09:02:41	                main:486]	:	INFO	:	Preparing Dataset
[2022-03-03 09:02:41	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-03 09:02:41	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080 Ti)
[2022-03-03 09:15:43	                main:435]	:	INFO	:	Set logging level to 1
[2022-03-03 09:15:43	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-03-03 09:15:43	                main:444]	:	INFO	:	Resolving all filenames
[2022-03-03 09:15:43	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-03 09:15:43	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-03 09:15:43	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-03 09:15:43	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-03 09:15:43	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-03 09:15:43	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-03-03 09:15:43	                main:474]	:	INFO	:	Configuration: 
[2022-03-03 09:15:43	                main:475]	:	INFO	:	    Model type: GRU
[2022-03-03 09:15:43	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-03-03 09:15:43	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-03-03 09:15:43	                main:478]	:	INFO	:	    Batch Size: 128
[2022-03-03 09:15:43	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-03-03 09:15:43	                main:480]	:	INFO	:	    Patience: 10
[2022-03-03 09:15:43	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-03-03 09:15:43	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-03-03 09:15:43	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-03-03 09:15:43	                main:484]	:	INFO	:	    # Threads: 1
[2022-03-03 09:15:43	                main:486]	:	INFO	:	Preparing Dataset
[2022-03-03 09:15:43	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-03 09:15:44	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080 Ti)
[2022-03-03 09:23:09	                main:435]	:	INFO	:	Set logging level to 1
[2022-03-03 09:23:09	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-03-03 09:23:09	                main:444]	:	INFO	:	Resolving all filenames
[2022-03-03 09:23:09	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-03 09:23:09	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-03 09:23:09	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-03 09:23:09	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-03 09:23:09	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-03 09:23:09	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-03-03 09:23:09	                main:474]	:	INFO	:	Configuration: 
[2022-03-03 09:23:09	                main:475]	:	INFO	:	    Model type: GRU
[2022-03-03 09:23:09	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-03-03 09:23:09	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-03-03 09:23:09	                main:478]	:	INFO	:	    Batch Size: 128
[2022-03-03 09:23:09	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-03-03 09:23:09	                main:480]	:	INFO	:	    Patience: 10
[2022-03-03 09:23:09	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-03-03 09:23:09	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-03-03 09:23:09	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-03-03 09:23:09	                main:484]	:	INFO	:	    # Threads: 1
[2022-03-03 09:23:09	                main:486]	:	INFO	:	Preparing Dataset
[2022-03-03 09:23:09	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-03 09:23:09	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080 Ti)
[2022-03-03 09:34:02	                main:435]	:	INFO	:	Set logging level to 1
[2022-03-03 09:34:02	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-03-03 09:34:02	                main:444]	:	INFO	:	Resolving all filenames
[2022-03-03 09:34:02	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-03 09:34:02	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-03 09:34:02	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-03 09:34:02	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-03 09:34:02	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-03 09:34:02	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-03-03 09:34:02	                main:474]	:	INFO	:	Configuration: 
[2022-03-03 09:34:02	                main:475]	:	INFO	:	    Model type: GRU
[2022-03-03 09:34:02	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-03-03 09:34:02	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-03-03 09:34:02	                main:478]	:	INFO	:	    Batch Size: 128
[2022-03-03 09:34:02	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-03-03 09:34:02	                main:480]	:	INFO	:	    Patience: 10
[2022-03-03 09:34:02	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-03-03 09:34:02	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-03-03 09:34:02	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-03-03 09:34:02	                main:484]	:	INFO	:	    # Threads: 1
[2022-03-03 09:34:02	                main:486]	:	INFO	:	Preparing Dataset
[2022-03-03 09:34:02	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-03 09:34:02	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFA172990F2

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 03/03/22 09:49:54
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
Loaded Library    : symsrv.dll
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\12;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 00000000b41a0000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000019910000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.19041.1466 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1466

ModLoad: 0000000017a30000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.19041.1503 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1503

ModLoad: 00000000171d0000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.19041.1503 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1503

ModLoad: 0000000018880000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.19041.1526 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1526

ModLoad: 0000000017720000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1526) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.19041.1526 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1526

ModLoad: 0000000017970000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202

ModLoad: 0000000017750000 000000000010d000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.19041.1466 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1466

ModLoad: 0000000003d90000 0000000000058000 C:\ProgramData\BOINC\slots\12\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000174a0000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 0000000017860000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 0000000018e60000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000019660000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.19041.546

ModLoad: 0000000017af0000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000180a0000 0000000000125000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000edae0000 0000000000092000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.28.29334.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\6\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.28.29334.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.28.29334.0

ModLoad: 0000000015530000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.867

ModLoad: 00000000edb80000 0000000000019000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.28.29334.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\6\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.28.29334.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.28.29334.0

ModLoad: 0000000090440000 000000000abe7000 C:\ProgramData\BOINC\slots\12\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000f0de0000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.28.29334.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\6\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.28.29334.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.28.29334.0

ModLoad: 0000000002ad0000 000000000020d000 C:\ProgramData\BOINC\slots\12\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 00000000a8420000 00000000002db000 C:\ProgramData\BOINC\slots\12\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000000ead0000 0000000000040000 C:\ProgramData\BOINC\slots\12\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000006b8f0000 0000000024b49000 C:\ProgramData\BOINC\slots\12\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000003ca0000 0000000000045000 C:\ProgramData\BOINC\slots\12\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000068840000 00000000030a5000 C:\ProgramData\BOINC\slots\12\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 0000000065380000 00000000034b2000 C:\ProgramData\BOINC\slots\12\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 0000000012090000 0000000000010000 C:\ProgramData\BOINC\slots\12\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 000000003d0d0000 0000000003d5b000 C:\ProgramData\BOINC\slots\12\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 0000000040e30000 000000000919f000 C:\ProgramData\BOINC\slots\12\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 000000003b200000 0000000001eca000 C:\ProgramData\BOINC\slots\12\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 0000000049fd0000 000000001b3a4000 C:\ProgramData\BOINC\slots\12\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 0000000017a00000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000158f0000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000017c20000 0000000000472000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.19041.1526 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1526

ModLoad: 0000000017180000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 0000000017680000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000016dc0000 0000000000034000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 00000000176b0000 0000000000069000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.19041.1503 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1503

ModLoad: 0000000017020000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.19041.1526 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1526

ModLoad: 0000000016c00000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000018f10000 0000000000744000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.19041.1526 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1526

ModLoad: 0000000014d90000 0000000000794000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.19041.1526 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1526

ModLoad: 0000000018a20000 0000000000355000 C:\WINDOWS\System32\combase.dll (6.2.19041.1348) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.19041.1320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1320

ModLoad: 0000000016a70000 000000000002e000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000018380000 00000000000ad000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1387) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.19041.1526 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1526

ModLoad: 0000000018d80000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.19041.1526 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1526

ModLoad: 00000000c8f40000 00000000002cd000 C:\WINDOWS\system32\nvcuda.dll (30.0.15.1165) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_37\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 30.0.15.1165
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.6.99 driver
    Product Version       : 30.0.15.1165

ModLoad: 0000000039b60000 00000000016a0000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_31a2adf8c49e7799\nvcuda64.dll (30.0.15.1165) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_37\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 30.0.15.1165
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.6.99 driver
    Product Version       : 30.0.15.1165

ModLoad: 000000000ee80000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000000ee40000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.19041.906 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.906

ModLoad: 000000000ecf0000 000000000014a000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : drvstore.pdb
    File Version          : 10.0.19041.1320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1320

ModLoad: 00000000169c0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000000d5d0000 0000000000768000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.15.1165) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_37\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 30.0.15.1165
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 30.0.15.1165

ModLoad: 00000000392a0000 00000000008b3000 C:\WINDOWS\System32\DriverStore\FileRepository\nv_dispi.inf_amd64_31a2adf8c49e7799\nvptxJitCompiler64.dll (30.0.15.1165) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 30.0.15.1165
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows PTX JIT Compiler
    Product Version       : 30.0.15.1165

ModLoad: 0000000003df0000 000000000006c000 C:\Program Files\Oculus\Support\oculus-runtime\symsrv.dll (10.0.17763.132) (-exported- Symbols Loaded)
    Linked PDB Filename   : symsrv.pdb
    File Version          : 10.0.17763.132 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.132

ModLoad: 0000000019790000 000000000006b000 C:\WINDOWS\System32\WS2_32.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : ws2_32.pdb
    File Version          : 10.0.19041.1081 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1081

ModLoad: 0000000017540000 0000000000082000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.19041.1415 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1415



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 2799, Write: 1117, Other 20259

- I/O Transfers Counters -
Read: 77696460, Write: 740308044, Other 71904

- Paged Pool Usage -
QuotaPagedPoolUsage: 3439784, QuotaPeakPagedPoolUsage: 3439784
QuotaNonPagedPoolUsage: 41136, QuotaPeakNonPagedPoolUsage: 51744

- Virtual Memory Usage -
VirtualSize: -1100075008, PeakVirtualSize: -99246080

- Pagefile Usage -
PagefileUsage: -1100075008, PeakPagefileUsage: -341123072

- Working Set Size -
WorkingSetSize: 1455755264, PeakWorkingSetSize: -2100903936, PageFaultCount: 10923918

*** Dump of thread ID 17348 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 391340.000000

- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFA172990F2

- Registers -
rax=0000000000000000 rbx=0000000000000001 rcx=00000000b4458c40 rdx=00000000a83fe720 rsi=0000000000000000 rdi=0000000000000000
r8=00000000a83fe720 r9=00000000b4458c30 r10=0000000000000fff r11=0000000000000ff0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000172990f2 rsp=00000000a83fe6f8 rbp=0000000000000000
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
a83fe6f0 b41d9100 00000001 a83fe720 a83fe720 b4458c30 KERNELBASE!DebugBreak+0x0 
a83feb30 b41d9ce4 87000000 a83fee94 00000000 00000094 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
a83ffa90 b41da084 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
a83ffac0 17a47034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
a83ffaf0 19962651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
a83ffb70 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 15188 (state: Running): ***

- Information -
Status: Base Priority: Above Normal, Priority: Above Normal, , Kernel Time: 128437504.000000, User Time: 9384375296.000000, Wait Time: 391340.000000

- Registers -
rax=0000000000000119 rbx=00000000e5a9f7a0 rcx=00000000d7c62228 rdx=00000000e5a9f7a0 rsi=0000000000000000 rdi=0000000000000000
r8=00000000e5a9f7a0 r9=0000000000000003 r10=0000000000003955 r11=0000000010000000 r12=0000000000000057 r13=000000000000010e
r14=00000000e2738300 r15=0000000000000000 rip=0000000039350815 rsp=00000000a7ee2c88 rbp=00000000d7c5c660
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
a7ee2c80 39392885 e5a9f7a0 00000000 d7c5c660 00000000 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0 
a7ee2cc0 3939980c d7c5c660 00000000 0000087b e5a9f7a0 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0 
a7ee2cf0 394f196c 00000000 00000000 0000087b 3964fde7 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0 
a7ee2dc0 394d7f7e de66ab00 0000087a e2738300 00000000 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0 
a7ee2e10 394ebfa7 d7c5c660 d7c62228 39878458 d7c5f590 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0 
a7ee2e80 39370cd2 de7337d0 d7c5c660 e2738358 a7ee3070 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0 
a7ee2f20 39370dc3 0000005b de7337d0 00000059 a7ee3070 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0 
a7ee3020 39347c99 00000000 d7c62228 d7c5c660 a7ee3250 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0 
a7ee30e0 394c7b12 a90c7060 00000007 a90c7060 f4299008 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0 
a7ee3110 392a1ff9 a90c7060 8e1c8200 392ac310 8e1c8200 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0 
a7ee3140 392a81c1 967d6fb8 00000000 a90c7060 a7ee3250 nvptxJitCompiler64!+0x0 
a7ee33a0 392a4a12 e3fbc598 a7ee3570 fe0181d8 fe0181d8 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
a7ee3730 392a6c92 e86c6178 00000005 fc929078 00000005 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
a7ee37c0 392afa60 8e1c8200 a7ee38d0 00000000 00000005 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
a7ee3990 392a282b 93929190 019a9998 a3a2a1a0 ab01a9a8 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
a7ee48e0 39fe4f5a 00000001 00000005 a7ee4940 a7ee4910 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
a7ee4b50 39fe5200 acef3600 f1aafe58 00000056 ad088aa5 nvcuda64!cuProfilerStop+0x0 
a7ee4d40 39cec961 a7ee4fc0 00000000 a7ee4fc0 00000002 nvcuda64!cuProfilerStop+0x0 
a7ee4e00 39cecd3e ad2430a0 00000000 a7ee4fc0 018b836b nvcuda64!+0x0 
a7ee4ec0 39cecff0 a7ee5140 a7ee5101 a7ee4fc0 a7ee4fa9 nvcuda64!+0x0 
a7ee4f80 39d0e892 00000000 00000001 cbe98120 0000007f nvcuda64!+0x0 
a7ee5070 39c07961 00000000 90424db0 00003b54 a7ee5220 nvcuda64!+0x0 
a7ee50e0 39c07ac7 a2826740 90424db0 00000000 167c5280 nvcuda64!+0x0 
a7ee51d0 39c08641 00000000 00000000 00000000 a7ee5261 nvcuda64!+0x0 
a7ee52b0 6b8f8333 00000000 00000000 90424db0 cbe97b28 nvcuda64!+0x0 
a7ee5330 6b8ffd19 ae1c1140 ae1c5158 00000000 6b8ffd00 torch_cuda!+0x0 
a7ee5360 6b8f722b ae1c5158 ae1c5988 ae0b0101 ae17d4a0 torch_cuda!+0x0 
a7ee53a0 6b8fa2d9 ae19f3e8 ae19f3e8 00000000 ae19f3e0 torch_cuda!+0x0 
a7ee5420 6b8f9ef1 00000001 00000001 00000001 ae1b48c0 torch_cuda!+0x0 
a7ee5460 6b9003d3 00000000 ae0b0860 00000000 a7ee5440 torch_cuda!+0x0 
a7ee5490 6b8f23c4 00000000 acf63fd0 ba950000 00000001 torch_cuda!+0x0 
a7ee54e0 6b8f2381 ae0b0860 a7ee55f1 00000001 b6119040 torch_cuda!+0x0 
a7ee5520 6b8f5ab0 a7ee55f0 1722a65b 03cdd6d8 00000000 torch_cuda!+0x0 
a7ee5640 6da5471e 00000001 00000001 a7ee5c90 00000001 torch_cuda!+0x0 
a7ee5850 95b4f058 289bea35 a7ee7920 9ad616c0 a7ee5c90 torch_cuda!at::cuda::CUDAEvent::block+0x0 
a7ee5a50 95b522d2 a7ee5c90 a7ee5b88 a7ee68c0 a7ee68c0 torch_cpu!at::native::conv_tbc_backward+0x0 
a7ee5fb0 95b51eff 00000000 a7ee68c0 14000000 95a2bfac torch_cpu!at::native::copy_+0x0 
a7ee6010 95fe4a0d 9ad60101 9ad60640 ffffffff 95a10231 torch_cpu!at::native::copy_+0x0 
a7ee6230 979115e6 10000000 00000000 98f2ac10 00000000 torch_cpu!at::Tensor::copy_+0x0 
a7ee6670 95fe4a0d 9ad60640 1993b3c7 a7ee66f8 9ad60640 torch_cpu!torch::autograd::VariableType::allCUDATypes+0x0 
a7ee6890 95caa38f a7ee6a50 03daa8c0 ad07f0b0 a7ee68c0 torch_cpu!at::Tensor::copy_+0x0 
a7ee6940 95ca9c19 a7ee6ee8 a7ee7920 a7ee6c50 a7ee6ee8 torch_cpu!at::native::to_dense_backward+0x0 
a7ee6b50 95fce363 a96427f5 00000000 00000002 00000002 torch_cpu!at::native::to+0x0 
a7ee6b90 97236573 a7ee0000 acf6dd00 a7ee6bd0 0000657a torch_cpu!at::zeros_out+0x0 
a7ee6bd0 95e102f2 a7ee0000 98c824d6 289bd735 a7ee7920 torch_cpu!torch::autograd::GraphRoot::apply+0x0 
a7ee6c10 96001222 a7ee0000 00000000 a7ee6c98 a7ee6d20 torch_cpu!at::native::mkldnn_sigmoid_+0x0 
a7ee6e50 b41bcd74 a7ee78b0 a7ee78b0 a7ee78b0 00000000 torch_cpu!at::Tensor::to+0x0 
a7ee7060 b41baf96 a7ee7940 a7ee71e0 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
a7effe00 b43fc6f8 acd7f140 00000000 00000000 acda9aa0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
a7effe40 17a47034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
a7effe70 19962651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
a7effef0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 22004 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 391334.000000

- Registers -
rax=000000000000005b rbx=0000000000000006 rcx=0000000000000006 rdx=00000000a84ff940 rsi=0000000000000000 rdi=0000000000000006
r8=0000000000000001 r9=00000000acfcc600 r10=0000000000000000 r11=00000000a84ff8b0 r12=0000000000000064 r13=00000000a84ff940
r14=00000000a84ff640 r15=0000000000000000 rip=00000000199ad8c4 rsp=00000000a84ff5e8 rbp=00000000acfcc680
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
a84ff5e0 1721cb20 00000000 a7d1a000 19a7a4d0 a7d1a000 ntdll!ZwWaitForMultipleObjects+0x0 
a84ff8d0 1721ca1e ab36f510 004e0049 00000006 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
a84ff910 39d3d554 acfcfbc0 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
a84ffb50 39de58cd 00000000 acfcc680 00000000 00000000 nvcuda64!+0x0 
a84ffc00 39d3cf23 3cf0421d 0599b5b9 ad542bd0 00000000 nvcuda64!cuProfilerStop+0x0 
a84ffc30 3a0744c4 ad542bd0 00000000 00000000 00000000 nvcuda64!+0x0 
a84ffc60 17a47034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
a84ffc90 19962651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
a84ffd10 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 9276 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 368783.000000

- Registers -
rax=00000000000001d3 rbx=00000000ab39e220 rcx=0000000000000018 rdx=00000000ab39dea0 rsi=00000000ab360b50 rdi=00000000ab39e220
r8=00000000a28181f4 r9=0000000000000000 r10=00000000a7ffe300 r11=00000000a7ffdf48 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000199b07c4 rsp=00000000a7fff608 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
a7fff600 19962dc7 00010013 ab360c01 00000001 ab39e220 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
a7fff900 17a47034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
a7fff930 19962651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
a7fff9b0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 7708 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 368783.000000

- Registers -
rax=00000000000001d3 rbx=00000000ab39e960 rcx=0000000000000018 rdx=00000000ab39e5e0 rsi=00000000ab360b50 rdi=00000000ab39e960
r8=000000009698b560 r9=000000007ffe03b0 r10=00000000a5c87460 r11=00000000a5c87480 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000199b07c4 rsp=00000000a80ff5c8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
a80ff5c0 19962dc7 ab360c68 ab360c68 ab360b50 ab360b68 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
a80ff8c0 17a47034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
a80ff8f0 19962651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
a80ff970 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)