Task 14372417
| Name | ParityModified-1647042283-23171-3-0_0 |
| Workunit | 11418846 |
| Created | 5 Apr 2022, 2:51:28 UTC |
| Sent | 11 Apr 2022, 0:13:41 UTC |
| Report deadline | 19 Apr 2022, 0:13:41 UTC |
| Received | 22 Apr 2022, 22:42:19 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | -529697949 (0xE06D7363) Unknown error code |
| Computer ID | 13372 |
| Run time | 1 hours 26 min 7 sec |
| CPU time | 1 hours 25 min 11 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 10,868.72 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 2.74 GB |
| Peak swap size | 4.51 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
22-04-18 17:19:29 main:486] : INFO : Preparing Dataset
[2022-04-18 17:19:29 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-18 17:19:29 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3070)
[2022-04-18 20:42:14 main:435] : INFO : Set logging level to 1
[2022-04-18 20:42:14 main:441] : INFO : Running in BOINC Client mode
[2022-04-18 20:42:14 main:444] : INFO : Resolving all filenames
[2022-04-18 20:42:14 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-18 20:42:14 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-18 20:42:14 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-18 20:42:14 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-18 20:42:14 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-18 20:42:14 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-04-18 20:42:14 main:474] : INFO : Configuration:
[2022-04-18 20:42:14 main:475] : INFO : Model type: GRU
[2022-04-18 20:42:14 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-04-18 20:42:14 main:477] : INFO : Max Epochs: 2048
[2022-04-18 20:42:14 main:478] : INFO : Batch Size: 128
[2022-04-18 20:42:14 main:479] : INFO : Learning Rate: 0.01
[2022-04-18 20:42:14 main:480] : INFO : Patience: 10
[2022-04-18 20:42:14 main:481] : INFO : Hidden Width: 12
[2022-04-18 20:42:14 main:482] : INFO : # Recurrent Layers: 4
[2022-04-18 20:42:14 main:483] : INFO : # Backend Layers: 4
[2022-04-18 20:42:14 main:484] : INFO : # Threads: 1
[2022-04-18 20:42:14 main:486] : INFO : Preparing Dataset
[2022-04-18 20:42:14 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-18 20:42:14 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3070)
[2022-04-19 20:13:22 main:435] : INFO : Set logging level to 1
[2022-04-19 20:13:22 main:441] : INFO : Running in BOINC Client mode
[2022-04-19 20:13:22 main:444] : INFO : Resolving all filenames
[2022-04-19 20:13:22 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-19 20:13:22 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-19 20:13:22 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-19 20:13:22 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-19 20:13:22 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-19 20:13:22 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-04-19 20:13:22 main:474] : INFO : Configuration:
[2022-04-19 20:13:22 main:475] : INFO : Model type: GRU
[2022-04-19 20:13:22 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-04-19 20:13:22 main:477] : INFO : Max Epochs: 2048
[2022-04-19 20:13:22 main:478] : INFO : Batch Size: 128
[2022-04-19 20:13:22 main:479] : INFO : Learning Rate: 0.01
[2022-04-19 20:13:22 main:480] : INFO : Patience: 10
[2022-04-19 20:13:22 main:481] : INFO : Hidden Width: 12
[2022-04-19 20:13:22 main:482] : INFO : # Recurrent Layers: 4
[2022-04-19 20:13:22 main:483] : INFO : # Backend Layers: 4
[2022-04-19 20:13:22 main:484] : INFO : # Threads: 1
[2022-04-19 20:13:22 main:486] : INFO : Preparing Dataset
[2022-04-19 20:13:22 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-19 20:13:22 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3070)
[2022-04-19 20:23:40 main:435] : INFO : Set logging level to 1
[2022-04-19 20:23:40 main:441] : INFO : Running in BOINC Client mode
[2022-04-19 20:23:40 main:444] : INFO : Resolving all filenames
[2022-04-19 20:23:40 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-19 20:23:40 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-19 20:23:40 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-19 20:23:40 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-19 20:23:40 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-19 20:23:40 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-04-19 20:23:40 main:474] : INFO : Configuration:
[2022-04-19 20:23:40 main:475] : INFO : Model type: GRU
[2022-04-19 20:23:40 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-04-19 20:23:40 main:477] : INFO : Max Epochs: 2048
[2022-04-19 20:23:40 main:478] : INFO : Batch Size: 128
[2022-04-19 20:23:41 main:479] : INFO : Learning Rate: 0.01
[2022-04-19 20:23:41 main:480] : INFO : Patience: 10
[2022-04-19 20:23:41 main:481] : INFO : Hidden Width: 12
[2022-04-19 20:23:41 main:482] : INFO : # Recurrent Layers: 4
[2022-04-19 20:23:41 main:483] : INFO : # Backend Layers: 4
[2022-04-19 20:23:41 main:484] : INFO : # Threads: 1
[2022-04-19 20:23:41 main:486] : INFO : Preparing Dataset
[2022-04-19 20:23:41 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-19 20:23:41 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3070)
[2022-04-19 20:39:24 main:435] : INFO : Set logging level to 1
[2022-04-19 20:39:24 main:441] : INFO : Running in BOINC Client mode
[2022-04-19 20:39:24 main:444] : INFO : Resolving all filenames
[2022-04-19 20:39:24 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-19 20:39:24 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-19 20:39:24 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-19 20:39:24 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-19 20:39:24 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-19 20:39:24 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-04-19 20:39:24 main:474] : INFO : Configuration:
[2022-04-19 20:39:24 main:475] : INFO : Model type: GRU
[2022-04-19 20:39:24 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-04-19 20:39:24 main:477] : INFO : Max Epochs: 2048
[2022-04-19 20:39:24 main:478] : INFO : Batch Size: 128
[2022-04-19 20:39:24 main:479] : INFO : Learning Rate: 0.01
[2022-04-19 20:39:24 main:480] : INFO : Patience: 10
[2022-04-19 20:39:24 main:481] : INFO : Hidden Width: 12
[2022-04-19 20:39:24 main:482] : INFO : # Recurrent Layers: 4
[2022-04-19 20:39:24 main:483] : INFO : # Backend Layers: 4
[2022-04-19 20:39:24 main:484] : INFO : # Threads: 1
[2022-04-19 20:39:24 main:486] : INFO : Preparing Dataset
[2022-04-19 20:39:24 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-19 20:39:24 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3070)
[2022-04-19 20:48:53 main:435] : INFO : Set logging level to 1
[2022-04-19 20:48:53 main:441] : INFO : Running in BOINC Client mode
[2022-04-19 20:48:53 main:444] : INFO : Resolving all filenames
[2022-04-19 20:48:53 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-19 20:48:53 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-19 20:48:53 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-19 20:48:53 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-19 20:48:53 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-19 20:48:53 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-04-19 20:48:53 main:474] : INFO : Configuration:
[2022-04-19 20:48:53 main:475] : INFO : Model type: GRU
[2022-04-19 20:48:53 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-04-19 20:48:53 main:477] : INFO : Max Epochs: 2048
[2022-04-19 20:48:53 main:478] : INFO : Batch Size: 128
[2022-04-19 20:48:53 main:479] : INFO : Learning Rate: 0.01
[2022-04-19 20:48:53 main:480] : INFO : Patience: 10
[2022-04-19 20:48:53 main:481] : INFO : Hidden Width: 12
[2022-04-19 20:48:53 main:482] : INFO : # Recurrent Layers: 4
[2022-04-19 20:48:53 main:483] : INFO : # Backend Layers: 4
[2022-04-19 20:48:53 main:484] : INFO : # Threads: 1
[2022-04-19 20:48:53 main:486] : INFO : Preparing Dataset
[2022-04-19 20:48:53 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-19 20:48:53 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3070)
[2022-04-19 20:55:15 main:435] : INFO : Set logging level to 1
[2022-04-19 20:55:15 main:441] : INFO : Running in BOINC Client mode
[2022-04-19 20:55:15 main:444] : INFO : Resolving all filenames
[2022-04-19 20:55:15 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-19 20:55:15 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-19 20:55:15 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-19 20:55:15 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-19 20:55:15 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-19 20:55:15 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-04-19 20:55:15 main:474] : INFO : Configuration:
[2022-04-19 20:55:15 main:475] : INFO : Model type: GRU
[2022-04-19 20:55:15 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-04-19 20:55:15 main:477] : INFO : Max Epochs: 2048
[2022-04-19 20:55:15 main:478] : INFO : Batch Size: 128
[2022-04-19 20:55:15 main:479] : INFO : Learning Rate: 0.01
[2022-04-19 20:55:15 main:480] : INFO : Patience: 10
[2022-04-19 20:55:15 main:481] : INFO : Hidden Width: 12
[2022-04-19 20:55:15 main:482] : INFO : # Recurrent Layers: 4
[2022-04-19 20:55:15 main:483] : INFO : # Backend Layers: 4
[2022-04-19 20:55:15 main:484] : INFO : # Threads: 1
[2022-04-19 20:55:15 main:486] : INFO : Preparing Dataset
[2022-04-19 20:55:15 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-19 20:55:15 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3070)
[2022-04-19 20:58:37 main:435] : INFO : Set logging level to 1
[2022-04-19 20:58:37 main:441] : INFO : Running in BOINC Client mode
[2022-04-19 20:58:37 main:444] : INFO : Resolving all filenames
[2022-04-19 20:58:37 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-19 20:58:37 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-19 20:58:37 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-19 20:58:37 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-19 20:58:37 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-19 20:58:37 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-04-19 20:58:37 main:474] : INFO : Configuration:
[2022-04-19 20:58:37 main:475] : INFO : Model type: GRU
[2022-04-19 20:58:37 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-04-19 20:58:37 main:477] : INFO : Max Epochs: 2048
[2022-04-19 20:58:37 main:478] : INFO : Batch Size: 128
[2022-04-19 20:58:37 main:479] : INFO : Learning Rate: 0.01
[2022-04-19 20:58:37 main:480] : INFO : Patience: 10
[2022-04-19 20:58:37 main:481] : INFO : Hidden Width: 12
[2022-04-19 20:58:37 main:482] : INFO : # Recurrent Layers: 4
[2022-04-19 20:58:37 main:483] : INFO : # Backend Layers: 4
[2022-04-19 20:58:37 main:484] : INFO : # Threads: 1
[2022-04-19 20:58:37 main:486] : INFO : Preparing Dataset
[2022-04-19 20:58:37 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-19 20:58:37 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3070)
[2022-04-19 21:23:52 main:435] : INFO : Set logging level to 1
[2022-04-19 21:23:52 main:441] : INFO : Running in BOINC Client mode
[2022-04-19 21:23:52 main:444] : INFO : Resolving all filenames
[2022-04-19 21:23:52 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-19 21:23:52 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-19 21:23:52 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-19 21:23:52 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-19 21:23:52 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-19 21:23:52 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-04-19 21:23:52 main:474] : INFO : Configuration:
[2022-04-19 21:23:52 main:475] : INFO : Model type: GRU
[2022-04-19 21:23:52 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-04-19 21:23:52 main:477] : INFO : Max Epochs: 2048
[2022-04-19 21:23:52 main:478] : INFO : Batch Size: 128
[2022-04-19 21:23:52 main:479] : INFO : Learning Rate: 0.01
[2022-04-19 21:23:52 main:480] : INFO : Patience: 10
[2022-04-19 21:23:52 main:481] : INFO : Hidden Width: 12
[2022-04-19 21:23:52 main:482] : INFO : # Recurrent Layers: 4
[2022-04-19 21:23:52 main:483] : INFO : # Backend Layers: 4
[2022-04-19 21:23:52 main:484] : INFO : # Threads: 1
[2022-04-19 21:23:52 main:486] : INFO : Preparing Dataset
[2022-04-19 21:23:52 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-19 21:23:52 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3070)
[2022-04-19 21:36:48 main:435] : INFO : Set logging level to 1
[2022-04-19 21:36:48 main:441] : INFO : Running in BOINC Client mode
[2022-04-19 21:36:48 main:444] : INFO : Resolving all filenames
[2022-04-19 21:36:48 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-19 21:36:48 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-19 21:36:48 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-19 21:36:48 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-19 21:36:48 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-19 21:36:48 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-04-19 21:36:48 main:474] : INFO : Configuration:
[2022-04-19 21:36:48 main:475] : INFO : Model type: GRU
[2022-04-19 21:36:48 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-04-19 21:36:48 main:477] : INFO : Max Epochs: 2048
[2022-04-19 21:36:48 main:478] : INFO : Batch Size: 128
[2022-04-19 21:36:48 main:479] : INFO : Learning Rate: 0.01
[2022-04-19 21:36:48 main:480] : INFO : Patience: 10
[2022-04-19 21:36:48 main:481] : INFO : Hidden Width: 12
[2022-04-19 21:36:48 main:482] : INFO : # Recurrent Layers: 4
[2022-04-19 21:36:48 main:483] : INFO : # Backend Layers: 4
[2022-04-19 21:36:48 main:484] : INFO : # Threads: 1
[2022-04-19 21:36:48 main:486] : INFO : Preparing Dataset
[2022-04-19 21:36:48 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-19 21:36:48 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3070)
[2022-04-20 20:47:41 main:435] : INFO : Set logging level to 1
[2022-04-20 20:47:41 main:441] : INFO : Running in BOINC Client mode
[2022-04-20 20:47:41 main:444] : INFO : Resolving all filenames
[2022-04-20 20:47:41 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-20 20:47:41 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-20 20:47:41 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-20 20:47:41 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-20 20:47:41 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-20 20:47:41 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-04-20 20:47:41 main:474] : INFO : Configuration:
[2022-04-20 20:47:41 main:475] : INFO : Model type: GRU
[2022-04-20 20:47:41 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-04-20 20:47:41 main:477] : INFO : Max Epochs: 2048
[2022-04-20 20:47:41 main:478] : INFO : Batch Size: 128
[2022-04-20 20:47:41 main:479] : INFO : Learning Rate: 0.01
[2022-04-20 20:47:41 main:480] : INFO : Patience: 10
[2022-04-20 20:47:41 main:481] : INFO : Hidden Width: 12
[2022-04-20 20:47:41 main:482] : INFO : # Recurrent Layers: 4
[2022-04-20 20:47:41 main:483] : INFO : # Backend Layers: 4
[2022-04-20 20:47:41 main:484] : INFO : # Threads: 1
[2022-04-20 20:47:41 main:486] : INFO : Preparing Dataset
[2022-04-20 20:47:41 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-20 20:47:42 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3070)
[2022-04-20 20:52:02 main:435] : INFO : Set logging level to 1
[2022-04-20 20:52:02 main:441] : INFO : Running in BOINC Client mode
[2022-04-20 20:52:02 main:444] : INFO : Resolving all filenames
[2022-04-20 20:52:02 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-20 20:52:02 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-20 20:52:02 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-20 20:52:02 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-20 20:52:02 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-20 20:52:02 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-04-20 20:52:02 main:474] : INFO : Configuration:
[2022-04-20 20:52:02 main:475] : INFO : Model type: GRU
[2022-04-20 20:52:02 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-04-20 20:52:02 main:477] : INFO : Max Epochs: 2048
[2022-04-20 20:52:02 main:478] : INFO : Batch Size: 128
[2022-04-20 20:52:02 main:479] : INFO : Learning Rate: 0.01
[2022-04-20 20:52:02 main:480] : INFO : Patience: 10
[2022-04-20 20:52:02 main:481] : INFO : Hidden Width: 12
[2022-04-20 20:52:02 main:482] : INFO : # Recurrent Layers: 4
[2022-04-20 20:52:02 main:483] : INFO : # Backend Layers: 4
[2022-04-20 20:52:02 main:484] : INFO : # Threads: 1
[2022-04-20 20:52:02 main:486] : INFO : Preparing Dataset
[2022-04-20 20:52:02 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-20 20:52:03 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3070)
[2022-04-21 20:41:58 main:435] : INFO : Set logging level to 1
[2022-04-21 20:41:58 main:441] : INFO : Running in BOINC Client mode
[2022-04-21 20:41:58 main:444] : INFO : Resolving all filenames
[2022-04-21 20:41:58 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-21 20:41:58 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-21 20:41:58 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-21 20:41:58 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-21 20:41:58 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-21 20:41:58 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-04-21 20:41:58 main:474] : INFO : Configuration:
[2022-04-21 20:41:58 main:475] : INFO : Model type: GRU
[2022-04-21 20:41:58 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-04-21 20:41:58 main:477] : INFO : Max Epochs: 2048
[2022-04-21 20:41:58 main:478] : INFO : Batch Size: 128
[2022-04-21 20:41:58 main:479] : INFO : Learning Rate: 0.01
[2022-04-21 20:41:58 main:480] : INFO : Patience: 10
[2022-04-21 20:41:58 main:481] : INFO : Hidden Width: 12
[2022-04-21 20:41:58 main:482] : INFO : # Recurrent Layers: 4
[2022-04-21 20:41:58 main:483] : INFO : # Backend Layers: 4
[2022-04-21 20:41:58 main:484] : INFO : # Threads: 1
[2022-04-21 20:41:58 main:486] : INFO : Preparing Dataset
[2022-04-21 20:41:58 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-21 20:41:58 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3070)
[2022-04-21 20:50:29 main:435] : INFO : Set logging level to 1
[2022-04-21 20:50:29 main:441] : INFO : Running in BOINC Client mode
[2022-04-21 20:50:29 main:444] : INFO : Resolving all filenames
[2022-04-21 20:50:29 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-21 20:50:29 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-21 20:50:29 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-21 20:50:29 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-21 20:50:29 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-21 20:50:29 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-04-21 20:50:29 main:474] : INFO : Configuration:
[2022-04-21 20:50:29 main:475] : INFO : Model type: GRU
[2022-04-21 20:50:29 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-04-21 20:50:29 main:477] : INFO : Max Epochs: 2048
[2022-04-21 20:50:29 main:478] : INFO : Batch Size: 128
[2022-04-21 20:50:29 main:479] : INFO : Learning Rate: 0.01
[2022-04-21 20:50:29 main:480] : INFO : Patience: 10
[2022-04-21 20:50:29 main:481] : INFO : Hidden Width: 12
[2022-04-21 20:50:29 main:482] : INFO : # Recurrent Layers: 4
[2022-04-21 20:50:29 main:483] : INFO : # Backend Layers: 4
[2022-04-21 20:50:29 main:484] : INFO : # Threads: 1
[2022-04-21 20:50:29 main:486] : INFO : Preparing Dataset
[2022-04-21 20:50:29 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-21 20:50:30 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3070)
[2022-04-21 21:02:18 main:435] : INFO : Set logging level to 1
[2022-04-21 21:02:18 main:441] : INFO : Running in BOINC Client mode
[2022-04-21 21:02:18 main:444] : INFO : Resolving all filenames
[2022-04-21 21:02:18 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-21 21:02:18 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-21 21:02:18 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-21 21:02:18 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-21 21:02:18 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-21 21:02:18 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-04-21 21:02:18 main:474] : INFO : Configuration:
[2022-04-21 21:02:18 main:475] : INFO : Model type: GRU
[2022-04-21 21:02:18 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-04-21 21:02:18 main:477] : INFO : Max Epochs: 2048
[2022-04-21 21:02:18 main:478] : INFO : Batch Size: 128
[2022-04-21 21:02:18 main:479] : INFO : Learning Rate: 0.01
[2022-04-21 21:02:19 main:480] : INFO : Patience: 10
[2022-04-21 21:02:19 main:481] : INFO : Hidden Width: 12
[2022-04-21 21:02:19 main:482] : INFO : # Recurrent Layers: 4
[2022-04-21 21:02:19 main:483] : INFO : # Backend Layers: 4
[2022-04-21 21:02:19 main:484] : INFO : # Threads: 1
[2022-04-21 21:02:19 main:486] : INFO : Preparing Dataset
[2022-04-21 21:02:19 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-21 21:02:19 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3070)
[2022-04-22 17:15:58 main:435] : INFO : Set logging level to 1
[2022-04-22 17:15:58 main:441] : INFO : Running in BOINC Client mode
[2022-04-22 17:15:58 main:444] : INFO : Resolving all filenames
[2022-04-22 17:15:58 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-22 17:15:58 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-22 17:15:58 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-22 17:15:58 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-22 17:15:58 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-22 17:15:58 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-04-22 17:15:58 main:474] : INFO : Configuration:
[2022-04-22 17:15:58 main:475] : INFO : Model type: GRU
[2022-04-22 17:15:58 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-04-22 17:15:58 main:477] : INFO : Max Epochs: 2048
[2022-04-22 17:15:58 main:478] : INFO : Batch Size: 128
[2022-04-22 17:15:58 main:479] : INFO : Learning Rate: 0.01
[2022-04-22 17:15:58 main:480] : INFO : Patience: 10
[2022-04-22 17:15:58 main:481] : INFO : Hidden Width: 12
[2022-04-22 17:15:58 main:482] : INFO : # Recurrent Layers: 4
[2022-04-22 17:15:58 main:483] : INFO : # Backend Layers: 4
[2022-04-22 17:15:58 main:484] : INFO : # Threads: 1
[2022-04-22 17:15:58 main:486] : INFO : Preparing Dataset
[2022-04-22 17:15:58 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-22 17:15:58 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-22 17:41:03 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2022-04-22 17:41:03 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-22 17:41:03 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-22 17:41:03 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2022-04-22 17:41:03 main:494] : INFO : Creating Model
[2022-04-22 17:41:03 main:507] : INFO : Preparing config file
[2022-04-22 17:41:03 main:511] : INFO : Found checkpoint, attempting to load...
[2022-04-22 17:41:03 main:512] : INFO : Loading config
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFA88014F69
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 04/22/22 17:41:03
Install Directory : C:\Program Files\BOINC\
Data Directory : C:\ProgramData\BOINC
Project Symstore :
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\0;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 00000000d2150000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000008a850000 00000000001f5000 C:\Windows\SYSTEM32\ntdll.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 000000008a080000 00000000000be000 C:\Windows\System32\KERNEL32.DLL (6.2.19041.1645) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 0000000087fe0000 00000000002c8000 C:\Windows\System32\KERNELBASE.dll (6.2.19041.1645) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000889b0000 00000000001a0000 C:\Windows\System32\USER32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000088460000 0000000000022000 C:\Windows\System32\win32u.dll (6.2.19041.1645) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.1645 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1645
ModLoad: 000000008a320000 000000000002a000 C:\Windows\System32\GDI32.dll (6.2.19041.1620) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.1620 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1620
ModLoad: 0000000088490000 000000000010b000 C:\Windows\System32\gdi32full.dll (6.2.19041.1620) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.1620 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1620
ModLoad: 0000000083c30000 0000000000058000 C:\ProgramData\BOINC\slots\0\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000087f40000 000000000009d000 C:\Windows\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 0000000088780000 0000000000100000 C:\Windows\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 000000008a350000 00000000000ae000 C:\Windows\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000089670000 000000000009e000 C:\Windows\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.19041.546
ModLoad: 000000008a140000 000000000009c000 C:\Windows\System32\sechost.dll (6.2.19041.1586) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000008a4e0000 0000000000125000 C:\Windows\System32\RPCRT4.dll (6.2.19041.1645) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000700b0000 000000000008d000 C:\Windows\SYSTEM32\MSVCP140.dll (14.29.30133.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.29.30133.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.29.30133.0
ModLoad: 00000000766c0000 00000000001e4000 C:\Windows\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.867 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.867
ModLoad: 0000000070330000 000000000001b000 C:\Windows\SYSTEM32\VCRUNTIME140.dll (14.29.30133.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.29.30133.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.29.30133.0
ModLoad: 000000006e8b0000 000000000000c000 C:\Windows\SYSTEM32\VCRUNTIME140_1.dll (14.29.30133.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.29.30133.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.29.30133.0
ModLoad: 00000000ea9f0000 000000000abe7000 C:\ProgramData\BOINC\slots\0\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000f55e0000 0000000024b49000 C:\ProgramData\BOINC\slots\0\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000054af0000 000000000020d000 C:\ProgramData\BOINC\slots\0\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 000000004ce10000 00000000002db000 C:\ProgramData\BOINC\slots\0\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000083be0000 0000000000045000 C:\ProgramData\BOINC\slots\0\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000e7940000 00000000030a5000 C:\ProgramData\BOINC\slots\0\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 00000000e4480000 00000000034b2000 C:\ProgramData\BOINC\slots\0\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 0000000083bd0000 0000000000010000 C:\ProgramData\BOINC\slots\0\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 00000000bc1d0000 0000000003d5b000 C:\ProgramData\BOINC\slots\0\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 0000000083b90000 0000000000040000 C:\ProgramData\BOINC\slots\0\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000bff30000 000000000919f000 C:\ProgramData\BOINC\slots\0\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 000000004a930000 0000000001eca000 C:\ProgramData\BOINC\slots\0\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000c90d0000 000000001b3a4000 C:\ProgramData\BOINC\slots\0\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 0000000089be0000 0000000000030000 C:\Windows\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000085da0000 0000000000012000 C:\Windows\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000089c10000 000000000046a000 C:\Windows\System32\Setupapi.dll (6.2.19041.1620) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000088410000 000000000004e000 C:\Windows\System32\cfgmgr32.dll (6.2.19041.1620) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.1620 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1620
ModLoad: 0000000088630000 0000000000027000 C:\Windows\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000087cf0000 000000000002c000 C:\Windows\SYSTEM32\DEVOBJ.dll (6.2.19041.1620) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.1620 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1620
ModLoad: 0000000088660000 0000000000068000 C:\Windows\System32\WINTRUST.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000882b0000 0000000000156000 C:\Windows\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000087b30000 0000000000012000 C:\Windows\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000088b60000 0000000000744000 C:\Windows\System32\Shell32.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.964 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.964
ModLoad: 0000000086080000 0000000000794000 C:\Windows\SYSTEM32\windows.storage.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000089710000 0000000000354000 C:\Windows\System32\combase.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.1320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1320
ModLoad: 00000000879b0000 000000000002c000 C:\Windows\SYSTEM32\Wldp.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000089a80000 00000000000ad000 C:\Windows\System32\SHCORE.dll (6.2.19041.1645) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000008a6a0000 0000000000055000 C:\Windows\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000004a660000 00000000002cd000 C:\Windows\system32\nvcuda.dll (30.0.15.1215) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r512_08\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 30.0.15.1215
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.6.127 driver
Product Version : 30.0.15.1215
ModLoad: 0000000029750000 000000000169f000 C:\Windows\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_c0e159863e7afdde\nvcuda64.dll (30.0.15.1215) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r512_08\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 30.0.15.1215
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.6.127 driver
Product Version : 30.0.15.1215
ModLoad: 0000000080b70000 000000000000a000 C:\Windows\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000810c0000 0000000000031000 C:\Windows\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.906 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.906
ModLoad: 0000000080f70000 0000000000148000 C:\Windows\SYSTEM32\drvstore.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : drvstore.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 0000000087890000 000000000000c000 C:\Windows\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000007e060000 0000000000768000 C:\Windows\SYSTEM32\nvapi64.dll (30.0.15.1215) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r512_08\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 30.0.15.1215
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 30.0.15.1215
ModLoad: 000000003fc10000 00000000008b3000 C:\Windows\System32\DriverStore\FileRepository\nv_dispi.inf_amd64_c0e159863e7afdde\nvptxJitCompiler64.dll (30.0.15.1215) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 30.0.15.1215
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows PTX JIT Compiler
Product Version : 30.0.15.1215
ModLoad: 00000000885a0000 0000000000082000 C:\Windows\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.1415 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1415
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 4397, Write: 1995, Other 8550
- I/O Transfers Counters -
Read: 62552823, Write: 1354770983, Other 40324
- Paged Pool Usage -
QuotaPagedPoolUsage: 3460128, QuotaPeakPagedPoolUsage: 3460176
QuotaNonPagedPoolUsage: 43104, QuotaPeakNonPagedPoolUsage: 53032
- Virtual Memory Usage -
VirtualSize: -844369920, PeakVirtualSize: 153075712
- Pagefile Usage -
PagefileUsage: -844369920, PeakPagefileUsage: -268120064
- Working Set Size -
WorkingSetSize: 1571119104, PeakWorkingSetSize: -1997975552, PageFaultCount: 18905448
*** Dump of thread ID 11184 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 141718752.000000, User Time: 11315312640.000000, Wait Time: 164118.000000
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFA88014F69
- Registers -
rax=00000000f0588b93 rbx=00000000d24b4910 rcx=000000007fce5d30 rdx=0000000000000001 rsi=000000007fce6670 rdi=0000000019930520
r8=000000007fce5dc8 r9=0000000000000000 r10=0000000000000000 r11=000000007d7c3c00 r12=000000006a37fa70 r13=000000007fce6880
r14=0000000060e07300 r15=0000000000000000 rip=0000000088014f69 rsp=000000007fce6510 rbp=000000007fce6800
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202
- Callstack -
ChildEBP RetAddr Args to Child
7fce65e0 d23ca884 00000040 0000004f 6a380d00 000004ba KERNELBASE!RaiseException+0x0
7fce6640 d2171ca6 1ace0000 7fce6719 a09f2020 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
7fce66f0 d217593b 00000000 00000030 00000020 00000008 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
7fce6840 d2171a78 00000000 00000000 7fce6b70 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
7fce6910 d2171cfc 7fce6b70 00000000 00000080 7fce6e40 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
7fce69d0 d217c4dd 7fce6e40 7fce6e40 7fce6e40 7fce6e40 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
7fce6cc0 d216b2fe 7fce72d8 7fce6e40 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
7fcffa60 d23ac6f8 1c6d9420 00000000 00000000 1c00c020 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
7fcffaa0 8a097034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
7fcffad0 8a8a2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
7fcffb50 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 11360 (state: Waiting): ***
- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 164112.000000
- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000001ff8e0 rsi=0000000000000000 rdi=0000000000000064
r8=00000000001ff8b8 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000008a8ed3f4 rsp=00000000001ff8b8 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
001ff8b0 8802962e 001ff978 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0
001ff950 d218a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0
001ff980 8a097034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
001ff9b0 8a8a2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
001ffa30 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 21316 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 164112.000000
- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=00000000002ff8a0 rsi=0000000000000000 rdi=000000000000000d
r8=00000000002ff548 r9=000000001c8d5f00 r10=0000000000000000 r11=00000000002ff810 r12=0000000000000064 r13=00000000002ff8a0
r14=00000000002ff5a0 r15=0000000000000000 rip=000000008a8ed8c4 rsp=00000000002ff548 rbp=000000001c8d5f00
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
002ff540 8802cb10 00000000 7fb8c000 8a9ba4d0 7fb8c000 ntdll!ZwWaitForMultipleObjects+0x0
002ff830 8802ca0e 1acf4f00 006e0069 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
002ff870 2992d554 1c8d86c0 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0
002ffab0 299d58cd 00000000 1c8d5f00 00000000 00000000 nvcuda64!+0x0
002ffb60 2992cf23 f8d38556 7da8d7c7 1ced6950 00000000 nvcuda64!cuProfilerStop+0x0
002ffb90 29c641e4 1ced6950 00000000 00000000 00000000 nvcuda64!+0x0
002ffbc0 8a097034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
002ffbf0 8a8a2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
002ffc70 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 13796 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 67826.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=000000000000029c rdx=0000000000000000 rsi=0000000000000000 rdi=000000000000029c
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=000000001c8b7180 r13=0000000000000000
r14=000000000000029c r15=0000000000000000 rip=000000008a8ecdf4 rsp=00000000003ff688 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
003ff680 88001a5e 00000000 00001f80 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0
003ff720 29b5596e 1ced7850 00000000 00000000 0000029c KERNELBASE!WaitForSingleObjectEx+0x0
003ff960 2992cf23 00000000 1ced7850 29750000 1c91da70 nvcuda64!cuProfilerStop+0x0
003ff990 29c641e4 1ced7850 00000000 00000000 00000000 nvcuda64!+0x0
003ff9c0 8a097034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
003ff9f0 8a8a2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
003ffa70 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 2780 (state: Waiting): ***
- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 106197.000000
- Registers -
rax=00000000000001d3 rbx=000000007b9d4370 rcx=0000000000000014 rdx=000000007b9d3ff0 rsi=000000001ace0b50 rdi=000000007b9d4370
r8=0000000058a65060 r9=000000007ffe03b0 r10=00000000558c32b0 r11=00000000558c32f0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000008a8f07c4 rsp=00000000004ff888 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
004ff880 8a8a2dc7 00000000 00000000 1ace0b50 1ace0b68 ntdll!ZwWaitForWorkViaWorkerFactory+0x0
004ffb80 8a097034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0
004ffbb0 8a8a2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
004ffc30 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 4232 (state: Waiting): ***
- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 106197.000000
- Registers -
rax=00000000000001d3 rbx=000000007b9d22d0 rcx=0000000000000014 rdx=000000007b9d1f50 rsi=000000001ace0b50 rdi=000000007b9d22d0
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000008a8f07c4 rsp=00000000005ffac8 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
005ffac0 8a8a2dc7 0001000b 1ace0c01 00000001 7b9d22d0 ntdll!ZwWaitForWorkViaWorkerFactory+0x0
005ffdc0 8a097034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0
005ffdf0 8a8a2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
005ffe70 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 14732 (state: Waiting): ***
- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 106197.000000
- Registers -
rax=00000000000001d3 rbx=0000000000000000 rcx=0000000000000014 rdx=000000007b9d4ad0 rsi=000000001ace0b50 rdi=0000000000000000
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000008a8f07c4 rsp=00000000006ff548 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
006ff540 8a8a2dc7 00000000 00000000 1ace0b50 00000000 ntdll!ZwWaitForWorkViaWorkerFactory+0x0
006ff840 8a097034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0
006ff870 8a8a2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
006ff8f0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)