Task 10300465
| Name | ParityModified-1639949690-4606-1-0_0 |
| Workunit | 7651685 |
| Created | 1 Jan 2022, 13:31:42 UTC |
| Sent | 16 Jan 2022, 21:44:12 UTC |
| Report deadline | 24 Jan 2022, 21:44:12 UTC |
| Received | 5 Feb 2022, 19:16:26 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | -529697949 (0xE06D7363) Unknown error code |
| Computer ID | 8169 |
| Run time | 3 min 30 sec |
| CPU time | 2 min 49 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 9,066.41 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 3.05 GB |
| Peak swap size | 4.36 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
(libTorch: release/1.6 GPU: NVIDIA GeForce RTX 2070 SUPER)
[2022-02-05 10:43:01 main:435] : INFO : Set logging level to 1
[2022-02-05 10:43:01 main:441] : INFO : Running in BOINC Client mode
[2022-02-05 10:43:01 main:444] : INFO : Resolving all filenames
[2022-02-05 10:43:01 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-02-05 10:43:01 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-02-05 10:43:01 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-02-05 10:43:01 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-02-05 10:43:01 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-02-05 10:43:01 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-02-05 10:43:02 main:474] : INFO : Configuration:
[2022-02-05 10:43:02 main:475] : INFO : Model type: GRU
[2022-02-05 10:43:02 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-02-05 10:43:02 main:477] : INFO : Max Epochs: 2048
[2022-02-05 10:43:02 main:478] : INFO : Batch Size: 128
[2022-02-05 10:43:02 main:479] : INFO : Learning Rate: 0.01
[2022-02-05 10:43:02 main:480] : INFO : Patience: 10
[2022-02-05 10:43:02 main:481] : INFO : Hidden Width: 12
[2022-02-05 10:43:02 main:482] : INFO : # Recurrent Layers: 4
[2022-02-05 10:43:02 main:483] : INFO : # Backend Layers: 4
[2022-02-05 10:43:02 main:484] : INFO : # Threads: 1
[2022-02-05 10:43:02 main:486] : INFO : Preparing Dataset
[2022-02-05 10:43:02 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-02-05 10:43:02 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
[2022-02-05 10:43:04 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2022-02-05 10:43:04 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory
[2022-02-05 10:43:04 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory
[2022-02-05 10:43:05 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2022-02-05 10:43:05 main:494] : INFO : Creating Model
[2022-02-05 10:43:05 main:507] : INFO : Preparing config file
[2022-02-05 10:43:05 main:511] : INFO : Found checkpoint, attempting to load...
[2022-02-05 10:43:05 main:512] : INFO : Loading config
[2022-02-05 10:43:05 main:514] : INFO : Loading state
[2022-02-05 10:43:06 main:559] : INFO : Loading DataLoader into Memory
[2022-02-05 10:43:06 main:562] : INFO : Starting Training
[2022-02-05 10:43:08 main:574] : INFO : Epoch 73 | loss: 0.0314262 | val_loss: 0.03133 | Time: 1979.47 ms
[2022-02-05 10:43:10 main:574] : INFO : Epoch 74 | loss: 0.0312697 | val_loss: 0.0312509 | Time: 1475.77 ms
[2022-02-05 10:43:11 main:574] : INFO : Epoch 75 | loss: 0.0312418 | val_loss: 0.0312384 | Time: 1461.79 ms
[2022-02-05 10:43:13 main:574] : INFO : Epoch 76 | loss: 0.0312347 | val_loss: 0.0312352 | Time: 1459.83 ms
[2022-02-05 10:43:14 main:574] : INFO : Epoch 77 | loss: 0.0312302 | val_loss: 0.0312263 | Time: 1466.42 ms
[2022-02-05 10:43:16 main:574] : INFO : Epoch 78 | loss: 0.0312239 | val_loss: 0.0312211 | Time: 1469.11 ms
[2022-02-05 10:43:17 main:574] : INFO : Epoch 79 | loss: 0.0312234 | val_loss: 0.0312316 | Time: 1464.02 ms
[2022-02-05 10:43:19 main:574] : INFO : Epoch 80 | loss: 0.0312228 | val_loss: 0.0312193 | Time: 1495.29 ms
[2022-02-05 10:43:20 main:574] : INFO : Epoch 81 | loss: 0.0312201 | val_loss: 0.0312207 | Time: 1465.65 ms
[2022-02-05 10:43:22 main:574] : INFO : Epoch 82 | loss: 0.0312209 | val_loss: 0.0312187 | Time: 1475.78 ms
[2022-02-05 10:43:24 main:574] : INFO : Epoch 83 | loss: 0.0312211 | val_loss: 0.0312189 | Time: 1458.18 ms
[2022-02-05 10:43:25 main:574] : INFO : Epoch 84 | loss: 0.0312251 | val_loss: 0.0312214 | Time: 1459.31 ms
[2022-02-05 10:43:27 main:574] : INFO : Epoch 85 | loss: 0.0312233 | val_loss: 0.0312255 | Time: 1474.98 ms
[2022-02-05 10:43:28 main:574] : INFO : Epoch 86 | loss: 0.0312227 | val_loss: 0.0312207 | Time: 1453.06 ms
[2022-02-05 10:43:30 main:574] : INFO : Epoch 87 | loss: 0.0312265 | val_loss: 0.0312372 | Time: 1469.7 ms
[2022-02-05 10:43:31 main:574] : INFO : Epoch 88 | loss: 0.0312275 | val_loss: 0.0312276 | Time: 1452.53 ms
[2022-02-05 10:43:33 main:574] : INFO : Epoch 89 | loss: 0.0312208 | val_loss: 0.0312176 | Time: 1502.51 ms
[2022-02-05 10:43:34 main:574] : INFO : Epoch 90 | loss: 0.0312189 | val_loss: 0.031218 | Time: 1572.9 ms
[2022-02-05 10:43:36 main:574] : INFO : Epoch 91 | loss: 0.0312189 | val_loss: 0.0312167 | Time: 1507.54 ms
[2022-02-05 10:43:37 main:574] : INFO : Epoch 92 | loss: 0.0312181 | val_loss: 0.0312164 | Time: 1489.09 ms
[2022-02-05 10:43:39 main:574] : INFO : Epoch 93 | loss: 0.0312205 | val_loss: 0.0312193 | Time: 1559.13 ms
[2022-02-05 10:43:41 main:574] : INFO : Epoch 94 | loss: 0.0312211 | val_loss: 0.031218 | Time: 1789.76 ms
[2022-02-05 10:43:43 main:574] : INFO : Epoch 95 | loss: 0.0312208 | val_loss: 0.0312215 | Time: 1683.78 ms
[2022-02-05 10:43:44 main:574] : INFO : Epoch 96 | loss: 0.0312206 | val_loss: 0.0312172 | Time: 1615.51 ms
[2022-02-05 10:43:46 main:574] : INFO : Epoch 97 | loss: 0.0312193 | val_loss: 0.031219 | Time: 1698.47 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 2070 SUPER)
[2022-02-05 10:46:48 main:435] : INFO : Set logging level to 1
[2022-02-05 10:46:48 main:441] : INFO : Running in BOINC Client mode
[2022-02-05 10:46:48 main:444] : INFO : Resolving all filenames
[2022-02-05 10:46:48 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-02-05 10:46:48 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-02-05 10:46:48 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-02-05 10:46:48 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-02-05 10:46:49 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-02-05 10:46:49 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-02-05 10:46:49 main:474] : INFO : Configuration:
[2022-02-05 10:46:49 main:475] : INFO : Model type: GRU
[2022-02-05 10:46:49 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-02-05 10:46:49 main:477] : INFO : Max Epochs: 2048
[2022-02-05 10:46:49 main:478] : INFO : Batch Size: 128
[2022-02-05 10:46:49 main:479] : INFO : Learning Rate: 0.01
[2022-02-05 10:46:49 main:480] : INFO : Patience: 10
[2022-02-05 10:46:49 main:481] : INFO : Hidden Width: 12
[2022-02-05 10:46:49 main:482] : INFO : # Recurrent Layers: 4
[2022-02-05 10:46:49 main:483] : INFO : # Backend Layers: 4
[2022-02-05 10:46:49 main:484] : INFO : # Threads: 1
[2022-02-05 10:46:49 main:486] : INFO : Preparing Dataset
[2022-02-05 10:46:49 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-02-05 10:46:50 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
[2022-02-05 10:46:51 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2022-02-05 10:46:51 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory
[2022-02-05 10:46:52 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory
[2022-02-05 10:46:52 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2022-02-05 10:46:52 main:494] : INFO : Creating Model
[2022-02-05 10:46:52 main:507] : INFO : Preparing config file
[2022-02-05 10:46:52 main:511] : INFO : Found checkpoint, attempting to load...
[2022-02-05 10:46:52 main:512] : INFO : Loading config
[2022-02-05 10:46:52 main:514] : INFO : Loading state
[2022-02-05 10:46:53 main:559] : INFO : Loading DataLoader into Memory
[2022-02-05 10:46:53 main:562] : INFO : Starting Training
[2022-02-05 10:46:55 main:574] : INFO : Epoch 73 | loss: 0.0314207 | val_loss: 0.0312678 | Time: 1794.71 ms
[2022-02-05 10:46:57 main:574] : INFO : Epoch 74 | loss: 0.031267 | val_loss: 0.0312481 | Time: 1540.4 ms
[2022-02-05 10:46:58 main:574] : INFO : Epoch 75 | loss: 0.0312368 | val_loss: 0.0312261 | Time: 1527.7 ms
[2022-02-05 10:47:00 main:574] : INFO : Epoch 76 | loss: 0.0312229 | val_loss: 0.0312171 | Time: 1531.32 ms
[2022-02-05 10:47:02 main:574] : INFO : Epoch 77 | loss: 0.0312172 | val_loss: 0.0312131 | Time: 1525.11 ms
[2022-02-05 10:47:03 main:574] : INFO : Epoch 78 | loss: 0.0312148 | val_loss: 0.0312133 | Time: 1531.5 ms
[2022-02-05 10:47:05 main:574] : INFO : Epoch 79 | loss: 0.0312159 | val_loss: 0.0312112 | Time: 1527.4 ms
[2022-02-05 10:47:06 main:574] : INFO : Epoch 80 | loss: 0.0312134 | val_loss: 0.0312119 | Time: 1529.32 ms
[2022-02-05 10:47:08 main:574] : INFO : Epoch 81 | loss: 0.0312133 | val_loss: 0.0312087 | Time: 1528.46 ms
[2022-02-05 10:47:09 main:574] : INFO : Epoch 82 | loss: 0.0312137 | val_loss: 0.0312093 | Time: 1588.91 ms
[2022-02-05 10:47:11 main:574] : INFO : Epoch 83 | loss: 0.0312125 | val_loss: 0.0312151 | Time: 1517.66 ms
[2022-02-05 10:47:13 main:574] : INFO : Epoch 84 | loss: 0.0312107 | val_loss: 0.0312091 | Time: 1518.49 ms
[2022-02-05 10:47:14 main:574] : INFO : Epoch 85 | loss: 0.0312108 | val_loss: 0.0312141 | Time: 1533.12 ms
[2022-02-05 10:47:16 main:574] : INFO : Epoch 86 | loss: 0.0312101 | val_loss: 0.0312079 | Time: 1535.68 ms
[2022-02-05 10:47:17 main:574] : INFO : Epoch 87 | loss: 0.0312098 | val_loss: 0.0312117 | Time: 1518.08 ms
[2022-02-05 10:47:19 main:574] : INFO : Epoch 88 | loss: 0.0312139 | val_loss: 0.0312181 | Time: 1532.11 ms
[2022-02-05 10:47:21 main:574] : INFO : Epoch 89 | loss: 0.0312112 | val_loss: 0.0312134 | Time: 1582.04 ms
[2022-02-05 10:47:22 main:574] : INFO : Epoch 90 | loss: 0.0312104 | val_loss: 0.0312074 | Time: 1522.57 ms
[2022-02-05 10:47:24 main:574] : INFO : Epoch 91 | loss: 0.0312082 | val_loss: 0.0312065 | Time: 1527.6 ms
[2022-02-05 10:47:25 main:574] : INFO : Epoch 92 | loss: 0.0312073 | val_loss: 0.0312099 | Time: 1526.1 ms
[2022-02-05 10:47:27 main:574] : INFO : Epoch 93 | loss: 0.0312098 | val_loss: 0.0312096 | Time: 1512.68 ms
[2022-02-05 10:47:28 main:574] : INFO : Epoch 94 | loss: 0.0312144 | val_loss: 0.0312092 | Time: 1540.68 ms
[2022-02-05 10:47:30 main:574] : INFO : Epoch 95 | loss: 0.0312082 | val_loss: 0.031213 | Time: 1542.92 ms
[2022-02-05 10:47:32 main:574] : INFO : Epoch 96 | loss: 0.0312103 | val_loss: 0.0312058 | Time: 1534.59 ms
[2022-02-05 10:47:33 main:574] : INFO : Epoch 97 | loss: 0.0312077 | val_loss: 0.0312099 | Time: 1529.12 ms
[2022-02-05 10:47:35 main:574] : INFO : Epoch 98 | loss: 0.0312087 | val_loss: 0.0312093 | Time: 1533.48 ms
[2022-02-05 10:47:37 main:574] : INFO : Epoch 99 | loss: 0.0312126 | val_loss: 0.0312122 | Time: 1553.54 ms
[2022-02-05 10:47:38 main:574] : INFO : Epoch 100 | loss: 0.0312127 | val_loss: 0.0312167 | Time: 1550.5 ms
[2022-02-05 10:47:40 main:574] : INFO : Epoch 101 | loss: 0.0312121 | val_loss: 0.0312131 | Time: 1556.35 ms
[2022-02-05 10:47:41 main:574] : INFO : Epoch 102 | loss: 0.0312078 | val_loss: 0.0312064 | Time: 1537.42 ms
[2022-02-05 10:47:43 main:574] : INFO : Epoch 103 | loss: 0.0312064 | val_loss: 0.0312059 | Time: 1540.01 ms
[2022-02-05 10:47:45 main:574] : INFO : Epoch 104 | loss: 0.0312076 | val_loss: 0.0312068 | Time: 1535.17 ms
[2022-02-05 10:47:46 main:574] : INFO : Epoch 105 | loss: 0.0312079 | val_loss: 0.031206 | Time: 1598.27 ms
[2022-02-05 10:47:48 main:574] : INFO : Epoch 106 | loss: 0.0312064 | val_loss: 0.0312054 | Time: 1538.07 ms
[2022-02-05 10:47:55 main:574] : INFO : Epoch 107 | loss: 0.0312101 | val_loss: 0.0312113 | Time: 7429.14 ms
[2022-02-05 10:48:00 main:574] : INFO : Epoch 108 | loss: 0.0312095 | val_loss: 0.0312047 | Time: 3873.77 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 2070 SUPER)
[2022-02-05 10:51:51 main:435] : INFO : Set logging level to 1
[2022-02-05 10:51:51 main:441] : INFO : Running in BOINC Client mode
[2022-02-05 10:51:51 main:444] : INFO : Resolving all filenames
[2022-02-05 10:51:52 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-02-05 10:51:52 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-02-05 10:51:52 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-02-05 10:51:52 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-02-05 10:51:52 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-02-05 10:51:52 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-02-05 10:51:52 main:474] : INFO : Configuration:
[2022-02-05 10:51:52 main:475] : INFO : Model type: GRU
[2022-02-05 10:51:52 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-02-05 10:51:52 main:477] : INFO : Max Epochs: 2048
[2022-02-05 10:51:52 main:478] : INFO : Batch Size: 128
[2022-02-05 10:51:52 main:479] : INFO : Learning Rate: 0.01
[2022-02-05 10:51:52 main:480] : INFO : Patience: 10
[2022-02-05 10:51:52 main:481] : INFO : Hidden Width: 12
[2022-02-05 10:51:52 main:482] : INFO : # Recurrent Layers: 4
[2022-02-05 10:51:52 main:483] : INFO : # Backend Layers: 4
[2022-02-05 10:51:52 main:484] : INFO : # Threads: 1
[2022-02-05 10:51:52 main:486] : INFO : Preparing Dataset
[2022-02-05 10:51:52 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-02-05 10:51:53 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
[2022-02-05 10:51:54 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2022-02-05 10:51:54 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory
[2022-02-05 10:51:55 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory
[2022-02-05 10:51:55 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2022-02-05 10:51:55 main:494] : INFO : Creating Model
[2022-02-05 10:51:55 main:507] : INFO : Preparing config file
[2022-02-05 10:51:55 main:511] : INFO : Found checkpoint, attempting to load...
[2022-02-05 10:51:55 main:512] : INFO : Loading config
[2022-02-05 10:51:55 main:514] : INFO : Loading state
[2022-02-05 10:51:56 main:559] : INFO : Loading DataLoader into Memory
[2022-02-05 10:51:56 main:562] : INFO : Starting Training
[2022-02-05 10:51:58 main:574] : INFO : Epoch 73 | loss: 0.031342 | val_loss: 0.0312711 | Time: 1776 ms
[2022-02-05 10:51:59 main:574] : INFO : Epoch 74 | loss: 0.0312471 | val_loss: 0.0312287 | Time: 1540.33 ms
[2022-02-05 10:52:01 main:574] : INFO : Epoch 75 | loss: 0.0312255 | val_loss: 0.0312232 | Time: 1540.09 ms
[2022-02-05 10:52:03 main:574] : INFO : Epoch 76 | loss: 0.031219 | val_loss: 0.0312213 | Time: 1523.81 ms
[2022-02-05 10:52:04 main:574] : INFO : Epoch 77 | loss: 0.0312172 | val_loss: 0.0312196 | Time: 1522.44 ms
[2022-02-05 10:52:06 main:574] : INFO : Epoch 78 | loss: 0.0312164 | val_loss: 0.0312177 | Time: 1523.43 ms
[2022-02-05 10:52:07 main:574] : INFO : Epoch 79 | loss: 0.0312151 | val_loss: 0.0312173 | Time: 1527.6 ms
[2022-02-05 10:52:09 main:574] : INFO : Epoch 80 | loss: 0.0312182 | val_loss: 0.0312173 | Time: 1517.04 ms
[2022-02-05 10:52:10 main:574] : INFO : Epoch 81 | loss: 0.0312208 | val_loss: 0.0312203 | Time: 1521.9 ms
[2022-02-05 10:52:12 main:574] : INFO : Epoch 82 | loss: 0.0312167 | val_loss: 0.0312176 | Time: 1525.35 ms
[2022-02-05 10:52:14 main:574] : INFO : Epoch 83 | loss: 0.0312137 | val_loss: 0.0312159 | Time: 1531.3 ms
[2022-02-05 10:52:15 main:574] : INFO : Epoch 84 | loss: 0.0312141 | val_loss: 0.0312152 | Time: 1525.48 ms
[2022-02-05 10:52:17 main:574] : INFO : Epoch 85 | loss: 0.0312136 | val_loss: 0.0312151 | Time: 1527.11 ms
[2022-02-05 10:52:18 main:574] : INFO : Epoch 86 | loss: 0.0312154 | val_loss: 0.0312161 | Time: 1532.37 ms
[2022-02-05 10:52:20 main:574] : INFO : Epoch 87 | loss: 0.0312167 | val_loss: 0.0312177 | Time: 1524.21 ms
[2022-02-05 10:52:21 main:574] : INFO : Epoch 88 | loss: 0.031217 | val_loss: 0.0312162 | Time: 1521.63 ms
[2022-02-05 10:52:23 main:574] : INFO : Epoch 89 | loss: 0.0312155 | val_loss: 0.031216 | Time: 1523.4 ms
[2022-02-05 10:52:24 main:574] : INFO : Epoch 90 | loss: 0.0312139 | val_loss: 0.0312148 | Time: 1518.97 ms
[2022-02-05 10:52:26 main:574] : INFO : Epoch 91 | loss: 0.031213 | val_loss: 0.0312158 | Time: 1538.4 ms
[2022-02-05 10:52:28 main:574] : INFO : Epoch 92 | loss: 0.031213 | val_loss: 0.031215 | Time: 1513.86 ms
[2022-02-05 10:52:29 main:574] : INFO : Epoch 93 | loss: 0.0312135 | val_loss: 0.0312163 | Time: 1520.28 ms
[2022-02-05 10:52:31 main:574] : INFO : Epoch 94 | loss: 0.0312145 | val_loss: 0.031217 | Time: 1533.29 ms
[2022-02-05 10:52:32 main:574] : INFO : Epoch 95 | loss: 0.0312149 | val_loss: 0.0312174 | Time: 1507.8 ms
[2022-02-05 10:52:34 main:574] : INFO : Epoch 96 | loss: 0.0312155 | val_loss: 0.031217 | Time: 1523.48 ms
[2022-02-05 10:52:35 main:574] : INFO : Epoch 97 | loss: 0.0312166 | val_loss: 0.0312171 | Time: 1528.38 ms
[2022-02-05 10:52:37 main:574] : INFO : Epoch 98 | loss: 0.0312139 | val_loss: 0.0312174 | Time: 1531.55 ms
[2022-02-05 10:52:39 main:574] : INFO : Epoch 99 | loss: 0.0312139 | val_loss: 0.0312141 | Time: 1520.8 ms
[2022-02-05 10:52:40 main:574] : INFO : Epoch 100 | loss: 0.0312154 | val_loss: 0.0312161 | Time: 1522.26 ms
[2022-02-05 10:52:42 main:574] : INFO : Epoch 101 | loss: 0.0312149 | val_loss: 0.0312143 | Time: 1522.81 ms
[2022-02-05 10:52:43 main:574] : INFO : Epoch 102 | loss: 0.0312143 | val_loss: 0.0312148 | Time: 1525.77 ms
[2022-02-05 10:52:45 main:574] : INFO : Epoch 103 | loss: 0.0312139 | val_loss: 0.0312164 | Time: 1527.93 ms
[2022-02-05 10:52:46 main:574] : INFO : Epoch 104 | loss: 0.0312159 | val_loss: 0.0312157 | Time: 1521.7 ms
[2022-02-05 10:52:48 main:574] : INFO : Epoch 105 | loss: 0.0312157 | val_loss: 0.0312163 | Time: 1544.54 ms
[2022-02-05 10:52:50 main:574] : INFO : Epoch 106 | loss: 0.0312182 | val_loss: 0.0312181 | Time: 1522.25 ms
[2022-02-05 10:52:51 main:574] : INFO : Epoch 107 | loss: 0.031213 | val_loss: 0.0312163 | Time: 1516.53 ms
[2022-02-05 10:52:53 main:574] : INFO : Epoch 108 | loss: 0.0312133 | val_loss: 0.0312158 | Time: 1873.87 ms
[2022-02-05 10:52:55 main:574] : INFO : Epoch 109 | loss: 0.0312127 | val_loss: 0.0312149 | Time: 1617.47 ms
[2022-02-05 10:52:57 main:574] : INFO : Epoch 110 | loss: 0.0312128 | val_loss: 0.0312141 | Time: 1625 ms
[2022-02-05 10:52:58 main:574] : INFO : Epoch 111 | loss: 0.031213 | val_loss: 0.0312167 | Time: 1626.26 ms
[2022-02-05 10:53:00 main:574] : INFO : Epoch 112 | loss: 0.0312139 | val_loss: 0.0312145 | Time: 1626.45 ms
[2022-02-05 10:53:02 main:574] : INFO : Epoch 113 | loss: 0.0312129 | val_loss: 0.0312143 | Time: 1612.51 ms
[2022-02-05 10:58:17 main:574] : INFO : Epoch 114 | loss: 0.0312139 | val_loss: 0.0312181 | Time: 315412 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 2070 SUPER)
[2022-02-05 11:02:26 main:435] : INFO : Set logging level to 1
[2022-02-05 11:02:26 main:441] : INFO : Running in BOINC Client mode
[2022-02-05 11:02:26 main:444] : INFO : Resolving all filenames
[2022-02-05 11:02:26 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-02-05 11:02:27 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-02-05 11:02:27 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-02-05 11:02:27 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-02-05 11:02:27 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-02-05 11:02:27 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-02-05 11:02:27 main:474] : INFO : Configuration:
[2022-02-05 11:02:27 main:475] : INFO : Model type: GRU
[2022-02-05 11:02:27 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-02-05 11:02:27 main:477] : INFO : Max Epochs: 2048
[2022-02-05 11:02:27 main:478] : INFO : Batch Size: 128
[2022-02-05 11:02:27 main:479] : INFO : Learning Rate: 0.01
[2022-02-05 11:02:27 main:480] : INFO : Patience: 10
[2022-02-05 11:02:27 main:481] : INFO : Hidden Width: 12
[2022-02-05 11:02:27 main:482] : INFO : # Recurrent Layers: 4
[2022-02-05 11:02:27 main:483] : INFO : # Backend Layers: 4
[2022-02-05 11:02:28 main:484] : INFO : # Threads: 1
[2022-02-05 11:02:28 main:486] : INFO : Preparing Dataset
[2022-02-05 11:02:28 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-02-05 11:02:28 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
[2022-02-05 11:02:30 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2022-02-05 11:02:30 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory
[2022-02-05 11:02:30 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory
[2022-02-05 11:02:30 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2022-02-05 11:02:30 main:494] : INFO : Creating Model
[2022-02-05 11:02:30 main:507] : INFO : Preparing config file
[2022-02-05 11:02:30 main:511] : INFO : Found checkpoint, attempting to load...
[2022-02-05 11:02:30 main:512] : INFO : Loading config
[2022-02-05 11:02:30 main:514] : INFO : Loading state
[2022-02-05 11:02:31 main:559] : INFO : Loading DataLoader into Memory
[2022-02-05 11:02:31 main:562] : INFO : Starting Training
[2022-02-05 11:02:33 main:574] : INFO : Epoch 115 | loss: 0.0314597 | val_loss: 0.03131 | Time: 1693.95 ms
[2022-02-05 11:02:35 main:574] : INFO : Epoch 116 | loss: 0.0312645 | val_loss: 0.0312315 | Time: 1437.34 ms
[2022-02-05 11:02:36 main:574] : INFO : Epoch 117 | loss: 0.0312145 | val_loss: 0.0311981 | Time: 1443.5 ms
[2022-02-05 11:02:38 main:574] : INFO : Epoch 118 | loss: 0.0311826 | val_loss: 0.0311844 | Time: 1433.75 ms
[2022-02-05 11:02:39 main:574] : INFO : Epoch 119 | loss: 0.0311703 | val_loss: 0.0311747 | Time: 1445.31 ms
[2022-02-05 11:02:41 main:574] : INFO : Epoch 120 | loss: 0.0311621 | val_loss: 0.0311709 | Time: 1437.05 ms
[2022-02-05 11:02:42 main:574] : INFO : Epoch 121 | loss: 0.031157 | val_loss: 0.0311693 | Time: 1449.74 ms
[2022-02-05 11:02:44 main:574] : INFO : Epoch 122 | loss: 0.0311529 | val_loss: 0.0311709 | Time: 1445.76 ms
[2022-02-05 11:02:45 main:574] : INFO : Epoch 123 | loss: 0.0311522 | val_loss: 0.031175 | Time: 1447.08 ms
[2022-02-05 11:02:47 main:574] : INFO : Epoch 124 | loss: 0.03115 | val_loss: 0.0311691 | Time: 1431.01 ms
[2022-02-05 11:02:48 main:574] : INFO : Epoch 125 | loss: 0.0311467 | val_loss: 0.0311705 | Time: 1436.15 ms
[2022-02-05 11:02:50 main:574] : INFO : Epoch 126 | loss: 0.031143 | val_loss: 0.0311658 | Time: 1448.31 ms
[2022-02-05 11:02:51 main:574] : INFO : Epoch 127 | loss: 0.0311411 | val_loss: 0.0311658 | Time: 1450.08 ms
[2022-02-05 11:02:53 main:574] : INFO : Epoch 128 | loss: 0.0311391 | val_loss: 0.0311631 | Time: 1425.49 ms
[2022-02-05 11:02:54 main:574] : INFO : Epoch 129 | loss: 0.0311368 | val_loss: 0.0311624 | Time: 1427.92 ms
[2022-02-05 11:02:56 main:574] : INFO : Epoch 130 | loss: 0.031136 | val_loss: 0.0311625 | Time: 1434.19 ms
[2022-02-05 11:02:57 main:574] : INFO : Epoch 131 | loss: 0.031136 | val_loss: 0.0311637 | Time: 1443.58 ms
[2022-02-05 11:02:59 main:574] : INFO : Epoch 132 | loss: 0.031134 | val_loss: 0.0311604 | Time: 1431.53 ms
[2022-02-05 11:03:00 main:574] : INFO : Epoch 133 | loss: 0.0311323 | val_loss: 0.0311665 | Time: 1429.92 ms
[2022-02-05 11:03:02 main:574] : INFO : Epoch 134 | loss: 0.03113 | val_loss: 0.0311643 | Time: 1456.76 ms
[2022-02-05 11:03:03 main:574] : INFO : Epoch 135 | loss: 0.0311293 | val_loss: 0.0311618 | Time: 1440.71 ms
[2022-02-05 11:03:05 main:574] : INFO : Epoch 136 | loss: 0.0311273 | val_loss: 0.0311641 | Time: 1450.18 ms
[2022-02-05 11:03:06 main:574] : INFO : Epoch 137 | loss: 0.0311236 | val_loss: 0.0311606 | Time: 1440.15 ms
[2022-02-05 11:03:08 main:574] : INFO : Epoch 138 | loss: 0.0311217 | val_loss: 0.0311581 | Time: 1447.39 ms
[2022-02-05 11:03:09 main:574] : INFO : Epoch 139 | loss: 0.0312265 | val_loss: 0.0312653 | Time: 1438.76 ms
[2022-02-05 11:03:11 main:574] : INFO : Epoch 140 | loss: nan | val_loss: nan | Time: 1444.43 ms
[2022-02-05 11:03:12 main:574] : INFO : Epoch 141 | loss: nan | val_loss: nan | Time: 1444.67 ms
[2022-02-05 11:03:14 main:574] : INFO : Epoch 142 | loss: nan | val_loss: nan | Time: 1437.91 ms
[2022-02-05 11:03:15 main:574] : INFO : Epoch 143 | loss: nan | val_loss: nan | Time: 1434.94 ms
[2022-02-05 11:03:17 main:574] : INFO : Epoch 144 | loss: nan | val_loss: nan | Time: 1437.72 ms
[2022-02-05 11:03:18 main:574] : INFO : Epoch 145 | loss: nan | val_loss: nan | Time: 1444.42 ms
[2022-02-05 11:03:20 main:574] : INFO : Epoch 146 | loss: nan | val_loss: nan | Time: 1457.57 ms
[2022-02-05 11:03:21 main:574] : INFO : Epoch 147 | loss: nan | val_loss: nan | Time: 1433 ms
[2022-02-05 11:03:22 main:574] : INFO : Epoch 148 | loss: nan | val_loss: nan | Time: 1439.95 ms
[2022-02-05 11:03:24 main:574] : INFO : Epoch 149 | loss: nan | val_loss: nan | Time: 1432.13 ms
[2022-02-05 11:03:25 main:574] : INFO : Epoch 150 | loss: nan | val_loss: nan | Time: 1488.42 ms
[2022-02-05 11:03:27 main:574] : INFO : Epoch 151 | loss: nan | val_loss: nan | Time: 1669.68 ms
[2022-02-05 11:03:29 main:574] : INFO : Epoch 152 | loss: nan | val_loss: nan | Time: 1513.86 ms
[2022-02-05 11:03:30 main:574] : INFO : Epoch 153 | loss: nan | val_loss: nan | Time: 1525.87 ms
[2022-02-05 11:03:32 main:574] : INFO : Epoch 154 | loss: nan | val_loss: nan | Time: 1516.65 ms
[2022-02-05 11:03:34 main:574] : INFO : Epoch 155 | loss: nan | val_loss: nan | Time: 1505.5 ms
[2022-02-05 11:03:35 main:574] : INFO : Epoch 156 | loss: nan | val_loss: nan | Time: 1525.26 ms
[2022-02-05 11:03:37 main:574] : INFO : Epoch 157 | loss: nan | val_loss: nan | Time: 1520.6 ms
[2022-02-05 11:03:38 main:574] : INFO : Epoch 158 | loss: nan | val_loss: nan | Time: 1509.23 ms
[2022-02-05 11:06:31 main:574] : INFO : Epoch 159 | loss: nan | val_loss: nan | Time: 172687 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 2070 SUPER)
[2022-02-05 11:15:09 main:435] : INFO : Set logging level to 1
[2022-02-05 11:15:09 main:441] : INFO : Running in BOINC Client mode
[2022-02-05 11:15:09 main:444] : INFO : Resolving all filenames
[2022-02-05 11:15:09 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-02-05 11:15:09 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-02-05 11:15:09 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-02-05 11:15:09 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-02-05 11:15:10 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-02-05 11:15:10 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-02-05 11:15:10 main:474] : INFO : Configuration:
[2022-02-05 11:15:10 main:475] : INFO : Model type: GRU
[2022-02-05 11:15:10 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-02-05 11:15:10 main:477] : INFO : Max Epochs: 2048
[2022-02-05 11:15:11 main:478] : INFO : Batch Size: 128
[2022-02-05 11:15:11 main:479] : INFO : Learning Rate: 0.01
[2022-02-05 11:15:11 main:480] : INFO : Patience: 10
[2022-02-05 11:15:11 main:481] : INFO : Hidden Width: 12
[2022-02-05 11:15:11 main:482] : INFO : # Recurrent Layers: 4
[2022-02-05 11:15:11 main:483] : INFO : # Backend Layers: 4
[2022-02-05 11:15:11 main:484] : INFO : # Threads: 1
[2022-02-05 11:15:11 main:486] : INFO : Preparing Dataset
[2022-02-05 11:15:11 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-02-05 11:15:12 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
[2022-02-05 11:15:14 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2022-02-05 11:15:14 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory
[2022-02-05 11:15:14 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory
[2022-02-05 11:15:14 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2022-02-05 11:15:14 main:494] : INFO : Creating Model
[2022-02-05 11:15:14 main:507] : INFO : Preparing config file
[2022-02-05 11:15:14 main:511] : INFO : Found checkpoint, attempting to load...
[2022-02-05 11:15:14 main:512] : INFO : Loading config
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FF95EAE4F69
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 02/05/22 11:15:15
Install Directory : C:\Program Files\BOINC\
Data Directory : D:\ProgramData\BOINC
Project Symstore :
LoadLibraryA( D:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( D:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( D:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( D:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: D:\ProgramData\BOINC\slots\1;D:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 000000003b2f0000 00000000003df000 D:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000060e50000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1466
ModLoad: 000000005f120000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1466
ModLoad: 000000005eab0000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1466
ModLoad: 000000005f1e0000 00000000001a1000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000005e610000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1466
ModLoad: 00000000603d0000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.1202 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1202
ModLoad: 000000005ed80000 000000000010d000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1466
ModLoad: 0000000058e00000 0000000000058000 D:\ProgramData\BOINC\slots\1\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000005e640000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 000000005e6e0000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 00000000604f0000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000609b0000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.19041.546
ModLoad: 000000005f3a0000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000005ee90000 0000000000125000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000049150000 000000000008d000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.29.30133.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.29.30133.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.29.30133.0
ModLoad: 000000005df80000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.867 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.867
ModLoad: 0000000049100000 000000000001b000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.29.30133.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.29.30133.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.29.30133.0
ModLoad: 00000000490f0000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.29.30133.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.29.30133.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.29.30133.0
ModLoad: 00000000ab7b0000 000000000abe7000 D:\ProgramData\BOINC\slots\1\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000244d0000 00000000002db000 D:\ProgramData\BOINC\slots\1\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000293f0000 000000000020d000 D:\ProgramData\BOINC\slots\1\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 0000000055e40000 0000000000040000 D:\ProgramData\BOINC\slots\1\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000b63a0000 0000000024b49000 D:\ProgramData\BOINC\slots\1\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000053110000 0000000000045000 D:\ProgramData\BOINC\slots\1\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000a82f0000 00000000034b2000 D:\ProgramData\BOINC\slots\1\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 0000000089e90000 00000000030a5000 D:\ProgramData\BOINC\slots\1\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 000000005df70000 0000000000010000 D:\ProgramData\BOINC\slots\1\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 0000000080cf0000 000000000919f000 D:\ProgramData\BOINC\slots\1\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 000000007a850000 0000000003d5b000 D:\ProgramData\BOINC\slots\1\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 0000000078980000 0000000001eca000 D:\ProgramData\BOINC\slots\1\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 000000008cf40000 000000001b3a4000 D:\ProgramData\BOINC\slots\1\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 0000000060cb0000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000005c7b0000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000005fe70000 0000000000472000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1237) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000005e7e0000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1151
ModLoad: 000000005e830000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000005e300000 0000000000034000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1151
ModLoad: 000000005e860000 0000000000060000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1466
ModLoad: 000000005e8c0000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000005dd10000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000005f440000 0000000000744000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.964 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.964
ModLoad: 000000005c000000 0000000000795000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000060650000 0000000000355000 C:\WINDOWS\System32\combase.dll (6.2.19041.1348) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.1320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1320
ModLoad: 000000005d8c0000 000000000002e000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000605a0000 00000000000ad000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1387) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000005fb90000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000001f660000 00000000002cd000 C:\WINDOWS\system32\nvcuda.dll (30.0.15.1165) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_37\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 30.0.15.1165
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.6.99 driver
Product Version : 30.0.15.1165
ModLoad: 000000006daa0000 00000000016a0000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_31a2adf8c49e7799\nvcuda64.dll (30.0.15.1165) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_37\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 30.0.15.1165
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.6.99 driver
Product Version : 30.0.15.1165
ModLoad: 0000000056970000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000568b0000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.906 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.906
ModLoad: 0000000054440000 000000000014a000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : drvstore.pdb
File Version : 10.0.19041.1320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1320
ModLoad: 000000005d8b0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000004d270000 0000000000768000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.15.1165) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_37\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 30.0.15.1165
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 30.0.15.1165
ModLoad: 000000005ea20000 0000000000082000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.1415 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1415
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 3603, Write: 308, Other 613
- I/O Transfers Counters -
Read: 6600750, Write: 6063, Other 28176
- Paged Pool Usage -
QuotaPagedPoolUsage: 3447888, QuotaPeakPagedPoolUsage: 3447888
QuotaNonPagedPoolUsage: 37392, QuotaPeakNonPagedPoolUsage: 37392
- Virtual Memory Usage -
VirtualSize: -1234616320, PeakVirtualSize: -648183808
- Pagefile Usage -
PagefileUsage: -1234616320, PeakPagefileUsage: -1234616320
- Working Set Size -
WorkingSetSize: 1222578176, PeakWorkingSetSize: 1222582272, PageFaultCount: 423903
*** Dump of thread ID 4356 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 5625000.000000, User Time: 15000000.000000, Wait Time: 4547826.000000
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FF95EAE4F69
- Registers -
rax=0000000028395cc8 rbx=000000003b654910 rcx=0000000000000000 rdx=0000000060e75b00 rsi=0000000028396530 rdi=0000000019930520
r8=0000000028395cf0 r9=0000000028395d18 r10=0000000000000004 r11=0000000028395d28 r12=00000000c55d2b70 r13=0000000028396740
r14=00000000e0582ca0 r15=0000000000000000 rip=000000005eae4f69 rsp=00000000283963d0 rbp=00000000283966c0
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000206
- Callstack -
ChildEBP RetAddr Args to Child
283964a0 3b56a884 00000040 0000004f c55d2400 00000560 KERNELBASE!RaiseException+0x0
28396500 3b311ca6 00000001 00000000 ed54aa88 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
283965b0 3b31593b 00000000 00000030 00000020 00000008 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
28396700 3b311a78 00000000 00000000 28396a30 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
283967d0 3b311cfc 28396a30 00000000 00000080 28396d00 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
28396890 3b31c4dd 28396d00 28396d00 28396d00 28396d00 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
28396b80 3b30b2fe 28397198 28396d00 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
283af920 3b54c6f8 889188d0 00000000 00000000 88583ad0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
283af960 5f137034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
283af990 60ea2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
283afa10 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 12360 (state: Waiting): ***
- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 4547415.000000
- Registers -
rax=00000000000001d3 rbx=0000000086e46530 rcx=0000000000000070 rdx=0000000086e461b0 rsi=0000000086e44330 rdi=0000000086e46530
r8=0000000056975008 r9=00000000286ff0f0 r10=00000000569700f0 r11=0000000000000001 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000060ef07c4 rsp=00000000286ff648 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
286ff640 60ea2dc7 00000000 00000000 86e44330 86e46530 ntdll!ZwWaitForWorkViaWorkerFactory+0x0
286ff940 5f137034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0
286ff970 60ea2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
286ff9f0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 21468 (state: Waiting): ***
- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 4547415.000000
- Registers -
rax=00000000000001d3 rbx=0000000086e469b0 rcx=0000000000000070 rdx=0000000086e46630 rsi=0000000086e44330 rdi=0000000086e469b0
r8=00000000287fee70 r9=0000000086e44934 r10=000000000000006c r11=00000000287fec70 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000060ef07c4 rsp=00000000287ff708 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
287ff700 60ea2dc7 00000000 00000000 86e44330 86e469b0 ntdll!ZwWaitForWorkViaWorkerFactory+0x0
287ffa00 5f137034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0
287ffa30 60ea2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
287ffab0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 10616 (state: Waiting): ***
- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 4547415.000000
- Registers -
rax=00000000000001d3 rbx=0000000086e47340 rcx=0000000000000070 rdx=0000000086e46fc0 rsi=0000000086e44330 rdi=0000000086e47340
r8=0000000000000008 r9=0000000000000040 r10=00000000000001c0 r11=0000000000000800 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000060ef07c4 rsp=00000000288ffb28 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
288ffb20 60ea2dc7 00000000 00000000 86e44330 86e47340 ntdll!ZwWaitForWorkViaWorkerFactory+0x0
288ffe20 5f137034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0
288ffe50 60ea2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
288ffed0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 22376 (state: Waiting): ***
- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 4547825.000000
- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=0000000028affa00 rsi=0000000000000000 rdi=0000000000000064
r8=0000000028aff9d8 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000060eed3f4 rsp=0000000028aff9d8 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
28aff9d0 5eaf962e 28affa98 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0
28affa70 3b32a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0
28affaa0 5f137034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
28affad0 60ea2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
28affb50 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 5520 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 4547822.000000
- Registers -
rax=000000000000005b rbx=000000000000000e rcx=000000000000000e rdx=0000000028bff620 rsi=0000000000000000 rdi=000000000000000e
r8=0000000028bff2c8 r9=0000000088988ec0 r10=0000000000000000 r11=0000000028bff590 r12=0000000000000064 r13=0000000028bff620
r14=0000000028bff320 r15=0000000000000000 rip=0000000060eed8c4 rsp=0000000028bff2c8 rbp=0000000088988ec0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
28bff2c0 5eafcb20 00000000 284f3000 60fba4d0 284f3000 ntdll!ZwWaitForMultipleObjects+0x0
28bff5b0 5eafca1e 86e53620 004e0049 0000000e 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
28bff5f0 6dc7d554 8898b860 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0
28bff830 6dd258cd 00000000 88988ec0 00000000 00000000 nvcuda64!+0x0
28bff8e0 6dc7cf23 73a07cfb 71c971ef 88f7e3b0 00000000 nvcuda64!cuProfilerStop+0x0
28bff910 6dfb44c4 88f7e3b0 00000000 00000000 00000000 nvcuda64!+0x0
28bff940 5f137034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
28bff970 60ea2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
28bff9f0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 6544 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 4547675.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=000000000000029c rdx=0000000000000000 rsi=0000000000000000 rdi=000000000000029c
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=00000000889d5040 r13=0000000000000000
r14=000000000000029c r15=0000000000000000 rip=0000000060eecdf4 rsp=0000000028cff9e8 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
28cff9e0 5ead1a5e 00000000 00001f80 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0
28cffa80 6dea5d0e 88f7ed70 00000000 00000000 0000029c KERNELBASE!WaitForSingleObjectEx+0x0
28cffcc0 6dc7cf23 00000000 88f7ed70 6daa0000 88a0acd0 nvcuda64!cuProfilerStop+0x0
28cffcf0 6dfb44c4 88f7ed70 00000000 00000000 00000000 nvcuda64!+0x0
28cffd20 5f137034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
28cffd50 60ea2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
28cffdd0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)