Task 5335454
| Name | ParityMachine-1622598620-19492-2_1 |
| Workunit | 3200164 |
| Created | 14 Jun 2021, 1:22:44 UTC |
| Sent | 14 Jun 2021, 2:29:49 UTC |
| Report deadline | 21 Jun 2021, 2:29:49 UTC |
| Received | 25 Jul 2021, 4:42:46 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 197 (0x000000C5) EXIT_TIME_LIMIT_EXCEEDED |
| Computer ID | 11527 |
| Run time | 9 hours 0 min 1 sec |
| CPU time | 8 hours 2 min 17 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 3,198.18 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 2.10 GB |
| Peak swap size | 4.00 GB |
| Peak disk usage | 1.53 GB |
Stderr output
<core_client_version>7.14.3</core_client_version>
<![CDATA[
<message>
exceeded elapsed time limit 32398.71 (4000000.00G/123.46G)</message>
<stderr_txt>
| Time: 2380.33 ms
[2021-07-03 21:20:16 main:574] : INFO : Epoch 143 | loss: 0.0311274 | val_loss: 0.031149 | Time: 2686.57 ms
[2021-07-03 21:20:19 main:574] : INFO : Epoch 144 | loss: 0.0311243 | val_loss: 0.0311509 | Time: 2568.03 ms
[2021-07-03 21:20:22 main:574] : INFO : Epoch 145 | loss: 0.0311232 | val_loss: 0.0311517 | Time: 2748.42 ms
[2021-07-03 21:20:24 main:574] : INFO : Epoch 146 | loss: 0.0311234 | val_loss: 0.0311535 | Time: 2668.84 ms
[2021-07-03 21:20:27 main:574] : INFO : Epoch 147 | loss: 0.0311235 | val_loss: 0.0311511 | Time: 2396.27 ms
[2021-07-03 21:20:30 main:574] : INFO : Epoch 148 | loss: 0.0311243 | val_loss: 0.0311508 | Time: 2389.78 ms
[2021-07-03 21:20:32 main:574] : INFO : Epoch 149 | loss: 0.0311242 | val_loss: 0.0311526 | Time: 2526.59 ms
[2021-07-03 21:20:35 main:574] : INFO : Epoch 150 | loss: 0.0311251 | val_loss: 0.0311497 | Time: 2867.68 ms
[2021-07-03 21:20:38 main:574] : INFO : Epoch 151 | loss: 0.0311271 | val_loss: 0.0311554 | Time: 2895.39 ms
[2021-07-03 21:20:41 main:574] : INFO : Epoch 152 | loss: 0.0311235 | val_loss: 0.0311521 | Time: 2894.54 ms
[2021-07-03 21:20:44 main:574] : INFO : Epoch 153 | loss: 0.0311224 | val_loss: 0.0311549 | Time: 2805.71 ms
[2021-07-03 21:20:47 main:574] : INFO : Epoch 154 | loss: 0.0311269 | val_loss: 0.031155 | Time: 2594.19 ms
[2021-07-03 21:20:50 main:574] : INFO : Epoch 155 | loss: 0.0311245 | val_loss: 0.0311505 | Time: 2933.22 ms
[2021-07-03 21:20:53 main:574] : INFO : Epoch 156 | loss: 0.0311225 | val_loss: 0.0311527 | Time: 2611.95 ms
[2021-07-03 21:20:55 main:574] : INFO : Epoch 157 | loss: 0.0311244 | val_loss: 0.0311521 | Time: 2650.33 ms
[2021-07-03 21:20:58 main:574] : INFO : Epoch 158 | loss: 0.031122 | val_loss: 0.0311514 | Time: 2727.2 ms
[2021-07-03 21:21:01 main:574] : INFO : Epoch 159 | loss: 0.0311215 | val_loss: 0.0311529 | Time: 2589.02 ms
[2021-07-03 21:21:04 main:574] : INFO : Epoch 160 | loss: 0.0311293 | val_loss: 0.0311582 | Time: 2529.14 ms
[2021-07-03 21:21:06 main:574] : INFO : Epoch 161 | loss: 0.0311289 | val_loss: 0.03116 | Time: 2380.26 ms
[2021-07-03 21:21:09 main:574] : INFO : Epoch 162 | loss: 0.0311285 | val_loss: 0.0311572 | Time: 2663.81 ms
[2021-07-03 21:21:12 main:574] : INFO : Epoch 163 | loss: 0.0311225 | val_loss: 0.0311527 | Time: 2962.87 ms
[2021-07-03 21:21:15 main:574] : INFO : Epoch 164 | loss: 0.031124 | val_loss: 0.0311551 | Time: 2759.95 ms
[2021-07-03 21:21:18 main:574] : INFO : Epoch 165 | loss: 0.031122 | val_loss: 0.0311533 | Time: 2679.87 ms
[2021-07-03 21:21:20 main:574] : INFO : Epoch 166 | loss: 0.0311223 | val_loss: 0.0311529 | Time: 2465.58 ms
[2021-07-03 21:21:23 main:574] : INFO : Epoch 167 | loss: 0.0311226 | val_loss: 0.0311534 | Time: 2609.74 ms
[2021-07-03 21:21:26 main:574] : INFO : Epoch 168 | loss: 0.0311215 | val_loss: 0.0311563 | Time: 2613.02 ms
[2021-07-03 21:21:29 main:574] : INFO : Epoch 169 | loss: 0.0311225 | val_loss: 0.0311525 | Time: 2892.47 ms
[2021-07-03 21:21:32 main:574] : INFO : Epoch 170 | loss: 0.0311225 | val_loss: 0.0311594 | Time: 2710.66 ms
[2021-07-03 21:21:34 main:574] : INFO : Epoch 171 | loss: 0.0311248 | val_loss: 0.0311531 | Time: 2282.97 ms
[2021-07-03 21:21:36 main:574] : INFO : Epoch 172 | loss: 0.0311221 | val_loss: 0.0311518 | Time: 2301.35 ms
[2021-07-03 21:21:39 main:574] : INFO : Epoch 173 | loss: 0.0311196 | val_loss: 0.0311519 | Time: 2399.5 ms
[2021-07-03 21:21:42 main:574] : INFO : Epoch 174 | loss: 0.0311225 | val_loss: 0.0311513 | Time: 2661.83 ms
[2021-07-03 21:21:44 main:574] : INFO : Epoch 175 | loss: 0.0311202 | val_loss: 0.0311596 | Time: 2411.73 ms
[2021-07-03 21:21:47 main:574] : INFO : Epoch 176 | loss: 0.0311246 | val_loss: 0.0311599 | Time: 2639.15 ms
[2021-07-03 21:21:50 main:574] : INFO : Epoch 177 | loss: 0.0311223 | val_loss: 0.0311565 | Time: 2261.76 ms
[2021-07-03 21:21:52 main:574] : INFO : Epoch 178 | loss: 0.0311212 | val_loss: 0.0311536 | Time: 2553.24 ms
[2021-07-03 21:21:55 main:574] : INFO : Epoch 179 | loss: 0.0311192 | val_loss: 0.0311548 | Time: 2611.18 ms
[2021-07-03 21:21:57 main:574] : INFO : Epoch 180 | loss: 0.0311195 | val_loss: 0.0311572 | Time: 2288.71 ms
[2021-07-03 21:22:00 main:574] : INFO : Epoch 181 | loss: 0.0311259 | val_loss: 0.0311621 | Time: 2183.1 ms
[2021-07-03 21:22:02 main:574] : INFO : Epoch 182 | loss: 0.0311367 | val_loss: 0.0311588 | Time: 2400.21 ms
[2021-07-03 21:22:05 main:574] : INFO : Epoch 183 | loss: 0.0311239 | val_loss: 0.0311539 | Time: 2902.07 ms
[2021-07-03 21:22:08 main:574] : INFO : Epoch 184 | loss: 0.0311191 | val_loss: 0.0311519 | Time: 2507.63 ms
[2021-07-03 21:22:10 main:574] : INFO : Epoch 185 | loss: 0.0311179 | val_loss: 0.0311539 | Time: 2242.38 ms
[2021-07-03 21:22:13 main:574] : INFO : Epoch 186 | loss: 0.031119 | val_loss: 0.0311528 | Time: 2277.42 ms
[2021-07-03 21:22:15 main:574] : INFO : Epoch 187 | loss: 0.0311286 | val_loss: 0.0311504 | Time: 2580.07 ms
[2021-07-03 21:22:18 main:574] : INFO : Epoch 188 | loss: 0.0311292 | val_loss: 0.0311526 | Time: 2495.95 ms
[2021-07-03 21:22:21 main:574] : INFO : Epoch 189 | loss: 0.0311249 | val_loss: 0.0311487 | Time: 2553.48 ms
[2021-07-03 21:22:24 main:574] : INFO : Epoch 190 | loss: 0.0311236 | val_loss: 0.0311498 | Time: 2605.45 ms
[2021-07-03 21:22:27 main:574] : INFO : Epoch 191 | loss: 0.0311261 | val_loss: 0.0311485 | Time: 2647.47 ms
[2021-07-03 21:22:29 main:574] : INFO : Epoch 192 | loss: 0.0311247 | val_loss: 0.0311506 | Time: 2689.47 ms
[2021-07-03 21:22:33 main:574] : INFO : Epoch 193 | loss: 0.0311225 | val_loss: 0.0311527 | Time: 3148.07 ms
[2021-07-03 21:22:35 main:574] : INFO : Epoch 194 | loss: 0.0311199 | val_loss: 0.0311517 | Time: 2496.8 ms
[2021-07-03 21:22:39 main:574] : INFO : Epoch 195 | loss: 0.031121 | val_loss: 0.0311479 | Time: 3511.36 ms
[2021-07-03 21:22:43 main:574] : INFO : Epoch 196 | loss: 0.0311192 | val_loss: 0.0311502 | Time: 3458.79 ms
[2021-07-03 21:22:45 main:574] : INFO : Epoch 197 | loss: 0.0311196 | val_loss: 0.0311518 | Time: 2596.74 ms
[2021-07-03 21:22:49 main:574] : INFO : Epoch 198 | loss: 0.0311201 | val_loss: 0.0311562 | Time: 3239.16 ms
[2021-07-03 21:22:52 main:574] : INFO : Epoch 199 | loss: 0.0311199 | val_loss: 0.0311521 | Time: 2828.27 ms
[2021-07-03 21:22:55 main:574] : INFO : Epoch 200 | loss: 0.0311192 | val_loss: 0.0311496 | Time: 2547.1 ms
[2021-07-03 21:22:58 main:574] : INFO : Epoch 201 | loss: 0.0311162 | val_loss: 0.0311536 | Time: 3363.14 ms
[2021-07-03 21:23:01 main:574] : INFO : Epoch 202 | loss: 0.0311169 | val_loss: 0.031153 | Time: 2705.51 ms
[2021-07-03 21:23:04 main:574] : INFO : Epoch 203 | loss: 0.0311168 | val_loss: 0.0311526 | Time: 2943.65 ms
[2021-07-03 21:23:07 main:574] : INFO : Epoch 204 | loss: 0.0311164 | val_loss: 0.0311534 | Time: 2859.69 ms
[2021-07-03 21:23:10 main:574] : INFO : Epoch 205 | loss: 0.0311159 | val_loss: 0.0311522 | Time: 2543.14 ms
[2021-07-03 21:23:13 main:574] : INFO : Epoch 206 | loss: 0.0311159 | val_loss: 0.0311501 | Time: 3362.17 ms
[2021-07-03 21:23:16 main:574] : INFO : Epoch 207 | loss: 0.0311212 | val_loss: 0.0311515 | Time: 2391.43 ms
[2021-07-03 21:23:19 main:574] : INFO : Epoch 208 | loss: 0.031117 | val_loss: 0.0311492 | Time: 3056.07 ms
[2021-07-03 21:23:22 main:574] : INFO : Epoch 209 | loss: 0.0311159 | val_loss: 0.0311558 | Time: 2720.48 ms
[2021-07-03 21:23:25 main:574] : INFO : Epoch 210 | loss: 0.0311142 | val_loss: 0.0311559 | Time: 2618.41 ms
[2021-07-03 21:23:28 main:574] : INFO : Epoch 211 | loss: 0.031117 | val_loss: 0.0311528 | Time: 3253.62 ms
[2021-07-03 21:23:31 main:574] : INFO : Epoch 212 | loss: 0.0311172 | val_loss: 0.0311569 | Time: 2419.31 ms
[2021-07-03 21:23:34 main:574] : INFO : Epoch 213 | loss: 0.0311169 | val_loss: 0.0311554 | Time: 3084.8 ms
[2021-07-03 21:23:37 main:574] : INFO : Epoch 214 | loss: 0.0311163 | val_loss: 0.0311537 | Time: 2652.95 ms
[2021-07-03 21:23:40 main:574] : INFO : Epoch 215 | loss: 0.0311153 | val_loss: 0.031151 | Time: 2657.9 ms
[2021-07-03 21:23:43 main:574] : INFO : Epoch 216 | loss: 0.0311163 | val_loss: 0.0311609 | Time: 3190.2 ms
[2021-07-03 21:23:46 main:574] : INFO : Epoch 217 | loss: 0.0311162 | val_loss: 0.0311557 | Time: 2463.3 ms
[2021-07-03 21:23:49 main:574] : INFO : Epoch 218 | loss: 0.0311142 | val_loss: 0.0311554 | Time: 3115.47 ms
[2021-07-03 21:23:52 main:574] : INFO : Epoch 219 | loss: 0.0311142 | val_loss: 0.0311566 | Time: 2549.03 ms
[2021-07-03 21:23:55 main:574] : INFO : Epoch 220 | loss: 0.0311117 | val_loss: 0.0311539 | Time: 2740.73 ms
[2021-07-03 21:23:58 main:574] : INFO : Epoch 221 | loss: 0.0311148 | val_loss: 0.0311648 | Time: 3025.37 ms
[2021-07-03 21:24:00 main:574] : INFO : Epoch 222 | loss: 0.0311161 | val_loss: 0.0311565 | Time: 2385.65 ms
[2021-07-03 21:24:04 main:574] : INFO : Epoch 223 | loss: 0.0311146 | val_loss: 0.0311547 | Time: 3227.68 ms
[2021-07-03 21:24:06 main:574] : INFO : Epoch 224 | loss: 0.0311147 | val_loss: 0.0311563 | Time: 2438.14 ms
[2021-07-03 21:24:09 main:574] : INFO : Epoch 225 | loss: 0.0311163 | val_loss: 0.0311546 | Time: 2952.32 ms
[2021-07-03 21:24:12 main:574] : INFO : Epoch 226 | loss: 0.0311149 | val_loss: 0.031154 | Time: 2813.93 ms
[2021-07-03 21:24:15 main:574] : INFO : Epoch 227 | loss: 0.0311146 | val_loss: 0.0311547 | Time: 2442.43 ms
[2021-07-03 21:24:18 main:574] : INFO : Epoch 228 | loss: 0.031117 | val_loss: 0.0311564 | Time: 3338.78 ms
[2021-07-03 21:24:21 main:574] : INFO : Epoch 229 | loss: 0.0311173 | val_loss: 0.0311523 | Time: 2606.86 ms
[2021-07-03 21:24:24 main:574] : INFO : Epoch 230 | loss: 0.0311161 | val_loss: 0.0311516 | Time: 3014.24 ms
[2021-07-03 21:24:27 main:574] : INFO : Epoch 231 | loss: 0.0311192 | val_loss: 0.0311594 | Time: 2758.72 ms
[2021-07-03 21:24:30 main:574] : INFO : Epoch 232 | loss: 0.0311174 | val_loss: 0.0311578 | Time: 2500.01 ms
[2021-07-03 21:24:33 main:574] : INFO : Epoch 233 | loss: 0.0311174 | val_loss: 0.031151 | Time: 3166.58 ms
[2021-07-03 21:24:36 main:574] : INFO : Epoch 234 | loss: 0.0311147 | val_loss: 0.0311547 | Time: 2452.17 ms
[2021-07-03 21:24:39 main:574] : INFO : Epoch 235 | loss: 0.0311146 | val_loss: 0.0311531 | Time: 3124.6 ms
[2021-07-03 21:24:42 main:574] : INFO : Epoch 236 | loss: 0.0311138 | val_loss: 0.0311543 | Time: 2605.83 ms
[2021-07-03 21:24:45 main:574] : INFO : Epoch 237 | loss: 0.0311113 | val_loss: 0.0311518 | Time: 2742.38 ms
[2021-07-03 21:24:48 main:574] : INFO : Epoch 238 | loss: 0.0311125 | val_loss: 0.031156 | Time: 3035.99 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 1650)
[2021-07-04 13:39:29 main:435] : INFO : Set logging level to 1
[2021-07-04 13:39:29 main:441] : INFO : Running in BOINC Client mode
[2021-07-04 13:39:29 main:444] : INFO : Resolving all filenames
[2021-07-04 13:39:29 main:452] : INFO : Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 (exists = 1)
[2021-07-04 13:39:29 main:452] : INFO : Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityMachine-1622598620-19492-2_1_r428382114_1 (exists = 1)
[2021-07-04 13:39:29 main:452] : INFO : Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityMachine-1622598620-19492-2_1_r428382114_0 (exists = 0)
[2021-07-04 13:39:29 main:452] : INFO : Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityMachine-1622598620-19492-2 (exists = 1)
[2021-07-04 13:39:30 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2021-07-04 13:39:30 main:472] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5
[2021-07-04 13:39:30 main:474] : INFO : Configuration:
[2021-07-04 13:39:30 main:475] : INFO : Model type: GRU
[2021-07-04 13:39:30 main:476] : INFO : Validation Loss Threshold: 0.0001
[2021-07-04 13:39:30 main:477] : INFO : Max Epochs: 2048
[2021-07-04 13:39:30 main:478] : INFO : Batch Size: 128
[2021-07-04 13:39:30 main:479] : INFO : Learning Rate: 0.01
[2021-07-04 13:39:30 main:480] : INFO : Patience: 10
[2021-07-04 13:39:30 main:481] : INFO : Hidden Width: 12
[2021-07-04 13:39:30 main:482] : INFO : # Recurrent Layers: 4
[2021-07-04 13:39:30 main:483] : INFO : # Backend Layers: 4
[2021-07-04 13:39:30 main:484] : INFO : # Threads: 1
[2021-07-04 13:39:30 main:486] : INFO : Preparing Dataset
[2021-07-04 13:39:30 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 into memory
[2021-07-04 13:39:32 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 into memory
[2021-07-04 13:39:47 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2021-07-04 13:39:47 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 into memory
[2021-07-04 13:39:47 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 into memory
[2021-07-04 13:39:47 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2021-07-04 13:39:47 main:494] : INFO : Creating Model
[2021-07-04 13:39:48 main:507] : INFO : Preparing config file
[2021-07-04 13:39:48 main:511] : INFO : Found checkpoint, attempting to load...
[2021-07-04 13:39:48 main:512] : INFO : Loading config
[2021-07-04 13:39:48 main:514] : INFO : Loading state
[2021-07-04 13:40:12 main:559] : INFO : Loading DataLoader into Memory
[2021-07-04 13:40:12 main:562] : INFO : Starting Training
[2021-07-04 13:40:17 main:574] : INFO : Epoch 236 | loss: 0.0312632 | val_loss: 0.0311884 | Time: 4739.47 ms
[2021-07-04 13:40:20 main:574] : INFO : Epoch 237 | loss: 0.0311358 | val_loss: 0.0311498 | Time: 2211.63 ms
[2021-07-04 13:40:21 main:574] : INFO : Epoch 238 | loss: 0.0311192 | val_loss: 0.0311541 | Time: 1873.29 ms
[2021-07-04 13:40:23 main:574] : INFO : Epoch 239 | loss: 0.0311157 | val_loss: 0.031149 | Time: 1903.6 ms
[2021-07-04 13:40:26 main:574] : INFO : Epoch 240 | loss: 0.0311132 | val_loss: 0.0311513 | Time: 1974.69 ms
[2021-07-04 13:40:27 main:574] : INFO : Epoch 241 | loss: 0.0311125 | val_loss: 0.0311516 | Time: 1888.12 ms
[2021-07-04 13:40:30 main:574] : INFO : Epoch 242 | loss: 0.0311149 | val_loss: 0.0311564 | Time: 1948.37 ms
[2021-07-04 13:40:31 main:574] : INFO : Epoch 243 | loss: 0.0311179 | val_loss: 0.0311527 | Time: 1827.86 ms
[2021-07-04 13:40:33 main:574] : INFO : Epoch 244 | loss: 0.0311147 | val_loss: 0.0311504 | Time: 1923.65 ms
[2021-07-04 13:40:35 main:574] : INFO : Epoch 245 | loss: 0.031111 | val_loss: 0.0311469 | Time: 1925.44 ms
[2021-07-04 13:40:38 main:574] : INFO : Epoch 246 | loss: 0.0311104 | val_loss: 0.0311494 | Time: 1947.88 ms
[2021-07-04 13:40:40 main:574] : INFO : Epoch 247 | loss: 0.0311107 | val_loss: 0.0311525 | Time: 1967.71 ms
[2021-07-04 13:40:42 main:574] : INFO : Epoch 248 | loss: 0.0311112 | val_loss: 0.0311517 | Time: 1949.62 ms
[2021-07-04 13:40:44 main:574] : INFO : Epoch 249 | loss: 0.0311098 | val_loss: 0.0311534 | Time: 1888.24 ms
[2021-07-04 13:40:46 main:574] : INFO : Epoch 250 | loss: 0.0311101 | val_loss: 0.0311531 | Time: 1997.45 ms
[2021-07-04 13:40:48 main:574] : INFO : Epoch 251 | loss: 0.0311081 | val_loss: 0.0311506 | Time: 1890.21 ms
[2021-07-04 13:40:50 main:574] : INFO : Epoch 252 | loss: 0.0311079 | val_loss: 0.0311532 | Time: 1962.72 ms
[2021-07-04 13:40:52 main:574] : INFO : Epoch 253 | loss: 0.0311085 | val_loss: 0.0311553 | Time: 1877.95 ms
[2021-07-04 13:40:54 main:574] : INFO : Epoch 254 | loss: 0.0311139 | val_loss: 0.031155 | Time: 1840.04 ms
[2021-07-04 13:40:56 main:574] : INFO : Epoch 255 | loss: 0.0311109 | val_loss: 0.031156 | Time: 1899.13 ms
[2021-07-04 13:40:58 main:574] : INFO : Epoch 256 | loss: 0.0311158 | val_loss: 0.0311529 | Time: 1977.07 ms
[2021-07-04 13:41:00 main:574] : INFO : Epoch 257 | loss: 0.0311102 | val_loss: 0.0311537 | Time: 1899.05 ms
[2021-07-04 13:41:02 main:574] : INFO : Epoch 258 | loss: 0.03111 | val_loss: 0.0311555 | Time: 1870.96 ms
[2021-07-04 13:41:04 main:574] : INFO : Epoch 259 | loss: 0.03111 | val_loss: 0.0311564 | Time: 1850.95 ms
[2021-07-04 13:41:06 main:574] : INFO : Epoch 260 | loss: 0.0311107 | val_loss: 0.0311539 | Time: 1907.46 ms
[2021-07-04 13:41:08 main:574] : INFO : Epoch 261 | loss: 0.0311094 | val_loss: 0.0311545 | Time: 1909.16 ms
[2021-07-04 13:41:10 main:574] : INFO : Epoch 262 | loss: 0.0311091 | val_loss: 0.0311528 | Time: 1905.03 ms
[2021-07-04 13:41:11 main:574] : INFO : Epoch 263 | loss: 0.0311096 | val_loss: 0.0311549 | Time: 1864.76 ms
[2021-07-04 13:41:13 main:574] : INFO : Epoch 264 | loss: 0.03111 | val_loss: 0.0311591 | Time: 1866.73 ms
[2021-07-04 13:41:16 main:574] : INFO : Epoch 265 | loss: 0.0311148 | val_loss: 0.0311536 | Time: 1980.19 ms
[2021-07-04 13:41:17 main:574] : INFO : Epoch 266 | loss: 0.0311133 | val_loss: 0.0311527 | Time: 1908.01 ms
[2021-07-04 13:41:19 main:574] : INFO : Epoch 267 | loss: 0.0311134 | val_loss: 0.0311545 | Time: 1874.78 ms
[2021-07-04 13:41:21 main:574] : INFO : Epoch 268 | loss: 0.0311138 | val_loss: 0.0311543 | Time: 1878.69 ms
[2021-07-04 13:41:23 main:574] : INFO : Epoch 269 | loss: 0.0311158 | val_loss: 0.0311532 | Time: 1910.24 ms
[2021-07-04 13:41:25 main:574] : INFO : Epoch 270 | loss: 0.0311114 | val_loss: 0.0311541 | Time: 1926.81 ms
[2021-07-04 13:41:27 main:574] : INFO : Epoch 271 | loss: 0.031112 | val_loss: 0.0311565 | Time: 1927.43 ms
[2021-07-04 13:41:29 main:574] : INFO : Epoch 272 | loss: 0.0311105 | val_loss: 0.0311521 | Time: 1886.46 ms
[2021-07-04 13:41:31 main:574] : INFO : Epoch 273 | loss: 0.0311098 | val_loss: 0.0311503 | Time: 1895.73 ms
[2021-07-04 13:41:33 main:574] : INFO : Epoch 274 | loss: 0.031108 | val_loss: 0.0311615 | Time: 1917.09 ms
[2021-07-04 13:41:35 main:574] : INFO : Epoch 275 | loss: 0.031111 | val_loss: 0.0311573 | Time: 1967.44 ms
[2021-07-04 13:41:37 main:574] : INFO : Epoch 276 | loss: 0.0311119 | val_loss: 0.0311527 | Time: 1889.9 ms
[2021-07-04 13:41:39 main:574] : INFO : Epoch 277 | loss: 0.0311078 | val_loss: 0.0311548 | Time: 1843.32 ms
[2021-07-04 13:41:41 main:574] : INFO : Epoch 278 | loss: 0.0311068 | val_loss: 0.0311568 | Time: 1894.3 ms
[2021-07-04 13:41:44 main:574] : INFO : Epoch 279 | loss: 0.0311062 | val_loss: 0.0311551 | Time: 2762.62 ms
[2021-07-04 13:41:46 main:574] : INFO : Epoch 280 | loss: 0.0311061 | val_loss: 0.0311558 | Time: 2249.31 ms
[2021-07-04 13:41:49 main:574] : INFO : Epoch 281 | loss: 0.0311083 | val_loss: 0.0311521 | Time: 2121 ms
[2021-07-04 13:41:51 main:574] : INFO : Epoch 282 | loss: 0.0311075 | val_loss: 0.0311543 | Time: 2118.49 ms
[2021-07-04 13:41:53 main:574] : INFO : Epoch 283 | loss: 0.0311097 | val_loss: 0.0311574 | Time: 2198.94 ms
[2021-07-04 13:41:55 main:574] : INFO : Epoch 284 | loss: 0.03111 | val_loss: 0.0311524 | Time: 2115.2 ms
[2021-07-04 13:41:58 main:574] : INFO : Epoch 285 | loss: 0.0311156 | val_loss: 0.0311537 | Time: 2157.22 ms
[2021-07-04 13:42:00 main:574] : INFO : Epoch 286 | loss: 0.0311118 | val_loss: 0.0311591 | Time: 2040.63 ms
[2021-07-04 13:42:02 main:574] : INFO : Epoch 287 | loss: 0.0311057 | val_loss: 0.0311555 | Time: 1998.04 ms
[2021-07-04 13:42:04 main:574] : INFO : Epoch 288 | loss: 0.0311057 | val_loss: 0.0311585 | Time: 2088.49 ms
[2021-07-04 13:42:06 main:574] : INFO : Epoch 289 | loss: 0.0311048 | val_loss: 0.0311571 | Time: 2131.19 ms
[2021-07-04 13:42:09 main:574] : INFO : Epoch 290 | loss: 0.0311059 | val_loss: 0.0311525 | Time: 2200.94 ms
[2021-07-04 13:42:11 main:574] : INFO : Epoch 291 | loss: 0.0311096 | val_loss: 0.0311509 | Time: 2140.55 ms
[2021-07-04 13:42:13 main:574] : INFO : Epoch 292 | loss: 0.0311053 | val_loss: 0.0311586 | Time: 2093.15 ms
[2021-07-04 13:42:15 main:574] : INFO : Epoch 293 | loss: 0.0311063 | val_loss: 0.0311551 | Time: 2248.62 ms
[2021-07-04 13:42:17 main:574] : INFO : Epoch 294 | loss: 0.0311084 | val_loss: 0.0311621 | Time: 2097.25 ms
[2021-07-04 13:42:20 main:574] : INFO : Epoch 295 | loss: 0.0311073 | val_loss: 0.0311562 | Time: 2133.59 ms
[2021-07-04 13:42:22 main:574] : INFO : Epoch 296 | loss: 0.0311063 | val_loss: 0.0311593 | Time: 2097.6 ms
[2021-07-04 13:42:24 main:574] : INFO : Epoch 297 | loss: 0.0311075 | val_loss: 0.0311555 | Time: 2421.57 ms
[2021-07-04 13:42:27 main:574] : INFO : Epoch 298 | loss: 0.0311091 | val_loss: 0.031153 | Time: 2224.12 ms
[2021-07-04 13:42:29 main:574] : INFO : Epoch 299 | loss: 0.0311119 | val_loss: 0.0311498 | Time: 2193.47 ms
[2021-07-04 13:42:31 main:574] : INFO : Epoch 300 | loss: 0.0311097 | val_loss: 0.031154 | Time: 2033.6 ms
[2021-07-04 13:42:33 main:574] : INFO : Epoch 301 | loss: 0.0311094 | val_loss: 0.0311518 | Time: 2124.1 ms
[2021-07-04 13:42:36 main:574] : INFO : Epoch 302 | loss: 0.0311069 | val_loss: 0.0311536 | Time: 2057.51 ms
[2021-07-04 13:42:38 main:574] : INFO : Epoch 303 | loss: 0.0311096 | val_loss: 0.031165 | Time: 1966.45 ms
[2021-07-04 13:42:40 main:574] : INFO : Epoch 304 | loss: 0.0311259 | val_loss: 0.0311542 | Time: 1870.88 ms
[2021-07-04 13:42:42 main:574] : INFO : Epoch 305 | loss: 0.0311223 | val_loss: 0.0311542 | Time: 1880.47 ms
[2021-07-04 13:42:44 main:574] : INFO : Epoch 306 | loss: 0.031114 | val_loss: 0.0311526 | Time: 2179.72 ms
[2021-07-04 13:42:46 main:574] : INFO : Epoch 307 | loss: 0.0311159 | val_loss: 0.0311533 | Time: 2187.36 ms
[2021-07-04 13:42:51 main:574] : INFO : Epoch 308 | loss: 0.0311143 | val_loss: 0.031152 | Time: 4348.83 ms
[2021-07-04 13:42:55 main:574] : INFO : Epoch 309 | loss: 0.0311127 | val_loss: 0.031153 | Time: 4281.9 ms
[2021-07-04 13:42:58 main:574] : INFO : Epoch 310 | loss: 0.0311189 | val_loss: 0.0311552 | Time: 2991.27 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 1650)
[2021-07-24 16:58:16 main:435] : INFO : Set logging level to 1
[2021-07-24 16:58:16 main:441] : INFO : Running in BOINC Client mode
[2021-07-24 16:58:17 main:444] : INFO : Resolving all filenames
[2021-07-24 16:58:17 main:452] : INFO : Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 (exists = 1)
[2021-07-24 16:58:17 main:452] : INFO : Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityMachine-1622598620-19492-2_1_r428382114_1 (exists = 1)
[2021-07-24 16:58:18 main:452] : INFO : Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityMachine-1622598620-19492-2_1_r428382114_0 (exists = 0)
[2021-07-24 16:58:18 main:452] : INFO : Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityMachine-1622598620-19492-2 (exists = 1)
[2021-07-24 16:58:18 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2021-07-24 16:58:18 main:472] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5
[2021-07-24 16:58:19 main:474] : INFO : Configuration:
[2021-07-24 16:58:19 main:475] : INFO : Model type: GRU
[2021-07-24 16:58:19 main:476] : INFO : Validation Loss Threshold: 0.0001
[2021-07-24 16:58:19 main:477] : INFO : Max Epochs: 2048
[2021-07-24 16:58:19 main:478] : INFO : Batch Size: 128
[2021-07-24 16:58:20 main:479] : INFO : Learning Rate: 0.01
[2021-07-24 16:58:20 main:480] : INFO : Patience: 10
[2021-07-24 16:58:20 main:481] : INFO : Hidden Width: 12
[2021-07-24 16:58:20 main:482] : INFO : # Recurrent Layers: 4
[2021-07-24 16:58:20 main:483] : INFO : # Backend Layers: 4
[2021-07-24 16:58:20 main:484] : INFO : # Threads: 1
[2021-07-24 16:58:20 main:486] : INFO : Preparing Dataset
[2021-07-24 16:58:21 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 into memory
[2021-07-24 16:58:36 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 into memory
[2021-07-24 16:59:10 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2021-07-24 16:59:10 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 into memory
[2021-07-24 16:59:10 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 into memory
[2021-07-24 16:59:10 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2021-07-24 16:59:11 main:494] : INFO : Creating Model
[2021-07-24 16:59:11 main:507] : INFO : Preparing config file
[2021-07-24 16:59:11 main:511] : INFO : Found checkpoint, attempting to load...
[2021-07-24 16:59:12 main:512] : INFO : Loading config
[2021-07-24 16:59:13 main:514] : INFO : Loading state
[2021-07-24 16:59:36 main:559] : INFO : Loading DataLoader into Memory
[2021-07-24 16:59:36 main:562] : INFO : Starting Training
[2021-07-24 16:59:43 main:574] : INFO : Epoch 309 | loss: 0.0312392 | val_loss: 0.0311667 | Time: 7009.33 ms
[2021-07-24 16:59:47 main:574] : INFO : Epoch 310 | loss: 0.0311266 | val_loss: 0.0311563 | Time: 3468.8 ms
[2021-07-24 16:59:50 main:574] : INFO : Epoch 311 | loss: 0.0311118 | val_loss: 0.0311566 | Time: 3238.97 ms
[2021-07-24 16:59:54 main:574] : INFO : Epoch 312 | loss: 0.0311119 | val_loss: 0.0311558 | Time: 3645.43 ms
[2021-07-24 16:59:57 main:574] : INFO : Epoch 313 | loss: 0.0311131 | val_loss: 0.0311543 | Time: 3143.35 ms
[2021-07-24 17:00:01 main:574] : INFO : Epoch 314 | loss: 0.0311075 | val_loss: 0.0311584 | Time: 3035.67 ms
[2021-07-24 17:00:05 main:574] : INFO : Epoch 315 | loss: 0.0311066 | val_loss: 0.0311546 | Time: 3995.99 ms
[2021-07-24 17:00:08 main:574] : INFO : Epoch 316 | loss: 0.0311047 | val_loss: 0.0311565 | Time: 3300.68 ms
[2021-07-24 17:00:11 main:574] : INFO : Epoch 317 | loss: 0.0311051 | val_loss: 0.0311555 | Time: 2914.62 ms
[2021-07-24 17:00:15 main:574] : INFO : Epoch 318 | loss: 0.0311049 | val_loss: 0.031157 | Time: 3804.6 ms
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFA24759142
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 07/25/21 01:41:32
Install Directory :
Data Directory : D:\BOINC
Project Symstore :
LoadLibraryA( D:\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( D:\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( D:\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( D:\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: D:\BOINC\slots\8;D:\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 0000000037020000 00000000003df000 D:\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000269d0000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema Operacional Microsoft® Windows®
Product Version : 10.0.19041.1100
ModLoad: 000000001efa0000 0000000000013000 D:\Arquivos de Programas\Avast\aswhook.dll (21.5.6354.0) (-nosymbols- Symbols Loaded)
Linked PDB Filename : D:\work\616216c47067779c\idp\build\avgast\RU_NTDLL-lH-Y2A!x64_vs142\bin\Release_Unicode_NTDLL_vs142\x64\aswhook.pdb
File Version : 21.5.6354.0
Company Name : AVAST Software
Product Name : Avast
Product Version : 21.5.6354.0
ModLoad: 0000000026320000 00000000000bd000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema Operacional Microsoft® Windows®
Product Version : 10.0.19041.1100
ModLoad: 0000000024690000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema Operacional Microsoft® Windows®
Product Version : 10.0.19041.1100
ModLoad: 00000000266d0000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema Operacional Microsoft® Windows®
Product Version : 10.0.19041.1100
ModLoad: 0000000024a10000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1052) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.1052 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1052
ModLoad: 0000000024a40000 000000000002a000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.746) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.746 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.746
ModLoad: 0000000024580000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.928) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.928 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.928
ModLoad: 00000000244e0000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 00000000243b0000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 00000000263e0000 00000000000ac000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1052) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema Operacional Microsoft® Windows®
Product Version : 10.0.19041.1100
ModLoad: 0000000025100000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.19041.546
ModLoad: 0000000026870000 000000000009b000 C:\WINDOWS\System32\sechost.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000251a0000 000000000012b000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1052) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema Operacional Microsoft® Windows®
Product Version : 10.0.19041.1100
ModLoad: 00000000d8cc0000 0000000000058000 D:\BOINC\slots\8\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000f5400000 000000000008d000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.28.29910.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\9\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.28.29910.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.28.29910.0
ModLoad: 0000000021920000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.867 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.867
ModLoad: 00000000f8ba0000 000000000001a000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.28.29910.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\9\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.28.29910.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.28.29910.0
ModLoad: 00000000f8b90000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.28.29910.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\9\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.28.29910.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.28.29910.0
ModLoad: 000000007ec30000 0000000024b49000 D:\BOINC\slots\8\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000074040000 000000000abe7000 D:\BOINC\slots\8\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000d8c70000 0000000000045000 D:\BOINC\slots\8\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000a9800000 00000000030a5000 D:\BOINC\slots\8\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 00000000a6340000 00000000034b2000 D:\BOINC\slots\8\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 00000000d8c60000 0000000000010000 D:\BOINC\slots\8\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 0000000067140000 0000000003d5b000 D:\BOINC\slots\8\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 000000006aea0000 000000000919f000 D:\BOINC\slots\8\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 000000004bd90000 000000001b3a4000 D:\BOINC\slots\8\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 00000000d8980000 00000000002db000 D:\BOINC\slots\8\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000cee80000 000000000020d000 D:\BOINC\slots\8\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 00000000d8940000 0000000000040000 D:\BOINC\slots\8\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000049ec0000 0000000001eca000 D:\BOINC\slots\8\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 0000000026560000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000022040000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000024c80000 0000000000469000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.844) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema Operacional Microsoft® Windows®
Product Version : 10.0.19041.1100
ModLoad: 0000000024110000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000244b0000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema Operacional Microsoft® Windows®
Product Version : 10.0.19041.1100
ModLoad: 0000000023ec0000 000000000002c000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000241f0000 0000000000060000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1052) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.1052 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1052
ModLoad: 0000000024250000 000000000015f000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.844) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema Operacional Microsoft® Windows®
Product Version : 10.0.19041.1100
ModLoad: 0000000023d00000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000025620000 000000000073f000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema operacional Microsoft® Windows®
Product Version : 10.0.19041.1100
ModLoad: 0000000022260000 0000000000790000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema Operacional Microsoft® Windows®
Product Version : 10.0.19041.1100
ModLoad: 0000000025d60000 0000000000355000 C:\WINDOWS\System32\combase.dll (6.2.19041.1052) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema Operacional Microsoft® Windows®
Product Version : 10.0.19041.1100
ModLoad: 0000000023b80000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema Operacional Microsoft® Windows®
Product Version : 10.0.19041.1100
ModLoad: 0000000026130000 00000000000ae000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema Operacional Microsoft® Windows®
Product Version : 10.0.19041.1100
ModLoad: 0000000024bf0000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema operacional Microsoft® Windows®
Product Version : 10.0.19041.1100
ModLoad: 00000000dbe00000 000000000029d000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.6231) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r460\r462_23\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 27.21.14.6231
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.2.162 driver
Product Version : 27.21.14.6231
ModLoad: 0000000018df0000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000001c700000 00000000015b8000 C:\WINDOWS\system32\DriverStore\FileRepository\nvdm.inf_amd64_5848d6f3df1e6423\nvcuda64.dll (27.21.14.6231) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r460\r462_23\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 27.21.14.6231
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.2.162 driver
Product Version : 27.21.14.6231
ModLoad: 00000000260c0000 000000000006b000 C:\WINDOWS\System32\WS2_32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : ws2_32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema Operacional Microsoft® Windows®
Product Version : 10.0.19041.1
ModLoad: 0000000018cf0000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.906 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.906
ModLoad: 0000000023ae0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000021750000 000000000009e000 C:\WINDOWS\system32\uxtheme.dll (6.2.19041.746) (-exported- Symbols Loaded)
Linked PDB Filename : UxTheme.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema Operacional Microsoft® Windows®
Product Version : 10.0.19041.1100
ModLoad: 000000000d740000 00000000006f2000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.6231) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r460\r462_23\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 27.21.14.6231
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 27.21.14.6231
ModLoad: 00000000261e0000 000000000012a000 C:\WINDOWS\System32\OLE32.DLL (6.2.19041.746) (-exported- Symbols Loaded)
Linked PDB Filename : ole32.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema Operacional Microsoft® Windows®
Product Version : 10.0.19041.1100
ModLoad: 00000000cdb40000 0000000000009000 D:\BOINC\slots\8\caffe2_nvrtc.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000cc8f0000 0000000000fca000 D:\BOINC\slots\8\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6.14.11.9000
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.89 NVRTC Library
Product Version : 6.14.11.9000
ModLoad: 0000000024160000 0000000000083000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.1023 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1023
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 3648, Write: 357, Other 840
- I/O Transfers Counters -
Read: 6552009, Write: 58397, Other 37254
- Paged Pool Usage -
QuotaPagedPoolUsage: 3540704, QuotaPeakPagedPoolUsage: 3540976
QuotaNonPagedPoolUsage: 59560, QuotaPeakNonPagedPoolUsage: 59824
- Virtual Memory Usage -
VirtualSize: 344866816, PeakVirtualSize: 967069696
- Pagefile Usage -
PagefileUsage: 344866816, PeakPagefileUsage: 344866816
- Working Set Size -
WorkingSetSize: 1140039680, PeakWorkingSetSize: -2034315264, PageFaultCount: 862022
*** Dump of thread ID 4428 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 2025883.000000
- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFA24759142
- Registers -
rax=0000000000000000 rbx=0000000000000001 rcx=00000000372d8c40 rdx=00000000edbfe800 rsi=0000000000000000 rdi=0000000000000000
r8=00000000edbfe800 r9=00000000372d8c30 r10=0000000000000fff r11=0000000000000ff0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000024759142 rsp=00000000edbfe7d8 rbp=0000000000000000
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
edbfe7d0 37059100 00000001 edbfe800 edbfe800 372d8c30 KERNELBASE!DebugBreak+0x0
edbfec10 37059ce4 dd000000 edbfef74 00000000 00000344 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
edbffb70 3705a084 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
edbffba0 26337034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
edbffbd0 26a22651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
edbffc50 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 20412 (state: Running): ***
- Information -
Status: Base Priority: Above Normal, Priority: Above Normal, , Kernel Time: 108281248.000000, User Time: 282028605440.000000, Wait Time: 2025883.000000
- Registers -
rax=000000000006a447 rbx=00000000ed6e5408 rcx=0000000000000000 rdx=00000000b4386364 rsi=000000007b976980 rdi=0000000000000000
r8=000000000280ff83 r9=000000007ffe2000 r10=00000000546c6148 r11=00000000faf309d1 r12=0000000000000001 r13=000000007ee87f20
r14=000000007ee27d20 r15=0000000000000000 rip=000000001cabe831 rsp=00000000ed6e4a80 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
ed6e4b10 1c9b0994 00000028 00000003 b431bf1d b4386364 nvcuda64!cuProfilerStop+0x0
ed6e4b50 1c9b1151 00000000 ed6e4c60 00000001 ed6e4bd8 nvcuda64!cuProfilerStop+0x0
ed6e5340 1c87cdd8 ed6e5390 7ee87f20 ed6e5450 7ee87f20 nvcuda64!cuProfilerStop+0x0
ed6e5580 1c73fb35 40000000 1c87ac2a ed6e0000 00000000 nvcuda64!+0x0
ed6e5630 1c74012b 40000000 7b976990 ed6e5838 ed6e5838 nvcuda64!+0x0
ed6e56c0 1c745ead 7b976980 00000000 22201c00 00000000 nvcuda64!+0x0
ed6e5a40 1c90af6c ccb25c20 00000000 ed6e5e68 79610231 nvcuda64!+0x0
ed6e5b40 7ec40dc0 ed6e5e68 22201c00 00000004 00000000 nvcuda64!cuMemcpyDtoHAsync_v2+0x0
ed6e5c70 7ec323ee 7cb91140 00000000 00000004 00000002 torch_cuda!+0x0
ed6e5cc0 7ec32381 7c8d0860 ed6e5dd1 00000002 ed6e6028 torch_cuda!+0x0
ed6e5d00 7ec35ab0 ed6e5da0 00000038 ed6e6cc8 246ea0cb torch_cuda!+0x0
ed6e5e20 80c10793 ed6e61f0 00000000 ed6e7750 ed6e6228 torch_cuda!+0x0
ed6e5fe0 80c11e02 d8cf9c50 ed6e61f0 ed6e7750 ed6e6280 torch_cuda!at::native::searchsorted_out_cuda+0x0
ed6e61c0 80c1205a 00000001 ed6e6cc8 00000001 ed6e6238 torch_cuda!at::native::searchsorted_out_cuda+0x0
ed6e6200 81a03684 ed6e6280 00000001 ed6e6238 00000001 torch_cuda!at::native::_local_scalar_dense_cuda+0x0
ed6e6250 81a11107 ed6e6370 7962bfac 00000001 ed6e6230 torch_cuda!at::native::set_storage_cuda_+0x0
ed6e62a0 79ac6bbe 7e960640 00000001 ed6e6310 7b512f07 torch_cuda!at::native::set_storage_cuda_+0x0
ed6e64b0 7ad73c5e 00000000 ed6e6cc8 ed6e6cc8 ed6e6860 torch_cpu!at::_local_scalar_dense+0x0
ed6e64f0 79a529c7 ed6e6980 7962bfac ed6e6610 ed6e65c0 torch_cpu!torch::autograd::NotImplemented::~NotImplemented+0x0
ed6e6540 79ac6bbe 7e960640 ed6e6938 00000000 ed6e7750 torch_cpu!at::native::mkldnn_sigmoid_+0x0
ed6e6750 7987dead ed6e66d8 00000001 ed6e69c0 ed6e6860 torch_cpu!at::_local_scalar_dense+0x0
ed6e6910 79bbd1e1 ed6e6948 00000001 ed6e69c0 ed6e6cc8 torch_cpu!at::native::item+0x0
ed6e6960 7add4d4e ed6e69c0 00000001 ed6e6940 d8d11ea8 torch_cpu!at::zeros_out+0x0
ed6e6990 79a529c7 cc3f6cd0 7962bfac cc3f6ce0 d8d11ea8 torch_cpu!torch::autograd::GraphRoot::apply+0x0
ed6e69e0 79bee69e 7e960640 ed6e6a10 7e960640 79c0129f torch_cpu!at::native::mkldnn_sigmoid_+0x0
ed6e6bf0 79bda68e ed6e6d50 798c4e49 ed6e6d10 ed6e6d50 torch_cpu!at::Tensor::item+0x0
ed6e6c40 3703712b ed6e6d10 ed6e6d10 ed6e6d10 ed6e7750 torch_cpu!at::Tensor::item<double>+0x0
ed6e7140 3703b950 ed6e7240 ed6e7240 00000000 5a2b8d80 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0
ed6ffee0 3727c6f8 7b6b81e0 00000000 00000000 7b6cb450 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
ed6fff20 26337034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
ed6fff50 26a22651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
ed6fffd0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 9748 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 2025881.000000
- Registers -
rax=000000000000005b rbx=000000000000000e rcx=000000000000000e rdx=00000000edcff660 rsi=0000000000000000 rdi=000000000000000e
r8=0000000000000001 r9=000000007b845400 r10=0000000000000000 r11=00000000edcff5d0 r12=0000000000000064 r13=00000000edcff660
r14=00000000edcff360 r15=0000000000000000 rip=0000000026a6d974 rsp=00000000edcff308 rbp=000000007b845460
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
edcff300 246dc5a0 00000000 ed51e000 52b8165e ed51e000 ntdll!ZwWaitForMultipleObjects+0x0
edcff5f0 246dc49e 79b923f0 269e693e 0000000e 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
edcff630 1c8b68e4 7b8476e0 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0
edcff870 1c94e8dd 00000000 7b845460 00000000 00000000 nvcuda64!+0x0
edcff920 1c8b62b3 b45ca392 96e14a14 7bfd2890 00000000 nvcuda64!cuProfilerStop+0x0
edcff950 1cbce084 7bfd2890 00000000 00000000 00000000 nvcuda64!+0x0
edcff980 26337034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
edcff9b0 26a22651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
edcffa30 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 19876 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 16162.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002b4 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002b4
r8=00000000eddff6c8 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=00000000000002b4 r15=0000000000000000 rip=0000000026a6cea4 rsp=00000000eddff618 rbp=000000007b8a3080
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
eddff610 246b168e 00000000 00000000 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0
eddff6b0 1cacd58e 7bfd3670 246b9fb5 00000000 000002b4 KERNELBASE!WaitForSingleObjectEx+0x0
eddff720 1c8b62b3 7b8a3080 7ef207c0 7bfd3670 00000000 nvcuda64!cuProfilerStop+0x0
eddff750 1cbce084 7bfd3670 00000000 00000000 00000000 nvcuda64!+0x0
eddff780 26337034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
eddff7b0 26a22651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
eddff830 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 4252 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 2025860.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=000000007bb2efa8 rdx=00000000edeffe78 rsi=00000000edeffde0 rdi=0000000000000000
r8=000000000280ff60 r9=00000000000000e3 r10=00000000000000e3 r11=000000007bec0428 r12=00000000edeffe78 r13=0000000000000000
r14=000000007bb2efa8 r15=000000007b9791a0 rip=0000000026a70814 rsp=00000000edeffdb8 rbp=00000000edeffe10
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
edeffdb0 26a34295 00000102 1c989cae 00000000 edeffde0 ntdll!NtWaitForAlertByThreadId+0x0
edeffe20 246fc849 7b976980 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0
edeffe50 1c834d1c 7b976980 7b976980 7b976980 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0
edeffeb0 1c8b62b3 00000003 b44e580a d0caa313 00000000 nvcuda64!+0x0
edeffee0 1cbce084 7bfd35b0 00000000 00000000 00000000 nvcuda64!+0x0
edefff10 26337034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
edefff40 26a22651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
edefffc0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 19984 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 6406250.000000, User Time: 90312496.000000, Wait Time: 22351.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000aee9b618 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000aee9b618
r8=0000000079d81d40 r9=0000000000000001 r10=0000000000008000 r11=00000000ed8faf50 r12=0000000000000000 r13=0000000000000000
r14=00000000ed8ff740 r15=00000000aee9b5c8 rip=0000000026a70814 rsp=00000000ed8ff718 rbp=00000000ed8ff770
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
ed8ff710 26a34021 ed8ffa10 00000000 ed8ff810 00000000 ntdll!NtWaitForAlertByThreadId+0x0
ed8ff790 246fc8f9 aee9b610 aee9b608 aee9b5c0 7b2205b4 ntdll!RtlSleepConditionVariableSRW+0x0
ed8ff7d0 f5412549 00000000 b93f8b80 00000000 00000000 KERNELBASE!SleepConditionVariableSRW+0x0
ed8ff800 f54127da 0a49ea85 00000000 ed8ffa10 aee9b608 MSVCP140!std::_Winerror_message+0x0
ed8ff830 7b22064b aee9b5c0 ed8ff930 aee9b5c0 b93f8b60 MSVCP140!_Cnd_wait+0x0
ed8ff870 7b2225b1 cf48bba0 ffffffff b93f8b60 ffffffff torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
ed8ffb60 7b222471 7e746d10 ed8ffba0 7e746d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0
ed8ffbb0 7b219744 00080001 cc94e160 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0
ed8ffbe0 243d1bb2 cc94e160 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0
ed8ffc10 26337034 00000000 00000000 00000000 00000000 ucrtbase!_configthreadlocale+0x0
ed8ffc40 26a22651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
ed8ffcc0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)