Task 14595206
| Name | ParityModified-1647048294-3725-3-0_0 |
| Workunit | 11617434 |
| Created | 10 Apr 2022, 9:16:39 UTC |
| Sent | 11 Apr 2022, 3:55:29 UTC |
| Report deadline | 19 Apr 2022, 3:55:29 UTC |
| Received | 12 Apr 2022, 4:13:09 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | -529697949 (0xE06D7363) Unknown error code |
| Computer ID | 6170 |
| Run time | 1 hours 45 min 26 sec |
| CPU time | 1 hours 30 min 51 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 1,130.52 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.62 GB |
| Peak swap size | 3.57 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
main:574] : INFO : Epoch 481 | loss: 0.03122 | val_loss: 0.0312179 | Time: 6444.6 ms
[2022-04-11 19:19:25 main:574] : INFO : Epoch 482 | loss: 0.0312201 | val_loss: 0.0312174 | Time: 6209.45 ms
[2022-04-11 19:19:31 main:574] : INFO : Epoch 483 | loss: 0.0312204 | val_loss: 0.0312175 | Time: 6035.35 ms
[2022-04-11 19:19:37 main:574] : INFO : Epoch 484 | loss: 0.0312199 | val_loss: 0.0312165 | Time: 6047.85 ms
[2022-04-11 19:19:43 main:574] : INFO : Epoch 485 | loss: 0.0312229 | val_loss: 0.0312167 | Time: 6138.98 ms
[2022-04-11 19:19:49 main:574] : INFO : Epoch 486 | loss: 0.0312218 | val_loss: 0.0312224 | Time: 6049.25 ms
[2022-04-11 19:19:55 main:574] : INFO : Epoch 487 | loss: 0.0312224 | val_loss: 0.0312171 | Time: 6202.77 ms
[2022-04-11 19:20:02 main:574] : INFO : Epoch 488 | loss: 0.0312202 | val_loss: 0.0312175 | Time: 6095.72 ms
[2022-04-11 19:20:08 main:574] : INFO : Epoch 489 | loss: 0.03122 | val_loss: 0.0312176 | Time: 6166.49 ms
[2022-04-11 19:20:14 main:574] : INFO : Epoch 490 | loss: 0.0312197 | val_loss: 0.031217 | Time: 6241.05 ms
[2022-04-11 19:20:20 main:574] : INFO : Epoch 491 | loss: 0.0312211 | val_loss: 0.0312164 | Time: 6255.06 ms
[2022-04-11 19:20:27 main:574] : INFO : Epoch 492 | loss: 0.0312205 | val_loss: 0.0312162 | Time: 6187.53 ms
[2022-04-11 19:20:33 main:574] : INFO : Epoch 493 | loss: 0.031219 | val_loss: 0.0312162 | Time: 6213.17 ms
[2022-04-11 19:20:39 main:574] : INFO : Epoch 494 | loss: 0.0312199 | val_loss: 0.031219 | Time: 6282.23 ms
[2022-04-11 19:20:45 main:574] : INFO : Epoch 495 | loss: 0.0312193 | val_loss: 0.031216 | Time: 6171.61 ms
[2022-04-11 19:20:52 main:574] : INFO : Epoch 496 | loss: 0.0312195 | val_loss: 0.0312162 | Time: 6218.7 ms
[2022-04-11 19:20:58 main:574] : INFO : Epoch 497 | loss: 0.0312189 | val_loss: 0.0312156 | Time: 6243.95 ms
[2022-04-11 19:21:04 main:574] : INFO : Epoch 498 | loss: 0.0312197 | val_loss: 0.0312181 | Time: 6218.44 ms
[2022-04-11 19:21:10 main:574] : INFO : Epoch 499 | loss: 0.0312195 | val_loss: 0.0312159 | Time: 6133.78 ms
[2022-04-11 19:21:22 main:574] : INFO : Epoch 500 | loss: 0.0312188 | val_loss: 0.0312167 | Time: 11094.7 ms
[2022-04-11 19:21:29 main:574] : INFO : Epoch 501 | loss: 0.0312208 | val_loss: 0.0312166 | Time: 7162.25 ms
[2022-04-11 19:21:35 main:574] : INFO : Epoch 502 | loss: 0.0312198 | val_loss: 0.0312169 | Time: 6201.09 ms
[2022-04-11 19:21:41 main:574] : INFO : Epoch 503 | loss: 0.031221 | val_loss: 0.0312179 | Time: 6204.51 ms
[2022-04-11 19:21:48 main:574] : INFO : Epoch 504 | loss: 0.031221 | val_loss: 0.0312209 | Time: 6230.68 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GT 1030)
[2022-04-11 19:24:34 main:435] : INFO : Set logging level to 1
[2022-04-11 19:24:34 main:441] : INFO : Running in BOINC Client mode
[2022-04-11 19:24:34 main:444] : INFO : Resolving all filenames
[2022-04-11 19:24:34 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-11 19:24:34 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-11 19:24:34 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-11 19:24:34 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-11 19:24:34 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-11 19:24:34 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-04-11 19:24:34 main:474] : INFO : Configuration:
[2022-04-11 19:24:34 main:475] : INFO : Model type: GRU
[2022-04-11 19:24:34 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-04-11 19:24:34 main:477] : INFO : Max Epochs: 2048
[2022-04-11 19:24:35 main:478] : INFO : Batch Size: 128
[2022-04-11 19:24:35 main:479] : INFO : Learning Rate: 0.01
[2022-04-11 19:24:35 main:480] : INFO : Patience: 10
[2022-04-11 19:24:35 main:481] : INFO : Hidden Width: 12
[2022-04-11 19:24:35 main:482] : INFO : # Recurrent Layers: 4
[2022-04-11 19:24:35 main:483] : INFO : # Backend Layers: 4
[2022-04-11 19:24:35 main:484] : INFO : # Threads: 1
[2022-04-11 19:24:35 main:486] : INFO : Preparing Dataset
[2022-04-11 19:24:35 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-11 19:24:36 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-11 19:24:43 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2022-04-11 19:24:43 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-11 19:24:43 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-11 19:24:44 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2022-04-11 19:24:44 main:494] : INFO : Creating Model
[2022-04-11 19:24:44 main:507] : INFO : Preparing config file
[2022-04-11 19:24:44 main:511] : INFO : Found checkpoint, attempting to load...
[2022-04-11 19:24:44 main:512] : INFO : Loading config
[2022-04-11 19:24:44 main:514] : INFO : Loading state
[2022-04-11 19:24:47 main:559] : INFO : Loading DataLoader into Memory
[2022-04-11 19:24:47 main:562] : INFO : Starting Training
[2022-04-11 19:25:00 main:574] : INFO : Epoch 497 | loss: 0.0313452 | val_loss: 0.0312457 | Time: 12968.1 ms
[2022-04-11 19:25:09 main:574] : INFO : Epoch 498 | loss: 0.0312408 | val_loss: 0.0312274 | Time: 8681.41 ms
[2022-04-11 19:25:23 main:574] : INFO : Epoch 499 | loss: 0.0312243 | val_loss: 0.03122 | Time: 13453.3 ms
[2022-04-11 19:25:33 main:574] : INFO : Epoch 500 | loss: 0.0312218 | val_loss: 0.0312214 | Time: 10013.6 ms
[2022-04-11 19:25:42 main:574] : INFO : Epoch 501 | loss: 0.0312193 | val_loss: 0.0312164 | Time: 8955.07 ms
[2022-04-11 19:25:54 main:574] : INFO : Epoch 502 | loss: 0.0312187 | val_loss: 0.0312177 | Time: 11988 ms
[2022-04-11 19:26:02 main:574] : INFO : Epoch 503 | loss: 0.0312178 | val_loss: 0.0312152 | Time: 8548.32 ms
[2022-04-11 19:26:10 main:574] : INFO : Epoch 504 | loss: 0.0312165 | val_loss: 0.0312171 | Time: 7368.11 ms
[2022-04-11 19:26:17 main:574] : INFO : Epoch 505 | loss: 0.0312172 | val_loss: 0.0312157 | Time: 7041.27 ms
[2022-04-11 19:26:24 main:574] : INFO : Epoch 506 | loss: 0.0312183 | val_loss: 0.0312151 | Time: 6901.34 ms
[2022-04-11 19:26:31 main:574] : INFO : Epoch 507 | loss: 0.0312179 | val_loss: 0.0312153 | Time: 7012.29 ms
[2022-04-11 19:26:38 main:574] : INFO : Epoch 508 | loss: 0.0312175 | val_loss: 0.0312168 | Time: 6823.09 ms
[2022-04-11 19:26:44 main:574] : INFO : Epoch 509 | loss: 0.0312176 | val_loss: 0.0312172 | Time: 6712.48 ms
[2022-04-11 19:26:51 main:574] : INFO : Epoch 510 | loss: 0.0312189 | val_loss: 0.0312179 | Time: 6594.29 ms
[2022-04-11 19:26:58 main:574] : INFO : Epoch 511 | loss: 0.0312219 | val_loss: 0.0312192 | Time: 6773.94 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GT 1030)
[2022-04-11 19:31:39 main:435] : INFO : Set logging level to 1
[2022-04-11 19:31:39 main:441] : INFO : Running in BOINC Client mode
[2022-04-11 19:31:39 main:444] : INFO : Resolving all filenames
[2022-04-11 19:31:39 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-11 19:31:39 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-11 19:31:39 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-11 19:31:39 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-11 19:31:39 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-11 19:31:39 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-04-11 19:31:39 main:474] : INFO : Configuration:
[2022-04-11 19:31:39 main:475] : INFO : Model type: GRU
[2022-04-11 19:31:39 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-04-11 19:31:39 main:477] : INFO : Max Epochs: 2048
[2022-04-11 19:31:39 main:478] : INFO : Batch Size: 128
[2022-04-11 19:31:40 main:479] : INFO : Learning Rate: 0.01
[2022-04-11 19:31:40 main:480] : INFO : Patience: 10
[2022-04-11 19:31:40 main:481] : INFO : Hidden Width: 12
[2022-04-11 19:31:40 main:482] : INFO : # Recurrent Layers: 4
[2022-04-11 19:31:40 main:483] : INFO : # Backend Layers: 4
[2022-04-11 19:31:40 main:484] : INFO : # Threads: 1
[2022-04-11 19:31:40 main:486] : INFO : Preparing Dataset
[2022-04-11 19:31:40 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-11 19:31:41 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-11 19:31:48 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2022-04-11 19:31:48 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-11 19:31:48 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-11 19:31:49 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2022-04-11 19:31:49 main:494] : INFO : Creating Model
[2022-04-11 19:31:49 main:507] : INFO : Preparing config file
[2022-04-11 19:31:49 main:511] : INFO : Found checkpoint, attempting to load...
[2022-04-11 19:31:49 main:512] : INFO : Loading config
[2022-04-11 19:31:49 main:514] : INFO : Loading state
[2022-04-11 19:31:52 main:559] : INFO : Loading DataLoader into Memory
[2022-04-11 19:31:52 main:562] : INFO : Starting Training
[2022-04-11 19:32:08 main:574] : INFO : Epoch 510 | loss: 0.0314535 | val_loss: 0.031228 | Time: 15465.4 ms
[2022-04-11 19:32:17 main:574] : INFO : Epoch 511 | loss: 0.0312451 | val_loss: 0.0312299 | Time: 9799.57 ms
[2022-04-11 19:32:26 main:574] : INFO : Epoch 512 | loss: 0.0312244 | val_loss: 0.0312191 | Time: 8732.43 ms
[2022-04-11 19:32:33 main:574] : INFO : Epoch 513 | loss: 0.0312205 | val_loss: 0.0312181 | Time: 7197.5 ms
[2022-04-11 19:32:45 main:574] : INFO : Epoch 514 | loss: 0.0312192 | val_loss: 0.0312167 | Time: 11978.6 ms
[2022-04-11 19:32:55 main:574] : INFO : Epoch 515 | loss: 0.0312177 | val_loss: 0.0312156 | Time: 9392.93 ms
[2022-04-11 19:33:03 main:574] : INFO : Epoch 516 | loss: 0.0312175 | val_loss: 0.0312152 | Time: 8321.25 ms
[2022-04-11 19:33:10 main:574] : INFO : Epoch 517 | loss: 0.0312222 | val_loss: 0.0312225 | Time: 7058.34 ms
[2022-04-11 19:33:17 main:574] : INFO : Epoch 518 | loss: 0.0312255 | val_loss: 0.0312209 | Time: 6673.01 ms
[2022-04-11 19:33:29 main:574] : INFO : Epoch 519 | loss: 0.0312231 | val_loss: 0.0312202 | Time: 11927.5 ms
[2022-04-11 19:33:38 main:574] : INFO : Epoch 520 | loss: 0.0312217 | val_loss: 0.0312191 | Time: 9179.58 ms
[2022-04-11 19:33:46 main:574] : INFO : Epoch 521 | loss: 0.0312207 | val_loss: 0.0312188 | Time: 7493.67 ms
[2022-04-11 19:33:59 main:574] : INFO : Epoch 522 | loss: 0.0312243 | val_loss: 0.0312227 | Time: 13176.4 ms
[2022-04-11 19:34:08 main:574] : INFO : Epoch 523 | loss: 0.0312304 | val_loss: 0.0312216 | Time: 9202.73 ms
[2022-04-11 19:34:16 main:574] : INFO : Epoch 524 | loss: 0.0312263 | val_loss: 0.0312209 | Time: 7623.16 ms
[2022-04-11 19:34:30 main:574] : INFO : Epoch 525 | loss: 0.0312237 | val_loss: 0.0312208 | Time: 13401.5 ms
[2022-04-11 19:34:40 main:574] : INFO : Epoch 526 | loss: 0.0312269 | val_loss: 0.0312369 | Time: 10091.2 ms
[2022-04-11 19:34:48 main:574] : INFO : Epoch 527 | loss: 0.0312335 | val_loss: 0.0312278 | Time: 8440.45 ms
[2022-04-11 19:34:55 main:574] : INFO : Epoch 528 | loss: 0.0312326 | val_loss: 0.0312286 | Time: 7164.01 ms
[2022-04-11 19:35:08 main:574] : INFO : Epoch 529 | loss: 0.0312342 | val_loss: 0.0312276 | Time: 12477.5 ms
[2022-04-11 19:35:18 main:574] : INFO : Epoch 530 | loss: 0.0312337 | val_loss: 0.0312274 | Time: 9657.18 ms
[2022-04-11 19:35:30 main:574] : INFO : Epoch 531 | loss: 0.0312328 | val_loss: 0.0312273 | Time: 12316.4 ms
[2022-04-11 19:35:42 main:574] : INFO : Epoch 532 | loss: 0.0312331 | val_loss: 0.0312266 | Time: 11918.7 ms
[2022-04-11 19:35:53 main:574] : INFO : Epoch 533 | loss: 0.0312336 | val_loss: 0.0312283 | Time: 11290.1 ms
[2022-04-11 19:36:01 main:574] : INFO : Epoch 534 | loss: 0.031236 | val_loss: 0.03123 | Time: 7762.65 ms
[2022-04-11 19:36:09 main:574] : INFO : Epoch 535 | loss: 0.0312345 | val_loss: 0.031234 | Time: 7590.19 ms
[2022-04-11 19:36:20 main:574] : INFO : Epoch 536 | loss: 0.0312356 | val_loss: 0.0312269 | Time: 11525.5 ms
[2022-04-11 19:36:28 main:574] : INFO : Epoch 537 | loss: 0.031233 | val_loss: 0.0312282 | Time: 7511.68 ms
[2022-04-11 19:36:35 main:574] : INFO : Epoch 538 | loss: 0.0312335 | val_loss: 0.0312277 | Time: 6521.49 ms
[2022-04-11 19:36:41 main:574] : INFO : Epoch 539 | loss: 0.0312335 | val_loss: 0.0312315 | Time: 6509.96 ms
[2022-04-11 19:36:47 main:574] : INFO : Epoch 540 | loss: 0.0312336 | val_loss: 0.0312288 | Time: 6248.75 ms
[2022-04-11 19:36:54 main:574] : INFO : Epoch 541 | loss: 0.0312337 | val_loss: 0.0312275 | Time: 6404.04 ms
[2022-04-11 19:37:06 main:574] : INFO : Epoch 542 | loss: 0.0312329 | val_loss: 0.0312273 | Time: 12062.9 ms
[2022-04-11 19:37:16 main:574] : INFO : Epoch 543 | loss: 0.0312333 | val_loss: 0.0312272 | Time: 9375.44 ms
[2022-04-11 19:37:23 main:574] : INFO : Epoch 544 | loss: 0.0312336 | val_loss: 0.0312279 | Time: 7868.13 ms
[2022-04-11 19:37:31 main:574] : INFO : Epoch 545 | loss: 0.0312331 | val_loss: 0.0312273 | Time: 7895.16 ms
[2022-04-11 19:37:39 main:574] : INFO : Epoch 546 | loss: 0.0312339 | val_loss: 0.0312283 | Time: 7390.56 ms
[2022-04-11 19:37:52 main:574] : INFO : Epoch 547 | loss: 0.0312336 | val_loss: 0.0312286 | Time: 12911.6 ms
[2022-04-11 19:38:02 main:574] : INFO : Epoch 548 | loss: 0.0312331 | val_loss: 0.0312276 | Time: 10596.6 ms
[2022-04-11 19:38:15 main:574] : INFO : Epoch 549 | loss: 0.0312334 | val_loss: 0.0312295 | Time: 12083.2 ms
[2022-04-11 19:38:25 main:574] : INFO : Epoch 550 | loss: 0.0312341 | val_loss: 0.0312287 | Time: 10014.6 ms
[2022-04-11 19:38:34 main:574] : INFO : Epoch 551 | loss: 0.0312328 | val_loss: 0.031228 | Time: 9728.98 ms
[2022-04-11 19:38:44 main:574] : INFO : Epoch 552 | loss: 0.031233 | val_loss: 0.0312268 | Time: 9921.47 ms
[2022-04-11 19:38:54 main:574] : INFO : Epoch 553 | loss: 0.0312325 | val_loss: 0.0312293 | Time: 9879.46 ms
[2022-04-11 19:39:05 main:574] : INFO : Epoch 554 | loss: 0.0312332 | val_loss: 0.0312307 | Time: 10143.5 ms
[2022-04-11 19:39:15 main:574] : INFO : Epoch 555 | loss: 0.0312322 | val_loss: 0.0312302 | Time: 9983.38 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GT 1030)
[2022-04-11 19:41:47 main:435] : INFO : Set logging level to 1
[2022-04-11 19:41:47 main:441] : INFO : Running in BOINC Client mode
[2022-04-11 19:41:47 main:444] : INFO : Resolving all filenames
[2022-04-11 19:41:47 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-11 19:41:47 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-11 19:41:47 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-11 19:41:47 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-11 19:41:47 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-11 19:41:47 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-04-11 19:41:47 main:474] : INFO : Configuration:
[2022-04-11 19:41:47 main:475] : INFO : Model type: GRU
[2022-04-11 19:41:47 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-04-11 19:41:47 main:477] : INFO : Max Epochs: 2048
[2022-04-11 19:41:48 main:478] : INFO : Batch Size: 128
[2022-04-11 19:41:48 main:479] : INFO : Learning Rate: 0.01
[2022-04-11 19:41:48 main:480] : INFO : Patience: 10
[2022-04-11 19:41:48 main:481] : INFO : Hidden Width: 12
[2022-04-11 19:41:48 main:482] : INFO : # Recurrent Layers: 4
[2022-04-11 19:41:48 main:483] : INFO : # Backend Layers: 4
[2022-04-11 19:41:48 main:484] : INFO : # Threads: 1
[2022-04-11 19:41:48 main:486] : INFO : Preparing Dataset
[2022-04-11 19:41:48 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-11 19:41:49 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-11 19:41:56 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2022-04-11 19:41:57 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-11 19:41:57 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-11 19:41:57 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2022-04-11 19:41:57 main:494] : INFO : Creating Model
[2022-04-11 19:41:57 main:507] : INFO : Preparing config file
[2022-04-11 19:41:57 main:511] : INFO : Found checkpoint, attempting to load...
[2022-04-11 19:41:58 main:512] : INFO : Loading config
[2022-04-11 19:41:58 main:514] : INFO : Loading state
[2022-04-11 19:42:01 main:559] : INFO : Loading DataLoader into Memory
[2022-04-11 19:42:01 main:562] : INFO : Starting Training
[2022-04-11 19:42:15 main:574] : INFO : Epoch 555 | loss: 0.0313745 | val_loss: 0.0312431 | Time: 14232.1 ms
[2022-04-11 19:42:28 main:574] : INFO : Epoch 556 | loss: 0.0312533 | val_loss: 0.0312356 | Time: 12863.3 ms
[2022-04-11 19:42:42 main:574] : INFO : Epoch 557 | loss: 0.031239 | val_loss: 0.0312313 | Time: 14104.7 ms
[2022-04-11 19:42:55 main:574] : INFO : Epoch 558 | loss: 0.0312364 | val_loss: 0.0312305 | Time: 12121.7 ms
[2022-04-11 19:43:09 main:574] : INFO : Epoch 559 | loss: 0.0312341 | val_loss: 0.0312278 | Time: 13899 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GT 1030)
[2022-04-11 19:47:29 main:435] : INFO : Set logging level to 1
[2022-04-11 19:47:29 main:441] : INFO : Running in BOINC Client mode
[2022-04-11 19:47:29 main:444] : INFO : Resolving all filenames
[2022-04-11 19:47:29 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-11 19:47:29 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-11 19:47:29 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-11 19:47:29 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-11 19:47:29 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-11 19:47:29 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-04-11 19:47:29 main:474] : INFO : Configuration:
[2022-04-11 19:47:29 main:475] : INFO : Model type: GRU
[2022-04-11 19:47:29 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-04-11 19:47:29 main:477] : INFO : Max Epochs: 2048
[2022-04-11 19:47:29 main:478] : INFO : Batch Size: 128
[2022-04-11 19:47:29 main:479] : INFO : Learning Rate: 0.01
[2022-04-11 19:47:29 main:480] : INFO : Patience: 10
[2022-04-11 19:47:29 main:481] : INFO : Hidden Width: 12
[2022-04-11 19:47:30 main:482] : INFO : # Recurrent Layers: 4
[2022-04-11 19:47:30 main:483] : INFO : # Backend Layers: 4
[2022-04-11 19:47:30 main:484] : INFO : # Threads: 1
[2022-04-11 19:47:30 main:486] : INFO : Preparing Dataset
[2022-04-11 19:47:30 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-11 19:47:31 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-11 19:47:38 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2022-04-11 19:47:38 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-11 19:47:39 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-11 19:47:39 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2022-04-11 19:47:39 main:494] : INFO : Creating Model
[2022-04-11 19:47:39 main:507] : INFO : Preparing config file
[2022-04-11 19:47:39 main:511] : INFO : Found checkpoint, attempting to load...
[2022-04-11 19:47:39 main:512] : INFO : Loading config
[2022-04-11 19:47:39 main:514] : INFO : Loading state
[2022-04-11 19:47:42 main:559] : INFO : Loading DataLoader into Memory
[2022-04-11 19:47:42 main:562] : INFO : Starting Training
[2022-04-11 19:47:57 main:574] : INFO : Epoch 559 | loss: 0.0314347 | val_loss: 0.0312592 | Time: 15057.2 ms
[2022-04-11 19:48:10 main:574] : INFO : Epoch 560 | loss: 0.0312511 | val_loss: 0.0312385 | Time: 13003.1 ms
[2022-04-11 19:48:20 main:574] : INFO : Epoch 561 | loss: 0.0312335 | val_loss: 0.0312376 | Time: 9562.94 ms
[2022-04-11 19:48:28 main:574] : INFO : Epoch 562 | loss: 0.0312321 | val_loss: 0.0312332 | Time: 7673.53 ms
[2022-04-11 19:48:35 main:574] : INFO : Epoch 563 | loss: 0.0312311 | val_loss: 0.0312332 | Time: 7854.6 ms
[2022-04-11 19:48:48 main:574] : INFO : Epoch 564 | loss: 0.0312307 | val_loss: 0.0312333 | Time: 12518 ms
[2022-04-11 19:49:01 main:574] : INFO : Epoch 565 | loss: 0.0312333 | val_loss: 0.0312346 | Time: 13107 ms
[2022-04-11 19:49:11 main:574] : INFO : Epoch 566 | loss: 0.0312331 | val_loss: 0.0312335 | Time: 9616.81 ms
[2022-04-11 19:49:24 main:574] : INFO : Epoch 567 | loss: 0.0312326 | val_loss: 0.0312336 | Time: 13039.6 ms
[2022-04-11 19:49:35 main:574] : INFO : Epoch 568 | loss: 0.031236 | val_loss: 0.0312361 | Time: 10542.4 ms
[2022-04-11 19:49:43 main:574] : INFO : Epoch 569 | loss: 0.0312381 | val_loss: 0.0312358 | Time: 8098.05 ms
[2022-04-11 19:49:56 main:574] : INFO : Epoch 570 | loss: 0.0312363 | val_loss: 0.0312348 | Time: 13219 ms
[2022-04-11 19:50:06 main:574] : INFO : Epoch 571 | loss: 0.0312364 | val_loss: 0.0312392 | Time: 10427.4 ms
[2022-04-11 19:50:19 main:574] : INFO : Epoch 572 | loss: 0.0312376 | val_loss: 0.0312347 | Time: 12258.3 ms
[2022-04-11 19:50:28 main:574] : INFO : Epoch 573 | loss: 0.0312357 | val_loss: 0.0312377 | Time: 9432.44 ms
[2022-04-11 19:50:40 main:574] : INFO : Epoch 574 | loss: 0.0312363 | val_loss: 0.0312342 | Time: 11673.6 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GT 1030)
[2022-04-11 19:53:18 main:435] : INFO : Set logging level to 1
[2022-04-11 19:53:18 main:441] : INFO : Running in BOINC Client mode
[2022-04-11 19:53:18 main:444] : INFO : Resolving all filenames
[2022-04-11 19:53:18 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-11 19:53:18 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-11 19:53:18 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-11 19:53:18 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-11 19:53:18 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-11 19:53:18 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-04-11 19:53:18 main:474] : INFO : Configuration:
[2022-04-11 19:53:18 main:475] : INFO : Model type: GRU
[2022-04-11 19:53:18 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-04-11 19:53:18 main:477] : INFO : Max Epochs: 2048
[2022-04-11 19:53:18 main:478] : INFO : Batch Size: 128
[2022-04-11 19:53:18 main:479] : INFO : Learning Rate: 0.01
[2022-04-11 19:53:18 main:480] : INFO : Patience: 10
[2022-04-11 19:53:18 main:481] : INFO : Hidden Width: 12
[2022-04-11 19:53:18 main:482] : INFO : # Recurrent Layers: 4
[2022-04-11 19:53:18 main:483] : INFO : # Backend Layers: 4
[2022-04-11 19:53:18 main:484] : INFO : # Threads: 1
[2022-04-11 19:53:19 main:486] : INFO : Preparing Dataset
[2022-04-11 19:53:19 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-11 19:53:20 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-11 19:53:27 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2022-04-11 19:53:27 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-11 19:53:27 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-11 19:53:28 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2022-04-11 19:53:28 main:494] : INFO : Creating Model
[2022-04-11 19:53:28 main:507] : INFO : Preparing config file
[2022-04-11 19:53:28 main:511] : INFO : Found checkpoint, attempting to load...
[2022-04-11 19:53:28 main:512] : INFO : Loading config
[2022-04-11 19:53:28 main:514] : INFO : Loading state
[2022-04-11 19:53:31 main:559] : INFO : Loading DataLoader into Memory
[2022-04-11 19:53:31 main:562] : INFO : Starting Training
[2022-04-11 19:53:46 main:574] : INFO : Epoch 570 | loss: 0.0314475 | val_loss: 0.0312653 | Time: 14988.9 ms
[2022-04-11 19:53:56 main:574] : INFO : Epoch 571 | loss: 0.0312594 | val_loss: 0.0312525 | Time: 10076.1 ms
[2022-04-11 19:54:08 main:574] : INFO : Epoch 572 | loss: 0.0312469 | val_loss: 0.0312428 | Time: 12046.5 ms
[2022-04-11 19:54:16 main:574] : INFO : Epoch 573 | loss: 0.0312429 | val_loss: 0.0312415 | Time: 7643.37 ms
[2022-04-11 19:54:29 main:574] : INFO : Epoch 574 | loss: 0.0312424 | val_loss: 0.0312408 | Time: 13190.4 ms
[2022-04-11 19:54:41 main:574] : INFO : Epoch 575 | loss: 0.0312418 | val_loss: 0.0312415 | Time: 11400.1 ms
[2022-04-11 19:54:49 main:574] : INFO : Epoch 576 | loss: 0.0312439 | val_loss: 0.0312459 | Time: 8125.84 ms
[2022-04-11 19:55:01 main:574] : INFO : Epoch 577 | loss: 0.0312458 | val_loss: 0.0312458 | Time: 12034.6 ms
[2022-04-11 19:55:10 main:574] : INFO : Epoch 578 | loss: nan | val_loss: nan | Time: 9057.23 ms
[2022-04-11 19:55:22 main:574] : INFO : Epoch 579 | loss: nan | val_loss: nan | Time: 11882.3 ms
[2022-04-11 19:55:30 main:574] : INFO : Epoch 580 | loss: nan | val_loss: nan | Time: 8001.12 ms
[2022-04-11 19:55:42 main:574] : INFO : Epoch 581 | loss: nan | val_loss: nan | Time: 11949.5 ms
[2022-04-11 19:55:54 main:574] : INFO : Epoch 582 | loss: nan | val_loss: nan | Time: 12105.6 ms
[2022-04-11 19:56:03 main:574] : INFO : Epoch 583 | loss: nan | val_loss: nan | Time: 8344.78 ms
[2022-04-11 19:56:10 main:574] : INFO : Epoch 584 | loss: nan | val_loss: nan | Time: 7150.38 ms
[2022-04-11 19:56:17 main:574] : INFO : Epoch 585 | loss: nan | val_loss: nan | Time: 6752.03 ms
[2022-04-11 19:56:23 main:574] : INFO : Epoch 586 | loss: nan | val_loss: nan | Time: 6843.63 ms
[2022-04-11 19:56:30 main:574] : INFO : Epoch 587 | loss: nan | val_loss: nan | Time: 6592.44 ms
[2022-04-11 19:56:37 main:574] : INFO : Epoch 588 | loss: nan | val_loss: nan | Time: 6400.66 ms
[2022-04-11 19:56:43 main:574] : INFO : Epoch 589 | loss: nan | val_loss: nan | Time: 6053.63 ms
[2022-04-11 19:56:55 main:574] : INFO : Epoch 590 | loss: nan | val_loss: nan | Time: 12474.1 ms
[2022-04-11 19:57:08 main:574] : INFO : Epoch 591 | loss: nan | val_loss: nan | Time: 12162.3 ms
[2022-04-11 19:57:21 main:574] : INFO : Epoch 592 | loss: nan | val_loss: nan | Time: 13012.5 ms
[2022-04-11 19:57:31 main:574] : INFO : Epoch 593 | loss: nan | val_loss: nan | Time: 10055.9 ms
[2022-04-11 19:57:43 main:574] : INFO : Epoch 594 | loss: nan | val_loss: nan | Time: 11991.2 ms
[2022-04-11 19:57:56 main:574] : INFO : Epoch 595 | loss: nan | val_loss: nan | Time: 12899.2 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GT 1030)
[2022-04-11 20:10:58 main:435] : INFO : Set logging level to 1
[2022-04-11 20:10:58 main:441] : INFO : Running in BOINC Client mode
[2022-04-11 20:10:58 main:444] : INFO : Resolving all filenames
[2022-04-11 20:10:58 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-11 20:10:58 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-11 20:10:58 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-11 20:10:58 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-11 20:10:58 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-11 20:10:58 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-04-11 20:10:58 main:474] : INFO : Configuration:
[2022-04-11 20:10:58 main:475] : INFO : Model type: GRU
[2022-04-11 20:10:58 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-04-11 20:10:58 main:477] : INFO : Max Epochs: 2048
[2022-04-11 20:10:58 main:478] : INFO : Batch Size: 128
[2022-04-11 20:10:58 main:479] : INFO : Learning Rate: 0.01
[2022-04-11 20:10:59 main:480] : INFO : Patience: 10
[2022-04-11 20:10:59 main:481] : INFO : Hidden Width: 12
[2022-04-11 20:10:59 main:482] : INFO : # Recurrent Layers: 4
[2022-04-11 20:10:59 main:483] : INFO : # Backend Layers: 4
[2022-04-11 20:10:59 main:484] : INFO : # Threads: 1
[2022-04-11 20:10:59 main:486] : INFO : Preparing Dataset
[2022-04-11 20:10:59 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-11 20:11:00 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-11 20:11:06 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2022-04-11 20:11:06 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-11 20:11:07 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-11 20:11:07 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2022-04-11 20:11:07 main:494] : INFO : Creating Model
[2022-04-11 20:11:07 main:507] : INFO : Preparing config file
[2022-04-11 20:11:07 main:511] : INFO : Found checkpoint, attempting to load...
[2022-04-11 20:11:07 main:512] : INFO : Loading config
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFA54D24F69
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 04/11/22 20:11:07
Install Directory : C:\Program Files\BOINC\
Data Directory : C:\ProgramData\BOINC
Project Symstore :
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\2;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 0000000003cf0000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000575d0000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 0000000056cb0000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 0000000054cf0000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 0000000057100000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000055050000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1586) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1586
ModLoad: 00000000559a0000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.1202 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1202
ModLoad: 0000000055390000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 000000004a4c0000 0000000000058000 C:\ProgramData\BOINC\slots\2\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000551f0000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 0000000055290000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 00000000572a0000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000056f30000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.19041.546
ModLoad: 0000000055a50000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.1586) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000557f0000 0000000000125000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000003ded0000 0000000000099000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.24.28127.4) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.24.28127.4 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.24.28127.4
ModLoad: 00000000479d0000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.867 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.867
ModLoad: 000000003deb0000 0000000000017000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.24.28127.4) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.24.28127.4 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.24.28127.4
ModLoad: 0000000050f10000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.24.28127.4) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.24.28127.4 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.24.28127.4
ModLoad: 00000000c55a0000 0000000024b49000 C:\ProgramData\BOINC\slots\2\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000004a470000 0000000000045000 C:\ProgramData\BOINC\slots\2\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000f0ef0000 000000000abe7000 C:\ProgramData\BOINC\slots\2\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000fd010000 00000000030a5000 C:\ProgramData\BOINC\slots\2\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 00000000eda30000 00000000034b2000 C:\ProgramData\BOINC\slots\2\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 00000000507d0000 0000000000010000 C:\ProgramData\BOINC\slots\2\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 0000000095590000 0000000003d5b000 C:\ProgramData\BOINC\slots\2\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000992f0000 000000000919f000 C:\ProgramData\BOINC\slots\2\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 000000002bb50000 000000000020d000 C:\ProgramData\BOINC\slots\2\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 0000000027450000 00000000002db000 C:\ProgramData\BOINC\slots\2\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000936c0000 0000000001eca000 C:\ProgramData\BOINC\slots\2\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 000000004a430000 0000000000040000 C:\ProgramData\BOINC\slots\2\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000aa1f0000 000000001b3a4000 C:\ProgramData\BOINC\slots\2\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 00000000573c0000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000052c20000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000055bc0000 0000000000470000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000551a0000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1151
ModLoad: 0000000055600000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000054a90000 0000000000033000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 0000000055080000 0000000000068000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000554a0000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000548d0000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000056050000 0000000000744000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.964 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.964
ModLoad: 0000000052e20000 0000000000794000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000056950000 0000000000354000 C:\WINDOWS\System32\combase.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.1320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1320
ModLoad: 0000000054750000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000055630000 00000000000ad000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000573f0000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000001ed40000 00000000002cd000 C:\WINDOWS\system32\nvcuda.dll (30.0.15.1179) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_75\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 30.0.15.1179
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.6.110 driver
Product Version : 30.0.15.1179
ModLoad: 0000000092020000 00000000016a0000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_3b12ac0f95b18b9d\nvcuda64.dll (30.0.15.1179) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_75\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 30.0.15.1179
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.6.110 driver
Product Version : 30.0.15.1179
ModLoad: 000000004f230000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000004f1f0000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.906 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.906
ModLoad: 000000004c820000 0000000000148000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : drvstore.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000546c0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000004bff0000 0000000000768000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.15.1179) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_75\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 30.0.15.1179
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 30.0.15.1179
ModLoad: 0000000054fc0000 0000000000082000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.1415 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1415
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 3609, Write: 307, Other 739
- I/O Transfers Counters -
Read: 6627599, Write: 6049, Other 27842
- Paged Pool Usage -
QuotaPagedPoolUsage: 3433184, QuotaPeakPagedPoolUsage: 3433184
QuotaNonPagedPoolUsage: 38144, QuotaPeakNonPagedPoolUsage: 38144
- Virtual Memory Usage -
VirtualSize: -1475772416, PeakVirtualSize: -878116864
- Pagefile Usage -
PagefileUsage: -1475772416, PeakPagefileUsage: -1475772416
- Working Set Size -
WorkingSetSize: 1153175552, PeakWorkingSetSize: 1153179648, PageFaultCount: 392957
*** Dump of thread ID 12460 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 21093750.000000, User Time: 61562500.000000, Wait Time: 57276528.000000
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFA54D24F69
- Registers -
rax=00000000592e61f8 rbx=0000000004054910 rcx=00000000723ec300 rdx=00000000575f5b00 rsi=00000000592e6a60 rdi=0000000019930520
r8=00000000592e6220 r9=00000000592e6248 r10=0000000000000004 r11=00000000592e6258 r12=000000005e6f1d50 r13=00000000592e6c70
r14=000000006d1dc590 r15=0000000000000000 rip=0000000054d24f69 rsp=00000000592e6900 rbp=00000000592e6bf0
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000206
- Callstack -
ChildEBP RetAddr Args to Child
592e69d0 03f6a884 00000040 0000004f 5e6f2500 00000728 KERNELBASE!RaiseException+0x0
592e6a30 03d11ca6 00000010 17080000 5e561908 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
592e6ae0 03d1593b 00000000 00000030 00000020 00000008 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
592e6c30 03d11a78 00000000 00000000 592e6f60 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
592e6d00 03d11cfc 592e6f60 00000000 00000080 592e7230 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
592e6dc0 03d1c4dd 592e7230 592e7230 592e7230 592e7230 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
592e70b0 03d0b2fe 592e76c8 592e7230 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
592ffe50 03f4c6f8 18c26d30 00000000 00000000 18715400 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
592ffe90 56cc7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
592ffec0 57622651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
592fff40 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 3444 (state: Waiting): ***
- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 57275924.000000
- Registers -
rax=00000000000001d3 rbx=0000000017085f60 rcx=0000000000000070 rdx=0000000017085be0 rsi=0000000017083d10 rdi=0000000017085f60
r8=000000004f235008 r9=00000000593ff0b0 r10=000000004f2300f0 r11=0000000000000001 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000576707c4 rsp=00000000593ff608 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
593ff600 57622dc7 00000000 00000000 17083d10 17085f60 ntdll!ZwWaitForWorkViaWorkerFactory+0x0
593ff900 56cc7034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0
593ff930 57622651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
593ff9b0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 3132 (state: Waiting): ***
- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 468750.000000, User Time: 0.000000, Wait Time: 57275924.000000
- Registers -
rax=00000000000001d3 rbx=0000000017086390 rcx=0000000000000070 rdx=0000000017086010 rsi=0000000017083d10 rdi=0000000017086390
r8=0000000000000008 r9=0000000000000040 r10=0000000000000100 r11=0000000008000000 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000576707c4 rsp=00000000594ff788 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
594ff780 57622dc7 00000000 00000000 17083d10 17086390 ntdll!ZwWaitForWorkViaWorkerFactory+0x0
594ffa80 56cc7034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0
594ffab0 57622651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
594ffb30 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 3968 (state: Waiting): ***
- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 312500.000000, User Time: 0.000000, Wait Time: 57275924.000000
- Registers -
rax=00000000000001d3 rbx=0000000017087cd0 rcx=0000000000000070 rdx=0000000017087950 rsi=0000000017083d10 rdi=0000000017087cd0
r8=0000000000000008 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000576707c4 rsp=00000000595ff778 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
595ff770 57622dc7 00000000 00000000 17083d10 17087cd0 ntdll!ZwWaitForWorkViaWorkerFactory+0x0
595ffa70 56cc7034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0
595ffaa0 57622651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
595ffb20 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 3096 (state: Waiting): ***
- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 57276524.000000
- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000597ff8b0 rsi=0000000000000000 rdi=0000000000000064
r8=00000000597fe9d0 r9=00000000597fe640 r10=000000000000000a r11=0000000003cf0000 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000005766d3f4 rsp=00000000597ff888 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
597ff880 54d3962e 597ff948 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0
597ff920 03d2a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0
597ff950 56cc7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
597ff980 57622651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
597ffa00 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 9120 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 57276520.000000
- Registers -
rax=000000000000005b rbx=0000000000000006 rcx=0000000000000006 rdx=00000000598ffbb0 rsi=0000000000000000 rdi=0000000000000006
r8=00000000598ff858 r9=0000000018dac480 r10=0000000000000000 r11=00000000598ffb20 r12=0000000000000064 r13=00000000598ffbb0
r14=00000000598ff8b0 r15=0000000000000000 rip=000000005766d8c4 rsp=00000000598ff858 rbp=0000000018dac480
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
598ff850 54d3cb20 00000000 59132000 5773a4d0 59132000 ntdll!ZwWaitForMultipleObjects+0x0
598ffb40 54d3ca1e 17093af0 004e0049 00000006 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
598ffb80 921fd554 18daf660 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0
598ffdc0 922a58cd 00000000 18dac480 00000000 00000000 nvcuda64!+0x0
598ffe70 921fcf23 cdbcaca2 c90b39cd 19354c50 00000000 nvcuda64!cuProfilerStop+0x0
598ffea0 92534594 19354c50 00000000 00000000 00000000 nvcuda64!+0x0
598ffed0 56cc7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
598fff00 57622651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
598fff80 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)