Task 11353639
| Name | ParityModified-1639953578-10147-3-0_0 |
| Workunit | 8597884 |
| Created | 4 Feb 2022, 19:50:21 UTC |
| Sent | 16 Feb 2022, 16:49:21 UTC |
| Report deadline | 24 Feb 2022, 16:49:21 UTC |
| Received | 10 Mar 2022, 18:20:43 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | -529697949 (0xE06D7363) Unknown error code |
| Computer ID | 18852 |
| Run time | 36 min 54 sec |
| CPU time | 34 min 19 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 2,823.40 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 2.08 GB |
| Peak swap size | 4.29 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
1:08 main:574] : INFO : Epoch 340 | loss: 0.0311576 | val_loss: 0.0311608 | Time: 3496.3 ms
[2022-03-10 13:31:12 main:574] : INFO : Epoch 341 | loss: 0.0311561 | val_loss: 0.031161 | Time: 3596.7 ms
[2022-03-10 13:31:16 main:574] : INFO : Epoch 342 | loss: 0.0311557 | val_loss: 0.0311613 | Time: 3804.62 ms
[2022-03-10 13:31:19 main:574] : INFO : Epoch 343 | loss: 0.0311571 | val_loss: 0.0311672 | Time: 3555.74 ms
[2022-03-10 13:31:23 main:574] : INFO : Epoch 344 | loss: 0.0311561 | val_loss: 0.0311629 | Time: 3769.48 ms
[2022-03-10 13:31:27 main:574] : INFO : Epoch 345 | loss: 0.0311563 | val_loss: 0.0311612 | Time: 3655.39 ms
[2022-03-10 13:31:30 main:574] : INFO : Epoch 346 | loss: 0.0311564 | val_loss: 0.0311603 | Time: 3718.97 ms
[2022-03-10 13:31:34 main:574] : INFO : Epoch 347 | loss: 0.0311555 | val_loss: 0.0311606 | Time: 3775.86 ms
[2022-03-10 13:31:38 main:574] : INFO : Epoch 348 | loss: 0.031156 | val_loss: 0.0311617 | Time: 3648.57 ms
[2022-03-10 13:31:42 main:574] : INFO : Epoch 349 | loss: 0.031156 | val_loss: 0.0311609 | Time: 3665.49 ms
[2022-03-10 13:31:45 main:574] : INFO : Epoch 350 | loss: 0.0311566 | val_loss: 0.0311622 | Time: 3656.75 ms
[2022-03-10 13:31:49 main:574] : INFO : Epoch 351 | loss: 0.0311556 | val_loss: 0.0311601 | Time: 3767.37 ms
[2022-03-10 13:31:53 main:574] : INFO : Epoch 352 | loss: 0.0311567 | val_loss: 0.0311604 | Time: 3779.25 ms
[2022-03-10 13:31:57 main:574] : INFO : Epoch 353 | loss: 0.0311562 | val_loss: 0.031163 | Time: 3745.65 ms
[2022-03-10 13:32:00 main:574] : INFO : Epoch 354 | loss: 0.0311561 | val_loss: 0.0311606 | Time: 3853.11 ms
[2022-03-10 13:32:04 main:574] : INFO : Epoch 355 | loss: 0.0311564 | val_loss: 0.0311625 | Time: 3695.97 ms
[2022-03-10 13:32:08 main:574] : INFO : Epoch 356 | loss: 0.0311602 | val_loss: 0.0311676 | Time: 3754.9 ms
[2022-03-10 13:32:12 main:574] : INFO : Epoch 357 | loss: 0.0311642 | val_loss: 0.0311675 | Time: 3672.09 ms
[2022-03-10 13:32:15 main:574] : INFO : Epoch 358 | loss: 0.0311611 | val_loss: 0.0311647 | Time: 3759.82 ms
[2022-03-10 13:32:19 main:574] : INFO : Epoch 359 | loss: 0.03116 | val_loss: 0.0311621 | Time: 3802.73 ms
[2022-03-10 13:32:23 main:574] : INFO : Epoch 360 | loss: 0.0311565 | val_loss: 0.031164 | Time: 3815.3 ms
[2022-03-10 13:32:27 main:574] : INFO : Epoch 361 | loss: 0.0311588 | val_loss: 0.0311626 | Time: 3810.68 ms
[2022-03-10 13:32:31 main:574] : INFO : Epoch 362 | loss: 0.0311587 | val_loss: 0.0311703 | Time: 3873.52 ms
[2022-03-10 13:32:34 main:574] : INFO : Epoch 363 | loss: 0.0311589 | val_loss: 0.0311641 | Time: 3757.22 ms
[2022-03-10 13:32:38 main:574] : INFO : Epoch 364 | loss: 0.0311564 | val_loss: 0.0311609 | Time: 3877.94 ms
[2022-03-10 13:32:42 main:574] : INFO : Epoch 365 | loss: 0.0311557 | val_loss: 0.0311634 | Time: 3780.97 ms
[2022-03-10 13:32:46 main:574] : INFO : Epoch 366 | loss: 0.0311573 | val_loss: 0.0311675 | Time: 3871.67 ms
[2022-03-10 13:32:50 main:574] : INFO : Epoch 367 | loss: 0.031157 | val_loss: 0.0311603 | Time: 3945.78 ms
[2022-03-10 13:32:54 main:574] : INFO : Epoch 368 | loss: 0.0311553 | val_loss: 0.0311604 | Time: 3948.36 ms
[2022-03-10 13:32:58 main:574] : INFO : Epoch 369 | loss: 0.0311554 | val_loss: 0.0311591 | Time: 4059.82 ms
[2022-03-10 13:33:02 main:574] : INFO : Epoch 370 | loss: 0.0311585 | val_loss: 0.0311668 | Time: 3990.17 ms
[2022-03-10 13:33:06 main:574] : INFO : Epoch 371 | loss: 0.0311556 | val_loss: 0.0311585 | Time: 3915.78 ms
[2022-03-10 13:33:10 main:574] : INFO : Epoch 372 | loss: 0.0311543 | val_loss: 0.0311612 | Time: 4092.7 ms
[2022-03-10 13:33:14 main:574] : INFO : Epoch 373 | loss: 0.0311588 | val_loss: 0.0311633 | Time: 4284.89 ms
[2022-03-10 13:33:19 main:574] : INFO : Epoch 374 | loss: 0.0311628 | val_loss: 0.0311656 | Time: 4499.92 ms
[2022-03-10 13:33:23 main:574] : INFO : Epoch 375 | loss: 0.0311635 | val_loss: 0.0311686 | Time: 4486.34 ms
[2022-03-10 13:33:28 main:574] : INFO : Epoch 376 | loss: 0.0311643 | val_loss: 0.031164 | Time: 4383.49 ms
[2022-03-10 13:33:32 main:574] : INFO : Epoch 377 | loss: 0.0311586 | val_loss: 0.0311611 | Time: 4465.35 ms
[2022-03-10 13:33:36 main:574] : INFO : Epoch 378 | loss: 0.0311562 | val_loss: 0.0311623 | Time: 4351.04 ms
[2022-03-10 13:33:41 main:574] : INFO : Epoch 379 | loss: 0.0311592 | val_loss: 0.0311624 | Time: 4507.87 ms
[2022-03-10 13:33:45 main:574] : INFO : Epoch 380 | loss: 0.0311594 | val_loss: 0.0311666 | Time: 4254.63 ms
[2022-03-10 13:33:49 main:574] : INFO : Epoch 381 | loss: 0.0311593 | val_loss: 0.0311609 | Time: 4168.42 ms
[2022-03-10 13:33:54 main:574] : INFO : Epoch 382 | loss: 0.0311559 | val_loss: 0.0311581 | Time: 4132.37 ms
[2022-03-10 13:33:58 main:574] : INFO : Epoch 383 | loss: 0.0311575 | val_loss: 0.031169 | Time: 4216.74 ms
[2022-03-10 13:34:02 main:574] : INFO : Epoch 384 | loss: 0.0311697 | val_loss: 0.0311727 | Time: 4329.52 ms
[2022-03-10 13:34:06 main:574] : INFO : Epoch 385 | loss: 0.0311724 | val_loss: 0.0311674 | Time: 4197.49 ms
[2022-03-10 13:34:11 main:574] : INFO : Epoch 386 | loss: 0.0311686 | val_loss: 0.0311673 | Time: 4454.86 ms
[2022-03-10 13:34:15 main:574] : INFO : Epoch 387 | loss: 0.0311641 | val_loss: 0.0311628 | Time: 4313.12 ms
[2022-03-10 13:34:19 main:574] : INFO : Epoch 388 | loss: 0.0311593 | val_loss: 0.0311606 | Time: 4290.41 ms
[2022-03-10 13:34:24 main:574] : INFO : Epoch 389 | loss: 0.0311586 | val_loss: 0.0311597 | Time: 4221.9 ms
[2022-03-10 13:34:28 main:574] : INFO : Epoch 390 | loss: 0.0311588 | val_loss: 0.0311623 | Time: 4187.84 ms
[2022-03-10 13:34:32 main:574] : INFO : Epoch 391 | loss: 0.0311586 | val_loss: 0.0311661 | Time: 4384.77 ms
[2022-03-10 13:34:36 main:574] : INFO : Epoch 392 | loss: 0.0311622 | val_loss: 0.031173 | Time: 4283.92 ms
[2022-03-10 13:34:41 main:574] : INFO : Epoch 393 | loss: 0.0311612 | val_loss: 0.0311611 | Time: 4288.31 ms
[2022-03-10 13:34:45 main:574] : INFO : Epoch 394 | loss: 0.0311584 | val_loss: 0.0311616 | Time: 4236.51 ms
[2022-03-10 13:34:49 main:574] : INFO : Epoch 395 | loss: 0.0311588 | val_loss: 0.031165 | Time: 4437.7 ms
[2022-03-10 13:34:54 main:574] : INFO : Epoch 396 | loss: 0.0311582 | val_loss: 0.0311598 | Time: 4407.12 ms
[2022-03-10 13:34:58 main:574] : INFO : Epoch 397 | loss: 0.0311557 | val_loss: 0.0311622 | Time: 4366.6 ms
[2022-03-10 13:35:03 main:574] : INFO : Epoch 398 | loss: 0.0311582 | val_loss: 0.0311589 | Time: 4405.69 ms
[2022-03-10 13:35:07 main:574] : INFO : Epoch 399 | loss: 0.0311567 | val_loss: 0.0311599 | Time: 4364.57 ms
[2022-03-10 13:35:11 main:574] : INFO : Epoch 400 | loss: 0.0311564 | val_loss: 0.0311648 | Time: 4401.91 ms
[2022-03-10 13:35:16 main:574] : INFO : Epoch 401 | loss: 0.0311565 | val_loss: 0.0311602 | Time: 4421.19 ms
[2022-03-10 13:35:20 main:574] : INFO : Epoch 402 | loss: 0.0311538 | val_loss: 0.0311592 | Time: 4420.88 ms
[2022-03-10 13:35:25 main:574] : INFO : Epoch 403 | loss: 0.0311552 | val_loss: 0.0311591 | Time: 4520.69 ms
[2022-03-10 13:35:29 main:574] : INFO : Epoch 404 | loss: 0.0311569 | val_loss: 0.031158 | Time: 4542.97 ms
[2022-03-10 13:35:34 main:574] : INFO : Epoch 405 | loss: 0.0311552 | val_loss: 0.0311591 | Time: 4528.9 ms
[2022-03-10 13:35:38 main:574] : INFO : Epoch 406 | loss: 0.0311548 | val_loss: 0.0311585 | Time: 4463.91 ms
[2022-03-10 13:35:43 main:574] : INFO : Epoch 407 | loss: 0.0311544 | val_loss: 0.0311582 | Time: 4450.84 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce MX450)
[2022-03-10 18:45:08 main:435] : INFO : Set logging level to 1
[2022-03-10 18:45:08 main:441] : INFO : Running in BOINC Client mode
[2022-03-10 18:45:08 main:444] : INFO : Resolving all filenames
[2022-03-10 18:45:08 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-10 18:45:08 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-10 18:45:09 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-10 18:45:09 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-10 18:45:09 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-10 18:45:09 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-03-10 18:45:09 main:474] : INFO : Configuration:
[2022-03-10 18:45:09 main:475] : INFO : Model type: GRU
[2022-03-10 18:45:09 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-03-10 18:45:09 main:477] : INFO : Max Epochs: 2048
[2022-03-10 18:45:09 main:478] : INFO : Batch Size: 128
[2022-03-10 18:45:09 main:479] : INFO : Learning Rate: 0.01
[2022-03-10 18:45:09 main:480] : INFO : Patience: 10
[2022-03-10 18:45:09 main:481] : INFO : Hidden Width: 12
[2022-03-10 18:45:09 main:482] : INFO : # Recurrent Layers: 4
[2022-03-10 18:45:09 main:483] : INFO : # Backend Layers: 4
[2022-03-10 18:45:09 main:484] : INFO : # Threads: 1
[2022-03-10 18:45:09 main:486] : INFO : Preparing Dataset
[2022-03-10 18:45:09 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-10 18:45:09 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
[2022-03-10 18:45:10 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2022-03-10 18:45:10 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory
[2022-03-10 18:45:10 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory
[2022-03-10 18:45:10 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2022-03-10 18:45:10 main:494] : INFO : Creating Model
[2022-03-10 18:45:10 main:507] : INFO : Preparing config file
[2022-03-10 18:45:10 main:511] : INFO : Found checkpoint, attempting to load...
[2022-03-10 18:45:10 main:512] : INFO : Loading config
[2022-03-10 18:45:10 main:514] : INFO : Loading state
[2022-03-10 18:45:11 main:559] : INFO : Loading DataLoader into Memory
[2022-03-10 18:45:11 main:562] : INFO : Starting Training
[2022-03-10 18:45:15 main:574] : INFO : Epoch 404 | loss: 0.0312338 | val_loss: 0.0311744 | Time: 3595.46 ms
[2022-03-10 18:45:18 main:574] : INFO : Epoch 405 | loss: 0.0311629 | val_loss: 0.0311606 | Time: 3268.61 ms
[2022-03-10 18:45:21 main:574] : INFO : Epoch 406 | loss: 0.0311598 | val_loss: 0.0311592 | Time: 3303.76 ms
[2022-03-10 18:45:24 main:574] : INFO : Epoch 407 | loss: 0.0311555 | val_loss: 0.0311594 | Time: 3285.79 ms
[2022-03-10 18:45:28 main:574] : INFO : Epoch 408 | loss: 0.031156 | val_loss: 0.0311579 | Time: 3351.28 ms
[2022-03-10 18:45:31 main:574] : INFO : Epoch 409 | loss: 0.0311563 | val_loss: 0.0311611 | Time: 3282.47 ms
[2022-03-10 18:45:34 main:574] : INFO : Epoch 410 | loss: 0.0311554 | val_loss: 0.0311616 | Time: 3336.99 ms
[2022-03-10 18:45:38 main:574] : INFO : Epoch 411 | loss: 0.0311573 | val_loss: 0.0311583 | Time: 3347.92 ms
[2022-03-10 18:45:41 main:574] : INFO : Epoch 412 | loss: 0.031154 | val_loss: 0.0311626 | Time: 3302.33 ms
[2022-03-10 18:45:44 main:574] : INFO : Epoch 413 | loss: 0.0311564 | val_loss: 0.0311615 | Time: 3301.03 ms
[2022-03-10 18:45:48 main:574] : INFO : Epoch 414 | loss: 0.0311551 | val_loss: 0.031159 | Time: 3321.08 ms
[2022-03-10 18:45:51 main:574] : INFO : Epoch 415 | loss: 0.0311553 | val_loss: 0.0311594 | Time: 3308.24 ms
[2022-03-10 18:45:54 main:574] : INFO : Epoch 416 | loss: 0.0311559 | val_loss: 0.0311695 | Time: 3329.55 ms
[2022-03-10 18:45:58 main:574] : INFO : Epoch 417 | loss: 0.0311595 | val_loss: 0.0311603 | Time: 3343.06 ms
[2022-03-10 18:46:01 main:574] : INFO : Epoch 418 | loss: 0.0311581 | val_loss: 0.0311626 | Time: 3382.56 ms
[2022-03-10 18:46:04 main:574] : INFO : Epoch 419 | loss: 0.0311586 | val_loss: 0.0311611 | Time: 3356.89 ms
[2022-03-10 18:46:08 main:574] : INFO : Epoch 420 | loss: 0.0311559 | val_loss: 0.031159 | Time: 4005.11 ms
[2022-03-10 18:46:13 main:574] : INFO : Epoch 421 | loss: 0.0311553 | val_loss: 0.0311584 | Time: 4118.76 ms
[2022-03-10 18:46:16 main:574] : INFO : Epoch 422 | loss: 0.0311565 | val_loss: 0.0311626 | Time: 3759.99 ms
[2022-03-10 18:46:20 main:574] : INFO : Epoch 423 | loss: 0.0311558 | val_loss: 0.0311584 | Time: 3683.83 ms
[2022-03-10 18:46:24 main:574] : INFO : Epoch 424 | loss: 0.0311647 | val_loss: 0.0311796 | Time: 3740.46 ms
[2022-03-10 18:46:28 main:574] : INFO : Epoch 425 | loss: 0.0311653 | val_loss: 0.0311632 | Time: 3861.49 ms
[2022-03-10 18:46:31 main:574] : INFO : Epoch 426 | loss: 0.0311577 | val_loss: 0.0311606 | Time: 3704.24 ms
[2022-03-10 18:46:35 main:574] : INFO : Epoch 427 | loss: 0.0311547 | val_loss: 0.0311585 | Time: 3865.61 ms
[2022-03-10 18:46:39 main:574] : INFO : Epoch 428 | loss: 0.0311544 | val_loss: 0.0311596 | Time: 3742.17 ms
[2022-03-10 18:46:43 main:574] : INFO : Epoch 429 | loss: 0.031156 | val_loss: 0.0311583 | Time: 3810.69 ms
[2022-03-10 18:46:47 main:574] : INFO : Epoch 430 | loss: 0.031155 | val_loss: 0.0311569 | Time: 3816.92 ms
[2022-03-10 18:46:50 main:574] : INFO : Epoch 431 | loss: 0.0311557 | val_loss: 0.0311617 | Time: 3843.4 ms
[2022-03-10 18:46:54 main:574] : INFO : Epoch 432 | loss: 0.0311602 | val_loss: 0.0311632 | Time: 3892.04 ms
[2022-03-10 18:46:58 main:574] : INFO : Epoch 433 | loss: 0.0311612 | val_loss: 0.0311638 | Time: 3933.63 ms
[2022-03-10 18:47:02 main:574] : INFO : Epoch 434 | loss: 0.0311603 | val_loss: 0.0311621 | Time: 3898.07 ms
[2022-03-10 18:47:06 main:574] : INFO : Epoch 435 | loss: 0.03116 | val_loss: 0.0311605 | Time: 3913.31 ms
[2022-03-10 18:47:10 main:574] : INFO : Epoch 436 | loss: 0.0311583 | val_loss: 0.0311589 | Time: 4218.84 ms
[2022-03-10 18:47:15 main:574] : INFO : Epoch 437 | loss: 0.0311564 | val_loss: 0.0311579 | Time: 4186.24 ms
[2022-03-10 18:47:19 main:574] : INFO : Epoch 438 | loss: 0.0311561 | val_loss: 0.0311595 | Time: 4171.36 ms
[2022-03-10 18:47:23 main:574] : INFO : Epoch 439 | loss: 0.0311553 | val_loss: 0.0311572 | Time: 4269.63 ms
[2022-03-10 18:47:27 main:574] : INFO : Epoch 440 | loss: 0.0311553 | val_loss: 0.0311594 | Time: 4362.46 ms
[2022-03-10 18:47:32 main:574] : INFO : Epoch 441 | loss: 0.031155 | val_loss: 0.0311595 | Time: 4296.32 ms
[2022-03-10 18:47:36 main:574] : INFO : Epoch 442 | loss: 0.031156 | val_loss: 0.0311577 | Time: 4456.83 ms
[2022-03-10 18:47:40 main:574] : INFO : Epoch 443 | loss: 0.0311555 | val_loss: 0.0311575 | Time: 3959.12 ms
[2022-03-10 18:47:44 main:574] : INFO : Epoch 444 | loss: 0.0311552 | val_loss: 0.031159 | Time: 3931.65 ms
[2022-03-10 18:47:48 main:574] : INFO : Epoch 445 | loss: 0.0311539 | val_loss: 0.0311588 | Time: 3970.44 ms
[2022-03-10 18:47:52 main:574] : INFO : Epoch 446 | loss: 0.0311556 | val_loss: 0.0311598 | Time: 3977.76 ms
[2022-03-10 18:47:56 main:574] : INFO : Epoch 447 | loss: 0.0311549 | val_loss: 0.0311586 | Time: 3996.93 ms
[2022-03-10 18:48:00 main:574] : INFO : Epoch 448 | loss: 0.031154 | val_loss: 0.0311586 | Time: 4159.28 ms
[2022-03-10 18:48:04 main:574] : INFO : Epoch 449 | loss: 0.0311548 | val_loss: 0.0311606 | Time: 4121.24 ms
[2022-03-10 18:48:08 main:574] : INFO : Epoch 450 | loss: 0.0311563 | val_loss: 0.0311588 | Time: 4001.16 ms
[2022-03-10 18:48:12 main:574] : INFO : Epoch 451 | loss: 0.0311563 | val_loss: 0.0311566 | Time: 4077.29 ms
[2022-03-10 18:48:17 main:574] : INFO : Epoch 452 | loss: 0.0311538 | val_loss: 0.0311589 | Time: 4316.23 ms
[2022-03-10 18:48:21 main:574] : INFO : Epoch 453 | loss: 0.0311539 | val_loss: 0.031161 | Time: 4216.12 ms
[2022-03-10 18:48:25 main:574] : INFO : Epoch 454 | loss: 0.0311555 | val_loss: 0.0311585 | Time: 4171.97 ms
[2022-03-10 18:48:29 main:574] : INFO : Epoch 455 | loss: 0.0311559 | val_loss: 0.0311583 | Time: 4204.44 ms
[2022-03-10 18:48:34 main:574] : INFO : Epoch 456 | loss: 0.0311535 | val_loss: 0.0311581 | Time: 4321.19 ms
[2022-03-10 18:48:38 main:574] : INFO : Epoch 457 | loss: 0.0311532 | val_loss: 0.0311587 | Time: 4205.04 ms
[2022-03-10 18:48:42 main:574] : INFO : Epoch 458 | loss: 0.0311527 | val_loss: 0.0311565 | Time: 4267.26 ms
[2022-03-10 18:48:46 main:574] : INFO : Epoch 459 | loss: 0.031153 | val_loss: 0.0311563 | Time: 4205.99 ms
[2022-03-10 18:48:50 main:574] : INFO : Epoch 460 | loss: 0.0311543 | val_loss: 0.0311567 | Time: 4052.5 ms
[2022-03-10 18:48:55 main:574] : INFO : Epoch 461 | loss: 0.0311544 | val_loss: 0.0311614 | Time: 4193.06 ms
[2022-03-10 18:48:59 main:574] : INFO : Epoch 462 | loss: 0.0311538 | val_loss: 0.0311567 | Time: 4344.1 ms
[2022-03-10 18:49:03 main:574] : INFO : Epoch 463 | loss: 0.0311527 | val_loss: 0.0311565 | Time: 4360.32 ms
[2022-03-10 18:49:08 main:574] : INFO : Epoch 464 | loss: 0.0311544 | val_loss: 0.0311593 | Time: 4241.66 ms
[2022-03-10 18:49:12 main:574] : INFO : Epoch 465 | loss: 0.0311525 | val_loss: 0.031158 | Time: 4242.13 ms
[2022-03-10 18:49:16 main:574] : INFO : Epoch 466 | loss: 0.0311532 | val_loss: 0.03116 | Time: 4212.19 ms
[2022-03-10 18:49:20 main:574] : INFO : Epoch 467 | loss: 0.0311546 | val_loss: 0.0311565 | Time: 4302.01 ms
[2022-03-10 18:49:25 main:574] : INFO : Epoch 468 | loss: 0.0311539 | val_loss: 0.0311588 | Time: 4317.8 ms
[2022-03-10 18:49:29 main:574] : INFO : Epoch 469 | loss: 0.0311534 | val_loss: 0.0311575 | Time: 4417.07 ms
[2022-03-10 18:49:34 main:574] : INFO : Epoch 470 | loss: 0.0311531 | val_loss: 0.0311586 | Time: 4592.78 ms
[2022-03-10 18:49:38 main:574] : INFO : Epoch 471 | loss: 0.0311527 | val_loss: 0.0311569 | Time: 4537.79 ms
[2022-03-10 18:49:43 main:574] : INFO : Epoch 472 | loss: 0.0311528 | val_loss: 0.0311598 | Time: 4509.23 ms
[2022-03-10 18:49:47 main:574] : INFO : Epoch 473 | loss: 0.0311522 | val_loss: 0.0311587 | Time: 4617.18 ms
[2022-03-10 18:49:52 main:574] : INFO : Epoch 474 | loss: 0.031152 | val_loss: 0.0311571 | Time: 4679.63 ms
[2022-03-10 18:49:57 main:574] : INFO : Epoch 475 | loss: 0.0311537 | val_loss: 0.0311579 | Time: 4716.99 ms
[2022-03-10 18:50:02 main:574] : INFO : Epoch 476 | loss: 0.0311519 | val_loss: 0.0311555 | Time: 4744.83 ms
[2022-03-10 18:50:06 main:574] : INFO : Epoch 477 | loss: 0.031153 | val_loss: 0.0311651 | Time: 4712.15 ms
[2022-03-10 18:50:11 main:574] : INFO : Epoch 478 | loss: 0.0311657 | val_loss: 0.0312054 | Time: 4638.13 ms
[2022-03-10 18:50:16 main:574] : INFO : Epoch 479 | loss: 0.0311722 | val_loss: 0.0311817 | Time: 4723.84 ms
[2022-03-10 18:50:22 main:574] : INFO : Epoch 480 | loss: 0.0311929 | val_loss: 0.0312012 | Time: 6365.31 ms
[2022-03-10 18:51:28 main:574] : INFO : Epoch 481 | loss: 0.0331923 | val_loss: 0.0322755 | Time: 66036.9 ms
[2022-03-10 18:51:31 main:574] : INFO : Epoch 482 | loss: 0.0578664 | val_loss: 0.0467509 | Time: 3326.67 ms
[2022-03-10 18:51:35 main:574] : INFO : Epoch 483 | loss: 0.0345732 | val_loss: 0.0325888 | Time: 4051.98 ms
[2022-03-10 18:51:40 main:574] : INFO : Epoch 484 | loss: 0.0316891 | val_loss: 0.0314968 | Time: 4783.11 ms
[2022-03-10 18:51:46 main:574] : INFO : Epoch 485 | loss: nan | val_loss: nan | Time: 5467.86 ms
[2022-03-10 18:51:52 main:574] : INFO : Epoch 486 | loss: nan | val_loss: nan | Time: 6485.57 ms
[2022-03-10 18:55:19 main:574] : INFO : Epoch 487 | loss: nan | val_loss: nan | Time: 206797 ms
[2022-03-10 18:55:22 main:574] : INFO : Epoch 488 | loss: nan | val_loss: nan | Time: 3329.81 ms
[2022-03-10 18:55:26 main:574] : INFO : Epoch 489 | loss: nan | val_loss: nan | Time: 3310.18 ms
[2022-03-10 18:55:29 main:574] : INFO : Epoch 490 | loss: nan | val_loss: nan | Time: 3251.75 ms
[2022-03-10 18:55:32 main:574] : INFO : Epoch 491 | loss: nan | val_loss: nan | Time: 3340.54 ms
[2022-03-10 18:55:36 main:574] : INFO : Epoch 492 | loss: nan | val_loss: nan | Time: 3355.86 ms
[2022-03-10 18:55:39 main:574] : INFO : Epoch 493 | loss: nan | val_loss: nan | Time: 3278.18 ms
[2022-03-10 18:55:44 main:574] : INFO : Epoch 494 | loss: nan | val_loss: nan | Time: 4795.66 ms
[2022-03-10 18:55:49 main:574] : INFO : Epoch 495 | loss: nan | val_loss: nan | Time: 5086.49 ms
[2022-03-10 18:55:54 main:574] : INFO : Epoch 496 | loss: nan | val_loss: nan | Time: 4918.72 ms
[2022-03-10 18:55:59 main:574] : INFO : Epoch 497 | loss: nan | val_loss: nan | Time: 4920.11 ms
[2022-03-10 18:56:04 main:574] : INFO : Epoch 498 | loss: nan | val_loss: nan | Time: 4928.68 ms
[2022-03-10 18:56:09 main:574] : INFO : Epoch 499 | loss: nan | val_loss: nan | Time: 4944.58 ms
[2022-03-10 18:56:13 main:574] : INFO : Epoch 500 | loss: nan | val_loss: nan | Time: 4826.08 ms
[2022-03-10 18:56:18 main:574] : INFO : Epoch 501 | loss: nan | val_loss: nan | Time: 4879.22 ms
[2022-03-10 18:56:23 main:574] : INFO : Epoch 502 | loss: nan | val_loss: nan | Time: 4951.93 ms
[2022-03-10 18:56:28 main:574] : INFO : Epoch 503 | loss: nan | val_loss: nan | Time: 4926.24 ms
[2022-03-10 18:56:33 main:574] : INFO : Epoch 504 | loss: nan | val_loss: nan | Time: 4864.5 ms
[2022-03-10 18:56:38 main:574] : INFO : Epoch 505 | loss: nan | val_loss: nan | Time: 4945.9 ms
[2022-03-10 18:56:43 main:574] : INFO : Epoch 506 | loss: nan | val_loss: nan | Time: 4863.6 ms
[2022-03-10 18:56:48 main:574] : INFO : Epoch 507 | loss: nan | val_loss: nan | Time: 4905.08 ms
[2022-03-10 18:56:53 main:574] : INFO : Epoch 508 | loss: nan | val_loss: nan | Time: 4941.01 ms
[2022-03-10 18:56:58 main:574] : INFO : Epoch 509 | loss: nan | val_loss: nan | Time: 4962.98 ms
[2022-03-10 18:57:03 main:574] : INFO : Epoch 510 | loss: nan | val_loss: nan | Time: 5000.27 ms
[2022-03-10 18:57:08 main:574] : INFO : Epoch 511 | loss: nan | val_loss: nan | Time: 4958 ms
[2022-03-10 18:57:13 main:574] : INFO : Epoch 512 | loss: nan | val_loss: nan | Time: 4934.32 ms
[2022-03-10 18:57:18 main:574] : INFO : Epoch 513 | loss: nan | val_loss: nan | Time: 5140.63 ms
[2022-03-10 18:57:23 main:574] : INFO : Epoch 514 | loss: nan | val_loss: nan | Time: 4956.4 ms
[2022-03-10 18:57:28 main:574] : INFO : Epoch 515 | loss: nan | val_loss: nan | Time: 4919.54 ms
[2022-03-10 18:57:33 main:574] : INFO : Epoch 516 | loss: nan | val_loss: nan | Time: 4961.82 ms
[2022-03-10 18:57:37 main:574] : INFO : Epoch 517 | loss: nan | val_loss: nan | Time: 4899.75 ms
[2022-03-10 18:57:43 main:574] : INFO : Epoch 518 | loss: nan | val_loss: nan | Time: 5115.31 ms
[2022-03-10 18:57:48 main:574] : INFO : Epoch 519 | loss: nan | val_loss: nan | Time: 5033.21 ms
[2022-03-10 18:57:53 main:574] : INFO : Epoch 520 | loss: nan | val_loss: nan | Time: 5136.88 ms
[2022-03-10 18:57:58 main:574] : INFO : Epoch 521 | loss: nan | val_loss: nan | Time: 4901.29 ms
[2022-03-10 18:58:03 main:574] : INFO : Epoch 522 | loss: nan | val_loss: nan | Time: 5048.26 ms
[2022-03-10 18:58:08 main:574] : INFO : Epoch 523 | loss: nan | val_loss: nan | Time: 4900.99 ms
[2022-03-10 18:58:13 main:574] : INFO : Epoch 524 | loss: nan | val_loss: nan | Time: 4949.45 ms
[2022-03-10 18:58:18 main:574] : INFO : Epoch 525 | loss: nan | val_loss: nan | Time: 4917.94 ms
[2022-03-10 18:58:23 main:574] : INFO : Epoch 526 | loss: nan | val_loss: nan | Time: 4981.43 ms
[2022-03-10 18:58:27 main:574] : INFO : Epoch 527 | loss: nan | val_loss: nan | Time: 4927.3 ms
[2022-03-10 18:58:32 main:574] : INFO : Epoch 528 | loss: nan | val_loss: nan | Time: 4982.03 ms
[2022-03-10 18:58:37 main:574] : INFO : Epoch 529 | loss: nan | val_loss: nan | Time: 4962.99 ms
[2022-03-10 18:58:42 main:574] : INFO : Epoch 530 | loss: nan | val_loss: nan | Time: 5026.94 ms
[2022-03-10 18:58:47 main:574] : INFO : Epoch 531 | loss: nan | val_loss: nan | Time: 4965.08 ms
[2022-03-10 18:58:53 main:574] : INFO : Epoch 532 | loss: nan | val_loss: nan | Time: 5070.81 ms
[2022-03-10 18:58:58 main:574] : INFO : Epoch 533 | loss: nan | val_loss: nan | Time: 5159.05 ms
[2022-03-10 18:59:13 main:574] : INFO : Epoch 534 | loss: nan | val_loss: nan | Time: 14913.2 ms
[2022-03-10 18:59:16 main:574] : INFO : Epoch 535 | loss: nan | val_loss: nan | Time: 3271.46 ms
[2022-03-10 18:59:19 main:574] : INFO : Epoch 536 | loss: nan | val_loss: nan | Time: 3248.56 ms
[2022-03-10 18:59:23 main:574] : INFO : Epoch 537 | loss: nan | val_loss: nan | Time: 4363.28 ms
[2022-03-10 18:59:29 main:574] : INFO : Epoch 538 | loss: nan | val_loss: nan | Time: 5052.74 ms
[2022-03-10 18:59:34 main:574] : INFO : Epoch 539 | loss: nan | val_loss: nan | Time: 4999.44 ms
[2022-03-10 18:59:39 main:574] : INFO : Epoch 540 | loss: nan | val_loss: nan | Time: 4936.54 ms
[2022-03-10 18:59:43 main:574] : INFO : Epoch 541 | loss: nan | val_loss: nan | Time: 4927.21 ms
[2022-03-10 18:59:48 main:574] : INFO : Epoch 542 | loss: nan | val_loss: nan | Time: 4958.7 ms
[2022-03-10 18:59:53 main:574] : INFO : Epoch 543 | loss: nan | val_loss: nan | Time: 4946.68 ms
[2022-03-10 18:59:58 main:574] : INFO : Epoch 544 | loss: nan | val_loss: nan | Time: 4940.25 ms
[2022-03-10 19:00:03 main:574] : INFO : Epoch 545 | loss: nan | val_loss: nan | Time: 4989.49 ms
[2022-03-10 19:00:08 main:574] : INFO : Epoch 546 | loss: nan | val_loss: nan | Time: 4946.93 ms
[2022-03-10 19:00:13 main:574] : INFO : Epoch 547 | loss: nan | val_loss: nan | Time: 4897.9 ms
[2022-03-10 19:00:18 main:574] : INFO : Epoch 548 | loss: nan | val_loss: nan | Time: 4987.16 ms
[2022-03-10 19:00:23 main:574] : INFO : Epoch 549 | loss: nan | val_loss: nan | Time: 4980.39 ms
[2022-03-10 19:00:28 main:574] : INFO : Epoch 550 | loss: nan | val_loss: nan | Time: 4918.27 ms
[2022-03-10 19:00:33 main:574] : INFO : Epoch 551 | loss: nan | val_loss: nan | Time: 4965.65 ms
[2022-03-10 19:00:38 main:574] : INFO : Epoch 552 | loss: nan | val_loss: nan | Time: 4902.2 ms
[2022-03-10 19:00:43 main:574] : INFO : Epoch 553 | loss: nan | val_loss: nan | Time: 5041.27 ms
[2022-03-10 19:00:48 main:574] : INFO : Epoch 554 | loss: nan | val_loss: nan | Time: 5056.86 ms
[2022-03-10 19:00:53 main:574] : INFO : Epoch 555 | loss: nan | val_loss: nan | Time: 5107.3 ms
[2022-03-10 19:00:58 main:574] : INFO : Epoch 556 | loss: nan | val_loss: nan | Time: 5083.38 ms
[2022-03-10 19:01:03 main:574] : INFO : Epoch 557 | loss: nan | val_loss: nan | Time: 5168.58 ms
[2022-03-10 19:01:09 main:574] : INFO : Epoch 558 | loss: nan | val_loss: nan | Time: 5184.51 ms
[2022-03-10 19:01:14 main:574] : INFO : Epoch 559 | loss: nan | val_loss: nan | Time: 5201.08 ms
[2022-03-10 19:01:19 main:574] : INFO : Epoch 560 | loss: nan | val_loss: nan | Time: 5065.5 ms
[2022-03-10 19:01:24 main:574] : INFO : Epoch 561 | loss: nan | val_loss: nan | Time: 4936.26 ms
[2022-03-10 19:01:29 main:574] : INFO : Epoch 562 | loss: nan | val_loss: nan | Time: 4861.36 ms
[2022-03-10 19:01:34 main:574] : INFO : Epoch 563 | loss: nan | val_loss: nan | Time: 5059.93 ms
[2022-03-10 19:01:39 main:574] : INFO : Epoch 564 | loss: nan | val_loss: nan | Time: 4909.32 ms
[2022-03-10 19:01:44 main:574] : INFO : Epoch 565 | loss: nan | val_loss: nan | Time: 5075.28 ms
[2022-03-10 19:01:49 main:574] : INFO : Epoch 566 | loss: nan | val_loss: nan | Time: 5084.89 ms
[2022-03-10 19:01:54 main:574] : INFO : Epoch 567 | loss: nan | val_loss: nan | Time: 4854.97 ms
[2022-03-10 19:01:59 main:574] : INFO : Epoch 568 | loss: nan | val_loss: nan | Time: 5322.04 ms
[2022-03-10 19:02:04 main:574] : INFO : Epoch 569 | loss: nan | val_loss: nan | Time: 5374.56 ms
[2022-03-10 19:02:10 main:574] : INFO : Epoch 570 | loss: nan | val_loss: nan | Time: 5080.14 ms
[2022-03-10 19:02:14 main:574] : INFO : Epoch 571 | loss: nan | val_loss: nan | Time: 4870.63 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce MX450)
[2022-03-10 19:19:05 main:435] : INFO : Set logging level to 1
[2022-03-10 19:19:05 main:441] : INFO : Running in BOINC Client mode
[2022-03-10 19:19:05 main:444] : INFO : Resolving all filenames
[2022-03-10 19:19:05 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-10 19:19:05 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-10 19:19:05 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-10 19:19:05 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-10 19:19:05 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-10 19:19:05 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-03-10 19:19:05 main:474] : INFO : Configuration:
[2022-03-10 19:19:05 main:475] : INFO : Model type: GRU
[2022-03-10 19:19:05 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-03-10 19:19:05 main:477] : INFO : Max Epochs: 2048
[2022-03-10 19:19:05 main:478] : INFO : Batch Size: 128
[2022-03-10 19:19:05 main:479] : INFO : Learning Rate: 0.01
[2022-03-10 19:19:05 main:480] : INFO : Patience: 10
[2022-03-10 19:19:05 main:481] : INFO : Hidden Width: 12
[2022-03-10 19:19:05 main:482] : INFO : # Recurrent Layers: 4
[2022-03-10 19:19:05 main:483] : INFO : # Backend Layers: 4
[2022-03-10 19:19:05 main:484] : INFO : # Threads: 1
[2022-03-10 19:19:05 main:486] : INFO : Preparing Dataset
[2022-03-10 19:19:05 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-10 19:19:05 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
[2022-03-10 19:19:06 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2022-03-10 19:19:06 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory
[2022-03-10 19:19:06 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory
[2022-03-10 19:19:06 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2022-03-10 19:19:06 main:494] : INFO : Creating Model
[2022-03-10 19:19:06 main:507] : INFO : Preparing config file
[2022-03-10 19:19:06 main:511] : INFO : Found checkpoint, attempting to load...
[2022-03-10 19:19:06 main:512] : INFO : Loading config
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFCA214478C
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 03/10/22 19:19:06
Install Directory : C:\Program Files\BOINC\
Data Directory : C:\ProgramData\BOINC
Project Symstore :
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\3;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 000000001b820000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000a48e0000 0000000000209000 C:\windows\SYSTEM32\ntdll.dll (6.2.22000.527) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.22000.493 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.22000.493
ModLoad: 00000000a3140000 00000000000bd000 C:\windows\System32\KERNEL32.DLL (6.2.22000.434) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.22000.493 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.22000.493
ModLoad: 00000000a2100000 0000000000374000 C:\windows\System32\KERNELBASE.dll (6.2.22000.527) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.22000.493 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.22000.493
ModLoad: 00000000a44d0000 00000000001ac000 C:\windows\System32\USER32.dll (6.2.22000.282) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.22000.493 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.22000.493
ModLoad: 00000000a1e40000 0000000000026000 C:\windows\System32\win32u.dll (6.2.22000.556) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.22000.556 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.556
ModLoad: 00000000a37f0000 0000000000029000 C:\windows\System32\GDI32.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000a1e70000 0000000000112000 C:\windows\System32\gdi32full.dll (6.2.22000.527) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.22000.527 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.527
ModLoad: 00000000a2660000 000000000009d000 C:\windows\System32\msvcp_win.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 0000000092b50000 0000000000058000 C:\ProgramData\BOINC\slots\3\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000a2540000 0000000000111000 C:\windows\System32\ucrtbase.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000a2db0000 00000000000ae000 C:\windows\System32\ADVAPI32.dll (6.2.22000.434) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.22000.493 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.22000.493
ModLoad: 00000000a2980000 00000000000a3000 C:\windows\System32\msvcrt.dll (7.0.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.22000.1
ModLoad: 00000000a3c80000 000000000009e000 C:\windows\System32\sechost.dll (6.2.22000.556) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000a2ba0000 0000000000120000 C:\windows\System32\RPCRT4.dll (6.2.22000.434) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.22000.493 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.22000.493
ModLoad: 00000000811f0000 000000000008d000 C:\windows\SYSTEM32\MSVCP140.dll (14.29.30139.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\a01\_work\12\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.29.30139.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.29.30139.0
ModLoad: 000000009f870000 0000000000221000 C:\windows\SYSTEM32\dbghelp.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000819b0000 000000000001b000 C:\windows\SYSTEM32\VCRUNTIME140.dll (14.29.30139.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\a01\_work\12\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.29.30139.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.29.30139.0
ModLoad: 0000000084d10000 000000000000c000 C:\windows\SYSTEM32\VCRUNTIME140_1.dll (14.29.30139.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\a01\_work\12\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.29.30139.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.29.30139.0
ModLoad: 00000000841c0000 000000000abe7000 C:\ProgramData\BOINC\slots\3\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000024c00000 00000000002db000 C:\ProgramData\BOINC\slots\3\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000024ee0000 000000000020d000 C:\ProgramData\BOINC\slots\3\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 0000000086d20000 0000000000040000 C:\ProgramData\BOINC\slots\3\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000008edb0000 0000000024b49000 C:\ProgramData\BOINC\slots\3\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000086cd0000 0000000000045000 C:\ProgramData\BOINC\slots\3\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000007dc50000 00000000034b2000 C:\ProgramData\BOINC\slots\3\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 0000000081110000 00000000030a5000 C:\ProgramData\BOINC\slots\3\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 0000000097950000 0000000000010000 C:\ProgramData\BOINC\slots\3\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 00000000559a0000 0000000003d5b000 C:\ProgramData\BOINC\slots\3\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 0000000059700000 000000000919f000 C:\ProgramData\BOINC\slots\3\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 0000000053ad0000 0000000001eca000 C:\ProgramData\BOINC\slots\3\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000628a0000 000000001b3a4000 C:\ProgramData\BOINC\slots\3\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 00000000a2940000 0000000000031000 C:\windows\System32\IMM32.DLL (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000a0fc0000 0000000000018000 C:\windows\SYSTEM32\kernel.appcore.dll (6.2.22000.71) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.22000.71 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.71
ModLoad: 000000009f270000 0000000000038000 C:\windows\SYSTEM32\dxcore.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : DXCore.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000a3320000 000000000046c000 C:\windows\System32\Setupapi.dll (6.2.22000.469) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.22000.493 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.22000.493
ModLoad: 00000000a1aa0000 000000000002c000 C:\windows\SYSTEM32\DEVOBJ.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000a1ad0000 000000000004c000 C:\windows\SYSTEM32\cfgmgr32.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000a1dd0000 0000000000067000 C:\windows\System32\WINTRUST.dll (6.2.22000.527) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.22000.527 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.527
ModLoad: 00000000a1f90000 0000000000162000 C:\windows\System32\CRYPT32.dll (6.2.22000.348) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.22000.493 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.22000.493
ModLoad: 00000000a1690000 0000000000012000 C:\windows\SYSTEM32\MSASN1.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000a3d20000 00000000007ae000 C:\windows\System32\Shell32.dll (6.2.22000.527) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.22000.493 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.22000.493
ModLoad: 000000009ff50000 0000000000868000 C:\windows\SYSTEM32\windows.storage.dll (6.2.22000.527) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.22000.493 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.22000.493
ModLoad: 00000000a38f0000 0000000000378000 C:\windows\System32\combase.dll (6.2.22000.527) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.22000.493 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.22000.493
ModLoad: 000000009fde0000 0000000000166000 C:\windows\SYSTEM32\wintypes.dll (6.2.22000.527) (-exported- Symbols Loaded)
Linked PDB Filename : WinTypes.pdb
File Version : 10.0.22000.493 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.22000.493
ModLoad: 00000000a2a30000 00000000000ea000 C:\windows\System32\SHCORE.dll (6.2.22000.71) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.22000.493 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.22000.493
ModLoad: 00000000a3790000 000000000005d000 C:\windows\System32\shlwapi.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.22000.493 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.22000.493
ModLoad: 00000000dd550000 00000000002b9000 C:\windows\system32\nvcuda.dll (30.0.14.9733) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r495\r495_00\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 30.0.14.9733
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.5.125 driver
Product Version : 30.0.14.9733
ModLoad: 0000000052400000 00000000010e6000 C:\windows\system32\DriverStore\FileRepository\nvhm.inf_amd64_d745ea92fee8ab77\nvcuda64.dll (30.0.14.9733) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r495\r495_00\drivers\gpgpu\_out\wddm2_ms_shipping_wddm2_amd64_release\nvcuda.pdb
File Version : 30.0.14.9733
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.5.125 driver
Product Version : 30.0.14.9733
ModLoad: 000000009c1a0000 000000000000a000 C:\windows\SYSTEM32\VERSION.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 0000000096280000 0000000000031000 C:\windows\SYSTEM32\cryptnet.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000945c0000 0000000000149000 C:\windows\SYSTEM32\drvstore.dll (6.2.22000.120) (-exported- Symbols Loaded)
Linked PDB Filename : drvstore.pdb
File Version : 10.0.22000.120 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.120
ModLoad: 00000000a1700000 000000000003d000 C:\windows\SYSTEM32\wldp.dll (6.2.22000.120) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.22000.493 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.22000.493
ModLoad: 00000000a1650000 000000000000c000 C:\windows\SYSTEM32\cryptbase.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 000000007eef0000 0000000000762000 C:\windows\SYSTEM32\nvapi64.dll (30.0.14.9733) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r495\r495_00\drivers\nvapi\gpu\_out\wddm2_ms_shipping_wddm2_amd64_release\nvapi64.pdb
File Version : 30.0.14.9733
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 30.0.14.9733
ModLoad: 00000000a2700000 000000000007f000 C:\windows\System32\bcryptPrimitives.dll (6.2.22000.376) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.22000.376 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.376
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 3611, Write: 307, Other 858
- I/O Transfers Counters -
Read: 6684732, Write: 6045, Other 29594
- Paged Pool Usage -
QuotaPagedPoolUsage: 3439320, QuotaPeakPagedPoolUsage: 3439320
QuotaNonPagedPoolUsage: 40896, QuotaPeakNonPagedPoolUsage: 40896
- Virtual Memory Usage -
VirtualSize: -1309917184, PeakVirtualSize: -713547776
- Pagefile Usage -
PagefileUsage: -1309917184, PeakPagefileUsage: -1309868032
- Working Set Size -
WorkingSetSize: 1220382720, PeakWorkingSetSize: 1220382720, PageFaultCount: 423791
*** Dump of thread ID 24120 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 3437500.000000, User Time: 11562500.000000, Wait Time: 4980512.000000
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFCA214478C
- Registers -
rax=000000005a4e6090 rbx=000000001bb84910 rcx=000000005a4e60a0 rdx=0000000089d6a9a2 rsi=000000005a4e6a10 rdi=0000000019930520
r8=000000005a4e6090 r9=00000000e45f4d20 r10=000000004590331d r11=000000004590331d r12=00000000c2c99c90 r13=000000005a4e6c20
r14=00000000bda4d120 r15=0000000000000000 rip=00000000a214478c rsp=000000005a4e68b0 rbp=000000005a4e6ba0
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000206
- Callstack -
ChildEBP RetAddr Args to Child
5a4e6980 1ba9a884 00000040 0000004f c2c99b00 0000011f KERNELBASE!RaiseException+0x0
5a4e69e0 1b841ca6 000011f0 00000000 d9cef580 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
5a4e6a90 1b84593b 00000000 00000020 00000000 00000030 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
5a4e6be0 1b841a78 00000000 00000000 5a4e6f10 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
5a4e6cb0 1b841cfc 5a4e6f10 00000000 00000080 5a4e71e0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
5a4e6d70 1b84c4dd 5a4e71e0 5a4e71e0 5a4e71e0 5a4e71e0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
5a4e7060 1b83b2fe 5a4e7678 5a4e71e0 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
5a4ffe00 1ba7c6f8 817a4580 00000000 00000000 80388c40 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
5a4ffe40 a31554e0 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
5a4ffe70 a48e485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
5a4ffef0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 20284 (state: Waiting): ***
- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 4980408.000000
- Registers -
rax=00000000000001de rbx=000000008037a7a0 rcx=0000000000000078 rdx=000000008037a420 rsi=0000000080377b20 rdi=000000008037a7a0
r8=0000000000000008 r9=0000000000000040 r10=0000000000000180 r11=0000000000000000 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000a4987304 rsp=000000005a5ffb78 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
5a5ffb70 a48f6c2f 00000000 00000000 80377b20 8037a7a0 ntdll!NtWaitForWorkViaWorkerFactory+0x0
5a5ffe60 a31554e0 00000000 00000000 00000000 00000000 ntdll!EtwNotificationRegister+0x0
5a5ffe90 a48e485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
5a5fff10 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 18632 (state: Waiting): ***
- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 312500.000000, User Time: 0.000000, Wait Time: 4980408.000000
- Registers -
rax=00000000000001de rbx=000000008037b030 rcx=0000000000000078 rdx=000000008037acb0 rsi=0000000080377b20 rdi=000000008037b030
r8=000000005a6fece0 r9=0000000000000000 r10=000000005a6fee26 r11=000000005a6feae0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000a4987304 rsp=000000005a6ff558 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
5a6ff550 a48f6c2f 00000000 00000000 80377b20 8037b030 ntdll!NtWaitForWorkViaWorkerFactory+0x0
5a6ff840 a31554e0 00000000 00000000 00000000 00000000 ntdll!EtwNotificationRegister+0x0
5a6ff870 a48e485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
5a6ff8f0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 3368 (state: Waiting): ***
- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 4980408.000000
- Registers -
rax=00000000000001de rbx=000000008037bc70 rcx=0000000000000078 rdx=000000008037b8f0 rsi=0000000080377b20 rdi=000000008037bc70
r8=000000009c1a5004 r9=0000000000000000 r10=000000009c1a00f0 r11=0000000000000001 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000a4987304 rsp=000000005a7ffa58 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
5a7ffa50 a48f6c2f 00000000 00000000 80377b20 8037bc70 ntdll!NtWaitForWorkViaWorkerFactory+0x0
5a7ffd40 a31554e0 00000000 00000000 00000000 00000000 ntdll!EtwNotificationRegister+0x0
5a7ffd70 a48e485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
5a7ffdf0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 27568 (state: Waiting): ***
- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 4980511.000000
- Registers -
rax=0000000000000034 rbx=000000005a9ffdf0 rcx=0000000000000000 rdx=000000005a9ffdf0 rsi=000000005a21f000 rdi=0000000000000000
r8=000000005a9ffd28 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000a4983dd4 rsp=000000005a9ffd28 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
5a9ffd20 a493b5c3 00000000 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0
5a9ffd50 a214b3a1 00000000 00000000 00000000 00000000 ntdll!RtlDelayExecution+0x0
5a9ffdd0 1b85a07f 00000000 00000000 fff0bdc0 00000000 KERNELBASE!SleepEx+0x0
5a9ffe00 a31554e0 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
5a9ffe30 a48e485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
5a9ffeb0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 19960 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 4980510.000000
- Registers -
rax=000000000000005b rbx=0000000000000007 rcx=0000000000000007 rdx=000000005aaff460 rsi=0000000000000000 rdi=0000000000000007
r8=000000005aaff108 r9=0000000000000000 r10=0000000000000000 r11=000000005aaff3d0 r12=0000000000000064 r13=000000005aaff460
r14=000000005aaff160 r15=0000000000000000 rip=00000000a49842a4 rsp=000000005aaff108 rbp=0000000081f77410
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
5aaff100 a214fb10 00000000 00000000 00000000 00000000 ntdll!NtWaitForMultipleObjects+0x0
5aaff3f0 a214fa0e 5293e1b8 82060fa0 00000007 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
5aaff430 525d5b44 81f7a7d0 00000000 81f74770 00000000 KERNELBASE!WaitForMultipleObjects+0x0
5aaff670 5267d0bd 00000000 81f77410 00000000 00000000 nvcuda64!+0x0
5aaff720 525d5513 30d78c1b 301e6e47 825a6b40 00000000 nvcuda64!cuProfilerStop+0x0
5aaff750 52903044 825a6b40 00000000 00000000 00000000 nvcuda64!+0x0
5aaff780 a31554e0 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
5aaff7b0 a48e485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
5aaff830 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)