Task 5578718
| Name | ParityMachine-1624572408-21241-0_1 |
| Workunit | 3299324 |
| Created | 3 Jul 2021, 8:01:44 UTC |
| Sent | 3 Jul 2021, 10:22:59 UTC |
| Report deadline | 11 Jul 2021, 10:22:59 UTC |
| Received | 3 Jul 2021, 12:58:04 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | -529697949 (0xE06D7363) Unknown error code |
| Computer ID | 7258 |
| Run time | 1 hours 43 min 45 sec |
| CPU time | 1 hours 43 min 26 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 1,132.78 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 2.26 GB |
| Peak swap size | 3.62 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
309853 | val_loss: 0.0313189 | Time: 8561.46 ms
[2021-07-03 14:20:26 main:574] : INFO : Epoch 470 | loss: 0.0309883 | val_loss: 0.0313136 | Time: 8584.67 ms
[2021-07-03 14:20:35 main:574] : INFO : Epoch 471 | loss: 0.030979 | val_loss: 0.0313128 | Time: 8503.09 ms
[2021-07-03 14:20:43 main:574] : INFO : Epoch 472 | loss: 0.0309921 | val_loss: 0.0312989 | Time: 8561.78 ms
[2021-07-03 14:20:51 main:574] : INFO : Epoch 473 | loss: 0.0309998 | val_loss: 0.0313341 | Time: 7338.14 ms
[2021-07-03 14:20:59 main:574] : INFO : Epoch 474 | loss: 0.030983 | val_loss: 0.0313395 | Time: 8539.68 ms
[2021-07-03 14:21:08 main:574] : INFO : Epoch 475 | loss: 0.0309828 | val_loss: 0.0313142 | Time: 8523.51 ms
[2021-07-03 14:21:16 main:574] : INFO : Epoch 476 | loss: 0.0309817 | val_loss: 0.0313432 | Time: 8519.75 ms
[2021-07-03 14:21:25 main:574] : INFO : Epoch 477 | loss: 0.0309781 | val_loss: 0.031335 | Time: 8514.03 ms
[2021-07-03 14:21:32 main:574] : INFO : Epoch 478 | loss: 0.030985 | val_loss: 0.0313061 | Time: 7378.59 ms
[2021-07-03 14:21:41 main:574] : INFO : Epoch 479 | loss: 0.0310006 | val_loss: 0.031322 | Time: 8526.78 ms
[2021-07-03 14:21:49 main:574] : INFO : Epoch 480 | loss: 0.0310043 | val_loss: 0.0313737 | Time: 8565.08 ms
[2021-07-03 14:21:58 main:574] : INFO : Epoch 481 | loss: 0.0309968 | val_loss: 0.0313157 | Time: 8544.53 ms
[2021-07-03 14:22:06 main:574] : INFO : Epoch 482 | loss: 0.0309949 | val_loss: 0.0313191 | Time: 8546.02 ms
[2021-07-03 14:22:15 main:574] : INFO : Epoch 483 | loss: 0.0309819 | val_loss: 0.0312745 | Time: 8550.29 ms
[2021-07-03 14:22:22 main:574] : INFO : Epoch 484 | loss: 0.0309853 | val_loss: 0.031329 | Time: 7357.95 ms
[2021-07-03 14:22:31 main:574] : INFO : Epoch 485 | loss: 0.030987 | val_loss: 0.0313676 | Time: 8508.86 ms
[2021-07-03 14:22:39 main:574] : INFO : Epoch 486 | loss: 0.0309929 | val_loss: 0.0313159 | Time: 8540.63 ms
[2021-07-03 14:22:48 main:574] : INFO : Epoch 487 | loss: 0.0309918 | val_loss: 0.0313151 | Time: 8529.3 ms
[2021-07-03 14:22:57 main:574] : INFO : Epoch 488 | loss: 0.0310052 | val_loss: 0.0312695 | Time: 8562.03 ms
[2021-07-03 14:23:05 main:574] : INFO : Epoch 489 | loss: 0.0309996 | val_loss: 0.0313614 | Time: 8520.99 ms
[2021-07-03 14:23:12 main:574] : INFO : Epoch 490 | loss: 0.0309958 | val_loss: 0.0313191 | Time: 7350.19 ms
[2021-07-03 14:23:21 main:574] : INFO : Epoch 491 | loss: 0.0310079 | val_loss: 0.0313343 | Time: 8537.86 ms
[2021-07-03 14:23:29 main:574] : INFO : Epoch 492 | loss: 0.0309916 | val_loss: 0.0313468 | Time: 8529.07 ms
[2021-07-03 14:23:38 main:574] : INFO : Epoch 493 | loss: 0.030984 | val_loss: 0.0313386 | Time: 8539.84 ms
[2021-07-03 14:23:47 main:574] : INFO : Epoch 494 | loss: 0.0309735 | val_loss: 0.0313364 | Time: 8510.24 ms
[2021-07-03 14:23:55 main:574] : INFO : Epoch 495 | loss: 0.0309796 | val_loss: 0.0313228 | Time: 8535.34 ms
[2021-07-03 14:24:02 main:574] : INFO : Epoch 496 | loss: 0.0309784 | val_loss: 0.0313258 | Time: 7384.41 ms
[2021-07-03 14:24:11 main:574] : INFO : Epoch 497 | loss: 0.0309783 | val_loss: 0.0313132 | Time: 8490.38 ms
[2021-07-03 14:24:20 main:574] : INFO : Epoch 498 | loss: 0.0309949 | val_loss: 0.0313231 | Time: 8572.08 ms
[2021-07-03 14:24:28 main:574] : INFO : Epoch 499 | loss: 0.03099 | val_loss: 0.0313264 | Time: 8563.59 ms
[2021-07-03 14:24:37 main:574] : INFO : Epoch 500 | loss: 0.0309817 | val_loss: 0.0313312 | Time: 8515.26 ms
[2021-07-03 14:24:45 main:574] : INFO : Epoch 501 | loss: 0.0309809 | val_loss: 0.0313275 | Time: 8576.22 ms
[2021-07-03 14:24:53 main:574] : INFO : Epoch 502 | loss: 0.0309806 | val_loss: 0.0313129 | Time: 7340.13 ms
[2021-07-03 14:25:01 main:574] : INFO : Epoch 503 | loss: 0.0309811 | val_loss: 0.0313275 | Time: 8556.97 ms
[2021-07-03 14:25:10 main:574] : INFO : Epoch 504 | loss: 0.0309782 | val_loss: 0.0312902 | Time: 8535.79 ms
[2021-07-03 14:25:18 main:574] : INFO : Epoch 505 | loss: 0.030984 | val_loss: 0.0313072 | Time: 8480.92 ms
[2021-07-03 14:25:27 main:574] : INFO : Epoch 506 | loss: 0.0309761 | val_loss: 0.0313465 | Time: 8591.54 ms
[2021-07-03 14:25:34 main:574] : INFO : Epoch 507 | loss: 0.0309775 | val_loss: 0.0313429 | Time: 7390.07 ms
[2021-07-03 14:25:43 main:574] : INFO : Epoch 508 | loss: 0.0309766 | val_loss: 0.0313515 | Time: 8546.15 ms
[2021-07-03 14:25:51 main:574] : INFO : Epoch 509 | loss: 0.030977 | val_loss: 0.0313271 | Time: 8536.64 ms
[2021-07-03 14:26:00 main:574] : INFO : Epoch 510 | loss: 0.0309751 | val_loss: 0.0313298 | Time: 8498.24 ms
[2021-07-03 14:26:08 main:574] : INFO : Epoch 511 | loss: 0.0309765 | val_loss: 0.0313598 | Time: 8529.16 ms
[2021-07-03 14:26:16 main:574] : INFO : Epoch 512 | loss: 0.0309743 | val_loss: 0.0313278 | Time: 7340.6 ms
[2021-07-03 14:26:24 main:574] : INFO : Epoch 513 | loss: 0.0309744 | val_loss: 0.0313494 | Time: 8500.62 ms
[2021-07-03 14:26:33 main:574] : INFO : Epoch 514 | loss: 0.0309752 | val_loss: 0.0313576 | Time: 8536.7 ms
[2021-07-03 14:26:41 main:574] : INFO : Epoch 515 | loss: 0.0309779 | val_loss: 0.0313016 | Time: 8475 ms
[2021-07-03 14:26:50 main:574] : INFO : Epoch 516 | loss: 0.030985 | val_loss: 0.0313255 | Time: 8557.29 ms
[2021-07-03 14:26:58 main:574] : INFO : Epoch 517 | loss: 0.0309733 | val_loss: 0.0313382 | Time: 8517.84 ms
[2021-07-03 14:27:05 main:574] : INFO : Epoch 518 | loss: 0.0309753 | val_loss: 0.0313756 | Time: 7313.88 ms
[2021-07-03 14:27:14 main:574] : INFO : Epoch 519 | loss: 0.0309871 | val_loss: 0.0313093 | Time: 8471.28 ms
[2021-07-03 14:27:22 main:574] : INFO : Epoch 520 | loss: 0.0309764 | val_loss: 0.0313398 | Time: 8522.39 ms
[2021-07-03 14:27:31 main:574] : INFO : Epoch 521 | loss: 0.0309723 | val_loss: 0.0313106 | Time: 8469.21 ms
[2021-07-03 14:27:39 main:574] : INFO : Epoch 522 | loss: 0.0309825 | val_loss: 0.0313555 | Time: 8505.12 ms
[2021-07-03 14:27:47 main:574] : INFO : Epoch 523 | loss: 0.030987 | val_loss: 0.0313017 | Time: 7316.34 ms
[2021-07-03 14:27:55 main:574] : INFO : Epoch 524 | loss: 0.0309859 | val_loss: 0.0313564 | Time: 8527.82 ms
[2021-07-03 14:28:04 main:574] : INFO : Epoch 525 | loss: 0.0309837 | val_loss: 0.0313412 | Time: 8619.02 ms
[2021-07-03 14:28:12 main:574] : INFO : Epoch 526 | loss: 0.0309885 | val_loss: 0.031333 | Time: 8552.14 ms
[2021-07-03 14:28:21 main:574] : INFO : Epoch 527 | loss: 0.0309795 | val_loss: 0.031352 | Time: 8549.23 ms
[2021-07-03 14:28:28 main:574] : INFO : Epoch 528 | loss: 0.0309818 | val_loss: 0.031386 | Time: 7324.19 ms
[2021-07-03 14:28:37 main:574] : INFO : Epoch 529 | loss: 0.0309704 | val_loss: 0.0313292 | Time: 8530.87 ms
[2021-07-03 14:28:45 main:574] : INFO : Epoch 530 | loss: 0.030976 | val_loss: 0.0313486 | Time: 8541.96 ms
[2021-07-03 14:28:54 main:574] : INFO : Epoch 531 | loss: 0.0309815 | val_loss: 0.0312944 | Time: 8491.36 ms
[2021-07-03 14:29:02 main:574] : INFO : Epoch 532 | loss: 0.0310027 | val_loss: 0.031385 | Time: 8523.02 ms
[2021-07-03 14:29:10 main:574] : INFO : Epoch 533 | loss: 0.030994 | val_loss: 0.0312936 | Time: 7330.81 ms
[2021-07-03 14:29:18 main:574] : INFO : Epoch 534 | loss: 0.0309866 | val_loss: 0.0313421 | Time: 8475.16 ms
[2021-07-03 14:29:27 main:574] : INFO : Epoch 535 | loss: 0.0309781 | val_loss: 0.0313274 | Time: 8534.82 ms
[2021-07-03 14:29:35 main:574] : INFO : Epoch 536 | loss: 0.0309936 | val_loss: 0.0313495 | Time: 8537.11 ms
[2021-07-03 14:29:44 main:574] : INFO : Epoch 537 | loss: 0.0309929 | val_loss: 0.0313145 | Time: 8541.38 ms
[2021-07-03 14:29:51 main:574] : INFO : Epoch 538 | loss: 0.0309861 | val_loss: 0.0313469 | Time: 7342.98 ms
[2021-07-03 14:30:00 main:574] : INFO : Epoch 539 | loss: 0.0309843 | val_loss: 0.0312823 | Time: 8497.27 ms
[2021-07-03 14:30:08 main:574] : INFO : Epoch 540 | loss: 0.0309898 | val_loss: 0.0313801 | Time: 8504.92 ms
[2021-07-03 14:30:17 main:574] : INFO : Epoch 541 | loss: 0.0309836 | val_loss: 0.0312897 | Time: 8551.61 ms
[2021-07-03 14:30:25 main:574] : INFO : Epoch 542 | loss: 0.0309808 | val_loss: 0.0313136 | Time: 8475.2 ms
[2021-07-03 14:30:33 main:574] : INFO : Epoch 543 | loss: 0.0309777 | val_loss: 0.0313636 | Time: 7346.49 ms
[2021-07-03 14:30:41 main:574] : INFO : Epoch 544 | loss: 0.0309909 | val_loss: 0.0313231 | Time: 8470.66 ms
[2021-07-03 14:30:50 main:574] : INFO : Epoch 545 | loss: 0.0309746 | val_loss: 0.0313173 | Time: 8547.98 ms
[2021-07-03 14:30:58 main:574] : INFO : Epoch 546 | loss: 0.0309858 | val_loss: 0.0312934 | Time: 8552.71 ms
[2021-07-03 14:31:07 main:574] : INFO : Epoch 547 | loss: 0.0309875 | val_loss: 0.0313472 | Time: 8535.42 ms
[2021-07-03 14:31:14 main:574] : INFO : Epoch 548 | loss: 0.0309858 | val_loss: 0.0313595 | Time: 7396.88 ms
[2021-07-03 14:31:23 main:574] : INFO : Epoch 549 | loss: 0.0309914 | val_loss: 0.031304 | Time: 8511.46 ms
[2021-07-03 14:31:31 main:574] : INFO : Epoch 550 | loss: 0.0309883 | val_loss: 0.0313932 | Time: 8527.72 ms
[2021-07-03 14:31:40 main:574] : INFO : Epoch 551 | loss: 0.0310026 | val_loss: 0.0313694 | Time: 8545.12 ms
[2021-07-03 14:31:48 main:574] : INFO : Epoch 552 | loss: 0.030992 | val_loss: 0.031325 | Time: 8528.8 ms
[2021-07-03 14:31:57 main:574] : INFO : Epoch 553 | loss: 0.0309773 | val_loss: 0.0313627 | Time: 8528.59 ms
[2021-07-03 14:32:04 main:574] : INFO : Epoch 554 | loss: 0.0309782 | val_loss: 0.0313192 | Time: 7400.99 ms
[2021-07-03 14:32:13 main:574] : INFO : Epoch 555 | loss: 0.0309764 | val_loss: 0.0313216 | Time: 8530.15 ms
[2021-07-03 14:32:21 main:574] : INFO : Epoch 556 | loss: 0.0309771 | val_loss: 0.0313734 | Time: 8515.13 ms
[2021-07-03 14:32:30 main:574] : INFO : Epoch 557 | loss: 0.0309899 | val_loss: 0.0313049 | Time: 8480.94 ms
[2021-07-03 14:32:38 main:574] : INFO : Epoch 558 | loss: 0.0309755 | val_loss: 0.0313561 | Time: 8527.12 ms
[2021-07-03 14:32:46 main:574] : INFO : Epoch 559 | loss: 0.0309829 | val_loss: 0.0313284 | Time: 7367.48 ms
[2021-07-03 14:32:54 main:574] : INFO : Epoch 560 | loss: 0.0309779 | val_loss: 0.0313398 | Time: 8521.84 ms
[2021-07-03 14:33:03 main:574] : INFO : Epoch 561 | loss: 0.0309755 | val_loss: 0.0313456 | Time: 8548.04 ms
[2021-07-03 14:33:11 main:574] : INFO : Epoch 562 | loss: 0.0309818 | val_loss: 0.0313133 | Time: 8592.17 ms
[2021-07-03 14:33:20 main:574] : INFO : Epoch 563 | loss: 0.0309856 | val_loss: 0.0312647 | Time: 8521.55 ms
[2021-07-03 14:33:28 main:574] : INFO : Epoch 564 | loss: 0.0309965 | val_loss: 0.0313259 | Time: 8543.28 ms
[2021-07-03 14:33:36 main:574] : INFO : Epoch 565 | loss: 0.030991 | val_loss: 0.0313331 | Time: 7322.29 ms
[2021-07-03 14:33:44 main:574] : INFO : Epoch 566 | loss: 0.0309901 | val_loss: 0.0313058 | Time: 8565.44 ms
[2021-07-03 14:33:53 main:574] : INFO : Epoch 567 | loss: 0.0309888 | val_loss: 0.0313271 | Time: 8536.17 ms
[2021-07-03 14:34:01 main:574] : INFO : Epoch 568 | loss: 0.0309729 | val_loss: 0.0313245 | Time: 8516.79 ms
[2021-07-03 14:34:10 main:574] : INFO : Epoch 569 | loss: 0.0309807 | val_loss: 0.0313362 | Time: 8546.47 ms
[2021-07-03 14:34:18 main:574] : INFO : Epoch 570 | loss: 0.030992 | val_loss: 0.0313328 | Time: 8540.48 ms
[2021-07-03 14:34:26 main:574] : INFO : Epoch 571 | loss: 0.0309811 | val_loss: 0.0313385 | Time: 7312.93 ms
[2021-07-03 14:34:34 main:574] : INFO : Epoch 572 | loss: 0.0309837 | val_loss: 0.0312916 | Time: 8507.22 ms
[2021-07-03 14:34:43 main:574] : INFO : Epoch 573 | loss: 0.0309982 | val_loss: 0.0313277 | Time: 8482.43 ms
[2021-07-03 14:34:51 main:574] : INFO : Epoch 574 | loss: 0.030993 | val_loss: 0.0312825 | Time: 8550.08 ms
[2021-07-03 14:35:00 main:574] : INFO : Epoch 575 | loss: 0.0309889 | val_loss: 0.0312981 | Time: 8563.11 ms
[2021-07-03 14:35:07 main:574] : INFO : Epoch 576 | loss: 0.0309777 | val_loss: 0.031336 | Time: 7360.77 ms
[2021-07-03 14:35:16 main:574] : INFO : Epoch 577 | loss: 0.0309822 | val_loss: 0.0313204 | Time: 8555.02 ms
[2021-07-03 14:35:24 main:574] : INFO : Epoch 578 | loss: 0.0309812 | val_loss: 0.0313462 | Time: 8524.54 ms
[2021-07-03 14:35:33 main:574] : INFO : Epoch 579 | loss: 0.0309739 | val_loss: 0.0313365 | Time: 8518.29 ms
[2021-07-03 14:35:41 main:574] : INFO : Epoch 580 | loss: 0.0309747 | val_loss: 0.0313546 | Time: 8522.49 ms
[2021-07-03 14:35:49 main:574] : INFO : Epoch 581 | loss: 0.030972 | val_loss: 0.0313321 | Time: 7335.03 ms
[2021-07-03 14:35:57 main:574] : INFO : Epoch 582 | loss: 0.0309774 | val_loss: 0.0313212 | Time: 8567.26 ms
[2021-07-03 14:36:06 main:574] : INFO : Epoch 583 | loss: 0.0309808 | val_loss: 0.0313284 | Time: 8506.36 ms
[2021-07-03 14:36:14 main:574] : INFO : Epoch 584 | loss: 0.0309847 | val_loss: 0.0313518 | Time: 8539.19 ms
[2021-07-03 14:36:23 main:574] : INFO : Epoch 585 | loss: 0.0309762 | val_loss: 0.0313534 | Time: 8518.18 ms
[2021-07-03 14:36:30 main:574] : INFO : Epoch 586 | loss: 0.0309776 | val_loss: 0.0313853 | Time: 7313.33 ms
[2021-07-03 14:36:39 main:574] : INFO : Epoch 587 | loss: 0.0309857 | val_loss: 0.0313262 | Time: 8520.72 ms
[2021-07-03 14:36:47 main:574] : INFO : Epoch 588 | loss: 0.0309842 | val_loss: 0.0313526 | Time: 8507.71 ms
[2021-07-03 14:36:56 main:574] : INFO : Epoch 589 | loss: 0.0309789 | val_loss: 0.0313331 | Time: 8494.96 ms
[2021-07-03 14:37:04 main:574] : INFO : Epoch 590 | loss: 0.0309773 | val_loss: 0.0313499 | Time: 8494.21 ms
[2021-07-03 14:37:12 main:574] : INFO : Epoch 591 | loss: 0.030982 | val_loss: 0.0313342 | Time: 7374.21 ms
[2021-07-03 14:37:20 main:574] : INFO : Epoch 592 | loss: 0.0309826 | val_loss: 0.0313312 | Time: 8527.28 ms
[2021-07-03 14:37:29 main:574] : INFO : Epoch 593 | loss: 0.031017 | val_loss: 0.03127 | Time: 8557.23 ms
[2021-07-03 14:37:37 main:574] : INFO : Epoch 594 | loss: 0.0309999 | val_loss: 0.0313687 | Time: 8507.01 ms
[2021-07-03 14:37:46 main:574] : INFO : Epoch 595 | loss: 0.0309851 | val_loss: 0.0313543 | Time: 8570.37 ms
[2021-07-03 14:37:54 main:574] : INFO : Epoch 596 | loss: 0.030973 | val_loss: 0.0313386 | Time: 8479.71 ms
[2021-07-03 14:38:02 main:574] : INFO : Epoch 597 | loss: 0.0309831 | val_loss: 0.0313281 | Time: 7343.29 ms
[2021-07-03 14:38:10 main:574] : INFO : Epoch 598 | loss: 0.030989 | val_loss: 0.0313516 | Time: 8540.03 ms
[2021-07-03 14:38:19 main:574] : INFO : Epoch 599 | loss: 0.0309827 | val_loss: 0.0313278 | Time: 8529.69 ms
[2021-07-03 14:38:27 main:574] : INFO : Epoch 600 | loss: 0.0309824 | val_loss: 0.03131 | Time: 8542.37 ms
[2021-07-03 14:38:36 main:574] : INFO : Epoch 601 | loss: 0.0309776 | val_loss: 0.0313203 | Time: 8516.79 ms
[2021-07-03 14:38:44 main:574] : INFO : Epoch 602 | loss: 0.0309773 | val_loss: 0.0313465 | Time: 8497.44 ms
[2021-07-03 14:38:52 main:574] : INFO : Epoch 603 | loss: 0.0309724 | val_loss: 0.0313385 | Time: 7336.89 ms
[2021-07-03 14:39:00 main:574] : INFO : Epoch 604 | loss: 0.0309723 | val_loss: 0.0313333 | Time: 8528.24 ms
[2021-07-03 14:39:09 main:574] : INFO : Epoch 605 | loss: 0.0309726 | val_loss: 0.0313191 | Time: 8514.92 ms
[2021-07-03 14:39:17 main:574] : INFO : Epoch 606 | loss: 0.0309841 | val_loss: 0.0313645 | Time: 8519.76 ms
[2021-07-03 14:39:26 main:574] : INFO : Epoch 607 | loss: 0.0309795 | val_loss: 0.0313056 | Time: 8531.04 ms
[2021-07-03 14:39:33 main:574] : INFO : Epoch 608 | loss: 0.0309875 | val_loss: 0.0313745 | Time: 7371.15 ms
[2021-07-03 14:39:42 main:574] : INFO : Epoch 609 | loss: 0.0309845 | val_loss: 0.0313309 | Time: 8525.06 ms
[2021-07-03 14:39:50 main:574] : INFO : Epoch 610 | loss: 0.0309756 | val_loss: 0.0312936 | Time: 8516.41 ms
[2021-07-03 14:39:59 main:574] : INFO : Epoch 611 | loss: 0.0309797 | val_loss: 0.0313436 | Time: 8528.15 ms
[2021-07-03 14:40:07 main:574] : INFO : Epoch 612 | loss: 0.030983 | val_loss: 0.0313531 | Time: 8518.36 ms
[2021-07-03 14:40:14 main:574] : INFO : Epoch 613 | loss: 0.0309763 | val_loss: 0.0313401 | Time: 7341.11 ms
[2021-07-03 14:40:23 main:574] : INFO : Epoch 614 | loss: 0.0309744 | val_loss: 0.0313463 | Time: 8528.88 ms
[2021-07-03 14:40:32 main:574] : INFO : Epoch 615 | loss: 0.0309743 | val_loss: 0.0313143 | Time: 8505.56 ms
[2021-07-03 14:40:40 main:574] : INFO : Epoch 616 | loss: 0.030973 | val_loss: 0.0313769 | Time: 8513.93 ms
[2021-07-03 14:40:49 main:574] : INFO : Epoch 617 | loss: 0.0309826 | val_loss: 0.0313375 | Time: 8575.59 ms
[2021-07-03 14:40:57 main:574] : INFO : Epoch 618 | loss: 0.0309795 | val_loss: 0.0313557 | Time: 8531.42 ms
[2021-07-03 14:41:05 main:574] : INFO : Epoch 619 | loss: 0.0309756 | val_loss: 0.031376 | Time: 7374.72 ms
[2021-07-03 14:41:13 main:574] : INFO : Epoch 620 | loss: 0.0309808 | val_loss: 0.0313108 | Time: 8503.07 ms
[2021-07-03 14:41:22 main:574] : INFO : Epoch 621 | loss: 0.0309734 | val_loss: 0.0313277 | Time: 8508.71 ms
[2021-07-03 14:41:30 main:574] : INFO : Epoch 622 | loss: 0.0309833 | val_loss: 0.0314039 | Time: 8540.56 ms
[2021-07-03 14:41:39 main:574] : INFO : Epoch 623 | loss: 0.0309844 | val_loss: 0.0312942 | Time: 8562.94 ms
[2021-07-03 14:41:47 main:574] : INFO : Epoch 624 | loss: 0.0309764 | val_loss: 0.0313467 | Time: 8601.7 ms
[2021-07-03 14:41:55 main:574] : INFO : Epoch 625 | loss: 0.0309826 | val_loss: 0.0313289 | Time: 7325.76 ms
[2021-07-03 14:42:03 main:574] : INFO : Epoch 626 | loss: 0.0309807 | val_loss: 0.0313033 | Time: 8541.49 ms
[2021-07-03 14:42:12 main:574] : INFO : Epoch 627 | loss: 0.0309895 | val_loss: 0.0313511 | Time: 8635.82 ms
[2021-07-03 14:42:20 main:574] : INFO : Epoch 628 | loss: 0.0309746 | val_loss: 0.0313604 | Time: 8595.1 ms
[2021-07-03 14:42:29 main:574] : INFO : Epoch 629 | loss: 0.0309744 | val_loss: 0.0312944 | Time: 8562.51 ms
[2021-07-03 14:42:37 main:574] : INFO : Epoch 630 | loss: 0.0309849 | val_loss: 0.0312937 | Time: 8506.28 ms
[2021-07-03 14:42:45 main:574] : INFO : Epoch 631 | loss: 0.0309803 | val_loss: 0.0313473 | Time: 7387.01 ms
[2021-07-03 14:42:53 main:574] : INFO : Epoch 632 | loss: 0.0309712 | val_loss: 0.0313177 | Time: 8596.4 ms
[2021-07-03 14:43:02 main:574] : INFO : Epoch 633 | loss: 0.0309747 | val_loss: 0.031365 | Time: 8548.85 ms
[2021-07-03 14:43:11 main:574] : INFO : Epoch 634 | loss: 0.0309819 | val_loss: 0.0312972 | Time: 8545.06 ms
[2021-07-03 14:43:19 main:574] : INFO : Epoch 635 | loss: 0.0310044 | val_loss: 0.0313258 | Time: 8505.02 ms
[2021-07-03 14:43:26 main:574] : INFO : Epoch 636 | loss: 0.0309943 | val_loss: 0.0312983 | Time: 7343.29 ms
[2021-07-03 14:43:35 main:574] : INFO : Epoch 637 | loss: 0.0309841 | val_loss: 0.0313188 | Time: 8566.18 ms
[2021-07-03 14:43:43 main:574] : INFO : Epoch 638 | loss: 0.0309756 | val_loss: 0.0313141 | Time: 8499.58 ms
[2021-07-03 14:43:52 main:574] : INFO : Epoch 639 | loss: 0.030972 | val_loss: 0.0313553 | Time: 8541.21 ms
[2021-07-03 14:44:01 main:574] : INFO : Epoch 640 | loss: 0.0309739 | val_loss: 0.0313118 | Time: 8553.65 ms
[2021-07-03 14:44:08 main:574] : INFO : Epoch 641 | loss: 0.0309804 | val_loss: 0.0313175 | Time: 7311.7 ms
[2021-07-03 14:44:16 main:574] : INFO : Epoch 642 | loss: 0.0309854 | val_loss: 0.0313136 | Time: 8539.53 ms
[2021-07-03 14:44:25 main:574] : INFO : Epoch 643 | loss: 0.0309758 | val_loss: 0.0313493 | Time: 8520.3 ms
[2021-07-03 14:44:33 main:574] : INFO : Epoch 644 | loss: 0.0309776 | val_loss: 0.0313621 | Time: 8503.04 ms
[2021-07-03 14:44:42 main:574] : INFO : Epoch 645 | loss: 0.0309762 | val_loss: 0.0313104 | Time: 8517.06 ms
[2021-07-03 14:44:50 main:574] : INFO : Epoch 646 | loss: 0.0309754 | val_loss: 0.031318 | Time: 8502.62 ms
[2021-07-03 14:44:56 main:574] : INFO : Epoch 647 | loss: 0.0309734 | val_loss: 0.0313314 | Time: 5031.97 ms
[2021-07-03 14:44:59 main:574] : INFO : Epoch 648 | loss: 0.0309733 | val_loss: 0.0313445 | Time: 3844.04 ms
[2021-07-03 14:45:04 main:574] : INFO : Epoch 649 | loss: 0.0309726 | val_loss: 0.0313526 | Time: 4575.66 ms
[2021-07-03 14:45:13 main:574] : INFO : Epoch 650 | loss: 0.0309737 | val_loss: 0.0313437 | Time: 9084.92 ms
[2021-07-03 14:45:22 main:574] : INFO : Epoch 651 | loss: 0.0309751 | val_loss: 0.0313263 | Time: 8846.54 ms
[2021-07-03 14:45:31 main:574] : INFO : Epoch 652 | loss: 0.0309763 | val_loss: 0.0313211 | Time: 8941.82 ms
[2021-07-03 14:45:40 main:574] : INFO : Epoch 653 | loss: 0.0309867 | val_loss: 0.0313125 | Time: 9168.85 ms
[2021-07-03 14:45:49 main:574] : INFO : Epoch 654 | loss: 0.0309882 | val_loss: 0.0313499 | Time: 8928.52 ms
[2021-07-03 14:45:58 main:574] : INFO : Epoch 655 | loss: 0.0309768 | val_loss: 0.0312811 | Time: 8880.24 ms
[2021-07-03 14:46:05 main:574] : INFO : Epoch 656 | loss: 0.0309746 | val_loss: 0.0313601 | Time: 7610.92 ms
[2021-07-03 14:46:14 main:574] : INFO : Epoch 657 | loss: 0.0309631 | val_loss: 0.0313109 | Time: 8960.6 ms
[2021-07-03 14:46:23 main:574] : INFO : Epoch 658 | loss: 0.0309744 | val_loss: 0.0313447 | Time: 8866.79 ms
[2021-07-03 14:46:32 main:574] : INFO : Epoch 659 | loss: 0.0309792 | val_loss: 0.031359 | Time: 9155.95 ms
[2021-07-03 14:46:41 main:574] : INFO : Epoch 660 | loss: 0.0309775 | val_loss: 0.0313043 | Time: 9037.65 ms
[2021-07-03 14:46:51 main:574] : INFO : Epoch 661 | loss: 0.0309789 | val_loss: 0.0312974 | Time: 9207.06 ms
[2021-07-03 14:47:00 main:574] : INFO : Epoch 662 | loss: 0.0309846 | val_loss: 0.0313654 | Time: 9230.79 ms
[2021-07-03 14:47:09 main:574] : INFO : Epoch 663 | loss: 0.0309928 | val_loss: 0.0313301 | Time: 9396.32 ms
[2021-07-03 14:47:17 main:574] : INFO : Epoch 664 | loss: 0.0309878 | val_loss: 0.031382 | Time: 7810.03 ms
[2021-07-03 14:47:26 main:574] : INFO : Epoch 665 | loss: 0.0309806 | val_loss: 0.0313275 | Time: 9196.84 ms
[2021-07-03 14:47:36 main:574] : INFO : Epoch 666 | loss: 0.0309778 | val_loss: 0.0313653 | Time: 9402.62 ms
[2021-07-03 14:47:45 main:574] : INFO : Epoch 667 | loss: 0.0309708 | val_loss: 0.0313165 | Time: 9182.61 ms
[2021-07-03 14:47:54 main:574] : INFO : Epoch 668 | loss: 0.0309796 | val_loss: 0.0314034 | Time: 9127.99 ms
[2021-07-03 14:48:03 main:574] : INFO : Epoch 669 | loss: 0.0309903 | val_loss: 0.031333 | Time: 9231.77 ms
[2021-07-03 14:48:12 main:574] : INFO : Epoch 670 | loss: 0.0309841 | val_loss: 0.0313298 | Time: 9162.65 ms
[2021-07-03 14:48:20 main:574] : INFO : Epoch 671 | loss: 0.0309944 | val_loss: 0.0312938 | Time: 7831.14 ms
[2021-07-03 14:48:30 main:574] : INFO : Epoch 672 | loss: 0.030984 | val_loss: 0.0313719 | Time: 9257.5 ms
[2021-07-03 14:48:39 main:574] : INFO : Epoch 673 | loss: 0.0309768 | val_loss: 0.0313398 | Time: 9201.8 ms
[2021-07-03 14:48:48 main:574] : INFO : Epoch 674 | loss: 0.0309718 | val_loss: 0.031373 | Time: 9185.26 ms
[2021-07-03 14:48:57 main:574] : INFO : Epoch 675 | loss: 0.0309706 | val_loss: 0.0313284 | Time: 9208.01 ms
[2021-07-03 14:49:07 main:574] : INFO : Epoch 676 | loss: 0.030972 | val_loss: 0.0313544 | Time: 9435.05 ms
[2021-07-03 14:49:16 main:574] : INFO : Epoch 677 | loss: 0.0309717 | val_loss: 0.03131 | Time: 9369.01 ms
[2021-07-03 14:49:25 main:574] : INFO : Epoch 678 | loss: 0.0309861 | val_loss: 0.0313523 | Time: 9389.44 ms
[2021-07-03 14:49:35 main:574] : INFO : Epoch 679 | loss: 0.0309797 | val_loss: 0.0313511 | Time: 9396.82 ms
[2021-07-03 14:49:44 main:574] : INFO : Epoch 680 | loss: 0.0309723 | val_loss: 0.0312981 | Time: 9271.99 ms
[2021-07-03 14:49:52 main:574] : INFO : Epoch 681 | loss: 0.0309844 | val_loss: 0.0313645 | Time: 7787.55 ms
[2021-07-03 14:50:01 main:574] : INFO : Epoch 682 | loss: 0.0309831 | val_loss: 0.0313739 | Time: 9126.99 ms
[2021-07-03 14:50:10 main:574] : INFO : Epoch 683 | loss: 0.0309887 | val_loss: 0.0313334 | Time: 9261.31 ms
[2021-07-03 14:50:20 main:574] : INFO : Epoch 684 | loss: 0.0309743 | val_loss: 0.0313205 | Time: 9423 ms
[2021-07-03 14:50:29 main:574] : INFO : Epoch 685 | loss: 0.0309706 | val_loss: 0.0313319 | Time: 9385.15 ms
[2021-07-03 14:50:38 main:574] : INFO : Epoch 686 | loss: 0.030977 | val_loss: 0.0313015 | Time: 9343.3 ms
[2021-07-03 14:50:48 main:574] : INFO : Epoch 687 | loss: 0.0309672 | val_loss: 0.0313573 | Time: 9334.37 ms
[2021-07-03 14:50:57 main:574] : INFO : Epoch 688 | loss: 0.0309753 | val_loss: 0.0313083 | Time: 9223.81 ms
[2021-07-03 14:51:06 main:574] : INFO : Epoch 689 | loss: 0.0309616 | val_loss: 0.0313509 | Time: 9282.61 ms
[2021-07-03 14:51:15 main:574] : INFO : Epoch 690 | loss: 0.0309627 | val_loss: 0.0313371 | Time: 9219.46 ms
[2021-07-03 14:51:25 main:574] : INFO : Epoch 691 | loss: 0.0309673 | val_loss: 0.0313274 | Time: 9551.31 ms
[2021-07-03 14:51:33 main:574] : INFO : Epoch 692 | loss: 0.0309768 | val_loss: 0.0313409 | Time: 7774.36 ms
[2021-07-03 14:51:42 main:574] : INFO : Epoch 693 | loss: 0.0309827 | val_loss: 0.0313367 | Time: 9268.69 ms
[2021-07-03 14:51:51 main:574] : INFO : Epoch 694 | loss: 0.0309758 | val_loss: 0.0313472 | Time: 9282.36 ms
[2021-07-03 14:52:00 main:574] : INFO : Epoch 695 | loss: 0.0309707 | val_loss: 0.0313272 | Time: 9163.75 ms
[2021-07-03 14:52:10 main:574] : INFO : Epoch 696 | loss: 0.0309683 | val_loss: 0.0313051 | Time: 9185.51 ms
[2021-07-03 14:52:19 main:574] : INFO : Epoch 697 | loss: 0.030972 | val_loss: 0.0313422 | Time: 9167.74 ms
[2021-07-03 14:52:27 main:574] : INFO : Epoch 698 | loss: 0.0309792 | val_loss: 0.0313322 | Time: 7785.26 ms
[2021-07-03 14:52:36 main:574] : INFO : Epoch 699 | loss: 0.0309722 | val_loss: 0.0313508 | Time: 9325.67 ms
[2021-07-03 14:52:46 main:574] : INFO : Epoch 700 | loss: 0.030982 | val_loss: 0.0313391 | Time: 9557.21 ms
[2021-07-03 14:52:55 main:574] : INFO : Epoch 701 | loss: 0.030984 | val_loss: 0.0313037 | Time: 9202.67 ms
[2021-07-03 14:53:04 main:574] : INFO : Epoch 702 | loss: 0.0309779 | val_loss: 0.0313472 | Time: 9243.91 ms
[2021-07-03 14:53:13 main:574] : INFO : Epoch 703 | loss: 0.0309723 | val_loss: 0.0313113 | Time: 9174.24 ms
[2021-07-03 14:53:23 main:574] : INFO : Epoch 704 | loss: 0.0309665 | val_loss: 0.0313711 | Time: 9393.39 ms
[2021-07-03 14:53:32 main:574] : INFO : Epoch 705 | loss: 0.0309765 | val_loss: 0.0312785 | Time: 9145.95 ms
[2021-07-03 14:53:40 main:574] : INFO : Epoch 706 | loss: 0.0309758 | val_loss: 0.0313172 | Time: 7799.53 ms
[2021-07-03 14:53:49 main:574] : INFO : Epoch 707 | loss: 0.0309822 | val_loss: 0.0314138 | Time: 9217.09 ms
[2021-07-03 14:53:58 main:574] : INFO : Epoch 708 | loss: 0.0309768 | val_loss: 0.0312989 | Time: 9425.59 ms
[2021-07-03 14:54:07 main:574] : INFO : Epoch 709 | loss: 0.0309722 | val_loss: 0.0313824 | Time: 9200.21 ms
[2021-07-03 14:54:17 main:574] : INFO : Epoch 710 | loss: 0.0309716 | val_loss: 0.031329 | Time: 9202.06 ms
[2021-07-03 14:54:26 main:574] : INFO : Epoch 711 | loss: 0.0309688 | val_loss: 0.0313337 | Time: 9195.45 ms
[2021-07-03 14:54:35 main:574] : INFO : Epoch 712 | loss: 0.030987 | val_loss: 0.0313351 | Time: 9258.11 ms
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFC23624B89
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 07/03/21 14:54:42
Install Directory : C:\Program Files\BOINC\
Data Directory : C:\ProgramData\BOINC
Project Symstore :
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\3;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 00000000f09f0000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000025d10000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.1023 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1023
ModLoad: 00000000245c0000 00000000000bd000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.1023 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1023
ModLoad: 00000000235f0000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.1023 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1023
ModLoad: 0000000024850000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1100
ModLoad: 0000000023b70000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1052) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.1052 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1052
ModLoad: 00000000244d0000 000000000002a000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.746) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.746 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.746
ModLoad: 0000000023480000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.928) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.928 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.928
ModLoad: 0000000023ba0000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 0000000023a20000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 0000000023f90000 00000000000ac000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1052) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.320
ModLoad: 0000000025c30000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.19041.546
ModLoad: 0000000024220000 000000000009b000 C:\WINDOWS\System32\sechost.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.320
ModLoad: 0000000025a30000 000000000012b000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1052) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.320
ModLoad: 0000000004650000 0000000000058000 C:\ProgramData\BOINC\slots\3\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000000e3f0000 0000000000091000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.25.28508.3) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\8\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.25.28508.3 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.25.28508.3
ModLoad: 000000001c760000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.867 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.867
ModLoad: 0000000015f30000 0000000000019000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.25.28508.3) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\8\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.25.28508.3 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.25.28508.3
ModLoad: 0000000015f20000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.25.28508.3) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\8\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.25.28508.3 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.25.28508.3
ModLoad: 00000000ac530000 000000000abe7000 C:\ProgramData\BOINC\slots\3\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000d7d80000 00000000002db000 C:\ProgramData\BOINC\slots\3\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000d8210000 000000000020d000 C:\ProgramData\BOINC\slots\3\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 0000000018220000 0000000000040000 C:\ProgramData\BOINC\slots\3\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000879e0000 0000000024b49000 C:\ProgramData\BOINC\slots\3\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000000cd10000 0000000000045000 C:\ProgramData\BOINC\slots\3\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000084520000 00000000034b2000 C:\ProgramData\BOINC\slots\3\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 0000000081470000 00000000030a5000 C:\ProgramData\BOINC\slots\3\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 000000001ba40000 0000000000010000 C:\ProgramData\BOINC\slots\3\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 000000007d710000 0000000003d5b000 C:\ProgramData\BOINC\slots\3\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 000000007b840000 0000000001eca000 C:\ProgramData\BOINC\slots\3\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 0000000060490000 000000001b3a4000 C:\ProgramData\BOINC\slots\3\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 00000000572f0000 000000000919f000 C:\ProgramData\BOINC\slots\3\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 0000000025980000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000021d40000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000254b0000 0000000000469000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.844) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1100
ModLoad: 0000000023b20000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000023450000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.320
ModLoad: 0000000023200000 000000000002c000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000023590000 0000000000060000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1052) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.1052 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1052
ModLoad: 00000000238c0000 000000000015f000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.844) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1100
ModLoad: 0000000023040000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000249f0000 000000000073f000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1100
ModLoad: 0000000021510000 0000000000790000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1100
ModLoad: 0000000025150000 0000000000355000 C:\WINDOWS\System32\combase.dll (6.2.19041.1052) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.320
ModLoad: 0000000022ec0000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.320
ModLoad: 00000000240c0000 00000000000ae000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1100
ModLoad: 0000000024560000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1100
ModLoad: 00000000d7ac0000 00000000002b4000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.6677) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r465\r466_61\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 27.21.14.6677
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.3.121 driver
Product Version : 27.21.14.6677
ModLoad: 000000001ced0000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000050560000 00000000015db000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_b2801df14ec7de03\nvcuda64.dll (27.21.14.6677) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r465\r466_61\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 27.21.14.6677
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.3.121 driver
Product Version : 27.21.14.6677
ModLoad: 000000001cef0000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.906 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.906
ModLoad: 0000000022e20000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000020b10000 000000000009e000 C:\WINDOWS\system32\uxtheme.dll (6.2.19041.746) (-exported- Symbols Loaded)
Linked PDB Filename : UxTheme.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1100
ModLoad: 00000000057f0000 0000000000708000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.6677) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r465\r466_61\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 27.21.14.6677
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 27.21.14.6677
ModLoad: 0000000024720000 000000000012a000 C:\WINDOWS\System32\OLE32.DLL (6.2.19041.746) (-exported- Symbols Loaded)
Linked PDB Filename : ole32.pdb
File Version : 10.0.19041.320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.320
ModLoad: 000000001a920000 0000000000009000 C:\ProgramData\BOINC\slots\3\caffe2_nvrtc.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000bd920000 0000000000fca000 C:\ProgramData\BOINC\slots\3\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6.14.11.9000
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.89 NVRTC Library
Product Version : 6.14.11.9000
ModLoad: 0000000023c40000 0000000000083000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.1023 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1023
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 4344, Write: 3923, Other 10430
- I/O Transfers Counters -
Read: 6567899, Write: 4820372, Other 66734
- Paged Pool Usage -
QuotaPagedPoolUsage: 3506832, QuotaPeakPagedPoolUsage: 3523216
QuotaNonPagedPoolUsage: 52352, QuotaPeakNonPagedPoolUsage: 52488
- Virtual Memory Usage -
VirtualSize: -443904000, PeakVirtualSize: 168927232
- Pagefile Usage -
PagefileUsage: -443904000, PeakPagefileUsage: -443764736
- Working Set Size -
WorkingSetSize: 2025791488, PeakWorkingSetSize: -1861812224, PageFaultCount: 2267472
*** Dump of thread ID 23044 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 283124992.000000, User Time: 58456875008.000000, Wait Time: 38250264.000000
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFC23624B89
- Registers -
rax=000000002c939bc0 rbx=000000008b45af00 rcx=0000000000000020 rdx=00000000506f7523 rsi=00000000ee8e5f10 rdi=0000000019930520
r8=00000000000002bc r9=0000000000000000 r10=00000000ee8e5820 r11=00000000ee8e5838 r12=000000009f41be70 r13=000000009bf80d20
r14=00000000ee8e6cc8 r15=000000009c8dde40 rip=0000000023624b89 rsp=00000000ee8e5cf0 rbp=00000000ee8e5f30
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202
- Callstack -
ChildEBP RetAddr Args to Child
ee8e5dc0 15f361e0 ee8e5eb0 9f82a650 9c8dde40 000009bc KERNELBASE!RaiseException+0x0
ee8e5e20 899c094a 8ad83020 00000000 ee8e5ed0 000002bc VCRUNTIME140!_CxxThrowException+0x0
ee8e5fe0 899c1e02 04689c50 ee8e61f0 ee8e7750 ee8e6280 torch_cuda!at::native::searchsorted_out_cuda+0x0
ee8e61c0 899c205a 00000001 ee8e6cc8 00000001 ee8e6238 torch_cuda!at::native::searchsorted_out_cuda+0x0
ee8e6200 8a7b3684 ee8e6280 00000001 ee8e6238 00000001 torch_cuda!at::native::_local_scalar_dense_cuda+0x0
ee8e6250 8a7c1107 ee8e6370 b1b1bfac 00000001 ee8e6230 torch_cuda!at::native::set_storage_cuda_+0x0
ee8e62a0 b1fb6bbe b6e50640 00000001 00000000 b3a02f07 torch_cuda!at::native::set_storage_cuda_+0x0
ee8e64b0 b3263c5e 00000000 ee8e6cc8 ee8e6cc8 ee8e6860 torch_cpu!at::_local_scalar_dense+0x0
ee8e64f0 b1f429c7 ee8e6980 b1b1bfac ee8e6610 ee8e65c0 torch_cpu!torch::autograd::NotImplemented::~NotImplemented+0x0
ee8e6540 b1fb6bbe b6e50640 ee8e6938 00000000 ee8e7750 torch_cpu!at::native::mkldnn_sigmoid_+0x0
ee8e6750 b1d6dead ee8e66d8 00000001 ee8e69c0 ee8e6860 torch_cpu!at::_local_scalar_dense+0x0
ee8e6910 b20ad1e1 ee8e6948 00000001 ee8e69c0 ee8e6cc8 torch_cpu!at::native::item+0x0
ee8e6960 b32c4d4e ee8e69c0 00000001 ee8e6940 046a1ea8 torch_cpu!at::zeros_out+0x0
ee8e6990 b1f429c7 9f41c750 b1b1bfac 9f41c760 046a1ea8 torch_cpu!torch::autograd::GraphRoot::apply+0x0
ee8e69e0 b20de69e b6e50640 ee8e6a10 b6e50640 b20f129f torch_cpu!at::native::mkldnn_sigmoid_+0x0
ee8e6bf0 b20ca68e ee8e6d50 b1db4e49 ee8e6d10 ee8e6d50 torch_cpu!at::Tensor::item+0x0
ee8e6c40 f0a0712b ee8e6d10 ee8e6d10 ee8e6d10 ee8e7750 torch_cpu!at::Tensor::item<double>+0x0
ee8e7140 f0a0b950 ee8e7240 ee8e7240 00000000 692afa30 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0
ee8ffee0 f0c4c6f8 2c240040 00000000 00000000 2c249210 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
ee8fff20 245d7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
ee8fff50 25d62651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
ee8fffd0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 13112 (state: Waiting): ***
- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 38250264.000000
- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000eedffaf0 rsi=0000000000000000 rdi=0000000000000064
r8=00000000ee716000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000025dad4a4 rsp=00000000eedffac8 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
eedffac0 236390ae eedffb88 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0
eedffb60 f0a2a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0
eedffb90 245d7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
eedffbc0 25d62651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
eedffc40 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 21624 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 38250264.000000
- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=00000000eeeffbf0 rsi=0000000000000000 rdi=000000000000000d
r8=0000000000000001 r9=000000002c37ab00 r10=0000000000000000 r11=00000000eeeffb60 r12=0000000000000064 r13=00000000eeeffbf0
r14=00000000eeeff8f0 r15=0000000000000000 rip=0000000025dad974 rsp=00000000eeeff898 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
eeeff890 2363c5a0 00000000 ee70b000 25e7a4d0 ee70b000 ntdll!ZwWaitForMultipleObjects+0x0
eeeffb80 2363c49e 2a364b40 004e0049 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
eeeffbc0 50722634 2c381060 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0
eeeffe00 507c465d 00000000 2c37abe0 00000000 00000000 nvcuda64!+0x0
eeeffeb0 50722003 8999af59 8960b421 2c9898c0 00000000 nvcuda64!cuProfilerStop+0x0
eeeffee0 50a458e4 2c9898c0 00000000 00000000 00000000 nvcuda64!+0x0
eeefff10 245d7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
eeefff40 25d62651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
eeefffc0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 12736 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 37852160.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000001bc rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000001bc
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000000000000 r13=0000000000000000
r14=00000000000001bc r15=0000000000000000 rip=0000000025dacea4 rsp=00000000eefff8c8 rbp=000000002c3a4290
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
eefff8c0 2361168e 00000000 25d62630 0000027f 00000000 ntdll!ZwWaitForSingleObject+0x0
eefff960 50942d1d 2c989530 00000000 00000000 000001bc KERNELBASE!WaitForSingleObjectEx+0x0
eefffbc0 50722003 00000000 2c989530 50560000 2c3b95b0 nvcuda64!cuProfilerStop+0x0
eefffbf0 50a458e4 2c989530 00000000 00000000 00000000 nvcuda64!+0x0
eefffc20 245d7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
eefffc50 25d62651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
eefffcd0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 21952 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 38250236.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=000000002c46d9e8 rdx=00000000ef0ff708 rsi=00000000ef0ff670 rdi=0000000000000000
r8=000000000d6b9443 r9=000000000d6bbaa1 r10=000000002c4726f8 r11=00000000f86aa73f r12=00000000ef0ff708 r13=0000000000000000
r14=000000002c46d9e8 r15=000000002c4726f8 rip=0000000025db0814 rsp=00000000ef0ff648 rbp=00000000ef0ff6a0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
ef0ff640 25d74295 00000102 507fdec8 00000000 ef0ff670 ntdll!NtWaitForAlertByThreadId+0x0
ef0ff6b0 2365c849 2c46fee0 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0
ef0ff6e0 50699a5c 2c46fee0 2c46fee0 2c46fee0 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0
ef0ff740 50722003 00000004 8986c2b0 00000000 00000000 nvcuda64!+0x0
ef0ff770 50a458e4 2c9891d0 00000000 00000000 00000000 nvcuda64!+0x0
ef0ff7a0 245d7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
ef0ff7d0 25d62651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
ef0ff850 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 8648 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 170781248.000000, User Time: 3084999936.000000, Wait Time: 38250148.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=0000000089b21d58 rdx=0000000000000000 rsi=0000000000000000 rdi=0000000089b21d58
r8=000000002a521800 r9=0000000000000001 r10=0000000000008000 r11=00000000ef1fed80 r12=0000000000000000 r13=0000000000000000
r14=00000000ef1ff320 r15=0000000089b21d08 rip=0000000025db0814 rsp=00000000ef1ff2f8 rbp=00000000ef1ff350
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
ef1ff2f0 25d74021 97bb9998 97bb9998 ef1ff430 97bb9998 ntdll!NtWaitForAlertByThreadId+0x0
ef1ff370 2365c8f9 89b21d00 89b21d48 00000000 00000000 ntdll!RtlSleepConditionVariableSRW+0x0
ef1ff3b0 0e42bc2d 1a1ccaf0 1a1ccaf0 1a1ccaf0 00000000 KERNELBASE!SleepConditionVariableSRW+0x0
ef1ff3f0 0e4028c8 9ac98360 00000000 00000000 b37105b4 MSVCP140!__crtSetThreadpoolWait+0x0
ef1ff420 0e402790 00000000 0e402f97 00000000 9ac98360 MSVCP140!std::_Winerror_message+0x0
ef1ff490 b371064b 9ac98340 000001c0 89b21d00 89b21d00 MSVCP140!std::_Winerror_message+0x0
ef1ff4d0 b37125b1 9f3ef150 ffffffff 9ac98340 ffffffff torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
ef1ff7c0 b3712471 b6c36d10 ef1ff800 b6c36d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0
ef1ff810 b3709744 00080001 9f2ebd20 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0
ef1ff840 23a41bb2 9f2ebd20 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0
ef1ff870 245d7034 00000000 00000000 00000000 00000000 ucrtbase!_configthreadlocale+0x0
ef1ff8a0 25d62651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
ef1ff920 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 13992 (state: Waiting): ***
- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 38250252.000000
- Registers -
rax=00000000000001d3 rbx=0000000004713bd0 rcx=0000000000000070 rdx=0000000004713850 rsi=000000002a3533d0 rdi=0000000004713bd0
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000025db0874 rsp=00000000ee9ff908 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
ee9ff900 25d62dc7 00000000 00000000 2a3533d0 00000000 ntdll!ZwWaitForWorkViaWorkerFactory+0x0
ee9ffc00 245d7034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0
ee9ffc30 25d62651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
ee9ffcb0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)