Task 6168401
| Name | ParityMachine-1627362514-22991-2_0 |
| Workunit | 3962220 |
| Created | 30 Jul 2021, 22:18:34 UTC |
| Sent | 2 Aug 2021, 1:40:24 UTC |
| Report deadline | 9 Aug 2021, 1:40:24 UTC |
| Received | 2 Aug 2021, 7:12:43 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | -529697949 (0xE06D7363) Unknown error code |
| Computer ID | 9955 |
| Run time | 47 min 54 sec |
| CPU time | 47 min 3 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 1,883.38 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.64 GB |
| Peak swap size | 3.59 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
INFO : Epoch 549 | loss: 0.0311643 | val_loss: 0.0311754 | Time: 3650.89 ms
[2021-08-02 08:57:25 main:574] : INFO : Epoch 550 | loss: 0.0311632 | val_loss: 0.0311736 | Time: 3643.52 ms
[2021-08-02 08:57:28 main:574] : INFO : Epoch 551 | loss: 0.0311624 | val_loss: 0.0311742 | Time: 3621.88 ms
[2021-08-02 08:57:32 main:574] : INFO : Epoch 552 | loss: 0.0311621 | val_loss: 0.0311746 | Time: 3585.95 ms
[2021-08-02 08:57:36 main:574] : INFO : Epoch 553 | loss: 0.0311626 | val_loss: 0.0311749 | Time: 3591.7 ms
[2021-08-02 08:57:39 main:574] : INFO : Epoch 554 | loss: 0.031163 | val_loss: 0.0311745 | Time: 3624.42 ms
[2021-08-02 08:57:43 main:574] : INFO : Epoch 555 | loss: 0.0311623 | val_loss: 0.0311733 | Time: 3618.98 ms
[2021-08-02 08:57:47 main:574] : INFO : Epoch 556 | loss: 0.0311623 | val_loss: 0.0311755 | Time: 3632.64 ms
[2021-08-02 08:57:50 main:574] : INFO : Epoch 557 | loss: 0.0311633 | val_loss: 0.0311737 | Time: 3655.6 ms
[2021-08-02 08:57:54 main:574] : INFO : Epoch 558 | loss: 0.031163 | val_loss: 0.0311752 | Time: 3633.4 ms
[2021-08-02 08:57:58 main:574] : INFO : Epoch 559 | loss: 0.0311608 | val_loss: 0.0311732 | Time: 3678.32 ms
[2021-08-02 08:58:01 main:574] : INFO : Epoch 560 | loss: 0.0311608 | val_loss: 0.0311749 | Time: 3647.07 ms
[2021-08-02 08:58:05 main:574] : INFO : Epoch 561 | loss: 0.0311619 | val_loss: 0.0311737 | Time: 3619.02 ms
[2021-08-02 08:58:09 main:574] : INFO : Epoch 562 | loss: 0.0311631 | val_loss: 0.031173 | Time: 3686.15 ms
[2021-08-02 08:58:12 main:574] : INFO : Epoch 563 | loss: 0.0311654 | val_loss: 0.0311738 | Time: 3622.89 ms
[2021-08-02 08:58:16 main:574] : INFO : Epoch 564 | loss: 0.031163 | val_loss: 0.0311728 | Time: 3571.28 ms
[2021-08-02 08:58:20 main:574] : INFO : Epoch 565 | loss: 0.0311617 | val_loss: 0.0311726 | Time: 3647.42 ms
[2021-08-02 08:58:23 main:574] : INFO : Epoch 566 | loss: 0.0311616 | val_loss: 0.0311718 | Time: 3558.68 ms
[2021-08-02 08:58:27 main:574] : INFO : Epoch 567 | loss: 0.0311616 | val_loss: 0.0311724 | Time: 3608.92 ms
[2021-08-02 08:58:30 main:574] : INFO : Epoch 568 | loss: 0.0311627 | val_loss: 0.031173 | Time: 3654.02 ms
[2021-08-02 08:58:34 main:574] : INFO : Epoch 569 | loss: 0.0311618 | val_loss: 0.0311726 | Time: 3589.57 ms
[2021-08-02 08:58:38 main:574] : INFO : Epoch 570 | loss: 0.0311612 | val_loss: 0.0311725 | Time: 3651.52 ms
[2021-08-02 08:58:41 main:574] : INFO : Epoch 571 | loss: 0.0311623 | val_loss: 0.0311775 | Time: 3648.61 ms
[2021-08-02 08:58:45 main:574] : INFO : Epoch 572 | loss: 0.0311614 | val_loss: 0.031174 | Time: 3995.04 ms
[2021-08-02 08:58:49 main:574] : INFO : Epoch 573 | loss: 0.0311613 | val_loss: 0.0311722 | Time: 3636.84 ms
[2021-08-02 08:58:53 main:574] : INFO : Epoch 574 | loss: 0.0311605 | val_loss: 0.031174 | Time: 3621.8 ms
[2021-08-02 08:58:56 main:574] : INFO : Epoch 575 | loss: 0.0311603 | val_loss: 0.0311749 | Time: 3676.56 ms
[2021-08-02 08:59:00 main:574] : INFO : Epoch 576 | loss: 0.0311609 | val_loss: 0.031173 | Time: 3618.97 ms
[2021-08-02 08:59:04 main:574] : INFO : Epoch 577 | loss: 0.0311601 | val_loss: 0.031174 | Time: 3672.62 ms
[2021-08-02 08:59:07 main:574] : INFO : Epoch 578 | loss: 0.0311611 | val_loss: 0.0311772 | Time: 3638.17 ms
[2021-08-02 08:59:11 main:574] : INFO : Epoch 579 | loss: 0.0311609 | val_loss: 0.0311747 | Time: 3661.52 ms
[2021-08-02 08:59:15 main:574] : INFO : Epoch 580 | loss: 0.0311598 | val_loss: 0.0311742 | Time: 3706.75 ms
[2021-08-02 08:59:19 main:574] : INFO : Epoch 581 | loss: 0.0311602 | val_loss: 0.0311724 | Time: 3849.14 ms
[2021-08-02 08:59:22 main:574] : INFO : Epoch 582 | loss: 0.0311588 | val_loss: 0.0311722 | Time: 3589.83 ms
[2021-08-02 08:59:26 main:574] : INFO : Epoch 583 | loss: 0.0311593 | val_loss: 0.0311718 | Time: 3614.94 ms
[2021-08-02 08:59:30 main:574] : INFO : Epoch 584 | loss: 0.0311604 | val_loss: 0.031174 | Time: 3663.55 ms
[2021-08-02 08:59:33 main:574] : INFO : Epoch 585 | loss: 0.0311618 | val_loss: 0.0311737 | Time: 3596.96 ms
[2021-08-02 08:59:37 main:574] : INFO : Epoch 586 | loss: 0.0311606 | val_loss: 0.0311744 | Time: 3573.92 ms
[2021-08-02 08:59:40 main:574] : INFO : Epoch 587 | loss: 0.0311603 | val_loss: 0.031173 | Time: 3590.48 ms
[2021-08-02 08:59:44 main:574] : INFO : Epoch 588 | loss: 0.0311603 | val_loss: 0.0311764 | Time: 3653.98 ms
[2021-08-02 08:59:48 main:574] : INFO : Epoch 589 | loss: 0.0311618 | val_loss: 0.0311766 | Time: 3635.65 ms
[2021-08-02 08:59:51 main:574] : INFO : Epoch 590 | loss: 0.0311629 | val_loss: 0.0311721 | Time: 3650.14 ms
[2021-08-02 08:59:55 main:574] : INFO : Epoch 591 | loss: 0.0311614 | val_loss: 0.031174 | Time: 3591.56 ms
[2021-08-02 08:59:59 main:574] : INFO : Epoch 592 | loss: 0.0311614 | val_loss: 0.0311731 | Time: 3641.24 ms
[2021-08-02 09:00:02 main:574] : INFO : Epoch 593 | loss: 0.0311617 | val_loss: 0.0311736 | Time: 3645.1 ms
[2021-08-02 09:00:06 main:574] : INFO : Epoch 594 | loss: 0.0311611 | val_loss: 0.0311741 | Time: 3599.32 ms
[2021-08-02 09:00:10 main:574] : INFO : Epoch 595 | loss: 0.0311607 | val_loss: 0.0311725 | Time: 3636.8 ms
[2021-08-02 09:00:13 main:574] : INFO : Epoch 596 | loss: 0.0311607 | val_loss: 0.0311752 | Time: 3611.02 ms
[2021-08-02 09:00:17 main:574] : INFO : Epoch 597 | loss: 0.0311599 | val_loss: 0.031174 | Time: 3611.96 ms
[2021-08-02 09:00:20 main:574] : INFO : Epoch 598 | loss: 0.031161 | val_loss: 0.031173 | Time: 3601.78 ms
[2021-08-02 09:00:24 main:574] : INFO : Epoch 599 | loss: 0.0311595 | val_loss: 0.0311755 | Time: 3623.94 ms
[2021-08-02 09:00:28 main:574] : INFO : Epoch 600 | loss: 0.0311612 | val_loss: 0.0311731 | Time: 3593.58 ms
[2021-08-02 09:00:31 main:574] : INFO : Epoch 601 | loss: 0.0311596 | val_loss: 0.0311729 | Time: 3644.04 ms
[2021-08-02 09:00:35 main:574] : INFO : Epoch 602 | loss: 0.0311608 | val_loss: 0.0311735 | Time: 3825.98 ms
[2021-08-02 09:00:39 main:574] : INFO : Epoch 603 | loss: 0.0311613 | val_loss: 0.0311722 | Time: 3783.89 ms
[2021-08-02 09:00:43 main:574] : INFO : Epoch 604 | loss: 0.0311605 | val_loss: 0.0311716 | Time: 3612.09 ms
[2021-08-02 09:00:46 main:574] : INFO : Epoch 605 | loss: 0.0311615 | val_loss: 0.0311749 | Time: 3545.31 ms
[2021-08-02 09:00:50 main:574] : INFO : Epoch 606 | loss: 0.03116 | val_loss: 0.0311745 | Time: 3657.8 ms
[2021-08-02 09:00:54 main:574] : INFO : Epoch 607 | loss: 0.0311593 | val_loss: 0.0311737 | Time: 3675.68 ms
[2021-08-02 09:00:57 main:574] : INFO : Epoch 608 | loss: 0.0311603 | val_loss: 0.0311715 | Time: 3614.38 ms
[2021-08-02 09:01:01 main:574] : INFO : Epoch 609 | loss: 0.0311604 | val_loss: 0.0311708 | Time: 3655.08 ms
[2021-08-02 09:01:05 main:574] : INFO : Epoch 610 | loss: 0.0311614 | val_loss: 0.0311704 | Time: 3626.43 ms
[2021-08-02 09:01:08 main:574] : INFO : Epoch 611 | loss: 0.0311596 | val_loss: 0.031172 | Time: 3689.78 ms
[2021-08-02 09:01:12 main:574] : INFO : Epoch 612 | loss: 0.0311586 | val_loss: 0.031174 | Time: 3659.39 ms
[2021-08-02 09:01:16 main:574] : INFO : Epoch 613 | loss: 0.0311592 | val_loss: 0.0311744 | Time: 3631.56 ms
[2021-08-02 09:01:19 main:574] : INFO : Epoch 614 | loss: 0.0311597 | val_loss: 0.0311719 | Time: 3589.37 ms
[2021-08-02 09:01:23 main:574] : INFO : Epoch 615 | loss: 0.03116 | val_loss: 0.0311721 | Time: 3620.92 ms
[2021-08-02 09:01:26 main:574] : INFO : Epoch 616 | loss: 0.0311596 | val_loss: 0.0311722 | Time: 3625.04 ms
[2021-08-02 09:01:30 main:574] : INFO : Epoch 617 | loss: 0.0311602 | val_loss: 0.0311719 | Time: 3657.14 ms
[2021-08-02 09:01:34 main:574] : INFO : Epoch 618 | loss: 0.0311596 | val_loss: 0.0311719 | Time: 3563.33 ms
[2021-08-02 09:01:37 main:574] : INFO : Epoch 619 | loss: 0.0311595 | val_loss: 0.031174 | Time: 3637.22 ms
[2021-08-02 09:01:41 main:574] : INFO : Epoch 620 | loss: 0.03116 | val_loss: 0.0311739 | Time: 3633.94 ms
[2021-08-02 09:01:45 main:574] : INFO : Epoch 621 | loss: 0.0311646 | val_loss: 0.0311737 | Time: 3683.28 ms
[2021-08-02 09:01:48 main:574] : INFO : Epoch 622 | loss: 0.0311687 | val_loss: 0.0311787 | Time: 3626.7 ms
[2021-08-02 09:01:52 main:574] : INFO : Epoch 623 | loss: 0.0311738 | val_loss: 0.031181 | Time: 3774.7 ms
[2021-08-02 09:01:56 main:574] : INFO : Epoch 624 | loss: 0.0311734 | val_loss: 0.0311775 | Time: 3624.77 ms
[2021-08-02 09:02:00 main:574] : INFO : Epoch 625 | loss: 0.0311704 | val_loss: 0.0311772 | Time: 3600.58 ms
[2021-08-02 09:02:03 main:574] : INFO : Epoch 626 | loss: 0.0311711 | val_loss: 0.0311753 | Time: 3625 ms
[2021-08-02 09:02:07 main:574] : INFO : Epoch 627 | loss: 0.0311698 | val_loss: 0.0311757 | Time: 3661.41 ms
[2021-08-02 09:02:11 main:574] : INFO : Epoch 628 | loss: 0.0311692 | val_loss: 0.0311757 | Time: 3662.81 ms
[2021-08-02 09:02:14 main:574] : INFO : Epoch 629 | loss: 0.0311699 | val_loss: 0.0311773 | Time: 3634.23 ms
[2021-08-02 09:02:18 main:574] : INFO : Epoch 630 | loss: 0.0311676 | val_loss: 0.0311749 | Time: 3631.62 ms
[2021-08-02 09:02:22 main:574] : INFO : Epoch 631 | loss: 0.0311686 | val_loss: 0.0311773 | Time: 3673.61 ms
[2021-08-02 09:02:25 main:574] : INFO : Epoch 632 | loss: 0.0311673 | val_loss: 0.0311737 | Time: 3639.54 ms
[2021-08-02 09:02:29 main:574] : INFO : Epoch 633 | loss: 0.0311663 | val_loss: 0.0311752 | Time: 3637.75 ms
[2021-08-02 09:02:33 main:574] : INFO : Epoch 634 | loss: 0.0311657 | val_loss: 0.031176 | Time: 3627.44 ms
[2021-08-02 09:02:36 main:574] : INFO : Epoch 635 | loss: 0.0311658 | val_loss: 0.0311755 | Time: 3614.07 ms
[2021-08-02 09:02:40 main:574] : INFO : Epoch 636 | loss: 0.0311653 | val_loss: 0.0311772 | Time: 3630.97 ms
[2021-08-02 09:02:43 main:574] : INFO : Epoch 637 | loss: 0.031165 | val_loss: 0.0311774 | Time: 3577.2 ms
[2021-08-02 09:02:47 main:574] : INFO : Epoch 638 | loss: 0.0311655 | val_loss: 0.0311781 | Time: 3581.93 ms
[2021-08-02 09:02:51 main:574] : INFO : Epoch 639 | loss: 0.0311662 | val_loss: 0.0311726 | Time: 3600.67 ms
[2021-08-02 09:02:54 main:574] : INFO : Epoch 640 | loss: 0.0311647 | val_loss: 0.0311746 | Time: 3636.85 ms
[2021-08-02 09:02:58 main:574] : INFO : Epoch 641 | loss: 0.0311654 | val_loss: 0.031173 | Time: 3613.11 ms
[2021-08-02 09:03:02 main:574] : INFO : Epoch 642 | loss: 0.0311668 | val_loss: 0.031179 | Time: 3557.97 ms
[2021-08-02 09:03:05 main:574] : INFO : Epoch 643 | loss: 0.0311645 | val_loss: 0.0311786 | Time: 3616.09 ms
[2021-08-02 09:03:09 main:574] : INFO : Epoch 644 | loss: 0.031166 | val_loss: 0.0311741 | Time: 3619.67 ms
[2021-08-02 09:03:13 main:574] : INFO : Epoch 645 | loss: 0.0311641 | val_loss: 0.0311732 | Time: 3715.11 ms
[2021-08-02 09:03:16 main:574] : INFO : Epoch 646 | loss: 0.0311634 | val_loss: 0.0311756 | Time: 3612.68 ms
[2021-08-02 09:03:20 main:574] : INFO : Epoch 647 | loss: 0.0311639 | val_loss: 0.0311738 | Time: 3577.42 ms
[2021-08-02 09:03:23 main:574] : INFO : Epoch 648 | loss: 0.0311648 | val_loss: 0.0311745 | Time: 3639.32 ms
[2021-08-02 09:03:27 main:574] : INFO : Epoch 649 | loss: 0.031163 | val_loss: 0.0311766 | Time: 3619.71 ms
[2021-08-02 09:03:31 main:574] : INFO : Epoch 650 | loss: 0.0311638 | val_loss: 0.0311753 | Time: 3659.91 ms
[2021-08-02 09:03:34 main:574] : INFO : Epoch 651 | loss: 0.031166 | val_loss: 0.0311748 | Time: 3611.41 ms
[2021-08-02 09:03:38 main:574] : INFO : Epoch 652 | loss: 0.0311638 | val_loss: 0.0311736 | Time: 3595.78 ms
[2021-08-02 09:03:42 main:574] : INFO : Epoch 653 | loss: 0.0311633 | val_loss: 0.0311734 | Time: 3588.53 ms
[2021-08-02 09:03:45 main:574] : INFO : Epoch 654 | loss: 0.031163 | val_loss: 0.031174 | Time: 3644.2 ms
[2021-08-02 09:03:49 main:574] : INFO : Epoch 655 | loss: 0.0311648 | val_loss: 0.0311868 | Time: 3618.97 ms
[2021-08-02 09:03:53 main:574] : INFO : Epoch 656 | loss: 0.0311638 | val_loss: 0.0311759 | Time: 3659.34 ms
[2021-08-02 09:03:56 main:574] : INFO : Epoch 657 | loss: 0.0311633 | val_loss: 0.0311747 | Time: 3660.77 ms
[2021-08-02 09:04:00 main:574] : INFO : Epoch 658 | loss: 0.0311621 | val_loss: 0.0311749 | Time: 3665.28 ms
[2021-08-02 09:04:04 main:574] : INFO : Epoch 659 | loss: 0.0311613 | val_loss: 0.0311715 | Time: 3763.79 ms
[2021-08-02 09:04:07 main:574] : INFO : Epoch 660 | loss: 0.0311604 | val_loss: 0.0311733 | Time: 3603.51 ms
[2021-08-02 09:04:11 main:574] : INFO : Epoch 661 | loss: 0.0311629 | val_loss: 0.0311721 | Time: 3636.1 ms
[2021-08-02 09:04:15 main:574] : INFO : Epoch 662 | loss: 0.0311642 | val_loss: 0.0311708 | Time: 3653.28 ms
[2021-08-02 09:04:18 main:574] : INFO : Epoch 663 | loss: 0.0311643 | val_loss: 0.0311728 | Time: 3630.77 ms
[2021-08-02 09:04:22 main:574] : INFO : Epoch 664 | loss: 0.0311636 | val_loss: 0.031173 | Time: 3628.01 ms
[2021-08-02 09:04:26 main:574] : INFO : Epoch 665 | loss: 0.031165 | val_loss: 0.0311732 | Time: 3651.86 ms
[2021-08-02 09:04:29 main:574] : INFO : Epoch 666 | loss: 0.0311647 | val_loss: 0.0311728 | Time: 3664.93 ms
[2021-08-02 09:04:33 main:574] : INFO : Epoch 667 | loss: 0.0311646 | val_loss: 0.0311727 | Time: 3657.57 ms
[2021-08-02 09:04:37 main:574] : INFO : Epoch 668 | loss: 0.0311643 | val_loss: 0.0311732 | Time: 3603.42 ms
[2021-08-02 09:04:40 main:574] : INFO : Epoch 669 | loss: 0.0311635 | val_loss: 0.0311731 | Time: 3676.12 ms
[2021-08-02 09:04:44 main:574] : INFO : Epoch 670 | loss: 0.0311648 | val_loss: 0.0311726 | Time: 3738.65 ms
[2021-08-02 09:04:48 main:574] : INFO : Epoch 671 | loss: 0.0311642 | val_loss: 0.0311725 | Time: 3616.81 ms
[2021-08-02 09:04:51 main:574] : INFO : Epoch 672 | loss: 0.0311637 | val_loss: 0.0311714 | Time: 3682.91 ms
[2021-08-02 09:04:55 main:574] : INFO : Epoch 673 | loss: 0.0311651 | val_loss: 0.031175 | Time: 3648.13 ms
[2021-08-02 09:04:59 main:574] : INFO : Epoch 674 | loss: 0.031165 | val_loss: 0.0311754 | Time: 3610.54 ms
[2021-08-02 09:05:02 main:574] : INFO : Epoch 675 | loss: 0.0311637 | val_loss: 0.0311737 | Time: 3662.75 ms
[2021-08-02 09:05:06 main:574] : INFO : Epoch 676 | loss: 0.0311642 | val_loss: 0.0311773 | Time: 3639.92 ms
[2021-08-02 09:05:10 main:574] : INFO : Epoch 677 | loss: 0.0311652 | val_loss: 0.031174 | Time: 3681.21 ms
[2021-08-02 09:05:13 main:574] : INFO : Epoch 678 | loss: 0.0311669 | val_loss: 0.0311762 | Time: 3635.92 ms
[2021-08-02 09:05:17 main:574] : INFO : Epoch 679 | loss: 0.0311636 | val_loss: 0.0311739 | Time: 3739.5 ms
[2021-08-02 09:05:21 main:574] : INFO : Epoch 680 | loss: 0.0311631 | val_loss: 0.031173 | Time: 3591.31 ms
[2021-08-02 09:05:24 main:574] : INFO : Epoch 681 | loss: 0.0311642 | val_loss: 0.0311731 | Time: 3642.75 ms
[2021-08-02 09:05:28 main:574] : INFO : Epoch 682 | loss: 0.0311657 | val_loss: 0.0311731 | Time: 3611.52 ms
[2021-08-02 09:05:32 main:574] : INFO : Epoch 683 | loss: 0.0311655 | val_loss: 0.031173 | Time: 3618.68 ms
[2021-08-02 09:05:35 main:574] : INFO : Epoch 684 | loss: 0.0311653 | val_loss: 0.0311734 | Time: 3689.81 ms
[2021-08-02 09:05:39 main:574] : INFO : Epoch 685 | loss: 0.0311642 | val_loss: 0.0311734 | Time: 3609.18 ms
[2021-08-02 09:05:43 main:574] : INFO : Epoch 686 | loss: 0.0311649 | val_loss: 0.0311748 | Time: 3673.45 ms
[2021-08-02 09:05:46 main:574] : INFO : Epoch 687 | loss: 0.0311644 | val_loss: 0.0311731 | Time: 3619.9 ms
[2021-08-02 09:05:50 main:574] : INFO : Epoch 688 | loss: 0.031164 | val_loss: 0.0311764 | Time: 3627.73 ms
[2021-08-02 09:05:54 main:574] : INFO : Epoch 689 | loss: 0.0311684 | val_loss: 0.0311791 | Time: 3642.53 ms
[2021-08-02 09:05:57 main:574] : INFO : Epoch 690 | loss: 0.0311649 | val_loss: 0.0311731 | Time: 3599.43 ms
[2021-08-02 09:06:01 main:574] : INFO : Epoch 691 | loss: 0.0311639 | val_loss: 0.0311722 | Time: 3634.86 ms
[2021-08-02 09:06:05 main:574] : INFO : Epoch 692 | loss: 0.0311634 | val_loss: 0.0311726 | Time: 3602.3 ms
[2021-08-02 09:06:08 main:574] : INFO : Epoch 693 | loss: 0.0311628 | val_loss: 0.0311736 | Time: 3684.66 ms
[2021-08-02 09:06:12 main:574] : INFO : Epoch 694 | loss: 0.0311624 | val_loss: 0.0311742 | Time: 3718.39 ms
[2021-08-02 09:06:16 main:574] : INFO : Epoch 695 | loss: 0.0311646 | val_loss: 0.0311745 | Time: 3641.31 ms
[2021-08-02 09:06:19 main:574] : INFO : Epoch 696 | loss: 0.031164 | val_loss: 0.0311745 | Time: 3657.23 ms
[2021-08-02 09:06:23 main:574] : INFO : Epoch 697 | loss: 0.0311644 | val_loss: 0.0311767 | Time: 3700.51 ms
[2021-08-02 09:06:27 main:574] : INFO : Epoch 698 | loss: 0.0311643 | val_loss: 0.0311746 | Time: 3602.42 ms
[2021-08-02 09:06:30 main:574] : INFO : Epoch 699 | loss: 0.031164 | val_loss: 0.0311726 | Time: 3612.1 ms
[2021-08-02 09:06:34 main:574] : INFO : Epoch 700 | loss: 0.0311672 | val_loss: 0.031176 | Time: 3626.05 ms
[2021-08-02 09:06:38 main:574] : INFO : Epoch 701 | loss: 0.0311692 | val_loss: 0.0311702 | Time: 3631.49 ms
[2021-08-02 09:06:41 main:574] : INFO : Epoch 702 | loss: 0.031168 | val_loss: 0.0311696 | Time: 3618.49 ms
[2021-08-02 09:06:46 main:574] : INFO : Epoch 703 | loss: 0.0311679 | val_loss: 0.0311716 | Time: 4215.85 ms
[2021-08-02 09:06:49 main:574] : INFO : Epoch 704 | loss: 0.0311672 | val_loss: 0.031171 | Time: 3614.57 ms
[2021-08-02 09:06:53 main:574] : INFO : Epoch 705 | loss: 0.0311657 | val_loss: 0.0311701 | Time: 3592.48 ms
[2021-08-02 09:06:56 main:574] : INFO : Epoch 706 | loss: 0.0311654 | val_loss: 0.0311714 | Time: 3590.47 ms
[2021-08-02 09:07:00 main:574] : INFO : Epoch 707 | loss: 0.0311659 | val_loss: 0.0311709 | Time: 3714.34 ms
[2021-08-02 09:07:04 main:574] : INFO : Epoch 708 | loss: 0.0311651 | val_loss: 0.0311706 | Time: 3641.91 ms
[2021-08-02 09:07:07 main:574] : INFO : Epoch 709 | loss: 0.0311646 | val_loss: 0.0311717 | Time: 3636.3 ms
[2021-08-02 09:07:11 main:574] : INFO : Epoch 710 | loss: 0.0311641 | val_loss: 0.0311717 | Time: 3708.36 ms
[2021-08-02 09:07:15 main:574] : INFO : Epoch 711 | loss: 0.0311663 | val_loss: 0.0311769 | Time: 3649.28 ms
[2021-08-02 09:07:19 main:574] : INFO : Epoch 712 | loss: 0.0311679 | val_loss: 0.0311749 | Time: 3653.55 ms
[2021-08-02 09:07:22 main:574] : INFO : Epoch 713 | loss: 0.0311659 | val_loss: 0.0311735 | Time: 3650.77 ms
[2021-08-02 09:07:26 main:574] : INFO : Epoch 714 | loss: 0.0311634 | val_loss: 0.0311714 | Time: 3635.36 ms
[2021-08-02 09:07:30 main:574] : INFO : Epoch 715 | loss: 0.0311638 | val_loss: 0.0311732 | Time: 3680.31 ms
[2021-08-02 09:07:33 main:574] : INFO : Epoch 716 | loss: 0.0311634 | val_loss: 0.0311711 | Time: 3705.69 ms
[2021-08-02 09:07:37 main:574] : INFO : Epoch 717 | loss: 0.0311635 | val_loss: 0.0311714 | Time: 3646.26 ms
[2021-08-02 09:07:41 main:574] : INFO : Epoch 718 | loss: 0.0311632 | val_loss: 0.0311718 | Time: 3682.45 ms
[2021-08-02 09:07:44 main:574] : INFO : Epoch 719 | loss: 0.0311638 | val_loss: 0.0311723 | Time: 3642.19 ms
[2021-08-02 09:07:48 main:574] : INFO : Epoch 720 | loss: 0.0311643 | val_loss: 0.0311739 | Time: 3622.17 ms
[2021-08-02 09:07:52 main:574] : INFO : Epoch 721 | loss: 0.0311646 | val_loss: 0.031173 | Time: 3657.04 ms
[2021-08-02 09:07:55 main:574] : INFO : Epoch 722 | loss: 0.0311641 | val_loss: 0.0311725 | Time: 3648.99 ms
[2021-08-02 09:07:59 main:574] : INFO : Epoch 723 | loss: 0.0311631 | val_loss: 0.0311722 | Time: 3594.24 ms
[2021-08-02 09:08:03 main:574] : INFO : Epoch 724 | loss: 0.0311633 | val_loss: 0.031171 | Time: 3680.02 ms
[2021-08-02 09:08:06 main:574] : INFO : Epoch 725 | loss: 0.0311628 | val_loss: 0.0311735 | Time: 3584.59 ms
[2021-08-02 09:08:10 main:574] : INFO : Epoch 726 | loss: 0.0311629 | val_loss: 0.0311724 | Time: 3582.75 ms
[2021-08-02 09:08:14 main:574] : INFO : Epoch 727 | loss: 0.0311633 | val_loss: 0.0311697 | Time: 3617.67 ms
[2021-08-02 09:08:17 main:574] : INFO : Epoch 728 | loss: 0.0311628 | val_loss: 0.0311722 | Time: 3637.37 ms
[2021-08-02 09:08:21 main:574] : INFO : Epoch 729 | loss: 0.0311631 | val_loss: 0.0311703 | Time: 3666.18 ms
[2021-08-02 09:08:25 main:574] : INFO : Epoch 730 | loss: 0.0311611 | val_loss: 0.0311699 | Time: 3599.24 ms
[2021-08-02 09:08:28 main:574] : INFO : Epoch 731 | loss: 0.0311619 | val_loss: 0.0311695 | Time: 3650.53 ms
[2021-08-02 09:08:32 main:574] : INFO : Epoch 732 | loss: 0.0311618 | val_loss: 0.0311703 | Time: 3570.44 ms
[2021-08-02 09:08:35 main:574] : INFO : Epoch 733 | loss: 0.0311619 | val_loss: 0.0311728 | Time: 3688.37 ms
[2021-08-02 09:08:39 main:574] : INFO : Epoch 734 | loss: 0.0311623 | val_loss: 0.0311703 | Time: 3668.21 ms
[2021-08-02 09:08:43 main:574] : INFO : Epoch 735 | loss: 0.031162 | val_loss: 0.0311723 | Time: 3613.69 ms
[2021-08-02 09:08:46 main:574] : INFO : Epoch 736 | loss: 0.0311625 | val_loss: 0.0311701 | Time: 3574.22 ms
[2021-08-02 09:08:50 main:574] : INFO : Epoch 737 | loss: 0.0311618 | val_loss: 0.0311733 | Time: 3550.68 ms
[2021-08-02 09:08:54 main:574] : INFO : Epoch 738 | loss: 0.0311615 | val_loss: 0.0311707 | Time: 3651.69 ms
[2021-08-02 09:08:57 main:574] : INFO : Epoch 739 | loss: 0.0311619 | val_loss: 0.0311715 | Time: 3655.15 ms
[2021-08-02 09:09:01 main:574] : INFO : Epoch 740 | loss: 0.0311621 | val_loss: 0.0311707 | Time: 3618.73 ms
[2021-08-02 09:09:05 main:574] : INFO : Epoch 741 | loss: 0.0311609 | val_loss: 0.0311717 | Time: 3600.57 ms
[2021-08-02 09:09:08 main:574] : INFO : Epoch 742 | loss: 0.0311618 | val_loss: 0.0311737 | Time: 3646.51 ms
[2021-08-02 09:09:12 main:574] : INFO : Epoch 743 | loss: 0.031162 | val_loss: 0.0311708 | Time: 3660.52 ms
[2021-08-02 09:09:16 main:574] : INFO : Epoch 744 | loss: 0.0311604 | val_loss: 0.0311712 | Time: 3664.06 ms
[2021-08-02 09:09:19 main:574] : INFO : Epoch 745 | loss: 0.0311603 | val_loss: 0.0311772 | Time: 3626.28 ms
[2021-08-02 09:09:23 main:574] : INFO : Epoch 746 | loss: 0.0311623 | val_loss: 0.0311702 | Time: 3565.43 ms
[2021-08-02 09:09:26 main:574] : INFO : Epoch 747 | loss: 0.0311602 | val_loss: 0.0311712 | Time: 3630.22 ms
[2021-08-02 09:09:30 main:574] : INFO : Epoch 748 | loss: 0.0311611 | val_loss: 0.0311729 | Time: 3614.38 ms
[2021-08-02 09:09:34 main:574] : INFO : Epoch 749 | loss: 0.0311633 | val_loss: 0.0311719 | Time: 3595.5 ms
[2021-08-02 09:09:37 main:574] : INFO : Epoch 750 | loss: 0.0311644 | val_loss: 0.0311751 | Time: 3613.86 ms
[2021-08-02 09:09:41 main:574] : INFO : Epoch 751 | loss: 0.0311656 | val_loss: 0.0311756 | Time: 3621.54 ms
[2021-08-02 09:09:45 main:574] : INFO : Epoch 752 | loss: 0.031165 | val_loss: 0.0311728 | Time: 3633.79 ms
[2021-08-02 09:09:48 main:574] : INFO : Epoch 753 | loss: 0.0311622 | val_loss: 0.0311735 | Time: 3702.8 ms
[2021-08-02 09:09:52 main:574] : INFO : Epoch 754 | loss: 0.0311619 | val_loss: 0.0311729 | Time: 3675.79 ms
[2021-08-02 09:09:56 main:574] : INFO : Epoch 755 | loss: 0.0311626 | val_loss: 0.0311759 | Time: 3652.62 ms
[2021-08-02 09:09:59 main:574] : INFO : Epoch 756 | loss: 0.0311616 | val_loss: 0.0311738 | Time: 3628.56 ms
[2021-08-02 09:10:03 main:574] : INFO : Epoch 757 | loss: 0.0311612 | val_loss: 0.0311725 | Time: 3645.76 ms
[2021-08-02 09:10:07 main:574] : INFO : Epoch 758 | loss: 0.0311615 | val_loss: 0.0311713 | Time: 3612.63 ms
[2021-08-02 09:10:10 main:574] : INFO : Epoch 759 | loss: 0.0311636 | val_loss: 0.0311794 | Time: 3708.26 ms
[2021-08-02 09:10:14 main:574] : INFO : Epoch 760 | loss: 0.0311634 | val_loss: 0.0311755 | Time: 3607.28 ms
[2021-08-02 09:10:18 main:574] : INFO : Epoch 761 | loss: 0.0311629 | val_loss: 0.0311736 | Time: 3645.39 ms
[2021-08-02 09:10:22 main:574] : INFO : Epoch 762 | loss: 0.0311639 | val_loss: 0.0311719 | Time: 3782.01 ms
[2021-08-02 09:10:25 main:574] : INFO : Epoch 763 | loss: 0.0311621 | val_loss: 0.0311752 | Time: 3634.67 ms
[2021-08-02 09:10:29 main:574] : INFO : Epoch 764 | loss: 0.0311618 | val_loss: 0.0311757 | Time: 3614.39 ms
[2021-08-02 09:10:33 main:574] : INFO : Epoch 765 | loss: 0.0311634 | val_loss: 0.0311736 | Time: 3618.03 ms
[2021-08-02 09:10:36 main:574] : INFO : Epoch 766 | loss: 0.0311626 | val_loss: 0.0311736 | Time: 3682.4 ms
[2021-08-02 09:10:40 main:574] : INFO : Epoch 767 | loss: 0.0311603 | val_loss: 0.0311727 | Time: 3631.73 ms
[2021-08-02 09:10:43 main:574] : INFO : Epoch 768 | loss: 0.0311608 | val_loss: 0.0311724 | Time: 3589.46 ms
[2021-08-02 09:10:47 main:574] : INFO : Epoch 769 | loss: 0.0311606 | val_loss: 0.0311722 | Time: 3589.24 ms
[2021-08-02 09:10:51 main:574] : INFO : Epoch 770 | loss: 0.0311597 | val_loss: 0.0311718 | Time: 3685.34 ms
[2021-08-02 09:10:54 main:574] : INFO : Epoch 771 | loss: 0.0311593 | val_loss: 0.0311727 | Time: 3626.13 ms
[2021-08-02 09:10:58 main:574] : INFO : Epoch 772 | loss: 0.0311601 | val_loss: 0.0311737 | Time: 3688.01 ms
[2021-08-02 09:11:02 main:574] : INFO : Epoch 773 | loss: 0.0311611 | val_loss: 0.031172 | Time: 3740.18 ms
[2021-08-02 09:11:06 main:574] : INFO : Epoch 774 | loss: 0.0311603 | val_loss: 0.0311709 | Time: 3643.34 ms
[2021-08-02 09:11:09 main:574] : INFO : Epoch 775 | loss: 0.0311612 | val_loss: 0.0311707 | Time: 3682.23 ms
[2021-08-02 09:11:13 main:574] : INFO : Epoch 776 | loss: 0.031161 | val_loss: 0.0311719 | Time: 3656.45 ms
[2021-08-02 09:11:17 main:574] : INFO : Epoch 777 | loss: 0.0311604 | val_loss: 0.0311728 | Time: 3654.23 ms
[2021-08-02 09:11:20 main:574] : INFO : Epoch 778 | loss: 0.0311606 | val_loss: 0.03117 | Time: 3690.67 ms
THCudaCheck FAIL file=..\..\aten\src\THC\THCCachingHostAllocator.cpp line=278 error=719 : unspecified launch failure
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFC426E4ED9
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 08/02/21 09:11:23
Install Directory : C:\Program Files\BOINC\
Data Directory : C:\ProgramData\BOINC
Project Symstore :
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\2;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 000000002d3b0000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000044970000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1110) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 0000000044690000 00000000000bd000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 00000000426b0000 00000000002c9000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1110) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 0000000042bd0000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 0000000042230000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1110) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.1110 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1110
ModLoad: 0000000042ea0000 000000000002a000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.746) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.746 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.746
ModLoad: 00000000422f0000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1110) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.1110 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1110
ModLoad: 0000000042610000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 0000000042100000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 0000000043bc0000 00000000000ac000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1052) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 0000000042ac0000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.19041.546
ModLoad: 00000000436c0000 000000000009b000 C:\WINDOWS\System32\sechost.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.320
ModLoad: 0000000043d00000 000000000012a000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1081) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 00000000d4180000 0000000024b49000 C:\ProgramData\BOINC\slots\2\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000c9590000 000000000abe7000 C:\ProgramData\BOINC\slots\2\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000003b8d0000 0000000000058000 C:\ProgramData\BOINC\slots\2\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000003b650000 0000000000045000 C:\ProgramData\BOINC\slots\2\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000c60d0000 00000000034b2000 C:\ProgramData\BOINC\slots\2\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 000000003dcf0000 0000000000010000 C:\ProgramData\BOINC\slots\2\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 00000000c3020000 00000000030a5000 C:\ProgramData\BOINC\slots\2\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 00000000797e0000 000000001b3a4000 C:\ProgramData\BOINC\slots\2\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 00000000308f0000 0000000000091000 C:\ProgramData\BOINC\slots\2\MSVCP140.dll (14.27.29112.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.27.29112.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.27.29112.0
ModLoad: 000000003ca30000 0000000000019000 C:\ProgramData\BOINC\slots\2\VCRUNTIME140.dll (14.27.29112.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.27.29112.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.27.29112.0
ModLoad: 000000003dc00000 000000000000c000 C:\ProgramData\BOINC\slots\2\VCRUNTIME140_1.dll (14.27.29112.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.27.29112.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.27.29112.0
ModLoad: 00000000255c0000 000000000020d000 C:\ProgramData\BOINC\slots\2\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 0000000009190000 00000000002db000 C:\ProgramData\BOINC\slots\2\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000003b2b0000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.867 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.867
ModLoad: 000000003b610000 0000000000040000 C:\ProgramData\BOINC\slots\2\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000bb8a0000 0000000003d5b000 C:\ProgramData\BOINC\slots\2\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000a44c0000 000000000919f000 C:\ProgramData\BOINC\slots\2\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 00000000c1150000 0000000001eca000 C:\ProgramData\BOINC\slots\2\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 0000000043b90000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000003ffe0000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000043e30000 0000000000469000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.844) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 00000000420b0000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000042200000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 0000000041e60000 000000000002c000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000042980000 0000000000060000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1110) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.1110 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1110
ModLoad: 00000000424b0000 000000000015f000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.844) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 0000000041ca0000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000042f80000 000000000073f000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 00000000401e0000 0000000000791000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1081) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 0000000043760000 0000000000355000 C:\WINDOWS\System32\combase.dll (6.2.19041.1081) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 0000000041b20000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 0000000042ed0000 00000000000ae000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 00000000447b0000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 0000000022180000 0000000000267000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.5730) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 27.21.14.5730
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.1.114 driver
Product Version : 27.21.14.5730
ModLoad: 000000003cee0000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000048c0000 000000000152c000 C:\WINDOWS\system32\DriverStore\FileRepository\nvhqi.inf_amd64_6e271d4dca2c455f\nvcuda64.dll (27.21.14.5730) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 27.21.14.5730
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.1.114 driver
Product Version : 27.21.14.5730
ModLoad: 00000000448c0000 000000000006b000 C:\WINDOWS\System32\WS2_32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : ws2_32.pdb
File Version : 10.0.19041.1081 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1081
ModLoad: 000000003bd90000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.906 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.906
ModLoad: 0000000041a80000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000003fb20000 000000000009e000 C:\WINDOWS\system32\uxtheme.dll (6.2.19041.1081) (-exported- Symbols Loaded)
Linked PDB Filename : UxTheme.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 000000001a790000 00000000006d6000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.5730) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 27.21.14.5730
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 27.21.14.5730
ModLoad: 0000000042d70000 000000000012a000 C:\WINDOWS\System32\OLE32.DLL (6.2.19041.746) (-exported- Symbols Loaded)
Linked PDB Filename : ole32.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 000000003ca20000 0000000000009000 C:\ProgramData\BOINC\slots\2\caffe2_nvrtc.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000fb720000 0000000000fca000 C:\ProgramData\BOINC\slots\2\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6.14.11.9000
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.89 NVRTC Library
Product Version : 6.14.11.9000
ModLoad: 0000000042260000 0000000000083000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.1023 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1023
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 4405, Write: 3010, Other 12803
- I/O Transfers Counters -
Read: 6734343, Write: 633662, Other 144832
- Paged Pool Usage -
QuotaPagedPoolUsage: 3505144, QuotaPeakPagedPoolUsage: 3505736
QuotaNonPagedPoolUsage: 52216, QuotaPeakNonPagedPoolUsage: 52752
- Virtual Memory Usage -
VirtualSize: -440905728, PeakVirtualSize: 179040256
- Pagefile Usage -
PagefileUsage: -440905728, PeakPagefileUsage: -440905728
- Working Set Size -
WorkingSetSize: 1724596224, PeakWorkingSetSize: 1762975744, PageFaultCount: 633390
*** Dump of thread ID 12224 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 1397031296.000000, User Time: 14942812160.000000, Wait Time: 104141072.000000
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFC426E4ED9
- Registers -
rax=0000000000000000 rbx=00000000d3a062f0 rcx=0000000000000000 rdx=0000000000000000 rsi=0000000083173ef0 rdi=0000000019930520
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000000006000 r13=0000000000000000
r14=0000000083174c30 r15=0000000083174bb0 rip=00000000426e4ed9 rsp=0000000083173d90 rbp=0000000083174798
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000206
- Callstack -
ChildEBP RetAddr Args to Child
83173e60 3ca36220 5f15cf64 00000000 83174c30 ceb5a014 KERNELBASE!RaiseException+0x0
83173ec0 cf155272 5f15cf04 00000000 000007cb 00000116 VCRUNTIME140!_CxxThrowException+0x0
83173f10 cf1556d4 00000000 00000000 d217d290 d79e5f68 torch_cpu!at::Tensor::zero_+0x0
83174770 d6fa9ebe 831749a0 d79e6850 d79e6880 000002cf torch_cpu!_THError+0x0
831747b0 d6fa5412 831749a0 83174900 47ce04e0 d7e1a720 torch_cuda!__THCudaCheck+0x0
831747f0 cee059ff 83174b00 831749a0 83174e70 3b9097b0 torch_cuda!at::native::set_storage_cuda_+0x0
83174b80 cefa726f d761f630 ceb5ea63 00000001 3b8eef8f torch_cpu!at::native::empty_cpu+0x0
83174bc0 cef60615 83170000 83174c38 83174e30 3b8d7ce6 torch_cpu!at::native::mkldnn_sigmoid_+0x0
83174c00 cef6204a 83170000 83174c00 47cb7800 d62e6ae5 torch_cpu!at::native::mkldnn_sigmoid_+0x0
83174c90 cef60615 00000000 ceb5ea63 83174d70 83174e70 torch_cpu!at::native::mkldnn_sigmoid_+0x0
83174cd0 cf031eb0 83170000 00000000 83174e58 00000001 torch_cpu!at::native::mkldnn_sigmoid_+0x0
83174d70 cf042eec 335e4c56 3b909c50 83174ed0 3b8d3bd6 torch_cpu!at::bucketize_out+0x0
83174dc0 d66af160 83170000 00000000 83174ed0 00000000 torch_cpu!at::empty+0x0
83175160 d66b2de8 3b909c50 ceb60528 48bc21a0 3b909c50 torch_cuda!at::native::cummin_helper_cuda+0x0
83175340 d66b4379 83175450 9ee3adf0 83175850 9ee3ae08 torch_cuda!at::native::cummin_helper_cuda+0x0
83175580 d66b3d64 83170000 83175850 83175690 83175850 torch_cuda!at::native::cat_out_cuda+0x0
83175780 d6f51dd2 831757d8 00000001 831757d8 83175850 torch_cuda!at::native::cat_cuda+0x0
83175800 d6f64179 00000001 83175840 48bc0528 04000000 torch_cuda!at::native::set_storage_cuda_+0x0
83175840 cf031d7d 8c3954b0 83175bb0 83175b80 00000000 torch_cuda!at::native::set_storage_cuda_+0x0
831758c0 cf010d81 00000000 3b8f3994 83176090 9ee3a410 torch_cpu!at::bucketize_out+0x0
83175900 cee1b4a5 83175940 48bc1da0 83175a10 83175a80 torch_cpu!at::_cat+0x0
831759d0 cf1027bd 83175aa0 00000101 83175a28 3b921ea8 torch_cpu!at::native::cat+0x0
83175a50 cebc29ae 9ee3aab0 9ee3aac0 9ee3aac8 83175a08 torch_cpu!at::zeros_out+0x0
83175a90 cf031d7d 83175ad0 83175b40 00000000 449947b1 torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0
83175b10 cf0375d1 831760b0 d3eb0640 83176090 9ee3a410 torch_cpu!at::bucketize_out+0x0
83175b50 cee27d4c 83175de0 00000000 83175de0 00000000 torch_cpu!at::cat+0x0
83175d10 cf11c38d 83175d68 00000001 83175d68 83175de0 torch_cpu!at::native::stack+0x0
83175d90 cebc29ae 83176090 9ee3a410 00000000 00000000 torch_cpu!at::zeros_out+0x0
83175dd0 cf031d7d 83175e10 83175e80 00000000 d1dd1c8f torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0
83175e50 cf0802e1 83175f80 3b8f3720 831760b0 d3eb0640 torch_cpu!at::bucketize_out+0x0
83175e90 d0413839 83175f10 48bba7c0 48bba7c0 83175fa0 torch_cpu!at::stack+0x0
83176060 cebc29ae 00000000 831761b0 00000000 83176150 torch_cpu!torch::autograd::GraphRoot::apply+0x0
831760a0 cf031d7d 831760e0 83176150 48bbcc50 00000000 torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0
83176120 cf0802e1 83176290 ceb59cac 9bef7ea0 9ee3a410 torch_cpu!at::bucketize_out+0x0
83176160 2d3bff7e 83176228 9f224190 9f224190 83176370 torch_cpu!at::stack+0x0
83176200 2d3c2ef8 2d3bfe30 83176240 83176240 83176290 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::addCallback+0x0
83176260 2d3c3ea4 26617390 449947b1 83176400 47240000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Object::getSlot+0x0
831763a0 2d3bd3d2 9b4dc290 9f182010 83176400 44995ba1 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::markCompleted+0x0
831763d0 2d3c4541 00000000 9f186d90 21525210 44995ba1 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Object::operator=+0x0
83176580 2d3c743a 83176650 00000000 83177090 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::markCompleted+0x0
83176a80 2d3cb950 83176b80 83176b80 00000000 07c7e870 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0
8318f820 2d60c6f8 48c432d0 00000000 00000000 48562340 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
8318f860 446a7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
8318f890 449c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
8318f910 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 10488 (state: Waiting): ***
- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 104141064.000000
- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000838ffbe0 rsi=0000000000000000 rdi=0000000000000064
r8=00000000838ffbb8 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000044a0d4a4 rsp=00000000838ffbb8 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
838ffbb0 426f95be 838ffc78 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0
838ffc50 2d3ea07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0
838ffc80 446a7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
838ffcb0 449c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
838ffd30 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 8996 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 156250.000000, User Time: 156250.000000, Wait Time: 104141064.000000
- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=00000000839ffa60 rsi=0000000000000000 rdi=000000000000000d
r8=00000000839ff708 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000064 r13=00000000839ffa60
r14=00000000839ff760 r15=0000000000000000 rip=0000000044a0d974 rsp=00000000839ff708 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
839ff700 426fcab0 00000000 83333000 44ada4d0 83333000 ntdll!ZwWaitForMultipleObjects+0x0
839ff9f0 426fc9ae 47252c00 004e0049 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
839ffa30 04a6bb54 48e53e00 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0
839ffc70 04b009ed 00000000 00000004 00000000 00000000 nvcuda64!+0x0
839ffd20 04a6b523 a1d45cd9 a15a9c73 4937f680 00000000 nvcuda64!cuProfilerStop+0x0
839ffd50 04d7a750 4937f680 00000000 00000000 00000000 nvcuda64!+0x0
839ffd80 446a7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
839ffdb0 449c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
839ffe30 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 3196 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 104141064.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=0000000000000298 rdx=0000000000000000 rsi=0000000083aff6e8 rdi=0000000000000298
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000048e2d3d0 r13=0000000000000000
r14=0000000000000298 r15=0000000000000001 rip=0000000044a0cea4 rsp=0000000083aff6b8 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
83aff6b0 426d19ce 00000000 00000000 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0
83aff750 04c7c0e7 00000000 426da305 00000000 00000298 KERNELBASE!WaitForSingleObjectEx+0x0
83aff7c0 04a6b523 00000001 49179540 4937fbc0 00000000 nvcuda64!cuProfilerStop+0x0
83aff7f0 04d7a750 4937fbc0 00000000 00000000 00000000 nvcuda64!+0x0
83aff820 446a7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
83aff850 449c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
83aff8d0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 12060 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 104141040.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000490a6258 rdx=0000000083bffe58 rsi=0000000083bffdc0 rdi=0000000000000000
r8=0000000000000001 r9=0000000000002f1c r10=00000000490a95c8 r11=00000000fd413640 r12=0000000083bffe58 r13=0000000000000000
r14=00000000490a6258 r15=00000000490a95c8 rip=0000000044a10814 rsp=0000000083bffd98 rbp=0000000083bffdf0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
83bffd90 449d4295 00000102 04b3965d 00000000 83bffdc0 ntdll!NtWaitForAlertByThreadId+0x0
83bffe00 4271cd79 490a6db0 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0
83bffe30 049f223a 490a6db0 490a6db0 490a6db0 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0
83bffe90 04a6b523 00000002 a1b2fd5e 00000000 00000000 nvcuda64!+0x0
83bffec0 04d7a750 49380250 00000000 00000000 00000000 nvcuda64!+0x0
83bffef0 446a7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
83bfff20 449c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
83bfffa0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 8588 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 524218752.000000, User Time: 11368281088.000000, Wait Time: 104141064.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=0000000084216d48 rdx=0000000000000000 rsi=0000000000000000 rdi=0000000084216d48
r8=000000004791ff40 r9=0000000000000001 r10=0000000000008000 r11=0000000083cfad80 r12=0000000000000000 r13=0000000000000000
r14=0000000083cff4f0 r15=0000000084216cf8 rip=0000000044a10814 rsp=0000000083cff4c8 rbp=0000000083cff520
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
83cff4c0 449d4021 8cad1d38 8cad1d38 83cff600 8cad1d38 ntdll!NtWaitForAlertByThreadId+0x0
83cff540 4271ce29 84216cf0 84216d38 00000000 00000000 ntdll!RtlSleepConditionVariableSRW+0x0
83cff580 3092ba8d 8c5c7e20 8c5c7e20 8c5c7e20 00000000 KERNELBASE!SleepConditionVariableSRW+0x0
83cff5c0 30902848 99e77b30 00000000 00000000 d07705b4 MSVCP140!__crtSetThreadpoolWait+0x0
83cff5f0 30902710 00000000 30902f17 00000000 99e77b30 MSVCP140!std::_Winerror_message+0x0
83cff660 d077064b 99e77b10 000001c0 84216cf0 84216cf0 MSVCP140!std::_Winerror_message+0x0
83cff6a0 d07725b1 9f2d7700 ffffffff 99e77b10 ffffffff torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
83cff990 d0772471 d3c96d10 83cff9d0 d3c96d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0
83cff9e0 d0769744 00080001 9e900b70 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0
83cffa10 42121bb2 9e900b70 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0
83cffa40 446a7034 00000000 00000000 00000000 00000000 ucrtbase!_configthreadlocale+0x0
83cffa70 449c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
83cffaf0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)