Task 3431433
| Name | ParityModified-1606530407-30167-6_0 |
| Workunit | 1674642 |
| Created | 26 Dec 2020, 16:43:21 UTC |
| Sent | 27 Dec 2020, 4:51:57 UTC |
| Report deadline | 3 Jan 2021, 4:51:57 UTC |
| Received | 27 Dec 2020, 15:03:36 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | -529697949 (0xE06D7363) Unknown error code |
| Computer ID | 4161 |
| Run time | 26 min 57 sec |
| CPU time | 25 min 41 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 4,701.39 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.64 GB |
| Peak swap size | 3.62 GB |
| Peak disk usage | 1.53 GB |
Stderr output
<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
:574] : INFO : Epoch 539 | loss: 0.0311798 | val_loss: 0.0311865 | Time: 2032.31 ms
[2020-12-27 05:54:47 main:574] : INFO : Epoch 540 | loss: 0.0311772 | val_loss: 0.0311877 | Time: 2052.08 ms
[2020-12-27 05:54:49 main:574] : INFO : Epoch 541 | loss: 0.0311763 | val_loss: 0.0311864 | Time: 2011.81 ms
[2020-12-27 05:54:52 main:574] : INFO : Epoch 542 | loss: 0.0311765 | val_loss: 0.0311868 | Time: 2105.43 ms
[2020-12-27 05:54:54 main:574] : INFO : Epoch 543 | loss: 0.0311764 | val_loss: 0.0311888 | Time: 2086.79 ms
[2020-12-27 05:54:56 main:574] : INFO : Epoch 544 | loss: 0.0311781 | val_loss: 0.0311872 | Time: 2093.48 ms
[2020-12-27 05:54:58 main:574] : INFO : Epoch 545 | loss: 0.0311764 | val_loss: 0.0311867 | Time: 2056 ms
[2020-12-27 05:55:00 main:574] : INFO : Epoch 546 | loss: 0.031176 | val_loss: 0.0311883 | Time: 2093.83 ms
[2020-12-27 05:55:02 main:574] : INFO : Epoch 547 | loss: 0.0311763 | val_loss: 0.031186 | Time: 2027.39 ms
[2020-12-27 05:55:04 main:574] : INFO : Epoch 548 | loss: 0.0311774 | val_loss: 0.031188 | Time: 1982.66 ms
[2020-12-27 05:55:06 main:574] : INFO : Epoch 549 | loss: 0.0311782 | val_loss: 0.0311876 | Time: 2005.88 ms
[2020-12-27 05:55:08 main:574] : INFO : Epoch 550 | loss: 0.0311789 | val_loss: 0.0311877 | Time: 2076.69 ms
[2020-12-27 05:55:10 main:574] : INFO : Epoch 551 | loss: 0.0311784 | val_loss: 0.0311888 | Time: 2024.21 ms
[2020-12-27 05:55:13 main:574] : INFO : Epoch 552 | loss: 0.0311793 | val_loss: 0.031189 | Time: 2281.98 ms
[2020-12-27 05:55:15 main:574] : INFO : Epoch 553 | loss: 0.031178 | val_loss: 0.0311876 | Time: 2129.75 ms
[2020-12-27 05:55:17 main:574] : INFO : Epoch 554 | loss: 0.0311774 | val_loss: 0.0311868 | Time: 2127.1 ms
[2020-12-27 05:55:19 main:574] : INFO : Epoch 555 | loss: 0.0311772 | val_loss: 0.0311895 | Time: 2059.35 ms
[2020-12-27 05:55:21 main:574] : INFO : Epoch 556 | loss: 0.0311764 | val_loss: 0.0311873 | Time: 2113.56 ms
[2020-12-27 05:55:23 main:574] : INFO : Epoch 557 | loss: 0.0311761 | val_loss: 0.0311863 | Time: 2030.66 ms
[2020-12-27 05:55:25 main:574] : INFO : Epoch 558 | loss: 0.031177 | val_loss: 0.0311861 | Time: 2070.4 ms
[2020-12-27 05:55:27 main:574] : INFO : Epoch 559 | loss: 0.0311766 | val_loss: 0.0311868 | Time: 2062.46 ms
[2020-12-27 05:55:29 main:574] : INFO : Epoch 560 | loss: 0.0311758 | val_loss: 0.0311868 | Time: 2039.04 ms
[2020-12-27 05:55:32 main:574] : INFO : Epoch 561 | loss: 0.0311769 | val_loss: 0.0311864 | Time: 2112.66 ms
[2020-12-27 05:55:34 main:574] : INFO : Epoch 562 | loss: 0.0311782 | val_loss: 0.0311933 | Time: 2130.43 ms
[2020-12-27 05:55:36 main:574] : INFO : Epoch 563 | loss: 0.0311791 | val_loss: 0.0311947 | Time: 2059.08 ms
[2020-12-27 05:55:38 main:574] : INFO : Epoch 564 | loss: 0.0311785 | val_loss: 0.0311886 | Time: 1981.04 ms
[2020-12-27 05:55:40 main:574] : INFO : Epoch 565 | loss: 0.0311783 | val_loss: 0.0311879 | Time: 2039.82 ms
[2020-12-27 05:55:42 main:574] : INFO : Epoch 566 | loss: 0.0311762 | val_loss: 0.0311857 | Time: 2062.78 ms
[2020-12-27 05:55:44 main:574] : INFO : Epoch 567 | loss: 0.0311757 | val_loss: 0.0311878 | Time: 2004.69 ms
[2020-12-27 05:55:46 main:574] : INFO : Epoch 568 | loss: 0.0311756 | val_loss: 0.0311869 | Time: 2031.99 ms
[2020-12-27 05:55:48 main:574] : INFO : Epoch 569 | loss: 0.0311758 | val_loss: 0.031187 | Time: 2091.15 ms
[2020-12-27 05:55:50 main:574] : INFO : Epoch 570 | loss: 0.031177 | val_loss: 0.0311859 | Time: 2070.8 ms
[2020-12-27 05:55:52 main:574] : INFO : Epoch 571 | loss: 0.0311793 | val_loss: 0.031186 | Time: 2024.12 ms
[2020-12-27 05:55:54 main:574] : INFO : Epoch 572 | loss: 0.0311771 | val_loss: 0.0311872 | Time: 2054.17 ms
[2020-12-27 05:55:57 main:574] : INFO : Epoch 573 | loss: 0.0311769 | val_loss: 0.0311874 | Time: 2073.31 ms
[2020-12-27 05:55:59 main:574] : INFO : Epoch 574 | loss: 0.0311777 | val_loss: 0.0311867 | Time: 2040.41 ms
[2020-12-27 05:56:01 main:574] : INFO : Epoch 575 | loss: 0.0311778 | val_loss: 0.0311853 | Time: 2088.65 ms
[2020-12-27 05:56:03 main:574] : INFO : Epoch 576 | loss: 0.0311782 | val_loss: 0.0311854 | Time: 2037.94 ms
[2020-12-27 05:56:05 main:574] : INFO : Epoch 577 | loss: 0.0311764 | val_loss: 0.031185 | Time: 2028.15 ms
[2020-12-27 05:56:07 main:574] : INFO : Epoch 578 | loss: 0.0311756 | val_loss: 0.031186 | Time: 2037.21 ms
[2020-12-27 05:56:09 main:574] : INFO : Epoch 579 | loss: 0.0311753 | val_loss: 0.0311867 | Time: 2029.58 ms
[2020-12-27 05:56:11 main:574] : INFO : Epoch 580 | loss: 0.0311767 | val_loss: 0.0311895 | Time: 2024.34 ms
[2020-12-27 05:56:13 main:574] : INFO : Epoch 581 | loss: 0.0311748 | val_loss: 0.031186 | Time: 2067.5 ms
[2020-12-27 05:56:15 main:574] : INFO : Epoch 582 | loss: 0.0311749 | val_loss: 0.0311871 | Time: 2077.97 ms
[2020-12-27 05:56:17 main:574] : INFO : Epoch 583 | loss: 0.0311779 | val_loss: 0.0311858 | Time: 2029.96 ms
[2020-12-27 05:56:20 main:574] : INFO : Epoch 584 | loss: 0.0311784 | val_loss: 0.0311866 | Time: 2115.87 ms
[2020-12-27 05:56:22 main:574] : INFO : Epoch 585 | loss: 0.031179 | val_loss: 0.0311864 | Time: 2006.22 ms
[2020-12-27 05:56:24 main:574] : INFO : Epoch 586 | loss: 0.0311782 | val_loss: 0.0311862 | Time: 2014.12 ms
[2020-12-27 05:56:26 main:574] : INFO : Epoch 587 | loss: 0.0311787 | val_loss: 0.0311856 | Time: 2083.88 ms
[2020-12-27 05:56:28 main:574] : INFO : Epoch 588 | loss: 0.0311782 | val_loss: 0.0311846 | Time: 2062.22 ms
[2020-12-27 05:56:30 main:574] : INFO : Epoch 589 | loss: 0.0311775 | val_loss: 0.0311869 | Time: 2083.49 ms
[2020-12-27 05:56:32 main:574] : INFO : Epoch 590 | loss: 0.0311781 | val_loss: 0.031187 | Time: 2018.21 ms
[2020-12-27 05:56:34 main:574] : INFO : Epoch 591 | loss: 0.0311779 | val_loss: 0.0311855 | Time: 2050.93 ms
[2020-12-27 05:56:36 main:574] : INFO : Epoch 592 | loss: 0.031177 | val_loss: 0.0311862 | Time: 2075.9 ms
[2020-12-27 05:56:38 main:574] : INFO : Epoch 593 | loss: 0.0311771 | val_loss: 0.0311935 | Time: 2030.2 ms
[2020-12-27 05:56:40 main:574] : INFO : Epoch 594 | loss: 0.0311791 | val_loss: 0.031187 | Time: 1988.89 ms
[2020-12-27 05:56:42 main:574] : INFO : Epoch 595 | loss: 0.0311776 | val_loss: 0.0311885 | Time: 2054.42 ms
[2020-12-27 05:56:44 main:574] : INFO : Epoch 596 | loss: 0.0311781 | val_loss: 0.0311863 | Time: 2026.55 ms
[2020-12-27 05:56:46 main:574] : INFO : Epoch 597 | loss: 0.0311768 | val_loss: 0.0311854 | Time: 1988.52 ms
[2020-12-27 05:56:49 main:574] : INFO : Epoch 598 | loss: 0.0311752 | val_loss: 0.0311854 | Time: 2068.79 ms
[2020-12-27 05:56:51 main:574] : INFO : Epoch 599 | loss: 0.0311771 | val_loss: 0.031188 | Time: 2052.21 ms
[2020-12-27 05:56:53 main:574] : INFO : Epoch 600 | loss: 0.0311805 | val_loss: 0.0311905 | Time: 2014.44 ms
[2020-12-27 05:56:55 main:574] : INFO : Epoch 601 | loss: 0.0311793 | val_loss: 0.0311891 | Time: 1979.6 ms
[2020-12-27 05:56:57 main:574] : INFO : Epoch 602 | loss: 0.0311782 | val_loss: 0.0311902 | Time: 2084.4 ms
[2020-12-27 05:56:59 main:574] : INFO : Epoch 603 | loss: 0.0311776 | val_loss: 0.0311862 | Time: 2010.54 ms
[2020-12-27 05:57:01 main:574] : INFO : Epoch 604 | loss: 0.0311782 | val_loss: 0.031187 | Time: 2038.17 ms
[2020-12-27 05:57:03 main:574] : INFO : Epoch 605 | loss: 0.0311761 | val_loss: 0.0311865 | Time: 2113.58 ms
[2020-12-27 05:57:05 main:574] : INFO : Epoch 606 | loss: 0.0311749 | val_loss: 0.0311861 | Time: 2017.89 ms
[2020-12-27 05:57:07 main:574] : INFO : Epoch 607 | loss: 0.0311761 | val_loss: 0.0311868 | Time: 2177.26 ms
[2020-12-27 05:57:09 main:574] : INFO : Epoch 608 | loss: 0.0311791 | val_loss: 0.0311941 | Time: 2150.63 ms
[2020-12-27 05:57:12 main:574] : INFO : Epoch 609 | loss: 0.031181 | val_loss: 0.0311869 | Time: 2096.81 ms
[2020-12-27 05:57:14 main:574] : INFO : Epoch 610 | loss: 0.0311755 | val_loss: 0.031185 | Time: 2052.92 ms
[2020-12-27 05:57:16 main:574] : INFO : Epoch 611 | loss: 0.0311759 | val_loss: 0.0311856 | Time: 2023.01 ms
[2020-12-27 05:57:18 main:574] : INFO : Epoch 612 | loss: 0.0311748 | val_loss: 0.0311839 | Time: 2070.24 ms
[2020-12-27 05:57:20 main:574] : INFO : Epoch 613 | loss: 0.0311763 | val_loss: 0.0311854 | Time: 2067.66 ms
[2020-12-27 05:57:22 main:574] : INFO : Epoch 614 | loss: 0.0311766 | val_loss: 0.0311843 | Time: 1974.16 ms
[2020-12-27 05:57:24 main:574] : INFO : Epoch 615 | loss: 0.0311753 | val_loss: 0.0311837 | Time: 1938.26 ms
[2020-12-27 05:57:26 main:574] : INFO : Epoch 616 | loss: 0.0311749 | val_loss: 0.0311844 | Time: 2093.1 ms
[2020-12-27 05:57:28 main:574] : INFO : Epoch 617 | loss: 0.0311745 | val_loss: 0.0311852 | Time: 2037.55 ms
[2020-12-27 05:57:30 main:574] : INFO : Epoch 618 | loss: 0.0311748 | val_loss: 0.0311867 | Time: 2003.5 ms
[2020-12-27 05:57:32 main:574] : INFO : Epoch 619 | loss: 0.0311777 | val_loss: 0.0311882 | Time: 2016.87 ms
[2020-12-27 05:57:34 main:574] : INFO : Epoch 620 | loss: 0.0311761 | val_loss: 0.0311864 | Time: 1993.23 ms
[2020-12-27 05:57:36 main:574] : INFO : Epoch 621 | loss: 0.0311745 | val_loss: 0.0311872 | Time: 1982.03 ms
[2020-12-27 05:57:38 main:574] : INFO : Epoch 622 | loss: 0.0311739 | val_loss: 0.0311861 | Time: 2018.09 ms
[2020-12-27 05:57:40 main:574] : INFO : Epoch 623 | loss: 0.0311731 | val_loss: 0.0311866 | Time: 2055.67 ms
[2020-12-27 05:57:42 main:574] : INFO : Epoch 624 | loss: 0.0311731 | val_loss: 0.0311856 | Time: 2033.17 ms
[2020-12-27 05:57:44 main:574] : INFO : Epoch 625 | loss: 0.0311722 | val_loss: 0.0311851 | Time: 1958.28 ms
[2020-12-27 05:57:46 main:574] : INFO : Epoch 626 | loss: 0.0311748 | val_loss: 0.0311876 | Time: 2009.53 ms
[2020-12-27 05:57:48 main:574] : INFO : Epoch 627 | loss: 0.0311732 | val_loss: 0.0311881 | Time: 2017.7 ms
[2020-12-27 05:57:50 main:574] : INFO : Epoch 628 | loss: 0.0311728 | val_loss: 0.0311851 | Time: 1964.02 ms
[2020-12-27 05:57:52 main:574] : INFO : Epoch 629 | loss: 0.0311738 | val_loss: 0.0311857 | Time: 2005.91 ms
[2020-12-27 05:57:55 main:574] : INFO : Epoch 630 | loss: 0.0311727 | val_loss: 0.0311846 | Time: 2075.07 ms
[2020-12-27 05:57:57 main:574] : INFO : Epoch 631 | loss: 0.0311724 | val_loss: 0.0311871 | Time: 2065.79 ms
[2020-12-27 05:57:59 main:574] : INFO : Epoch 632 | loss: 0.031175 | val_loss: 0.0311842 | Time: 2025.93 ms
[2020-12-27 05:58:01 main:574] : INFO : Epoch 633 | loss: 0.031172 | val_loss: 0.0311842 | Time: 2072.7 ms
[2020-12-27 05:58:03 main:574] : INFO : Epoch 634 | loss: 0.0311717 | val_loss: 0.0311851 | Time: 2074.58 ms
[2020-12-27 05:58:05 main:574] : INFO : Epoch 635 | loss: 0.0311722 | val_loss: 0.0311849 | Time: 2042.56 ms
[2020-12-27 05:58:07 main:574] : INFO : Epoch 636 | loss: 0.0311767 | val_loss: 0.0311837 | Time: 2039.77 ms
[2020-12-27 05:58:09 main:574] : INFO : Epoch 637 | loss: 0.0311717 | val_loss: 0.031184 | Time: 2030.83 ms
[2020-12-27 05:58:11 main:574] : INFO : Epoch 638 | loss: 0.0311717 | val_loss: 0.0311849 | Time: 2102.2 ms
[2020-12-27 05:58:14 main:574] : INFO : Epoch 639 | loss: 0.031172 | val_loss: 0.0311848 | Time: 2157.65 ms
[2020-12-27 05:58:16 main:574] : INFO : Epoch 640 | loss: 0.0311714 | val_loss: 0.0311906 | Time: 2075.31 ms
[2020-12-27 05:58:18 main:574] : INFO : Epoch 641 | loss: 0.0311737 | val_loss: 0.0311833 | Time: 2011.98 ms
[2020-12-27 05:58:20 main:574] : INFO : Epoch 642 | loss: 0.0311717 | val_loss: 0.031185 | Time: 2094.86 ms
[2020-12-27 05:58:22 main:574] : INFO : Epoch 643 | loss: 0.0311719 | val_loss: 0.0311825 | Time: 2186.66 ms
[2020-12-27 05:58:24 main:574] : INFO : Epoch 644 | loss: 0.0311724 | val_loss: 0.0311839 | Time: 2177.72 ms
[2020-12-27 05:58:26 main:574] : INFO : Epoch 645 | loss: 0.0311712 | val_loss: 0.0311859 | Time: 2135.93 ms
[2020-12-27 05:58:28 main:574] : INFO : Epoch 646 | loss: 0.0311727 | val_loss: 0.0311838 | Time: 2043.46 ms
[2020-12-27 05:58:30 main:574] : INFO : Epoch 647 | loss: 0.0311714 | val_loss: 0.0311835 | Time: 2010.47 ms
[2020-12-27 05:58:33 main:574] : INFO : Epoch 648 | loss: 0.0311711 | val_loss: 0.0311854 | Time: 2014.5 ms
[2020-12-27 05:58:34 main:574] : INFO : Epoch 649 | loss: 0.0311709 | val_loss: 0.0311875 | Time: 1965.62 ms
[2020-12-27 05:58:37 main:574] : INFO : Epoch 650 | loss: 0.0311747 | val_loss: 0.0311868 | Time: 2011.1 ms
[2020-12-27 05:58:39 main:574] : INFO : Epoch 651 | loss: 0.0311729 | val_loss: 0.0311854 | Time: 2028.9 ms
[2020-12-27 05:58:41 main:574] : INFO : Epoch 652 | loss: 0.0311704 | val_loss: 0.0311867 | Time: 2034.42 ms
[2020-12-27 05:58:43 main:574] : INFO : Epoch 653 | loss: 0.0311702 | val_loss: 0.0311858 | Time: 1975.43 ms
[2020-12-27 05:58:45 main:574] : INFO : Epoch 654 | loss: 0.0311721 | val_loss: 0.0311845 | Time: 2017.58 ms
[2020-12-27 05:58:47 main:574] : INFO : Epoch 655 | loss: 0.0311732 | val_loss: 0.031184 | Time: 2039.99 ms
[2020-12-27 05:58:49 main:574] : INFO : Epoch 656 | loss: 0.0311699 | val_loss: 0.0311849 | Time: 2052.89 ms
[2020-12-27 05:58:51 main:574] : INFO : Epoch 657 | loss: 0.0311703 | val_loss: 0.0311865 | Time: 2001.99 ms
[2020-12-27 05:58:53 main:574] : INFO : Epoch 658 | loss: 0.0311706 | val_loss: 0.0311834 | Time: 2067.41 ms
[2020-12-27 05:58:55 main:574] : INFO : Epoch 659 | loss: 0.0311693 | val_loss: 0.0311839 | Time: 2026.57 ms
[2020-12-27 05:58:57 main:574] : INFO : Epoch 660 | loss: 0.0311697 | val_loss: 0.0311851 | Time: 2106.88 ms
[2020-12-27 05:58:59 main:574] : INFO : Epoch 661 | loss: 0.0311693 | val_loss: 0.0311847 | Time: 1985.3 ms
[2020-12-27 05:59:01 main:574] : INFO : Epoch 662 | loss: 0.031173 | val_loss: 0.0311859 | Time: 2005.13 ms
[2020-12-27 05:59:03 main:574] : INFO : Epoch 663 | loss: 0.0311701 | val_loss: 0.0311845 | Time: 2099.88 ms
[2020-12-27 05:59:06 main:574] : INFO : Epoch 664 | loss: 0.03117 | val_loss: 0.0311841 | Time: 2135.06 ms
[2020-12-27 05:59:08 main:574] : INFO : Epoch 665 | loss: 0.0311698 | val_loss: 0.0311849 | Time: 2011.11 ms
[2020-12-27 05:59:10 main:574] : INFO : Epoch 666 | loss: 0.0311703 | val_loss: 0.0311833 | Time: 1974.05 ms
[2020-12-27 05:59:12 main:574] : INFO : Epoch 667 | loss: 0.0311705 | val_loss: 0.0311854 | Time: 2054.55 ms
[2020-12-27 05:59:14 main:574] : INFO : Epoch 668 | loss: 0.0311697 | val_loss: 0.0311853 | Time: 2063.76 ms
[2020-12-27 05:59:16 main:574] : INFO : Epoch 669 | loss: 0.0311686 | val_loss: 0.0311859 | Time: 1992.48 ms
[2020-12-27 05:59:18 main:574] : INFO : Epoch 670 | loss: 0.0311681 | val_loss: 0.0311848 | Time: 2017.54 ms
[2020-12-27 05:59:20 main:574] : INFO : Epoch 671 | loss: 0.0311688 | val_loss: 0.0311851 | Time: 1996.62 ms
[2020-12-27 05:59:22 main:574] : INFO : Epoch 672 | loss: 0.0311695 | val_loss: 0.031187 | Time: 2046.16 ms
[2020-12-27 05:59:24 main:574] : INFO : Epoch 673 | loss: 0.0311691 | val_loss: 0.031184 | Time: 2024.55 ms
[2020-12-27 05:59:26 main:574] : INFO : Epoch 674 | loss: 0.0311686 | val_loss: 0.0311841 | Time: 2174.96 ms
[2020-12-27 05:59:28 main:574] : INFO : Epoch 675 | loss: 0.0311678 | val_loss: 0.0311844 | Time: 1988.08 ms
[2020-12-27 05:59:30 main:574] : INFO : Epoch 676 | loss: 0.0311688 | val_loss: 0.031183 | Time: 2115.09 ms
[2020-12-27 05:59:33 main:574] : INFO : Epoch 677 | loss: 0.0311688 | val_loss: 0.0311865 | Time: 1999.69 ms
[2020-12-27 05:59:35 main:574] : INFO : Epoch 678 | loss: 0.0311696 | val_loss: 0.0311852 | Time: 2002.71 ms
[2020-12-27 05:59:37 main:574] : INFO : Epoch 679 | loss: 0.031172 | val_loss: 0.0311851 | Time: 2002.09 ms
[2020-12-27 05:59:39 main:574] : INFO : Epoch 680 | loss: 0.0311727 | val_loss: 0.0311877 | Time: 2011.7 ms
[2020-12-27 05:59:41 main:574] : INFO : Epoch 681 | loss: 0.0311713 | val_loss: 0.0311854 | Time: 2069.14 ms
[2020-12-27 05:59:43 main:574] : INFO : Epoch 682 | loss: 0.0311715 | val_loss: 0.0311868 | Time: 2066 ms
[2020-12-27 05:59:45 main:574] : INFO : Epoch 683 | loss: 0.0311706 | val_loss: 0.0311855 | Time: 2022.43 ms
[2020-12-27 05:59:47 main:574] : INFO : Epoch 684 | loss: 0.031171 | val_loss: 0.0311833 | Time: 1972.28 ms
[2020-12-27 05:59:49 main:574] : INFO : Epoch 685 | loss: 0.0311699 | val_loss: 0.0311825 | Time: 1990.46 ms
[2020-12-27 05:59:51 main:574] : INFO : Epoch 686 | loss: 0.0311695 | val_loss: 0.0311846 | Time: 2025.58 ms
[2020-12-27 05:59:53 main:574] : INFO : Epoch 687 | loss: 0.0311694 | val_loss: 0.031184 | Time: 2027.03 ms
[2020-12-27 05:59:55 main:574] : INFO : Epoch 688 | loss: 0.0311693 | val_loss: 0.0311834 | Time: 2033.62 ms
[2020-12-27 05:59:57 main:574] : INFO : Epoch 689 | loss: 0.0311689 | val_loss: 0.0311843 | Time: 2030.45 ms
[2020-12-27 05:59:59 main:574] : INFO : Epoch 690 | loss: 0.0311695 | val_loss: 0.0311914 | Time: 2034.75 ms
[2020-12-27 06:00:01 main:574] : INFO : Epoch 691 | loss: 0.0311722 | val_loss: 0.0311893 | Time: 2032.44 ms
[2020-12-27 06:00:03 main:574] : INFO : Epoch 692 | loss: 0.031171 | val_loss: 0.0311881 | Time: 2049.02 ms
[2020-12-27 06:00:05 main:574] : INFO : Epoch 693 | loss: 0.0311722 | val_loss: 0.0311869 | Time: 2066.35 ms
[2020-12-27 06:00:07 main:574] : INFO : Epoch 694 | loss: 0.0311702 | val_loss: 0.0311857 | Time: 2042.96 ms
[2020-12-27 06:00:10 main:574] : INFO : Epoch 695 | loss: 0.0311723 | val_loss: 0.0311819 | Time: 1986.99 ms
[2020-12-27 06:00:12 main:574] : INFO : Epoch 696 | loss: 0.0311685 | val_loss: 0.0311839 | Time: 2007.23 ms
[2020-12-27 06:00:14 main:574] : INFO : Epoch 697 | loss: 0.0311685 | val_loss: 0.0311837 | Time: 2107.52 ms
[2020-12-27 06:00:16 main:574] : INFO : Epoch 698 | loss: 0.031169 | val_loss: 0.0311858 | Time: 2116.98 ms
[2020-12-27 06:00:18 main:574] : INFO : Epoch 699 | loss: 0.0311699 | val_loss: 0.0311891 | Time: 1999 ms
[2020-12-27 06:00:20 main:574] : INFO : Epoch 700 | loss: 0.03117 | val_loss: 0.0311859 | Time: 2126.86 ms
[2020-12-27 06:00:22 main:574] : INFO : Epoch 701 | loss: 0.0311698 | val_loss: 0.0311834 | Time: 2092.64 ms
[2020-12-27 06:00:24 main:574] : INFO : Epoch 702 | loss: 0.031175 | val_loss: 0.0311858 | Time: 2079.41 ms
[2020-12-27 06:00:26 main:574] : INFO : Epoch 703 | loss: 0.0311779 | val_loss: 0.0311867 | Time: 2001.04 ms
[2020-12-27 06:00:28 main:574] : INFO : Epoch 704 | loss: 0.0311748 | val_loss: 0.0311833 | Time: 2038.23 ms
[2020-12-27 06:00:30 main:574] : INFO : Epoch 705 | loss: 0.031174 | val_loss: 0.0311964 | Time: 2051.57 ms
[2020-12-27 06:00:32 main:574] : INFO : Epoch 706 | loss: 0.0311777 | val_loss: 0.031185 | Time: 2039.15 ms
[2020-12-27 06:00:34 main:574] : INFO : Epoch 707 | loss: 0.0311723 | val_loss: 0.031183 | Time: 1966.27 ms
[2020-12-27 06:00:37 main:574] : INFO : Epoch 708 | loss: 0.031173 | val_loss: 0.0311848 | Time: 2062.06 ms
[2020-12-27 06:00:39 main:574] : INFO : Epoch 709 | loss: 0.0311714 | val_loss: 0.0311821 | Time: 2134.21 ms
[2020-12-27 06:00:41 main:574] : INFO : Epoch 710 | loss: 0.0311719 | val_loss: 0.0311842 | Time: 1995 ms
[2020-12-27 06:00:43 main:574] : INFO : Epoch 711 | loss: 0.0311713 | val_loss: 0.0311801 | Time: 2042.49 ms
[2020-12-27 06:00:45 main:574] : INFO : Epoch 712 | loss: 0.03117 | val_loss: 0.0311809 | Time: 2102.99 ms
[2020-12-27 06:00:47 main:574] : INFO : Epoch 713 | loss: 0.0311708 | val_loss: 0.0311816 | Time: 1963.5 ms
[2020-12-27 06:00:49 main:574] : INFO : Epoch 714 | loss: 0.0311708 | val_loss: 0.0311813 | Time: 1991.19 ms
[2020-12-27 06:00:51 main:574] : INFO : Epoch 715 | loss: 0.031171 | val_loss: 0.0311809 | Time: 2057.91 ms
[2020-12-27 06:00:53 main:574] : INFO : Epoch 716 | loss: 0.031172 | val_loss: 0.0311827 | Time: 1995.3 ms
[2020-12-27 06:00:55 main:574] : INFO : Epoch 717 | loss: 0.031173 | val_loss: 0.0311851 | Time: 2054.47 ms
[2020-12-27 06:00:57 main:574] : INFO : Epoch 718 | loss: 0.0311721 | val_loss: 0.0311817 | Time: 1976.44 ms
[2020-12-27 06:00:59 main:574] : INFO : Epoch 719 | loss: 0.0311707 | val_loss: 0.031183 | Time: 2077.41 ms
[2020-12-27 06:01:01 main:574] : INFO : Epoch 720 | loss: 0.0311723 | val_loss: 0.031186 | Time: 2041.35 ms
[2020-12-27 06:01:03 main:574] : INFO : Epoch 721 | loss: 0.0311745 | val_loss: 0.0311829 | Time: 2045.78 ms
[2020-12-27 06:01:05 main:574] : INFO : Epoch 722 | loss: 0.0311712 | val_loss: 0.0311812 | Time: 2021.98 ms
[2020-12-27 06:01:08 main:574] : INFO : Epoch 723 | loss: 0.0311705 | val_loss: 0.0311824 | Time: 2057.26 ms
[2020-12-27 06:01:10 main:574] : INFO : Epoch 724 | loss: 0.0311722 | val_loss: 0.0311862 | Time: 2076.31 ms
[2020-12-27 06:01:12 main:574] : INFO : Epoch 725 | loss: 0.0311711 | val_loss: 0.0311834 | Time: 2035.65 ms
[2020-12-27 06:01:14 main:574] : INFO : Epoch 726 | loss: 0.0311731 | val_loss: 0.0311838 | Time: 2040.43 ms
[2020-12-27 06:01:16 main:574] : INFO : Epoch 727 | loss: 0.0311733 | val_loss: 0.0311823 | Time: 1983.7 ms
[2020-12-27 06:01:18 main:574] : INFO : Epoch 728 | loss: 0.0311705 | val_loss: 0.0311822 | Time: 2026.49 ms
[2020-12-27 06:01:20 main:574] : INFO : Epoch 729 | loss: 0.0311729 | val_loss: 0.0311831 | Time: 2022.38 ms
[2020-12-27 06:01:22 main:574] : INFO : Epoch 730 | loss: 0.0311736 | val_loss: 0.0311846 | Time: 2065.47 ms
[2020-12-27 06:01:24 main:574] : INFO : Epoch 731 | loss: 0.0311762 | val_loss: 0.0311834 | Time: 1991.57 ms
[2020-12-27 06:01:26 main:574] : INFO : Epoch 732 | loss: 0.0311742 | val_loss: 0.0311797 | Time: 2035.83 ms
[2020-12-27 06:01:28 main:574] : INFO : Epoch 733 | loss: 0.0311729 | val_loss: 0.0311798 | Time: 2009.57 ms
[2020-12-27 06:01:30 main:574] : INFO : Epoch 734 | loss: 0.0311723 | val_loss: 0.0311793 | Time: 2006.83 ms
[2020-12-27 06:01:32 main:574] : INFO : Epoch 735 | loss: 0.0311723 | val_loss: 0.0311782 | Time: 2013.17 ms
[2020-12-27 06:01:35 main:574] : INFO : Epoch 736 | loss: 0.0311713 | val_loss: 0.031181 | Time: 2129.47 ms
[2020-12-27 06:01:37 main:574] : INFO : Epoch 737 | loss: 0.0311735 | val_loss: 0.0311795 | Time: 2090.71 ms
[2020-12-27 06:01:39 main:574] : INFO : Epoch 738 | loss: 0.0311712 | val_loss: 0.0311797 | Time: 2112.42 ms
[2020-12-27 06:01:41 main:574] : INFO : Epoch 739 | loss: 0.0311709 | val_loss: 0.0311793 | Time: 1947.89 ms
[2020-12-27 06:01:43 main:574] : INFO : Epoch 740 | loss: 0.0311706 | val_loss: 0.0311794 | Time: 2074.75 ms
[2020-12-27 06:01:45 main:574] : INFO : Epoch 741 | loss: 0.0311703 | val_loss: 0.0311819 | Time: 2031.88 ms
[2020-12-27 06:01:47 main:574] : INFO : Epoch 742 | loss: 0.0311747 | val_loss: 0.0311871 | Time: 2012.32 ms
[2020-12-27 06:01:49 main:574] : INFO : Epoch 743 | loss: 0.0311765 | val_loss: 0.0311811 | Time: 2063.09 ms
[2020-12-27 06:01:51 main:574] : INFO : Epoch 744 | loss: 0.0311739 | val_loss: 0.0311821 | Time: 2078.42 ms
[2020-12-27 06:01:53 main:574] : INFO : Epoch 745 | loss: 0.0311724 | val_loss: 0.0311831 | Time: 2031.68 ms
[2020-12-27 06:01:55 main:574] : INFO : Epoch 746 | loss: 0.0311718 | val_loss: 0.0311809 | Time: 2056.22 ms
[2020-12-27 06:01:57 main:574] : INFO : Epoch 747 | loss: 0.0311704 | val_loss: 0.0311814 | Time: 2062.7 ms
[2020-12-27 06:01:59 main:574] : INFO : Epoch 748 | loss: 0.0311723 | val_loss: 0.0311829 | Time: 2062.84 ms
[2020-12-27 06:02:02 main:574] : INFO : Epoch 749 | loss: 0.0311744 | val_loss: 0.0311809 | Time: 2071.46 ms
[2020-12-27 06:02:04 main:574] : INFO : Epoch 750 | loss: 0.0311751 | val_loss: 0.0311817 | Time: 1969.98 ms
[2020-12-27 06:02:06 main:574] : INFO : Epoch 751 | loss: 0.0311759 | val_loss: 0.031183 | Time: 1991.57 ms
[2020-12-27 06:02:08 main:574] : INFO : Epoch 752 | loss: 0.0311755 | val_loss: 0.0311824 | Time: 2059.59 ms
[2020-12-27 06:02:10 main:574] : INFO : Epoch 753 | loss: 0.0311742 | val_loss: 0.031182 | Time: 1987.61 ms
[2020-12-27 06:02:12 main:574] : INFO : Epoch 754 | loss: 0.0311733 | val_loss: 0.0311807 | Time: 2010.49 ms
[2020-12-27 06:02:14 main:574] : INFO : Epoch 755 | loss: 0.0311727 | val_loss: 0.0311816 | Time: 2058.39 ms
[2020-12-27 06:02:16 main:574] : INFO : Epoch 756 | loss: 0.0311722 | val_loss: 0.0311818 | Time: 2069.12 ms
[2020-12-27 06:02:18 main:574] : INFO : Epoch 757 | loss: 0.0311741 | val_loss: 0.0311806 | Time: 2020.04 ms
[2020-12-27 06:02:20 main:574] : INFO : Epoch 758 | loss: 0.0311729 | val_loss: 0.0311825 | Time: 1993.05 ms
[2020-12-27 06:02:22 main:574] : INFO : Epoch 759 | loss: 0.0311721 | val_loss: 0.0311835 | Time: 2004.76 ms
[2020-12-27 06:02:24 main:574] : INFO : Epoch 760 | loss: 0.0311729 | val_loss: 0.0311843 | Time: 2010.88 ms
[2020-12-27 06:02:26 main:574] : INFO : Epoch 761 | loss: 0.0311721 | val_loss: 0.0311803 | Time: 2105.59 ms
[2020-12-27 06:02:28 main:574] : INFO : Epoch 762 | loss: 0.0311717 | val_loss: 0.0311812 | Time: 2039.83 ms
[2020-12-27 06:02:31 main:574] : INFO : Epoch 763 | loss: 0.0311716 | val_loss: 0.0311814 | Time: 2017.81 ms
[2020-12-27 06:02:33 main:574] : INFO : Epoch 764 | loss: 0.0311715 | val_loss: 0.0311842 | Time: 2009.05 ms
THCudaCheck FAIL file=..\..\aten\src\THC\THCCachingHostAllocator.cpp line=278 error=719 : unspecified launch failure
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FF8644FD759
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 12/27/20 06:02:33
Install Directory : E:\Program Files\BOINC\
Data Directory : E:\Program Files\BOINC\DATA
Project Symstore :
LoadLibraryA( E:\Program Files\BOINC\DATA\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( E:\Program Files\BOINC\DATA\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( E:\Program Files\BOINC\DATA\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( E:\Program Files\BOINC\DATA\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: E:\Program Files\BOINC\DATA\slots\4;E:\Program Files\BOINC\DATA\projects\www.mlcathome.org_mlcathome
ModLoad: 00000000ecb80000 00000000003df000 E:\Program Files\BOINC\DATA\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000066ad0000 00000000001f6000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.662
ModLoad: 0000000041c90000 0000000000012000 C:\Program Files\AVAST Software\Avast\aswhook.dll (20.7.5568.0) (-nosymbols- Symbols Loaded)
Linked PDB Filename : D:\work\616216c47067779c\idp\build\avgast\RU_NTDLL-lH-Y2A!x64_vs142\bin\Release_Unicode_NTDLL_vs142\x64\aswhook.pdb
File Version : 20.7.5568.0
Company Name : AVAST Software
Product Name : Avast
Product Version : 20.7.5568.0
ModLoad: 00000000665e0000 00000000000bd000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.662
ModLoad: 00000000644d0000 00000000002c9000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.662
ModLoad: 0000000066120000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.685) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000648d0000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.662
ModLoad: 0000000065400000 000000000002a000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.685) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.685 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.685
ModLoad: 00000000643c0000 0000000000109000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.685) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.685 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.685
ModLoad: 0000000064900000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000064210000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000065670000 00000000000ac000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.610) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000664e0000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.19041.546
ModLoad: 0000000065a10000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000657c0000 000000000012b000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000005a7c0000 0000000000058000 E:\Program Files\BOINC\DATA\slots\4\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000743c0000 0000000024b49000 E:\Program Files\BOINC\DATA\slots\4\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000b9c30000 000000000abe7000 E:\Program Files\BOINC\DATA\slots\4\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000003b5d0000 0000000000099000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.20.27508.1) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\1\s\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.20.27508.1 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio® 2017
Product Version : 14.20.27508.1
ModLoad: 000000005e130000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.488) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.488 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.488
ModLoad: 000000003b5b0000 0000000000016000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.20.27508.1) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\1\s\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.20.27508.1 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio® 2017
Product Version : 14.20.27508.1
ModLoad: 000000005fa00000 000000000000b000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.20.27508.1) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\1\s\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.20.27508.1 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio® 2017
Product Version : 14.20.27508.1
ModLoad: 000000005a770000 0000000000045000 E:\Program Files\BOINC\DATA\slots\4\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000fcf40000 00000000030a5000 E:\Program Files\BOINC\DATA\slots\4\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 00000000f3540000 00000000034b2000 E:\Program Files\BOINC\DATA\slots\4\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 0000000059010000 000000001b3a4000 E:\Program Files\BOINC\DATA\slots\4\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 000000005bde0000 0000000000010000 E:\Program Files\BOINC\DATA\slots\4\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 00000000b0a90000 000000000919f000 E:\Program Files\BOINC\DATA\slots\4\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 00000000ef7e0000 0000000003d5b000 E:\Program Files\BOINC\DATA\slots\4\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 000000003e5c0000 000000000020d000 E:\Program Files\BOINC\DATA\slots\4\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 0000000037020000 00000000002db000 E:\Program Files\BOINC\DATA\slots\4\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000fa120000 0000000001eca000 E:\Program Files\BOINC\DATA\slots\4\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 000000004f410000 0000000000040000 E:\Program Files\BOINC\DATA\slots\4\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000065560000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000062180000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000065b60000 0000000000467000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000064800000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000064b00000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000063fc0000 000000000002c000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000647a0000 0000000000060000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.662
ModLoad: 00000000649a0000 000000000015d000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000063e00000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000064c50000 0000000000742000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.329 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.329
ModLoad: 0000000062380000 0000000000795000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000066700000 0000000000356000 C:\WINDOWS\System32\combase.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000063c80000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000065ab0000 00000000000ae000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000065900000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000020fd0000 0000000000267000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.5751) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 27.21.14.5751
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.1.114 driver
Product Version : 27.21.14.5751
ModLoad: 000000005f3b0000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000af560000 000000000152c000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_372920ce6be76248\nvcuda64.dll (27.21.14.5751) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 27.21.14.5751
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.1.114 driver
Product Version : 27.21.14.5751
ModLoad: 00000000662c0000 000000000006b000 C:\WINDOWS\System32\WS2_32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : ws2_32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000005f170000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000063bf0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000061c20000 000000000009e000 C:\WINDOWS\system32\uxtheme.dll (6.2.19041.610) (-exported- Symbols Loaded)
Linked PDB Filename : UxTheme.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000382c0000 00000000006d6000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.5751) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 27.21.14.5751
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 27.21.14.5751
ModLoad: 0000000065430000 000000000012a000 C:\WINDOWS\System32\OLE32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : ole32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000005bdd0000 0000000000009000 E:\Program Files\BOINC\DATA\slots\4\caffe2_nvrtc.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000f7770000 0000000000fca000 E:\Program Files\BOINC\DATA\slots\4\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6.14.11.9000
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.89 NVRTC Library
Product Version : 6.14.11.9000
ModLoad: 0000000064850000 0000000000080000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.662
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 4397, Write: 3148, Other 8412
- I/O Transfers Counters -
Read: 6691267, Write: 1417643, Other 116848
- Paged Pool Usage -
QuotaPagedPoolUsage: 3505360, QuotaPeakPagedPoolUsage: 3506160
QuotaNonPagedPoolUsage: 52560, QuotaPeakNonPagedPoolUsage: 52560
- Virtual Memory Usage -
VirtualSize: -404574208, PeakVirtualSize: 206049280
- Pagefile Usage -
PagefileUsage: -404574208, PeakPagefileUsage: -404574208
- Working Set Size -
WorkingSetSize: 1725603840, PeakWorkingSetSize: 1765498880, PageFaultCount: 636415
*** Dump of thread ID 15452 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 671562496.000000, User Time: 8096249856.000000, Wait Time: 98682872.000000
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FF8644FD759
- Registers -
rax=0000000000000000 rbx=00000000c40a62f0 rcx=0000000000000000 rdx=0000000000000000 rsi=0000000000000116 rdi=000000002f784280
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000000006000 r13=0000000000000000
r14=000000002f784fc0 r15=000000002f784f40 rip=00000000644fd759 rsp=000000002f784110 rbp=000000002f784250
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000206
- Callstack -
ChildEBP RetAddr Args to Child
2f7841e0 3b5b480d 2f784280 00000000 55bb2a4a 00000000 KERNELBASE!RaiseException+0x0
2f784250 bf7f5272 b9c30000 000007cb 77c25f68 2f7842c8 VCRUNTIME140!_CxxThrowException+0x0
2f7842a0 bf7f56d4 00000000 66ae786b c281d290 77c25f68 torch_cpu!at::Tensor::zero_+0x0
2f784b00 771e9ebe 2f784d30 77c26850 77c26880 000002cf torch_cpu!_THError+0x0
2f784b40 771e5412 2f784d30 2f784c90 d87a6750 7805a720 torch_cuda!__THCudaCheck+0x0
2f784b80 bf4a59ff 2f784f00 2f784d30 2f785200 5a7f97b0 torch_cuda!at::native::set_storage_cuda_+0x0
2f784f10 bf64726f 7785f630 bf1fea63 00000001 5a7def8f torch_cpu!at::native::empty_cpu+0x0
2f784f50 bf600615 2f780000 2f784fc8 2f7851c0 5a7c7ce6 torch_cpu!at::native::mkldnn_sigmoid_+0x0
2f784f90 bf60204a 2f780000 2f785000 d877b100 76526ae5 torch_cpu!at::native::mkldnn_sigmoid_+0x0
2f785020 bf600615 00000000 bf1fea63 2f785100 2f785200 torch_cpu!at::native::mkldnn_sigmoid_+0x0
2f785060 bf6d1eb0 2f780000 00000000 2f7851e8 00000001 torch_cpu!at::native::mkldnn_sigmoid_+0x0
2f785100 bf6e2eec 7b165aab 5a7f9c50 2f785260 5a7c3bd6 torch_cpu!at::bucketize_out+0x0
2f785150 768ef160 2f780000 00000000 2f785260 00000000 torch_cpu!at::empty+0x0
2f7854f0 768f2de8 5a7f9c50 bf200528 d96716a0 5a7f9c50 torch_cuda!at::native::cummin_helper_cuda+0x0
2f7856d0 768f4379 2f7857e0 217b2340 2f785be0 217b2358 torch_cuda!at::native::cummin_helper_cuda+0x0
2f785910 768f3d64 2f780000 2f785be0 2f785a20 2f785be0 torch_cuda!at::native::cat_out_cuda+0x0
2f785b10 77191dd2 2f785b68 00000001 2f785b68 2f785be0 torch_cuda!at::native::cat_cuda+0x0
2f785b90 771a4179 00000001 2f785bd0 d966bd38 04000000 torch_cuda!at::native::set_storage_cuda_+0x0
2f785bd0 bf6d1d7d 0f1795f0 2f785f40 2f785f10 00000000 torch_cuda!at::native::set_storage_cuda_+0x0
2f785c50 bf6b0d81 00000000 5a7e3994 2f786420 217ad8e0 torch_cpu!at::bucketize_out+0x0
2f785c90 bf4bb4a5 2f785cd0 d96712a0 2f785da0 2f785e10 torch_cpu!at::_cat+0x0
2f785d60 bf7a27bd 2f785e30 00000101 2f785db8 5a811ea8 torch_cpu!at::native::cat+0x0
2f785de0 bf2629ae 217b2360 217b2370 217b2378 2f785d98 torch_cpu!at::zeros_out+0x0
2f785e20 bf6d1d7d 2f785e60 2f785ed0 00000000 66ae5d21 torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0
2f785ea0 bf6d75d1 2f786440 c4550640 2f786420 217ad8e0 torch_cpu!at::bucketize_out+0x0
2f785ee0 bf4c7d4c 2f786170 00000000 2f786170 00000000 torch_cpu!at::cat+0x0
2f7860a0 bf7bc38d 2f7860f8 00000001 2f7860f8 2f786170 torch_cpu!at::native::stack+0x0
2f786120 bf2629ae 2f786420 217ad8e0 00000000 00000000 torch_cpu!at::zeros_out+0x0
2f786160 bf6d1d7d 2f7861a0 2f786210 00000000 c2471c8f torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0
2f7861e0 bf7202e1 2f786310 5a7e3720 2f786440 c4550640 torch_cpu!at::bucketize_out+0x0
2f786220 c0ab3839 2f7862a0 d966e1d0 d966e1d0 2f786330 torch_cpu!at::stack+0x0
2f7863f0 bf2629ae 00000000 2f786540 00000000 2f7864e0 torch_cpu!torch::autograd::GraphRoot::apply+0x0
2f786430 bf6d1d7d 2f786470 2f7864e0 d9670660 00000000 torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0
2f7864b0 bf7202e1 2f786620 bf1f9cac 1e3e3880 217ad8e0 torch_cpu!at::bucketize_out+0x0
2f7864f0 ecb8ff7e 2f7865b8 217691b0 217691b0 2f786700 torch_cpu!at::stack+0x0
2f786590 ecb92ef8 ecb8fe30 2f7865d0 2f7865d0 2f786620 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::addCallback+0x0
2f7865f0 ecb93ea4 9ace1460 66ae5d21 2f786790 d7ca0000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Object::getSlot+0x0
2f786730 ecb8d3d2 0fbd62f0 21696010 2f786790 66ae95f1 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::markCompleted+0x0
2f786760 ecb94541 00000000 216a6340 0f8ed0d0 66ae95f1 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Object::operator=+0x0
2f786910 ecb9743a 00000000 00000000 2f787420 00000004 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::markCompleted+0x0
2f786e10 ecb9b950 2f786f10 2f786f10 00000000 876a1730 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0
2f79fbb0 ecddc6f8 d96eeb30 00000000 00000000 d968b630 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
2f79fbf0 665f7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
2f79fc20 66b1d0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
2f79fca0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 13368 (state: Waiting): ***
- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 98682872.000000
- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=000000002fbff770 rsi=0000000000000000 rdi=0000000000000064
r8=000000002fbff748 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000066b6c634 rsp=000000002fbff748 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
2fbff740 6451d84e 2fbff808 00000000 00000000 00000000 ntdll!ZwDelayExecution+0x0
2fbff7e0 ecbba07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0
2fbff810 665f7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
2fbff840 66b1d0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
2fbff8c0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 6020 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 98682872.000000
- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=000000002fcffba0 rsi=0000000000000000 rdi=000000000000000d
r8=000000002fcff848 r9=0000000000000000 r10=0000000000000000 r11=000000002fcffb10 r12=0000000000000064 r13=000000002fcffba0
r14=000000002fcff8a0 r15=0000000000000000 rip=0000000066b6cb04 rsp=000000002fcff848 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
2fcff840 64520d40 00000000 2f8d0000 66c3b4d0 2f8d0000 ntdll!NtWaitForMultipleObjects+0x0
2fcffb30 64520c3e d7caf7f0 00700070 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
2fcffb70 af70bb54 d993d1d0 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0
2fcffdb0 af7a09ed 00000000 00000004 00000000 00000000 nvcuda64!+0x0
2fcffe60 af70b523 1058ccf5 0ff9dc41 d9e4f900 00000000 nvcuda64!cuProfilerStop+0x0
2fcffe90 afa1a750 d9e4f900 00000000 00000000 00000000 nvcuda64!+0x0
2fcffec0 665f7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
2fcffef0 66b1d0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
2fcfff70 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 12764 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 98682872.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=0000000000000280 rdx=0000000000000000 rsi=000000002fdff888 rdi=0000000000000280
r8=000000002fdff738 r9=0000000000000007 r10=0000000000000000 r11=0000000000000246 r12=00000000d991adc0 r13=0000000000000000
r14=0000000000000280 r15=0000000000000001 rip=0000000066b6c034 rsp=000000002fdff858 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
2fdff850 644ea34e 00000000 00000000 00000000 00000000 ntdll!NtWaitForSingleObject+0x0
2fdff8f0 af91c0e7 00000000 644f2cb5 00000000 00000280 KERNELBASE!WaitForSingleObjectEx+0x0
2fdff960 af70b523 00000001 da3e6520 d9e4fae0 00000000 nvcuda64!cuProfilerStop+0x0
2fdff990 afa1a750 d9e4fae0 00000000 00000000 00000000 nvcuda64!+0x0
2fdff9c0 665f7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
2fdff9f0 66b1d0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
2fdffa70 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 15588 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 98682864.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000d9b97268 rdx=000000002feff718 rsi=000000002feff680 rdi=0000000000000000
r8=000000002feff658 r9=000000002feff6b0 r10=0000000000000000 r11=0000000000000246 r12=000000002feff718 r13=0000000000000000
r14=00000000d9b97268 r15=00000000d9b9b9e8 rip=0000000066b6f9a4 rsp=000000002feff658 rbp=000000002feff6b0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
2feff650 66b354f5 00000102 00000102 00000000 2feff680 ntdll!NtWaitForAlertByThreadId+0x0
2feff6c0 6453b9d9 d9b991d0 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0
2feff6f0 af69223a d9b991d0 66b1a9f0 d9b991d0 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0
2feff750 af70b523 00000001 1039625a 00000000 00000000 nvcuda64!+0x0
2feff780 afa1a750 d9e4fab0 00000000 00000000 00000000 nvcuda64!+0x0
2feff7b0 665f7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
2feff7e0 66b1d0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
2feff860 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 5936 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 529843744.000000, User Time: 6112500224.000000, Wait Time: 98682872.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=0000000008658948 rdx=0000000000000000 rsi=0000000000000000 rdi=0000000008658948
r8=0000000000000000 r9=0000000000000000 r10=0000000000000102 r11=000000002ffff260 r12=0000000000000000 r13=0000000000000000
r14=000000002ffff790 r15=00000000086588f8 rip=0000000066b6f9a4 rsp=000000002ffff768 rbp=000000002ffff7c0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
2ffff760 66b35281 0f787b98 0f787b98 2ffff8a0 0f787b98 ntdll!NtWaitForAlertByThreadId+0x0
2ffff7e0 6453ba89 086588f0 08658938 00000000 00000000 ntdll!RtlSleepConditionVariableSRW+0x0
2ffff820 3b606980 0fc49120 0fc49120 0fc49120 00000000 KERNELBASE!SleepConditionVariableSRW+0x0
2ffff860 3b5e8d48 1cc5f730 00000000 00000000 c0e105b4 MSVCP140!__crtSetThreadpoolWait+0x0
2ffff890 3b5e8c10 00000000 3b5e90b7 00000000 1cc5f730 MSVCP140!std::_Winerror_message+0x0
2ffff900 c0e1064b 1cc5f710 000001c0 086588f0 086588f0 MSVCP140!std::_Winerror_message+0x0
2ffff940 c0e125b1 21856380 ffffffff 1cc5f710 ffffffff torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
2ffffc30 c0e12471 c4336d10 2ffffc70 c4336d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0
2ffffc80 c0e09744 00080001 217a0fc0 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0
2ffffcb0 642314c2 217a0fc0 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0
2ffffce0 665f7034 00000000 00000000 00000000 00000000 ucrtbase!_configthreadlocale+0x0
2ffffd10 66b1d0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
2ffffd90 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)