Task 14553067
| Name | ParityModified-1647048718-27331-2-0_3 |
| Workunit | 11004458 |
| Created | 9 Apr 2022, 11:12:43 UTC |
| Sent | 9 Apr 2022, 12:01:05 UTC |
| Report deadline | 17 Apr 2022, 12:01:05 UTC |
| Received | 10 Apr 2022, 10:22:56 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 197 (0x000000C5) EXIT_TIME_LIMIT_EXCEEDED |
| Computer ID | 4503 |
| Run time | 6 hours 59 min 54 sec |
| CPU time | 48 min 32 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 10,073.24 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 2.08 GB |
| Peak swap size | 4.37 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
exceeded elapsed time limit 25192.79 (4000000.00G/158.78G)</message>
<stderr_txt>
1615 | val_loss: 0.0311776 | Time: 2299.69 ms
[2022-04-10 03:48:46 main:574] : INFO : Epoch 751 | loss: 0.0311618 | val_loss: 0.031177 | Time: 2372.71 ms
[2022-04-10 03:48:49 main:574] : INFO : Epoch 752 | loss: 0.0311604 | val_loss: 0.0311762 | Time: 2348.07 ms
[2022-04-10 03:48:51 main:574] : INFO : Epoch 753 | loss: 0.0311622 | val_loss: 0.0311817 | Time: 2381.05 ms
[2022-04-10 03:48:53 main:574] : INFO : Epoch 754 | loss: 0.0311641 | val_loss: 0.0311749 | Time: 2414.95 ms
[2022-04-10 03:48:56 main:574] : INFO : Epoch 755 | loss: 0.03116 | val_loss: 0.0311732 | Time: 2281.67 ms
[2022-04-10 03:48:58 main:574] : INFO : Epoch 756 | loss: 0.0311592 | val_loss: 0.0311739 | Time: 2439.85 ms
[2022-04-10 03:49:00 main:574] : INFO : Epoch 757 | loss: 0.0311596 | val_loss: 0.0311752 | Time: 2405 ms
[2022-04-10 03:49:03 main:574] : INFO : Epoch 758 | loss: 0.0311582 | val_loss: 0.0311743 | Time: 2295.38 ms
[2022-04-10 03:49:05 main:574] : INFO : Epoch 759 | loss: 0.0311578 | val_loss: 0.031173 | Time: 2190.46 ms
[2022-04-10 03:49:07 main:574] : INFO : Epoch 760 | loss: 0.0311582 | val_loss: 0.0311736 | Time: 2394.04 ms
[2022-04-10 03:49:10 main:574] : INFO : Epoch 761 | loss: 0.0311621 | val_loss: 0.031173 | Time: 2294.79 ms
[2022-04-10 03:49:12 main:574] : INFO : Epoch 762 | loss: 0.0311595 | val_loss: 0.0311754 | Time: 2371.31 ms
[2022-04-10 03:49:14 main:574] : INFO : Epoch 763 | loss: 0.0311606 | val_loss: 0.031173 | Time: 2400.97 ms
[2022-04-10 03:49:17 main:574] : INFO : Epoch 764 | loss: 0.0311612 | val_loss: 0.0311773 | Time: 2358.03 ms
[2022-04-10 03:49:19 main:574] : INFO : Epoch 765 | loss: 0.0311633 | val_loss: 0.0311817 | Time: 2437.35 ms
[2022-04-10 03:49:22 main:574] : INFO : Epoch 766 | loss: 0.0311633 | val_loss: 0.0311742 | Time: 2406.64 ms
[2022-04-10 03:49:24 main:574] : INFO : Epoch 767 | loss: 0.0311656 | val_loss: 0.0311724 | Time: 2458.09 ms
[2022-04-10 03:49:26 main:574] : INFO : Epoch 768 | loss: 0.0311638 | val_loss: 0.0311735 | Time: 2334.55 ms
[2022-04-10 03:49:29 main:574] : INFO : Epoch 769 | loss: 0.0311642 | val_loss: 0.0311759 | Time: 2321.16 ms
[2022-04-10 03:49:31 main:574] : INFO : Epoch 770 | loss: 0.0311672 | val_loss: 0.0311758 | Time: 2318.28 ms
[2022-04-10 03:49:33 main:574] : INFO : Epoch 771 | loss: 0.0311676 | val_loss: 0.0311786 | Time: 2334.11 ms
[2022-04-10 03:49:36 main:574] : INFO : Epoch 772 | loss: 0.0311668 | val_loss: 0.0311704 | Time: 2405.59 ms
[2022-04-10 03:49:38 main:574] : INFO : Epoch 773 | loss: 0.031168 | val_loss: 0.0311791 | Time: 2352.3 ms
[2022-04-10 03:49:40 main:574] : INFO : Epoch 774 | loss: 0.0311715 | val_loss: 0.0311788 | Time: 2230.33 ms
[2022-04-10 03:49:42 main:574] : INFO : Epoch 775 | loss: 0.0311727 | val_loss: 0.0311779 | Time: 2027.32 ms
[2022-04-10 03:49:44 main:574] : INFO : Epoch 776 | loss: 0.0311724 | val_loss: 0.0311751 | Time: 1999.68 ms
[2022-04-10 03:49:47 main:574] : INFO : Epoch 777 | loss: 0.0311708 | val_loss: 0.0311776 | Time: 2096.84 ms
[2022-04-10 03:49:49 main:574] : INFO : Epoch 778 | loss: 0.031171 | val_loss: 0.0311749 | Time: 2059.13 ms
[2022-04-10 03:49:51 main:574] : INFO : Epoch 779 | loss: 0.0311692 | val_loss: 0.0311733 | Time: 1998.91 ms
[2022-04-10 03:49:53 main:574] : INFO : Epoch 780 | loss: 0.0311663 | val_loss: 0.0311724 | Time: 1997.82 ms
[2022-04-10 03:49:55 main:574] : INFO : Epoch 781 | loss: 0.0311659 | val_loss: 0.0311726 | Time: 2094.92 ms
[2022-04-10 03:49:57 main:574] : INFO : Epoch 782 | loss: 0.0311675 | val_loss: 0.0311787 | Time: 2091.76 ms
[2022-04-10 03:49:59 main:574] : INFO : Epoch 783 | loss: 0.0311673 | val_loss: 0.031171 | Time: 2075.94 ms
[2022-04-10 03:50:01 main:574] : INFO : Epoch 784 | loss: 0.0311656 | val_loss: 0.0311693 | Time: 2081.96 ms
[2022-04-10 03:50:03 main:574] : INFO : Epoch 785 | loss: 0.0311676 | val_loss: 0.0311715 | Time: 2055.5 ms
[2022-04-10 03:50:05 main:574] : INFO : Epoch 786 | loss: 0.0311633 | val_loss: 0.0311712 | Time: 2045.97 ms
[2022-04-10 03:50:07 main:574] : INFO : Epoch 787 | loss: 0.0311624 | val_loss: 0.031169 | Time: 2053.17 ms
[2022-04-10 03:50:09 main:574] : INFO : Epoch 788 | loss: 0.0311621 | val_loss: 0.0311715 | Time: 2174.11 ms
[2022-04-10 03:50:11 main:574] : INFO : Epoch 789 | loss: 0.0311613 | val_loss: 0.0311694 | Time: 1985.01 ms
[2022-04-10 03:50:13 main:574] : INFO : Epoch 790 | loss: 0.0311618 | val_loss: 0.0311697 | Time: 2068.2 ms
[2022-04-10 03:50:15 main:574] : INFO : Epoch 791 | loss: 0.0311623 | val_loss: 0.0311718 | Time: 2022.46 ms
[2022-04-10 03:50:17 main:574] : INFO : Epoch 792 | loss: 0.0311628 | val_loss: 0.0311721 | Time: 2006.6 ms
[2022-04-10 03:50:20 main:574] : INFO : Epoch 793 | loss: 0.0311639 | val_loss: 0.0311734 | Time: 2077.9 ms
[2022-04-10 03:50:22 main:574] : INFO : Epoch 794 | loss: 0.0311646 | val_loss: 0.0311726 | Time: 2033.66 ms
[2022-04-10 03:50:24 main:574] : INFO : Epoch 795 | loss: 0.0311652 | val_loss: 0.0311714 | Time: 2078.42 ms
[2022-04-10 03:50:26 main:574] : INFO : Epoch 796 | loss: 0.0311647 | val_loss: 0.0311723 | Time: 1975.49 ms
[2022-04-10 03:50:28 main:574] : INFO : Epoch 797 | loss: 0.0311644 | val_loss: 0.0311712 | Time: 2034.21 ms
[2022-04-10 03:50:30 main:574] : INFO : Epoch 798 | loss: 0.0311646 | val_loss: 0.0311707 | Time: 2026.59 ms
[2022-04-10 03:50:32 main:574] : INFO : Epoch 799 | loss: 0.0311629 | val_loss: 0.031172 | Time: 2104.13 ms
[2022-04-10 03:50:34 main:574] : INFO : Epoch 800 | loss: 0.0311615 | val_loss: 0.0311728 | Time: 2013.54 ms
[2022-04-10 03:50:36 main:574] : INFO : Epoch 801 | loss: 0.0311613 | val_loss: 0.0311758 | Time: 1985.54 ms
[2022-04-10 03:50:38 main:574] : INFO : Epoch 802 | loss: 0.0311658 | val_loss: 0.0311734 | Time: 2016.72 ms
[2022-04-10 03:50:50 main:574] : INFO : Epoch 803 | loss: 0.0311624 | val_loss: 0.0311697 | Time: 12047.3 ms
[2022-04-10 03:50:52 main:574] : INFO : Epoch 804 | loss: 0.0311601 | val_loss: 0.0311727 | Time: 1965.91 ms
[2022-04-10 03:50:54 main:574] : INFO : Epoch 805 | loss: 0.0311595 | val_loss: 0.03117 | Time: 2065.11 ms
[2022-04-10 03:50:56 main:574] : INFO : Epoch 806 | loss: 0.0311623 | val_loss: 0.0311762 | Time: 1941.74 ms
[2022-04-10 03:50:58 main:574] : INFO : Epoch 807 | loss: 0.0311631 | val_loss: 0.0311712 | Time: 2054.68 ms
[2022-04-10 03:51:00 main:574] : INFO : Epoch 808 | loss: 0.0311625 | val_loss: 0.0311691 | Time: 1992.44 ms
[2022-04-10 03:51:02 main:574] : INFO : Epoch 809 | loss: 0.0311614 | val_loss: 0.0311712 | Time: 1963.19 ms
[2022-04-10 03:51:04 main:574] : INFO : Epoch 810 | loss: 0.0311617 | val_loss: 0.0311742 | Time: 1997.75 ms
[2022-04-10 03:51:06 main:574] : INFO : Epoch 811 | loss: 0.0311612 | val_loss: 0.0311784 | Time: 2016.91 ms
[2022-04-10 03:51:08 main:574] : INFO : Epoch 812 | loss: 0.0311714 | val_loss: 0.0311732 | Time: 1956.66 ms
[2022-04-10 03:51:10 main:574] : INFO : Epoch 813 | loss: 0.0311731 | val_loss: 0.0311735 | Time: 2120.6 ms
[2022-04-10 03:51:12 main:574] : INFO : Epoch 814 | loss: 0.0311662 | val_loss: 0.0311718 | Time: 2026.9 ms
[2022-04-10 03:51:14 main:574] : INFO : Epoch 815 | loss: 0.0311648 | val_loss: 0.0311712 | Time: 2056.21 ms
[2022-04-10 03:51:16 main:574] : INFO : Epoch 816 | loss: 0.0311654 | val_loss: 0.031173 | Time: 2071.14 ms
[2022-04-10 03:51:18 main:574] : INFO : Epoch 817 | loss: 0.031166 | val_loss: 0.0311734 | Time: 2052.3 ms
[2022-04-10 03:51:20 main:574] : INFO : Epoch 818 | loss: 0.0311665 | val_loss: 0.03117 | Time: 2042.45 ms
[2022-04-10 03:51:22 main:574] : INFO : Epoch 819 | loss: 0.0311642 | val_loss: 0.031171 | Time: 2000.93 ms
[2022-04-10 03:51:24 main:574] : INFO : Epoch 820 | loss: 0.031167 | val_loss: 0.0311757 | Time: 2031.33 ms
[2022-04-10 03:51:27 main:574] : INFO : Epoch 821 | loss: 0.0311672 | val_loss: 0.031172 | Time: 2089.66 ms
[2022-04-10 03:51:29 main:574] : INFO : Epoch 822 | loss: 0.0311676 | val_loss: 0.0311697 | Time: 1997.06 ms
[2022-04-10 03:51:31 main:574] : INFO : Epoch 823 | loss: 0.0311668 | val_loss: 0.0311682 | Time: 2045.21 ms
[2022-04-10 03:51:33 main:574] : INFO : Epoch 824 | loss: 0.0311661 | val_loss: 0.0311705 | Time: 2006.96 ms
[2022-04-10 03:51:35 main:574] : INFO : Epoch 825 | loss: 0.0311647 | val_loss: 0.031169 | Time: 1976.35 ms
[2022-04-10 03:51:37 main:574] : INFO : Epoch 826 | loss: 0.0311628 | val_loss: 0.0311682 | Time: 2004.57 ms
[2022-04-10 03:51:39 main:574] : INFO : Epoch 827 | loss: 0.0311614 | val_loss: 0.0311676 | Time: 2003.25 ms
[2022-04-10 03:51:41 main:574] : INFO : Epoch 828 | loss: 0.0311607 | val_loss: 0.0311772 | Time: 2094.56 ms
[2022-04-10 03:51:43 main:574] : INFO : Epoch 829 | loss: 0.0311638 | val_loss: 0.0311777 | Time: 2044.74 ms
[2022-04-10 03:51:45 main:574] : INFO : Epoch 830 | loss: 0.0311702 | val_loss: 0.0311764 | Time: 1963.52 ms
[2022-04-10 03:51:47 main:574] : INFO : Epoch 831 | loss: 0.0311752 | val_loss: 0.0311727 | Time: 2042.2 ms
[2022-04-10 03:51:49 main:574] : INFO : Epoch 832 | loss: 0.0311739 | val_loss: 0.0311723 | Time: 2047.56 ms
[2022-04-10 03:51:51 main:574] : INFO : Epoch 833 | loss: 0.0311727 | val_loss: 0.0311743 | Time: 2025.53 ms
[2022-04-10 03:51:53 main:574] : INFO : Epoch 834 | loss: 0.0311742 | val_loss: 0.0311768 | Time: 2076.87 ms
[2022-04-10 03:51:55 main:574] : INFO : Epoch 835 | loss: 0.0311747 | val_loss: 0.0311699 | Time: 1990.97 ms
[2022-04-10 03:51:57 main:574] : INFO : Epoch 836 | loss: 0.0311712 | val_loss: 0.0311701 | Time: 2000.82 ms
[2022-04-10 03:51:59 main:574] : INFO : Epoch 837 | loss: 0.0311683 | val_loss: 0.0311699 | Time: 2005.87 ms
[2022-04-10 03:52:01 main:574] : INFO : Epoch 838 | loss: 0.0311673 | val_loss: 0.0311698 | Time: 2107.58 ms
[2022-04-10 03:52:03 main:574] : INFO : Epoch 839 | loss: 0.031167 | val_loss: 0.0311708 | Time: 2039.19 ms
[2022-04-10 03:52:05 main:574] : INFO : Epoch 840 | loss: 0.0311659 | val_loss: 0.0311702 | Time: 2108.99 ms
[2022-04-10 03:52:07 main:574] : INFO : Epoch 841 | loss: 0.0311663 | val_loss: 0.0311714 | Time: 2007.52 ms
[2022-04-10 03:52:09 main:574] : INFO : Epoch 842 | loss: 0.0311691 | val_loss: 0.0311736 | Time: 1974.4 ms
[2022-04-10 03:52:11 main:574] : INFO : Epoch 843 | loss: 0.0311679 | val_loss: 0.0311705 | Time: 2000.11 ms
[2022-04-10 03:52:13 main:574] : INFO : Epoch 844 | loss: 0.031166 | val_loss: 0.0311718 | Time: 2047.45 ms
[2022-04-10 03:52:15 main:574] : INFO : Epoch 845 | loss: 0.0311657 | val_loss: 0.0311706 | Time: 2051.42 ms
[2022-04-10 03:52:17 main:574] : INFO : Epoch 846 | loss: 0.0311653 | val_loss: 0.0311704 | Time: 2032.79 ms
[2022-04-10 03:52:19 main:574] : INFO : Epoch 847 | loss: 0.0311642 | val_loss: 0.0311695 | Time: 2014.73 ms
[2022-04-10 03:52:21 main:574] : INFO : Epoch 848 | loss: 0.0311652 | val_loss: 0.0311767 | Time: 2036.06 ms
[2022-04-10 03:52:24 main:574] : INFO : Epoch 849 | loss: 0.0311663 | val_loss: 0.0311722 | Time: 2036.57 ms
[2022-04-10 03:52:26 main:574] : INFO : Epoch 850 | loss: 0.0311661 | val_loss: 0.031171 | Time: 2015.62 ms
[2022-04-10 03:52:28 main:574] : INFO : Epoch 851 | loss: 0.0311629 | val_loss: 0.0311709 | Time: 2079.62 ms
[2022-04-10 03:52:30 main:574] : INFO : Epoch 852 | loss: 0.0311635 | val_loss: 0.0311697 | Time: 2070.31 ms
[2022-04-10 03:52:32 main:574] : INFO : Epoch 853 | loss: 0.0311642 | val_loss: 0.031171 | Time: 2087.37 ms
[2022-04-10 03:52:34 main:574] : INFO : Epoch 854 | loss: 0.0311637 | val_loss: 0.0311702 | Time: 2089.14 ms
[2022-04-10 03:52:36 main:574] : INFO : Epoch 855 | loss: 0.031163 | val_loss: 0.0311723 | Time: 1989.98 ms
[2022-04-10 03:52:38 main:574] : INFO : Epoch 856 | loss: 0.0311649 | val_loss: 0.0311704 | Time: 2039.72 ms
[2022-04-10 03:52:40 main:574] : INFO : Epoch 857 | loss: 0.031162 | val_loss: 0.0311733 | Time: 2067.43 ms
[2022-04-10 03:52:42 main:574] : INFO : Epoch 858 | loss: 0.0311622 | val_loss: 0.031169 | Time: 2033.95 ms
[2022-04-10 03:52:44 main:574] : INFO : Epoch 859 | loss: 0.0311614 | val_loss: 0.03117 | Time: 2136.81 ms
[2022-04-10 03:52:46 main:574] : INFO : Epoch 860 | loss: 0.0311634 | val_loss: 0.0311701 | Time: 2078.85 ms
[2022-04-10 03:52:48 main:574] : INFO : Epoch 861 | loss: 0.0311624 | val_loss: 0.0311694 | Time: 2023.1 ms
[2022-04-10 03:52:50 main:574] : INFO : Epoch 862 | loss: 0.03116 | val_loss: 0.0311699 | Time: 2051.87 ms
[2022-04-10 03:52:52 main:574] : INFO : Epoch 863 | loss: 0.0311596 | val_loss: 0.0311688 | Time: 1973.36 ms
[2022-04-10 03:52:54 main:574] : INFO : Epoch 864 | loss: 0.0311602 | val_loss: 0.0311704 | Time: 2025.89 ms
[2022-04-10 03:52:56 main:574] : INFO : Epoch 865 | loss: 0.0311625 | val_loss: 0.0311698 | Time: 2051.18 ms
[2022-04-10 03:52:59 main:574] : INFO : Epoch 866 | loss: 0.0311614 | val_loss: 0.0311733 | Time: 2047.66 ms
[2022-04-10 03:53:01 main:574] : INFO : Epoch 867 | loss: 0.0311607 | val_loss: 0.0311709 | Time: 2058.6 ms
[2022-04-10 03:53:03 main:574] : INFO : Epoch 868 | loss: 0.0311601 | val_loss: 0.0311685 | Time: 2105.45 ms
[2022-04-10 03:53:05 main:574] : INFO : Epoch 869 | loss: 0.0311613 | val_loss: 0.0311734 | Time: 2044.31 ms
[2022-04-10 03:53:07 main:574] : INFO : Epoch 870 | loss: 0.0311597 | val_loss: 0.0311711 | Time: 2079.01 ms
[2022-04-10 03:53:09 main:574] : INFO : Epoch 871 | loss: 0.0311592 | val_loss: 0.0311695 | Time: 2007.37 ms
[2022-04-10 03:53:11 main:574] : INFO : Epoch 872 | loss: 0.0311585 | val_loss: 0.0311787 | Time: 1999.36 ms
[2022-04-10 03:53:13 main:574] : INFO : Epoch 873 | loss: 0.0311604 | val_loss: 0.0311709 | Time: 2053.64 ms
[2022-04-10 03:53:15 main:574] : INFO : Epoch 874 | loss: 0.0311589 | val_loss: 0.0311732 | Time: 2071.82 ms
[2022-04-10 03:53:17 main:574] : INFO : Epoch 875 | loss: 0.0311589 | val_loss: 0.0311705 | Time: 2038.29 ms
[2022-04-10 03:53:19 main:574] : INFO : Epoch 876 | loss: 0.0311601 | val_loss: 0.0311703 | Time: 2022.44 ms
[2022-04-10 03:53:21 main:574] : INFO : Epoch 877 | loss: 0.0311619 | val_loss: 0.0311695 | Time: 2002.31 ms
[2022-04-10 03:53:23 main:574] : INFO : Epoch 878 | loss: 0.0311599 | val_loss: 0.0311704 | Time: 2021.8 ms
[2022-04-10 03:53:25 main:574] : INFO : Epoch 879 | loss: 0.0311585 | val_loss: 0.0311711 | Time: 2042.11 ms
[2022-04-10 03:53:27 main:574] : INFO : Epoch 880 | loss: 0.0311576 | val_loss: 0.0311689 | Time: 2125.31 ms
[2022-04-10 03:53:29 main:574] : INFO : Epoch 881 | loss: 0.0311581 | val_loss: 0.0311699 | Time: 2058.5 ms
[2022-04-10 03:53:31 main:574] : INFO : Epoch 882 | loss: 0.0311586 | val_loss: 0.0311705 | Time: 2084.63 ms
[2022-04-10 03:53:33 main:574] : INFO : Epoch 883 | loss: 0.0311571 | val_loss: 0.0311687 | Time: 2029.89 ms
[2022-04-10 03:53:36 main:574] : INFO : Epoch 884 | loss: 0.0311575 | val_loss: 0.0311688 | Time: 2053.46 ms
[2022-04-10 03:53:38 main:574] : INFO : Epoch 885 | loss: 0.0311589 | val_loss: 0.0311695 | Time: 2018.58 ms
[2022-04-10 03:53:40 main:574] : INFO : Epoch 886 | loss: 0.0311555 | val_loss: 0.0311697 | Time: 1913.64 ms
[2022-04-10 03:53:42 main:574] : INFO : Epoch 887 | loss: 0.031156 | val_loss: 0.0311712 | Time: 2035.52 ms
[2022-04-10 03:53:44 main:574] : INFO : Epoch 888 | loss: 0.0311575 | val_loss: 0.0311696 | Time: 2083.01 ms
[2022-04-10 03:53:46 main:574] : INFO : Epoch 889 | loss: 0.0311581 | val_loss: 0.0311706 | Time: 2027.82 ms
[2022-04-10 03:53:48 main:574] : INFO : Epoch 890 | loss: 0.0311558 | val_loss: 0.0311703 | Time: 1998.6 ms
[2022-04-10 03:53:50 main:574] : INFO : Epoch 891 | loss: 0.031157 | val_loss: 0.031169 | Time: 2044.09 ms
[2022-04-10 03:53:52 main:574] : INFO : Epoch 892 | loss: 0.0311556 | val_loss: 0.0311736 | Time: 1995.78 ms
[2022-04-10 03:53:54 main:574] : INFO : Epoch 893 | loss: 0.0311582 | val_loss: 0.0311721 | Time: 2091.07 ms
[2022-04-10 03:53:56 main:574] : INFO : Epoch 894 | loss: 0.0311547 | val_loss: 0.03117 | Time: 1990.33 ms
[2022-04-10 03:53:58 main:574] : INFO : Epoch 895 | loss: 0.0311539 | val_loss: 0.0311714 | Time: 1982.11 ms
[2022-04-10 03:54:00 main:574] : INFO : Epoch 896 | loss: 0.0311545 | val_loss: 0.0311694 | Time: 2068.53 ms
[2022-04-10 03:54:02 main:574] : INFO : Epoch 897 | loss: 0.0311558 | val_loss: 0.0311713 | Time: 2067.94 ms
[2022-04-10 03:54:04 main:574] : INFO : Epoch 898 | loss: 0.0311567 | val_loss: 0.0311719 | Time: 2017.22 ms
[2022-04-10 03:54:06 main:574] : INFO : Epoch 899 | loss: 0.0311581 | val_loss: 0.0311704 | Time: 2117.18 ms
[2022-04-10 03:54:08 main:574] : INFO : Epoch 900 | loss: 0.0311582 | val_loss: 0.0311738 | Time: 2066.22 ms
[2022-04-10 03:54:10 main:574] : INFO : Epoch 901 | loss: 0.0311588 | val_loss: 0.0311713 | Time: 2034.15 ms
[2022-04-10 03:54:22 main:574] : INFO : Epoch 902 | loss: 0.0311571 | val_loss: 0.0311691 | Time: 12023.6 ms
[2022-04-10 03:54:24 main:574] : INFO : Epoch 903 | loss: 0.0311552 | val_loss: 0.0311707 | Time: 1981.64 ms
[2022-04-10 03:54:26 main:574] : INFO : Epoch 904 | loss: 0.0311546 | val_loss: 0.0311736 | Time: 1923.13 ms
[2022-04-10 03:54:28 main:574] : INFO : Epoch 905 | loss: 0.0311571 | val_loss: 0.0311688 | Time: 1909.53 ms
[2022-04-10 03:54:30 main:574] : INFO : Epoch 906 | loss: 0.0311549 | val_loss: 0.0311713 | Time: 1844.83 ms
[2022-04-10 03:54:32 main:574] : INFO : Epoch 907 | loss: 0.0311552 | val_loss: 0.0311684 | Time: 1976.27 ms
[2022-04-10 03:54:34 main:574] : INFO : Epoch 908 | loss: 0.0311559 | val_loss: 0.0311748 | Time: 2007.56 ms
[2022-04-10 03:54:36 main:574] : INFO : Epoch 909 | loss: 0.0311592 | val_loss: 0.0311698 | Time: 2015.48 ms
[2022-04-10 03:54:38 main:574] : INFO : Epoch 910 | loss: 0.0311562 | val_loss: 0.0311744 | Time: 2037.07 ms
[2022-04-10 03:54:40 main:574] : INFO : Epoch 911 | loss: 0.0311552 | val_loss: 0.0311699 | Time: 2017.53 ms
[2022-04-10 03:54:42 main:574] : INFO : Epoch 912 | loss: 0.0311532 | val_loss: 0.0311786 | Time: 1929.25 ms
[2022-04-10 03:54:44 main:574] : INFO : Epoch 913 | loss: 0.0311547 | val_loss: 0.031173 | Time: 2009.02 ms
[2022-04-10 03:54:46 main:574] : INFO : Epoch 914 | loss: 0.0311578 | val_loss: 0.0311739 | Time: 2055.12 ms
[2022-04-10 03:54:48 main:574] : INFO : Epoch 915 | loss: 0.0311578 | val_loss: 0.0311741 | Time: 1980.81 ms
[2022-04-10 03:54:50 main:574] : INFO : Epoch 916 | loss: 0.0311554 | val_loss: 0.0311704 | Time: 2064.31 ms
[2022-04-10 03:54:52 main:574] : INFO : Epoch 917 | loss: 0.0311591 | val_loss: 0.03117 | Time: 1971.77 ms
[2022-04-10 03:54:54 main:574] : INFO : Epoch 918 | loss: 0.0311579 | val_loss: 0.0311713 | Time: 2011.16 ms
[2022-04-10 03:54:56 main:574] : INFO : Epoch 919 | loss: 0.0311588 | val_loss: 0.0311725 | Time: 2036.09 ms
[2022-04-10 03:54:58 main:574] : INFO : Epoch 920 | loss: 0.0311584 | val_loss: 0.0311698 | Time: 2001.92 ms
[2022-04-10 03:55:00 main:574] : INFO : Epoch 921 | loss: 0.0311584 | val_loss: 0.0311705 | Time: 2043.45 ms
[2022-04-10 03:55:02 main:574] : INFO : Epoch 922 | loss: 0.0311578 | val_loss: 0.0311718 | Time: 2072.3 ms
[2022-04-10 03:55:04 main:574] : INFO : Epoch 923 | loss: 0.0311567 | val_loss: 0.0311695 | Time: 1999.42 ms
[2022-04-10 03:55:06 main:574] : INFO : Epoch 924 | loss: 0.0311584 | val_loss: 0.031171 | Time: 2086.49 ms
[2022-04-10 03:55:08 main:574] : INFO : Epoch 925 | loss: 0.0311601 | val_loss: 0.0311702 | Time: 2003.61 ms
[2022-04-10 03:55:10 main:574] : INFO : Epoch 926 | loss: 0.0311588 | val_loss: 0.0311736 | Time: 1967.61 ms
[2022-04-10 03:55:12 main:574] : INFO : Epoch 927 | loss: 0.0311566 | val_loss: 0.0311713 | Time: 2004.56 ms
[2022-04-10 03:55:15 main:574] : INFO : Epoch 928 | loss: 0.0311569 | val_loss: 0.0311689 | Time: 2093.6 ms
[2022-04-10 03:55:17 main:574] : INFO : Epoch 929 | loss: 0.0311568 | val_loss: 0.0311682 | Time: 2050.08 ms
[2022-04-10 03:55:19 main:574] : INFO : Epoch 930 | loss: 0.0311554 | val_loss: 0.0311698 | Time: 1949.28 ms
[2022-04-10 03:55:21 main:574] : INFO : Epoch 931 | loss: 0.0311547 | val_loss: 0.0311694 | Time: 2016.41 ms
[2022-04-10 03:55:23 main:574] : INFO : Epoch 932 | loss: 0.0311556 | val_loss: 0.0311695 | Time: 2057.73 ms
[2022-04-10 03:55:25 main:574] : INFO : Epoch 933 | loss: 0.0311547 | val_loss: 0.0311702 | Time: 2020.53 ms
[2022-04-10 03:55:27 main:574] : INFO : Epoch 934 | loss: 0.0311575 | val_loss: 0.0311704 | Time: 2013.43 ms
[2022-04-10 03:55:29 main:574] : INFO : Epoch 935 | loss: 0.0311569 | val_loss: 0.0311713 | Time: 2009.09 ms
[2022-04-10 03:55:31 main:574] : INFO : Epoch 936 | loss: 0.0311558 | val_loss: 0.0311695 | Time: 2004.99 ms
[2022-04-10 03:55:33 main:574] : INFO : Epoch 937 | loss: 0.0311555 | val_loss: 0.0311717 | Time: 2042.4 ms
[2022-04-10 03:55:35 main:574] : INFO : Epoch 938 | loss: 0.0311562 | val_loss: 0.0311725 | Time: 2054.49 ms
[2022-04-10 03:55:37 main:574] : INFO : Epoch 939 | loss: 0.0311612 | val_loss: 0.0311728 | Time: 2049.67 ms
[2022-04-10 03:55:39 main:574] : INFO : Epoch 940 | loss: 0.0311601 | val_loss: 0.0311851 | Time: 2066.27 ms
[2022-04-10 03:55:41 main:574] : INFO : Epoch 941 | loss: 0.0311597 | val_loss: 0.0311701 | Time: 2023.97 ms
[2022-04-10 03:55:43 main:574] : INFO : Epoch 942 | loss: 0.0311568 | val_loss: 0.0311717 | Time: 2063.31 ms
[2022-04-10 03:55:45 main:574] : INFO : Epoch 943 | loss: 0.0311582 | val_loss: 0.0311725 | Time: 2040.81 ms
[2022-04-10 03:55:47 main:574] : INFO : Epoch 944 | loss: 0.0311596 | val_loss: 0.0311708 | Time: 2074.7 ms
[2022-04-10 03:55:49 main:574] : INFO : Epoch 945 | loss: 0.0311603 | val_loss: 0.0311808 | Time: 2026.17 ms
[2022-04-10 03:55:51 main:574] : INFO : Epoch 946 | loss: 0.0311655 | val_loss: 0.031178 | Time: 1992.78 ms
[2022-04-10 03:55:53 main:574] : INFO : Epoch 947 | loss: 0.0311601 | val_loss: 0.0311761 | Time: 2055.42 ms
[2022-04-10 03:55:55 main:574] : INFO : Epoch 948 | loss: 0.0311576 | val_loss: 0.0311734 | Time: 2001.19 ms
[2022-04-10 03:55:57 main:574] : INFO : Epoch 949 | loss: 0.0311578 | val_loss: 0.0311717 | Time: 2046.96 ms
[2022-04-10 03:55:59 main:574] : INFO : Epoch 950 | loss: 0.0311579 | val_loss: 0.0311711 | Time: 2029.4 ms
[2022-04-10 03:56:02 main:574] : INFO : Epoch 951 | loss: 0.0311576 | val_loss: 0.0311711 | Time: 2132.74 ms
[2022-04-10 03:56:13 main:574] : INFO : Epoch 952 | loss: 0.0311573 | val_loss: 0.0311773 | Time: 11971 ms
[2022-04-10 03:56:15 main:574] : INFO : Epoch 953 | loss: 0.0311564 | val_loss: 0.0311706 | Time: 1948.52 ms
[2022-04-10 03:56:17 main:574] : INFO : Epoch 954 | loss: 0.0311547 | val_loss: 0.0311714 | Time: 1977.45 ms
[2022-04-10 03:56:19 main:574] : INFO : Epoch 955 | loss: 0.0311541 | val_loss: 0.0311718 | Time: 1947.95 ms
[2022-04-10 03:56:21 main:574] : INFO : Epoch 956 | loss: 0.0311563 | val_loss: 0.0311717 | Time: 1987.64 ms
[2022-04-10 03:56:23 main:574] : INFO : Epoch 957 | loss: 0.0311565 | val_loss: 0.0311697 | Time: 1950.1 ms
[2022-04-10 03:56:25 main:574] : INFO : Epoch 958 | loss: 0.0311564 | val_loss: 0.0311685 | Time: 2084.67 ms
[2022-04-10 03:56:27 main:574] : INFO : Epoch 959 | loss: 0.0311603 | val_loss: 0.03117 | Time: 1941.41 ms
[2022-04-10 03:56:29 main:574] : INFO : Epoch 960 | loss: 0.0311546 | val_loss: 0.0311703 | Time: 1950.58 ms
[2022-04-10 03:56:31 main:574] : INFO : Epoch 961 | loss: 0.0311546 | val_loss: 0.0311688 | Time: 1972.07 ms
[2022-04-10 03:56:33 main:574] : INFO : Epoch 962 | loss: 0.0311608 | val_loss: 0.0311746 | Time: 2040.59 ms
[2022-04-10 03:56:35 main:574] : INFO : Epoch 963 | loss: 0.0311629 | val_loss: 0.0311688 | Time: 1935.54 ms
[2022-04-10 03:56:37 main:574] : INFO : Epoch 964 | loss: 0.0311602 | val_loss: 0.0311691 | Time: 2080.5 ms
[2022-04-10 03:56:39 main:574] : INFO : Epoch 965 | loss: 0.0311591 | val_loss: 0.0311666 | Time: 2089.93 ms
[2022-04-10 03:56:42 main:574] : INFO : Epoch 966 | loss: 0.0311583 | val_loss: 0.0311699 | Time: 2061.6 ms
[2022-04-10 03:56:44 main:574] : INFO : Epoch 967 | loss: 0.0311587 | val_loss: 0.031169 | Time: 2047.32 ms
[2022-04-10 03:56:46 main:574] : INFO : Epoch 968 | loss: 0.0311566 | val_loss: 0.0311696 | Time: 2072.8 ms
[2022-04-10 03:56:48 main:574] : INFO : Epoch 969 | loss: 0.0311562 | val_loss: 0.0311677 | Time: 2001.33 ms
[2022-04-10 03:56:50 main:574] : INFO : Epoch 970 | loss: 0.0311544 | val_loss: 0.0311679 | Time: 2052.7 ms
[2022-04-10 03:56:52 main:574] : INFO : Epoch 971 | loss: 0.0311537 | val_loss: 0.0311683 | Time: 2004.04 ms
[2022-04-10 03:56:54 main:574] : INFO : Epoch 972 | loss: 0.0311542 | val_loss: 0.0311675 | Time: 1952.27 ms
[2022-04-10 03:56:56 main:574] : INFO : Epoch 973 | loss: 0.0311588 | val_loss: 0.0311775 | Time: 2146.04 ms
[2022-04-10 03:56:58 main:574] : INFO : Epoch 974 | loss: 0.0311601 | val_loss: 0.0311713 | Time: 2034.84 ms
[2022-04-10 03:57:00 main:574] : INFO : Epoch 975 | loss: 0.0311603 | val_loss: 0.0311687 | Time: 2087.27 ms
[2022-04-10 03:57:02 main:574] : INFO : Epoch 976 | loss: 0.0311619 | val_loss: 0.0311725 | Time: 2030.45 ms
[2022-04-10 03:57:04 main:574] : INFO : Epoch 977 | loss: 0.0311608 | val_loss: 0.031169 | Time: 2020.14 ms
[2022-04-10 03:57:06 main:574] : INFO : Epoch 978 | loss: 0.0311575 | val_loss: 0.0311675 | Time: 2060.49 ms
[2022-04-10 03:57:08 main:574] : INFO : Epoch 979 | loss: 0.031158 | val_loss: 0.0311714 | Time: 1972.87 ms
[2022-04-10 03:57:10 main:574] : INFO : Epoch 980 | loss: 0.0311606 | val_loss: 0.0311717 | Time: 2028.63 ms
[2022-04-10 03:57:12 main:574] : INFO : Epoch 981 | loss: 0.0311614 | val_loss: 0.031172 | Time: 2207.35 ms
[2022-04-10 03:57:14 main:574] : INFO : Epoch 982 | loss: 0.0311651 | val_loss: 0.0311725 | Time: 2086.18 ms
[2022-04-10 03:57:16 main:574] : INFO : Epoch 983 | loss: 0.0311695 | val_loss: 0.0311807 | Time: 1996.37 ms
[2022-04-10 03:57:18 main:574] : INFO : Epoch 984 | loss: 0.0311817 | val_loss: 0.0311953 | Time: 2055.77 ms
[2022-04-10 03:57:21 main:574] : INFO : Epoch 985 | loss: 0.0311908 | val_loss: 0.0311886 | Time: 2085.78 ms
[2022-04-10 03:57:23 main:574] : INFO : Epoch 986 | loss: 0.0311878 | val_loss: 0.0311822 | Time: 2111.59 ms
[2022-04-10 03:57:25 main:574] : INFO : Epoch 987 | loss: 0.0311837 | val_loss: 0.0311812 | Time: 2032.79 ms
[2022-04-10 03:57:27 main:574] : INFO : Epoch 988 | loss: 0.0311827 | val_loss: 0.0311786 | Time: 2085.7 ms
[2022-04-10 03:57:29 main:574] : INFO : Epoch 989 | loss: 0.0311809 | val_loss: 0.0311828 | Time: 2023.38 ms
[2022-04-10 03:57:31 main:574] : INFO : Epoch 990 | loss: 0.0311805 | val_loss: 0.0311782 | Time: 2299.1 ms
[2022-04-10 03:57:33 main:574] : INFO : Epoch 991 | loss: 0.0311786 | val_loss: 0.0311781 | Time: 2187.54 ms
[2022-04-10 03:57:35 main:574] : INFO : Epoch 992 | loss: 0.0311773 | val_loss: 0.0311775 | Time: 1989.32 ms
[2022-04-10 03:57:37 main:574] : INFO : Epoch 993 | loss: 0.0311773 | val_loss: 0.0311853 | Time: 2020.21 ms
[2022-04-10 03:57:39 main:574] : INFO : Epoch 994 | loss: 0.0311777 | val_loss: 0.0311788 | Time: 2057.22 ms
[2022-04-10 03:57:41 main:574] : INFO : Epoch 995 | loss: 0.0311765 | val_loss: 0.0311772 | Time: 2017.72 ms
[2022-04-10 03:57:43 main:574] : INFO : Epoch 996 | loss: 0.0311745 | val_loss: 0.0311759 | Time: 2059.6 ms
[2022-04-10 03:57:45 main:574] : INFO : Epoch 997 | loss: 0.0311728 | val_loss: 0.0311759 | Time: 1989.95 ms
[2022-04-10 03:57:47 main:574] : INFO : Epoch 998 | loss: 0.0311724 | val_loss: 0.0311755 | Time: 2046.84 ms
[2022-04-10 03:57:50 main:574] : INFO : Epoch 999 | loss: 0.0311719 | val_loss: 0.0311778 | Time: 2031.26 ms
[2022-04-10 03:57:52 main:574] : INFO : Epoch 1000 | loss: 0.0311711 | val_loss: 0.0311757 | Time: 2035.15 ms
[2022-04-10 03:57:54 main:574] : INFO : Epoch 1001 | loss: 0.0311706 | val_loss: 0.0311785 | Time: 2004.5 ms
[2022-04-10 03:57:56 main:574] : INFO : Epoch 1002 | loss: 0.0311702 | val_loss: 0.0311846 | Time: 2013.4 ms
[2022-04-10 03:57:58 main:574] : INFO : Epoch 1003 | loss: 0.0311731 | val_loss: 0.0311819 | Time: 2092.53 ms
[2022-04-10 03:58:00 main:574] : INFO : Epoch 1004 | loss: 0.0311803 | val_loss: 0.0311773 | Time: 2014.85 ms
[2022-04-10 03:58:02 main:574] : INFO : Epoch 1005 | loss: 0.0311717 | val_loss: 0.0311786 | Time: 2052.7 ms
[2022-04-10 03:58:04 main:574] : INFO : Epoch 1006 | loss: 0.0311714 | val_loss: 0.0311757 | Time: 1971.97 ms
[2022-04-10 03:58:06 main:574] : INFO : Epoch 1007 | loss: 0.0311701 | val_loss: 0.0311752 | Time: 1973.6 ms
[2022-04-10 03:58:08 main:574] : INFO : Epoch 1008 | loss: 0.0311698 | val_loss: 0.0311762 | Time: 2014.54 ms
[2022-04-10 03:58:10 main:574] : INFO : Epoch 1009 | loss: 0.0311685 | val_loss: 0.0311758 | Time: 2045.57 ms
[2022-04-10 03:58:12 main:574] : INFO : Epoch 1010 | loss: 0.0311692 | val_loss: 0.03118 | Time: 2015.2 ms
[2022-04-10 03:58:14 main:574] : INFO : Epoch 1011 | loss: 0.031169 | val_loss: 0.0311768 | Time: 2080.04 ms
[2022-04-10 03:58:16 main:574] : INFO : Epoch 1012 | loss: 0.0311689 | val_loss: 0.0311796 | Time: 2039.83 ms
[2022-04-10 03:58:18 main:574] : INFO : Epoch 1013 | loss: 0.0311693 | val_loss: 0.0311782 | Time: 2096.48 ms
[2022-04-10 03:58:20 main:574] : INFO : Epoch 1014 | loss: 0.0311684 | val_loss: 0.0311801 | Time: 1990.1 ms
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFF273290D2
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 04/10/22 03:58:22
Install Directory : C:\Program Files\BOINC\
Data Directory : C:\ProgramData\BOINC
Project Symstore :
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
[2022-04-10 03:58:22 main:574] : INFO : Epoch 1015 | loss: 0.0311707 | val_loss: 0.0311773 | Time: 2040.57 ms
Debugger Engine : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\16;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 000000002c280000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000294d0000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 0000000028900000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 0000000027260000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000283d0000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000026c90000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1586) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1586
ModLoad: 0000000027740000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.1202 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1202
ModLoad: 0000000026f90000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 0000000026bf0000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 00000000270a0000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 0000000028850000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000293e0000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.19041.546
ModLoad: 0000000027770000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.1586) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000027870000 0000000000125000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000019410000 0000000000058000 C:\ProgramData\BOINC\slots\16\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000007c40000 0000000000092000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.28.29334.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\6\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.28.29334.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.28.29334.0
ModLoad: 000000001a230000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.867 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.867
ModLoad: 000000000cd10000 0000000000019000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.28.29334.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\6\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.28.29334.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.28.29334.0
ModLoad: 000000000d570000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.28.29334.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\6\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.28.29334.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.28.29334.0
ModLoad: 00000000aad10000 000000000abe7000 C:\ProgramData\BOINC\slots\16\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000e36b0000 00000000002db000 C:\ProgramData\BOINC\slots\16\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000e8bb0000 000000000020d000 C:\ProgramData\BOINC\slots\16\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 0000000004710000 0000000000040000 C:\ProgramData\BOINC\slots\16\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000007af60000 0000000024b49000 C:\ProgramData\BOINC\slots\16\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000046c0000 0000000000045000 C:\ProgramData\BOINC\slots\16\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000ba000000 00000000034b2000 C:\ProgramData\BOINC\slots\16\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 00000000219d0000 0000000000010000 C:\ProgramData\BOINC\slots\16\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 00000000a7c60000 00000000030a5000 C:\ProgramData\BOINC\slots\16\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 000000005fbb0000 000000001b3a4000 C:\ProgramData\BOINC\slots\16\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 0000000056a10000 000000000919f000 C:\ProgramData\BOINC\slots\16\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 000000004a960000 0000000003d5b000 C:\ProgramData\BOINC\slots\16\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000b71f0000 0000000001eca000 C:\ProgramData\BOINC\slots\16\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 0000000028710000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000024a40000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000289c0000 0000000000470000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000271a0000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1151
ModLoad: 0000000026cc0000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000269b0000 0000000000033000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000271f0000 0000000000068000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 0000000026d80000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000267d0000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000027a50000 0000000000744000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.964 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.964
ModLoad: 0000000024d20000 0000000000794000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000028e30000 0000000000354000 C:\WINDOWS\System32\combase.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.1320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1320
ModLoad: 0000000026650000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000027690000 00000000000ad000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000275a0000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000e01e0000 00000000002cd000 C:\WINDOWS\system32\nvcuda.dll (30.0.15.1165) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_37\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 30.0.15.1165
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.6.99 driver
Product Version : 30.0.15.1165
ModLoad: 00000000492c0000 00000000016a0000 C:\WINDOWS\system32\DriverStore\FileRepository\nvhdc.inf_amd64_d11413f6fd8fe259\nvcuda64.dll (30.0.15.1165) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_37\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 30.0.15.1165
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.6.99 driver
Product Version : 30.0.15.1165
ModLoad: 00000000216e0000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000001dc70000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.906 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.906
ModLoad: 0000000018c60000 0000000000148000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : drvstore.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000265c0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000052540000 0000000000768000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.15.1165) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_37\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 30.0.15.1165
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 30.0.15.1165
ModLoad: 00000000219c0000 0000000000009000 C:\ProgramData\BOINC\slots\16\caffe2_nvrtc.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000055a40000 0000000000fca000 C:\ProgramData\BOINC\slots\16\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6.14.11.9000
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.89 NVRTC Library
Product Version : 6.14.11.9000
ModLoad: 0000000026cf0000 0000000000082000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.1415 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1415
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 4634, Write: 5563, Other 21293
- I/O Transfers Counters -
Read: 10795764, Write: 7147277, Other 107880
- Paged Pool Usage -
QuotaPagedPoolUsage: 3533304, QuotaPeakPagedPoolUsage: 3533528
QuotaNonPagedPoolUsage: 58064, QuotaPeakNonPagedPoolUsage: 58472
- Virtual Memory Usage -
VirtualSize: 395825152, PeakVirtualSize: 1022439424
- Pagefile Usage -
PagefileUsage: 395825152, PeakPagefileUsage: 395825152
- Working Set Size -
WorkingSetSize: -2122313728, PeakWorkingSetSize: -2059603968, PageFaultCount: 839268
*** Dump of thread ID 3360 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 176320272.000000
- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFF273290D2
- Registers -
rax=0000000000000000 rbx=0000000000000001 rcx=000000002c538c40 rdx=0000000028efe9f0 rsi=0000000000000000 rdi=0000000000000000
r8=0000000028efe9f0 r9=000000002c538c30 r10=0000000000000fff r11=0000000000000ff0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000273290d2 rsp=0000000028efe9c8 rbp=0000000000000000
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
28efe9c0 2c2b9100 00000001 28efe9f0 28efe9f0 2c538c30 KERNELBASE!DebugBreak+0x0
28efee00 2c2b9ce4 cd800000 28eff164 00000000 00000298 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
28effd60 2c2ba084 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
28effd90 28917034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
28effdc0 29522651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
28effe40 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 8400 (state: Running): ***
- Information -
Status: Base Priority: Above Normal, Priority: Above Normal, , Kernel Time: 636406272.000000, User Time: 16204999680.000000, Wait Time: 176320272.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=000000003b2e5368 rdx=0000000000000000 rsi=0000000000000000 rdi=000000003b2e5368
r8=0000000000000002 r9=000000004a61b448 r10=0000000000000038 r11=0000000000000868 r12=0000000000000000 r13=0000000000000000
r14=0000000028745a20 r15=000000003b2e5318 rip=0000000029570764 rsp=00000000287459f8 rbp=0000000028745a50
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
287459f0 29534021 00000000 00000031 d5e40150 28745a30 ntdll!NtWaitForAlertByThreadId+0x0
28745a70 272ccfa9 3b2e5360 3b2e5358 3b2e5310 000000b0 ntdll!RtlSleepConditionVariableSRW+0x0
28745ab0 07c7bf3d 00000000 28745690 046c2e0d 19432433 KERNELBASE!SleepConditionVariableSRW+0x0
28745af0 07c52798 00000000 b02e0231 b10000b1 0000009c MSVCP140!__crtSetThreadpoolWait+0x0
28745b20 07c52a4a 770358d7 3b2e5310 4a61b300 3b2e5358 MSVCP140!std::_Winerror_message+0x0
28745b50 b1ef064b 3b2e5310 28745c50 3b2e5310 ffffffff MSVCP140!_Cnd_wait+0x0
28745b90 b1ef25b1 d5e51990 4a61b2f0 4a61b2f0 00000026 torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
28745e80 b1eef15d 28746160 28746160 28746160 d5e51990 torch_cpu!torch::autograd::Engine::thread_main+0x0
287460f0 b1eeeea0 29450580 b5416d10 fffffffe 00000000 torch_cpu!torch::autograd::Engine::execute_with_graph_task+0x0
28746220 b1ee56f9 36938e90 36938e90 28746210 28746318 torch_cpu!torch::autograd::Engine::execute+0x0
28746740 b1ee5086 00000000 28746ba8 36938900 28746810 torch_cpu!torch::autograd::Engine::make_anomaly_metadata+0x0
287467e0 b21e09be 3af50fa0 36938e98 00000000 28746780 torch_cpu!torch::autograd::backward+0x0
287468c0 b1c11cd0 d78ea920 00000000 00000000 00000000 torch_cpu!torch::autograd::VariableType::allCUDATypes+0x0
287468f0 b08b0a06 00000000 00000000 00010001 00000001 torch_cpu!torch::autograd::GraphRoot::apply+0x0
28746b20 2c297166 28746bf0 28746c30 28746bf0 28747190 torch_cpu!at::Tensor::backward+0x0
28747020 2c29b950 28747120 28747120 00000000 bde59080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0
2875fdc0 2c4dc6f8 d782f980 00000000 00000000 d74ec6f0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
2875fe00 28917034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
2875fe30 29522651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
2875feb0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 5896 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 176320256.000000
- Registers -
rax=000000000000005b rbx=000000000000000e rcx=000000000000000e rdx=0000000028fff880 rsi=0000000000000000 rdi=000000000000000e
r8=0000000000000001 r9=00000000d7a45800 r10=0000000000000000 r11=0000000028fff7f0 r12=0000000000000064 r13=0000000028fff880
r14=0000000028fff580 r15=0000000000000000 rip=000000002956d8c4 rsp=0000000028fff528 rbp=00000000d7a458d0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
28fff520 272acb20 00000000 2886c000 2963a4d0 2886c000 ntdll!ZwWaitForMultipleObjects+0x0
28fff810 272aca1e d5e54f60 004e0049 0000000e 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
28fff850 4949d554 28fff908 d7b27f38 d7b27f38 00001708 KERNELBASE!WaitForMultipleObjects+0x0
28fffa90 495458cd 00000000 d7a458d0 00000000 00000000 nvcuda64!+0x0
28fffb40 4949cf23 7ed7766e 2369d2fb d7f7ecb0 00000000 nvcuda64!cuProfilerStop+0x0
28fffb70 497d44c4 d7f7ecb0 00000000 00000000 00000000 nvcuda64!+0x0
28fffba0 28917034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
28fffbd0 29522651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
28fffc50 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 12572 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 174661200.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002c8 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002c8
r8=00000000290ff758 r9=0000000000000000 r10=0000000000000000 r11=00000000290ff7b8 r12=00000000d7a67700 r13=0000000000000000
r14=00000000000002c8 r15=0000000000000000 rip=000000002956cdf4 rsp=00000000290ff4d8 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
290ff4d0 27281a5e 00000000 00001f80 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0
290ff570 496c5d0e d7f7ea70 00000000 00000000 000002c8 KERNELBASE!WaitForSingleObjectEx+0x0
290ff7b0 4949cf23 00000000 d7f7ea70 492c0000 d7a7e3d0 nvcuda64!cuProfilerStop+0x0
290ff7e0 497d44c4 d7f7ea70 00000000 00000000 00000000 nvcuda64!+0x0
290ff810 28917034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
290ff840 29522651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
290ff8c0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 4104 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 433124992.000000, User Time: 11851094016.000000, Wait Time: 176320256.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=000000002963b318 rdx=0000000000000000 rsi=0000000000000000 rdi=000000002963b318
r8=0000000000000000 r9=0000000000000000 r10=0000000000008000 r11=00000000291fb660 r12=0000000000000000 r13=0000000000000000
r14=00000000291ff9b0 r15=000000002963b2c8 rip=0000000029570764 rsp=00000000291ff988 rbp=00000000291ff9e0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
291ff980 29534021 3b2e5358 07c52f97 4a61b300 4a61b2f0 ntdll!NtWaitForAlertByThreadId+0x0
291ffa00 272ccfa9 2963b310 2963b308 2963b2c0 00000000 ntdll!RtlSleepConditionVariableSRW+0x0
291ffa40 07c7bf3d 4a61b320 00000000 00000000 b1ef05b4 KERNELBASE!SleepConditionVariableSRW+0x0
291ffa80 07c52798 00000000 4a61b320 00000000 00000000 MSVCP140!__crtSetThreadpoolWait+0x0
291ffab0 07c52a4a 7668f947 00000000 291ffcc0 2963b308 MSVCP140!std::_Winerror_message+0x0
291ffae0 b1ef064b 2963b2c0 291ffbe0 2963b2c0 4a61b300 MSVCP140!_Cnd_wait+0x0
291ffb20 b1ef25b1 4fc965e0 ffffffff 4a61b300 ffffffff torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
291ffe10 b1ef2471 b5416d10 291ffe50 b5416d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0
291ffe60 b1ee9744 00080001 4fd135e0 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0
291ffe90 270c1bb2 4fd135e0 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0
291ffec0 28917034 00000000 00000000 00000000 00000000 ucrtbase!_configthreadlocale+0x0
291ffef0 29522651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
291fff70 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)