Task 13795780

Name ParityModified-1647044416-13688-1-0_0
Workunit 10879479
Created 26 Mar 2022, 10:26:11 UTC
Sent 31 Mar 2022, 20:56:08 UTC
Report deadline 8 Apr 2022, 20:56:08 UTC
Received 1 Apr 2022, 19:14:24 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 12503
Run time 36 min 33 sec
CPU time 36 min 14 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 2,746.36 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 2.08 GB
Peak swap size 4.29 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
 ms
[2022-04-01 11:20:37	                main:574]	:	INFO	:	Epoch 764 | loss: 0.0310831 | val_loss: 0.0311922 | Time: 1512 ms
[2022-04-01 11:20:39	                main:574]	:	INFO	:	Epoch 765 | loss: 0.0310727 | val_loss: 0.0311847 | Time: 1644.81 ms
[2022-04-01 11:20:40	                main:574]	:	INFO	:	Epoch 766 | loss: 0.0310684 | val_loss: 0.0312045 | Time: 1592.7 ms
[2022-04-01 11:20:42	                main:574]	:	INFO	:	Epoch 767 | loss: 0.0310692 | val_loss: 0.0311988 | Time: 1482.14 ms
[2022-04-01 11:20:43	                main:574]	:	INFO	:	Epoch 768 | loss: 0.0310689 | val_loss: 0.0311956 | Time: 1591.2 ms
[2022-04-01 11:20:45	                main:574]	:	INFO	:	Epoch 769 | loss: 0.0310704 | val_loss: 0.0311934 | Time: 1511.67 ms
[2022-04-01 11:20:46	                main:574]	:	INFO	:	Epoch 770 | loss: 0.0310674 | val_loss: 0.0311837 | Time: 1558.55 ms
[2022-04-01 11:20:48	                main:574]	:	INFO	:	Epoch 771 | loss: 0.0310667 | val_loss: 0.0311755 | Time: 1686.28 ms
[2022-04-01 11:20:50	                main:574]	:	INFO	:	Epoch 772 | loss: 0.031065 | val_loss: 0.0311929 | Time: 1497.14 ms
[2022-04-01 11:20:51	                main:574]	:	INFO	:	Epoch 773 | loss: 0.0310619 | val_loss: 0.0311893 | Time: 1592.07 ms
[2022-04-01 11:20:53	                main:574]	:	INFO	:	Epoch 774 | loss: 0.0310602 | val_loss: 0.0311957 | Time: 1521.36 ms
[2022-04-01 11:20:54	                main:574]	:	INFO	:	Epoch 775 | loss: 0.0310789 | val_loss: 0.0311891 | Time: 1567.8 ms
[2022-04-01 11:20:56	                main:574]	:	INFO	:	Epoch 776 | loss: 0.0310863 | val_loss: 0.0311764 | Time: 1652.37 ms
[2022-04-01 11:20:57	                main:574]	:	INFO	:	Epoch 777 | loss: 0.0310801 | val_loss: 0.031195 | Time: 1507.54 ms
[2022-04-01 11:20:59	                main:574]	:	INFO	:	Epoch 778 | loss: 0.0310708 | val_loss: 0.0312009 | Time: 1624.4 ms
[2022-04-01 11:21:01	                main:574]	:	INFO	:	Epoch 779 | loss: 0.0310661 | val_loss: 0.0311914 | Time: 1585.39 ms
[2022-04-01 11:21:02	                main:574]	:	INFO	:	Epoch 780 | loss: 0.0310659 | val_loss: 0.0311961 | Time: 1543.88 ms
[2022-04-01 11:21:04	                main:574]	:	INFO	:	Epoch 781 | loss: 0.0310653 | val_loss: 0.0311866 | Time: 1643.31 ms
[2022-04-01 11:21:05	                main:574]	:	INFO	:	Epoch 782 | loss: 0.0310715 | val_loss: 0.0311691 | Time: 1521.6 ms
[2022-04-01 11:21:07	                main:574]	:	INFO	:	Epoch 783 | loss: 0.0310906 | val_loss: 0.0311876 | Time: 1632.83 ms
[2022-04-01 11:21:09	                main:574]	:	INFO	:	Epoch 784 | loss: 0.0310791 | val_loss: 0.0311843 | Time: 1579.61 ms
[2022-04-01 11:21:10	                main:574]	:	INFO	:	Epoch 785 | loss: 0.0310805 | val_loss: 0.031187 | Time: 1570.51 ms
[2022-04-01 11:21:12	                main:574]	:	INFO	:	Epoch 786 | loss: 0.0310756 | val_loss: 0.0312269 | Time: 1595.92 ms
[2022-04-01 11:21:13	                main:574]	:	INFO	:	Epoch 787 | loss: 0.0310713 | val_loss: 0.0312102 | Time: 1506.39 ms
[2022-04-01 11:21:15	                main:574]	:	INFO	:	Epoch 788 | loss: 0.0310648 | val_loss: 0.0311974 | Time: 1625.6 ms
[2022-04-01 11:21:16	                main:574]	:	INFO	:	Epoch 789 | loss: 0.0310704 | val_loss: 0.0312131 | Time: 1619.99 ms
[2022-04-01 11:21:18	                main:574]	:	INFO	:	Epoch 790 | loss: 0.0310746 | val_loss: 0.0311871 | Time: 1542.3 ms
[2022-04-01 11:21:20	                main:574]	:	INFO	:	Epoch 791 | loss: 0.0310698 | val_loss: 0.0311868 | Time: 1603.82 ms
[2022-04-01 11:21:21	                main:574]	:	INFO	:	Epoch 792 | loss: 0.0310701 | val_loss: 0.0311914 | Time: 1526.15 ms
[2022-04-01 11:21:23	                main:574]	:	INFO	:	Epoch 793 | loss: 0.0310844 | val_loss: 0.031202 | Time: 1633.95 ms
[2022-04-01 11:21:24	                main:574]	:	INFO	:	Epoch 794 | loss: 0.0310804 | val_loss: 0.0311767 | Time: 1569.69 ms
[2022-04-01 11:21:26	                main:574]	:	INFO	:	Epoch 795 | loss: 0.0311023 | val_loss: 0.0311796 | Time: 1918.56 ms
[2022-04-01 11:21:29	                main:574]	:	INFO	:	Epoch 796 | loss: 0.0311023 | val_loss: 0.0311851 | Time: 2639.6 ms
[2022-04-01 11:21:32	                main:574]	:	INFO	:	Epoch 797 | loss: 0.0310939 | val_loss: 0.0311768 | Time: 2914.29 ms
[2022-04-01 11:21:35	                main:574]	:	INFO	:	Epoch 798 | loss: 0.0310855 | val_loss: 0.0311783 | Time: 2624.92 ms
[2022-04-01 11:21:38	                main:574]	:	INFO	:	Epoch 799 | loss: 0.031083 | val_loss: 0.0311926 | Time: 3142.33 ms
[2022-04-01 11:21:41	                main:574]	:	INFO	:	Epoch 800 | loss: 0.0310759 | val_loss: 0.0311843 | Time: 3004.29 ms
[2022-04-01 11:21:44	                main:574]	:	INFO	:	Epoch 801 | loss: 0.0310739 | val_loss: 0.0311844 | Time: 2970.89 ms
[2022-04-01 11:21:47	                main:574]	:	INFO	:	Epoch 802 | loss: 0.0310723 | val_loss: 0.0311963 | Time: 3194.94 ms
[2022-04-01 11:21:50	                main:574]	:	INFO	:	Epoch 803 | loss: 0.0310695 | val_loss: 0.0311873 | Time: 2873.3 ms
[2022-04-01 11:21:53	                main:574]	:	INFO	:	Epoch 804 | loss: 0.0310693 | val_loss: 0.0311923 | Time: 3037.88 ms
[2022-04-01 11:21:56	                main:574]	:	INFO	:	Epoch 805 | loss: 0.0310704 | val_loss: 0.0311784 | Time: 3193.3 ms
[2022-04-01 11:21:59	                main:574]	:	INFO	:	Epoch 806 | loss: 0.0310813 | val_loss: 0.0311942 | Time: 2874.23 ms
[2022-04-01 11:22:02	                main:574]	:	INFO	:	Epoch 807 | loss: 0.0310763 | val_loss: 0.0311804 | Time: 2695.15 ms
[2022-04-01 11:22:05	                main:574]	:	INFO	:	Epoch 808 | loss: 0.0310853 | val_loss: 0.031172 | Time: 3043.61 ms
[2022-04-01 11:22:07	                main:574]	:	INFO	:	Epoch 809 | loss: 0.0331449 | val_loss: 0.0579451 | Time: 2715.47 ms
[2022-04-01 11:22:10	                main:574]	:	INFO	:	Epoch 810 | loss: 0.0434153 | val_loss: 0.0392496 | Time: 2703.33 ms
[2022-04-01 11:22:13	                main:574]	:	INFO	:	Epoch 811 | loss: nan | val_loss: nan | Time: 3024.54 ms
[2022-04-01 11:22:16	                main:574]	:	INFO	:	Epoch 812 | loss: nan | val_loss: nan | Time: 2906.49 ms
[2022-04-01 11:22:19	                main:574]	:	INFO	:	Epoch 813 | loss: nan | val_loss: nan | Time: 2755.61 ms
[2022-04-01 11:22:22	                main:574]	:	INFO	:	Epoch 814 | loss: nan | val_loss: nan | Time: 2839.17 ms
[2022-04-01 11:22:25	                main:574]	:	INFO	:	Epoch 815 | loss: nan | val_loss: nan | Time: 3274.76 ms
[2022-04-01 11:22:28	                main:574]	:	INFO	:	Epoch 816 | loss: nan | val_loss: nan | Time: 2984.02 ms
[2022-04-01 11:22:31	                main:574]	:	INFO	:	Epoch 817 | loss: nan | val_loss: nan | Time: 2967.61 ms
[2022-04-01 11:22:34	                main:574]	:	INFO	:	Epoch 818 | loss: nan | val_loss: nan | Time: 3123.86 ms
[2022-04-01 11:22:37	                main:574]	:	INFO	:	Epoch 819 | loss: nan | val_loss: nan | Time: 3061.12 ms
[2022-04-01 11:22:40	                main:574]	:	INFO	:	Epoch 820 | loss: nan | val_loss: nan | Time: 3049.66 ms
[2022-04-01 11:22:43	                main:574]	:	INFO	:	Epoch 821 | loss: nan | val_loss: nan | Time: 3156.78 ms
[2022-04-01 11:22:46	                main:574]	:	INFO	:	Epoch 822 | loss: nan | val_loss: nan | Time: 2755.72 ms
[2022-04-01 11:22:49	                main:574]	:	INFO	:	Epoch 823 | loss: nan | val_loss: nan | Time: 2924.91 ms
[2022-04-01 11:22:52	                main:574]	:	INFO	:	Epoch 824 | loss: nan | val_loss: nan | Time: 3341.21 ms
[2022-04-01 11:22:55	                main:574]	:	INFO	:	Epoch 825 | loss: nan | val_loss: nan | Time: 2766.51 ms
[2022-04-01 11:22:58	                main:574]	:	INFO	:	Epoch 826 | loss: nan | val_loss: nan | Time: 2790.03 ms
[2022-04-01 11:23:01	                main:574]	:	INFO	:	Epoch 827 | loss: nan | val_loss: nan | Time: 3107.04 ms
[2022-04-01 11:23:04	                main:574]	:	INFO	:	Epoch 828 | loss: nan | val_loss: nan | Time: 3216.16 ms
[2022-04-01 11:23:07	                main:574]	:	INFO	:	Epoch 829 | loss: nan | val_loss: nan | Time: 3008.13 ms
[2022-04-01 11:23:11	                main:574]	:	INFO	:	Epoch 830 | loss: nan | val_loss: nan | Time: 3361.96 ms
[2022-04-01 11:23:14	                main:574]	:	INFO	:	Epoch 831 | loss: nan | val_loss: nan | Time: 3165.72 ms
[2022-04-01 11:23:18	                main:574]	:	INFO	:	Epoch 832 | loss: nan | val_loss: nan | Time: 3712.22 ms
[2022-04-01 11:23:21	                main:574]	:	INFO	:	Epoch 833 | loss: nan | val_loss: nan | Time: 3681.69 ms
[2022-04-01 11:23:24	                main:574]	:	INFO	:	Epoch 834 | loss: nan | val_loss: nan | Time: 3080.11 ms
[2022-04-01 11:23:28	                main:574]	:	INFO	:	Epoch 835 | loss: nan | val_loss: nan | Time: 3992.44 ms
[2022-04-01 11:23:43	                main:574]	:	INFO	:	Epoch 836 | loss: nan | val_loss: nan | Time: 14943 ms
[2022-04-01 11:23:46	                main:574]	:	INFO	:	Epoch 837 | loss: nan | val_loss: nan | Time: 3061.94 ms
[2022-04-01 11:23:50	                main:574]	:	INFO	:	Epoch 838 | loss: nan | val_loss: nan | Time: 3484.59 ms
[2022-04-01 11:23:52	                main:574]	:	INFO	:	Epoch 839 | loss: nan | val_loss: nan | Time: 2608.29 ms
[2022-04-01 11:23:55	                main:574]	:	INFO	:	Epoch 840 | loss: nan | val_loss: nan | Time: 2898.97 ms
[2022-04-01 11:23:58	                main:574]	:	INFO	:	Epoch 841 | loss: nan | val_loss: nan | Time: 3089.95 ms
[2022-04-01 11:24:01	                main:574]	:	INFO	:	Epoch 842 | loss: nan | val_loss: nan | Time: 2914.69 ms
[2022-04-01 11:24:04	                main:574]	:	INFO	:	Epoch 843 | loss: nan | val_loss: nan | Time: 2836 ms
[2022-04-01 11:24:08	                main:574]	:	INFO	:	Epoch 844 | loss: nan | val_loss: nan | Time: 3294.85 ms
[2022-04-01 11:24:10	                main:574]	:	INFO	:	Epoch 845 | loss: nan | val_loss: nan | Time: 2927.07 ms
[2022-04-01 11:24:13	                main:574]	:	INFO	:	Epoch 846 | loss: nan | val_loss: nan | Time: 3050.77 ms
[2022-04-01 11:24:17	                main:574]	:	INFO	:	Epoch 847 | loss: nan | val_loss: nan | Time: 3254.17 ms
[2022-04-01 11:24:20	                main:574]	:	INFO	:	Epoch 848 | loss: nan | val_loss: nan | Time: 3238.08 ms
[2022-04-01 11:24:23	                main:574]	:	INFO	:	Epoch 849 | loss: nan | val_loss: nan | Time: 3163.22 ms
[2022-04-01 11:24:26	                main:574]	:	INFO	:	Epoch 850 | loss: nan | val_loss: nan | Time: 3282.4 ms
[2022-04-01 11:24:29	                main:574]	:	INFO	:	Epoch 851 | loss: nan | val_loss: nan | Time: 2924.92 ms
[2022-04-01 11:24:32	                main:574]	:	INFO	:	Epoch 852 | loss: nan | val_loss: nan | Time: 2997.11 ms
[2022-04-01 11:24:36	                main:574]	:	INFO	:	Epoch 853 | loss: nan | val_loss: nan | Time: 3356.41 ms
[2022-04-01 11:24:39	                main:574]	:	INFO	:	Epoch 854 | loss: nan | val_loss: nan | Time: 3148.74 ms
[2022-04-01 11:24:42	                main:574]	:	INFO	:	Epoch 855 | loss: nan | val_loss: nan | Time: 2895.8 ms
[2022-04-01 11:24:45	                main:574]	:	INFO	:	Epoch 856 | loss: nan | val_loss: nan | Time: 3378.37 ms
[2022-04-01 11:24:48	                main:574]	:	INFO	:	Epoch 857 | loss: nan | val_loss: nan | Time: 3080.67 ms
[2022-04-01 11:24:52	                main:574]	:	INFO	:	Epoch 858 | loss: nan | val_loss: nan | Time: 3349.4 ms
[2022-04-01 11:24:55	                main:574]	:	INFO	:	Epoch 859 | loss: nan | val_loss: nan | Time: 2998.89 ms
[2022-04-01 11:24:58	                main:574]	:	INFO	:	Epoch 860 | loss: nan | val_loss: nan | Time: 2900.18 ms
[2022-04-01 11:25:01	                main:574]	:	INFO	:	Epoch 861 | loss: nan | val_loss: nan | Time: 3678.91 ms
[2022-04-01 11:25:05	                main:574]	:	INFO	:	Epoch 862 | loss: nan | val_loss: nan | Time: 3765.2 ms
[2022-04-01 11:25:08	                main:574]	:	INFO	:	Epoch 863 | loss: nan | val_loss: nan | Time: 3421.69 ms
[2022-04-01 11:25:12	                main:574]	:	INFO	:	Epoch 864 | loss: nan | val_loss: nan | Time: 3486.79 ms
[2022-04-01 11:25:15	                main:574]	:	INFO	:	Epoch 865 | loss: nan | val_loss: nan | Time: 3209.34 ms
[2022-04-01 11:25:19	                main:574]	:	INFO	:	Epoch 866 | loss: nan | val_loss: nan | Time: 3353.35 ms
[2022-04-01 11:25:22	                main:574]	:	INFO	:	Epoch 867 | loss: nan | val_loss: nan | Time: 3262.05 ms
[2022-04-01 11:25:25	                main:574]	:	INFO	:	Epoch 868 | loss: nan | val_loss: nan | Time: 3217.08 ms
[2022-04-01 11:25:29	                main:574]	:	INFO	:	Epoch 869 | loss: nan | val_loss: nan | Time: 3528.1 ms
[2022-04-01 11:25:32	                main:574]	:	INFO	:	Epoch 870 | loss: nan | val_loss: nan | Time: 3523.37 ms
[2022-04-01 11:25:36	                main:574]	:	INFO	:	Epoch 871 | loss: nan | val_loss: nan | Time: 3435.2 ms
[2022-04-01 11:25:39	                main:574]	:	INFO	:	Epoch 872 | loss: nan | val_loss: nan | Time: 3643.44 ms
[2022-04-01 11:25:42	                main:574]	:	INFO	:	Epoch 873 | loss: nan | val_loss: nan | Time: 3246.14 ms
[2022-04-01 11:25:46	                main:574]	:	INFO	:	Epoch 874 | loss: nan | val_loss: nan | Time: 3667 ms
[2022-04-01 11:25:50	                main:574]	:	INFO	:	Epoch 875 | loss: nan | val_loss: nan | Time: 3962.8 ms
[2022-04-01 11:25:54	                main:574]	:	INFO	:	Epoch 876 | loss: nan | val_loss: nan | Time: 3760.13 ms
[2022-04-01 11:25:58	                main:574]	:	INFO	:	Epoch 877 | loss: nan | val_loss: nan | Time: 3870.98 ms
[2022-04-01 11:26:01	                main:574]	:	INFO	:	Epoch 878 | loss: nan | val_loss: nan | Time: 2945.35 ms
[2022-04-01 11:26:04	                main:574]	:	INFO	:	Epoch 879 | loss: nan | val_loss: nan | Time: 3229.97 ms
[2022-04-01 11:26:07	                main:574]	:	INFO	:	Epoch 880 | loss: nan | val_loss: nan | Time: 2834.08 ms
[2022-04-01 11:26:10	                main:574]	:	INFO	:	Epoch 881 | loss: nan | val_loss: nan | Time: 2785.72 ms
[2022-04-01 11:26:13	                main:574]	:	INFO	:	Epoch 882 | loss: nan | val_loss: nan | Time: 3086.1 ms
[2022-04-01 11:26:16	                main:574]	:	INFO	:	Epoch 883 | loss: nan | val_loss: nan | Time: 3157.72 ms
[2022-04-01 11:26:19	                main:574]	:	INFO	:	Epoch 884 | loss: nan | val_loss: nan | Time: 2765.84 ms
[2022-04-01 11:26:22	                main:574]	:	INFO	:	Epoch 885 | loss: nan | val_loss: nan | Time: 2960.15 ms
[2022-04-01 11:26:24	                main:574]	:	INFO	:	Epoch 886 | loss: nan | val_loss: nan | Time: 2818.2 ms
[2022-04-01 11:26:27	                main:574]	:	INFO	:	Epoch 887 | loss: nan | val_loss: nan | Time: 2836.77 ms
[2022-04-01 11:26:30	                main:574]	:	INFO	:	Epoch 888 | loss: nan | val_loss: nan | Time: 2697.93 ms
[2022-04-01 11:26:33	                main:574]	:	INFO	:	Epoch 889 | loss: nan | val_loss: nan | Time: 2899.78 ms
[2022-04-01 11:26:36	                main:574]	:	INFO	:	Epoch 890 | loss: nan | val_loss: nan | Time: 2802.04 ms
[2022-04-01 11:26:38	                main:574]	:	INFO	:	Epoch 891 | loss: nan | val_loss: nan | Time: 2580.76 ms
[2022-04-01 11:26:41	                main:574]	:	INFO	:	Epoch 892 | loss: nan | val_loss: nan | Time: 2802.84 ms
[2022-04-01 11:26:44	                main:574]	:	INFO	:	Epoch 893 | loss: nan | val_loss: nan | Time: 2818.23 ms
[2022-04-01 11:26:47	                main:574]	:	INFO	:	Epoch 894 | loss: nan | val_loss: nan | Time: 2626.85 ms
[2022-04-01 11:26:50	                main:574]	:	INFO	:	Epoch 895 | loss: nan | val_loss: nan | Time: 3238.25 ms
[2022-04-01 11:26:53	                main:574]	:	INFO	:	Epoch 896 | loss: nan | val_loss: nan | Time: 2880.81 ms
[2022-04-01 11:26:56	                main:574]	:	INFO	:	Epoch 897 | loss: nan | val_loss: nan | Time: 2906.52 ms
[2022-04-01 11:26:58	                main:574]	:	INFO	:	Epoch 898 | loss: nan | val_loss: nan | Time: 2875.14 ms
[2022-04-01 11:27:01	                main:574]	:	INFO	:	Epoch 899 | loss: nan | val_loss: nan | Time: 2712.47 ms
[2022-04-01 11:27:04	                main:574]	:	INFO	:	Epoch 900 | loss: nan | val_loss: nan | Time: 2959.96 ms
[2022-04-01 11:27:07	                main:574]	:	INFO	:	Epoch 901 | loss: nan | val_loss: nan | Time: 2869.19 ms
[2022-04-01 11:27:10	                main:574]	:	INFO	:	Epoch 902 | loss: nan | val_loss: nan | Time: 2687.32 ms
[2022-04-01 11:27:13	                main:574]	:	INFO	:	Epoch 903 | loss: nan | val_loss: nan | Time: 2848.01 ms
[2022-04-01 11:27:16	                main:574]	:	INFO	:	Epoch 904 | loss: nan | val_loss: nan | Time: 3056.92 ms
[2022-04-01 11:27:18	                main:574]	:	INFO	:	Epoch 905 | loss: nan | val_loss: nan | Time: 2759.02 ms
[2022-04-01 11:27:21	                main:574]	:	INFO	:	Epoch 906 | loss: nan | val_loss: nan | Time: 2807.57 ms
[2022-04-01 11:27:24	                main:574]	:	INFO	:	Epoch 907 | loss: nan | val_loss: nan | Time: 3153.44 ms
[2022-04-01 11:27:27	                main:574]	:	INFO	:	Epoch 908 | loss: nan | val_loss: nan | Time: 2746.87 ms
[2022-04-01 11:27:30	                main:574]	:	INFO	:	Epoch 909 | loss: nan | val_loss: nan | Time: 2816.73 ms
[2022-04-01 11:27:33	                main:574]	:	INFO	:	Epoch 910 | loss: nan | val_loss: nan | Time: 2861.13 ms
[2022-04-01 11:27:36	                main:574]	:	INFO	:	Epoch 911 | loss: nan | val_loss: nan | Time: 3197.43 ms
[2022-04-01 11:27:39	                main:574]	:	INFO	:	Epoch 912 | loss: nan | val_loss: nan | Time: 2699.77 ms
[2022-04-01 11:27:42	                main:574]	:	INFO	:	Epoch 913 | loss: nan | val_loss: nan | Time: 2781.11 ms
[2022-04-01 11:27:45	                main:574]	:	INFO	:	Epoch 914 | loss: nan | val_loss: nan | Time: 3145.61 ms
[2022-04-01 11:27:48	                main:574]	:	INFO	:	Epoch 915 | loss: nan | val_loss: nan | Time: 3438.56 ms
[2022-04-01 11:27:53	                main:574]	:	INFO	:	Epoch 916 | loss: nan | val_loss: nan | Time: 4905.87 ms
[2022-04-01 11:27:56	                main:574]	:	INFO	:	Epoch 917 | loss: nan | val_loss: nan | Time: 3241.13 ms
[2022-04-01 11:27:59	                main:574]	:	INFO	:	Epoch 918 | loss: nan | val_loss: nan | Time: 3130.95 ms
[2022-04-01 11:28:03	                main:574]	:	INFO	:	Epoch 919 | loss: nan | val_loss: nan | Time: 3085.35 ms
[2022-04-01 11:28:05	                main:574]	:	INFO	:	Epoch 920 | loss: nan | val_loss: nan | Time: 2817.42 ms
[2022-04-01 11:28:08	                main:574]	:	INFO	:	Epoch 921 | loss: nan | val_loss: nan | Time: 3080.86 ms
[2022-04-01 11:28:12	                main:574]	:	INFO	:	Epoch 922 | loss: nan | val_loss: nan | Time: 3147.69 ms
[2022-04-01 11:28:15	                main:574]	:	INFO	:	Epoch 923 | loss: nan | val_loss: nan | Time: 3334.75 ms
[2022-04-01 11:28:18	                main:574]	:	INFO	:	Epoch 924 | loss: nan | val_loss: nan | Time: 2853.36 ms
[2022-04-01 11:28:21	                main:574]	:	INFO	:	Epoch 925 | loss: nan | val_loss: nan | Time: 3287.15 ms
[2022-04-01 11:28:24	                main:574]	:	INFO	:	Epoch 926 | loss: nan | val_loss: nan | Time: 3102 ms
[2022-04-01 11:28:27	                main:574]	:	INFO	:	Epoch 927 | loss: nan | val_loss: nan | Time: 2831.86 ms
[2022-04-01 11:28:30	                main:574]	:	INFO	:	Epoch 928 | loss: nan | val_loss: nan | Time: 3279.61 ms
[2022-04-01 11:28:33	                main:574]	:	INFO	:	Epoch 929 | loss: nan | val_loss: nan | Time: 2947.67 ms
[2022-04-01 11:28:37	                main:574]	:	INFO	:	Epoch 930 | loss: nan | val_loss: nan | Time: 3216.38 ms
[2022-04-01 11:28:40	                main:574]	:	INFO	:	Epoch 931 | loss: nan | val_loss: nan | Time: 3144.15 ms
[2022-04-01 11:28:43	                main:574]	:	INFO	:	Epoch 932 | loss: nan | val_loss: nan | Time: 2872.13 ms
[2022-04-01 11:28:46	                main:574]	:	INFO	:	Epoch 933 | loss: nan | val_loss: nan | Time: 2950.35 ms
[2022-04-01 11:28:49	                main:574]	:	INFO	:	Epoch 934 | loss: nan | val_loss: nan | Time: 3396.18 ms
[2022-04-01 11:28:52	                main:574]	:	INFO	:	Epoch 935 | loss: nan | val_loss: nan | Time: 3070.07 ms
[2022-04-01 11:28:55	                main:574]	:	INFO	:	Epoch 936 | loss: nan | val_loss: nan | Time: 3337.38 ms
[2022-04-01 11:28:58	                main:574]	:	INFO	:	Epoch 937 | loss: nan | val_loss: nan | Time: 2909.89 ms
[2022-04-01 11:29:02	                main:574]	:	INFO	:	Epoch 938 | loss: nan | val_loss: nan | Time: 3195.02 ms
[2022-04-01 11:29:05	                main:574]	:	INFO	:	Epoch 939 | loss: nan | val_loss: nan | Time: 3447.56 ms
[2022-04-01 11:29:08	                main:574]	:	INFO	:	Epoch 940 | loss: nan | val_loss: nan | Time: 3162.1 ms
[2022-04-01 11:29:11	                main:574]	:	INFO	:	Epoch 941 | loss: nan | val_loss: nan | Time: 2979.2 ms
[2022-04-01 11:29:15	                main:574]	:	INFO	:	Epoch 942 | loss: nan | val_loss: nan | Time: 3395.72 ms
[2022-04-01 11:29:18	                main:574]	:	INFO	:	Epoch 943 | loss: nan | val_loss: nan | Time: 3366.6 ms
[2022-04-01 11:29:21	                main:574]	:	INFO	:	Epoch 944 | loss: nan | val_loss: nan | Time: 3360.09 ms
[2022-04-01 11:29:25	                main:574]	:	INFO	:	Epoch 945 | loss: nan | val_loss: nan | Time: 3498.16 ms
[2022-04-01 11:29:28	                main:574]	:	INFO	:	Epoch 946 | loss: nan | val_loss: nan | Time: 3146.64 ms
[2022-04-01 11:29:31	                main:574]	:	INFO	:	Epoch 947 | loss: nan | val_loss: nan | Time: 3376.71 ms
[2022-04-01 11:29:34	                main:574]	:	INFO	:	Epoch 948 | loss: nan | val_loss: nan | Time: 3040.77 ms
[2022-04-01 11:29:38	                main:574]	:	INFO	:	Epoch 949 | loss: nan | val_loss: nan | Time: 3130.09 ms
[2022-04-01 11:29:41	                main:574]	:	INFO	:	Epoch 950 | loss: nan | val_loss: nan | Time: 3312.47 ms
[2022-04-01 11:29:44	                main:574]	:	INFO	:	Epoch 951 | loss: nan | val_loss: nan | Time: 2874.84 ms
[2022-04-01 11:29:47	                main:574]	:	INFO	:	Epoch 952 | loss: nan | val_loss: nan | Time: 2807.03 ms
[2022-04-01 11:29:50	                main:574]	:	INFO	:	Epoch 953 | loss: nan | val_loss: nan | Time: 3176.88 ms
[2022-04-01 11:29:53	                main:574]	:	INFO	:	Epoch 954 | loss: nan | val_loss: nan | Time: 2948.3 ms
[2022-04-01 11:29:56	                main:574]	:	INFO	:	Epoch 955 | loss: nan | val_loss: nan | Time: 2986.08 ms
[2022-04-01 11:29:59	                main:574]	:	INFO	:	Epoch 956 | loss: nan | val_loss: nan | Time: 3009.43 ms
[2022-04-01 11:30:02	                main:574]	:	INFO	:	Epoch 957 | loss: nan | val_loss: nan | Time: 3473.86 ms
[2022-04-01 11:30:05	                main:574]	:	INFO	:	Epoch 958 | loss: nan | val_loss: nan | Time: 3319.6 ms
[2022-04-01 11:30:08	                main:574]	:	INFO	:	Epoch 959 | loss: nan | val_loss: nan | Time: 3011.32 ms
[2022-04-01 11:30:11	                main:574]	:	INFO	:	Epoch 960 | loss: nan | val_loss: nan | Time: 2716.17 ms
[2022-04-01 11:30:14	                main:574]	:	INFO	:	Epoch 961 | loss: nan | val_loss: nan | Time: 2689.01 ms
[2022-04-01 11:30:17	                main:574]	:	INFO	:	Epoch 962 | loss: nan | val_loss: nan | Time: 3210.88 ms
[2022-04-01 11:30:20	                main:574]	:	INFO	:	Epoch 963 | loss: nan | val_loss: nan | Time: 2899.59 ms
[2022-04-01 11:30:23	                main:574]	:	INFO	:	Epoch 964 | loss: nan | val_loss: nan | Time: 2629.69 ms
[2022-04-01 11:30:26	                main:574]	:	INFO	:	Epoch 965 | loss: nan | val_loss: nan | Time: 3008.66 ms
[2022-04-01 11:30:28	                main:574]	:	INFO	:	Epoch 966 | loss: nan | val_loss: nan | Time: 2613.17 ms
[2022-04-01 11:30:31	                main:574]	:	INFO	:	Epoch 967 | loss: nan | val_loss: nan | Time: 2793.64 ms
[2022-04-01 11:30:34	                main:574]	:	INFO	:	Epoch 968 | loss: nan | val_loss: nan | Time: 2663.73 ms
[2022-04-01 11:30:37	                main:574]	:	INFO	:	Epoch 969 | loss: nan | val_loss: nan | Time: 3006.23 ms
[2022-04-01 11:30:39	                main:574]	:	INFO	:	Epoch 970 | loss: nan | val_loss: nan | Time: 2615.37 ms
[2022-04-01 11:30:42	                main:574]	:	INFO	:	Epoch 971 | loss: nan | val_loss: nan | Time: 2639.97 ms
[2022-04-01 11:30:45	                main:574]	:	INFO	:	Epoch 972 | loss: nan | val_loss: nan | Time: 3011.27 ms
[2022-04-01 11:30:48	                main:574]	:	INFO	:	Epoch 973 | loss: nan | val_loss: nan | Time: 2626.24 ms
[2022-04-01 11:30:51	                main:574]	:	INFO	:	Epoch 974 | loss: nan | val_loss: nan | Time: 2965.84 ms
[2022-04-01 11:30:54	                main:574]	:	INFO	:	Epoch 975 | loss: nan | val_loss: nan | Time: 3291.43 ms
[2022-04-01 11:30:57	                main:574]	:	INFO	:	Epoch 976 | loss: nan | val_loss: nan | Time: 2887.89 ms
[2022-04-01 11:31:00	                main:574]	:	INFO	:	Epoch 977 | loss: nan | val_loss: nan | Time: 2737.48 ms
[2022-04-01 11:31:03	                main:574]	:	INFO	:	Epoch 978 | loss: nan | val_loss: nan | Time: 2992.87 ms
[2022-04-01 11:31:05	                main:574]	:	INFO	:	Epoch 979 | loss: nan | val_loss: nan | Time: 2767.81 ms
[2022-04-01 11:31:08	                main:574]	:	INFO	:	Epoch 980 | loss: nan | val_loss: nan | Time: 2675.16 ms
[2022-04-01 11:31:11	                main:574]	:	INFO	:	Epoch 981 | loss: nan | val_loss: nan | Time: 2871.07 ms
[2022-04-01 11:31:14	                main:574]	:	INFO	:	Epoch 982 | loss: nan | val_loss: nan | Time: 2793.75 ms
[2022-04-01 11:31:17	                main:574]	:	INFO	:	Epoch 983 | loss: nan | val_loss: nan | Time: 3192.87 ms
[2022-04-01 11:31:20	                main:574]	:	INFO	:	Epoch 984 | loss: nan | val_loss: nan | Time: 3225.57 ms
[2022-04-01 11:31:23	                main:574]	:	INFO	:	Epoch 985 | loss: nan | val_loss: nan | Time: 2768.6 ms
[2022-04-01 11:31:26	                main:574]	:	INFO	:	Epoch 986 | loss: nan | val_loss: nan | Time: 2855.24 ms
[2022-04-01 11:31:29	                main:574]	:	INFO	:	Epoch 987 | loss: nan | val_loss: nan | Time: 3111.08 ms
[2022-04-01 11:31:32	                main:574]	:	INFO	:	Epoch 988 | loss: nan | val_loss: nan | Time: 2680.98 ms
[2022-04-01 11:31:34	                main:574]	:	INFO	:	Epoch 989 | loss: nan | val_loss: nan | Time: 2702.9 ms
[2022-04-01 11:31:38	                main:574]	:	INFO	:	Epoch 990 | loss: nan | val_loss: nan | Time: 3081 ms
[2022-04-01 11:31:40	                main:574]	:	INFO	:	Epoch 991 | loss: nan | val_loss: nan | Time: 2711.92 ms
[2022-04-01 11:31:43	                main:574]	:	INFO	:	Epoch 992 | loss: nan | val_loss: nan | Time: 2661.57 ms
[2022-04-01 11:31:46	                main:574]	:	INFO	:	Epoch 993 | loss: nan | val_loss: nan | Time: 2844.24 ms
[2022-04-01 11:31:49	                main:574]	:	INFO	:	Epoch 994 | loss: nan | val_loss: nan | Time: 3161.3 ms
[2022-04-01 11:31:52	                main:574]	:	INFO	:	Epoch 995 | loss: nan | val_loss: nan | Time: 2635.5 ms
[2022-04-01 11:31:54	                main:574]	:	INFO	:	Epoch 996 | loss: nan | val_loss: nan | Time: 2803.34 ms
[2022-04-01 11:31:58	                main:574]	:	INFO	:	Epoch 997 | loss: nan | val_loss: nan | Time: 3069.61 ms
[2022-04-01 11:32:00	                main:574]	:	INFO	:	Epoch 998 | loss: nan | val_loss: nan | Time: 2780.83 ms
[2022-04-01 11:32:03	                main:574]	:	INFO	:	Epoch 999 | loss: nan | val_loss: nan | Time: 2784.12 ms
[2022-04-01 11:32:06	                main:574]	:	INFO	:	Epoch 1000 | loss: nan | val_loss: nan | Time: 3075.24 ms
[2022-04-01 11:32:09	                main:574]	:	INFO	:	Epoch 1001 | loss: nan | val_loss: nan | Time: 2994.43 ms
[2022-04-01 11:32:12	                main:574]	:	INFO	:	Epoch 1002 | loss: nan | val_loss: nan | Time: 3230.93 ms
[2022-04-01 11:32:17	                main:574]	:	INFO	:	Epoch 1003 | loss: nan | val_loss: nan | Time: 4186.71 ms
[2022-04-01 11:32:20	                main:574]	:	INFO	:	Epoch 1004 | loss: nan | val_loss: nan | Time: 3559.45 ms
[2022-04-01 11:32:24	                main:574]	:	INFO	:	Epoch 1005 | loss: nan | val_loss: nan | Time: 3870.28 ms
[2022-04-01 11:32:28	                main:574]	:	INFO	:	Epoch 1006 | loss: nan | val_loss: nan | Time: 3617.64 ms
[2022-04-01 11:32:33	                main:574]	:	INFO	:	Epoch 1007 | loss: nan | val_loss: nan | Time: 4855.7 ms
[2022-04-01 11:32:36	                main:574]	:	INFO	:	Epoch 1008 | loss: nan | val_loss: nan | Time: 3630.33 ms
[2022-04-01 11:32:40	                main:574]	:	INFO	:	Epoch 1009 | loss: nan | val_loss: nan | Time: 3437.84 ms
[2022-04-01 11:32:43	                main:574]	:	INFO	:	Epoch 1010 | loss: nan | val_loss: nan | Time: 3752.68 ms
[2022-04-01 11:32:47	                main:574]	:	INFO	:	Epoch 1011 | loss: nan | val_loss: nan | Time: 3655.26 ms
[2022-04-01 11:32:51	                main:574]	:	INFO	:	Epoch 1012 | loss: nan | val_loss: nan | Time: 4193.52 ms
[2022-04-01 11:32:55	                main:574]	:	INFO	:	Epoch 1013 | loss: nan | val_loss: nan | Time: 3749.91 ms
[2022-04-01 11:32:59	                main:574]	:	INFO	:	Epoch 1014 | loss: nan | val_loss: nan | Time: 3640.81 ms
[2022-04-01 11:33:03	                main:574]	:	INFO	:	Epoch 1015 | loss: nan | val_loss: nan | Time: 4309.89 ms
[2022-04-01 11:33:07	                main:574]	:	INFO	:	Epoch 1016 | loss: nan | val_loss: nan | Time: 3779.37 ms
[2022-04-01 11:33:11	                main:574]	:	INFO	:	Epoch 1017 | loss: nan | val_loss: nan | Time: 3989.39 ms
[2022-04-01 11:33:15	                main:574]	:	INFO	:	Epoch 1018 | loss: nan | val_loss: nan | Time: 4531.94 ms
[2022-04-01 11:33:30	                main:574]	:	INFO	:	Epoch 1019 | loss: nan | val_loss: nan | Time: 14869.3 ms
[2022-04-01 11:33:33	                main:574]	:	INFO	:	Epoch 1020 | loss: nan | val_loss: nan | Time: 3052.7 ms
[2022-04-01 11:33:36	                main:574]	:	INFO	:	Epoch 1021 | loss: nan | val_loss: nan | Time: 2902.5 ms
[2022-04-01 11:33:40	                main:574]	:	INFO	:	Epoch 1022 | loss: nan | val_loss: nan | Time: 4006.18 ms
[2022-04-01 11:33:43	                main:574]	:	INFO	:	Epoch 1023 | loss: nan | val_loss: nan | Time: 2774.84 ms
[2022-04-01 11:33:46	                main:574]	:	INFO	:	Epoch 1024 | loss: nan | val_loss: nan | Time: 2703.55 ms
[2022-04-01 11:33:49	                main:574]	:	INFO	:	Epoch 1025 | loss: nan | val_loss: nan | Time: 2827.79 ms
[2022-04-01 11:33:52	                main:574]	:	INFO	:	Epoch 1026 | loss: nan | val_loss: nan | Time: 3041.01 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: Quadro T1000)
[2022-04-01 12:34:37	                main:435]	:	INFO	:	Set logging level to 1
[2022-04-01 12:34:37	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-04-01 12:34:37	                main:444]	:	INFO	:	Resolving all filenames
[2022-04-01 12:34:37	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-01 12:34:37	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-01 12:34:37	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-01 12:34:37	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-01 12:34:37	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-01 12:34:37	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-04-01 12:34:37	                main:474]	:	INFO	:	Configuration: 
[2022-04-01 12:34:37	                main:475]	:	INFO	:	    Model type: GRU
[2022-04-01 12:34:37	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-04-01 12:34:37	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-04-01 12:34:37	                main:478]	:	INFO	:	    Batch Size: 128
[2022-04-01 12:34:37	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-04-01 12:34:37	                main:480]	:	INFO	:	    Patience: 10
[2022-04-01 12:34:37	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-04-01 12:34:37	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-04-01 12:34:37	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-04-01 12:34:37	                main:484]	:	INFO	:	    # Threads: 1
[2022-04-01 12:34:37	                main:486]	:	INFO	:	Preparing Dataset
[2022-04-01 12:34:37	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-01 12:34:37	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-01 12:34:39	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-04-01 12:34:39	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-01 12:34:39	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-01 12:34:39	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-04-01 12:34:39	                main:494]	:	INFO	:	Creating Model
[2022-04-01 12:34:39	                main:507]	:	INFO	:	Preparing config file
[2022-04-01 12:34:39	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-04-01 12:34:39	                main:512]	:	INFO	:	Loading config


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FF8D7B04F69

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 04/01/22 12:34:39
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\3;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 00000000dbae0000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000d9ef0000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 00000000d82b0000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 00000000d7ad0000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 00000000d8550000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.DLL (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000d88a0000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.19041.546

ModLoad: 00000000d8800000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.1586) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000d9d50000 0000000000125000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000d9970000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000d78a0000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1586) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1586

ModLoad: 00000000d8370000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202

ModLoad: 00000000d79c0000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 00000000d78d0000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 00000000d7da0000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 000000009ea10000 0000000000058000 C:\ProgramData\BOINC\slots\3\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000b3970000 000000000008d000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.29.30133.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.29.30133.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.29.30133.0

ModLoad: 00000000d5b20000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.867

ModLoad: 00000000b3950000 000000000001b000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.29.30133.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.29.30133.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.29.30133.0

ModLoad: 00000000b3940000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.29.30133.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.29.30133.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.29.30133.0

ModLoad: 00000000db4a0000 0000000024b49000 C:\ProgramData\BOINC\slots\3\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000ab140000 0000000000045000 C:\ProgramData\BOINC\slots\3\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000036b30000 00000000034b2000 C:\ProgramData\BOINC\slots\3\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 0000000033a80000 00000000030a5000 C:\ProgramData\BOINC\slots\3\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 00000000d16f0000 0000000000010000 C:\ProgramData\BOINC\slots\3\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 00000000c00f0000 000000001b3a4000 C:\ProgramData\BOINC\slots\3\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 00000000b5500000 000000000abe7000 C:\ProgramData\BOINC\slots\3\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000090850000 000000000020d000 C:\ProgramData\BOINC\slots\3\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 000000008e130000 00000000002db000 C:\ProgramData\BOINC\slots\3\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000cc8f0000 0000000000040000 C:\ProgramData\BOINC\slots\3\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000001d410000 000000000919f000 C:\ProgramData\BOINC\slots\3\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 000000002fd20000 0000000003d5b000 C:\ProgramData\BOINC\slots\3\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 000000003c510000 0000000001eca000 C:\ProgramData\BOINC\slots\3\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000d9e80000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000003c270000 0000000000014000 C:\WINDOWS\System32\umppc15005.dll (6.36.15005.0) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : umppc.pdb
    File Version          : 6.36.15005.0
    Company Name          : CrowdStrike, Inc.
    Product Name          : CrowdStrike Falcon Sensor
    Product Version       : 6.36.15005.0

ModLoad: 00000000d5d60000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000d8940000 0000000000470000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000d7970000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 00000000d77e0000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000d73b0000 0000000000033000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 00000000d7610000 0000000000068000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 00000000d7680000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000d71f0000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000d91c0000 0000000000744000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.19041.964 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.964

ModLoad: 00000000d52b0000 0000000000794000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000d8db0000 0000000000354000 C:\WINDOWS\System32\combase.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.19041.1320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1320

ModLoad: 00000000d6f90000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000d80d0000 00000000000ad000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000d9c90000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000005a600000 00000000002cd000 C:\WINDOWS\system32\nvcuda.dll (30.0.15.1215) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r512_08\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 30.0.15.1215
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.6.127 driver
    Product Version       : 30.0.15.1215

ModLoad: 000000002d560000 000000000169f000 C:\WINDOWS\system32\DriverStore\FileRepository\nvltwi.inf_amd64_785ccac5ce3deed9\nvcuda64.dll (30.0.15.1215) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r512_08\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 30.0.15.1215
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.6.127 driver
    Product Version       : 30.0.15.1215

ModLoad: 00000000ce4c0000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000ce480000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.19041.906 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.906

ModLoad: 00000000ce2d0000 0000000000148000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : drvstore.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 00000000d6f00000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000b0dc0000 0000000000768000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.15.1215) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r512_08\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 30.0.15.1215
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 30.0.15.1215

ModLoad: 00000000d7810000 0000000000082000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.19041.1415 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1415



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3617, Write: 307, Other 1172

- I/O Transfers Counters -
Read: 6700371, Write: 6029, Other 46792

- Paged Pool Usage -
QuotaPagedPoolUsage: 3447752, QuotaPeakPagedPoolUsage: 3447752
QuotaNonPagedPoolUsage: 37936, QuotaPeakNonPagedPoolUsage: 38000

- Virtual Memory Usage -
VirtualSize: -1304350720, PeakVirtualSize: -707489792

- Pagefile Usage -
PagefileUsage: -1304350720, PeakPagefileUsage: -1304350720

- Working Set Size -
WorkingSetSize: 1223958528, PeakWorkingSetSize: 1223962624, PageFaultCount: 424749

*** Dump of thread ID 20812 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 5937500.000000, User Time: 13593750.000000, Wait Time: 89333472.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FF8D7B04F69

- Registers -
rax=00000000bb098b93 rbx=00000000dbe44910 rcx=0000000037d15de0 rdx=0000000000000001 rsi=0000000037d16720 rdi=0000000019930520
r8=0000000037d15e78 r9=0000000000000000 r10=0000000000000000 r11=0000000013507e00 r12=000000006d49e8d0 r13=0000000037d16930
r14=000000002102b2c0 r15=0000000000000000 rip=00000000d7b04f69 rsp=0000000037d165c0 rbp=0000000037d168b0
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
37d16690 dbd5a884 00000040 0000004f 6d49e500 00000522 KERNELBASE!RaiseException+0x0 
37d166f0 dbb01ca6 00000020 3bf90000 127229b0 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
37d167a0 dbb0593b 00000000 00000030 00000020 00000008 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
37d168f0 dbb01a78 00000000 00000000 37d16c20 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
37d169c0 dbb01cfc 37d16c20 00000000 00000080 37d16ef0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
37d16a80 dbb0c4dd 37d16ef0 37d16ef0 37d16ef0 37d16ef0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
37d16d70 dbafb2fe 37d17388 37d16ef0 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
37d2fb10 dbd3c6f8 3d977720 00000000 00000000 3da16d90 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
37d2fb50 d82c7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
37d2fb80 d9f42651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
37d2fc00 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 25200 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 89333264.000000

- Registers -
rax=00000000000001d3 rbx=000000003bf9caf0 rcx=0000000000000090 rdx=000000003bf9c770 rsi=000000003bf9bda0 rdi=000000003bf9caf0
r8=00000000000002a8 r9=000000000000000c r10=0000000000000000 r11=000000003e3ba2a8 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000d9f907c4 rsp=00000000380ffa78 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
380ffa70 d9f42dc7 00000000 00000000 3bf9bda0 3bf9caf0 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
380ffd70 d82c7034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
380ffda0 d9f42651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
380ffe20 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 23876 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 625000.000000, User Time: 0.000000, Wait Time: 89333264.000000

- Registers -
rax=00000000000001d3 rbx=000000003bf9ce90 rcx=0000000000000090 rdx=000000003bf9cb10 rsi=000000003bf9bda0 rdi=000000003bf9ce90
r8=00000000000002a8 r9=0000000000000038 r10=0000000000000000 r11=0000000033a682a8 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000d9f907c4 rsp=00000000381ff588 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
381ff580 d9f42dc7 00000000 00000000 3bf9bda0 3bf9ce90 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
381ff880 d82c7034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
381ff8b0 d9f42651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
381ff930 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 21904 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 89333264.000000

- Registers -
rax=00000000000001d3 rbx=000000003bf9dc10 rcx=0000000000000090 rdx=000000003bf9d890 rsi=000000003bf9bda0 rdi=000000003bf9dc10
r8=000000003c6bf000 r9=00000000382ff110 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000d9f907c4 rsp=00000000382ff648 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
382ff640 d9f42dc7 00000000 00000000 3bf9bda0 3bf9dc10 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
382ff940 d82c7034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
382ff970 d9f42651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
382ff9f0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 8668 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 89333464.000000

- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000384ffe50 rsi=0000000000000000 rdi=0000000000000064
r8=00000000384ffe28 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000d9f8d3f4 rsp=00000000384ffe28 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
384ffe20 d7b1962e 384ffee8 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0 
384ffec0 dbb1a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0 
384ffef0 d82c7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
384fff20 d9f42651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
384fffa0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 24696 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 89333464.000000

- Registers -
rax=000000000000005b rbx=000000000000000e rcx=000000000000000e rdx=00000000385ffb80 rsi=0000000000000000 rdi=000000000000000e
r8=0000000000000001 r9=000000003db07e00 r10=0000000000000000 r11=00000000385ffaf0 r12=0000000000000064 r13=00000000385ffb80
r14=00000000385ff880 r15=0000000000000000 rip=00000000d9f8d8c4 rsp=00000000385ff828 rbp=000000003db07e00
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
385ff820 d7b1cb20 00000000 37f05000 da05a4d0 37f05000 ntdll!ZwWaitForMultipleObjects+0x0 
385ffb10 d7b1ca1e 3bfa56c0 004e0049 0000000e 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
385ffb50 2d73d554 3db0afe0 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
385ffd90 2d7e58cd 00000000 3db07e00 00000000 00000000 nvcuda64!+0x0 
385ffe40 2d73cf23 093dd5e9 08469201 3e0e0a50 00000000 nvcuda64!cuProfilerStop+0x0 
385ffe70 2da741e4 3e0e0a50 00000000 00000000 00000000 nvcuda64!+0x0 
385ffea0 d82c7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
385ffed0 d9f42651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
385fff50 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 15912 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 89333384.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002b0 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002b0
r8=0000000000000000 r9=00000000386ffa98 r10=0000000000000024 r11=0000000000000000 r12=000000003daedc20 r13=0000000000000000
r14=00000000000002b0 r15=0000000000000000 rip=00000000d9f8cdf4 rsp=00000000386ff7a8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
386ff7a0 d7af1a5e 00000000 00001f80 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0 
386ff840 2d96596e 3e0e0ff0 00000000 00000000 000002b0 KERNELBASE!WaitForSingleObjectEx+0x0 
386ffa80 2d73cf23 00000000 3e0e0ff0 2d560000 3db411f0 nvcuda64!cuProfilerStop+0x0 
386ffab0 2da741e4 3e0e0ff0 00000000 00000000 00000000 nvcuda64!+0x0 
386ffae0 d82c7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
386ffb10 d9f42651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
386ffb90 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)