Task 11112891

Name ParityModified-1639962835-9909-2-0_0
Workunit 8394808
Created 27 Jan 2022, 16:39:55 UTC
Sent 13 Feb 2022, 22:03:50 UTC
Report deadline 21 Feb 2022, 22:03:50 UTC
Received 14 Feb 2022, 0:00:39 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID 571
Run time 56 min 13 sec
CPU time 54 min 56 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 5,441.63 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 2.09 GB
Peak swap size 4.33 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.14.2</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code -1073741819 (0xc0000005)</message>
<stderr_txt>
ime: 2947.57 ms
[2022-02-13 23:54:32	                main:574]	:	INFO	:	Epoch 957 | loss: nan | val_loss: nan | Time: 2798.26 ms
[2022-02-13 23:54:34	                main:574]	:	INFO	:	Epoch 958 | loss: nan | val_loss: nan | Time: 2742.79 ms
[2022-02-13 23:54:37	                main:574]	:	INFO	:	Epoch 959 | loss: nan | val_loss: nan | Time: 2560.67 ms
[2022-02-13 23:54:40	                main:574]	:	INFO	:	Epoch 960 | loss: nan | val_loss: nan | Time: 2913.97 ms
[2022-02-13 23:54:43	                main:574]	:	INFO	:	Epoch 961 | loss: nan | val_loss: nan | Time: 3037.89 ms
[2022-02-13 23:54:46	                main:574]	:	INFO	:	Epoch 962 | loss: nan | val_loss: nan | Time: 2866.95 ms
[2022-02-13 23:54:49	                main:574]	:	INFO	:	Epoch 963 | loss: nan | val_loss: nan | Time: 2998.58 ms
[2022-02-13 23:54:52	                main:574]	:	INFO	:	Epoch 964 | loss: nan | val_loss: nan | Time: 2877.79 ms
[2022-02-13 23:54:55	                main:574]	:	INFO	:	Epoch 965 | loss: nan | val_loss: nan | Time: 2886.66 ms
[2022-02-13 23:54:57	                main:574]	:	INFO	:	Epoch 966 | loss: nan | val_loss: nan | Time: 2699.29 ms
[2022-02-13 23:55:00	                main:574]	:	INFO	:	Epoch 967 | loss: nan | val_loss: nan | Time: 2840.46 ms
[2022-02-13 23:55:03	                main:574]	:	INFO	:	Epoch 968 | loss: nan | val_loss: nan | Time: 2708.38 ms
[2022-02-13 23:55:06	                main:574]	:	INFO	:	Epoch 969 | loss: nan | val_loss: nan | Time: 2743.99 ms
[2022-02-13 23:55:09	                main:574]	:	INFO	:	Epoch 970 | loss: nan | val_loss: nan | Time: 2668.91 ms
[2022-02-13 23:55:12	                main:574]	:	INFO	:	Epoch 971 | loss: nan | val_loss: nan | Time: 3234.22 ms
[2022-02-13 23:55:15	                main:574]	:	INFO	:	Epoch 972 | loss: nan | val_loss: nan | Time: 2687.68 ms
[2022-02-13 23:55:17	                main:574]	:	INFO	:	Epoch 973 | loss: nan | val_loss: nan | Time: 2713.05 ms
[2022-02-13 23:55:20	                main:574]	:	INFO	:	Epoch 974 | loss: nan | val_loss: nan | Time: 2623.43 ms
[2022-02-13 23:55:23	                main:574]	:	INFO	:	Epoch 975 | loss: nan | val_loss: nan | Time: 3012.85 ms
[2022-02-13 23:55:26	                main:574]	:	INFO	:	Epoch 976 | loss: nan | val_loss: nan | Time: 2825.95 ms
[2022-02-13 23:55:29	                main:574]	:	INFO	:	Epoch 977 | loss: nan | val_loss: nan | Time: 2989.43 ms
[2022-02-13 23:55:32	                main:574]	:	INFO	:	Epoch 978 | loss: nan | val_loss: nan | Time: 3048.92 ms
[2022-02-13 23:55:35	                main:574]	:	INFO	:	Epoch 979 | loss: nan | val_loss: nan | Time: 2825.61 ms
[2022-02-13 23:55:38	                main:574]	:	INFO	:	Epoch 980 | loss: nan | val_loss: nan | Time: 2852.09 ms
[2022-02-13 23:55:41	                main:574]	:	INFO	:	Epoch 981 | loss: nan | val_loss: nan | Time: 3063.65 ms
[2022-02-13 23:55:44	                main:574]	:	INFO	:	Epoch 982 | loss: nan | val_loss: nan | Time: 2795.54 ms
[2022-02-13 23:55:47	                main:574]	:	INFO	:	Epoch 983 | loss: nan | val_loss: nan | Time: 2878.68 ms
[2022-02-13 23:55:50	                main:574]	:	INFO	:	Epoch 984 | loss: nan | val_loss: nan | Time: 2967.46 ms
[2022-02-13 23:55:53	                main:574]	:	INFO	:	Epoch 985 | loss: nan | val_loss: nan | Time: 2893.21 ms
[2022-02-13 23:55:56	                main:574]	:	INFO	:	Epoch 986 | loss: nan | val_loss: nan | Time: 3102.22 ms
[2022-02-13 23:55:58	                main:574]	:	INFO	:	Epoch 987 | loss: nan | val_loss: nan | Time: 2650.16 ms
[2022-02-13 23:56:01	                main:574]	:	INFO	:	Epoch 988 | loss: nan | val_loss: nan | Time: 2452.91 ms
[2022-02-13 23:56:04	                main:574]	:	INFO	:	Epoch 989 | loss: nan | val_loss: nan | Time: 2660.82 ms
[2022-02-13 23:56:06	                main:574]	:	INFO	:	Epoch 990 | loss: nan | val_loss: nan | Time: 2774.28 ms
[2022-02-13 23:56:09	                main:574]	:	INFO	:	Epoch 991 | loss: nan | val_loss: nan | Time: 2918.99 ms
[2022-02-13 23:56:13	                main:574]	:	INFO	:	Epoch 992 | loss: nan | val_loss: nan | Time: 3171.52 ms
[2022-02-13 23:56:16	                main:574]	:	INFO	:	Epoch 993 | loss: nan | val_loss: nan | Time: 2956.05 ms
[2022-02-13 23:56:19	                main:574]	:	INFO	:	Epoch 994 | loss: nan | val_loss: nan | Time: 3020.6 ms
[2022-02-13 23:56:22	                main:574]	:	INFO	:	Epoch 995 | loss: nan | val_loss: nan | Time: 2926.65 ms
[2022-02-13 23:56:24	                main:574]	:	INFO	:	Epoch 996 | loss: nan | val_loss: nan | Time: 2874.72 ms
[2022-02-13 23:56:28	                main:574]	:	INFO	:	Epoch 997 | loss: nan | val_loss: nan | Time: 3084.6 ms
[2022-02-13 23:56:30	                main:574]	:	INFO	:	Epoch 998 | loss: nan | val_loss: nan | Time: 2729.41 ms
[2022-02-13 23:56:33	                main:574]	:	INFO	:	Epoch 999 | loss: nan | val_loss: nan | Time: 2758.41 ms
[2022-02-13 23:56:36	                main:574]	:	INFO	:	Epoch 1000 | loss: nan | val_loss: nan | Time: 2549.83 ms
[2022-02-13 23:56:38	                main:574]	:	INFO	:	Epoch 1001 | loss: nan | val_loss: nan | Time: 2714.88 ms
[2022-02-13 23:56:42	                main:574]	:	INFO	:	Epoch 1002 | loss: nan | val_loss: nan | Time: 3430.8 ms
[2022-02-13 23:56:45	                main:574]	:	INFO	:	Epoch 1003 | loss: nan | val_loss: nan | Time: 3269.12 ms
[2022-02-13 23:56:48	                main:574]	:	INFO	:	Epoch 1004 | loss: nan | val_loss: nan | Time: 3070.58 ms
[2022-02-13 23:56:51	                main:574]	:	INFO	:	Epoch 1005 | loss: nan | val_loss: nan | Time: 2748.66 ms
[2022-02-13 23:56:54	                main:574]	:	INFO	:	Epoch 1006 | loss: nan | val_loss: nan | Time: 2797.84 ms
[2022-02-13 23:56:57	                main:574]	:	INFO	:	Epoch 1007 | loss: nan | val_loss: nan | Time: 2915.32 ms
[2022-02-13 23:56:59	                main:574]	:	INFO	:	Epoch 1008 | loss: nan | val_loss: nan | Time: 2590.83 ms
[2022-02-13 23:57:03	                main:574]	:	INFO	:	Epoch 1009 | loss: nan | val_loss: nan | Time: 2986.25 ms
[2022-02-13 23:57:06	                main:574]	:	INFO	:	Epoch 1010 | loss: nan | val_loss: nan | Time: 3214.12 ms
[2022-02-13 23:57:09	                main:574]	:	INFO	:	Epoch 1011 | loss: nan | val_loss: nan | Time: 2711.16 ms
[2022-02-13 23:57:11	                main:574]	:	INFO	:	Epoch 1012 | loss: nan | val_loss: nan | Time: 2898.79 ms
[2022-02-13 23:57:14	                main:574]	:	INFO	:	Epoch 1013 | loss: nan | val_loss: nan | Time: 2617.8 ms
[2022-02-13 23:57:17	                main:574]	:	INFO	:	Epoch 1014 | loss: nan | val_loss: nan | Time: 2559.6 ms
[2022-02-13 23:57:19	                main:574]	:	INFO	:	Epoch 1015 | loss: nan | val_loss: nan | Time: 2426.49 ms
[2022-02-13 23:57:22	                main:574]	:	INFO	:	Epoch 1016 | loss: nan | val_loss: nan | Time: 2548.63 ms
[2022-02-13 23:57:25	                main:574]	:	INFO	:	Epoch 1017 | loss: nan | val_loss: nan | Time: 2781.34 ms
[2022-02-13 23:57:28	                main:574]	:	INFO	:	Epoch 1018 | loss: nan | val_loss: nan | Time: 2908.48 ms
[2022-02-13 23:57:31	                main:574]	:	INFO	:	Epoch 1019 | loss: nan | val_loss: nan | Time: 3132.77 ms
[2022-02-13 23:57:34	                main:574]	:	INFO	:	Epoch 1020 | loss: nan | val_loss: nan | Time: 3130.95 ms
[2022-02-13 23:57:37	                main:574]	:	INFO	:	Epoch 1021 | loss: nan | val_loss: nan | Time: 2835.19 ms
[2022-02-13 23:57:39	                main:574]	:	INFO	:	Epoch 1022 | loss: nan | val_loss: nan | Time: 2531.47 ms
[2022-02-13 23:57:42	                main:574]	:	INFO	:	Epoch 1023 | loss: nan | val_loss: nan | Time: 2579.78 ms
[2022-02-13 23:57:45	                main:574]	:	INFO	:	Epoch 1024 | loss: nan | val_loss: nan | Time: 3036.95 ms
[2022-02-13 23:57:48	                main:574]	:	INFO	:	Epoch 1025 | loss: nan | val_loss: nan | Time: 2860.21 ms
[2022-02-13 23:57:51	                main:574]	:	INFO	:	Epoch 1026 | loss: nan | val_loss: nan | Time: 3028.92 ms
[2022-02-13 23:57:54	                main:574]	:	INFO	:	Epoch 1027 | loss: nan | val_loss: nan | Time: 3141.32 ms
[2022-02-13 23:57:57	                main:574]	:	INFO	:	Epoch 1028 | loss: nan | val_loss: nan | Time: 3025.15 ms
[2022-02-13 23:58:00	                main:574]	:	INFO	:	Epoch 1029 | loss: nan | val_loss: nan | Time: 2787.13 ms
[2022-02-13 23:58:03	                main:574]	:	INFO	:	Epoch 1030 | loss: nan | val_loss: nan | Time: 2749.67 ms
[2022-02-13 23:58:06	                main:574]	:	INFO	:	Epoch 1031 | loss: nan | val_loss: nan | Time: 3056.21 ms
[2022-02-13 23:58:09	                main:574]	:	INFO	:	Epoch 1032 | loss: nan | val_loss: nan | Time: 2851.91 ms
[2022-02-13 23:58:12	                main:574]	:	INFO	:	Epoch 1033 | loss: nan | val_loss: nan | Time: 2875.19 ms
[2022-02-13 23:58:15	                main:574]	:	INFO	:	Epoch 1034 | loss: nan | val_loss: nan | Time: 2814.34 ms
[2022-02-13 23:58:18	                main:574]	:	INFO	:	Epoch 1035 | loss: nan | val_loss: nan | Time: 3315.88 ms
[2022-02-13 23:58:20	                main:574]	:	INFO	:	Epoch 1036 | loss: nan | val_loss: nan | Time: 2436.94 ms
[2022-02-13 23:58:23	                main:574]	:	INFO	:	Epoch 1037 | loss: nan | val_loss: nan | Time: 2568.3 ms
[2022-02-13 23:58:26	                main:574]	:	INFO	:	Epoch 1038 | loss: nan | val_loss: nan | Time: 2913.97 ms
[2022-02-13 23:58:29	                main:574]	:	INFO	:	Epoch 1039 | loss: nan | val_loss: nan | Time: 2946.47 ms
[2022-02-13 23:58:32	                main:574]	:	INFO	:	Epoch 1040 | loss: nan | val_loss: nan | Time: 3485.28 ms
[2022-02-13 23:58:35	                main:574]	:	INFO	:	Epoch 1041 | loss: nan | val_loss: nan | Time: 2547.29 ms
[2022-02-13 23:58:38	                main:574]	:	INFO	:	Epoch 1042 | loss: nan | val_loss: nan | Time: 2832.22 ms
[2022-02-13 23:58:41	                main:574]	:	INFO	:	Epoch 1043 | loss: nan | val_loss: nan | Time: 2839.08 ms
[2022-02-13 23:58:44	                main:574]	:	INFO	:	Epoch 1044 | loss: nan | val_loss: nan | Time: 3038.27 ms
[2022-02-13 23:58:47	                main:574]	:	INFO	:	Epoch 1045 | loss: nan | val_loss: nan | Time: 3235.97 ms
[2022-02-13 23:58:50	                main:574]	:	INFO	:	Epoch 1046 | loss: nan | val_loss: nan | Time: 2714.91 ms
[2022-02-13 23:58:53	                main:574]	:	INFO	:	Epoch 1047 | loss: nan | val_loss: nan | Time: 2927.68 ms
[2022-02-13 23:58:55	                main:574]	:	INFO	:	Epoch 1048 | loss: nan | val_loss: nan | Time: 2684.25 ms
[2022-02-13 23:58:58	                main:574]	:	INFO	:	Epoch 1049 | loss: nan | val_loss: nan | Time: 2683.36 ms
[2022-02-13 23:59:01	                main:574]	:	INFO	:	Epoch 1050 | loss: nan | val_loss: nan | Time: 2987.52 ms
[2022-02-13 23:59:04	                main:574]	:	INFO	:	Epoch 1051 | loss: nan | val_loss: nan | Time: 2751.42 ms
[2022-02-13 23:59:07	                main:574]	:	INFO	:	Epoch 1052 | loss: nan | val_loss: nan | Time: 2597.99 ms
[2022-02-13 23:59:10	                main:574]	:	INFO	:	Epoch 1053 | loss: nan | val_loss: nan | Time: 3167.4 ms
[2022-02-13 23:59:12	                main:574]	:	INFO	:	Epoch 1054 | loss: nan | val_loss: nan | Time: 2562.88 ms
[2022-02-13 23:59:15	                main:574]	:	INFO	:	Epoch 1055 | loss: nan | val_loss: nan | Time: 2698.36 ms
[2022-02-13 23:59:18	                main:574]	:	INFO	:	Epoch 1056 | loss: nan | val_loss: nan | Time: 2646.29 ms
[2022-02-13 23:59:20	                main:574]	:	INFO	:	Epoch 1057 | loss: nan | val_loss: nan | Time: 2303.47 ms
[2022-02-13 23:59:22	                main:574]	:	INFO	:	Epoch 1058 | loss: nan | val_loss: nan | Time: 2314.78 ms
[2022-02-13 23:59:25	                main:574]	:	INFO	:	Epoch 1059 | loss: nan | val_loss: nan | Time: 2424.57 ms
[2022-02-13 23:59:27	                main:574]	:	INFO	:	Epoch 1060 | loss: nan | val_loss: nan | Time: 2401.89 ms
[2022-02-13 23:59:30	                main:574]	:	INFO	:	Epoch 1061 | loss: nan | val_loss: nan | Time: 2532.42 ms
[2022-02-13 23:59:33	                main:574]	:	INFO	:	Epoch 1062 | loss: nan | val_loss: nan | Time: 2561.54 ms
[2022-02-13 23:59:35	                main:574]	:	INFO	:	Epoch 1063 | loss: nan | val_loss: nan | Time: 2513.67 ms
[2022-02-13 23:59:38	                main:574]	:	INFO	:	Epoch 1064 | loss: nan | val_loss: nan | Time: 2444.18 ms
[2022-02-13 23:59:40	                main:574]	:	INFO	:	Epoch 1065 | loss: nan | val_loss: nan | Time: 2306.64 ms
[2022-02-13 23:59:42	                main:574]	:	INFO	:	Epoch 1066 | loss: nan | val_loss: nan | Time: 2503.59 ms
[2022-02-13 23:59:45	                main:574]	:	INFO	:	Epoch 1067 | loss: nan | val_loss: nan | Time: 2641.96 ms
[2022-02-13 23:59:48	                main:574]	:	INFO	:	Epoch 1068 | loss: nan | val_loss: nan | Time: 2529.11 ms
[2022-02-13 23:59:50	                main:574]	:	INFO	:	Epoch 1069 | loss: nan | val_loss: nan | Time: 2347.44 ms
[2022-02-13 23:59:53	                main:574]	:	INFO	:	Epoch 1070 | loss: nan | val_loss: nan | Time: 2478.93 ms
[2022-02-13 23:59:55	                main:574]	:	INFO	:	Epoch 1071 | loss: nan | val_loss: nan | Time: 2526.7 ms
[2022-02-13 23:59:58	                main:574]	:	INFO	:	Epoch 1072 | loss: nan | val_loss: nan | Time: 2552.34 ms
[2022-02-14 00:00:00	                main:574]	:	INFO	:	Epoch 1073 | loss: nan | val_loss: nan | Time: 2436.65 ms
[2022-02-14 00:00:03	                main:574]	:	INFO	:	Epoch 1074 | loss: nan | val_loss: nan | Time: 2360.02 ms
[2022-02-14 00:00:05	                main:574]	:	INFO	:	Epoch 1075 | loss: nan | val_loss: nan | Time: 2443.18 ms
[2022-02-14 00:00:08	                main:574]	:	INFO	:	Epoch 1076 | loss: nan | val_loss: nan | Time: 2662.4 ms
[2022-02-14 00:00:10	                main:574]	:	INFO	:	Epoch 1077 | loss: nan | val_loss: nan | Time: 2681.89 ms
[2022-02-14 00:00:13	                main:574]	:	INFO	:	Epoch 1078 | loss: nan | val_loss: nan | Time: 2479.66 ms
[2022-02-14 00:00:15	                main:574]	:	INFO	:	Epoch 1079 | loss: nan | val_loss: nan | Time: 2495.56 ms
[2022-02-14 00:00:18	                main:574]	:	INFO	:	Epoch 1080 | loss: nan | val_loss: nan | Time: 2492.67 ms
[2022-02-14 00:00:20	                main:574]	:	INFO	:	Epoch 1081 | loss: nan | val_loss: nan | Time: 2240.99 ms
[2022-02-14 00:00:22	                main:574]	:	INFO	:	Epoch 1082 | loss: nan | val_loss: nan | Time: 2181.98 ms
[2022-02-14 00:00:25	                main:574]	:	INFO	:	Epoch 1083 | loss: nan | val_loss: nan | Time: 2147.23 ms
[2022-02-14 00:00:27	                main:574]	:	INFO	:	Epoch 1084 | loss: nan | val_loss: nan | Time: 2180.44 ms
[2022-02-14 00:00:29	                main:574]	:	INFO	:	Epoch 1085 | loss: nan | val_loss: nan | Time: 2111.69 ms
[2022-02-14 00:00:31	                main:574]	:	INFO	:	Epoch 1086 | loss: nan | val_loss: nan | Time: 2213.47 ms
[2022-02-14 00:00:34	                main:574]	:	INFO	:	Epoch 1087 | loss: nan | val_loss: nan | Time: 2308.81 ms
[2022-02-14 00:00:36	                main:574]	:	INFO	:	Epoch 1088 | loss: nan | val_loss: nan | Time: 2033.36 ms
[2022-02-14 00:00:38	                main:574]	:	INFO	:	Epoch 1089 | loss: nan | val_loss: nan | Time: 2028.9 ms
[2022-02-14 00:00:40	                main:574]	:	INFO	:	Epoch 1090 | loss: nan | val_loss: nan | Time: 2062.99 ms
[2022-02-14 00:00:42	                main:574]	:	INFO	:	Epoch 1091 | loss: nan | val_loss: nan | Time: 1996.31 ms
[2022-02-14 00:00:44	                main:574]	:	INFO	:	Epoch 1092 | loss: nan | val_loss: nan | Time: 2003.67 ms
[2022-02-14 00:00:46	                main:574]	:	INFO	:	Epoch 1093 | loss: nan | val_loss: nan | Time: 2042.71 ms
[2022-02-14 00:00:48	                main:574]	:	INFO	:	Epoch 1094 | loss: nan | val_loss: nan | Time: 2058.95 ms
[2022-02-14 00:00:50	                main:574]	:	INFO	:	Epoch 1095 | loss: nan | val_loss: nan | Time: 2103.83 ms
[2022-02-14 00:00:52	                main:574]	:	INFO	:	Epoch 1096 | loss: nan | val_loss: nan | Time: 2030.64 ms
[2022-02-14 00:00:54	                main:574]	:	INFO	:	Epoch 1097 | loss: nan | val_loss: nan | Time: 2030.27 ms
[2022-02-14 00:00:56	                main:574]	:	INFO	:	Epoch 1098 | loss: nan | val_loss: nan | Time: 2003.42 ms
[2022-02-14 00:00:58	                main:574]	:	INFO	:	Epoch 1099 | loss: nan | val_loss: nan | Time: 2012.99 ms
[2022-02-14 00:01:01	                main:574]	:	INFO	:	Epoch 1100 | loss: nan | val_loss: nan | Time: 2092.45 ms
[2022-02-14 00:01:03	                main:574]	:	INFO	:	Epoch 1101 | loss: nan | val_loss: nan | Time: 1993.5 ms
[2022-02-14 00:01:05	                main:574]	:	INFO	:	Epoch 1102 | loss: nan | val_loss: nan | Time: 2241.32 ms
[2022-02-14 00:01:07	                main:574]	:	INFO	:	Epoch 1103 | loss: nan | val_loss: nan | Time: 2164.42 ms
[2022-02-14 00:01:09	                main:574]	:	INFO	:	Epoch 1104 | loss: nan | val_loss: nan | Time: 2165.86 ms
[2022-02-14 00:01:11	                main:574]	:	INFO	:	Epoch 1105 | loss: nan | val_loss: nan | Time: 2135.02 ms
[2022-02-14 00:01:13	                main:574]	:	INFO	:	Epoch 1106 | loss: nan | val_loss: nan | Time: 2002.53 ms
[2022-02-14 00:01:15	                main:574]	:	INFO	:	Epoch 1107 | loss: nan | val_loss: nan | Time: 1988.71 ms
[2022-02-14 00:01:17	                main:574]	:	INFO	:	Epoch 1108 | loss: nan | val_loss: nan | Time: 1994.79 ms
[2022-02-14 00:01:20	                main:574]	:	INFO	:	Epoch 1109 | loss: nan | val_loss: nan | Time: 2057.67 ms
[2022-02-14 00:01:22	                main:574]	:	INFO	:	Epoch 1110 | loss: nan | val_loss: nan | Time: 2041.76 ms
[2022-02-14 00:01:24	                main:574]	:	INFO	:	Epoch 1111 | loss: nan | val_loss: nan | Time: 2256.53 ms
[2022-02-14 00:01:26	                main:574]	:	INFO	:	Epoch 1112 | loss: nan | val_loss: nan | Time: 2238.49 ms
[2022-02-14 00:01:28	                main:574]	:	INFO	:	Epoch 1113 | loss: nan | val_loss: nan | Time: 2238.68 ms
[2022-02-14 00:01:31	                main:574]	:	INFO	:	Epoch 1114 | loss: nan | val_loss: nan | Time: 2155.35 ms
[2022-02-14 00:01:33	                main:574]	:	INFO	:	Epoch 1115 | loss: nan | val_loss: nan | Time: 2101.67 ms
[2022-02-14 00:01:35	                main:574]	:	INFO	:	Epoch 1116 | loss: nan | val_loss: nan | Time: 1990.43 ms
[2022-02-14 00:01:37	                main:574]	:	INFO	:	Epoch 1117 | loss: nan | val_loss: nan | Time: 1947.27 ms
[2022-02-14 00:01:39	                main:574]	:	INFO	:	Epoch 1118 | loss: nan | val_loss: nan | Time: 2006.77 ms
[2022-02-14 00:01:41	                main:574]	:	INFO	:	Epoch 1119 | loss: nan | val_loss: nan | Time: 2005.63 ms
[2022-02-14 00:01:43	                main:574]	:	INFO	:	Epoch 1120 | loss: nan | val_loss: nan | Time: 2008.17 ms
[2022-02-14 00:01:45	                main:574]	:	INFO	:	Epoch 1121 | loss: nan | val_loss: nan | Time: 1994.53 ms
[2022-02-14 00:01:47	                main:574]	:	INFO	:	Epoch 1122 | loss: nan | val_loss: nan | Time: 2013.66 ms
[2022-02-14 00:01:49	                main:574]	:	INFO	:	Epoch 1123 | loss: nan | val_loss: nan | Time: 2063.18 ms
[2022-02-14 00:01:51	                main:574]	:	INFO	:	Epoch 1124 | loss: nan | val_loss: nan | Time: 2001.06 ms
[2022-02-14 00:01:53	                main:574]	:	INFO	:	Epoch 1125 | loss: nan | val_loss: nan | Time: 1968.66 ms
[2022-02-14 00:01:55	                main:574]	:	INFO	:	Epoch 1126 | loss: nan | val_loss: nan | Time: 2039.93 ms
[2022-02-14 00:01:57	                main:574]	:	INFO	:	Epoch 1127 | loss: nan | val_loss: nan | Time: 2079.02 ms
[2022-02-14 00:01:59	                main:574]	:	INFO	:	Epoch 1128 | loss: nan | val_loss: nan | Time: 1989.17 ms
[2022-02-14 00:02:01	                main:574]	:	INFO	:	Epoch 1129 | loss: nan | val_loss: nan | Time: 1978.63 ms
[2022-02-14 00:02:03	                main:574]	:	INFO	:	Epoch 1130 | loss: nan | val_loss: nan | Time: 1974.09 ms
[2022-02-14 00:02:05	                main:574]	:	INFO	:	Epoch 1131 | loss: nan | val_loss: nan | Time: 1950.64 ms
[2022-02-14 00:02:07	                main:574]	:	INFO	:	Epoch 1132 | loss: nan | val_loss: nan | Time: 1965.81 ms
[2022-02-14 00:02:09	                main:574]	:	INFO	:	Epoch 1133 | loss: nan | val_loss: nan | Time: 1965.71 ms
[2022-02-14 00:02:11	                main:574]	:	INFO	:	Epoch 1134 | loss: nan | val_loss: nan | Time: 1964.42 ms
[2022-02-14 00:02:13	                main:574]	:	INFO	:	Epoch 1135 | loss: nan | val_loss: nan | Time: 1970.98 ms
[2022-02-14 00:02:15	                main:574]	:	INFO	:	Epoch 1136 | loss: nan | val_loss: nan | Time: 1965.46 ms
[2022-02-14 00:02:17	                main:574]	:	INFO	:	Epoch 1137 | loss: nan | val_loss: nan | Time: 1965.96 ms
[2022-02-14 00:02:20	                main:574]	:	INFO	:	Epoch 1138 | loss: nan | val_loss: nan | Time: 2480.26 ms
[2022-02-14 00:02:22	                main:574]	:	INFO	:	Epoch 1139 | loss: nan | val_loss: nan | Time: 2163.87 ms
[2022-02-14 00:02:24	                main:574]	:	INFO	:	Epoch 1140 | loss: nan | val_loss: nan | Time: 2112.3 ms
[2022-02-14 00:02:26	                main:574]	:	INFO	:	Epoch 1141 | loss: nan | val_loss: nan | Time: 2008.56 ms
[2022-02-14 00:02:28	                main:574]	:	INFO	:	Epoch 1142 | loss: nan | val_loss: nan | Time: 2068.32 ms
[2022-02-14 00:02:30	                main:574]	:	INFO	:	Epoch 1143 | loss: nan | val_loss: nan | Time: 2005.99 ms
[2022-02-14 00:02:33	                main:574]	:	INFO	:	Epoch 1144 | loss: nan | val_loss: nan | Time: 2048.12 ms
[2022-02-14 00:02:35	                main:574]	:	INFO	:	Epoch 1145 | loss: nan | val_loss: nan | Time: 2126.61 ms
[2022-02-14 00:02:37	                main:574]	:	INFO	:	Epoch 1146 | loss: nan | val_loss: nan | Time: 2089.09 ms
[2022-02-14 00:02:39	                main:574]	:	INFO	:	Epoch 1147 | loss: nan | val_loss: nan | Time: 2111.98 ms
[2022-02-14 00:02:41	                main:574]	:	INFO	:	Epoch 1148 | loss: nan | val_loss: nan | Time: 2073.89 ms
[2022-02-14 00:02:43	                main:574]	:	INFO	:	Epoch 1149 | loss: nan | val_loss: nan | Time: 2079.14 ms
[2022-02-14 00:02:45	                main:574]	:	INFO	:	Epoch 1150 | loss: nan | val_loss: nan | Time: 2054.66 ms
[2022-02-14 00:02:47	                main:574]	:	INFO	:	Epoch 1151 | loss: nan | val_loss: nan | Time: 1988.46 ms
[2022-02-14 00:02:49	                main:574]	:	INFO	:	Epoch 1152 | loss: nan | val_loss: nan | Time: 1974.64 ms
[2022-02-14 00:02:51	                main:574]	:	INFO	:	Epoch 1153 | loss: nan | val_loss: nan | Time: 1975.04 ms
[2022-02-14 00:02:53	                main:574]	:	INFO	:	Epoch 1154 | loss: nan | val_loss: nan | Time: 2082.25 ms
[2022-02-14 00:02:55	                main:574]	:	INFO	:	Epoch 1155 | loss: nan | val_loss: nan | Time: 2068.19 ms
[2022-02-14 00:02:58	                main:574]	:	INFO	:	Epoch 1156 | loss: nan | val_loss: nan | Time: 2073.84 ms
[2022-02-14 00:03:00	                main:574]	:	INFO	:	Epoch 1157 | loss: nan | val_loss: nan | Time: 2031.31 ms
[2022-02-14 00:03:02	                main:574]	:	INFO	:	Epoch 1158 | loss: nan | val_loss: nan | Time: 2078.47 ms
[2022-02-14 00:03:04	                main:574]	:	INFO	:	Epoch 1159 | loss: nan | val_loss: nan | Time: 2048.94 ms
[2022-02-14 00:03:06	                main:574]	:	INFO	:	Epoch 1160 | loss: nan | val_loss: nan | Time: 2006.94 ms
[2022-02-14 00:03:08	                main:574]	:	INFO	:	Epoch 1161 | loss: nan | val_loss: nan | Time: 2002.54 ms
[2022-02-14 00:03:10	                main:574]	:	INFO	:	Epoch 1162 | loss: nan | val_loss: nan | Time: 2052.86 ms
[2022-02-14 00:03:12	                main:574]	:	INFO	:	Epoch 1163 | loss: nan | val_loss: nan | Time: 2044.95 ms
[2022-02-14 00:03:14	                main:574]	:	INFO	:	Epoch 1164 | loss: nan | val_loss: nan | Time: 2094.36 ms
[2022-02-14 00:03:16	                main:574]	:	INFO	:	Epoch 1165 | loss: nan | val_loss: nan | Time: 2095.07 ms
[2022-02-14 00:03:19	                main:574]	:	INFO	:	Epoch 1166 | loss: nan | val_loss: nan | Time: 2143.85 ms
[2022-02-14 00:03:21	                main:574]	:	INFO	:	Epoch 1167 | loss: nan | val_loss: nan | Time: 2054.49 ms
[2022-02-14 00:03:23	                main:574]	:	INFO	:	Epoch 1168 | loss: nan | val_loss: nan | Time: 2149.96 ms
[2022-02-14 00:03:25	                main:574]	:	INFO	:	Epoch 1169 | loss: nan | val_loss: nan | Time: 2135.81 ms
[2022-02-14 00:03:27	                main:574]	:	INFO	:	Epoch 1170 | loss: nan | val_loss: nan | Time: 2158.71 ms
[2022-02-14 00:03:29	                main:574]	:	INFO	:	Epoch 1171 | loss: nan | val_loss: nan | Time: 2213.13 ms
[2022-02-14 00:03:32	                main:574]	:	INFO	:	Epoch 1172 | loss: nan | val_loss: nan | Time: 2131.92 ms
[2022-02-14 00:03:34	                main:574]	:	INFO	:	Epoch 1173 | loss: nan | val_loss: nan | Time: 2010.71 ms
[2022-02-14 00:03:36	                main:574]	:	INFO	:	Epoch 1174 | loss: nan | val_loss: nan | Time: 2045.15 ms
[2022-02-14 00:03:38	                main:574]	:	INFO	:	Epoch 1175 | loss: nan | val_loss: nan | Time: 2011.54 ms
[2022-02-14 00:03:40	                main:574]	:	INFO	:	Epoch 1176 | loss: nan | val_loss: nan | Time: 1993.73 ms
[2022-02-14 00:03:42	                main:574]	:	INFO	:	Epoch 1177 | loss: nan | val_loss: nan | Time: 2003.88 ms
[2022-02-14 00:03:44	                main:574]	:	INFO	:	Epoch 1178 | loss: nan | val_loss: nan | Time: 2074.8 ms
[2022-02-14 00:03:47	                main:574]	:	INFO	:	Epoch 1179 | loss: nan | val_loss: nan | Time: 2005.75 ms
[2022-02-14 00:03:49	                main:574]	:	INFO	:	Epoch 1180 | loss: nan | val_loss: nan | Time: 2012.18 ms
[2022-02-14 00:03:51	                main:574]	:	INFO	:	Epoch 1181 | loss: nan | val_loss: nan | Time: 2015.7 ms
[2022-02-14 00:03:53	                main:574]	:	INFO	:	Epoch 1182 | loss: nan | val_loss: nan | Time: 2041.59 ms
[2022-02-14 00:03:55	                main:574]	:	INFO	:	Epoch 1183 | loss: nan | val_loss: nan | Time: 2141.12 ms
[2022-02-14 00:03:57	                main:574]	:	INFO	:	Epoch 1184 | loss: nan | val_loss: nan | Time: 2140.98 ms
[2022-02-14 00:03:59	                main:574]	:	INFO	:	Epoch 1185 | loss: nan | val_loss: nan | Time: 2048.05 ms
[2022-02-14 00:04:01	                main:574]	:	INFO	:	Epoch 1186 | loss: nan | val_loss: nan | Time: 2093.51 ms
[2022-02-14 00:04:04	                main:574]	:	INFO	:	Epoch 1187 | loss: nan | val_loss: nan | Time: 2154.09 ms
[2022-02-14 00:04:06	                main:574]	:	INFO	:	Epoch 1188 | loss: nan | val_loss: nan | Time: 2150.73 ms
[2022-02-14 00:04:08	                main:574]	:	INFO	:	Epoch 1189 | loss: nan | val_loss: nan | Time: 1994.33 ms
[2022-02-14 00:04:10	                main:574]	:	INFO	:	Epoch 1190 | loss: nan | val_loss: nan | Time: 1996.48 ms
[2022-02-14 00:04:12	                main:574]	:	INFO	:	Epoch 1191 | loss: nan | val_loss: nan | Time: 1997.96 ms
[2022-02-14 00:04:14	                main:574]	:	INFO	:	Epoch 1192 | loss: nan | val_loss: nan | Time: 1986.13 ms
[2022-02-14 00:04:16	                main:574]	:	INFO	:	Epoch 1193 | loss: nan | val_loss: nan | Time: 2113.63 ms
[2022-02-14 00:04:18	                main:574]	:	INFO	:	Epoch 1194 | loss: nan | val_loss: nan | Time: 2040.35 ms
[2022-02-14 00:04:20	                main:574]	:	INFO	:	Epoch 1195 | loss: nan | val_loss: nan | Time: 1985.85 ms
[2022-02-14 00:04:22	                main:574]	:	INFO	:	Epoch 1196 | loss: nan | val_loss: nan | Time: 2132.2 ms
[2022-02-14 00:04:25	                main:574]	:	INFO	:	Epoch 1197 | loss: nan | val_loss: nan | Time: 2013.13 ms
[2022-02-14 00:04:27	                main:574]	:	INFO	:	Epoch 1198 | loss: nan | val_loss: nan | Time: 2169.16 ms
[2022-02-14 00:04:29	                main:574]	:	INFO	:	Epoch 1199 | loss: nan | val_loss: nan | Time: 2176.59 ms
[2022-02-14 00:04:31	                main:574]	:	INFO	:	Epoch 1200 | loss: nan | val_loss: nan | Time: 2173.7 ms


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x00007FF9F2CEE7F5 read attempt to address 0xFFFFFFFF

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 02/14/22 00:04:32
Install Directory : H:\Program Files\BOINC\
Data Directory    : H:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( H:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( H:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( H:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( H:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: H:\ProgramData\BOINC\slots\122;H:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 000000006fa30000 00000000003df000 H:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000342c0000 00000000001f0000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.18362.815) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000032670000 00000000000b2000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.18362.959 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.959

ModLoad: 0000000031d60000 00000000002a4000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.18362.959 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.959

ModLoad: 00000000324b0000 0000000000194000 C:\WINDOWS\System32\USER32.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000032070000 0000000000021000 C:\WINDOWS\System32\win32u.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.18362.959 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.959

ModLoad: 0000000032840000 0000000000026000 C:\WINDOWS\System32\GDI32.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000320a0000 0000000000196000 C:\WINDOWS\System32\gdi32full.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.18362.959 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.959

ModLoad: 0000000031b70000 000000000009e000 C:\WINDOWS\System32\msvcp_win.dll (6.2.18362.815) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.18362.815 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.815

ModLoad: 00000000319f0000 00000000000fa000 C:\WINDOWS\System32\ucrtbase.dll (6.2.18362.815) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.18362.815 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.815

ModLoad: 0000000033b20000 00000000000a3000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.18362.752) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000032740000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.18362.1

ModLoad: 0000000033be0000 0000000000097000 C:\WINDOWS\System32\sechost.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000032aa0000 0000000000120000 C:\WINDOWS\System32\RPCRT4.dll (6.2.18362.628) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000024800000 0000000000058000 H:\ProgramData\BOINC\slots\122\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000001ade0000 0000000000091000 H:\ProgramData\BOINC\slots\122\MSVCP140.dll (14.27.29112.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.27.29112.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.27.29112.0

ModLoad: 000000001e700000 00000000001f4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000021c90000 0000000000019000 H:\ProgramData\BOINC\slots\122\VCRUNTIME140.dll (14.27.29112.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.27.29112.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.27.29112.0

ModLoad: 000000002eb10000 000000000000c000 H:\ProgramData\BOINC\slots\122\VCRUNTIME140_1.dll (14.27.29112.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.27.29112.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.27.29112.0

ModLoad: 00000000c9720000 000000000abe7000 H:\ProgramData\BOINC\slots\122\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000013e80000 00000000002db000 H:\ProgramData\BOINC\slots\122\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000001e1e0000 0000000000040000 H:\ProgramData\BOINC\slots\122\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000003920000 000000000020d000 H:\ProgramData\BOINC\slots\122\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 00000000a4bd0000 0000000024b49000 H:\ProgramData\BOINC\slots\122\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000181e0000 0000000000045000 H:\ProgramData\BOINC\slots\122\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000e4bd0000 00000000034b2000 H:\ProgramData\BOINC\slots\122\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000eace0000 00000000030a5000 H:\ProgramData\BOINC\slots\122\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 000000002ad30000 0000000000010000 H:\ProgramData\BOINC\slots\122\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 00000000a0e70000 0000000003d5b000 H:\ProgramData\BOINC\slots\122\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000e2d00000 0000000001eca000 H:\ProgramData\BOINC\slots\122\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 0000000060f70000 000000001b3a4000 H:\ProgramData\BOINC\slots\122\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 0000000057dd0000 000000000919f000 H:\ProgramData\BOINC\slots\122\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 0000000032240000 0000000000080000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.18362.836) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.18362.836 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.836

ModLoad: 0000000033de0000 000000000002e000 C:\WINDOWS\System32\IMM32.DLL (6.2.18362.387) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.18362.387 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.387

ModLoad: 0000000031180000 0000000000011000 C:\WINDOWS\System32\kernel.appcore.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 000000002fe10000 0000000000020000 C:\WINDOWS\SYSTEM32\dxcore.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : DXCore.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000031b20000 000000000004a000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.18362.387) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.18362.387 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.387

ModLoad: 00000000334b0000 0000000000335000 C:\WINDOWS\System32\combase.dll (6.2.18362.900) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000033e10000 0000000000470000 C:\WINDOWS\System32\Setupapi.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000031af0000 0000000000026000 C:\WINDOWS\System32\bcrypt.dll (6.2.18362.267) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000030f10000 000000000002a000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.18362.387) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.18362.387 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.387

ModLoad: 0000000032010000 000000000005c000 C:\WINDOWS\System32\WINTRUST.dll (6.2.18362.387) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.18362.387 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.387

ModLoad: 00000000311a0000 0000000000012000 C:\WINDOWS\System32\MSASN1.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000031c10000 0000000000149000 C:\WINDOWS\System32\CRYPT32.dll (6.2.18362.592) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000032bc0000 00000000006e6000 C:\WINDOWS\System32\Shell32.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.18362.900 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.900

ModLoad: 00000000332b0000 00000000000a9000 C:\WINDOWS\System32\shcore.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000031260000 0000000000782000 C:\WINDOWS\System32\windows.storage.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 00000000311c0000 0000000000023000 C:\WINDOWS\System32\profapi.dll (6.2.18362.693) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : profapi.pdb
    File Version          : 10.0.18362.693 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.693

ModLoad: 00000000311f0000 000000000004a000 C:\WINDOWS\System32\powrprof.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : powrprof.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000031170000 0000000000010000 C:\WINDOWS\System32\UMPDC.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : UMPDC.pdb

ModLoad: 00000000327e0000 0000000000052000 C:\WINDOWS\System32\shlwapi.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000031240000 0000000000017000 C:\WINDOWS\System32\cryptsp.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptsp.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000017a30000 0000000000267000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.5730) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 27.21.14.5730
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.1.114 driver
    Product Version       : 27.21.14.5730

ModLoad: 000000002f150000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000f2b80000 000000000152c000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_5dcb5bbf5c3edcf2\nvcuda64.dll (27.21.14.5730) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 27.21.14.5730
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.1.114 driver
    Product Version       : 27.21.14.5730

ModLoad: 00000000338d0000 000000000006f000 C:\WINDOWS\System32\WS2_32.dll (6.2.18362.387) (-exported- Symbols Loaded)
    Linked PDB Filename   : ws2_32.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 000000002f120000 000000000002f000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000030ab0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 000000002f4a0000 0000000000099000 C:\WINDOWS\system32\uxtheme.dll (6.2.18362.449) (-exported- Symbols Loaded)
    Linked PDB Filename   : UxTheme.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 00000000295b0000 00000000006d6000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.5730) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 27.21.14.5730
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 27.21.14.5730

ModLoad: 0000000033c80000 0000000000157000 C:\WINDOWS\System32\OLE32.DLL (6.2.18362.693) (-exported- Symbols Loaded)
    Linked PDB Filename   : ole32.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000021d60000 0000000000009000 H:\ProgramData\BOINC\slots\122\caffe2_nvrtc.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000f1980000 0000000000fca000 H:\ProgramData\BOINC\slots\122\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6.14.11.9000
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.89 NVRTC Library
    Product Version       : 6.14.11.9000



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 4821, Write: 4364, Other 15409

- I/O Transfers Counters -
Read: 11460235, Write: 529450, Other 112716

- Paged Pool Usage -
QuotaPagedPoolUsage: 3535464, QuotaPeakPagedPoolUsage: 3535464
QuotaNonPagedPoolUsage: 59288, QuotaPeakNonPagedPoolUsage: 59760

- Virtual Memory Usage -
VirtualSize: 354881536, PeakVirtualSize: 977850368

- Pagefile Usage -
PagefileUsage: 354881536, PeakPagefileUsage: 354881536

- Working Set Size -
WorkingSetSize: -2118520832, PeakWorkingSetSize: -2041278464, PageFaultCount: 1058310

*** Dump of thread ID 18032 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 5642500096.000000, User Time: 14855156736.000000, Wait Time: 356388384.000000

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x00007FF9F2CEE7F5 read attempt to address 0xFFFFFFFF

- Registers -
rax=0000000000000000 rbx=000000004e602590 rcx=00000000c75705a0 rdx=000000004e602590 rsi=00000000576f5610 rdi=00000000c75705a0
r8=0000000000000100 r9=0000000000000001 r10=0000000000000018 r11=0000000000000094 r12=0000000000000001 r13=0000000000000001
r14=000000004e602590 r15=0000000000000003 rip=00000000f2cee7f5 rsp=00000000c7570438 rbp=00000000c7570590
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00010246

- Callstack -
ChildEBP RetAddr  Args to Child
c7570430 f2bb8363 4e602590 c75705a0 c7570498 576f5610 nvcuda64!+0x0 
c7570480 f2bb890c 576f5620 576f5610 4e602590 576f5620 nvcuda64!+0x0 
c7570710 f2d81108 00004000 61f90b00 00000000 61d14de7 nvcuda64!+0x0 
c7570880 61d129b6 00000001 00000100 00000000 61f90b00 nvcuda64!cuLaunchKernel+0x0 
c7570990 61d0fdf4 61f90b00 55f4ffd0 4e602590 c7570bb0 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
c7570b10 61f7bb21 61f90b00 00000000 61f90b00 00000000 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
c7570c80 61e7de74 39091950 3ab92000 3907e000 00000090 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
c7570eb0 61e8f99d 00000000 63181400 00000000 61f90b00 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
c7570f10 61e5703b 00000000 00000000 39091950 c7571020 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
c75713a0 61d743bc 00000000 c757148c 00000000 b9d35950 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
c7571670 61d7700e c75716b8 b9d46a40 d1310ca0 55f4ff40 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
c7571760 61c782ca b9d35950 00000000 00000000 00000024 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
c7571830 61c8a9bb 0000000c 3907e000 00000002 00000000 cudnn64_7!cudnnSetAttnDescriptor+0x0 
c7571ce0 61c7eff1 c7573fc8 3e0a2720 00000005 cd995230 cudnn64_7!cudnnSetRNNProjectionLayers+0x0 
c7571e80 61c87d8e d113e900 00000000 cd995230 c7572148 cudnn64_7!cudnnSetRNNProjectionLayers+0x0 
c7572020 61c9dcd3 00000000 00000000 ce1f8240 c7572140 cudnn64_7!cudnnSetRNNProjectionLayers+0x0 
c75741b0 a79489fd d11471e0 39000000 d11471e0 3e0a2720 cudnn64_7!cudnnRNNForwardTraining+0x0 
c7574690 a79a25ea c7574758 00000001 c7574758 00000001 torch_cuda!at::native::_cudnn_rnn+0x0 
c7574770 a79b0cbf c7574e60 c7576668 c75757b0 342fc43f torch_cuda!at::native::set_storage_cuda_+0x0 
c7574850 cf16b9fc c7574e60 00000000 ba1e0f30 ba1e0f00 torch_cuda!at::native::set_storage_cuda_+0x0 
c75749d0 cf1a31a2 00000001 d09167c2 c7574a04 342fc43f torch_cpu!at::native::mkldnn_sigmoid_+0x0 
c7574cb0 d0452613 00000000 00000000 00000003 b025fd78 torch_cpu!at::_cudnn_rnn+0x0 
c75751b0 d046080b c8044155 ce0116a0 c75752e0 00000004 torch_cpu!torch::autograd::NotImplemented::~NotImplemented+0x0 
c7575290 cf16b9fc c7575810 f2ba5a07 c75754c8 c7575340 torch_cpu!torch::autograd::GraphRoot::apply+0x0 
c7575410 cf1a31a2 cd9966e0 00000000 c80443c5 a886a3f0 torch_cpu!at::native::mkldnn_sigmoid_+0x0 
c75756f0 a79469a1 c7570001 00000001 00000004 00000004 torch_cpu!at::_cudnn_rnn+0x0 
c75758c0 a7950117 00000000 c7576668 181e2e0d c75759e0 torch_cuda!at::native::_use_cudnn_ctc_loss+0x0 
c7575950 ceef107b d4041ac0 c7575c70 8b01735e 57486800 torch_cuda!at::native::_cudnn_rnn_flatten_weight+0x0 
c7575bc0 cef23b16 00000001 c7576668 00000080 cee0f018 torch_cpu!at::native::fbgemm_pack_quantized_matrix+0x0 
c7575d50 cf29ae89 c7575dc8 00000001 c7575dc8 00000001 torch_cpu!at::native::gru+0x0 
c7575de0 d0589fa3 c7575ee0 00000001 c7576060 c7576668 torch_cpu!at::zeros_out+0x0 
c7575e70 cf28dd35 24851ea8 56dcc650 00000000 24851ea8 torch_cpu!torch::autograd::GraphRoot::apply+0x0 
c7575ef0 cf1688ec d40475c8 ceceea63 d2604d98 3d50d170 torch_cpu!at::zeros_out+0x0 
c7575ff0 cf1dc1bb 0000000c 00000080 00000004 ce011c00 torch_cpu!at::native::mkldnn_sigmoid_+0x0 
c7576070 d0cc7294 c7576190 3d50d170 c7576180 c7576328 torch_cpu!at::gru+0x0 
c75762a0 d0cc62ab c7576640 cf0f030e c7576640 c7576668 torch_cpu!torch::nn::GRUImpl::forward_helper+0x0 
c7576390 6fa42621 00000004 c75770a0 00000000 24851ea8 torch_cpu!torch::nn::GRUImpl::forward+0x0 
c7576590 6fa4705a 00000000 c7570000 c7570601 00000004 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::error+0x0 
c7576a90 6fa4b950 c7576b90 c7576b90 00000000 7ec5ca90 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0 
c758f830 6fc8c6f8 57257cd0 00000000 00000000 5726fce0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
c758f870 32687bd4 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
c758f8a0 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
c758f920 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 2364 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 356388384.000000

- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000c7cffd10 rsi=0000000000000000 rdi=0000000000000064
r8=00000000c7cffce8 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000003435c6f4 rsp=00000000c7cffce8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
c7cffce0 31da6891 c7cffda8 00000000 00000000 00000000 ntdll!ZwDelayExecution+0x0 
c7cffd80 6fa6a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0 
c7cffdb0 32687bd4 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
c7cffde0 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
c7cffe60 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 16764 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 356388384.000000

- Registers -
rax=000000000000005b rbx=000000000000000b rcx=000000000000000b rdx=00000000c7dff740 rsi=0000000000000000 rdi=000000000000000b
r8=0000000000000001 r9=0000000000000000 r10=00000000569933d0 r11=00000000c7dff6d8 r12=0000000000000064 r13=00000000c7dff740
r14=00000000c7dff430 r15=0000000000000000 rip=000000003435cbc4 rsp=00000000c7dff3d8 rbp=0000000057469e60
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
c7dff3d0 31db8037 33ca3880 343337d4 00000000 c774a000 ntdll!NtWaitForMultipleObjects+0x0 
c7dff6d0 31db7f1e f3074b48 55993a60 0000000b 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
c7dff710 f2d2bb54 5746cb60 00000000 57468300 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
c7dff950 f2dc09ed 00000000 00000004 00000000 00000000 nvcuda64!+0x0 
c7dffa00 f2d2b523 5625bea7 84d8eff2 57d67240 00000000 nvcuda64!cuProfilerStop+0x0 
c7dffa30 f303a750 57d67240 00000000 00000000 00000000 nvcuda64!+0x0 
c7dffa60 32687bd4 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
c7dffa90 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
c7dffb10 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 6280 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 356173504.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002b0 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002b0
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000057451150 r13=0000000000000000
r14=00000000000002b0 r15=0000000000000000 rip=000000003435c0f4 rsp=00000000c7effd68 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
c7effd60 31d98b03 00000000 00000000 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0 
c7effe00 f2f3bf48 00000000 31d84975 00000000 000002b0 KERNELBASE!WaitForSingleObjectEx+0x0 
c7effe70 f2d2b523 00000001 57b98a90 5598e5a0 00000000 nvcuda64!cuProfilerStop+0x0 
c7effea0 f303a750 5598e5a0 00000000 00000000 00000000 nvcuda64!+0x0 
c7effed0 32687bd4 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
c7efff00 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
c7efff80 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 21904 (state: Waiting): ***

- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 356388352.000000

- Registers -
rax=00000000000001ca rbx=0000000000000000 rcx=00000000576f3258 rdx=00000000c7fff8e8 rsi=00000000c7fff850 rdi=0000000000000000
r8=0000000000000001 r9=0000000000005590 r10=00000000576f7e28 r11=000000006a00730f r12=00000000c7fff8e8 r13=0000000000000000
r14=00000000576f3258 r15=00000000576f7e28 rip=000000003435f9a4 rsp=00000000c7fff828 rbp=00000000c7fff880
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
c7fff820 34320815 00000102 00000102 00000000 c7fff850 ntdll!ZwWaitForAlertByThreadId+0x0 
c7fff890 31ddc2b9 576f5610 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0 
c7fff8c0 f2cb223a 576f5610 576f5610 576f5610 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0 
c7fff920 f2d2b523 00000004 5620f59a 5620f59b 00000000 nvcuda64!+0x0 
c7fff950 f303a750 57d67390 00000000 00000000 00000000 nvcuda64!+0x0 
c7fff980 32687bd4 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
c7fff9b0 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
c7fffa30 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 6040 (state: Waiting): ***

- Information -
Status: Wait Reason: Unknown, , Kernel Time: 981093760.000000, User Time: 11490781184.000000, Wait Time: 356388384.000000

- Registers -
rax=00000000000001ca rbx=0000000000000000 rcx=00000000b04665d8 rdx=0000000000000000 rsi=0000000000000000 rdi=0000000000000000
r8=00000000cd5e0050 r9=0000000000000002 r10=000000000000000c r11=00000000cd997630 r12=0000000000000004 r13=00000000000001c0
r14=00000000b0466588 r15=0000000000000000 rip=000000003435f9a4 rsp=00000000c80ff258 rbp=00000000b04665d8
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
c80ff250 34320590 c80ff380 ba57bb58 c80ff5c0 d090092a ntdll!ZwWaitForAlertByThreadId+0x0 
c80ff2c0 31d858fd b0466580 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableSRW+0x0 
c80ff300 1ae1ba8d ba1fb480 ba1fb480 ba1fb480 00000000 KERNELBASE!SleepConditionVariableSRW+0x0 
c80ff340 1adf2848 ba2130a0 00000000 00000000 d09005b4 MSVCP140!__crtSetThreadpoolWait+0x0 
c80ff370 1adf2710 00000000 1adf2f17 00000000 ba2130a0 MSVCP140!std::_Winerror_message+0x0 
c80ff3e0 d090064b ba213080 000001c0 b0466580 b0466580 MSVCP140!std::_Winerror_message+0x0 
c80ff420 d09025b1 d0f33070 ffffffff ba213080 ffffffff torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0 
c80ff710 d0902471 d3e26d10 c80ff750 d3e26d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0 
c80ff760 d08f9744 00080001 ce9ca810 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0 
c80ff790 31a10e82 ce9ca810 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0 
c80ff7c0 32687bd4 00000000 00000000 00000000 00000000 ucrtbase!_beginthreadex+0x0 
c80ff7f0 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
c80ff870 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)