Task 4645374

Name ParityModified-1617250232-30878-1_0
Workunit 2656498
Created 6 Apr 2021, 16:26:36 UTC
Sent 12 Apr 2021, 14:29:51 UTC
Report deadline 19 Apr 2021, 14:29:51 UTC
Received 13 Apr 2021, 22:14:53 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 6310
Run time 1 hours 7 min 17 sec
CPU time 1 hours 6 min 11 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 1,131.77 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.64 GB
Peak swap size 3.59 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
  main:574]	:	INFO	:	Epoch 1046 | loss: nan | val_loss: nan | Time: 3206.19 ms
[2021-04-13 23:40:02	                main:574]	:	INFO	:	Epoch 1047 | loss: nan | val_loss: nan | Time: 3232.49 ms
[2021-04-13 23:40:05	                main:574]	:	INFO	:	Epoch 1048 | loss: nan | val_loss: nan | Time: 3215.15 ms
[2021-04-13 23:40:09	                main:574]	:	INFO	:	Epoch 1049 | loss: nan | val_loss: nan | Time: 3270.15 ms
[2021-04-13 23:40:12	                main:574]	:	INFO	:	Epoch 1050 | loss: nan | val_loss: nan | Time: 3225.96 ms
[2021-04-13 23:40:15	                main:574]	:	INFO	:	Epoch 1051 | loss: nan | val_loss: nan | Time: 3183.94 ms
[2021-04-13 23:40:18	                main:574]	:	INFO	:	Epoch 1052 | loss: nan | val_loss: nan | Time: 3213.34 ms
[2021-04-13 23:40:21	                main:574]	:	INFO	:	Epoch 1053 | loss: nan | val_loss: nan | Time: 3195.12 ms
[2021-04-13 23:40:25	                main:574]	:	INFO	:	Epoch 1054 | loss: nan | val_loss: nan | Time: 3187.31 ms
[2021-04-13 23:40:28	                main:574]	:	INFO	:	Epoch 1055 | loss: nan | val_loss: nan | Time: 3275.49 ms
[2021-04-13 23:40:31	                main:574]	:	INFO	:	Epoch 1056 | loss: nan | val_loss: nan | Time: 3216.17 ms
[2021-04-13 23:40:34	                main:574]	:	INFO	:	Epoch 1057 | loss: nan | val_loss: nan | Time: 3236.39 ms
[2021-04-13 23:40:38	                main:574]	:	INFO	:	Epoch 1058 | loss: nan | val_loss: nan | Time: 3254.98 ms
[2021-04-13 23:40:41	                main:574]	:	INFO	:	Epoch 1059 | loss: nan | val_loss: nan | Time: 3207.1 ms
[2021-04-13 23:40:44	                main:574]	:	INFO	:	Epoch 1060 | loss: nan | val_loss: nan | Time: 3206.84 ms
[2021-04-13 23:40:47	                main:574]	:	INFO	:	Epoch 1061 | loss: nan | val_loss: nan | Time: 3212.03 ms
[2021-04-13 23:40:51	                main:574]	:	INFO	:	Epoch 1062 | loss: nan | val_loss: nan | Time: 3262.02 ms
[2021-04-13 23:40:54	                main:574]	:	INFO	:	Epoch 1063 | loss: nan | val_loss: nan | Time: 3214.67 ms
[2021-04-13 23:40:57	                main:574]	:	INFO	:	Epoch 1064 | loss: nan | val_loss: nan | Time: 3283.08 ms
[2021-04-13 23:41:00	                main:574]	:	INFO	:	Epoch 1065 | loss: nan | val_loss: nan | Time: 3251.27 ms
[2021-04-13 23:41:04	                main:574]	:	INFO	:	Epoch 1066 | loss: nan | val_loss: nan | Time: 3213.59 ms
[2021-04-13 23:41:07	                main:574]	:	INFO	:	Epoch 1067 | loss: nan | val_loss: nan | Time: 3222.53 ms
[2021-04-13 23:41:10	                main:574]	:	INFO	:	Epoch 1068 | loss: nan | val_loss: nan | Time: 3219.04 ms
[2021-04-13 23:41:13	                main:574]	:	INFO	:	Epoch 1069 | loss: nan | val_loss: nan | Time: 3230.34 ms
[2021-04-13 23:41:16	                main:574]	:	INFO	:	Epoch 1070 | loss: nan | val_loss: nan | Time: 3197.6 ms
[2021-04-13 23:41:20	                main:574]	:	INFO	:	Epoch 1071 | loss: nan | val_loss: nan | Time: 3291.38 ms
[2021-04-13 23:41:23	                main:574]	:	INFO	:	Epoch 1072 | loss: nan | val_loss: nan | Time: 3207.82 ms
[2021-04-13 23:41:26	                main:574]	:	INFO	:	Epoch 1073 | loss: nan | val_loss: nan | Time: 3196.4 ms
[2021-04-13 23:41:29	                main:574]	:	INFO	:	Epoch 1074 | loss: nan | val_loss: nan | Time: 3219.64 ms
[2021-04-13 23:41:33	                main:574]	:	INFO	:	Epoch 1075 | loss: nan | val_loss: nan | Time: 3222.42 ms
[2021-04-13 23:41:36	                main:574]	:	INFO	:	Epoch 1076 | loss: nan | val_loss: nan | Time: 3242.77 ms
[2021-04-13 23:41:39	                main:574]	:	INFO	:	Epoch 1077 | loss: nan | val_loss: nan | Time: 3251.32 ms
[2021-04-13 23:41:42	                main:574]	:	INFO	:	Epoch 1078 | loss: nan | val_loss: nan | Time: 3213.3 ms
[2021-04-13 23:41:46	                main:574]	:	INFO	:	Epoch 1079 | loss: nan | val_loss: nan | Time: 3209.72 ms
[2021-04-13 23:41:49	                main:574]	:	INFO	:	Epoch 1080 | loss: nan | val_loss: nan | Time: 3223.24 ms
[2021-04-13 23:41:52	                main:574]	:	INFO	:	Epoch 1081 | loss: nan | val_loss: nan | Time: 3223.62 ms
[2021-04-13 23:41:55	                main:574]	:	INFO	:	Epoch 1082 | loss: nan | val_loss: nan | Time: 3205.91 ms
[2021-04-13 23:41:58	                main:574]	:	INFO	:	Epoch 1083 | loss: nan | val_loss: nan | Time: 3204.78 ms
[2021-04-13 23:42:02	                main:574]	:	INFO	:	Epoch 1084 | loss: nan | val_loss: nan | Time: 3207.2 ms
[2021-04-13 23:42:05	                main:574]	:	INFO	:	Epoch 1085 | loss: nan | val_loss: nan | Time: 3188.97 ms
[2021-04-13 23:42:08	                main:574]	:	INFO	:	Epoch 1086 | loss: nan | val_loss: nan | Time: 3226.73 ms
[2021-04-13 23:42:11	                main:574]	:	INFO	:	Epoch 1087 | loss: nan | val_loss: nan | Time: 3240.43 ms
[2021-04-13 23:42:14	                main:574]	:	INFO	:	Epoch 1088 | loss: nan | val_loss: nan | Time: 3229.38 ms
[2021-04-13 23:42:18	                main:574]	:	INFO	:	Epoch 1089 | loss: nan | val_loss: nan | Time: 3250.93 ms
[2021-04-13 23:42:21	                main:574]	:	INFO	:	Epoch 1090 | loss: nan | val_loss: nan | Time: 3235.56 ms
[2021-04-13 23:42:24	                main:574]	:	INFO	:	Epoch 1091 | loss: nan | val_loss: nan | Time: 3241.68 ms
[2021-04-13 23:42:27	                main:574]	:	INFO	:	Epoch 1092 | loss: nan | val_loss: nan | Time: 3216.86 ms
[2021-04-13 23:42:31	                main:574]	:	INFO	:	Epoch 1093 | loss: nan | val_loss: nan | Time: 3208.69 ms
[2021-04-13 23:42:34	                main:574]	:	INFO	:	Epoch 1094 | loss: nan | val_loss: nan | Time: 3247.01 ms
[2021-04-13 23:42:37	                main:574]	:	INFO	:	Epoch 1095 | loss: nan | val_loss: nan | Time: 3230.96 ms
[2021-04-13 23:42:40	                main:574]	:	INFO	:	Epoch 1096 | loss: nan | val_loss: nan | Time: 3239.01 ms
[2021-04-13 23:42:44	                main:574]	:	INFO	:	Epoch 1097 | loss: nan | val_loss: nan | Time: 3230.12 ms
[2021-04-13 23:42:47	                main:574]	:	INFO	:	Epoch 1098 | loss: nan | val_loss: nan | Time: 3220.96 ms
[2021-04-13 23:42:50	                main:574]	:	INFO	:	Epoch 1099 | loss: nan | val_loss: nan | Time: 3278.43 ms
[2021-04-13 23:42:53	                main:574]	:	INFO	:	Epoch 1100 | loss: nan | val_loss: nan | Time: 3192.04 ms
[2021-04-13 23:42:57	                main:574]	:	INFO	:	Epoch 1101 | loss: nan | val_loss: nan | Time: 3203.2 ms
[2021-04-13 23:43:00	                main:574]	:	INFO	:	Epoch 1102 | loss: nan | val_loss: nan | Time: 3209.9 ms
[2021-04-13 23:43:03	                main:574]	:	INFO	:	Epoch 1103 | loss: nan | val_loss: nan | Time: 3209.58 ms
[2021-04-13 23:43:06	                main:574]	:	INFO	:	Epoch 1104 | loss: nan | val_loss: nan | Time: 3249.73 ms
[2021-04-13 23:43:09	                main:574]	:	INFO	:	Epoch 1105 | loss: nan | val_loss: nan | Time: 3199.75 ms
[2021-04-13 23:43:13	                main:574]	:	INFO	:	Epoch 1106 | loss: nan | val_loss: nan | Time: 3202.48 ms
[2021-04-13 23:43:16	                main:574]	:	INFO	:	Epoch 1107 | loss: nan | val_loss: nan | Time: 3250.18 ms
[2021-04-13 23:43:19	                main:574]	:	INFO	:	Epoch 1108 | loss: nan | val_loss: nan | Time: 3200.28 ms
[2021-04-13 23:43:22	                main:574]	:	INFO	:	Epoch 1109 | loss: nan | val_loss: nan | Time: 3228.21 ms
[2021-04-13 23:43:26	                main:574]	:	INFO	:	Epoch 1110 | loss: nan | val_loss: nan | Time: 3202.02 ms
[2021-04-13 23:43:29	                main:574]	:	INFO	:	Epoch 1111 | loss: nan | val_loss: nan | Time: 3233.57 ms
[2021-04-13 23:43:32	                main:574]	:	INFO	:	Epoch 1112 | loss: nan | val_loss: nan | Time: 3205.85 ms
[2021-04-13 23:43:35	                main:574]	:	INFO	:	Epoch 1113 | loss: nan | val_loss: nan | Time: 3253.56 ms
[2021-04-13 23:43:38	                main:574]	:	INFO	:	Epoch 1114 | loss: nan | val_loss: nan | Time: 3238.59 ms
[2021-04-13 23:43:42	                main:574]	:	INFO	:	Epoch 1115 | loss: nan | val_loss: nan | Time: 3235.39 ms
[2021-04-13 23:43:45	                main:574]	:	INFO	:	Epoch 1116 | loss: nan | val_loss: nan | Time: 3235.92 ms
[2021-04-13 23:43:48	                main:574]	:	INFO	:	Epoch 1117 | loss: nan | val_loss: nan | Time: 3205.55 ms
[2021-04-13 23:43:51	                main:574]	:	INFO	:	Epoch 1118 | loss: nan | val_loss: nan | Time: 3214.03 ms
[2021-04-13 23:43:55	                main:574]	:	INFO	:	Epoch 1119 | loss: nan | val_loss: nan | Time: 3210.67 ms
[2021-04-13 23:43:58	                main:574]	:	INFO	:	Epoch 1120 | loss: nan | val_loss: nan | Time: 3207.76 ms
[2021-04-13 23:44:01	                main:574]	:	INFO	:	Epoch 1121 | loss: nan | val_loss: nan | Time: 3222.33 ms
[2021-04-13 23:44:04	                main:574]	:	INFO	:	Epoch 1122 | loss: nan | val_loss: nan | Time: 3223 ms
[2021-04-13 23:44:08	                main:574]	:	INFO	:	Epoch 1123 | loss: nan | val_loss: nan | Time: 3246.43 ms
[2021-04-13 23:44:11	                main:574]	:	INFO	:	Epoch 1124 | loss: nan | val_loss: nan | Time: 3219.16 ms
[2021-04-13 23:44:14	                main:574]	:	INFO	:	Epoch 1125 | loss: nan | val_loss: nan | Time: 3208.82 ms
[2021-04-13 23:44:17	                main:574]	:	INFO	:	Epoch 1126 | loss: nan | val_loss: nan | Time: 3227.27 ms
[2021-04-13 23:44:20	                main:574]	:	INFO	:	Epoch 1127 | loss: nan | val_loss: nan | Time: 3231.77 ms
[2021-04-13 23:44:24	                main:574]	:	INFO	:	Epoch 1128 | loss: nan | val_loss: nan | Time: 3209.11 ms
[2021-04-13 23:44:27	                main:574]	:	INFO	:	Epoch 1129 | loss: nan | val_loss: nan | Time: 3220.19 ms
[2021-04-13 23:44:30	                main:574]	:	INFO	:	Epoch 1130 | loss: nan | val_loss: nan | Time: 3235.68 ms
[2021-04-13 23:44:33	                main:574]	:	INFO	:	Epoch 1131 | loss: nan | val_loss: nan | Time: 3227.75 ms
[2021-04-13 23:44:37	                main:574]	:	INFO	:	Epoch 1132 | loss: nan | val_loss: nan | Time: 3243.29 ms
[2021-04-13 23:44:40	                main:574]	:	INFO	:	Epoch 1133 | loss: nan | val_loss: nan | Time: 3254.65 ms
[2021-04-13 23:44:43	                main:574]	:	INFO	:	Epoch 1134 | loss: nan | val_loss: nan | Time: 3214.26 ms
[2021-04-13 23:44:46	                main:574]	:	INFO	:	Epoch 1135 | loss: nan | val_loss: nan | Time: 3215.84 ms
[2021-04-13 23:44:49	                main:574]	:	INFO	:	Epoch 1136 | loss: nan | val_loss: nan | Time: 3202.33 ms
[2021-04-13 23:44:53	                main:574]	:	INFO	:	Epoch 1137 | loss: nan | val_loss: nan | Time: 3187.27 ms
[2021-04-13 23:44:56	                main:574]	:	INFO	:	Epoch 1138 | loss: nan | val_loss: nan | Time: 3210.36 ms
[2021-04-13 23:44:59	                main:574]	:	INFO	:	Epoch 1139 | loss: nan | val_loss: nan | Time: 3208.48 ms
[2021-04-13 23:45:02	                main:574]	:	INFO	:	Epoch 1140 | loss: nan | val_loss: nan | Time: 3182.53 ms
[2021-04-13 23:45:06	                main:574]	:	INFO	:	Epoch 1141 | loss: nan | val_loss: nan | Time: 3298.8 ms
[2021-04-13 23:45:09	                main:574]	:	INFO	:	Epoch 1142 | loss: nan | val_loss: nan | Time: 3240.15 ms
[2021-04-13 23:45:12	                main:574]	:	INFO	:	Epoch 1143 | loss: nan | val_loss: nan | Time: 3198.4 ms
[2021-04-13 23:45:15	                main:574]	:	INFO	:	Epoch 1144 | loss: nan | val_loss: nan | Time: 3201.7 ms
[2021-04-13 23:45:18	                main:574]	:	INFO	:	Epoch 1145 | loss: nan | val_loss: nan | Time: 3202.71 ms
[2021-04-13 23:45:22	                main:574]	:	INFO	:	Epoch 1146 | loss: nan | val_loss: nan | Time: 3226.65 ms
[2021-04-13 23:45:25	                main:574]	:	INFO	:	Epoch 1147 | loss: nan | val_loss: nan | Time: 3200.5 ms
[2021-04-13 23:45:28	                main:574]	:	INFO	:	Epoch 1148 | loss: nan | val_loss: nan | Time: 3224.91 ms
[2021-04-13 23:45:31	                main:574]	:	INFO	:	Epoch 1149 | loss: nan | val_loss: nan | Time: 3223.95 ms
[2021-04-13 23:45:35	                main:574]	:	INFO	:	Epoch 1150 | loss: nan | val_loss: nan | Time: 3204.52 ms
[2021-04-13 23:45:38	                main:574]	:	INFO	:	Epoch 1151 | loss: nan | val_loss: nan | Time: 3222.59 ms
[2021-04-13 23:45:41	                main:574]	:	INFO	:	Epoch 1152 | loss: nan | val_loss: nan | Time: 3216.77 ms
[2021-04-13 23:45:44	                main:574]	:	INFO	:	Epoch 1153 | loss: nan | val_loss: nan | Time: 3198.33 ms
[2021-04-13 23:45:47	                main:574]	:	INFO	:	Epoch 1154 | loss: nan | val_loss: nan | Time: 3205.43 ms
[2021-04-13 23:45:51	                main:574]	:	INFO	:	Epoch 1155 | loss: nan | val_loss: nan | Time: 3245.26 ms
[2021-04-13 23:45:54	                main:574]	:	INFO	:	Epoch 1156 | loss: nan | val_loss: nan | Time: 3227.1 ms
[2021-04-13 23:45:57	                main:574]	:	INFO	:	Epoch 1157 | loss: nan | val_loss: nan | Time: 3208.48 ms
[2021-04-13 23:46:00	                main:574]	:	INFO	:	Epoch 1158 | loss: nan | val_loss: nan | Time: 3213.13 ms
[2021-04-13 23:46:04	                main:574]	:	INFO	:	Epoch 1159 | loss: nan | val_loss: nan | Time: 3196.88 ms
[2021-04-13 23:46:07	                main:574]	:	INFO	:	Epoch 1160 | loss: nan | val_loss: nan | Time: 3207.91 ms
[2021-04-13 23:46:10	                main:574]	:	INFO	:	Epoch 1161 | loss: nan | val_loss: nan | Time: 3218.78 ms
[2021-04-13 23:46:13	                main:574]	:	INFO	:	Epoch 1162 | loss: nan | val_loss: nan | Time: 3216.85 ms
[2021-04-13 23:46:16	                main:574]	:	INFO	:	Epoch 1163 | loss: nan | val_loss: nan | Time: 3213.41 ms
[2021-04-13 23:46:20	                main:574]	:	INFO	:	Epoch 1164 | loss: nan | val_loss: nan | Time: 3198.64 ms
[2021-04-13 23:46:23	                main:574]	:	INFO	:	Epoch 1165 | loss: nan | val_loss: nan | Time: 3215.04 ms
[2021-04-13 23:46:26	                main:574]	:	INFO	:	Epoch 1166 | loss: nan | val_loss: nan | Time: 3218.6 ms
[2021-04-13 23:46:29	                main:574]	:	INFO	:	Epoch 1167 | loss: nan | val_loss: nan | Time: 3243.32 ms
[2021-04-13 23:46:32	                main:574]	:	INFO	:	Epoch 1168 | loss: nan | val_loss: nan | Time: 3209.09 ms
[2021-04-13 23:46:36	                main:574]	:	INFO	:	Epoch 1169 | loss: nan | val_loss: nan | Time: 3219.93 ms
[2021-04-13 23:46:39	                main:574]	:	INFO	:	Epoch 1170 | loss: nan | val_loss: nan | Time: 3223.32 ms
[2021-04-13 23:46:42	                main:574]	:	INFO	:	Epoch 1171 | loss: nan | val_loss: nan | Time: 3229.54 ms
[2021-04-13 23:46:45	                main:574]	:	INFO	:	Epoch 1172 | loss: nan | val_loss: nan | Time: 3191.84 ms
[2021-04-13 23:46:49	                main:574]	:	INFO	:	Epoch 1173 | loss: nan | val_loss: nan | Time: 3234.13 ms
[2021-04-13 23:46:52	                main:574]	:	INFO	:	Epoch 1174 | loss: nan | val_loss: nan | Time: 3276.39 ms
[2021-04-13 23:46:55	                main:574]	:	INFO	:	Epoch 1175 | loss: nan | val_loss: nan | Time: 3203.68 ms
[2021-04-13 23:46:58	                main:574]	:	INFO	:	Epoch 1176 | loss: nan | val_loss: nan | Time: 3214.43 ms
[2021-04-13 23:47:02	                main:574]	:	INFO	:	Epoch 1177 | loss: nan | val_loss: nan | Time: 3207.55 ms
[2021-04-13 23:47:05	                main:574]	:	INFO	:	Epoch 1178 | loss: nan | val_loss: nan | Time: 3222.12 ms
[2021-04-13 23:47:08	                main:574]	:	INFO	:	Epoch 1179 | loss: nan | val_loss: nan | Time: 3269.07 ms
[2021-04-13 23:47:11	                main:574]	:	INFO	:	Epoch 1180 | loss: nan | val_loss: nan | Time: 3208.26 ms
[2021-04-13 23:47:15	                main:574]	:	INFO	:	Epoch 1181 | loss: nan | val_loss: nan | Time: 3283.32 ms
[2021-04-13 23:47:18	                main:574]	:	INFO	:	Epoch 1182 | loss: nan | val_loss: nan | Time: 3199.86 ms
[2021-04-13 23:47:21	                main:574]	:	INFO	:	Epoch 1183 | loss: nan | val_loss: nan | Time: 3231.06 ms
[2021-04-13 23:47:24	                main:574]	:	INFO	:	Epoch 1184 | loss: nan | val_loss: nan | Time: 3190.02 ms
[2021-04-13 23:47:27	                main:574]	:	INFO	:	Epoch 1185 | loss: nan | val_loss: nan | Time: 3230.93 ms
[2021-04-13 23:47:31	                main:574]	:	INFO	:	Epoch 1186 | loss: nan | val_loss: nan | Time: 3203.77 ms
[2021-04-13 23:47:34	                main:574]	:	INFO	:	Epoch 1187 | loss: nan | val_loss: nan | Time: 3205.16 ms
[2021-04-13 23:47:37	                main:574]	:	INFO	:	Epoch 1188 | loss: nan | val_loss: nan | Time: 3234.86 ms
[2021-04-13 23:47:40	                main:574]	:	INFO	:	Epoch 1189 | loss: nan | val_loss: nan | Time: 3203.07 ms
[2021-04-13 23:47:43	                main:574]	:	INFO	:	Epoch 1190 | loss: nan | val_loss: nan | Time: 3262.88 ms
[2021-04-13 23:47:47	                main:574]	:	INFO	:	Epoch 1191 | loss: nan | val_loss: nan | Time: 3215.37 ms
[2021-04-13 23:47:50	                main:574]	:	INFO	:	Epoch 1192 | loss: nan | val_loss: nan | Time: 3194.2 ms
[2021-04-13 23:47:53	                main:574]	:	INFO	:	Epoch 1193 | loss: nan | val_loss: nan | Time: 3222.88 ms
[2021-04-13 23:47:56	                main:574]	:	INFO	:	Epoch 1194 | loss: nan | val_loss: nan | Time: 3199.99 ms
[2021-04-13 23:48:00	                main:574]	:	INFO	:	Epoch 1195 | loss: nan | val_loss: nan | Time: 3229.25 ms
[2021-04-13 23:48:03	                main:574]	:	INFO	:	Epoch 1196 | loss: nan | val_loss: nan | Time: 3224.15 ms
[2021-04-13 23:48:06	                main:574]	:	INFO	:	Epoch 1197 | loss: nan | val_loss: nan | Time: 3246.52 ms
[2021-04-13 23:48:09	                main:574]	:	INFO	:	Epoch 1198 | loss: nan | val_loss: nan | Time: 3259.13 ms
[2021-04-13 23:48:13	                main:574]	:	INFO	:	Epoch 1199 | loss: nan | val_loss: nan | Time: 3208.6 ms
[2021-04-13 23:48:16	                main:574]	:	INFO	:	Epoch 1200 | loss: nan | val_loss: nan | Time: 3280.57 ms
[2021-04-13 23:48:19	                main:574]	:	INFO	:	Epoch 1201 | loss: nan | val_loss: nan | Time: 3221.85 ms
[2021-04-13 23:48:22	                main:574]	:	INFO	:	Epoch 1202 | loss: nan | val_loss: nan | Time: 3191.65 ms
[2021-04-13 23:48:25	                main:574]	:	INFO	:	Epoch 1203 | loss: nan | val_loss: nan | Time: 3223.82 ms
[2021-04-13 23:48:29	                main:574]	:	INFO	:	Epoch 1204 | loss: nan | val_loss: nan | Time: 3202.92 ms
[2021-04-13 23:48:32	                main:574]	:	INFO	:	Epoch 1205 | loss: nan | val_loss: nan | Time: 3188.16 ms
[2021-04-13 23:48:35	                main:574]	:	INFO	:	Epoch 1206 | loss: nan | val_loss: nan | Time: 3183.56 ms
[2021-04-13 23:48:38	                main:574]	:	INFO	:	Epoch 1207 | loss: nan | val_loss: nan | Time: 3195.68 ms
[2021-04-13 23:48:41	                main:574]	:	INFO	:	Epoch 1208 | loss: nan | val_loss: nan | Time: 3212.67 ms
[2021-04-13 23:48:45	                main:574]	:	INFO	:	Epoch 1209 | loss: nan | val_loss: nan | Time: 3215.02 ms
[2021-04-13 23:48:48	                main:574]	:	INFO	:	Epoch 1210 | loss: nan | val_loss: nan | Time: 3211.79 ms
[2021-04-13 23:48:51	                main:574]	:	INFO	:	Epoch 1211 | loss: nan | val_loss: nan | Time: 3257.58 ms
[2021-04-13 23:48:54	                main:574]	:	INFO	:	Epoch 1212 | loss: nan | val_loss: nan | Time: 3223.47 ms
[2021-04-13 23:48:58	                main:574]	:	INFO	:	Epoch 1213 | loss: nan | val_loss: nan | Time: 3231.57 ms
[2021-04-13 23:49:01	                main:574]	:	INFO	:	Epoch 1214 | loss: nan | val_loss: nan | Time: 3255.81 ms
[2021-04-13 23:49:04	                main:574]	:	INFO	:	Epoch 1215 | loss: nan | val_loss: nan | Time: 3226.85 ms
[2021-04-13 23:49:07	                main:574]	:	INFO	:	Epoch 1216 | loss: nan | val_loss: nan | Time: 3277.26 ms
[2021-04-13 23:49:11	                main:574]	:	INFO	:	Epoch 1217 | loss: nan | val_loss: nan | Time: 3184.36 ms
[2021-04-13 23:49:14	                main:574]	:	INFO	:	Epoch 1218 | loss: nan | val_loss: nan | Time: 3217.55 ms
[2021-04-13 23:49:17	                main:574]	:	INFO	:	Epoch 1219 | loss: nan | val_loss: nan | Time: 3191.39 ms
[2021-04-13 23:49:20	                main:574]	:	INFO	:	Epoch 1220 | loss: nan | val_loss: nan | Time: 3186.85 ms
[2021-04-13 23:49:23	                main:574]	:	INFO	:	Epoch 1221 | loss: nan | val_loss: nan | Time: 3184.51 ms
[2021-04-13 23:49:27	                main:574]	:	INFO	:	Epoch 1222 | loss: nan | val_loss: nan | Time: 3186.47 ms
[2021-04-13 23:49:30	                main:574]	:	INFO	:	Epoch 1223 | loss: nan | val_loss: nan | Time: 3266.09 ms
[2021-04-13 23:49:33	                main:574]	:	INFO	:	Epoch 1224 | loss: nan | val_loss: nan | Time: 3195.25 ms
[2021-04-13 23:49:36	                main:574]	:	INFO	:	Epoch 1225 | loss: nan | val_loss: nan | Time: 3295.78 ms
[2021-04-13 23:49:40	                main:574]	:	INFO	:	Epoch 1226 | loss: nan | val_loss: nan | Time: 3202.1 ms
[2021-04-13 23:49:43	                main:574]	:	INFO	:	Epoch 1227 | loss: nan | val_loss: nan | Time: 3209.98 ms
[2021-04-13 23:49:46	                main:574]	:	INFO	:	Epoch 1228 | loss: nan | val_loss: nan | Time: 3195.77 ms
[2021-04-13 23:49:49	                main:574]	:	INFO	:	Epoch 1229 | loss: nan | val_loss: nan | Time: 3188.58 ms
[2021-04-13 23:49:52	                main:574]	:	INFO	:	Epoch 1230 | loss: nan | val_loss: nan | Time: 3217.8 ms
[2021-04-13 23:49:56	                main:574]	:	INFO	:	Epoch 1231 | loss: nan | val_loss: nan | Time: 3189.48 ms
[2021-04-13 23:49:59	                main:574]	:	INFO	:	Epoch 1232 | loss: nan | val_loss: nan | Time: 3285.07 ms
[2021-04-13 23:50:02	                main:574]	:	INFO	:	Epoch 1233 | loss: nan | val_loss: nan | Time: 3231.33 ms
[2021-04-13 23:50:05	                main:574]	:	INFO	:	Epoch 1234 | loss: nan | val_loss: nan | Time: 3204.72 ms
[2021-04-13 23:50:09	                main:574]	:	INFO	:	Epoch 1235 | loss: nan | val_loss: nan | Time: 3236.39 ms
[2021-04-13 23:50:12	                main:574]	:	INFO	:	Epoch 1236 | loss: nan | val_loss: nan | Time: 3186.74 ms
[2021-04-13 23:50:15	                main:574]	:	INFO	:	Epoch 1237 | loss: nan | val_loss: nan | Time: 3228.51 ms
[2021-04-13 23:50:18	                main:574]	:	INFO	:	Epoch 1238 | loss: nan | val_loss: nan | Time: 3177.22 ms
[2021-04-13 23:50:21	                main:574]	:	INFO	:	Epoch 1239 | loss: nan | val_loss: nan | Time: 3230.35 ms
[2021-04-13 23:50:25	                main:574]	:	INFO	:	Epoch 1240 | loss: nan | val_loss: nan | Time: 3230.45 ms
[2021-04-13 23:50:28	                main:574]	:	INFO	:	Epoch 1241 | loss: nan | val_loss: nan | Time: 3194.51 ms
[2021-04-13 23:50:31	                main:574]	:	INFO	:	Epoch 1242 | loss: nan | val_loss: nan | Time: 3229.6 ms
[2021-04-13 23:50:34	                main:574]	:	INFO	:	Epoch 1243 | loss: nan | val_loss: nan | Time: 3204.14 ms
[2021-04-13 23:50:37	                main:574]	:	INFO	:	Epoch 1244 | loss: nan | val_loss: nan | Time: 3195.77 ms
[2021-04-13 23:50:41	                main:574]	:	INFO	:	Epoch 1245 | loss: nan | val_loss: nan | Time: 3194.04 ms
[2021-04-13 23:50:44	                main:574]	:	INFO	:	Epoch 1246 | loss: nan | val_loss: nan | Time: 3206.85 ms
[2021-04-13 23:50:47	                main:574]	:	INFO	:	Epoch 1247 | loss: nan | val_loss: nan | Time: 3217.64 ms
[2021-04-13 23:50:50	                main:574]	:	INFO	:	Epoch 1248 | loss: nan | val_loss: nan | Time: 3204.09 ms
[2021-04-13 23:50:54	                main:574]	:	INFO	:	Epoch 1249 | loss: nan | val_loss: nan | Time: 3226.79 ms
[2021-04-13 23:50:57	                main:574]	:	INFO	:	Epoch 1250 | loss: nan | val_loss: nan | Time: 3227.55 ms
[2021-04-13 23:51:00	                main:574]	:	INFO	:	Epoch 1251 | loss: nan | val_loss: nan | Time: 3228.36 ms
[2021-04-13 23:51:03	                main:574]	:	INFO	:	Epoch 1252 | loss: nan | val_loss: nan | Time: 3246.12 ms
[2021-04-13 23:51:06	                main:574]	:	INFO	:	Epoch 1253 | loss: nan | val_loss: nan | Time: 3181.32 ms
[2021-04-13 23:51:10	                main:574]	:	INFO	:	Epoch 1254 | loss: nan | val_loss: nan | Time: 3214.98 ms
[2021-04-13 23:51:13	                main:574]	:	INFO	:	Epoch 1255 | loss: nan | val_loss: nan | Time: 3213.36 ms
[2021-04-13 23:51:16	                main:574]	:	INFO	:	Epoch 1256 | loss: nan | val_loss: nan | Time: 3180.64 ms
[2021-04-13 23:51:19	                main:574]	:	INFO	:	Epoch 1257 | loss: nan | val_loss: nan | Time: 3233.19 ms
[2021-04-13 23:51:22	                main:574]	:	INFO	:	Epoch 1258 | loss: nan | val_loss: nan | Time: 3189.53 ms
[2021-04-13 23:51:26	                main:574]	:	INFO	:	Epoch 1259 | loss: nan | val_loss: nan | Time: 3250.74 ms
[2021-04-13 23:51:29	                main:574]	:	INFO	:	Epoch 1260 | loss: nan | val_loss: nan | Time: 3228.43 ms
[2021-04-13 23:51:32	                main:574]	:	INFO	:	Epoch 1261 | loss: nan | val_loss: nan | Time: 3254.34 ms
[2021-04-13 23:51:35	                main:574]	:	INFO	:	Epoch 1262 | loss: nan | val_loss: nan | Time: 3204.88 ms
[2021-04-13 23:51:39	                main:574]	:	INFO	:	Epoch 1263 | loss: nan | val_loss: nan | Time: 3206.75 ms
[2021-04-13 23:51:42	                main:574]	:	INFO	:	Epoch 1264 | loss: nan | val_loss: nan | Time: 3194.89 ms
[2021-04-13 23:51:45	                main:574]	:	INFO	:	Epoch 1265 | loss: nan | val_loss: nan | Time: 3233.38 ms
[2021-04-13 23:51:48	                main:574]	:	INFO	:	Epoch 1266 | loss: nan | val_loss: nan | Time: 3193.18 ms
[2021-04-13 23:51:51	                main:574]	:	INFO	:	Epoch 1267 | loss: nan | val_loss: nan | Time: 3218.05 ms
[2021-04-13 23:51:55	                main:574]	:	INFO	:	Epoch 1268 | loss: nan | val_loss: nan | Time: 3210.63 ms
[2021-04-13 23:51:58	                main:574]	:	INFO	:	Epoch 1269 | loss: nan | val_loss: nan | Time: 3230.96 ms
[2021-04-13 23:52:01	                main:574]	:	INFO	:	Epoch 1270 | loss: nan | val_loss: nan | Time: 3196.99 ms
[2021-04-13 23:52:04	                main:574]	:	INFO	:	Epoch 1271 | loss: nan | val_loss: nan | Time: 3203.62 ms
[2021-04-13 23:52:08	                main:574]	:	INFO	:	Epoch 1272 | loss: nan | val_loss: nan | Time: 3229.82 ms
[2021-04-13 23:52:11	                main:574]	:	INFO	:	Epoch 1273 | loss: nan | val_loss: nan | Time: 3206.84 ms
[2021-04-13 23:52:14	                main:574]	:	INFO	:	Epoch 1274 | loss: nan | val_loss: nan | Time: 3200.34 ms
[2021-04-13 23:52:17	                main:574]	:	INFO	:	Epoch 1275 | loss: nan | val_loss: nan | Time: 3228.19 ms
[2021-04-13 23:52:20	                main:574]	:	INFO	:	Epoch 1276 | loss: nan | val_loss: nan | Time: 3191.76 ms
[2021-04-13 23:52:24	                main:574]	:	INFO	:	Epoch 1277 | loss: nan | val_loss: nan | Time: 3250 ms
[2021-04-13 23:52:27	                main:574]	:	INFO	:	Epoch 1278 | loss: nan | val_loss: nan | Time: 3222.65 ms
[2021-04-13 23:52:30	                main:574]	:	INFO	:	Epoch 1279 | loss: nan | val_loss: nan | Time: 3209.17 ms
[2021-04-13 23:52:33	                main:574]	:	INFO	:	Epoch 1280 | loss: nan | val_loss: nan | Time: 3189.8 ms
[2021-04-13 23:52:37	                main:574]	:	INFO	:	Epoch 1281 | loss: nan | val_loss: nan | Time: 3206.84 ms
[2021-04-13 23:52:40	                main:574]	:	INFO	:	Epoch 1282 | loss: nan | val_loss: nan | Time: 3178.13 ms
[2021-04-13 23:52:43	                main:574]	:	INFO	:	Epoch 1283 | loss: nan | val_loss: nan | Time: 3179.38 ms
[2021-04-13 23:52:46	                main:574]	:	INFO	:	Epoch 1284 | loss: nan | val_loss: nan | Time: 3289.89 ms
[2021-04-13 23:52:49	                main:574]	:	INFO	:	Epoch 1285 | loss: nan | val_loss: nan | Time: 3258.54 ms
[2021-04-13 23:52:53	                main:574]	:	INFO	:	Epoch 1286 | loss: nan | val_loss: nan | Time: 3228.89 ms
[2021-04-13 23:52:56	                main:574]	:	INFO	:	Epoch 1287 | loss: nan | val_loss: nan | Time: 3243.94 ms
[2021-04-13 23:52:59	                main:574]	:	INFO	:	Epoch 1288 | loss: nan | val_loss: nan | Time: 3203.94 ms
[2021-04-13 23:53:02	                main:574]	:	INFO	:	Epoch 1289 | loss: nan | val_loss: nan | Time: 3195.74 ms
[2021-04-13 23:53:06	                main:574]	:	INFO	:	Epoch 1290 | loss: nan | val_loss: nan | Time: 3213.51 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GT 1030)
[2021-04-14 00:06:28	                main:435]	:	INFO	:	Set logging level to 1
[2021-04-14 00:06:28	                main:441]	:	INFO	:	Running in BOINC Client mode
[2021-04-14 00:06:28	                main:444]	:	INFO	:	Resolving all filenames
[2021-04-14 00:06:28	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1)
[2021-04-14 00:06:28	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1617250232-30878-1_0_r1156262776_1 (exists = 1)
[2021-04-14 00:06:28	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1617250232-30878-1_0_r1156262776_0 (exists = 0)
[2021-04-14 00:06:28	                main:452]	:	INFO	:	Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1617250232-30878-1 (exists = 1)
[2021-04-14 00:06:28	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2021-04-14 00:06:28	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5
[2021-04-14 00:06:28	                main:474]	:	INFO	:	Configuration: 
[2021-04-14 00:06:28	                main:475]	:	INFO	:	    Model type: GRU
[2021-04-14 00:06:28	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2021-04-14 00:06:28	                main:477]	:	INFO	:	    Max Epochs: 2048
[2021-04-14 00:06:28	                main:478]	:	INFO	:	    Batch Size: 128
[2021-04-14 00:06:28	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2021-04-14 00:06:28	                main:480]	:	INFO	:	    Patience: 10
[2021-04-14 00:06:28	                main:481]	:	INFO	:	    Hidden Width: 12
[2021-04-14 00:06:28	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2021-04-14 00:06:28	                main:483]	:	INFO	:	    # Backend Layers: 4
[2021-04-14 00:06:28	                main:484]	:	INFO	:	    # Threads: 1
[2021-04-14 00:06:28	                main:486]	:	INFO	:	Preparing Dataset
[2021-04-14 00:06:28	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-04-14 00:06:28	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-04-14 00:06:30	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2021-04-14 00:06:30	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-04-14 00:06:30	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-04-14 00:06:30	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2021-04-14 00:06:30	                main:494]	:	INFO	:	Creating Model
[2021-04-14 00:06:30	                main:507]	:	INFO	:	Preparing config file
[2021-04-14 00:06:30	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2021-04-14 00:06:30	                main:512]	:	INFO	:	Loading config


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FF9E6D9D759

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 04/14/21 00:06:30
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\1;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 0000000001dc0000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000e9190000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.844) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.867

ModLoad: 00000000e8f70000 00000000000bd000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.804) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.867

ModLoad: 00000000e6d70000 00000000002c9000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.804) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.867

ModLoad: 00000000e7980000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.867

ModLoad: 00000000e7040000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.867) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.867

ModLoad: 00000000e7880000 000000000002a000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.19041.746 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.746

ModLoad: 00000000e6900000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.19041.746 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.746

ModLoad: 00000000e7070000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.789

ModLoad: 00000000e6a10000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.789

ModLoad: 00000000e8190000 00000000000ac000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.610) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.867

ModLoad: 00000000c6ed0000 0000000000058000 C:\ProgramData\BOINC\slots\1\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000e8ac0000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 7.0.19041.546

ModLoad: 00000000e7700000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000e74a0000 000000000012b000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.867

ModLoad: 00000000cc430000 0000000000091000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.27.29114.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\A01\_work\62\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.27.29114.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR Visual StudioR
    Product Version       : 14.27.29114.0

ModLoad: 0000000077c20000 000000000abe7000 C:\ProgramData\BOINC\slots\1\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000cc1f0000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.867

ModLoad: 00000000cc4d0000 0000000000019000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.27.29114.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\A01\_work\62\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.27.29114.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR Visual StudioR
    Product Version       : 14.27.29114.0

ModLoad: 00000000cc420000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.27.29114.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\A01\_work\62\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.27.29114.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR Visual StudioR
    Product Version       : 14.27.29114.0

ModLoad: 000000008ffa0000 00000000002db000 C:\ProgramData\BOINC\slots\1\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000097fe0000 000000000020d000 C:\ProgramData\BOINC\slots\1\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 00000000d3d20000 0000000000040000 C:\ProgramData\BOINC\slots\1\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000004dca0000 0000000024b49000 C:\ProgramData\BOINC\slots\1\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000cfce0000 0000000000045000 C:\ProgramData\BOINC\slots\1\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000082ea0000 00000000030a5000 C:\ProgramData\BOINC\slots\1\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 0000000074760000 00000000034b2000 C:\ProgramData\BOINC\slots\1\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000e4180000 0000000000010000 C:\ProgramData\BOINC\slots\1\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 0000000029750000 000000000919f000 C:\ProgramData\BOINC\slots\1\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000259f0000 0000000003d5b000 C:\ProgramData\BOINC\slots\1\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 0000000072890000 0000000001eca000 C:\ProgramData\BOINC\slots\1\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000328f0000 000000001b3a4000 C:\ProgramData\BOINC\slots\1\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 00000000e78b0000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000e4820000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000e7ba0000 0000000000469000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.844) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.867

ModLoad: 00000000e6cf0000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000e6d40000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.662) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.867

ModLoad: 00000000e6650000 000000000002c000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000e68a0000 0000000000060000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.804) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.19041.804 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.804

ModLoad: 00000000e6b90000 000000000015f000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.844) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.867

ModLoad: 00000000e6490000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000e8370000 0000000000742000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.844) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.867

ModLoad: 00000000e4a20000 0000000000790000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.844) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.867

ModLoad: 00000000e8b60000 0000000000355000 C:\WINDOWS\System32\combase.dll (6.2.19041.844) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.867

ModLoad: 00000000e62a0000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.662) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.867

ModLoad: 00000000e8ec0000 00000000000ae000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.867

ModLoad: 00000000e8130000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.867

ModLoad: 000000008f970000 0000000000267000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.5671) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r456_61\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 27.21.14.5671
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.1.96 driver
    Product Version       : 27.21.14.5671

ModLoad: 00000000df2c0000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000244c0000 000000000152a000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_1c83a5d7cffd7bff\nvcuda64.dll (27.21.14.5671) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r456_61\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 27.21.14.5671
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.1.96 driver
    Product Version       : 27.21.14.5671

ModLoad: 00000000e9030000 000000000006b000 C:\WINDOWS\System32\WS2_32.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : ws2_32.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.867

ModLoad: 00000000df170000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000e61b0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000e4360000 000000000009e000 C:\WINDOWS\system32\uxtheme.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : UxTheme.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.867

ModLoad: 00000000d9510000 00000000006d5000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.5671) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r456_61\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 27.21.14.5671
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 27.21.14.5671

ModLoad: 00000000e75d0000 000000000012a000 C:\WINDOWS\System32\OLE32.DLL (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : ole32.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.867

ModLoad: 00000000e6b10000 0000000000080000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.662) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.19041.662 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.19041.662



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3621, Write: 307, Other 855

- I/O Transfers Counters -
Read: 6529130, Write: 7297, Other 31186

- Paged Pool Usage -
QuotaPagedPoolUsage: 3442536, QuotaPeakPagedPoolUsage: 3442584
QuotaNonPagedPoolUsage: 38344, QuotaPeakNonPagedPoolUsage: 38472

- Virtual Memory Usage -
VirtualSize: -1460301824, PeakVirtualSize: -866906112

- Pagefile Usage -
PagefileUsage: -1460301824, PeakPagefileUsage: -1460301824

- Working Set Size -
WorkingSetSize: 1168080896, PeakWorkingSetSize: 1168084992, PageFaultCount: 397573

*** Dump of thread ID 4648 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 8593750.000000, User Time: 18281250.000000, Wait Time: 166352304.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FF9E6D9D759

- Registers -
rax=000000007d7b8b93 rbx=0000000002124910 rcx=00000000660e5f70 rdx=0000000000000001 rsi=00000000660e68b0 rdi=0000000019930520
r8=00000000660e6008 r9=0000000000000000 r10=0000000000000000 r11=00000000eab15700 r12=0000000088620020 r13=00000000660e6ac0
r14=0000000087d0bfb0 r15=0000000000000000 rip=00000000e6d9d759 rsp=00000000660e6750 rbp=00000000660e6a40
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
660e6820 0203a884 00000040 0000004f 8861f300 000003ec KERNELBASE!RaiseException+0x0 
660e6880 01de1ca6 00000008 ab840000 87daa4c8 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
660e6930 01de593b 00000000 00000030 00000020 00000008 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
660e6a80 01de1a78 00000000 00000000 660e6db0 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
660e6b50 01de1cfc 660e6db0 00000000 00000080 660e7080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
660e6c10 01dec4dd 660e7080 660e7080 660e7080 660e7080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
660e6f00 01ddb2fe 660e7518 660e7080 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
660ffca0 0201c6f8 ad455d40 00000000 00000000 acd6a1b0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
660ffce0 e8f87034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
660ffd10 e91e2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
660ffd90 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 11448 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 166352144.000000

- Registers -
rax=00000000000001d3 rbx=00000000ab845530 rcx=0000000000000074 rdx=00000000ab8451b0 rsi=00000000ab843320 rdi=00000000ab845530
r8=0000000000000008 r9=0000000000000040 r10=0000000000000140 r11=00000000beaefee3 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000e9230664 rsp=00000000661ffa78 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
661ffa70 e91e2dc7 00000000 00000000 ab843320 ab845530 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
661ffd70 e8f87034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
661ffda0 e91e2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
661ffe20 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 9128 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 166352144.000000

- Registers -
rax=00000000000001d3 rbx=00000000ab845e30 rcx=0000000000000074 rdx=00000000ab845ab0 rsi=00000000ab843320 rdi=00000000ab845e30
r8=00000000df2c5008 r9=00000000662fefd0 r10=00000000df2c00f0 r11=0000000000000001 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000e9230664 rsp=00000000662ff528 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
662ff520 e91e2dc7 00000000 00000000 ab843320 ab845e30 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
662ff820 e8f87034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
662ff850 e91e2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
662ff8d0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 17468 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 166352144.000000

- Registers -
rax=00000000000001d3 rbx=00000000ab846900 rcx=0000000000000074 rdx=00000000ab846580 rsi=00000000ab843320 rdi=00000000ab846900
r8=0000000000000005 r9=0000000000000005 r10=0000000000000000 r11=0000000000000660 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000e9230664 rsp=00000000663ff668 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
663ff660 e91e2dc7 00000000 00000000 ab843320 ab846900 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
663ff960 e8f87034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
663ff990 e91e2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
663ffa10 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 6552 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 166352304.000000

- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000665ff910 rsi=0000000000000000 rdi=0000000000000064
r8=00000000665ff8e8 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000e922d294 rsp=00000000665ff8e8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
665ff8e0 e6dbd84e 665ff9a8 00000000 00000000 00000000 ntdll!ZwDelayExecution+0x0 
665ff980 01dfa07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0 
665ff9b0 e8f87034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
665ff9e0 e91e2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
665ffa60 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 10088 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 166352304.000000

- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=00000000666ffa70 rsi=0000000000000000 rdi=000000000000000d
r8=00000000ad915090 r9=00000000ad628f00 r10=0000000000000000 r11=00000000666ff9e0 r12=0000000000000064 r13=00000000666ffa70
r14=00000000666ff770 r15=0000000000000000 rip=00000000e922d764 rsp=00000000666ff718 rbp=00000000ad628fc0
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
666ff710 e6dc0d40 00000000 65ea6000 e92fa4d0 65ea6000 ntdll!ZwWaitForMultipleObjects+0x0 
666ffa00 e6dc0c3e ab854360 004e0049 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
666ffa40 2466ba44 ad62d8e0 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
666ffc80 247008dd 00000000 00000004 00000000 00000000 nvcuda64!+0x0 
666ffd30 2466b413 314032bf 2ff4f52f adb724a0 00000000 nvcuda64!cuProfilerStop+0x0 
666ffd60 24979200 adb724a0 00000000 00000000 00000000 nvcuda64!+0x0 
666ffd90 e8f87034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
666ffdc0 e91e2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
666ffe40 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 5076 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 166352192.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002bc rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002bc
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=00000000ad64fce0 r13=0000000000000000
r14=00000000000002bc r15=0000000000000000 rip=00000000e922cc94 rsp=00000000667ff698 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
667ff690 e6d8a34e 00000000 00000000 00000000 00000000 ntdll!NtWaitForSingleObject+0x0 
667ff730 2487a9f8 00000000 e6d92cb5 00000000 000002bc KERNELBASE!WaitForSingleObjectEx+0x0 
667ff7a0 2466b413 00000001 adfd4e60 adb72710 00000000 nvcuda64!cuProfilerStop+0x0 
667ff7d0 24979200 adb72710 00000000 00000000 00000000 nvcuda64!+0x0 
667ff800 e8f87034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
667ff830 e91e2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
667ff8b0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 6796 (state: Waiting): ***

- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 166352288.000000

- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000ad918258 rdx=00000000668ff9b8 rsi=00000000668ff920 rdi=0000000000000000
r8=0000000000000001 r9=0000000000001a8c r10=00000000ad91c9d8 r11=000000000f16f87f r12=00000000668ff9b8 r13=0000000000000000
r14=00000000ad918258 r15=00000000ad91c9d8 rip=00000000e9230604 rsp=00000000668ff8f8 rbp=00000000668ff950
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
668ff8f0 e91f4295 00000102 00000102 00000000 668ff920 ntdll!ZwWaitForAlertByThreadId+0x0 
668ff960 e6ddb9d9 ad91a1c0 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0 
668ff990 245f21da ad91a1c0 e91e07b0 ad91a1c0 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0 
668ff9f0 2466b413 00000001 3124c024 00000000 00000000 nvcuda64!+0x0 
668ffa20 24979200 adb725f0 00000000 00000000 00000000 nvcuda64!+0x0 
668ffa50 e8f87034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
668ffa80 e91e2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
668ffb00 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)