Task 13135284

Name ParityModified-1647042451-516-1-0_0
Workunit 10260854
Created 14 Mar 2022, 5:38:40 UTC
Sent 21 Mar 2022, 18:03:13 UTC
Report deadline 29 Mar 2022, 18:03:13 UTC
Received 22 Mar 2022, 7:56:20 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 18317
Run time 2 hours 0 min 24 sec
CPU time 1 hours 54 min 44 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 882.14 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.55 GB
Peak swap size 3.45 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
           main:574]	:	INFO	:	Epoch 1100 | loss: nan | val_loss: nan | Time: 5323.14 ms
[2022-03-22 06:30:32	                main:574]	:	INFO	:	Epoch 1101 | loss: nan | val_loss: nan | Time: 5322.18 ms
[2022-03-22 06:30:37	                main:574]	:	INFO	:	Epoch 1102 | loss: nan | val_loss: nan | Time: 5319.91 ms
[2022-03-22 06:30:42	                main:574]	:	INFO	:	Epoch 1103 | loss: nan | val_loss: nan | Time: 5340.72 ms
[2022-03-22 06:30:48	                main:574]	:	INFO	:	Epoch 1104 | loss: nan | val_loss: nan | Time: 5325.28 ms
[2022-03-22 06:30:53	                main:574]	:	INFO	:	Epoch 1105 | loss: nan | val_loss: nan | Time: 5322.77 ms
[2022-03-22 06:30:58	                main:574]	:	INFO	:	Epoch 1106 | loss: nan | val_loss: nan | Time: 5326.69 ms
[2022-03-22 06:31:04	                main:574]	:	INFO	:	Epoch 1107 | loss: nan | val_loss: nan | Time: 5323.32 ms
[2022-03-22 06:31:09	                main:574]	:	INFO	:	Epoch 1108 | loss: nan | val_loss: nan | Time: 5328.75 ms
[2022-03-22 06:31:14	                main:574]	:	INFO	:	Epoch 1109 | loss: nan | val_loss: nan | Time: 5334.1 ms
[2022-03-22 06:31:20	                main:574]	:	INFO	:	Epoch 1110 | loss: nan | val_loss: nan | Time: 5326.27 ms
[2022-03-22 06:31:25	                main:574]	:	INFO	:	Epoch 1111 | loss: nan | val_loss: nan | Time: 5323.7 ms
[2022-03-22 06:31:30	                main:574]	:	INFO	:	Epoch 1112 | loss: nan | val_loss: nan | Time: 5324.43 ms
[2022-03-22 06:31:36	                main:574]	:	INFO	:	Epoch 1113 | loss: nan | val_loss: nan | Time: 5325.7 ms
[2022-03-22 06:31:41	                main:574]	:	INFO	:	Epoch 1114 | loss: nan | val_loss: nan | Time: 5318.23 ms
[2022-03-22 06:31:46	                main:574]	:	INFO	:	Epoch 1115 | loss: nan | val_loss: nan | Time: 5320.4 ms
[2022-03-22 06:31:52	                main:574]	:	INFO	:	Epoch 1116 | loss: nan | val_loss: nan | Time: 5328.42 ms
[2022-03-22 06:31:57	                main:574]	:	INFO	:	Epoch 1117 | loss: nan | val_loss: nan | Time: 5324.42 ms
[2022-03-22 06:32:02	                main:574]	:	INFO	:	Epoch 1118 | loss: nan | val_loss: nan | Time: 5323.67 ms
[2022-03-22 06:32:08	                main:574]	:	INFO	:	Epoch 1119 | loss: nan | val_loss: nan | Time: 5323.51 ms
[2022-03-22 06:32:13	                main:574]	:	INFO	:	Epoch 1120 | loss: nan | val_loss: nan | Time: 5325.64 ms
[2022-03-22 06:32:18	                main:574]	:	INFO	:	Epoch 1121 | loss: nan | val_loss: nan | Time: 5317.05 ms
[2022-03-22 06:32:24	                main:574]	:	INFO	:	Epoch 1122 | loss: nan | val_loss: nan | Time: 5324.55 ms
[2022-03-22 06:32:29	                main:574]	:	INFO	:	Epoch 1123 | loss: nan | val_loss: nan | Time: 5346.05 ms
[2022-03-22 06:32:34	                main:574]	:	INFO	:	Epoch 1124 | loss: nan | val_loss: nan | Time: 5321.63 ms
[2022-03-22 06:32:40	                main:574]	:	INFO	:	Epoch 1125 | loss: nan | val_loss: nan | Time: 5323.49 ms
[2022-03-22 06:32:45	                main:574]	:	INFO	:	Epoch 1126 | loss: nan | val_loss: nan | Time: 5326.03 ms
[2022-03-22 06:32:50	                main:574]	:	INFO	:	Epoch 1127 | loss: nan | val_loss: nan | Time: 5322.07 ms
[2022-03-22 06:32:56	                main:574]	:	INFO	:	Epoch 1128 | loss: nan | val_loss: nan | Time: 5319.56 ms
[2022-03-22 06:33:01	                main:574]	:	INFO	:	Epoch 1129 | loss: nan | val_loss: nan | Time: 5326.97 ms
[2022-03-22 06:33:06	                main:574]	:	INFO	:	Epoch 1130 | loss: nan | val_loss: nan | Time: 5323.58 ms
[2022-03-22 06:33:12	                main:574]	:	INFO	:	Epoch 1131 | loss: nan | val_loss: nan | Time: 5323.66 ms
[2022-03-22 06:33:17	                main:574]	:	INFO	:	Epoch 1132 | loss: nan | val_loss: nan | Time: 5332.72 ms
[2022-03-22 06:33:22	                main:574]	:	INFO	:	Epoch 1133 | loss: nan | val_loss: nan | Time: 5338.63 ms
[2022-03-22 06:33:28	                main:574]	:	INFO	:	Epoch 1134 | loss: nan | val_loss: nan | Time: 5325.76 ms
[2022-03-22 06:33:33	                main:574]	:	INFO	:	Epoch 1135 | loss: nan | val_loss: nan | Time: 5325.08 ms
[2022-03-22 06:33:38	                main:574]	:	INFO	:	Epoch 1136 | loss: nan | val_loss: nan | Time: 5326.15 ms
[2022-03-22 06:33:44	                main:574]	:	INFO	:	Epoch 1137 | loss: nan | val_loss: nan | Time: 5325.97 ms
[2022-03-22 06:33:49	                main:574]	:	INFO	:	Epoch 1138 | loss: nan | val_loss: nan | Time: 5322.19 ms
[2022-03-22 06:33:54	                main:574]	:	INFO	:	Epoch 1139 | loss: nan | val_loss: nan | Time: 5331.68 ms
[2022-03-22 06:34:00	                main:574]	:	INFO	:	Epoch 1140 | loss: nan | val_loss: nan | Time: 5329.55 ms
[2022-03-22 06:34:05	                main:574]	:	INFO	:	Epoch 1141 | loss: nan | val_loss: nan | Time: 5322.97 ms
[2022-03-22 06:34:10	                main:574]	:	INFO	:	Epoch 1142 | loss: nan | val_loss: nan | Time: 5322.45 ms
[2022-03-22 06:34:16	                main:574]	:	INFO	:	Epoch 1143 | loss: nan | val_loss: nan | Time: 5327.76 ms
[2022-03-22 06:34:21	                main:574]	:	INFO	:	Epoch 1144 | loss: nan | val_loss: nan | Time: 5324.17 ms
[2022-03-22 06:34:26	                main:574]	:	INFO	:	Epoch 1145 | loss: nan | val_loss: nan | Time: 5320.31 ms
[2022-03-22 06:34:32	                main:574]	:	INFO	:	Epoch 1146 | loss: nan | val_loss: nan | Time: 5355.13 ms
[2022-03-22 06:34:37	                main:574]	:	INFO	:	Epoch 1147 | loss: nan | val_loss: nan | Time: 5325.48 ms
[2022-03-22 06:34:42	                main:574]	:	INFO	:	Epoch 1148 | loss: nan | val_loss: nan | Time: 5320.73 ms
[2022-03-22 06:34:48	                main:574]	:	INFO	:	Epoch 1149 | loss: nan | val_loss: nan | Time: 5327.67 ms
[2022-03-22 06:34:53	                main:574]	:	INFO	:	Epoch 1150 | loss: nan | val_loss: nan | Time: 5328.49 ms
[2022-03-22 06:34:58	                main:574]	:	INFO	:	Epoch 1151 | loss: nan | val_loss: nan | Time: 5321.68 ms
[2022-03-22 06:35:03	                main:574]	:	INFO	:	Epoch 1152 | loss: nan | val_loss: nan | Time: 5321.18 ms
[2022-03-22 06:35:09	                main:574]	:	INFO	:	Epoch 1153 | loss: nan | val_loss: nan | Time: 5334.83 ms
[2022-03-22 06:35:14	                main:574]	:	INFO	:	Epoch 1154 | loss: nan | val_loss: nan | Time: 5324.75 ms
[2022-03-22 06:35:19	                main:574]	:	INFO	:	Epoch 1155 | loss: nan | val_loss: nan | Time: 5327.22 ms
[2022-03-22 06:35:25	                main:574]	:	INFO	:	Epoch 1156 | loss: nan | val_loss: nan | Time: 5323.66 ms
[2022-03-22 06:35:30	                main:574]	:	INFO	:	Epoch 1157 | loss: nan | val_loss: nan | Time: 5324.89 ms
[2022-03-22 06:35:35	                main:574]	:	INFO	:	Epoch 1158 | loss: nan | val_loss: nan | Time: 5325.15 ms
[2022-03-22 06:35:41	                main:574]	:	INFO	:	Epoch 1159 | loss: nan | val_loss: nan | Time: 5321.33 ms
[2022-03-22 06:35:46	                main:574]	:	INFO	:	Epoch 1160 | loss: nan | val_loss: nan | Time: 5328.46 ms
[2022-03-22 06:35:51	                main:574]	:	INFO	:	Epoch 1161 | loss: nan | val_loss: nan | Time: 5323.89 ms
[2022-03-22 06:35:57	                main:574]	:	INFO	:	Epoch 1162 | loss: nan | val_loss: nan | Time: 5327.23 ms
[2022-03-22 06:36:02	                main:574]	:	INFO	:	Epoch 1163 | loss: nan | val_loss: nan | Time: 5323.35 ms
[2022-03-22 06:36:07	                main:574]	:	INFO	:	Epoch 1164 | loss: nan | val_loss: nan | Time: 5326.77 ms
[2022-03-22 06:36:13	                main:574]	:	INFO	:	Epoch 1165 | loss: nan | val_loss: nan | Time: 5320.33 ms
[2022-03-22 06:36:18	                main:574]	:	INFO	:	Epoch 1166 | loss: nan | val_loss: nan | Time: 5325.32 ms
[2022-03-22 06:36:23	                main:574]	:	INFO	:	Epoch 1167 | loss: nan | val_loss: nan | Time: 5335.39 ms
[2022-03-22 06:36:29	                main:574]	:	INFO	:	Epoch 1168 | loss: nan | val_loss: nan | Time: 5327.78 ms
[2022-03-22 06:36:34	                main:574]	:	INFO	:	Epoch 1169 | loss: nan | val_loss: nan | Time: 5320.34 ms
[2022-03-22 06:36:39	                main:574]	:	INFO	:	Epoch 1170 | loss: nan | val_loss: nan | Time: 5320.77 ms
[2022-03-22 06:36:45	                main:574]	:	INFO	:	Epoch 1171 | loss: nan | val_loss: nan | Time: 5318.83 ms
[2022-03-22 06:36:50	                main:574]	:	INFO	:	Epoch 1172 | loss: nan | val_loss: nan | Time: 5331.19 ms
[2022-03-22 06:36:55	                main:574]	:	INFO	:	Epoch 1173 | loss: nan | val_loss: nan | Time: 5320.37 ms
[2022-03-22 06:37:01	                main:574]	:	INFO	:	Epoch 1174 | loss: nan | val_loss: nan | Time: 5322.89 ms
[2022-03-22 06:37:06	                main:574]	:	INFO	:	Epoch 1175 | loss: nan | val_loss: nan | Time: 5325.53 ms
[2022-03-22 06:37:11	                main:574]	:	INFO	:	Epoch 1176 | loss: nan | val_loss: nan | Time: 5323.66 ms
[2022-03-22 06:37:17	                main:574]	:	INFO	:	Epoch 1177 | loss: nan | val_loss: nan | Time: 5324.41 ms
[2022-03-22 06:37:22	                main:574]	:	INFO	:	Epoch 1178 | loss: nan | val_loss: nan | Time: 5324.5 ms
[2022-03-22 06:37:27	                main:574]	:	INFO	:	Epoch 1179 | loss: nan | val_loss: nan | Time: 5327.51 ms
[2022-03-22 06:37:33	                main:574]	:	INFO	:	Epoch 1180 | loss: nan | val_loss: nan | Time: 5323.52 ms
[2022-03-22 06:37:38	                main:574]	:	INFO	:	Epoch 1181 | loss: nan | val_loss: nan | Time: 5333.66 ms
[2022-03-22 06:37:43	                main:574]	:	INFO	:	Epoch 1182 | loss: nan | val_loss: nan | Time: 5328.4 ms
[2022-03-22 06:37:49	                main:574]	:	INFO	:	Epoch 1183 | loss: nan | val_loss: nan | Time: 5374.65 ms
[2022-03-22 06:37:54	                main:574]	:	INFO	:	Epoch 1184 | loss: nan | val_loss: nan | Time: 5316.76 ms
[2022-03-22 06:37:59	                main:574]	:	INFO	:	Epoch 1185 | loss: nan | val_loss: nan | Time: 5328 ms
[2022-03-22 06:38:05	                main:574]	:	INFO	:	Epoch 1186 | loss: nan | val_loss: nan | Time: 5321.53 ms
[2022-03-22 06:38:10	                main:574]	:	INFO	:	Epoch 1187 | loss: nan | val_loss: nan | Time: 5319.31 ms
[2022-03-22 06:38:15	                main:574]	:	INFO	:	Epoch 1188 | loss: nan | val_loss: nan | Time: 5328.72 ms
[2022-03-22 06:38:21	                main:574]	:	INFO	:	Epoch 1189 | loss: nan | val_loss: nan | Time: 5323.39 ms
[2022-03-22 06:38:26	                main:574]	:	INFO	:	Epoch 1190 | loss: nan | val_loss: nan | Time: 5324.21 ms
[2022-03-22 06:38:31	                main:574]	:	INFO	:	Epoch 1191 | loss: nan | val_loss: nan | Time: 5328.68 ms
[2022-03-22 06:38:37	                main:574]	:	INFO	:	Epoch 1192 | loss: nan | val_loss: nan | Time: 5324.33 ms
[2022-03-22 06:38:42	                main:574]	:	INFO	:	Epoch 1193 | loss: nan | val_loss: nan | Time: 5326.01 ms
[2022-03-22 06:38:47	                main:574]	:	INFO	:	Epoch 1194 | loss: nan | val_loss: nan | Time: 5326.23 ms
[2022-03-22 06:38:53	                main:574]	:	INFO	:	Epoch 1195 | loss: nan | val_loss: nan | Time: 5327.65 ms
[2022-03-22 06:38:58	                main:574]	:	INFO	:	Epoch 1196 | loss: nan | val_loss: nan | Time: 5325.3 ms
[2022-03-22 06:39:03	                main:574]	:	INFO	:	Epoch 1197 | loss: nan | val_loss: nan | Time: 5326.26 ms
[2022-03-22 06:39:09	                main:574]	:	INFO	:	Epoch 1198 | loss: nan | val_loss: nan | Time: 5320.66 ms
[2022-03-22 06:39:14	                main:574]	:	INFO	:	Epoch 1199 | loss: nan | val_loss: nan | Time: 5327.02 ms
[2022-03-22 06:39:19	                main:574]	:	INFO	:	Epoch 1200 | loss: nan | val_loss: nan | Time: 5319.82 ms
[2022-03-22 06:39:25	                main:574]	:	INFO	:	Epoch 1201 | loss: nan | val_loss: nan | Time: 5330.97 ms
[2022-03-22 06:39:30	                main:574]	:	INFO	:	Epoch 1202 | loss: nan | val_loss: nan | Time: 5328.31 ms
[2022-03-22 06:39:35	                main:574]	:	INFO	:	Epoch 1203 | loss: nan | val_loss: nan | Time: 5331.21 ms
[2022-03-22 06:39:41	                main:574]	:	INFO	:	Epoch 1204 | loss: nan | val_loss: nan | Time: 5323.28 ms
[2022-03-22 06:39:46	                main:574]	:	INFO	:	Epoch 1205 | loss: nan | val_loss: nan | Time: 5343.8 ms
[2022-03-22 06:39:51	                main:574]	:	INFO	:	Epoch 1206 | loss: nan | val_loss: nan | Time: 5339.21 ms
[2022-03-22 06:39:57	                main:574]	:	INFO	:	Epoch 1207 | loss: nan | val_loss: nan | Time: 5326.29 ms
[2022-03-22 06:40:02	                main:574]	:	INFO	:	Epoch 1208 | loss: nan | val_loss: nan | Time: 5323.33 ms
[2022-03-22 06:40:07	                main:574]	:	INFO	:	Epoch 1209 | loss: nan | val_loss: nan | Time: 5329.33 ms
[2022-03-22 06:40:13	                main:574]	:	INFO	:	Epoch 1210 | loss: nan | val_loss: nan | Time: 5323.41 ms
[2022-03-22 06:40:18	                main:574]	:	INFO	:	Epoch 1211 | loss: nan | val_loss: nan | Time: 5325.55 ms
[2022-03-22 06:40:23	                main:574]	:	INFO	:	Epoch 1212 | loss: nan | val_loss: nan | Time: 5322.96 ms
[2022-03-22 06:40:29	                main:574]	:	INFO	:	Epoch 1213 | loss: nan | val_loss: nan | Time: 5322.35 ms
[2022-03-22 06:40:34	                main:574]	:	INFO	:	Epoch 1214 | loss: nan | val_loss: nan | Time: 5322.89 ms
[2022-03-22 06:40:39	                main:574]	:	INFO	:	Epoch 1215 | loss: nan | val_loss: nan | Time: 5326.73 ms
[2022-03-22 06:40:45	                main:574]	:	INFO	:	Epoch 1216 | loss: nan | val_loss: nan | Time: 5327.94 ms
[2022-03-22 06:40:50	                main:574]	:	INFO	:	Epoch 1217 | loss: nan | val_loss: nan | Time: 5329.83 ms
[2022-03-22 06:40:55	                main:574]	:	INFO	:	Epoch 1218 | loss: nan | val_loss: nan | Time: 5322.55 ms
[2022-03-22 06:41:01	                main:574]	:	INFO	:	Epoch 1219 | loss: nan | val_loss: nan | Time: 5327.21 ms
[2022-03-22 06:41:06	                main:574]	:	INFO	:	Epoch 1220 | loss: nan | val_loss: nan | Time: 5325.89 ms
[2022-03-22 06:41:11	                main:574]	:	INFO	:	Epoch 1221 | loss: nan | val_loss: nan | Time: 5320.07 ms
[2022-03-22 06:41:17	                main:574]	:	INFO	:	Epoch 1222 | loss: nan | val_loss: nan | Time: 5323.44 ms
[2022-03-22 06:41:22	                main:574]	:	INFO	:	Epoch 1223 | loss: nan | val_loss: nan | Time: 5329.18 ms
[2022-03-22 06:41:27	                main:574]	:	INFO	:	Epoch 1224 | loss: nan | val_loss: nan | Time: 5327.11 ms
[2022-03-22 06:41:33	                main:574]	:	INFO	:	Epoch 1225 | loss: nan | val_loss: nan | Time: 5319.49 ms
[2022-03-22 06:41:38	                main:574]	:	INFO	:	Epoch 1226 | loss: nan | val_loss: nan | Time: 5323.46 ms
[2022-03-22 06:41:43	                main:574]	:	INFO	:	Epoch 1227 | loss: nan | val_loss: nan | Time: 5330.07 ms
[2022-03-22 06:41:49	                main:574]	:	INFO	:	Epoch 1228 | loss: nan | val_loss: nan | Time: 5321.35 ms
[2022-03-22 06:41:54	                main:574]	:	INFO	:	Epoch 1229 | loss: nan | val_loss: nan | Time: 5327.89 ms
[2022-03-22 06:41:59	                main:574]	:	INFO	:	Epoch 1230 | loss: nan | val_loss: nan | Time: 5325.09 ms
[2022-03-22 06:42:05	                main:574]	:	INFO	:	Epoch 1231 | loss: nan | val_loss: nan | Time: 5320.41 ms
[2022-03-22 06:42:10	                main:574]	:	INFO	:	Epoch 1232 | loss: nan | val_loss: nan | Time: 5324.76 ms
[2022-03-22 06:42:15	                main:574]	:	INFO	:	Epoch 1233 | loss: nan | val_loss: nan | Time: 5324.01 ms
[2022-03-22 06:42:21	                main:574]	:	INFO	:	Epoch 1234 | loss: nan | val_loss: nan | Time: 5325.15 ms
[2022-03-22 06:42:26	                main:574]	:	INFO	:	Epoch 1235 | loss: nan | val_loss: nan | Time: 5316.44 ms
[2022-03-22 06:42:31	                main:574]	:	INFO	:	Epoch 1236 | loss: nan | val_loss: nan | Time: 5403.57 ms
[2022-03-22 06:42:37	                main:574]	:	INFO	:	Epoch 1237 | loss: nan | val_loss: nan | Time: 5333.01 ms
[2022-03-22 06:42:42	                main:574]	:	INFO	:	Epoch 1238 | loss: nan | val_loss: nan | Time: 5329.65 ms
[2022-03-22 06:42:47	                main:574]	:	INFO	:	Epoch 1239 | loss: nan | val_loss: nan | Time: 5323.36 ms
[2022-03-22 06:42:53	                main:574]	:	INFO	:	Epoch 1240 | loss: nan | val_loss: nan | Time: 5324.7 ms
[2022-03-22 06:42:58	                main:574]	:	INFO	:	Epoch 1241 | loss: nan | val_loss: nan | Time: 5325.55 ms
[2022-03-22 06:43:03	                main:574]	:	INFO	:	Epoch 1242 | loss: nan | val_loss: nan | Time: 5323.75 ms
[2022-03-22 06:43:09	                main:574]	:	INFO	:	Epoch 1243 | loss: nan | val_loss: nan | Time: 5332.69 ms
[2022-03-22 06:43:14	                main:574]	:	INFO	:	Epoch 1244 | loss: nan | val_loss: nan | Time: 5339.1 ms
[2022-03-22 06:43:19	                main:574]	:	INFO	:	Epoch 1245 | loss: nan | val_loss: nan | Time: 5323.01 ms
[2022-03-22 06:43:25	                main:574]	:	INFO	:	Epoch 1246 | loss: nan | val_loss: nan | Time: 5323 ms
[2022-03-22 06:43:30	                main:574]	:	INFO	:	Epoch 1247 | loss: nan | val_loss: nan | Time: 5315.81 ms
[2022-03-22 06:43:35	                main:574]	:	INFO	:	Epoch 1248 | loss: nan | val_loss: nan | Time: 5327.09 ms
[2022-03-22 06:43:41	                main:574]	:	INFO	:	Epoch 1249 | loss: nan | val_loss: nan | Time: 5317.71 ms
[2022-03-22 06:43:46	                main:574]	:	INFO	:	Epoch 1250 | loss: nan | val_loss: nan | Time: 5323.24 ms
[2022-03-22 06:43:51	                main:574]	:	INFO	:	Epoch 1251 | loss: nan | val_loss: nan | Time: 5325.8 ms
[2022-03-22 06:43:57	                main:574]	:	INFO	:	Epoch 1252 | loss: nan | val_loss: nan | Time: 5323.78 ms
[2022-03-22 06:44:02	                main:574]	:	INFO	:	Epoch 1253 | loss: nan | val_loss: nan | Time: 5327.13 ms
[2022-03-22 06:44:07	                main:574]	:	INFO	:	Epoch 1254 | loss: nan | val_loss: nan | Time: 5325.9 ms
[2022-03-22 06:44:13	                main:574]	:	INFO	:	Epoch 1255 | loss: nan | val_loss: nan | Time: 5333.88 ms
[2022-03-22 06:44:18	                main:574]	:	INFO	:	Epoch 1256 | loss: nan | val_loss: nan | Time: 5326.68 ms
[2022-03-22 06:44:23	                main:574]	:	INFO	:	Epoch 1257 | loss: nan | val_loss: nan | Time: 5318.48 ms
[2022-03-22 06:44:29	                main:574]	:	INFO	:	Epoch 1258 | loss: nan | val_loss: nan | Time: 5328.74 ms
[2022-03-22 06:44:34	                main:574]	:	INFO	:	Epoch 1259 | loss: nan | val_loss: nan | Time: 5326.66 ms
[2022-03-22 06:44:39	                main:574]	:	INFO	:	Epoch 1260 | loss: nan | val_loss: nan | Time: 5331.8 ms
[2022-03-22 06:44:45	                main:574]	:	INFO	:	Epoch 1261 | loss: nan | val_loss: nan | Time: 5319.82 ms
[2022-03-22 06:44:50	                main:574]	:	INFO	:	Epoch 1262 | loss: nan | val_loss: nan | Time: 5326.94 ms
[2022-03-22 06:44:55	                main:574]	:	INFO	:	Epoch 1263 | loss: nan | val_loss: nan | Time: 5322.41 ms
[2022-03-22 06:45:01	                main:574]	:	INFO	:	Epoch 1264 | loss: nan | val_loss: nan | Time: 5326.4 ms
[2022-03-22 06:45:06	                main:574]	:	INFO	:	Epoch 1265 | loss: nan | val_loss: nan | Time: 5328.07 ms
[2022-03-22 06:45:11	                main:574]	:	INFO	:	Epoch 1266 | loss: nan | val_loss: nan | Time: 5327.54 ms
[2022-03-22 06:45:17	                main:574]	:	INFO	:	Epoch 1267 | loss: nan | val_loss: nan | Time: 5318.03 ms
[2022-03-22 06:45:22	                main:574]	:	INFO	:	Epoch 1268 | loss: nan | val_loss: nan | Time: 5318.09 ms
[2022-03-22 06:45:27	                main:574]	:	INFO	:	Epoch 1269 | loss: nan | val_loss: nan | Time: 5329.01 ms
[2022-03-22 06:45:33	                main:574]	:	INFO	:	Epoch 1270 | loss: nan | val_loss: nan | Time: 5316.81 ms
[2022-03-22 06:45:38	                main:574]	:	INFO	:	Epoch 1271 | loss: nan | val_loss: nan | Time: 5321.78 ms
[2022-03-22 06:45:43	                main:574]	:	INFO	:	Epoch 1272 | loss: nan | val_loss: nan | Time: 5325.23 ms
[2022-03-22 06:45:49	                main:574]	:	INFO	:	Epoch 1273 | loss: nan | val_loss: nan | Time: 5329.25 ms
[2022-03-22 06:45:54	                main:574]	:	INFO	:	Epoch 1274 | loss: nan | val_loss: nan | Time: 5322.65 ms
[2022-03-22 06:45:59	                main:574]	:	INFO	:	Epoch 1275 | loss: nan | val_loss: nan | Time: 5327.49 ms
[2022-03-22 06:46:05	                main:574]	:	INFO	:	Epoch 1276 | loss: nan | val_loss: nan | Time: 5322.02 ms
[2022-03-22 06:46:10	                main:574]	:	INFO	:	Epoch 1277 | loss: nan | val_loss: nan | Time: 5322.78 ms
[2022-03-22 06:46:15	                main:574]	:	INFO	:	Epoch 1278 | loss: nan | val_loss: nan | Time: 5322.18 ms
[2022-03-22 06:46:21	                main:574]	:	INFO	:	Epoch 1279 | loss: nan | val_loss: nan | Time: 5322.26 ms
[2022-03-22 06:46:26	                main:574]	:	INFO	:	Epoch 1280 | loss: nan | val_loss: nan | Time: 5325.05 ms
[2022-03-22 06:46:31	                main:574]	:	INFO	:	Epoch 1281 | loss: nan | val_loss: nan | Time: 5319.98 ms
[2022-03-22 06:46:36	                main:574]	:	INFO	:	Epoch 1282 | loss: nan | val_loss: nan | Time: 5318.56 ms
[2022-03-22 06:46:42	                main:574]	:	INFO	:	Epoch 1283 | loss: nan | val_loss: nan | Time: 5326.99 ms
[2022-03-22 06:46:47	                main:574]	:	INFO	:	Epoch 1284 | loss: nan | val_loss: nan | Time: 5326.36 ms
[2022-03-22 06:46:52	                main:574]	:	INFO	:	Epoch 1285 | loss: nan | val_loss: nan | Time: 5325.9 ms
[2022-03-22 06:46:58	                main:574]	:	INFO	:	Epoch 1286 | loss: nan | val_loss: nan | Time: 5333.01 ms
[2022-03-22 06:47:03	                main:574]	:	INFO	:	Epoch 1287 | loss: nan | val_loss: nan | Time: 5322.16 ms
[2022-03-22 06:47:08	                main:574]	:	INFO	:	Epoch 1288 | loss: nan | val_loss: nan | Time: 5324.86 ms
[2022-03-22 06:47:14	                main:574]	:	INFO	:	Epoch 1289 | loss: nan | val_loss: nan | Time: 5323.14 ms
[2022-03-22 06:47:19	                main:574]	:	INFO	:	Epoch 1290 | loss: nan | val_loss: nan | Time: 5326.14 ms
[2022-03-22 06:47:24	                main:574]	:	INFO	:	Epoch 1291 | loss: nan | val_loss: nan | Time: 5324.61 ms
[2022-03-22 06:47:30	                main:574]	:	INFO	:	Epoch 1292 | loss: nan | val_loss: nan | Time: 5325.1 ms
[2022-03-22 06:47:35	                main:574]	:	INFO	:	Epoch 1293 | loss: nan | val_loss: nan | Time: 5327.4 ms
[2022-03-22 06:47:40	                main:574]	:	INFO	:	Epoch 1294 | loss: nan | val_loss: nan | Time: 5327.43 ms
[2022-03-22 06:47:46	                main:574]	:	INFO	:	Epoch 1295 | loss: nan | val_loss: nan | Time: 5322.58 ms
[2022-03-22 06:47:51	                main:574]	:	INFO	:	Epoch 1296 | loss: nan | val_loss: nan | Time: 5320.04 ms
[2022-03-22 06:47:56	                main:574]	:	INFO	:	Epoch 1297 | loss: nan | val_loss: nan | Time: 5330.03 ms
[2022-03-22 06:48:02	                main:574]	:	INFO	:	Epoch 1298 | loss: nan | val_loss: nan | Time: 5321.81 ms
[2022-03-22 06:48:07	                main:574]	:	INFO	:	Epoch 1299 | loss: nan | val_loss: nan | Time: 5323.15 ms
[2022-03-22 06:48:12	                main:574]	:	INFO	:	Epoch 1300 | loss: nan | val_loss: nan | Time: 5333.65 ms
[2022-03-22 06:48:18	                main:574]	:	INFO	:	Epoch 1301 | loss: nan | val_loss: nan | Time: 5323.47 ms
[2022-03-22 06:48:23	                main:574]	:	INFO	:	Epoch 1302 | loss: nan | val_loss: nan | Time: 5322.72 ms
[2022-03-22 06:48:28	                main:574]	:	INFO	:	Epoch 1303 | loss: nan | val_loss: nan | Time: 5323.92 ms
[2022-03-22 06:48:34	                main:574]	:	INFO	:	Epoch 1304 | loss: nan | val_loss: nan | Time: 5323.6 ms
[2022-03-22 06:48:39	                main:574]	:	INFO	:	Epoch 1305 | loss: nan | val_loss: nan | Time: 5320.63 ms
[2022-03-22 06:48:44	                main:574]	:	INFO	:	Epoch 1306 | loss: nan | val_loss: nan | Time: 5322.77 ms
[2022-03-22 06:48:50	                main:574]	:	INFO	:	Epoch 1307 | loss: nan | val_loss: nan | Time: 5331.59 ms
[2022-03-22 06:48:55	                main:574]	:	INFO	:	Epoch 1308 | loss: nan | val_loss: nan | Time: 5324.92 ms
[2022-03-22 06:49:00	                main:574]	:	INFO	:	Epoch 1309 | loss: nan | val_loss: nan | Time: 5319.83 ms
[2022-03-22 06:49:06	                main:574]	:	INFO	:	Epoch 1310 | loss: nan | val_loss: nan | Time: 5323.2 ms
[2022-03-22 06:49:11	                main:574]	:	INFO	:	Epoch 1311 | loss: nan | val_loss: nan | Time: 5324.41 ms
[2022-03-22 06:49:16	                main:574]	:	INFO	:	Epoch 1312 | loss: nan | val_loss: nan | Time: 5321.36 ms
[2022-03-22 06:49:22	                main:574]	:	INFO	:	Epoch 1313 | loss: nan | val_loss: nan | Time: 5324.11 ms
[2022-03-22 06:49:27	                main:574]	:	INFO	:	Epoch 1314 | loss: nan | val_loss: nan | Time: 5334.96 ms
[2022-03-22 06:49:32	                main:574]	:	INFO	:	Epoch 1315 | loss: nan | val_loss: nan | Time: 5323.68 ms
[2022-03-22 06:49:38	                main:574]	:	INFO	:	Epoch 1316 | loss: nan | val_loss: nan | Time: 5324.86 ms
[2022-03-22 06:49:43	                main:574]	:	INFO	:	Epoch 1317 | loss: nan | val_loss: nan | Time: 5320.44 ms
[2022-03-22 06:49:48	                main:574]	:	INFO	:	Epoch 1318 | loss: nan | val_loss: nan | Time: 5325.46 ms
[2022-03-22 06:49:54	                main:574]	:	INFO	:	Epoch 1319 | loss: nan | val_loss: nan | Time: 5318.75 ms
[2022-03-22 06:49:59	                main:574]	:	INFO	:	Epoch 1320 | loss: nan | val_loss: nan | Time: 5326.47 ms
[2022-03-22 06:50:04	                main:574]	:	INFO	:	Epoch 1321 | loss: nan | val_loss: nan | Time: 5325.56 ms
[2022-03-22 06:50:10	                main:574]	:	INFO	:	Epoch 1322 | loss: nan | val_loss: nan | Time: 5324.34 ms
[2022-03-22 06:50:15	                main:574]	:	INFO	:	Epoch 1323 | loss: nan | val_loss: nan | Time: 5320.89 ms
[2022-03-22 06:50:20	                main:574]	:	INFO	:	Epoch 1324 | loss: nan | val_loss: nan | Time: 5321.29 ms
[2022-03-22 06:50:26	                main:574]	:	INFO	:	Epoch 1325 | loss: nan | val_loss: nan | Time: 5331.89 ms
[2022-03-22 06:50:31	                main:574]	:	INFO	:	Epoch 1326 | loss: nan | val_loss: nan | Time: 5320.28 ms
[2022-03-22 06:50:36	                main:574]	:	INFO	:	Epoch 1327 | loss: nan | val_loss: nan | Time: 5319.44 ms
[2022-03-22 06:50:42	                main:574]	:	INFO	:	Epoch 1328 | loss: nan | val_loss: nan | Time: 5323.53 ms
[2022-03-22 06:50:47	                main:574]	:	INFO	:	Epoch 1329 | loss: nan | val_loss: nan | Time: 5325.8 ms
[2022-03-22 06:50:52	                main:574]	:	INFO	:	Epoch 1330 | loss: nan | val_loss: nan | Time: 5318.3 ms
[2022-03-22 06:50:58	                main:574]	:	INFO	:	Epoch 1331 | loss: nan | val_loss: nan | Time: 5327.68 ms
[2022-03-22 06:51:03	                main:574]	:	INFO	:	Epoch 1332 | loss: nan | val_loss: nan | Time: 5332.44 ms
[2022-03-22 06:51:08	                main:574]	:	INFO	:	Epoch 1333 | loss: nan | val_loss: nan | Time: 5324.77 ms
[2022-03-22 06:51:14	                main:574]	:	INFO	:	Epoch 1334 | loss: nan | val_loss: nan | Time: 5327.91 ms
[2022-03-22 06:51:19	                main:574]	:	INFO	:	Epoch 1335 | loss: nan | val_loss: nan | Time: 5325.66 ms
[2022-03-22 06:51:24	                main:574]	:	INFO	:	Epoch 1336 | loss: nan | val_loss: nan | Time: 5322.32 ms
[2022-03-22 06:51:30	                main:574]	:	INFO	:	Epoch 1337 | loss: nan | val_loss: nan | Time: 5324.43 ms
[2022-03-22 06:51:35	                main:574]	:	INFO	:	Epoch 1338 | loss: nan | val_loss: nan | Time: 5325.56 ms
[2022-03-22 06:51:40	                main:574]	:	INFO	:	Epoch 1339 | loss: nan | val_loss: nan | Time: 5332.49 ms
[2022-03-22 06:51:46	                main:574]	:	INFO	:	Epoch 1340 | loss: nan | val_loss: nan | Time: 5318.68 ms
[2022-03-22 06:51:51	                main:574]	:	INFO	:	Epoch 1341 | loss: nan | val_loss: nan | Time: 5322.83 ms
[2022-03-22 06:51:56	                main:574]	:	INFO	:	Epoch 1342 | loss: nan | val_loss: nan | Time: 5331.19 ms
[2022-03-22 06:52:02	                main:574]	:	INFO	:	Epoch 1343 | loss: nan | val_loss: nan | Time: 5325.75 ms
[2022-03-22 06:52:07	                main:574]	:	INFO	:	Epoch 1344 | loss: nan | val_loss: nan | Time: 5326.42 ms
[2022-03-22 06:52:12	                main:574]	:	INFO	:	Epoch 1345 | loss: nan | val_loss: nan | Time: 5322.48 ms
[2022-03-22 06:52:18	                main:574]	:	INFO	:	Epoch 1346 | loss: nan | val_loss: nan | Time: 5327.64 ms
[2022-03-22 06:52:23	                main:574]	:	INFO	:	Epoch 1347 | loss: nan | val_loss: nan | Time: 5326.31 ms
[2022-03-22 06:52:28	                main:574]	:	INFO	:	Epoch 1348 | loss: nan | val_loss: nan | Time: 5329.81 ms
[2022-03-22 06:52:34	                main:574]	:	INFO	:	Epoch 1349 | loss: nan | val_loss: nan | Time: 5324.52 ms
[2022-03-22 06:52:39	                main:574]	:	INFO	:	Epoch 1350 | loss: nan | val_loss: nan | Time: 5325.16 ms
[2022-03-22 06:52:44	                main:574]	:	INFO	:	Epoch 1351 | loss: nan | val_loss: nan | Time: 5328.64 ms
[2022-03-22 06:52:50	                main:574]	:	INFO	:	Epoch 1352 | loss: nan | val_loss: nan | Time: 5322.41 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce 940MX)
[2022-03-22 08:54:14	                main:435]	:	INFO	:	Set logging level to 1
[2022-03-22 08:54:14	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-03-22 08:54:14	                main:444]	:	INFO	:	Resolving all filenames
[2022-03-22 08:54:14	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-22 08:54:14	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-22 08:54:14	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-22 08:54:14	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-22 08:54:14	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-22 08:54:14	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-03-22 08:54:14	                main:474]	:	INFO	:	Configuration: 
[2022-03-22 08:54:14	                main:475]	:	INFO	:	    Model type: GRU
[2022-03-22 08:54:14	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-03-22 08:54:14	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-03-22 08:54:14	                main:478]	:	INFO	:	    Batch Size: 128
[2022-03-22 08:54:14	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-03-22 08:54:14	                main:480]	:	INFO	:	    Patience: 10
[2022-03-22 08:54:14	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-03-22 08:54:14	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-03-22 08:54:14	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-03-22 08:54:14	                main:484]	:	INFO	:	    # Threads: 1
[2022-03-22 08:54:14	                main:486]	:	INFO	:	Preparing Dataset
[2022-03-22 08:54:14	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-22 08:54:15	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-03-22 08:54:17	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-03-22 08:54:17	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-03-22 08:54:18	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-03-22 08:54:18	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-03-22 08:54:18	                main:494]	:	INFO	:	Creating Model
[2022-03-22 08:54:18	                main:507]	:	INFO	:	Preparing config file
[2022-03-22 08:54:18	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-03-22 08:54:18	                main:512]	:	INFO	:	Loading config


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFBDD114F69

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 03/22/22 08:54:18
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\0;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 00000000922f0000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000df5d0000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1586

ModLoad: 00000000de330000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1586

ModLoad: 00000000dd0e0000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1586

ModLoad: 00000000deb40000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1586

ModLoad: 00000000dd030000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1586) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1586

ModLoad: 00000000df560000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202

ModLoad: 00000000dd520000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 00000000dcf90000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 00000000dd420000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 00000000dd860000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1586

ModLoad: 00000000dd7c0000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.19041.546

ModLoad: 00000000ddc80000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.1586) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000dedc0000 0000000000125000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1586

ModLoad: 000000003ce40000 0000000024b49000 C:\ProgramData\BOINC\slots\0\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000cd0d0000 0000000000058000 C:\ProgramData\BOINC\slots\0\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000082e50000 00000000030a5000 C:\ProgramData\BOINC\slots\0\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 00000000cb8c0000 0000000000045000 C:\ProgramData\BOINC\slots\0\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000077db0000 00000000034b2000 C:\ProgramData\BOINC\slots\0\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 0000000021a90000 000000001b3a4000 C:\ProgramData\BOINC\slots\0\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 00000000d7340000 0000000000010000 C:\ProgramData\BOINC\slots\0\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 000000006cc20000 000000000919f000 C:\ProgramData\BOINC\slots\0\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 0000000068ec0000 0000000003d5b000 C:\ProgramData\BOINC\slots\0\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000d9690000 000000000008e000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.30.30704.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\3\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.30.30704.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.30.30704.0

ModLoad: 00000000d9bb0000 000000000001b000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.30.30704.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\3\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.30.30704.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.30.30704.0

ModLoad: 00000000d9680000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.30.30704.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\3\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.30.30704.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.30.30704.0

ModLoad: 0000000016ea0000 000000000abe7000 C:\ProgramData\BOINC\slots\0\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000daa70000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.867

ModLoad: 0000000080f80000 0000000001eca000 C:\ProgramData\BOINC\slots\0\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 000000009e4d0000 000000000020d000 C:\ProgramData\BOINC\slots\0\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 0000000095440000 00000000002db000 C:\ProgramData\BOINC\slots\0\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000d2970000 0000000000040000 C:\ProgramData\BOINC\slots\0\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000de1e0000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000db550000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000defb0000 0000000000470000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1586

ModLoad: 00000000dd060000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 00000000dd0b0000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1586

ModLoad: 00000000dcab0000 0000000000033000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 00000000dd3b0000 0000000000068000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 00000000dcda0000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1586

ModLoad: 00000000dc8d0000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000de3f0000 0000000000744000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1586

ModLoad: 00000000dada0000 0000000000794000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1586

ModLoad: 00000000ddd30000 0000000000354000 C:\WINDOWS\System32\combase.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1586

ModLoad: 00000000dc750000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1586

ModLoad: 00000000dd910000 00000000000ad000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1586

ModLoad: 00000000de100000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1586

ModLoad: 000000009c020000 0000000000244000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.5167) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r450\r451_65\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 27.21.14.5167
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.0.208 driver
    Product Version       : 27.21.14.5167

ModLoad: 00000000d55c0000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000007c860000 0000000001338000 C:\WINDOWS\system32\DriverStore\FileRepository\nvam.inf_amd64_1cb913a256e10ee4\nvcuda64.dll (27.21.14.5167) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r450\r451_65\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 27.21.14.5167
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.0.208 driver
    Product Version       : 27.21.14.5167

ModLoad: 00000000de090000 000000000006b000 C:\WINDOWS\System32\WS2_32.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : ws2_32.pdb
    File Version          : 10.0.19041.1081 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1081

ModLoad: 00000000d9930000 000000000009e000 C:\WINDOWS\system32\uxtheme.dll (6.2.19041.1266) (-exported- Symbols Loaded)
    Linked PDB Filename   : UxTheme.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1586

ModLoad: 00000000d0830000 0000000000554000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.5167) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r450\r451_65\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 27.21.14.5167
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 27.21.14.5167

ModLoad: 00000000df420000 000000000012a000 C:\WINDOWS\System32\OLE32.DLL (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : ole32.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.19041.1586

ModLoad: 00000000db5c0000 00000000000f3000 C:\WINDOWS\SYSTEM32\dxgi.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : dxgi.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 00000000dcf00000 0000000000082000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.19041.1415 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1415



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3673, Write: 308, Other 801

- I/O Transfers Counters -
Read: 7637655, Write: 6031, Other 29644

- Paged Pool Usage -
QuotaPagedPoolUsage: 3463160, QuotaPeakPagedPoolUsage: 3477128
QuotaNonPagedPoolUsage: 37392, QuotaPeakNonPagedPoolUsage: 37392

- Virtual Memory Usage -
VirtualSize: -1501937664, PeakVirtualSize: -1019285504

- Pagefile Usage -
PagefileUsage: -1501937664, PeakPagefileUsage: -1501937664

- Working Set Size -
WorkingSetSize: 1142566912, PeakWorkingSetSize: 1142571008, PageFaultCount: 378179

*** Dump of thread ID 260 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 9531250.000000, User Time: 23750000.000000, Wait Time: 69713880.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFBDD114F69

- Registers -
rax=000000001ca38b93 rbx=0000000092654910 rcx=00000000782e5dc0 rdx=0000000000000001 rsi=00000000782e6700 rdi=0000000019930520
r8=00000000782e5e58 r9=0000000000000000 r10=0000000000000000 r11=00000000c9357c00 r12=00000000f07eac80 r13=00000000782e6910
r14=00000000f2671ba0 r15=0000000000000000 rip=00000000dd114f69 rsp=00000000782e65a0 rbp=00000000782e6890
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
782e6670 9256a884 00000040 0000004f f07ea900 000002e5 KERNELBASE!RaiseException+0x0 
782e66d0 92311ca6 00000080 9d400000 f10ec490 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
782e6780 9231593b 00000000 00000030 00000020 00000008 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
782e68d0 92311a78 00000000 00000000 782e6c00 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
782e69a0 92311cfc 782e6c00 00000000 00000080 782e6ed0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
782e6a60 9231c4dd 782e6ed0 782e6ed0 782e6ed0 782e6ed0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
782e6d50 9230b2fe 782e7368 782e6ed0 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
782ffaf0 9254c6f8 9ed73f30 00000000 00000000 9d40da20 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
782ffb30 de347034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
782ffb60 df622651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
782ffbe0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 7584 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 69713648.000000

- Registers -
rax=00000000000001d3 rbx=000000009d405ea0 rcx=0000000000000070 rdx=000000009d405b20 rsi=000000009d403c50 rdi=000000009d405ea0
r8=00000000000002a8 r9=000000000000000c r10=0000000000000000 r11=000000006cc082a8 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000df6707c4 rsp=00000000783ff878 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
783ff870 df622dc7 00000000 00000000 9d403c50 9d405ea0 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
783ffb70 de347034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
783ffba0 df622651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
783ffc20 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 9928 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 468750.000000, User Time: 0.000000, Wait Time: 69713648.000000

- Registers -
rax=00000000000001d3 rbx=000000009d4062d0 rcx=0000000000000070 rdx=000000009d405f50 rsi=000000009d403c50 rdi=000000009d4062d0
r8=0000000000000008 r9=0000000000000040 r10=0000000000000600 r11=00000000bffffeff r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000df6707c4 rsp=00000000784ffa98 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
784ffa90 df622dc7 00000000 00000000 9d403c50 9d4062d0 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
784ffd90 de347034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
784ffdc0 df622651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
784ffe40 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 8260 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 312500.000000, User Time: 0.000000, Wait Time: 69713648.000000

- Registers -
rax=00000000000001d3 rbx=000000009d406700 rcx=0000000000000070 rdx=000000009d406380 rsi=000000009d403c50 rdi=000000009d406700
r8=00000000785ff190 r9=00000000000000ff r10=000000000000006c r11=00000000785fef90 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000df6707c4 rsp=00000000785ffa28 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
785ffa20 df622dc7 00000000 00000000 9d403c50 9d406700 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
785ffd20 de347034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
785ffd50 df622651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
785ffdd0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 3256 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 69713872.000000

- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000787ff8d0 rsi=0000000000000000 rdi=0000000000000064
r8=00000000787ff8a8 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000df66d3f4 rsp=00000000787ff8a8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
787ff8a0 dd12962e 787ff968 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0 
787ff940 9232a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0 
787ff970 de347034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
787ff9a0 df622651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
787ffa20 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 16452 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 69713880.000000

- Registers -
rax=000000000000005b rbx=000000000000000a rcx=000000000000000a rdx=00000000788ff800 rsi=0000000000000000 rdi=000000000000000a
r8=00000000788ff4a8 r9=000000009ef52e10 r10=0000000000000000 r11=0000000000000246 r12=0000000000000064 r13=00000000788ff800
r14=00000000788ff500 r15=0000000000000000 rip=00000000df66d8c4 rsp=00000000788ff4a8 rbp=000000009ef52e10
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
788ff4a0 dd12cb20 00000000 780e9000 df73a4d0 780e9000 ntdll!ZwWaitForMultipleObjects+0x0 
788ff790 dd12ca1e 9d4148a0 004e0049 0000000a 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
788ff7d0 7ca121b4 9ef59410 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
788ffa10 7caac95d 00000000 00000004 00000000 00000000 nvcuda64!+0x0 
788ffac0 7ca11b83 2d69b566 2b9c1879 9f490740 00000000 nvcuda64!cuProfilerStop+0x0 
788ffaf0 7ccff450 9f490740 00000000 00000000 00000000 nvcuda64!+0x0 
788ffb20 de347034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
788ffb50 df622651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
788ffbd0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 5984 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 69713712.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002a8 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002a8
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=000000009ef3bc90 r13=0000000000000000
r14=00000000000002a8 r15=0000000000000000 rip=00000000df66cdf4 rsp=00000000789ffa38 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
789ffa30 dd101a5e 00000000 00000000 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0 
789ffad0 7cc1abd8 00000000 dd10a395 00000000 000002a8 KERNELBASE!WaitForSingleObjectEx+0x0 
789ffb40 7ca11b83 00000001 9f303810 9f491490 00000000 nvcuda64!cuProfilerStop+0x0 
789ffb70 7ccff450 9f491490 00000000 00000000 00000000 nvcuda64!+0x0 
789ffba0 de347034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
789ffbd0 df622651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
789ffc50 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 5964 (state: Waiting): ***

- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 69713848.000000

- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=000000009f1e94a8 rdx=0000000078aff738 rsi=0000000078aff6a0 rdi=0000000000000000
r8=0000000078aff678 r9=0000000078aff6d0 r10=0000000000000000 r11=0000000000000246 r12=0000000078aff738 r13=0000000000000000
r14=000000009f1e94a8 r15=000000009f1e94d8 rip=00000000df670764 rsp=0000000078aff678 rbp=0000000078aff6d0
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
78aff670 df634295 00000102 00000102 00000000 78aff6a0 ntdll!NtWaitForAlertByThreadId+0x0 
78aff6e0 dd14cef9 9f1e6cb0 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0 
78aff710 7c99f41a 9f1e6cb0 9f1e6cb0 9f1e6cb0 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0 
78aff770 7ca11b83 00000004 2d1a8c4f 2d69b5c4 00000000 nvcuda64!+0x0 
78aff7a0 7ccff450 9f4914c0 00000000 00000000 00000000 nvcuda64!+0x0 
78aff7d0 de347034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
78aff800 df622651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
78aff880 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


**


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)