Task 10209726

Name ParityModified-1638633332-5566-3-0_0
Workunit 7573775
Created 26 Dec 2021, 15:26:49 UTC
Sent 12 Jan 2022, 16:25:42 UTC
Report deadline 20 Jan 2022, 16:25:42 UTC
Received 12 Jan 2022, 22:43:31 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 17991
Run time 3 hours 32 min 52 sec
CPU time 3 hours 15 min 12 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 4,458.46 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 2.10 GB
Peak swap size 4.32 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
47.46 ms
[2022-01-12 12:42:06	                main:574]	:	INFO	:	Epoch 1189 | loss: 0.0311724 | val_loss: 0.0311753 | Time: 9025.84 ms
[2022-01-12 12:42:16	                main:574]	:	INFO	:	Epoch 1190 | loss: 0.0311727 | val_loss: 0.0311761 | Time: 9194.21 ms
[2022-01-12 12:42:24	                main:574]	:	INFO	:	Epoch 1191 | loss: 0.0311726 | val_loss: 0.0311754 | Time: 8548.72 ms
[2022-01-12 12:42:34	                main:574]	:	INFO	:	Epoch 1192 | loss: 0.0311723 | val_loss: 0.0311748 | Time: 9497.76 ms
[2022-01-12 12:42:43	                main:574]	:	INFO	:	Epoch 1193 | loss: 0.031172 | val_loss: 0.0311759 | Time: 8761.98 ms
[2022-01-12 12:42:52	                main:574]	:	INFO	:	Epoch 1194 | loss: 0.0311712 | val_loss: 0.0311746 | Time: 9520.27 ms
[2022-01-12 12:43:00	                main:574]	:	INFO	:	Epoch 1195 | loss: 0.031172 | val_loss: 0.0311768 | Time: 8380.78 ms
[2022-01-12 12:43:10	                main:574]	:	INFO	:	Epoch 1196 | loss: 0.031175 | val_loss: 0.0311822 | Time: 9548.98 ms
[2022-01-12 12:43:18	                main:574]	:	INFO	:	Epoch 1197 | loss: 0.0311729 | val_loss: 0.0311768 | Time: 8208.15 ms
[2022-01-12 12:43:28	                main:574]	:	INFO	:	Epoch 1198 | loss: 0.0311727 | val_loss: 0.031177 | Time: 9237.75 ms
[2022-01-12 12:43:37	                main:574]	:	INFO	:	Epoch 1199 | loss: 0.0311715 | val_loss: 0.0311746 | Time: 9538 ms
[2022-01-12 12:43:46	                main:574]	:	INFO	:	Epoch 1200 | loss: 0.0311745 | val_loss: 0.0311792 | Time: 8405.49 ms
[2022-01-12 12:43:55	                main:574]	:	INFO	:	Epoch 1201 | loss: 0.0311715 | val_loss: 0.0311749 | Time: 9275.72 ms
[2022-01-12 12:44:03	                main:574]	:	INFO	:	Epoch 1202 | loss: 0.0311707 | val_loss: 0.0311781 | Time: 8572.7 ms
[2022-01-12 12:44:13	                main:574]	:	INFO	:	Epoch 1203 | loss: 0.0311711 | val_loss: 0.031174 | Time: 9345.19 ms
[2022-01-12 12:44:21	                main:574]	:	INFO	:	Epoch 1204 | loss: 0.0311703 | val_loss: 0.0311786 | Time: 8298.08 ms
[2022-01-12 12:44:31	                main:574]	:	INFO	:	Epoch 1205 | loss: 0.0311714 | val_loss: 0.0311748 | Time: 9442.07 ms
[2022-01-12 12:44:39	                main:574]	:	INFO	:	Epoch 1206 | loss: 0.0311695 | val_loss: 0.0311743 | Time: 8427.9 ms
[2022-01-12 12:44:48	                main:574]	:	INFO	:	Epoch 1207 | loss: 0.0311689 | val_loss: 0.0311754 | Time: 9327.25 ms
[2022-01-12 12:44:58	                main:574]	:	INFO	:	Epoch 1208 | loss: 0.0311684 | val_loss: 0.0311749 | Time: 9264.55 ms
[2022-01-12 12:45:06	                main:574]	:	INFO	:	Epoch 1209 | loss: 0.031168 | val_loss: 0.0311743 | Time: 8551.7 ms
[2022-01-12 12:45:16	                main:574]	:	INFO	:	Epoch 1210 | loss: 0.0311687 | val_loss: 0.0311774 | Time: 9456.4 ms
[2022-01-12 12:45:24	                main:574]	:	INFO	:	Epoch 1211 | loss: 0.03117 | val_loss: 0.031174 | Time: 8241.71 ms
[2022-01-12 12:45:33	                main:574]	:	INFO	:	Epoch 1212 | loss: 0.0311681 | val_loss: 0.031176 | Time: 9082.12 ms
[2022-01-12 12:45:41	                main:574]	:	INFO	:	Epoch 1213 | loss: 0.0311684 | val_loss: 0.0311768 | Time: 8189.6 ms
[2022-01-12 12:45:50	                main:574]	:	INFO	:	Epoch 1214 | loss: 0.0311691 | val_loss: 0.0311792 | Time: 9227.01 ms
[2022-01-12 12:45:59	                main:574]	:	INFO	:	Epoch 1215 | loss: 0.0311679 | val_loss: 0.0311747 | Time: 8352.64 ms
[2022-01-12 12:46:08	                main:574]	:	INFO	:	Epoch 1216 | loss: 0.0311676 | val_loss: 0.0311762 | Time: 9111.1 ms
[2022-01-12 12:46:17	                main:574]	:	INFO	:	Epoch 1217 | loss: 0.0311674 | val_loss: 0.0311774 | Time: 9417.48 ms
[2022-01-12 12:46:26	                main:574]	:	INFO	:	Epoch 1218 | loss: 0.0311663 | val_loss: 0.0311739 | Time: 8336.94 ms
[2022-01-12 12:46:35	                main:574]	:	INFO	:	Epoch 1219 | loss: 0.0311673 | val_loss: 0.0311789 | Time: 9227.23 ms
[2022-01-12 12:46:43	                main:574]	:	INFO	:	Epoch 1220 | loss: 0.0311686 | val_loss: 0.031178 | Time: 8538.82 ms
[2022-01-12 12:46:53	                main:574]	:	INFO	:	Epoch 1221 | loss: 0.0311667 | val_loss: 0.0311774 | Time: 9377.19 ms
[2022-01-12 12:47:02	                main:574]	:	INFO	:	Epoch 1222 | loss: 0.0311679 | val_loss: 0.0311752 | Time: 8866.57 ms
[2022-01-12 12:47:11	                main:574]	:	INFO	:	Epoch 1223 | loss: 0.0311668 | val_loss: 0.0311782 | Time: 9618.65 ms
[2022-01-12 12:47:20	                main:574]	:	INFO	:	Epoch 1224 | loss: 0.0311679 | val_loss: 0.0311745 | Time: 8138.43 ms
[2022-01-12 12:47:29	                main:574]	:	INFO	:	Epoch 1225 | loss: nan | val_loss: nan | Time: 9588.2 ms
[2022-01-12 12:47:38	                main:574]	:	INFO	:	Epoch 1226 | loss: nan | val_loss: nan | Time: 9132.32 ms
[2022-01-12 12:47:47	                main:574]	:	INFO	:	Epoch 1227 | loss: nan | val_loss: nan | Time: 8972.7 ms
[2022-01-12 12:47:57	                main:574]	:	INFO	:	Epoch 1228 | loss: nan | val_loss: nan | Time: 9386.33 ms
[2022-01-12 12:48:05	                main:574]	:	INFO	:	Epoch 1229 | loss: nan | val_loss: nan | Time: 8123.63 ms
[2022-01-12 12:48:14	                main:574]	:	INFO	:	Epoch 1230 | loss: nan | val_loss: nan | Time: 9533.34 ms
[2022-01-12 12:48:23	                main:574]	:	INFO	:	Epoch 1231 | loss: nan | val_loss: nan | Time: 8848.93 ms
[2022-01-12 12:48:33	                main:574]	:	INFO	:	Epoch 1232 | loss: nan | val_loss: nan | Time: 9488.71 ms
[2022-01-12 12:48:41	                main:574]	:	INFO	:	Epoch 1233 | loss: nan | val_loss: nan | Time: 8307.8 ms
[2022-01-12 12:48:50	                main:574]	:	INFO	:	Epoch 1234 | loss: nan | val_loss: nan | Time: 9336.45 ms
[2022-01-12 12:48:59	                main:574]	:	INFO	:	Epoch 1235 | loss: nan | val_loss: nan | Time: 8340.06 ms
[2022-01-12 12:49:08	                main:574]	:	INFO	:	Epoch 1236 | loss: nan | val_loss: nan | Time: 9409.53 ms
[2022-01-12 12:49:17	                main:574]	:	INFO	:	Epoch 1237 | loss: nan | val_loss: nan | Time: 9257.01 ms
[2022-01-12 12:49:26	                main:574]	:	INFO	:	Epoch 1238 | loss: nan | val_loss: nan | Time: 8531.07 ms
[2022-01-12 12:49:35	                main:574]	:	INFO	:	Epoch 1239 | loss: nan | val_loss: nan | Time: 9350.08 ms
[2022-01-12 12:49:44	                main:574]	:	INFO	:	Epoch 1240 | loss: nan | val_loss: nan | Time: 8599.36 ms
[2022-01-12 12:49:53	                main:574]	:	INFO	:	Epoch 1241 | loss: nan | val_loss: nan | Time: 9401.68 ms
[2022-01-12 12:50:02	                main:574]	:	INFO	:	Epoch 1242 | loss: nan | val_loss: nan | Time: 8604.38 ms
[2022-01-12 12:50:12	                main:574]	:	INFO	:	Epoch 1243 | loss: nan | val_loss: nan | Time: 9662.18 ms
[2022-01-12 12:50:20	                main:574]	:	INFO	:	Epoch 1244 | loss: nan | val_loss: nan | Time: 8332.44 ms
[2022-01-12 12:50:29	                main:574]	:	INFO	:	Epoch 1245 | loss: nan | val_loss: nan | Time: 9344.15 ms
[2022-01-12 12:50:38	                main:574]	:	INFO	:	Epoch 1246 | loss: nan | val_loss: nan | Time: 9023.44 ms
[2022-01-12 12:50:47	                main:574]	:	INFO	:	Epoch 1247 | loss: nan | val_loss: nan | Time: 8681.36 ms
[2022-01-12 12:50:57	                main:574]	:	INFO	:	Epoch 1248 | loss: nan | val_loss: nan | Time: 9502.57 ms
[2022-01-12 12:51:05	                main:574]	:	INFO	:	Epoch 1249 | loss: nan | val_loss: nan | Time: 8234.24 ms
[2022-01-12 12:51:14	                main:574]	:	INFO	:	Epoch 1250 | loss: nan | val_loss: nan | Time: 9360.48 ms
[2022-01-12 12:51:23	                main:574]	:	INFO	:	Epoch 1251 | loss: nan | val_loss: nan | Time: 8751.59 ms
[2022-01-12 12:51:32	                main:574]	:	INFO	:	Epoch 1252 | loss: nan | val_loss: nan | Time: 9256.74 ms
[2022-01-12 12:51:41	                main:574]	:	INFO	:	Epoch 1253 | loss: nan | val_loss: nan | Time: 8468.62 ms
[2022-01-12 12:51:50	                main:574]	:	INFO	:	Epoch 1254 | loss: nan | val_loss: nan | Time: 9449.46 ms
[2022-01-12 12:51:59	                main:574]	:	INFO	:	Epoch 1255 | loss: nan | val_loss: nan | Time: 8725.7 ms
[2022-01-12 12:52:09	                main:574]	:	INFO	:	Epoch 1256 | loss: nan | val_loss: nan | Time: 9544.54 ms
[2022-01-12 12:52:18	                main:574]	:	INFO	:	Epoch 1257 | loss: nan | val_loss: nan | Time: 9251.02 ms
[2022-01-12 12:52:26	                main:574]	:	INFO	:	Epoch 1258 | loss: nan | val_loss: nan | Time: 8229.24 ms
[2022-01-12 12:52:36	                main:574]	:	INFO	:	Epoch 1259 | loss: nan | val_loss: nan | Time: 9449.99 ms
[2022-01-12 12:52:44	                main:574]	:	INFO	:	Epoch 1260 | loss: nan | val_loss: nan | Time: 8372.53 ms
[2022-01-12 12:52:53	                main:574]	:	INFO	:	Epoch 1261 | loss: nan | val_loss: nan | Time: 9289.6 ms
[2022-01-12 12:53:02	                main:574]	:	INFO	:	Epoch 1262 | loss: nan | val_loss: nan | Time: 8346.76 ms
[2022-01-12 12:53:11	                main:574]	:	INFO	:	Epoch 1263 | loss: nan | val_loss: nan | Time: 9022.26 ms
[2022-01-12 12:53:20	                main:574]	:	INFO	:	Epoch 1264 | loss: nan | val_loss: nan | Time: 9155.87 ms
[2022-01-12 12:53:29	                main:574]	:	INFO	:	Epoch 1265 | loss: nan | val_loss: nan | Time: 9649.37 ms
[2022-01-12 12:53:39	                main:574]	:	INFO	:	Epoch 1266 | loss: nan | val_loss: nan | Time: 9005 ms
[2022-01-12 12:53:47	                main:574]	:	INFO	:	Epoch 1267 | loss: nan | val_loss: nan | Time: 8553.26 ms
[2022-01-12 12:53:57	                main:574]	:	INFO	:	Epoch 1268 | loss: nan | val_loss: nan | Time: 9573.74 ms
[2022-01-12 12:54:05	                main:574]	:	INFO	:	Epoch 1269 | loss: nan | val_loss: nan | Time: 8594.99 ms
[2022-01-12 12:54:14	                main:574]	:	INFO	:	Epoch 1270 | loss: nan | val_loss: nan | Time: 9060.22 ms
[2022-01-12 12:54:22	                main:574]	:	INFO	:	Epoch 1271 | loss: nan | val_loss: nan | Time: 8092.96 ms
[2022-01-12 12:54:32	                main:574]	:	INFO	:	Epoch 1272 | loss: nan | val_loss: nan | Time: 9067.32 ms
[2022-01-12 12:54:40	                main:574]	:	INFO	:	Epoch 1273 | loss: nan | val_loss: nan | Time: 8285.86 ms
[2022-01-12 12:54:49	                main:574]	:	INFO	:	Epoch 1274 | loss: nan | val_loss: nan | Time: 9302.62 ms
[2022-01-12 12:54:58	                main:574]	:	INFO	:	Epoch 1275 | loss: nan | val_loss: nan | Time: 9177.73 ms
[2022-01-12 12:55:07	                main:574]	:	INFO	:	Epoch 1276 | loss: nan | val_loss: nan | Time: 8693.24 ms
[2022-01-12 12:55:16	                main:574]	:	INFO	:	Epoch 1277 | loss: nan | val_loss: nan | Time: 8748.49 ms
[2022-01-12 12:55:24	                main:574]	:	INFO	:	Epoch 1278 | loss: nan | val_loss: nan | Time: 7920.62 ms
[2022-01-12 12:55:33	                main:574]	:	INFO	:	Epoch 1279 | loss: nan | val_loss: nan | Time: 8898.79 ms
[2022-01-12 12:55:41	                main:574]	:	INFO	:	Epoch 1280 | loss: nan | val_loss: nan | Time: 7924.66 ms
[2022-01-12 12:55:50	                main:574]	:	INFO	:	Epoch 1281 | loss: nan | val_loss: nan | Time: 8988.52 ms
[2022-01-12 12:55:59	                main:574]	:	INFO	:	Epoch 1282 | loss: nan | val_loss: nan | Time: 8908.5 ms
[2022-01-12 12:56:08	                main:574]	:	INFO	:	Epoch 1283 | loss: nan | val_loss: nan | Time: 9081.01 ms
[2022-01-12 12:56:17	                main:574]	:	INFO	:	Epoch 1284 | loss: nan | val_loss: nan | Time: 9032.78 ms
[2022-01-12 12:56:25	                main:574]	:	INFO	:	Epoch 1285 | loss: nan | val_loss: nan | Time: 8125.58 ms
[2022-01-12 12:56:34	                main:574]	:	INFO	:	Epoch 1286 | loss: nan | val_loss: nan | Time: 9105.22 ms
[2022-01-12 12:56:42	                main:574]	:	INFO	:	Epoch 1287 | loss: nan | val_loss: nan | Time: 7941.21 ms
[2022-01-12 12:56:51	                main:574]	:	INFO	:	Epoch 1288 | loss: nan | val_loss: nan | Time: 8923.79 ms
[2022-01-12 12:56:59	                main:574]	:	INFO	:	Epoch 1289 | loss: nan | val_loss: nan | Time: 8437.52 ms
[2022-01-12 12:57:08	                main:574]	:	INFO	:	Epoch 1290 | loss: nan | val_loss: nan | Time: 8750.04 ms
[2022-01-12 12:57:17	                main:574]	:	INFO	:	Epoch 1291 | loss: nan | val_loss: nan | Time: 8974.5 ms
[2022-01-12 12:57:25	                main:574]	:	INFO	:	Epoch 1292 | loss: nan | val_loss: nan | Time: 7997.42 ms
[2022-01-12 12:57:34	                main:574]	:	INFO	:	Epoch 1293 | loss: nan | val_loss: nan | Time: 8890.6 ms
[2022-01-12 12:57:43	                main:574]	:	INFO	:	Epoch 1294 | loss: nan | val_loss: nan | Time: 8840.99 ms
[2022-01-12 12:57:52	                main:574]	:	INFO	:	Epoch 1295 | loss: nan | val_loss: nan | Time: 9061.61 ms
[2022-01-12 12:58:00	                main:574]	:	INFO	:	Epoch 1296 | loss: nan | val_loss: nan | Time: 8161.85 ms
[2022-01-12 12:58:09	                main:574]	:	INFO	:	Epoch 1297 | loss: nan | val_loss: nan | Time: 8873.59 ms
[2022-01-12 12:58:18	                main:574]	:	INFO	:	Epoch 1298 | loss: nan | val_loss: nan | Time: 9022.2 ms
[2022-01-12 12:58:26	                main:574]	:	INFO	:	Epoch 1299 | loss: nan | val_loss: nan | Time: 7872.13 ms
[2022-01-12 12:58:35	                main:574]	:	INFO	:	Epoch 1300 | loss: nan | val_loss: nan | Time: 8799.08 ms
[2022-01-12 12:58:43	                main:574]	:	INFO	:	Epoch 1301 | loss: nan | val_loss: nan | Time: 8128.82 ms
[2022-01-12 12:58:52	                main:574]	:	INFO	:	Epoch 1302 | loss: nan | val_loss: nan | Time: 8903.13 ms
[2022-01-12 12:59:00	                main:574]	:	INFO	:	Epoch 1303 | loss: nan | val_loss: nan | Time: 8132.69 ms
[2022-01-12 12:59:09	                main:574]	:	INFO	:	Epoch 1304 | loss: nan | val_loss: nan | Time: 8920.91 ms
[2022-01-12 12:59:18	                main:574]	:	INFO	:	Epoch 1305 | loss: nan | val_loss: nan | Time: 8938.7 ms
[2022-01-12 12:59:26	                main:574]	:	INFO	:	Epoch 1306 | loss: nan | val_loss: nan | Time: 8024.34 ms
[2022-01-12 12:59:35	                main:574]	:	INFO	:	Epoch 1307 | loss: nan | val_loss: nan | Time: 9060.59 ms
[2022-01-12 12:59:43	                main:574]	:	INFO	:	Epoch 1308 | loss: nan | val_loss: nan | Time: 8333.61 ms
[2022-01-12 12:59:52	                main:574]	:	INFO	:	Epoch 1309 | loss: nan | val_loss: nan | Time: 9014.88 ms
[2022-01-12 13:00:00	                main:574]	:	INFO	:	Epoch 1310 | loss: nan | val_loss: nan | Time: 7736.07 ms
[2022-01-12 13:00:09	                main:574]	:	INFO	:	Epoch 1311 | loss: nan | val_loss: nan | Time: 8859.7 ms
[2022-01-12 13:00:18	                main:574]	:	INFO	:	Epoch 1312 | loss: nan | val_loss: nan | Time: 8707.97 ms
[2022-01-12 13:00:25	                main:574]	:	INFO	:	Epoch 1313 | loss: nan | val_loss: nan | Time: 7832.31 ms
[2022-01-12 13:00:34	                main:574]	:	INFO	:	Epoch 1314 | loss: nan | val_loss: nan | Time: 8871.33 ms
[2022-01-12 13:00:43	                main:574]	:	INFO	:	Epoch 1315 | loss: nan | val_loss: nan | Time: 8307.65 ms
[2022-01-12 13:00:52	                main:574]	:	INFO	:	Epoch 1316 | loss: nan | val_loss: nan | Time: 9055.46 ms
[2022-01-12 13:01:00	                main:574]	:	INFO	:	Epoch 1317 | loss: nan | val_loss: nan | Time: 7998.44 ms
[2022-01-12 13:01:08	                main:574]	:	INFO	:	Epoch 1318 | loss: nan | val_loss: nan | Time: 8695.29 ms
[2022-01-12 13:01:17	                main:574]	:	INFO	:	Epoch 1319 | loss: nan | val_loss: nan | Time: 8903.45 ms
[2022-01-12 13:01:25	                main:574]	:	INFO	:	Epoch 1320 | loss: nan | val_loss: nan | Time: 7973.57 ms
[2022-01-12 13:01:34	                main:574]	:	INFO	:	Epoch 1321 | loss: nan | val_loss: nan | Time: 8913.72 ms
[2022-01-12 13:01:43	                main:574]	:	INFO	:	Epoch 1322 | loss: nan | val_loss: nan | Time: 8254.3 ms
[2022-01-12 13:01:52	                main:574]	:	INFO	:	Epoch 1323 | loss: nan | val_loss: nan | Time: 9061.73 ms
[2022-01-12 13:02:00	                main:574]	:	INFO	:	Epoch 1324 | loss: nan | val_loss: nan | Time: 8188.21 ms
[2022-01-12 13:02:09	                main:574]	:	INFO	:	Epoch 1325 | loss: nan | val_loss: nan | Time: 8808.55 ms
[2022-01-12 13:02:18	                main:574]	:	INFO	:	Epoch 1326 | loss: nan | val_loss: nan | Time: 8945.27 ms
[2022-01-12 13:02:26	                main:574]	:	INFO	:	Epoch 1327 | loss: nan | val_loss: nan | Time: 8119.93 ms
[2022-01-12 13:02:35	                main:574]	:	INFO	:	Epoch 1328 | loss: nan | val_loss: nan | Time: 9008.21 ms
[2022-01-12 13:02:43	                main:574]	:	INFO	:	Epoch 1329 | loss: nan | val_loss: nan | Time: 8035.17 ms
[2022-01-12 13:02:52	                main:574]	:	INFO	:	Epoch 1330 | loss: nan | val_loss: nan | Time: 8851.42 ms
[2022-01-12 13:03:00	                main:574]	:	INFO	:	Epoch 1331 | loss: nan | val_loss: nan | Time: 8174.91 ms
[2022-01-12 13:03:09	                main:574]	:	INFO	:	Epoch 1332 | loss: nan | val_loss: nan | Time: 9150.58 ms
[2022-01-12 13:03:18	                main:574]	:	INFO	:	Epoch 1333 | loss: nan | val_loss: nan | Time: 8918.24 ms
[2022-01-12 13:03:26	                main:574]	:	INFO	:	Epoch 1334 | loss: nan | val_loss: nan | Time: 8316.34 ms
[2022-01-12 13:03:35	                main:574]	:	INFO	:	Epoch 1335 | loss: nan | val_loss: nan | Time: 8939.07 ms
[2022-01-12 13:03:43	                main:574]	:	INFO	:	Epoch 1336 | loss: nan | val_loss: nan | Time: 7864.69 ms
[2022-01-12 13:03:52	                main:574]	:	INFO	:	Epoch 1337 | loss: nan | val_loss: nan | Time: 8811.28 ms
[2022-01-12 13:04:00	                main:574]	:	INFO	:	Epoch 1338 | loss: nan | val_loss: nan | Time: 8119.3 ms
[2022-01-12 13:04:09	                main:574]	:	INFO	:	Epoch 1339 | loss: nan | val_loss: nan | Time: 8995.85 ms
[2022-01-12 13:04:18	                main:574]	:	INFO	:	Epoch 1340 | loss: nan | val_loss: nan | Time: 9155.84 ms
[2022-01-12 13:04:27	                main:574]	:	INFO	:	Epoch 1341 | loss: nan | val_loss: nan | Time: 8483.76 ms
[2022-01-12 13:04:36	                main:574]	:	INFO	:	Epoch 1342 | loss: nan | val_loss: nan | Time: 8963.43 ms
[2022-01-12 13:04:44	                main:574]	:	INFO	:	Epoch 1343 | loss: nan | val_loss: nan | Time: 8359.63 ms
[2022-01-12 13:04:53	                main:574]	:	INFO	:	Epoch 1344 | loss: nan | val_loss: nan | Time: 9043.17 ms
[2022-01-12 13:05:01	                main:574]	:	INFO	:	Epoch 1345 | loss: nan | val_loss: nan | Time: 8200.17 ms
[2022-01-12 13:05:10	                main:574]	:	INFO	:	Epoch 1346 | loss: nan | val_loss: nan | Time: 8937.47 ms
[2022-01-12 13:05:19	                main:574]	:	INFO	:	Epoch 1347 | loss: nan | val_loss: nan | Time: 8827.05 ms
[2022-01-12 13:05:28	                main:574]	:	INFO	:	Epoch 1348 | loss: nan | val_loss: nan | Time: 8281.13 ms
[2022-01-12 13:05:37	                main:574]	:	INFO	:	Epoch 1349 | loss: nan | val_loss: nan | Time: 9237.13 ms
[2022-01-12 13:05:45	                main:574]	:	INFO	:	Epoch 1350 | loss: nan | val_loss: nan | Time: 8069.55 ms
[2022-01-12 13:05:54	                main:574]	:	INFO	:	Epoch 1351 | loss: nan | val_loss: nan | Time: 8903.92 ms
[2022-01-12 13:06:02	                main:574]	:	INFO	:	Epoch 1352 | loss: nan | val_loss: nan | Time: 8195.19 ms
[2022-01-12 13:06:11	                main:574]	:	INFO	:	Epoch 1353 | loss: nan | val_loss: nan | Time: 8876.98 ms
[2022-01-12 13:06:20	                main:574]	:	INFO	:	Epoch 1354 | loss: nan | val_loss: nan | Time: 8889.09 ms
[2022-01-12 13:06:28	                main:574]	:	INFO	:	Epoch 1355 | loss: nan | val_loss: nan | Time: 8441.47 ms
[2022-01-12 13:06:37	                main:574]	:	INFO	:	Epoch 1356 | loss: nan | val_loss: nan | Time: 9197.85 ms
[2022-01-12 13:06:46	                main:574]	:	INFO	:	Epoch 1357 | loss: nan | val_loss: nan | Time: 8643.49 ms
[2022-01-12 13:06:55	                main:574]	:	INFO	:	Epoch 1358 | loss: nan | val_loss: nan | Time: 9271.8 ms
[2022-01-12 13:07:04	                main:574]	:	INFO	:	Epoch 1359 | loss: nan | val_loss: nan | Time: 8304.53 ms
[2022-01-12 13:07:13	                main:574]	:	INFO	:	Epoch 1360 | loss: nan | val_loss: nan | Time: 8928.82 ms
[2022-01-12 13:07:21	                main:574]	:	INFO	:	Epoch 1361 | loss: nan | val_loss: nan | Time: 8327.11 ms
[2022-01-12 13:07:30	                main:574]	:	INFO	:	Epoch 1362 | loss: nan | val_loss: nan | Time: 8912.76 ms
[2022-01-12 13:07:39	                main:574]	:	INFO	:	Epoch 1363 | loss: nan | val_loss: nan | Time: 9020.06 ms
[2022-01-12 13:07:47	                main:574]	:	INFO	:	Epoch 1364 | loss: nan | val_loss: nan | Time: 8247.51 ms
[2022-01-12 13:07:56	                main:574]	:	INFO	:	Epoch 1365 | loss: nan | val_loss: nan | Time: 9227.62 ms
[2022-01-12 13:08:05	                main:574]	:	INFO	:	Epoch 1366 | loss: nan | val_loss: nan | Time: 8321.07 ms
[2022-01-12 13:08:14	                main:574]	:	INFO	:	Epoch 1367 | loss: nan | val_loss: nan | Time: 9320.49 ms
[2022-01-12 13:08:22	                main:574]	:	INFO	:	Epoch 1368 | loss: nan | val_loss: nan | Time: 8145.39 ms
[2022-01-12 13:08:32	                main:574]	:	INFO	:	Epoch 1369 | loss: nan | val_loss: nan | Time: 9221.86 ms
[2022-01-12 13:08:40	                main:574]	:	INFO	:	Epoch 1370 | loss: nan | val_loss: nan | Time: 8598.44 ms
[2022-01-12 13:08:49	                main:574]	:	INFO	:	Epoch 1371 | loss: nan | val_loss: nan | Time: 8786.6 ms
[2022-01-12 13:08:58	                main:574]	:	INFO	:	Epoch 1372 | loss: nan | val_loss: nan | Time: 9143.88 ms
[2022-01-12 13:09:06	                main:574]	:	INFO	:	Epoch 1373 | loss: nan | val_loss: nan | Time: 8131.68 ms
[2022-01-12 13:09:15	                main:574]	:	INFO	:	Epoch 1374 | loss: nan | val_loss: nan | Time: 8780.57 ms
[2022-01-12 13:09:23	                main:574]	:	INFO	:	Epoch 1375 | loss: nan | val_loss: nan | Time: 8344.01 ms
[2022-01-12 13:09:32	                main:574]	:	INFO	:	Epoch 1376 | loss: nan | val_loss: nan | Time: 9069.84 ms
[2022-01-12 13:09:41	                main:574]	:	INFO	:	Epoch 1377 | loss: nan | val_loss: nan | Time: 8469.98 ms
[2022-01-12 13:09:50	                main:574]	:	INFO	:	Epoch 1378 | loss: nan | val_loss: nan | Time: 9226.61 ms
[2022-01-12 13:09:59	                main:574]	:	INFO	:	Epoch 1379 | loss: nan | val_loss: nan | Time: 9053.13 ms
[2022-01-12 13:10:08	                main:574]	:	INFO	:	Epoch 1380 | loss: nan | val_loss: nan | Time: 8537.44 ms
[2022-01-12 13:10:17	                main:574]	:	INFO	:	Epoch 1381 | loss: nan | val_loss: nan | Time: 9151.91 ms
[2022-01-12 13:10:26	                main:574]	:	INFO	:	Epoch 1382 | loss: nan | val_loss: nan | Time: 8757.94 ms
[2022-01-12 13:10:35	                main:574]	:	INFO	:	Epoch 1383 | loss: nan | val_loss: nan | Time: 9437.41 ms
[2022-01-12 13:10:43	                main:574]	:	INFO	:	Epoch 1384 | loss: nan | val_loss: nan | Time: 8119.47 ms
[2022-01-12 13:10:52	                main:574]	:	INFO	:	Epoch 1385 | loss: nan | val_loss: nan | Time: 9048.93 ms
[2022-01-12 13:11:01	                main:574]	:	INFO	:	Epoch 1386 | loss: nan | val_loss: nan | Time: 8500.63 ms
[2022-01-12 13:11:10	                main:574]	:	INFO	:	Epoch 1387 | loss: nan | val_loss: nan | Time: 9121.59 ms
[2022-01-12 13:11:19	                main:574]	:	INFO	:	Epoch 1388 | loss: nan | val_loss: nan | Time: 9250.5 ms
[2022-01-12 13:11:27	                main:574]	:	INFO	:	Epoch 1389 | loss: nan | val_loss: nan | Time: 8031.62 ms
[2022-01-12 13:11:37	                main:574]	:	INFO	:	Epoch 1390 | loss: nan | val_loss: nan | Time: 9186.43 ms
[2022-01-12 13:11:45	                main:574]	:	INFO	:	Epoch 1391 | loss: nan | val_loss: nan | Time: 8252.8 ms
[2022-01-12 13:11:54	                main:574]	:	INFO	:	Epoch 1392 | loss: nan | val_loss: nan | Time: 9103.7 ms
[2022-01-12 13:12:02	                main:574]	:	INFO	:	Epoch 1393 | loss: nan | val_loss: nan | Time: 8282.41 ms
[2022-01-12 13:12:11	                main:574]	:	INFO	:	Epoch 1394 | loss: nan | val_loss: nan | Time: 8932 ms
[2022-01-12 13:12:20	                main:574]	:	INFO	:	Epoch 1395 | loss: nan | val_loss: nan | Time: 8821.18 ms
[2022-01-12 13:12:29	                main:574]	:	INFO	:	Epoch 1396 | loss: nan | val_loss: nan | Time: 8963.38 ms
[2022-01-12 13:12:38	                main:574]	:	INFO	:	Epoch 1397 | loss: nan | val_loss: nan | Time: 9186.51 ms
[2022-01-12 13:12:47	                main:574]	:	INFO	:	Epoch 1398 | loss: nan | val_loss: nan | Time: 8436.95 ms
[2022-01-12 13:12:56	                main:574]	:	INFO	:	Epoch 1399 | loss: nan | val_loss: nan | Time: 9602.82 ms
[2022-01-12 13:13:05	                main:574]	:	INFO	:	Epoch 1400 | loss: nan | val_loss: nan | Time: 8550.35 ms
[2022-01-12 13:13:14	                main:574]	:	INFO	:	Epoch 1401 | loss: nan | val_loss: nan | Time: 8928.31 ms
[2022-01-12 13:13:22	                main:574]	:	INFO	:	Epoch 1402 | loss: nan | val_loss: nan | Time: 8271.98 ms
[2022-01-12 13:13:31	                main:574]	:	INFO	:	Epoch 1403 | loss: nan | val_loss: nan | Time: 9268.97 ms
[2022-01-12 13:13:40	                main:574]	:	INFO	:	Epoch 1404 | loss: nan | val_loss: nan | Time: 8829.71 ms
[2022-01-12 13:13:49	                main:574]	:	INFO	:	Epoch 1405 | loss: nan | val_loss: nan | Time: 8621.04 ms
[2022-01-12 13:13:58	                main:574]	:	INFO	:	Epoch 1406 | loss: nan | val_loss: nan | Time: 9331.53 ms
[2022-01-12 13:14:06	                main:574]	:	INFO	:	Epoch 1407 | loss: nan | val_loss: nan | Time: 8056.99 ms
[2022-01-12 13:14:15	                main:574]	:	INFO	:	Epoch 1408 | loss: nan | val_loss: nan | Time: 9155.75 ms
[2022-01-12 13:14:24	                main:574]	:	INFO	:	Epoch 1409 | loss: nan | val_loss: nan | Time: 8775.23 ms
[2022-01-12 13:14:34	                main:574]	:	INFO	:	Epoch 1410 | loss: nan | val_loss: nan | Time: 9374.72 ms
[2022-01-12 13:14:42	                main:574]	:	INFO	:	Epoch 1411 | loss: nan | val_loss: nan | Time: 8196.28 ms
[2022-01-12 13:14:51	                main:574]	:	INFO	:	Epoch 1412 | loss: nan | val_loss: nan | Time: 9419.51 ms
[2022-01-12 13:15:00	                main:574]	:	INFO	:	Epoch 1413 | loss: nan | val_loss: nan | Time: 9045.21 ms
[2022-01-12 13:15:09	                main:574]	:	INFO	:	Epoch 1414 | loss: nan | val_loss: nan | Time: 8525.69 ms
[2022-01-12 13:15:18	                main:574]	:	INFO	:	Epoch 1415 | loss: nan | val_loss: nan | Time: 9457.61 ms
[2022-01-12 13:15:27	                main:574]	:	INFO	:	Epoch 1416 | loss: nan | val_loss: nan | Time: 8564.83 ms
[2022-01-12 13:15:36	                main:574]	:	INFO	:	Epoch 1417 | loss: nan | val_loss: nan | Time: 9121.21 ms
[2022-01-12 13:15:45	                main:574]	:	INFO	:	Epoch 1418 | loss: nan | val_loss: nan | Time: 8416.09 ms
[2022-01-12 13:15:54	                main:574]	:	INFO	:	Epoch 1419 | loss: nan | val_loss: nan | Time: 9342.32 ms
[2022-01-12 13:16:03	                main:574]	:	INFO	:	Epoch 1420 | loss: nan | val_loss: nan | Time: 8646.02 ms
[2022-01-12 13:16:12	                main:574]	:	INFO	:	Epoch 1421 | loss: nan | val_loss: nan | Time: 9384.69 ms
[2022-01-12 13:16:21	                main:574]	:	INFO	:	Epoch 1422 | loss: nan | val_loss: nan | Time: 8785.39 ms
[2022-01-12 13:16:29	                main:574]	:	INFO	:	Epoch 1423 | loss: nan | val_loss: nan | Time: 8749.65 ms
[2022-01-12 13:16:39	                main:574]	:	INFO	:	Epoch 1424 | loss: nan | val_loss: nan | Time: 9572.34 ms
[2022-01-12 13:16:48	                main:574]	:	INFO	:	Epoch 1425 | loss: nan | val_loss: nan | Time: 8576.92 ms
[2022-01-12 13:16:57	                main:574]	:	INFO	:	Epoch 1426 | loss: nan | val_loss: nan | Time: 9032.05 ms
[2022-01-12 13:17:05	                main:574]	:	INFO	:	Epoch 1427 | loss: nan | val_loss: nan | Time: 8557.88 ms
[2022-01-12 13:17:15	                main:574]	:	INFO	:	Epoch 1428 | loss: nan | val_loss: nan | Time: 9211.81 ms
[2022-01-12 13:17:23	                main:574]	:	INFO	:	Epoch 1429 | loss: nan | val_loss: nan | Time: 8314.36 ms
[2022-01-12 13:17:32	                main:574]	:	INFO	:	Epoch 1430 | loss: nan | val_loss: nan | Time: 9418.14 ms
[2022-01-12 13:17:41	                main:574]	:	INFO	:	Epoch 1431 | loss: nan | val_loss: nan | Time: 8725.8 ms
[2022-01-12 13:17:50	                main:574]	:	INFO	:	Epoch 1432 | loss: nan | val_loss: nan | Time: 8847.81 ms
[2022-01-12 13:17:59	                main:574]	:	INFO	:	Epoch 1433 | loss: nan | val_loss: nan | Time: 9515.55 ms
[2022-01-12 13:18:08	                main:574]	:	INFO	:	Epoch 1434 | loss: nan | val_loss: nan | Time: 8523.37 ms
[2022-01-12 13:18:17	                main:574]	:	INFO	:	Epoch 1435 | loss: nan | val_loss: nan | Time: 9199.76 ms
[2022-01-12 13:18:25	                main:574]	:	INFO	:	Epoch 1436 | loss: nan | val_loss: nan | Time: 8159.88 ms
[2022-01-12 13:18:35	                main:574]	:	INFO	:	Epoch 1437 | loss: nan | val_loss: nan | Time: 9398.19 ms
[2022-01-12 13:18:43	                main:574]	:	INFO	:	Epoch 1438 | loss: nan | val_loss: nan | Time: 8251.56 ms
[2022-01-12 13:18:52	                main:574]	:	INFO	:	Epoch 1439 | loss: nan | val_loss: nan | Time: 9159.84 ms
[2022-01-12 13:19:01	                main:574]	:	INFO	:	Epoch 1440 | loss: nan | val_loss: nan | Time: 8853.88 ms
[2022-01-12 13:19:10	                main:574]	:	INFO	:	Epoch 1441 | loss: nan | val_loss: nan | Time: 8649.49 ms
[2022-01-12 13:19:19	                main:574]	:	INFO	:	Epoch 1442 | loss: nan | val_loss: nan | Time: 9161.96 ms
[2022-01-12 13:19:27	                main:574]	:	INFO	:	Epoch 1443 | loss: nan | val_loss: nan | Time: 8465.2 ms
[2022-01-12 13:19:37	                main:574]	:	INFO	:	Epoch 1444 | loss: nan | val_loss: nan | Time: 9109.82 ms
[2022-01-12 13:19:45	                main:574]	:	INFO	:	Epoch 1445 | loss: nan | val_loss: nan | Time: 8645.24 ms
[2022-01-12 13:19:55	                main:574]	:	INFO	:	Epoch 1446 | loss: nan | val_loss: nan | Time: 9712.08 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 1650 SUPER)
[2022-01-12 14:43:20	                main:435]	:	INFO	:	Set logging level to 1
[2022-01-12 14:43:20	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-01-12 14:43:20	                main:444]	:	INFO	:	Resolving all filenames
[2022-01-12 14:43:20	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-01-12 14:43:20	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-01-12 14:43:20	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-01-12 14:43:20	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-01-12 14:43:20	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-01-12 14:43:20	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-01-12 14:43:20	                main:474]	:	INFO	:	Configuration: 
[2022-01-12 14:43:20	                main:475]	:	INFO	:	    Model type: GRU
[2022-01-12 14:43:20	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-01-12 14:43:20	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-01-12 14:43:20	                main:478]	:	INFO	:	    Batch Size: 128
[2022-01-12 14:43:20	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-01-12 14:43:20	                main:480]	:	INFO	:	    Patience: 10
[2022-01-12 14:43:20	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-01-12 14:43:20	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-01-12 14:43:20	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-01-12 14:43:20	                main:484]	:	INFO	:	    # Threads: 1
[2022-01-12 14:43:20	                main:486]	:	INFO	:	Preparing Dataset
[2022-01-12 14:43:20	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-01-12 14:43:20	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-01-12 14:43:23	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-01-12 14:43:23	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-01-12 14:43:23	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-01-12 14:43:23	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-01-12 14:43:23	                main:494]	:	INFO	:	Creating Model
[2022-01-12 14:43:23	                main:507]	:	INFO	:	Preparing config file
[2022-01-12 14:43:23	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-01-12 14:43:23	                main:512]	:	INFO	:	Loading config


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFAD51E478C

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 01/12/22 14:43:23
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\6;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 0000000079de0000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000d7a20000 0000000000207000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.22000.434) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.22000.434 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.434

ModLoad: 00000000d6590000 00000000000bd000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.22000.434) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.22000.434 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.434

ModLoad: 00000000d51a0000 0000000000374000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.22000.434) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.22000.434 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.434

ModLoad: 00000000d5a30000 00000000001ac000 C:\WINDOWS\System32\USER32.dll (6.2.22000.282) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000d56c0000 0000000000026000 C:\WINDOWS\System32\win32u.dll (6.2.22000.434) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.22000.434 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.434

ModLoad: 00000000d5be0000 0000000000029000 C:\WINDOWS\System32\GDI32.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000b8020000 0000000000058000 C:\ProgramData\BOINC\slots\6\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000d5080000 0000000000112000 C:\WINDOWS\System32\gdi32full.dll (6.2.22000.71) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.22000.71 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.71

ModLoad: 00000000d5760000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000d5520000 0000000000111000 C:\WINDOWS\System32\ucrtbase.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000d6fe0000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.22000.434) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000d64e0000 00000000000a3000 C:\WINDOWS\System32\msvcrt.dll (7.0.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.22000.1

ModLoad: 00000000d7500000 000000000009e000 C:\WINDOWS\System32\sechost.dll (6.2.22000.434) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000d78c0000 0000000000120000 C:\WINDOWS\System32\RPCRT4.dll (6.2.22000.434) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000aecb0000 0000000000099000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.23.27820.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\agent\_work\2\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.23.27820.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174; 2017
    Product Version       : 14.23.27820.0

ModLoad: 00000000cfe70000 0000000000221000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000cc8c0000 0000000000016000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.23.27820.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\agent\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.23.27820.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174; 2017
    Product Version       : 14.23.27820.0

ModLoad: 00000000cba70000 000000000000b000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.23.27820.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\agent\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.23.27820.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174; 2017
    Product Version       : 14.23.27820.0

ModLoad: 0000000060470000 000000000abe7000 C:\ProgramData\BOINC\slots\6\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000aeaa0000 000000000020d000 C:\ProgramData\BOINC\slots\6\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 0000000090110000 00000000002db000 C:\ProgramData\BOINC\slots\6\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000c2de0000 0000000000040000 C:\ProgramData\BOINC\slots\6\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000003b920000 0000000024b49000 C:\ProgramData\BOINC\slots\6\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000c2ca0000 0000000000045000 C:\ProgramData\BOINC\slots\6\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000038460000 00000000034b2000 C:\ProgramData\BOINC\slots\6\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 000000007a550000 00000000030a5000 C:\ProgramData\BOINC\slots\6\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 00000000cba60000 0000000000010000 C:\ProgramData\BOINC\slots\6\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 0000000013f10000 000000000919f000 C:\ProgramData\BOINC\slots\6\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000101b0000 0000000003d5b000 C:\ProgramData\BOINC\slots\6\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 000000008c000000 0000000001eca000 C:\ProgramData\BOINC\slots\6\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 000000001d0b0000 000000001b3a4000 C:\ProgramData\BOINC\slots\6\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 00000000d70b0000 0000000000031000 C:\WINDOWS\System32\IMM32.DLL (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000d4100000 0000000000018000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.22000.71) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.22000.71 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.71

ModLoad: 00000000d2770000 0000000000038000 C:\WINDOWS\SYSTEM32\dxcore.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : DXCore.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000d66c0000 000000000046b000 C:\WINDOWS\System32\Setupapi.dll (6.2.22000.194) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000d4c30000 000000000002c000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000d4be0000 000000000004c000 C:\WINDOWS\SYSTEM32\cfgmgr32.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000d56f0000 0000000000066000 C:\WINDOWS\System32\WINTRUST.dll (6.2.22000.434) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.22000.434 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.434

ModLoad: 00000000d4f10000 0000000000162000 C:\WINDOWS\System32\CRYPT32.dll (6.2.22000.348) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000d47d0000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000d5d30000 00000000007ae000 C:\WINDOWS\System32\Shell32.dll (6.2.22000.434) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.22000.184 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.184

ModLoad: 00000000d3050000 0000000000867000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.22000.348) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.22000.184 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.184

ModLoad: 00000000d7180000 0000000000378000 C:\WINDOWS\System32\combase.dll (6.2.22000.282) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000d2ee0000 0000000000166000 C:\WINDOWS\SYSTEM32\wintypes.dll (6.2.22000.41) (-exported- Symbols Loaded)
    Linked PDB Filename   : WinTypes.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000d5940000 00000000000ea000 C:\WINDOWS\System32\SHCORE.dll (6.2.22000.71) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000d6650000 000000000005d000 C:\WINDOWS\System32\shlwapi.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 000000008f480000 0000000000267000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.5671) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r456_61\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 27.21.14.5671
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.1.96 driver
    Product Version       : 27.21.14.5671

ModLoad: 00000000d1050000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000079020000 000000000152a000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_1c83a5d7cffd7bff\nvcuda64.dll (27.21.14.5671) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r456_61\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 27.21.14.5671
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.1.96 driver
    Product Version       : 27.21.14.5671

ModLoad: 00000000d7110000 000000000006f000 C:\WINDOWS\System32\WS2_32.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : ws2_32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000d0e30000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000d4790000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000d2630000 00000000000ac000 C:\WINDOWS\system32\uxtheme.dll (6.2.22000.120) (-exported- Symbols Loaded)
    Linked PDB Filename   : uxtheme.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000b65f0000 00000000006d5000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.5671) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r456_61\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 27.21.14.5671
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 27.21.14.5671

ModLoad: 00000000d6d60000 000000000019a000 C:\WINDOWS\System32\OLE32.DLL (6.2.22000.120) (-exported- Symbols Loaded)
    Linked PDB Filename   : ole32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000d5640000 000000000007f000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.22000.376) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.22000.376 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.376



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3625, Write: 307, Other 899

- I/O Transfers Counters -
Read: 6729247, Write: 6049, Other 30234

- Paged Pool Usage -
QuotaPagedPoolUsage: 3460192, QuotaPeakPagedPoolUsage: 3460192
QuotaNonPagedPoolUsage: 41576, QuotaPeakNonPagedPoolUsage: 41640

- Virtual Memory Usage -
VirtualSize: -1279836160, PeakVirtualSize: -675426304

- Pagefile Usage -
PagefileUsage: -1279836160, PeakPagefileUsage: -1279836160

- Working Set Size -
WorkingSetSize: 1228705792, PeakWorkingSetSize: 1228705792, PageFaultCount: 427838

*** Dump of thread ID 9420 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 7031250.000000, User Time: 25625000.000000, Wait Time: 4213846.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFAD51E478C

- Registers -
rax=00000000d7a48200 rbx=000000007a144910 rcx=000000004590331d rdx=00000000c84e5da0 rsi=00000000c84e6600 rdi=0000000019930520
r8=0000000000000004 r9=00000000c84e5df8 r10=0000000000000004 r11=00000000d23bed30 r12=00000000ba2007b0 r13=00000000c84e6810
r14=00000000df1fbfc0 r15=0000000000000000 rip=00000000d51e478c rsp=00000000c84e64a0 rbp=00000000c84e6790
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
c84e6570 7a05a884 00000040 0000004f ba201100 000002d6 KERNELBASE!RaiseException+0x0 
c84e65d0 79e01ca6 00002d60 00000000 cdf2c600 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
c84e6680 79e0593b 00000000 00000020 00000000 00000030 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
c84e67d0 79e01a78 00000000 00000000 c84e6b00 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
c84e68a0 79e01cfc c84e6b00 00000000 00000080 c84e6dd0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
c84e6960 79e0c4dd c84e6dd0 c84e6dd0 c84e6dd0 c84e6dd0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
c84e6c50 79dfb2fe c84e7268 c84e6dd0 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
c84ff9f0 7a03c6f8 f771c980 00000000 00000000 f780b620 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
c84ffa30 d65a54e0 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
c84ffa60 d7a2485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
c84ffae0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 6048 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 312500.000000, User Time: 0.000000, Wait Time: 4213611.000000

- Registers -
rax=00000000000001de rbx=00000000f5dd9d40 rcx=0000000000000074 rdx=00000000f5dd99c0 rsi=00000000f5dd7590 rdi=00000000f5dd9d40
r8=00000000d1055004 r9=0000000000000000 r10=00000000d10500f0 r11=0000000000000001 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000d7ac6f14 rsp=00000000c85ff8d8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
c85ff8d0 d7a36b4f 00000000 00000000 f5dd7590 f5dd9d40 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
c85ffbc0 d65a54e0 00000000 00000000 00000000 00000000 ntdll!EtwNotificationRegister+0x0 
c85ffbf0 d7a2485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
c85ffc70 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 8440 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 4213612.000000

- Registers -
rax=00000000000001de rbx=00000000f5ddb8d0 rcx=0000000000000074 rdx=00000000f5ddb550 rsi=00000000f5dd7590 rdi=00000000f5ddb8d0
r8=0000000000000008 r9=0000000000000040 r10=0000000000000540 r11=00000000ddbfe369 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000d7ac6f14 rsp=00000000c86ff7a8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
c86ff7a0 d7a36b4f 00000000 00000000 f5dd7590 f5ddb8d0 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
c86ffa90 d65a54e0 00000000 00000000 00000000 00000000 ntdll!EtwNotificationRegister+0x0 
c86ffac0 d7a2485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
c86ffb40 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 5952 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 4213611.000000

- Registers -
rax=00000000000001de rbx=00000000f5ddc750 rcx=0000000000000074 rdx=00000000f5ddc3d0 rsi=00000000f5dd7590 rdi=00000000f5ddc750
r8=00000000c87ff6a8 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000d7ac6f14 rsp=00000000c87ff918 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
c87ff910 d7a36b4f 00000000 00000000 f5dd7590 f5ddc750 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
c87ffc00 d65a54e0 00000000 00000000 00000000 00000000 ntdll!EtwNotificationRegister+0x0 
c87ffc30 d7a2485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
c87ffcb0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 6528 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 4213842.000000

- Registers -
rax=0000000000000034 rbx=00000000c89ff810 rcx=0000000000000000 rdx=00000000c89ff810 rsi=00000000c820c000 rdi=0000000000000000
r8=0000000000000001 r9=00000000c89fdc60 r10=00000000c89fde89 r11=0000000000000000 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000d7ac39e4 rsp=00000000c89ff748 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
c89ff740 d7a7b4c3 00000000 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0 
c89ff770 d51eb3a1 00000000 00000000 00000000 00000000 ntdll!RtlDelayExecution+0x0 
c89ff7f0 79e1a07f 00000000 00000000 fff0bdc0 00000000 KERNELBASE!SleepEx+0x0 
c89ff820 d65a54e0 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
c89ff850 d7a2485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
c89ff8d0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 1700 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 4213841.000000

- Registers -
rax=000000000000005b rbx=0000000000000007 rcx=0000000000000007 rdx=00000000c8aff7b0 rsi=0000000000000000 rdi=0000000000000007
r8=00000000c8aff458 r9=00000000f79aa950 r10=0000000000000000 r11=00000000c8aff720 r12=0000000000000064 r13=00000000c8aff7b0
r14=00000000c8aff4b0 r15=0000000000000000 rip=00000000d7ac3eb4 rsp=00000000c8aff458 rbp=00000000f79aa950
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
c8aff450 d51efb10 00000000 00000000 00000000 00000000 ntdll!NtWaitForMultipleObjects+0x0 
c8aff740 d51efa0e 79513b48 f7a395a0 00000007 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
c8aff780 791cba44 f79ae250 00000000 f79a93f0 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
c8aff9c0 792608dd 00000000 00000004 00000000 00000000 nvcuda64!+0x0 
c8affa70 791cb413 4ccde58b 4b38e696 f7e72d50 00000000 nvcuda64!cuProfilerStop+0x0 
c8affaa0 794d9200 f7e72d50 00000000 00000000 00000000 nvcuda64!+0x0 
c8affad0 d65a54e0 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
c8affb00 d7a2485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
c8affb80 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 1072 (state: Waiting): ***

- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 4213825.000000

- Registers -
rax=00000000000001db rbx=0000000000000000 rcx=00000000f7bfa508 rdx=00000000c8bff9d8 rsi=0000000000000102 rdi=0000000000000000
r8=0000000000000001 r9=0000000000000430 r10=00000000f7bff0d8 r11=00000000f855d460 r12=00000000c8bff9d8 r13=0000000000000000
r14=00000000f7bff0d8 r15=00000000f7bfa508 rip=00000000d7ac6eb4 rsp=00000000c8bff918 rbp=00000000c8bff970
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
c8bff910 d7a8a1da 00000102 00000102 00000000 c8bff940 ntdll!NtWaitForAlertByThreadId+0x0 
c8bff980 d51fd449 f7bfc8c0 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0 
c8bff9b0 791521da f7bfc8c0 d7a26770 f7bfc8c0 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0 
c8bffa10 791cb413 00000001 4cb3ae5f 00000000 00000000 nvcuda64!+0x0 
c8bffa40 794d9200 f7e72ea0 00000000 00000000 00000000 nvcuda64!+0x0 
c8bffa70 d65a54e0 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
c8bffaa0 d7a2485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
c8bffb20 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)