Task 13957784

Name ParityModified-1647049091-17784-1-0_0
Workunit 11031568
Created 29 Mar 2022, 0:33:17 UTC
Sent 1 Apr 2022, 21:41:04 UTC
Report deadline 9 Apr 2022, 21:41:04 UTC
Received 2 Apr 2022, 2:42:29 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 18617
Run time 3 hours 6 min 58 sec
CPU time 2 hours 27 min
Validate state Invalid
Credit 0.00
Device peak FLOPS 5,307.63 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.62 GB
Peak swap size 3.62 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
            main:574]	:	INFO	:	Epoch 1290 | loss: nan | val_loss: nan | Time: 7129.59 ms
[2022-04-01 20:41:03	                main:574]	:	INFO	:	Epoch 1291 | loss: nan | val_loss: nan | Time: 7159.52 ms
[2022-04-01 20:41:11	                main:574]	:	INFO	:	Epoch 1292 | loss: nan | val_loss: nan | Time: 7643.85 ms
[2022-04-01 20:41:18	                main:574]	:	INFO	:	Epoch 1293 | loss: nan | val_loss: nan | Time: 7214.87 ms
[2022-04-01 20:41:25	                main:574]	:	INFO	:	Epoch 1294 | loss: nan | val_loss: nan | Time: 7414.43 ms
[2022-04-01 20:41:33	                main:574]	:	INFO	:	Epoch 1295 | loss: nan | val_loss: nan | Time: 7571.22 ms
[2022-04-01 20:41:40	                main:574]	:	INFO	:	Epoch 1296 | loss: nan | val_loss: nan | Time: 6987.48 ms
[2022-04-01 20:41:48	                main:574]	:	INFO	:	Epoch 1297 | loss: nan | val_loss: nan | Time: 7752.76 ms
[2022-04-01 20:41:55	                main:574]	:	INFO	:	Epoch 1298 | loss: nan | val_loss: nan | Time: 7432.48 ms
[2022-04-01 20:42:02	                main:574]	:	INFO	:	Epoch 1299 | loss: nan | val_loss: nan | Time: 7055.15 ms
[2022-04-01 20:42:09	                main:574]	:	INFO	:	Epoch 1300 | loss: nan | val_loss: nan | Time: 7285.37 ms
[2022-04-01 20:42:17	                main:574]	:	INFO	:	Epoch 1301 | loss: nan | val_loss: nan | Time: 7571.42 ms
[2022-04-01 20:42:24	                main:574]	:	INFO	:	Epoch 1302 | loss: nan | val_loss: nan | Time: 7014.01 ms
[2022-04-01 20:42:32	                main:574]	:	INFO	:	Epoch 1303 | loss: nan | val_loss: nan | Time: 7614.94 ms
[2022-04-01 20:42:39	                main:574]	:	INFO	:	Epoch 1304 | loss: nan | val_loss: nan | Time: 7579.58 ms
[2022-04-01 20:42:47	                main:574]	:	INFO	:	Epoch 1305 | loss: nan | val_loss: nan | Time: 7353.26 ms
[2022-04-01 20:42:54	                main:574]	:	INFO	:	Epoch 1306 | loss: nan | val_loss: nan | Time: 7105.05 ms
[2022-04-01 20:43:01	                main:574]	:	INFO	:	Epoch 1307 | loss: nan | val_loss: nan | Time: 7204.16 ms
[2022-04-01 20:43:08	                main:574]	:	INFO	:	Epoch 1308 | loss: nan | val_loss: nan | Time: 7188.33 ms
[2022-04-01 20:43:15	                main:574]	:	INFO	:	Epoch 1309 | loss: nan | val_loss: nan | Time: 7364.63 ms
[2022-04-01 20:43:23	                main:574]	:	INFO	:	Epoch 1310 | loss: nan | val_loss: nan | Time: 7412.65 ms
[2022-04-01 20:43:30	                main:574]	:	INFO	:	Epoch 1311 | loss: nan | val_loss: nan | Time: 7421.69 ms
[2022-04-01 20:43:38	                main:574]	:	INFO	:	Epoch 1312 | loss: nan | val_loss: nan | Time: 7334.02 ms
[2022-04-01 20:43:45	                main:574]	:	INFO	:	Epoch 1313 | loss: nan | val_loss: nan | Time: 7097.94 ms
[2022-04-01 20:43:52	                main:574]	:	INFO	:	Epoch 1314 | loss: nan | val_loss: nan | Time: 7549.28 ms
[2022-04-01 20:43:59	                main:574]	:	INFO	:	Epoch 1315 | loss: nan | val_loss: nan | Time: 7096.68 ms
[2022-04-01 20:44:06	                main:574]	:	INFO	:	Epoch 1316 | loss: nan | val_loss: nan | Time: 7074.9 ms
[2022-04-01 20:44:14	                main:574]	:	INFO	:	Epoch 1317 | loss: nan | val_loss: nan | Time: 7128.2 ms
[2022-04-01 20:44:21	                main:574]	:	INFO	:	Epoch 1318 | loss: nan | val_loss: nan | Time: 7205.4 ms
[2022-04-01 20:44:28	                main:574]	:	INFO	:	Epoch 1319 | loss: nan | val_loss: nan | Time: 7582.24 ms
[2022-04-01 20:44:36	                main:574]	:	INFO	:	Epoch 1320 | loss: nan | val_loss: nan | Time: 7156.36 ms
[2022-04-01 20:44:43	                main:574]	:	INFO	:	Epoch 1321 | loss: nan | val_loss: nan | Time: 7349.86 ms
[2022-04-01 20:44:50	                main:574]	:	INFO	:	Epoch 1322 | loss: nan | val_loss: nan | Time: 7252.62 ms
[2022-04-01 20:44:58	                main:574]	:	INFO	:	Epoch 1323 | loss: nan | val_loss: nan | Time: 7992.22 ms
[2022-04-01 20:45:06	                main:574]	:	INFO	:	Epoch 1324 | loss: nan | val_loss: nan | Time: 7534.93 ms
[2022-04-01 20:45:13	                main:574]	:	INFO	:	Epoch 1325 | loss: nan | val_loss: nan | Time: 7094.28 ms
[2022-04-01 20:45:21	                main:574]	:	INFO	:	Epoch 1326 | loss: nan | val_loss: nan | Time: 8282.24 ms
[2022-04-01 20:45:29	                main:574]	:	INFO	:	Epoch 1327 | loss: nan | val_loss: nan | Time: 7965.36 ms
[2022-04-01 20:45:36	                main:574]	:	INFO	:	Epoch 1328 | loss: nan | val_loss: nan | Time: 7016.96 ms
[2022-04-01 20:45:43	                main:574]	:	INFO	:	Epoch 1329 | loss: nan | val_loss: nan | Time: 7216.68 ms
[2022-04-01 20:45:51	                main:574]	:	INFO	:	Epoch 1330 | loss: nan | val_loss: nan | Time: 7560.86 ms
[2022-04-01 20:45:58	                main:574]	:	INFO	:	Epoch 1331 | loss: nan | val_loss: nan | Time: 7111.61 ms
[2022-04-01 20:46:05	                main:574]	:	INFO	:	Epoch 1332 | loss: nan | val_loss: nan | Time: 6960.84 ms
[2022-04-01 20:46:12	                main:574]	:	INFO	:	Epoch 1333 | loss: nan | val_loss: nan | Time: 7401.81 ms
[2022-04-01 20:46:21	                main:574]	:	INFO	:	Epoch 1334 | loss: nan | val_loss: nan | Time: 8754.63 ms
[2022-04-01 20:46:28	                main:574]	:	INFO	:	Epoch 1335 | loss: nan | val_loss: nan | Time: 7266.64 ms
[2022-04-01 20:46:35	                main:574]	:	INFO	:	Epoch 1336 | loss: nan | val_loss: nan | Time: 6973.68 ms
[2022-04-01 20:46:43	                main:574]	:	INFO	:	Epoch 1337 | loss: nan | val_loss: nan | Time: 7378.56 ms
[2022-04-01 20:46:50	                main:574]	:	INFO	:	Epoch 1338 | loss: nan | val_loss: nan | Time: 7231.81 ms
[2022-04-01 20:46:57	                main:574]	:	INFO	:	Epoch 1339 | loss: nan | val_loss: nan | Time: 6896.36 ms
[2022-04-01 20:47:04	                main:574]	:	INFO	:	Epoch 1340 | loss: nan | val_loss: nan | Time: 7102 ms
[2022-04-01 20:47:11	                main:574]	:	INFO	:	Epoch 1341 | loss: nan | val_loss: nan | Time: 7194.93 ms
[2022-04-01 20:47:18	                main:574]	:	INFO	:	Epoch 1342 | loss: nan | val_loss: nan | Time: 7036.79 ms
[2022-04-01 20:47:26	                main:574]	:	INFO	:	Epoch 1343 | loss: nan | val_loss: nan | Time: 7289.89 ms
[2022-04-01 20:47:33	                main:574]	:	INFO	:	Epoch 1344 | loss: nan | val_loss: nan | Time: 7656.36 ms
[2022-04-01 20:47:42	                main:574]	:	INFO	:	Epoch 1345 | loss: nan | val_loss: nan | Time: 8868.66 ms
[2022-04-01 20:47:50	                main:574]	:	INFO	:	Epoch 1346 | loss: nan | val_loss: nan | Time: 7777.32 ms
[2022-04-01 20:47:57	                main:574]	:	INFO	:	Epoch 1347 | loss: nan | val_loss: nan | Time: 7347.62 ms
[2022-04-01 20:48:05	                main:574]	:	INFO	:	Epoch 1348 | loss: nan | val_loss: nan | Time: 7396.15 ms
[2022-04-01 20:48:12	                main:574]	:	INFO	:	Epoch 1349 | loss: nan | val_loss: nan | Time: 7686.62 ms
[2022-04-01 20:48:20	                main:574]	:	INFO	:	Epoch 1350 | loss: nan | val_loss: nan | Time: 8011.57 ms
[2022-04-01 20:48:28	                main:574]	:	INFO	:	Epoch 1351 | loss: nan | val_loss: nan | Time: 7625.51 ms
[2022-04-01 20:48:36	                main:574]	:	INFO	:	Epoch 1352 | loss: nan | val_loss: nan | Time: 7618.88 ms
[2022-04-01 20:48:44	                main:574]	:	INFO	:	Epoch 1353 | loss: nan | val_loss: nan | Time: 7947.27 ms
[2022-04-01 20:48:51	                main:574]	:	INFO	:	Epoch 1354 | loss: nan | val_loss: nan | Time: 7442.52 ms
[2022-04-01 20:48:58	                main:574]	:	INFO	:	Epoch 1355 | loss: nan | val_loss: nan | Time: 6953.99 ms
[2022-04-01 20:49:05	                main:574]	:	INFO	:	Epoch 1356 | loss: nan | val_loss: nan | Time: 7502.6 ms
[2022-04-01 20:49:13	                main:574]	:	INFO	:	Epoch 1357 | loss: nan | val_loss: nan | Time: 7150.91 ms
[2022-04-01 20:49:20	                main:574]	:	INFO	:	Epoch 1358 | loss: nan | val_loss: nan | Time: 7508.88 ms
[2022-04-01 20:49:28	                main:574]	:	INFO	:	Epoch 1359 | loss: nan | val_loss: nan | Time: 7633.57 ms
[2022-04-01 20:49:35	                main:574]	:	INFO	:	Epoch 1360 | loss: nan | val_loss: nan | Time: 7733.31 ms
[2022-04-01 20:49:43	                main:574]	:	INFO	:	Epoch 1361 | loss: nan | val_loss: nan | Time: 7198.78 ms
[2022-04-01 20:49:50	                main:574]	:	INFO	:	Epoch 1362 | loss: nan | val_loss: nan | Time: 7361.28 ms
[2022-04-01 20:49:57	                main:574]	:	INFO	:	Epoch 1363 | loss: nan | val_loss: nan | Time: 7147.29 ms
[2022-04-01 20:50:06	                main:574]	:	INFO	:	Epoch 1364 | loss: nan | val_loss: nan | Time: 8528.54 ms
[2022-04-01 20:50:15	                main:574]	:	INFO	:	Epoch 1365 | loss: nan | val_loss: nan | Time: 9469.75 ms
[2022-04-01 20:50:23	                main:574]	:	INFO	:	Epoch 1366 | loss: nan | val_loss: nan | Time: 7288 ms
[2022-04-01 20:50:30	                main:574]	:	INFO	:	Epoch 1367 | loss: nan | val_loss: nan | Time: 7907.98 ms
[2022-04-01 20:50:38	                main:574]	:	INFO	:	Epoch 1368 | loss: nan | val_loss: nan | Time: 7276.28 ms
[2022-04-01 20:50:45	                main:574]	:	INFO	:	Epoch 1369 | loss: nan | val_loss: nan | Time: 7295.79 ms
[2022-04-01 20:50:52	                main:574]	:	INFO	:	Epoch 1370 | loss: nan | val_loss: nan | Time: 7242.78 ms
[2022-04-01 20:50:59	                main:574]	:	INFO	:	Epoch 1371 | loss: nan | val_loss: nan | Time: 7077.87 ms
[2022-04-01 20:51:07	                main:574]	:	INFO	:	Epoch 1372 | loss: nan | val_loss: nan | Time: 7846.73 ms
[2022-04-01 20:51:14	                main:574]	:	INFO	:	Epoch 1373 | loss: nan | val_loss: nan | Time: 7129.16 ms
[2022-04-01 20:51:22	                main:574]	:	INFO	:	Epoch 1374 | loss: nan | val_loss: nan | Time: 7276 ms
[2022-04-01 20:51:29	                main:574]	:	INFO	:	Epoch 1375 | loss: nan | val_loss: nan | Time: 7427.52 ms
[2022-04-01 20:51:36	                main:574]	:	INFO	:	Epoch 1376 | loss: nan | val_loss: nan | Time: 7308.69 ms
[2022-04-01 20:51:44	                main:574]	:	INFO	:	Epoch 1377 | loss: nan | val_loss: nan | Time: 7250.81 ms
[2022-04-01 20:51:51	                main:574]	:	INFO	:	Epoch 1378 | loss: nan | val_loss: nan | Time: 7260.24 ms
[2022-04-01 20:51:58	                main:574]	:	INFO	:	Epoch 1379 | loss: nan | val_loss: nan | Time: 7393.94 ms
[2022-04-01 20:52:06	                main:574]	:	INFO	:	Epoch 1380 | loss: nan | val_loss: nan | Time: 7222.83 ms
[2022-04-01 20:52:13	                main:574]	:	INFO	:	Epoch 1381 | loss: nan | val_loss: nan | Time: 7166.8 ms
[2022-04-01 20:52:20	                main:574]	:	INFO	:	Epoch 1382 | loss: nan | val_loss: nan | Time: 7700.45 ms
[2022-04-01 20:52:28	                main:574]	:	INFO	:	Epoch 1383 | loss: nan | val_loss: nan | Time: 7428.08 ms
[2022-04-01 20:52:35	                main:574]	:	INFO	:	Epoch 1384 | loss: nan | val_loss: nan | Time: 7331.1 ms
[2022-04-01 20:52:43	                main:574]	:	INFO	:	Epoch 1385 | loss: nan | val_loss: nan | Time: 7778.31 ms
[2022-04-01 20:52:50	                main:574]	:	INFO	:	Epoch 1386 | loss: nan | val_loss: nan | Time: 7454.76 ms
[2022-04-01 20:52:58	                main:574]	:	INFO	:	Epoch 1387 | loss: nan | val_loss: nan | Time: 7294.83 ms
[2022-04-01 20:53:05	                main:574]	:	INFO	:	Epoch 1388 | loss: nan | val_loss: nan | Time: 7204.65 ms
[2022-04-01 20:53:12	                main:574]	:	INFO	:	Epoch 1389 | loss: nan | val_loss: nan | Time: 7407.2 ms
[2022-04-01 20:53:19	                main:574]	:	INFO	:	Epoch 1390 | loss: nan | val_loss: nan | Time: 7045.83 ms
[2022-04-01 20:53:27	                main:574]	:	INFO	:	Epoch 1391 | loss: nan | val_loss: nan | Time: 7226.29 ms
[2022-04-01 20:53:34	                main:574]	:	INFO	:	Epoch 1392 | loss: nan | val_loss: nan | Time: 7706.51 ms
[2022-04-01 20:53:42	                main:574]	:	INFO	:	Epoch 1393 | loss: nan | val_loss: nan | Time: 7478.27 ms
[2022-04-01 20:53:49	                main:574]	:	INFO	:	Epoch 1394 | loss: nan | val_loss: nan | Time: 7221.62 ms
[2022-04-01 20:53:56	                main:574]	:	INFO	:	Epoch 1395 | loss: nan | val_loss: nan | Time: 7228.63 ms
[2022-04-01 20:54:04	                main:574]	:	INFO	:	Epoch 1396 | loss: nan | val_loss: nan | Time: 7389.01 ms
[2022-04-01 20:54:11	                main:574]	:	INFO	:	Epoch 1397 | loss: nan | val_loss: nan | Time: 7023.22 ms
[2022-04-01 20:54:18	                main:574]	:	INFO	:	Epoch 1398 | loss: nan | val_loss: nan | Time: 7392.08 ms
[2022-04-01 20:54:25	                main:574]	:	INFO	:	Epoch 1399 | loss: nan | val_loss: nan | Time: 7360.99 ms
[2022-04-01 20:54:33	                main:574]	:	INFO	:	Epoch 1400 | loss: nan | val_loss: nan | Time: 7709.12 ms
[2022-04-01 20:54:40	                main:574]	:	INFO	:	Epoch 1401 | loss: nan | val_loss: nan | Time: 7044.21 ms
[2022-04-01 20:54:48	                main:574]	:	INFO	:	Epoch 1402 | loss: nan | val_loss: nan | Time: 7257.89 ms
[2022-04-01 20:54:55	                main:574]	:	INFO	:	Epoch 1403 | loss: nan | val_loss: nan | Time: 7329.74 ms
[2022-04-01 20:55:02	                main:574]	:	INFO	:	Epoch 1404 | loss: nan | val_loss: nan | Time: 7137.41 ms
[2022-04-01 20:55:09	                main:574]	:	INFO	:	Epoch 1405 | loss: nan | val_loss: nan | Time: 7510.22 ms
[2022-04-01 20:55:17	                main:574]	:	INFO	:	Epoch 1406 | loss: nan | val_loss: nan | Time: 7326.51 ms
[2022-04-01 20:55:24	                main:574]	:	INFO	:	Epoch 1407 | loss: nan | val_loss: nan | Time: 7061.92 ms
[2022-04-01 20:55:31	                main:574]	:	INFO	:	Epoch 1408 | loss: nan | val_loss: nan | Time: 7592.33 ms
[2022-04-01 20:55:40	                main:574]	:	INFO	:	Epoch 1409 | loss: nan | val_loss: nan | Time: 8107.45 ms
[2022-04-01 20:55:47	                main:574]	:	INFO	:	Epoch 1410 | loss: nan | val_loss: nan | Time: 7618.64 ms
[2022-04-01 20:55:55	                main:574]	:	INFO	:	Epoch 1411 | loss: nan | val_loss: nan | Time: 7506.13 ms
[2022-04-01 20:56:02	                main:574]	:	INFO	:	Epoch 1412 | loss: nan | val_loss: nan | Time: 7170.94 ms
[2022-04-01 20:56:09	                main:574]	:	INFO	:	Epoch 1413 | loss: nan | val_loss: nan | Time: 7148.52 ms
[2022-04-01 20:56:16	                main:574]	:	INFO	:	Epoch 1414 | loss: nan | val_loss: nan | Time: 7383.91 ms
[2022-04-01 20:56:24	                main:574]	:	INFO	:	Epoch 1415 | loss: nan | val_loss: nan | Time: 8023.66 ms
[2022-04-01 20:56:32	                main:574]	:	INFO	:	Epoch 1416 | loss: nan | val_loss: nan | Time: 7462.07 ms
[2022-04-01 20:56:39	                main:574]	:	INFO	:	Epoch 1417 | loss: nan | val_loss: nan | Time: 7183.51 ms
[2022-04-01 20:56:46	                main:574]	:	INFO	:	Epoch 1418 | loss: nan | val_loss: nan | Time: 7146.4 ms
[2022-04-01 20:56:54	                main:574]	:	INFO	:	Epoch 1419 | loss: nan | val_loss: nan | Time: 7267.75 ms
[2022-04-01 20:57:01	                main:574]	:	INFO	:	Epoch 1420 | loss: nan | val_loss: nan | Time: 7243.56 ms
[2022-04-01 20:57:08	                main:574]	:	INFO	:	Epoch 1421 | loss: nan | val_loss: nan | Time: 7143.56 ms
[2022-04-01 20:57:15	                main:574]	:	INFO	:	Epoch 1422 | loss: nan | val_loss: nan | Time: 7045.48 ms
[2022-04-01 20:57:22	                main:574]	:	INFO	:	Epoch 1423 | loss: nan | val_loss: nan | Time: 7156.94 ms
[2022-04-01 20:57:30	                main:574]	:	INFO	:	Epoch 1424 | loss: nan | val_loss: nan | Time: 7864.77 ms
[2022-04-01 20:57:38	                main:574]	:	INFO	:	Epoch 1425 | loss: nan | val_loss: nan | Time: 7475.06 ms
[2022-04-01 20:57:45	                main:574]	:	INFO	:	Epoch 1426 | loss: nan | val_loss: nan | Time: 7618.84 ms
[2022-04-01 20:57:53	                main:574]	:	INFO	:	Epoch 1427 | loss: nan | val_loss: nan | Time: 7375.22 ms
[2022-04-01 20:57:59	                main:574]	:	INFO	:	Epoch 1428 | loss: nan | val_loss: nan | Time: 6902.32 ms
[2022-04-01 20:58:07	                main:574]	:	INFO	:	Epoch 1429 | loss: nan | val_loss: nan | Time: 7416.95 ms
[2022-04-01 20:58:15	                main:574]	:	INFO	:	Epoch 1430 | loss: nan | val_loss: nan | Time: 7684.03 ms
[2022-04-01 20:58:22	                main:574]	:	INFO	:	Epoch 1431 | loss: nan | val_loss: nan | Time: 7204.57 ms
[2022-04-01 20:58:30	                main:574]	:	INFO	:	Epoch 1432 | loss: nan | val_loss: nan | Time: 7910.33 ms
[2022-04-01 20:58:37	                main:574]	:	INFO	:	Epoch 1433 | loss: nan | val_loss: nan | Time: 6984.52 ms
[2022-04-01 20:58:44	                main:574]	:	INFO	:	Epoch 1434 | loss: nan | val_loss: nan | Time: 7367.83 ms
[2022-04-01 20:58:51	                main:574]	:	INFO	:	Epoch 1435 | loss: nan | val_loss: nan | Time: 7230.97 ms
[2022-04-01 20:58:59	                main:574]	:	INFO	:	Epoch 1436 | loss: nan | val_loss: nan | Time: 7392.42 ms
[2022-04-01 20:59:06	                main:574]	:	INFO	:	Epoch 1437 | loss: nan | val_loss: nan | Time: 6889.62 ms
[2022-04-01 20:59:13	                main:574]	:	INFO	:	Epoch 1438 | loss: nan | val_loss: nan | Time: 7281.3 ms
[2022-04-01 20:59:20	                main:574]	:	INFO	:	Epoch 1439 | loss: nan | val_loss: nan | Time: 7268.46 ms
[2022-04-01 20:59:28	                main:574]	:	INFO	:	Epoch 1440 | loss: nan | val_loss: nan | Time: 8171.89 ms
[2022-04-01 20:59:35	                main:574]	:	INFO	:	Epoch 1441 | loss: nan | val_loss: nan | Time: 7084.21 ms
[2022-04-01 20:59:43	                main:574]	:	INFO	:	Epoch 1442 | loss: nan | val_loss: nan | Time: 7088.17 ms
[2022-04-01 20:59:50	                main:574]	:	INFO	:	Epoch 1443 | loss: nan | val_loss: nan | Time: 7056.9 ms
[2022-04-01 20:59:57	                main:574]	:	INFO	:	Epoch 1444 | loss: nan | val_loss: nan | Time: 7244.47 ms
[2022-04-01 21:00:04	                main:574]	:	INFO	:	Epoch 1445 | loss: nan | val_loss: nan | Time: 7356.25 ms
[2022-04-01 21:00:14	                main:574]	:	INFO	:	Epoch 1446 | loss: nan | val_loss: nan | Time: 9758.23 ms
[2022-04-01 21:00:22	                main:574]	:	INFO	:	Epoch 1447 | loss: nan | val_loss: nan | Time: 7693.57 ms
[2022-04-01 21:00:30	                main:574]	:	INFO	:	Epoch 1448 | loss: nan | val_loss: nan | Time: 8010.53 ms
[2022-04-01 21:00:37	                main:574]	:	INFO	:	Epoch 1449 | loss: nan | val_loss: nan | Time: 7056.72 ms
[2022-04-01 21:00:44	                main:574]	:	INFO	:	Epoch 1450 | loss: nan | val_loss: nan | Time: 7196.36 ms
[2022-04-01 21:00:51	                main:574]	:	INFO	:	Epoch 1451 | loss: nan | val_loss: nan | Time: 7272.27 ms
[2022-04-01 21:00:59	                main:574]	:	INFO	:	Epoch 1452 | loss: nan | val_loss: nan | Time: 7238.29 ms
[2022-04-01 21:01:05	                main:574]	:	INFO	:	Epoch 1453 | loss: nan | val_loss: nan | Time: 6897.26 ms
[2022-04-01 21:01:13	                main:574]	:	INFO	:	Epoch 1454 | loss: nan | val_loss: nan | Time: 7327.63 ms
[2022-04-01 21:01:20	                main:574]	:	INFO	:	Epoch 1455 | loss: nan | val_loss: nan | Time: 7105.59 ms
[2022-04-01 21:01:28	                main:574]	:	INFO	:	Epoch 1456 | loss: nan | val_loss: nan | Time: 8397.44 ms
[2022-04-01 21:01:36	                main:574]	:	INFO	:	Epoch 1457 | loss: nan | val_loss: nan | Time: 7347.61 ms
[2022-04-01 21:01:43	                main:574]	:	INFO	:	Epoch 1458 | loss: nan | val_loss: nan | Time: 7788.43 ms
[2022-04-01 21:01:50	                main:574]	:	INFO	:	Epoch 1459 | loss: nan | val_loss: nan | Time: 7056.6 ms
[2022-04-01 21:01:58	                main:574]	:	INFO	:	Epoch 1460 | loss: nan | val_loss: nan | Time: 7546.11 ms
[2022-04-01 21:02:05	                main:574]	:	INFO	:	Epoch 1461 | loss: nan | val_loss: nan | Time: 7117.83 ms
[2022-04-01 21:02:12	                main:574]	:	INFO	:	Epoch 1462 | loss: nan | val_loss: nan | Time: 6949.46 ms
[2022-04-01 21:02:21	                main:574]	:	INFO	:	Epoch 1463 | loss: nan | val_loss: nan | Time: 8454.34 ms
[2022-04-01 21:02:29	                main:574]	:	INFO	:	Epoch 1464 | loss: nan | val_loss: nan | Time: 7953.91 ms
[2022-04-01 21:02:36	                main:574]	:	INFO	:	Epoch 1465 | loss: nan | val_loss: nan | Time: 7488.36 ms
[2022-04-01 21:02:44	                main:574]	:	INFO	:	Epoch 1466 | loss: nan | val_loss: nan | Time: 7637.28 ms
[2022-04-01 21:02:51	                main:574]	:	INFO	:	Epoch 1467 | loss: nan | val_loss: nan | Time: 7274.56 ms
[2022-04-01 21:02:58	                main:574]	:	INFO	:	Epoch 1468 | loss: nan | val_loss: nan | Time: 7239.8 ms
[2022-04-01 21:03:05	                main:574]	:	INFO	:	Epoch 1469 | loss: nan | val_loss: nan | Time: 7052.19 ms
[2022-04-01 21:03:12	                main:574]	:	INFO	:	Epoch 1470 | loss: nan | val_loss: nan | Time: 7212.13 ms
[2022-04-01 21:03:20	                main:574]	:	INFO	:	Epoch 1471 | loss: nan | val_loss: nan | Time: 7635.18 ms
[2022-04-01 21:03:27	                main:574]	:	INFO	:	Epoch 1472 | loss: nan | val_loss: nan | Time: 7160.13 ms
[2022-04-01 21:03:35	                main:574]	:	INFO	:	Epoch 1473 | loss: nan | val_loss: nan | Time: 7668.94 ms
[2022-04-01 21:03:42	                main:574]	:	INFO	:	Epoch 1474 | loss: nan | val_loss: nan | Time: 7002.59 ms
[2022-04-01 21:03:49	                main:574]	:	INFO	:	Epoch 1475 | loss: nan | val_loss: nan | Time: 7005.29 ms
[2022-04-01 21:03:56	                main:574]	:	INFO	:	Epoch 1476 | loss: nan | val_loss: nan | Time: 7320.09 ms
[2022-04-01 21:04:03	                main:574]	:	INFO	:	Epoch 1477 | loss: nan | val_loss: nan | Time: 7180.12 ms
[2022-04-01 21:04:11	                main:574]	:	INFO	:	Epoch 1478 | loss: nan | val_loss: nan | Time: 7080.23 ms
[2022-04-01 21:04:18	                main:574]	:	INFO	:	Epoch 1479 | loss: nan | val_loss: nan | Time: 7566.15 ms
[2022-04-01 21:04:25	                main:574]	:	INFO	:	Epoch 1480 | loss: nan | val_loss: nan | Time: 7379.96 ms
[2022-04-01 21:04:33	                main:574]	:	INFO	:	Epoch 1481 | loss: nan | val_loss: nan | Time: 7301.25 ms
[2022-04-01 21:04:40	                main:574]	:	INFO	:	Epoch 1482 | loss: nan | val_loss: nan | Time: 7139.05 ms
[2022-04-01 21:04:47	                main:574]	:	INFO	:	Epoch 1483 | loss: nan | val_loss: nan | Time: 7283.35 ms
[2022-04-01 21:04:55	                main:574]	:	INFO	:	Epoch 1484 | loss: nan | val_loss: nan | Time: 7687.13 ms
[2022-04-01 21:05:02	                main:574]	:	INFO	:	Epoch 1485 | loss: nan | val_loss: nan | Time: 7148.24 ms
[2022-04-01 21:05:09	                main:574]	:	INFO	:	Epoch 1486 | loss: nan | val_loss: nan | Time: 7270.59 ms
[2022-04-01 21:05:16	                main:574]	:	INFO	:	Epoch 1487 | loss: nan | val_loss: nan | Time: 7006.43 ms
[2022-04-01 21:05:23	                main:574]	:	INFO	:	Epoch 1488 | loss: nan | val_loss: nan | Time: 7126.75 ms
[2022-04-01 21:05:31	                main:574]	:	INFO	:	Epoch 1489 | loss: nan | val_loss: nan | Time: 7507.13 ms
[2022-04-01 21:05:38	                main:574]	:	INFO	:	Epoch 1490 | loss: nan | val_loss: nan | Time: 7214.28 ms
[2022-04-01 21:05:45	                main:574]	:	INFO	:	Epoch 1491 | loss: nan | val_loss: nan | Time: 6928.69 ms
[2022-04-01 21:05:53	                main:574]	:	INFO	:	Epoch 1492 | loss: nan | val_loss: nan | Time: 7796.2 ms
[2022-04-01 21:06:00	                main:574]	:	INFO	:	Epoch 1493 | loss: nan | val_loss: nan | Time: 7015.63 ms
[2022-04-01 21:06:07	                main:574]	:	INFO	:	Epoch 1494 | loss: nan | val_loss: nan | Time: 7485.82 ms
[2022-04-01 21:06:15	                main:574]	:	INFO	:	Epoch 1495 | loss: nan | val_loss: nan | Time: 7037.8 ms
[2022-04-01 21:06:21	                main:574]	:	INFO	:	Epoch 1496 | loss: nan | val_loss: nan | Time: 6921.28 ms
[2022-04-01 21:06:30	                main:574]	:	INFO	:	Epoch 1497 | loss: nan | val_loss: nan | Time: 8083.04 ms
[2022-04-01 21:06:36	                main:574]	:	INFO	:	Epoch 1498 | loss: nan | val_loss: nan | Time: 6811.15 ms
[2022-04-01 21:06:43	                main:574]	:	INFO	:	Epoch 1499 | loss: nan | val_loss: nan | Time: 7110.14 ms
[2022-04-01 21:06:50	                main:574]	:	INFO	:	Epoch 1500 | loss: nan | val_loss: nan | Time: 6963.12 ms
[2022-04-01 21:06:58	                main:574]	:	INFO	:	Epoch 1501 | loss: nan | val_loss: nan | Time: 7381.84 ms
[2022-04-01 21:07:05	                main:574]	:	INFO	:	Epoch 1502 | loss: nan | val_loss: nan | Time: 6807.72 ms
[2022-04-01 21:07:12	                main:574]	:	INFO	:	Epoch 1503 | loss: nan | val_loss: nan | Time: 6896.86 ms
[2022-04-01 21:07:18	                main:574]	:	INFO	:	Epoch 1504 | loss: nan | val_loss: nan | Time: 6934.41 ms
[2022-04-01 21:07:26	                main:574]	:	INFO	:	Epoch 1505 | loss: nan | val_loss: nan | Time: 7192.79 ms
[2022-04-01 21:07:33	                main:574]	:	INFO	:	Epoch 1506 | loss: nan | val_loss: nan | Time: 6912.47 ms
[2022-04-01 21:07:42	                main:574]	:	INFO	:	Epoch 1507 | loss: nan | val_loss: nan | Time: 9508.92 ms
[2022-04-01 21:07:51	                main:574]	:	INFO	:	Epoch 1508 | loss: nan | val_loss: nan | Time: 9228.24 ms
[2022-04-01 21:07:59	                main:574]	:	INFO	:	Epoch 1509 | loss: nan | val_loss: nan | Time: 7208.9 ms
[2022-04-01 21:08:06	                main:574]	:	INFO	:	Epoch 1510 | loss: nan | val_loss: nan | Time: 7093.51 ms
[2022-04-01 21:08:13	                main:574]	:	INFO	:	Epoch 1511 | loss: nan | val_loss: nan | Time: 7196.03 ms
[2022-04-01 21:08:20	                main:574]	:	INFO	:	Epoch 1512 | loss: nan | val_loss: nan | Time: 7176.79 ms
[2022-04-01 21:08:27	                main:574]	:	INFO	:	Epoch 1513 | loss: nan | val_loss: nan | Time: 6982.2 ms
[2022-04-01 21:08:34	                main:574]	:	INFO	:	Epoch 1514 | loss: nan | val_loss: nan | Time: 6657.1 ms
[2022-04-01 21:08:41	                main:574]	:	INFO	:	Epoch 1515 | loss: nan | val_loss: nan | Time: 7015.79 ms
[2022-04-01 21:08:48	                main:574]	:	INFO	:	Epoch 1516 | loss: nan | val_loss: nan | Time: 7185.6 ms
[2022-04-01 21:08:55	                main:574]	:	INFO	:	Epoch 1517 | loss: nan | val_loss: nan | Time: 6995.34 ms
[2022-04-01 21:09:02	                main:574]	:	INFO	:	Epoch 1518 | loss: nan | val_loss: nan | Time: 6841.71 ms
[2022-04-01 21:09:09	                main:574]	:	INFO	:	Epoch 1519 | loss: nan | val_loss: nan | Time: 7059.57 ms
[2022-04-01 21:09:16	                main:574]	:	INFO	:	Epoch 1520 | loss: nan | val_loss: nan | Time: 7411.1 ms
[2022-04-01 21:09:23	                main:574]	:	INFO	:	Epoch 1521 | loss: nan | val_loss: nan | Time: 7048.01 ms
[2022-04-01 21:09:31	                main:574]	:	INFO	:	Epoch 1522 | loss: nan | val_loss: nan | Time: 7931.56 ms
[2022-04-01 21:09:38	                main:574]	:	INFO	:	Epoch 1523 | loss: nan | val_loss: nan | Time: 6836.97 ms
[2022-04-01 21:09:45	                main:574]	:	INFO	:	Epoch 1524 | loss: nan | val_loss: nan | Time: 6849.83 ms
[2022-04-01 21:09:52	                main:574]	:	INFO	:	Epoch 1525 | loss: nan | val_loss: nan | Time: 6887.52 ms
[2022-04-01 21:09:59	                main:574]	:	INFO	:	Epoch 1526 | loss: nan | val_loss: nan | Time: 6953.2 ms
[2022-04-01 21:10:06	                main:574]	:	INFO	:	Epoch 1527 | loss: nan | val_loss: nan | Time: 6877.85 ms
[2022-04-01 21:10:13	                main:574]	:	INFO	:	Epoch 1528 | loss: nan | val_loss: nan | Time: 6960.86 ms
[2022-04-01 21:10:20	                main:574]	:	INFO	:	Epoch 1529 | loss: nan | val_loss: nan | Time: 6917.76 ms
[2022-04-01 21:10:26	                main:574]	:	INFO	:	Epoch 1530 | loss: nan | val_loss: nan | Time: 6915.77 ms
[2022-04-01 21:10:34	                main:574]	:	INFO	:	Epoch 1531 | loss: nan | val_loss: nan | Time: 7098.1 ms
[2022-04-01 21:10:40	                main:574]	:	INFO	:	Epoch 1532 | loss: nan | val_loss: nan | Time: 6848.65 ms
[2022-04-01 21:10:47	                main:574]	:	INFO	:	Epoch 1533 | loss: nan | val_loss: nan | Time: 6943.47 ms
[2022-04-01 21:10:54	                main:574]	:	INFO	:	Epoch 1534 | loss: nan | val_loss: nan | Time: 6893.8 ms
[2022-04-01 21:11:01	                main:574]	:	INFO	:	Epoch 1535 | loss: nan | val_loss: nan | Time: 7020.62 ms
[2022-04-01 21:11:08	                main:574]	:	INFO	:	Epoch 1536 | loss: nan | val_loss: nan | Time: 7067.51 ms
[2022-04-01 21:11:15	                main:574]	:	INFO	:	Epoch 1537 | loss: nan | val_loss: nan | Time: 7031.09 ms
[2022-04-01 21:11:22	                main:574]	:	INFO	:	Epoch 1538 | loss: nan | val_loss: nan | Time: 6927.52 ms
[2022-04-01 21:11:30	                main:574]	:	INFO	:	Epoch 1539 | loss: nan | val_loss: nan | Time: 7676.66 ms
[2022-04-01 21:11:37	                main:574]	:	INFO	:	Epoch 1540 | loss: nan | val_loss: nan | Time: 6933.95 ms
[2022-04-01 21:11:44	                main:574]	:	INFO	:	Epoch 1541 | loss: nan | val_loss: nan | Time: 6840.11 ms
[2022-04-01 21:11:51	                main:574]	:	INFO	:	Epoch 1542 | loss: nan | val_loss: nan | Time: 7067.48 ms
[2022-04-01 21:11:58	                main:574]	:	INFO	:	Epoch 1543 | loss: nan | val_loss: nan | Time: 6895.51 ms
[2022-04-01 21:12:05	                main:574]	:	INFO	:	Epoch 1544 | loss: nan | val_loss: nan | Time: 7079.47 ms
[2022-04-01 21:12:12	                main:574]	:	INFO	:	Epoch 1545 | loss: nan | val_loss: nan | Time: 6739.9 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: Quadro P4000)
[2022-04-01 22:41:16	                main:435]	:	INFO	:	Set logging level to 1
[2022-04-01 22:41:16	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-04-01 22:41:16	                main:444]	:	INFO	:	Resolving all filenames
[2022-04-01 22:41:16	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-01 22:41:16	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-01 22:41:16	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-01 22:41:16	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-01 22:41:16	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-01 22:41:16	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-04-01 22:41:16	                main:474]	:	INFO	:	Configuration: 
[2022-04-01 22:41:16	                main:475]	:	INFO	:	    Model type: GRU
[2022-04-01 22:41:16	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-04-01 22:41:16	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-04-01 22:41:16	                main:478]	:	INFO	:	    Batch Size: 128
[2022-04-01 22:41:16	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-04-01 22:41:16	                main:480]	:	INFO	:	    Patience: 10
[2022-04-01 22:41:16	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-04-01 22:41:16	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-04-01 22:41:16	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-04-01 22:41:16	                main:484]	:	INFO	:	    # Threads: 1
[2022-04-01 22:41:16	                main:486]	:	INFO	:	Preparing Dataset
[2022-04-01 22:41:16	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-01 22:41:17	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-01 22:41:19	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-04-01 22:41:19	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-01 22:41:19	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-01 22:41:19	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-04-01 22:41:19	                main:494]	:	INFO	:	Creating Model
[2022-04-01 22:41:19	                main:507]	:	INFO	:	Preparing config file
[2022-04-01 22:41:19	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-04-01 22:41:19	                main:512]	:	INFO	:	Loading config


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FF94672526C

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 04/01/22 22:41:19
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\2;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 000000009fd50000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000048c90000 0000000000211000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 0000000047c70000 00000000000c2000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 0000000046710000 000000000039b000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 0000000047ac0000 00000000001a6000 C:\WINDOWS\System32\USER32.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 00000000466e0000 0000000000026000 C:\WINDOWS\System32\win32u.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 00000000479d0000 0000000000029000 C:\WINDOWS\System32\GDI32.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 00000000460e0000 0000000000118000 C:\WINDOWS\System32\gdi32full.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 00000000462f0000 000000000009a000 C:\WINDOWS\System32\msvcp_win.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 0000000046500000 0000000000111000 C:\WINDOWS\System32\ucrtbase.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 0000000047a00000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 00000000485d0000 00000000000a5000 C:\WINDOWS\System32\msvcrt.dll (7.0.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.22581.1

ModLoad: 0000000048a90000 00000000000a6000 C:\WINDOWS\System32\sechost.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 0000000048970000 0000000000115000 C:\WINDOWS\System32\RPCRT4.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 000000003a1d0000 0000000000058000 C:\ProgramData\BOINC\slots\2\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000087880000 000000000abe7000 C:\ProgramData\BOINC\slots\2\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000027720000 000000000008e000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.30.30708.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\43\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.30.30708.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.30.30708.0

ModLoad: 000000003b500000 000000000022e000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 00000000473d0000 0000000000375000 C:\WINDOWS\System32\combase.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 0000000047270000 00000000000d7000 C:\WINDOWS\System32\OLEAUT32.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : oleaut32.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 000000003c2a0000 000000000001b000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.30.30708.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\43\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.30.30708.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.30.30708.0

ModLoad: 0000000008110000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.30.30708.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\43\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.30.30708.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.30.30708.0

ModLoad: 00000000247c0000 000000000020d000 C:\ProgramData\BOINC\slots\2\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 00000000e8720000 00000000002db000 C:\ProgramData\BOINC\slots\2\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000003a730000 0000000000040000 C:\ProgramData\BOINC\slots\2\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000092470000 0000000024b49000 C:\ProgramData\BOINC\slots\2\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000037840000 0000000000045000 C:\ProgramData\BOINC\slots\2\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000843c0000 00000000034b2000 C:\ProgramData\BOINC\slots\2\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000d37d0000 00000000030a5000 C:\ProgramData\BOINC\slots\2\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 000000003a5b0000 0000000000010000 C:\ProgramData\BOINC\slots\2\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 000000005fe70000 000000000919f000 C:\ProgramData\BOINC\slots\2\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 000000005c110000 0000000003d5b000 C:\ProgramData\BOINC\slots\2\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000b83c0000 0000000001eca000 C:\ProgramData\BOINC\slots\2\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 0000000069010000 000000001b3a4000 C:\ProgramData\BOINC\slots\2\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 0000000048590000 0000000000031000 C:\WINDOWS\System32\IMM32.DLL (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 0000000045150000 0000000000018000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 0000000043850000 0000000000036000 C:\WINDOWS\SYSTEM32\dxcore.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : DXCore.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 0000000046ba0000 0000000000474000 C:\WINDOWS\System32\Setupapi.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 0000000045df0000 000000000002c000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 0000000045da0000 000000000004f000 C:\WINDOWS\SYSTEM32\cfgmgr32.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 0000000046280000 0000000000068000 C:\WINDOWS\System32\WINTRUST.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 0000000046390000 0000000000163000 C:\WINDOWS\System32\CRYPT32.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 00000000459b0000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 0000000047da0000 00000000007e3000 C:\WINDOWS\System32\Shell32.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 0000000044130000 0000000000898000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 0000000043ff0000 000000000013d000 C:\WINDOWS\SYSTEM32\wintypes.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : WinTypes.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 00000000487a0000 00000000000f1000 C:\WINDOWS\System32\SHCORE.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 0000000046b20000 000000000005e000 C:\WINDOWS\System32\shlwapi.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 00000000ea0f0000 00000000002cc000 C:\WINDOWS\system32\nvcuda.dll (30.0.14.7239) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r470\r470_00\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 30.0.14.7239
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.4.153 driver
    Product Version       : 30.0.14.7239

ModLoad: 000000003ef40000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 000000005a920000 00000000017e8000 C:\WINDOWS\system32\DriverStore\FileRepository\nvdw.inf_amd64_a77a12569ba68c98\nvcuda64.dll (30.0.14.7239) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r470\r470_00\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 30.0.14.7239
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.4.153 driver
    Product Version       : 30.0.14.7239

ModLoad: 000000003f2c0000 0000000000032000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 000000003cf70000 0000000000158000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : drvstore.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 0000000045870000 0000000000045000 C:\WINDOWS\SYSTEM32\wldp.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 00000000458d0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 0000000043720000 00000000000ac000 C:\WINDOWS\system32\uxtheme.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : uxtheme.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 00000000200a0000 0000000000719000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.14.7239) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r470\r470_00\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 30.0.14.7239
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 30.0.14.7239

ModLoad: 0000000047830000 000000000019c000 C:\WINDOWS\System32\ole32.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : ole32.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1

ModLoad: 0000000046200000 000000000007b000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.22581.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.22581.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22581.1



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3621, Write: 307, Other 930

- I/O Transfers Counters -
Read: 6723451, Write: 6029, Other 30942

- Paged Pool Usage -
QuotaPagedPoolUsage: 3462160, QuotaPeakPagedPoolUsage: 3462160
QuotaNonPagedPoolUsage: 39792, QuotaPeakNonPagedPoolUsage: 39856

- Virtual Memory Usage -
VirtualSize: -1416613888, PeakVirtualSize: -822034432

- Pagefile Usage -
PagefileUsage: -1416613888, PeakPagefileUsage: -1416613888

- Working Set Size -
WorkingSetSize: 1154469888, PeakWorkingSetSize: 1154469888, PageFaultCount: 393060

*** Dump of thread ID 11332 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 7031250.000000, User Time: 18906250.000000, Wait Time: 10348328.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FF94672526C

- Registers -
rax=0000000000000000 rbx=00000000a00b4910 rcx=0000000001000000 rdx=0000000048cbf80a rsi=00000000a82e68e0 rdi=0000000019930520
r8=0000000000000001 r9=000000004d305c87 r10=00000000a82e60f0 r11=0000000000000000 r12=00000000a8f0ec00 r13=00000000a82e6af0
r14=00000000cce0bc00 r15=0000000000000000 rip=000000004672526c rsp=00000000a82e6780 rbp=00000000a82e6a70
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
a82e6850 9ffca884 00000040 0000004f a8f10200 c963ab60 KERNELBASE!RaiseException+0x0 
a82e68b0 9fd71ca6 00002fb0 00000000 c963bf00 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
a82e6960 9fd7593b 00000000 00000020 00000000 00000030 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
a82e6ab0 9fd71a78 00000000 00000000 a82e6de0 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
a82e6b80 9fd71cfc a82e6de0 00000000 00000080 a82e70b0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
a82e6c40 9fd7c4dd a82e70b0 a82e70b0 a82e70b0 a82e70b0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
a82e6f30 9fd6b2fe a82e7548 a82e70b0 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
a82ffcd0 9ffac6f8 eec6e620 00000000 00000000 eec86190 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
a82ffd10 47c86624 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
a82ffd40 48cda958 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
a82ffdc0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 7648 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 10348135.000000

- Registers -
rax=00000000000001e3 rbx=00000000ed29fc80 rcx=0000000000000090 rdx=00000000ed29f900 rsi=0000000000000000 rdi=00000000ed297890
r8=0000000000000008 r9=0000000000000040 r10=0000000000000580 r11=00000000ffffbfff r12=0000000000000000 r13=0000000000000001
r14=0000000000000000 r15=0000000000000000 rip=0000000048d379f4 rsp=00000000a83ffad8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
a83ffad0 48cb7550 ed29fc80 00000000 00000000 ed297890 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
a83ffdc0 47c86624 00000000 00000000 00000000 00000000 ntdll!RtlSetThreadWorkOnBehalfTicket+0x0 
a83ffdf0 48cda958 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
a83ffe70 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 500 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 156250.000000, Wait Time: 10348134.000000

- Registers -
rax=00000000000001e3 rbx=00000000ed2a77a0 rcx=0000000000000090 rdx=00000000ed2a7420 rsi=0000000000000000 rdi=00000000ed297890
r8=000000003ef450e0 r9=0000000000000000 r10=000000003ef400f0 r11=0000000000000000 r12=0000000000000000 r13=0000000000000001
r14=0000000000000000 r15=0000000000000000 rip=0000000048d379f4 rsp=00000000a84ff818 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
a84ff810 48cb7550 ed2a77a0 00000000 00000000 ed297890 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
a84ffb00 47c86624 00000000 00000000 00000000 00000000 ntdll!RtlSetThreadWorkOnBehalfTicket+0x0 
a84ffb30 48cda958 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
a84ffbb0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 19784 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 10348134.000000

- Registers -
rax=00000000000001e3 rbx=00000000ed2a9570 rcx=0000000000000090 rdx=00000000ed2a91f0 rsi=0000000000000000 rdi=00000000ed297890
r8=00000000a85ff370 r9=000000000000006c r10=000000000000006c r11=00000000a85ff180 r12=0000000000000000 r13=0000000000000001
r14=0000000000000000 r15=0000000000000000 rip=0000000048d379f4 rsp=00000000a85ffc08 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
a85ffc00 48cb7550 ed2a9570 00000000 00000000 ed297890 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
a85ffef0 47c86624 00000000 00000000 00000000 00000000 ntdll!RtlSetThreadWorkOnBehalfTicket+0x0 
a85fff20 48cda958 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
a85fffa0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 3832 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 10348324.000000

- Registers -
rax=0000000000000034 rbx=00000000a87ffe30 rcx=0000000000000000 rdx=00000000a87ffe30 rsi=00000000a80e5000 rdi=0000000000000000
r8=0000000000000006 r9=000000009fd50000 r10=00000000a87fe4aa r11=00000000a87fe4a9 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000048d34424 rsp=00000000a87ffd68 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
a87ffd60 48ced193 00000000 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0 
a87ffd90 4675e4ad 00000000 00000000 a87ffe30 00000000 ntdll!RtlDelayExecution+0x0 
a87ffe10 9fd8a07f 00000000 00000000 fff0bdc0 00000000 KERNELBASE!SleepEx+0x0 
a87ffe40 47c86624 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
a87ffe70 48cda958 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
a87ffef0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 20368 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 10348327.000000

- Registers -
rax=000000000000005b rbx=0000000000000006 rcx=0000000000000006 rdx=00000000a88ff890 rsi=0000000000000000 rdi=0000000000000006
r8=0000000000000001 r9=00000000eee3d200 r10=0000000000000000 r11=00000000a88ff800 r12=00000000a88ff890 r13=00000000a80da000
r14=00000000a88ff590 r15=0000000000000000 rip=0000000048d348f4 rsp=00000000a88ff548 rbp=00000000eee3d2e0
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
a88ff540 4676b459 00000000 00000000 00000000 00000000 ntdll!NtWaitForMultipleObjects+0x0 
a88ff820 4676b35e 5ae621b8 eef1ec00 00000006 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
a88ff860 5aaf1324 eee3eae0 00000000 eee3b8a0 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
a88ffaa0 5ab980dd 00000000 eee3d2e0 00000000 00000000 nvcuda64!+0x0 
a88ffb50 5aaf0cf3 78940876 77419635 ef47fbf0 00000000 nvcuda64!cuProfilerStop+0x0 
a88ffb80 5ae26cf4 ef47fbf0 00000000 00000000 00000000 nvcuda64!+0x0 
a88ffbb0 47c86624 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
a88ffbe0 48cda958 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
a88ffc60 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 19688 (state: Waiting): ***

- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 10348308.000000

- Registers -
rax=00000000000001e0 rbx=0000000000000000 rcx=00000000ef121f90 rdx=00000000a89ff6c8 rsi=0000000000000102 rdi=0000000000000000
r8=0000000000000000 r9=0000000000000000 r10=00000000ef126740 r11=00000000a89ff650 r12=00000000a89ff6c8 r13=0000000000000000
r14=00000000ef126740 r15=00000000ef121f90 rip=0000000048d37994 rsp=00000000a89ff5f8 rbp=00000000a89ff650
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
a89ff5f0 48cfc144 00000102 00000102 00000000 a89ff620 ntdll!ZwWaitForAlertByThreadId+0x0 
a89ff670 46799db9 00000000 ef123f20 00000000 000002d4 ntdll!RtlSleepConditionVariableCS+0x0 
a89ff6a0 5aa5f12c ef123f20 00000000 ef123f20 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0 
a89ff700 5aaf0cf3 00000002 787156da 00000000 00000000 nvcuda64!+0x0 
a89ff730 5ae26cf4 ef47f620 00000000 00000000 00000000 nvcuda64!+0x0 
a89ff760 47c86624 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
a89ff790 48cda958 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
a89ff810 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)