Task 13544817

Name ParityModified-1647042263-22264-1-0_1
Workunit 10161220
Created 22 Mar 2022, 17:21:50 UTC
Sent 22 Mar 2022, 20:28:39 UTC
Report deadline 30 Mar 2022, 20:28:39 UTC
Received 23 Mar 2022, 16:34:11 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 15372
Run time 2 hours 22 min 6 sec
CPU time 2 hours 21 min 3 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 4,115.87 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.63 GB
Peak swap size 3.60 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
-23 17:01:46	                main:574]	:	INFO	:	Epoch 1349 | loss: nan | val_loss: nan | Time: 5312.43 ms
[2022-03-23 17:01:51	                main:574]	:	INFO	:	Epoch 1350 | loss: nan | val_loss: nan | Time: 5359.15 ms
[2022-03-23 17:01:56	                main:574]	:	INFO	:	Epoch 1351 | loss: nan | val_loss: nan | Time: 5331.59 ms
[2022-03-23 17:02:02	                main:574]	:	INFO	:	Epoch 1352 | loss: nan | val_loss: nan | Time: 5300.98 ms
[2022-03-23 17:02:07	                main:574]	:	INFO	:	Epoch 1353 | loss: nan | val_loss: nan | Time: 5303.87 ms
[2022-03-23 17:02:12	                main:574]	:	INFO	:	Epoch 1354 | loss: nan | val_loss: nan | Time: 5331.39 ms
[2022-03-23 17:02:18	                main:574]	:	INFO	:	Epoch 1355 | loss: nan | val_loss: nan | Time: 5309.09 ms
[2022-03-23 17:02:23	                main:574]	:	INFO	:	Epoch 1356 | loss: nan | val_loss: nan | Time: 5340.36 ms
[2022-03-23 17:02:28	                main:574]	:	INFO	:	Epoch 1357 | loss: nan | val_loss: nan | Time: 5357.46 ms
[2022-03-23 17:02:34	                main:574]	:	INFO	:	Epoch 1358 | loss: nan | val_loss: nan | Time: 5329.48 ms
[2022-03-23 17:02:39	                main:574]	:	INFO	:	Epoch 1359 | loss: nan | val_loss: nan | Time: 5379.32 ms
[2022-03-23 17:02:45	                main:574]	:	INFO	:	Epoch 1360 | loss: nan | val_loss: nan | Time: 5344.9 ms
[2022-03-23 17:02:50	                main:574]	:	INFO	:	Epoch 1361 | loss: nan | val_loss: nan | Time: 5317.23 ms
[2022-03-23 17:02:55	                main:574]	:	INFO	:	Epoch 1362 | loss: nan | val_loss: nan | Time: 5358.12 ms
[2022-03-23 17:03:01	                main:574]	:	INFO	:	Epoch 1363 | loss: nan | val_loss: nan | Time: 5340.07 ms
[2022-03-23 17:03:06	                main:574]	:	INFO	:	Epoch 1364 | loss: nan | val_loss: nan | Time: 5319.3 ms
[2022-03-23 17:03:11	                main:574]	:	INFO	:	Epoch 1365 | loss: nan | val_loss: nan | Time: 5363.47 ms
[2022-03-23 17:03:17	                main:574]	:	INFO	:	Epoch 1366 | loss: nan | val_loss: nan | Time: 5328.01 ms
[2022-03-23 17:03:22	                main:574]	:	INFO	:	Epoch 1367 | loss: nan | val_loss: nan | Time: 5325.35 ms
[2022-03-23 17:03:27	                main:574]	:	INFO	:	Epoch 1368 | loss: nan | val_loss: nan | Time: 5312.04 ms
[2022-03-23 17:03:33	                main:574]	:	INFO	:	Epoch 1369 | loss: nan | val_loss: nan | Time: 5332.49 ms
[2022-03-23 17:03:38	                main:574]	:	INFO	:	Epoch 1370 | loss: nan | val_loss: nan | Time: 5335.84 ms
[2022-03-23 17:03:43	                main:574]	:	INFO	:	Epoch 1371 | loss: nan | val_loss: nan | Time: 5345.44 ms
[2022-03-23 17:03:49	                main:574]	:	INFO	:	Epoch 1372 | loss: nan | val_loss: nan | Time: 5352.23 ms
[2022-03-23 17:03:54	                main:574]	:	INFO	:	Epoch 1373 | loss: nan | val_loss: nan | Time: 5327.7 ms
[2022-03-23 17:03:59	                main:574]	:	INFO	:	Epoch 1374 | loss: nan | val_loss: nan | Time: 5329.74 ms
[2022-03-23 17:04:05	                main:574]	:	INFO	:	Epoch 1375 | loss: nan | val_loss: nan | Time: 5373.22 ms
[2022-03-23 17:04:10	                main:574]	:	INFO	:	Epoch 1376 | loss: nan | val_loss: nan | Time: 5328.55 ms
[2022-03-23 17:04:15	                main:574]	:	INFO	:	Epoch 1377 | loss: nan | val_loss: nan | Time: 5349.5 ms
[2022-03-23 17:04:21	                main:574]	:	INFO	:	Epoch 1378 | loss: nan | val_loss: nan | Time: 5319.16 ms
[2022-03-23 17:04:26	                main:574]	:	INFO	:	Epoch 1379 | loss: nan | val_loss: nan | Time: 5310.98 ms
[2022-03-23 17:04:31	                main:574]	:	INFO	:	Epoch 1380 | loss: nan | val_loss: nan | Time: 5342.05 ms
[2022-03-23 17:04:37	                main:574]	:	INFO	:	Epoch 1381 | loss: nan | val_loss: nan | Time: 5334.21 ms
[2022-03-23 17:04:42	                main:574]	:	INFO	:	Epoch 1382 | loss: nan | val_loss: nan | Time: 5317.02 ms
[2022-03-23 17:04:47	                main:574]	:	INFO	:	Epoch 1383 | loss: nan | val_loss: nan | Time: 5354.21 ms
[2022-03-23 17:04:53	                main:574]	:	INFO	:	Epoch 1384 | loss: nan | val_loss: nan | Time: 5330.36 ms
[2022-03-23 17:04:58	                main:574]	:	INFO	:	Epoch 1385 | loss: nan | val_loss: nan | Time: 5335.2 ms
[2022-03-23 17:05:03	                main:574]	:	INFO	:	Epoch 1386 | loss: nan | val_loss: nan | Time: 5340.86 ms
[2022-03-23 17:05:09	                main:574]	:	INFO	:	Epoch 1387 | loss: nan | val_loss: nan | Time: 5362.02 ms
[2022-03-23 17:05:14	                main:574]	:	INFO	:	Epoch 1388 | loss: nan | val_loss: nan | Time: 5341.89 ms
[2022-03-23 17:05:20	                main:574]	:	INFO	:	Epoch 1389 | loss: nan | val_loss: nan | Time: 5327.83 ms
[2022-03-23 17:05:25	                main:574]	:	INFO	:	Epoch 1390 | loss: nan | val_loss: nan | Time: 5319.76 ms
[2022-03-23 17:05:30	                main:574]	:	INFO	:	Epoch 1391 | loss: nan | val_loss: nan | Time: 5291.71 ms
[2022-03-23 17:05:35	                main:574]	:	INFO	:	Epoch 1392 | loss: nan | val_loss: nan | Time: 5322.01 ms
[2022-03-23 17:05:41	                main:574]	:	INFO	:	Epoch 1393 | loss: nan | val_loss: nan | Time: 5350.47 ms
[2022-03-23 17:05:46	                main:574]	:	INFO	:	Epoch 1394 | loss: nan | val_loss: nan | Time: 5317.01 ms
[2022-03-23 17:05:51	                main:574]	:	INFO	:	Epoch 1395 | loss: nan | val_loss: nan | Time: 5305.89 ms
[2022-03-23 17:05:57	                main:574]	:	INFO	:	Epoch 1396 | loss: nan | val_loss: nan | Time: 5318.98 ms
[2022-03-23 17:06:02	                main:574]	:	INFO	:	Epoch 1397 | loss: nan | val_loss: nan | Time: 5349.8 ms
[2022-03-23 17:06:07	                main:574]	:	INFO	:	Epoch 1398 | loss: nan | val_loss: nan | Time: 5321.87 ms
[2022-03-23 17:06:13	                main:574]	:	INFO	:	Epoch 1399 | loss: nan | val_loss: nan | Time: 5294.52 ms
[2022-03-23 17:06:18	                main:574]	:	INFO	:	Epoch 1400 | loss: nan | val_loss: nan | Time: 5325.97 ms
[2022-03-23 17:06:23	                main:574]	:	INFO	:	Epoch 1401 | loss: nan | val_loss: nan | Time: 5340.27 ms
[2022-03-23 17:06:29	                main:574]	:	INFO	:	Epoch 1402 | loss: nan | val_loss: nan | Time: 5310.88 ms
[2022-03-23 17:06:34	                main:574]	:	INFO	:	Epoch 1403 | loss: nan | val_loss: nan | Time: 5335.55 ms
[2022-03-23 17:06:39	                main:574]	:	INFO	:	Epoch 1404 | loss: nan | val_loss: nan | Time: 5329.35 ms
[2022-03-23 17:06:45	                main:574]	:	INFO	:	Epoch 1405 | loss: nan | val_loss: nan | Time: 5356.81 ms
[2022-03-23 17:06:50	                main:574]	:	INFO	:	Epoch 1406 | loss: nan | val_loss: nan | Time: 5322.66 ms
[2022-03-23 17:06:56	                main:574]	:	INFO	:	Epoch 1407 | loss: nan | val_loss: nan | Time: 5349.46 ms
[2022-03-23 17:07:01	                main:574]	:	INFO	:	Epoch 1408 | loss: nan | val_loss: nan | Time: 5344.87 ms
[2022-03-23 17:07:06	                main:574]	:	INFO	:	Epoch 1409 | loss: nan | val_loss: nan | Time: 5328.04 ms
[2022-03-23 17:07:12	                main:574]	:	INFO	:	Epoch 1410 | loss: nan | val_loss: nan | Time: 5320.54 ms
[2022-03-23 17:07:17	                main:574]	:	INFO	:	Epoch 1411 | loss: nan | val_loss: nan | Time: 5347.68 ms
[2022-03-23 17:07:22	                main:574]	:	INFO	:	Epoch 1412 | loss: nan | val_loss: nan | Time: 5319.15 ms
[2022-03-23 17:07:28	                main:574]	:	INFO	:	Epoch 1413 | loss: nan | val_loss: nan | Time: 5358.3 ms
[2022-03-23 17:07:33	                main:574]	:	INFO	:	Epoch 1414 | loss: nan | val_loss: nan | Time: 5335.8 ms
[2022-03-23 17:07:38	                main:574]	:	INFO	:	Epoch 1415 | loss: nan | val_loss: nan | Time: 5299.16 ms
[2022-03-23 17:07:44	                main:574]	:	INFO	:	Epoch 1416 | loss: nan | val_loss: nan | Time: 5324.12 ms
[2022-03-23 17:07:49	                main:574]	:	INFO	:	Epoch 1417 | loss: nan | val_loss: nan | Time: 5308.25 ms
[2022-03-23 17:07:54	                main:574]	:	INFO	:	Epoch 1418 | loss: nan | val_loss: nan | Time: 5324.44 ms
[2022-03-23 17:08:00	                main:574]	:	INFO	:	Epoch 1419 | loss: nan | val_loss: nan | Time: 5343.6 ms
[2022-03-23 17:08:05	                main:574]	:	INFO	:	Epoch 1420 | loss: nan | val_loss: nan | Time: 5348.1 ms
[2022-03-23 17:08:10	                main:574]	:	INFO	:	Epoch 1421 | loss: nan | val_loss: nan | Time: 5342.54 ms
[2022-03-23 17:08:16	                main:574]	:	INFO	:	Epoch 1422 | loss: nan | val_loss: nan | Time: 5326.6 ms
[2022-03-23 17:08:21	                main:574]	:	INFO	:	Epoch 1423 | loss: nan | val_loss: nan | Time: 5368.72 ms
[2022-03-23 17:08:26	                main:574]	:	INFO	:	Epoch 1424 | loss: nan | val_loss: nan | Time: 5333.5 ms
[2022-03-23 17:08:32	                main:574]	:	INFO	:	Epoch 1425 | loss: nan | val_loss: nan | Time: 5369.72 ms
[2022-03-23 17:08:37	                main:574]	:	INFO	:	Epoch 1426 | loss: nan | val_loss: nan | Time: 5333.9 ms
[2022-03-23 17:08:42	                main:574]	:	INFO	:	Epoch 1427 | loss: nan | val_loss: nan | Time: 5330.73 ms
[2022-03-23 17:08:48	                main:574]	:	INFO	:	Epoch 1428 | loss: nan | val_loss: nan | Time: 5316.63 ms
[2022-03-23 17:08:53	                main:574]	:	INFO	:	Epoch 1429 | loss: nan | val_loss: nan | Time: 5306.48 ms
[2022-03-23 17:08:58	                main:574]	:	INFO	:	Epoch 1430 | loss: nan | val_loss: nan | Time: 5327.26 ms
[2022-03-23 17:09:04	                main:574]	:	INFO	:	Epoch 1431 | loss: nan | val_loss: nan | Time: 5344.48 ms
[2022-03-23 17:09:09	                main:574]	:	INFO	:	Epoch 1432 | loss: nan | val_loss: nan | Time: 5330.38 ms
[2022-03-23 17:09:14	                main:574]	:	INFO	:	Epoch 1433 | loss: nan | val_loss: nan | Time: 5317.75 ms
[2022-03-23 17:09:20	                main:574]	:	INFO	:	Epoch 1434 | loss: nan | val_loss: nan | Time: 5370.27 ms
[2022-03-23 17:09:25	                main:574]	:	INFO	:	Epoch 1435 | loss: nan | val_loss: nan | Time: 5354.36 ms
[2022-03-23 17:09:30	                main:574]	:	INFO	:	Epoch 1436 | loss: nan | val_loss: nan | Time: 5347.21 ms
[2022-03-23 17:09:36	                main:574]	:	INFO	:	Epoch 1437 | loss: nan | val_loss: nan | Time: 5345.14 ms
[2022-03-23 17:09:41	                main:574]	:	INFO	:	Epoch 1438 | loss: nan | val_loss: nan | Time: 5354.48 ms
[2022-03-23 17:09:47	                main:574]	:	INFO	:	Epoch 1439 | loss: nan | val_loss: nan | Time: 5345.66 ms
[2022-03-23 17:09:52	                main:574]	:	INFO	:	Epoch 1440 | loss: nan | val_loss: nan | Time: 5321.78 ms
[2022-03-23 17:09:57	                main:574]	:	INFO	:	Epoch 1441 | loss: nan | val_loss: nan | Time: 5296.4 ms
[2022-03-23 17:10:02	                main:574]	:	INFO	:	Epoch 1442 | loss: nan | val_loss: nan | Time: 5331.67 ms
[2022-03-23 17:10:08	                main:574]	:	INFO	:	Epoch 1443 | loss: nan | val_loss: nan | Time: 5304.71 ms
[2022-03-23 17:10:13	                main:574]	:	INFO	:	Epoch 1444 | loss: nan | val_loss: nan | Time: 5351.62 ms
[2022-03-23 17:10:19	                main:574]	:	INFO	:	Epoch 1445 | loss: nan | val_loss: nan | Time: 5336.45 ms
[2022-03-23 17:10:24	                main:574]	:	INFO	:	Epoch 1446 | loss: nan | val_loss: nan | Time: 5384.4 ms
[2022-03-23 17:10:29	                main:574]	:	INFO	:	Epoch 1447 | loss: nan | val_loss: nan | Time: 5335.58 ms
[2022-03-23 17:10:35	                main:574]	:	INFO	:	Epoch 1448 | loss: nan | val_loss: nan | Time: 5342.09 ms
[2022-03-23 17:10:40	                main:574]	:	INFO	:	Epoch 1449 | loss: nan | val_loss: nan | Time: 5352.46 ms
[2022-03-23 17:10:45	                main:574]	:	INFO	:	Epoch 1450 | loss: nan | val_loss: nan | Time: 5354.12 ms
[2022-03-23 17:10:51	                main:574]	:	INFO	:	Epoch 1451 | loss: nan | val_loss: nan | Time: 5330.53 ms
[2022-03-23 17:10:56	                main:574]	:	INFO	:	Epoch 1452 | loss: nan | val_loss: nan | Time: 5333.12 ms
[2022-03-23 17:11:01	                main:574]	:	INFO	:	Epoch 1453 | loss: nan | val_loss: nan | Time: 5325.79 ms
[2022-03-23 17:11:07	                main:574]	:	INFO	:	Epoch 1454 | loss: nan | val_loss: nan | Time: 5337.71 ms
[2022-03-23 17:11:12	                main:574]	:	INFO	:	Epoch 1455 | loss: nan | val_loss: nan | Time: 5329.84 ms
[2022-03-23 17:11:17	                main:574]	:	INFO	:	Epoch 1456 | loss: nan | val_loss: nan | Time: 5312.27 ms
[2022-03-23 17:11:23	                main:574]	:	INFO	:	Epoch 1457 | loss: nan | val_loss: nan | Time: 5316.8 ms
[2022-03-23 17:11:28	                main:574]	:	INFO	:	Epoch 1458 | loss: nan | val_loss: nan | Time: 5350.2 ms
[2022-03-23 17:11:33	                main:574]	:	INFO	:	Epoch 1459 | loss: nan | val_loss: nan | Time: 5330.16 ms
[2022-03-23 17:11:39	                main:574]	:	INFO	:	Epoch 1460 | loss: nan | val_loss: nan | Time: 5365.22 ms
[2022-03-23 17:11:44	                main:574]	:	INFO	:	Epoch 1461 | loss: nan | val_loss: nan | Time: 5353.57 ms
[2022-03-23 17:11:49	                main:574]	:	INFO	:	Epoch 1462 | loss: nan | val_loss: nan | Time: 5317.64 ms
[2022-03-23 17:11:55	                main:574]	:	INFO	:	Epoch 1463 | loss: nan | val_loss: nan | Time: 5358.83 ms
[2022-03-23 17:12:00	                main:574]	:	INFO	:	Epoch 1464 | loss: nan | val_loss: nan | Time: 5334.62 ms
[2022-03-23 17:12:05	                main:574]	:	INFO	:	Epoch 1465 | loss: nan | val_loss: nan | Time: 5313.3 ms
[2022-03-23 17:12:11	                main:574]	:	INFO	:	Epoch 1466 | loss: nan | val_loss: nan | Time: 5329.16 ms
[2022-03-23 17:12:16	                main:574]	:	INFO	:	Epoch 1467 | loss: nan | val_loss: nan | Time: 5348.09 ms
[2022-03-23 17:12:21	                main:574]	:	INFO	:	Epoch 1468 | loss: nan | val_loss: nan | Time: 5310.29 ms
[2022-03-23 17:12:27	                main:574]	:	INFO	:	Epoch 1469 | loss: nan | val_loss: nan | Time: 5336.2 ms
[2022-03-23 17:12:32	                main:574]	:	INFO	:	Epoch 1470 | loss: nan | val_loss: nan | Time: 5346.53 ms
[2022-03-23 17:12:37	                main:574]	:	INFO	:	Epoch 1471 | loss: nan | val_loss: nan | Time: 5333.77 ms
[2022-03-23 17:12:43	                main:574]	:	INFO	:	Epoch 1472 | loss: nan | val_loss: nan | Time: 5342.3 ms
[2022-03-23 17:12:48	                main:574]	:	INFO	:	Epoch 1473 | loss: nan | val_loss: nan | Time: 5323.52 ms
[2022-03-23 17:12:54	                main:574]	:	INFO	:	Epoch 1474 | loss: nan | val_loss: nan | Time: 5336.09 ms
[2022-03-23 17:12:59	                main:574]	:	INFO	:	Epoch 1475 | loss: nan | val_loss: nan | Time: 5348.44 ms
[2022-03-23 17:13:04	                main:574]	:	INFO	:	Epoch 1476 | loss: nan | val_loss: nan | Time: 5309.78 ms
[2022-03-23 17:13:10	                main:574]	:	INFO	:	Epoch 1477 | loss: nan | val_loss: nan | Time: 5349.33 ms
[2022-03-23 17:13:15	                main:574]	:	INFO	:	Epoch 1478 | loss: nan | val_loss: nan | Time: 5373.84 ms
[2022-03-23 17:13:20	                main:574]	:	INFO	:	Epoch 1479 | loss: nan | val_loss: nan | Time: 5318.16 ms
[2022-03-23 17:13:26	                main:574]	:	INFO	:	Epoch 1480 | loss: nan | val_loss: nan | Time: 5344.03 ms
[2022-03-23 17:13:31	                main:574]	:	INFO	:	Epoch 1481 | loss: nan | val_loss: nan | Time: 5322.7 ms
[2022-03-23 17:13:36	                main:574]	:	INFO	:	Epoch 1482 | loss: nan | val_loss: nan | Time: 5329.7 ms
[2022-03-23 17:13:42	                main:574]	:	INFO	:	Epoch 1483 | loss: nan | val_loss: nan | Time: 5345.08 ms
[2022-03-23 17:13:47	                main:574]	:	INFO	:	Epoch 1484 | loss: nan | val_loss: nan | Time: 5356.89 ms
[2022-03-23 17:13:52	                main:574]	:	INFO	:	Epoch 1485 | loss: nan | val_loss: nan | Time: 5331.64 ms
[2022-03-23 17:13:58	                main:574]	:	INFO	:	Epoch 1486 | loss: nan | val_loss: nan | Time: 5367.62 ms
[2022-03-23 17:14:03	                main:574]	:	INFO	:	Epoch 1487 | loss: nan | val_loss: nan | Time: 5347.03 ms
[2022-03-23 17:14:08	                main:574]	:	INFO	:	Epoch 1488 | loss: nan | val_loss: nan | Time: 5386.17 ms
[2022-03-23 17:14:14	                main:574]	:	INFO	:	Epoch 1489 | loss: nan | val_loss: nan | Time: 5368.78 ms
[2022-03-23 17:14:19	                main:574]	:	INFO	:	Epoch 1490 | loss: nan | val_loss: nan | Time: 5367.55 ms
[2022-03-23 17:14:25	                main:574]	:	INFO	:	Epoch 1491 | loss: nan | val_loss: nan | Time: 5345.31 ms
[2022-03-23 17:14:30	                main:574]	:	INFO	:	Epoch 1492 | loss: nan | val_loss: nan | Time: 5375.12 ms
[2022-03-23 17:14:35	                main:574]	:	INFO	:	Epoch 1493 | loss: nan | val_loss: nan | Time: 5345.12 ms
[2022-03-23 17:14:41	                main:574]	:	INFO	:	Epoch 1494 | loss: nan | val_loss: nan | Time: 5379.3 ms
[2022-03-23 17:14:46	                main:574]	:	INFO	:	Epoch 1495 | loss: nan | val_loss: nan | Time: 5363.52 ms
[2022-03-23 17:14:51	                main:574]	:	INFO	:	Epoch 1496 | loss: nan | val_loss: nan | Time: 5361.47 ms
[2022-03-23 17:14:57	                main:574]	:	INFO	:	Epoch 1497 | loss: nan | val_loss: nan | Time: 5363.29 ms
[2022-03-23 17:15:02	                main:574]	:	INFO	:	Epoch 1498 | loss: nan | val_loss: nan | Time: 5373.04 ms
[2022-03-23 17:15:08	                main:574]	:	INFO	:	Epoch 1499 | loss: nan | val_loss: nan | Time: 5352.1 ms
[2022-03-23 17:15:13	                main:574]	:	INFO	:	Epoch 1500 | loss: nan | val_loss: nan | Time: 5396.45 ms
[2022-03-23 17:15:18	                main:574]	:	INFO	:	Epoch 1501 | loss: nan | val_loss: nan | Time: 5385.89 ms
[2022-03-23 17:15:24	                main:574]	:	INFO	:	Epoch 1502 | loss: nan | val_loss: nan | Time: 5329.57 ms
[2022-03-23 17:15:29	                main:574]	:	INFO	:	Epoch 1503 | loss: nan | val_loss: nan | Time: 5352.1 ms
[2022-03-23 17:15:34	                main:574]	:	INFO	:	Epoch 1504 | loss: nan | val_loss: nan | Time: 5351.51 ms
[2022-03-23 17:15:40	                main:574]	:	INFO	:	Epoch 1505 | loss: nan | val_loss: nan | Time: 5361.01 ms
[2022-03-23 17:15:45	                main:574]	:	INFO	:	Epoch 1506 | loss: nan | val_loss: nan | Time: 5391.22 ms
[2022-03-23 17:15:51	                main:574]	:	INFO	:	Epoch 1507 | loss: nan | val_loss: nan | Time: 5375.07 ms
[2022-03-23 17:15:56	                main:574]	:	INFO	:	Epoch 1508 | loss: nan | val_loss: nan | Time: 5368.48 ms
[2022-03-23 17:16:01	                main:574]	:	INFO	:	Epoch 1509 | loss: nan | val_loss: nan | Time: 5370.95 ms
[2022-03-23 17:16:07	                main:574]	:	INFO	:	Epoch 1510 | loss: nan | val_loss: nan | Time: 5376.88 ms
[2022-03-23 17:16:12	                main:574]	:	INFO	:	Epoch 1511 | loss: nan | val_loss: nan | Time: 5379.26 ms
[2022-03-23 17:16:17	                main:574]	:	INFO	:	Epoch 1512 | loss: nan | val_loss: nan | Time: 5327.79 ms
[2022-03-23 17:16:23	                main:574]	:	INFO	:	Epoch 1513 | loss: nan | val_loss: nan | Time: 5321.49 ms
[2022-03-23 17:16:28	                main:574]	:	INFO	:	Epoch 1514 | loss: nan | val_loss: nan | Time: 5332.83 ms
[2022-03-23 17:16:33	                main:574]	:	INFO	:	Epoch 1515 | loss: nan | val_loss: nan | Time: 5357.59 ms
[2022-03-23 17:16:39	                main:574]	:	INFO	:	Epoch 1516 | loss: nan | val_loss: nan | Time: 5358.91 ms
[2022-03-23 17:16:44	                main:574]	:	INFO	:	Epoch 1517 | loss: nan | val_loss: nan | Time: 5351.83 ms
[2022-03-23 17:16:50	                main:574]	:	INFO	:	Epoch 1518 | loss: nan | val_loss: nan | Time: 5355.75 ms
[2022-03-23 17:16:55	                main:574]	:	INFO	:	Epoch 1519 | loss: nan | val_loss: nan | Time: 5350.38 ms
[2022-03-23 17:17:00	                main:574]	:	INFO	:	Epoch 1520 | loss: nan | val_loss: nan | Time: 5368.94 ms
[2022-03-23 17:17:06	                main:574]	:	INFO	:	Epoch 1521 | loss: nan | val_loss: nan | Time: 5365.99 ms
[2022-03-23 17:17:11	                main:574]	:	INFO	:	Epoch 1522 | loss: nan | val_loss: nan | Time: 5324.76 ms
[2022-03-23 17:17:16	                main:574]	:	INFO	:	Epoch 1523 | loss: nan | val_loss: nan | Time: 5358.38 ms
[2022-03-23 17:17:22	                main:574]	:	INFO	:	Epoch 1524 | loss: nan | val_loss: nan | Time: 5346.14 ms
[2022-03-23 17:17:27	                main:574]	:	INFO	:	Epoch 1525 | loss: nan | val_loss: nan | Time: 5360.65 ms
[2022-03-23 17:17:32	                main:574]	:	INFO	:	Epoch 1526 | loss: nan | val_loss: nan | Time: 5372.93 ms
[2022-03-23 17:17:38	                main:574]	:	INFO	:	Epoch 1527 | loss: nan | val_loss: nan | Time: 5397.42 ms
[2022-03-23 17:17:43	                main:574]	:	INFO	:	Epoch 1528 | loss: nan | val_loss: nan | Time: 5339.15 ms
[2022-03-23 17:17:49	                main:574]	:	INFO	:	Epoch 1529 | loss: nan | val_loss: nan | Time: 5345.75 ms
[2022-03-23 17:17:54	                main:574]	:	INFO	:	Epoch 1530 | loss: nan | val_loss: nan | Time: 5366.22 ms
[2022-03-23 17:17:59	                main:574]	:	INFO	:	Epoch 1531 | loss: nan | val_loss: nan | Time: 5339.53 ms
[2022-03-23 17:18:05	                main:574]	:	INFO	:	Epoch 1532 | loss: nan | val_loss: nan | Time: 5378.11 ms
[2022-03-23 17:18:10	                main:574]	:	INFO	:	Epoch 1533 | loss: nan | val_loss: nan | Time: 5352.46 ms
[2022-03-23 17:18:15	                main:574]	:	INFO	:	Epoch 1534 | loss: nan | val_loss: nan | Time: 5369.8 ms
[2022-03-23 17:18:21	                main:574]	:	INFO	:	Epoch 1535 | loss: nan | val_loss: nan | Time: 5372 ms
[2022-03-23 17:18:26	                main:574]	:	INFO	:	Epoch 1536 | loss: nan | val_loss: nan | Time: 5360.57 ms
[2022-03-23 17:18:32	                main:574]	:	INFO	:	Epoch 1537 | loss: nan | val_loss: nan | Time: 5365.49 ms
[2022-03-23 17:18:37	                main:574]	:	INFO	:	Epoch 1538 | loss: nan | val_loss: nan | Time: 5353.24 ms
[2022-03-23 17:18:42	                main:574]	:	INFO	:	Epoch 1539 | loss: nan | val_loss: nan | Time: 5331.31 ms
[2022-03-23 17:18:48	                main:574]	:	INFO	:	Epoch 1540 | loss: nan | val_loss: nan | Time: 5353.55 ms
[2022-03-23 17:18:53	                main:574]	:	INFO	:	Epoch 1541 | loss: nan | val_loss: nan | Time: 5354.94 ms
[2022-03-23 17:18:58	                main:574]	:	INFO	:	Epoch 1542 | loss: nan | val_loss: nan | Time: 5326.27 ms
[2022-03-23 17:19:04	                main:574]	:	INFO	:	Epoch 1543 | loss: nan | val_loss: nan | Time: 5320.24 ms
[2022-03-23 17:19:09	                main:574]	:	INFO	:	Epoch 1544 | loss: nan | val_loss: nan | Time: 5342.83 ms
[2022-03-23 17:19:14	                main:574]	:	INFO	:	Epoch 1545 | loss: nan | val_loss: nan | Time: 5350.22 ms
[2022-03-23 17:19:20	                main:574]	:	INFO	:	Epoch 1546 | loss: nan | val_loss: nan | Time: 5342.15 ms
[2022-03-23 17:19:25	                main:574]	:	INFO	:	Epoch 1547 | loss: nan | val_loss: nan | Time: 5334.29 ms
[2022-03-23 17:19:30	                main:574]	:	INFO	:	Epoch 1548 | loss: nan | val_loss: nan | Time: 5325.53 ms
[2022-03-23 17:19:36	                main:574]	:	INFO	:	Epoch 1549 | loss: nan | val_loss: nan | Time: 5322.5 ms
[2022-03-23 17:19:41	                main:574]	:	INFO	:	Epoch 1550 | loss: nan | val_loss: nan | Time: 5323.81 ms
[2022-03-23 17:19:46	                main:574]	:	INFO	:	Epoch 1551 | loss: nan | val_loss: nan | Time: 5347.72 ms
[2022-03-23 17:19:52	                main:574]	:	INFO	:	Epoch 1552 | loss: nan | val_loss: nan | Time: 5347.69 ms
[2022-03-23 17:19:57	                main:574]	:	INFO	:	Epoch 1553 | loss: nan | val_loss: nan | Time: 5331.98 ms
[2022-03-23 17:20:02	                main:574]	:	INFO	:	Epoch 1554 | loss: nan | val_loss: nan | Time: 5347.03 ms
[2022-03-23 17:20:08	                main:574]	:	INFO	:	Epoch 1555 | loss: nan | val_loss: nan | Time: 5338.78 ms
[2022-03-23 17:20:13	                main:574]	:	INFO	:	Epoch 1556 | loss: nan | val_loss: nan | Time: 5353.22 ms
[2022-03-23 17:20:18	                main:574]	:	INFO	:	Epoch 1557 | loss: nan | val_loss: nan | Time: 5339.77 ms
[2022-03-23 17:20:24	                main:574]	:	INFO	:	Epoch 1558 | loss: nan | val_loss: nan | Time: 5328.9 ms
[2022-03-23 17:20:29	                main:574]	:	INFO	:	Epoch 1559 | loss: nan | val_loss: nan | Time: 5344.14 ms
[2022-03-23 17:20:34	                main:574]	:	INFO	:	Epoch 1560 | loss: nan | val_loss: nan | Time: 5331.44 ms
[2022-03-23 17:20:40	                main:574]	:	INFO	:	Epoch 1561 | loss: nan | val_loss: nan | Time: 5318.02 ms
[2022-03-23 17:20:45	                main:574]	:	INFO	:	Epoch 1562 | loss: nan | val_loss: nan | Time: 5339.83 ms
[2022-03-23 17:20:50	                main:574]	:	INFO	:	Epoch 1563 | loss: nan | val_loss: nan | Time: 5312.35 ms
[2022-03-23 17:20:56	                main:574]	:	INFO	:	Epoch 1564 | loss: nan | val_loss: nan | Time: 5334.27 ms
[2022-03-23 17:21:01	                main:574]	:	INFO	:	Epoch 1565 | loss: nan | val_loss: nan | Time: 5331.7 ms
[2022-03-23 17:21:06	                main:574]	:	INFO	:	Epoch 1566 | loss: nan | val_loss: nan | Time: 5326.91 ms
[2022-03-23 17:21:12	                main:574]	:	INFO	:	Epoch 1567 | loss: nan | val_loss: nan | Time: 5345.58 ms
[2022-03-23 17:21:17	                main:574]	:	INFO	:	Epoch 1568 | loss: nan | val_loss: nan | Time: 5339.11 ms
[2022-03-23 17:21:23	                main:574]	:	INFO	:	Epoch 1569 | loss: nan | val_loss: nan | Time: 5308.42 ms
[2022-03-23 17:21:28	                main:574]	:	INFO	:	Epoch 1570 | loss: nan | val_loss: nan | Time: 5324.99 ms
[2022-03-23 17:21:33	                main:574]	:	INFO	:	Epoch 1571 | loss: nan | val_loss: nan | Time: 5321.58 ms
[2022-03-23 17:21:39	                main:574]	:	INFO	:	Epoch 1572 | loss: nan | val_loss: nan | Time: 5357.37 ms
[2022-03-23 17:21:44	                main:574]	:	INFO	:	Epoch 1573 | loss: nan | val_loss: nan | Time: 5370.55 ms
[2022-03-23 17:21:49	                main:574]	:	INFO	:	Epoch 1574 | loss: nan | val_loss: nan | Time: 5335.35 ms
[2022-03-23 17:21:55	                main:574]	:	INFO	:	Epoch 1575 | loss: nan | val_loss: nan | Time: 5310.53 ms
[2022-03-23 17:22:00	                main:574]	:	INFO	:	Epoch 1576 | loss: nan | val_loss: nan | Time: 5324 ms
[2022-03-23 17:22:05	                main:574]	:	INFO	:	Epoch 1577 | loss: nan | val_loss: nan | Time: 5296.51 ms
[2022-03-23 17:22:11	                main:574]	:	INFO	:	Epoch 1578 | loss: nan | val_loss: nan | Time: 5298.84 ms
[2022-03-23 17:22:16	                main:574]	:	INFO	:	Epoch 1579 | loss: nan | val_loss: nan | Time: 5320.96 ms
[2022-03-23 17:22:21	                main:574]	:	INFO	:	Epoch 1580 | loss: nan | val_loss: nan | Time: 5298.65 ms
[2022-03-23 17:22:26	                main:574]	:	INFO	:	Epoch 1581 | loss: nan | val_loss: nan | Time: 5342.07 ms
[2022-03-23 17:22:32	                main:574]	:	INFO	:	Epoch 1582 | loss: nan | val_loss: nan | Time: 5337.39 ms
[2022-03-23 17:22:37	                main:574]	:	INFO	:	Epoch 1583 | loss: nan | val_loss: nan | Time: 5339.59 ms
[2022-03-23 17:22:42	                main:574]	:	INFO	:	Epoch 1584 | loss: nan | val_loss: nan | Time: 5306.42 ms
[2022-03-23 17:22:48	                main:574]	:	INFO	:	Epoch 1585 | loss: nan | val_loss: nan | Time: 5330.77 ms
[2022-03-23 17:22:53	                main:574]	:	INFO	:	Epoch 1586 | loss: nan | val_loss: nan | Time: 5306.55 ms
[2022-03-23 17:22:58	                main:574]	:	INFO	:	Epoch 1587 | loss: nan | val_loss: nan | Time: 5298.25 ms
[2022-03-23 17:23:04	                main:574]	:	INFO	:	Epoch 1588 | loss: nan | val_loss: nan | Time: 5327.19 ms
[2022-03-23 17:23:09	                main:574]	:	INFO	:	Epoch 1589 | loss: nan | val_loss: nan | Time: 5318.03 ms
[2022-03-23 17:23:14	                main:574]	:	INFO	:	Epoch 1590 | loss: nan | val_loss: nan | Time: 5282.9 ms
[2022-03-23 17:23:20	                main:574]	:	INFO	:	Epoch 1591 | loss: nan | val_loss: nan | Time: 5335.98 ms
[2022-03-23 17:23:25	                main:574]	:	INFO	:	Epoch 1592 | loss: nan | val_loss: nan | Time: 5294.65 ms
[2022-03-23 17:23:30	                main:574]	:	INFO	:	Epoch 1593 | loss: nan | val_loss: nan | Time: 5328.19 ms
[2022-03-23 17:23:36	                main:574]	:	INFO	:	Epoch 1594 | loss: nan | val_loss: nan | Time: 5333.61 ms
[2022-03-23 17:23:41	                main:574]	:	INFO	:	Epoch 1595 | loss: nan | val_loss: nan | Time: 5283.9 ms
[2022-03-23 17:23:46	                main:574]	:	INFO	:	Epoch 1596 | loss: nan | val_loss: nan | Time: 5308.81 ms
[2022-03-23 17:23:52	                main:574]	:	INFO	:	Epoch 1597 | loss: nan | val_loss: nan | Time: 5338.73 ms
[2022-03-23 17:23:57	                main:574]	:	INFO	:	Epoch 1598 | loss: nan | val_loss: nan | Time: 5307.88 ms
[2022-03-23 17:24:02	                main:574]	:	INFO	:	Epoch 1599 | loss: nan | val_loss: nan | Time: 5301.19 ms
[2022-03-23 17:24:08	                main:574]	:	INFO	:	Epoch 1600 | loss: nan | val_loss: nan | Time: 5327.85 ms
[2022-03-23 17:24:13	                main:574]	:	INFO	:	Epoch 1601 | loss: nan | val_loss: nan | Time: 5259.86 ms
[2022-03-23 17:24:18	                main:574]	:	INFO	:	Epoch 1602 | loss: nan | val_loss: nan | Time: 5311.32 ms
[2022-03-23 17:24:24	                main:574]	:	INFO	:	Epoch 1603 | loss: nan | val_loss: nan | Time: 5317.72 ms
[2022-03-23 17:24:29	                main:574]	:	INFO	:	Epoch 1604 | loss: nan | val_loss: nan | Time: 5329.67 ms
[2022-03-23 17:24:34	                main:574]	:	INFO	:	Epoch 1605 | loss: nan | val_loss: nan | Time: 5306.34 ms
[2022-03-23 17:24:39	                main:574]	:	INFO	:	Epoch 1606 | loss: nan | val_loss: nan | Time: 5296.32 ms
[2022-03-23 17:24:45	                main:574]	:	INFO	:	Epoch 1607 | loss: nan | val_loss: nan | Time: 5342.77 ms
[2022-03-23 17:24:50	                main:574]	:	INFO	:	Epoch 1608 | loss: nan | val_loss: nan | Time: 5323.2 ms
[2022-03-23 17:24:56	                main:574]	:	INFO	:	Epoch 1609 | loss: nan | val_loss: nan | Time: 5342.75 ms
[2022-03-23 17:25:01	                main:574]	:	INFO	:	Epoch 1610 | loss: nan | val_loss: nan | Time: 5337.2 ms
[2022-03-23 17:25:06	                main:574]	:	INFO	:	Epoch 1611 | loss: nan | val_loss: nan | Time: 5325.05 ms
[2022-03-23 17:25:12	                main:574]	:	INFO	:	Epoch 1612 | loss: nan | val_loss: nan | Time: 5335.65 ms
[2022-03-23 17:25:17	                main:574]	:	INFO	:	Epoch 1613 | loss: nan | val_loss: nan | Time: 5320.72 ms
[2022-03-23 17:25:22	                main:574]	:	INFO	:	Epoch 1614 | loss: nan | val_loss: nan | Time: 5337.98 ms
[2022-03-23 17:25:28	                main:574]	:	INFO	:	Epoch 1615 | loss: nan | val_loss: nan | Time: 5328.35 ms
[2022-03-23 17:25:33	                main:574]	:	INFO	:	Epoch 1616 | loss: nan | val_loss: nan | Time: 5358.22 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1060 3GB)
[2022-03-23 17:32:47	                main:435]	:	INFO	:	Set logging level to 1
[2022-03-23 17:32:47	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-03-23 17:32:48	                main:444]	:	INFO	:	Resolving all filenames
[2022-03-23 17:32:48	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-23 17:32:48	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-23 17:32:48	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-23 17:32:48	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-23 17:32:48	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-23 17:32:48	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-03-23 17:32:48	                main:474]	:	INFO	:	Configuration: 
[2022-03-23 17:32:48	                main:475]	:	INFO	:	    Model type: GRU
[2022-03-23 17:32:48	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-03-23 17:32:48	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-03-23 17:32:48	                main:478]	:	INFO	:	    Batch Size: 128
[2022-03-23 17:32:48	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-03-23 17:32:48	                main:480]	:	INFO	:	    Patience: 10
[2022-03-23 17:32:48	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-03-23 17:32:48	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-03-23 17:32:48	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-03-23 17:32:48	                main:484]	:	INFO	:	    # Threads: 1
[2022-03-23 17:32:48	                main:486]	:	INFO	:	Preparing Dataset
[2022-03-23 17:32:48	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-23 17:32:48	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-03-23 17:32:53	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-03-23 17:32:53	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-03-23 17:32:53	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-03-23 17:32:53	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-03-23 17:32:53	                main:494]	:	INFO	:	Creating Model
[2022-03-23 17:32:53	                main:507]	:	INFO	:	Preparing config file
[2022-03-23 17:32:53	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-03-23 17:32:53	                main:512]	:	INFO	:	Loading config


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFF34404F69

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 03/23/22 17:32:53
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\1;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 00000000248e0000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000036c30000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1566

ModLoad: 0000000035be0000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1566

ModLoad: 00000000343d0000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1566

ModLoad: 0000000034cc0000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.19041.1526 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1526

ModLoad: 0000000034960000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1586) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1586

ModLoad: 0000000036760000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202

ModLoad: 00000000346f0000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 0000000034800000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 0000000034b60000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 0000000034ff0000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.19041.1526 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1526

ModLoad: 0000000029aa0000 0000000000058000 C:\ProgramData\BOINC\slots\1\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000034ec0000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.19041.546

ModLoad: 0000000035390000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.1586) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000036790000 0000000000125000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.19041.1526 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1526

ModLoad: 000000001b530000 000000000008d000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.29.30037.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\agent\_work\13\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.29.30037.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.29.30037.0

ModLoad: 0000000029520000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.867

ModLoad: 000000001b5c0000 000000000001b000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.29.30037.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\agent\_work\13\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.29.30037.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.29.30037.0

ModLoad: 000000001b520000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.29.30037.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\agent\_work\13\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.29.30037.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.29.30037.0

ModLoad: 0000000090040000 000000000abe7000 C:\ProgramData\BOINC\slots\1\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000e42a0000 00000000002db000 C:\ProgramData\BOINC\slots\1\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000016370000 000000000020d000 C:\ProgramData\BOINC\slots\1\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 0000000069aa0000 0000000024b49000 C:\ProgramData\BOINC\slots\1\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000029a60000 0000000000040000 C:\ProgramData\BOINC\slots\1\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000029a10000 0000000000045000 C:\ProgramData\BOINC\slots\1\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000669f0000 00000000030a5000 C:\ProgramData\BOINC\slots\1\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 0000000063530000 00000000034b2000 C:\ProgramData\BOINC\slots\1\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 0000000031990000 0000000000010000 C:\ProgramData\BOINC\slots\1\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 000000003b280000 0000000003d5b000 C:\ProgramData\BOINC\slots\1\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000a3130000 0000000001eca000 C:\ProgramData\BOINC\slots\1\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 000000003efe0000 000000000919f000 C:\ProgramData\BOINC\slots\1\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 0000000048180000 000000001b3a4000 C:\ProgramData\BOINC\slots\1\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 00000000361c0000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000032250000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000362f0000 0000000000470000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.19041.1526 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1526

ModLoad: 00000000346a0000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 00000000348a0000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.19041.1526 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1526

ModLoad: 00000000340c0000 0000000000033000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 0000000034af0000 0000000000068000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 0000000034990000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.19041.1526 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1526

ModLoad: 0000000033f00000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000035490000 0000000000744000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.19041.1526 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1526

ModLoad: 0000000032450000 0000000000794000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.19041.1526 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1526

ModLoad: 0000000035e60000 0000000000354000 C:\WINDOWS\System32\combase.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.19041.1526 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1526

ModLoad: 0000000033d30000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.19041.1526 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1526

ModLoad: 0000000036b10000 00000000000ad000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.19041.1526 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1526

ModLoad: 0000000035430000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.19041.1526 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1526

ModLoad: 00000000b0bf0000 00000000002cd000 C:\WINDOWS\system32\nvcuda.dll (30.0.15.1179) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_75\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 30.0.15.1179
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.6.110 driver
    Product Version       : 30.0.15.1179

ModLoad: 000000009ba30000 00000000016a0000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_3b12ac0f95b18b9d\nvcuda64.dll (30.0.15.1179) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_75\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 30.0.15.1179
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.6.110 driver
    Product Version       : 30.0.15.1179

ModLoad: 000000002e9f0000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000002e4b0000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.19041.906 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.906

ModLoad: 000000002c460000 0000000000148000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : drvstore.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 0000000033c80000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000027bf0000 0000000000768000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.15.1179) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_75\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 30.0.15.1179
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 30.0.15.1179

ModLoad: 00000000348d0000 0000000000082000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.19041.1415 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1415



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3619, Write: 308, Other 680

- I/O Transfers Counters -
Read: 6778954, Write: 6059, Other 27990

- Paged Pool Usage -
QuotaPagedPoolUsage: 3439360, QuotaPeakPagedPoolUsage: 3439408
QuotaNonPagedPoolUsage: 37392, QuotaPeakNonPagedPoolUsage: 37520

- Virtual Memory Usage -
VirtualSize: -1436499968, PeakVirtualSize: -849432576

- Pagefile Usage -
PagefileUsage: -1436499968, PeakPagefileUsage: -1436499968

- Working Set Size -
WorkingSetSize: 1158852608, PeakWorkingSetSize: 1158856704, PageFaultCount: 395175

*** Dump of thread ID 19364 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 9375000.000000, User Time: 34687500.000000, Wait Time: 78389224.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFF34404F69

- Registers -
rax=00000000bc7b5f38 rbx=0000000024c44910 rcx=0000000059dedb00 rdx=0000000036c55b00 rsi=00000000bc7b67a0 rdi=0000000019930520
r8=00000000bc7b5f60 r9=00000000bc7b5f88 r10=0000000000000004 r11=00000000bc7b5f98 r12=0000000035d7f110 r13=00000000bc7b69b0
r14=000000005a6fd6b0 r15=0000000000000000 rip=0000000034404f69 rsp=00000000bc7b6640 rbp=00000000bc7b6930
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
bc7b6710 24b5a884 00000040 0000004f 35d7ea00 000005c7 KERNELBASE!RaiseException+0x0 
bc7b6770 24901ca6 7b3c0000 bc7b6849 534e5e88 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
bc7b6820 2490593b 00000000 00000030 00000020 00000008 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
bc7b6970 24901a78 00000000 00000000 bc7b6ca0 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
bc7b6a40 24901cfc bc7b6ca0 00000000 00000080 bc7b6f70 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
bc7b6b00 2490c4dd bc7b6f70 bc7b6f70 bc7b6f70 bc7b6f70 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
bc7b6df0 248fb2fe bc7b7408 bc7b6f70 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
bc7cfb90 24b3c6f8 7cdc91e0 00000000 00000000 7b3c66d0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
bc7cfbd0 35bf7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
bc7cfc00 36c82651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
bc7cfc80 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 20008 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 78388872.000000

- Registers -
rax=00000000000001d3 rbx=000000007b3c52a0 rcx=0000000000000074 rdx=000000007b3c4f20 rsi=000000007b3c3340 rdi=000000007b3c52a0
r8=0000000000000008 r9=0000000000000040 r10=0000000000000540 r11=0000000048000200 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000036cd07c4 rsp=00000000bcaff568 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
bcaff560 36c82dc7 00000000 00000000 7b3c3340 7b3c52a0 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
bcaff860 35bf7034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
bcaff890 36c82651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
bcaff910 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 20952 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 78388872.000000

- Registers -
rax=00000000000001d3 rbx=000000007b3c6100 rcx=0000000000000074 rdx=000000007b3c5d80 rsi=000000007b3c3340 rdi=000000007b3c6100
r8=0000000000000008 r9=0000000000000000 r10=0000000000000000 r11=0000000000000001 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000036cd07c4 rsp=00000000bcbff958 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
bcbff950 36c82dc7 00000000 00000000 7b3c3340 7b3c6100 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
bcbffc50 35bf7034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
bcbffc80 36c82651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
bcbffd00 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 1344 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 78388872.000000

- Registers -
rax=00000000000001d3 rbx=000000007b3c75a0 rcx=0000000000000074 rdx=000000007b3c7220 rsi=000000007b3c3340 rdi=000000007b3c75a0
r8=000000002e9f5008 r9=00000000bccff410 r10=000000002e9f00f0 r11=0000000000000001 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000036cd07c4 rsp=00000000bccff968 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
bccff960 36c82dc7 00000000 00000000 7b3c3340 7b3c75a0 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
bccffc60 35bf7034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
bccffc90 36c82651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
bccffd10 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 15396 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 78389224.000000

- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000bceffd40 rsi=0000000000000000 rdi=0000000000000064
r8=00000000bceffd18 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000036ccd3f4 rsp=00000000bceffd18 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
bceffd10 3441962e bceffdd8 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0 
bceffdb0 2491a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0 
bceffde0 35bf7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
bceffe10 36c82651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
bceffe90 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 7580 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 78389216.000000

- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=00000000bcfff5e0 rsi=0000000000000000 rdi=000000000000000d
r8=000000007cfd8c40 r9=000000000000000d r10=000000007c4fa7e0 r11=0000000099cf2760 r12=0000000000000064 r13=00000000bcfff5e0
r14=00000000bcfff2e0 r15=0000000000000000 rip=0000000036ccd8c4 rsp=00000000bcfff288 rbp=000000007cfbab70
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
bcfff280 3441cb20 00000000 bc9d1000 36d9a4d0 bc9d1000 ntdll!ZwWaitForMultipleObjects+0x0 
bcfff570 3441ca1e 7b3d1ad0 004e0049 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
bcfff5b0 9bc0d554 7cfbea70 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
bcfff7f0 9bcb58cd 00000000 7cfbab70 00000000 00000000 nvcuda64!+0x0 
bcfff8a0 9bc0cf23 e288ad2a dfd05229 7d54e920 00000000 nvcuda64!cuProfilerStop+0x0 
bcfff8d0 9bf44594 7d54e920 00000000 00000000 00000000 nvcuda64!+0x0 
bcfff900 35bf7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
bcfff930 36c82651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
bcfff9b0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 14200 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 78388928.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002a8 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002a8
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=000000007cfa0550 r13=0000000000000000
r14=00000000000002a8 r15=0000000000000000 rip=0000000036cccdf4 rsp=00000000bd0ff9b8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
bd0ff9b0 343f1a5e 00000000 00001f80 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0 
bd0ffa50 9be35d0e 7d54f5e0 00000000 00000000 000002a8 KERNELBASE!WaitForSingleObjectEx+0x0 
bd0ffc90 9bc0cf23 00000000 7d54f5e0 9ba30000 7cfd9aa0 nvcuda64!cuProfilerStop+0x0 
bd0ffcc0 9bf44594 7d54f5e0 00000000 00000000 00000000 nvcuda64!+0x0 
bd0ffcf0 35bf7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
bd0ffd20 36c82651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
bd0ffda0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)