Task 12620583
| Name | ParityModified-1645992455-28393-1-0_2 |
| Workunit | 9449962 |
| Created | 6 Mar 2022, 21:56:08 UTC |
| Sent | 6 Mar 2022, 23:12:27 UTC |
| Report deadline | 14 Mar 2022, 23:12:27 UTC |
| Received | 9 Mar 2022, 4:24:33 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | -529697949 (0xE06D7363) Unknown error code |
| Computer ID | 157 |
| Run time | 1 days 0 hours 28 min 9 sec |
| CPU time | 6 hours 11 min 45 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 4,474.01 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.62 GB |
| Peak swap size | 3.61 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
ime: 32013.4 ms
[2022-03-08 17:08:46 main:574] : INFO : Epoch 1397 | loss: nan | val_loss: nan | Time: 49944.8 ms
[2022-03-08 17:09:15 main:574] : INFO : Epoch 1398 | loss: nan | val_loss: nan | Time: 29590.4 ms
[2022-03-08 17:09:47 main:574] : INFO : Epoch 1399 | loss: nan | val_loss: nan | Time: 31506.6 ms
[2022-03-08 17:10:40 main:574] : INFO : Epoch 1400 | loss: nan | val_loss: nan | Time: 53095.6 ms
[2022-03-08 17:11:07 main:574] : INFO : Epoch 1401 | loss: nan | val_loss: nan | Time: 27239.7 ms
[2022-03-08 17:11:38 main:574] : INFO : Epoch 1402 | loss: nan | val_loss: nan | Time: 30576.8 ms
[2022-03-08 17:12:26 main:574] : INFO : Epoch 1403 | loss: nan | val_loss: nan | Time: 48345.4 ms
[2022-03-08 17:12:56 main:574] : INFO : Epoch 1404 | loss: nan | val_loss: nan | Time: 29304.7 ms
[2022-03-08 17:13:26 main:574] : INFO : Epoch 1405 | loss: nan | val_loss: nan | Time: 30070.6 ms
[2022-03-08 17:14:02 main:574] : INFO : Epoch 1406 | loss: nan | val_loss: nan | Time: 36085.4 ms
[2022-03-08 17:14:47 main:574] : INFO : Epoch 1407 | loss: nan | val_loss: nan | Time: 44610.8 ms
[2022-03-08 17:15:16 main:574] : INFO : Epoch 1408 | loss: nan | val_loss: nan | Time: 28884.6 ms
[2022-03-08 17:15:47 main:574] : INFO : Epoch 1409 | loss: nan | val_loss: nan | Time: 31054.5 ms
[2022-03-08 17:16:43 main:574] : INFO : Epoch 1410 | loss: nan | val_loss: nan | Time: 56023.2 ms
[2022-03-08 17:17:14 main:574] : INFO : Epoch 1411 | loss: nan | val_loss: nan | Time: 30745.2 ms
[2022-03-08 17:17:45 main:574] : INFO : Epoch 1412 | loss: nan | val_loss: nan | Time: 31208.8 ms
[2022-03-08 17:18:24 main:574] : INFO : Epoch 1413 | loss: nan | val_loss: nan | Time: 38908.7 ms
[2022-03-08 17:19:13 main:574] : INFO : Epoch 1414 | loss: nan | val_loss: nan | Time: 49272 ms
[2022-03-08 17:19:45 main:574] : INFO : Epoch 1415 | loss: nan | val_loss: nan | Time: 31900.9 ms
[2022-03-08 17:20:19 main:574] : INFO : Epoch 1416 | loss: nan | val_loss: nan | Time: 33608.2 ms
[2022-03-08 17:21:08 main:574] : INFO : Epoch 1417 | loss: nan | val_loss: nan | Time: 48556.2 ms
[2022-03-08 17:21:39 main:574] : INFO : Epoch 1418 | loss: nan | val_loss: nan | Time: 31728.4 ms
[2022-03-08 17:22:11 main:574] : INFO : Epoch 1419 | loss: nan | val_loss: nan | Time: 31799.7 ms
[2022-03-08 17:22:48 main:574] : INFO : Epoch 1420 | loss: nan | val_loss: nan | Time: 36967.5 ms
[2022-03-08 17:23:39 main:574] : INFO : Epoch 1421 | loss: nan | val_loss: nan | Time: 49961.6 ms
[2022-03-08 17:24:12 main:574] : INFO : Epoch 1422 | loss: nan | val_loss: nan | Time: 32714.3 ms
[2022-03-08 17:24:45 main:574] : INFO : Epoch 1423 | loss: nan | val_loss: nan | Time: 33574.6 ms
[2022-03-08 17:25:41 main:574] : INFO : Epoch 1424 | loss: nan | val_loss: nan | Time: 55801.7 ms
[2022-03-08 17:26:11 main:574] : INFO : Epoch 1425 | loss: nan | val_loss: nan | Time: 30022.3 ms
[2022-03-08 17:26:44 main:574] : INFO : Epoch 1426 | loss: nan | val_loss: nan | Time: 32251 ms
[2022-03-08 17:27:39 main:574] : INFO : Epoch 1427 | loss: nan | val_loss: nan | Time: 55628.6 ms
[2022-03-08 17:28:08 main:574] : INFO : Epoch 1428 | loss: nan | val_loss: nan | Time: 28490.9 ms
[2022-03-08 17:28:37 main:574] : INFO : Epoch 1429 | loss: nan | val_loss: nan | Time: 29124.3 ms
[2022-03-08 17:29:15 main:574] : INFO : Epoch 1430 | loss: nan | val_loss: nan | Time: 37958 ms
[2022-03-08 17:31:02 main:574] : INFO : Epoch 1431 | loss: nan | val_loss: nan | Time: 106589 ms
[2022-03-08 17:31:36 main:574] : INFO : Epoch 1432 | loss: nan | val_loss: nan | Time: 34382.4 ms
[2022-03-08 17:32:29 main:574] : INFO : Epoch 1433 | loss: nan | val_loss: nan | Time: 52908.8 ms
[2022-03-08 17:32:59 main:574] : INFO : Epoch 1434 | loss: nan | val_loss: nan | Time: 29574.3 ms
[2022-03-08 17:33:31 main:574] : INFO : Epoch 1435 | loss: nan | val_loss: nan | Time: 31811.9 ms
[2022-03-08 17:34:22 main:574] : INFO : Epoch 1436 | loss: nan | val_loss: nan | Time: 51646.2 ms
[2022-03-08 17:34:55 main:574] : INFO : Epoch 1437 | loss: nan | val_loss: nan | Time: 33134.1 ms
[2022-03-08 17:35:26 main:574] : INFO : Epoch 1438 | loss: nan | val_loss: nan | Time: 30547.3 ms
[2022-03-08 17:35:57 main:574] : INFO : Epoch 1439 | loss: nan | val_loss: nan | Time: 31333.5 ms
[2022-03-08 17:36:57 main:574] : INFO : Epoch 1440 | loss: nan | val_loss: nan | Time: 59180.8 ms
[2022-03-08 17:37:46 main:574] : INFO : Epoch 1441 | loss: nan | val_loss: nan | Time: 49515.3 ms
[2022-03-08 17:39:17 main:574] : INFO : Epoch 1442 | loss: nan | val_loss: nan | Time: 91071.9 ms
[2022-03-08 17:40:09 main:574] : INFO : Epoch 1443 | loss: nan | val_loss: nan | Time: 51367.8 ms
[2022-03-08 17:41:09 main:574] : INFO : Epoch 1444 | loss: nan | val_loss: nan | Time: 59803.7 ms
[2022-03-08 17:42:23 main:574] : INFO : Epoch 1445 | loss: nan | val_loss: nan | Time: 74768.4 ms
[2022-03-08 17:44:25 main:574] : INFO : Epoch 1446 | loss: nan | val_loss: nan | Time: 121223 ms
[2022-03-08 17:45:19 main:574] : INFO : Epoch 1447 | loss: nan | val_loss: nan | Time: 54458.6 ms
[2022-03-08 17:45:53 main:574] : INFO : Epoch 1448 | loss: nan | val_loss: nan | Time: 33887.9 ms
[2022-03-08 17:48:06 main:574] : INFO : Epoch 1449 | loss: nan | val_loss: nan | Time: 132026 ms
[2022-03-08 17:51:44 main:574] : INFO : Epoch 1450 | loss: nan | val_loss: nan | Time: 215038 ms
[2022-03-08 17:53:21 main:574] : INFO : Epoch 1451 | loss: nan | val_loss: nan | Time: 96776.1 ms
[2022-03-08 17:53:59 main:574] : INFO : Epoch 1452 | loss: nan | val_loss: nan | Time: 37970.4 ms
[2022-03-08 17:54:28 main:574] : INFO : Epoch 1453 | loss: nan | val_loss: nan | Time: 28410.1 ms
[2022-03-08 17:54:53 main:574] : INFO : Epoch 1454 | loss: nan | val_loss: nan | Time: 25611.8 ms
[2022-03-08 17:55:21 main:574] : INFO : Epoch 1455 | loss: nan | val_loss: nan | Time: 27891 ms
[2022-03-08 17:55:48 main:574] : INFO : Epoch 1456 | loss: nan | val_loss: nan | Time: 26942.6 ms
[2022-03-08 17:56:13 main:574] : INFO : Epoch 1457 | loss: nan | val_loss: nan | Time: 24917.5 ms
[2022-03-08 17:56:41 main:574] : INFO : Epoch 1458 | loss: nan | val_loss: nan | Time: 27972 ms
[2022-03-08 17:57:08 main:574] : INFO : Epoch 1459 | loss: nan | val_loss: nan | Time: 26922.9 ms
[2022-03-08 17:57:33 main:574] : INFO : Epoch 1460 | loss: nan | val_loss: nan | Time: 25045.1 ms
[2022-03-08 17:58:02 main:574] : INFO : Epoch 1461 | loss: nan | val_loss: nan | Time: 28423.2 ms
[2022-03-08 17:58:28 main:574] : INFO : Epoch 1462 | loss: nan | val_loss: nan | Time: 26470.9 ms
[2022-03-08 17:58:55 main:574] : INFO : Epoch 1463 | loss: nan | val_loss: nan | Time: 27027.8 ms
[2022-03-08 17:59:21 main:574] : INFO : Epoch 1464 | loss: nan | val_loss: nan | Time: 25140.3 ms
[2022-03-08 17:59:49 main:574] : INFO : Epoch 1465 | loss: nan | val_loss: nan | Time: 28017.8 ms
[2022-03-08 18:00:15 main:574] : INFO : Epoch 1466 | loss: nan | val_loss: nan | Time: 26291.4 ms
[2022-03-08 18:00:42 main:574] : INFO : Epoch 1467 | loss: nan | val_loss: nan | Time: 26392.7 ms
[2022-03-08 18:01:12 main:574] : INFO : Epoch 1468 | loss: nan | val_loss: nan | Time: 30544.7 ms
[2022-03-08 18:01:41 main:574] : INFO : Epoch 1469 | loss: nan | val_loss: nan | Time: 28332.3 ms
[2022-03-08 18:02:07 main:574] : INFO : Epoch 1470 | loss: nan | val_loss: nan | Time: 26276.1 ms
[2022-03-08 18:02:34 main:574] : INFO : Epoch 1471 | loss: nan | val_loss: nan | Time: 26701.7 ms
[2022-03-08 18:03:02 main:574] : INFO : Epoch 1472 | loss: nan | val_loss: nan | Time: 28064.6 ms
[2022-03-08 18:03:29 main:574] : INFO : Epoch 1473 | loss: nan | val_loss: nan | Time: 27016.7 ms
[2022-03-08 18:03:56 main:574] : INFO : Epoch 1474 | loss: nan | val_loss: nan | Time: 26687.5 ms
[2022-03-08 18:04:23 main:574] : INFO : Epoch 1475 | loss: nan | val_loss: nan | Time: 27462.9 ms
[2022-03-08 18:04:50 main:574] : INFO : Epoch 1476 | loss: nan | val_loss: nan | Time: 27178.9 ms
[2022-03-08 18:05:18 main:574] : INFO : Epoch 1477 | loss: nan | val_loss: nan | Time: 27168.4 ms
[2022-03-08 18:05:44 main:574] : INFO : Epoch 1478 | loss: nan | val_loss: nan | Time: 26863.6 ms
[2022-03-08 18:06:12 main:574] : INFO : Epoch 1479 | loss: nan | val_loss: nan | Time: 27377.8 ms
[2022-03-08 18:06:39 main:574] : INFO : Epoch 1480 | loss: nan | val_loss: nan | Time: 26885.7 ms
[2022-03-08 18:07:04 main:574] : INFO : Epoch 1481 | loss: nan | val_loss: nan | Time: 25590 ms
[2022-03-08 18:07:32 main:574] : INFO : Epoch 1482 | loss: nan | val_loss: nan | Time: 27735 ms
[2022-03-08 18:07:59 main:574] : INFO : Epoch 1483 | loss: nan | val_loss: nan | Time: 26880.1 ms
[2022-03-08 18:08:25 main:574] : INFO : Epoch 1484 | loss: nan | val_loss: nan | Time: 25559.7 ms
[2022-03-08 18:08:53 main:574] : INFO : Epoch 1485 | loss: nan | val_loss: nan | Time: 27855.9 ms
[2022-03-08 18:09:19 main:574] : INFO : Epoch 1486 | loss: nan | val_loss: nan | Time: 26806.1 ms
[2022-03-08 18:09:45 main:574] : INFO : Epoch 1487 | loss: nan | val_loss: nan | Time: 25240.3 ms
[2022-03-08 18:10:13 main:574] : INFO : Epoch 1488 | loss: nan | val_loss: nan | Time: 28249.5 ms
[2022-03-08 18:10:40 main:574] : INFO : Epoch 1489 | loss: nan | val_loss: nan | Time: 27332.1 ms
[2022-03-08 18:11:07 main:574] : INFO : Epoch 1490 | loss: nan | val_loss: nan | Time: 26744.3 ms
[2022-03-08 18:11:33 main:574] : INFO : Epoch 1491 | loss: nan | val_loss: nan | Time: 26155 ms
[2022-03-08 18:12:01 main:574] : INFO : Epoch 1492 | loss: nan | val_loss: nan | Time: 27926.3 ms
[2022-03-08 18:12:27 main:574] : INFO : Epoch 1493 | loss: nan | val_loss: nan | Time: 26065.3 ms
[2022-03-08 18:12:54 main:574] : INFO : Epoch 1494 | loss: nan | val_loss: nan | Time: 26079 ms
[2022-03-08 18:13:22 main:574] : INFO : Epoch 1495 | loss: nan | val_loss: nan | Time: 28651.2 ms
[2022-03-08 18:13:51 main:574] : INFO : Epoch 1496 | loss: nan | val_loss: nan | Time: 28939.7 ms
[2022-03-08 18:14:18 main:574] : INFO : Epoch 1497 | loss: nan | val_loss: nan | Time: 27197.6 ms
[2022-03-08 18:14:44 main:574] : INFO : Epoch 1498 | loss: nan | val_loss: nan | Time: 25187.8 ms
[2022-03-08 18:15:11 main:574] : INFO : Epoch 1499 | loss: nan | val_loss: nan | Time: 27186.8 ms
[2022-03-08 18:15:37 main:574] : INFO : Epoch 1500 | loss: nan | val_loss: nan | Time: 26267.7 ms
[2022-03-08 18:16:04 main:574] : INFO : Epoch 1501 | loss: nan | val_loss: nan | Time: 26500.8 ms
[2022-03-08 18:16:33 main:574] : INFO : Epoch 1502 | loss: nan | val_loss: nan | Time: 29009.3 ms
[2022-03-08 18:16:59 main:574] : INFO : Epoch 1503 | loss: nan | val_loss: nan | Time: 25699.2 ms
[2022-03-08 18:17:25 main:574] : INFO : Epoch 1504 | loss: nan | val_loss: nan | Time: 26238.7 ms
[2022-03-08 18:17:53 main:574] : INFO : Epoch 1505 | loss: nan | val_loss: nan | Time: 28133.9 ms
[2022-03-08 18:18:20 main:574] : INFO : Epoch 1506 | loss: nan | val_loss: nan | Time: 26984.6 ms
[2022-03-08 18:18:45 main:574] : INFO : Epoch 1507 | loss: nan | val_loss: nan | Time: 25183.7 ms
[2022-03-08 18:19:14 main:574] : INFO : Epoch 1508 | loss: nan | val_loss: nan | Time: 28369.9 ms
[2022-03-08 18:19:41 main:574] : INFO : Epoch 1509 | loss: nan | val_loss: nan | Time: 27329.8 ms
[2022-03-08 18:20:08 main:574] : INFO : Epoch 1510 | loss: nan | val_loss: nan | Time: 26933.7 ms
[2022-03-08 18:20:38 main:574] : INFO : Epoch 1511 | loss: nan | val_loss: nan | Time: 29402 ms
[2022-03-08 18:21:05 main:574] : INFO : Epoch 1512 | loss: nan | val_loss: nan | Time: 26752.1 ms
[2022-03-08 18:21:33 main:574] : INFO : Epoch 1513 | loss: nan | val_loss: nan | Time: 28124.8 ms
[2022-03-08 18:21:59 main:574] : INFO : Epoch 1514 | loss: nan | val_loss: nan | Time: 26553.9 ms
[2022-03-08 18:22:25 main:574] : INFO : Epoch 1515 | loss: nan | val_loss: nan | Time: 25346 ms
[2022-03-08 18:22:53 main:574] : INFO : Epoch 1516 | loss: nan | val_loss: nan | Time: 27843.3 ms
[2022-03-08 18:23:19 main:574] : INFO : Epoch 1517 | loss: nan | val_loss: nan | Time: 26450.6 ms
[2022-03-08 18:23:45 main:574] : INFO : Epoch 1518 | loss: nan | val_loss: nan | Time: 25840.9 ms
[2022-03-08 18:24:14 main:574] : INFO : Epoch 1519 | loss: nan | val_loss: nan | Time: 28617.6 ms
[2022-03-08 18:24:40 main:574] : INFO : Epoch 1520 | loss: nan | val_loss: nan | Time: 26268.4 ms
[2022-03-08 18:25:05 main:574] : INFO : Epoch 1521 | loss: nan | val_loss: nan | Time: 25070.3 ms
[2022-03-08 18:25:46 main:574] : INFO : Epoch 1522 | loss: nan | val_loss: nan | Time: 40650.3 ms
[2022-03-08 18:26:33 main:574] : INFO : Epoch 1523 | loss: nan | val_loss: nan | Time: 47452.3 ms
[2022-03-08 18:27:03 main:574] : INFO : Epoch 1524 | loss: nan | val_loss: nan | Time: 29196.5 ms
[2022-03-08 18:27:31 main:574] : INFO : Epoch 1525 | loss: nan | val_loss: nan | Time: 28210.2 ms
[2022-03-08 18:27:56 main:574] : INFO : Epoch 1526 | loss: nan | val_loss: nan | Time: 25321.4 ms
[2022-03-08 18:28:25 main:574] : INFO : Epoch 1527 | loss: nan | val_loss: nan | Time: 28352.4 ms
[2022-03-08 18:28:51 main:574] : INFO : Epoch 1528 | loss: nan | val_loss: nan | Time: 26623.8 ms
[2022-03-08 18:29:16 main:574] : INFO : Epoch 1529 | loss: nan | val_loss: nan | Time: 24950.2 ms
[2022-03-08 18:29:45 main:574] : INFO : Epoch 1530 | loss: nan | val_loss: nan | Time: 28381.6 ms
[2022-03-08 18:30:11 main:574] : INFO : Epoch 1531 | loss: nan | val_loss: nan | Time: 26405.2 ms
[2022-03-08 18:30:36 main:574] : INFO : Epoch 1532 | loss: nan | val_loss: nan | Time: 25178.1 ms
[2022-03-08 18:31:45 main:574] : INFO : Epoch 1533 | loss: nan | val_loss: nan | Time: 68105.7 ms
[2022-03-08 18:32:24 main:574] : INFO : Epoch 1534 | loss: nan | val_loss: nan | Time: 39149.8 ms
[2022-03-08 18:32:50 main:574] : INFO : Epoch 1535 | loss: nan | val_loss: nan | Time: 26397.9 ms
[2022-03-08 18:33:16 main:574] : INFO : Epoch 1536 | loss: nan | val_loss: nan | Time: 25481.4 ms
[2022-03-08 18:33:44 main:574] : INFO : Epoch 1537 | loss: nan | val_loss: nan | Time: 28136.6 ms
[2022-03-08 18:34:10 main:574] : INFO : Epoch 1538 | loss: nan | val_loss: nan | Time: 26124 ms
[2022-03-08 18:34:37 main:574] : INFO : Epoch 1539 | loss: nan | val_loss: nan | Time: 26712.3 ms
[2022-03-08 18:35:06 main:574] : INFO : Epoch 1540 | loss: nan | val_loss: nan | Time: 28657.4 ms
[2022-03-08 18:35:33 main:574] : INFO : Epoch 1541 | loss: nan | val_loss: nan | Time: 27724.6 ms
[2022-03-08 18:36:04 main:574] : INFO : Epoch 1542 | loss: nan | val_loss: nan | Time: 30653.7 ms
[2022-03-08 18:36:31 main:574] : INFO : Epoch 1543 | loss: nan | val_loss: nan | Time: 26817.2 ms
[2022-03-08 18:36:56 main:574] : INFO : Epoch 1544 | loss: nan | val_loss: nan | Time: 24870.4 ms
[2022-03-08 18:37:22 main:574] : INFO : Epoch 1545 | loss: nan | val_loss: nan | Time: 26561.5 ms
[2022-03-08 18:37:49 main:574] : INFO : Epoch 1546 | loss: nan | val_loss: nan | Time: 26077.2 ms
[2022-03-08 18:38:16 main:574] : INFO : Epoch 1547 | loss: nan | val_loss: nan | Time: 27073.4 ms
[2022-03-08 18:38:43 main:574] : INFO : Epoch 1548 | loss: nan | val_loss: nan | Time: 26863.1 ms
[2022-03-08 18:39:10 main:574] : INFO : Epoch 1549 | loss: nan | val_loss: nan | Time: 27038.5 ms
[2022-03-08 18:39:36 main:574] : INFO : Epoch 1550 | loss: nan | val_loss: nan | Time: 26189 ms
[2022-03-08 18:40:03 main:574] : INFO : Epoch 1551 | loss: nan | val_loss: nan | Time: 27466.4 ms
[2022-03-08 18:40:31 main:574] : INFO : Epoch 1552 | loss: nan | val_loss: nan | Time: 27212.4 ms
[2022-03-08 18:40:57 main:574] : INFO : Epoch 1553 | loss: nan | val_loss: nan | Time: 26693 ms
[2022-03-08 18:41:26 main:574] : INFO : Epoch 1554 | loss: nan | val_loss: nan | Time: 28448.9 ms
[2022-03-08 18:41:53 main:574] : INFO : Epoch 1555 | loss: nan | val_loss: nan | Time: 27129.2 ms
[2022-03-08 18:42:20 main:574] : INFO : Epoch 1556 | loss: nan | val_loss: nan | Time: 26636.3 ms
[2022-03-08 18:42:46 main:574] : INFO : Epoch 1557 | loss: nan | val_loss: nan | Time: 26387.3 ms
[2022-03-08 18:43:23 main:574] : INFO : Epoch 1558 | loss: nan | val_loss: nan | Time: 36290.8 ms
[2022-03-08 18:43:51 main:574] : INFO : Epoch 1559 | loss: nan | val_loss: nan | Time: 27977.7 ms
[2022-03-08 18:44:17 main:574] : INFO : Epoch 1560 | loss: nan | val_loss: nan | Time: 25824.5 ms
[2022-03-08 18:44:55 main:574] : INFO : Epoch 1561 | loss: nan | val_loss: nan | Time: 38791.8 ms
[2022-03-08 18:45:22 main:574] : INFO : Epoch 1562 | loss: nan | val_loss: nan | Time: 26925.1 ms
[2022-03-08 18:45:47 main:574] : INFO : Epoch 1563 | loss: nan | val_loss: nan | Time: 24711.3 ms
[2022-03-08 18:46:17 main:574] : INFO : Epoch 1564 | loss: nan | val_loss: nan | Time: 29559.4 ms
[2022-03-08 18:46:44 main:574] : INFO : Epoch 1565 | loss: nan | val_loss: nan | Time: 27454.8 ms
[2022-03-08 18:47:09 main:574] : INFO : Epoch 1566 | loss: nan | val_loss: nan | Time: 24388 ms
[2022-03-08 18:47:36 main:574] : INFO : Epoch 1567 | loss: nan | val_loss: nan | Time: 27596.4 ms
[2022-03-08 18:48:03 main:574] : INFO : Epoch 1568 | loss: nan | val_loss: nan | Time: 27006.3 ms
[2022-03-08 18:48:28 main:574] : INFO : Epoch 1569 | loss: nan | val_loss: nan | Time: 24610.5 ms
[2022-03-08 18:48:59 main:574] : INFO : Epoch 1570 | loss: nan | val_loss: nan | Time: 31111.6 ms
[2022-03-08 18:49:36 main:574] : INFO : Epoch 1571 | loss: nan | val_loss: nan | Time: 35079 ms
[2022-03-08 18:50:04 main:574] : INFO : Epoch 1572 | loss: nan | val_loss: nan | Time: 28114.8 ms
[2022-03-08 18:50:31 main:574] : INFO : Epoch 1573 | loss: nan | val_loss: nan | Time: 26768.8 ms
[2022-03-08 18:51:03 main:574] : INFO : Epoch 1574 | loss: nan | val_loss: nan | Time: 31526.2 ms
[2022-03-08 18:51:29 main:574] : INFO : Epoch 1575 | loss: nan | val_loss: nan | Time: 25863.2 ms
[2022-03-08 18:51:56 main:574] : INFO : Epoch 1576 | loss: nan | val_loss: nan | Time: 27320.7 ms
[2022-03-08 18:52:23 main:574] : INFO : Epoch 1577 | loss: nan | val_loss: nan | Time: 26589.9 ms
[2022-03-08 18:52:48 main:574] : INFO : Epoch 1578 | loss: nan | val_loss: nan | Time: 25461.2 ms
[2022-03-08 18:53:17 main:574] : INFO : Epoch 1579 | loss: nan | val_loss: nan | Time: 27972.1 ms
[2022-03-08 18:53:42 main:574] : INFO : Epoch 1580 | loss: nan | val_loss: nan | Time: 25911.4 ms
[2022-03-08 18:54:08 main:574] : INFO : Epoch 1581 | loss: nan | val_loss: nan | Time: 25694 ms
[2022-03-08 18:54:36 main:574] : INFO : Epoch 1582 | loss: nan | val_loss: nan | Time: 28173.3 ms
[2022-03-08 18:55:04 main:574] : INFO : Epoch 1583 | loss: nan | val_loss: nan | Time: 27447.2 ms
[2022-03-08 18:55:31 main:574] : INFO : Epoch 1584 | loss: nan | val_loss: nan | Time: 27010.1 ms
[2022-03-08 18:55:58 main:574] : INFO : Epoch 1585 | loss: nan | val_loss: nan | Time: 26654.3 ms
[2022-03-08 18:56:25 main:574] : INFO : Epoch 1586 | loss: nan | val_loss: nan | Time: 27063.2 ms
[2022-03-08 18:56:51 main:574] : INFO : Epoch 1587 | loss: nan | val_loss: nan | Time: 26399.2 ms
[2022-03-08 18:57:18 main:574] : INFO : Epoch 1588 | loss: nan | val_loss: nan | Time: 26558.5 ms
[2022-03-08 18:57:47 main:574] : INFO : Epoch 1589 | loss: nan | val_loss: nan | Time: 28434.6 ms
[2022-03-08 18:58:13 main:574] : INFO : Epoch 1590 | loss: nan | val_loss: nan | Time: 26526.8 ms
[2022-03-08 18:58:39 main:574] : INFO : Epoch 1591 | loss: nan | val_loss: nan | Time: 25879.5 ms
[2022-03-08 18:59:07 main:574] : INFO : Epoch 1592 | loss: nan | val_loss: nan | Time: 27925.7 ms
[2022-03-08 18:59:33 main:574] : INFO : Epoch 1593 | loss: nan | val_loss: nan | Time: 26026.4 ms
[2022-03-08 18:59:58 main:574] : INFO : Epoch 1594 | loss: nan | val_loss: nan | Time: 25078.8 ms
[2022-03-08 19:00:27 main:574] : INFO : Epoch 1595 | loss: nan | val_loss: nan | Time: 28288.5 ms
[2022-03-08 19:00:59 main:574] : INFO : Epoch 1596 | loss: nan | val_loss: nan | Time: 32373.6 ms
[2022-03-08 19:02:38 main:574] : INFO : Epoch 1597 | loss: nan | val_loss: nan | Time: 99314.5 ms
[2022-03-08 19:04:35 main:574] : INFO : Epoch 1598 | loss: nan | val_loss: nan | Time: 116485 ms
[2022-03-08 19:05:57 main:574] : INFO : Epoch 1599 | loss: nan | val_loss: nan | Time: 81585 ms
[2022-03-08 19:08:34 main:574] : INFO : Epoch 1600 | loss: nan | val_loss: nan | Time: 157381 ms
[2022-03-08 19:11:12 main:574] : INFO : Epoch 1601 | loss: nan | val_loss: nan | Time: 158132 ms
[2022-03-08 19:13:16 main:574] : INFO : Epoch 1602 | loss: nan | val_loss: nan | Time: 124065 ms
[2022-03-08 19:15:01 main:574] : INFO : Epoch 1603 | loss: nan | val_loss: nan | Time: 104950 ms
[2022-03-08 19:16:52 main:574] : INFO : Epoch 1604 | loss: nan | val_loss: nan | Time: 109217 ms
[2022-03-08 19:18:37 main:574] : INFO : Epoch 1605 | loss: nan | val_loss: nan | Time: 104344 ms
[2022-03-08 19:20:33 main:574] : INFO : Epoch 1606 | loss: nan | val_loss: nan | Time: 116421 ms
[2022-03-08 19:22:29 main:574] : INFO : Epoch 1607 | loss: nan | val_loss: nan | Time: 115540 ms
[2022-03-08 19:24:09 main:574] : INFO : Epoch 1608 | loss: nan | val_loss: nan | Time: 99764.3 ms
[2022-03-08 19:25:42 main:574] : INFO : Epoch 1609 | loss: nan | val_loss: nan | Time: 93184 ms
[2022-03-08 19:27:39 main:574] : INFO : Epoch 1610 | loss: nan | val_loss: nan | Time: 116765 ms
[2022-03-08 19:29:12 main:574] : INFO : Epoch 1611 | loss: nan | val_loss: nan | Time: 93347.1 ms
[2022-03-08 19:30:42 main:574] : INFO : Epoch 1612 | loss: nan | val_loss: nan | Time: 89512.2 ms
[2022-03-08 19:32:51 main:574] : INFO : Epoch 1613 | loss: nan | val_loss: nan | Time: 128256 ms
[2022-03-08 19:34:18 main:574] : INFO : Epoch 1614 | loss: nan | val_loss: nan | Time: 87846.4 ms
[2022-03-08 19:35:44 main:574] : INFO : Epoch 1615 | loss: nan | val_loss: nan | Time: 85817.5 ms
[2022-03-08 19:36:56 main:574] : INFO : Epoch 1616 | loss: nan | val_loss: nan | Time: 71799.5 ms
[2022-03-08 19:38:04 main:574] : INFO : Epoch 1617 | loss: nan | val_loss: nan | Time: 67503.5 ms
[2022-03-08 19:39:14 main:574] : INFO : Epoch 1618 | loss: nan | val_loss: nan | Time: 70253.5 ms
[2022-03-08 19:40:26 main:574] : INFO : Epoch 1619 | loss: nan | val_loss: nan | Time: 71829.6 ms
[2022-03-08 19:41:17 main:574] : INFO : Epoch 1620 | loss: nan | val_loss: nan | Time: 50763.6 ms
[2022-03-08 19:44:16 main:574] : INFO : Epoch 1621 | loss: nan | val_loss: nan | Time: 178825 ms
[2022-03-08 19:47:09 main:574] : INFO : Epoch 1622 | loss: nan | val_loss: nan | Time: 165893 ms
[2022-03-08 19:50:40 main:574] : INFO : Epoch 1623 | loss: nan | val_loss: nan | Time: 210710 ms
[2022-03-08 19:53:25 main:574] : INFO : Epoch 1624 | loss: nan | val_loss: nan | Time: 164806 ms
[2022-03-08 19:55:54 main:574] : INFO : Epoch 1625 | loss: nan | val_loss: nan | Time: 149387 ms
[2022-03-08 19:59:05 main:574] : INFO : Epoch 1626 | loss: nan | val_loss: nan | Time: 190732 ms
[2022-03-08 20:01:35 main:574] : INFO : Epoch 1627 | loss: nan | val_loss: nan | Time: 149804 ms
[2022-03-08 20:04:38 main:574] : INFO : Epoch 1628 | loss: nan | val_loss: nan | Time: 183287 ms
[2022-03-08 20:07:19 main:574] : INFO : Epoch 1629 | loss: nan | val_loss: nan | Time: 160936 ms
[2022-03-08 20:10:46 main:574] : INFO : Epoch 1630 | loss: nan | val_loss: nan | Time: 206468 ms
[2022-03-08 20:13:32 main:574] : INFO : Epoch 1631 | loss: nan | val_loss: nan | Time: 166773 ms
[2022-03-08 20:16:13 main:574] : INFO : Epoch 1632 | loss: nan | val_loss: nan | Time: 160423 ms
[2022-03-08 20:17:42 main:574] : INFO : Epoch 1633 | loss: nan | val_loss: nan | Time: 89209.4 ms
[2022-03-08 20:18:12 main:574] : INFO : Epoch 1634 | loss: nan | val_loss: nan | Time: 29801.9 ms
[2022-03-08 20:18:41 main:574] : INFO : Epoch 1635 | loss: nan | val_loss: nan | Time: 28542.1 ms
[2022-03-08 20:19:14 main:574] : INFO : Epoch 1636 | loss: nan | val_loss: nan | Time: 33701.4 ms
[2022-03-08 20:20:06 main:574] : INFO : Epoch 1637 | loss: nan | val_loss: nan | Time: 51551.6 ms
[2022-03-08 20:20:36 main:574] : INFO : Epoch 1638 | loss: nan | val_loss: nan | Time: 29652.8 ms
[2022-03-08 20:21:06 main:574] : INFO : Epoch 1639 | loss: nan | val_loss: nan | Time: 29856.8 ms
[2022-03-08 20:21:36 main:574] : INFO : Epoch 1640 | loss: nan | val_loss: nan | Time: 30387.8 ms
[2022-03-08 20:22:26 main:574] : INFO : Epoch 1641 | loss: nan | val_loss: nan | Time: 49812.1 ms
[2022-03-08 20:22:56 main:574] : INFO : Epoch 1642 | loss: nan | val_loss: nan | Time: 29838.2 ms
[2022-03-08 20:23:26 main:574] : INFO : Epoch 1643 | loss: nan | val_loss: nan | Time: 29850.4 ms
[2022-03-08 20:23:57 main:574] : INFO : Epoch 1644 | loss: nan | val_loss: nan | Time: 30897.2 ms
[2022-03-08 20:27:44 main:574] : INFO : Epoch 1645 | loss: nan | val_loss: nan | Time: 226894 ms
[2022-03-08 20:30:19 main:574] : INFO : Epoch 1646 | loss: nan | val_loss: nan | Time: 155255 ms
[2022-03-08 20:32:42 main:574] : INFO : Epoch 1647 | loss: nan | val_loss: nan | Time: 143211 ms
[2022-03-08 20:34:44 main:574] : INFO : Epoch 1648 | loss: nan | val_loss: nan | Time: 122006 ms
[2022-03-08 20:37:13 main:574] : INFO : Epoch 1649 | loss: nan | val_loss: nan | Time: 148279 ms
[2022-03-08 20:38:24 main:574] : INFO : Epoch 1650 | loss: nan | val_loss: nan | Time: 70665.8 ms
[2022-03-08 20:40:31 main:574] : INFO : Epoch 1651 | loss: nan | val_loss: nan | Time: 126503 ms
[2022-03-08 20:42:17 main:574] : INFO : Epoch 1652 | loss: nan | val_loss: nan | Time: 106169 ms
[2022-03-08 20:44:21 main:574] : INFO : Epoch 1653 | loss: nan | val_loss: nan | Time: 124242 ms
[2022-03-08 20:46:57 main:574] : INFO : Epoch 1654 | loss: nan | val_loss: nan | Time: 156002 ms
[2022-03-08 20:48:20 main:574] : INFO : Epoch 1655 | loss: nan | val_loss: nan | Time: 82265.7 ms
[2022-03-08 20:50:08 main:574] : INFO : Epoch 1656 | loss: nan | val_loss: nan | Time: 108802 ms
[2022-03-08 20:51:47 main:574] : INFO : Epoch 1657 | loss: nan | val_loss: nan | Time: 98774.6 ms
[2022-03-08 20:52:13 main:574] : INFO : Epoch 1658 | loss: nan | val_loss: nan | Time: 25803 ms
[2022-03-08 20:52:42 main:574] : INFO : Epoch 1659 | loss: nan | val_loss: nan | Time: 29054.8 ms
[2022-03-08 20:53:11 main:574] : INFO : Epoch 1660 | loss: nan | val_loss: nan | Time: 29039 ms
[2022-03-08 20:53:39 main:574] : INFO : Epoch 1661 | loss: nan | val_loss: nan | Time: 28026.8 ms
[2022-03-08 20:54:07 main:574] : INFO : Epoch 1662 | loss: nan | val_loss: nan | Time: 27916.9 ms
[2022-03-08 20:54:35 main:574] : INFO : Epoch 1663 | loss: nan | val_loss: nan | Time: 27790.9 ms
[2022-03-08 20:55:01 main:574] : INFO : Epoch 1664 | loss: nan | val_loss: nan | Time: 25859 ms
[2022-03-08 20:55:29 main:574] : INFO : Epoch 1665 | loss: nan | val_loss: nan | Time: 27654.3 ms
[2022-03-08 20:55:55 main:574] : INFO : Epoch 1666 | loss: nan | val_loss: nan | Time: 26392.6 ms
[2022-03-08 20:56:20 main:574] : INFO : Epoch 1667 | loss: nan | val_loss: nan | Time: 25081.9 ms
[2022-03-08 20:56:49 main:574] : INFO : Epoch 1668 | loss: nan | val_loss: nan | Time: 28091.1 ms
[2022-03-08 20:57:16 main:574] : INFO : Epoch 1669 | loss: nan | val_loss: nan | Time: 27046.9 ms
[2022-03-08 20:57:56 main:574] : INFO : Epoch 1670 | loss: nan | val_loss: nan | Time: 40108.6 ms
[2022-03-08 20:58:28 main:574] : INFO : Epoch 1671 | loss: nan | val_loss: nan | Time: 32579.1 ms
[2022-03-08 20:58:55 main:574] : INFO : Epoch 1672 | loss: nan | val_loss: nan | Time: 26034.9 ms
[2022-03-08 20:59:25 main:574] : INFO : Epoch 1673 | loss: nan | val_loss: nan | Time: 30582 ms
[2022-03-08 20:59:57 main:574] : INFO : Epoch 1674 | loss: nan | val_loss: nan | Time: 31918.2 ms
[2022-03-08 21:00:26 main:574] : INFO : Epoch 1675 | loss: nan | val_loss: nan | Time: 28543.5 ms
[2022-03-08 21:00:56 main:574] : INFO : Epoch 1676 | loss: nan | val_loss: nan | Time: 29824.1 ms
[2022-03-08 21:01:27 main:574] : INFO : Epoch 1677 | loss: nan | val_loss: nan | Time: 30926 ms
[2022-03-08 21:01:52 main:574] : INFO : Epoch 1678 | loss: nan | val_loss: nan | Time: 25191.3 ms
[2022-03-08 21:02:21 main:574] : INFO : Epoch 1679 | loss: nan | val_loss: nan | Time: 28700.5 ms
[2022-03-08 21:02:48 main:574] : INFO : Epoch 1680 | loss: nan | val_loss: nan | Time: 27676.3 ms
[2022-03-08 21:03:18 main:574] : INFO : Epoch 1681 | loss: nan | val_loss: nan | Time: 29629.5 ms
[2022-03-08 21:03:44 main:574] : INFO : Epoch 1682 | loss: nan | val_loss: nan | Time: 26166 ms
[2022-03-08 21:04:12 main:574] : INFO : Epoch 1683 | loss: nan | val_loss: nan | Time: 27917.8 ms
[2022-03-08 21:04:44 main:574] : INFO : Epoch 1684 | loss: nan | val_loss: nan | Time: 32189.5 ms
[2022-03-08 21:06:11 main:574] : INFO : Epoch 1685 | loss: nan | val_loss: nan | Time: 86163.8 ms
[2022-03-08 21:07:12 main:574] : INFO : Epoch 1686 | loss: nan | val_loss: nan | Time: 61737.3 ms
[2022-03-08 21:08:02 main:574] : INFO : Epoch 1687 | loss: nan | val_loss: nan | Time: 49721.6 ms
[2022-03-08 21:08:38 main:574] : INFO : Epoch 1688 | loss: nan | val_loss: nan | Time: 35374.1 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1060 6GB)
[2022-03-08 21:23:20 main:435] : INFO : Set logging level to 1
[2022-03-08 21:23:21 main:441] : INFO : Running in BOINC Client mode
[2022-03-08 21:23:21 main:444] : INFO : Resolving all filenames
[2022-03-08 21:23:21 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-08 21:23:21 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-08 21:23:22 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-08 21:23:22 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-08 21:23:22 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-08 21:23:23 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-03-08 21:23:23 main:474] : INFO : Configuration:
[2022-03-08 21:23:23 main:475] : INFO : Model type: GRU
[2022-03-08 21:23:23 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-03-08 21:23:23 main:477] : INFO : Max Epochs: 2048
[2022-03-08 21:23:23 main:478] : INFO : Batch Size: 128
[2022-03-08 21:23:23 main:479] : INFO : Learning Rate: 0.01
[2022-03-08 21:23:24 main:480] : INFO : Patience: 10
[2022-03-08 21:23:24 main:481] : INFO : Hidden Width: 12
[2022-03-08 21:23:24 main:482] : INFO : # Recurrent Layers: 4
[2022-03-08 21:23:25 main:483] : INFO : # Backend Layers: 4
[2022-03-08 21:23:25 main:484] : INFO : # Threads: 1
[2022-03-08 21:23:25 main:486] : INFO : Preparing Dataset
[2022-03-08 21:23:25 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-08 21:23:37 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
[2022-03-08 21:24:06 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2022-03-08 21:24:06 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory
[2022-03-08 21:24:06 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory
[2022-03-08 21:24:06 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2022-03-08 21:24:06 main:494] : INFO : Creating Model
[2022-03-08 21:24:07 main:507] : INFO : Preparing config file
[2022-03-08 21:24:07 main:511] : INFO : Found checkpoint, attempting to load...
[2022-03-08 21:24:07 main:512] : INFO : Loading config
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFEEC0E4F69
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 03/08/22 21:24:07
Install Directory : D:\Program Files\
Data Directory : D:\ProgramData
Project Symstore :
LoadLibraryA( D:\ProgramData\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( D:\ProgramData\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( D:\ProgramData\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( D:\ProgramData\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: D:\ProgramData\slots\5;D:\ProgramData\projects\www.mlcathome.org_mlcathome
ModLoad: 0000000014a40000 00000000003df000 D:\ProgramData\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000ee730000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000ecf00000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000ec0b0000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000b96f0000 0000000000112000 C:\Program Files\Bitdefender\Bitdefender Security\atcuf\dlls_265766195282433101\atcuf64.dll (1.46.325.0) (-exported- Symbols Loaded)
Linked PDB Filename : E:\builds\ATC-DEFAULT-SOURCES\bin\x64\Release\atcuf64\atcuf64.pdb
File Version : 1.46.325.0 #0x6353f486c
Company Name : Bitdefender S.R.L. Bucharest, ROMANIA
Product Name : Bitdefender® ATC
Product Version : 4
ModLoad: 00000000ed1d0000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000ec6b0000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1586) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1586
ModLoad: 00000000ed370000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.1202 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1202
ModLoad: 00000000ec380000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000ebe50000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 00000000ebf80000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 00000000ec8b0000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000ec7b0000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.19041.546
ModLoad: 00000000ed040000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.1586) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000ed3a0000 0000000000125000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000ae4f0000 0000000000058000 D:\ProgramData\slots\5\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000007cbf0000 0000000024b49000 D:\ProgramData\slots\5\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000006f0e0000 000000000abe7000 D:\ProgramData\slots\5\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000da1a0000 000000000008e000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.30.30708.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\a01\_work\43\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.30.30708.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.30.30708.0
ModLoad: 00000000e3bb0000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.867 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.867
ModLoad: 00000000da170000 000000000001b000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.30.30708.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\a01\_work\43\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.30.30708.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.30.30708.0
ModLoad: 00000000da190000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.30.30708.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\a01\_work\43\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.30.30708.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.30.30708.0
ModLoad: 000000006e8d0000 0000000000045000 D:\ProgramData\slots\5\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000006a780000 00000000030a5000 D:\ProgramData\slots\5\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 00000000672c0000 00000000034b2000 D:\ProgramData\slots\5\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 000000004bf10000 000000001b3a4000 D:\ProgramData\slots\5\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 00000000ae3e0000 0000000000010000 D:\ProgramData\slots\5\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 0000000042d70000 000000000919f000 D:\ProgramData\slots\5\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 000000003f010000 0000000003d5b000 D:\ProgramData\slots\5\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000a39b0000 000000000020d000 D:\ProgramData\slots\5\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 000000007a030000 00000000002db000 D:\ProgramData\slots\5\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000003d140000 0000000001eca000 D:\ProgramData\slots\5\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000a3970000 0000000000040000 D:\ProgramData\slots\5\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000e21e0000 000000000002c000 C:\WINDOWS\SYSTEM32\dbgcore.DLL (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : dbgcore.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 00000000ed680000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000e9d80000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000ee280000 0000000000470000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000ec660000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1151
ModLoad: 00000000ec080000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000ebb80000 0000000000033000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000ec490000 0000000000068000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000ec500000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000eb9c0000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000ed7a0000 0000000000744000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.964 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.964
ModLoad: 00000000e9f80000 0000000000794000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000ecba0000 0000000000354000 C:\WINDOWS\System32\combase.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.1320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1320
ModLoad: 00000000eb7e0000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000edf50000 00000000000ad000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000edef0000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000a4630000 00000000002cd000 C:\WINDOWS\system32\nvcuda.dll (30.0.15.1165) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_37\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 30.0.15.1165
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.6.99 driver
Product Version : 30.0.15.1165
ModLoad: 000000007a310000 00000000016a0000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispsi.inf_amd64_145fe9c72c40de0a\nvcuda64.dll (30.0.15.1165) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_37\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 30.0.15.1165
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.6.99 driver
Product Version : 30.0.15.1165
ModLoad: 00000000e5530000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000e5900000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.906 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.906
ModLoad: 00000000e0b70000 0000000000148000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : drvstore.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000eb750000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000dfec0000 0000000000768000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.15.1165) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_37\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 30.0.15.1165
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 30.0.15.1165
ModLoad: 00000000ebef0000 0000000000082000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.1415 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1415
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 3635, Write: 308, Other 800
- I/O Transfers Counters -
Read: 6699784, Write: 6059, Other 37030
- Paged Pool Usage -
QuotaPagedPoolUsage: 3435936, QuotaPeakPagedPoolUsage: 3435936
QuotaNonPagedPoolUsage: 40592, QuotaPeakNonPagedPoolUsage: 40592
- Virtual Memory Usage -
VirtualSize: -1437499392, PeakVirtualSize: -834469888
- Pagefile Usage -
PagefileUsage: -1437499392, PeakPagefileUsage: -1437499392
- Working Set Size -
WorkingSetSize: 1153949696, PeakWorkingSetSize: 1153953792, PageFaultCount: 393706
*** Dump of thread ID 13272 (state: Ready): ***
- Information -
Status: Base Priority: Above Normal, Priority: Highest, , Kernel Time: 12500000.000000, User Time: 32343750.000000, Wait Time: 14327.000000
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFEEC0E4F69
- Registers -
rax=00000000ee75b86b rbx=0000000014da4910 rcx=0000000004e70312 rdx=000000000000001c rsi=00000000c19c66f0 rdi=0000000019930520
r8=00000000fe701440 r9=00000000fe7a0000 r10=00000000fe700000 r11=00000000fe7002b0 r12=00000000b1732bd0 r13=00000000c19c6900
r14=00000000dda67eb0 r15=0000000000000000 rip=00000000ec0e4f69 rsp=00000000c19c6590 rbp=00000000c19c6880
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000206
- Callstack -
ChildEBP RetAddr Args to Child
c19c6660 14cba884 00000040 0000004f b1731a00 c19c6728 KERNELBASE!RaiseException+0x0
c19c66c0 14a61ca6 c19c6730 00000000 dc16e1a8 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
c19c6770 14a6593b 00000074 c19c69d8 00000800 00000001 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
c19c68c0 14a61a78 00000000 00000000 c19c6bf0 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
c19c6990 14a61cfc c19c6bf0 00000000 00000080 c19c6ec0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
c19c6a50 14a6c4dd c19c6ec0 c19c6ec0 c19c6ec0 c19c6ec0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
c19c6d40 14a5b2fe c19c7358 c19c6ec0 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
c19dfae0 14c9c6f8 80eda140 00000000 00000000 807dc3f0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
c19dfb20 ecf17034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
c19dfb50 ee782651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
c19dfbd0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 6052 (state: Waiting): ***
- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 156250.000000, Wait Time: 14326.000000
- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000c1dffcb0 rsi=0000000000000000 rdi=0000000000000064
r8=00000000c1dffc88 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000ee7cd3f4 rsp=00000000c1dffc88 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
c1dffc80 ec0f962e c1dffd48 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0
c1dffd20 14a7a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0
c1dffd50 ecf17034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
c1dffd80 ee782651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
c1dffe00 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 12636 (state: Waiting): ***
- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 12912.000000
- Registers -
rax=00000000000001d3 rbx=0000000081a5fb30 rcx=0000000000000014 rdx=0000000081a5f7b0 rsi=00000000fe7a0b50 rdi=0000000081a5fb30
r8=0000000000000000 r9=00000000ea697560 r10=000000007ffe03b0 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000ee7d07c4 rsp=00000000c1eff808 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
c1eff800 ee782dc7 81046678 81046678 fe7a0b50 00000000 ntdll!ZwWaitForWorkViaWorkerFactory+0x0
c1effb00 ecf17034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0
c1effb30 ee782651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
c1effbb0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 11904 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 14326.000000
- Registers -
rax=000000000000005b rbx=0000000000000006 rcx=0000000000000006 rdx=00000000c1fffb70 rsi=0000000000000000 rdi=0000000000000006
r8=0000000000000001 r9=0000000081072800 r10=0000000000000000 r11=00000000c1fffae0 r12=0000000000000064 r13=00000000c1fffb70
r14=00000000c1fff870 r15=0000000000000000 rip=00000000ee7cd8c4 rsp=00000000c1fff818 rbp=0000000081072890
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
c1fff810 ec0fcb20 00000000 b96f474c ee89a4d0 c1b33000 ntdll!ZwWaitForMultipleObjects+0x0
c1fffb00 ec0fca1e 00000202 ec0da395 00000006 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
c1fffb40 7a4ed554 810755f0 00000000 b97efe30 b9704677 KERNELBASE!WaitForMultipleObjects+0x0
c1fffd80 7a5958cd 00000000 81072890 00000000 00000000 nvcuda64!+0x0
c1fffe30 7a4ecf23 862cefb9 7a35fba3 81685360 00000000 nvcuda64!cuProfilerStop+0x0
c1fffe60 7a8244c4 81685360 00000000 00000000 00000000 nvcuda64!+0x0
c1fffe90 ecf17034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
c1fffec0 ee782651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
c1ffff40 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)