Task 7356190
| Name | ParityModified-1630353045-3193-3_0 |
| Workunit | 5033031 |
| Created | 15 Sep 2021, 12:31:11 UTC |
| Sent | 15 Sep 2021, 12:31:15 UTC |
| Report deadline | 22 Sep 2021, 12:31:15 UTC |
| Received | 15 Sep 2021, 13:29:05 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | -529697949 (0xE06D7363) Unknown error code |
| Computer ID | 6746 |
| Run time | 54 min 54 sec |
| CPU time | 53 min 7 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 4,733.95 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.64 GB |
| Peak swap size | 3.62 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.7</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code -529697949 (0xe06d7363)</message>
<stderr_txt>
1602 | loss: 0.0311331 | val_loss: 0.0311567 | Time: 1756.12 ms
[2021-09-15 15:21:03 main:574] : INFO : Epoch 1603 | loss: 0.0311319 | val_loss: 0.0311563 | Time: 1767.58 ms
[2021-09-15 15:21:04 main:574] : INFO : Epoch 1604 | loss: 0.0311301 | val_loss: 0.0311549 | Time: 1917.22 ms
[2021-09-15 15:21:06 main:574] : INFO : Epoch 1605 | loss: 0.0311294 | val_loss: 0.031157 | Time: 1807.25 ms
[2021-09-15 15:21:08 main:574] : INFO : Epoch 1606 | loss: 0.0311319 | val_loss: 0.0311632 | Time: 1825.38 ms
[2021-09-15 15:21:10 main:574] : INFO : Epoch 1607 | loss: 0.0311328 | val_loss: 0.0311606 | Time: 1843.86 ms
[2021-09-15 15:21:12 main:574] : INFO : Epoch 1608 | loss: 0.0311273 | val_loss: 0.0311603 | Time: 1838.42 ms
[2021-09-15 15:21:14 main:574] : INFO : Epoch 1609 | loss: 0.0311275 | val_loss: 0.0311592 | Time: 1774.43 ms
[2021-09-15 15:21:15 main:574] : INFO : Epoch 1610 | loss: 0.0311274 | val_loss: 0.0311542 | Time: 1789.03 ms
[2021-09-15 15:21:17 main:574] : INFO : Epoch 1611 | loss: 0.0311264 | val_loss: 0.0311557 | Time: 1862.45 ms
[2021-09-15 15:21:19 main:574] : INFO : Epoch 1612 | loss: 0.0311284 | val_loss: 0.0311552 | Time: 1779.25 ms
[2021-09-15 15:21:21 main:574] : INFO : Epoch 1613 | loss: 0.0311305 | val_loss: 0.031155 | Time: 2087.13 ms
[2021-09-15 15:21:23 main:574] : INFO : Epoch 1614 | loss: 0.0311255 | val_loss: 0.0311578 | Time: 1752.29 ms
[2021-09-15 15:21:25 main:574] : INFO : Epoch 1615 | loss: 0.0311261 | val_loss: 0.0311576 | Time: 1887.48 ms
[2021-09-15 15:21:27 main:574] : INFO : Epoch 1616 | loss: 0.0311246 | val_loss: 0.0311561 | Time: 1813.02 ms
[2021-09-15 15:21:29 main:574] : INFO : Epoch 1617 | loss: 0.0311283 | val_loss: 0.0311581 | Time: 1934.29 ms
[2021-09-15 15:21:30 main:574] : INFO : Epoch 1618 | loss: 0.0311269 | val_loss: 0.0311564 | Time: 1776.27 ms
[2021-09-15 15:21:32 main:574] : INFO : Epoch 1619 | loss: 0.0311279 | val_loss: 0.031162 | Time: 1715.26 ms
[2021-09-15 15:21:34 main:574] : INFO : Epoch 1620 | loss: 0.0311291 | val_loss: 0.0311619 | Time: 1748.46 ms
[2021-09-15 15:21:36 main:574] : INFO : Epoch 1621 | loss: 0.031128 | val_loss: 0.0311566 | Time: 1792.27 ms
[2021-09-15 15:21:37 main:574] : INFO : Epoch 1622 | loss: 0.0311274 | val_loss: 0.0311611 | Time: 1731.02 ms
[2021-09-15 15:21:39 main:574] : INFO : Epoch 1623 | loss: 0.0311287 | val_loss: 0.0311653 | Time: 1747.44 ms
[2021-09-15 15:21:41 main:574] : INFO : Epoch 1624 | loss: 0.0311307 | val_loss: 0.0311539 | Time: 1753.03 ms
[2021-09-15 15:21:43 main:574] : INFO : Epoch 1625 | loss: 0.0311289 | val_loss: 0.031157 | Time: 1734.38 ms
[2021-09-15 15:21:44 main:574] : INFO : Epoch 1626 | loss: 0.0311279 | val_loss: 0.0311541 | Time: 1790.66 ms
[2021-09-15 15:21:46 main:574] : INFO : Epoch 1627 | loss: 0.0311292 | val_loss: 0.0311547 | Time: 1761.38 ms
[2021-09-15 15:21:48 main:574] : INFO : Epoch 1628 | loss: 0.0311315 | val_loss: 0.0311565 | Time: 1810.12 ms
[2021-09-15 15:21:50 main:574] : INFO : Epoch 1629 | loss: 0.0311254 | val_loss: 0.031159 | Time: 1779.25 ms
[2021-09-15 15:21:51 main:574] : INFO : Epoch 1630 | loss: 0.0311247 | val_loss: 0.0311559 | Time: 1736.93 ms
[2021-09-15 15:21:53 main:574] : INFO : Epoch 1631 | loss: 0.031126 | val_loss: 0.0311538 | Time: 1805.84 ms
[2021-09-15 15:21:55 main:574] : INFO : Epoch 1632 | loss: 0.0311244 | val_loss: 0.031157 | Time: 1744.52 ms
[2021-09-15 15:21:57 main:574] : INFO : Epoch 1633 | loss: 0.031124 | val_loss: 0.0311582 | Time: 1741.97 ms
[2021-09-15 15:21:59 main:574] : INFO : Epoch 1634 | loss: 0.0311238 | val_loss: 0.0311594 | Time: 1750.99 ms
[2021-09-15 15:22:00 main:574] : INFO : Epoch 1635 | loss: 0.0311238 | val_loss: 0.0311516 | Time: 1818.93 ms
[2021-09-15 15:22:02 main:574] : INFO : Epoch 1636 | loss: 0.0311275 | val_loss: 0.0311588 | Time: 1761.47 ms
[2021-09-15 15:22:04 main:574] : INFO : Epoch 1637 | loss: 0.03114 | val_loss: 0.0311561 | Time: 1772.87 ms
[2021-09-15 15:22:06 main:574] : INFO : Epoch 1638 | loss: 0.0311373 | val_loss: 0.0311507 | Time: 1770.94 ms
[2021-09-15 15:22:07 main:574] : INFO : Epoch 1639 | loss: 0.031136 | val_loss: 0.0311524 | Time: 1758.67 ms
[2021-09-15 15:22:09 main:574] : INFO : Epoch 1640 | loss: 0.0311331 | val_loss: 0.0311545 | Time: 1830.84 ms
[2021-09-15 15:22:11 main:574] : INFO : Epoch 1641 | loss: 0.0311349 | val_loss: 0.0311526 | Time: 1750.43 ms
[2021-09-15 15:22:13 main:574] : INFO : Epoch 1642 | loss: 0.0311346 | val_loss: 0.0311622 | Time: 1792.44 ms
[2021-09-15 15:22:15 main:574] : INFO : Epoch 1643 | loss: 0.0311335 | val_loss: 0.0311599 | Time: 1798.88 ms
[2021-09-15 15:22:16 main:574] : INFO : Epoch 1644 | loss: 0.031131 | val_loss: 0.0311573 | Time: 1781.1 ms
[2021-09-15 15:22:18 main:574] : INFO : Epoch 1645 | loss: 0.0311301 | val_loss: 0.0311571 | Time: 1731.97 ms
[2021-09-15 15:22:20 main:574] : INFO : Epoch 1646 | loss: 0.0311288 | val_loss: 0.0311539 | Time: 1793.19 ms
[2021-09-15 15:22:22 main:574] : INFO : Epoch 1647 | loss: 0.0311287 | val_loss: 0.0311559 | Time: 1747.36 ms
[2021-09-15 15:22:23 main:574] : INFO : Epoch 1648 | loss: 0.0311297 | val_loss: 0.0311611 | Time: 1735.41 ms
[2021-09-15 15:22:25 main:574] : INFO : Epoch 1649 | loss: 0.0311294 | val_loss: 0.0311575 | Time: 1773.96 ms
[2021-09-15 15:22:27 main:574] : INFO : Epoch 1650 | loss: 0.0311313 | val_loss: 0.0311536 | Time: 1785.07 ms
[2021-09-15 15:22:29 main:574] : INFO : Epoch 1651 | loss: 0.0311298 | val_loss: 0.0311624 | Time: 1745.95 ms
[2021-09-15 15:22:31 main:574] : INFO : Epoch 1652 | loss: 0.0311283 | val_loss: 0.031161 | Time: 1775.63 ms
[2021-09-15 15:22:32 main:574] : INFO : Epoch 1653 | loss: 0.0311289 | val_loss: 0.0311546 | Time: 1785.83 ms
[2021-09-15 15:22:34 main:574] : INFO : Epoch 1654 | loss: 0.0311304 | val_loss: 0.0311528 | Time: 1724.25 ms
[2021-09-15 15:22:36 main:574] : INFO : Epoch 1655 | loss: 0.0311315 | val_loss: 0.0311628 | Time: 1743.88 ms
[2021-09-15 15:22:38 main:574] : INFO : Epoch 1656 | loss: 0.0311345 | val_loss: 0.0311529 | Time: 1761.47 ms
[2021-09-15 15:22:39 main:574] : INFO : Epoch 1657 | loss: 0.0311341 | val_loss: 0.0311501 | Time: 1765.21 ms
[2021-09-15 15:22:41 main:574] : INFO : Epoch 1658 | loss: 0.0311368 | val_loss: 0.0311511 | Time: 1750.86 ms
[2021-09-15 15:22:43 main:574] : INFO : Epoch 1659 | loss: 0.0311341 | val_loss: 0.0311523 | Time: 1778.26 ms
[2021-09-15 15:22:45 main:574] : INFO : Epoch 1660 | loss: 0.0311359 | val_loss: 0.0311503 | Time: 1767.87 ms
[2021-09-15 15:22:46 main:574] : INFO : Epoch 1661 | loss: 0.0311312 | val_loss: 0.0311466 | Time: 1755.72 ms
[2021-09-15 15:22:48 main:574] : INFO : Epoch 1662 | loss: 0.0311316 | val_loss: 0.0311506 | Time: 1713.99 ms
[2021-09-15 15:22:50 main:574] : INFO : Epoch 1663 | loss: 0.0311319 | val_loss: 0.0311481 | Time: 1743.15 ms
[2021-09-15 15:22:52 main:574] : INFO : Epoch 1664 | loss: 0.0311325 | val_loss: 0.0311473 | Time: 1768.19 ms
[2021-09-15 15:22:53 main:574] : INFO : Epoch 1665 | loss: 0.031131 | val_loss: 0.0311512 | Time: 1772.36 ms
[2021-09-15 15:22:55 main:574] : INFO : Epoch 1666 | loss: 0.0311286 | val_loss: 0.0311472 | Time: 1779.63 ms
[2021-09-15 15:22:57 main:574] : INFO : Epoch 1667 | loss: 0.0311282 | val_loss: 0.0311465 | Time: 1747.99 ms
[2021-09-15 15:22:59 main:574] : INFO : Epoch 1668 | loss: 0.0311264 | val_loss: 0.0311443 | Time: 1740.42 ms
[2021-09-15 15:23:00 main:574] : INFO : Epoch 1669 | loss: 0.0311255 | val_loss: 0.0311508 | Time: 1763.23 ms
[2021-09-15 15:23:02 main:574] : INFO : Epoch 1670 | loss: 0.0311272 | val_loss: 0.0311461 | Time: 1748.51 ms
[2021-09-15 15:23:04 main:574] : INFO : Epoch 1671 | loss: 0.0311266 | val_loss: 0.0311507 | Time: 1751.67 ms
[2021-09-15 15:23:06 main:574] : INFO : Epoch 1672 | loss: 0.0311301 | val_loss: 0.0311505 | Time: 1769.51 ms
[2021-09-15 15:23:07 main:574] : INFO : Epoch 1673 | loss: 0.0311294 | val_loss: 0.0311494 | Time: 1761.53 ms
[2021-09-15 15:23:09 main:574] : INFO : Epoch 1674 | loss: 0.0311299 | val_loss: 0.031152 | Time: 1793.17 ms
[2021-09-15 15:23:11 main:574] : INFO : Epoch 1675 | loss: 0.0311281 | val_loss: 0.0311506 | Time: 1741.17 ms
[2021-09-15 15:23:13 main:574] : INFO : Epoch 1676 | loss: 0.0311291 | val_loss: 0.0311486 | Time: 1735.56 ms
[2021-09-15 15:23:15 main:574] : INFO : Epoch 1677 | loss: 0.0311318 | val_loss: 0.0311526 | Time: 1751.4 ms
[2021-09-15 15:23:16 main:574] : INFO : Epoch 1678 | loss: 0.0311304 | val_loss: 0.0311486 | Time: 1710.72 ms
[2021-09-15 15:23:18 main:574] : INFO : Epoch 1679 | loss: 0.0311317 | val_loss: 0.0311533 | Time: 1746.87 ms
[2021-09-15 15:23:20 main:574] : INFO : Epoch 1680 | loss: 0.0311284 | val_loss: 0.0311479 | Time: 1744.98 ms
[2021-09-15 15:23:22 main:574] : INFO : Epoch 1681 | loss: 0.0311274 | val_loss: 0.031154 | Time: 1737.37 ms
[2021-09-15 15:23:23 main:574] : INFO : Epoch 1682 | loss: 0.0311322 | val_loss: 0.0311455 | Time: 1774.17 ms
[2021-09-15 15:23:25 main:574] : INFO : Epoch 1683 | loss: 0.03113 | val_loss: 0.0311513 | Time: 1779.17 ms
[2021-09-15 15:23:27 main:574] : INFO : Epoch 1684 | loss: 0.0311291 | val_loss: 0.0311504 | Time: 1770.89 ms
[2021-09-15 15:23:29 main:574] : INFO : Epoch 1685 | loss: 0.0311288 | val_loss: 0.0311536 | Time: 1731.05 ms
[2021-09-15 15:23:30 main:574] : INFO : Epoch 1686 | loss: 0.0311301 | val_loss: 0.0311506 | Time: 1765.35 ms
[2021-09-15 15:23:32 main:574] : INFO : Epoch 1687 | loss: 0.0311279 | val_loss: 0.0311492 | Time: 1742.68 ms
[2021-09-15 15:23:34 main:574] : INFO : Epoch 1688 | loss: 0.0311274 | val_loss: 0.0311532 | Time: 1714.02 ms
[2021-09-15 15:23:36 main:574] : INFO : Epoch 1689 | loss: 0.0311262 | val_loss: 0.0311476 | Time: 1754.74 ms
[2021-09-15 15:23:37 main:574] : INFO : Epoch 1690 | loss: 0.0311255 | val_loss: 0.0311502 | Time: 1793.02 ms
[2021-09-15 15:23:39 main:574] : INFO : Epoch 1691 | loss: 0.0311289 | val_loss: 0.0311511 | Time: 1812.72 ms
[2021-09-15 15:23:41 main:574] : INFO : Epoch 1692 | loss: 0.0311265 | val_loss: 0.0311471 | Time: 1731.73 ms
[2021-09-15 15:23:43 main:574] : INFO : Epoch 1693 | loss: 0.0311245 | val_loss: 0.0311534 | Time: 1733.69 ms
[2021-09-15 15:23:44 main:574] : INFO : Epoch 1694 | loss: 0.0311244 | val_loss: 0.0311493 | Time: 1748.76 ms
[2021-09-15 15:23:46 main:574] : INFO : Epoch 1695 | loss: 0.0311239 | val_loss: 0.0311462 | Time: 1727.36 ms
[2021-09-15 15:23:48 main:574] : INFO : Epoch 1696 | loss: 0.0311249 | val_loss: 0.0311506 | Time: 1797.95 ms
[2021-09-15 15:23:50 main:574] : INFO : Epoch 1697 | loss: 0.0311238 | val_loss: 0.0311496 | Time: 1748.69 ms
[2021-09-15 15:23:52 main:574] : INFO : Epoch 1698 | loss: 0.0311235 | val_loss: 0.031149 | Time: 1785.93 ms
[2021-09-15 15:23:53 main:574] : INFO : Epoch 1699 | loss: 0.031123 | val_loss: 0.0311484 | Time: 1729.3 ms
[2021-09-15 15:23:55 main:574] : INFO : Epoch 1700 | loss: 0.0311231 | val_loss: 0.0311493 | Time: 1774.49 ms
[2021-09-15 15:23:57 main:574] : INFO : Epoch 1701 | loss: 0.0311244 | val_loss: 0.0311499 | Time: 1760.07 ms
[2021-09-15 15:23:59 main:574] : INFO : Epoch 1702 | loss: 0.0311231 | val_loss: 0.031148 | Time: 1752.95 ms
[2021-09-15 15:24:00 main:574] : INFO : Epoch 1703 | loss: 0.031123 | val_loss: 0.0311548 | Time: 1745.46 ms
[2021-09-15 15:24:02 main:574] : INFO : Epoch 1704 | loss: 0.0311216 | val_loss: 0.0311498 | Time: 1797.62 ms
[2021-09-15 15:24:04 main:574] : INFO : Epoch 1705 | loss: 0.0311235 | val_loss: 0.031152 | Time: 1766.36 ms
[2021-09-15 15:24:06 main:574] : INFO : Epoch 1706 | loss: 0.0311268 | val_loss: 0.0311462 | Time: 1715.3 ms
[2021-09-15 15:24:07 main:574] : INFO : Epoch 1707 | loss: 0.031126 | val_loss: 0.0311505 | Time: 1749.96 ms
[2021-09-15 15:24:09 main:574] : INFO : Epoch 1708 | loss: 0.0311232 | val_loss: 0.0311475 | Time: 1745.66 ms
[2021-09-15 15:24:11 main:574] : INFO : Epoch 1709 | loss: 0.0311254 | val_loss: 0.031148 | Time: 1739.01 ms
[2021-09-15 15:24:13 main:574] : INFO : Epoch 1710 | loss: 0.031126 | val_loss: 0.0311494 | Time: 1766.42 ms
[2021-09-15 15:24:14 main:574] : INFO : Epoch 1711 | loss: 0.0311291 | val_loss: 0.0311564 | Time: 1761.11 ms
[2021-09-15 15:24:16 main:574] : INFO : Epoch 1712 | loss: 0.0311315 | val_loss: 0.0311497 | Time: 1797.65 ms
[2021-09-15 15:24:18 main:574] : INFO : Epoch 1713 | loss: 0.0311328 | val_loss: 0.0311486 | Time: 1732.43 ms
[2021-09-15 15:24:20 main:574] : INFO : Epoch 1714 | loss: 0.0311278 | val_loss: 0.0311525 | Time: 1797.13 ms
[2021-09-15 15:24:22 main:574] : INFO : Epoch 1715 | loss: 0.0311266 | val_loss: 0.0311512 | Time: 1790.65 ms
[2021-09-15 15:24:23 main:574] : INFO : Epoch 1716 | loss: 0.031127 | val_loss: 0.0311504 | Time: 1745.92 ms
[2021-09-15 15:24:25 main:574] : INFO : Epoch 1717 | loss: 0.0311277 | val_loss: 0.0311506 | Time: 1770.46 ms
[2021-09-15 15:24:27 main:574] : INFO : Epoch 1718 | loss: 0.0311309 | val_loss: 0.0311531 | Time: 1728.65 ms
[2021-09-15 15:24:29 main:574] : INFO : Epoch 1719 | loss: 0.0311318 | val_loss: 0.0311515 | Time: 1726.36 ms
[2021-09-15 15:24:30 main:574] : INFO : Epoch 1720 | loss: 0.0311279 | val_loss: 0.0311478 | Time: 1740.02 ms
[2021-09-15 15:24:32 main:574] : INFO : Epoch 1721 | loss: 0.0311279 | val_loss: 0.031155 | Time: 1779.09 ms
[2021-09-15 15:24:34 main:574] : INFO : Epoch 1722 | loss: 0.0311352 | val_loss: 0.0311527 | Time: 1736.26 ms
[2021-09-15 15:24:36 main:574] : INFO : Epoch 1723 | loss: 0.03113 | val_loss: 0.031151 | Time: 1727.23 ms
[2021-09-15 15:24:37 main:574] : INFO : Epoch 1724 | loss: 0.0311275 | val_loss: 0.0311476 | Time: 1763.78 ms
[2021-09-15 15:24:39 main:574] : INFO : Epoch 1725 | loss: 0.031127 | val_loss: 0.0311555 | Time: 1799.23 ms
[2021-09-15 15:24:41 main:574] : INFO : Epoch 1726 | loss: 0.0311296 | val_loss: 0.0311501 | Time: 1744.88 ms
[2021-09-15 15:24:43 main:574] : INFO : Epoch 1727 | loss: 0.031128 | val_loss: 0.0311514 | Time: 1772.01 ms
[2021-09-15 15:24:44 main:574] : INFO : Epoch 1728 | loss: 0.0311273 | val_loss: 0.0311531 | Time: 1777.64 ms
[2021-09-15 15:24:46 main:574] : INFO : Epoch 1729 | loss: 0.0311305 | val_loss: 0.0311495 | Time: 1810.89 ms
[2021-09-15 15:24:48 main:574] : INFO : Epoch 1730 | loss: 0.0311297 | val_loss: 0.0311511 | Time: 1824.19 ms
[2021-09-15 15:24:50 main:574] : INFO : Epoch 1731 | loss: 0.0311268 | val_loss: 0.0311551 | Time: 1786.92 ms
[2021-09-15 15:24:52 main:574] : INFO : Epoch 1732 | loss: 0.0311261 | val_loss: 0.0311483 | Time: 1728.88 ms
[2021-09-15 15:24:53 main:574] : INFO : Epoch 1733 | loss: 0.0311255 | val_loss: 0.0311518 | Time: 1709.34 ms
[2021-09-15 15:24:55 main:574] : INFO : Epoch 1734 | loss: 0.0311242 | val_loss: 0.0311497 | Time: 1739.75 ms
[2021-09-15 15:24:57 main:574] : INFO : Epoch 1735 | loss: 0.0311246 | val_loss: 0.0311534 | Time: 1808.29 ms
[2021-09-15 15:24:59 main:574] : INFO : Epoch 1736 | loss: 0.0311225 | val_loss: 0.0311501 | Time: 1800.25 ms
[2021-09-15 15:25:00 main:574] : INFO : Epoch 1737 | loss: 0.0311253 | val_loss: 0.0311556 | Time: 1752.05 ms
[2021-09-15 15:25:02 main:574] : INFO : Epoch 1738 | loss: 0.0311256 | val_loss: 0.0311519 | Time: 1915.73 ms
[2021-09-15 15:25:04 main:574] : INFO : Epoch 1739 | loss: 0.0311275 | val_loss: 0.0311518 | Time: 2024.91 ms
[2021-09-15 15:25:06 main:574] : INFO : Epoch 1740 | loss: 0.0311304 | val_loss: 0.0311553 | Time: 1797.91 ms
[2021-09-15 15:25:08 main:574] : INFO : Epoch 1741 | loss: 0.0311259 | val_loss: 0.0311488 | Time: 1946.39 ms
[2021-09-15 15:25:10 main:574] : INFO : Epoch 1742 | loss: 0.0311246 | val_loss: 0.0311564 | Time: 1754.91 ms
[2021-09-15 15:25:12 main:574] : INFO : Epoch 1743 | loss: 0.0311244 | val_loss: 0.0311542 | Time: 1786.98 ms
[2021-09-15 15:25:13 main:574] : INFO : Epoch 1744 | loss: 0.0311288 | val_loss: 0.0311505 | Time: 1778.35 ms
[2021-09-15 15:25:15 main:574] : INFO : Epoch 1745 | loss: 0.0311259 | val_loss: 0.031158 | Time: 1879.55 ms
[2021-09-15 15:25:17 main:574] : INFO : Epoch 1746 | loss: 0.0311267 | val_loss: 0.0311514 | Time: 1775.35 ms
[2021-09-15 15:25:19 main:574] : INFO : Epoch 1747 | loss: 0.0311275 | val_loss: 0.0311519 | Time: 1756.66 ms
[2021-09-15 15:25:21 main:574] : INFO : Epoch 1748 | loss: 0.0311234 | val_loss: 0.0311513 | Time: 1745 ms
[2021-09-15 15:25:22 main:574] : INFO : Epoch 1749 | loss: 0.0311241 | val_loss: 0.0311486 | Time: 1773.29 ms
[2021-09-15 15:25:24 main:574] : INFO : Epoch 1750 | loss: 0.0311229 | val_loss: 0.0311485 | Time: 1725.27 ms
[2021-09-15 15:25:26 main:574] : INFO : Epoch 1751 | loss: 0.0311223 | val_loss: 0.0311537 | Time: 1776.41 ms
[2021-09-15 15:25:28 main:574] : INFO : Epoch 1752 | loss: 0.0311261 | val_loss: 0.0311475 | Time: 1844.39 ms
[2021-09-15 15:25:30 main:574] : INFO : Epoch 1753 | loss: 0.0311209 | val_loss: 0.0311505 | Time: 1799.86 ms
[2021-09-15 15:25:31 main:574] : INFO : Epoch 1754 | loss: 0.0311262 | val_loss: 0.0311485 | Time: 1736.68 ms
[2021-09-15 15:25:33 main:574] : INFO : Epoch 1755 | loss: 0.0311307 | val_loss: 0.031159 | Time: 1785.56 ms
[2021-09-15 15:25:35 main:574] : INFO : Epoch 1756 | loss: 0.0311377 | val_loss: 0.0311506 | Time: 1782.52 ms
[2021-09-15 15:25:37 main:574] : INFO : Epoch 1757 | loss: 0.0311304 | val_loss: 0.0311478 | Time: 1744.44 ms
[2021-09-15 15:25:38 main:574] : INFO : Epoch 1758 | loss: 0.0311273 | val_loss: 0.0311506 | Time: 1759.64 ms
[2021-09-15 15:25:40 main:574] : INFO : Epoch 1759 | loss: 0.031138 | val_loss: 0.0311602 | Time: 1756.89 ms
[2021-09-15 15:25:42 main:574] : INFO : Epoch 1760 | loss: 0.0311419 | val_loss: 0.0311623 | Time: 1780.08 ms
[2021-09-15 15:25:44 main:574] : INFO : Epoch 1761 | loss: 0.0311413 | val_loss: 0.0311572 | Time: 1726.06 ms
[2021-09-15 15:25:46 main:574] : INFO : Epoch 1762 | loss: 0.0311367 | val_loss: 0.0311532 | Time: 1903.95 ms
[2021-09-15 15:25:47 main:574] : INFO : Epoch 1763 | loss: 0.0311365 | val_loss: 0.0311528 | Time: 1846.15 ms
[2021-09-15 15:25:49 main:574] : INFO : Epoch 1764 | loss: 0.0311368 | val_loss: 0.0311525 | Time: 1735.67 ms
[2021-09-15 15:25:51 main:574] : INFO : Epoch 1765 | loss: 0.031137 | val_loss: 0.0311496 | Time: 1771.07 ms
[2021-09-15 15:25:53 main:574] : INFO : Epoch 1766 | loss: 0.0311353 | val_loss: 0.0311489 | Time: 1738.27 ms
[2021-09-15 15:25:54 main:574] : INFO : Epoch 1767 | loss: 0.0311318 | val_loss: 0.0311527 | Time: 1743.31 ms
[2021-09-15 15:25:56 main:574] : INFO : Epoch 1768 | loss: 0.031132 | val_loss: 0.0311481 | Time: 1789.85 ms
[2021-09-15 15:25:58 main:574] : INFO : Epoch 1769 | loss: 0.0311325 | val_loss: 0.0311559 | Time: 1751.36 ms
[2021-09-15 15:26:00 main:574] : INFO : Epoch 1770 | loss: 0.0311315 | val_loss: 0.0311489 | Time: 1760.59 ms
[2021-09-15 15:26:02 main:574] : INFO : Epoch 1771 | loss: 0.0311304 | val_loss: 0.0311508 | Time: 1770.12 ms
[2021-09-15 15:26:03 main:574] : INFO : Epoch 1772 | loss: 0.0311293 | val_loss: 0.03115 | Time: 1725.23 ms
[2021-09-15 15:26:05 main:574] : INFO : Epoch 1773 | loss: 0.0311323 | val_loss: 0.0311496 | Time: 1814.97 ms
[2021-09-15 15:26:07 main:574] : INFO : Epoch 1774 | loss: 0.0311296 | val_loss: 0.0311499 | Time: 1744.07 ms
[2021-09-15 15:26:09 main:574] : INFO : Epoch 1775 | loss: 0.0311366 | val_loss: 0.0311633 | Time: 1733 ms
[2021-09-15 15:26:10 main:574] : INFO : Epoch 1776 | loss: 0.0311434 | val_loss: 0.0311547 | Time: 1807.73 ms
[2021-09-15 15:26:12 main:574] : INFO : Epoch 1777 | loss: 0.0311391 | val_loss: 0.0311552 | Time: 1821.13 ms
[2021-09-15 15:26:14 main:574] : INFO : Epoch 1778 | loss: 0.0311379 | val_loss: 0.0311526 | Time: 1773.17 ms
[2021-09-15 15:26:16 main:574] : INFO : Epoch 1779 | loss: 0.0311395 | val_loss: 0.0311514 | Time: 1751.18 ms
[2021-09-15 15:26:18 main:574] : INFO : Epoch 1780 | loss: 0.0311395 | val_loss: 0.0311574 | Time: 1795.97 ms
[2021-09-15 15:26:19 main:574] : INFO : Epoch 1781 | loss: 0.0311407 | val_loss: 0.0311503 | Time: 1807.62 ms
[2021-09-15 15:26:21 main:574] : INFO : Epoch 1782 | loss: 0.0311394 | val_loss: 0.0311507 | Time: 1748.02 ms
[2021-09-15 15:26:23 main:574] : INFO : Epoch 1783 | loss: 0.0311404 | val_loss: 0.0311511 | Time: 1771.79 ms
[2021-09-15 15:26:25 main:574] : INFO : Epoch 1784 | loss: 0.0311384 | val_loss: 0.0311511 | Time: 1729.48 ms
[2021-09-15 15:26:26 main:574] : INFO : Epoch 1785 | loss: 0.0311402 | val_loss: 0.031152 | Time: 1811.92 ms
[2021-09-15 15:26:28 main:574] : INFO : Epoch 1786 | loss: 0.0311409 | val_loss: 0.0311535 | Time: 1809.2 ms
[2021-09-15 15:26:30 main:574] : INFO : Epoch 1787 | loss: 0.0311389 | val_loss: 0.0311494 | Time: 1750.47 ms
[2021-09-15 15:26:32 main:574] : INFO : Epoch 1788 | loss: 0.0311383 | val_loss: 0.0311482 | Time: 1786.6 ms
[2021-09-15 15:26:34 main:574] : INFO : Epoch 1789 | loss: 0.031138 | val_loss: 0.0311522 | Time: 1815.15 ms
[2021-09-15 15:26:35 main:574] : INFO : Epoch 1790 | loss: 0.0311351 | val_loss: 0.0311501 | Time: 1831.01 ms
[2021-09-15 15:26:37 main:574] : INFO : Epoch 1791 | loss: 0.0311339 | val_loss: 0.0311517 | Time: 1794.44 ms
[2021-09-15 15:26:39 main:574] : INFO : Epoch 1792 | loss: 0.031135 | val_loss: 0.0311569 | Time: 1812.68 ms
[2021-09-15 15:26:41 main:574] : INFO : Epoch 1793 | loss: 0.0311346 | val_loss: 0.0311553 | Time: 1799.73 ms
[2021-09-15 15:26:43 main:574] : INFO : Epoch 1794 | loss: 0.0311299 | val_loss: 0.0311509 | Time: 1786.27 ms
[2021-09-15 15:26:44 main:574] : INFO : Epoch 1795 | loss: 0.0311281 | val_loss: 0.0311536 | Time: 1702.2 ms
[2021-09-15 15:26:46 main:574] : INFO : Epoch 1796 | loss: 0.0311314 | val_loss: 0.0311523 | Time: 1775.61 ms
[2021-09-15 15:26:48 main:574] : INFO : Epoch 1797 | loss: 0.0311357 | val_loss: 0.0311542 | Time: 1824.81 ms
[2021-09-15 15:26:50 main:574] : INFO : Epoch 1798 | loss: 0.0311381 | val_loss: 0.0311546 | Time: 1750.59 ms
[2021-09-15 15:26:52 main:574] : INFO : Epoch 1799 | loss: 0.0311366 | val_loss: 0.0311512 | Time: 1767.91 ms
[2021-09-15 15:26:53 main:574] : INFO : Epoch 1800 | loss: 0.031135 | val_loss: 0.0311529 | Time: 1731.12 ms
[2021-09-15 15:26:55 main:574] : INFO : Epoch 1801 | loss: 0.0311393 | val_loss: 0.0311528 | Time: 1724.93 ms
[2021-09-15 15:26:57 main:574] : INFO : Epoch 1802 | loss: 0.0311376 | val_loss: 0.0311611 | Time: 1764.14 ms
[2021-09-15 15:26:58 main:574] : INFO : Epoch 1803 | loss: 0.0311365 | val_loss: 0.0311629 | Time: 1729.52 ms
[2021-09-15 15:27:00 main:574] : INFO : Epoch 1804 | loss: 0.0311366 | val_loss: 0.0311527 | Time: 1719.59 ms
[2021-09-15 15:27:02 main:574] : INFO : Epoch 1805 | loss: 0.0311334 | val_loss: 0.0311531 | Time: 1742.36 ms
[2021-09-15 15:27:04 main:574] : INFO : Epoch 1806 | loss: 0.0311311 | val_loss: 0.0311554 | Time: 1796.01 ms
[2021-09-15 15:27:06 main:574] : INFO : Epoch 1807 | loss: 0.0311306 | val_loss: 0.0311545 | Time: 1772.16 ms
[2021-09-15 15:27:07 main:574] : INFO : Epoch 1808 | loss: 0.0311312 | val_loss: 0.0311526 | Time: 1797.72 ms
[2021-09-15 15:27:09 main:574] : INFO : Epoch 1809 | loss: 0.0311324 | val_loss: 0.0311536 | Time: 1792.8 ms
[2021-09-15 15:27:11 main:574] : INFO : Epoch 1810 | loss: 0.0311324 | val_loss: 0.0311539 | Time: 1758.75 ms
[2021-09-15 15:27:13 main:574] : INFO : Epoch 1811 | loss: 0.0311298 | val_loss: 0.0311614 | Time: 1757.78 ms
[2021-09-15 15:27:15 main:574] : INFO : Epoch 1812 | loss: 0.0311314 | val_loss: 0.0311548 | Time: 1808.47 ms
[2021-09-15 15:27:16 main:574] : INFO : Epoch 1813 | loss: 0.0311295 | val_loss: 0.031154 | Time: 1851.95 ms
[2021-09-15 15:27:18 main:574] : INFO : Epoch 1814 | loss: 0.0311328 | val_loss: 0.0311623 | Time: 1772.69 ms
[2021-09-15 15:27:20 main:574] : INFO : Epoch 1815 | loss: 0.0311317 | val_loss: 0.0311538 | Time: 1846.08 ms
[2021-09-15 15:27:22 main:574] : INFO : Epoch 1816 | loss: 0.0311276 | val_loss: 0.031153 | Time: 1766.72 ms
[2021-09-15 15:27:23 main:574] : INFO : Epoch 1817 | loss: 0.0311318 | val_loss: 0.0311533 | Time: 1735.47 ms
[2021-09-15 15:27:25 main:574] : INFO : Epoch 1818 | loss: 0.0311287 | val_loss: 0.0311511 | Time: 1735.43 ms
[2021-09-15 15:27:27 main:574] : INFO : Epoch 1819 | loss: 0.0311268 | val_loss: 0.031154 | Time: 1762.94 ms
[2021-09-15 15:27:29 main:574] : INFO : Epoch 1820 | loss: 0.0311277 | val_loss: 0.0311535 | Time: 1798.33 ms
[2021-09-15 15:27:31 main:574] : INFO : Epoch 1821 | loss: 0.0311254 | val_loss: 0.0311527 | Time: 1887.43 ms
[2021-09-15 15:27:32 main:574] : INFO : Epoch 1822 | loss: 0.0311296 | val_loss: 0.0311551 | Time: 1759.93 ms
[2021-09-15 15:27:34 main:574] : INFO : Epoch 1823 | loss: 0.0311349 | val_loss: 0.0311482 | Time: 1791.04 ms
[2021-09-15 15:27:36 main:574] : INFO : Epoch 1824 | loss: 0.0311361 | val_loss: 0.0311515 | Time: 1737.23 ms
[2021-09-15 15:27:38 main:574] : INFO : Epoch 1825 | loss: 0.0311341 | val_loss: 0.0311456 | Time: 1792.86 ms
[2021-09-15 15:27:40 main:574] : INFO : Epoch 1826 | loss: 0.0311327 | val_loss: 0.0311498 | Time: 1820.12 ms
THCudaCheck FAIL file=..\..\aten\src\THC\THCCachingHostAllocator.cpp line=278 error=719 : unspecified launch failure
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFB8BC44ED9
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 09/15/21 15:27:40
Install Directory : C:\Program Files\BOINC\
Data Directory : C:\ProgramData\BOINC
Project Symstore :
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\11;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 0000000008d90000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000008df90000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1110) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.1023 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1023
ModLoad: 00000000782a0000 0000000000015000 C:\Program Files (x86)\AVG\Antivirus\aswhook.dll (21.7.6523.0) (-nosymbols- Symbols Loaded)
Linked PDB Filename : D:\work\616216c47067779c\idp\build\avgast\RU_NTDLL-lH-Y2A!x64_vs142\bin\Release_Unicode_NTDLL_vs142\x64\aswhook.pdb
File Version : 21.7.6523.0
Company Name : AVG Technologies CZ, s.r.o.
Product Name : AVG
Product Version : 21.7.6523.0
ModLoad: 000000008d150000 00000000000bd000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1151
ModLoad: 000000008bc10000 00000000002c9000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1151
ModLoad: 000000008cd10000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000008bbe0000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1151
ModLoad: 000000008c860000 000000000002a000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.746) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.746 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.746
ModLoad: 000000008bee0000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1110) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.1110 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1110
ModLoad: 000000008b710000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 000000008b7e0000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 000000008d000000 00000000000ac000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1052) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000008d410000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.19041.546
ModLoad: 000000008d0b0000 000000000009b000 C:\WINDOWS\System32\sechost.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000008da90000 000000000012a000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1081) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000828a0000 0000000000058000 C:\ProgramData\BOINC\slots\11\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000006ff90000 0000000000099000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.24.28127.4) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.24.28127.4 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.24.28127.4
ModLoad: 0000000083410000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.867 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.867
ModLoad: 0000000070030000 0000000000017000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.24.28127.4) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.24.28127.4 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.24.28127.4
ModLoad: 0000000083af0000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.24.28127.4) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.24.28127.4 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.24.28127.4
ModLoad: 00000000fef40000 000000000abe7000 C:\ProgramData\BOINC\slots\11\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000003d8e0000 000000000020d000 C:\ProgramData\BOINC\slots\11\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 000000003d170000 00000000002db000 C:\ProgramData\BOINC\slots\11\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000081ca0000 0000000000040000 C:\ProgramData\BOINC\slots\11\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000da3f0000 0000000024b49000 C:\ProgramData\BOINC\slots\11\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000077a50000 0000000000045000 C:\ProgramData\BOINC\slots\11\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000d6f30000 00000000034b2000 C:\ProgramData\BOINC\slots\11\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 0000000016ac0000 00000000030a5000 C:\ProgramData\BOINC\slots\11\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 0000000083ae0000 0000000000010000 C:\ProgramData\BOINC\slots\11\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 00000000cdd90000 000000000919f000 C:\ProgramData\BOINC\slots\11\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 00000000aec80000 0000000003d5b000 C:\ProgramData\BOINC\slots\11\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000b29e0000 000000001b3a4000 C:\ProgramData\BOINC\slots\11\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 000000003ae60000 0000000001eca000 C:\ProgramData\BOINC\slots\11\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 000000008ceb0000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000895f0000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000008c890000 0000000000472000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000008b6c0000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1151
ModLoad: 000000008b7b0000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000008b460000 0000000000034000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1151
ModLoad: 000000008bb80000 0000000000060000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1151
ModLoad: 000000008ba20000 000000000015f000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.844) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000008b2a0000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000008c120000 000000000073f000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.964 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.964
ModLoad: 00000000897f0000 0000000000790000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000008d5e0000 0000000000355000 C:\WINDOWS\System32\combase.dll (6.2.19041.1081) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000008b0b0000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000008dbc0000 00000000000ae000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000008d520000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000003abf0000 0000000000267000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.5730) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 27.21.14.5730
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.1.114 driver
Product Version : 27.21.14.5730
ModLoad: 0000000085590000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000002a7d0000 000000000152c000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_5dcb5bbf5c3edcf2\nvcuda64.dll (27.21.14.5730) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 27.21.14.5730
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.1.114 driver
Product Version : 27.21.14.5730
ModLoad: 000000008dee0000 000000000006b000 C:\WINDOWS\System32\WS2_32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : ws2_32.pdb
File Version : 10.0.19041.1081 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1081
ModLoad: 0000000085480000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.906 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.906
ModLoad: 000000008afc0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000089130000 000000000009e000 C:\WINDOWS\system32\uxtheme.dll (6.2.19041.1081) (-exported- Symbols Loaded)
Linked PDB Filename : UxTheme.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000081080000 00000000006d6000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.5730) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 27.21.14.5730
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 27.21.14.5730
ModLoad: 000000008d210000 000000000012a000 C:\WINDOWS\System32\OLE32.DLL (6.2.19041.746) (-exported- Symbols Loaded)
Linked PDB Filename : ole32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000083ad0000 0000000000009000 C:\ProgramData\BOINC\slots\11\caffe2_nvrtc.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000028b90000 0000000000fca000 C:\ProgramData\BOINC\slots\11\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6.14.11.9000
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.89 NVRTC Library
Product Version : 6.14.11.9000
ModLoad: 000000008b8e0000 0000000000083000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.1023 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1023
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 5459, Write: 9924, Other 19628
- I/O Transfers Counters -
Read: 6762012, Write: 12970177, Other 96818
- Paged Pool Usage -
QuotaPagedPoolUsage: 3505512, QuotaPeakPagedPoolUsage: 3506312
QuotaNonPagedPoolUsage: 52624, QuotaPeakNonPagedPoolUsage: 53032
- Virtual Memory Usage -
VirtualSize: -411484160, PeakVirtualSize: 207421440
- Pagefile Usage -
PagefileUsage: -411484160, PeakPagefileUsage: -411484160
- Working Set Size -
WorkingSetSize: 1758973952, PeakWorkingSetSize: 1765732352, PageFaultCount: 631810
*** Dump of thread ID 22328 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 1201093760.000000, User Time: 16785937408.000000, Wait Time: 13093940.000000
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFB8BC44ED9
- Registers -
rax=0000000000000000 rbx=00000000093b62f0 rcx=0000000000000000 rdx=0000000000000000 rsi=00000000096e3e70 rdi=0000000019930520
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000000006000 r13=0000000000000000
r14=00000000096e4bb0 r15=00000000096e4b30 rip=000000008bc44ed9 rsp=00000000096e3d10 rbp=00000000096e4718
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202
- Callstack -
ChildEBP RetAddr Args to Child
096e3de0 70034880 9a6021b4 00000000 096e4bb0 0450a014 KERNELBASE!RaiseException+0x0
096e3e40 04b05272 9a6021d4 00000000 000007cb 00000116 VCRUNTIME140!_CxxThrowException+0x0
096e3e90 04b056d4 00000000 00000000 07b2d290 ddc55f68 torch_cpu!at::Tensor::zero_+0x0
096e46f0 dd219ebe 096e4920 ddc56850 ddc56880 000002cf torch_cpu!_THError+0x0
096e4730 dd215412 096e4920 096e4880 f3911df0 de08a720 torch_cuda!__THCudaCheck+0x0
096e4770 047b59ff 096e4b00 096e4920 096e4df0 828d97b0 torch_cuda!at::native::set_storage_cuda_+0x0
096e4b00 0495726f dd88f630 0450ea63 00000001 828bef8f torch_cpu!at::native::empty_cpu+0x0
096e4b40 04910615 096e0000 096e4bb8 096e4db0 828a7ce6 torch_cpu!at::native::mkldnn_sigmoid_+0x0
096e4b80 0491204a 096e0000 096e4c00 f3911f00 dc556ae5 torch_cpu!at::native::mkldnn_sigmoid_+0x0
096e4c10 04910615 00000000 0450ea63 096e4cf0 096e4df0 torch_cpu!at::native::mkldnn_sigmoid_+0x0
096e4c50 049e1eb0 096e0000 00000000 096e4dd8 00000001 torch_cpu!at::native::mkldnn_sigmoid_+0x0
096e4cf0 049f2eec 4dc7fc5d 828d9c50 096e4e50 828a3bd6 torch_cpu!at::bucketize_out+0x0
096e4d40 dc91f160 096e0000 00000000 096e4e50 00000000 torch_cpu!at::empty+0x0
096e50e0 dc922de8 828d9c50 04510528 f4824090 828d9c50 torch_cuda!at::native::cummin_helper_cuda+0x0
096e52c0 dc924379 096e53d0 20fdc2f0 096e57d0 20fdc308 torch_cuda!at::native::cummin_helper_cuda+0x0
096e5500 dc923d64 096e0000 096e57d0 096e5610 096e57d0 torch_cuda!at::native::cat_out_cuda+0x0
096e5700 dd1c1dd2 096e5758 00000001 096e5758 096e57d0 torch_cuda!at::native::cat_cuda+0x0
096e5780 dd1d4179 00000001 096e57c0 f482ae38 04000000 torch_cuda!at::native::set_storage_cuda_+0x0
096e57c0 049e1d7d 0e8d3cb0 096e5b30 096e5b00 00000000 torch_cuda!at::native::set_storage_cuda_+0x0
096e5840 049c0d81 00000000 828c3994 096e6010 20fdbaf0 torch_cpu!at::bucketize_out+0x0
096e5880 047cb4a5 096e58c0 f4823c90 096e5990 096e5a00 torch_cpu!at::_cat+0x0
096e5950 04ab27bd 096e5a20 00000101 096e59a8 828f1ea8 torch_cpu!at::native::cat+0x0
096e59d0 045729ae 20fdc8f0 20fdc900 20fdc908 096e5988 torch_cpu!at::zeros_out+0x0
096e5a10 049e1d7d 096e5a50 096e5ac0 00000000 8dfb47b1 torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0
096e5a90 049e75d1 096e6030 09860640 096e6010 20fdbaf0 torch_cpu!at::bucketize_out+0x0
096e5ad0 047d7d4c 096e5d60 00000000 096e5d60 00000000 torch_cpu!at::cat+0x0
096e5c90 04acc38d 096e5ce8 00000001 096e5ce8 096e5d60 torch_cpu!at::native::stack+0x0
096e5d10 045729ae 096e6010 20fdbaf0 00000000 00000000 torch_cpu!at::zeros_out+0x0
096e5d50 049e1d7d 096e5d90 096e5e00 00000000 07781c8f torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0
096e5dd0 04a302e1 096e5f00 828c3720 096e6030 09860640 torch_cpu!at::bucketize_out+0x0
096e5e10 05dc3839 096e5e90 f482a620 f482a620 096e5f20 torch_cpu!at::stack+0x0
096e5fe0 045729ae 00000000 096e6130 00000000 096e60d0 torch_cpu!torch::autograd::GraphRoot::apply+0x0
096e6020 049e1d7d 096e6060 096e60d0 f4823870 00000000 torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0
096e60a0 04a302e1 096e6210 04509cac 1c96f8b0 20fdbaf0 torch_cpu!at::bucketize_out+0x0
096e60e0 08d9ff7e 096e61a8 0e9762b0 0e9762b0 096e62f0 torch_cpu!at::stack+0x0
096e6180 08da2ef8 08d9fe30 096e61c0 096e61c0 096e6210 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::addCallback+0x0
096e61e0 08da3ea4 015536a0 8dfb47b1 096e6380 f2ca0000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Object::getSlot+0x0
096e6320 08d9d3d2 1d18fe50 20da4020 096e6380 8dfb5ba1 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::markCompleted+0x0
096e6350 08da4541 00000000 20daa750 bd2e5c60 8dfb5ba1 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Object::operator=+0x0
096e6500 08da743a 00000000 00000000 096e7010 00000004 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::markCompleted+0x0
096e6a00 08dab950 096e6b00 096e6b00 00000000 cbd8eda0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0
096ff7a0 08fec6f8 f48787f0 00000000 00000000 f47e51d0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
096ff7e0 8d167034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
096ff810 8dfe2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
096ff890 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 19924 (state: Waiting): ***
- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 13093934.000000
- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=0000000009bffbb0 rsi=0000000000000000 rdi=0000000000000064
r8=0000000009bffb88 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000008e02d4a4 rsp=0000000009bffb88 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
09bffb80 8bc595be 09bffc48 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0
09bffc20 08dca07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0
09bffc50 8d167034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
09bffc80 8dfe2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
09bffd00 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 24352 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 13093940.000000
- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=0000000009cffae0 rsi=0000000000000000 rdi=000000000000000d
r8=00000000f4d5e090 r9=0000000000000000 r10=0000000000000000 r11=0000000009cffa50 r12=0000000000000064 r13=0000000009cffae0
r14=0000000009cff7e0 r15=0000000000000000 rip=000000008e02d974 rsp=0000000009cff788 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
09cff780 8bc5cab0 09cffb40 8dfadc6b 00000000 09cff8a0 ntdll!ZwWaitForMultipleObjects+0x0
09cffa70 8bc5c9ae f2cb30c0 00700070 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
09cffab0 2a97bb54 f4a46f90 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0
09cffcf0 2aa109ed 00000000 00000004 00000000 00000000 nvcuda64!+0x0
09cffda0 2a97b523 5f5da74c 5f194527 f4fd6a50 00000000 nvcuda64!cuProfilerStop+0x0
09cffdd0 2ac8a750 f4fd6a50 00000000 00000000 00000000 nvcuda64!+0x0
09cffe00 8d167034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
09cffe30 8dfe2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
09cffeb0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 27336 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 13093939.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=0000000000000294 rdx=0000000000000000 rsi=0000000009dffae8 rdi=0000000000000294
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=00000000f4a95600 r13=0000000000000000
r14=0000000000000294 r15=0000000000000001 rip=000000008e02cea4 rsp=0000000009dffab8 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
09dffab0 8bc319ce 00000000 00000000 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0
09dffb50 2ab8c0e7 00000000 8bc3a305 00000000 00000294 KERNELBASE!WaitForSingleObjectEx+0x0
09dffbc0 2a97b523 00000001 f54662f0 f4fd6e40 00000000 nvcuda64!cuProfilerStop+0x0
09dffbf0 2ac8a750 f4fd6e40 00000000 00000000 00000000 nvcuda64!+0x0
09dffc20 8d167034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
09dffc50 8dfe2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
09dffcd0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 5228 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 13093923.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000f4d61258 rdx=0000000009effd78 rsi=0000000009effce0 rdi=0000000000000000
r8=0000000009effcb8 r9=0000000009effd10 r10=0000000000000000 r11=0000000000000246 r12=0000000009effd78 r13=0000000000000000
r14=00000000f4d61258 r15=00000000f4b5dce8 rip=000000008e030814 rsp=0000000009effcb8 rbp=0000000009effd10
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
09effcb0 8dff4295 00000102 00000102 00000000 09effce0 ntdll!NtWaitForAlertByThreadId+0x0
09effd20 8bc7cd79 f4b5b4d0 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0
09effd50 2a90223a f4b5b4d0 8dfe07b0 f4b5b4d0 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0
09effdb0 2a97b523 00000001 5f3eaa20 00000000 00000000 nvcuda64!+0x0
09effde0 2ac8a750 f4fd6f90 00000000 00000000 00000000 nvcuda64!+0x0
09effe10 8d167034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
09effe40 8dfe2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
09effec0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 16564 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 698124992.000000, User Time: 13184687104.000000, Wait Time: 13093938.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000010b4218 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000010b4218
r8=0000000000000000 r9=00000000201b7990 r10=00000000b29e0000 r11=0000000009ff9d70 r12=0000000000000000 r13=0000000000000000
r14=0000000009fff260 r15=00000000010b41c8 rip=000000008e030814 rsp=0000000009fff238 rbp=0000000009fff290
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
09fff230 8dff4021 0ee797c8 0ee797c8 09fff370 0ee797c8 ntdll!NtWaitForAlertByThreadId+0x0
09fff2b0 8bc7ce29 010b41c0 010b4208 00000000 00000000 ntdll!RtlSleepConditionVariableSRW+0x0
09fff2f0 6ffc53dd 0e953c70 0e953c70 0e953c70 00000000 KERNELBASE!SleepConditionVariableSRW+0x0
09fff330 6ffa1fa8 1ca6f1a0 00000000 00000000 061205b4 MSVCP140!__crtSetThreadpoolWait+0x0
09fff360 6ffa1e70 00000000 6ffa2677 00000000 1ca6f1a0 MSVCP140!std::_Winerror_message+0x0
09fff3d0 0612064b 1ca6f180 000001c0 010b41c0 010b41c0 MSVCP140!std::_Winerror_message+0x0
09fff410 061225b1 20718a30 ffffffff 1ca6f180 ffffffff torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
09fff700 06122471 09646d10 09fff740 09646d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0
09fff750 06119744 00080001 20cbe010 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0
09fff780 8b801bb2 20cbe010 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0
09fff7b0 8d167034 00000000 00000000 00000000 00000000 ucrtbase!_configthreadlocale+0x0
09fff7e0 8dfe2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
09fff860 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)