Task 7364288

Name ParityModified-1631728174-30793-0_0
Workunit 5040435
Created 15 Sep 2021, 17:49:37 UTC
Sent 16 Sep 2021, 15:48:54 UTC
Report deadline 24 Sep 2021, 15:48:54 UTC
Received 16 Sep 2021, 21:07:38 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 6650
Run time 56 min 38 sec
CPU time 48 min 25 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 6,456.68 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 2.10 GB
Peak swap size 4.35 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>

[2021-09-16 15:52:00	                main:574]	:	INFO	:	Epoch 1571 | loss: nan | val_loss: nan | Time: 1720.41 ms
[2021-09-16 15:52:02	                main:574]	:	INFO	:	Epoch 1572 | loss: nan | val_loss: nan | Time: 1730.39 ms
[2021-09-16 15:52:06	                main:574]	:	INFO	:	Epoch 1573 | loss: nan | val_loss: nan | Time: 1772.78 ms
[2021-09-16 15:52:08	                main:574]	:	INFO	:	Epoch 1574 | loss: nan | val_loss: nan | Time: 1761.3 ms
[2021-09-16 15:52:09	                main:574]	:	INFO	:	Epoch 1575 | loss: nan | val_loss: nan | Time: 1704.06 ms
[2021-09-16 15:52:11	                main:574]	:	INFO	:	Epoch 1576 | loss: nan | val_loss: nan | Time: 1674.84 ms
[2021-09-16 15:52:13	                main:574]	:	INFO	:	Epoch 1577 | loss: nan | val_loss: nan | Time: 1706.72 ms
[2021-09-16 15:52:15	                main:574]	:	INFO	:	Epoch 1578 | loss: nan | val_loss: nan | Time: 1653.53 ms
[2021-09-16 15:52:17	                main:574]	:	INFO	:	Epoch 1579 | loss: nan | val_loss: nan | Time: 1731.22 ms
[2021-09-16 15:52:19	                main:574]	:	INFO	:	Epoch 1580 | loss: nan | val_loss: nan | Time: 1698.63 ms
[2021-09-16 15:52:22	                main:574]	:	INFO	:	Epoch 1581 | loss: nan | val_loss: nan | Time: 1728.61 ms
[2021-09-16 15:52:24	                main:574]	:	INFO	:	Epoch 1582 | loss: nan | val_loss: nan | Time: 1788.34 ms
[2021-09-16 15:52:26	                main:574]	:	INFO	:	Epoch 1583 | loss: nan | val_loss: nan | Time: 1805.64 ms
[2021-09-16 15:52:28	                main:574]	:	INFO	:	Epoch 1584 | loss: nan | val_loss: nan | Time: 1739.23 ms
[2021-09-16 15:52:41	                main:574]	:	INFO	:	Epoch 1585 | loss: nan | val_loss: nan | Time: 11830 ms
[2021-09-16 15:52:43	                main:574]	:	INFO	:	Epoch 1586 | loss: nan | val_loss: nan | Time: 1693.29 ms
[2021-09-16 15:52:45	                main:574]	:	INFO	:	Epoch 1587 | loss: nan | val_loss: nan | Time: 1682.09 ms
[2021-09-16 15:52:46	                main:574]	:	INFO	:	Epoch 1588 | loss: nan | val_loss: nan | Time: 1635.02 ms
[2021-09-16 15:52:48	                main:574]	:	INFO	:	Epoch 1589 | loss: nan | val_loss: nan | Time: 1638.66 ms
[2021-09-16 15:52:50	                main:574]	:	INFO	:	Epoch 1590 | loss: nan | val_loss: nan | Time: 1722.79 ms
[2021-09-16 15:53:02	                main:574]	:	INFO	:	Epoch 1591 | loss: nan | val_loss: nan | Time: 11733.8 ms
[2021-09-16 15:53:04	                main:574]	:	INFO	:	Epoch 1592 | loss: nan | val_loss: nan | Time: 1706.6 ms
[2021-09-16 15:53:06	                main:574]	:	INFO	:	Epoch 1593 | loss: nan | val_loss: nan | Time: 1707.44 ms
[2021-09-16 15:53:07	                main:574]	:	INFO	:	Epoch 1594 | loss: nan | val_loss: nan | Time: 1651.3 ms
[2021-09-16 15:53:09	                main:574]	:	INFO	:	Epoch 1595 | loss: nan | val_loss: nan | Time: 1647.46 ms
[2021-09-16 15:53:21	                main:574]	:	INFO	:	Epoch 1596 | loss: nan | val_loss: nan | Time: 11746 ms
[2021-09-16 15:53:23	                main:574]	:	INFO	:	Epoch 1597 | loss: nan | val_loss: nan | Time: 1734.16 ms
[2021-09-16 15:53:25	                main:574]	:	INFO	:	Epoch 1598 | loss: nan | val_loss: nan | Time: 1676.17 ms
[2021-09-16 15:53:27	                main:574]	:	INFO	:	Epoch 1599 | loss: nan | val_loss: nan | Time: 1696.79 ms
[2021-09-16 15:53:28	                main:574]	:	INFO	:	Epoch 1600 | loss: nan | val_loss: nan | Time: 1654.53 ms
[2021-09-16 15:53:30	                main:574]	:	INFO	:	Epoch 1601 | loss: nan | val_loss: nan | Time: 1686.67 ms
[2021-09-16 15:53:42	                main:574]	:	INFO	:	Epoch 1602 | loss: nan | val_loss: nan | Time: 11682.2 ms
[2021-09-16 15:53:44	                main:574]	:	INFO	:	Epoch 1603 | loss: nan | val_loss: nan | Time: 1652.12 ms
[2021-09-16 15:53:46	                main:574]	:	INFO	:	Epoch 1604 | loss: nan | val_loss: nan | Time: 1659.51 ms
[2021-09-16 15:53:47	                main:574]	:	INFO	:	Epoch 1605 | loss: nan | val_loss: nan | Time: 1616.15 ms
[2021-09-16 15:53:49	                main:574]	:	INFO	:	Epoch 1606 | loss: nan | val_loss: nan | Time: 1667.73 ms
[2021-09-16 15:53:51	                main:574]	:	INFO	:	Epoch 1607 | loss: nan | val_loss: nan | Time: 1657.28 ms
[2021-09-16 15:54:03	                main:574]	:	INFO	:	Epoch 1608 | loss: nan | val_loss: nan | Time: 11670.3 ms
[2021-09-16 15:54:04	                main:574]	:	INFO	:	Epoch 1609 | loss: nan | val_loss: nan | Time: 1623.88 ms
[2021-09-16 15:54:06	                main:574]	:	INFO	:	Epoch 1610 | loss: nan | val_loss: nan | Time: 1628.67 ms
[2021-09-16 15:54:08	                main:574]	:	INFO	:	Epoch 1611 | loss: nan | val_loss: nan | Time: 1665.95 ms
[2021-09-16 15:54:10	                main:574]	:	INFO	:	Epoch 1612 | loss: nan | val_loss: nan | Time: 1625.69 ms
[2021-09-16 15:54:12	                main:574]	:	INFO	:	Epoch 1613 | loss: nan | val_loss: nan | Time: 1622.57 ms
[2021-09-16 15:54:14	                main:574]	:	INFO	:	Epoch 1614 | loss: nan | val_loss: nan | Time: 1604.99 ms
[2021-09-16 15:54:16	                main:574]	:	INFO	:	Epoch 1615 | loss: nan | val_loss: nan | Time: 1689.96 ms
[2021-09-16 15:54:17	                main:574]	:	INFO	:	Epoch 1616 | loss: nan | val_loss: nan | Time: 1610.93 ms
[2021-09-16 15:54:19	                main:574]	:	INFO	:	Epoch 1617 | loss: nan | val_loss: nan | Time: 1626.51 ms
[2021-09-16 15:54:21	                main:574]	:	INFO	:	Epoch 1618 | loss: nan | val_loss: nan | Time: 1601.94 ms
[2021-09-16 15:54:23	                main:574]	:	INFO	:	Epoch 1619 | loss: nan | val_loss: nan | Time: 1667.91 ms
[2021-09-16 15:54:24	                main:574]	:	INFO	:	Epoch 1620 | loss: nan | val_loss: nan | Time: 1645.4 ms
[2021-09-16 15:54:26	                main:574]	:	INFO	:	Epoch 1621 | loss: nan | val_loss: nan | Time: 1626.16 ms
[2021-09-16 15:54:28	                main:574]	:	INFO	:	Epoch 1622 | loss: nan | val_loss: nan | Time: 1664.02 ms
[2021-09-16 15:54:30	                main:574]	:	INFO	:	Epoch 1623 | loss: nan | val_loss: nan | Time: 1746.81 ms
[2021-09-16 15:54:32	                main:574]	:	INFO	:	Epoch 1624 | loss: nan | val_loss: nan | Time: 1734.86 ms
[2021-09-16 15:54:34	                main:574]	:	INFO	:	Epoch 1625 | loss: nan | val_loss: nan | Time: 1668.18 ms
[2021-09-16 15:54:36	                main:574]	:	INFO	:	Epoch 1626 | loss: nan | val_loss: nan | Time: 1686.08 ms
[2021-09-16 15:54:37	                main:574]	:	INFO	:	Epoch 1627 | loss: nan | val_loss: nan | Time: 1690.45 ms
[2021-09-16 15:54:39	                main:574]	:	INFO	:	Epoch 1628 | loss: nan | val_loss: nan | Time: 1714.37 ms
[2021-09-16 15:54:41	                main:574]	:	INFO	:	Epoch 1629 | loss: nan | val_loss: nan | Time: 1652.91 ms
[2021-09-16 15:54:43	                main:574]	:	INFO	:	Epoch 1630 | loss: nan | val_loss: nan | Time: 1695.93 ms
[2021-09-16 15:54:45	                main:574]	:	INFO	:	Epoch 1631 | loss: nan | val_loss: nan | Time: 1693.37 ms
[2021-09-16 15:54:46	                main:574]	:	INFO	:	Epoch 1632 | loss: nan | val_loss: nan | Time: 1623.15 ms
[2021-09-16 15:54:48	                main:574]	:	INFO	:	Epoch 1633 | loss: nan | val_loss: nan | Time: 1758.59 ms
[2021-09-16 15:54:50	                main:574]	:	INFO	:	Epoch 1634 | loss: nan | val_loss: nan | Time: 1677.04 ms
[2021-09-16 15:54:52	                main:574]	:	INFO	:	Epoch 1635 | loss: nan | val_loss: nan | Time: 1657.79 ms
[2021-09-16 15:54:54	                main:574]	:	INFO	:	Epoch 1636 | loss: nan | val_loss: nan | Time: 1695.42 ms
[2021-09-16 15:54:56	                main:574]	:	INFO	:	Epoch 1637 | loss: nan | val_loss: nan | Time: 1703.7 ms
[2021-09-16 15:54:57	                main:574]	:	INFO	:	Epoch 1638 | loss: nan | val_loss: nan | Time: 1680.92 ms
[2021-09-16 15:54:59	                main:574]	:	INFO	:	Epoch 1639 | loss: nan | val_loss: nan | Time: 1709.07 ms
[2021-09-16 15:55:01	                main:574]	:	INFO	:	Epoch 1640 | loss: nan | val_loss: nan | Time: 1711.2 ms
[2021-09-16 15:55:03	                main:574]	:	INFO	:	Epoch 1641 | loss: nan | val_loss: nan | Time: 1733.48 ms
[2021-09-16 15:55:05	                main:574]	:	INFO	:	Epoch 1642 | loss: nan | val_loss: nan | Time: 1713.8 ms
[2021-09-16 15:55:07	                main:574]	:	INFO	:	Epoch 1643 | loss: nan | val_loss: nan | Time: 1705.32 ms
[2021-09-16 15:55:08	                main:574]	:	INFO	:	Epoch 1644 | loss: nan | val_loss: nan | Time: 1639.44 ms
[2021-09-16 15:55:10	                main:574]	:	INFO	:	Epoch 1645 | loss: nan | val_loss: nan | Time: 1672.16 ms
[2021-09-16 15:55:12	                main:574]	:	INFO	:	Epoch 1646 | loss: nan | val_loss: nan | Time: 1678.26 ms
[2021-09-16 15:55:14	                main:574]	:	INFO	:	Epoch 1647 | loss: nan | val_loss: nan | Time: 1683.46 ms
[2021-09-16 15:55:16	                main:574]	:	INFO	:	Epoch 1648 | loss: nan | val_loss: nan | Time: 1710.99 ms
[2021-09-16 15:55:18	                main:574]	:	INFO	:	Epoch 1649 | loss: nan | val_loss: nan | Time: 1710.36 ms
[2021-09-16 15:55:19	                main:574]	:	INFO	:	Epoch 1650 | loss: nan | val_loss: nan | Time: 1710.38 ms
[2021-09-16 15:55:21	                main:574]	:	INFO	:	Epoch 1651 | loss: nan | val_loss: nan | Time: 1834.42 ms
[2021-09-16 15:55:23	                main:574]	:	INFO	:	Epoch 1652 | loss: nan | val_loss: nan | Time: 1677.88 ms
[2021-09-16 15:55:25	                main:574]	:	INFO	:	Epoch 1653 | loss: nan | val_loss: nan | Time: 1741.16 ms
[2021-09-16 15:55:27	                main:574]	:	INFO	:	Epoch 1654 | loss: nan | val_loss: nan | Time: 1680.63 ms
[2021-09-16 15:55:29	                main:574]	:	INFO	:	Epoch 1655 | loss: nan | val_loss: nan | Time: 1633.22 ms
[2021-09-16 15:55:30	                main:574]	:	INFO	:	Epoch 1656 | loss: nan | val_loss: nan | Time: 1715.47 ms
[2021-09-16 15:55:32	                main:574]	:	INFO	:	Epoch 1657 | loss: nan | val_loss: nan | Time: 1657.53 ms
[2021-09-16 15:55:34	                main:574]	:	INFO	:	Epoch 1658 | loss: nan | val_loss: nan | Time: 1684.41 ms
[2021-09-16 15:55:36	                main:574]	:	INFO	:	Epoch 1659 | loss: nan | val_loss: nan | Time: 1677.24 ms
[2021-09-16 15:55:38	                main:574]	:	INFO	:	Epoch 1660 | loss: nan | val_loss: nan | Time: 1773.64 ms
[2021-09-16 15:55:40	                main:574]	:	INFO	:	Epoch 1661 | loss: nan | val_loss: nan | Time: 1770.61 ms
[2021-09-16 15:55:42	                main:574]	:	INFO	:	Epoch 1662 | loss: nan | val_loss: nan | Time: 1662.55 ms
[2021-09-16 15:55:44	                main:574]	:	INFO	:	Epoch 1663 | loss: nan | val_loss: nan | Time: 1712.92 ms
[2021-09-16 15:55:45	                main:574]	:	INFO	:	Epoch 1664 | loss: nan | val_loss: nan | Time: 1735.33 ms
[2021-09-16 15:55:47	                main:574]	:	INFO	:	Epoch 1665 | loss: nan | val_loss: nan | Time: 1651.98 ms
[2021-09-16 15:55:49	                main:574]	:	INFO	:	Epoch 1666 | loss: nan | val_loss: nan | Time: 1721.61 ms
[2021-09-16 15:55:51	                main:574]	:	INFO	:	Epoch 1667 | loss: nan | val_loss: nan | Time: 1639.5 ms
[2021-09-16 15:55:53	                main:574]	:	INFO	:	Epoch 1668 | loss: nan | val_loss: nan | Time: 1737.93 ms
[2021-09-16 15:55:55	                main:574]	:	INFO	:	Epoch 1669 | loss: nan | val_loss: nan | Time: 1728.06 ms
[2021-09-16 15:55:56	                main:574]	:	INFO	:	Epoch 1670 | loss: nan | val_loss: nan | Time: 1799.65 ms
[2021-09-16 15:55:58	                main:574]	:	INFO	:	Epoch 1671 | loss: nan | val_loss: nan | Time: 1702.37 ms
[2021-09-16 15:56:00	                main:574]	:	INFO	:	Epoch 1672 | loss: nan | val_loss: nan | Time: 1701.74 ms
[2021-09-16 15:56:02	                main:574]	:	INFO	:	Epoch 1673 | loss: nan | val_loss: nan | Time: 1740.07 ms
[2021-09-16 15:56:04	                main:574]	:	INFO	:	Epoch 1674 | loss: nan | val_loss: nan | Time: 1727.6 ms
[2021-09-16 15:56:06	                main:574]	:	INFO	:	Epoch 1675 | loss: nan | val_loss: nan | Time: 1693.19 ms
[2021-09-16 15:56:07	                main:574]	:	INFO	:	Epoch 1676 | loss: nan | val_loss: nan | Time: 1712.76 ms
[2021-09-16 15:56:09	                main:574]	:	INFO	:	Epoch 1677 | loss: nan | val_loss: nan | Time: 1704.94 ms
[2021-09-16 15:56:11	                main:574]	:	INFO	:	Epoch 1678 | loss: nan | val_loss: nan | Time: 1711.15 ms
[2021-09-16 15:56:13	                main:574]	:	INFO	:	Epoch 1679 | loss: nan | val_loss: nan | Time: 1746.44 ms
[2021-09-16 15:56:15	                main:574]	:	INFO	:	Epoch 1680 | loss: nan | val_loss: nan | Time: 1700.89 ms
[2021-09-16 15:56:17	                main:574]	:	INFO	:	Epoch 1681 | loss: nan | val_loss: nan | Time: 1711.77 ms
[2021-09-16 15:56:19	                main:574]	:	INFO	:	Epoch 1682 | loss: nan | val_loss: nan | Time: 1658.56 ms
[2021-09-16 15:56:20	                main:574]	:	INFO	:	Epoch 1683 | loss: nan | val_loss: nan | Time: 1724.12 ms
[2021-09-16 15:56:22	                main:574]	:	INFO	:	Epoch 1684 | loss: nan | val_loss: nan | Time: 1701.69 ms
[2021-09-16 15:56:24	                main:574]	:	INFO	:	Epoch 1685 | loss: nan | val_loss: nan | Time: 1685.18 ms
[2021-09-16 15:56:26	                main:574]	:	INFO	:	Epoch 1686 | loss: nan | val_loss: nan | Time: 1750.04 ms
[2021-09-16 15:56:28	                main:574]	:	INFO	:	Epoch 1687 | loss: nan | val_loss: nan | Time: 1691.51 ms
[2021-09-16 15:56:30	                main:574]	:	INFO	:	Epoch 1688 | loss: nan | val_loss: nan | Time: 1759.62 ms
[2021-09-16 15:56:32	                main:574]	:	INFO	:	Epoch 1689 | loss: nan | val_loss: nan | Time: 1831.04 ms
[2021-09-16 15:56:33	                main:574]	:	INFO	:	Epoch 1690 | loss: nan | val_loss: nan | Time: 1682.66 ms
[2021-09-16 15:56:35	                main:574]	:	INFO	:	Epoch 1691 | loss: nan | val_loss: nan | Time: 1701.7 ms
[2021-09-16 15:56:37	                main:574]	:	INFO	:	Epoch 1692 | loss: nan | val_loss: nan | Time: 1671.67 ms
[2021-09-16 15:56:39	                main:574]	:	INFO	:	Epoch 1693 | loss: nan | val_loss: nan | Time: 1717.46 ms
[2021-09-16 15:56:41	                main:574]	:	INFO	:	Epoch 1694 | loss: nan | val_loss: nan | Time: 1700.47 ms
[2021-09-16 15:56:43	                main:574]	:	INFO	:	Epoch 1695 | loss: nan | val_loss: nan | Time: 1704.54 ms
[2021-09-16 15:56:44	                main:574]	:	INFO	:	Epoch 1696 | loss: nan | val_loss: nan | Time: 1713.42 ms
[2021-09-16 15:56:46	                main:574]	:	INFO	:	Epoch 1697 | loss: nan | val_loss: nan | Time: 1777.8 ms
[2021-09-16 15:56:48	                main:574]	:	INFO	:	Epoch 1698 | loss: nan | val_loss: nan | Time: 1732.68 ms
[2021-09-16 15:56:50	                main:574]	:	INFO	:	Epoch 1699 | loss: nan | val_loss: nan | Time: 1845.98 ms
[2021-09-16 15:56:52	                main:574]	:	INFO	:	Epoch 1700 | loss: nan | val_loss: nan | Time: 1719.93 ms
[2021-09-16 15:56:54	                main:574]	:	INFO	:	Epoch 1701 | loss: nan | val_loss: nan | Time: 1719.96 ms
[2021-09-16 15:56:56	                main:574]	:	INFO	:	Epoch 1702 | loss: nan | val_loss: nan | Time: 1746.23 ms
[2021-09-16 15:56:58	                main:574]	:	INFO	:	Epoch 1703 | loss: nan | val_loss: nan | Time: 1662.83 ms
[2021-09-16 15:57:00	                main:574]	:	INFO	:	Epoch 1704 | loss: nan | val_loss: nan | Time: 1679.97 ms
[2021-09-16 15:57:01	                main:574]	:	INFO	:	Epoch 1705 | loss: nan | val_loss: nan | Time: 1673.68 ms
[2021-09-16 15:57:03	                main:574]	:	INFO	:	Epoch 1706 | loss: nan | val_loss: nan | Time: 1714.81 ms
[2021-09-16 15:57:05	                main:574]	:	INFO	:	Epoch 1707 | loss: nan | val_loss: nan | Time: 1665.54 ms
[2021-09-16 15:57:07	                main:574]	:	INFO	:	Epoch 1708 | loss: nan | val_loss: nan | Time: 1668.76 ms
[2021-09-16 15:57:09	                main:574]	:	INFO	:	Epoch 1709 | loss: nan | val_loss: nan | Time: 1770.46 ms
[2021-09-16 15:57:10	                main:574]	:	INFO	:	Epoch 1710 | loss: nan | val_loss: nan | Time: 1738.92 ms
[2021-09-16 15:57:12	                main:574]	:	INFO	:	Epoch 1711 | loss: nan | val_loss: nan | Time: 1693.11 ms
[2021-09-16 15:57:14	                main:574]	:	INFO	:	Epoch 1712 | loss: nan | val_loss: nan | Time: 1711.87 ms
[2021-09-16 15:57:16	                main:574]	:	INFO	:	Epoch 1713 | loss: nan | val_loss: nan | Time: 1640.58 ms
[2021-09-16 15:57:18	                main:574]	:	INFO	:	Epoch 1714 | loss: nan | val_loss: nan | Time: 1710.56 ms
[2021-09-16 15:57:20	                main:574]	:	INFO	:	Epoch 1715 | loss: nan | val_loss: nan | Time: 1684.77 ms
[2021-09-16 15:57:21	                main:574]	:	INFO	:	Epoch 1716 | loss: nan | val_loss: nan | Time: 1655.67 ms
[2021-09-16 15:57:23	                main:574]	:	INFO	:	Epoch 1717 | loss: nan | val_loss: nan | Time: 1680.39 ms
[2021-09-16 15:57:25	                main:574]	:	INFO	:	Epoch 1718 | loss: nan | val_loss: nan | Time: 1656.53 ms
[2021-09-16 15:57:27	                main:574]	:	INFO	:	Epoch 1719 | loss: nan | val_loss: nan | Time: 1910.75 ms
[2021-09-16 15:57:29	                main:574]	:	INFO	:	Epoch 1720 | loss: nan | val_loss: nan | Time: 1772.21 ms
[2021-09-16 15:57:31	                main:574]	:	INFO	:	Epoch 1721 | loss: nan | val_loss: nan | Time: 1826.43 ms
[2021-09-16 15:57:33	                main:574]	:	INFO	:	Epoch 1722 | loss: nan | val_loss: nan | Time: 1731.16 ms
[2021-09-16 15:57:45	                main:574]	:	INFO	:	Epoch 1723 | loss: nan | val_loss: nan | Time: 11762.6 ms
[2021-09-16 15:57:46	                main:574]	:	INFO	:	Epoch 1724 | loss: nan | val_loss: nan | Time: 1724.26 ms
[2021-09-16 15:57:48	                main:574]	:	INFO	:	Epoch 1725 | loss: nan | val_loss: nan | Time: 1798.11 ms
[2021-09-16 15:57:50	                main:574]	:	INFO	:	Epoch 1726 | loss: nan | val_loss: nan | Time: 1688.86 ms
[2021-09-16 15:57:52	                main:574]	:	INFO	:	Epoch 1727 | loss: nan | val_loss: nan | Time: 1662.55 ms
[2021-09-16 15:58:04	                main:574]	:	INFO	:	Epoch 1728 | loss: nan | val_loss: nan | Time: 11894.2 ms
[2021-09-16 15:58:06	                main:574]	:	INFO	:	Epoch 1729 | loss: nan | val_loss: nan | Time: 1667.87 ms
[2021-09-16 15:58:07	                main:574]	:	INFO	:	Epoch 1730 | loss: nan | val_loss: nan | Time: 1621.98 ms
[2021-09-16 15:58:09	                main:574]	:	INFO	:	Epoch 1731 | loss: nan | val_loss: nan | Time: 1668.55 ms
[2021-09-16 15:58:11	                main:574]	:	INFO	:	Epoch 1732 | loss: nan | val_loss: nan | Time: 1642.39 ms
[2021-09-16 15:58:13	                main:574]	:	INFO	:	Epoch 1733 | loss: nan | val_loss: nan | Time: 1679.41 ms
[2021-09-16 15:58:14	                main:574]	:	INFO	:	Epoch 1734 | loss: nan | val_loss: nan | Time: 1607.41 ms
[2021-09-16 15:58:16	                main:574]	:	INFO	:	Epoch 1735 | loss: nan | val_loss: nan | Time: 1659.71 ms
[2021-09-16 15:58:18	                main:574]	:	INFO	:	Epoch 1736 | loss: nan | val_loss: nan | Time: 1636.76 ms
[2021-09-16 15:58:20	                main:574]	:	INFO	:	Epoch 1737 | loss: nan | val_loss: nan | Time: 1635.51 ms
[2021-09-16 15:58:21	                main:574]	:	INFO	:	Epoch 1738 | loss: nan | val_loss: nan | Time: 1769.87 ms
[2021-09-16 15:58:23	                main:574]	:	INFO	:	Epoch 1739 | loss: nan | val_loss: nan | Time: 1749.66 ms
[2021-09-16 15:58:25	                main:574]	:	INFO	:	Epoch 1740 | loss: nan | val_loss: nan | Time: 1822.54 ms
[2021-09-16 15:58:27	                main:574]	:	INFO	:	Epoch 1741 | loss: nan | val_loss: nan | Time: 1731.54 ms
[2021-09-16 15:58:29	                main:574]	:	INFO	:	Epoch 1742 | loss: nan | val_loss: nan | Time: 1766.6 ms
[2021-09-16 15:58:31	                main:574]	:	INFO	:	Epoch 1743 | loss: nan | val_loss: nan | Time: 1726.52 ms
[2021-09-16 15:58:33	                main:574]	:	INFO	:	Epoch 1744 | loss: nan | val_loss: nan | Time: 1751.49 ms
[2021-09-16 15:58:35	                main:574]	:	INFO	:	Epoch 1745 | loss: nan | val_loss: nan | Time: 1726.16 ms
[2021-09-16 15:58:37	                main:574]	:	INFO	:	Epoch 1746 | loss: nan | val_loss: nan | Time: 1761.55 ms
[2021-09-16 15:58:39	                main:574]	:	INFO	:	Epoch 1747 | loss: nan | val_loss: nan | Time: 1742.82 ms
[2021-09-16 15:58:40	                main:574]	:	INFO	:	Epoch 1748 | loss: nan | val_loss: nan | Time: 1745.41 ms
[2021-09-16 15:58:42	                main:574]	:	INFO	:	Epoch 1749 | loss: nan | val_loss: nan | Time: 1816.55 ms
[2021-09-16 15:58:54	                main:574]	:	INFO	:	Epoch 1750 | loss: nan | val_loss: nan | Time: 11821.4 ms
[2021-09-16 15:58:56	                main:574]	:	INFO	:	Epoch 1751 | loss: nan | val_loss: nan | Time: 1663.77 ms
[2021-09-16 15:58:58	                main:574]	:	INFO	:	Epoch 1752 | loss: nan | val_loss: nan | Time: 1648.81 ms
[2021-09-16 15:59:00	                main:574]	:	INFO	:	Epoch 1753 | loss: nan | val_loss: nan | Time: 1671.49 ms
[2021-09-16 15:59:01	                main:574]	:	INFO	:	Epoch 1754 | loss: nan | val_loss: nan | Time: 1700.31 ms
[2021-09-16 15:59:03	                main:574]	:	INFO	:	Epoch 1755 | loss: nan | val_loss: nan | Time: 1712.62 ms
[2021-09-16 15:59:15	                main:574]	:	INFO	:	Epoch 1756 | loss: nan | val_loss: nan | Time: 11708.6 ms
[2021-09-16 15:59:17	                main:574]	:	INFO	:	Epoch 1757 | loss: nan | val_loss: nan | Time: 1610.82 ms
[2021-09-16 15:59:20	                main:574]	:	INFO	:	Epoch 1758 | loss: nan | val_loss: nan | Time: 1660.68 ms
[2021-09-16 15:59:22	                main:574]	:	INFO	:	Epoch 1759 | loss: nan | val_loss: nan | Time: 1605.52 ms
[2021-09-16 15:59:24	                main:574]	:	INFO	:	Epoch 1760 | loss: nan | val_loss: nan | Time: 1606.71 ms
[2021-09-16 15:59:26	                main:574]	:	INFO	:	Epoch 1761 | loss: nan | val_loss: nan | Time: 1626.85 ms
[2021-09-16 15:59:28	                main:574]	:	INFO	:	Epoch 1762 | loss: nan | val_loss: nan | Time: 1681.36 ms
[2021-09-16 15:59:30	                main:574]	:	INFO	:	Epoch 1763 | loss: nan | val_loss: nan | Time: 1596.93 ms
[2021-09-16 15:59:31	                main:574]	:	INFO	:	Epoch 1764 | loss: nan | val_loss: nan | Time: 1652.29 ms
[2021-09-16 15:59:33	                main:574]	:	INFO	:	Epoch 1765 | loss: nan | val_loss: nan | Time: 1626.69 ms
[2021-09-16 15:59:35	                main:574]	:	INFO	:	Epoch 1766 | loss: nan | val_loss: nan | Time: 1690.86 ms
[2021-09-16 15:59:37	                main:574]	:	INFO	:	Epoch 1767 | loss: nan | val_loss: nan | Time: 1710.43 ms
[2021-09-16 15:59:39	                main:574]	:	INFO	:	Epoch 1768 | loss: nan | val_loss: nan | Time: 1719.34 ms
[2021-09-16 15:59:41	                main:574]	:	INFO	:	Epoch 1769 | loss: nan | val_loss: nan | Time: 1683.04 ms
[2021-09-16 15:59:42	                main:574]	:	INFO	:	Epoch 1770 | loss: nan | val_loss: nan | Time: 1695.72 ms
[2021-09-16 15:59:44	                main:574]	:	INFO	:	Epoch 1771 | loss: nan | val_loss: nan | Time: 1643.17 ms
[2021-09-16 15:59:46	                main:574]	:	INFO	:	Epoch 1772 | loss: nan | val_loss: nan | Time: 1678.68 ms
[2021-09-16 15:59:48	                main:574]	:	INFO	:	Epoch 1773 | loss: nan | val_loss: nan | Time: 1650.96 ms
[2021-09-16 15:59:50	                main:574]	:	INFO	:	Epoch 1774 | loss: nan | val_loss: nan | Time: 1695.37 ms
[2021-09-16 15:59:51	                main:574]	:	INFO	:	Epoch 1775 | loss: nan | val_loss: nan | Time: 1721.11 ms
[2021-09-16 15:59:53	                main:574]	:	INFO	:	Epoch 1776 | loss: nan | val_loss: nan | Time: 1716.06 ms
[2021-09-16 15:59:55	                main:574]	:	INFO	:	Epoch 1777 | loss: nan | val_loss: nan | Time: 1723.44 ms
[2021-09-16 15:59:57	                main:574]	:	INFO	:	Epoch 1778 | loss: nan | val_loss: nan | Time: 1698.85 ms
[2021-09-16 15:59:59	                main:574]	:	INFO	:	Epoch 1779 | loss: nan | val_loss: nan | Time: 1734.1 ms
[2021-09-16 16:00:01	                main:574]	:	INFO	:	Epoch 1780 | loss: nan | val_loss: nan | Time: 1650.06 ms
[2021-09-16 16:00:02	                main:574]	:	INFO	:	Epoch 1781 | loss: nan | val_loss: nan | Time: 1667.63 ms
[2021-09-16 16:00:04	                main:574]	:	INFO	:	Epoch 1782 | loss: nan | val_loss: nan | Time: 1692.46 ms
[2021-09-16 16:00:06	                main:574]	:	INFO	:	Epoch 1783 | loss: nan | val_loss: nan | Time: 1636.21 ms
[2021-09-16 16:00:08	                main:574]	:	INFO	:	Epoch 1784 | loss: nan | val_loss: nan | Time: 1690.95 ms
[2021-09-16 16:00:10	                main:574]	:	INFO	:	Epoch 1785 | loss: nan | val_loss: nan | Time: 1715.24 ms
[2021-09-16 16:00:11	                main:574]	:	INFO	:	Epoch 1786 | loss: nan | val_loss: nan | Time: 1673.79 ms
[2021-09-16 16:00:13	                main:574]	:	INFO	:	Epoch 1787 | loss: nan | val_loss: nan | Time: 1650.55 ms
[2021-09-16 16:00:15	                main:574]	:	INFO	:	Epoch 1788 | loss: nan | val_loss: nan | Time: 1664.81 ms
[2021-09-16 16:00:17	                main:574]	:	INFO	:	Epoch 1789 | loss: nan | val_loss: nan | Time: 1700.87 ms
[2021-09-16 16:00:19	                main:574]	:	INFO	:	Epoch 1790 | loss: nan | val_loss: nan | Time: 1617.61 ms
[2021-09-16 16:00:20	                main:574]	:	INFO	:	Epoch 1791 | loss: nan | val_loss: nan | Time: 1626.45 ms
[2021-09-16 16:00:22	                main:574]	:	INFO	:	Epoch 1792 | loss: nan | val_loss: nan | Time: 1701.23 ms
[2021-09-16 16:00:24	                main:574]	:	INFO	:	Epoch 1793 | loss: nan | val_loss: nan | Time: 1668.84 ms
[2021-09-16 16:00:26	                main:574]	:	INFO	:	Epoch 1794 | loss: nan | val_loss: nan | Time: 1753.2 ms
[2021-09-16 16:00:28	                main:574]	:	INFO	:	Epoch 1795 | loss: nan | val_loss: nan | Time: 1702.62 ms
[2021-09-16 16:00:29	                main:574]	:	INFO	:	Epoch 1796 | loss: nan | val_loss: nan | Time: 1677.54 ms
[2021-09-16 16:00:31	                main:574]	:	INFO	:	Epoch 1797 | loss: nan | val_loss: nan | Time: 1679.62 ms
[2021-09-16 16:00:33	                main:574]	:	INFO	:	Epoch 1798 | loss: nan | val_loss: nan | Time: 1687.83 ms
[2021-09-16 16:00:35	                main:574]	:	INFO	:	Epoch 1799 | loss: nan | val_loss: nan | Time: 1652.9 ms
[2021-09-16 16:00:37	                main:574]	:	INFO	:	Epoch 1800 | loss: nan | val_loss: nan | Time: 1649.37 ms
[2021-09-16 16:00:38	                main:574]	:	INFO	:	Epoch 1801 | loss: nan | val_loss: nan | Time: 1660.97 ms
[2021-09-16 16:00:40	                main:574]	:	INFO	:	Epoch 1802 | loss: nan | val_loss: nan | Time: 1624.77 ms
[2021-09-16 16:00:42	                main:574]	:	INFO	:	Epoch 1803 | loss: nan | val_loss: nan | Time: 1670.54 ms
[2021-09-16 16:00:44	                main:574]	:	INFO	:	Epoch 1804 | loss: nan | val_loss: nan | Time: 1733.01 ms
[2021-09-16 16:00:46	                main:574]	:	INFO	:	Epoch 1805 | loss: nan | val_loss: nan | Time: 1648.72 ms
[2021-09-16 16:00:48	                main:574]	:	INFO	:	Epoch 1806 | loss: nan | val_loss: nan | Time: 1649.39 ms
[2021-09-16 16:00:50	                main:574]	:	INFO	:	Epoch 1807 | loss: nan | val_loss: nan | Time: 1701.42 ms
[2021-09-16 16:00:51	                main:574]	:	INFO	:	Epoch 1808 | loss: nan | val_loss: nan | Time: 1677.55 ms
[2021-09-16 16:00:53	                main:574]	:	INFO	:	Epoch 1809 | loss: nan | val_loss: nan | Time: 1675.12 ms
[2021-09-16 16:00:55	                main:574]	:	INFO	:	Epoch 1810 | loss: nan | val_loss: nan | Time: 1630.85 ms
[2021-09-16 16:00:57	                main:574]	:	INFO	:	Epoch 1811 | loss: nan | val_loss: nan | Time: 1698.8 ms
[2021-09-16 16:00:59	                main:574]	:	INFO	:	Epoch 1812 | loss: nan | val_loss: nan | Time: 1713.4 ms
[2021-09-16 16:01:01	                main:574]	:	INFO	:	Epoch 1813 | loss: nan | val_loss: nan | Time: 1708.26 ms
[2021-09-16 16:01:03	                main:574]	:	INFO	:	Epoch 1814 | loss: nan | val_loss: nan | Time: 1726.4 ms
[2021-09-16 16:01:05	                main:574]	:	INFO	:	Epoch 1815 | loss: nan | val_loss: nan | Time: 1815.99 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce RTX 2060)
[2021-09-16 16:07:23	                main:435]	:	INFO	:	Set logging level to 1
[2021-09-16 16:07:23	                main:441]	:	INFO	:	Running in BOINC Client mode
[2021-09-16 16:07:23	                main:444]	:	INFO	:	Resolving all filenames
[2021-09-16 16:07:23	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1)
[2021-09-16 16:07:24	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1631728174-30793-0_0_r424634468_1 (exists = 1)
[2021-09-16 16:07:24	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1631728174-30793-0_0_r424634468_0 (exists = 0)
[2021-09-16 16:07:24	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 0)
[2021-09-16 16:07:24	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2021-09-16 16:07:24	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5
[2021-09-16 16:07:24	                main:474]	:	INFO	:	Configuration: 
[2021-09-16 16:07:24	                main:475]	:	INFO	:	    Model type: GRU
[2021-09-16 16:07:24	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2021-09-16 16:07:24	                main:477]	:	INFO	:	    Max Epochs: 2048
[2021-09-16 16:07:24	                main:478]	:	INFO	:	    Batch Size: 128
[2021-09-16 16:07:24	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2021-09-16 16:07:24	                main:480]	:	INFO	:	    Patience: 10
[2021-09-16 16:07:25	                main:481]	:	INFO	:	    Hidden Width: 12
[2021-09-16 16:07:25	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2021-09-16 16:07:25	                main:483]	:	INFO	:	    # Backend Layers: 4
[2021-09-16 16:07:25	                main:484]	:	INFO	:	    # Threads: 1
[2021-09-16 16:07:25	                main:486]	:	INFO	:	Preparing Dataset
[2021-09-16 16:07:25	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-09-16 16:07:25	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-09-16 16:07:27	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2021-09-16 16:07:27	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-09-16 16:07:27	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-09-16 16:07:27	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2021-09-16 16:07:27	                main:494]	:	INFO	:	Creating Model
[2021-09-16 16:07:27	                main:507]	:	INFO	:	Preparing config file
[2021-09-16 16:07:27	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2021-09-16 16:07:28	                main:512]	:	INFO	:	Loading config


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFDD5DD4F99

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 09/16/21 16:07:28
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\5;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 00000000f7030000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000d8250000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.19041.1023 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1023

ModLoad: 00000000d6430000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 00000000d5da0000 00000000002c9000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 00000000d7e50000 00000000001a1000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000d6070000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1237) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.19041.1237 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1237

ModLoad: 00000000d78f0000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202

ModLoad: 00000000d5aa0000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1110) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.19041.1110 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1110

ModLoad: 00000000d5a00000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 00000000d60f0000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 0000000090490000 0000000000058000 C:\ProgramData\BOINC\slots\5\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000d80d0000 00000000000ac000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1052) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000d7110000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.19041.546

ModLoad: 00000000d7940000 000000000009b000 C:\WINDOWS\System32\sechost.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000d6300000 000000000012a000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1081) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000c0620000 000000000009b000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.16.27033.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\agent\_work\2\s\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.16.27033.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174; 2017
    Product Version       : 14.16.27033.0

ModLoad: 00000000b6410000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.867

ModLoad: 00000000c0a70000 0000000000015000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.16.27033.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\agent\_work\2\s\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.16.27033.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174; 2017
    Product Version       : 14.16.27033.0

ModLoad: 00000000c0dd0000 000000000000c000 C:\ProgramData\BOINC\slots\5\VCRUNTIME140_1.dll (14.27.29112.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.27.29112.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.27.29112.0

ModLoad: 000000001b030000 000000000abe7000 C:\ProgramData\BOINC\slots\5\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000085c40000 00000000002db000 C:\ProgramData\BOINC\slots\5\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000085f20000 000000000020d000 C:\ProgramData\BOINC\slots\5\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 00000000baf80000 0000000000040000 C:\ProgramData\BOINC\slots\5\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000025c20000 0000000024b49000 C:\ProgramData\BOINC\slots\5\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000a75a0000 0000000000045000 C:\ProgramData\BOINC\slots\5\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000017f80000 00000000030a5000 C:\ProgramData\BOINC\slots\5\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 0000000014ac0000 00000000034b2000 C:\ProgramData\BOINC\slots\5\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000c07a0000 0000000000010000 C:\ProgramData\BOINC\slots\5\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 00000000f0570000 000000000919f000 C:\ProgramData\BOINC\slots\5\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000ec810000 0000000003d5b000 C:\ProgramData\BOINC\slots\5\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000ea940000 0000000001eca000 C:\ProgramData\BOINC\slots\5\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000f9710000 000000001b3a4000 C:\ProgramData\BOINC\slots\5\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 00000000d7ac0000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000d3890000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000d6770000 0000000000472000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1237) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000d60a0000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 00000000d5c10000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000d5710000 0000000000034000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 00000000d5bb0000 0000000000060000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1237) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.19041.1237 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1237

ModLoad: 00000000d5c40000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000d5550000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000d71b0000 000000000073f000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.19041.964 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.964

ModLoad: 00000000d3a90000 0000000000790000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000d7af0000 0000000000355000 C:\WINDOWS\System32\combase.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202

ModLoad: 00000000d53c0000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.662) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000d6df0000 00000000000ae000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000d7a60000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000859a0000 000000000029d000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.6137) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r460\r460_00\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 27.21.14.6137
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.2.136 driver
    Product Version       : 27.21.14.6137

ModLoad: 00000000cf9a0000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000e9370000 00000000015c2000 C:\WINDOWS\system32\DriverStore\FileRepository\nvdd.inf_amd64_0a539bf579a84773\nvcuda64.dll (27.21.14.6137) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r460\r460_00\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 27.21.14.6137
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.2.136 driver
    Product Version       : 27.21.14.6137

ModLoad: 00000000d6bf0000 000000000006b000 C:\WINDOWS\System32\WS2_32.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : ws2_32.pdb
    File Version          : 10.0.19041.1081 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1081

ModLoad: 00000000cd3f0000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.19041.906 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.906

ModLoad: 00000000d5310000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000d34f0000 000000000009e000 C:\WINDOWS\system32\uxtheme.dll (6.2.19041.1081) (-exported- Symbols Loaded)
    Linked PDB Filename   : UxTheme.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000c5160000 00000000006f1000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.6137) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r460\r460_00\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 27.21.14.6137
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 27.21.14.6137

ModLoad: 00000000d6f00000 000000000012a000 C:\WINDOWS\System32\OLE32.DLL (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : ole32.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202

ModLoad: 00000000d5970000 0000000000083000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3630, Write: 306, Other 897

- I/O Transfers Counters -
Read: 6621881, Write: 7171, Other 32494

- Paged Pool Usage -
QuotaPagedPoolUsage: 3454928, QuotaPeakPagedPoolUsage: 3454928
QuotaNonPagedPoolUsage: 38208, QuotaPeakNonPagedPoolUsage: 38336

- Virtual Memory Usage -
VirtualSize: -1253728256, PeakVirtualSize: -650588160

- Pagefile Usage -
PagefileUsage: -1253728256, PeakPagefileUsage: -1253728256

- Working Set Size -
WorkingSetSize: 1233858560, PeakWorkingSetSize: 1233862656, PageFaultCount: 429272

*** Dump of thread ID 10004 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 3906250.000000, User Time: 11718750.000000, Wait Time: 7645400.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFDD5DD4F99

- Registers -
rax=0000000020bc8b93 rbx=00000000f7394910 rcx=0000000044ae5be0 rdx=0000000000000001 rsi=0000000044ae6520 rdi=0000000019930520
r8=0000000044ae5c78 r9=0000000000000000 r10=0000000030000000 r11=00000000bdafd000 r12=0000000096a90aa0 r13=0000000044ae6730
r14=00000000cf9f61e0 r15=0000000000000000 rip=00000000d5dd4f99 rsp=0000000044ae63c0 rbp=0000000044ae66b0
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
44ae6490 f72aa884 00000040 0000004f 96a90d00 0000007d KERNELBASE!RaiseException+0x0 
44ae64f0 f7051ca6 df820000 44ae65c9 c7996940 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
44ae65a0 f705593b 00000000 00000030 00000020 00000008 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
44ae66f0 f7051a78 00000000 00000000 44ae6a20 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
44ae67c0 f7051cfc 44ae6a20 00000000 00000080 44ae6cf0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
44ae6880 f705c4dd 44ae6cf0 44ae6cf0 44ae6cf0 44ae6cf0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
44ae6b70 f704b2fe 44ae7188 44ae6cf0 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
44aff910 f728c6f8 e13e9730 00000000 00000000 e138f830 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
44aff950 d6447034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
44aff980 d82a2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
44affa00 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 12376 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 156250.000000, Wait Time: 7645100.000000

- Registers -
rax=00000000000001d3 rbx=00000000df827a50 rcx=0000000000000070 rdx=00000000df8276d0 rsi=00000000df823390 rdi=00000000df827a50
r8=00000000cf9a5008 r9=0000000044bfef90 r10=00000000cf9a00f0 r11=0000000000000001 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000d82f07c4 rsp=0000000044bff4e8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
44bff4e0 d82a2dc7 00000000 00000000 df823390 df827a50 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
44bff7e0 d6447034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
44bff810 d82a2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
44bff890 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 12440 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 7645100.000000

- Registers -
rax=00000000000001d3 rbx=00000000df827df0 rcx=0000000000000070 rdx=00000000df827a70 rsi=00000000df823390 rdi=00000000df827df0
r8=0000000000000008 r9=0000000000000040 r10=0000000000000500 r11=0000000073df3f9f r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000d82f07c4 rsp=0000000044cff498 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
44cff490 d82a2dc7 00000000 00000000 df823390 df827df0 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
44cff790 d6447034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
44cff7c0 d82a2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
44cff840 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 12200 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 312500.000000, User Time: 0.000000, Wait Time: 7645100.000000

- Registers -
rax=00000000000001d3 rbx=00000000df828e40 rcx=0000000000000070 rdx=00000000df828ac0 rsi=00000000df823390 rdi=00000000df828e40
r8=0000000044dfef88 r9=0000000000000000 r10=0000000000000098 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000d82f07c4 rsp=0000000044dff538 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
44dff530 d82a2dc7 00000000 00000000 df823390 df828e40 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
44dff830 d6447034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
44dff860 d82a2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
44dff8e0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 10900 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 7645397.000000

- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=0000000044fffbe0 rsi=0000000000000000 rdi=0000000000000064
r8=0000000044fffbb8 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000d82ed3f4 rsp=0000000044fffbb8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
44fffbb0 d5de967e 44fffc78 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0 
44fffc50 f706a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0 
44fffc80 d6447034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
44fffcb0 d82a2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
44fffd30 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 13560 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 7645396.000000

- Registers -
rax=000000000000005b rbx=000000000000000e rcx=000000000000000e rdx=00000000450ff5e0 rsi=0000000000000000 rdi=000000000000000e
r8=0000000000000001 r9=00000000e15b0300 r10=0000000000000000 r11=00000000450ff550 r12=0000000000000064 r13=00000000450ff5e0
r14=00000000450ff2e0 r15=0000000000000000 rip=00000000d82ed8c4 rsp=00000000450ff288 rbp=00000000e15b0300
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
450ff280 d5decb70 00000000 44836000 d83ba4d0 44836000 ntdll!ZwWaitForMultipleObjects+0x0 
450ff570 d5deca6e df8345a0 004e0049 0000000e 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
450ff5b0 e9526714 e15b31e0 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
450ff7f0 e95be55d 00000000 e15b0300 00000000 00000000 nvcuda64!+0x0 
450ff8a0 e95260e3 241c4afa 225f583c e1b32710 00000000 nvcuda64!cuProfilerStop+0x0 
450ff8d0 e983d9d4 e1b32710 00000000 00000000 00000000 nvcuda64!+0x0 
450ff900 d6447034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
450ff930 d82a2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
450ff9b0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 17816 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 7645273.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=0000000000000290 rdx=0000000000000000 rsi=0000000000000000 rdi=0000000000000290
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000000000000 r13=0000000000000000
r14=0000000000000290 r15=0000000000000000 rip=00000000d82ecdf4 rsp=00000000451ff878 rbp=00000000e1569960
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
451ff870 d5dc1a8e 00000000 00000000 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0 
451ff910 e973cfae e1b329b0 d5dca3c5 00000000 00000290 KERNELBASE!WaitForSingleObjectEx+0x0 
451ff980 e95260e3 e1569960 ef0728a0 e1b329b0 00000000 nvcuda64!cuProfilerStop+0x0 
451ff9b0 e983d9d4 e1b329b0 00000000 00000000 00000000 nvcuda64!+0x0 
451ff9e0 d6447034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
451ffa10 d82a2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
451ffa90 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 4216 (state: Waiting): ***

- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 7645374.000000

- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000e18082a8 rdx=00000000452ffcb8 rsi=00000000452ffc20 rdi=0000000000000000
r8=00000000452ffc98 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=00000000452ffcb8 r13=0000000000000000
r14=00000000e18082a8 r15=00000000e180ca20 rip=00000000d82f0764 rsp=00000000452ffbf8 rbp=00000000452ffc50
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
452ffbf0 d82b4295 00000102 00000102 00000000 452ffc20 ntdll!NtWaitForAlertByThreadId+0x0 
452ffc60 d5e0ce39 e180a200 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0 
452ffc90 e94a4a9c e180a200 e180a200 e180a200 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0 
452ffcf0 e95260e3 00000004 2340d734 242a4a01 00000000 nvcuda64!+0x0 
452ffd20 e983d9d4 e1b323e0 00000000 00000000 00000000 nvcuda64!+0x0 
452ffd50 d6447034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
452ffd80 d82a2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
452ffe00 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)