Task 14550494

Name ParityModified-1647047358-17352-3-0_0
Workunit 11575550
Created 8 Apr 2022, 14:10:58 UTC
Sent 10 Apr 2022, 12:23:53 UTC
Report deadline 18 Apr 2022, 12:23:53 UTC
Received 11 Apr 2022, 0:02:31 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 18919
Run time 49 min 28 sec
CPU time 48 min 31 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 4,378.59 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.64 GB
Peak swap size 3.62 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
an | Time: 1622.9 ms
[2022-04-10 18:51:05	                main:574]	:	INFO	:	Epoch 1579 | loss: nan | val_loss: nan | Time: 1629.48 ms
[2022-04-10 18:51:07	                main:574]	:	INFO	:	Epoch 1580 | loss: nan | val_loss: nan | Time: 1645.18 ms
[2022-04-10 18:51:08	                main:574]	:	INFO	:	Epoch 1581 | loss: nan | val_loss: nan | Time: 1596.26 ms
[2022-04-10 18:51:10	                main:574]	:	INFO	:	Epoch 1582 | loss: nan | val_loss: nan | Time: 1606.24 ms
[2022-04-10 18:51:11	                main:574]	:	INFO	:	Epoch 1583 | loss: nan | val_loss: nan | Time: 1596.07 ms
[2022-04-10 18:51:13	                main:574]	:	INFO	:	Epoch 1584 | loss: nan | val_loss: nan | Time: 1618.69 ms
[2022-04-10 18:51:15	                main:574]	:	INFO	:	Epoch 1585 | loss: nan | val_loss: nan | Time: 1638.19 ms
[2022-04-10 18:51:16	                main:574]	:	INFO	:	Epoch 1586 | loss: nan | val_loss: nan | Time: 1602.54 ms
[2022-04-10 18:51:18	                main:574]	:	INFO	:	Epoch 1587 | loss: nan | val_loss: nan | Time: 1615.57 ms
[2022-04-10 18:51:19	                main:574]	:	INFO	:	Epoch 1588 | loss: nan | val_loss: nan | Time: 1606.88 ms
[2022-04-10 18:51:21	                main:574]	:	INFO	:	Epoch 1589 | loss: nan | val_loss: nan | Time: 1629.99 ms
[2022-04-10 18:51:23	                main:574]	:	INFO	:	Epoch 1590 | loss: nan | val_loss: nan | Time: 1633.71 ms
[2022-04-10 18:51:24	                main:574]	:	INFO	:	Epoch 1591 | loss: nan | val_loss: nan | Time: 1624.25 ms
[2022-04-10 18:51:26	                main:574]	:	INFO	:	Epoch 1592 | loss: nan | val_loss: nan | Time: 1642.05 ms
[2022-04-10 18:51:28	                main:574]	:	INFO	:	Epoch 1593 | loss: nan | val_loss: nan | Time: 1599.53 ms
[2022-04-10 18:51:29	                main:574]	:	INFO	:	Epoch 1594 | loss: nan | val_loss: nan | Time: 1604.65 ms
[2022-04-10 18:51:31	                main:574]	:	INFO	:	Epoch 1595 | loss: nan | val_loss: nan | Time: 1609.81 ms
[2022-04-10 18:51:32	                main:574]	:	INFO	:	Epoch 1596 | loss: nan | val_loss: nan | Time: 1612.66 ms
[2022-04-10 18:51:34	                main:574]	:	INFO	:	Epoch 1597 | loss: nan | val_loss: nan | Time: 1625.06 ms
[2022-04-10 18:51:36	                main:574]	:	INFO	:	Epoch 1598 | loss: nan | val_loss: nan | Time: 1625.96 ms
[2022-04-10 18:51:37	                main:574]	:	INFO	:	Epoch 1599 | loss: nan | val_loss: nan | Time: 1608.1 ms
[2022-04-10 18:51:39	                main:574]	:	INFO	:	Epoch 1600 | loss: nan | val_loss: nan | Time: 1627.11 ms
[2022-04-10 18:51:41	                main:574]	:	INFO	:	Epoch 1601 | loss: nan | val_loss: nan | Time: 1613.93 ms
[2022-04-10 18:51:42	                main:574]	:	INFO	:	Epoch 1602 | loss: nan | val_loss: nan | Time: 1609.65 ms
[2022-04-10 18:51:44	                main:574]	:	INFO	:	Epoch 1603 | loss: nan | val_loss: nan | Time: 1632.72 ms
[2022-04-10 18:51:45	                main:574]	:	INFO	:	Epoch 1604 | loss: nan | val_loss: nan | Time: 1620.15 ms
[2022-04-10 18:51:47	                main:574]	:	INFO	:	Epoch 1605 | loss: nan | val_loss: nan | Time: 1632.99 ms
[2022-04-10 18:51:49	                main:574]	:	INFO	:	Epoch 1606 | loss: nan | val_loss: nan | Time: 1624.85 ms
[2022-04-10 18:51:50	                main:574]	:	INFO	:	Epoch 1607 | loss: nan | val_loss: nan | Time: 1694.79 ms
[2022-04-10 18:51:52	                main:574]	:	INFO	:	Epoch 1608 | loss: nan | val_loss: nan | Time: 1614.65 ms
[2022-04-10 18:51:54	                main:574]	:	INFO	:	Epoch 1609 | loss: nan | val_loss: nan | Time: 1629.36 ms
[2022-04-10 18:51:55	                main:574]	:	INFO	:	Epoch 1610 | loss: nan | val_loss: nan | Time: 1641.51 ms
[2022-04-10 18:51:57	                main:574]	:	INFO	:	Epoch 1611 | loss: nan | val_loss: nan | Time: 1627.7 ms
[2022-04-10 18:51:59	                main:574]	:	INFO	:	Epoch 1612 | loss: nan | val_loss: nan | Time: 1600.8 ms
[2022-04-10 18:52:00	                main:574]	:	INFO	:	Epoch 1613 | loss: nan | val_loss: nan | Time: 1650.71 ms
[2022-04-10 18:52:02	                main:574]	:	INFO	:	Epoch 1614 | loss: nan | val_loss: nan | Time: 1630.03 ms
[2022-04-10 18:52:03	                main:574]	:	INFO	:	Epoch 1615 | loss: nan | val_loss: nan | Time: 1632.13 ms
[2022-04-10 18:52:05	                main:574]	:	INFO	:	Epoch 1616 | loss: nan | val_loss: nan | Time: 1615.62 ms
[2022-04-10 18:52:07	                main:574]	:	INFO	:	Epoch 1617 | loss: nan | val_loss: nan | Time: 1634.34 ms
[2022-04-10 18:52:08	                main:574]	:	INFO	:	Epoch 1618 | loss: nan | val_loss: nan | Time: 1631.91 ms
[2022-04-10 18:52:10	                main:574]	:	INFO	:	Epoch 1619 | loss: nan | val_loss: nan | Time: 1615.05 ms
[2022-04-10 18:52:12	                main:574]	:	INFO	:	Epoch 1620 | loss: nan | val_loss: nan | Time: 1601.74 ms
[2022-04-10 18:52:13	                main:574]	:	INFO	:	Epoch 1621 | loss: nan | val_loss: nan | Time: 1646.42 ms
[2022-04-10 18:52:15	                main:574]	:	INFO	:	Epoch 1622 | loss: nan | val_loss: nan | Time: 1739.31 ms
[2022-04-10 18:52:17	                main:574]	:	INFO	:	Epoch 1623 | loss: nan | val_loss: nan | Time: 1691.5 ms
[2022-04-10 18:52:18	                main:574]	:	INFO	:	Epoch 1624 | loss: nan | val_loss: nan | Time: 1642.49 ms
[2022-04-10 18:52:20	                main:574]	:	INFO	:	Epoch 1625 | loss: nan | val_loss: nan | Time: 1723.14 ms
[2022-04-10 18:52:22	                main:574]	:	INFO	:	Epoch 1626 | loss: nan | val_loss: nan | Time: 1598.62 ms
[2022-04-10 18:52:23	                main:574]	:	INFO	:	Epoch 1627 | loss: nan | val_loss: nan | Time: 1598.34 ms
[2022-04-10 18:52:25	                main:574]	:	INFO	:	Epoch 1628 | loss: nan | val_loss: nan | Time: 1629.46 ms
[2022-04-10 18:52:26	                main:574]	:	INFO	:	Epoch 1629 | loss: nan | val_loss: nan | Time: 1588.66 ms
[2022-04-10 18:52:28	                main:574]	:	INFO	:	Epoch 1630 | loss: nan | val_loss: nan | Time: 1635.71 ms
[2022-04-10 18:52:30	                main:574]	:	INFO	:	Epoch 1631 | loss: nan | val_loss: nan | Time: 1602.9 ms
[2022-04-10 18:52:31	                main:574]	:	INFO	:	Epoch 1632 | loss: nan | val_loss: nan | Time: 1660.73 ms
[2022-04-10 18:52:33	                main:574]	:	INFO	:	Epoch 1633 | loss: nan | val_loss: nan | Time: 1633.78 ms
[2022-04-10 18:52:35	                main:574]	:	INFO	:	Epoch 1634 | loss: nan | val_loss: nan | Time: 1591.55 ms
[2022-04-10 18:52:36	                main:574]	:	INFO	:	Epoch 1635 | loss: nan | val_loss: nan | Time: 1613.55 ms
[2022-04-10 18:52:38	                main:574]	:	INFO	:	Epoch 1636 | loss: nan | val_loss: nan | Time: 1623.89 ms
[2022-04-10 18:52:39	                main:574]	:	INFO	:	Epoch 1637 | loss: nan | val_loss: nan | Time: 1604.46 ms
[2022-04-10 18:52:41	                main:574]	:	INFO	:	Epoch 1638 | loss: nan | val_loss: nan | Time: 1625.01 ms
[2022-04-10 18:52:43	                main:574]	:	INFO	:	Epoch 1639 | loss: nan | val_loss: nan | Time: 1623.57 ms
[2022-04-10 18:52:44	                main:574]	:	INFO	:	Epoch 1640 | loss: nan | val_loss: nan | Time: 1630.95 ms
[2022-04-10 18:52:46	                main:574]	:	INFO	:	Epoch 1641 | loss: nan | val_loss: nan | Time: 1618.98 ms
[2022-04-10 18:52:48	                main:574]	:	INFO	:	Epoch 1642 | loss: nan | val_loss: nan | Time: 1608.96 ms
[2022-04-10 18:52:49	                main:574]	:	INFO	:	Epoch 1643 | loss: nan | val_loss: nan | Time: 1602.76 ms
[2022-04-10 18:52:51	                main:574]	:	INFO	:	Epoch 1644 | loss: nan | val_loss: nan | Time: 1651.71 ms
[2022-04-10 18:52:52	                main:574]	:	INFO	:	Epoch 1645 | loss: nan | val_loss: nan | Time: 1647.68 ms
[2022-04-10 18:52:54	                main:574]	:	INFO	:	Epoch 1646 | loss: nan | val_loss: nan | Time: 1593.23 ms
[2022-04-10 18:52:56	                main:574]	:	INFO	:	Epoch 1647 | loss: nan | val_loss: nan | Time: 1627.14 ms
[2022-04-10 18:52:57	                main:574]	:	INFO	:	Epoch 1648 | loss: nan | val_loss: nan | Time: 1642.21 ms
[2022-04-10 18:52:59	                main:574]	:	INFO	:	Epoch 1649 | loss: nan | val_loss: nan | Time: 1606.11 ms
[2022-04-10 18:53:01	                main:574]	:	INFO	:	Epoch 1650 | loss: nan | val_loss: nan | Time: 1599.31 ms
[2022-04-10 18:53:02	                main:574]	:	INFO	:	Epoch 1651 | loss: nan | val_loss: nan | Time: 1625.68 ms
[2022-04-10 18:53:04	                main:574]	:	INFO	:	Epoch 1652 | loss: nan | val_loss: nan | Time: 1595.23 ms
[2022-04-10 18:53:05	                main:574]	:	INFO	:	Epoch 1653 | loss: nan | val_loss: nan | Time: 1625.62 ms
[2022-04-10 18:53:07	                main:574]	:	INFO	:	Epoch 1654 | loss: nan | val_loss: nan | Time: 1644.55 ms
[2022-04-10 18:53:09	                main:574]	:	INFO	:	Epoch 1655 | loss: nan | val_loss: nan | Time: 1614.83 ms
[2022-04-10 18:53:10	                main:574]	:	INFO	:	Epoch 1656 | loss: nan | val_loss: nan | Time: 1622.39 ms
[2022-04-10 18:53:12	                main:574]	:	INFO	:	Epoch 1657 | loss: nan | val_loss: nan | Time: 1599.51 ms
[2022-04-10 18:53:14	                main:574]	:	INFO	:	Epoch 1658 | loss: nan | val_loss: nan | Time: 1651.59 ms
[2022-04-10 18:53:15	                main:574]	:	INFO	:	Epoch 1659 | loss: nan | val_loss: nan | Time: 1607.87 ms
[2022-04-10 18:53:17	                main:574]	:	INFO	:	Epoch 1660 | loss: nan | val_loss: nan | Time: 1625.28 ms
[2022-04-10 18:53:18	                main:574]	:	INFO	:	Epoch 1661 | loss: nan | val_loss: nan | Time: 1602.9 ms
[2022-04-10 18:53:20	                main:574]	:	INFO	:	Epoch 1662 | loss: nan | val_loss: nan | Time: 1627.15 ms
[2022-04-10 18:53:22	                main:574]	:	INFO	:	Epoch 1663 | loss: nan | val_loss: nan | Time: 1630.1 ms
[2022-04-10 18:53:23	                main:574]	:	INFO	:	Epoch 1664 | loss: nan | val_loss: nan | Time: 1630.42 ms
[2022-04-10 18:53:25	                main:574]	:	INFO	:	Epoch 1665 | loss: nan | val_loss: nan | Time: 1609.1 ms
[2022-04-10 18:53:27	                main:574]	:	INFO	:	Epoch 1666 | loss: nan | val_loss: nan | Time: 1617.4 ms
[2022-04-10 18:53:28	                main:574]	:	INFO	:	Epoch 1667 | loss: nan | val_loss: nan | Time: 1638.1 ms
[2022-04-10 18:53:30	                main:574]	:	INFO	:	Epoch 1668 | loss: nan | val_loss: nan | Time: 1610.38 ms
[2022-04-10 18:53:31	                main:574]	:	INFO	:	Epoch 1669 | loss: nan | val_loss: nan | Time: 1612.04 ms
[2022-04-10 18:53:33	                main:574]	:	INFO	:	Epoch 1670 | loss: nan | val_loss: nan | Time: 1606.46 ms
[2022-04-10 18:53:35	                main:574]	:	INFO	:	Epoch 1671 | loss: nan | val_loss: nan | Time: 1611.97 ms
[2022-04-10 18:53:36	                main:574]	:	INFO	:	Epoch 1672 | loss: nan | val_loss: nan | Time: 1602.66 ms
[2022-04-10 18:53:38	                main:574]	:	INFO	:	Epoch 1673 | loss: nan | val_loss: nan | Time: 1608.18 ms
[2022-04-10 18:53:39	                main:574]	:	INFO	:	Epoch 1674 | loss: nan | val_loss: nan | Time: 1594.51 ms
[2022-04-10 18:53:41	                main:574]	:	INFO	:	Epoch 1675 | loss: nan | val_loss: nan | Time: 1606.57 ms
[2022-04-10 18:53:43	                main:574]	:	INFO	:	Epoch 1676 | loss: nan | val_loss: nan | Time: 1639.56 ms
[2022-04-10 18:53:44	                main:574]	:	INFO	:	Epoch 1677 | loss: nan | val_loss: nan | Time: 1616.25 ms
[2022-04-10 18:53:46	                main:574]	:	INFO	:	Epoch 1678 | loss: nan | val_loss: nan | Time: 1662.08 ms
[2022-04-10 18:53:48	                main:574]	:	INFO	:	Epoch 1679 | loss: nan | val_loss: nan | Time: 1603.75 ms
[2022-04-10 18:53:49	                main:574]	:	INFO	:	Epoch 1680 | loss: nan | val_loss: nan | Time: 1604.2 ms
[2022-04-10 18:53:51	                main:574]	:	INFO	:	Epoch 1681 | loss: nan | val_loss: nan | Time: 1650.89 ms
[2022-04-10 18:53:52	                main:574]	:	INFO	:	Epoch 1682 | loss: nan | val_loss: nan | Time: 1620.11 ms
[2022-04-10 18:53:54	                main:574]	:	INFO	:	Epoch 1683 | loss: nan | val_loss: nan | Time: 1616.36 ms
[2022-04-10 18:53:56	                main:574]	:	INFO	:	Epoch 1684 | loss: nan | val_loss: nan | Time: 1633.64 ms
[2022-04-10 18:53:57	                main:574]	:	INFO	:	Epoch 1685 | loss: nan | val_loss: nan | Time: 1598.09 ms
[2022-04-10 18:53:59	                main:574]	:	INFO	:	Epoch 1686 | loss: nan | val_loss: nan | Time: 1640.79 ms
[2022-04-10 18:54:01	                main:574]	:	INFO	:	Epoch 1687 | loss: nan | val_loss: nan | Time: 1631.96 ms
[2022-04-10 18:54:02	                main:574]	:	INFO	:	Epoch 1688 | loss: nan | val_loss: nan | Time: 1630.63 ms
[2022-04-10 18:54:04	                main:574]	:	INFO	:	Epoch 1689 | loss: nan | val_loss: nan | Time: 1628.34 ms
[2022-04-10 18:54:05	                main:574]	:	INFO	:	Epoch 1690 | loss: nan | val_loss: nan | Time: 1616.12 ms
[2022-04-10 18:54:07	                main:574]	:	INFO	:	Epoch 1691 | loss: nan | val_loss: nan | Time: 1599.58 ms
[2022-04-10 18:54:09	                main:574]	:	INFO	:	Epoch 1692 | loss: nan | val_loss: nan | Time: 1601.59 ms
[2022-04-10 18:54:10	                main:574]	:	INFO	:	Epoch 1693 | loss: nan | val_loss: nan | Time: 1652.15 ms
[2022-04-10 18:54:12	                main:574]	:	INFO	:	Epoch 1694 | loss: nan | val_loss: nan | Time: 1630.37 ms
[2022-04-10 18:54:14	                main:574]	:	INFO	:	Epoch 1695 | loss: nan | val_loss: nan | Time: 1596.65 ms
[2022-04-10 18:54:15	                main:574]	:	INFO	:	Epoch 1696 | loss: nan | val_loss: nan | Time: 1625.83 ms
[2022-04-10 18:54:17	                main:574]	:	INFO	:	Epoch 1697 | loss: nan | val_loss: nan | Time: 1626.27 ms
[2022-04-10 18:54:18	                main:574]	:	INFO	:	Epoch 1698 | loss: nan | val_loss: nan | Time: 1594.19 ms
[2022-04-10 18:54:20	                main:574]	:	INFO	:	Epoch 1699 | loss: nan | val_loss: nan | Time: 1638.13 ms
[2022-04-10 18:54:22	                main:574]	:	INFO	:	Epoch 1700 | loss: nan | val_loss: nan | Time: 1625.87 ms
[2022-04-10 18:54:23	                main:574]	:	INFO	:	Epoch 1701 | loss: nan | val_loss: nan | Time: 1654.75 ms
[2022-04-10 18:54:25	                main:574]	:	INFO	:	Epoch 1702 | loss: nan | val_loss: nan | Time: 1618.85 ms
[2022-04-10 18:54:27	                main:574]	:	INFO	:	Epoch 1703 | loss: nan | val_loss: nan | Time: 1634.82 ms
[2022-04-10 18:54:28	                main:574]	:	INFO	:	Epoch 1704 | loss: nan | val_loss: nan | Time: 1617.85 ms
[2022-04-10 18:54:30	                main:574]	:	INFO	:	Epoch 1705 | loss: nan | val_loss: nan | Time: 1605.15 ms
[2022-04-10 18:54:31	                main:574]	:	INFO	:	Epoch 1706 | loss: nan | val_loss: nan | Time: 1607.93 ms
[2022-04-10 18:54:33	                main:574]	:	INFO	:	Epoch 1707 | loss: nan | val_loss: nan | Time: 1622.74 ms
[2022-04-10 18:54:35	                main:574]	:	INFO	:	Epoch 1708 | loss: nan | val_loss: nan | Time: 1638.4 ms
[2022-04-10 18:54:36	                main:574]	:	INFO	:	Epoch 1709 | loss: nan | val_loss: nan | Time: 1636.75 ms
[2022-04-10 18:54:38	                main:574]	:	INFO	:	Epoch 1710 | loss: nan | val_loss: nan | Time: 1608.2 ms
[2022-04-10 18:54:40	                main:574]	:	INFO	:	Epoch 1711 | loss: nan | val_loss: nan | Time: 1648.75 ms
[2022-04-10 18:54:41	                main:574]	:	INFO	:	Epoch 1712 | loss: nan | val_loss: nan | Time: 1604.72 ms
[2022-04-10 18:54:43	                main:574]	:	INFO	:	Epoch 1713 | loss: nan | val_loss: nan | Time: 1637.4 ms
[2022-04-10 18:54:44	                main:574]	:	INFO	:	Epoch 1714 | loss: nan | val_loss: nan | Time: 1604.8 ms
[2022-04-10 18:54:46	                main:574]	:	INFO	:	Epoch 1715 | loss: nan | val_loss: nan | Time: 1595.26 ms
[2022-04-10 18:54:48	                main:574]	:	INFO	:	Epoch 1716 | loss: nan | val_loss: nan | Time: 1714 ms
[2022-04-10 18:54:49	                main:574]	:	INFO	:	Epoch 1717 | loss: nan | val_loss: nan | Time: 1661.99 ms
[2022-04-10 18:54:51	                main:574]	:	INFO	:	Epoch 1718 | loss: nan | val_loss: nan | Time: 1630.66 ms
[2022-04-10 18:54:53	                main:574]	:	INFO	:	Epoch 1719 | loss: nan | val_loss: nan | Time: 1616.34 ms
[2022-04-10 18:54:54	                main:574]	:	INFO	:	Epoch 1720 | loss: nan | val_loss: nan | Time: 1611.73 ms
[2022-04-10 18:54:56	                main:574]	:	INFO	:	Epoch 1721 | loss: nan | val_loss: nan | Time: 1618 ms
[2022-04-10 18:54:58	                main:574]	:	INFO	:	Epoch 1722 | loss: nan | val_loss: nan | Time: 1636.15 ms
[2022-04-10 18:54:59	                main:574]	:	INFO	:	Epoch 1723 | loss: nan | val_loss: nan | Time: 1593.25 ms
[2022-04-10 18:55:01	                main:574]	:	INFO	:	Epoch 1724 | loss: nan | val_loss: nan | Time: 1599.41 ms
[2022-04-10 18:55:02	                main:574]	:	INFO	:	Epoch 1725 | loss: nan | val_loss: nan | Time: 1620.17 ms
[2022-04-10 18:55:04	                main:574]	:	INFO	:	Epoch 1726 | loss: nan | val_loss: nan | Time: 1632.41 ms
[2022-04-10 18:55:06	                main:574]	:	INFO	:	Epoch 1727 | loss: nan | val_loss: nan | Time: 1633.51 ms
[2022-04-10 18:55:07	                main:574]	:	INFO	:	Epoch 1728 | loss: nan | val_loss: nan | Time: 1619.04 ms
[2022-04-10 18:55:09	                main:574]	:	INFO	:	Epoch 1729 | loss: nan | val_loss: nan | Time: 1627.03 ms
[2022-04-10 18:55:11	                main:574]	:	INFO	:	Epoch 1730 | loss: nan | val_loss: nan | Time: 1599.5 ms
[2022-04-10 18:55:12	                main:574]	:	INFO	:	Epoch 1731 | loss: nan | val_loss: nan | Time: 1622.05 ms
[2022-04-10 18:55:14	                main:574]	:	INFO	:	Epoch 1732 | loss: nan | val_loss: nan | Time: 1608.6 ms
[2022-04-10 18:55:15	                main:574]	:	INFO	:	Epoch 1733 | loss: nan | val_loss: nan | Time: 1617.52 ms
[2022-04-10 18:55:17	                main:574]	:	INFO	:	Epoch 1734 | loss: nan | val_loss: nan | Time: 1630.94 ms
[2022-04-10 18:55:19	                main:574]	:	INFO	:	Epoch 1735 | loss: nan | val_loss: nan | Time: 1635.39 ms
[2022-04-10 18:55:20	                main:574]	:	INFO	:	Epoch 1736 | loss: nan | val_loss: nan | Time: 1627.95 ms
[2022-04-10 18:55:22	                main:574]	:	INFO	:	Epoch 1737 | loss: nan | val_loss: nan | Time: 1622.52 ms
[2022-04-10 18:55:24	                main:574]	:	INFO	:	Epoch 1738 | loss: nan | val_loss: nan | Time: 1632.81 ms
[2022-04-10 18:55:25	                main:574]	:	INFO	:	Epoch 1739 | loss: nan | val_loss: nan | Time: 1615.56 ms
[2022-04-10 18:55:27	                main:574]	:	INFO	:	Epoch 1740 | loss: nan | val_loss: nan | Time: 1618.6 ms
[2022-04-10 18:55:28	                main:574]	:	INFO	:	Epoch 1741 | loss: nan | val_loss: nan | Time: 1637.69 ms
[2022-04-10 18:55:30	                main:574]	:	INFO	:	Epoch 1742 | loss: nan | val_loss: nan | Time: 1640.61 ms
[2022-04-10 18:55:32	                main:574]	:	INFO	:	Epoch 1743 | loss: nan | val_loss: nan | Time: 1634.55 ms
[2022-04-10 18:55:33	                main:574]	:	INFO	:	Epoch 1744 | loss: nan | val_loss: nan | Time: 1642.04 ms
[2022-04-10 18:55:35	                main:574]	:	INFO	:	Epoch 1745 | loss: nan | val_loss: nan | Time: 1640.57 ms
[2022-04-10 18:55:37	                main:574]	:	INFO	:	Epoch 1746 | loss: nan | val_loss: nan | Time: 1641.45 ms
[2022-04-10 18:55:38	                main:574]	:	INFO	:	Epoch 1747 | loss: nan | val_loss: nan | Time: 1607.16 ms
[2022-04-10 18:55:40	                main:574]	:	INFO	:	Epoch 1748 | loss: nan | val_loss: nan | Time: 1601.29 ms
[2022-04-10 18:55:42	                main:574]	:	INFO	:	Epoch 1749 | loss: nan | val_loss: nan | Time: 1635.23 ms
[2022-04-10 18:55:43	                main:574]	:	INFO	:	Epoch 1750 | loss: nan | val_loss: nan | Time: 1621.13 ms
[2022-04-10 18:55:45	                main:574]	:	INFO	:	Epoch 1751 | loss: nan | val_loss: nan | Time: 1608.09 ms
[2022-04-10 18:55:46	                main:574]	:	INFO	:	Epoch 1752 | loss: nan | val_loss: nan | Time: 1632.32 ms
[2022-04-10 18:55:48	                main:574]	:	INFO	:	Epoch 1753 | loss: nan | val_loss: nan | Time: 1645.72 ms
[2022-04-10 18:55:50	                main:574]	:	INFO	:	Epoch 1754 | loss: nan | val_loss: nan | Time: 1636.72 ms
[2022-04-10 18:55:51	                main:574]	:	INFO	:	Epoch 1755 | loss: nan | val_loss: nan | Time: 1623.93 ms
[2022-04-10 18:55:53	                main:574]	:	INFO	:	Epoch 1756 | loss: nan | val_loss: nan | Time: 1596.34 ms
[2022-04-10 18:55:54	                main:574]	:	INFO	:	Epoch 1757 | loss: nan | val_loss: nan | Time: 1592.45 ms
[2022-04-10 18:55:56	                main:574]	:	INFO	:	Epoch 1758 | loss: nan | val_loss: nan | Time: 1634.69 ms
[2022-04-10 18:55:58	                main:574]	:	INFO	:	Epoch 1759 | loss: nan | val_loss: nan | Time: 1604.67 ms
[2022-04-10 18:55:59	                main:574]	:	INFO	:	Epoch 1760 | loss: nan | val_loss: nan | Time: 1602.53 ms
[2022-04-10 18:56:01	                main:574]	:	INFO	:	Epoch 1761 | loss: nan | val_loss: nan | Time: 1622.49 ms
[2022-04-10 18:56:03	                main:574]	:	INFO	:	Epoch 1762 | loss: nan | val_loss: nan | Time: 1624.5 ms
[2022-04-10 18:56:04	                main:574]	:	INFO	:	Epoch 1763 | loss: nan | val_loss: nan | Time: 1620.63 ms
[2022-04-10 18:56:06	                main:574]	:	INFO	:	Epoch 1764 | loss: nan | val_loss: nan | Time: 1631.69 ms
[2022-04-10 18:56:07	                main:574]	:	INFO	:	Epoch 1765 | loss: nan | val_loss: nan | Time: 1608 ms
[2022-04-10 18:56:09	                main:574]	:	INFO	:	Epoch 1766 | loss: nan | val_loss: nan | Time: 1592.63 ms
[2022-04-10 18:56:11	                main:574]	:	INFO	:	Epoch 1767 | loss: nan | val_loss: nan | Time: 1625.3 ms
[2022-04-10 18:56:12	                main:574]	:	INFO	:	Epoch 1768 | loss: nan | val_loss: nan | Time: 1581.97 ms
[2022-04-10 18:56:14	                main:574]	:	INFO	:	Epoch 1769 | loss: nan | val_loss: nan | Time: 1605.08 ms
[2022-04-10 18:56:16	                main:574]	:	INFO	:	Epoch 1770 | loss: nan | val_loss: nan | Time: 1652.87 ms
[2022-04-10 18:56:17	                main:574]	:	INFO	:	Epoch 1771 | loss: nan | val_loss: nan | Time: 1611.13 ms
[2022-04-10 18:56:19	                main:574]	:	INFO	:	Epoch 1772 | loss: nan | val_loss: nan | Time: 1639.61 ms
[2022-04-10 18:56:20	                main:574]	:	INFO	:	Epoch 1773 | loss: nan | val_loss: nan | Time: 1601.9 ms
[2022-04-10 18:56:22	                main:574]	:	INFO	:	Epoch 1774 | loss: nan | val_loss: nan | Time: 1618.8 ms
[2022-04-10 18:56:24	                main:574]	:	INFO	:	Epoch 1775 | loss: nan | val_loss: nan | Time: 1652.5 ms
[2022-04-10 18:56:25	                main:574]	:	INFO	:	Epoch 1776 | loss: nan | val_loss: nan | Time: 1601.95 ms
[2022-04-10 18:56:27	                main:574]	:	INFO	:	Epoch 1777 | loss: nan | val_loss: nan | Time: 1605 ms
[2022-04-10 18:56:29	                main:574]	:	INFO	:	Epoch 1778 | loss: nan | val_loss: nan | Time: 1626.13 ms
[2022-04-10 18:56:30	                main:574]	:	INFO	:	Epoch 1779 | loss: nan | val_loss: nan | Time: 1660.24 ms
[2022-04-10 18:56:32	                main:574]	:	INFO	:	Epoch 1780 | loss: nan | val_loss: nan | Time: 1640.68 ms
[2022-04-10 18:56:33	                main:574]	:	INFO	:	Epoch 1781 | loss: nan | val_loss: nan | Time: 1656.87 ms
[2022-04-10 18:56:35	                main:574]	:	INFO	:	Epoch 1782 | loss: nan | val_loss: nan | Time: 1616.13 ms
[2022-04-10 18:56:37	                main:574]	:	INFO	:	Epoch 1783 | loss: nan | val_loss: nan | Time: 1634.34 ms
[2022-04-10 18:56:38	                main:574]	:	INFO	:	Epoch 1784 | loss: nan | val_loss: nan | Time: 1606.49 ms
[2022-04-10 18:56:40	                main:574]	:	INFO	:	Epoch 1785 | loss: nan | val_loss: nan | Time: 1589.47 ms
[2022-04-10 18:56:42	                main:574]	:	INFO	:	Epoch 1786 | loss: nan | val_loss: nan | Time: 1642.43 ms
[2022-04-10 18:56:43	                main:574]	:	INFO	:	Epoch 1787 | loss: nan | val_loss: nan | Time: 1615.79 ms
[2022-04-10 18:56:45	                main:574]	:	INFO	:	Epoch 1788 | loss: nan | val_loss: nan | Time: 1615.48 ms
[2022-04-10 18:56:46	                main:574]	:	INFO	:	Epoch 1789 | loss: nan | val_loss: nan | Time: 1614.93 ms
[2022-04-10 18:56:48	                main:574]	:	INFO	:	Epoch 1790 | loss: nan | val_loss: nan | Time: 1660.05 ms
[2022-04-10 18:56:50	                main:574]	:	INFO	:	Epoch 1791 | loss: nan | val_loss: nan | Time: 1642.11 ms
[2022-04-10 18:56:51	                main:574]	:	INFO	:	Epoch 1792 | loss: nan | val_loss: nan | Time: 1616.79 ms
[2022-04-10 18:56:53	                main:574]	:	INFO	:	Epoch 1793 | loss: nan | val_loss: nan | Time: 1636.62 ms
[2022-04-10 18:56:55	                main:574]	:	INFO	:	Epoch 1794 | loss: nan | val_loss: nan | Time: 1636.08 ms
[2022-04-10 18:56:56	                main:574]	:	INFO	:	Epoch 1795 | loss: nan | val_loss: nan | Time: 1617.53 ms
[2022-04-10 18:56:58	                main:574]	:	INFO	:	Epoch 1796 | loss: nan | val_loss: nan | Time: 1641.6 ms
[2022-04-10 18:57:00	                main:574]	:	INFO	:	Epoch 1797 | loss: nan | val_loss: nan | Time: 1645.19 ms
[2022-04-10 18:57:01	                main:574]	:	INFO	:	Epoch 1798 | loss: nan | val_loss: nan | Time: 1612.59 ms
[2022-04-10 18:57:03	                main:574]	:	INFO	:	Epoch 1799 | loss: nan | val_loss: nan | Time: 1628.67 ms
[2022-04-10 18:57:04	                main:574]	:	INFO	:	Epoch 1800 | loss: nan | val_loss: nan | Time: 1629.52 ms
[2022-04-10 18:57:06	                main:574]	:	INFO	:	Epoch 1801 | loss: nan | val_loss: nan | Time: 1617.11 ms
[2022-04-10 18:57:08	                main:574]	:	INFO	:	Epoch 1802 | loss: nan | val_loss: nan | Time: 1637.61 ms
[2022-04-10 18:57:09	                main:574]	:	INFO	:	Epoch 1803 | loss: nan | val_loss: nan | Time: 1654.67 ms
[2022-04-10 18:57:11	                main:574]	:	INFO	:	Epoch 1804 | loss: nan | val_loss: nan | Time: 1637.98 ms
[2022-04-10 18:57:13	                main:574]	:	INFO	:	Epoch 1805 | loss: nan | val_loss: nan | Time: 1625.38 ms
[2022-04-10 18:57:14	                main:574]	:	INFO	:	Epoch 1806 | loss: nan | val_loss: nan | Time: 1652.12 ms
[2022-04-10 18:57:16	                main:574]	:	INFO	:	Epoch 1807 | loss: nan | val_loss: nan | Time: 1630.95 ms
[2022-04-10 18:57:18	                main:574]	:	INFO	:	Epoch 1808 | loss: nan | val_loss: nan | Time: 1633.41 ms
[2022-04-10 18:57:19	                main:574]	:	INFO	:	Epoch 1809 | loss: nan | val_loss: nan | Time: 1648.08 ms
[2022-04-10 18:57:21	                main:574]	:	INFO	:	Epoch 1810 | loss: nan | val_loss: nan | Time: 1628.55 ms
[2022-04-10 18:57:22	                main:574]	:	INFO	:	Epoch 1811 | loss: nan | val_loss: nan | Time: 1636.02 ms
[2022-04-10 18:57:24	                main:574]	:	INFO	:	Epoch 1812 | loss: nan | val_loss: nan | Time: 1627.08 ms
[2022-04-10 18:57:26	                main:574]	:	INFO	:	Epoch 1813 | loss: nan | val_loss: nan | Time: 1628.6 ms
[2022-04-10 18:57:27	                main:574]	:	INFO	:	Epoch 1814 | loss: nan | val_loss: nan | Time: 1619.04 ms
[2022-04-10 18:57:29	                main:574]	:	INFO	:	Epoch 1815 | loss: nan | val_loss: nan | Time: 1628.09 ms
[2022-04-10 18:57:31	                main:574]	:	INFO	:	Epoch 1816 | loss: nan | val_loss: nan | Time: 1634.26 ms
[2022-04-10 18:57:32	                main:574]	:	INFO	:	Epoch 1817 | loss: nan | val_loss: nan | Time: 1632.26 ms
[2022-04-10 18:57:34	                main:574]	:	INFO	:	Epoch 1818 | loss: nan | val_loss: nan | Time: 1645.18 ms
[2022-04-10 18:57:36	                main:574]	:	INFO	:	Epoch 1819 | loss: nan | val_loss: nan | Time: 1648.91 ms
[2022-04-10 18:57:37	                main:574]	:	INFO	:	Epoch 1820 | loss: nan | val_loss: nan | Time: 1625.97 ms
[2022-04-10 18:57:39	                main:574]	:	INFO	:	Epoch 1821 | loss: nan | val_loss: nan | Time: 1615.2 ms
[2022-04-10 18:57:40	                main:574]	:	INFO	:	Epoch 1822 | loss: nan | val_loss: nan | Time: 1612.26 ms
[2022-04-10 18:57:42	                main:574]	:	INFO	:	Epoch 1823 | loss: nan | val_loss: nan | Time: 1642.23 ms
[2022-04-10 18:57:44	                main:574]	:	INFO	:	Epoch 1824 | loss: nan | val_loss: nan | Time: 1632.17 ms
[2022-04-10 18:57:45	                main:574]	:	INFO	:	Epoch 1825 | loss: nan | val_loss: nan | Time: 1637.6 ms
[2022-04-10 18:57:47	                main:574]	:	INFO	:	Epoch 1826 | loss: nan | val_loss: nan | Time: 1628.46 ms
[2022-04-10 18:57:49	                main:574]	:	INFO	:	Epoch 1827 | loss: nan | val_loss: nan | Time: 1603.29 ms
[2022-04-10 18:57:50	                main:574]	:	INFO	:	Epoch 1828 | loss: nan | val_loss: nan | Time: 1662.67 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 1060 6GB)
[2022-04-10 20:01:13	                main:435]	:	INFO	:	Set logging level to 1
[2022-04-10 20:01:13	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-04-10 20:01:13	                main:444]	:	INFO	:	Resolving all filenames
[2022-04-10 20:01:13	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-10 20:01:13	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-10 20:01:13	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-10 20:01:13	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-10 20:01:13	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-10 20:01:13	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-04-10 20:01:13	                main:474]	:	INFO	:	Configuration: 
[2022-04-10 20:01:13	                main:475]	:	INFO	:	    Model type: GRU
[2022-04-10 20:01:13	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-04-10 20:01:13	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-04-10 20:01:13	                main:478]	:	INFO	:	    Batch Size: 128
[2022-04-10 20:01:13	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-04-10 20:01:13	                main:480]	:	INFO	:	    Patience: 10
[2022-04-10 20:01:13	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-04-10 20:01:13	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-04-10 20:01:13	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-04-10 20:01:13	                main:484]	:	INFO	:	    # Threads: 1
[2022-04-10 20:01:13	                main:486]	:	INFO	:	Preparing Dataset
[2022-04-10 20:01:13	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-10 20:01:14	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-10 20:01:17	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-04-10 20:01:17	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-10 20:01:17	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-10 20:01:17	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-04-10 20:01:17	                main:494]	:	INFO	:	Creating Model
[2022-04-10 20:01:17	                main:507]	:	INFO	:	Preparing config file
[2022-04-10 20:01:17	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-04-10 20:01:17	                main:512]	:	INFO	:	Loading config


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFB82B74F69

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 04/10/22 20:01:17
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\1;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 00000000bdb50000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000084eb0000 00000000001f5000 C:\Windows\SYSTEM32\ntdll.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 0000000084d50000 00000000000be000 C:\Windows\System32\KERNEL32.DLL (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 0000000082b40000 00000000002c8000 C:\Windows\System32\KERNELBASE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 00000000842f0000 00000000001a0000 C:\Windows\System32\USER32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000082850000 0000000000022000 C:\Windows\System32\win32u.dll (6.2.19041.1586) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1586

ModLoad: 0000000084020000 000000000002b000 C:\Windows\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202

ModLoad: 0000000082a30000 000000000010b000 C:\Windows\System32\gdi32full.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 0000000082780000 000000000009d000 C:\Windows\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 0000000082930000 0000000000100000 C:\Windows\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 00000000640d0000 0000000000058000 C:\ProgramData\BOINC\slots\1\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000084c30000 00000000000ae000 C:\Windows\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000083c60000 000000000009e000 C:\Windows\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.19041.546

ModLoad: 0000000083bc0000 000000000009c000 C:\Windows\System32\sechost.dll (6.2.19041.1586) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000084a40000 0000000000125000 C:\Windows\System32\RPCRT4.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000005c400000 0000000000099000 C:\Windows\SYSTEM32\MSVCP140.dll (14.24.28127.4) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.24.28127.4 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.24.28127.4

ModLoad: 000000006cbd0000 00000000001e4000 C:\Windows\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.867

ModLoad: 00000000684f0000 0000000000017000 C:\Windows\SYSTEM32\VCRUNTIME140.dll (14.24.28127.4) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.24.28127.4 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.24.28127.4

ModLoad: 000000006e0d0000 000000000000c000 C:\Windows\SYSTEM32\VCRUNTIME140_1.dll (14.24.28127.4) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.24.28127.4 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.24.28127.4

ModLoad: 00000000126a0000 000000000abe7000 C:\ProgramData\BOINC\slots\1\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000567a0000 00000000002db000 C:\ProgramData\BOINC\slots\1\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000056d80000 000000000020d000 C:\ProgramData\BOINC\slots\1\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 0000000064720000 0000000000040000 C:\ProgramData\BOINC\slots\1\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000edb50000 0000000024b49000 C:\ProgramData\BOINC\slots\1\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000064080000 0000000000045000 C:\ProgramData\BOINC\slots\1\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000254a0000 00000000034b2000 C:\ProgramData\BOINC\slots\1\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000223f0000 00000000030a5000 C:\ProgramData\BOINC\slots\1\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 000000006e050000 0000000000010000 C:\ProgramData\BOINC\slots\1\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 00000000c58a0000 0000000003d5b000 C:\ProgramData\BOINC\slots\1\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000c9600000 000000000919f000 C:\ProgramData\BOINC\slots\1\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000c0780000 0000000001eca000 C:\ProgramData\BOINC\slots\1\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000d27a0000 000000001b3a4000 C:\ProgramData\BOINC\slots\1\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 0000000083b90000 0000000000030000 C:\Windows\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000080500000 0000000000012000 C:\Windows\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000083720000 0000000000470000 C:\Windows\System32\Setupapi.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000825d0000 000000000004e000 C:\Windows\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 0000000082820000 0000000000027000 C:\Windows\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000082370000 0000000000033000 C:\Windows\SYSTEM32\DEVOBJ.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 0000000082e10000 0000000000068000 C:\Windows\System32\WINTRUST.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 0000000082620000 0000000000156000 C:\Windows\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000821b0000 0000000000012000 C:\Windows\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000082fd0000 0000000000744000 C:\Windows\System32\Shell32.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.19041.964 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.964

ModLoad: 0000000080700000 0000000000794000 C:\Windows\SYSTEM32\windows.storage.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000084640000 0000000000354000 C:\Windows\System32\combase.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.19041.1320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1320

ModLoad: 0000000082030000 000000000002c000 C:\Windows\SYSTEM32\Wldp.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000082f10000 00000000000ad000 C:\Windows\System32\SHCORE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000083e80000 0000000000055000 C:\Windows\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000030da0000 0000000000267000 C:\Windows\system32\nvcuda.dll (27.21.14.5671) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r456_61\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 27.21.14.5671
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.1.96 driver
    Product Version       : 27.21.14.5671

ModLoad: 000000007c150000 000000000000a000 C:\Windows\SYSTEM32\VERSION.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000bf250000 000000000152a000 C:\Windows\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_1c83a5d7cffd7bff\nvcuda64.dll (27.21.14.5671) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r456_61\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 27.21.14.5671
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.1.96 driver
    Product Version       : 27.21.14.5671

ModLoad: 0000000084ce0000 000000000006b000 C:\Windows\System32\WS2_32.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : ws2_32.pdb
    File Version          : 10.0.19041.1081 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1081

ModLoad: 000000007bac0000 0000000000031000 C:\Windows\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.19041.906 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.906

ModLoad: 0000000081fa0000 000000000000c000 C:\Windows\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000080020000 000000000009e000 C:\Windows\system32\uxtheme.dll (6.2.19041.1266) (-exported- Symbols Loaded)
    Linked PDB Filename   : UxTheme.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000073ff0000 00000000006d5000 C:\Windows\SYSTEM32\nvapi64.dll (27.21.14.5671) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r456_61\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 27.21.14.5671
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 27.21.14.5671

ModLoad: 0000000084130000 000000000012a000 C:\Windows\System32\OLE32.DLL (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : ole32.pdb
    File Version          : 10.0.19041.1320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1320

ModLoad: 0000000082e80000 0000000000082000 C:\Windows\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.19041.1415 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1415



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3627, Write: 307, Other 883

- I/O Transfers Counters -
Read: 6752998, Write: 6045, Other 29718

- Paged Pool Usage -
QuotaPagedPoolUsage: 3444488, QuotaPeakPagedPoolUsage: 3444488
QuotaNonPagedPoolUsage: 38072, QuotaPeakNonPagedPoolUsage: 38136

- Virtual Memory Usage -
VirtualSize: -1415327744, PeakVirtualSize: -816758784

- Pagefile Usage -
PagefileUsage: -1415327744, PeakPagefileUsage: -1415327744

- Working Set Size -
WorkingSetSize: 1165119488, PeakWorkingSetSize: 1165123584, PageFaultCount: 397389

*** Dump of thread ID 9616 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 8281250.000000, User Time: 22812500.000000, Wait Time: 78591144.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFB82B74F69

- Registers -
rax=0000000018238b93 rbx=00000000bdeb4910 rcx=00000000219559d0 rdx=0000000000000001 rsi=0000000021956310 rdi=0000000019930520
r8=0000000021955a68 r9=0000000000000000 r10=0000000000000000 r11=00000000e944a200 r12=00000000ee2a4050 r13=0000000021956520
r14=000000008ced54c0 r15=0000000000000000 rip=0000000082b74f69 rsp=00000000219561b0 rbp=00000000219564a0
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
21956280 bddca884 00000040 0000004f ee2a3b00 000003da KERNELBASE!RaiseException+0x0 
219562e0 bdb71ca6 a6070000 219563b9 fbe81fb0 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
21956390 bdb7593b 00000000 00000030 00000020 00000008 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
219564e0 bdb71a78 00000000 00000000 21956810 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
219565b0 bdb71cfc 21956810 00000000 00000080 21956ae0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
21956670 bdb7c4dd 21956ae0 21956ae0 21956ae0 21956ae0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
21956960 bdb6b2fe 21956f78 21956ae0 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
2196f700 bddac6f8 a7a47ab0 00000000 00000000 a7aaf690 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
2196f740 84d67034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
2196f770 84f02651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
2196f7f0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 13288 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 78590880.000000

- Registers -
rax=00000000000001d3 rbx=00000000a6075300 rcx=0000000000000070 rdx=00000000a6074f80 rsi=00000000a60730b0 rdi=00000000a6075300
r8=0000000000000008 r9=0000000000000040 r10=0000000000000240 r11=00000000cc5fbfe8 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000084f507c4 rsp=0000000021cff9e8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
21cff9e0 84f02dc7 00000000 00000000 a60730b0 a6075300 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
21cffce0 84d67034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
21cffd10 84f02651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
21cffd90 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 11260 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 78590880.000000

- Registers -
rax=00000000000001d3 rbx=00000000a6075730 rcx=0000000000000070 rdx=00000000a60753b0 rsi=00000000a60730b0 rdi=00000000a6075730
r8=000000007c155008 r9=0000000021dff4b0 r10=000000007c1500f0 r11=0000000000000001 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000084f507c4 rsp=0000000021dffa08 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
21dffa00 84f02dc7 00000000 00000000 a60730b0 a6075730 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
21dffd00 84d67034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
21dffd30 84f02651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
21dffdb0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 10728 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 78590880.000000

- Registers -
rax=00000000000001d3 rbx=00000000a6075f20 rcx=0000000000000070 rdx=00000000a6075ba0 rsi=00000000a60730b0 rdi=00000000a6075f20
r8=0000000021eff6b8 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000084f507c4 rsp=0000000021eff6b8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
21eff6b0 84f02dc7 00000000 00000000 a60730b0 a6075f20 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
21eff9b0 84d67034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
21eff9e0 84f02651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
21effa60 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 5896 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 78591144.000000

- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000220ffba0 rsi=0000000000000000 rdi=0000000000000064
r8=00000000220ffb78 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000084f4d3f4 rsp=00000000220ffb78 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
220ffb70 82b8962e 220ffc38 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0 
220ffc10 bdb8a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0 
220ffc40 84d67034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
220ffc70 84f02651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
220ffcf0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 3768 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 78591144.000000

- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=00000000221ff630 rsi=0000000000000000 rdi=000000000000000d
r8=0000000000000001 r9=00000000a7c4df00 r10=0000000000000000 r11=00000000221ff5a0 r12=0000000000000064 r13=00000000221ff630
r14=00000000221ff330 r15=0000000000000000 rip=0000000084f4d8c4 rsp=00000000221ff2d8 rbp=00000000a7c4df10
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
221ff2d0 82b8cb20 00000000 21ab2000 8501a4d0 21ab2000 ntdll!ZwWaitForMultipleObjects+0x0 
221ff5c0 82b8ca1e a6082b20 006e0069 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
221ff600 bf3fba44 a7c52770 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
221ff840 bf4908dd 00000000 00000004 00000000 00000000 nvcuda64!+0x0 
221ff8f0 bf3fb413 22115740 1ffffbb2 a8175590 00000000 nvcuda64!cuProfilerStop+0x0 
221ff920 bf709200 a8175590 00000000 00000000 00000000 nvcuda64!+0x0 
221ff950 84d67034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
221ff980 84f02651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
221ffa00 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 8100 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 78590936.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000001c4 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000001c4
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=00000000a7c351e0 r13=0000000000000000
r14=00000000000001c4 r15=0000000000000000 rip=0000000084f4cdf4 rsp=00000000222ff778 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
222ff770 82b61a5e 00000000 00000000 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0 
222ff810 bf60a9f8 00000000 82b6a395 00000000 000001c4 KERNELBASE!WaitForSingleObjectEx+0x0 
222ff880 bf3fb413 00000001 a8381af0 a8174f60 00000000 nvcuda64!cuProfilerStop+0x0 
222ff8b0 bf709200 a8174f60 00000000 00000000 00000000 nvcuda64!+0x0 
222ff8e0 84d67034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
222ff910 84f02651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
222ff990 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 12744 (state: Waiting): ***

- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 78591128.000000

- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000a7d1bd48 rdx=00000000223ffac8 rsi=00000000223ffa30 rdi=0000000000000000
r8=00000000223ffa08 r9=00000000223ffa60 r10=0000000000000000 r11=0000000000000246 r12=00000000223ffac8 r13=0000000000000000
r14=00000000a7d1bd48 r15=00000000a7ede8a8 rip=0000000084f50764 rsp=00000000223ffa08 rbp=00000000223ffa60
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
223ffa00 84f14295 00000102 00000102 00000000 223ffa30 ntdll!NtWaitForAlertByThreadId+0x0 
223ffa70 82bacef9 a7edc090 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0 
223ffaa0 bf3821da a7edc090 84f007b0 a7edc090 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0 
223ffb00 bf3fb413 00000001 21fa41b8 00000000 00000000 nvcuda64!+0x0 
223ffb30 bf709200 a8175cb0 00000000 00000000 00000000 nvcuda64!+0x0 
223ffb60 84d67034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
223ffb90 84f02651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
223ffc10 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)