Task 11326771

Name ParityModified-1639965372-784-1-0_2
Workunit 7879323
Created 3 Feb 2022, 13:11:19 UTC
Sent 3 Feb 2022, 16:57:22 UTC
Report deadline 11 Feb 2022, 16:57:22 UTC
Received 5 Feb 2022, 12:48:24 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 1182
Run time 4 hours 19 min 39 sec
CPU time 3 hours 56 min 12 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 4,702.10 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.62 GB
Peak swap size 3.61 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
4]	:	INFO	:	Epoch 1590 | loss: nan | val_loss: nan | Time: 9046.62 ms
[2022-02-05 12:44:24	                main:574]	:	INFO	:	Epoch 1591 | loss: nan | val_loss: nan | Time: 8464.84 ms
[2022-02-05 12:44:33	                main:574]	:	INFO	:	Epoch 1592 | loss: nan | val_loss: nan | Time: 8690.56 ms
[2022-02-05 12:44:42	                main:574]	:	INFO	:	Epoch 1593 | loss: nan | val_loss: nan | Time: 8689.73 ms
[2022-02-05 12:44:50	                main:574]	:	INFO	:	Epoch 1594 | loss: nan | val_loss: nan | Time: 8580.53 ms
[2022-02-05 12:44:59	                main:574]	:	INFO	:	Epoch 1595 | loss: nan | val_loss: nan | Time: 9114.94 ms
[2022-02-05 12:45:08	                main:574]	:	INFO	:	Epoch 1596 | loss: nan | val_loss: nan | Time: 8812.1 ms
[2022-02-05 12:45:18	                main:574]	:	INFO	:	Epoch 1597 | loss: nan | val_loss: nan | Time: 9388.09 ms
[2022-02-05 12:45:26	                main:574]	:	INFO	:	Epoch 1598 | loss: nan | val_loss: nan | Time: 8431.47 ms
[2022-02-05 12:45:35	                main:574]	:	INFO	:	Epoch 1599 | loss: nan | val_loss: nan | Time: 8776.5 ms
[2022-02-05 12:45:44	                main:574]	:	INFO	:	Epoch 1600 | loss: nan | val_loss: nan | Time: 8934.37 ms
[2022-02-05 12:45:53	                main:574]	:	INFO	:	Epoch 1601 | loss: nan | val_loss: nan | Time: 8681.93 ms
[2022-02-05 12:46:02	                main:574]	:	INFO	:	Epoch 1602 | loss: nan | val_loss: nan | Time: 8940.8 ms
[2022-02-05 12:46:11	                main:574]	:	INFO	:	Epoch 1603 | loss: nan | val_loss: nan | Time: 8616.61 ms
[2022-02-05 12:46:19	                main:574]	:	INFO	:	Epoch 1604 | loss: nan | val_loss: nan | Time: 8790.72 ms
[2022-02-05 12:46:28	                main:574]	:	INFO	:	Epoch 1605 | loss: nan | val_loss: nan | Time: 8779.2 ms
[2022-02-05 12:46:37	                main:574]	:	INFO	:	Epoch 1606 | loss: nan | val_loss: nan | Time: 8723.86 ms
[2022-02-05 12:46:46	                main:574]	:	INFO	:	Epoch 1607 | loss: nan | val_loss: nan | Time: 8923.72 ms
[2022-02-05 12:46:55	                main:574]	:	INFO	:	Epoch 1608 | loss: nan | val_loss: nan | Time: 8982.94 ms
[2022-02-05 12:47:04	                main:574]	:	INFO	:	Epoch 1609 | loss: nan | val_loss: nan | Time: 8964.99 ms
[2022-02-05 12:47:13	                main:574]	:	INFO	:	Epoch 1610 | loss: nan | val_loss: nan | Time: 8672.55 ms
[2022-02-05 12:47:22	                main:574]	:	INFO	:	Epoch 1611 | loss: nan | val_loss: nan | Time: 9148.45 ms
[2022-02-05 12:47:31	                main:574]	:	INFO	:	Epoch 1612 | loss: nan | val_loss: nan | Time: 9310.34 ms
[2022-02-05 12:47:40	                main:574]	:	INFO	:	Epoch 1613 | loss: nan | val_loss: nan | Time: 8913.69 ms
[2022-02-05 12:47:49	                main:574]	:	INFO	:	Epoch 1614 | loss: nan | val_loss: nan | Time: 8962.71 ms
[2022-02-05 12:47:59	                main:574]	:	INFO	:	Epoch 1615 | loss: nan | val_loss: nan | Time: 8978.86 ms
[2022-02-05 12:48:07	                main:574]	:	INFO	:	Epoch 1616 | loss: nan | val_loss: nan | Time: 8707.41 ms
[2022-02-05 12:48:16	                main:574]	:	INFO	:	Epoch 1617 | loss: nan | val_loss: nan | Time: 9078.05 ms
[2022-02-05 12:48:25	                main:574]	:	INFO	:	Epoch 1618 | loss: nan | val_loss: nan | Time: 8824.52 ms
[2022-02-05 12:48:34	                main:574]	:	INFO	:	Epoch 1619 | loss: nan | val_loss: nan | Time: 8924.2 ms
[2022-02-05 12:48:44	                main:574]	:	INFO	:	Epoch 1620 | loss: nan | val_loss: nan | Time: 9341.01 ms
[2022-02-05 12:48:53	                main:574]	:	INFO	:	Epoch 1621 | loss: nan | val_loss: nan | Time: 8996.39 ms
[2022-02-05 12:49:01	                main:574]	:	INFO	:	Epoch 1622 | loss: nan | val_loss: nan | Time: 8268.41 ms
[2022-02-05 12:49:10	                main:574]	:	INFO	:	Epoch 1623 | loss: nan | val_loss: nan | Time: 8883.89 ms
[2022-02-05 12:49:19	                main:574]	:	INFO	:	Epoch 1624 | loss: nan | val_loss: nan | Time: 8414.18 ms
[2022-02-05 12:49:27	                main:574]	:	INFO	:	Epoch 1625 | loss: nan | val_loss: nan | Time: 8384.98 ms
[2022-02-05 12:49:36	                main:574]	:	INFO	:	Epoch 1626 | loss: nan | val_loss: nan | Time: 8983.5 ms
[2022-02-05 12:49:45	                main:574]	:	INFO	:	Epoch 1627 | loss: nan | val_loss: nan | Time: 9090.76 ms
[2022-02-05 12:49:54	                main:574]	:	INFO	:	Epoch 1628 | loss: nan | val_loss: nan | Time: 8818.28 ms
[2022-02-05 12:50:03	                main:574]	:	INFO	:	Epoch 1629 | loss: nan | val_loss: nan | Time: 9262.21 ms
[2022-02-05 12:50:12	                main:574]	:	INFO	:	Epoch 1630 | loss: nan | val_loss: nan | Time: 8431.75 ms
[2022-02-05 12:50:21	                main:574]	:	INFO	:	Epoch 1631 | loss: nan | val_loss: nan | Time: 9127.84 ms
[2022-02-05 12:50:31	                main:574]	:	INFO	:	Epoch 1632 | loss: nan | val_loss: nan | Time: 9626.6 ms
[2022-02-05 12:50:40	                main:574]	:	INFO	:	Epoch 1633 | loss: nan | val_loss: nan | Time: 8925.34 ms
[2022-02-05 12:50:49	                main:574]	:	INFO	:	Epoch 1634 | loss: nan | val_loss: nan | Time: 8869.92 ms
[2022-02-05 12:50:58	                main:574]	:	INFO	:	Epoch 1635 | loss: nan | val_loss: nan | Time: 8892.01 ms
[2022-02-05 12:51:06	                main:574]	:	INFO	:	Epoch 1636 | loss: nan | val_loss: nan | Time: 8776.19 ms
[2022-02-05 12:51:15	                main:574]	:	INFO	:	Epoch 1637 | loss: nan | val_loss: nan | Time: 8817.88 ms
[2022-02-05 12:51:24	                main:574]	:	INFO	:	Epoch 1638 | loss: nan | val_loss: nan | Time: 8836.37 ms
[2022-02-05 12:51:33	                main:574]	:	INFO	:	Epoch 1639 | loss: nan | val_loss: nan | Time: 9115.63 ms
[2022-02-05 12:51:42	                main:574]	:	INFO	:	Epoch 1640 | loss: nan | val_loss: nan | Time: 8840.31 ms
[2022-02-05 12:51:51	                main:574]	:	INFO	:	Epoch 1641 | loss: nan | val_loss: nan | Time: 8694.24 ms
[2022-02-05 12:52:00	                main:574]	:	INFO	:	Epoch 1642 | loss: nan | val_loss: nan | Time: 8557 ms
[2022-02-05 12:52:08	                main:574]	:	INFO	:	Epoch 1643 | loss: nan | val_loss: nan | Time: 8739.54 ms
[2022-02-05 12:52:18	                main:574]	:	INFO	:	Epoch 1644 | loss: nan | val_loss: nan | Time: 9034.59 ms
[2022-02-05 12:52:27	                main:574]	:	INFO	:	Epoch 1645 | loss: nan | val_loss: nan | Time: 9042.82 ms
[2022-02-05 12:52:36	                main:574]	:	INFO	:	Epoch 1646 | loss: nan | val_loss: nan | Time: 9067.71 ms
[2022-02-05 12:52:44	                main:574]	:	INFO	:	Epoch 1647 | loss: nan | val_loss: nan | Time: 8489.04 ms
[2022-02-05 12:52:53	                main:574]	:	INFO	:	Epoch 1648 | loss: nan | val_loss: nan | Time: 8931.13 ms
[2022-02-05 12:53:02	                main:574]	:	INFO	:	Epoch 1649 | loss: nan | val_loss: nan | Time: 8968.39 ms
[2022-02-05 12:53:11	                main:574]	:	INFO	:	Epoch 1650 | loss: nan | val_loss: nan | Time: 8532.22 ms
[2022-02-05 12:53:20	                main:574]	:	INFO	:	Epoch 1651 | loss: nan | val_loss: nan | Time: 8817.43 ms
[2022-02-05 12:53:31	                main:574]	:	INFO	:	Epoch 1652 | loss: nan | val_loss: nan | Time: 11065.9 ms
[2022-02-05 12:53:41	                main:574]	:	INFO	:	Epoch 1653 | loss: nan | val_loss: nan | Time: 9427.03 ms
[2022-02-05 12:53:50	                main:574]	:	INFO	:	Epoch 1654 | loss: nan | val_loss: nan | Time: 9495.74 ms
[2022-02-05 12:53:59	                main:574]	:	INFO	:	Epoch 1655 | loss: nan | val_loss: nan | Time: 8612.62 ms
[2022-02-05 12:54:08	                main:574]	:	INFO	:	Epoch 1656 | loss: nan | val_loss: nan | Time: 8775.4 ms
[2022-02-05 12:54:16	                main:574]	:	INFO	:	Epoch 1657 | loss: nan | val_loss: nan | Time: 8600.33 ms
[2022-02-05 12:54:25	                main:574]	:	INFO	:	Epoch 1658 | loss: nan | val_loss: nan | Time: 8769.57 ms
[2022-02-05 12:54:34	                main:574]	:	INFO	:	Epoch 1659 | loss: nan | val_loss: nan | Time: 8531.2 ms
[2022-02-05 12:54:43	                main:574]	:	INFO	:	Epoch 1660 | loss: nan | val_loss: nan | Time: 8960.3 ms
[2022-02-05 12:54:52	                main:574]	:	INFO	:	Epoch 1661 | loss: nan | val_loss: nan | Time: 8727.3 ms
[2022-02-05 12:55:00	                main:574]	:	INFO	:	Epoch 1662 | loss: nan | val_loss: nan | Time: 8866.57 ms
[2022-02-05 12:55:09	                main:574]	:	INFO	:	Epoch 1663 | loss: nan | val_loss: nan | Time: 8832.94 ms
[2022-02-05 12:55:18	                main:574]	:	INFO	:	Epoch 1664 | loss: nan | val_loss: nan | Time: 8480.86 ms
[2022-02-05 12:55:27	                main:574]	:	INFO	:	Epoch 1665 | loss: nan | val_loss: nan | Time: 8742.92 ms
[2022-02-05 12:55:36	                main:574]	:	INFO	:	Epoch 1666 | loss: nan | val_loss: nan | Time: 8894.48 ms
[2022-02-05 12:55:45	                main:574]	:	INFO	:	Epoch 1667 | loss: nan | val_loss: nan | Time: 8951.43 ms
[2022-02-05 12:55:53	                main:574]	:	INFO	:	Epoch 1668 | loss: nan | val_loss: nan | Time: 8497.75 ms
[2022-02-05 12:56:02	                main:574]	:	INFO	:	Epoch 1669 | loss: nan | val_loss: nan | Time: 8895.47 ms
[2022-02-05 12:56:11	                main:574]	:	INFO	:	Epoch 1670 | loss: nan | val_loss: nan | Time: 8702.75 ms
[2022-02-05 12:56:20	                main:574]	:	INFO	:	Epoch 1671 | loss: nan | val_loss: nan | Time: 9221.84 ms
[2022-02-05 12:56:29	                main:574]	:	INFO	:	Epoch 1672 | loss: nan | val_loss: nan | Time: 8906.65 ms
[2022-02-05 12:56:38	                main:574]	:	INFO	:	Epoch 1673 | loss: nan | val_loss: nan | Time: 8909.7 ms
[2022-02-05 12:56:47	                main:574]	:	INFO	:	Epoch 1674 | loss: nan | val_loss: nan | Time: 8692.39 ms
[2022-02-05 12:56:56	                main:574]	:	INFO	:	Epoch 1675 | loss: nan | val_loss: nan | Time: 8669.64 ms
[2022-02-05 12:57:04	                main:574]	:	INFO	:	Epoch 1676 | loss: nan | val_loss: nan | Time: 8628.77 ms
[2022-02-05 12:57:13	                main:574]	:	INFO	:	Epoch 1677 | loss: nan | val_loss: nan | Time: 9070.01 ms
[2022-02-05 12:57:22	                main:574]	:	INFO	:	Epoch 1678 | loss: nan | val_loss: nan | Time: 8610.27 ms
[2022-02-05 12:57:31	                main:574]	:	INFO	:	Epoch 1679 | loss: nan | val_loss: nan | Time: 8863.01 ms
[2022-02-05 12:57:40	                main:574]	:	INFO	:	Epoch 1680 | loss: nan | val_loss: nan | Time: 8821.18 ms
[2022-02-05 12:57:49	                main:574]	:	INFO	:	Epoch 1681 | loss: nan | val_loss: nan | Time: 9169.45 ms
[2022-02-05 12:57:58	                main:574]	:	INFO	:	Epoch 1682 | loss: nan | val_loss: nan | Time: 8876.05 ms
[2022-02-05 12:58:07	                main:574]	:	INFO	:	Epoch 1683 | loss: nan | val_loss: nan | Time: 8694.59 ms
[2022-02-05 12:58:16	                main:574]	:	INFO	:	Epoch 1684 | loss: nan | val_loss: nan | Time: 8917.89 ms
[2022-02-05 12:58:25	                main:574]	:	INFO	:	Epoch 1685 | loss: nan | val_loss: nan | Time: 9201.26 ms
[2022-02-05 12:58:34	                main:574]	:	INFO	:	Epoch 1686 | loss: nan | val_loss: nan | Time: 8540.12 ms
[2022-02-05 12:58:42	                main:574]	:	INFO	:	Epoch 1687 | loss: nan | val_loss: nan | Time: 8518.69 ms
[2022-02-05 12:58:51	                main:574]	:	INFO	:	Epoch 1688 | loss: nan | val_loss: nan | Time: 8781.01 ms
[2022-02-05 12:59:00	                main:574]	:	INFO	:	Epoch 1689 | loss: nan | val_loss: nan | Time: 8419.24 ms
[2022-02-05 12:59:09	                main:574]	:	INFO	:	Epoch 1690 | loss: nan | val_loss: nan | Time: 9104.86 ms
[2022-02-05 12:59:18	                main:574]	:	INFO	:	Epoch 1691 | loss: nan | val_loss: nan | Time: 8685.46 ms
[2022-02-05 12:59:26	                main:574]	:	INFO	:	Epoch 1692 | loss: nan | val_loss: nan | Time: 8588.99 ms
[2022-02-05 12:59:35	                main:574]	:	INFO	:	Epoch 1693 | loss: nan | val_loss: nan | Time: 8725.48 ms
[2022-02-05 12:59:44	                main:574]	:	INFO	:	Epoch 1694 | loss: nan | val_loss: nan | Time: 8676.67 ms
[2022-02-05 12:59:52	                main:574]	:	INFO	:	Epoch 1695 | loss: nan | val_loss: nan | Time: 8492.56 ms
[2022-02-05 13:00:01	                main:574]	:	INFO	:	Epoch 1696 | loss: nan | val_loss: nan | Time: 8776.35 ms
[2022-02-05 13:00:10	                main:574]	:	INFO	:	Epoch 1697 | loss: nan | val_loss: nan | Time: 8668.09 ms
[2022-02-05 13:00:18	                main:574]	:	INFO	:	Epoch 1698 | loss: nan | val_loss: nan | Time: 8180.42 ms
[2022-02-05 13:00:27	                main:574]	:	INFO	:	Epoch 1699 | loss: nan | val_loss: nan | Time: 8375.32 ms
[2022-02-05 13:00:35	                main:574]	:	INFO	:	Epoch 1700 | loss: nan | val_loss: nan | Time: 8601.81 ms
[2022-02-05 13:00:44	                main:574]	:	INFO	:	Epoch 1701 | loss: nan | val_loss: nan | Time: 8542.05 ms
[2022-02-05 13:00:53	                main:574]	:	INFO	:	Epoch 1702 | loss: nan | val_loss: nan | Time: 9018.37 ms
[2022-02-05 13:01:02	                main:574]	:	INFO	:	Epoch 1703 | loss: nan | val_loss: nan | Time: 8960.45 ms
[2022-02-05 13:01:10	                main:574]	:	INFO	:	Epoch 1704 | loss: nan | val_loss: nan | Time: 8262.21 ms
[2022-02-05 13:01:19	                main:574]	:	INFO	:	Epoch 1705 | loss: nan | val_loss: nan | Time: 8929.41 ms
[2022-02-05 13:01:28	                main:574]	:	INFO	:	Epoch 1706 | loss: nan | val_loss: nan | Time: 8643.65 ms
[2022-02-05 13:01:37	                main:574]	:	INFO	:	Epoch 1707 | loss: nan | val_loss: nan | Time: 8689.49 ms
[2022-02-05 13:01:46	                main:574]	:	INFO	:	Epoch 1708 | loss: nan | val_loss: nan | Time: 9108.55 ms
[2022-02-05 13:01:55	                main:574]	:	INFO	:	Epoch 1709 | loss: nan | val_loss: nan | Time: 8875.82 ms
[2022-02-05 13:02:04	                main:574]	:	INFO	:	Epoch 1710 | loss: nan | val_loss: nan | Time: 9223.69 ms
[2022-02-05 13:02:13	                main:574]	:	INFO	:	Epoch 1711 | loss: nan | val_loss: nan | Time: 8707.05 ms
[2022-02-05 13:02:22	                main:574]	:	INFO	:	Epoch 1712 | loss: nan | val_loss: nan | Time: 8704.47 ms
[2022-02-05 13:02:30	                main:574]	:	INFO	:	Epoch 1713 | loss: nan | val_loss: nan | Time: 8602.92 ms
[2022-02-05 13:02:39	                main:574]	:	INFO	:	Epoch 1714 | loss: nan | val_loss: nan | Time: 8678.47 ms
[2022-02-05 13:02:48	                main:574]	:	INFO	:	Epoch 1715 | loss: nan | val_loss: nan | Time: 8808.18 ms
[2022-02-05 13:02:56	                main:574]	:	INFO	:	Epoch 1716 | loss: nan | val_loss: nan | Time: 8352.98 ms
[2022-02-05 13:03:05	                main:574]	:	INFO	:	Epoch 1717 | loss: nan | val_loss: nan | Time: 8641.76 ms
[2022-02-05 13:03:14	                main:574]	:	INFO	:	Epoch 1718 | loss: nan | val_loss: nan | Time: 9028.03 ms
[2022-02-05 13:03:23	                main:574]	:	INFO	:	Epoch 1719 | loss: nan | val_loss: nan | Time: 8631.58 ms
[2022-02-05 13:03:31	                main:574]	:	INFO	:	Epoch 1720 | loss: nan | val_loss: nan | Time: 8603.34 ms
[2022-02-05 13:03:41	                main:574]	:	INFO	:	Epoch 1721 | loss: nan | val_loss: nan | Time: 9167.88 ms
[2022-02-05 13:03:50	                main:574]	:	INFO	:	Epoch 1722 | loss: nan | val_loss: nan | Time: 9044.13 ms
[2022-02-05 13:03:59	                main:574]	:	INFO	:	Epoch 1723 | loss: nan | val_loss: nan | Time: 9037.09 ms
[2022-02-05 13:04:08	                main:574]	:	INFO	:	Epoch 1724 | loss: nan | val_loss: nan | Time: 8715.83 ms
[2022-02-05 13:04:17	                main:574]	:	INFO	:	Epoch 1725 | loss: nan | val_loss: nan | Time: 9540.66 ms
[2022-02-05 13:04:26	                main:574]	:	INFO	:	Epoch 1726 | loss: nan | val_loss: nan | Time: 8636.8 ms
[2022-02-05 13:04:35	                main:574]	:	INFO	:	Epoch 1727 | loss: nan | val_loss: nan | Time: 8709.84 ms
[2022-02-05 13:04:44	                main:574]	:	INFO	:	Epoch 1728 | loss: nan | val_loss: nan | Time: 8876.15 ms
[2022-02-05 13:04:53	                main:574]	:	INFO	:	Epoch 1729 | loss: nan | val_loss: nan | Time: 9322.09 ms
[2022-02-05 13:05:02	                main:574]	:	INFO	:	Epoch 1730 | loss: nan | val_loss: nan | Time: 9112.86 ms
[2022-02-05 13:05:11	                main:574]	:	INFO	:	Epoch 1731 | loss: nan | val_loss: nan | Time: 8702.56 ms
[2022-02-05 13:05:20	                main:574]	:	INFO	:	Epoch 1732 | loss: nan | val_loss: nan | Time: 8610.25 ms
[2022-02-05 13:05:29	                main:574]	:	INFO	:	Epoch 1733 | loss: nan | val_loss: nan | Time: 9287.97 ms
[2022-02-05 13:05:38	                main:574]	:	INFO	:	Epoch 1734 | loss: nan | val_loss: nan | Time: 8796.28 ms
[2022-02-05 13:05:47	                main:574]	:	INFO	:	Epoch 1735 | loss: nan | val_loss: nan | Time: 8913.76 ms
[2022-02-05 13:05:56	                main:574]	:	INFO	:	Epoch 1736 | loss: nan | val_loss: nan | Time: 9090.99 ms
[2022-02-05 13:06:05	                main:574]	:	INFO	:	Epoch 1737 | loss: nan | val_loss: nan | Time: 8851.89 ms
[2022-02-05 13:06:14	                main:574]	:	INFO	:	Epoch 1738 | loss: nan | val_loss: nan | Time: 8975.71 ms
[2022-02-05 13:06:23	                main:574]	:	INFO	:	Epoch 1739 | loss: nan | val_loss: nan | Time: 9136.8 ms
[2022-02-05 13:06:32	                main:574]	:	INFO	:	Epoch 1740 | loss: nan | val_loss: nan | Time: 8838.21 ms
[2022-02-05 13:06:41	                main:574]	:	INFO	:	Epoch 1741 | loss: nan | val_loss: nan | Time: 8545.03 ms
[2022-02-05 13:06:50	                main:574]	:	INFO	:	Epoch 1742 | loss: nan | val_loss: nan | Time: 8962.87 ms
[2022-02-05 13:06:59	                main:574]	:	INFO	:	Epoch 1743 | loss: nan | val_loss: nan | Time: 8971.65 ms
[2022-02-05 13:07:08	                main:574]	:	INFO	:	Epoch 1744 | loss: nan | val_loss: nan | Time: 8618.45 ms
[2022-02-05 13:07:16	                main:574]	:	INFO	:	Epoch 1745 | loss: nan | val_loss: nan | Time: 8855.56 ms
[2022-02-05 13:07:26	                main:574]	:	INFO	:	Epoch 1746 | loss: nan | val_loss: nan | Time: 9162.16 ms
[2022-02-05 13:07:35	                main:574]	:	INFO	:	Epoch 1747 | loss: nan | val_loss: nan | Time: 8990.52 ms
[2022-02-05 13:07:44	                main:574]	:	INFO	:	Epoch 1748 | loss: nan | val_loss: nan | Time: 9221.72 ms
[2022-02-05 13:07:53	                main:574]	:	INFO	:	Epoch 1749 | loss: nan | val_loss: nan | Time: 9338.36 ms
[2022-02-05 13:08:02	                main:574]	:	INFO	:	Epoch 1750 | loss: nan | val_loss: nan | Time: 8934.33 ms
[2022-02-05 13:08:12	                main:574]	:	INFO	:	Epoch 1751 | loss: nan | val_loss: nan | Time: 9096.97 ms
[2022-02-05 13:08:20	                main:574]	:	INFO	:	Epoch 1752 | loss: nan | val_loss: nan | Time: 8653.56 ms
[2022-02-05 13:08:29	                main:574]	:	INFO	:	Epoch 1753 | loss: nan | val_loss: nan | Time: 9110.92 ms
[2022-02-05 13:08:38	                main:574]	:	INFO	:	Epoch 1754 | loss: nan | val_loss: nan | Time: 8627.42 ms
[2022-02-05 13:08:47	                main:574]	:	INFO	:	Epoch 1755 | loss: nan | val_loss: nan | Time: 8770.33 ms
[2022-02-05 13:08:56	                main:574]	:	INFO	:	Epoch 1756 | loss: nan | val_loss: nan | Time: 8606.9 ms
[2022-02-05 13:09:05	                main:574]	:	INFO	:	Epoch 1757 | loss: nan | val_loss: nan | Time: 9191.3 ms
[2022-02-05 13:09:14	                main:574]	:	INFO	:	Epoch 1758 | loss: nan | val_loss: nan | Time: 9083.36 ms
[2022-02-05 13:09:23	                main:574]	:	INFO	:	Epoch 1759 | loss: nan | val_loss: nan | Time: 8998.21 ms
[2022-02-05 13:09:32	                main:574]	:	INFO	:	Epoch 1760 | loss: nan | val_loss: nan | Time: 9141.94 ms
[2022-02-05 13:09:41	                main:574]	:	INFO	:	Epoch 1761 | loss: nan | val_loss: nan | Time: 8941.44 ms
[2022-02-05 13:09:50	                main:574]	:	INFO	:	Epoch 1762 | loss: nan | val_loss: nan | Time: 8832.06 ms
[2022-02-05 13:09:59	                main:574]	:	INFO	:	Epoch 1763 | loss: nan | val_loss: nan | Time: 8977.08 ms
[2022-02-05 13:10:08	                main:574]	:	INFO	:	Epoch 1764 | loss: nan | val_loss: nan | Time: 9006.72 ms
[2022-02-05 13:10:17	                main:574]	:	INFO	:	Epoch 1765 | loss: nan | val_loss: nan | Time: 8767.3 ms
[2022-02-05 13:10:26	                main:574]	:	INFO	:	Epoch 1766 | loss: nan | val_loss: nan | Time: 8703.3 ms
[2022-02-05 13:10:34	                main:574]	:	INFO	:	Epoch 1767 | loss: nan | val_loss: nan | Time: 8522.96 ms
[2022-02-05 13:10:43	                main:574]	:	INFO	:	Epoch 1768 | loss: nan | val_loss: nan | Time: 8877.23 ms
[2022-02-05 13:10:53	                main:574]	:	INFO	:	Epoch 1769 | loss: nan | val_loss: nan | Time: 9203.36 ms
[2022-02-05 13:11:01	                main:574]	:	INFO	:	Epoch 1770 | loss: nan | val_loss: nan | Time: 8392.77 ms
[2022-02-05 13:11:10	                main:574]	:	INFO	:	Epoch 1771 | loss: nan | val_loss: nan | Time: 9161.72 ms
[2022-02-05 13:11:19	                main:574]	:	INFO	:	Epoch 1772 | loss: nan | val_loss: nan | Time: 8701.34 ms
[2022-02-05 13:11:27	                main:574]	:	INFO	:	Epoch 1773 | loss: nan | val_loss: nan | Time: 8403.95 ms
[2022-02-05 13:11:36	                main:574]	:	INFO	:	Epoch 1774 | loss: nan | val_loss: nan | Time: 8908.33 ms
[2022-02-05 13:11:45	                main:574]	:	INFO	:	Epoch 1775 | loss: nan | val_loss: nan | Time: 8683.52 ms
[2022-02-05 13:11:54	                main:574]	:	INFO	:	Epoch 1776 | loss: nan | val_loss: nan | Time: 8601.95 ms
[2022-02-05 13:12:02	                main:574]	:	INFO	:	Epoch 1777 | loss: nan | val_loss: nan | Time: 8597.29 ms
[2022-02-05 13:12:11	                main:574]	:	INFO	:	Epoch 1778 | loss: nan | val_loss: nan | Time: 8917.78 ms
[2022-02-05 13:12:21	                main:574]	:	INFO	:	Epoch 1779 | loss: nan | val_loss: nan | Time: 9079.81 ms
[2022-02-05 13:12:29	                main:574]	:	INFO	:	Epoch 1780 | loss: nan | val_loss: nan | Time: 8786.89 ms
[2022-02-05 13:12:39	                main:574]	:	INFO	:	Epoch 1781 | loss: nan | val_loss: nan | Time: 9161.04 ms
[2022-02-05 13:12:48	                main:574]	:	INFO	:	Epoch 1782 | loss: nan | val_loss: nan | Time: 8869.94 ms
[2022-02-05 13:12:56	                main:574]	:	INFO	:	Epoch 1783 | loss: nan | val_loss: nan | Time: 8588.08 ms
[2022-02-05 13:13:05	                main:574]	:	INFO	:	Epoch 1784 | loss: nan | val_loss: nan | Time: 8301.35 ms
[2022-02-05 13:13:13	                main:574]	:	INFO	:	Epoch 1785 | loss: nan | val_loss: nan | Time: 8867.13 ms
[2022-02-05 13:13:23	                main:574]	:	INFO	:	Epoch 1786 | loss: nan | val_loss: nan | Time: 9431.21 ms
[2022-02-05 13:13:32	                main:574]	:	INFO	:	Epoch 1787 | loss: nan | val_loss: nan | Time: 9382.55 ms
[2022-02-05 13:13:42	                main:574]	:	INFO	:	Epoch 1788 | loss: nan | val_loss: nan | Time: 9090.39 ms
[2022-02-05 13:13:50	                main:574]	:	INFO	:	Epoch 1789 | loss: nan | val_loss: nan | Time: 8653.85 ms
[2022-02-05 13:13:59	                main:574]	:	INFO	:	Epoch 1790 | loss: nan | val_loss: nan | Time: 8705.65 ms
[2022-02-05 13:14:08	                main:574]	:	INFO	:	Epoch 1791 | loss: nan | val_loss: nan | Time: 9001.56 ms
[2022-02-05 13:14:17	                main:574]	:	INFO	:	Epoch 1792 | loss: nan | val_loss: nan | Time: 9040.43 ms
[2022-02-05 13:14:26	                main:574]	:	INFO	:	Epoch 1793 | loss: nan | val_loss: nan | Time: 8373.56 ms
[2022-02-05 13:14:34	                main:574]	:	INFO	:	Epoch 1794 | loss: nan | val_loss: nan | Time: 8769.87 ms
[2022-02-05 13:14:43	                main:574]	:	INFO	:	Epoch 1795 | loss: nan | val_loss: nan | Time: 8887.39 ms
[2022-02-05 13:14:53	                main:574]	:	INFO	:	Epoch 1796 | loss: nan | val_loss: nan | Time: 9187.73 ms
[2022-02-05 13:15:02	                main:574]	:	INFO	:	Epoch 1797 | loss: nan | val_loss: nan | Time: 8887.42 ms
[2022-02-05 13:15:11	                main:574]	:	INFO	:	Epoch 1798 | loss: nan | val_loss: nan | Time: 9090.38 ms
[2022-02-05 13:15:20	                main:574]	:	INFO	:	Epoch 1799 | loss: nan | val_loss: nan | Time: 9437.13 ms
[2022-02-05 13:15:29	                main:574]	:	INFO	:	Epoch 1800 | loss: nan | val_loss: nan | Time: 8639.85 ms
[2022-02-05 13:15:38	                main:574]	:	INFO	:	Epoch 1801 | loss: nan | val_loss: nan | Time: 8790.78 ms
[2022-02-05 13:15:48	                main:574]	:	INFO	:	Epoch 1802 | loss: nan | val_loss: nan | Time: 9346.22 ms
[2022-02-05 13:15:57	                main:574]	:	INFO	:	Epoch 1803 | loss: nan | val_loss: nan | Time: 9304.14 ms
[2022-02-05 13:16:06	                main:574]	:	INFO	:	Epoch 1804 | loss: nan | val_loss: nan | Time: 8754.25 ms
[2022-02-05 13:16:15	                main:574]	:	INFO	:	Epoch 1805 | loss: nan | val_loss: nan | Time: 8650.32 ms
[2022-02-05 13:16:24	                main:574]	:	INFO	:	Epoch 1806 | loss: nan | val_loss: nan | Time: 8776.41 ms
[2022-02-05 13:16:33	                main:574]	:	INFO	:	Epoch 1807 | loss: nan | val_loss: nan | Time: 8986.62 ms
[2022-02-05 13:16:42	                main:574]	:	INFO	:	Epoch 1808 | loss: nan | val_loss: nan | Time: 9475.04 ms
[2022-02-05 13:16:51	                main:574]	:	INFO	:	Epoch 1809 | loss: nan | val_loss: nan | Time: 8975.75 ms
[2022-02-05 13:17:00	                main:574]	:	INFO	:	Epoch 1810 | loss: nan | val_loss: nan | Time: 8728.28 ms
[2022-02-05 13:17:09	                main:574]	:	INFO	:	Epoch 1811 | loss: nan | val_loss: nan | Time: 8629.24 ms
[2022-02-05 13:17:17	                main:574]	:	INFO	:	Epoch 1812 | loss: nan | val_loss: nan | Time: 8553.35 ms
[2022-02-05 13:17:26	                main:574]	:	INFO	:	Epoch 1813 | loss: nan | val_loss: nan | Time: 8644.24 ms
[2022-02-05 13:17:35	                main:574]	:	INFO	:	Epoch 1814 | loss: nan | val_loss: nan | Time: 8682.1 ms
[2022-02-05 13:17:44	                main:574]	:	INFO	:	Epoch 1815 | loss: nan | val_loss: nan | Time: 8867.94 ms
[2022-02-05 13:17:52	                main:574]	:	INFO	:	Epoch 1816 | loss: nan | val_loss: nan | Time: 8630.58 ms
[2022-02-05 13:18:01	                main:574]	:	INFO	:	Epoch 1817 | loss: nan | val_loss: nan | Time: 8631.69 ms
[2022-02-05 13:18:10	                main:574]	:	INFO	:	Epoch 1818 | loss: nan | val_loss: nan | Time: 8663.1 ms
[2022-02-05 13:18:19	                main:574]	:	INFO	:	Epoch 1819 | loss: nan | val_loss: nan | Time: 9000.71 ms
[2022-02-05 13:18:28	                main:574]	:	INFO	:	Epoch 1820 | loss: nan | val_loss: nan | Time: 8738.76 ms
[2022-02-05 13:18:37	                main:574]	:	INFO	:	Epoch 1821 | loss: nan | val_loss: nan | Time: 8874.18 ms
[2022-02-05 13:18:45	                main:574]	:	INFO	:	Epoch 1822 | loss: nan | val_loss: nan | Time: 8775.25 ms
[2022-02-05 13:18:54	                main:574]	:	INFO	:	Epoch 1823 | loss: nan | val_loss: nan | Time: 8624.32 ms
[2022-02-05 13:19:03	                main:574]	:	INFO	:	Epoch 1824 | loss: nan | val_loss: nan | Time: 8571.43 ms
[2022-02-05 13:19:11	                main:574]	:	INFO	:	Epoch 1825 | loss: nan | val_loss: nan | Time: 8519.73 ms
[2022-02-05 13:19:20	                main:574]	:	INFO	:	Epoch 1826 | loss: nan | val_loss: nan | Time: 8364.71 ms
[2022-02-05 13:19:29	                main:574]	:	INFO	:	Epoch 1827 | loss: nan | val_loss: nan | Time: 8740.43 ms
[2022-02-05 13:19:38	                main:574]	:	INFO	:	Epoch 1828 | loss: nan | val_loss: nan | Time: 9357.74 ms
[2022-02-05 13:19:47	                main:574]	:	INFO	:	Epoch 1829 | loss: nan | val_loss: nan | Time: 8544.55 ms
[2022-02-05 13:19:55	                main:574]	:	INFO	:	Epoch 1830 | loss: nan | val_loss: nan | Time: 8685.97 ms
[2022-02-05 13:20:04	                main:574]	:	INFO	:	Epoch 1831 | loss: nan | val_loss: nan | Time: 8440.64 ms
[2022-02-05 13:20:13	                main:574]	:	INFO	:	Epoch 1832 | loss: nan | val_loss: nan | Time: 8905.31 ms
[2022-02-05 13:20:22	                main:574]	:	INFO	:	Epoch 1833 | loss: nan | val_loss: nan | Time: 8900.71 ms
[2022-02-05 13:20:31	                main:574]	:	INFO	:	Epoch 1834 | loss: nan | val_loss: nan | Time: 9166.98 ms
[2022-02-05 13:20:40	                main:574]	:	INFO	:	Epoch 1835 | loss: nan | val_loss: nan | Time: 8674.23 ms
[2022-02-05 13:20:49	                main:574]	:	INFO	:	Epoch 1836 | loss: nan | val_loss: nan | Time: 8971.18 ms
[2022-02-05 13:20:58	                main:574]	:	INFO	:	Epoch 1837 | loss: nan | val_loss: nan | Time: 8842.12 ms
[2022-02-05 13:21:07	                main:574]	:	INFO	:	Epoch 1838 | loss: nan | val_loss: nan | Time: 8831.99 ms
[2022-02-05 13:21:15	                main:574]	:	INFO	:	Epoch 1839 | loss: nan | val_loss: nan | Time: 8657.29 ms
[2022-02-05 13:21:24	                main:574]	:	INFO	:	Epoch 1840 | loss: nan | val_loss: nan | Time: 8614.3 ms
[2022-02-05 13:21:33	                main:574]	:	INFO	:	Epoch 1841 | loss: nan | val_loss: nan | Time: 8875.02 ms
[2022-02-05 13:21:42	                main:574]	:	INFO	:	Epoch 1842 | loss: nan | val_loss: nan | Time: 8994.33 ms
[2022-02-05 13:21:51	                main:574]	:	INFO	:	Epoch 1843 | loss: nan | val_loss: nan | Time: 8647.48 ms
[2022-02-05 13:22:00	                main:574]	:	INFO	:	Epoch 1844 | loss: nan | val_loss: nan | Time: 8741.93 ms
[2022-02-05 13:22:08	                main:574]	:	INFO	:	Epoch 1845 | loss: nan | val_loss: nan | Time: 8031.47 ms
[2022-02-05 13:22:16	                main:574]	:	INFO	:	Epoch 1846 | loss: nan | val_loss: nan | Time: 8471.22 ms
[2022-02-05 13:22:25	                main:574]	:	INFO	:	Epoch 1847 | loss: nan | val_loss: nan | Time: 8668.65 ms
[2022-02-05 13:22:34	                main:574]	:	INFO	:	Epoch 1848 | loss: nan | val_loss: nan | Time: 9060.99 ms
[2022-02-05 13:22:43	                main:574]	:	INFO	:	Epoch 1849 | loss: nan | val_loss: nan | Time: 8919.68 ms
[2022-02-05 13:22:52	                main:574]	:	INFO	:	Epoch 1850 | loss: nan | val_loss: nan | Time: 8682.58 ms
[2022-02-05 13:23:01	                main:574]	:	INFO	:	Epoch 1851 | loss: nan | val_loss: nan | Time: 8844.91 ms
[2022-02-05 13:23:10	                main:574]	:	INFO	:	Epoch 1852 | loss: nan | val_loss: nan | Time: 8842.09 ms
[2022-02-05 13:23:19	                main:574]	:	INFO	:	Epoch 1853 | loss: nan | val_loss: nan | Time: 8696.07 ms
[2022-02-05 13:23:27	                main:574]	:	INFO	:	Epoch 1854 | loss: nan | val_loss: nan | Time: 8677.82 ms
[2022-02-05 13:23:36	                main:574]	:	INFO	:	Epoch 1855 | loss: nan | val_loss: nan | Time: 8843.35 ms
[2022-02-05 13:23:45	                main:574]	:	INFO	:	Epoch 1856 | loss: nan | val_loss: nan | Time: 8876.09 ms
[2022-02-05 13:23:54	                main:574]	:	INFO	:	Epoch 1857 | loss: nan | val_loss: nan | Time: 8823.5 ms
[2022-02-05 13:24:03	                main:574]	:	INFO	:	Epoch 1858 | loss: nan | val_loss: nan | Time: 8797.07 ms
[2022-02-05 13:24:12	                main:574]	:	INFO	:	Epoch 1859 | loss: nan | val_loss: nan | Time: 8638.4 ms
[2022-02-05 13:24:21	                main:574]	:	INFO	:	Epoch 1860 | loss: nan | val_loss: nan | Time: 8859.73 ms
[2022-02-05 13:24:30	                main:574]	:	INFO	:	Epoch 1861 | loss: nan | val_loss: nan | Time: 8978.52 ms
[2022-02-05 13:24:39	                main:574]	:	INFO	:	Epoch 1862 | loss: nan | val_loss: nan | Time: 8970.07 ms
[2022-02-05 13:24:48	                main:574]	:	INFO	:	Epoch 1863 | loss: nan | val_loss: nan | Time: 8888.19 ms
[2022-02-05 13:24:57	                main:574]	:	INFO	:	Epoch 1864 | loss: nan | val_loss: nan | Time: 8934.1 ms
[2022-02-05 13:25:05	                main:574]	:	INFO	:	Epoch 1865 | loss: nan | val_loss: nan | Time: 8613.58 ms
[2022-02-05 13:25:15	                main:574]	:	INFO	:	Epoch 1866 | loss: nan | val_loss: nan | Time: 9734.48 ms
[2022-02-05 13:25:25	                main:574]	:	INFO	:	Epoch 1867 | loss: nan | val_loss: nan | Time: 9325.16 ms
[2022-02-05 13:25:34	                main:574]	:	INFO	:	Epoch 1868 | loss: nan | val_loss: nan | Time: 9260.53 ms
[2022-02-05 13:25:42	                main:574]	:	INFO	:	Epoch 1869 | loss: nan | val_loss: nan | Time: 8096.69 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1060 6GB)
[2022-02-05 13:46:32	                main:435]	:	INFO	:	Set logging level to 1
[2022-02-05 13:46:32	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-02-05 13:46:32	                main:444]	:	INFO	:	Resolving all filenames
[2022-02-05 13:46:32	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-02-05 13:46:32	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-02-05 13:46:32	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-02-05 13:46:32	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-02-05 13:46:32	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-02-05 13:46:32	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-02-05 13:46:32	                main:474]	:	INFO	:	Configuration: 
[2022-02-05 13:46:32	                main:475]	:	INFO	:	    Model type: GRU
[2022-02-05 13:46:33	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-02-05 13:46:33	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-02-05 13:46:33	                main:478]	:	INFO	:	    Batch Size: 128
[2022-02-05 13:46:33	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-02-05 13:46:33	                main:480]	:	INFO	:	    Patience: 10
[2022-02-05 13:46:33	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-02-05 13:46:33	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-02-05 13:46:33	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-02-05 13:46:33	                main:484]	:	INFO	:	    # Threads: 1
[2022-02-05 13:46:33	                main:486]	:	INFO	:	Preparing Dataset
[2022-02-05 13:46:33	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-02-05 13:46:34	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-02-05 13:46:36	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-02-05 13:46:36	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-02-05 13:46:37	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-02-05 13:46:37	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-02-05 13:46:37	                main:494]	:	INFO	:	Creating Model
[2022-02-05 13:46:37	                main:507]	:	INFO	:	Preparing config file
[2022-02-05 13:46:37	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-02-05 13:46:37	                main:512]	:	INFO	:	Loading config


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FF8DABB478C

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 02/05/22 13:46:37
Install Directory : C:\Program Files\BOINC\
Data Directory    : F:\boinc
Project Symstore  : 
LoadLibraryA( F:\boinc\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( F:\boinc\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( F:\boinc\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( F:\boinc\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: F:\boinc\slots\6;F:\boinc\projects\www.mlcathome.org_mlcathome


ModLoad: 0000000097460000 00000000003df000 F:\boinc\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000dd4c0000 0000000000209000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.22000.469) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.22000.434 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.434

ModLoad: 00000000dbd00000 00000000000bd000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.22000.434) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.22000.434 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.434

ModLoad: 00000000dab70000 0000000000374000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.22000.434) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.22000.434 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.434

ModLoad: 00000000db580000 00000000001ac000 C:\WINDOWS\System32\USER32.dll (6.2.22000.282) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.22000.434 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.434

ModLoad: 00000000db1f0000 0000000000026000 C:\WINDOWS\System32\win32u.dll (6.2.22000.434) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.22000.434 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.434

ModLoad: 00000000dc620000 0000000000029000 C:\WINDOWS\System32\GDI32.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000db060000 0000000000112000 C:\WINDOWS\System32\gdi32full.dll (6.2.22000.469) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.22000.469 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.469

ModLoad: 00000000da9b0000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000daa50000 0000000000111000 C:\WINDOWS\System32\ucrtbase.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000dc4f0000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.22000.434) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.22000.434 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.434

ModLoad: 00000000dbc30000 00000000000a3000 C:\WINDOWS\System32\msvcrt.dll (7.0.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.22000.1

ModLoad: 00000000dc9e0000 000000000009e000 C:\WINDOWS\System32\sechost.dll (6.2.22000.434) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000dcbb0000 0000000000120000 C:\WINDOWS\System32\RPCRT4.dll (6.2.22000.434) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.22000.434 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.434

ModLoad: 00000000c0730000 0000000000058000 F:\boinc\slots\6\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000bf3d0000 000000000008e000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.31.30818.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\14\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.31.30818.0
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.31.30818.0

ModLoad: 00000000ca8c0000 0000000000221000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000bf700000 000000000001b000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.31.30818.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\14\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.31.30818.0
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.31.30818.0

ModLoad: 00000000c2070000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.31.30818.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\14\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.31.30818.0
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.31.30818.0

ModLoad: 0000000041e20000 000000000abe7000 F:\boinc\slots\6\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000584e0000 0000000024b49000 F:\boinc\slots\6\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000c47f0000 0000000000045000 F:\boinc\slots\6\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000a0ad0000 00000000002db000 F:\boinc\slots\6\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000a08c0000 000000000020d000 F:\boinc\slots\6\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 0000000055020000 00000000034b2000 F:\boinc\slots\6\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000d7e80000 0000000000010000 F:\boinc\slots\6\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 0000000051f70000 00000000030a5000 F:\boinc\slots\6\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 0000000000640000 000000001b3a4000 F:\boinc\slots\6\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 00000000ce670000 0000000000040000 F:\boinc\slots\6\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000004e210000 0000000003d5b000 F:\boinc\slots\6\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 0000000038c80000 000000000919f000 F:\boinc\slots\6\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 0000000036db0000 0000000001eca000 F:\boinc\slots\6\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000dcb70000 0000000000031000 C:\WINDOWS\System32\IMM32.DLL (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000d9b30000 0000000000018000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.22000.71) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.22000.71 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.71

ModLoad: 00000000d8200000 0000000000038000 C:\WINDOWS\SYSTEM32\dxcore.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : DXCore.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000dbdd0000 000000000046c000 C:\WINDOWS\System32\Setupapi.dll (6.2.22000.469) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.22000.434 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.434

ModLoad: 00000000da680000 000000000002c000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000da6b0000 000000000004c000 C:\WINDOWS\SYSTEM32\cfgmgr32.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000db180000 0000000000067000 C:\WINDOWS\System32\WINTRUST.dll (6.2.22000.469) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.22000.469 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.469

ModLoad: 00000000daef0000 0000000000162000 C:\WINDOWS\System32\CRYPT32.dll (6.2.22000.348) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.22000.434 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.434

ModLoad: 00000000da270000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000dccd0000 00000000007ae000 C:\WINDOWS\System32\Shell32.dll (6.2.22000.469) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.22000.434 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.434

ModLoad: 00000000d8b20000 0000000000867000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.22000.469) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.22000.434 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.434

ModLoad: 00000000dc660000 0000000000378000 C:\WINDOWS\System32\combase.dll (6.2.22000.282) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.22000.434 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.434

ModLoad: 00000000d89b0000 0000000000166000 C:\WINDOWS\SYSTEM32\wintypes.dll (6.2.22000.41) (-exported- Symbols Loaded)
    Linked PDB Filename   : WinTypes.pdb
    File Version          : 10.0.22000.434 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.434

ModLoad: 00000000dc240000 00000000000ea000 C:\WINDOWS\System32\SHCORE.dll (6.2.22000.71) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.22000.434 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.434

ModLoad: 00000000db3d0000 000000000005d000 C:\WINDOWS\System32\shlwapi.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.22000.434 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.434

ModLoad: 0000000029990000 00000000002cd000 C:\WINDOWS\system32\nvcuda.dll (30.0.15.1123) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_04\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 30.0.15.1123
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.6.58 driver
    Product Version       : 30.0.15.1123

ModLoad: 00000000282f0000 00000000016a0000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_015fa42d67826549\nvcuda64.dll (30.0.15.1123) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_04\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 30.0.15.1123
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.6.58 driver
    Product Version       : 30.0.15.1123

ModLoad: 00000000d4820000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000d4400000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000d1ae0000 0000000000149000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.22000.120) (-exported- Symbols Loaded)
    Linked PDB Filename   : drvstore.pdb
    File Version          : 10.0.22000.120 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.120

ModLoad: 00000000da2e0000 000000000003d000 C:\WINDOWS\SYSTEM32\wldp.dll (6.2.22000.120) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.22000.434 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.434

ModLoad: 00000000da210000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000d0ad0000 0000000000767000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.15.1123) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_04\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 30.0.15.1123
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 30.0.15.1123

ModLoad: 00000000db2e0000 000000000007f000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.22000.376) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.22000.376 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.376



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3623, Write: 308, Other 1052

- I/O Transfers Counters -
Read: 6790802, Write: 6059, Other 30520

- Paged Pool Usage -
QuotaPagedPoolUsage: 3444208, QuotaPeakPagedPoolUsage: 3460272
QuotaNonPagedPoolUsage: 38696, QuotaPeakNonPagedPoolUsage: 38760

- Virtual Memory Usage -
VirtualSize: -1428930560, PeakVirtualSize: -846700544

- Pagefile Usage -
PagefileUsage: -1428930560, PeakPagefileUsage: -1428930560

- Working Set Size -
WorkingSetSize: 1157828608, PeakWorkingSetSize: 1157828608, PageFaultCount: 394607

*** Dump of thread ID 14168 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 9062500.000000, User Time: 22031250.000000, Wait Time: 668747.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FF8DABB478C

- Registers -
rax=00000000dd4e8300 rbx=00000000977c4910 rcx=000000004590331d rdx=0000000001375d40 rsi=00000000013765a0 rdi=0000000019930520
r8=0000000000000004 r9=0000000001375d98 r10=0000000000000004 r11=000000001bbdc220 r12=0000000000268b60 r13=00000000013767b0
r14=0000000023e28120 r15=0000000000000000 rip=00000000dabb478c rsp=0000000001376440 rbp=0000000001376730
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
01376510 976da884 00000040 0000004f 0026ae00 000003a7 KERNELBASE!RaiseException+0x0 
01376570 97481ca6 00003a70 00000000 24406080 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
01376620 9748593b 00000000 00000020 00000000 00000030 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
01376770 97481a78 00000000 00000000 01376aa0 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
01376840 97481cfc 01376aa0 00000000 00000080 01376d70 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
01376900 9748c4dd 01376d70 01376d70 01376d70 01376d70 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
01376bf0 9747b2fe 01377208 01376d70 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
0138f990 976bc6f8 49917530 00000000 00000000 4802e550 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
0138f9d0 dbd154e0 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
0138fa00 dd4c485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0138fa80 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 9036 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 312500.000000, User Time: 0.000000, Wait Time: 668397.000000

- Registers -
rax=00000000000001de rbx=000000004802a6f0 rcx=0000000000000078 rdx=000000004802a370 rsi=0000000048027ef0 rdi=000000004802a6f0
r8=0000000000000008 r9=0000000000000040 r10=0000000000000500 r11=0000000093f100b4 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000dd567304 rsp=00000000016ff728 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
016ff720 dd4d6c2f 00000000 00000000 48027ef0 4802a6f0 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
016ffa10 dbd154e0 00000000 00000000 00000000 00000000 ntdll!EtwNotificationRegister+0x0 
016ffa40 dd4c485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
016ffac0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 15020 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 625000.000000, User Time: 0.000000, Wait Time: 668397.000000

- Registers -
rax=00000000000001de rbx=000000004802d030 rcx=0000000000000078 rdx=000000004802ccb0 rsi=0000000048027ef0 rdi=000000004802d030
r8=00000000d4825004 r9=0000000000000000 r10=00000000d48200f0 r11=0000000000000001 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000dd567304 rsp=00000000017ff768 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
017ff760 dd4d6c2f 00000000 00000000 48027ef0 4802d030 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
017ffa50 dbd154e0 00000000 00000000 00000000 00000000 ntdll!EtwNotificationRegister+0x0 
017ffa80 dd4c485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
017ffb00 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 15724 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 312500.000000, User Time: 0.000000, Wait Time: 668397.000000

- Registers -
rax=00000000000001de rbx=000000004802efa0 rcx=0000000000000078 rdx=000000004802ec20 rsi=0000000048027ef0 rdi=000000004802efa0
r8=00000000000002a8 r9=0000000000000000 r10=0000000000000001 r11=0000000038c5a2a8 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000dd567304 rsp=00000000018ff718 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
018ff710 dd4d6c2f 0001000b 00000001 00000001 4802efa0 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
018ffa00 dbd154e0 00000000 00000000 00000000 00000000 ntdll!EtwNotificationRegister+0x0 
018ffa30 dd4c485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
018ffab0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 4224 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 668744.000000

- Registers -
rax=0000000000000034 rbx=0000000001affb40 rcx=0000000000000000 rdx=0000000001affb40 rsi=00000000014d6000 rdi=0000000000000000
r8=0000000001affa78 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000dd563dd4 rsp=0000000001affa78 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
01affa70 dd51b5c3 00000000 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0 
01affaa0 dabbb3a1 00000000 00000000 00000000 00000000 ntdll!RtlDelayExecution+0x0 
01affb20 9749a07f 00000000 00000000 fff0bdc0 00000000 KERNELBASE!SleepEx+0x0 
01affb50 dbd154e0 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
01affb80 dd4c485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
01affc00 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 2808 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 668744.000000

- Registers -
rax=000000000000005b rbx=0000000000000006 rcx=0000000000000006 rdx=0000000001bff9c0 rsi=0000000000000000 rdi=0000000000000006
r8=0000000000000001 r9=0000000000000000 r10=0000000000000000 r11=0000000001bff930 r12=0000000000000064 r13=0000000001bff9c0
r14=0000000001bff6c0 r15=0000000000000000 rip=00000000dd5642a4 rsp=0000000001bff668 rbp=0000000049b1f9e0
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
01bff660 dabbfb10 00000000 00000000 00000000 00000000 ntdll!NtWaitForMultipleObjects+0x0 
01bff950 dabbfa0e 2883f1b8 49be6350 00000006 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
01bff990 284cd384 49b21900 00000000 49b1c560 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
01bffbd0 285756fd 00000000 49b1f9e0 00000000 00000000 nvcuda64!+0x0 
01bffc80 284ccd53 54c9b6ad 52a831d9 4a0d3aa0 00000000 nvcuda64!cuProfilerStop+0x0 
01bffcb0 28804064 4a0d3aa0 00000000 00000000 00000000 nvcuda64!+0x0 
01bffce0 dbd154e0 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
01bffd10 dd4c485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
01bffd90 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)