Task 5840631
| Name | ParityMachine-1624573870-8558-3_1 |
| Workunit | 3551392 |
| Created | 14 Jul 2021, 20:07:36 UTC |
| Sent | 14 Jul 2021, 20:48:03 UTC |
| Report deadline | 21 Jul 2021, 20:48:03 UTC |
| Received | 14 Jul 2021, 22:53:50 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | -529697949 (0xE06D7363) Unknown error code |
| Computer ID | 9955 |
| Run time | 2 hours 1 min 37 sec |
| CPU time | 1 hours 59 min 45 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 1,883.38 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.64 GB |
| Peak swap size | 3.60 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
main:574] : INFO : Epoch 1678 | loss: 0.0311656 | val_loss: 0.0311941 | Time: 3948.03 ms
[2021-07-15 00:37:42 main:574] : INFO : Epoch 1679 | loss: 0.0311575 | val_loss: 0.0311764 | Time: 3955.69 ms
[2021-07-15 00:37:46 main:574] : INFO : Epoch 1680 | loss: 0.0311536 | val_loss: 0.0311738 | Time: 4281.34 ms
[2021-07-15 00:37:50 main:574] : INFO : Epoch 1681 | loss: 0.0311533 | val_loss: 0.0311785 | Time: 4454.43 ms
[2021-07-15 00:37:55 main:574] : INFO : Epoch 1682 | loss: 0.0311524 | val_loss: 0.03117 | Time: 4328.27 ms
[2021-07-15 00:37:59 main:574] : INFO : Epoch 1683 | loss: 0.0311509 | val_loss: 0.0311695 | Time: 4188.76 ms
[2021-07-15 00:38:03 main:574] : INFO : Epoch 1684 | loss: 0.0311546 | val_loss: 0.0311736 | Time: 4265.79 ms
[2021-07-15 00:38:08 main:574] : INFO : Epoch 1685 | loss: 0.0311522 | val_loss: 0.0311714 | Time: 4185.77 ms
[2021-07-15 00:38:12 main:574] : INFO : Epoch 1686 | loss: 0.0311519 | val_loss: 0.0311702 | Time: 3983.39 ms
[2021-07-15 00:38:15 main:574] : INFO : Epoch 1687 | loss: 0.0311526 | val_loss: 0.0311711 | Time: 3589.92 ms
[2021-07-15 00:38:20 main:574] : INFO : Epoch 1688 | loss: 0.0311514 | val_loss: 0.0311706 | Time: 4638.56 ms
[2021-07-15 00:38:24 main:574] : INFO : Epoch 1689 | loss: 0.0311506 | val_loss: 0.0311704 | Time: 4529.59 ms
[2021-07-15 00:38:28 main:574] : INFO : Epoch 1690 | loss: 0.0311498 | val_loss: 0.0311736 | Time: 3724.79 ms
[2021-07-15 00:38:32 main:574] : INFO : Epoch 1691 | loss: 0.031151 | val_loss: 0.0311731 | Time: 3917.85 ms
[2021-07-15 00:38:36 main:574] : INFO : Epoch 1692 | loss: 0.0311506 | val_loss: 0.0311728 | Time: 3748.65 ms
[2021-07-15 00:38:40 main:574] : INFO : Epoch 1693 | loss: 0.0311549 | val_loss: 0.0311749 | Time: 3776.49 ms
[2021-07-15 00:38:43 main:574] : INFO : Epoch 1694 | loss: 0.0311582 | val_loss: 0.0311699 | Time: 3721.55 ms
[2021-07-15 00:38:47 main:574] : INFO : Epoch 1695 | loss: 0.0311532 | val_loss: 0.0311719 | Time: 3704.52 ms
[2021-07-15 00:38:51 main:574] : INFO : Epoch 1696 | loss: 0.0311512 | val_loss: 0.0311706 | Time: 4362.51 ms
[2021-07-15 00:38:56 main:574] : INFO : Epoch 1697 | loss: 0.0311518 | val_loss: 0.0311707 | Time: 4142.07 ms
[2021-07-15 00:38:59 main:574] : INFO : Epoch 1698 | loss: 0.0311534 | val_loss: 0.0311718 | Time: 3844.34 ms
[2021-07-15 00:39:03 main:574] : INFO : Epoch 1699 | loss: 0.0311543 | val_loss: 0.0311818 | Time: 3657.46 ms
[2021-07-15 00:39:07 main:574] : INFO : Epoch 1700 | loss: 0.0311522 | val_loss: 0.0311709 | Time: 3808.16 ms
[2021-07-15 00:39:11 main:574] : INFO : Epoch 1701 | loss: 0.0311515 | val_loss: 0.0311711 | Time: 4502.46 ms
[2021-07-15 00:39:16 main:574] : INFO : Epoch 1702 | loss: 0.0311519 | val_loss: 0.031176 | Time: 4408.58 ms
[2021-07-15 00:39:20 main:574] : INFO : Epoch 1703 | loss: 0.0311529 | val_loss: 0.0311743 | Time: 4288.41 ms
[2021-07-15 00:39:24 main:574] : INFO : Epoch 1704 | loss: 0.0311511 | val_loss: 0.0311698 | Time: 3830.09 ms
[2021-07-15 00:39:28 main:574] : INFO : Epoch 1705 | loss: 0.0311502 | val_loss: 0.031172 | Time: 3730.13 ms
[2021-07-15 00:39:32 main:574] : INFO : Epoch 1706 | loss: 0.0311544 | val_loss: 0.031175 | Time: 4293.95 ms
[2021-07-15 00:39:36 main:574] : INFO : Epoch 1707 | loss: 0.0311532 | val_loss: 0.031172 | Time: 4247.51 ms
[2021-07-15 00:39:41 main:574] : INFO : Epoch 1708 | loss: 0.0311514 | val_loss: 0.0311702 | Time: 4243.68 ms
[2021-07-15 00:39:45 main:574] : INFO : Epoch 1709 | loss: 0.0311522 | val_loss: 0.0311856 | Time: 3974.84 ms
[2021-07-15 00:39:48 main:574] : INFO : Epoch 1710 | loss: 0.0311587 | val_loss: 0.0311805 | Time: 3760.66 ms
[2021-07-15 00:39:52 main:574] : INFO : Epoch 1711 | loss: 0.0311528 | val_loss: 0.0311692 | Time: 3662.09 ms
[2021-07-15 00:39:56 main:574] : INFO : Epoch 1712 | loss: 0.0311536 | val_loss: 0.0311727 | Time: 3804.67 ms
[2021-07-15 00:40:00 main:574] : INFO : Epoch 1713 | loss: 0.0311551 | val_loss: 0.0311668 | Time: 3677.74 ms
[2021-07-15 00:40:03 main:574] : INFO : Epoch 1714 | loss: 0.0311506 | val_loss: 0.0311696 | Time: 3667.14 ms
[2021-07-15 00:40:07 main:574] : INFO : Epoch 1715 | loss: 0.0311525 | val_loss: 0.0311718 | Time: 3776.54 ms
[2021-07-15 00:40:11 main:574] : INFO : Epoch 1716 | loss: 0.0311502 | val_loss: 0.0311691 | Time: 3676.79 ms
[2021-07-15 00:40:15 main:574] : INFO : Epoch 1717 | loss: 0.0311526 | val_loss: 0.0311731 | Time: 3682.64 ms
[2021-07-15 00:40:18 main:574] : INFO : Epoch 1718 | loss: 0.0311512 | val_loss: 0.0311696 | Time: 3689.05 ms
[2021-07-15 00:40:22 main:574] : INFO : Epoch 1719 | loss: 0.031153 | val_loss: 0.0311741 | Time: 3681.33 ms
[2021-07-15 00:40:26 main:574] : INFO : Epoch 1720 | loss: 0.0311536 | val_loss: 0.0311742 | Time: 3611.5 ms
[2021-07-15 00:40:29 main:574] : INFO : Epoch 1721 | loss: 0.0311507 | val_loss: 0.03117 | Time: 3739.06 ms
[2021-07-15 00:40:33 main:574] : INFO : Epoch 1722 | loss: 0.0311516 | val_loss: 0.0311687 | Time: 3760.6 ms
[2021-07-15 00:40:37 main:574] : INFO : Epoch 1723 | loss: 0.0311522 | val_loss: 0.0311704 | Time: 3799.92 ms
[2021-07-15 00:40:41 main:574] : INFO : Epoch 1724 | loss: 0.0311487 | val_loss: 0.0311718 | Time: 3875.44 ms
[2021-07-15 00:40:45 main:574] : INFO : Epoch 1725 | loss: 0.0311519 | val_loss: 0.0311702 | Time: 3888.04 ms
[2021-07-15 00:40:48 main:574] : INFO : Epoch 1726 | loss: 0.0311517 | val_loss: 0.0311771 | Time: 3688.95 ms
[2021-07-15 00:40:52 main:574] : INFO : Epoch 1727 | loss: 0.0311517 | val_loss: 0.0311692 | Time: 3877.07 ms
[2021-07-15 00:40:56 main:574] : INFO : Epoch 1728 | loss: 0.0311572 | val_loss: 0.0311766 | Time: 3630.24 ms
[2021-07-15 00:41:00 main:574] : INFO : Epoch 1729 | loss: 0.0311523 | val_loss: 0.0311696 | Time: 3834.47 ms
[2021-07-15 00:41:04 main:574] : INFO : Epoch 1730 | loss: 0.0311518 | val_loss: 0.03117 | Time: 3635.39 ms
[2021-07-15 00:41:07 main:574] : INFO : Epoch 1731 | loss: 0.031151 | val_loss: 0.0311689 | Time: 3878.17 ms
[2021-07-15 00:41:12 main:574] : INFO : Epoch 1732 | loss: 0.0311491 | val_loss: 0.0311709 | Time: 4072.07 ms
[2021-07-15 00:41:16 main:574] : INFO : Epoch 1733 | loss: 0.031152 | val_loss: 0.0311771 | Time: 4320.01 ms
[2021-07-15 00:41:20 main:574] : INFO : Epoch 1734 | loss: 0.0311505 | val_loss: 0.0311784 | Time: 3931.46 ms
[2021-07-15 00:41:24 main:574] : INFO : Epoch 1735 | loss: 0.0311529 | val_loss: 0.0311728 | Time: 3650.51 ms
[2021-07-15 00:41:27 main:574] : INFO : Epoch 1736 | loss: 0.0311496 | val_loss: 0.03117 | Time: 3699.07 ms
[2021-07-15 00:41:31 main:574] : INFO : Epoch 1737 | loss: 0.0311486 | val_loss: 0.0311696 | Time: 3671.7 ms
[2021-07-15 00:41:35 main:574] : INFO : Epoch 1738 | loss: 0.0311629 | val_loss: 0.0311889 | Time: 3736.44 ms
[2021-07-15 00:41:38 main:574] : INFO : Epoch 1739 | loss: 0.0311766 | val_loss: 0.0311834 | Time: 3600.11 ms
[2021-07-15 00:41:42 main:574] : INFO : Epoch 1740 | loss: 0.0311797 | val_loss: 0.0311876 | Time: 3652.76 ms
[2021-07-15 00:41:46 main:574] : INFO : Epoch 1741 | loss: 0.031179 | val_loss: 0.0311845 | Time: 3749.99 ms
[2021-07-15 00:41:49 main:574] : INFO : Epoch 1742 | loss: 0.031175 | val_loss: 0.0311803 | Time: 3682.11 ms
[2021-07-15 00:41:53 main:574] : INFO : Epoch 1743 | loss: 0.0311753 | val_loss: 0.0311828 | Time: 3820.08 ms
[2021-07-15 00:41:57 main:574] : INFO : Epoch 1744 | loss: 0.031175 | val_loss: 0.0311799 | Time: 3859.55 ms
[2021-07-15 00:42:01 main:574] : INFO : Epoch 1745 | loss: 0.0311718 | val_loss: 0.0311782 | Time: 3869.35 ms
[2021-07-15 00:42:05 main:574] : INFO : Epoch 1746 | loss: 0.0311707 | val_loss: 0.0311773 | Time: 3868.97 ms
[2021-07-15 00:42:09 main:574] : INFO : Epoch 1747 | loss: 0.0311705 | val_loss: 0.0311765 | Time: 3682.48 ms
[2021-07-15 00:42:13 main:574] : INFO : Epoch 1748 | loss: 0.0311729 | val_loss: 0.03118 | Time: 3835.05 ms
[2021-07-15 00:42:16 main:574] : INFO : Epoch 1749 | loss: 0.031172 | val_loss: 0.0311765 | Time: 3657.46 ms
[2021-07-15 00:42:20 main:574] : INFO : Epoch 1750 | loss: 0.0311699 | val_loss: 0.0311767 | Time: 3747.14 ms
[2021-07-15 00:42:24 main:574] : INFO : Epoch 1751 | loss: 0.0311706 | val_loss: 0.0311742 | Time: 3785.69 ms
[2021-07-15 00:42:28 main:574] : INFO : Epoch 1752 | loss: 0.031171 | val_loss: 0.0311751 | Time: 4484.71 ms
[2021-07-15 00:42:33 main:574] : INFO : Epoch 1753 | loss: 0.0311684 | val_loss: 0.0311737 | Time: 4523.38 ms
[2021-07-15 00:42:37 main:574] : INFO : Epoch 1754 | loss: 0.0311681 | val_loss: 0.0311734 | Time: 4021.16 ms
[2021-07-15 00:42:41 main:574] : INFO : Epoch 1755 | loss: 0.0311672 | val_loss: 0.0311752 | Time: 3665.69 ms
[2021-07-15 00:42:44 main:574] : INFO : Epoch 1756 | loss: 0.0311689 | val_loss: 0.0311735 | Time: 3902.65 ms
[2021-07-15 00:42:48 main:574] : INFO : Epoch 1757 | loss: 0.0311674 | val_loss: 0.0311736 | Time: 3725.05 ms
[2021-07-15 00:42:52 main:574] : INFO : Epoch 1758 | loss: 0.0311682 | val_loss: 0.0311787 | Time: 3761.64 ms
[2021-07-15 00:42:56 main:574] : INFO : Epoch 1759 | loss: 0.031168 | val_loss: 0.031175 | Time: 4069.37 ms
[2021-07-15 00:43:00 main:574] : INFO : Epoch 1760 | loss: 0.0311672 | val_loss: 0.0311778 | Time: 3981.17 ms
[2021-07-15 00:43:04 main:574] : INFO : Epoch 1761 | loss: 0.0311656 | val_loss: 0.0311742 | Time: 3664.4 ms
[2021-07-15 00:43:07 main:574] : INFO : Epoch 1762 | loss: 0.0311654 | val_loss: 0.0311736 | Time: 3684.14 ms
[2021-07-15 00:43:12 main:574] : INFO : Epoch 1763 | loss: 0.0311688 | val_loss: 0.0311836 | Time: 4162.36 ms
[2021-07-15 00:43:16 main:574] : INFO : Epoch 1764 | loss: 0.0311721 | val_loss: 0.0311819 | Time: 4278.71 ms
[2021-07-15 00:43:20 main:574] : INFO : Epoch 1765 | loss: 0.0311684 | val_loss: 0.031187 | Time: 4140.99 ms
[2021-07-15 00:43:24 main:574] : INFO : Epoch 1766 | loss: 0.031172 | val_loss: 0.0311806 | Time: 4021.98 ms
[2021-07-15 00:43:28 main:574] : INFO : Epoch 1767 | loss: 0.0311714 | val_loss: 0.0311732 | Time: 4173.73 ms
[2021-07-15 00:43:33 main:574] : INFO : Epoch 1768 | loss: 0.0311659 | val_loss: 0.0311754 | Time: 4415.95 ms
[2021-07-15 00:43:37 main:574] : INFO : Epoch 1769 | loss: 0.0311652 | val_loss: 0.0311766 | Time: 4098.82 ms
[2021-07-15 00:43:41 main:574] : INFO : Epoch 1770 | loss: 0.031165 | val_loss: 0.0311741 | Time: 4240.21 ms
[2021-07-15 00:43:45 main:574] : INFO : Epoch 1771 | loss: 0.0311641 | val_loss: 0.0311768 | Time: 3674.73 ms
[2021-07-15 00:43:49 main:574] : INFO : Epoch 1772 | loss: 0.0311642 | val_loss: 0.0311747 | Time: 3813.11 ms
[2021-07-15 00:43:53 main:574] : INFO : Epoch 1773 | loss: 0.031165 | val_loss: 0.0311738 | Time: 4429.03 ms
[2021-07-15 00:43:57 main:574] : INFO : Epoch 1774 | loss: 0.0311654 | val_loss: 0.0311751 | Time: 4135.29 ms
[2021-07-15 00:44:02 main:574] : INFO : Epoch 1775 | loss: 0.0311663 | val_loss: 0.0311747 | Time: 4194.23 ms
[2021-07-15 00:44:06 main:574] : INFO : Epoch 1776 | loss: 0.0311646 | val_loss: 0.0311749 | Time: 4247.7 ms
[2021-07-15 00:44:10 main:574] : INFO : Epoch 1777 | loss: 0.0311632 | val_loss: 0.0311765 | Time: 3870.11 ms
[2021-07-15 00:44:14 main:574] : INFO : Epoch 1778 | loss: 0.0311638 | val_loss: 0.031175 | Time: 3955.62 ms
[2021-07-15 00:44:18 main:574] : INFO : Epoch 1779 | loss: 0.0311623 | val_loss: 0.0311799 | Time: 3784.97 ms
[2021-07-15 00:44:21 main:574] : INFO : Epoch 1780 | loss: 0.0311662 | val_loss: 0.0311765 | Time: 3817.01 ms
[2021-07-15 00:44:25 main:574] : INFO : Epoch 1781 | loss: 0.0311641 | val_loss: 0.0311784 | Time: 3708.65 ms
[2021-07-15 00:44:29 main:574] : INFO : Epoch 1782 | loss: 0.0311673 | val_loss: 0.0311816 | Time: 4162.16 ms
[2021-07-15 00:44:33 main:574] : INFO : Epoch 1783 | loss: 0.031167 | val_loss: 0.0311782 | Time: 3671.3 ms
[2021-07-15 00:44:37 main:574] : INFO : Epoch 1784 | loss: 0.0311645 | val_loss: 0.0311789 | Time: 3852.03 ms
[2021-07-15 00:44:41 main:574] : INFO : Epoch 1785 | loss: 0.0311641 | val_loss: 0.0311748 | Time: 4454.89 ms
[2021-07-15 00:44:45 main:574] : INFO : Epoch 1786 | loss: 0.0311622 | val_loss: 0.0311755 | Time: 3929.02 ms
[2021-07-15 00:44:49 main:574] : INFO : Epoch 1787 | loss: 0.0311621 | val_loss: 0.0311769 | Time: 4190.33 ms
[2021-07-15 00:44:54 main:574] : INFO : Epoch 1788 | loss: 0.0311648 | val_loss: 0.031177 | Time: 4084.36 ms
[2021-07-15 00:44:58 main:574] : INFO : Epoch 1789 | loss: 0.031163 | val_loss: 0.0311743 | Time: 4312.83 ms
[2021-07-15 00:45:02 main:574] : INFO : Epoch 1790 | loss: 0.0311625 | val_loss: 0.0311758 | Time: 4101.01 ms
[2021-07-15 00:45:06 main:574] : INFO : Epoch 1791 | loss: 0.0311612 | val_loss: 0.0311745 | Time: 3899.2 ms
[2021-07-15 00:45:10 main:574] : INFO : Epoch 1792 | loss: 0.0311621 | val_loss: 0.0311783 | Time: 3875.42 ms
[2021-07-15 00:45:14 main:574] : INFO : Epoch 1793 | loss: 0.0311611 | val_loss: 0.0311786 | Time: 3883.8 ms
[2021-07-15 00:45:18 main:574] : INFO : Epoch 1794 | loss: 0.031162 | val_loss: 0.0311752 | Time: 3877.67 ms
[2021-07-15 00:45:22 main:574] : INFO : Epoch 1795 | loss: 0.031161 | val_loss: 0.0311753 | Time: 4041.68 ms
[2021-07-15 00:45:25 main:574] : INFO : Epoch 1796 | loss: 0.0311628 | val_loss: 0.031177 | Time: 3724.58 ms
[2021-07-15 00:45:29 main:574] : INFO : Epoch 1797 | loss: 0.0311653 | val_loss: 0.0311763 | Time: 3774.76 ms
[2021-07-15 00:45:33 main:574] : INFO : Epoch 1798 | loss: 0.0311625 | val_loss: 0.0311777 | Time: 3782.84 ms
[2021-07-15 00:45:37 main:574] : INFO : Epoch 1799 | loss: 0.0311631 | val_loss: 0.0311769 | Time: 4144.09 ms
[2021-07-15 00:45:41 main:574] : INFO : Epoch 1800 | loss: 0.0311648 | val_loss: 0.0311751 | Time: 3735.18 ms
[2021-07-15 00:45:45 main:574] : INFO : Epoch 1801 | loss: 0.0311644 | val_loss: 0.0311742 | Time: 4380.78 ms
[2021-07-15 00:45:49 main:574] : INFO : Epoch 1802 | loss: 0.0311628 | val_loss: 0.0311761 | Time: 3967.62 ms
[2021-07-15 00:45:53 main:574] : INFO : Epoch 1803 | loss: 0.0311612 | val_loss: 0.031177 | Time: 4052.22 ms
[2021-07-15 00:45:57 main:574] : INFO : Epoch 1804 | loss: 0.0311617 | val_loss: 0.0311746 | Time: 3923.8 ms
[2021-07-15 00:46:01 main:574] : INFO : Epoch 1805 | loss: 0.0311605 | val_loss: 0.0311762 | Time: 3927.11 ms
[2021-07-15 00:46:05 main:574] : INFO : Epoch 1806 | loss: 0.0311618 | val_loss: 0.0311777 | Time: 3952.43 ms
[2021-07-15 00:46:10 main:574] : INFO : Epoch 1807 | loss: 0.0311621 | val_loss: 0.031177 | Time: 4253.56 ms
[2021-07-15 00:46:14 main:574] : INFO : Epoch 1808 | loss: 0.0311598 | val_loss: 0.0311786 | Time: 4116.49 ms
[2021-07-15 00:46:18 main:574] : INFO : Epoch 1809 | loss: 0.0311638 | val_loss: 0.0311779 | Time: 4383.11 ms
[2021-07-15 00:46:22 main:574] : INFO : Epoch 1810 | loss: 0.0311628 | val_loss: 0.031182 | Time: 4247.76 ms
[2021-07-15 00:46:26 main:574] : INFO : Epoch 1811 | loss: 0.0311647 | val_loss: 0.0311819 | Time: 3688.21 ms
[2021-07-15 00:46:30 main:574] : INFO : Epoch 1812 | loss: 0.0311669 | val_loss: 0.0311766 | Time: 3847.4 ms
[2021-07-15 00:46:34 main:574] : INFO : Epoch 1813 | loss: 0.0311669 | val_loss: 0.0311763 | Time: 4013.35 ms
[2021-07-15 00:46:38 main:574] : INFO : Epoch 1814 | loss: 0.0311623 | val_loss: 0.0311755 | Time: 3874.53 ms
[2021-07-15 00:46:42 main:574] : INFO : Epoch 1815 | loss: 0.0311626 | val_loss: 0.0311783 | Time: 4155.37 ms
[2021-07-15 00:46:46 main:574] : INFO : Epoch 1816 | loss: 0.031163 | val_loss: 0.0311779 | Time: 3671.6 ms
[2021-07-15 00:46:49 main:574] : INFO : Epoch 1817 | loss: 0.0311618 | val_loss: 0.0311737 | Time: 3710.53 ms
[2021-07-15 00:46:54 main:574] : INFO : Epoch 1818 | loss: 0.0311601 | val_loss: 0.0311752 | Time: 4701.95 ms
[2021-07-15 00:46:58 main:574] : INFO : Epoch 1819 | loss: 0.0311632 | val_loss: 0.0311748 | Time: 3748.68 ms
[2021-07-15 00:47:02 main:574] : INFO : Epoch 1820 | loss: 0.0311623 | val_loss: 0.0311841 | Time: 3620.28 ms
[2021-07-15 00:47:05 main:574] : INFO : Epoch 1821 | loss: 0.0311624 | val_loss: 0.031174 | Time: 3781.99 ms
[2021-07-15 00:47:09 main:574] : INFO : Epoch 1822 | loss: 0.0311598 | val_loss: 0.0311769 | Time: 3756.05 ms
[2021-07-15 00:47:13 main:574] : INFO : Epoch 1823 | loss: 0.0311621 | val_loss: 0.0311734 | Time: 3672.06 ms
[2021-07-15 00:47:17 main:574] : INFO : Epoch 1824 | loss: 0.03116 | val_loss: 0.0311757 | Time: 3652.8 ms
[2021-07-15 00:47:20 main:574] : INFO : Epoch 1825 | loss: 0.0311597 | val_loss: 0.031176 | Time: 3829.5 ms
[2021-07-15 00:47:24 main:574] : INFO : Epoch 1826 | loss: 0.0311666 | val_loss: 0.0311751 | Time: 3838.84 ms
[2021-07-15 00:47:29 main:574] : INFO : Epoch 1827 | loss: 0.0311612 | val_loss: 0.0311776 | Time: 4364.63 ms
[2021-07-15 00:47:33 main:574] : INFO : Epoch 1828 | loss: 0.0311615 | val_loss: 0.0311776 | Time: 3881.58 ms
[2021-07-15 00:47:36 main:574] : INFO : Epoch 1829 | loss: 0.0311628 | val_loss: 0.0311719 | Time: 3931.85 ms
[2021-07-15 00:47:40 main:574] : INFO : Epoch 1830 | loss: 0.03116 | val_loss: 0.0311752 | Time: 3864.11 ms
[2021-07-15 00:47:44 main:574] : INFO : Epoch 1831 | loss: 0.0311598 | val_loss: 0.031175 | Time: 3654.92 ms
[2021-07-15 00:47:48 main:574] : INFO : Epoch 1832 | loss: 0.031159 | val_loss: 0.031172 | Time: 4140.04 ms
[2021-07-15 00:47:53 main:574] : INFO : Epoch 1833 | loss: 0.0311616 | val_loss: 0.0311745 | Time: 4287.83 ms
[2021-07-15 00:47:57 main:574] : INFO : Epoch 1834 | loss: 0.0311603 | val_loss: 0.0311751 | Time: 4207.25 ms
[2021-07-15 00:48:00 main:574] : INFO : Epoch 1835 | loss: 0.0311589 | val_loss: 0.0311744 | Time: 3724.44 ms
[2021-07-15 00:48:04 main:574] : INFO : Epoch 1836 | loss: 0.0311587 | val_loss: 0.031173 | Time: 3818.18 ms
[2021-07-15 00:48:08 main:574] : INFO : Epoch 1837 | loss: 0.0311592 | val_loss: 0.0311744 | Time: 4089.91 ms
[2021-07-15 00:48:12 main:574] : INFO : Epoch 1838 | loss: 0.0311617 | val_loss: 0.0311853 | Time: 3677.85 ms
[2021-07-15 00:48:16 main:574] : INFO : Epoch 1839 | loss: 0.0311618 | val_loss: 0.0311782 | Time: 3657.61 ms
[2021-07-15 00:48:20 main:574] : INFO : Epoch 1840 | loss: 0.0311619 | val_loss: 0.0311768 | Time: 3848.27 ms
[2021-07-15 00:48:23 main:574] : INFO : Epoch 1841 | loss: 0.031159 | val_loss: 0.0311768 | Time: 3768.51 ms
[2021-07-15 00:48:28 main:574] : INFO : Epoch 1842 | loss: 0.0311602 | val_loss: 0.0311778 | Time: 4189.35 ms
[2021-07-15 00:48:32 main:574] : INFO : Epoch 1843 | loss: 0.0311589 | val_loss: 0.031176 | Time: 3877.89 ms
[2021-07-15 00:48:35 main:574] : INFO : Epoch 1844 | loss: 0.0311589 | val_loss: 0.0311773 | Time: 3670.66 ms
[2021-07-15 00:48:39 main:574] : INFO : Epoch 1845 | loss: 0.0311587 | val_loss: 0.0311776 | Time: 3699.63 ms
[2021-07-15 00:48:43 main:574] : INFO : Epoch 1846 | loss: 0.0311588 | val_loss: 0.0311736 | Time: 3742.79 ms
[2021-07-15 00:48:46 main:574] : INFO : Epoch 1847 | loss: 0.0311607 | val_loss: 0.0311773 | Time: 3676.39 ms
[2021-07-15 00:48:51 main:574] : INFO : Epoch 1848 | loss: 0.0311588 | val_loss: 0.0311743 | Time: 4165.88 ms
[2021-07-15 00:48:55 main:574] : INFO : Epoch 1849 | loss: 0.0311574 | val_loss: 0.0311769 | Time: 3851.3 ms
[2021-07-15 00:48:58 main:574] : INFO : Epoch 1850 | loss: 0.0311574 | val_loss: 0.0311754 | Time: 3818.12 ms
[2021-07-15 00:49:02 main:574] : INFO : Epoch 1851 | loss: 0.0311572 | val_loss: 0.0311782 | Time: 3956.91 ms
[2021-07-15 00:49:06 main:574] : INFO : Epoch 1852 | loss: 0.0312653 | val_loss: 0.0317593 | Time: 3906.29 ms
[2021-07-15 00:49:10 main:574] : INFO : Epoch 1853 | loss: 0.0431582 | val_loss: 0.0515382 | Time: 3863.91 ms
[2021-07-15 00:49:14 main:574] : INFO : Epoch 1854 | loss: 0.0374719 | val_loss: 0.0347818 | Time: 3681.42 ms
[2021-07-15 00:49:18 main:574] : INFO : Epoch 1855 | loss: 0.0323433 | val_loss: 0.0316613 | Time: 3964.82 ms
[2021-07-15 00:49:22 main:574] : INFO : Epoch 1856 | loss: 0.031416 | val_loss: 0.0312629 | Time: 4273.58 ms
[2021-07-15 00:49:26 main:574] : INFO : Epoch 1857 | loss: 0.0312672 | val_loss: 0.0312469 | Time: 3711.7 ms
[2021-07-15 00:49:30 main:574] : INFO : Epoch 1858 | loss: 0.0312436 | val_loss: 0.031237 | Time: 3825.09 ms
[2021-07-15 00:49:34 main:574] : INFO : Epoch 1859 | loss: 0.031232 | val_loss: 0.031226 | Time: 3915.69 ms
[2021-07-15 00:49:38 main:574] : INFO : Epoch 1860 | loss: 0.0312198 | val_loss: 0.031213 | Time: 4023.56 ms
[2021-07-15 00:49:42 main:574] : INFO : Epoch 1861 | loss: 0.0312053 | val_loss: 0.0312012 | Time: 4042.52 ms
[2021-07-15 00:49:46 main:574] : INFO : Epoch 1862 | loss: 0.0311954 | val_loss: 0.0311942 | Time: 4094.14 ms
[2021-07-15 00:49:50 main:574] : INFO : Epoch 1863 | loss: 0.0311891 | val_loss: 0.0311889 | Time: 3941.92 ms
[2021-07-15 00:49:54 main:574] : INFO : Epoch 1864 | loss: 0.0311844 | val_loss: 0.0311853 | Time: 3938.29 ms
[2021-07-15 00:49:58 main:574] : INFO : Epoch 1865 | loss: 0.031181 | val_loss: 0.0311828 | Time: 3871.06 ms
[2021-07-15 00:50:02 main:574] : INFO : Epoch 1866 | loss: 0.0311782 | val_loss: 0.0311812 | Time: 4223.01 ms
[2021-07-15 00:50:06 main:574] : INFO : Epoch 1867 | loss: 0.0311767 | val_loss: 0.0311803 | Time: 3902.34 ms
[2021-07-15 00:50:10 main:574] : INFO : Epoch 1868 | loss: 0.0311755 | val_loss: 0.0311803 | Time: 4124.24 ms
[2021-07-15 00:50:14 main:574] : INFO : Epoch 1869 | loss: 0.0311748 | val_loss: 0.0311801 | Time: 4055.15 ms
[2021-07-15 00:50:18 main:574] : INFO : Epoch 1870 | loss: 0.0311738 | val_loss: 0.031179 | Time: 4224.63 ms
[2021-07-15 00:50:22 main:574] : INFO : Epoch 1871 | loss: 0.0311721 | val_loss: 0.0311788 | Time: 3912.9 ms
[2021-07-15 00:50:26 main:574] : INFO : Epoch 1872 | loss: 0.0311717 | val_loss: 0.0311787 | Time: 3790.72 ms
[2021-07-15 00:50:30 main:574] : INFO : Epoch 1873 | loss: 0.0311708 | val_loss: 0.0311772 | Time: 3651.36 ms
[2021-07-15 00:50:34 main:574] : INFO : Epoch 1874 | loss: 0.0311701 | val_loss: 0.0311777 | Time: 3972.23 ms
[2021-07-15 00:50:38 main:574] : INFO : Epoch 1875 | loss: 0.0311696 | val_loss: 0.0311773 | Time: 4136.63 ms
[2021-07-15 00:50:42 main:574] : INFO : Epoch 1876 | loss: 0.0311694 | val_loss: 0.0311777 | Time: 4126.37 ms
[2021-07-15 00:50:46 main:574] : INFO : Epoch 1877 | loss: 0.0311697 | val_loss: 0.0311774 | Time: 3819.93 ms
[2021-07-15 00:50:50 main:574] : INFO : Epoch 1878 | loss: 0.0311688 | val_loss: 0.0311778 | Time: 4302.89 ms
[2021-07-15 00:50:54 main:574] : INFO : Epoch 1879 | loss: 0.0311691 | val_loss: 0.0311774 | Time: 3782.34 ms
[2021-07-15 00:50:58 main:574] : INFO : Epoch 1880 | loss: 0.0311682 | val_loss: 0.0311765 | Time: 3683.92 ms
[2021-07-15 00:51:02 main:574] : INFO : Epoch 1881 | loss: 0.0311675 | val_loss: 0.0311769 | Time: 3727.41 ms
[2021-07-15 00:51:05 main:574] : INFO : Epoch 1882 | loss: 0.0311677 | val_loss: 0.0311762 | Time: 3711.71 ms
[2021-07-15 00:51:09 main:574] : INFO : Epoch 1883 | loss: 0.0311676 | val_loss: 0.0311778 | Time: 3760.64 ms
[2021-07-15 00:51:13 main:574] : INFO : Epoch 1884 | loss: 0.0311688 | val_loss: 0.0311766 | Time: 3640.8 ms
[2021-07-15 00:51:16 main:574] : INFO : Epoch 1885 | loss: 0.0311674 | val_loss: 0.031178 | Time: 3633.79 ms
[2021-07-15 00:51:20 main:574] : INFO : Epoch 1886 | loss: 0.0311672 | val_loss: 0.0311769 | Time: 3601.07 ms
[2021-07-15 00:51:24 main:574] : INFO : Epoch 1887 | loss: 0.031167 | val_loss: 0.0311763 | Time: 3633.05 ms
[2021-07-15 00:51:27 main:574] : INFO : Epoch 1888 | loss: 0.0311663 | val_loss: 0.0311769 | Time: 3703.94 ms
[2021-07-15 00:51:31 main:574] : INFO : Epoch 1889 | loss: 0.0311662 | val_loss: 0.0311765 | Time: 3686.04 ms
[2021-07-15 00:51:35 main:574] : INFO : Epoch 1890 | loss: 0.0311666 | val_loss: 0.0311772 | Time: 3635.01 ms
[2021-07-15 00:51:39 main:574] : INFO : Epoch 1891 | loss: 0.0311661 | val_loss: 0.0311768 | Time: 3750.2 ms
[2021-07-15 00:51:42 main:574] : INFO : Epoch 1892 | loss: 0.0311663 | val_loss: 0.0311772 | Time: 3693.53 ms
[2021-07-15 00:51:46 main:574] : INFO : Epoch 1893 | loss: 0.0311668 | val_loss: 0.0311766 | Time: 3662.46 ms
[2021-07-15 00:51:50 main:574] : INFO : Epoch 1894 | loss: 0.0311663 | val_loss: 0.0311787 | Time: 3762.21 ms
[2021-07-15 00:51:54 main:574] : INFO : Epoch 1895 | loss: 0.0311658 | val_loss: 0.0311766 | Time: 3946.92 ms
[2021-07-15 00:51:58 main:574] : INFO : Epoch 1896 | loss: 0.0311655 | val_loss: 0.0311782 | Time: 3992.14 ms
[2021-07-15 00:52:01 main:574] : INFO : Epoch 1897 | loss: 0.0311658 | val_loss: 0.0311773 | Time: 3631.74 ms
[2021-07-15 00:52:05 main:574] : INFO : Epoch 1898 | loss: 0.0311661 | val_loss: 0.0311758 | Time: 3693.93 ms
[2021-07-15 00:52:09 main:574] : INFO : Epoch 1899 | loss: 0.0311656 | val_loss: 0.0311753 | Time: 3635.63 ms
[2021-07-15 00:52:12 main:574] : INFO : Epoch 1900 | loss: 0.0311657 | val_loss: 0.0311759 | Time: 3762.05 ms
[2021-07-15 00:52:17 main:574] : INFO : Epoch 1901 | loss: 0.0311652 | val_loss: 0.0311766 | Time: 3979.46 ms
[2021-07-15 00:52:21 main:574] : INFO : Epoch 1902 | loss: 0.0311647 | val_loss: 0.0311751 | Time: 4360.14 ms
[2021-07-15 00:52:25 main:574] : INFO : Epoch 1903 | loss: 0.0311645 | val_loss: 0.0311774 | Time: 3802.77 ms
[2021-07-15 00:52:28 main:574] : INFO : Epoch 1904 | loss: 0.0311654 | val_loss: 0.0311768 | Time: 3653.11 ms
[2021-07-15 00:52:32 main:574] : INFO : Epoch 1905 | loss: 0.0311644 | val_loss: 0.0311763 | Time: 3803.15 ms
THCudaCheck FAIL file=..\..\aten\src\THC\THCCachingHostAllocator.cpp line=278 error=719 : unspecified launch failure
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFC426E4ED9
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 07/15/21 00:52:34
Install Directory : C:\Program Files\BOINC\
Data Directory : C:\ProgramData\BOINC
Project Symstore :
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\1;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 000000002d3b0000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000044970000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1110) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 0000000044690000 00000000000bd000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 00000000426b0000 00000000002c9000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1110) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 0000000042bd0000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 0000000042230000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1110) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.1110 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1110
ModLoad: 0000000042ea0000 000000000002a000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.746) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.746 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.746
ModLoad: 00000000422f0000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1110) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.1110 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1110
ModLoad: 0000000042610000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 0000000042100000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 0000000043bc0000 00000000000ac000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1052) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 0000000042ac0000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.19041.546
ModLoad: 00000000436c0000 000000000009b000 C:\WINDOWS\System32\sechost.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.320
ModLoad: 0000000043d00000 000000000012a000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1081) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 00000000c49e0000 000000000abe7000 C:\ProgramData\BOINC\slots\1\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000cf5d0000 0000000024b49000 C:\ProgramData\BOINC\slots\1\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000003b8c0000 0000000000058000 C:\ProgramData\BOINC\slots\1\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000fc410000 00000000002db000 C:\ProgramData\BOINC\slots\1\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000003a4c0000 0000000000019000 C:\ProgramData\BOINC\slots\1\VCRUNTIME140.dll (14.27.29112.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.27.29112.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.27.29112.0
ModLoad: 00000000308b0000 0000000000091000 C:\ProgramData\BOINC\slots\1\MSVCP140.dll (14.27.29112.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.27.29112.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.27.29112.0
ModLoad: 00000000225b0000 000000000020d000 C:\ProgramData\BOINC\slots\1\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 000000002e480000 0000000000045000 C:\ProgramData\BOINC\slots\1\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000003dcf0000 000000000000c000 C:\ProgramData\BOINC\slots\1\VCRUNTIME140_1.dll (14.27.29112.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.27.29112.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.27.29112.0
ModLoad: 00000000c1520000 00000000034b2000 C:\ProgramData\BOINC\slots\1\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 000000003c9c0000 0000000000010000 C:\ProgramData\BOINC\slots\1\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 00000000f9360000 00000000030a5000 C:\ProgramData\BOINC\slots\1\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 000000006fc60000 000000001b3a4000 C:\ProgramData\BOINC\slots\1\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 000000003b2b0000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.867 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.867
ModLoad: 000000002e440000 0000000000040000 C:\ProgramData\BOINC\slots\1\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000bd7c0000 0000000003d5b000 C:\ProgramData\BOINC\slots\1\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000b4620000 000000000919f000 C:\ProgramData\BOINC\slots\1\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 00000000b2750000 0000000001eca000 C:\ProgramData\BOINC\slots\1\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 0000000043b90000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000003ffe0000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000043e30000 0000000000469000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.844) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 00000000420b0000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000042200000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 0000000041e60000 000000000002c000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000042980000 0000000000060000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1110) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.1110 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1110
ModLoad: 00000000424b0000 000000000015f000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.844) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 0000000041ca0000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000042f80000 000000000073f000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 00000000401e0000 0000000000791000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1081) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 0000000043760000 0000000000355000 C:\WINDOWS\System32\combase.dll (6.2.19041.1081) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 0000000041b20000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 0000000042ed0000 00000000000ae000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 00000000447b0000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 00000000f89b0000 0000000000267000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.5730) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 27.21.14.5730
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.1.114 driver
Product Version : 27.21.14.5730
ModLoad: 000000003cee0000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000a5050000 000000000152c000 C:\WINDOWS\system32\DriverStore\FileRepository\nvhqi.inf_amd64_6e271d4dca2c455f\nvcuda64.dll (27.21.14.5730) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 27.21.14.5730
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.1.114 driver
Product Version : 27.21.14.5730
ModLoad: 00000000448c0000 000000000006b000 C:\WINDOWS\System32\WS2_32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : ws2_32.pdb
File Version : 10.0.19041.1081 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1081
ModLoad: 000000003bd90000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.906 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.906
ModLoad: 0000000041a80000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000003fb20000 000000000009e000 C:\WINDOWS\system32\uxtheme.dll (6.2.19041.1081) (-exported- Symbols Loaded)
Linked PDB Filename : UxTheme.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 000000001a790000 00000000006d6000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.5730) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 27.21.14.5730
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 27.21.14.5730
ModLoad: 0000000042d70000 000000000012a000 C:\WINDOWS\System32\OLE32.DLL (6.2.19041.746) (-exported- Symbols Loaded)
Linked PDB Filename : ole32.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 000000003b8b0000 0000000000009000 C:\ProgramData\BOINC\slots\1\caffe2_nvrtc.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000b1780000 0000000000fca000 C:\ProgramData\BOINC\slots\1\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6.14.11.9000
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.89 NVRTC Library
Product Version : 6.14.11.9000
ModLoad: 0000000042260000 0000000000083000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.1023 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1023
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 5532, Write: 7511, Other 29899
- I/O Transfers Counters -
Read: 6862311, Write: 2459746, Other 306538
- Paged Pool Usage -
QuotaPagedPoolUsage: 3505160, QuotaPeakPagedPoolUsage: 3505960
QuotaNonPagedPoolUsage: 51808, QuotaPeakNonPagedPoolUsage: 52344
- Virtual Memory Usage -
VirtualSize: -432762880, PeakVirtualSize: 180924416
- Pagefile Usage -
PagefileUsage: -432762880, PeakPagefileUsage: -432762880
- Working Set Size -
WorkingSetSize: 263823360, PeakWorkingSetSize: 1758666752, PageFaultCount: 633768
*** Dump of thread ID 8528 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 17424375808.000000, User Time: 31113125888.000000, Wait Time: 2691930.000000
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFC426E4ED9
- Registers -
rax=0000000000000000 rbx=00000000cee562f0 rcx=0000000000000000 rdx=0000000000000000 rsi=000000008c4e41f0 rdi=0000000019930520
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000000006000 r13=0000000000000000
r14=000000008c4e4f30 r15=000000008c4e4eb0 rip=00000000426e4ed9 rsp=000000008c4e4090 rbp=000000008c4e4a98
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000206
- Callstack -
ChildEBP RetAddr Args to Child
8c4e4160 3a4c6220 00bbee89 00000000 8c4e4f30 c9faa014 KERNELBASE!RaiseException+0x0
8c4e41c0 ca5a5272 00bbeee9 00000000 000007cb 00000116 VCRUNTIME140!_CxxThrowException+0x0
8c4e4210 ca5a56d4 00000000 00000000 cd5cd290 d2e35f68 torch_cpu!at::Tensor::zero_+0x0
8c4e4a70 d23f9ebe 8c4e4ca0 d2e36850 d2e36880 000002cf torch_cpu!_THError+0x0
8c4e4ab0 d23f5412 8c4e4ca0 8c4e4c00 6a2d6e50 d326a720 torch_cuda!__THCudaCheck+0x0
8c4e4af0 ca2559ff 8c4e4e00 8c4e4ca0 8c4e5170 3b8f97b0 torch_cuda!at::native::set_storage_cuda_+0x0
8c4e4e80 ca3f726f d2a6f630 c9faea63 00000001 3b8def8f torch_cpu!at::native::empty_cpu+0x0
8c4e4ec0 ca3b0615 8c4e0000 8c4e4f38 8c4e5130 3b8c7ce6 torch_cpu!at::native::mkldnn_sigmoid_+0x0
8c4e4f00 ca3b204a 8c4e0000 8c4e4f00 6a2bb100 d1736ae5 torch_cpu!at::native::mkldnn_sigmoid_+0x0
8c4e4f90 ca3b0615 00000000 c9faea63 8c4e5070 8c4e5170 torch_cpu!at::native::mkldnn_sigmoid_+0x0
8c4e4fd0 ca481eb0 8c4e0000 00000000 8c4e5158 00000001 torch_cpu!at::native::mkldnn_sigmoid_+0x0
8c4e5070 ca492eec d6cfdc24 3b8f9c50 8c4e51d0 3b8c3bd6 torch_cpu!at::bucketize_out+0x0
8c4e50c0 d1aff160 8c4e0000 00000000 8c4e51d0 00000000 torch_cpu!at::empty+0x0
8c4e5460 d1b02de8 3b8f9c50 c9fb0528 6b1a9c90 3b8f9c50 torch_cuda!at::native::cummin_helper_cuda+0x0
8c4e5640 d1b04379 8c4e5750 9e9cb750 8c4e5b50 9e9cb768 torch_cuda!at::native::cummin_helper_cuda+0x0
8c4e5880 d1b03d64 8c4e0000 8c4e5b50 8c4e5990 8c4e5b50 torch_cuda!at::native::cat_out_cuda+0x0
8c4e5a80 d23a1dd2 8c4e5ad8 00000001 8c4e5ad8 8c4e5b50 torch_cuda!at::native::cat_cuda+0x0
8c4e5b00 d23b4179 00000001 8c4e5b40 6b1a8838 04000000 torch_cuda!at::native::set_storage_cuda_+0x0
8c4e5b40 ca481d7d 8bb91ab0 8c4e5eb0 8c4e5e80 00000000 torch_cuda!at::native::set_storage_cuda_+0x0
8c4e5bc0 ca460d81 00000000 3b8e3994 8c4e6390 9e9caa50 torch_cpu!at::bucketize_out+0x0
8c4e5c00 ca26b4a5 8c4e5c40 6b1a9890 8c4e5d10 8c4e5d80 torch_cpu!at::_cat+0x0
8c4e5cd0 ca5527bd 8c4e5da0 00000101 8c4e5d28 3b911ea8 torch_cpu!at::native::cat+0x0
8c4e5d50 ca0129ae 9e9cb3d0 9e9cb3e0 9e9cb3e8 8c4e5d08 torch_cpu!at::zeros_out+0x0
8c4e5d90 ca481d7d 8c4e5dd0 8c4e5e40 00000000 449947b1 torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0
8c4e5e10 ca4875d1 8c4e63b0 cf300640 8c4e6390 9e9caa50 torch_cpu!at::bucketize_out+0x0
8c4e5e50 ca277d4c 8c4e60e0 00000000 8c4e60e0 00000000 torch_cpu!at::cat+0x0
8c4e6010 ca56c38d 8c4e6068 00000001 8c4e6068 8c4e60e0 torch_cpu!at::native::stack+0x0
8c4e6090 ca0129ae 8c4e6390 9e9caa50 00000000 00000000 torch_cpu!at::zeros_out+0x0
8c4e60d0 ca481d7d 8c4e6110 8c4e6180 00000000 cd221c8f torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0
8c4e6150 ca4d02e1 8c4e6280 3b8e3720 8c4e63b0 cf300640 torch_cpu!at::bucketize_out+0x0
8c4e6190 cb863839 8c4e6210 6b1a6fe0 6b1a6fe0 8c4e62a0 torch_cpu!at::stack+0x0
8c4e6360 ca0129ae 00000000 8c4e64b0 00000000 8c4e6450 torch_cpu!torch::autograd::GraphRoot::apply+0x0
8c4e63a0 ca481d7d 8c4e63e0 8c4e6450 6b1ab4f0 00000000 torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0
8c4e6420 ca4d02e1 8c4e6590 c9fa9cac 9d1c0c80 9e9caa50 torch_cpu!at::bucketize_out+0x0
8c4e6460 2d3bff7e 8c4e6528 8c08ab70 8c08ab70 8c4e6670 torch_cpu!at::stack+0x0
8c4e6500 2d3c2ef8 2d3bfe30 8c4e6540 8c4e6540 8c4e6590 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::addCallback+0x0
8c4e6560 2d3c3ea4 29527250 449947b1 8c4e6700 69970000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Object::getSlot+0x0
8c4e66a0 2d3bd3d2 9d8848a0 a0e22010 8c4e6700 44995ba1 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::markCompleted+0x0
8c4e66d0 2d3c4541 00000000 a0e27390 859f73d0 44995ba1 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Object::operator=+0x0
8c4e6880 2d3c743a 8c4e6950 00000000 8c4e7390 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::markCompleted+0x0
8c4e6d80 2d3cb950 8c4e6e80 8c4e6e80 00000000 42514a90 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0
8c4ffb20 2d60c6f8 6b21e5a0 00000000 00000000 6b31abd0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
8c4ffb60 446a7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
8c4ffb90 449c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
8c4ffc10 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 7988 (state: Waiting): ***
- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 312500.000000, Wait Time: 2691929.000000
- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=000000008c9ffe70 rsi=0000000000000000 rdi=0000000000000064
r8=000000008c9ffe48 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000044a0d4a4 rsp=000000008c9ffe48 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
8c9ffe40 426f95be 8c9fff08 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0
8c9ffee0 2d3ea07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0
8c9fff10 446a7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
8c9fff40 449c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
8c9fffc0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 10156 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 156250.000000, User Time: 312500.000000, Wait Time: 2691929.000000
- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=000000008caff640 rsi=0000000000000000 rdi=000000000000000d
r8=000000006bedc230 r9=0000000000000000 r10=0000000000000000 r11=000000008caff5b0 r12=0000000000000064 r13=000000008caff640
r14=000000008caff340 r15=0000000000000000 rip=0000000044a0d974 rsp=000000008caff2e8 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
8caff2e0 426fcab0 00000000 8c3a4000 44ada4d0 8c3a4000 ntdll!ZwWaitForMultipleObjects+0x0
8caff5d0 426fc9ae 69980f80 004e0049 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
8caff610 a51fbb54 6b433fd0 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0
8caff850 a52909ed 00000000 00000004 00000000 00000000 nvcuda64!+0x0
8caff900 a51fb523 ef15a591 eea557ca 6b93adc0 00000000 nvcuda64!cuProfilerStop+0x0
8caff930 a550a750 6b93adc0 00000000 00000000 00000000 nvcuda64!+0x0
8caff960 446a7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
8caff990 449c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
8caffa10 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 5280 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 2691929.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002b0 rdx=0000000000000000 rsi=000000008cbffba8 rdi=00000000000002b0
r8=0000000000000300 r9=0000000000000000 r10=0000000000000000 r11=000000006b8ba674 r12=000000006b416120 r13=0000000000000000
r14=00000000000002b0 r15=0000000000000001 rip=0000000044a0cea4 rsp=000000008cbffb78 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
8cbffb70 426d19ce 00000000 00000000 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0
8cbffc10 a540c0e7 00000000 426da305 00000000 000002b0 KERNELBASE!WaitForSingleObjectEx+0x0
8cbffc80 a51fb523 00000001 6bf083b0 6b93a880 00000000 nvcuda64!cuProfilerStop+0x0
8cbffcb0 a550a750 6b93a880 00000000 00000000 00000000 nvcuda64!+0x0
8cbffce0 446a7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
8cbffd10 449c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
8cbffd90 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 8180 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 2691930.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=000000006b501d38 rdx=000000008ccff948 rsi=000000008ccff8b0 rdi=0000000000000000
r8=000000008ccff888 r9=000000008ccff8e0 r10=0000000000000000 r11=0000000000000246 r12=000000008ccff948 r13=0000000000000000
r14=000000006b501d38 r15=000000006b506cd8 rip=0000000044a10814 rsp=000000008ccff888 rbp=000000008ccff8e0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
8ccff880 449d4295 00000102 a52c965d 00000000 8ccff8b0 ntdll!NtWaitForAlertByThreadId+0x0
8ccff8f0 4271cd79 6b5044c0 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0
8ccff920 a518223a 6b5044c0 6b5044c0 6b5044c0 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0
8ccff980 a51fb523 00000002 eef445f4 00000000 00000000 nvcuda64!+0x0
8ccff9b0 a550a750 6b93ab80 00000000 00000000 00000000 nvcuda64!+0x0
8ccff9e0 446a7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
8ccffa10 449c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
8ccffa90 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 5296 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 1142656256.000000, User Time: 22175780864.000000, Wait Time: 2691927.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=0000000065eaeb98 rdx=0000000000000000 rsi=0000000000000000 rdi=0000000065eaeb98
r8=0000000000000020 r9=0000000000000004 r10=0000000000000006 r11=000000008cdf9830 r12=0000000000000000 r13=0000000000000000
r14=000000008cdff560 r15=0000000065eaeb48 rip=0000000044a10814 rsp=000000008cdff538 rbp=000000008cdff590
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
8cdff530 449d4021 8c055418 8c055418 8cdff670 8c055418 ntdll!NtWaitForAlertByThreadId+0x0
8cdff5b0 4271ce29 65eaeb40 65eaeb88 00000000 00000000 ntdll!RtlSleepConditionVariableSRW+0x0
8cdff5f0 308eba8d 8bbe5550 8bbe5550 8bbe5550 00000000 KERNELBASE!SleepConditionVariableSRW+0x0
8cdff630 308c2848 9beacc20 00000000 00000000 cbbc05b4 MSVCP140!__crtSetThreadpoolWait+0x0
8cdff660 308c2710 00000000 308c2f17 00000000 9beacc20 MSVCP140!std::_Winerror_message+0x0
8cdff6d0 cbbc064b 9beacc00 000001c0 65eaeb40 65eaeb40 MSVCP140!std::_Winerror_message+0x0
8cdff710 cbbc25b1 a0a90830 ffffffff 9beacc00 ffffffff torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
8cdffa00 cbbc2471 cf0e6d10 8cdffa40 cf0e6d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0
8cdffa50 cbbb9744 00080001 9e315100 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0
8cdffa80 42121bb2 9e315100 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0
8cdffab0 446a7034 00000000 00000000 00000000 00000000 ucrtbase!_configthreadlocale+0x0
8cdffae0 449c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
8cdffb60 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)