Task 10957936
| Name | ParityModified-1639963741-7733-2-0_0 |
| Workunit | 8250815 |
| Created | 22 Jan 2022, 18:31:32 UTC |
| Sent | 7 Feb 2022, 19:12:10 UTC |
| Report deadline | 15 Feb 2022, 19:12:10 UTC |
| Received | 8 Feb 2022, 1:14:08 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | -529697949 (0xE06D7363) Unknown error code |
| Computer ID | 28641 |
| Run time | 1 hours 13 min 50 sec |
| CPU time | 1 hours 12 min 23 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 4,458.42 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 2.10 GB |
| Peak swap size | 4.33 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
3 | val_loss: 0.0312525 | Time: 2066.79 ms
[2022-02-07 17:05:01 main:574] : INFO : Epoch 1642 | loss: 0.0312513 | val_loss: 0.03125 | Time: 2162.14 ms
[2022-02-07 17:05:03 main:574] : INFO : Epoch 1643 | loss: 0.0312502 | val_loss: 0.0312502 | Time: 2234.22 ms
[2022-02-07 17:05:05 main:574] : INFO : Epoch 1644 | loss: 0.0312504 | val_loss: 0.0312501 | Time: 2076.27 ms
[2022-02-07 17:05:07 main:574] : INFO : Epoch 1645 | loss: 0.0312501 | val_loss: 0.0312498 | Time: 2073.48 ms
[2022-02-07 17:05:09 main:574] : INFO : Epoch 1646 | loss: 0.0312501 | val_loss: 0.03125 | Time: 2138.57 ms
[2022-02-07 17:05:11 main:574] : INFO : Epoch 1647 | loss: 0.0312498 | val_loss: 0.0312507 | Time: 2236.86 ms
[2022-02-07 17:05:13 main:574] : INFO : Epoch 1648 | loss: 0.0312503 | val_loss: 0.0312497 | Time: 2088.02 ms
[2022-02-07 17:05:16 main:574] : INFO : Epoch 1649 | loss: 0.0312502 | val_loss: 0.0312497 | Time: 2184.15 ms
[2022-02-07 17:05:18 main:574] : INFO : Epoch 1650 | loss: 0.03125 | val_loss: 0.0312501 | Time: 2201.2 ms
[2022-02-07 17:05:20 main:574] : INFO : Epoch 1651 | loss: 0.0312503 | val_loss: 0.0312498 | Time: 2166.44 ms
[2022-02-07 17:05:22 main:574] : INFO : Epoch 1652 | loss: 0.0312504 | val_loss: 0.0312497 | Time: 2176.73 ms
[2022-02-07 17:05:24 main:574] : INFO : Epoch 1653 | loss: 0.03125 | val_loss: 0.0312499 | Time: 2190.35 ms
[2022-02-07 17:05:26 main:574] : INFO : Epoch 1654 | loss: 0.0312502 | val_loss: 0.031251 | Time: 2057.27 ms
[2022-02-07 17:05:29 main:574] : INFO : Epoch 1655 | loss: 0.0312507 | val_loss: 0.0312499 | Time: 2200.34 ms
[2022-02-07 17:05:31 main:574] : INFO : Epoch 1656 | loss: 0.0312502 | val_loss: 0.0312497 | Time: 2190.95 ms
[2022-02-07 17:05:33 main:574] : INFO : Epoch 1657 | loss: 0.0312501 | val_loss: 0.0312505 | Time: 2184.84 ms
[2022-02-07 17:05:35 main:574] : INFO : Epoch 1658 | loss: 0.0312513 | val_loss: 0.0312513 | Time: 2233.35 ms
[2022-02-07 17:05:37 main:574] : INFO : Epoch 1659 | loss: 0.0312502 | val_loss: 0.0312497 | Time: 2130.21 ms
[2022-02-07 17:05:40 main:574] : INFO : Epoch 1660 | loss: 0.0312498 | val_loss: 0.0312498 | Time: 2142.58 ms
[2022-02-07 17:05:42 main:574] : INFO : Epoch 1661 | loss: 0.0312499 | val_loss: 0.0312503 | Time: 2169.78 ms
[2022-02-07 17:05:44 main:574] : INFO : Epoch 1662 | loss: 0.0312501 | val_loss: 0.0312497 | Time: 2235.75 ms
[2022-02-07 17:05:46 main:574] : INFO : Epoch 1663 | loss: 0.0312497 | val_loss: 0.0312495 | Time: 2209.08 ms
[2022-02-07 17:05:48 main:574] : INFO : Epoch 1664 | loss: 0.0312501 | val_loss: 0.0312504 | Time: 2212.56 ms
[2022-02-07 17:05:51 main:574] : INFO : Epoch 1665 | loss: 0.03125 | val_loss: 0.0312496 | Time: 2185.92 ms
[2022-02-07 17:05:53 main:574] : INFO : Epoch 1666 | loss: 0.0312498 | val_loss: 0.0312497 | Time: 2181.8 ms
[2022-02-07 17:05:55 main:574] : INFO : Epoch 1667 | loss: 0.0312506 | val_loss: 0.0312523 | Time: 2198.14 ms
[2022-02-07 17:05:57 main:574] : INFO : Epoch 1668 | loss: 0.0312514 | val_loss: 0.0312496 | Time: 2089.85 ms
[2022-02-07 17:05:59 main:574] : INFO : Epoch 1669 | loss: 0.0312503 | val_loss: 0.0312497 | Time: 2222.03 ms
[2022-02-07 17:06:01 main:574] : INFO : Epoch 1670 | loss: 0.0312499 | val_loss: 0.0312501 | Time: 2178.26 ms
[2022-02-07 17:06:04 main:574] : INFO : Epoch 1671 | loss: 0.0312499 | val_loss: 0.0312504 | Time: 2238.62 ms
[2022-02-07 17:06:06 main:574] : INFO : Epoch 1672 | loss: 0.0312504 | val_loss: 0.0312507 | Time: 2122.93 ms
[2022-02-07 17:06:08 main:574] : INFO : Epoch 1673 | loss: 0.0312504 | val_loss: 0.0312499 | Time: 2208.06 ms
[2022-02-07 17:06:10 main:574] : INFO : Epoch 1674 | loss: 0.0312501 | val_loss: 0.0312498 | Time: 2165.09 ms
[2022-02-07 17:06:12 main:574] : INFO : Epoch 1675 | loss: 0.0312512 | val_loss: 0.0312527 | Time: 2129.91 ms
[2022-02-07 17:06:15 main:574] : INFO : Epoch 1676 | loss: 0.0312512 | val_loss: 0.0312498 | Time: 2138.78 ms
[2022-02-07 17:06:17 main:574] : INFO : Epoch 1677 | loss: 0.0312504 | val_loss: 0.0312506 | Time: 2200.81 ms
[2022-02-07 17:06:19 main:574] : INFO : Epoch 1678 | loss: 0.0312499 | val_loss: 0.0312498 | Time: 2233.27 ms
[2022-02-07 17:06:21 main:574] : INFO : Epoch 1679 | loss: 0.0312499 | val_loss: 0.0312498 | Time: 2111.27 ms
[2022-02-07 17:06:23 main:574] : INFO : Epoch 1680 | loss: 0.03125 | val_loss: 0.0312504 | Time: 2125.29 ms
[2022-02-07 17:06:25 main:574] : INFO : Epoch 1681 | loss: 0.0312499 | val_loss: 0.0312495 | Time: 2229.86 ms
[2022-02-07 17:06:28 main:574] : INFO : Epoch 1682 | loss: 0.0312502 | val_loss: 0.0312503 | Time: 2207.23 ms
[2022-02-07 17:06:30 main:574] : INFO : Epoch 1683 | loss: 0.0312501 | val_loss: 0.0312497 | Time: 2140.76 ms
[2022-02-07 17:06:32 main:574] : INFO : Epoch 1684 | loss: 0.0312498 | val_loss: 0.0312499 | Time: 2229.59 ms
[2022-02-07 17:06:34 main:574] : INFO : Epoch 1685 | loss: 0.0312499 | val_loss: 0.0312498 | Time: 2183.08 ms
[2022-02-07 17:06:36 main:574] : INFO : Epoch 1686 | loss: 0.0312498 | val_loss: 0.0312501 | Time: 2210.21 ms
[2022-02-07 17:06:39 main:574] : INFO : Epoch 1687 | loss: 0.0312501 | val_loss: 0.0312499 | Time: 2162.54 ms
[2022-02-07 17:06:41 main:574] : INFO : Epoch 1688 | loss: 0.0312501 | val_loss: 0.0312501 | Time: 2149.42 ms
[2022-02-07 17:06:43 main:574] : INFO : Epoch 1689 | loss: 0.0312498 | val_loss: 0.0312496 | Time: 2194.4 ms
[2022-02-07 17:06:45 main:574] : INFO : Epoch 1690 | loss: 0.0312499 | val_loss: 0.0312496 | Time: 2184.3 ms
[2022-02-07 17:06:47 main:574] : INFO : Epoch 1691 | loss: 0.0312498 | val_loss: 0.0312497 | Time: 2157.54 ms
[2022-02-07 17:06:49 main:574] : INFO : Epoch 1692 | loss: 0.0312497 | val_loss: 0.0312502 | Time: 2167.18 ms
[2022-02-07 17:06:52 main:574] : INFO : Epoch 1693 | loss: 0.0312499 | val_loss: 0.0312496 | Time: 2116.44 ms
[2022-02-07 17:06:54 main:574] : INFO : Epoch 1694 | loss: 0.0312496 | val_loss: 0.0312499 | Time: 2185.83 ms
[2022-02-07 17:06:56 main:574] : INFO : Epoch 1695 | loss: 0.0312501 | val_loss: 0.0312511 | Time: 2134.85 ms
[2022-02-07 17:06:58 main:574] : INFO : Epoch 1696 | loss: 0.0312504 | val_loss: 0.0312496 | Time: 2095.01 ms
[2022-02-07 17:07:00 main:574] : INFO : Epoch 1697 | loss: 0.0312499 | val_loss: 0.0312505 | Time: 2408.1 ms
[2022-02-07 17:07:03 main:574] : INFO : Epoch 1698 | loss: 0.0312505 | val_loss: 0.0312498 | Time: 2319.44 ms
[2022-02-07 17:07:05 main:574] : INFO : Epoch 1699 | loss: 0.0312498 | val_loss: 0.0312495 | Time: 2320.44 ms
[2022-02-07 17:07:07 main:574] : INFO : Epoch 1700 | loss: 0.0312503 | val_loss: 0.031251 | Time: 2247.16 ms
[2022-02-07 17:07:09 main:574] : INFO : Epoch 1701 | loss: 0.0312501 | val_loss: 0.0312502 | Time: 2150.8 ms
[2022-02-07 17:07:12 main:574] : INFO : Epoch 1702 | loss: 0.0312503 | val_loss: 0.0312504 | Time: 2166.19 ms
[2022-02-07 17:07:14 main:574] : INFO : Epoch 1703 | loss: 0.03125 | val_loss: 0.0312496 | Time: 2233.3 ms
[2022-02-07 17:07:16 main:574] : INFO : Epoch 1704 | loss: 0.03125 | val_loss: 0.0312511 | Time: 2140.4 ms
[2022-02-07 17:07:18 main:574] : INFO : Epoch 1705 | loss: 0.0312501 | val_loss: 0.0312503 | Time: 2125.89 ms
[2022-02-07 17:07:20 main:574] : INFO : Epoch 1706 | loss: 0.0312502 | val_loss: 0.0312498 | Time: 2135.24 ms
[2022-02-07 17:07:22 main:574] : INFO : Epoch 1707 | loss: 0.0312496 | val_loss: 0.0312497 | Time: 2144.72 ms
[2022-02-07 17:07:25 main:574] : INFO : Epoch 1708 | loss: 0.03125 | val_loss: 0.0312502 | Time: 2131.57 ms
[2022-02-07 17:07:27 main:574] : INFO : Epoch 1709 | loss: 0.03125 | val_loss: 0.0312497 | Time: 2163.93 ms
[2022-02-07 17:07:29 main:574] : INFO : Epoch 1710 | loss: 0.0312499 | val_loss: 0.0312496 | Time: 2152.81 ms
[2022-02-07 17:07:31 main:574] : INFO : Epoch 1711 | loss: 0.0312498 | val_loss: 0.0312502 | Time: 2167.65 ms
[2022-02-07 17:07:33 main:574] : INFO : Epoch 1712 | loss: 0.0312504 | val_loss: 0.0312497 | Time: 2170.8 ms
[2022-02-07 17:07:35 main:574] : INFO : Epoch 1713 | loss: 0.0312507 | val_loss: 0.0312505 | Time: 2147 ms
[2022-02-07 17:07:38 main:574] : INFO : Epoch 1714 | loss: 0.0312503 | val_loss: 0.0312502 | Time: 2158.15 ms
[2022-02-07 17:07:40 main:574] : INFO : Epoch 1715 | loss: 0.0312504 | val_loss: 0.0312499 | Time: 2242.45 ms
[2022-02-07 17:07:42 main:574] : INFO : Epoch 1716 | loss: 0.0312499 | val_loss: 0.0312504 | Time: 2133.12 ms
[2022-02-07 17:07:44 main:574] : INFO : Epoch 1717 | loss: 0.03125 | val_loss: 0.0312501 | Time: 2189.22 ms
[2022-02-07 17:07:46 main:574] : INFO : Epoch 1718 | loss: 0.0312501 | val_loss: 0.0312502 | Time: 2196.41 ms
[2022-02-07 17:07:49 main:574] : INFO : Epoch 1719 | loss: 0.0312503 | val_loss: 0.0312498 | Time: 2188.66 ms
[2022-02-07 17:07:51 main:574] : INFO : Epoch 1720 | loss: 0.0312499 | val_loss: 0.03125 | Time: 2219.4 ms
[2022-02-07 17:07:53 main:574] : INFO : Epoch 1721 | loss: 0.0312501 | val_loss: 0.0312497 | Time: 2207.2 ms
[2022-02-07 17:07:55 main:574] : INFO : Epoch 1722 | loss: 0.0312501 | val_loss: 0.0312497 | Time: 2155.12 ms
[2022-02-07 17:07:57 main:574] : INFO : Epoch 1723 | loss: 0.0312497 | val_loss: 0.0312499 | Time: 2146.35 ms
[2022-02-07 17:07:59 main:574] : INFO : Epoch 1724 | loss: 0.0312499 | val_loss: 0.0312498 | Time: 2071.34 ms
[2022-02-07 17:08:02 main:574] : INFO : Epoch 1725 | loss: 0.0312499 | val_loss: 0.0312503 | Time: 2222.14 ms
[2022-02-07 17:08:04 main:574] : INFO : Epoch 1726 | loss: 0.0312499 | val_loss: 0.0312496 | Time: 2206.75 ms
[2022-02-07 17:08:06 main:574] : INFO : Epoch 1727 | loss: 0.0312505 | val_loss: 0.0312514 | Time: 2141.25 ms
[2022-02-07 17:08:08 main:574] : INFO : Epoch 1728 | loss: 0.0312503 | val_loss: 0.0312513 | Time: 2190.8 ms
[2022-02-07 17:08:10 main:574] : INFO : Epoch 1729 | loss: 0.0312499 | val_loss: 0.0312496 | Time: 2127.49 ms
[2022-02-07 17:08:12 main:574] : INFO : Epoch 1730 | loss: 0.0312498 | val_loss: 0.0312497 | Time: 2148.53 ms
[2022-02-07 17:08:15 main:574] : INFO : Epoch 1731 | loss: 0.0312497 | val_loss: 0.0312495 | Time: 2301.18 ms
[2022-02-07 17:08:17 main:574] : INFO : Epoch 1732 | loss: 0.0312497 | val_loss: 0.0312496 | Time: 2230.01 ms
[2022-02-07 17:08:19 main:574] : INFO : Epoch 1733 | loss: 0.0312498 | val_loss: 0.0312499 | Time: 2257.03 ms
[2022-02-07 17:08:21 main:574] : INFO : Epoch 1734 | loss: 0.031251 | val_loss: 0.0312496 | Time: 2206.71 ms
[2022-02-07 17:08:24 main:574] : INFO : Epoch 1735 | loss: 0.0312519 | val_loss: 0.0312527 | Time: 2151.25 ms
[2022-02-07 17:08:26 main:574] : INFO : Epoch 1736 | loss: 0.0312507 | val_loss: 0.0312497 | Time: 2188.89 ms
[2022-02-07 17:08:28 main:574] : INFO : Epoch 1737 | loss: 0.0312499 | val_loss: 0.0312498 | Time: 2144.18 ms
[2022-02-07 17:08:30 main:574] : INFO : Epoch 1738 | loss: 0.0312497 | val_loss: 0.0312497 | Time: 2172.54 ms
[2022-02-07 17:08:32 main:574] : INFO : Epoch 1739 | loss: 0.0312501 | val_loss: 0.0312516 | Time: 2143.31 ms
[2022-02-07 17:08:35 main:574] : INFO : Epoch 1740 | loss: 0.0312505 | val_loss: 0.0312504 | Time: 2222.2 ms
[2022-02-07 17:08:37 main:574] : INFO : Epoch 1741 | loss: 0.0312503 | val_loss: 0.03125 | Time: 2175.01 ms
[2022-02-07 17:08:39 main:574] : INFO : Epoch 1742 | loss: 0.0312501 | val_loss: 0.0312498 | Time: 2215.38 ms
[2022-02-07 17:08:41 main:574] : INFO : Epoch 1743 | loss: 0.0312497 | val_loss: 0.0312495 | Time: 2140.99 ms
[2022-02-07 17:08:43 main:574] : INFO : Epoch 1744 | loss: 0.0312502 | val_loss: 0.0312503 | Time: 2230.96 ms
[2022-02-07 17:08:45 main:574] : INFO : Epoch 1745 | loss: 0.0312502 | val_loss: 0.0312511 | Time: 2194.67 ms
[2022-02-07 17:08:48 main:574] : INFO : Epoch 1746 | loss: 0.0312503 | val_loss: 0.0312496 | Time: 2181.07 ms
[2022-02-07 17:08:50 main:574] : INFO : Epoch 1747 | loss: 0.0312501 | val_loss: 0.0312497 | Time: 2077.36 ms
[2022-02-07 17:08:52 main:574] : INFO : Epoch 1748 | loss: 0.0312503 | val_loss: 0.0312497 | Time: 2154.77 ms
[2022-02-07 17:08:54 main:574] : INFO : Epoch 1749 | loss: 0.0312498 | val_loss: 0.0312496 | Time: 2107.77 ms
[2022-02-07 17:08:56 main:574] : INFO : Epoch 1750 | loss: 0.0312503 | val_loss: 0.0312495 | Time: 2185.02 ms
[2022-02-07 17:08:58 main:574] : INFO : Epoch 1751 | loss: 0.0312504 | val_loss: 0.0312511 | Time: 2213.19 ms
[2022-02-07 17:09:01 main:574] : INFO : Epoch 1752 | loss: 0.0312512 | val_loss: 0.031256 | Time: 2167.38 ms
[2022-02-07 17:09:03 main:574] : INFO : Epoch 1753 | loss: 0.0312528 | val_loss: 0.0312497 | Time: 2245.51 ms
[2022-02-07 17:09:05 main:574] : INFO : Epoch 1754 | loss: 0.0312509 | val_loss: 0.0312505 | Time: 2100.4 ms
[2022-02-07 17:09:07 main:574] : INFO : Epoch 1755 | loss: 0.0312499 | val_loss: 0.0312497 | Time: 2160.86 ms
[2022-02-07 17:09:09 main:574] : INFO : Epoch 1756 | loss: 0.0312503 | val_loss: 0.0312516 | Time: 2323.85 ms
[2022-02-07 17:09:12 main:574] : INFO : Epoch 1757 | loss: 0.0312517 | val_loss: 0.0312498 | Time: 2251.14 ms
[2022-02-07 17:09:14 main:574] : INFO : Epoch 1758 | loss: 0.0312506 | val_loss: 0.0312498 | Time: 2163.55 ms
[2022-02-07 17:09:16 main:574] : INFO : Epoch 1759 | loss: 0.0312498 | val_loss: 0.0312498 | Time: 2275.02 ms
[2022-02-07 17:09:18 main:574] : INFO : Epoch 1760 | loss: 0.0312499 | val_loss: 0.0312497 | Time: 2172.4 ms
[2022-02-07 17:09:21 main:574] : INFO : Epoch 1761 | loss: 0.0312498 | val_loss: 0.0312498 | Time: 2244.65 ms
[2022-02-07 17:09:23 main:574] : INFO : Epoch 1762 | loss: 0.03125 | val_loss: 0.0312498 | Time: 2252.41 ms
[2022-02-07 17:09:25 main:574] : INFO : Epoch 1763 | loss: 0.0312499 | val_loss: 0.0312502 | Time: 2213.77 ms
[2022-02-07 17:09:27 main:574] : INFO : Epoch 1764 | loss: 0.0312497 | val_loss: 0.0312496 | Time: 2111 ms
[2022-02-07 17:09:29 main:574] : INFO : Epoch 1765 | loss: 0.0312498 | val_loss: 0.03125 | Time: 2183.85 ms
[2022-02-07 17:09:32 main:574] : INFO : Epoch 1766 | loss: 0.0312502 | val_loss: 0.0312497 | Time: 2161.36 ms
[2022-02-07 17:09:34 main:574] : INFO : Epoch 1767 | loss: 0.03125 | val_loss: 0.0312497 | Time: 2152.4 ms
[2022-02-07 17:09:36 main:574] : INFO : Epoch 1768 | loss: 0.0312498 | val_loss: 0.0312499 | Time: 2240.84 ms
[2022-02-07 17:09:38 main:574] : INFO : Epoch 1769 | loss: 0.0312501 | val_loss: 0.0312502 | Time: 2118.43 ms
[2022-02-07 17:09:40 main:574] : INFO : Epoch 1770 | loss: 0.03125 | val_loss: 0.0312495 | Time: 2271.66 ms
[2022-02-07 17:09:43 main:574] : INFO : Epoch 1771 | loss: 0.0312511 | val_loss: 0.0312524 | Time: 2242.17 ms
[2022-02-07 17:09:45 main:574] : INFO : Epoch 1772 | loss: 0.0312515 | val_loss: 0.031251 | Time: 2210.63 ms
[2022-02-07 17:09:47 main:574] : INFO : Epoch 1773 | loss: 0.0312511 | val_loss: 0.0312507 | Time: 2152.2 ms
[2022-02-07 17:09:49 main:574] : INFO : Epoch 1774 | loss: 0.0312511 | val_loss: 0.0312497 | Time: 2163.88 ms
[2022-02-07 17:09:51 main:574] : INFO : Epoch 1775 | loss: 0.0312499 | val_loss: 0.0312497 | Time: 2184.76 ms
[2022-02-07 17:09:53 main:574] : INFO : Epoch 1776 | loss: 0.03125 | val_loss: 0.0312495 | Time: 2197.02 ms
[2022-02-07 17:09:56 main:574] : INFO : Epoch 1777 | loss: 0.0312499 | val_loss: 0.0312498 | Time: 2158.02 ms
[2022-02-07 17:09:58 main:574] : INFO : Epoch 1778 | loss: 0.0312497 | val_loss: 0.0312502 | Time: 2249.29 ms
[2022-02-07 17:10:00 main:574] : INFO : Epoch 1779 | loss: 0.0312506 | val_loss: 0.0312497 | Time: 2266.58 ms
[2022-02-07 17:10:02 main:574] : INFO : Epoch 1780 | loss: 0.0312517 | val_loss: 0.0312502 | Time: 2134.49 ms
[2022-02-07 17:10:04 main:574] : INFO : Epoch 1781 | loss: 0.0312497 | val_loss: 0.0312511 | Time: 2151.43 ms
[2022-02-07 17:10:07 main:574] : INFO : Epoch 1782 | loss: 0.0312504 | val_loss: 0.031251 | Time: 2210.58 ms
[2022-02-07 17:10:09 main:574] : INFO : Epoch 1783 | loss: 0.0312502 | val_loss: 0.0312498 | Time: 2192.75 ms
[2022-02-07 17:10:11 main:574] : INFO : Epoch 1784 | loss: 0.0312499 | val_loss: 0.0312502 | Time: 2195.11 ms
[2022-02-07 17:10:13 main:574] : INFO : Epoch 1785 | loss: 0.0312497 | val_loss: 0.0312498 | Time: 2075.12 ms
[2022-02-07 17:10:15 main:574] : INFO : Epoch 1786 | loss: 0.0312504 | val_loss: 0.0312513 | Time: 2154.77 ms
[2022-02-07 17:10:18 main:574] : INFO : Epoch 1787 | loss: 0.03125 | val_loss: 0.0312495 | Time: 2188.94 ms
[2022-02-07 17:10:20 main:574] : INFO : Epoch 1788 | loss: 0.0312497 | val_loss: 0.0312497 | Time: 2106.72 ms
[2022-02-07 17:10:22 main:574] : INFO : Epoch 1789 | loss: 0.0312499 | val_loss: 0.0312499 | Time: 2184.24 ms
[2022-02-07 17:10:24 main:574] : INFO : Epoch 1790 | loss: 0.0312499 | val_loss: 0.03125 | Time: 2182.38 ms
[2022-02-07 17:10:26 main:574] : INFO : Epoch 1791 | loss: 0.0312502 | val_loss: 0.0312504 | Time: 2135.36 ms
[2022-02-07 17:10:28 main:574] : INFO : Epoch 1792 | loss: 0.0312499 | val_loss: 0.0312498 | Time: 2088.94 ms
[2022-02-07 17:10:30 main:574] : INFO : Epoch 1793 | loss: 0.0312498 | val_loss: 0.0312496 | Time: 2119.97 ms
[2022-02-07 17:10:33 main:574] : INFO : Epoch 1794 | loss: 0.0312498 | val_loss: 0.03125 | Time: 2162.41 ms
[2022-02-07 17:10:35 main:574] : INFO : Epoch 1795 | loss: 0.0312499 | val_loss: 0.0312497 | Time: 2072.62 ms
[2022-02-07 17:10:37 main:574] : INFO : Epoch 1796 | loss: 0.0312499 | val_loss: 0.0312505 | Time: 2077.8 ms
[2022-02-07 17:10:39 main:574] : INFO : Epoch 1797 | loss: 0.0312504 | val_loss: 0.0312498 | Time: 2213.32 ms
[2022-02-07 17:10:41 main:574] : INFO : Epoch 1798 | loss: 0.03125 | val_loss: 0.0312497 | Time: 2229.48 ms
[2022-02-07 17:10:43 main:574] : INFO : Epoch 1799 | loss: 0.0312503 | val_loss: 0.0312523 | Time: 2164.14 ms
[2022-02-07 17:10:45 main:574] : INFO : Epoch 1800 | loss: 0.031252 | val_loss: 0.0312496 | Time: 2065.98 ms
[2022-02-07 17:10:48 main:574] : INFO : Epoch 1801 | loss: 0.0312506 | val_loss: 0.0312512 | Time: 2205.33 ms
[2022-02-07 17:10:50 main:574] : INFO : Epoch 1802 | loss: 0.0312501 | val_loss: 0.0312496 | Time: 2172.75 ms
[2022-02-07 17:10:52 main:574] : INFO : Epoch 1803 | loss: 0.0312501 | val_loss: 0.0312497 | Time: 2178.87 ms
[2022-02-07 17:10:54 main:574] : INFO : Epoch 1804 | loss: 0.0312503 | val_loss: 0.0312505 | Time: 2178.52 ms
[2022-02-07 17:10:56 main:574] : INFO : Epoch 1805 | loss: 0.0312501 | val_loss: 0.0312505 | Time: 2270.69 ms
[2022-02-07 17:10:59 main:574] : INFO : Epoch 1806 | loss: 0.03125 | val_loss: 0.0312499 | Time: 2368.66 ms
[2022-02-07 17:11:01 main:574] : INFO : Epoch 1807 | loss: 0.0312499 | val_loss: 0.0312496 | Time: 2200.11 ms
[2022-02-07 17:11:03 main:574] : INFO : Epoch 1808 | loss: 0.0312499 | val_loss: 0.0312511 | Time: 2213.55 ms
[2022-02-07 17:11:05 main:574] : INFO : Epoch 1809 | loss: 0.0312507 | val_loss: 0.0312509 | Time: 2166.11 ms
[2022-02-07 17:11:08 main:574] : INFO : Epoch 1810 | loss: 0.0312501 | val_loss: 0.0312499 | Time: 2161.71 ms
[2022-02-07 17:11:10 main:574] : INFO : Epoch 1811 | loss: 0.0312497 | val_loss: 0.0312501 | Time: 2207.28 ms
[2022-02-07 17:11:12 main:574] : INFO : Epoch 1812 | loss: 0.0312502 | val_loss: 0.0312505 | Time: 2186.07 ms
[2022-02-07 17:11:14 main:574] : INFO : Epoch 1813 | loss: 0.03125 | val_loss: 0.0312498 | Time: 2133.48 ms
[2022-02-07 17:11:16 main:574] : INFO : Epoch 1814 | loss: 0.0312505 | val_loss: 0.03125 | Time: 2135.92 ms
[2022-02-07 17:11:18 main:574] : INFO : Epoch 1815 | loss: 0.0312508 | val_loss: 0.0312514 | Time: 2152.51 ms
[2022-02-07 17:11:21 main:574] : INFO : Epoch 1816 | loss: 0.0312499 | val_loss: 0.0312501 | Time: 2178.44 ms
[2022-02-07 17:11:23 main:574] : INFO : Epoch 1817 | loss: 0.0312497 | val_loss: 0.0312506 | Time: 2186.48 ms
[2022-02-07 17:11:25 main:574] : INFO : Epoch 1818 | loss: 0.0312498 | val_loss: 0.0312499 | Time: 2156.24 ms
[2022-02-07 17:11:27 main:574] : INFO : Epoch 1819 | loss: 0.0312502 | val_loss: 0.0312495 | Time: 2120.59 ms
[2022-02-07 17:11:29 main:574] : INFO : Epoch 1820 | loss: 0.03125 | val_loss: 0.0312498 | Time: 2162.35 ms
[2022-02-07 17:11:31 main:574] : INFO : Epoch 1821 | loss: 0.0312511 | val_loss: 0.0312534 | Time: 2157.44 ms
[2022-02-07 17:11:33 main:574] : INFO : Epoch 1822 | loss: 0.0312499 | val_loss: 0.0312502 | Time: 2113.53 ms
[2022-02-07 17:11:36 main:574] : INFO : Epoch 1823 | loss: 0.0312501 | val_loss: 0.0312496 | Time: 2161.26 ms
[2022-02-07 17:11:38 main:574] : INFO : Epoch 1824 | loss: 0.0312498 | val_loss: 0.0312495 | Time: 2131.21 ms
[2022-02-07 17:11:40 main:574] : INFO : Epoch 1825 | loss: 0.0312499 | val_loss: 0.0312496 | Time: 2218.92 ms
[2022-02-07 17:11:42 main:574] : INFO : Epoch 1826 | loss: 0.0312497 | val_loss: 0.0312495 | Time: 2481.52 ms
[2022-02-07 17:11:45 main:574] : INFO : Epoch 1827 | loss: 0.0312508 | val_loss: 0.0312502 | Time: 2485.42 ms
[2022-02-07 17:11:47 main:574] : INFO : Epoch 1828 | loss: 0.0312509 | val_loss: 0.0312527 | Time: 2197.83 ms
[2022-02-07 17:11:49 main:574] : INFO : Epoch 1829 | loss: 0.0312523 | val_loss: 0.0312497 | Time: 2163.29 ms
[2022-02-07 17:11:52 main:574] : INFO : Epoch 1830 | loss: 0.0312506 | val_loss: 0.0312519 | Time: 2212.04 ms
[2022-02-07 17:11:54 main:574] : INFO : Epoch 1831 | loss: 0.0312502 | val_loss: 0.0312495 | Time: 2134.55 ms
[2022-02-07 17:11:56 main:574] : INFO : Epoch 1832 | loss: 0.0312498 | val_loss: 0.0312497 | Time: 2254.73 ms
[2022-02-07 17:11:58 main:574] : INFO : Epoch 1833 | loss: 0.0312501 | val_loss: 0.0312504 | Time: 2231.31 ms
[2022-02-07 17:12:01 main:574] : INFO : Epoch 1834 | loss: 0.0312501 | val_loss: 0.03125 | Time: 2308.04 ms
[2022-02-07 17:12:03 main:574] : INFO : Epoch 1835 | loss: 0.0312501 | val_loss: 0.0312502 | Time: 2153.52 ms
[2022-02-07 17:12:05 main:574] : INFO : Epoch 1836 | loss: 0.0312501 | val_loss: 0.0312497 | Time: 2206.58 ms
[2022-02-07 17:12:07 main:574] : INFO : Epoch 1837 | loss: 0.0312503 | val_loss: 0.0312498 | Time: 2180.2 ms
[2022-02-07 17:12:09 main:574] : INFO : Epoch 1838 | loss: 0.0312506 | val_loss: 0.0312499 | Time: 2178.02 ms
[2022-02-07 17:12:11 main:574] : INFO : Epoch 1839 | loss: 0.0312499 | val_loss: 0.0312495 | Time: 2195.57 ms
[2022-02-07 17:12:14 main:574] : INFO : Epoch 1840 | loss: 0.0312498 | val_loss: 0.0312498 | Time: 2104.87 ms
[2022-02-07 17:12:16 main:574] : INFO : Epoch 1841 | loss: 0.0312497 | val_loss: 0.03125 | Time: 2177.44 ms
[2022-02-07 17:12:18 main:574] : INFO : Epoch 1842 | loss: 0.0312508 | val_loss: 0.0312499 | Time: 2191.72 ms
[2022-02-07 17:12:20 main:574] : INFO : Epoch 1843 | loss: 0.0312508 | val_loss: 0.0312495 | Time: 2349.58 ms
[2022-02-07 17:12:22 main:574] : INFO : Epoch 1844 | loss: 0.0312496 | val_loss: 0.0312496 | Time: 2155.16 ms
[2022-02-07 17:12:25 main:574] : INFO : Epoch 1845 | loss: 0.0312498 | val_loss: 0.0312498 | Time: 2246.31 ms
[2022-02-07 17:12:27 main:574] : INFO : Epoch 1846 | loss: 0.0312498 | val_loss: 0.0312503 | Time: 2269.91 ms
[2022-02-07 17:12:29 main:574] : INFO : Epoch 1847 | loss: 0.0312502 | val_loss: 0.0312495 | Time: 2201.13 ms
[2022-02-07 17:12:31 main:574] : INFO : Epoch 1848 | loss: 0.0312514 | val_loss: 0.031253 | Time: 2088.51 ms
[2022-02-07 17:12:33 main:574] : INFO : Epoch 1849 | loss: 0.0312498 | val_loss: 0.0312496 | Time: 2172.79 ms
[2022-02-07 17:12:36 main:574] : INFO : Epoch 1850 | loss: 0.0312498 | val_loss: 0.0312496 | Time: 2191.07 ms
[2022-02-07 17:12:38 main:574] : INFO : Epoch 1851 | loss: 0.0312497 | val_loss: 0.0312496 | Time: 2126.22 ms
[2022-02-07 17:12:40 main:574] : INFO : Epoch 1852 | loss: 0.0312505 | val_loss: 0.0312501 | Time: 2193.41 ms
[2022-02-07 17:12:42 main:574] : INFO : Epoch 1853 | loss: 0.0312504 | val_loss: 0.0312502 | Time: 2184.66 ms
[2022-02-07 17:12:44 main:574] : INFO : Epoch 1854 | loss: 0.0312498 | val_loss: 0.0312495 | Time: 2135.93 ms
[2022-02-07 17:12:47 main:574] : INFO : Epoch 1855 | loss: 0.0312498 | val_loss: 0.0312498 | Time: 2257.63 ms
[2022-02-07 17:12:49 main:574] : INFO : Epoch 1856 | loss: 0.03125 | val_loss: 0.031251 | Time: 2207.89 ms
[2022-02-07 17:12:51 main:574] : INFO : Epoch 1857 | loss: 0.0312501 | val_loss: 0.0312495 | Time: 2177.77 ms
[2022-02-07 17:12:53 main:574] : INFO : Epoch 1858 | loss: 0.03125 | val_loss: 0.0312495 | Time: 2216.59 ms
[2022-02-07 17:12:55 main:574] : INFO : Epoch 1859 | loss: 0.0312499 | val_loss: 0.0312495 | Time: 2118.48 ms
[2022-02-07 17:12:57 main:574] : INFO : Epoch 1860 | loss: 0.0312496 | val_loss: 0.0312495 | Time: 2156.36 ms
[2022-02-07 17:13:00 main:574] : INFO : Epoch 1861 | loss: 0.0312503 | val_loss: 0.0312495 | Time: 2136.5 ms
[2022-02-07 17:13:02 main:574] : INFO : Epoch 1862 | loss: 0.0312505 | val_loss: 0.0312516 | Time: 2165.45 ms
[2022-02-07 17:13:04 main:574] : INFO : Epoch 1863 | loss: 0.0312509 | val_loss: 0.0312496 | Time: 2207.48 ms
[2022-02-07 17:13:06 main:574] : INFO : Epoch 1864 | loss: 0.0312499 | val_loss: 0.0312495 | Time: 2171.61 ms
[2022-02-07 17:13:08 main:574] : INFO : Epoch 1865 | loss: 0.0312497 | val_loss: 0.0312499 | Time: 2149.55 ms
[2022-02-07 17:13:10 main:574] : INFO : Epoch 1866 | loss: 0.0312496 | val_loss: 0.0312495 | Time: 2123.75 ms
[2022-02-07 17:13:13 main:574] : INFO : Epoch 1867 | loss: 0.0312496 | val_loss: 0.0312495 | Time: 2100.69 ms
[2022-02-07 17:13:15 main:574] : INFO : Epoch 1868 | loss: 0.0312499 | val_loss: 0.0312497 | Time: 2186.87 ms
[2022-02-07 17:13:17 main:574] : INFO : Epoch 1869 | loss: 0.0312504 | val_loss: 0.0312499 | Time: 2149.51 ms
THCudaCheck FAIL file=..\..\aten\src\THC\THCCachingHostAllocator.cpp line=278 error=719 : unspecified launch failure
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFDB6DB4F69
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 02/07/22 17:13:20
Install Directory : C:\Program Files\BOINC\
Data Directory : C:\ProgramData\BOINC
Project Symstore :
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\0;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 00000000e7f20000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000b93f0000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1466
ModLoad: 00000000b7b10000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1503) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.1503 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1503
ModLoad: 00000000b6d80000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1503) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.1503 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1503
ModLoad: 00000000b7bd0000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000b6cb0000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1466
ModLoad: 00000000b8610000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.1202 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1202
ModLoad: 00000000b70c0000 000000000010d000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1466
ModLoad: 00000000b6ce0000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 00000000b7200000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 00000000b8f10000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000b8b70000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.19041.546
ModLoad: 00000000b8fd0000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000b7910000 0000000000125000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000007ebb0000 0000000000058000 C:\ProgramData\BOINC\slots\0\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000007ea10000 0000000000099000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.23.27820.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\2\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.23.27820.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio® 2017
Product Version : 14.23.27820.0
ModLoad: 00000000a5250000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.867 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.867
ModLoad: 00000000ad350000 0000000000016000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.23.27820.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.23.27820.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio® 2017
Product Version : 14.23.27820.0
ModLoad: 0000000099ab0000 000000000000b000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.23.27820.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.23.27820.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio® 2017
Product Version : 14.23.27820.0
ModLoad: 0000000027b50000 0000000024b49000 C:\ProgramData\BOINC\slots\0\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000001cf60000 000000000abe7000 C:\ProgramData\BOINC\slots\0\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000007eb60000 0000000000045000 C:\ProgramData\BOINC\slots\0\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000053380000 00000000034b2000 C:\ProgramData\BOINC\slots\0\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 0000000099aa0000 0000000000010000 C:\ProgramData\BOINC\slots\0\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 00000000feb00000 00000000030a5000 C:\ProgramData\BOINC\slots\0\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 0000000001bb0000 000000001b3a4000 C:\ProgramData\BOINC\slots\0\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 000000007ccd0000 000000000020d000 C:\ProgramData\BOINC\slots\0\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 0000000077d60000 00000000002db000 C:\ProgramData\BOINC\slots\0\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000007efb0000 0000000000040000 C:\ProgramData\BOINC\slots\0\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000f5960000 000000000919f000 C:\ProgramData\BOINC\slots\0\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 00000000f1c00000 0000000003d5b000 C:\ProgramData\BOINC\slots\0\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 0000000070400000 0000000001eca000 C:\ProgramData\BOINC\slots\0\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000b9070000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000b4a10000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000b86f0000 0000000000472000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1503) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000b6b00000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1151
ModLoad: 00000000b71d0000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000b68a0000 0000000000034000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1151
ModLoad: 00000000b7050000 0000000000069000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1503) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.1503 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1503
ModLoad: 00000000b6b50000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000b66e0000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000b7ec0000 0000000000744000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.964 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.964
ModLoad: 00000000b4c10000 0000000000794000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1503) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000b75b0000 0000000000355000 C:\WINDOWS\System32\combase.dll (6.2.19041.1348) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.1320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1320
ModLoad: 00000000b6550000 000000000002e000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000b8640000 00000000000ad000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1387) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000b8eb0000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000750a0000 0000000000267000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.5671) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r456_61\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 27.21.14.5671
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.1.96 driver
Product Version : 27.21.14.5671
ModLoad: 00000000b0a40000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000061be0000 000000000152a000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_1c83a5d7cffd7bff\nvcuda64.dll (27.21.14.5671) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r456_61\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 27.21.14.5671
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.1.96 driver
Product Version : 27.21.14.5671
ModLoad: 00000000b8e40000 000000000006b000 C:\WINDOWS\System32\WS2_32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : ws2_32.pdb
File Version : 10.0.19041.1081 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1081
ModLoad: 00000000b0b00000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.906 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.906
ModLoad: 00000000b64c0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000b44b0000 000000000009e000 C:\WINDOWS\system32\uxtheme.dll (6.2.19041.1266) (-exported- Symbols Loaded)
Linked PDB Filename : UxTheme.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000aaca0000 00000000006d5000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.5671) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r456_61\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 27.21.14.5671
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 27.21.14.5671
ModLoad: 00000000b7450000 000000000012a000 C:\WINDOWS\System32\OLE32.DLL (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : ole32.pdb
File Version : 10.0.19041.1320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1320
ModLoad: 0000000099a90000 0000000000009000 C:\ProgramData\BOINC\slots\0\caffe2_nvrtc.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000006c900000 0000000000fca000 C:\ProgramData\BOINC\slots\0\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6.14.11.9000
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.89 NVRTC Library
Product Version : 6.14.11.9000
ModLoad: 00000000b73b0000 0000000000082000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.1415 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1415
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 4007, Write: 2049, Other 7229
- I/O Transfers Counters -
Read: 8234637, Write: 1551915, Other 56622
- Paged Pool Usage -
QuotaPagedPoolUsage: 3539264, QuotaPeakPagedPoolUsage: 3540064
QuotaNonPagedPoolUsage: 59152, QuotaPeakNonPagedPoolUsage: 59624
- Virtual Memory Usage -
VirtualSize: 353038336, PeakVirtualSize: 979697664
- Pagefile Usage -
PagefileUsage: 353038336, PeakPagefileUsage: 353038336
- Working Set Size -
WorkingSetSize: -2041110528, PeakWorkingSetSize: -2036301824, PageFaultCount: 854718
*** Dump of thread ID 11220 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 258281248.000000, User Time: 4042656256.000000, Wait Time: 9659008.000000
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFDB6DB4F69
- Registers -
rax=0000000000000000 rbx=00000000273d62f0 rcx=0000000000000000 rdx=0000000000000000 rsi=00000000de3842e0 rdi=0000000019930520
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000000006000 r13=0000000000000000
r14=00000000de385020 r15=00000000de384fa0 rip=00000000b6db4f69 rsp=00000000de384180 rbp=00000000de384b88
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202
- Callstack -
ChildEBP RetAddr Args to Child
de384250 ad354890 c754fa92 00000000 de385020 2252a014 KERNELBASE!RaiseException+0x0
de3842b0 22b25272 c754faf2 00000000 000007cb 00000116 VCRUNTIME140!_CxxThrowException+0x0
de384300 22b256d4 00000000 00000000 25b4d290 2b3b5f68 torch_cpu!at::Tensor::zero_+0x0
de384b60 2a979ebe de384d90 2b3b6850 2b3b6880 000002cf torch_cpu!_THError+0x0
de384ba0 2a975412 de384d90 de384cf0 aa0c4d10 2b7ea720 torch_cuda!__THCudaCheck+0x0
de384be0 227d59ff de384f00 de384d90 de385260 7ebe97b0 torch_cuda!at::native::set_storage_cuda_+0x0
de384f70 2297726f 2afef630 2252ea63 00000001 7ebcef8f torch_cpu!at::native::empty_cpu+0x0
de384fb0 22930615 de380000 de385028 de385220 7ebb7ce6 torch_cpu!at::native::mkldnn_sigmoid_+0x0
de384ff0 2293204a de380000 de385000 aa0a8800 29cb6ae5 torch_cpu!at::native::mkldnn_sigmoid_+0x0
de385080 22930615 00000000 2252ea63 de385160 de385260 torch_cpu!at::native::mkldnn_sigmoid_+0x0
de3850c0 22a01eb0 de380000 00000000 de385248 00000001 torch_cpu!at::native::mkldnn_sigmoid_+0x0
de385160 22a12eec 88f5c4da 7ebe9c50 de3852c0 7ebb3bd6 torch_cpu!at::bucketize_out+0x0
de3851b0 2a07f160 de380000 00000000 de3852c0 00000000 torch_cpu!at::empty+0x0
de385550 2a082de8 7ebe9c50 22530528 1d593730 7ebe9c50 torch_cuda!at::native::cummin_helper_cuda+0x0
de385730 2a084379 de385840 4820d9f0 de385c40 4820da08 torch_cuda!at::native::cummin_helper_cuda+0x0
de385970 2a083d64 de380000 de385c40 de385a80 de385c40 torch_cuda!at::native::cat_out_cuda+0x0
de385b70 2a921dd2 de385bc8 00000001 de385bc8 de385c40 torch_cuda!at::native::cat_cuda+0x0
de385bf0 2a934179 00000001 de385c30 1d593318 04000000 torch_cuda!at::native::set_storage_cuda_+0x0
de385c30 22a01d7d 3a0256a0 de385fa0 de385f70 00000000 torch_cuda!at::native::set_storage_cuda_+0x0
de385cb0 229e0d81 00000000 7ebd3994 de386480 4820da90 torch_cpu!at::bucketize_out+0x0
de385cf0 227eb4a5 de385d30 1d593330 de385e00 de385e70 torch_cpu!at::_cat+0x0
de385dc0 22ad27bd de385e90 00000101 de385e18 7ec01ea8 torch_cpu!at::native::cat+0x0
de385e40 225929ae 4820d9b0 4820d9c0 4820d9c8 de385df8 torch_cpu!at::zeros_out+0x0
de385e80 22a01d7d de385ec0 de385f30 00000000 b94147b1 torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0
de385f00 22a075d1 de3864a0 27880640 de386480 4820da90 torch_cpu!at::bucketize_out+0x0
de385f40 227f7d4c de3861d0 00000000 de3861d0 00000000 torch_cpu!at::cat+0x0
de386100 22aec38d de386158 00000001 de386158 de3861d0 torch_cpu!at::native::stack+0x0
de386180 225929ae de386480 4820da90 00000000 00000000 torch_cpu!at::zeros_out+0x0
de3861c0 22a01d7d de386200 de386270 00000000 257a1c8f torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0
de386240 22a502e1 de386370 7ebd3720 de3864a0 27880640 torch_cpu!at::bucketize_out+0x0
de386280 23de3839 de386300 1d592b00 1d592b00 de386390 torch_cpu!at::stack+0x0
de386450 225929ae 00000000 de3865a0 00000000 de386540 torch_cpu!torch::autograd::GraphRoot::apply+0x0
de386490 22a01d7d de3864d0 de386540 1d5922e0 00000000 torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0
de386510 22a502e1 de386680 22529cac 4bd34cd0 4820da90 torch_cpu!at::bucketize_out+0x0
de386550 e7f2ff7e de386618 47820ad0 47820ad0 de386760 torch_cpu!at::stack+0x0
de3865f0 e7f32ef8 e7f2fe30 de386630 de386630 de386680 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::addCallback+0x0
de386650 e7f33ea4 ffcc56d0 b94147b1 de3867f0 a9740000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Object::getSlot+0x0
de386790 e7f2d3d2 00000000 4cf18010 de3867f0 a9744cf0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::markCompleted+0x0
de3867c0 e7f34541 00000000 4cf1b1d0 a9744cf0 b9415ba1 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Object::operator=+0x0
de386970 e7f3743a 00000000 00000000 de387480 00000008 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::markCompleted+0x0
de386e70 e7f3b950 de386f70 de386f70 00000000 d5a00ae0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0
de39fc10 e817c6f8 ab026c10 00000000 00000000 a974e940 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
de39fc50 b7b27034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
de39fc80 b9442651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
de39fd00 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 2124 (state: Waiting): ***
- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 9659008.000000
- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000deaffd10 rsi=0000000000000000 rdi=0000000000000064
r8=00000000deaffce8 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000b948d3f4 rsp=00000000deaffce8 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
deaffce0 b6dc962e deaffda8 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0
deaffd80 e7f5a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0
deaffdb0 b7b27034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
deaffde0 b9442651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
deaffe60 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 11720 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 9659008.000000
- Registers -
rax=000000000000005b rbx=000000000000000e rcx=000000000000000e rdx=00000000debff720 rsi=0000000000000000 rdi=000000000000000e
r8=00000000debff3c8 r9=0000000000000000 r10=0000000000000000 r11=00000000debff690 r12=0000000000000064 r13=00000000debff720
r14=00000000debff420 r15=0000000000000000 rip=00000000b948d8c4 rsp=00000000debff3c8 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
debff3c0 b6dccb20 00000000 de528000 b955a4d0 de528000 ntdll!ZwWaitForMultipleObjects+0x0
debff6b0 b6dcca1e a97531c0 004e0049 0000000e 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
debff6f0 61d8ba44 ab1c2450 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0
debff930 61e208dd 00000000 00000004 00000000 00000000 nvcuda64!+0x0
debff9e0 61d8b413 6505c97e 649e0eb5 ab777c50 00000000 nvcuda64!cuProfilerStop+0x0
debffa10 62099200 ab777c50 00000000 00000000 00000000 nvcuda64!+0x0
debffa40 b7b27034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
debffa70 b9442651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
debffaf0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 12260 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 9659005.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002c4 rdx=0000000000000000 rsi=00000000decffd08 rdi=00000000000002c4
r8=00000000decffcd8 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=00000000ab21d890 r13=0000000000000000
r14=00000000000002c4 r15=0000000000000001 rip=00000000b948cdf4 rsp=00000000decffcd8 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
decffcd0 b6da1a5e 00000000 00000000 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0
decffd70 61f9ab97 00000000 b6daa395 00000000 000002c4 KERNELBASE!WaitForSingleObjectEx+0x0
decffde0 61d8b413 00000001 ab573960 ab7779e0 00000000 nvcuda64!cuProfilerStop+0x0
decffe10 62099200 ab7779e0 00000000 00000000 00000000 nvcuda64!+0x0
decffe40 b7b27034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
decffe70 b9442651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
decffef0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 5732 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 9658989.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000ab497258 rdx=00000000dedffe08 rsi=00000000dedffd70 rdi=0000000000000000
r8=0000000000000008 r9=0000000000000011 r10=00000000bffffe6e r11=00000000dedffda0 r12=00000000dedffe08 r13=0000000000000000
r14=00000000ab497258 r15=00000000ab49bda8 rip=00000000b9490764 rsp=00000000dedffd48 rbp=00000000dedffda0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
dedffd40 b9454295 00000102 61e5953d 00000000 dedffd70 ntdll!NtWaitForAlertByThreadId+0x0
dedffdb0 b6decdd9 ab499590 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0
dedffde0 61d121da ab499590 ab499590 ab499590 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0
dedffe40 61d8b413 00000002 650cf03b 00000000 00000000 nvcuda64!+0x0
dedffe70 62099200 ab777950 00000000 00000000 00000000 nvcuda64!+0x0
dedffea0 b7b27034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
dedffed0 b9442651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
dedfff50 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 3344 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 209218752.000000, User Time: 3094687488.000000, Wait Time: 9658878.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=000000002560fde8 rdx=0000000000000000 rsi=0000000000000000 rdi=000000002560fde8
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=00000000deefebd0 r12=0000000000000000 r13=0000000000000000
r14=00000000deeff390 r15=000000002560fd98 rip=00000000b9490764 rsp=00000000deeff368 rbp=00000000deeff3c0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
deeff360 b9454021 3a39a3d8 3a39a3d8 deeff4a0 3a39a3d8 ntdll!NtWaitForAlertByThreadId+0x0
deeff3e0 b6dece89 2560fd90 2560fdd8 00000000 00000000 ntdll!RtlSleepConditionVariableSRW+0x0
deeff420 7ea4567d 35f4a040 35f4a040 35f4a040 00000000 KERNELBASE!SleepConditionVariableSRW+0x0
deeff460 7ea220b8 4811e320 00000000 00000000 241405b4 MSVCP140!__crtSetThreadpoolWait+0x0
deeff490 7ea21f80 00000000 7ea22787 00000000 4811e320 MSVCP140!std::_Winerror_message+0x0
deeff500 2414064b 4811e300 000001c0 2560fd90 2560fd90 MSVCP140!std::_Winerror_message+0x0
deeff540 241425b1 4fa06260 ffffffff 4811e300 ffffffff torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
deeff830 24142471 27666d10 deeff870 27666d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0
deeff880 24139744 00080001 4f9553a0 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0
deeff8b0 b7221bb2 4f9553a0 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0
deeff8e0 b7b27034 00000000 00000000 00000000 00000000 ucrtbase!_configthreadlocale+0x0
deeff910 b9442651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
deeff990 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)