Task 14551225
| Name | ParityModified-1647040587-21171-2-0_0 |
| Workunit | 11575732 |
| Created | 8 Apr 2022, 18:07:47 UTC |
| Sent | 10 Apr 2022, 11:36:44 UTC |
| Report deadline | 18 Apr 2022, 11:36:44 UTC |
| Received | 11 Apr 2022, 2:50:03 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 197 (0x000000C5) EXIT_TIME_LIMIT_EXCEEDED |
| Computer ID | 21690 |
| Run time | 6 hours 28 min 14 sec |
| CPU time | 1 hours 33 min 42 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 11,433.61 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 2.44 GB |
| Peak swap size | 4.28 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
exceeded elapsed time limit 23293.05 (4000000.00G/171.73G)</message>
<stderr_txt>
4542.03 ms
[2022-04-11 09:28:33 main:574] : INFO : Epoch 1632 | loss: 0.0312046 | val_loss: 0.0312031 | Time: 4681.24 ms
[2022-04-11 09:28:38 main:574] : INFO : Epoch 1633 | loss: 0.0312057 | val_loss: 0.0312033 | Time: 4522.41 ms
[2022-04-11 09:28:43 main:574] : INFO : Epoch 1634 | loss: 0.0312042 | val_loss: 0.031203 | Time: 4612.63 ms
[2022-04-11 09:28:49 main:574] : INFO : Epoch 1635 | loss: 0.0312048 | val_loss: 0.0312024 | Time: 4514.09 ms
[2022-04-11 09:28:54 main:574] : INFO : Epoch 1636 | loss: 0.0312049 | val_loss: 0.0312032 | Time: 4457.21 ms
[2022-04-11 09:28:59 main:574] : INFO : Epoch 1637 | loss: 0.0312078 | val_loss: 0.0312101 | Time: 4488.7 ms
[2022-04-11 09:29:04 main:574] : INFO : Epoch 1638 | loss: 0.0312068 | val_loss: 0.0312028 | Time: 4509.83 ms
[2022-04-11 09:29:09 main:574] : INFO : Epoch 1639 | loss: 0.0312043 | val_loss: 0.0312024 | Time: 4459.28 ms
[2022-04-11 09:29:15 main:574] : INFO : Epoch 1640 | loss: 0.0312053 | val_loss: 0.031203 | Time: 4480.74 ms
[2022-04-11 09:29:20 main:574] : INFO : Epoch 1641 | loss: 0.0312048 | val_loss: 0.0312022 | Time: 4500.1 ms
[2022-04-11 09:29:25 main:574] : INFO : Epoch 1642 | loss: 0.031205 | val_loss: 0.0312087 | Time: 4498.87 ms
[2022-04-11 09:29:31 main:574] : INFO : Epoch 1643 | loss: 0.0312059 | val_loss: 0.0312007 | Time: 4873.74 ms
[2022-04-11 09:29:36 main:574] : INFO : Epoch 1644 | loss: 0.031204 | val_loss: 0.0312015 | Time: 4472.59 ms
[2022-04-11 09:29:41 main:574] : INFO : Epoch 1645 | loss: 0.0312034 | val_loss: 0.0312019 | Time: 4532.89 ms
[2022-04-11 09:29:46 main:574] : INFO : Epoch 1646 | loss: 0.0312039 | val_loss: 0.0312008 | Time: 4482.84 ms
[2022-04-11 09:29:51 main:574] : INFO : Epoch 1647 | loss: 0.0312034 | val_loss: 0.0312039 | Time: 4563.07 ms
[2022-04-11 09:29:56 main:574] : INFO : Epoch 1648 | loss: 0.0312076 | val_loss: 0.0312049 | Time: 4554.69 ms
[2022-04-11 09:30:01 main:574] : INFO : Epoch 1649 | loss: 0.0312054 | val_loss: 0.031202 | Time: 4749.22 ms
[2022-04-11 09:30:06 main:574] : INFO : Epoch 1650 | loss: 0.0312034 | val_loss: 0.0312015 | Time: 4462.34 ms
[2022-04-11 09:30:12 main:574] : INFO : Epoch 1651 | loss: 0.0312042 | val_loss: 0.0312031 | Time: 4525.95 ms
[2022-04-11 09:30:17 main:574] : INFO : Epoch 1652 | loss: 0.0312041 | val_loss: 0.0312026 | Time: 4467.36 ms
[2022-04-11 09:30:23 main:574] : INFO : Epoch 1653 | loss: 0.0312038 | val_loss: 0.0312012 | Time: 4715.18 ms
[2022-04-11 09:30:28 main:574] : INFO : Epoch 1654 | loss: 0.0312033 | val_loss: 0.0312015 | Time: 4522.77 ms
[2022-04-11 09:30:33 main:574] : INFO : Epoch 1655 | loss: 0.0312045 | val_loss: 0.0312012 | Time: 4680.4 ms
[2022-04-11 09:30:38 main:574] : INFO : Epoch 1656 | loss: 0.0312055 | val_loss: 0.031201 | Time: 4454.35 ms
[2022-04-11 09:30:43 main:574] : INFO : Epoch 1657 | loss: 0.0312082 | val_loss: 0.0312041 | Time: 4481.92 ms
[2022-04-11 09:30:49 main:574] : INFO : Epoch 1658 | loss: 0.0312051 | val_loss: 0.0312034 | Time: 4789.12 ms
[2022-04-11 09:30:54 main:574] : INFO : Epoch 1659 | loss: 0.0312039 | val_loss: 0.0312001 | Time: 4663.44 ms
[2022-04-11 09:31:00 main:574] : INFO : Epoch 1660 | loss: 0.0312036 | val_loss: 0.0312009 | Time: 4554.64 ms
[2022-04-11 09:31:05 main:574] : INFO : Epoch 1661 | loss: 0.0312041 | val_loss: 0.0312042 | Time: 4449.79 ms
[2022-04-11 09:31:10 main:574] : INFO : Epoch 1662 | loss: 0.0312053 | val_loss: 0.0312017 | Time: 4496.57 ms
[2022-04-11 09:31:15 main:574] : INFO : Epoch 1663 | loss: 0.0312028 | val_loss: 0.0312005 | Time: 4443.47 ms
[2022-04-11 09:31:20 main:574] : INFO : Epoch 1664 | loss: 0.0312047 | val_loss: 0.0312019 | Time: 4511.09 ms
[2022-04-11 09:31:25 main:574] : INFO : Epoch 1665 | loss: 0.0312054 | val_loss: 0.0312046 | Time: 4598.79 ms
[2022-04-11 09:31:30 main:574] : INFO : Epoch 1666 | loss: 0.0312052 | val_loss: 0.031203 | Time: 4528.82 ms
[2022-04-11 09:31:36 main:574] : INFO : Epoch 1667 | loss: 0.0312035 | val_loss: 0.0312024 | Time: 4562.04 ms
[2022-04-11 09:31:41 main:574] : INFO : Epoch 1668 | loss: 0.031204 | val_loss: 0.0311997 | Time: 4536.63 ms
[2022-04-11 09:31:46 main:574] : INFO : Epoch 1669 | loss: 0.031204 | val_loss: 0.0312026 | Time: 4636.34 ms
[2022-04-11 09:31:51 main:574] : INFO : Epoch 1670 | loss: 0.0312063 | val_loss: 0.0312104 | Time: 4457.15 ms
[2022-04-11 09:31:56 main:574] : INFO : Epoch 1671 | loss: 0.0312105 | val_loss: 0.0312003 | Time: 4565.06 ms
[2022-04-11 09:32:01 main:574] : INFO : Epoch 1672 | loss: 0.0312053 | val_loss: 0.0312004 | Time: 4338.45 ms
[2022-04-11 09:32:06 main:574] : INFO : Epoch 1673 | loss: 0.0312028 | val_loss: 0.0311999 | Time: 4541.16 ms
[2022-04-11 09:32:11 main:574] : INFO : Epoch 1674 | loss: 0.0312025 | val_loss: 0.0311999 | Time: 4494.45 ms
[2022-04-11 09:32:17 main:574] : INFO : Epoch 1675 | loss: 0.0312039 | val_loss: 0.0312012 | Time: 4505.31 ms
[2022-04-11 09:32:22 main:574] : INFO : Epoch 1676 | loss: 0.0312027 | val_loss: 0.0312015 | Time: 4559.79 ms
[2022-04-11 09:32:27 main:574] : INFO : Epoch 1677 | loss: 0.0312037 | val_loss: 0.0312009 | Time: 4434.01 ms
[2022-04-11 09:32:33 main:574] : INFO : Epoch 1678 | loss: 0.0312033 | val_loss: 0.031202 | Time: 4589.65 ms
[2022-04-11 09:32:38 main:574] : INFO : Epoch 1679 | loss: 0.0312072 | val_loss: 0.0312003 | Time: 4510.89 ms
[2022-04-11 09:32:43 main:574] : INFO : Epoch 1680 | loss: 0.0312024 | val_loss: 0.0312076 | Time: 4478.13 ms
[2022-04-11 09:32:48 main:574] : INFO : Epoch 1681 | loss: 0.0312045 | val_loss: 0.0312046 | Time: 4515.63 ms
[2022-04-11 09:32:53 main:574] : INFO : Epoch 1682 | loss: 0.0312048 | val_loss: 0.0312017 | Time: 4692.59 ms
[2022-04-11 09:32:58 main:574] : INFO : Epoch 1683 | loss: 0.0312032 | val_loss: 0.0312002 | Time: 4573.79 ms
[2022-04-11 09:33:03 main:574] : INFO : Epoch 1684 | loss: 0.0312023 | val_loss: 0.0312 | Time: 4572.22 ms
[2022-04-11 09:33:08 main:574] : INFO : Epoch 1685 | loss: 0.0312033 | val_loss: 0.0312039 | Time: 4516.86 ms
[2022-04-11 09:33:13 main:574] : INFO : Epoch 1686 | loss: 0.0312021 | val_loss: 0.0312001 | Time: 4554.82 ms
[2022-04-11 09:33:18 main:574] : INFO : Epoch 1687 | loss: 0.0312016 | val_loss: 0.0312001 | Time: 4631.67 ms
[2022-04-11 09:33:23 main:574] : INFO : Epoch 1688 | loss: 0.0312036 | val_loss: 0.0312044 | Time: 4557.64 ms
[2022-04-11 09:33:28 main:574] : INFO : Epoch 1689 | loss: 0.0312056 | val_loss: 0.0311998 | Time: 4516.76 ms
[2022-04-11 09:33:33 main:574] : INFO : Epoch 1690 | loss: 0.0312019 | val_loss: 0.0312013 | Time: 4505.27 ms
[2022-04-11 09:33:39 main:574] : INFO : Epoch 1691 | loss: 0.0312044 | val_loss: 0.0311998 | Time: 4538.02 ms
[2022-04-11 09:33:44 main:574] : INFO : Epoch 1692 | loss: 0.0312011 | val_loss: 0.0311999 | Time: 4573.46 ms
[2022-04-11 09:33:49 main:574] : INFO : Epoch 1693 | loss: 0.0312015 | val_loss: 0.0311996 | Time: 4550.66 ms
[2022-04-11 09:33:54 main:574] : INFO : Epoch 1694 | loss: 0.0312018 | val_loss: 0.0312009 | Time: 4565.07 ms
[2022-04-11 09:33:59 main:574] : INFO : Epoch 1695 | loss: 0.0312025 | val_loss: 0.0312019 | Time: 4596.6 ms
[2022-04-11 09:34:04 main:574] : INFO : Epoch 1696 | loss: 0.031205 | val_loss: 0.0312022 | Time: 4452.96 ms
[2022-04-11 09:34:09 main:574] : INFO : Epoch 1697 | loss: 0.0312029 | val_loss: 0.0312012 | Time: 4587.44 ms
[2022-04-11 09:34:14 main:574] : INFO : Epoch 1698 | loss: 0.0312032 | val_loss: 0.0312004 | Time: 4532.35 ms
[2022-04-11 09:34:20 main:574] : INFO : Epoch 1699 | loss: 0.0312044 | val_loss: 0.0312004 | Time: 4587.29 ms
[2022-04-11 09:34:25 main:574] : INFO : Epoch 1700 | loss: 0.0312038 | val_loss: 0.0312005 | Time: 4550.35 ms
[2022-04-11 09:34:30 main:574] : INFO : Epoch 1701 | loss: 0.0312041 | val_loss: 0.031205 | Time: 4885.69 ms
[2022-04-11 09:34:35 main:574] : INFO : Epoch 1702 | loss: 0.0312023 | val_loss: 0.0311999 | Time: 4498.02 ms
[2022-04-11 09:34:40 main:574] : INFO : Epoch 1703 | loss: 0.0312014 | val_loss: 0.0312019 | Time: 4550.51 ms
[2022-04-11 09:34:46 main:574] : INFO : Epoch 1704 | loss: 0.0312026 | val_loss: 0.031199 | Time: 4631.64 ms
[2022-04-11 09:34:50 main:574] : INFO : Epoch 1705 | loss: 0.0312009 | val_loss: 0.0311992 | Time: 4445.17 ms
[2022-04-11 09:34:56 main:574] : INFO : Epoch 1706 | loss: 0.0312014 | val_loss: 0.0311999 | Time: 4592.17 ms
[2022-04-11 09:35:01 main:574] : INFO : Epoch 1707 | loss: 0.0312023 | val_loss: 0.0311994 | Time: 4545.54 ms
[2022-04-11 09:35:06 main:574] : INFO : Epoch 1708 | loss: 0.0312012 | val_loss: 0.0312014 | Time: 4469.45 ms
[2022-04-11 09:35:11 main:574] : INFO : Epoch 1709 | loss: 0.0312025 | val_loss: 0.031202 | Time: 4542.91 ms
[2022-04-11 09:35:16 main:574] : INFO : Epoch 1710 | loss: 0.0312016 | val_loss: 0.0312001 | Time: 4693.35 ms
[2022-04-11 09:35:22 main:574] : INFO : Epoch 1711 | loss: 0.0312012 | val_loss: 0.0311993 | Time: 4510.44 ms
[2022-04-11 09:35:27 main:574] : INFO : Epoch 1712 | loss: 0.0312003 | val_loss: 0.0311995 | Time: 4496.77 ms
[2022-04-11 09:35:32 main:574] : INFO : Epoch 1713 | loss: 0.0312015 | val_loss: 0.0312027 | Time: 4570.27 ms
[2022-04-11 09:35:37 main:574] : INFO : Epoch 1714 | loss: 0.0312012 | val_loss: 0.031201 | Time: 4525.11 ms
[2022-04-11 09:35:42 main:574] : INFO : Epoch 1715 | loss: 0.0312037 | val_loss: 0.0312 | Time: 4750.85 ms
[2022-04-11 09:35:48 main:574] : INFO : Epoch 1716 | loss: 0.0312002 | val_loss: 0.0311995 | Time: 4629.35 ms
[2022-04-11 09:35:53 main:574] : INFO : Epoch 1717 | loss: 0.0312004 | val_loss: 0.0312005 | Time: 4477.74 ms
[2022-04-11 09:35:58 main:574] : INFO : Epoch 1718 | loss: 0.0312004 | val_loss: 0.0311988 | Time: 4556 ms
[2022-04-11 09:36:03 main:574] : INFO : Epoch 1719 | loss: 0.0312003 | val_loss: 0.0311997 | Time: 4454.89 ms
[2022-04-11 09:36:08 main:574] : INFO : Epoch 1720 | loss: 0.0312014 | val_loss: 0.0311999 | Time: 4535.14 ms
[2022-04-11 09:36:14 main:574] : INFO : Epoch 1721 | loss: 0.0312 | val_loss: 0.0311979 | Time: 4564.64 ms
[2022-04-11 09:36:19 main:574] : INFO : Epoch 1722 | loss: 0.0312008 | val_loss: 0.0312012 | Time: 4613.37 ms
[2022-04-11 09:36:24 main:574] : INFO : Epoch 1723 | loss: 0.0312012 | val_loss: 0.0312049 | Time: 4577.45 ms
[2022-04-11 09:36:29 main:574] : INFO : Epoch 1724 | loss: 0.031204 | val_loss: 0.0312133 | Time: 4630.29 ms
[2022-04-11 09:36:35 main:574] : INFO : Epoch 1725 | loss: 0.0312036 | val_loss: 0.0311993 | Time: 4501.47 ms
[2022-04-11 09:36:40 main:574] : INFO : Epoch 1726 | loss: 0.031199 | val_loss: 0.0311978 | Time: 4523.26 ms
[2022-04-11 09:36:45 main:574] : INFO : Epoch 1727 | loss: 0.0311989 | val_loss: 0.0311983 | Time: 4542.21 ms
[2022-04-11 09:36:50 main:574] : INFO : Epoch 1728 | loss: 0.0311988 | val_loss: 0.0311992 | Time: 4554.6 ms
[2022-04-11 09:36:55 main:574] : INFO : Epoch 1729 | loss: 0.0312004 | val_loss: 0.0311979 | Time: 4519 ms
[2022-04-11 09:37:00 main:574] : INFO : Epoch 1730 | loss: 0.0311988 | val_loss: 0.0311977 | Time: 4525.97 ms
[2022-04-11 09:37:05 main:574] : INFO : Epoch 1731 | loss: 0.0311996 | val_loss: 0.0311987 | Time: 4551.34 ms
[2022-04-11 09:37:10 main:574] : INFO : Epoch 1732 | loss: 0.0311989 | val_loss: 0.0311981 | Time: 4556.11 ms
[2022-04-11 09:37:16 main:574] : INFO : Epoch 1733 | loss: 0.0311983 | val_loss: 0.0312041 | Time: 4625.6 ms
[2022-04-11 09:37:21 main:574] : INFO : Epoch 1734 | loss: 0.031205 | val_loss: 0.0312094 | Time: 4511.45 ms
[2022-04-11 09:37:26 main:574] : INFO : Epoch 1735 | loss: 0.0312024 | val_loss: 0.031198 | Time: 4681.96 ms
[2022-04-11 09:37:31 main:574] : INFO : Epoch 1736 | loss: 0.0311982 | val_loss: 0.031198 | Time: 4547.81 ms
[2022-04-11 09:37:36 main:574] : INFO : Epoch 1737 | loss: 0.0312002 | val_loss: 0.0312036 | Time: 4672.07 ms
[2022-04-11 09:37:41 main:574] : INFO : Epoch 1738 | loss: 0.0312006 | val_loss: 0.0312074 | Time: 4501.11 ms
[2022-04-11 09:37:47 main:574] : INFO : Epoch 1739 | loss: 0.031199 | val_loss: 0.0311963 | Time: 4569.66 ms
[2022-04-11 09:37:51 main:574] : INFO : Epoch 1740 | loss: 0.0311983 | val_loss: 0.0311963 | Time: 4543.6 ms
[2022-04-11 09:37:57 main:574] : INFO : Epoch 1741 | loss: 0.0311974 | val_loss: 0.0311999 | Time: 4568.92 ms
[2022-04-11 09:38:01 main:574] : INFO : Epoch 1742 | loss: 0.0311987 | val_loss: 0.0311969 | Time: 4535.64 ms
[2022-04-11 09:38:06 main:574] : INFO : Epoch 1743 | loss: 0.0311986 | val_loss: 0.0311969 | Time: 4525.57 ms
[2022-04-11 09:38:12 main:574] : INFO : Epoch 1744 | loss: 0.0312008 | val_loss: 0.031199 | Time: 4609.37 ms
[2022-04-11 09:38:17 main:574] : INFO : Epoch 1745 | loss: 0.0311981 | val_loss: 0.0311966 | Time: 4514.97 ms
[2022-04-11 09:38:22 main:574] : INFO : Epoch 1746 | loss: 0.0312006 | val_loss: 0.0312013 | Time: 4541.02 ms
[2022-04-11 09:38:27 main:574] : INFO : Epoch 1747 | loss: 0.0311983 | val_loss: 0.0312012 | Time: 4449.78 ms
[2022-04-11 09:38:32 main:574] : INFO : Epoch 1748 | loss: 0.0311973 | val_loss: 0.0311978 | Time: 4563.19 ms
[2022-04-11 09:38:37 main:574] : INFO : Epoch 1749 | loss: 0.0311971 | val_loss: 0.0312106 | Time: 4541.65 ms
[2022-04-11 09:38:43 main:574] : INFO : Epoch 1750 | loss: 0.0312019 | val_loss: 0.0312122 | Time: 4568.28 ms
[2022-04-11 09:38:48 main:574] : INFO : Epoch 1751 | loss: 0.0312009 | val_loss: 0.0311969 | Time: 4511.28 ms
[2022-04-11 09:38:53 main:574] : INFO : Epoch 1752 | loss: 0.0311961 | val_loss: 0.0311979 | Time: 4530.48 ms
[2022-04-11 09:38:58 main:574] : INFO : Epoch 1753 | loss: 0.0311966 | val_loss: 0.0311967 | Time: 4505.5 ms
[2022-04-11 09:39:03 main:574] : INFO : Epoch 1754 | loss: 0.0311983 | val_loss: 0.0311998 | Time: 4531.69 ms
[2022-04-11 09:39:08 main:574] : INFO : Epoch 1755 | loss: 0.0311983 | val_loss: 0.031196 | Time: 4417.28 ms
[2022-04-11 09:39:13 main:574] : INFO : Epoch 1756 | loss: 0.0311962 | val_loss: 0.0311959 | Time: 4577.93 ms
[2022-04-11 09:39:18 main:574] : INFO : Epoch 1757 | loss: 0.0311965 | val_loss: 0.0312014 | Time: 4446.13 ms
[2022-04-11 09:39:23 main:574] : INFO : Epoch 1758 | loss: 0.0311971 | val_loss: 0.0311972 | Time: 4694.47 ms
[2022-04-11 09:39:28 main:574] : INFO : Epoch 1759 | loss: 0.031198 | val_loss: 0.0311975 | Time: 4486.3 ms
[2022-04-11 09:39:33 main:574] : INFO : Epoch 1760 | loss: 0.0311949 | val_loss: 0.0311989 | Time: 4614.78 ms
[2022-04-11 09:39:38 main:574] : INFO : Epoch 1761 | loss: 0.0311965 | val_loss: 0.0312029 | Time: 4501.12 ms
[2022-04-11 09:39:43 main:574] : INFO : Epoch 1762 | loss: 0.0311966 | val_loss: 0.0311971 | Time: 4473.8 ms
[2022-04-11 09:39:48 main:574] : INFO : Epoch 1763 | loss: 0.0311967 | val_loss: 0.0312069 | Time: 4763.21 ms
[2022-04-11 09:39:52 main:574] : INFO : Epoch 1764 | loss: 0.0311987 | val_loss: 0.0311977 | Time: 4447.73 ms
[2022-04-11 09:39:58 main:574] : INFO : Epoch 1765 | loss: 0.0311948 | val_loss: 0.0311961 | Time: 4567.8 ms
[2022-04-11 09:40:04 main:574] : INFO : Epoch 1766 | loss: 0.0311966 | val_loss: 0.0311964 | Time: 4558.49 ms
[2022-04-11 09:40:09 main:574] : INFO : Epoch 1767 | loss: 0.0311972 | val_loss: 0.031195 | Time: 4497.87 ms
[2022-04-11 09:40:15 main:574] : INFO : Epoch 1768 | loss: 0.0311958 | val_loss: 0.031196 | Time: 4572.93 ms
[2022-04-11 09:40:20 main:574] : INFO : Epoch 1769 | loss: 0.0311963 | val_loss: 0.0311958 | Time: 4538.1 ms
[2022-04-11 09:40:25 main:574] : INFO : Epoch 1770 | loss: 0.0311969 | val_loss: 0.0312053 | Time: 4502.33 ms
[2022-04-11 09:40:30 main:574] : INFO : Epoch 1771 | loss: 0.0311994 | val_loss: 0.0312006 | Time: 4331.3 ms
[2022-04-11 09:40:35 main:574] : INFO : Epoch 1772 | loss: 0.0311965 | val_loss: 0.0311947 | Time: 4512.37 ms
[2022-04-11 09:40:41 main:574] : INFO : Epoch 1773 | loss: 0.0311958 | val_loss: 0.0311966 | Time: 4474.73 ms
[2022-04-11 09:40:46 main:574] : INFO : Epoch 1774 | loss: 0.0311965 | val_loss: 0.0311977 | Time: 4569.63 ms
[2022-04-11 09:40:51 main:574] : INFO : Epoch 1775 | loss: 0.0311957 | val_loss: 0.031195 | Time: 4565.35 ms
[2022-04-11 09:40:56 main:574] : INFO : Epoch 1776 | loss: 0.0311942 | val_loss: 0.031195 | Time: 4460.63 ms
[2022-04-11 09:41:02 main:574] : INFO : Epoch 1777 | loss: 0.0311934 | val_loss: 0.031195 | Time: 4480.84 ms
[2022-04-11 09:41:07 main:574] : INFO : Epoch 1778 | loss: 0.0311927 | val_loss: 0.0311944 | Time: 4546.23 ms
[2022-04-11 09:41:12 main:574] : INFO : Epoch 1779 | loss: 0.031193 | val_loss: 0.0311952 | Time: 4492.75 ms
[2022-04-11 09:41:18 main:574] : INFO : Epoch 1780 | loss: 0.0311954 | val_loss: 0.0312017 | Time: 4518.98 ms
[2022-04-11 09:41:23 main:574] : INFO : Epoch 1781 | loss: 0.0311987 | val_loss: 0.0311993 | Time: 4413.21 ms
[2022-04-11 09:41:28 main:574] : INFO : Epoch 1782 | loss: 0.031193 | val_loss: 0.0311953 | Time: 4434.02 ms
[2022-04-11 09:41:33 main:574] : INFO : Epoch 1783 | loss: 0.0312 | val_loss: 0.0311979 | Time: 4498.83 ms
[2022-04-11 09:41:38 main:574] : INFO : Epoch 1784 | loss: 0.0311959 | val_loss: 0.0311964 | Time: 4712.64 ms
[2022-04-11 09:41:43 main:574] : INFO : Epoch 1785 | loss: 0.0311935 | val_loss: 0.0311962 | Time: 4598.12 ms
[2022-04-11 09:41:48 main:574] : INFO : Epoch 1786 | loss: 0.0311928 | val_loss: 0.0311955 | Time: 4606.61 ms
[2022-04-11 09:41:53 main:574] : INFO : Epoch 1787 | loss: 0.0311928 | val_loss: 0.0311945 | Time: 4772.12 ms
[2022-04-11 09:41:59 main:574] : INFO : Epoch 1788 | loss: 0.0311934 | val_loss: 0.0311989 | Time: 4533.35 ms
[2022-04-11 09:42:03 main:574] : INFO : Epoch 1789 | loss: 0.0311966 | val_loss: 0.0311976 | Time: 4574.03 ms
[2022-04-11 09:42:09 main:574] : INFO : Epoch 1790 | loss: 0.031196 | val_loss: 0.0311966 | Time: 4498.39 ms
[2022-04-11 09:42:14 main:574] : INFO : Epoch 1791 | loss: 0.0311929 | val_loss: 0.0311976 | Time: 4600.84 ms
[2022-04-11 09:42:19 main:574] : INFO : Epoch 1792 | loss: 0.0311927 | val_loss: 0.0311943 | Time: 4423.82 ms
[2022-04-11 09:42:24 main:574] : INFO : Epoch 1793 | loss: 0.0311912 | val_loss: 0.0311957 | Time: 4715.42 ms
[2022-04-11 09:42:30 main:574] : INFO : Epoch 1794 | loss: 0.0311921 | val_loss: 0.0311936 | Time: 4473.24 ms
[2022-04-11 09:42:35 main:574] : INFO : Epoch 1795 | loss: 0.0311912 | val_loss: 0.0312012 | Time: 4430.78 ms
[2022-04-11 09:42:40 main:574] : INFO : Epoch 1796 | loss: 0.0311907 | val_loss: 0.0311947 | Time: 4463.23 ms
[2022-04-11 09:42:45 main:574] : INFO : Epoch 1797 | loss: 0.0311903 | val_loss: 0.0311957 | Time: 4440.89 ms
[2022-04-11 09:42:50 main:574] : INFO : Epoch 1798 | loss: 0.0311922 | val_loss: 0.0312005 | Time: 4503.22 ms
[2022-04-11 09:42:55 main:574] : INFO : Epoch 1799 | loss: 0.03119 | val_loss: 0.0311948 | Time: 4512.83 ms
[2022-04-11 09:43:01 main:574] : INFO : Epoch 1800 | loss: 0.0311895 | val_loss: 0.0311932 | Time: 4510.78 ms
[2022-04-11 09:43:06 main:574] : INFO : Epoch 1801 | loss: 0.0311907 | val_loss: 0.0311936 | Time: 4581.08 ms
[2022-04-11 09:43:11 main:574] : INFO : Epoch 1802 | loss: 0.0311894 | val_loss: 0.0311951 | Time: 4523.03 ms
[2022-04-11 09:43:16 main:574] : INFO : Epoch 1803 | loss: 0.0311903 | val_loss: 0.0311938 | Time: 4498.74 ms
[2022-04-11 09:43:21 main:574] : INFO : Epoch 1804 | loss: 0.0311914 | val_loss: 0.0312068 | Time: 4520.45 ms
[2022-04-11 09:43:26 main:574] : INFO : Epoch 1805 | loss: 0.0311948 | val_loss: 0.0311939 | Time: 4449.71 ms
[2022-04-11 09:43:31 main:574] : INFO : Epoch 1806 | loss: 0.03119 | val_loss: 0.0311951 | Time: 4481.4 ms
[2022-04-11 09:43:36 main:574] : INFO : Epoch 1807 | loss: 0.0311906 | val_loss: 0.0311959 | Time: 4410.33 ms
[2022-04-11 09:43:42 main:574] : INFO : Epoch 1808 | loss: 0.0311887 | val_loss: 0.0311935 | Time: 4596.73 ms
[2022-04-11 09:43:47 main:574] : INFO : Epoch 1809 | loss: 0.0311896 | val_loss: 0.0311987 | Time: 4562.84 ms
[2022-04-11 09:43:52 main:574] : INFO : Epoch 1810 | loss: 0.0311907 | val_loss: 0.0311966 | Time: 4589.86 ms
[2022-04-11 09:43:57 main:574] : INFO : Epoch 1811 | loss: 0.0311922 | val_loss: 0.0312035 | Time: 4489.84 ms
[2022-04-11 09:44:02 main:574] : INFO : Epoch 1812 | loss: 0.0311911 | val_loss: 0.0311938 | Time: 4515.25 ms
[2022-04-11 09:44:08 main:574] : INFO : Epoch 1813 | loss: 0.0311913 | val_loss: 0.0311979 | Time: 4541.81 ms
[2022-04-11 09:44:13 main:574] : INFO : Epoch 1814 | loss: 0.0311915 | val_loss: 0.031196 | Time: 4634.79 ms
[2022-04-11 09:44:18 main:574] : INFO : Epoch 1815 | loss: 0.0311896 | val_loss: 0.0311931 | Time: 4605.23 ms
[2022-04-11 09:44:23 main:574] : INFO : Epoch 1816 | loss: 0.0311897 | val_loss: 0.0311943 | Time: 4466.17 ms
[2022-04-11 09:44:28 main:574] : INFO : Epoch 1817 | loss: 0.0311887 | val_loss: 0.0311976 | Time: 4540.58 ms
[2022-04-11 09:44:34 main:574] : INFO : Epoch 1818 | loss: 0.0311889 | val_loss: 0.0311929 | Time: 4560.39 ms
[2022-04-11 09:44:39 main:574] : INFO : Epoch 1819 | loss: 0.0311919 | val_loss: 0.0311984 | Time: 4674.26 ms
[2022-04-11 09:44:45 main:574] : INFO : Epoch 1820 | loss: 0.0311886 | val_loss: 0.0311937 | Time: 4528.75 ms
[2022-04-11 09:44:49 main:574] : INFO : Epoch 1821 | loss: 0.0311904 | val_loss: 0.031194 | Time: 4458.2 ms
[2022-04-11 09:44:55 main:574] : INFO : Epoch 1822 | loss: 0.0311876 | val_loss: 0.0311936 | Time: 4652.46 ms
[2022-04-11 09:45:01 main:574] : INFO : Epoch 1823 | loss: 0.0311875 | val_loss: 0.0311971 | Time: 4596.33 ms
[2022-04-11 09:45:05 main:574] : INFO : Epoch 1824 | loss: 0.0311877 | val_loss: 0.031194 | Time: 4504.44 ms
[2022-04-11 09:45:11 main:574] : INFO : Epoch 1825 | loss: 0.031187 | val_loss: 0.0311988 | Time: 4545.58 ms
[2022-04-11 09:45:16 main:574] : INFO : Epoch 1826 | loss: 0.0311896 | val_loss: 0.0311963 | Time: 4586.02 ms
[2022-04-11 09:45:21 main:574] : INFO : Epoch 1827 | loss: 0.0311867 | val_loss: 0.0311949 | Time: 4499.37 ms
[2022-04-11 09:45:26 main:574] : INFO : Epoch 1828 | loss: 0.0311867 | val_loss: 0.031194 | Time: 4507.08 ms
[2022-04-11 09:45:31 main:574] : INFO : Epoch 1829 | loss: 0.0311869 | val_loss: 0.0311963 | Time: 4617.88 ms
[2022-04-11 09:45:36 main:574] : INFO : Epoch 1830 | loss: 0.0311874 | val_loss: 0.0311959 | Time: 4644.72 ms
[2022-04-11 09:45:42 main:574] : INFO : Epoch 1831 | loss: 0.0311887 | val_loss: 0.031196 | Time: 4497.96 ms
[2022-04-11 09:45:47 main:574] : INFO : Epoch 1832 | loss: 0.0311924 | val_loss: 0.031194 | Time: 4640.05 ms
[2022-04-11 09:45:52 main:574] : INFO : Epoch 1833 | loss: 0.0311935 | val_loss: 0.0311946 | Time: 4612.4 ms
[2022-04-11 09:45:57 main:574] : INFO : Epoch 1834 | loss: 0.0311948 | val_loss: 0.0311931 | Time: 4571.17 ms
[2022-04-11 09:46:03 main:574] : INFO : Epoch 1835 | loss: 0.0311944 | val_loss: 0.0311927 | Time: 4563.52 ms
[2022-04-11 09:46:07 main:574] : INFO : Epoch 1836 | loss: 0.0311933 | val_loss: 0.0311914 | Time: 4518.88 ms
[2022-04-11 09:46:13 main:574] : INFO : Epoch 1837 | loss: 0.031191 | val_loss: 0.0311938 | Time: 4483.18 ms
[2022-04-11 09:46:18 main:574] : INFO : Epoch 1838 | loss: 0.0311904 | val_loss: 0.0311907 | Time: 4874.49 ms
[2022-04-11 09:46:23 main:574] : INFO : Epoch 1839 | loss: 0.0311896 | val_loss: 0.0311916 | Time: 4505.98 ms
[2022-04-11 09:46:29 main:574] : INFO : Epoch 1840 | loss: 0.0311895 | val_loss: 0.0311951 | Time: 4514.18 ms
[2022-04-11 09:46:34 main:574] : INFO : Epoch 1841 | loss: 0.0311896 | val_loss: 0.0311937 | Time: 4444.43 ms
[2022-04-11 09:46:39 main:574] : INFO : Epoch 1842 | loss: 0.0311903 | val_loss: 0.0311985 | Time: 4635.86 ms
[2022-04-11 09:46:44 main:574] : INFO : Epoch 1843 | loss: 0.0311893 | val_loss: 0.0311942 | Time: 4449.26 ms
[2022-04-11 09:46:50 main:574] : INFO : Epoch 1844 | loss: 0.0311895 | val_loss: 0.0311951 | Time: 4513.99 ms
[2022-04-11 09:46:55 main:574] : INFO : Epoch 1845 | loss: 0.0311903 | val_loss: 0.0311911 | Time: 4485.54 ms
[2022-04-11 09:47:00 main:574] : INFO : Epoch 1846 | loss: 0.0311896 | val_loss: 0.0311914 | Time: 4531.06 ms
[2022-04-11 09:47:06 main:574] : INFO : Epoch 1847 | loss: 0.0311884 | val_loss: 0.0311918 | Time: 4549.51 ms
[2022-04-11 09:47:11 main:574] : INFO : Epoch 1848 | loss: 0.0311891 | val_loss: 0.0311934 | Time: 4525.28 ms
[2022-04-11 09:47:17 main:574] : INFO : Epoch 1849 | loss: 0.0311881 | val_loss: 0.0311923 | Time: 4505.64 ms
[2022-04-11 09:47:22 main:574] : INFO : Epoch 1850 | loss: 0.0311884 | val_loss: 0.0311925 | Time: 4484.42 ms
[2022-04-11 09:47:27 main:574] : INFO : Epoch 1851 | loss: 0.031188 | val_loss: 0.031193 | Time: 4545.59 ms
[2022-04-11 09:47:32 main:574] : INFO : Epoch 1852 | loss: 0.031188 | val_loss: 0.0311918 | Time: 4636.71 ms
[2022-04-11 09:47:37 main:574] : INFO : Epoch 1853 | loss: 0.0311879 | val_loss: 0.0311926 | Time: 4598.2 ms
[2022-04-11 09:47:42 main:574] : INFO : Epoch 1854 | loss: 0.0311897 | val_loss: 0.0311958 | Time: 4565.02 ms
[2022-04-11 09:47:47 main:574] : INFO : Epoch 1855 | loss: 0.0311907 | val_loss: 0.0311939 | Time: 4453.86 ms
[2022-04-11 09:47:53 main:574] : INFO : Epoch 1856 | loss: 0.0311876 | val_loss: 0.0311928 | Time: 4564.66 ms
[2022-04-11 09:47:58 main:574] : INFO : Epoch 1857 | loss: 0.0311883 | val_loss: 0.031193 | Time: 4519.25 ms
[2022-04-11 09:48:03 main:574] : INFO : Epoch 1858 | loss: 0.0311893 | val_loss: 0.0311988 | Time: 4819.55 ms
[2022-04-11 09:48:09 main:574] : INFO : Epoch 1859 | loss: 0.0311903 | val_loss: 0.0311938 | Time: 4491.72 ms
[2022-04-11 09:48:14 main:574] : INFO : Epoch 1860 | loss: 0.0311867 | val_loss: 0.0311924 | Time: 4495.11 ms
[2022-04-11 09:48:19 main:574] : INFO : Epoch 1861 | loss: 0.0311902 | val_loss: 0.0311916 | Time: 4455.69 ms
[2022-04-11 09:48:24 main:574] : INFO : Epoch 1862 | loss: 0.0311916 | val_loss: 0.0311966 | Time: 4563.74 ms
[2022-04-11 09:48:29 main:574] : INFO : Epoch 1863 | loss: 0.0311945 | val_loss: 0.0311943 | Time: 4519.42 ms
[2022-04-11 09:48:34 main:574] : INFO : Epoch 1864 | loss: 0.0311897 | val_loss: 0.0311909 | Time: 4494.75 ms
[2022-04-11 09:48:39 main:574] : INFO : Epoch 1865 | loss: 0.0311881 | val_loss: 0.0311961 | Time: 4513.47 ms
[2022-04-11 09:48:45 main:574] : INFO : Epoch 1866 | loss: 0.0311882 | val_loss: 0.0311916 | Time: 4511.49 ms
[2022-04-11 09:48:50 main:574] : INFO : Epoch 1867 | loss: 0.0311908 | val_loss: 0.0311958 | Time: 4479.2 ms
[2022-04-11 09:48:55 main:574] : INFO : Epoch 1868 | loss: 0.0311896 | val_loss: 0.0311908 | Time: 4574.33 ms
[2022-04-11 09:49:02 main:574] : INFO : Epoch 1869 | loss: 0.0311869 | val_loss: 0.0311932 | Time: 4543.49 ms
[2022-04-11 09:49:07 main:574] : INFO : Epoch 1870 | loss: 0.0311873 | val_loss: 0.0311909 | Time: 4479.36 ms
[2022-04-11 09:49:12 main:574] : INFO : Epoch 1871 | loss: 0.0311894 | val_loss: 0.0311916 | Time: 4515.79 ms
[2022-04-11 09:49:18 main:574] : INFO : Epoch 1872 | loss: 0.0311875 | val_loss: 0.031191 | Time: 4512.38 ms
[2022-04-11 09:49:23 main:574] : INFO : Epoch 1873 | loss: 0.0311862 | val_loss: 0.0311917 | Time: 4685.58 ms
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FF83D3990D2
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 04/11/22 09:49:25
Install Directory : D:\BOINC\
Data Directory : E:\BOINC
Project Symstore :
LoadLibraryA( E:\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( E:\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( E:\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( E:\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: E:\BOINC\slots\22;E:\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 00000000a0210000 00000000003df000 E:\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000003f9d0000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 000000003e630000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 000000003d2d0000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 000000003f5c0000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 000000003d200000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1586) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 000000003e410000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.1202 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1202
ModLoad: 000000003d0f0000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1566
ModLoad: 000000003d230000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.789
ModLoad: 000000003d610000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.789
ModLoad: 000000003dd30000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 000000003f8f0000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 7.0.19041.546
ModLoad: 000000003eb00000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.1586) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.320
ModLoad: 000000003f3e0000 0000000000125000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 0000000031660000 0000000000058000 E:\BOINC\slots\22\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000b1e60000 000000000abe7000 E:\BOINC\slots\22\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000027e90000 000000000008d000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.29.29917.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.29.29917.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft? Visual Studio?
Product Version : 14.29.29917.0
ModLoad: 000000002ef30000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.867 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.867
ModLoad: 0000000027f20000 000000000001a000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.29.29917.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.29.29917.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft? Visual Studio?
Product Version : 14.29.29917.0
ModLoad: 0000000027360000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.29.29917.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.29.29917.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft? Visual Studio?
Product Version : 14.29.29917.0
ModLoad: 000000001a200000 000000000020d000 E:\BOINC\slots\22\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 0000000004810000 00000000002db000 E:\BOINC\slots\22\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000031600000 0000000000040000 E:\BOINC\slots\22\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000054170000 0000000024b49000 E:\BOINC\slots\22\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000315b0000 0000000000045000 E:\BOINC\slots\22\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000cdb50000 00000000030a5000 E:\BOINC\slots\22\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 00000000ae9a0000 00000000034b2000 E:\BOINC\slots\22\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 0000000038c50000 0000000000010000 E:\BOINC\slots\22\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 0000000038dc0000 000000001b3a4000 E:\BOINC\slots\22\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 00000000a5800000 000000000919f000 E:\BOINC\slots\22\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 00000000a1aa0000 0000000003d5b000 E:\BOINC\slots\22\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000db610000 0000000001eca000 E:\BOINC\slots\22\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 000000003ead0000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.546
ModLoad: 000000003b020000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.546
ModLoad: 000000003de40000 0000000000470000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 000000003d9e0000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1151
ModLoad: 000000003d9b0000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 000000003ce90000 0000000000033000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1566
ModLoad: 000000003d5a0000 0000000000068000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1566
ModLoad: 000000003d710000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 000000003ccd0000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.546
ModLoad: 000000003eba0000 0000000000744000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 000000003b220000 0000000000794000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 000000003e6f0000 0000000000354000 C:\WINDOWS\System32\combase.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 000000003cb50000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 000000003e570000 00000000000ad000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 000000003dde0000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 00000000f9690000 00000000002cd000 C:\WINDOWS\system32\nvcuda.dll (30.0.15.1215) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r512_08\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 30.0.15.1215
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.6.127 driver
Product Version : 30.0.15.1215
ModLoad: 00000000d8b60000 000000000169f000 C:\WINDOWS\system32\DriverStore\FileRepository\nvmdi.inf_amd64_2b01a28ee7b06750\nvcuda64.dll (30.0.15.1215) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r512_08\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 30.0.15.1215
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.6.127 driver
Product Version : 30.0.15.1215
ModLoad: 0000000035d20000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000035ce0000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.906 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.906
ModLoad: 0000000035b90000 0000000000148000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : drvstore.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1566
ModLoad: 000000003caa0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.546
ModLoad: 000000002f1f0000 0000000000768000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.15.1215) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r512_08\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 30.0.15.1215
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 30.0.15.1215
ModLoad: 00000000f09c0000 00000000008b3000 C:\WINDOWS\System32\DriverStore\FileRepository\nvmdi.inf_amd64_2b01a28ee7b06750\nvptxJitCompiler64.dll (30.0.15.1215) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 30.0.15.1215
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows PTX JIT Compiler
Product Version : 30.0.15.1215
ModLoad: 0000000032610000 0000000000009000 E:\BOINC\slots\22\caffe2_nvrtc.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000e9c80000 0000000000fca000 E:\BOINC\slots\22\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6.14.11.9000
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.89 NVRTC Library
Product Version : 6.14.11.9000
ModLoad: 000000003d920000 0000000000082000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.1415 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1415
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 7001, Write: 13653, Other 108769
- I/O Transfers Counters -
Read: 48228869, Write: -1937923189, Other 528948
- Paged Pool Usage -
QuotaPagedPoolUsage: 3538424, QuotaPeakPagedPoolUsage: 3538424
QuotaNonPagedPoolUsage: 56840, QuotaPeakNonPagedPoolUsage: 73568
- Virtual Memory Usage -
VirtualSize: 305721344, PeakVirtualSize: 1304813568
- Pagefile Usage -
PagefileUsage: 305721344, PeakPagefileUsage: 305729536
- Working Set Size -
WorkingSetSize: -1936535552, PeakWorkingSetSize: -1661526016, PageFaultCount: 41438913
*** Dump of thread ID 28184 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 52975332.000000
- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FF83D3990D2
- Registers -
rax=0000000000000000 rbx=0000000000000001 rcx=00000000a04c8c40 rdx=00000000543fe480 rsi=0000000000000000 rdi=0000000000000000
r8=00000000543fe480 r9=00000000a04c8c30 r10=0000000000000fff r11=0000000000000ff0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000003d3990d2 rsp=00000000543fe458 rbp=0000000000000000
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
543fe450 a0249100 00000001 543fe480 543fe480 a04c8c30 KERNELBASE!DebugBreak+0x0
543fe890 a0249ce4 99400000 543febf4 00000000 0000036c mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
543ff7f0 a024a084 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
543ff820 3e647034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
543ff850 3fa22651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
543ff8d0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 19216 (state: Ready): ***
- Information -
Status: Base Priority: Above Normal, Priority: Above Normal, , Kernel Time: 640937472.000000, User Time: 42499063808.000000, Wait Time: 52975332.000000
- Registers -
rax=00000000ffffffff rbx=0000000015a732b0 rcx=00000000d8e0c9b5 rdx=0000000053edfea8 rsi=0000000094ba23e0 rdi=0000000094ee6430
r8=000000000e8b5170 r9=00000000e10fd0a8 r10=00000000d8b60000 r11=0000000000000003 r12=0000000015a732b0 r13=0000000000000000
r14=0000000000000080 r15=0000000053ee0880 rip=00000000d8ecc241 rsp=0000000053edfe60 rbp=0000000053edffa0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000202
- Callstack -
ChildEBP RetAddr Args to Child
53edfe90 d8cf1815 948dc610 aae77634 53edffa0 948dc610 nvcuda64!cuProfilerStop+0x0
53ee04d0 d8ea2a65 53ee0600 00000008 53ee05e0 00000020 nvcuda64!+0x0
53ee0610 d8b9c464 14ee8940 53ee0880 14ee8940 53ee0aa0 nvcuda64!cuProfilerStop+0x0
53ee06e0 d8b9ca57 53ee07f0 948dc610 53ee07f0 14ee8940 nvcuda64!+0x0
53ee0a50 d8d9c8bc 00000003 00000000 00000000 00000000 nvcuda64!+0x0
53ee0bc0 39b629b6 00000000 00000003 00000010 39b756a0 nvcuda64!cuEventRecordWithFlags+0x0
53ee0cd0 39b5fdf4 39b756a0 9309ffd0 14ee8940 53ee0ef0 cudnn64_7!cudnnSetDropoutDescriptor+0x0
53ee0e50 39b76325 39b756a0 53ee1cf8 39b756a0 00000009 cudnn64_7!cudnnSetDropoutDescriptor+0x0
53ee0f70 39b79441 39a6c000 39a90000 391c5000 00000024 cudnn64_7!cudnnSetDropoutDescriptor+0x0
53ee1050 39b78493 d734e630 00000024 d6290d10 00000000 cudnn64_7!cudnnSetDropoutDescriptor+0x0
53ee1100 39b7803c d734e630 d6290d10 53ee12d0 00000009 cudnn64_7!cudnnSetDropoutDescriptor+0x0
53ee1190 39b791a7 00000009 53ee12d0 00000100 391c5000 cudnn64_7!cudnnSetDropoutDescriptor+0x0
53ee1300 39bbcd01 00000000 53ee1cf8 00000000 53ee18d0 cudnn64_7!cudnnSetDropoutDescriptor+0x0
53ee1420 39bc5e12 00000000 00000000 d6290d10 00000000 cudnn64_7!cudnnSetDropoutDescriptor+0x0
53ee15a0 39bc4cd9 00000000 00000000 00000000 0000000f cudnn64_7!cudnnSetDropoutDescriptor+0x0
53ee16b0 39bc4504 d6290d10 00000000 00000000 00000024 cudnn64_7!cudnnSetDropoutDescriptor+0x0
53ee1980 39bc700e 53ee19c8 00000001 e06cc800 9309ff40 cudnn64_7!cudnnSetDropoutDescriptor+0x0
53ee1a70 39ac82ca d6290d10 00000000 00000000 00000024 cudnn64_7!cudnnSetDropoutDescriptor+0x0
53ee1b40 39ada9bb 00000009 39a6c000 00000000 00000000 cudnn64_7!cudnnSetAttnDescriptor+0x0
53ee1ff0 39aceff1 53ee42d8 d9502dd0 00000005 41325450 cudnn64_7!cudnnSetRNNProjectionLayers+0x0
53ee2190 39ad7d8e d6bd1000 00000000 41325450 53ee2458 cudnn64_7!cudnnSetRNNProjectionLayers+0x0
53ee2330 39aedcd3 00000000 00000000 1d300190 53ee2450 cudnn64_7!cudnnSetRNNProjectionLayers+0x0
53ee44c0 56ee89fd d6bcaa20 39a00000 d6bcaa20 d9502dd0 cudnn64_7!cudnnRNNForwardTraining+0x0
53ee49a0 56f425ea 53ee4a68 00000001 53ee4a68 00000001 torch_cuda!at::native::_cudnn_rnn+0x0
53ee4a80 56f50cbf 53ee5170 53ee6978 53ee5ac0 3f9fb86b torch_cuda!at::native::set_storage_cuda_+0x0
53ee4b60 b78ab9fc 53ee5170 00000000 276d52b0 276d5280 torch_cuda!at::native::set_storage_cuda_+0x0
53ee4ce0 b78e31a2 00000001 b90567c2 53ee4d14 3f9fb86b torch_cpu!at::native::mkldnn_sigmoid_+0x0
53ee4fc0 b8b92613 00000000 00000000 00000003 86d2d8d8 torch_cpu!at::_cudnn_rnn+0x0
53ee54c0 b8ba080b a73ff59d df5ac6d0 53ee55f0 00000004 torch_cpu!torch::autograd::NotImplemented::~NotImplemented+0x0
53ee55a0 b78ab9fc 53ee5b20 b8cc5878 53ee5700 d8b87a77 torch_cpu!torch::autograd::GraphRoot::apply+0x0
53ee5720 b78e31a2 413254c0 00000000 a73ff36d 57e0a3f0 torch_cpu!at::native::mkldnn_sigmoid_+0x0
53ee5a00 56ee69a1 53ee0001 00000001 00000004 00000004 torch_cpu!at::_cudnn_rnn+0x0
53ee5bd0 56ef0117 00000000 53ee6978 315b2e0d 53ee5cf0 torch_cuda!at::native::_use_cudnn_ctc_loss+0x0
53ee5c60 b763107b bc781ac0 53ee5f80 18c57886 d8d57783 torch_cuda!at::native::_cudnn_rnn_flatten_weight+0x0
53ee5ed0 b7663b16 00000001 53ee6978 00000080 dd814f28 torch_cpu!at::native::fbgemm_pack_quantized_matrix+0x0
53ee6060 b79dae89 53ee60d8 00000001 53ee60d8 00000001 torch_cpu!at::native::gru+0x0
53ee60f0 b8cc9fa3 53ee61f0 00000001 53ee6370 53ee6978 torch_cpu!at::zeros_out+0x0
53ee6180 b79cdd35 316b1ea8 93fcd810 00000000 316b1ea8 torch_cpu!torch::autograd::GraphRoot::apply+0x0
53ee6200 b78a88ec bc7875c8 dd298220 d734e680 53ee6420 torch_cpu!at::zeros_out+0x0
53ee6300 b791c1bb 0000000c 00000080 00000004 df5ac300 torch_cpu!at::native::mkldnn_sigmoid_+0x0
53ee6380 b9407294 53ee64a0 dd298220 53ee6490 53ee6638 torch_cpu!at::gru+0x0
53ee65b0 b94062ab 53ee6950 b783030e 53ee6950 53ee6978 torch_cpu!torch::nn::GRUImpl::forward_helper+0x0
53ee66a0 a0222621 00000006 53ee73b0 00000000 316b1ea8 torch_cpu!torch::nn::GRUImpl::forward+0x0
53ee68a0 a022705a 00000000 53ee0000 53ee0601 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::error+0x0
53ee6da0 a022b950 53ee6ea0 53ee6ea0 00000000 c4e4d0c0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0
53effb40 a046c6f8 9444de40 00000000 00000000 92735c70 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
53effb80 3e647034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
53effbb0 3fa22651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
53effc30 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 3324 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 52975332.000000
- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=00000000544ff910 rsi=0000000000000000 rdi=000000000000000d
r8=0000000000000001 r9=0000000094614300 r10=0000000000000000 r11=00000000544ff880 r12=0000000000000064 r13=00000000544ff910
r14=00000000544ff610 r15=0000000000000000 rip=000000003fa6d8c4 rsp=00000000544ff5b8 rbp=0000000094614330
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
544ff5b0 3d31cb20 00000000 53d7b000 3fb3a4d0 53d7b000 ntdll!ZwWaitForMultipleObjects+0x0
544ff8a0 3d31ca1e 92740f00 004e0049 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
544ff8e0 d8d3d554 94617b10 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0
544ffb20 d8de58cd 00000000 94614330 00000000 00000000 nvcuda64!+0x0
544ffbd0 d8d3cf23 400c094e 0e931cf2 94c084c0 00000000 nvcuda64!cuProfilerStop+0x0
544ffc00 d90741e4 94c084c0 00000000 00000000 00000000 nvcuda64!+0x0
544ffc30 3e647034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
544ffc60 3fa22651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
544ffce0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 13936 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 51485608.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002b8 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002b8
r8=00000000545ff678 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=00000000946e8230 r13=0000000000000000
r14=00000000000002b8 r15=0000000000000000 rip=000000003fa6cdf4 rsp=00000000545ff3f8 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
545ff3f0 3d2f1a5e 00000000 00001f80 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0
545ff490 d8f6596e 94c08250 00000000 00000000 000002b8 KERNELBASE!WaitForSingleObjectEx+0x0
545ff6d0 d8d3cf23 00000000 94c08250 d8b60000 946784d0 nvcuda64!cuProfilerStop+0x0
545ff700 d90741e4 94c08250 00000000 00000000 00000000 nvcuda64!+0x0
545ff730 3e647034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
545ff760 3fa22651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
545ff7e0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 22752 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 329687488.000000, User Time: 12753281024.000000, Wait Time: 52975328.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000e683b4b8 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000e683b4b8
r8=0000000000000070 r9=0000000053ffcf88 r10=0000000027f20000 r11=0000000053ffcb70 r12=0000000000000000 r13=0000000000000000
r14=0000000053fffa10 r15=00000000e683b468 rip=000000003fa70764 rsp=0000000053fff9e8 rbp=0000000053fffa40
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
53fff9e0 3fa34021 53fffce0 00000000 53fffae0 00000000 ntdll!NtWaitForAlertByThreadId+0x0
53fffa60 3d33cfa9 e683b4b0 e683b4a8 e683b460 b90405b4 ntdll!RtlSleepConditionVariableSRW+0x0
53fffaa0 27ea2879 00000000 e935e560 00000000 00000000 KERNELBASE!SleepConditionVariableSRW+0x0
53fffad0 27ea2b0a 026ae311 00000000 53fffce0 e683b4a8 MSVCP140!std::_Winerror_message+0x0
53fffb00 b904064b e683b460 53fffc00 e683b460 e935e540 MSVCP140!_Cnd_wait+0x0
53fffb40 b90425b1 c20c5300 ffffffff e935e540 ffffffff torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
53fffe30 b9042471 bc566d10 53fffe70 bc566d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0
53fffe80 b9039744 00080001 f2e02c90 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0
53fffeb0 3d631bb2 f2e02c90 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0
53fffee0 3e647034 00000000 00000000 00000000 00000000 ucrtbase!_configthreadlocale+0x0
53ffff10 3fa22651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
53ffff90 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)