Task 14597953
| Name | ParityModified-1645998296-31277-2-0_0 |
| Workunit | 11618775 |
| Created | 12 Apr 2022, 1:00:34 UTC |
| Sent | 12 Apr 2022, 1:00:37 UTC |
| Report deadline | 20 Apr 2022, 1:00:37 UTC |
| Received | 12 Apr 2022, 10:27:03 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 197 (0x000000C5) EXIT_TIME_LIMIT_EXCEEDED |
| Computer ID | 4503 |
| Run time | 5 hours 51 min 32 sec |
| CPU time | 48 min 21 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 10,073.24 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 2.08 GB |
| Peak swap size | 4.37 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
exceeded elapsed time limit 21091.09 (4000000.00G/189.65G)</message>
<stderr_txt>
8 | loss: 0.0311129 | val_loss: 0.0311493 | Time: 1168.42 ms
[2022-04-12 04:19:18 main:574] : INFO : Epoch 1719 | loss: 0.0311119 | val_loss: 0.0311424 | Time: 1148.59 ms
[2022-04-12 04:19:20 main:574] : INFO : Epoch 1720 | loss: 0.0311098 | val_loss: 0.0311442 | Time: 1156.94 ms
[2022-04-12 04:19:21 main:574] : INFO : Epoch 1721 | loss: 0.031113 | val_loss: 0.0311442 | Time: 1168.31 ms
[2022-04-12 04:19:22 main:574] : INFO : Epoch 1722 | loss: 0.0311094 | val_loss: 0.0311437 | Time: 1149.9 ms
[2022-04-12 04:19:23 main:574] : INFO : Epoch 1723 | loss: 0.031114 | val_loss: 0.0311452 | Time: 1152.55 ms
[2022-04-12 04:19:24 main:574] : INFO : Epoch 1724 | loss: 0.0311236 | val_loss: 0.0311445 | Time: 1152.76 ms
[2022-04-12 04:19:25 main:574] : INFO : Epoch 1725 | loss: 0.0311167 | val_loss: 0.0311412 | Time: 1158.64 ms
[2022-04-12 04:19:27 main:574] : INFO : Epoch 1726 | loss: 0.0311158 | val_loss: 0.0311476 | Time: 1147.28 ms
[2022-04-12 04:19:28 main:574] : INFO : Epoch 1727 | loss: 0.0311144 | val_loss: 0.0311493 | Time: 1151.44 ms
[2022-04-12 04:19:29 main:574] : INFO : Epoch 1728 | loss: 0.0311142 | val_loss: 0.0311443 | Time: 1151.26 ms
[2022-04-12 04:19:30 main:574] : INFO : Epoch 1729 | loss: 0.0311119 | val_loss: 0.0311445 | Time: 1160.94 ms
[2022-04-12 04:19:31 main:574] : INFO : Epoch 1730 | loss: 0.0311108 | val_loss: 0.0311416 | Time: 1168.3 ms
[2022-04-12 04:19:32 main:574] : INFO : Epoch 1731 | loss: 0.0311125 | val_loss: 0.0311444 | Time: 1172.03 ms
[2022-04-12 04:19:34 main:574] : INFO : Epoch 1732 | loss: 0.0311168 | val_loss: 0.0311443 | Time: 1168.92 ms
[2022-04-12 04:19:35 main:574] : INFO : Epoch 1733 | loss: 0.0311147 | val_loss: 0.0311433 | Time: 1152.98 ms
[2022-04-12 04:19:36 main:574] : INFO : Epoch 1734 | loss: 0.0311085 | val_loss: 0.0311427 | Time: 1168.67 ms
[2022-04-12 04:19:37 main:574] : INFO : Epoch 1735 | loss: 0.031108 | val_loss: 0.0311506 | Time: 1157.77 ms
[2022-04-12 04:19:38 main:574] : INFO : Epoch 1736 | loss: 0.0311069 | val_loss: 0.0311432 | Time: 1174.41 ms
[2022-04-12 04:19:39 main:574] : INFO : Epoch 1737 | loss: 0.0311052 | val_loss: 0.0311474 | Time: 1152.42 ms
[2022-04-12 04:19:41 main:574] : INFO : Epoch 1738 | loss: 0.0311069 | val_loss: 0.031144 | Time: 1165.02 ms
[2022-04-12 04:19:42 main:574] : INFO : Epoch 1739 | loss: 0.0311052 | val_loss: 0.0311444 | Time: 1152.55 ms
[2022-04-12 04:19:43 main:574] : INFO : Epoch 1740 | loss: 0.0311065 | val_loss: 0.0311507 | Time: 1162.05 ms
[2022-04-12 04:19:44 main:574] : INFO : Epoch 1741 | loss: 0.0311071 | val_loss: 0.0311429 | Time: 1156.78 ms
[2022-04-12 04:19:45 main:574] : INFO : Epoch 1742 | loss: 0.0311042 | val_loss: 0.031145 | Time: 1158.56 ms
[2022-04-12 04:19:46 main:574] : INFO : Epoch 1743 | loss: 0.0311055 | val_loss: 0.0311478 | Time: 1155.01 ms
[2022-04-12 04:19:48 main:574] : INFO : Epoch 1744 | loss: 0.0311054 | val_loss: 0.0311425 | Time: 1149.44 ms
[2022-04-12 04:19:49 main:574] : INFO : Epoch 1745 | loss: 0.0311063 | val_loss: 0.0311447 | Time: 1153.31 ms
[2022-04-12 04:19:50 main:574] : INFO : Epoch 1746 | loss: 0.0311068 | val_loss: 0.0311442 | Time: 1156.69 ms
[2022-04-12 04:19:51 main:574] : INFO : Epoch 1747 | loss: 0.031104 | val_loss: 0.0311465 | Time: 1156.11 ms
[2022-04-12 04:19:52 main:574] : INFO : Epoch 1748 | loss: 0.0311035 | val_loss: 0.0311488 | Time: 1163.42 ms
[2022-04-12 04:19:53 main:574] : INFO : Epoch 1749 | loss: 0.0311052 | val_loss: 0.0311489 | Time: 1163.62 ms
[2022-04-12 04:19:54 main:574] : INFO : Epoch 1750 | loss: 0.0311166 | val_loss: 0.0311778 | Time: 1155.69 ms
[2022-04-12 04:19:56 main:574] : INFO : Epoch 1751 | loss: 0.0311246 | val_loss: 0.031152 | Time: 1162.7 ms
[2022-04-12 04:19:57 main:574] : INFO : Epoch 1752 | loss: 0.0311122 | val_loss: 0.0311483 | Time: 1146.61 ms
[2022-04-12 04:19:58 main:574] : INFO : Epoch 1753 | loss: 0.0311139 | val_loss: 0.0311447 | Time: 1154.79 ms
[2022-04-12 04:19:59 main:574] : INFO : Epoch 1754 | loss: 0.0311123 | val_loss: 0.0311472 | Time: 1146.38 ms
[2022-04-12 04:20:00 main:574] : INFO : Epoch 1755 | loss: 0.0311131 | val_loss: 0.0311437 | Time: 1151.46 ms
[2022-04-12 04:20:01 main:574] : INFO : Epoch 1756 | loss: 0.0311121 | val_loss: 0.0311487 | Time: 1152.43 ms
[2022-04-12 04:20:03 main:574] : INFO : Epoch 1757 | loss: 0.0311129 | val_loss: 0.0311474 | Time: 1150.44 ms
[2022-04-12 04:20:04 main:574] : INFO : Epoch 1758 | loss: 0.0311097 | val_loss: 0.0311506 | Time: 1161.43 ms
[2022-04-12 04:20:05 main:574] : INFO : Epoch 1759 | loss: 0.0311072 | val_loss: 0.0311474 | Time: 1153.5 ms
[2022-04-12 04:20:06 main:574] : INFO : Epoch 1760 | loss: 0.0311088 | val_loss: 0.0311463 | Time: 1153.25 ms
[2022-04-12 04:20:07 main:574] : INFO : Epoch 1761 | loss: 0.0311083 | val_loss: 0.0311478 | Time: 1148.33 ms
[2022-04-12 04:20:08 main:574] : INFO : Epoch 1762 | loss: 0.0311085 | val_loss: 0.0311459 | Time: 1148.43 ms
[2022-04-12 04:20:10 main:574] : INFO : Epoch 1763 | loss: 0.0311107 | val_loss: 0.0311448 | Time: 1151.38 ms
[2022-04-12 04:20:11 main:574] : INFO : Epoch 1764 | loss: 0.031109 | val_loss: 0.0311434 | Time: 1180.91 ms
[2022-04-12 04:20:12 main:574] : INFO : Epoch 1765 | loss: 0.0311075 | val_loss: 0.0311476 | Time: 1145.71 ms
[2022-04-12 04:20:13 main:574] : INFO : Epoch 1766 | loss: 0.0311061 | val_loss: 0.0311505 | Time: 1150.7 ms
[2022-04-12 04:20:14 main:574] : INFO : Epoch 1767 | loss: 0.0311086 | val_loss: 0.0311478 | Time: 1157.26 ms
[2022-04-12 04:20:15 main:574] : INFO : Epoch 1768 | loss: 0.0311092 | val_loss: 0.0311475 | Time: 1145.45 ms
[2022-04-12 04:20:17 main:574] : INFO : Epoch 1769 | loss: 0.0311066 | val_loss: 0.0311499 | Time: 1164.83 ms
[2022-04-12 04:20:18 main:574] : INFO : Epoch 1770 | loss: 0.0311064 | val_loss: 0.0311437 | Time: 1149.89 ms
[2022-04-12 04:20:19 main:574] : INFO : Epoch 1771 | loss: 0.031109 | val_loss: 0.0311493 | Time: 1160.28 ms
[2022-04-12 04:20:20 main:574] : INFO : Epoch 1772 | loss: 0.0311133 | val_loss: 0.0311416 | Time: 1170.26 ms
[2022-04-12 04:20:21 main:574] : INFO : Epoch 1773 | loss: 0.0311082 | val_loss: 0.031142 | Time: 1146.65 ms
[2022-04-12 04:20:22 main:574] : INFO : Epoch 1774 | loss: 0.0311078 | val_loss: 0.0311409 | Time: 1170.04 ms
[2022-04-12 04:20:24 main:574] : INFO : Epoch 1775 | loss: 0.0311087 | val_loss: 0.0311384 | Time: 1163.61 ms
[2022-04-12 04:20:25 main:574] : INFO : Epoch 1776 | loss: 0.0311083 | val_loss: 0.031146 | Time: 1160.36 ms
[2022-04-12 04:20:26 main:574] : INFO : Epoch 1777 | loss: 0.0311089 | val_loss: 0.0311414 | Time: 1167.89 ms
[2022-04-12 04:20:27 main:574] : INFO : Epoch 1778 | loss: 0.0311102 | val_loss: 0.0311472 | Time: 1160.41 ms
[2022-04-12 04:20:28 main:574] : INFO : Epoch 1779 | loss: 0.0311134 | val_loss: 0.0311523 | Time: 1175.55 ms
[2022-04-12 04:20:29 main:574] : INFO : Epoch 1780 | loss: 0.0311158 | val_loss: 0.0311451 | Time: 1150.26 ms
[2022-04-12 04:20:31 main:574] : INFO : Epoch 1781 | loss: 0.0311104 | val_loss: 0.031142 | Time: 1156.71 ms
[2022-04-12 04:20:32 main:574] : INFO : Epoch 1782 | loss: 0.0311109 | val_loss: 0.0311465 | Time: 1163.02 ms
[2022-04-12 04:20:33 main:574] : INFO : Epoch 1783 | loss: 0.0311104 | val_loss: 0.0311468 | Time: 1159.93 ms
[2022-04-12 04:20:34 main:574] : INFO : Epoch 1784 | loss: 0.0311073 | val_loss: 0.0311495 | Time: 1196.02 ms
[2022-04-12 04:20:35 main:574] : INFO : Epoch 1785 | loss: 0.0311072 | val_loss: 0.0311427 | Time: 1177.96 ms
[2022-04-12 04:20:36 main:574] : INFO : Epoch 1786 | loss: 0.0311078 | val_loss: 0.0311444 | Time: 1171.26 ms
[2022-04-12 04:20:38 main:574] : INFO : Epoch 1787 | loss: 0.0311067 | val_loss: 0.0311448 | Time: 1195.13 ms
[2022-04-12 04:20:39 main:574] : INFO : Epoch 1788 | loss: 0.0311118 | val_loss: 0.0311428 | Time: 1170.24 ms
[2022-04-12 04:20:40 main:574] : INFO : Epoch 1789 | loss: 0.0311134 | val_loss: 0.0311429 | Time: 1164.95 ms
[2022-04-12 04:20:41 main:574] : INFO : Epoch 1790 | loss: 0.0311112 | val_loss: 0.031144 | Time: 1170.3 ms
[2022-04-12 04:20:42 main:574] : INFO : Epoch 1791 | loss: 0.0311097 | val_loss: 0.0311486 | Time: 1161.11 ms
[2022-04-12 04:20:43 main:574] : INFO : Epoch 1792 | loss: 0.03111 | val_loss: 0.0311462 | Time: 1163.74 ms
[2022-04-12 04:20:55 main:574] : INFO : Epoch 1793 | loss: 0.031108 | val_loss: 0.0311512 | Time: 11522.2 ms
[2022-04-12 04:20:56 main:574] : INFO : Epoch 1794 | loss: 0.0311129 | val_loss: 0.0311481 | Time: 1161.92 ms
[2022-04-12 04:20:57 main:574] : INFO : Epoch 1795 | loss: 0.0311116 | val_loss: 0.0311428 | Time: 1148.42 ms
[2022-04-12 04:20:58 main:574] : INFO : Epoch 1796 | loss: 0.0311064 | val_loss: 0.0311465 | Time: 1154.3 ms
[2022-04-12 04:21:00 main:574] : INFO : Epoch 1797 | loss: 0.0311075 | val_loss: 0.0311469 | Time: 1160.19 ms
[2022-04-12 04:21:01 main:574] : INFO : Epoch 1798 | loss: 0.0311084 | val_loss: 0.0311465 | Time: 1165.49 ms
[2022-04-12 04:21:02 main:574] : INFO : Epoch 1799 | loss: 0.0311068 | val_loss: 0.0311467 | Time: 1148.83 ms
[2022-04-12 04:21:03 main:574] : INFO : Epoch 1800 | loss: 0.0311055 | val_loss: 0.031147 | Time: 1152.36 ms
[2022-04-12 04:21:04 main:574] : INFO : Epoch 1801 | loss: 0.031107 | val_loss: 0.0311436 | Time: 1159.27 ms
[2022-04-12 04:21:05 main:574] : INFO : Epoch 1802 | loss: 0.0311072 | val_loss: 0.0311483 | Time: 1159.09 ms
[2022-04-12 04:21:07 main:574] : INFO : Epoch 1803 | loss: 0.0311076 | val_loss: 0.0311462 | Time: 1166.36 ms
[2022-04-12 04:21:08 main:574] : INFO : Epoch 1804 | loss: 0.0311069 | val_loss: 0.0311454 | Time: 1167.76 ms
[2022-04-12 04:21:09 main:574] : INFO : Epoch 1805 | loss: 0.0311069 | val_loss: 0.0311438 | Time: 1165.47 ms
[2022-04-12 04:21:10 main:574] : INFO : Epoch 1806 | loss: 0.0311049 | val_loss: 0.0311424 | Time: 1153.93 ms
[2022-04-12 04:21:11 main:574] : INFO : Epoch 1807 | loss: 0.0311061 | val_loss: 0.0311515 | Time: 1160.69 ms
[2022-04-12 04:21:12 main:574] : INFO : Epoch 1808 | loss: 0.0311054 | val_loss: 0.0311476 | Time: 1147.58 ms
[2022-04-12 04:21:14 main:574] : INFO : Epoch 1809 | loss: 0.0311057 | val_loss: 0.0311475 | Time: 1169.13 ms
[2022-04-12 04:21:15 main:574] : INFO : Epoch 1810 | loss: 0.0311046 | val_loss: 0.0311461 | Time: 1159.12 ms
[2022-04-12 04:21:16 main:574] : INFO : Epoch 1811 | loss: 0.031106 | val_loss: 0.0311564 | Time: 1157.39 ms
[2022-04-12 04:21:17 main:574] : INFO : Epoch 1812 | loss: 0.0311043 | val_loss: 0.0311468 | Time: 1157.16 ms
[2022-04-12 04:21:18 main:574] : INFO : Epoch 1813 | loss: 0.0311167 | val_loss: 0.0311552 | Time: 1155.88 ms
[2022-04-12 04:21:19 main:574] : INFO : Epoch 1814 | loss: 0.031138 | val_loss: 0.0311575 | Time: 1160.29 ms
[2022-04-12 04:21:21 main:574] : INFO : Epoch 1815 | loss: 0.0311347 | val_loss: 0.0311521 | Time: 1157.26 ms
[2022-04-12 04:21:22 main:574] : INFO : Epoch 1816 | loss: 0.0311251 | val_loss: 0.03115 | Time: 1151.47 ms
[2022-04-12 04:21:23 main:574] : INFO : Epoch 1817 | loss: 0.0311227 | val_loss: 0.0311506 | Time: 1166.81 ms
[2022-04-12 04:21:24 main:574] : INFO : Epoch 1818 | loss: 0.0311194 | val_loss: 0.031155 | Time: 1161.12 ms
[2022-04-12 04:21:25 main:574] : INFO : Epoch 1819 | loss: 0.0311175 | val_loss: 0.0311486 | Time: 1160.92 ms
[2022-04-12 04:21:26 main:574] : INFO : Epoch 1820 | loss: 0.0311148 | val_loss: 0.0311482 | Time: 1146.52 ms
[2022-04-12 04:21:28 main:574] : INFO : Epoch 1821 | loss: 0.0311136 | val_loss: 0.0311424 | Time: 1166.2 ms
[2022-04-12 04:21:29 main:574] : INFO : Epoch 1822 | loss: 0.0311163 | val_loss: 0.0311468 | Time: 1167.06 ms
[2022-04-12 04:21:30 main:574] : INFO : Epoch 1823 | loss: 0.0311133 | val_loss: 0.0311519 | Time: 1167.35 ms
[2022-04-12 04:21:31 main:574] : INFO : Epoch 1824 | loss: 0.0311164 | val_loss: 0.0311444 | Time: 1136.42 ms
[2022-04-12 04:21:32 main:574] : INFO : Epoch 1825 | loss: 0.0311155 | val_loss: 0.0311478 | Time: 1149.61 ms
[2022-04-12 04:21:33 main:574] : INFO : Epoch 1826 | loss: 0.0311164 | val_loss: 0.031145 | Time: 1157.85 ms
[2022-04-12 04:21:34 main:574] : INFO : Epoch 1827 | loss: 0.0311118 | val_loss: 0.0311472 | Time: 1150.04 ms
[2022-04-12 04:21:36 main:574] : INFO : Epoch 1828 | loss: 0.0311115 | val_loss: 0.0311456 | Time: 1147.45 ms
[2022-04-12 04:21:37 main:574] : INFO : Epoch 1829 | loss: 0.0311117 | val_loss: 0.0311479 | Time: 1163.65 ms
[2022-04-12 04:21:38 main:574] : INFO : Epoch 1830 | loss: 0.0311119 | val_loss: 0.0311473 | Time: 1158.37 ms
[2022-04-12 04:21:39 main:574] : INFO : Epoch 1831 | loss: 0.0311114 | val_loss: 0.0311506 | Time: 1153.99 ms
[2022-04-12 04:21:40 main:574] : INFO : Epoch 1832 | loss: 0.0311101 | val_loss: 0.0311505 | Time: 1165.39 ms
[2022-04-12 04:21:41 main:574] : INFO : Epoch 1833 | loss: 0.0311116 | val_loss: 0.031151 | Time: 1157.67 ms
[2022-04-12 04:21:43 main:574] : INFO : Epoch 1834 | loss: 0.0311089 | val_loss: 0.0311455 | Time: 1159.7 ms
[2022-04-12 04:21:44 main:574] : INFO : Epoch 1835 | loss: 0.0311198 | val_loss: 0.0311439 | Time: 1159.92 ms
[2022-04-12 04:21:45 main:574] : INFO : Epoch 1836 | loss: 0.0311212 | val_loss: 0.0311448 | Time: 1160.1 ms
[2022-04-12 04:21:46 main:574] : INFO : Epoch 1837 | loss: 0.0311177 | val_loss: 0.0311433 | Time: 1162.23 ms
[2022-04-12 04:21:47 main:574] : INFO : Epoch 1838 | loss: 0.0311251 | val_loss: 0.0311508 | Time: 1152.76 ms
[2022-04-12 04:21:48 main:574] : INFO : Epoch 1839 | loss: 0.031128 | val_loss: 0.0311494 | Time: 1156 ms
[2022-04-12 04:21:50 main:574] : INFO : Epoch 1840 | loss: 0.0311246 | val_loss: 0.0311523 | Time: 1154.69 ms
[2022-04-12 04:21:51 main:574] : INFO : Epoch 1841 | loss: 0.0311193 | val_loss: 0.0311481 | Time: 1160.51 ms
[2022-04-12 04:21:52 main:574] : INFO : Epoch 1842 | loss: 0.0311176 | val_loss: 0.0311505 | Time: 1156.97 ms
[2022-04-12 04:21:53 main:574] : INFO : Epoch 1843 | loss: 0.0311178 | val_loss: 0.0311455 | Time: 1159.92 ms
[2022-04-12 04:21:54 main:574] : INFO : Epoch 1844 | loss: 0.0311189 | val_loss: 0.0311527 | Time: 1161.15 ms
[2022-04-12 04:21:55 main:574] : INFO : Epoch 1845 | loss: 0.0311234 | val_loss: 0.0311468 | Time: 1155.03 ms
[2022-04-12 04:21:57 main:574] : INFO : Epoch 1846 | loss: 0.0311302 | val_loss: 0.0311463 | Time: 1150.44 ms
[2022-04-12 04:21:58 main:574] : INFO : Epoch 1847 | loss: 0.0311282 | val_loss: 0.0311464 | Time: 1146.54 ms
[2022-04-12 04:21:59 main:574] : INFO : Epoch 1848 | loss: 0.0311221 | val_loss: 0.031143 | Time: 1156.1 ms
[2022-04-12 04:22:00 main:574] : INFO : Epoch 1849 | loss: 0.0311203 | val_loss: 0.031143 | Time: 1165.13 ms
[2022-04-12 04:22:01 main:574] : INFO : Epoch 1850 | loss: 0.0311254 | val_loss: 0.0311431 | Time: 1165.03 ms
[2022-04-12 04:22:02 main:574] : INFO : Epoch 1851 | loss: 0.0311189 | val_loss: 0.0311447 | Time: 1174.87 ms
[2022-04-12 04:22:04 main:574] : INFO : Epoch 1852 | loss: 0.0311165 | val_loss: 0.0311393 | Time: 1163.08 ms
[2022-04-12 04:22:05 main:574] : INFO : Epoch 1853 | loss: 0.031115 | val_loss: 0.0311414 | Time: 1162.72 ms
[2022-04-12 04:22:06 main:574] : INFO : Epoch 1854 | loss: 0.0311137 | val_loss: 0.0311426 | Time: 1161.92 ms
[2022-04-12 04:22:07 main:574] : INFO : Epoch 1855 | loss: 0.0311124 | val_loss: 0.0311378 | Time: 1168.24 ms
[2022-04-12 04:22:08 main:574] : INFO : Epoch 1856 | loss: 0.031111 | val_loss: 0.031142 | Time: 1144.1 ms
[2022-04-12 04:22:09 main:574] : INFO : Epoch 1857 | loss: 0.0311117 | val_loss: 0.0311478 | Time: 1166.17 ms
[2022-04-12 04:22:10 main:574] : INFO : Epoch 1858 | loss: 0.0311104 | val_loss: 0.0311441 | Time: 1153.38 ms
[2022-04-12 04:22:12 main:574] : INFO : Epoch 1859 | loss: 0.0311096 | val_loss: 0.0311422 | Time: 1152.46 ms
[2022-04-12 04:22:13 main:574] : INFO : Epoch 1860 | loss: 0.0311136 | val_loss: 0.0311424 | Time: 1164.51 ms
[2022-04-12 04:22:14 main:574] : INFO : Epoch 1861 | loss: 0.031109 | val_loss: 0.0311428 | Time: 1161.15 ms
[2022-04-12 04:22:15 main:574] : INFO : Epoch 1862 | loss: 0.0311071 | val_loss: 0.0311424 | Time: 1151.42 ms
[2022-04-12 04:22:16 main:574] : INFO : Epoch 1863 | loss: 0.0311128 | val_loss: 0.0311446 | Time: 1157.82 ms
[2022-04-12 04:22:17 main:574] : INFO : Epoch 1864 | loss: 0.0311198 | val_loss: 0.0311435 | Time: 1144.72 ms
[2022-04-12 04:22:19 main:574] : INFO : Epoch 1865 | loss: 0.0311211 | val_loss: 0.0311501 | Time: 1155.91 ms
[2022-04-12 04:22:20 main:574] : INFO : Epoch 1866 | loss: 0.0311151 | val_loss: 0.0311429 | Time: 1152.74 ms
[2022-04-12 04:22:21 main:574] : INFO : Epoch 1867 | loss: 0.0311114 | val_loss: 0.0311461 | Time: 1153.46 ms
[2022-04-12 04:22:22 main:574] : INFO : Epoch 1868 | loss: 0.0311155 | val_loss: 0.0311463 | Time: 1163.33 ms
[2022-04-12 04:22:23 main:574] : INFO : Epoch 1869 | loss: 0.0311154 | val_loss: 0.0311438 | Time: 1152.17 ms
[2022-04-12 04:22:24 main:574] : INFO : Epoch 1870 | loss: 0.0311173 | val_loss: 0.0311435 | Time: 1159.12 ms
[2022-04-12 04:22:26 main:574] : INFO : Epoch 1871 | loss: 0.0311119 | val_loss: 0.0311444 | Time: 1159.49 ms
[2022-04-12 04:22:27 main:574] : INFO : Epoch 1872 | loss: 0.0311112 | val_loss: 0.0311455 | Time: 1163.33 ms
[2022-04-12 04:22:28 main:574] : INFO : Epoch 1873 | loss: 0.0311124 | val_loss: 0.0311485 | Time: 1150.15 ms
[2022-04-12 04:22:29 main:574] : INFO : Epoch 1874 | loss: 0.0311123 | val_loss: 0.031147 | Time: 1143.93 ms
[2022-04-12 04:22:30 main:574] : INFO : Epoch 1875 | loss: 0.0311105 | val_loss: 0.0311446 | Time: 1148.36 ms
[2022-04-12 04:22:31 main:574] : INFO : Epoch 1876 | loss: 0.0311138 | val_loss: 0.0311462 | Time: 1154.39 ms
[2022-04-12 04:22:32 main:574] : INFO : Epoch 1877 | loss: 0.0311121 | val_loss: 0.0311443 | Time: 1158.34 ms
[2022-04-12 04:22:34 main:574] : INFO : Epoch 1878 | loss: 0.0311111 | val_loss: 0.0311572 | Time: 1154.67 ms
[2022-04-12 04:22:35 main:574] : INFO : Epoch 1879 | loss: 0.031112 | val_loss: 0.0311451 | Time: 1168.79 ms
[2022-04-12 04:22:36 main:574] : INFO : Epoch 1880 | loss: 0.0311098 | val_loss: 0.0311426 | Time: 1157.87 ms
[2022-04-12 04:22:37 main:574] : INFO : Epoch 1881 | loss: 0.0311086 | val_loss: 0.0311446 | Time: 1178.42 ms
[2022-04-12 04:22:38 main:574] : INFO : Epoch 1882 | loss: 0.0311084 | val_loss: 0.0311408 | Time: 1156.51 ms
[2022-04-12 04:22:39 main:574] : INFO : Epoch 1883 | loss: 0.0311086 | val_loss: 0.0311436 | Time: 1169.32 ms
[2022-04-12 04:22:41 main:574] : INFO : Epoch 1884 | loss: 0.0311075 | val_loss: 0.0311432 | Time: 1155.46 ms
[2022-04-12 04:22:42 main:574] : INFO : Epoch 1885 | loss: 0.0311083 | val_loss: 0.0311498 | Time: 1144.22 ms
[2022-04-12 04:22:43 main:574] : INFO : Epoch 1886 | loss: 0.031125 | val_loss: 0.0311499 | Time: 1155.51 ms
[2022-04-12 04:22:44 main:574] : INFO : Epoch 1887 | loss: 0.0311377 | val_loss: 0.0311443 | Time: 1153.67 ms
[2022-04-12 04:22:45 main:574] : INFO : Epoch 1888 | loss: 0.0311316 | val_loss: 0.0311433 | Time: 1149.6 ms
[2022-04-12 04:22:46 main:574] : INFO : Epoch 1889 | loss: 0.0311288 | val_loss: 0.0311463 | Time: 1167.64 ms
[2022-04-12 04:22:48 main:574] : INFO : Epoch 1890 | loss: 0.0311297 | val_loss: 0.0311451 | Time: 1145.34 ms
[2022-04-12 04:22:49 main:574] : INFO : Epoch 1891 | loss: 0.0311282 | val_loss: 0.0311428 | Time: 1156.58 ms
[2022-04-12 04:22:50 main:574] : INFO : Epoch 1892 | loss: 0.0311276 | val_loss: 0.0311439 | Time: 1151.8 ms
[2022-04-12 04:22:51 main:574] : INFO : Epoch 1893 | loss: 0.0311249 | val_loss: 0.0311442 | Time: 1155.31 ms
[2022-04-12 04:22:52 main:574] : INFO : Epoch 1894 | loss: 0.0311194 | val_loss: 0.0311407 | Time: 1163.24 ms
[2022-04-12 04:22:53 main:574] : INFO : Epoch 1895 | loss: 0.0311184 | val_loss: 0.0311393 | Time: 1148.31 ms
[2022-04-12 04:22:55 main:574] : INFO : Epoch 1896 | loss: 0.0311156 | val_loss: 0.0311481 | Time: 1167.51 ms
[2022-04-12 04:22:56 main:574] : INFO : Epoch 1897 | loss: 0.0311204 | val_loss: 0.0311427 | Time: 1156.34 ms
[2022-04-12 04:22:57 main:574] : INFO : Epoch 1898 | loss: 0.0311208 | val_loss: 0.0311421 | Time: 1157.05 ms
[2022-04-12 04:22:58 main:574] : INFO : Epoch 1899 | loss: 0.0311163 | val_loss: 0.0311429 | Time: 1151.46 ms
[2022-04-12 04:22:59 main:574] : INFO : Epoch 1900 | loss: 0.031118 | val_loss: 0.0311416 | Time: 1139.91 ms
[2022-04-12 04:23:00 main:574] : INFO : Epoch 1901 | loss: 0.0311158 | val_loss: 0.0311416 | Time: 1172.71 ms
[2022-04-12 04:23:01 main:574] : INFO : Epoch 1902 | loss: 0.0311157 | val_loss: 0.0311418 | Time: 1149.17 ms
[2022-04-12 04:23:03 main:574] : INFO : Epoch 1903 | loss: 0.0311165 | val_loss: 0.0311391 | Time: 1154.67 ms
[2022-04-12 04:23:04 main:574] : INFO : Epoch 1904 | loss: 0.0311151 | val_loss: 0.0311511 | Time: 1145.18 ms
[2022-04-12 04:23:05 main:574] : INFO : Epoch 1905 | loss: 0.0311151 | val_loss: 0.0311456 | Time: 1167.97 ms
[2022-04-12 04:23:06 main:574] : INFO : Epoch 1906 | loss: 0.031121 | val_loss: 0.0311474 | Time: 1139.44 ms
[2022-04-12 04:23:07 main:574] : INFO : Epoch 1907 | loss: 0.0311222 | val_loss: 0.0311452 | Time: 1160.16 ms
[2022-04-12 04:23:08 main:574] : INFO : Epoch 1908 | loss: 0.0311186 | val_loss: 0.031144 | Time: 1152.2 ms
[2022-04-12 04:23:10 main:574] : INFO : Epoch 1909 | loss: 0.0311182 | val_loss: 0.0311418 | Time: 1158.19 ms
[2022-04-12 04:23:11 main:574] : INFO : Epoch 1910 | loss: 0.0311209 | val_loss: 0.0311453 | Time: 1139.25 ms
[2022-04-12 04:23:12 main:574] : INFO : Epoch 1911 | loss: 0.0311245 | val_loss: 0.0311422 | Time: 1150.49 ms
[2022-04-12 04:23:13 main:574] : INFO : Epoch 1912 | loss: 0.0311193 | val_loss: 0.0311438 | Time: 1160.19 ms
[2022-04-12 04:23:14 main:574] : INFO : Epoch 1913 | loss: 0.0311163 | val_loss: 0.0311479 | Time: 1157.6 ms
[2022-04-12 04:23:15 main:574] : INFO : Epoch 1914 | loss: 0.031133 | val_loss: 0.0311501 | Time: 1166.06 ms
[2022-04-12 04:23:16 main:574] : INFO : Epoch 1915 | loss: 0.0311341 | val_loss: 0.0311462 | Time: 1147.94 ms
[2022-04-12 04:23:18 main:574] : INFO : Epoch 1916 | loss: 0.0311299 | val_loss: 0.0311459 | Time: 1148.56 ms
[2022-04-12 04:23:19 main:574] : INFO : Epoch 1917 | loss: 0.0311277 | val_loss: 0.0311464 | Time: 1164.23 ms
[2022-04-12 04:23:20 main:574] : INFO : Epoch 1918 | loss: 0.0311275 | val_loss: 0.0311498 | Time: 1152.71 ms
[2022-04-12 04:23:21 main:574] : INFO : Epoch 1919 | loss: 0.0311261 | val_loss: 0.0311484 | Time: 1171.09 ms
[2022-04-12 04:23:22 main:574] : INFO : Epoch 1920 | loss: 0.0311228 | val_loss: 0.0311462 | Time: 1161.03 ms
[2022-04-12 04:23:23 main:574] : INFO : Epoch 1921 | loss: 0.0311218 | val_loss: 0.031146 | Time: 1151.49 ms
[2022-04-12 04:23:25 main:574] : INFO : Epoch 1922 | loss: 0.0311228 | val_loss: 0.031146 | Time: 1153.48 ms
[2022-04-12 04:23:26 main:574] : INFO : Epoch 1923 | loss: 0.0311217 | val_loss: 0.0311537 | Time: 1152.92 ms
[2022-04-12 04:23:27 main:574] : INFO : Epoch 1924 | loss: 0.0311185 | val_loss: 0.0311502 | Time: 1152.1 ms
[2022-04-12 04:23:28 main:574] : INFO : Epoch 1925 | loss: 0.0311183 | val_loss: 0.031149 | Time: 1153.52 ms
[2022-04-12 04:23:29 main:574] : INFO : Epoch 1926 | loss: 0.0311181 | val_loss: 0.0311524 | Time: 1168.95 ms
[2022-04-12 04:23:30 main:574] : INFO : Epoch 1927 | loss: 0.0311186 | val_loss: 0.031148 | Time: 1164.36 ms
[2022-04-12 04:23:32 main:574] : INFO : Epoch 1928 | loss: 0.0311156 | val_loss: 0.0311458 | Time: 1170.89 ms
[2022-04-12 04:23:33 main:574] : INFO : Epoch 1929 | loss: 0.0311143 | val_loss: 0.0311497 | Time: 1143.67 ms
[2022-04-12 04:23:34 main:574] : INFO : Epoch 1930 | loss: 0.0311149 | val_loss: 0.0311492 | Time: 1167.28 ms
[2022-04-12 04:23:35 main:574] : INFO : Epoch 1931 | loss: 0.0311136 | val_loss: 0.0311496 | Time: 1150.28 ms
[2022-04-12 04:23:36 main:574] : INFO : Epoch 1932 | loss: 0.0311137 | val_loss: 0.0311497 | Time: 1147.85 ms
[2022-04-12 04:23:37 main:574] : INFO : Epoch 1933 | loss: 0.0311133 | val_loss: 0.0311487 | Time: 1170.05 ms
[2022-04-12 04:23:39 main:574] : INFO : Epoch 1934 | loss: 0.031113 | val_loss: 0.0311489 | Time: 1150.94 ms
[2022-04-12 04:23:40 main:574] : INFO : Epoch 1935 | loss: 0.0311147 | val_loss: 0.0311469 | Time: 1150.5 ms
[2022-04-12 04:23:41 main:574] : INFO : Epoch 1936 | loss: 0.0311137 | val_loss: 0.0311504 | Time: 1161.53 ms
[2022-04-12 04:23:42 main:574] : INFO : Epoch 1937 | loss: 0.031114 | val_loss: 0.0311479 | Time: 1161.03 ms
[2022-04-12 04:23:43 main:574] : INFO : Epoch 1938 | loss: 0.0311131 | val_loss: 0.031148 | Time: 1157.19 ms
[2022-04-12 04:23:44 main:574] : INFO : Epoch 1939 | loss: 0.0311118 | val_loss: 0.031148 | Time: 1144.98 ms
[2022-04-12 04:23:45 main:574] : INFO : Epoch 1940 | loss: 0.0311123 | val_loss: 0.0311482 | Time: 1153.2 ms
[2022-04-12 04:23:47 main:574] : INFO : Epoch 1941 | loss: 0.0311139 | val_loss: 0.0311465 | Time: 1158.39 ms
[2022-04-12 04:23:48 main:574] : INFO : Epoch 1942 | loss: 0.0311129 | val_loss: 0.0311451 | Time: 1195.06 ms
[2022-04-12 04:23:49 main:574] : INFO : Epoch 1943 | loss: 0.031114 | val_loss: 0.0311488 | Time: 1198.99 ms
[2022-04-12 04:23:50 main:574] : INFO : Epoch 1944 | loss: 0.0311152 | val_loss: 0.0311476 | Time: 1173.45 ms
[2022-04-12 04:23:51 main:574] : INFO : Epoch 1945 | loss: 0.0311134 | val_loss: 0.0311493 | Time: 1157.12 ms
[2022-04-12 04:23:53 main:574] : INFO : Epoch 1946 | loss: 0.0311141 | val_loss: 0.0311479 | Time: 1158.13 ms
[2022-04-12 04:23:54 main:574] : INFO : Epoch 1947 | loss: 0.0311172 | val_loss: 0.0311456 | Time: 1159.26 ms
[2022-04-12 04:23:55 main:574] : INFO : Epoch 1948 | loss: 0.0311148 | val_loss: 0.0311515 | Time: 1153.54 ms
[2022-04-12 04:23:56 main:574] : INFO : Epoch 1949 | loss: 0.0311131 | val_loss: 0.0311496 | Time: 1173.73 ms
[2022-04-12 04:23:57 main:574] : INFO : Epoch 1950 | loss: 0.0311126 | val_loss: 0.0311464 | Time: 1161.34 ms
[2022-04-12 04:23:58 main:574] : INFO : Epoch 1951 | loss: 0.0311114 | val_loss: 0.0311513 | Time: 1158.06 ms
[2022-04-12 04:24:00 main:574] : INFO : Epoch 1952 | loss: 0.031113 | val_loss: 0.0311456 | Time: 1159.76 ms
[2022-04-12 04:24:01 main:574] : INFO : Epoch 1953 | loss: 0.0311111 | val_loss: 0.0311457 | Time: 1170.38 ms
[2022-04-12 04:24:02 main:574] : INFO : Epoch 1954 | loss: 0.0311101 | val_loss: 0.0311512 | Time: 1160.97 ms
[2022-04-12 04:24:03 main:574] : INFO : Epoch 1955 | loss: 0.0311206 | val_loss: 0.0311563 | Time: 1160.69 ms
[2022-04-12 04:24:04 main:574] : INFO : Epoch 1956 | loss: 0.0311171 | val_loss: 0.0311519 | Time: 1149.07 ms
[2022-04-12 04:24:05 main:574] : INFO : Epoch 1957 | loss: 0.0311123 | val_loss: 0.0311476 | Time: 1151.93 ms
[2022-04-12 04:24:06 main:574] : INFO : Epoch 1958 | loss: 0.0311113 | val_loss: 0.0311541 | Time: 1153.31 ms
[2022-04-12 04:24:08 main:574] : INFO : Epoch 1959 | loss: 0.0311084 | val_loss: 0.031152 | Time: 1148.84 ms
[2022-04-12 04:24:09 main:574] : INFO : Epoch 1960 | loss: 0.0311101 | val_loss: 0.0311485 | Time: 1162.06 ms
[2022-04-12 04:24:10 main:574] : INFO : Epoch 1961 | loss: 0.0311096 | val_loss: 0.031149 | Time: 1172.71 ms
[2022-04-12 04:24:11 main:574] : INFO : Epoch 1962 | loss: 0.031111 | val_loss: 0.0311533 | Time: 1159.99 ms
[2022-04-12 04:24:12 main:574] : INFO : Epoch 1963 | loss: 0.031114 | val_loss: 0.0311502 | Time: 1145.24 ms
[2022-04-12 04:24:13 main:574] : INFO : Epoch 1964 | loss: 0.0311103 | val_loss: 0.031148 | Time: 1145.19 ms
[2022-04-12 04:24:15 main:574] : INFO : Epoch 1965 | loss: 0.0311108 | val_loss: 0.0311505 | Time: 1160.76 ms
[2022-04-12 04:24:16 main:574] : INFO : Epoch 1966 | loss: 0.0311106 | val_loss: 0.0311508 | Time: 1147.72 ms
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFF273290D2
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 04/12/22 04:24:16
Install Directory : C:\Program Files\BOINC\
Data Directory : C:\ProgramData\BOINC
Project Symstore :
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\0;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 000000007e4e0000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000294d0000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 0000000028900000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 0000000027260000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000283d0000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000026c90000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1586) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1586
ModLoad: 0000000027740000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.1202 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1202
ModLoad: 0000000026f90000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 0000000026bf0000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 00000000270a0000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 0000000028850000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000293e0000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.19041.546
ModLoad: 0000000027770000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.1586) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000027870000 0000000000125000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000003490000 0000000000058000 C:\ProgramData\BOINC\slots\0\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000007c40000 0000000000092000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.28.29334.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\6\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.28.29334.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.28.29334.0
ModLoad: 000000001a230000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.867 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.867
ModLoad: 000000000cd10000 0000000000019000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.28.29334.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\6\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.28.29334.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.28.29334.0
ModLoad: 000000000d570000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.28.29334.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\6\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.28.29334.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.28.29334.0
ModLoad: 0000000010670000 0000000024b49000 C:\ProgramData\BOINC\slots\0\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000005bf0000 0000000000045000 C:\ProgramData\BOINC\slots\0\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000ba000000 00000000034b2000 C:\ProgramData\BOINC\slots\0\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 0000000005a80000 000000000abe7000 C:\ProgramData\BOINC\slots\0\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000113c0000 0000000000010000 C:\ProgramData\BOINC\slots\0\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 000000005d580000 00000000030a5000 C:\ProgramData\BOINC\slots\0\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 00000000b4eb0000 000000001b3a4000 C:\ProgramData\BOINC\slots\0\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 00000000d1fc0000 000000000020d000 C:\ProgramData\BOINC\slots\0\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 00000000b8a90000 00000000002db000 C:\ProgramData\BOINC\slots\0\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000006050000 0000000000040000 C:\ProgramData\BOINC\slots\0\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000059820000 0000000003d5b000 C:\ProgramData\BOINC\slots\0\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 000000009f290000 000000000919f000 C:\ProgramData\BOINC\slots\0\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 0000000057950000 0000000001eca000 C:\ProgramData\BOINC\slots\0\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 0000000028710000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000024a40000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000289c0000 0000000000470000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000271a0000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1151
ModLoad: 0000000026cc0000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000269b0000 0000000000033000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000271f0000 0000000000068000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 0000000026d80000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000267d0000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000027a50000 0000000000744000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.964 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.964
ModLoad: 0000000024d20000 0000000000794000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000028e30000 0000000000354000 C:\WINDOWS\System32\combase.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.1320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1320
ModLoad: 0000000026650000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000027690000 00000000000ad000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000275a0000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000b7d00000 00000000002cd000 C:\WINDOWS\system32\nvcuda.dll (30.0.15.1165) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_37\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 30.0.15.1165
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.6.99 driver
Product Version : 30.0.15.1165
ModLoad: 00000000a77e0000 00000000016a0000 C:\WINDOWS\system32\DriverStore\FileRepository\nvhdc.inf_amd64_d11413f6fd8fe259\nvcuda64.dll (30.0.15.1165) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_37\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 30.0.15.1165
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.6.99 driver
Product Version : 30.0.15.1165
ModLoad: 00000000216e0000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000001dc70000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.906 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.906
ModLoad: 0000000018c60000 0000000000148000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : drvstore.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000265c0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000052540000 0000000000768000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.15.1165) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_37\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 30.0.15.1165
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 30.0.15.1165
ModLoad: 0000000019960000 0000000000009000 C:\ProgramData\BOINC\slots\0\caffe2_nvrtc.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000b6d30000 0000000000fca000 C:\ProgramData\BOINC\slots\0\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6.14.11.9000
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.89 NVRTC Library
Product Version : 6.14.11.9000
ModLoad: 0000000026cf0000 0000000000082000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.1415 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1415
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 5483, Write: 8327, Other 34225
- I/O Transfers Counters -
Read: 14357960, Write: 5936833, Other 162562
- Paged Pool Usage -
QuotaPagedPoolUsage: 3533544, QuotaPeakPagedPoolUsage: 3533544
QuotaNonPagedPoolUsage: 58472, QuotaPeakNonPagedPoolUsage: 58880
- Virtual Memory Usage -
VirtualSize: 395112448, PeakVirtualSize: 1015611392
- Pagefile Usage -
PagefileUsage: 395112448, PeakPagefileUsage: 395112448
- Working Set Size -
WorkingSetSize: -2123988992, PeakWorkingSetSize: -2059583488, PageFaultCount: 838312
*** Dump of thread ID 22368 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 187478992.000000
- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFF273290D2
- Registers -
rax=0000000000000000 rbx=0000000000000001 rcx=000000007e798c40 rdx=000000009b7fe660 rsi=0000000000000000 rdi=0000000000000000
r8=000000009b7fe660 r9=000000007e798c30 r10=0000000000000fff r11=0000000000000ff0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000273290d2 rsp=000000009b7fe638 rbp=0000000000000000
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
9b7fe630 7e519100 00000001 9b7fe660 9b7fe660 7e798c30 KERNELBASE!DebugBreak+0x0
9b7fea70 7e519ce4 cd800000 9b7fedd4 00000000 0000037c mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
9b7ff9d0 7e51a084 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
9b7ffa00 28917034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
9b7ffa30 29522651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
9b7ffab0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 21932 (state: Running): ***
- Information -
Status: Base Priority: Above Normal, Priority: Highest, , Kernel Time: 540156224.000000, User Time: 14775000064.000000, Wait Time: 187478992.000000
- Registers -
rax=0000000000000001 rbx=00000000b6eb0c30 rcx=00000000811a5850 rdx=0000000044010000 rsi=0000000000000000 rdi=000000009b2e13b0
r8=0000000000000000 r9=000000001ff7ffd0 r10=000000009fdc5a60 r11=00000000b6eb0c30 r12=0000000000008000 r13=0000000000010000
r14=000000009fdc5a60 r15=0000000000008000 rip=00000000a7b9621a rsp=000000009b2e07d0 rbp=000000005e5f1620
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
9b2e0810 a7b97029 cde8db60 9fdc5a60 9b2e13b0 6bb1ed58 nvcuda64!cuProfilerStop+0x0
9b2e0840 a7970704 9fdc5ad8 5e5f1620 cde8db60 9fdc5a60 nvcuda64!cuProfilerStop+0x0
9b2e09c0 a7970dac 5e5f1620 747c5068 cde8db60 6bb1ed58 nvcuda64!+0x0
9b2e1000 a7b22e95 00000000 00000000 3c292010 9b2e1110 nvcuda64!+0x0
9b2e1140 a781c464 9fdc5a60 9b2e13b0 9fdc5a60 9b2e15d0 nvcuda64!cuProfilerStop+0x0
9b2e1210 a781ca57 9b2e1320 5e5f1620 9b2e1320 9fdc5a60 nvcuda64!+0x0
9b2e1580 a7a1c8bc 00000006 a7a8d047 9b2e1d38 00000000 nvcuda64!+0x0
9b2e16f0 b5c529b6 00000000 00000006 00000100 b5bbd5d0 nvcuda64!cuEventRecordWithFlags+0x0
9b2e1800 b5c4fdf4 b5bbd5d0 5ce3ffd0 9fdc5a60 9b2e1a10 cudnn64_7!cudnnSetDropoutDescriptor+0x0
9b2e1980 b5bc2719 b5bbd5d0 00000002 b5bbd5d0 0000000c cudnn64_7!cudnnSetDropoutDescriptor+0x0
9b2e1aa0 b5bbce23 0000000c 0000000c 00000080 00000080 cudnn64_7!cudnnSetRNNProjectionLayers+0x0
9b2e1b80 b5bcb483 00000002 00000001 3e3ed800 00000000 cudnn64_7!cudnnSetRNNProjectionLayers+0x0
9b2e2030 b5bbeff1 9b2e4318 3cb638d0 00000005 cee23de0 cudnn64_7!cudnnSetRNNProjectionLayers+0x0
9b2e21d0 b5bc7d8e cee9c200 00000000 cee23de0 9b2e2498 cudnn64_7!cudnnSetRNNProjectionLayers+0x0
9b2e2370 b5bddcd3 00000000 00000000 cf60a990 9b2e2490 cudnn64_7!cudnnSetRNNProjectionLayers+0x0
9b2e4500 133e89fd ceea6ce0 3c200000 ceea6ce0 3cb638d0 cudnn64_7!cudnnRNNForwardTraining+0x0
9b2e49e0 134425ea 9b2e4aa8 00000001 9b2e4aa8 00000001 torch_cuda!at::native::_cudnn_rnn+0x0
9b2e4ac0 13450cbf 9b2e51b0 9b2e69b8 9b2e5b00 294fb86b torch_cuda!at::native::set_storage_cuda_+0x0
9b2e4ba0 0b4cb9fc 9b2e51b0 00000000 bcc2ae30 bcc2ae00 torch_cuda!at::native::set_storage_cuda_+0x0
9b2e4d20 0b5031a2 00000001 0cc767c2 9b2e4d54 294fb86b torch_cpu!at::native::mkldnn_sigmoid_+0x0
9b2e5000 0c7b2613 00000000 00000000 00000003 9c6ba2a8 torch_cpu!at::_cudnn_rnn+0x0
9b2e5500 0c7c080b 01e33f36 bcc3a790 9b2e5630 00000004 torch_cpu!torch::autograd::NotImplemented::~NotImplemented+0x0
9b2e55e0 0b4cb9fc 9b2e5b60 0c8e5878 9b2e5740 a7807a77 torch_cpu!torch::autograd::GraphRoot::apply+0x0
9b2e5760 0b5031a2 cee25440 00000000 01e33946 1430a3f0 torch_cpu!at::native::mkldnn_sigmoid_+0x0
9b2e5a40 133e69a1 9b2e0001 00000001 00000004 00000004 torch_cpu!at::_cudnn_rnn+0x0
9b2e5c10 133f0117 00000000 9b2e69b8 05bf2e0d 9b2e5d30 torch_cuda!at::native::_use_cudnn_ctc_loss+0x0
9b2e5ca0 0b25107b 103a1ac0 9b2e5fc0 ff232c80 a79d7783 torch_cuda!at::native::_cudnn_rnn_flatten_weight+0x0
9b2e5f10 0b283b16 00000001 9b2e69b8 00000080 cf140458 torch_cpu!at::native::fbgemm_pack_quantized_matrix+0x0
9b2e60a0 0b5fae89 9b2e6118 00000001 9b2e6118 00000001 torch_cpu!at::native::gru+0x0
9b2e6130 0c8e9fa3 9b2e6230 00000001 9b2e63b0 9b2e69b8 torch_cpu!at::zeros_out+0x0
9b2e61c0 0b5edd35 034e1ea8 5dcac8f0 00000000 034e1ea8 torch_cpu!torch::autograd::GraphRoot::apply+0x0
9b2e6240 0b4c88ec 103a75c8 47a26990 aa44c500 9b2e6460 torch_cpu!at::zeros_out+0x0
9b2e6340 0b53c1bb 0000000c 00000080 00000004 bcc3ae00 torch_cpu!at::native::mkldnn_sigmoid_+0x0
9b2e63c0 0d027294 9b2e64e0 47a26990 9b2e64d0 9b2e6678 torch_cpu!at::gru+0x0
9b2e65f0 0d0262ab 9b2e6990 0b45030e 9b2e6990 9b2e69b8 torch_cpu!torch::nn::GRUImpl::forward_helper+0x0
9b2e66e0 7e4f2621 00000006 9b2e73f0 00000000 034e1ea8 torch_cpu!torch::nn::GRUImpl::forward+0x0
9b2e68e0 7e4f705a 00000000 9b2e0000 9b2e0601 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::error+0x0
9b2e6de0 7e4fb950 9b2e6ee0 9b2e6ee0 00000000 2ba4e660 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0
9b2ffb80 7e73c6f8 5e14bb90 00000000 00000000 5e292490 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
9b2ffbc0 28917034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
9b2ffbf0 29522651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
9b2ffc70 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 15800 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 187478992.000000
- Registers -
rax=000000000000005b rbx=000000000000000e rcx=000000000000000e rdx=000000009b8ff440 rsi=0000000000000000 rdi=000000000000000e
r8=0000000000000001 r9=000000005e354400 r10=0000000000000000 r11=000000009b8ff3b0 r12=0000000000000064 r13=000000009b8ff440
r14=000000009b8ff140 r15=0000000000000000 rip=000000002956d8c4 rsp=000000009b8ff0e8 rbp=000000005e354420
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
9b8ff0e0 272acb20 00000000 9b168000 2963a4d0 9b168000 ntdll!ZwWaitForMultipleObjects+0x0
9b8ff3d0 272aca1e 5c831e50 004e0049 0000000e 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
9b8ff410 a79bd554 5e357ae0 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0
9b8ff650 a7a658cd 00000000 5e354420 00000000 00000000 nvcuda64!+0x0
9b8ff700 a79bcf23 7268a44e 71a2f41c 5e8f3d00 00000000 nvcuda64!cuProfilerStop+0x0
9b8ff730 a7cf44c4 5e8f3d00 00000000 00000000 00000000 nvcuda64!+0x0
9b8ff760 28917034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
9b8ff790 29522651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
9b8ff810 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 19396 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 186709248.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=000000000000008c rdx=0000000000000000 rsi=0000000000000000 rdi=000000000000008c
r8=000000009b9ffe08 r9=0000000000000000 r10=0000000000000000 r11=000000009b9ffe68 r12=000000005e379e40 r13=0000000000000000
r14=000000000000008c r15=0000000000000000 rip=000000002956cdf4 rsp=000000009b9ffb88 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
9b9ffb80 27281a5e 00000000 00001f80 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0
9b9ffc20 a7be5d0e 5e8f3ca0 00000000 00000000 0000008c KERNELBASE!WaitForSingleObjectEx+0x0
9b9ffe60 a79bcf23 00000000 5e8f3ca0 a77e0000 5e3911a0 nvcuda64!cuProfilerStop+0x0
9b9ffe90 a7cf44c4 5e8f3ca0 00000000 00000000 00000000 nvcuda64!+0x0
9b9ffec0 28917034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
9b9ffef0 29522651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
9b9fff70 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 11168 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 479062496.000000, User Time: 10371719168.000000, Wait Time: 187478976.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000a1c7cd88 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000a1c7cd88
r8=0000000000000000 r9=0000000000000000 r10=0000000000008000 r11=000000009bafef30 r12=0000000000000000 r13=0000000000000000
r14=000000009baff890 r15=00000000a1c7cd38 rip=0000000029570764 rsp=000000009baff868 rbp=000000009baff8c0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
9baff860 29534021 bd0dc2e8 07c52f97 ca2aaff0 ca2aafe0 ntdll!NtWaitForAlertByThreadId+0x0
9baff8e0 272ccfa9 a1c7cd80 a1c7cd78 a1c7cd30 00000000 ntdll!RtlSleepConditionVariableSRW+0x0
9baff920 07c7bf3d ca2ab010 00000000 00000000 0cc605b4 KERNELBASE!SleepConditionVariableSRW+0x0
9baff960 07c52798 00000000 ca2ab010 00000000 00000000 MSVCP140!__crtSetThreadpoolWait+0x0
9baff990 07c52a4a b804af33 00000000 9baffba0 a1c7cd78 MSVCP140!std::_Winerror_message+0x0
9baff9c0 0cc6064b a1c7cd30 9baffac0 a1c7cd30 ca2aaff0 MSVCP140!_Cnd_wait+0x0
9baffa00 0cc625b1 cf9925c0 ffffffff ca2aaff0 ffffffff torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
9baffcf0 0cc62471 10186d10 9baffd30 10186d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0
9baffd40 0cc59744 00080001 ce9a0320 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0
9baffd70 270c1bb2 ce9a0320 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0
9baffda0 28917034 00000000 00000000 00000000 00000000 ucrtbase!_configthreadlocale+0x0
9baffdd0 29522651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
9baffe50 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)