Task 13534148

Name ParityModified-1645998310-32321-1-0_5
Workunit 9640834
Created 22 Mar 2022, 12:31:29 UTC
Sent 22 Mar 2022, 14:14:33 UTC
Report deadline 30 Mar 2022, 14:14:33 UTC
Received 27 Mar 2022, 19:03:55 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 13970
Run time 1 days 22 hours 30 min 21 sec
CPU time 12 hours 7 min 32 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 1,168.29 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.63 GB
Peak swap size 3.58 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
 nan | val_loss: nan | Time: 527381 ms
[2022-03-24 08:42:12	                main:574]	:	INFO	:	Epoch 1660 | loss: nan | val_loss: nan | Time: 529560 ms
[2022-03-24 08:47:10	                main:574]	:	INFO	:	Epoch 1661 | loss: nan | val_loss: nan | Time: 298025 ms
[2022-03-24 08:56:21	                main:574]	:	INFO	:	Epoch 1662 | loss: nan | val_loss: nan | Time: 546214 ms
[2022-03-24 08:59:41	                main:574]	:	INFO	:	Epoch 1663 | loss: nan | val_loss: nan | Time: 193814 ms
[2022-03-24 09:06:16	                main:574]	:	INFO	:	Epoch 1664 | loss: nan | val_loss: nan | Time: 394369 ms
[2022-03-24 09:15:47	                main:574]	:	INFO	:	Epoch 1665 | loss: nan | val_loss: nan | Time: 571128 ms
[2022-03-24 09:18:08	                main:574]	:	INFO	:	Epoch 1666 | loss: nan | val_loss: nan | Time: 136068 ms
[2022-03-24 09:24:27	                main:574]	:	INFO	:	Epoch 1667 | loss: nan | val_loss: nan | Time: 377904 ms
[2022-03-24 09:33:54	                main:574]	:	INFO	:	Epoch 1668 | loss: nan | val_loss: nan | Time: 562028 ms
[2022-03-24 09:36:10	                main:574]	:	INFO	:	Epoch 1669 | loss: nan | val_loss: nan | Time: 128309 ms
[2022-03-24 09:42:04	                main:574]	:	INFO	:	Epoch 1670 | loss: nan | val_loss: nan | Time: 353434 ms
[2022-03-24 09:51:30	                main:574]	:	INFO	:	Epoch 1671 | loss: nan | val_loss: nan | Time: 566378 ms
[2022-03-24 09:53:56	                main:574]	:	INFO	:	Epoch 1672 | loss: nan | val_loss: nan | Time: 145928 ms
[2022-03-24 09:54:45	                main:574]	:	INFO	:	Epoch 1673 | loss: nan | val_loss: nan | Time: 47856.3 ms
[2022-03-24 09:55:29	                main:574]	:	INFO	:	Epoch 1674 | loss: nan | val_loss: nan | Time: 44066.9 ms
[2022-03-24 10:03:41	                main:574]	:	INFO	:	Epoch 1675 | loss: nan | val_loss: nan | Time: 491768 ms
[2022-03-24 10:12:29	                main:574]	:	INFO	:	Epoch 1676 | loss: nan | val_loss: nan | Time: 528404 ms
[2022-03-24 10:14:39	                main:574]	:	INFO	:	Epoch 1677 | loss: nan | val_loss: nan | Time: 124976 ms
[2022-03-24 10:19:07	                main:574]	:	INFO	:	Epoch 1678 | loss: nan | val_loss: nan | Time: 267536 ms
[2022-03-24 10:25:26	                main:574]	:	INFO	:	Epoch 1679 | loss: nan | val_loss: nan | Time: 378528 ms
[2022-03-24 10:34:29	                main:574]	:	INFO	:	Epoch 1680 | loss: nan | val_loss: nan | Time: 538722 ms
[2022-03-24 10:35:13	                main:574]	:	INFO	:	Epoch 1681 | loss: nan | val_loss: nan | Time: 42838.3 ms
[2022-03-24 10:42:41	                main:574]	:	INFO	:	Epoch 1682 | loss: nan | val_loss: nan | Time: 448607 ms
[2022-03-24 10:52:29	                main:574]	:	INFO	:	Epoch 1683 | loss: nan | val_loss: nan | Time: 565152 ms
[2022-03-24 10:53:12	                main:574]	:	INFO	:	Epoch 1684 | loss: nan | val_loss: nan | Time: 42150 ms
[2022-03-24 10:53:56	                main:574]	:	INFO	:	Epoch 1685 | loss: nan | val_loss: nan | Time: 44046.9 ms
[2022-03-24 10:56:28	                main:574]	:	INFO	:	Epoch 1686 | loss: nan | val_loss: nan | Time: 151999 ms
[2022-03-24 11:06:49	                main:574]	:	INFO	:	Epoch 1687 | loss: nan | val_loss: nan | Time: 621024 ms
[2022-03-24 11:12:43	                main:574]	:	INFO	:	Epoch 1688 | loss: nan | val_loss: nan | Time: 348936 ms
[2022-03-24 11:15:14	                main:574]	:	INFO	:	Epoch 1689 | loss: nan | val_loss: nan | Time: 150799 ms
[2022-03-24 11:25:43	                main:574]	:	INFO	:	Epoch 1690 | loss: nan | val_loss: nan | Time: 629327 ms
[2022-03-24 11:33:12	                main:574]	:	INFO	:	Epoch 1691 | loss: nan | val_loss: nan | Time: 448830 ms
[2022-03-24 11:33:55	                main:574]	:	INFO	:	Epoch 1692 | loss: nan | val_loss: nan | Time: 42475 ms
[2022-03-24 11:34:41	                main:574]	:	INFO	:	Epoch 1693 | loss: nan | val_loss: nan | Time: 46542 ms
[2022-03-24 11:35:25	                main:574]	:	INFO	:	Epoch 1694 | loss: nan | val_loss: nan | Time: 44113.8 ms
[2022-03-24 11:36:14	                main:574]	:	INFO	:	Epoch 1695 | loss: nan | val_loss: nan | Time: 48014.5 ms
[2022-03-24 11:43:13	                main:574]	:	INFO	:	Epoch 1696 | loss: nan | val_loss: nan | Time: 418927 ms
[2022-03-24 11:52:45	                main:574]	:	INFO	:	Epoch 1697 | loss: nan | val_loss: nan | Time: 565186 ms
[2022-03-24 11:55:18	                main:574]	:	INFO	:	Epoch 1698 | loss: nan | val_loss: nan | Time: 152940 ms
[2022-03-24 11:56:05	                main:574]	:	INFO	:	Epoch 1699 | loss: nan | val_loss: nan | Time: 46476.6 ms
[2022-03-24 11:56:49	                main:574]	:	INFO	:	Epoch 1700 | loss: nan | val_loss: nan | Time: 44121.6 ms
[2022-03-24 11:57:36	                main:574]	:	INFO	:	Epoch 1701 | loss: nan | val_loss: nan | Time: 47076.9 ms
[2022-03-24 11:58:22	                main:574]	:	INFO	:	Epoch 1702 | loss: nan | val_loss: nan | Time: 44749.6 ms
[2022-03-24 11:59:11	                main:574]	:	INFO	:	Epoch 1703 | loss: nan | val_loss: nan | Time: 47495.5 ms
[2022-03-24 11:59:59	                main:574]	:	INFO	:	Epoch 1704 | loss: nan | val_loss: nan | Time: 47958.4 ms
[2022-03-24 12:00:50	                main:574]	:	INFO	:	Epoch 1705 | loss: nan | val_loss: nan | Time: 50877.7 ms
[2022-03-24 12:01:56	                main:574]	:	INFO	:	Epoch 1706 | loss: nan | val_loss: nan | Time: 65277.3 ms
[2022-03-24 12:03:08	                main:574]	:	INFO	:	Epoch 1707 | loss: nan | val_loss: nan | Time: 71669.4 ms
[2022-03-24 12:04:14	                main:574]	:	INFO	:	Epoch 1708 | loss: nan | val_loss: nan | Time: 65275.6 ms
[2022-03-24 12:05:30	                main:574]	:	INFO	:	Epoch 1709 | loss: nan | val_loss: nan | Time: 74943.4 ms
[2022-03-24 12:06:38	                main:574]	:	INFO	:	Epoch 1710 | loss: nan | val_loss: nan | Time: 67540.5 ms
[2022-03-24 12:07:49	                main:574]	:	INFO	:	Epoch 1711 | loss: nan | val_loss: nan | Time: 70388.4 ms
[2022-03-24 12:09:02	                main:574]	:	INFO	:	Epoch 1712 | loss: nan | val_loss: nan | Time: 72578.2 ms
[2022-03-24 12:09:53	                main:574]	:	INFO	:	Epoch 1713 | loss: nan | val_loss: nan | Time: 51057.9 ms
[2022-03-24 12:10:38	                main:574]	:	INFO	:	Epoch 1714 | loss: nan | val_loss: nan | Time: 44105.9 ms
[2022-03-24 12:13:47	                main:574]	:	INFO	:	Epoch 1715 | loss: nan | val_loss: nan | Time: 189537 ms
[2022-03-24 12:19:32	                main:574]	:	INFO	:	Epoch 1716 | loss: nan | val_loss: nan | Time: 335793 ms
[2022-03-24 12:24:01	                main:574]	:	INFO	:	Epoch 1717 | loss: nan | val_loss: nan | Time: 259340 ms
[2022-03-24 12:29:12	                main:574]	:	INFO	:	Epoch 1718 | loss: nan | val_loss: nan | Time: 310960 ms
[2022-03-24 12:35:00	                main:574]	:	INFO	:	Epoch 1719 | loss: nan | val_loss: nan | Time: 347884 ms
[2022-03-24 12:40:53	                main:574]	:	INFO	:	Epoch 1720 | loss: nan | val_loss: nan | Time: 352612 ms
[2022-03-24 12:46:36	                main:574]	:	INFO	:	Epoch 1721 | loss: nan | val_loss: nan | Time: 343142 ms
[2022-03-24 12:52:24	                main:574]	:	INFO	:	Epoch 1722 | loss: nan | val_loss: nan | Time: 347816 ms
[2022-03-24 12:58:12	                main:574]	:	INFO	:	Epoch 1723 | loss: nan | val_loss: nan | Time: 347885 ms
[2022-03-24 13:04:00	                main:574]	:	INFO	:	Epoch 1724 | loss: nan | val_loss: nan | Time: 347861 ms
[2022-03-24 13:06:45	                main:574]	:	INFO	:	Epoch 1725 | loss: nan | val_loss: nan | Time: 165037 ms
[2022-03-24 13:07:31	                main:574]	:	INFO	:	Epoch 1726 | loss: nan | val_loss: nan | Time: 43738.6 ms
[2022-03-24 13:10:19	                main:574]	:	INFO	:	Epoch 1727 | loss: nan | val_loss: nan | Time: 167662 ms
[2022-03-24 13:20:44	                main:574]	:	INFO	:	Epoch 1728 | loss: nan | val_loss: nan | Time: 624761 ms
[2022-03-24 13:22:55	                main:574]	:	INFO	:	Epoch 1729 | loss: nan | val_loss: nan | Time: 125193 ms
[2022-03-24 13:29:34	                main:574]	:	INFO	:	Epoch 1730 | loss: nan | val_loss: nan | Time: 399114 ms
[2022-03-24 13:38:04	                main:574]	:	INFO	:	Epoch 1731 | loss: nan | val_loss: nan | Time: 509750 ms
[2022-03-24 13:38:47	                main:574]	:	INFO	:	Epoch 1732 | loss: nan | val_loss: nan | Time: 42591.6 ms
[2022-03-24 13:46:20	                main:574]	:	INFO	:	Epoch 1733 | loss: nan | val_loss: nan | Time: 453097 ms
[2022-03-24 13:53:47	                main:574]	:	INFO	:	Epoch 1734 | loss: nan | val_loss: nan | Time: 446515 ms
[2022-03-24 13:59:13	                main:574]	:	INFO	:	Epoch 1735 | loss: nan | val_loss: nan | Time: 326381 ms
[2022-03-24 14:07:58	                main:574]	:	INFO	:	Epoch 1736 | loss: nan | val_loss: nan | Time: 524810 ms
[2022-03-24 14:11:02	                main:574]	:	INFO	:	Epoch 1737 | loss: nan | val_loss: nan | Time: 182827 ms
[2022-03-24 14:22:11	                main:574]	:	INFO	:	Epoch 1738 | loss: nan | val_loss: nan | Time: 668536 ms
[2022-03-24 14:25:52	                main:574]	:	INFO	:	Epoch 1739 | loss: nan | val_loss: nan | Time: 216146 ms
[2022-03-24 14:28:40	                main:574]	:	INFO	:	Epoch 1740 | loss: nan | val_loss: nan | Time: 168401 ms
[2022-03-24 14:39:24	                main:574]	:	INFO	:	Epoch 1741 | loss: nan | val_loss: nan | Time: 643551 ms
[2022-03-24 14:46:18	                main:574]	:	INFO	:	Epoch 1742 | loss: nan | val_loss: nan | Time: 414355 ms
[2022-03-24 14:57:17	                main:574]	:	INFO	:	Epoch 1743 | loss: nan | val_loss: nan | Time: 658998 ms
[2022-03-24 14:58:21	                main:574]	:	INFO	:	Epoch 1744 | loss: nan | val_loss: nan | Time: 63709 ms
[2022-03-24 15:02:58	                main:574]	:	INFO	:	Epoch 1745 | loss: nan | val_loss: nan | Time: 276859 ms
[2022-03-24 15:11:37	                main:574]	:	INFO	:	Epoch 1746 | loss: nan | val_loss: nan | Time: 518857 ms
[2022-03-24 15:15:13	                main:574]	:	INFO	:	Epoch 1747 | loss: nan | val_loss: nan | Time: 215861 ms
[2022-03-24 15:22:10	                main:574]	:	INFO	:	Epoch 1748 | loss: nan | val_loss: nan | Time: 416801 ms
[2022-03-24 15:31:05	                main:574]	:	INFO	:	Epoch 1749 | loss: nan | val_loss: nan | Time: 534445 ms
[2022-03-24 15:31:52	                main:574]	:	INFO	:	Epoch 1750 | loss: nan | val_loss: nan | Time: 47388.4 ms
[2022-03-24 15:39:29	                main:574]	:	INFO	:	Epoch 1751 | loss: nan | val_loss: nan | Time: 456703 ms
[2022-03-24 15:48:23	                main:574]	:	INFO	:	Epoch 1752 | loss: nan | val_loss: nan | Time: 534179 ms
[2022-03-24 15:56:03	                main:574]	:	INFO	:	Epoch 1753 | loss: nan | val_loss: nan | Time: 459859 ms
[2022-03-24 16:04:01	                main:574]	:	INFO	:	Epoch 1754 | loss: nan | val_loss: nan | Time: 467486 ms
[2022-03-24 16:04:45	                main:574]	:	INFO	:	Epoch 1755 | loss: nan | val_loss: nan | Time: 43407.3 ms
[2022-03-24 16:05:29	                main:574]	:	INFO	:	Epoch 1756 | loss: nan | val_loss: nan | Time: 44071.7 ms
[2022-03-24 16:11:07	                main:574]	:	INFO	:	Epoch 1757 | loss: nan | val_loss: nan | Time: 337602 ms
[2022-03-24 16:20:28	                main:574]	:	INFO	:	Epoch 1758 | loss: nan | val_loss: nan | Time: 561586 ms
[2022-03-24 16:22:31	                main:574]	:	INFO	:	Epoch 1759 | loss: nan | val_loss: nan | Time: 122116 ms
[2022-03-24 16:31:14	                main:574]	:	INFO	:	Epoch 1760 | loss: nan | val_loss: nan | Time: 523663 ms
[2022-03-24 16:39:04	                main:574]	:	INFO	:	Epoch 1761 | loss: nan | val_loss: nan | Time: 469092 ms
[2022-03-24 16:45:16	                main:574]	:	INFO	:	Epoch 1762 | loss: nan | val_loss: nan | Time: 372525 ms
[2022-03-24 16:54:56	                main:574]	:	INFO	:	Epoch 1763 | loss: nan | val_loss: nan | Time: 579444 ms
[2022-03-24 16:56:30	                main:574]	:	INFO	:	Epoch 1764 | loss: nan | val_loss: nan | Time: 93883.7 ms
[2022-03-24 17:03:29	                main:574]	:	INFO	:	Epoch 1765 | loss: nan | val_loss: nan | Time: 418825 ms
[2022-03-24 17:12:54	                main:574]	:	INFO	:	Epoch 1766 | loss: nan | val_loss: nan | Time: 565193 ms
[2022-03-24 17:18:00	                main:574]	:	INFO	:	Epoch 1767 | loss: nan | val_loss: nan | Time: 306325 ms
[2022-03-24 17:29:20	                main:574]	:	INFO	:	Epoch 1768 | loss: nan | val_loss: nan | Time: 679194 ms
[2022-03-24 17:31:15	                main:574]	:	INFO	:	Epoch 1769 | loss: nan | val_loss: nan | Time: 115009 ms
[2022-03-24 17:35:49	                main:574]	:	INFO	:	Epoch 1770 | loss: nan | val_loss: nan | Time: 274083 ms
[2022-03-24 17:45:06	                main:574]	:	INFO	:	Epoch 1771 | loss: nan | val_loss: nan | Time: 556862 ms
[2022-03-24 17:48:45	                main:574]	:	INFO	:	Epoch 1772 | loss: nan | val_loss: nan | Time: 219250 ms
[2022-03-24 17:52:19	                main:574]	:	INFO	:	Epoch 1773 | loss: nan | val_loss: nan | Time: 213429 ms
[2022-03-24 17:59:43	                main:574]	:	INFO	:	Epoch 1774 | loss: nan | val_loss: nan | Time: 438128 ms
[2022-03-24 18:08:19	                main:574]	:	INFO	:	Epoch 1775 | loss: nan | val_loss: nan | Time: 516479 ms
[2022-03-24 18:10:19	                main:574]	:	INFO	:	Epoch 1776 | loss: nan | val_loss: nan | Time: 119857 ms
[2022-03-24 18:17:05	                main:574]	:	INFO	:	Epoch 1777 | loss: nan | val_loss: nan | Time: 405993 ms
[2022-03-24 18:26:43	                main:574]	:	INFO	:	Epoch 1778 | loss: nan | val_loss: nan | Time: 578202 ms
[2022-03-24 18:27:44	                main:574]	:	INFO	:	Epoch 1779 | loss: nan | val_loss: nan | Time: 60051.7 ms
[2022-03-24 18:28:28	                main:574]	:	INFO	:	Epoch 1780 | loss: nan | val_loss: nan | Time: 44117.3 ms
[2022-03-24 18:29:13	                main:574]	:	INFO	:	Epoch 1781 | loss: nan | val_loss: nan | Time: 45495.3 ms
[2022-03-24 18:29:58	                main:574]	:	INFO	:	Epoch 1782 | loss: nan | val_loss: nan | Time: 44086.5 ms
[2022-03-24 18:30:42	                main:574]	:	INFO	:	Epoch 1783 | loss: nan | val_loss: nan | Time: 43990.5 ms
[2022-03-24 18:34:12	                main:574]	:	INFO	:	Epoch 1784 | loss: nan | val_loss: nan | Time: 210598 ms
[2022-03-24 18:42:06	                main:574]	:	INFO	:	Epoch 1785 | loss: nan | val_loss: nan | Time: 473733 ms
[2022-03-24 18:47:18	                main:574]	:	INFO	:	Epoch 1786 | loss: nan | val_loss: nan | Time: 311527 ms
[2022-03-24 18:48:02	                main:574]	:	INFO	:	Epoch 1787 | loss: nan | val_loss: nan | Time: 43846.6 ms
[2022-03-24 18:48:50	                main:574]	:	INFO	:	Epoch 1788 | loss: nan | val_loss: nan | Time: 48167 ms
[2022-03-24 18:49:34	                main:574]	:	INFO	:	Epoch 1789 | loss: nan | val_loss: nan | Time: 44188 ms
[2022-03-24 18:50:21	                main:574]	:	INFO	:	Epoch 1790 | loss: nan | val_loss: nan | Time: 46531.4 ms
[2022-03-24 18:51:06	                main:574]	:	INFO	:	Epoch 1791 | loss: nan | val_loss: nan | Time: 44776.5 ms
[2022-03-24 18:51:50	                main:574]	:	INFO	:	Epoch 1792 | loss: nan | val_loss: nan | Time: 43974.2 ms
[2022-03-24 18:52:45	                main:574]	:	INFO	:	Epoch 1793 | loss: nan | val_loss: nan | Time: 54896 ms
[2022-03-24 18:53:49	                main:574]	:	INFO	:	Epoch 1794 | loss: nan | val_loss: nan | Time: 63920.3 ms
[2022-03-24 18:54:59	                main:574]	:	INFO	:	Epoch 1795 | loss: nan | val_loss: nan | Time: 68971.6 ms
[2022-03-24 18:56:05	                main:574]	:	INFO	:	Epoch 1796 | loss: nan | val_loss: nan | Time: 65224.3 ms
[2022-03-24 18:57:10	                main:574]	:	INFO	:	Epoch 1797 | loss: nan | val_loss: nan | Time: 64104 ms
[2022-03-24 18:58:23	                main:574]	:	INFO	:	Epoch 1798 | loss: nan | val_loss: nan | Time: 72847.7 ms
[2022-03-24 18:59:28	                main:574]	:	INFO	:	Epoch 1799 | loss: nan | val_loss: nan | Time: 65264.5 ms
[2022-03-24 19:00:36	                main:574]	:	INFO	:	Epoch 1800 | loss: nan | val_loss: nan | Time: 67290.3 ms
[2022-03-24 19:01:41	                main:574]	:	INFO	:	Epoch 1801 | loss: nan | val_loss: nan | Time: 64800.2 ms
[2022-03-24 19:02:47	                main:574]	:	INFO	:	Epoch 1802 | loss: nan | val_loss: nan | Time: 65879.8 ms
[2022-03-24 19:03:53	                main:574]	:	INFO	:	Epoch 1803 | loss: nan | val_loss: nan | Time: 64881.4 ms
[2022-03-24 19:05:11	                main:574]	:	INFO	:	Epoch 1804 | loss: nan | val_loss: nan | Time: 78145.2 ms
[2022-03-24 19:05:55	                main:574]	:	INFO	:	Epoch 1805 | loss: nan | val_loss: nan | Time: 43371.2 ms
[2022-03-24 19:06:42	                main:574]	:	INFO	:	Epoch 1806 | loss: nan | val_loss: nan | Time: 47601.7 ms
[2022-03-24 19:07:27	                main:574]	:	INFO	:	Epoch 1807 | loss: nan | val_loss: nan | Time: 44050.1 ms
[2022-03-24 19:08:11	                main:574]	:	INFO	:	Epoch 1808 | loss: nan | val_loss: nan | Time: 43977.3 ms
[2022-03-24 19:08:58	                main:574]	:	INFO	:	Epoch 1809 | loss: nan | val_loss: nan | Time: 47094.8 ms
[2022-03-24 19:09:46	                main:574]	:	INFO	:	Epoch 1810 | loss: nan | val_loss: nan | Time: 48516.1 ms
[2022-03-24 19:10:38	                main:574]	:	INFO	:	Epoch 1811 | loss: nan | val_loss: nan | Time: 50508.3 ms
[2022-03-24 19:11:26	                main:574]	:	INFO	:	Epoch 1812 | loss: nan | val_loss: nan | Time: 46558.2 ms
[2022-03-24 19:12:10	                main:574]	:	INFO	:	Epoch 1813 | loss: nan | val_loss: nan | Time: 44385.5 ms
[2022-03-24 19:13:45	                main:574]	:	INFO	:	Epoch 1814 | loss: nan | val_loss: nan | Time: 94100.7 ms
[2022-03-24 19:14:30	                main:574]	:	INFO	:	Epoch 1815 | loss: nan | val_loss: nan | Time: 44158.1 ms
[2022-03-24 19:15:25	                main:574]	:	INFO	:	Epoch 1816 | loss: nan | val_loss: nan | Time: 55279.6 ms
[2022-03-24 19:16:14	                main:574]	:	INFO	:	Epoch 1817 | loss: nan | val_loss: nan | Time: 46798 ms
[2022-03-24 19:16:58	                main:574]	:	INFO	:	Epoch 1818 | loss: nan | val_loss: nan | Time: 44154 ms
[2022-03-24 19:17:44	                main:574]	:	INFO	:	Epoch 1819 | loss: nan | val_loss: nan | Time: 44806.7 ms
[2022-03-24 19:18:29	                main:574]	:	INFO	:	Epoch 1820 | loss: nan | val_loss: nan | Time: 44186.6 ms
[2022-03-24 19:19:18	                main:574]	:	INFO	:	Epoch 1821 | loss: nan | val_loss: nan | Time: 48427.3 ms
[2022-03-24 19:22:55	                main:574]	:	INFO	:	Epoch 1822 | loss: nan | val_loss: nan | Time: 213246 ms
[2022-03-24 19:28:59	                main:574]	:	INFO	:	Epoch 1823 | loss: nan | val_loss: nan | Time: 359565 ms
[2022-03-24 19:33:47	                main:574]	:	INFO	:	Epoch 1824 | loss: nan | val_loss: nan | Time: 287546 ms
[2022-03-24 19:37:38	                main:574]	:	INFO	:	Epoch 1825 | loss: nan | val_loss: nan | Time: 231047 ms
[2022-03-24 19:40:43	                main:574]	:	INFO	:	Epoch 1826 | loss: nan | val_loss: nan | Time: 184234 ms
[2022-03-24 19:44:39	                main:574]	:	INFO	:	Epoch 1827 | loss: nan | val_loss: nan | Time: 230040 ms
[2022-03-24 19:47:39	                main:574]	:	INFO	:	Epoch 1828 | loss: nan | val_loss: nan | Time: 178969 ms
[2022-03-24 19:50:54	                main:574]	:	INFO	:	Epoch 1829 | loss: nan | val_loss: nan | Time: 194126 ms
[2022-03-24 19:51:43	                main:574]	:	INFO	:	Epoch 1830 | loss: nan | val_loss: nan | Time: 48856 ms
[2022-03-24 19:54:55	                main:574]	:	INFO	:	Epoch 1831 | loss: nan | val_loss: nan | Time: 192273 ms
[2022-03-24 20:00:41	                main:574]	:	INFO	:	Epoch 1832 | loss: nan | val_loss: nan | Time: 343960 ms
[2022-03-24 20:06:22	                main:574]	:	INFO	:	Epoch 1833 | loss: nan | val_loss: nan | Time: 341460 ms
[2022-03-24 20:08:42	                main:574]	:	INFO	:	Epoch 1834 | loss: nan | val_loss: nan | Time: 138766 ms
[2022-03-24 20:09:41	                main:574]	:	INFO	:	Epoch 1835 | loss: nan | val_loss: nan | Time: 58257.4 ms
[2022-03-24 20:10:44	                main:574]	:	INFO	:	Epoch 1836 | loss: nan | val_loss: nan | Time: 61446.3 ms
[2022-03-24 20:11:42	                main:574]	:	INFO	:	Epoch 1837 | loss: nan | val_loss: nan | Time: 57372.9 ms
[2022-03-24 20:12:39	                main:574]	:	INFO	:	Epoch 1838 | loss: nan | val_loss: nan | Time: 57489.4 ms
[2022-03-24 20:13:58	                main:574]	:	INFO	:	Epoch 1839 | loss: nan | val_loss: nan | Time: 77815.7 ms
[2022-03-24 20:14:57	                main:574]	:	INFO	:	Epoch 1840 | loss: nan | val_loss: nan | Time: 59400.3 ms
[2022-03-24 20:16:32	                main:574]	:	INFO	:	Epoch 1841 | loss: nan | val_loss: nan | Time: 94251 ms
[2022-03-24 20:25:01	                main:574]	:	INFO	:	Epoch 1842 | loss: nan | val_loss: nan | Time: 509334 ms
[2022-03-24 20:31:56	                main:574]	:	INFO	:	Epoch 1843 | loss: nan | val_loss: nan | Time: 414305 ms
[2022-03-24 20:39:04	                main:574]	:	INFO	:	Epoch 1844 | loss: nan | val_loss: nan | Time: 423667 ms
[2022-03-24 20:39:48	                main:574]	:	INFO	:	Epoch 1845 | loss: nan | val_loss: nan | Time: 43937.1 ms
[2022-03-24 20:40:34	                main:574]	:	INFO	:	Epoch 1846 | loss: nan | val_loss: nan | Time: 44348.8 ms
[2022-03-24 20:41:23	                main:574]	:	INFO	:	Epoch 1847 | loss: nan | val_loss: nan | Time: 49290.7 ms
[2022-03-24 20:42:07	                main:574]	:	INFO	:	Epoch 1848 | loss: nan | val_loss: nan | Time: 44329.8 ms
[2022-03-24 20:42:52	                main:574]	:	INFO	:	Epoch 1849 | loss: nan | val_loss: nan | Time: 44072.2 ms
[2022-03-24 20:43:36	                main:574]	:	INFO	:	Epoch 1850 | loss: nan | val_loss: nan | Time: 44358.8 ms
[2022-03-24 20:44:25	                main:574]	:	INFO	:	Epoch 1851 | loss: nan | val_loss: nan | Time: 49045.5 ms
[2022-03-24 20:45:10	                main:574]	:	INFO	:	Epoch 1852 | loss: nan | val_loss: nan | Time: 44271.2 ms
[2022-03-24 20:45:54	                main:574]	:	INFO	:	Epoch 1853 | loss: nan | val_loss: nan | Time: 44183.6 ms
[2022-03-24 20:46:44	                main:574]	:	INFO	:	Epoch 1854 | loss: nan | val_loss: nan | Time: 49076.1 ms
[2022-03-24 20:47:28	                main:574]	:	INFO	:	Epoch 1855 | loss: nan | val_loss: nan | Time: 44203.1 ms
[2022-03-24 20:48:13	                main:574]	:	INFO	:	Epoch 1856 | loss: nan | val_loss: nan | Time: 45132.6 ms
[2022-03-24 20:49:01	                main:574]	:	INFO	:	Epoch 1857 | loss: nan | val_loss: nan | Time: 44317.4 ms
[2022-03-24 20:49:50	                main:574]	:	INFO	:	Epoch 1858 | loss: nan | val_loss: nan | Time: 48686.2 ms
[2022-03-24 20:50:39	                main:574]	:	INFO	:	Epoch 1859 | loss: nan | val_loss: nan | Time: 48730.7 ms
[2022-03-24 20:51:23	                main:574]	:	INFO	:	Epoch 1860 | loss: nan | val_loss: nan | Time: 44168.2 ms
[2022-03-24 20:52:08	                main:574]	:	INFO	:	Epoch 1861 | loss: nan | val_loss: nan | Time: 44117.1 ms
[2022-03-24 20:52:57	                main:574]	:	INFO	:	Epoch 1862 | loss: nan | val_loss: nan | Time: 48848.4 ms
[2022-03-24 20:53:41	                main:574]	:	INFO	:	Epoch 1863 | loss: nan | val_loss: nan | Time: 44314.8 ms
[2022-03-24 20:54:29	                main:574]	:	INFO	:	Epoch 1864 | loss: nan | val_loss: nan | Time: 47954.4 ms
[2022-03-24 20:55:14	                main:574]	:	INFO	:	Epoch 1865 | loss: nan | val_loss: nan | Time: 44283.2 ms
[2022-03-24 20:56:02	                main:574]	:	INFO	:	Epoch 1866 | loss: nan | val_loss: nan | Time: 48274.3 ms
[2022-03-24 20:56:46	                main:574]	:	INFO	:	Epoch 1867 | loss: nan | val_loss: nan | Time: 44208.9 ms
[2022-03-24 20:57:31	                main:574]	:	INFO	:	Epoch 1868 | loss: nan | val_loss: nan | Time: 44257.8 ms
[2022-03-24 20:58:20	                main:574]	:	INFO	:	Epoch 1869 | loss: nan | val_loss: nan | Time: 48541.9 ms
[2022-03-24 20:59:04	                main:574]	:	INFO	:	Epoch 1870 | loss: nan | val_loss: nan | Time: 44177.6 ms
[2022-03-24 20:59:51	                main:574]	:	INFO	:	Epoch 1871 | loss: nan | val_loss: nan | Time: 46568.4 ms
[2022-03-24 21:00:35	                main:574]	:	INFO	:	Epoch 1872 | loss: nan | val_loss: nan | Time: 44173.6 ms
[2022-03-24 21:01:20	                main:574]	:	INFO	:	Epoch 1873 | loss: nan | val_loss: nan | Time: 44158.6 ms
[2022-03-24 21:02:08	                main:574]	:	INFO	:	Epoch 1874 | loss: nan | val_loss: nan | Time: 48096.3 ms
[2022-03-24 21:02:52	                main:574]	:	INFO	:	Epoch 1875 | loss: nan | val_loss: nan | Time: 44160.4 ms
[2022-03-24 21:03:41	                main:574]	:	INFO	:	Epoch 1876 | loss: nan | val_loss: nan | Time: 48212.9 ms
[2022-03-24 21:04:25	                main:574]	:	INFO	:	Epoch 1877 | loss: nan | val_loss: nan | Time: 44284.6 ms
[2022-03-24 21:05:09	                main:574]	:	INFO	:	Epoch 1878 | loss: nan | val_loss: nan | Time: 44279.8 ms
[2022-03-24 21:05:58	                main:574]	:	INFO	:	Epoch 1879 | loss: nan | val_loss: nan | Time: 48072 ms
[2022-03-24 21:06:42	                main:574]	:	INFO	:	Epoch 1880 | loss: nan | val_loss: nan | Time: 44207.8 ms
[2022-03-24 21:07:31	                main:574]	:	INFO	:	Epoch 1881 | loss: nan | val_loss: nan | Time: 48544.6 ms
[2022-03-24 21:08:15	                main:574]	:	INFO	:	Epoch 1882 | loss: nan | val_loss: nan | Time: 44264.4 ms
[2022-03-24 21:09:00	                main:574]	:	INFO	:	Epoch 1883 | loss: nan | val_loss: nan | Time: 44154.8 ms
[2022-03-24 21:09:44	                main:574]	:	INFO	:	Epoch 1884 | loss: nan | val_loss: nan | Time: 44296.5 ms
[2022-03-24 21:10:33	                main:574]	:	INFO	:	Epoch 1885 | loss: nan | val_loss: nan | Time: 48887.2 ms
[2022-03-24 21:11:18	                main:574]	:	INFO	:	Epoch 1886 | loss: nan | val_loss: nan | Time: 44321.5 ms
[2022-03-24 21:12:02	                main:574]	:	INFO	:	Epoch 1887 | loss: nan | val_loss: nan | Time: 44286 ms
[2022-03-24 21:12:52	                main:574]	:	INFO	:	Epoch 1888 | loss: nan | val_loss: nan | Time: 49651.3 ms
[2022-03-24 21:13:36	                main:574]	:	INFO	:	Epoch 1889 | loss: nan | val_loss: nan | Time: 44265.4 ms
[2022-03-24 21:14:21	                main:574]	:	INFO	:	Epoch 1890 | loss: nan | val_loss: nan | Time: 44347.3 ms
[2022-03-24 21:15:05	                main:574]	:	INFO	:	Epoch 1891 | loss: nan | val_loss: nan | Time: 44310.3 ms
[2022-03-24 21:15:54	                main:574]	:	INFO	:	Epoch 1892 | loss: nan | val_loss: nan | Time: 48708.2 ms
[2022-03-24 21:16:38	                main:574]	:	INFO	:	Epoch 1893 | loss: nan | val_loss: nan | Time: 44111.5 ms
[2022-03-24 21:17:26	                main:574]	:	INFO	:	Epoch 1894 | loss: nan | val_loss: nan | Time: 47843.1 ms
[2022-03-24 21:18:11	                main:574]	:	INFO	:	Epoch 1895 | loss: nan | val_loss: nan | Time: 44153.5 ms
[2022-03-24 21:18:55	                main:574]	:	INFO	:	Epoch 1896 | loss: nan | val_loss: nan | Time: 44211.2 ms
[2022-03-24 21:19:47	                main:574]	:	INFO	:	Epoch 1897 | loss: nan | val_loss: nan | Time: 51707.2 ms
[2022-03-24 21:20:31	                main:574]	:	INFO	:	Epoch 1898 | loss: nan | val_loss: nan | Time: 44271.6 ms
[2022-03-24 21:21:20	                main:574]	:	INFO	:	Epoch 1899 | loss: nan | val_loss: nan | Time: 49133.8 ms
[2022-03-24 21:22:08	                main:574]	:	INFO	:	Epoch 1900 | loss: nan | val_loss: nan | Time: 47964.9 ms
[2022-03-24 21:23:14	                main:574]	:	INFO	:	Epoch 1901 | loss: nan | val_loss: nan | Time: 64930.3 ms
[2022-03-24 21:23:59	                main:574]	:	INFO	:	Epoch 1902 | loss: nan | val_loss: nan | Time: 44756.8 ms
[2022-03-24 21:24:47	                main:574]	:	INFO	:	Epoch 1903 | loss: nan | val_loss: nan | Time: 43983.8 ms
[2022-03-24 21:25:32	                main:574]	:	INFO	:	Epoch 1904 | loss: nan | val_loss: nan | Time: 44464.6 ms
[2022-03-24 21:26:16	                main:574]	:	INFO	:	Epoch 1905 | loss: nan | val_loss: nan | Time: 44143.5 ms
[2022-03-24 21:27:04	                main:574]	:	INFO	:	Epoch 1906 | loss: nan | val_loss: nan | Time: 47444.2 ms
[2022-03-24 21:27:48	                main:574]	:	INFO	:	Epoch 1907 | loss: nan | val_loss: nan | Time: 44230.1 ms
[2022-03-24 21:28:37	                main:574]	:	INFO	:	Epoch 1908 | loss: nan | val_loss: nan | Time: 47920.2 ms
[2022-03-24 21:29:21	                main:574]	:	INFO	:	Epoch 1909 | loss: nan | val_loss: nan | Time: 44391.6 ms
[2022-03-24 21:30:05	                main:574]	:	INFO	:	Epoch 1910 | loss: nan | val_loss: nan | Time: 44172.3 ms
[2022-03-24 21:30:54	                main:574]	:	INFO	:	Epoch 1911 | loss: nan | val_loss: nan | Time: 48685.5 ms
[2022-03-24 21:31:39	                main:574]	:	INFO	:	Epoch 1912 | loss: nan | val_loss: nan | Time: 44311.5 ms
[2022-03-24 21:32:27	                main:574]	:	INFO	:	Epoch 1913 | loss: nan | val_loss: nan | Time: 47645.9 ms
[2022-03-24 21:33:11	                main:574]	:	INFO	:	Epoch 1914 | loss: nan | val_loss: nan | Time: 44289.6 ms
[2022-03-24 21:33:55	                main:574]	:	INFO	:	Epoch 1915 | loss: nan | val_loss: nan | Time: 44232.3 ms
[2022-03-24 21:34:43	                main:574]	:	INFO	:	Epoch 1916 | loss: nan | val_loss: nan | Time: 47744.2 ms
[2022-03-24 21:35:28	                main:574]	:	INFO	:	Epoch 1917 | loss: nan | val_loss: nan | Time: 44317.3 ms
[2022-03-24 21:36:16	                main:574]	:	INFO	:	Epoch 1918 | loss: nan | val_loss: nan | Time: 47634.3 ms
[2022-03-24 21:37:00	                main:574]	:	INFO	:	Epoch 1919 | loss: nan | val_loss: nan | Time: 44418.7 ms
[2022-03-24 21:37:50	                main:574]	:	INFO	:	Epoch 1920 | loss: nan | val_loss: nan | Time: 50181.7 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GT 1030)
[2022-03-27 13:52:22	                main:435]	:	INFO	:	Set logging level to 1
[2022-03-27 13:52:22	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-03-27 13:52:22	                main:444]	:	INFO	:	Resolving all filenames
[2022-03-27 13:52:32	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-27 13:52:32	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-27 13:52:32	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-27 13:52:32	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-27 13:52:32	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-27 13:52:33	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-03-27 13:52:33	                main:474]	:	INFO	:	Configuration: 
[2022-03-27 13:52:33	                main:475]	:	INFO	:	    Model type: GRU
[2022-03-27 13:52:33	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-03-27 13:52:33	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-03-27 13:52:33	                main:478]	:	INFO	:	    Batch Size: 128
[2022-03-27 13:52:33	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-03-27 13:52:33	                main:480]	:	INFO	:	    Patience: 10
[2022-03-27 13:52:33	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-03-27 13:52:33	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-03-27 13:52:33	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-03-27 13:52:33	                main:484]	:	INFO	:	    # Threads: 1
[2022-03-27 13:52:33	                main:486]	:	INFO	:	Preparing Dataset
[2022-03-27 13:52:33	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GT 1030)
[2022-03-27 13:53:34	                main:435]	:	INFO	:	Set logging level to 1
[2022-03-27 13:53:34	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-03-27 13:53:34	                main:444]	:	INFO	:	Resolving all filenames
[2022-03-27 13:53:34	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-27 13:53:34	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-27 13:53:34	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-27 13:53:34	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-27 13:53:34	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-27 13:53:34	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-03-27 13:53:34	                main:474]	:	INFO	:	Configuration: 
[2022-03-27 13:53:34	                main:475]	:	INFO	:	    Model type: GRU
[2022-03-27 13:53:34	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-03-27 13:53:35	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-03-27 13:53:35	                main:478]	:	INFO	:	    Batch Size: 128
[2022-03-27 13:53:35	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-03-27 13:53:35	                main:480]	:	INFO	:	    Patience: 10
[2022-03-27 13:53:35	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-03-27 13:53:35	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-03-27 13:53:35	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-03-27 13:53:35	                main:484]	:	INFO	:	    # Threads: 1
[2022-03-27 13:53:35	                main:486]	:	INFO	:	Preparing Dataset
[2022-03-27 13:53:35	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GT 1030)
[2022-03-27 13:58:24	                main:435]	:	INFO	:	Set logging level to 1
[2022-03-27 13:58:24	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-03-27 13:58:24	                main:444]	:	INFO	:	Resolving all filenames
[2022-03-27 13:58:24	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-27 13:58:24	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-27 13:58:24	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-27 13:58:24	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-27 13:58:24	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-27 13:58:24	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-03-27 13:58:24	                main:474]	:	INFO	:	Configuration: 
[2022-03-27 13:58:24	                main:475]	:	INFO	:	    Model type: GRU
[2022-03-27 13:58:24	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-03-27 13:58:24	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-03-27 13:58:24	                main:478]	:	INFO	:	    Batch Size: 128
[2022-03-27 13:58:24	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-03-27 13:58:24	                main:480]	:	INFO	:	    Patience: 10
[2022-03-27 13:58:24	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-03-27 13:58:24	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-03-27 13:58:25	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-03-27 13:58:25	                main:484]	:	INFO	:	    # Threads: 1
[2022-03-27 13:58:25	                main:486]	:	INFO	:	Preparing Dataset
[2022-03-27 13:58:25	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-27 13:59:33	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-03-27 14:02:16	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-03-27 14:02:16	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-03-27 14:02:31	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-03-27 14:02:52	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-03-27 14:02:52	                main:494]	:	INFO	:	Creating Model
[2022-03-27 14:02:52	                main:507]	:	INFO	:	Preparing config file
[2022-03-27 14:02:53	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-03-27 14:02:53	                main:512]	:	INFO	:	Loading config


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFB7A454F69

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 03/27/22 14:02:53
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\0;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 000000000fd10000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000007ccd0000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 000000007b400000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 000000007a420000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 000000007b4c0000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000007a3f0000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1586) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1586

ModLoad: 0000000065720000 0000000000058000 C:\ProgramData\BOINC\slots\0\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000007aa30000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 000000007cc60000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202

ModLoad: 000000007a720000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 000000007ac90000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 000000007b2b0000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000007b7c0000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.19041.546

ModLoad: 000000007b660000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.1586) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000007b180000 0000000000125000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000012f40000 000000000abe7000 C:\ProgramData\BOINC\slots\0\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000001db30000 0000000024b49000 C:\ProgramData\BOINC\slots\0\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000062b00000 0000000000099000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.22.27821.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\agent\_work\3\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.22.27821.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174; 2017
    Product Version       : 14.22.27821.0

ModLoad: 0000000068370000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.867

ModLoad: 0000000065aa0000 0000000000016000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.22.27821.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\agent\_work\3\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.22.27821.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174; 2017
    Product Version       : 14.22.27821.0

ModLoad: 00000000759e0000 000000000000b000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.22.27821.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\agent\_work\3\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.22.27821.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174; 2017
    Product Version       : 14.22.27821.0

ModLoad: 0000000057f60000 000000000020d000 C:\ProgramData\BOINC\slots\0\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 0000000045120000 00000000002db000 C:\ProgramData\BOINC\slots\0\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000656d0000 0000000000045000 C:\ProgramData\BOINC\slots\0\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000000fe90000 00000000030a5000 C:\ProgramData\BOINC\slots\0\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 00000000f1620000 00000000034b2000 C:\ProgramData\BOINC\slots\0\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000759d0000 0000000000010000 C:\ProgramData\BOINC\slots\0\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 00000000e8480000 000000000919f000 C:\ProgramData\BOINC\slots\0\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000e4720000 0000000003d5b000 C:\ProgramData\BOINC\slots\0\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 0000000063ee0000 0000000000040000 C:\ProgramData\BOINC\slots\0\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000df530000 0000000001eca000 C:\ProgramData\BOINC\slots\0\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000f4ae0000 000000001b3a4000 C:\ProgramData\BOINC\slots\0\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 000000007b360000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000078320000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000007c740000 0000000000470000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000007a8c0000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 000000007a6f0000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000007a0c0000 0000000000033000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 000000007a9c0000 0000000000068000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 000000007ab30000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000079f00000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000007bbc0000 0000000000744000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.19041.964 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.964

ModLoad: 0000000078520000 0000000000794000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000007b860000 0000000000354000 C:\WINDOWS\System32\combase.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.19041.1320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1320

ModLoad: 0000000079d80000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000007b710000 00000000000ad000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000007adb0000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000437b0000 00000000002cd000 C:\WINDOWS\system32\nvcuda.dll (30.0.15.1165) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_37\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 30.0.15.1165
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.6.99 driver
    Product Version       : 30.0.15.1165

ModLoad: 00000000e1400000 00000000016a0000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_31a2adf8c49e7799\nvcuda64.dll (30.0.15.1165) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_37\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 30.0.15.1165
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.6.99 driver
    Product Version       : 30.0.15.1165

ModLoad: 00000000756e0000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000756a0000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.19041.906 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.906

ModLoad: 0000000073030000 0000000000148000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : drvstore.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 0000000079cf0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000006ec40000 0000000000768000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.15.1165) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_37\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 30.0.15.1165
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 30.0.15.1165

ModLoad: 000000007a830000 0000000000082000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.19041.1415 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1415



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3624, Write: 307, Other 848

- I/O Transfers Counters -
Read: 6683859, Write: 6049, Other 28850

- Paged Pool Usage -
QuotaPagedPoolUsage: 3438864, QuotaPeakPagedPoolUsage: 3438864
QuotaNonPagedPoolUsage: 36984, QuotaPeakNonPagedPoolUsage: 37048

- Virtual Memory Usage -
VirtualSize: -1467019264, PeakVirtualSize: -876109824

- Pagefile Usage -
PagefileUsage: -1467019264, PeakPagefileUsage: -1467019264

- Working Set Size -
WorkingSetSize: 1159057408, PeakWorkingSetSize: 1159061504, PageFaultCount: 395074

*** Dump of thread ID 2744 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 21093750.000000, User Time: 66718752.000000, Wait Time: 1173884.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFB7A454F69

- Registers -
rax=000000007ccfb3c7 rbx=0000000010074910 rcx=000000000ede0000 rdx=0000000000000000 rsi=000000007a7d6930 rdi=0000000019930520
r8=000000000000004e r9=0000000000000027 r10=000000007ccfb86b r11=00000000041301b3 r12=0000000056f29c00 r13=000000007a7d6b40
r14=0000000048b2b0e0 r15=0000000000000000 rip=000000007a454f69 rsp=000000007a7d67d0 rbp=000000007a7d6ac0
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
7a7d68a0 0ff8a884 00000040 0000004f 56f2a500 0000007a KERNELBASE!RaiseException+0x0 
7a7d6900 0fd31ca6 00000008 0eeb0000 6b83f460 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
7a7d69b0 0fd3593b 00000000 00000030 00000020 00000008 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
7a7d6b00 0fd31a78 00000000 00000000 7a7d6e30 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
7a7d6bd0 0fd31cfc 7a7d6e30 00000000 00000080 7a7d7100 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
7a7d6c90 0fd3c4dd 7a7d7100 7a7d7100 7a7d7100 7a7d7100 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
7a7d6f80 0fd2b2fe 7a7d7598 7a7d7100 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
7a7efd20 0ff6c6f8 1082b900 00000000 00000000 0eeb7820 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
7a7efd60 7b417034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
7a7efd90 7cd22651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
7a7efe10 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 3060 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 1173878.000000

- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=000000007adff870 rsi=0000000000000000 rdi=0000000000000064
r8=000000007adff848 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000007cd6d3f4 rsp=000000007adff848 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
7adff840 7a46962e 7adff908 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0 
7adff8e0 0fd4a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0 
7adff910 7b417034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
7adff940 7cd22651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
7adff9c0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 3992 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 156250.000000, Wait Time: 1173883.000000

- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=000000007aaff420 rsi=0000000000000000 rdi=000000000000000d
r8=000000007aaff0c8 r9=0000000010a5db70 r10=0000000000000000 r11=0000000000000246 r12=0000000000000064 r13=000000007aaff420
r14=000000007aaff120 r15=0000000000000000 rip=000000007cd6d8c4 rsp=000000007aaff0c8 rbp=0000000010a5db70
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
7aaff0c0 7a46cb20 00000000 7a982000 7ce3a4d0 7a982000 ntdll!ZwWaitForMultipleObjects+0x0 
7aaff3b0 7a46ca1e 10af5000 004e0049 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
7aaff3f0 e15dd554 10a60f90 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
7aaff630 e16858cd 00000000 10a5db70 00000000 00000000 nvcuda64!+0x0 
7aaff6e0 e15dcf23 b550f119 592d6477 114084d0 00000000 nvcuda64!cuProfilerStop+0x0 
7aaff710 e19144c4 114084d0 00000000 00000000 00000000 nvcuda64!+0x0 
7aaff740 7b417034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
7aaff770 7cd22651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
7aaff7f0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 2240 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 1163673.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002bc rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002bc
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000010a29350 r13=0000000000000000
r14=00000000000002bc r15=0000000000000000 rip=000000007cd6cdf4 rsp=000000007abff468 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
7abff460 7a441a5e 00000000 00001f80 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0 
7abff500 e1805d0e 11408710 00000000 00000000 000002bc KERNELBASE!WaitForSingleObjectEx+0x0 
7abff740 e15dcf23 00000000 11408710 e1400000 10a7cd20 nvcuda64!cuProfilerStop+0x0 
7abff770 e19144c4 11408710 00000000 00000000 00000000 nvcuda64!+0x0 
7abff7a0 7b417034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
7abff7d0 7cd22651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
7abff850 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)