Task 14140284

Name ParityModified-1647046519-4221-2-0_1
Workunit 10836785
Created 31 Mar 2022, 12:45:07 UTC
Sent 31 Mar 2022, 14:05:35 UTC
Report deadline 8 Apr 2022, 14:05:35 UTC
Received 31 Mar 2022, 14:40:23 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 8915
Run time 24 min 19 sec
CPU time 21 min 36 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 4,470.32 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.54 GB
Peak swap size 3.48 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
26:54	                main:574]	:	INFO	:	Epoch 570 | loss: 0.0311286 | val_loss: 0.0311548 | Time: 1666.3 ms
[2022-03-31 15:26:56	                main:574]	:	INFO	:	Epoch 571 | loss: 0.031126 | val_loss: 0.0311578 | Time: 1692.76 ms
[2022-03-31 15:26:57	                main:574]	:	INFO	:	Epoch 572 | loss: 0.0311249 | val_loss: 0.031162 | Time: 1684.69 ms
[2022-03-31 15:26:59	                main:574]	:	INFO	:	Epoch 573 | loss: 0.031126 | val_loss: 0.0311516 | Time: 1670.47 ms
[2022-03-31 15:27:01	                main:574]	:	INFO	:	Epoch 574 | loss: 0.0311252 | val_loss: 0.0311535 | Time: 1662.75 ms
[2022-03-31 15:27:02	                main:574]	:	INFO	:	Epoch 575 | loss: 0.0311229 | val_loss: 0.0311555 | Time: 1657.86 ms
[2022-03-31 15:27:04	                main:574]	:	INFO	:	Epoch 576 | loss: 0.0311208 | val_loss: 0.0311522 | Time: 1656.74 ms
[2022-03-31 15:27:06	                main:574]	:	INFO	:	Epoch 577 | loss: 0.0311207 | val_loss: 0.03116 | Time: 1672.27 ms
[2022-03-31 15:27:07	                main:574]	:	INFO	:	Epoch 578 | loss: 0.0311222 | val_loss: 0.0311603 | Time: 1682.33 ms
[2022-03-31 15:27:09	                main:574]	:	INFO	:	Epoch 579 | loss: 0.0311219 | val_loss: 0.0311553 | Time: 1671.62 ms
[2022-03-31 15:27:11	                main:574]	:	INFO	:	Epoch 580 | loss: 0.0311246 | val_loss: 0.0311588 | Time: 1656.38 ms
[2022-03-31 15:27:12	                main:574]	:	INFO	:	Epoch 581 | loss: 0.03113 | val_loss: 0.0311515 | Time: 1664.43 ms
[2022-03-31 15:27:14	                main:574]	:	INFO	:	Epoch 582 | loss: 0.0311309 | val_loss: 0.0311531 | Time: 1667.14 ms
[2022-03-31 15:27:16	                main:574]	:	INFO	:	Epoch 583 | loss: 0.0311293 | val_loss: 0.0311512 | Time: 1697.36 ms
[2022-03-31 15:27:18	                main:574]	:	INFO	:	Epoch 584 | loss: 0.0311261 | val_loss: 0.0311515 | Time: 1681.76 ms
[2022-03-31 15:27:19	                main:574]	:	INFO	:	Epoch 585 | loss: 0.0311245 | val_loss: 0.0311499 | Time: 1659.03 ms
[2022-03-31 15:27:21	                main:574]	:	INFO	:	Epoch 586 | loss: 0.031125 | val_loss: 0.031151 | Time: 1675.35 ms
[2022-03-31 15:27:23	                main:574]	:	INFO	:	Epoch 587 | loss: 0.0311253 | val_loss: 0.0311497 | Time: 1674.64 ms
[2022-03-31 15:27:24	                main:574]	:	INFO	:	Epoch 588 | loss: 0.0311247 | val_loss: 0.0311515 | Time: 1669.78 ms
[2022-03-31 15:27:26	                main:574]	:	INFO	:	Epoch 589 | loss: 0.0311254 | val_loss: 0.0311549 | Time: 1686.52 ms
[2022-03-31 15:27:28	                main:574]	:	INFO	:	Epoch 590 | loss: 0.0311242 | val_loss: 0.0311505 | Time: 1669.07 ms
[2022-03-31 15:27:29	                main:574]	:	INFO	:	Epoch 591 | loss: 0.0311235 | val_loss: 0.031152 | Time: 1679.13 ms
[2022-03-31 15:27:31	                main:574]	:	INFO	:	Epoch 592 | loss: 0.0311233 | val_loss: 0.0311558 | Time: 1673.42 ms
[2022-03-31 15:27:33	                main:574]	:	INFO	:	Epoch 593 | loss: 0.0311219 | val_loss: 0.0311509 | Time: 1679.06 ms
[2022-03-31 15:27:34	                main:574]	:	INFO	:	Epoch 594 | loss: 0.0311214 | val_loss: 0.0311553 | Time: 1669.45 ms
[2022-03-31 15:27:36	                main:574]	:	INFO	:	Epoch 595 | loss: 0.0311202 | val_loss: 0.0311532 | Time: 1701.48 ms
[2022-03-31 15:27:38	                main:574]	:	INFO	:	Epoch 596 | loss: 0.0311238 | val_loss: 0.0311504 | Time: 1728.73 ms
[2022-03-31 15:27:40	                main:574]	:	INFO	:	Epoch 597 | loss: 0.0311293 | val_loss: 0.0311522 | Time: 1700.72 ms
[2022-03-31 15:27:41	                main:574]	:	INFO	:	Epoch 598 | loss: 0.0311334 | val_loss: 0.0311498 | Time: 1661.86 ms
[2022-03-31 15:27:43	                main:574]	:	INFO	:	Epoch 599 | loss: 0.0311301 | val_loss: 0.03115 | Time: 1660.72 ms
[2022-03-31 15:27:45	                main:574]	:	INFO	:	Epoch 600 | loss: 0.0311284 | val_loss: 0.0311482 | Time: 1677.62 ms
[2022-03-31 15:27:46	                main:574]	:	INFO	:	Epoch 601 | loss: 0.0311274 | val_loss: 0.0311495 | Time: 1673.34 ms
[2022-03-31 15:27:48	                main:574]	:	INFO	:	Epoch 602 | loss: 0.0311271 | val_loss: 0.0311497 | Time: 1691.5 ms
[2022-03-31 15:27:50	                main:574]	:	INFO	:	Epoch 603 | loss: 0.031126 | val_loss: 0.0311496 | Time: 1689.72 ms
[2022-03-31 15:27:51	                main:574]	:	INFO	:	Epoch 604 | loss: 0.0311242 | val_loss: 0.0311512 | Time: 1681.49 ms
[2022-03-31 15:27:53	                main:574]	:	INFO	:	Epoch 605 | loss: 0.0311233 | val_loss: 0.0311532 | Time: 1719.9 ms
[2022-03-31 15:27:55	                main:574]	:	INFO	:	Epoch 606 | loss: 0.0311234 | val_loss: 0.0311525 | Time: 1680.25 ms
[2022-03-31 15:27:56	                main:574]	:	INFO	:	Epoch 607 | loss: 0.0311232 | val_loss: 0.0311473 | Time: 1689.2 ms
[2022-03-31 15:27:58	                main:574]	:	INFO	:	Epoch 608 | loss: 0.0311237 | val_loss: 0.031151 | Time: 1686.7 ms
[2022-03-31 15:28:00	                main:574]	:	INFO	:	Epoch 609 | loss: 0.0311238 | val_loss: 0.0311527 | Time: 1686.8 ms
[2022-03-31 15:28:02	                main:574]	:	INFO	:	Epoch 610 | loss: 0.0311231 | val_loss: 0.0311518 | Time: 1708.19 ms
[2022-03-31 15:28:03	                main:574]	:	INFO	:	Epoch 611 | loss: 0.031124 | val_loss: 0.0311583 | Time: 1681.24 ms
[2022-03-31 15:28:05	                main:574]	:	INFO	:	Epoch 612 | loss: 0.0311255 | val_loss: 0.0311513 | Time: 1671.45 ms
[2022-03-31 15:28:07	                main:574]	:	INFO	:	Epoch 613 | loss: 0.0311228 | val_loss: 0.0311463 | Time: 1674.38 ms
[2022-03-31 15:28:08	                main:574]	:	INFO	:	Epoch 614 | loss: 0.0311239 | val_loss: 0.0311466 | Time: 1778.1 ms
[2022-03-31 15:28:10	                main:574]	:	INFO	:	Epoch 615 | loss: 0.0311308 | val_loss: 0.0311523 | Time: 1821.91 ms
[2022-03-31 15:28:12	                main:574]	:	INFO	:	Epoch 616 | loss: 0.0311299 | val_loss: 0.0311536 | Time: 1782.01 ms
[2022-03-31 15:28:14	                main:574]	:	INFO	:	Epoch 617 | loss: 0.0311271 | val_loss: 0.0311519 | Time: 2046.85 ms
[2022-03-31 15:28:16	                main:574]	:	INFO	:	Epoch 618 | loss: 0.0311325 | val_loss: 0.0311543 | Time: 1711.55 ms
[2022-03-31 15:28:18	                main:574]	:	INFO	:	Epoch 619 | loss: 0.0311312 | val_loss: 0.0311522 | Time: 1698.34 ms
[2022-03-31 15:28:19	                main:574]	:	INFO	:	Epoch 620 | loss: 0.0311454 | val_loss: 0.0311697 | Time: 1707.41 ms
[2022-03-31 15:28:21	                main:574]	:	INFO	:	Epoch 621 | loss: 0.0335598 | val_loss: 0.0324801 | Time: 1719.79 ms
[2022-03-31 15:28:33	                main:574]	:	INFO	:	Epoch 622 | loss: nan | val_loss: nan | Time: 12019 ms
[2022-03-31 15:28:35	                main:574]	:	INFO	:	Epoch 623 | loss: nan | val_loss: nan | Time: 1697.5 ms
[2022-03-31 15:28:36	                main:574]	:	INFO	:	Epoch 624 | loss: nan | val_loss: nan | Time: 1700.52 ms
[2022-03-31 15:28:38	                main:574]	:	INFO	:	Epoch 625 | loss: nan | val_loss: nan | Time: 1710.33 ms
[2022-03-31 15:28:40	                main:574]	:	INFO	:	Epoch 626 | loss: nan | val_loss: nan | Time: 1934.73 ms
[2022-03-31 15:28:42	                main:574]	:	INFO	:	Epoch 627 | loss: nan | val_loss: nan | Time: 1713.4 ms
[2022-03-31 15:28:44	                main:574]	:	INFO	:	Epoch 628 | loss: nan | val_loss: nan | Time: 1826.23 ms
[2022-03-31 15:28:45	                main:574]	:	INFO	:	Epoch 629 | loss: nan | val_loss: nan | Time: 1705.73 ms
[2022-03-31 15:28:47	                main:574]	:	INFO	:	Epoch 630 | loss: nan | val_loss: nan | Time: 1711.44 ms
[2022-03-31 15:28:49	                main:574]	:	INFO	:	Epoch 631 | loss: nan | val_loss: nan | Time: 1708.62 ms
[2022-03-31 15:28:51	                main:574]	:	INFO	:	Epoch 632 | loss: nan | val_loss: nan | Time: 1697.07 ms
[2022-03-31 15:28:52	                main:574]	:	INFO	:	Epoch 633 | loss: nan | val_loss: nan | Time: 1857.23 ms
[2022-03-31 15:28:54	                main:574]	:	INFO	:	Epoch 634 | loss: nan | val_loss: nan | Time: 1706.71 ms
[2022-03-31 15:28:56	                main:574]	:	INFO	:	Epoch 635 | loss: nan | val_loss: nan | Time: 1724.91 ms
[2022-03-31 15:28:58	                main:574]	:	INFO	:	Epoch 636 | loss: nan | val_loss: nan | Time: 1705.98 ms
[2022-03-31 15:28:59	                main:574]	:	INFO	:	Epoch 637 | loss: nan | val_loss: nan | Time: 1716.5 ms
[2022-03-31 15:29:01	                main:574]	:	INFO	:	Epoch 638 | loss: nan | val_loss: nan | Time: 1718.35 ms
[2022-03-31 15:29:03	                main:574]	:	INFO	:	Epoch 639 | loss: nan | val_loss: nan | Time: 1825.63 ms
[2022-03-31 15:29:05	                main:574]	:	INFO	:	Epoch 640 | loss: nan | val_loss: nan | Time: 1741.63 ms
[2022-03-31 15:29:06	                main:574]	:	INFO	:	Epoch 641 | loss: nan | val_loss: nan | Time: 1712.99 ms
[2022-03-31 15:29:08	                main:574]	:	INFO	:	Epoch 642 | loss: nan | val_loss: nan | Time: 1868.71 ms
[2022-03-31 15:29:10	                main:574]	:	INFO	:	Epoch 643 | loss: nan | val_loss: nan | Time: 1704.3 ms
[2022-03-31 15:29:12	                main:574]	:	INFO	:	Epoch 644 | loss: nan | val_loss: nan | Time: 1691.53 ms
[2022-03-31 15:29:13	                main:574]	:	INFO	:	Epoch 645 | loss: nan | val_loss: nan | Time: 1695.99 ms
[2022-03-31 15:29:15	                main:574]	:	INFO	:	Epoch 646 | loss: nan | val_loss: nan | Time: 1847.2 ms
[2022-03-31 15:29:17	                main:574]	:	INFO	:	Epoch 647 | loss: nan | val_loss: nan | Time: 1696.89 ms
[2022-03-31 15:29:19	                main:574]	:	INFO	:	Epoch 648 | loss: nan | val_loss: nan | Time: 1823.56 ms
[2022-03-31 15:29:20	                main:574]	:	INFO	:	Epoch 649 | loss: nan | val_loss: nan | Time: 1707.27 ms
[2022-03-31 15:29:22	                main:574]	:	INFO	:	Epoch 650 | loss: nan | val_loss: nan | Time: 1720.78 ms
[2022-03-31 15:29:24	                main:574]	:	INFO	:	Epoch 651 | loss: nan | val_loss: nan | Time: 1682.44 ms
[2022-03-31 15:29:26	                main:574]	:	INFO	:	Epoch 652 | loss: nan | val_loss: nan | Time: 1835.16 ms
[2022-03-31 15:29:27	                main:574]	:	INFO	:	Epoch 653 | loss: nan | val_loss: nan | Time: 1702.14 ms
[2022-03-31 15:29:29	                main:574]	:	INFO	:	Epoch 654 | loss: nan | val_loss: nan | Time: 1725.78 ms
[2022-03-31 15:29:31	                main:574]	:	INFO	:	Epoch 655 | loss: nan | val_loss: nan | Time: 1718.13 ms
[2022-03-31 15:29:33	                main:574]	:	INFO	:	Epoch 656 | loss: nan | val_loss: nan | Time: 1732.21 ms
[2022-03-31 15:29:35	                main:574]	:	INFO	:	Epoch 657 | loss: nan | val_loss: nan | Time: 1841 ms
[2022-03-31 15:29:36	                main:574]	:	INFO	:	Epoch 658 | loss: nan | val_loss: nan | Time: 1725.62 ms
[2022-03-31 15:29:38	                main:574]	:	INFO	:	Epoch 659 | loss: nan | val_loss: nan | Time: 1707.88 ms
[2022-03-31 15:29:40	                main:574]	:	INFO	:	Epoch 660 | loss: nan | val_loss: nan | Time: 1840.67 ms
[2022-03-31 15:29:42	                main:574]	:	INFO	:	Epoch 661 | loss: nan | val_loss: nan | Time: 1698.8 ms
[2022-03-31 15:29:43	                main:574]	:	INFO	:	Epoch 662 | loss: nan | val_loss: nan | Time: 1709.03 ms
[2022-03-31 15:29:45	                main:574]	:	INFO	:	Epoch 663 | loss: nan | val_loss: nan | Time: 1718.79 ms
[2022-03-31 15:29:47	                main:574]	:	INFO	:	Epoch 664 | loss: nan | val_loss: nan | Time: 1725.39 ms
[2022-03-31 15:29:48	                main:574]	:	INFO	:	Epoch 665 | loss: nan | val_loss: nan | Time: 1727.8 ms
[2022-03-31 15:29:50	                main:574]	:	INFO	:	Epoch 666 | loss: nan | val_loss: nan | Time: 1918.35 ms
[2022-03-31 15:29:52	                main:574]	:	INFO	:	Epoch 667 | loss: nan | val_loss: nan | Time: 1863.8 ms
[2022-03-31 15:29:54	                main:574]	:	INFO	:	Epoch 668 | loss: nan | val_loss: nan | Time: 1704.58 ms
[2022-03-31 15:29:56	                main:574]	:	INFO	:	Epoch 669 | loss: nan | val_loss: nan | Time: 1701.32 ms
[2022-03-31 15:29:57	                main:574]	:	INFO	:	Epoch 670 | loss: nan | val_loss: nan | Time: 1703.17 ms
[2022-03-31 15:29:59	                main:574]	:	INFO	:	Epoch 671 | loss: nan | val_loss: nan | Time: 1723.82 ms
[2022-03-31 15:30:01	                main:574]	:	INFO	:	Epoch 672 | loss: nan | val_loss: nan | Time: 1913.73 ms
[2022-03-31 15:30:03	                main:574]	:	INFO	:	Epoch 673 | loss: nan | val_loss: nan | Time: 1703.04 ms
[2022-03-31 15:30:04	                main:574]	:	INFO	:	Epoch 674 | loss: nan | val_loss: nan | Time: 1713.41 ms
[2022-03-31 15:30:06	                main:574]	:	INFO	:	Epoch 675 | loss: nan | val_loss: nan | Time: 1838.6 ms
[2022-03-31 15:30:08	                main:574]	:	INFO	:	Epoch 676 | loss: nan | val_loss: nan | Time: 1699.68 ms
[2022-03-31 15:30:10	                main:574]	:	INFO	:	Epoch 677 | loss: nan | val_loss: nan | Time: 1724.08 ms
[2022-03-31 15:30:12	                main:574]	:	INFO	:	Epoch 678 | loss: nan | val_loss: nan | Time: 1853.59 ms
[2022-03-31 15:30:13	                main:574]	:	INFO	:	Epoch 679 | loss: nan | val_loss: nan | Time: 1717.91 ms
[2022-03-31 15:30:15	                main:574]	:	INFO	:	Epoch 680 | loss: nan | val_loss: nan | Time: 1731.62 ms
[2022-03-31 15:30:17	                main:574]	:	INFO	:	Epoch 681 | loss: nan | val_loss: nan | Time: 1726 ms
[2022-03-31 15:30:19	                main:574]	:	INFO	:	Epoch 682 | loss: nan | val_loss: nan | Time: 1696.9 ms
[2022-03-31 15:30:20	                main:574]	:	INFO	:	Epoch 683 | loss: nan | val_loss: nan | Time: 1825.21 ms
[2022-03-31 15:30:22	                main:574]	:	INFO	:	Epoch 684 | loss: nan | val_loss: nan | Time: 1703.7 ms
[2022-03-31 15:30:24	                main:574]	:	INFO	:	Epoch 685 | loss: nan | val_loss: nan | Time: 1719.86 ms
[2022-03-31 15:30:26	                main:574]	:	INFO	:	Epoch 686 | loss: nan | val_loss: nan | Time: 1703.68 ms
[2022-03-31 15:30:27	                main:574]	:	INFO	:	Epoch 687 | loss: nan | val_loss: nan | Time: 1705.59 ms
[2022-03-31 15:30:29	                main:574]	:	INFO	:	Epoch 688 | loss: nan | val_loss: nan | Time: 1839.93 ms
[2022-03-31 15:30:31	                main:574]	:	INFO	:	Epoch 689 | loss: nan | val_loss: nan | Time: 1692.05 ms
[2022-03-31 15:30:33	                main:574]	:	INFO	:	Epoch 690 | loss: nan | val_loss: nan | Time: 1719.4 ms
[2022-03-31 15:30:34	                main:574]	:	INFO	:	Epoch 691 | loss: nan | val_loss: nan | Time: 1713.82 ms
[2022-03-31 15:30:36	                main:574]	:	INFO	:	Epoch 692 | loss: nan | val_loss: nan | Time: 1818.71 ms
[2022-03-31 15:30:38	                main:574]	:	INFO	:	Epoch 693 | loss: nan | val_loss: nan | Time: 1696.29 ms
[2022-03-31 15:30:40	                main:574]	:	INFO	:	Epoch 694 | loss: nan | val_loss: nan | Time: 1694.83 ms
[2022-03-31 15:30:41	                main:574]	:	INFO	:	Epoch 695 | loss: nan | val_loss: nan | Time: 1757.77 ms
[2022-03-31 15:30:43	                main:574]	:	INFO	:	Epoch 696 | loss: nan | val_loss: nan | Time: 1725.84 ms
[2022-03-31 15:30:45	                main:574]	:	INFO	:	Epoch 697 | loss: nan | val_loss: nan | Time: 1960.18 ms
[2022-03-31 15:30:47	                main:574]	:	INFO	:	Epoch 698 | loss: nan | val_loss: nan | Time: 1761.47 ms
[2022-03-31 15:30:49	                main:574]	:	INFO	:	Epoch 699 | loss: nan | val_loss: nan | Time: 1761.8 ms
[2022-03-31 15:30:50	                main:574]	:	INFO	:	Epoch 700 | loss: nan | val_loss: nan | Time: 1823.6 ms
[2022-03-31 15:30:52	                main:574]	:	INFO	:	Epoch 701 | loss: nan | val_loss: nan | Time: 1669.51 ms
[2022-03-31 15:31:14	                main:574]	:	INFO	:	Epoch 702 | loss: nan | val_loss: nan | Time: 22072.5 ms
[2022-03-31 15:31:16	                main:574]	:	INFO	:	Epoch 703 | loss: nan | val_loss: nan | Time: 1812.05 ms
[2022-03-31 15:31:18	                main:574]	:	INFO	:	Epoch 704 | loss: nan | val_loss: nan | Time: 1761.4 ms
[2022-03-31 15:31:20	                main:574]	:	INFO	:	Epoch 705 | loss: nan | val_loss: nan | Time: 1775.15 ms
[2022-03-31 15:31:21	                main:574]	:	INFO	:	Epoch 706 | loss: nan | val_loss: nan | Time: 1783.27 ms
[2022-03-31 15:31:23	                main:574]	:	INFO	:	Epoch 707 | loss: nan | val_loss: nan | Time: 1781.39 ms
[2022-03-31 15:31:25	                main:574]	:	INFO	:	Epoch 708 | loss: nan | val_loss: nan | Time: 1880.24 ms
[2022-03-31 15:31:27	                main:574]	:	INFO	:	Epoch 709 | loss: nan | val_loss: nan | Time: 1884.38 ms
[2022-03-31 15:31:29	                main:574]	:	INFO	:	Epoch 710 | loss: nan | val_loss: nan | Time: 2019.05 ms
[2022-03-31 15:31:31	                main:574]	:	INFO	:	Epoch 711 | loss: nan | val_loss: nan | Time: 1820.85 ms
[2022-03-31 15:31:33	                main:574]	:	INFO	:	Epoch 712 | loss: nan | val_loss: nan | Time: 1790.6 ms
[2022-03-31 15:31:34	                main:574]	:	INFO	:	Epoch 713 | loss: nan | val_loss: nan | Time: 1774.12 ms
[2022-03-31 15:31:36	                main:574]	:	INFO	:	Epoch 714 | loss: nan | val_loss: nan | Time: 1837.63 ms
[2022-03-31 15:31:38	                main:574]	:	INFO	:	Epoch 715 | loss: nan | val_loss: nan | Time: 1769.67 ms
[2022-03-31 15:31:40	                main:574]	:	INFO	:	Epoch 716 | loss: nan | val_loss: nan | Time: 1776.95 ms
[2022-03-31 15:31:42	                main:574]	:	INFO	:	Epoch 717 | loss: nan | val_loss: nan | Time: 1772.22 ms
[2022-03-31 15:31:43	                main:574]	:	INFO	:	Epoch 718 | loss: nan | val_loss: nan | Time: 1779.56 ms
[2022-03-31 15:31:45	                main:574]	:	INFO	:	Epoch 719 | loss: nan | val_loss: nan | Time: 1816.39 ms
[2022-03-31 15:31:47	                main:574]	:	INFO	:	Epoch 720 | loss: nan | val_loss: nan | Time: 1766.84 ms
[2022-03-31 15:31:49	                main:574]	:	INFO	:	Epoch 721 | loss: nan | val_loss: nan | Time: 1756.65 ms
[2022-03-31 15:31:51	                main:574]	:	INFO	:	Epoch 722 | loss: nan | val_loss: nan | Time: 1786.69 ms
[2022-03-31 15:31:52	                main:574]	:	INFO	:	Epoch 723 | loss: nan | val_loss: nan | Time: 1790.26 ms
[2022-03-31 15:31:54	                main:574]	:	INFO	:	Epoch 724 | loss: nan | val_loss: nan | Time: 1935.27 ms
[2022-03-31 15:31:56	                main:574]	:	INFO	:	Epoch 725 | loss: nan | val_loss: nan | Time: 1759 ms
[2022-03-31 15:31:58	                main:574]	:	INFO	:	Epoch 726 | loss: nan | val_loss: nan | Time: 1754.14 ms
[2022-03-31 15:32:00	                main:574]	:	INFO	:	Epoch 727 | loss: nan | val_loss: nan | Time: 1771.99 ms
[2022-03-31 15:32:02	                main:574]	:	INFO	:	Epoch 728 | loss: nan | val_loss: nan | Time: 1928.44 ms
[2022-03-31 15:32:03	                main:574]	:	INFO	:	Epoch 729 | loss: nan | val_loss: nan | Time: 1806.51 ms
[2022-03-31 15:32:15	                main:574]	:	INFO	:	Epoch 730 | loss: nan | val_loss: nan | Time: 12058.1 ms
[2022-03-31 15:32:17	                main:574]	:	INFO	:	Epoch 731 | loss: nan | val_loss: nan | Time: 1816.29 ms
[2022-03-31 15:32:19	                main:574]	:	INFO	:	Epoch 732 | loss: nan | val_loss: nan | Time: 1757.05 ms
[2022-03-31 15:32:21	                main:574]	:	INFO	:	Epoch 733 | loss: nan | val_loss: nan | Time: 1843.98 ms
[2022-03-31 15:32:23	                main:574]	:	INFO	:	Epoch 734 | loss: nan | val_loss: nan | Time: 1773.35 ms
[2022-03-31 15:32:24	                main:574]	:	INFO	:	Epoch 735 | loss: nan | val_loss: nan | Time: 1769.71 ms
[2022-03-31 15:32:26	                main:574]	:	INFO	:	Epoch 736 | loss: nan | val_loss: nan | Time: 1782.92 ms
[2022-03-31 15:32:28	                main:574]	:	INFO	:	Epoch 737 | loss: nan | val_loss: nan | Time: 1788.05 ms
[2022-03-31 15:32:30	                main:574]	:	INFO	:	Epoch 738 | loss: nan | val_loss: nan | Time: 1811.35 ms
[2022-03-31 15:32:32	                main:574]	:	INFO	:	Epoch 739 | loss: nan | val_loss: nan | Time: 1887.17 ms
[2022-03-31 15:32:34	                main:574]	:	INFO	:	Epoch 740 | loss: nan | val_loss: nan | Time: 1822.42 ms
[2022-03-31 15:32:35	                main:574]	:	INFO	:	Epoch 741 | loss: nan | val_loss: nan | Time: 1751.87 ms
[2022-03-31 15:32:37	                main:574]	:	INFO	:	Epoch 742 | loss: nan | val_loss: nan | Time: 1788.97 ms
[2022-03-31 15:32:39	                main:574]	:	INFO	:	Epoch 743 | loss: nan | val_loss: nan | Time: 1837.62 ms
[2022-03-31 15:32:41	                main:574]	:	INFO	:	Epoch 744 | loss: nan | val_loss: nan | Time: 1771.78 ms
[2022-03-31 15:32:43	                main:574]	:	INFO	:	Epoch 745 | loss: nan | val_loss: nan | Time: 1790.06 ms
[2022-03-31 15:32:44	                main:574]	:	INFO	:	Epoch 746 | loss: nan | val_loss: nan | Time: 1790.27 ms
[2022-03-31 15:32:46	                main:574]	:	INFO	:	Epoch 747 | loss: nan | val_loss: nan | Time: 1836.8 ms
[2022-03-31 15:32:48	                main:574]	:	INFO	:	Epoch 748 | loss: nan | val_loss: nan | Time: 1775.94 ms
[2022-03-31 15:32:50	                main:574]	:	INFO	:	Epoch 749 | loss: nan | val_loss: nan | Time: 1859.87 ms
[2022-03-31 15:32:52	                main:574]	:	INFO	:	Epoch 750 | loss: nan | val_loss: nan | Time: 1827.55 ms
[2022-03-31 15:32:54	                main:574]	:	INFO	:	Epoch 751 | loss: nan | val_loss: nan | Time: 1872.66 ms
[2022-03-31 15:32:56	                main:574]	:	INFO	:	Epoch 752 | loss: nan | val_loss: nan | Time: 1839.15 ms
[2022-03-31 15:32:57	                main:574]	:	INFO	:	Epoch 753 | loss: nan | val_loss: nan | Time: 1772.59 ms
[2022-03-31 15:32:59	                main:574]	:	INFO	:	Epoch 754 | loss: nan | val_loss: nan | Time: 1790.76 ms
[2022-03-31 15:33:01	                main:574]	:	INFO	:	Epoch 755 | loss: nan | val_loss: nan | Time: 1772.7 ms
[2022-03-31 15:33:03	                main:574]	:	INFO	:	Epoch 756 | loss: nan | val_loss: nan | Time: 1779.7 ms
[2022-03-31 15:33:04	                main:574]	:	INFO	:	Epoch 757 | loss: nan | val_loss: nan | Time: 1815.97 ms
[2022-03-31 15:33:06	                main:574]	:	INFO	:	Epoch 758 | loss: nan | val_loss: nan | Time: 1777.78 ms
[2022-03-31 15:33:08	                main:574]	:	INFO	:	Epoch 759 | loss: nan | val_loss: nan | Time: 1794.66 ms
[2022-03-31 15:33:10	                main:574]	:	INFO	:	Epoch 760 | loss: nan | val_loss: nan | Time: 1764.65 ms
[2022-03-31 15:33:12	                main:574]	:	INFO	:	Epoch 761 | loss: nan | val_loss: nan | Time: 1805.54 ms
[2022-03-31 15:33:14	                main:574]	:	INFO	:	Epoch 762 | loss: nan | val_loss: nan | Time: 1824.35 ms
[2022-03-31 15:33:15	                main:574]	:	INFO	:	Epoch 763 | loss: nan | val_loss: nan | Time: 1780.8 ms
[2022-03-31 15:33:17	                main:574]	:	INFO	:	Epoch 764 | loss: nan | val_loss: nan | Time: 1795.45 ms
[2022-03-31 15:33:19	                main:574]	:	INFO	:	Epoch 765 | loss: nan | val_loss: nan | Time: 1795.59 ms
[2022-03-31 15:33:21	                main:574]	:	INFO	:	Epoch 766 | loss: nan | val_loss: nan | Time: 1773.8 ms
[2022-03-31 15:33:23	                main:574]	:	INFO	:	Epoch 767 | loss: nan | val_loss: nan | Time: 1839.04 ms
[2022-03-31 15:33:24	                main:574]	:	INFO	:	Epoch 768 | loss: nan | val_loss: nan | Time: 1853.31 ms
[2022-03-31 15:33:26	                main:574]	:	INFO	:	Epoch 769 | loss: nan | val_loss: nan | Time: 1758.4 ms
[2022-03-31 15:33:28	                main:574]	:	INFO	:	Epoch 770 | loss: nan | val_loss: nan | Time: 1782.54 ms
[2022-03-31 15:33:30	                main:574]	:	INFO	:	Epoch 771 | loss: nan | val_loss: nan | Time: 1774.29 ms
[2022-03-31 15:33:32	                main:574]	:	INFO	:	Epoch 772 | loss: nan | val_loss: nan | Time: 1790.87 ms
[2022-03-31 15:33:33	                main:574]	:	INFO	:	Epoch 773 | loss: nan | val_loss: nan | Time: 1853.4 ms
[2022-03-31 15:33:35	                main:574]	:	INFO	:	Epoch 774 | loss: nan | val_loss: nan | Time: 1773.12 ms
[2022-03-31 15:33:37	                main:574]	:	INFO	:	Epoch 775 | loss: nan | val_loss: nan | Time: 1839.05 ms
[2022-03-31 15:33:39	                main:574]	:	INFO	:	Epoch 776 | loss: nan | val_loss: nan | Time: 1850.36 ms
[2022-03-31 15:33:41	                main:574]	:	INFO	:	Epoch 777 | loss: nan | val_loss: nan | Time: 1832.92 ms
[2022-03-31 15:33:43	                main:574]	:	INFO	:	Epoch 778 | loss: nan | val_loss: nan | Time: 1774.74 ms
[2022-03-31 15:33:44	                main:574]	:	INFO	:	Epoch 779 | loss: nan | val_loss: nan | Time: 1787.45 ms
[2022-03-31 15:33:46	                main:574]	:	INFO	:	Epoch 780 | loss: nan | val_loss: nan | Time: 1793.92 ms
[2022-03-31 15:33:48	                main:574]	:	INFO	:	Epoch 781 | loss: nan | val_loss: nan | Time: 1822.53 ms
[2022-03-31 15:33:50	                main:574]	:	INFO	:	Epoch 782 | loss: nan | val_loss: nan | Time: 1773.86 ms
[2022-03-31 15:33:52	                main:574]	:	INFO	:	Epoch 783 | loss: nan | val_loss: nan | Time: 1768.71 ms
[2022-03-31 15:33:53	                main:574]	:	INFO	:	Epoch 784 | loss: nan | val_loss: nan | Time: 1773.72 ms
[2022-03-31 15:33:55	                main:574]	:	INFO	:	Epoch 785 | loss: nan | val_loss: nan | Time: 1782.23 ms
[2022-03-31 15:33:57	                main:574]	:	INFO	:	Epoch 786 | loss: nan | val_loss: nan | Time: 1830.21 ms
[2022-03-31 15:33:59	                main:574]	:	INFO	:	Epoch 787 | loss: nan | val_loss: nan | Time: 1772.2 ms
[2022-03-31 15:34:01	                main:574]	:	INFO	:	Epoch 788 | loss: nan | val_loss: nan | Time: 2014.06 ms
[2022-03-31 15:34:03	                main:574]	:	INFO	:	Epoch 789 | loss: nan | val_loss: nan | Time: 2038.2 ms
[2022-03-31 15:34:05	                main:574]	:	INFO	:	Epoch 790 | loss: nan | val_loss: nan | Time: 1775.89 ms
[2022-03-31 15:34:06	                main:574]	:	INFO	:	Epoch 791 | loss: nan | val_loss: nan | Time: 1835.51 ms
[2022-03-31 15:34:08	                main:574]	:	INFO	:	Epoch 792 | loss: nan | val_loss: nan | Time: 1786.75 ms
[2022-03-31 15:34:10	                main:574]	:	INFO	:	Epoch 793 | loss: nan | val_loss: nan | Time: 1840.91 ms
[2022-03-31 15:34:12	                main:574]	:	INFO	:	Epoch 794 | loss: nan | val_loss: nan | Time: 1769.93 ms
[2022-03-31 15:34:14	                main:574]	:	INFO	:	Epoch 795 | loss: nan | val_loss: nan | Time: 1749.57 ms
[2022-03-31 15:34:16	                main:574]	:	INFO	:	Epoch 796 | loss: nan | val_loss: nan | Time: 1815.85 ms
[2022-03-31 15:34:17	                main:574]	:	INFO	:	Epoch 797 | loss: nan | val_loss: nan | Time: 1785.99 ms
[2022-03-31 15:34:19	                main:574]	:	INFO	:	Epoch 798 | loss: nan | val_loss: nan | Time: 1777.37 ms
[2022-03-31 15:34:21	                main:574]	:	INFO	:	Epoch 799 | loss: nan | val_loss: nan | Time: 1803.14 ms
[2022-03-31 15:34:23	                main:574]	:	INFO	:	Epoch 800 | loss: nan | val_loss: nan | Time: 1794.73 ms
[2022-03-31 15:34:25	                main:574]	:	INFO	:	Epoch 801 | loss: nan | val_loss: nan | Time: 1791.18 ms
[2022-03-31 15:34:26	                main:574]	:	INFO	:	Epoch 802 | loss: nan | val_loss: nan | Time: 1747.04 ms
[2022-03-31 15:34:28	                main:574]	:	INFO	:	Epoch 803 | loss: nan | val_loss: nan | Time: 1756.27 ms
[2022-03-31 15:34:30	                main:574]	:	INFO	:	Epoch 804 | loss: nan | val_loss: nan | Time: 1765.32 ms
[2022-03-31 15:34:32	                main:574]	:	INFO	:	Epoch 805 | loss: nan | val_loss: nan | Time: 1765.04 ms
[2022-03-31 15:34:33	                main:574]	:	INFO	:	Epoch 806 | loss: nan | val_loss: nan | Time: 1837.58 ms
[2022-03-31 15:34:35	                main:574]	:	INFO	:	Epoch 807 | loss: nan | val_loss: nan | Time: 1783.91 ms
[2022-03-31 15:34:47	                main:574]	:	INFO	:	Epoch 808 | loss: nan | val_loss: nan | Time: 12109.1 ms
[2022-03-31 15:34:49	                main:574]	:	INFO	:	Epoch 809 | loss: nan | val_loss: nan | Time: 1759.08 ms
[2022-03-31 15:34:51	                main:574]	:	INFO	:	Epoch 810 | loss: nan | val_loss: nan | Time: 1752.96 ms
[2022-03-31 15:34:53	                main:574]	:	INFO	:	Epoch 811 | loss: nan | val_loss: nan | Time: 1828.78 ms
[2022-03-31 15:34:55	                main:574]	:	INFO	:	Epoch 812 | loss: nan | val_loss: nan | Time: 1776.41 ms
[2022-03-31 15:35:16	                main:574]	:	INFO	:	Epoch 813 | loss: nan | val_loss: nan | Time: 21868.9 ms
[2022-03-31 15:35:18	                main:574]	:	INFO	:	Epoch 814 | loss: nan | val_loss: nan | Time: 1857.55 ms
[2022-03-31 15:35:20	                main:574]	:	INFO	:	Epoch 815 | loss: nan | val_loss: nan | Time: 1775.76 ms
[2022-03-31 15:35:22	                main:574]	:	INFO	:	Epoch 816 | loss: nan | val_loss: nan | Time: 1767.92 ms
[2022-03-31 15:35:24	                main:574]	:	INFO	:	Epoch 817 | loss: nan | val_loss: nan | Time: 1786.35 ms
[2022-03-31 15:35:26	                main:574]	:	INFO	:	Epoch 818 | loss: nan | val_loss: nan | Time: 1844.97 ms
[2022-03-31 15:35:27	                main:574]	:	INFO	:	Epoch 819 | loss: nan | val_loss: nan | Time: 1877.57 ms
[2022-03-31 15:35:29	                main:574]	:	INFO	:	Epoch 820 | loss: nan | val_loss: nan | Time: 1791.33 ms
[2022-03-31 15:35:31	                main:574]	:	INFO	:	Epoch 821 | loss: nan | val_loss: nan | Time: 1785.46 ms
[2022-03-31 15:35:33	                main:574]	:	INFO	:	Epoch 822 | loss: nan | val_loss: nan | Time: 1775.82 ms
[2022-03-31 15:35:35	                main:574]	:	INFO	:	Epoch 823 | loss: nan | val_loss: nan | Time: 1794.7 ms
[2022-03-31 15:35:36	                main:574]	:	INFO	:	Epoch 824 | loss: nan | val_loss: nan | Time: 1807 ms
[2022-03-31 15:35:38	                main:574]	:	INFO	:	Epoch 825 | loss: nan | val_loss: nan | Time: 1798.33 ms
[2022-03-31 15:35:40	                main:574]	:	INFO	:	Epoch 826 | loss: nan | val_loss: nan | Time: 1767.85 ms
[2022-03-31 15:35:42	                main:574]	:	INFO	:	Epoch 827 | loss: nan | val_loss: nan | Time: 1779.28 ms
[2022-03-31 15:35:44	                main:574]	:	INFO	:	Epoch 828 | loss: nan | val_loss: nan | Time: 1836.53 ms
[2022-03-31 15:35:45	                main:574]	:	INFO	:	Epoch 829 | loss: nan | val_loss: nan | Time: 1825.38 ms
[2022-03-31 15:35:48	                main:574]	:	INFO	:	Epoch 830 | loss: nan | val_loss: nan | Time: 2226.55 ms
[2022-03-31 15:35:50	                main:574]	:	INFO	:	Epoch 831 | loss: nan | val_loss: nan | Time: 1807.7 ms
[2022-03-31 15:35:51	                main:574]	:	INFO	:	Epoch 832 | loss: nan | val_loss: nan | Time: 1773.48 ms
[2022-03-31 15:35:53	                main:574]	:	INFO	:	Epoch 833 | loss: nan | val_loss: nan | Time: 1792 ms
[2022-03-31 15:35:55	                main:574]	:	INFO	:	Epoch 834 | loss: nan | val_loss: nan | Time: 1841.23 ms
[2022-03-31 15:35:57	                main:574]	:	INFO	:	Epoch 835 | loss: nan | val_loss: nan | Time: 1771.33 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 970)
[2022-03-31 15:38:42	                main:435]	:	INFO	:	Set logging level to 1
[2022-03-31 15:38:42	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-03-31 15:38:42	                main:444]	:	INFO	:	Resolving all filenames
[2022-03-31 15:38:42	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-31 15:38:42	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-31 15:38:42	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-31 15:38:42	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-31 15:38:42	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-31 15:38:42	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-03-31 15:38:42	                main:474]	:	INFO	:	Configuration: 
[2022-03-31 15:38:42	                main:475]	:	INFO	:	    Model type: GRU
[2022-03-31 15:38:42	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-03-31 15:38:42	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-03-31 15:38:42	                main:478]	:	INFO	:	    Batch Size: 128
[2022-03-31 15:38:42	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-03-31 15:38:42	                main:480]	:	INFO	:	    Patience: 10
[2022-03-31 15:38:42	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-03-31 15:38:42	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-03-31 15:38:42	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-03-31 15:38:42	                main:484]	:	INFO	:	    # Threads: 1
[2022-03-31 15:38:42	                main:486]	:	INFO	:	Preparing Dataset
[2022-03-31 15:38:42	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-31 15:38:43	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-03-31 15:39:22	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-03-31 15:39:22	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-03-31 15:39:22	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-03-31 15:39:22	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-03-31 15:39:22	                main:494]	:	INFO	:	Creating Model
[2022-03-31 15:39:22	                main:507]	:	INFO	:	Preparing config file
[2022-03-31 15:39:22	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-03-31 15:39:22	                main:512]	:	INFO	:	Loading config


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFF4BDC4F69

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 03/31/22 15:39:22
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\0;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 000000006cd70000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000004e370000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 000000004c910000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 000000004bd90000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 000000004d310000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1586

ModLoad: 000000004c1c0000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1586) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1586

ModLoad: 000000004cd30000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202

ModLoad: 000000004c0b0000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 000000004bbf0000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 000000004c2a0000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 000000004e000000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000004d210000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.19041.546

ModLoad: 000000004dcf0000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.1586) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000004c500000 0000000000125000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000024a60000 0000000000058000 C:\ProgramData\BOINC\slots\0\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000002a590000 000000000008d000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.29.30135.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\4\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.29.30135.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.29.30135.0

ModLoad: 00000000d95c0000 0000000024b49000 C:\ProgramData\BOINC\slots\0\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000003abe0000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.867

ModLoad: 000000002a570000 000000000001b000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.29.30135.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\4\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.29.30135.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.29.30135.0

ModLoad: 000000002c6a0000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.29.30135.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\4\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.29.30135.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.29.30135.0

ModLoad: 0000000024a10000 0000000000045000 C:\ProgramData\BOINC\slots\0\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000ce9d0000 000000000abe7000 C:\ProgramData\BOINC\slots\0\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000c8460000 00000000030a5000 C:\ProgramData\BOINC\slots\0\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 00000000cb510000 00000000034b2000 C:\ProgramData\BOINC\slots\0\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000458c0000 0000000000010000 C:\ProgramData\BOINC\slots\0\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 00000000a3f10000 000000000919f000 C:\ProgramData\BOINC\slots\0\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 0000000024800000 000000000020d000 C:\ProgramData\BOINC\slots\0\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 00000000a01b0000 0000000003d5b000 C:\ProgramData\BOINC\slots\0\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000ad0b0000 000000001b3a4000 C:\ProgramData\BOINC\slots\0\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 000000001dd00000 00000000002db000 C:\ProgramData\BOINC\slots\0\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000009e2e0000 0000000001eca000 C:\ProgramData\BOINC\slots\0\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000247c0000 0000000000040000 C:\ProgramData\BOINC\slots\0\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000004d1e0000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000004a350000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000004cd70000 0000000000470000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1586

ModLoad: 000000004c060000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 000000004c3a0000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000004b850000 0000000000033000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 000000004bc90000 0000000000068000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 000000004ba90000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1586

ModLoad: 000000004b670000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000004d510000 0000000000744000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1586

ModLoad: 0000000049ba0000 0000000000794000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1586

ModLoad: 000000004c9d0000 0000000000354000 C:\WINDOWS\System32\combase.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.19041.1320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1320

ModLoad: 000000004b4f0000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000004e280000 00000000000ad000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1586

ModLoad: 000000004d2b0000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1586

ModLoad: 000000001d830000 00000000002cd000 C:\WINDOWS\system32\nvcuda.dll (30.0.15.1123) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_04\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 30.0.15.1123
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.6.58 driver
    Product Version       : 30.0.15.1123

ModLoad: 000000009cc40000 00000000016a0000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_015fa42d67826549\nvcuda64.dll (30.0.15.1123) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_04\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 30.0.15.1123
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.6.58 driver
    Product Version       : 30.0.15.1123

ModLoad: 0000000049aa0000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000434e0000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.19041.906 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.906

ModLoad: 0000000041c00000 0000000000148000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : drvstore.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 000000004b460000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000003dfa0000 0000000000767000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.15.1123) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_04\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 30.0.15.1123
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 30.0.15.1123

ModLoad: 000000004bd00000 0000000000082000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.19041.1415 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1415



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3613, Write: 307, Other 865

- I/O Transfers Counters -
Read: 6733195, Write: 6049, Other 28644

- Paged Pool Usage -
QuotaPagedPoolUsage: 3466136, QuotaPeakPagedPoolUsage: 3466136
QuotaNonPagedPoolUsage: 36984, QuotaPeakNonPagedPoolUsage: 36984

- Virtual Memory Usage -
VirtualSize: -1466458112, PeakVirtualSize: -972410880

- Pagefile Usage -
PagefileUsage: -1466458112, PeakPagefileUsage: -1466458112

- Working Set Size -
WorkingSetSize: 1135828992, PeakWorkingSetSize: 1135833088, PageFaultCount: 377471

*** Dump of thread ID 12712 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 6718750.000000, User Time: 13281250.000000, Wait Time: 5597.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFF4BDC4F69

- Registers -
rax=00000000d4568b93 rbx=000000006d0d4910 rcx=0000000072fd6140 rdx=0000000000000001 rsi=0000000072fd6a80 rdi=0000000019930520
r8=0000000072fd61d8 r9=0000000000000000 r10=0000000000000000 r11=00000000adfdfc00 r12=000000009f783350 r13=0000000072fd6c90
r14=00000000bc4ce7b0 r15=0000000000000000 rip=000000004bdc4f69 rsp=0000000072fd6920 rbp=0000000072fd6c10
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
72fd69f0 6cfea884 00000040 0000004f 9f782a00 000002b4 KERNELBASE!RaiseException+0x0 
72fd6a50 6cd91ca6 e69a0000 72fd6b29 bbaa87e8 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
72fd6b00 6cd9593b 00000000 00000030 00000020 00000008 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
72fd6c50 6cd91a78 00000000 00000000 72fd6f80 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
72fd6d20 6cd91cfc 72fd6f80 00000000 00000080 72fd7250 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
72fd6de0 6cd9c4dd 72fd7250 72fd7250 72fd7250 72fd7250 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
72fd70d0 6cd8b2fe 72fd76e8 72fd7250 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
72fefe70 6cfcc6f8 e8291590 00000000 00000000 e8436b30 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
72fefeb0 4c927034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
72fefee0 4e3c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
72feff60 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 13056 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 2952.000000

- Registers -
rax=00000000000001d3 rbx=00000000e69ae840 rcx=0000000000000070 rdx=00000000e69ae4c0 rsi=00000000e69a3cf0 rdi=00000000e69ae840
r8=0000000049aa5008 r9=00000000732fef40 r10=0000000049aa00f0 r11=0000000000000001 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000004e4107c4 rsp=00000000732ff498 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
732ff490 4e3c2dc7 00000000 00000000 e69a3cf0 e69ae840 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
732ff790 4c927034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
732ff7c0 4e3c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
732ff840 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 13148 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 312500.000000, User Time: 0.000000, Wait Time: 2952.000000

- Registers -
rax=00000000000001d3 rbx=00000000e69aec70 rcx=0000000000000070 rdx=00000000e69ae8f0 rsi=00000000e69a3cf0 rdi=00000000e69aec70
r8=0000000000000008 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000004e4107c4 rsp=00000000733ffb68 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
733ffb60 4e3c2dc7 00000000 00000000 e69a3cf0 e69aec70 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
733ffe60 4c927034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
733ffe90 4e3c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
733fff10 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 13000 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 2923.000000

- Registers -
rax=00000000000001d3 rbx=00000000e69af6f0 rcx=0000000000000070 rdx=00000000e69af370 rsi=00000000e69a3cf0 rdi=00000000e69af6f0
r8=00000000000003e1 r9=0000000000000016 r10=0000000000000000 r11=000000001df74aa1 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000004e4107c4 rsp=00000000734ffb28 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
734ffb20 4e3c2dc7 00010002 00000001 00000001 e69af6f0 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
734ffe20 4c927034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
734ffe50 4e3c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
734ffed0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 1384 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 5591.000000

- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000736ffa60 rsi=0000000000000000 rdi=0000000000000064
r8=00000000736ffa38 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000004e40d3f4 rsp=00000000736ffa38 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
736ffa30 4bdd962e 736ffaf8 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0 
736ffad0 6cdaa07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0 
736ffb00 4c927034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
736ffb30 4e3c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
736ffbb0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 6452 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 5594.000000

- Registers -
rax=000000000000005b rbx=000000000000000b rcx=000000000000000b rdx=00000000737ffae0 rsi=0000000000000000 rdi=000000000000000b
r8=00000000737ff788 r9=00000000e84790b0 r10=0000000000000000 r11=00000000737ffa50 r12=0000000000000064 r13=00000000737ffae0
r14=00000000737ff7e0 r15=0000000000000000 rip=000000004e40d8c4 rsp=00000000737ff788 rbp=00000000e84790b0
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
737ff780 4bddcb20 00000000 731ba000 4e4da4d0 731ba000 ntdll!ZwWaitForMultipleObjects+0x0 
737ffa70 4bddca1e e69b3ca0 004e0049 0000000b 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
737ffab0 9ce1d384 e8479350 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
737ffcf0 9cec56fd 00000000 e84790b0 00000000 00000000 nvcuda64!+0x0 
737ffda0 9ce1cd53 34631ade 331426bd e8a36730 00000000 nvcuda64!cuProfilerStop+0x0 
737ffdd0 9d154064 e8a36730 00000000 00000000 00000000 nvcuda64!+0x0 
737ffe00 4c927034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
737ffe30 4e3c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
737ffeb0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 6448 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 5468.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002b0 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002b0
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=00000000e84bf430 r13=0000000000000000
r14=00000000000002b0 r15=0000000000000000 rip=000000004e40cdf4 rsp=00000000738ff7d8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
738ff7d0 4bdb1a5e 00000000 00001f80 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0 
738ff870 9d04596e e8a36e20 00000000 00000000 000002b0 KERNELBASE!WaitForSingleObjectEx+0x0 
738ffab0 9ce1cd53 00000000 e8a36e20 9cc40000 e84d2f90 nvcuda64!cuProfilerStop+0x0 
738ffae0 9d154064 e8a36e20 00000000 00000000 00000000 nvcuda64!+0x0 
738ffb10 4c927034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
738ffb40 4e3c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
738ffbc0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)