Task 9095402

Name ParityModified-1636228993-17696-2-0_0
Workunit 6540601
Created 21 Nov 2021, 22:22:10 UTC
Sent 27 Nov 2021, 23:07:21 UTC
Report deadline 5 Dec 2021, 23:07:21 UTC
Received 28 Nov 2021, 14:28:42 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 12135
Run time 1 hours 0 min 7 sec
CPU time 59 min 52 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 8,191.38 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.63 GB
Peak swap size 3.65 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
:22:01	                main:574]	:	INFO	:	Epoch 583 | loss: nan | val_loss: nan | Time: 4266.17 ms
[2021-11-28 02:22:05	                main:574]	:	INFO	:	Epoch 584 | loss: nan | val_loss: nan | Time: 4263.44 ms
[2021-11-28 02:22:09	                main:574]	:	INFO	:	Epoch 585 | loss: nan | val_loss: nan | Time: 4265.11 ms
[2021-11-28 02:22:14	                main:574]	:	INFO	:	Epoch 586 | loss: nan | val_loss: nan | Time: 4246.35 ms
[2021-11-28 02:22:18	                main:574]	:	INFO	:	Epoch 587 | loss: nan | val_loss: nan | Time: 4267.49 ms
[2021-11-28 02:22:22	                main:574]	:	INFO	:	Epoch 588 | loss: nan | val_loss: nan | Time: 4225.02 ms
[2021-11-28 02:22:26	                main:574]	:	INFO	:	Epoch 589 | loss: nan | val_loss: nan | Time: 4246.8 ms
[2021-11-28 02:22:31	                main:574]	:	INFO	:	Epoch 590 | loss: nan | val_loss: nan | Time: 4265.99 ms
[2021-11-28 02:22:35	                main:574]	:	INFO	:	Epoch 591 | loss: nan | val_loss: nan | Time: 4263.96 ms
[2021-11-28 02:22:39	                main:574]	:	INFO	:	Epoch 592 | loss: nan | val_loss: nan | Time: 4265.91 ms
[2021-11-28 02:22:44	                main:574]	:	INFO	:	Epoch 593 | loss: nan | val_loss: nan | Time: 4296.86 ms
[2021-11-28 02:22:48	                main:574]	:	INFO	:	Epoch 594 | loss: nan | val_loss: nan | Time: 4266.58 ms
[2021-11-28 02:22:52	                main:574]	:	INFO	:	Epoch 595 | loss: nan | val_loss: nan | Time: 4281.64 ms
[2021-11-28 02:22:56	                main:574]	:	INFO	:	Epoch 596 | loss: nan | val_loss: nan | Time: 4264.24 ms
[2021-11-28 02:23:01	                main:574]	:	INFO	:	Epoch 597 | loss: nan | val_loss: nan | Time: 4281.12 ms
[2021-11-28 02:23:05	                main:574]	:	INFO	:	Epoch 598 | loss: nan | val_loss: nan | Time: 4299.2 ms
[2021-11-28 02:23:09	                main:574]	:	INFO	:	Epoch 599 | loss: nan | val_loss: nan | Time: 4283.87 ms
[2021-11-28 02:23:14	                main:574]	:	INFO	:	Epoch 600 | loss: nan | val_loss: nan | Time: 4262.45 ms
[2021-11-28 02:23:18	                main:574]	:	INFO	:	Epoch 601 | loss: nan | val_loss: nan | Time: 4282.2 ms
[2021-11-28 02:23:22	                main:574]	:	INFO	:	Epoch 602 | loss: nan | val_loss: nan | Time: 4264.39 ms
[2021-11-28 02:23:26	                main:574]	:	INFO	:	Epoch 603 | loss: nan | val_loss: nan | Time: 4264.51 ms
[2021-11-28 02:23:31	                main:574]	:	INFO	:	Epoch 604 | loss: nan | val_loss: nan | Time: 4243.34 ms
[2021-11-28 02:23:35	                main:574]	:	INFO	:	Epoch 605 | loss: nan | val_loss: nan | Time: 4263.61 ms
[2021-11-28 02:23:39	                main:574]	:	INFO	:	Epoch 606 | loss: nan | val_loss: nan | Time: 4297.69 ms
[2021-11-28 02:23:43	                main:574]	:	INFO	:	Epoch 607 | loss: nan | val_loss: nan | Time: 4281.65 ms
[2021-11-28 02:23:48	                main:574]	:	INFO	:	Epoch 608 | loss: nan | val_loss: nan | Time: 4266.77 ms
[2021-11-28 02:23:52	                main:574]	:	INFO	:	Epoch 609 | loss: nan | val_loss: nan | Time: 4295.46 ms
[2021-11-28 02:23:56	                main:574]	:	INFO	:	Epoch 610 | loss: nan | val_loss: nan | Time: 4250.41 ms
[2021-11-28 02:24:01	                main:574]	:	INFO	:	Epoch 611 | loss: nan | val_loss: nan | Time: 4279.77 ms
[2021-11-28 02:24:05	                main:574]	:	INFO	:	Epoch 612 | loss: nan | val_loss: nan | Time: 4268.11 ms
[2021-11-28 02:24:09	                main:574]	:	INFO	:	Epoch 613 | loss: nan | val_loss: nan | Time: 4262.99 ms
[2021-11-28 02:24:13	                main:574]	:	INFO	:	Epoch 614 | loss: nan | val_loss: nan | Time: 4283.38 ms
[2021-11-28 02:24:18	                main:574]	:	INFO	:	Epoch 615 | loss: nan | val_loss: nan | Time: 4263.29 ms
[2021-11-28 02:24:22	                main:574]	:	INFO	:	Epoch 616 | loss: nan | val_loss: nan | Time: 4264.72 ms
[2021-11-28 02:24:26	                main:574]	:	INFO	:	Epoch 617 | loss: nan | val_loss: nan | Time: 4264.63 ms
[2021-11-28 02:24:30	                main:574]	:	INFO	:	Epoch 618 | loss: nan | val_loss: nan | Time: 4283.37 ms
[2021-11-28 02:24:35	                main:574]	:	INFO	:	Epoch 619 | loss: nan | val_loss: nan | Time: 4296.52 ms
[2021-11-28 02:24:39	                main:574]	:	INFO	:	Epoch 620 | loss: nan | val_loss: nan | Time: 4258.16 ms
[2021-11-28 02:24:43	                main:574]	:	INFO	:	Epoch 621 | loss: nan | val_loss: nan | Time: 4282.43 ms
[2021-11-28 02:24:48	                main:574]	:	INFO	:	Epoch 622 | loss: nan | val_loss: nan | Time: 4281.5 ms
[2021-11-28 02:24:52	                main:574]	:	INFO	:	Epoch 623 | loss: nan | val_loss: nan | Time: 4297.74 ms
[2021-11-28 02:24:56	                main:574]	:	INFO	:	Epoch 624 | loss: nan | val_loss: nan | Time: 4282.04 ms
[2021-11-28 02:25:00	                main:574]	:	INFO	:	Epoch 625 | loss: nan | val_loss: nan | Time: 4298.97 ms
[2021-11-28 02:25:05	                main:574]	:	INFO	:	Epoch 626 | loss: nan | val_loss: nan | Time: 4248.27 ms
[2021-11-28 02:25:09	                main:574]	:	INFO	:	Epoch 627 | loss: nan | val_loss: nan | Time: 4247.62 ms
[2021-11-28 02:25:13	                main:574]	:	INFO	:	Epoch 628 | loss: nan | val_loss: nan | Time: 4275.72 ms
[2021-11-28 02:25:18	                main:574]	:	INFO	:	Epoch 629 | loss: nan | val_loss: nan | Time: 4295.36 ms
[2021-11-28 02:25:22	                main:574]	:	INFO	:	Epoch 630 | loss: nan | val_loss: nan | Time: 4269.14 ms
[2021-11-28 02:25:26	                main:574]	:	INFO	:	Epoch 631 | loss: nan | val_loss: nan | Time: 4277.61 ms
[2021-11-28 02:25:30	                main:574]	:	INFO	:	Epoch 632 | loss: nan | val_loss: nan | Time: 4250.42 ms
[2021-11-28 02:25:35	                main:574]	:	INFO	:	Epoch 633 | loss: nan | val_loss: nan | Time: 4264.28 ms
[2021-11-28 02:25:39	                main:574]	:	INFO	:	Epoch 634 | loss: nan | val_loss: nan | Time: 4264.18 ms
[2021-11-28 02:25:43	                main:574]	:	INFO	:	Epoch 635 | loss: nan | val_loss: nan | Time: 4274.5 ms
[2021-11-28 02:25:47	                main:574]	:	INFO	:	Epoch 636 | loss: nan | val_loss: nan | Time: 4282.64 ms
[2021-11-28 02:25:52	                main:574]	:	INFO	:	Epoch 637 | loss: nan | val_loss: nan | Time: 4296.67 ms
[2021-11-28 02:25:56	                main:574]	:	INFO	:	Epoch 638 | loss: nan | val_loss: nan | Time: 4248.76 ms
[2021-11-28 02:26:00	                main:574]	:	INFO	:	Epoch 639 | loss: nan | val_loss: nan | Time: 4281.25 ms
[2021-11-28 02:26:05	                main:574]	:	INFO	:	Epoch 640 | loss: nan | val_loss: nan | Time: 4267.16 ms
[2021-11-28 02:26:09	                main:574]	:	INFO	:	Epoch 641 | loss: nan | val_loss: nan | Time: 4246.17 ms
[2021-11-28 02:26:13	                main:574]	:	INFO	:	Epoch 642 | loss: nan | val_loss: nan | Time: 4283.27 ms
[2021-11-28 02:26:17	                main:574]	:	INFO	:	Epoch 643 | loss: nan | val_loss: nan | Time: 4296.73 ms
[2021-11-28 02:26:22	                main:574]	:	INFO	:	Epoch 644 | loss: nan | val_loss: nan | Time: 4282.08 ms
[2021-11-28 02:26:26	                main:574]	:	INFO	:	Epoch 645 | loss: nan | val_loss: nan | Time: 4281.18 ms
[2021-11-28 02:26:30	                main:574]	:	INFO	:	Epoch 646 | loss: nan | val_loss: nan | Time: 4297.79 ms
[2021-11-28 02:26:35	                main:574]	:	INFO	:	Epoch 647 | loss: nan | val_loss: nan | Time: 4298.95 ms
[2021-11-28 02:26:39	                main:574]	:	INFO	:	Epoch 648 | loss: nan | val_loss: nan | Time: 4249.97 ms
[2021-11-28 02:26:43	                main:574]	:	INFO	:	Epoch 649 | loss: nan | val_loss: nan | Time: 4283.06 ms
[2021-11-28 02:26:47	                main:574]	:	INFO	:	Epoch 650 | loss: nan | val_loss: nan | Time: 4262.71 ms
[2021-11-28 02:26:52	                main:574]	:	INFO	:	Epoch 651 | loss: nan | val_loss: nan | Time: 4274.96 ms
[2021-11-28 02:26:56	                main:574]	:	INFO	:	Epoch 652 | loss: nan | val_loss: nan | Time: 4265.33 ms
[2021-11-28 02:27:00	                main:574]	:	INFO	:	Epoch 653 | loss: nan | val_loss: nan | Time: 4264.03 ms
[2021-11-28 02:27:04	                main:574]	:	INFO	:	Epoch 654 | loss: nan | val_loss: nan | Time: 4267.55 ms
[2021-11-28 02:27:09	                main:574]	:	INFO	:	Epoch 655 | loss: nan | val_loss: nan | Time: 4294.91 ms
[2021-11-28 02:27:13	                main:574]	:	INFO	:	Epoch 656 | loss: nan | val_loss: nan | Time: 4284.56 ms
[2021-11-28 02:27:17	                main:574]	:	INFO	:	Epoch 657 | loss: nan | val_loss: nan | Time: 4279.57 ms
[2021-11-28 02:27:22	                main:574]	:	INFO	:	Epoch 658 | loss: nan | val_loss: nan | Time: 4282.46 ms
[2021-11-28 02:27:26	                main:574]	:	INFO	:	Epoch 659 | loss: nan | val_loss: nan | Time: 4265.72 ms
[2021-11-28 02:27:30	                main:574]	:	INFO	:	Epoch 660 | loss: nan | val_loss: nan | Time: 4262.26 ms
[2021-11-28 02:27:34	                main:574]	:	INFO	:	Epoch 661 | loss: nan | val_loss: nan | Time: 4284.02 ms
[2021-11-28 02:27:39	                main:574]	:	INFO	:	Epoch 662 | loss: nan | val_loss: nan | Time: 4295.81 ms
[2021-11-28 02:27:43	                main:574]	:	INFO	:	Epoch 663 | loss: nan | val_loss: nan | Time: 4264.82 ms
[2021-11-28 02:27:47	                main:574]	:	INFO	:	Epoch 664 | loss: nan | val_loss: nan | Time: 4283.06 ms
[2021-11-28 02:27:52	                main:574]	:	INFO	:	Epoch 665 | loss: nan | val_loss: nan | Time: 4266.12 ms
[2021-11-28 02:27:56	                main:574]	:	INFO	:	Epoch 666 | loss: nan | val_loss: nan | Time: 4262.47 ms
[2021-11-28 02:28:00	                main:574]	:	INFO	:	Epoch 667 | loss: nan | val_loss: nan | Time: 4293.01 ms
[2021-11-28 02:28:04	                main:574]	:	INFO	:	Epoch 668 | loss: nan | val_loss: nan | Time: 4280.83 ms
[2021-11-28 02:28:09	                main:574]	:	INFO	:	Epoch 669 | loss: nan | val_loss: nan | Time: 4264.94 ms
[2021-11-28 02:28:13	                main:574]	:	INFO	:	Epoch 670 | loss: nan | val_loss: nan | Time: 4283.93 ms
[2021-11-28 02:28:17	                main:574]	:	INFO	:	Epoch 671 | loss: nan | val_loss: nan | Time: 4283.94 ms
[2021-11-28 02:28:21	                main:574]	:	INFO	:	Epoch 672 | loss: nan | val_loss: nan | Time: 4261.9 ms
[2021-11-28 02:28:26	                main:574]	:	INFO	:	Epoch 673 | loss: nan | val_loss: nan | Time: 4282.59 ms
[2021-11-28 02:28:30	                main:574]	:	INFO	:	Epoch 674 | loss: nan | val_loss: nan | Time: 4281.48 ms
[2021-11-28 02:28:34	                main:574]	:	INFO	:	Epoch 675 | loss: nan | val_loss: nan | Time: 4279.08 ms
[2021-11-28 02:28:39	                main:574]	:	INFO	:	Epoch 676 | loss: nan | val_loss: nan | Time: 4265.53 ms
[2021-11-28 02:28:43	                main:574]	:	INFO	:	Epoch 677 | loss: nan | val_loss: nan | Time: 4283.48 ms
[2021-11-28 02:28:47	                main:574]	:	INFO	:	Epoch 678 | loss: nan | val_loss: nan | Time: 4245.94 ms
[2021-11-28 02:28:51	                main:574]	:	INFO	:	Epoch 679 | loss: nan | val_loss: nan | Time: 4247.68 ms
[2021-11-28 02:28:56	                main:574]	:	INFO	:	Epoch 680 | loss: nan | val_loss: nan | Time: 4267.36 ms
[2021-11-28 02:29:00	                main:574]	:	INFO	:	Epoch 681 | loss: nan | val_loss: nan | Time: 4263.94 ms
[2021-11-28 02:29:04	                main:574]	:	INFO	:	Epoch 682 | loss: nan | val_loss: nan | Time: 4281.92 ms
[2021-11-28 02:29:08	                main:574]	:	INFO	:	Epoch 683 | loss: nan | val_loss: nan | Time: 4290.98 ms
[2021-11-28 02:29:13	                main:574]	:	INFO	:	Epoch 684 | loss: nan | val_loss: nan | Time: 4250.26 ms
[2021-11-28 02:29:17	                main:574]	:	INFO	:	Epoch 685 | loss: nan | val_loss: nan | Time: 4264.57 ms
[2021-11-28 02:29:21	                main:574]	:	INFO	:	Epoch 686 | loss: nan | val_loss: nan | Time: 4247.23 ms
[2021-11-28 02:29:26	                main:574]	:	INFO	:	Epoch 687 | loss: nan | val_loss: nan | Time: 4282.87 ms
[2021-11-28 02:29:30	                main:574]	:	INFO	:	Epoch 688 | loss: nan | val_loss: nan | Time: 4247.52 ms
[2021-11-28 02:29:34	                main:574]	:	INFO	:	Epoch 689 | loss: nan | val_loss: nan | Time: 4280.35 ms
[2021-11-28 02:29:38	                main:574]	:	INFO	:	Epoch 690 | loss: nan | val_loss: nan | Time: 4266.43 ms
[2021-11-28 02:29:43	                main:574]	:	INFO	:	Epoch 691 | loss: nan | val_loss: nan | Time: 4266.54 ms
[2021-11-28 02:29:47	                main:574]	:	INFO	:	Epoch 692 | loss: nan | val_loss: nan | Time: 4264.45 ms
[2021-11-28 02:29:51	                main:574]	:	INFO	:	Epoch 693 | loss: nan | val_loss: nan | Time: 4280.03 ms
[2021-11-28 02:29:55	                main:574]	:	INFO	:	Epoch 694 | loss: nan | val_loss: nan | Time: 4264.33 ms
[2021-11-28 02:30:00	                main:574]	:	INFO	:	Epoch 695 | loss: nan | val_loss: nan | Time: 4315.1 ms
[2021-11-28 02:30:04	                main:574]	:	INFO	:	Epoch 696 | loss: nan | val_loss: nan | Time: 4266.76 ms
[2021-11-28 02:30:08	                main:574]	:	INFO	:	Epoch 697 | loss: nan | val_loss: nan | Time: 4293.55 ms
[2021-11-28 02:30:13	                main:574]	:	INFO	:	Epoch 698 | loss: nan | val_loss: nan | Time: 4251.15 ms
[2021-11-28 02:30:17	                main:574]	:	INFO	:	Epoch 699 | loss: nan | val_loss: nan | Time: 4291.94 ms
[2021-11-28 02:30:21	                main:574]	:	INFO	:	Epoch 700 | loss: nan | val_loss: nan | Time: 4282.58 ms
[2021-11-28 02:30:25	                main:574]	:	INFO	:	Epoch 701 | loss: nan | val_loss: nan | Time: 4297.05 ms
[2021-11-28 02:30:30	                main:574]	:	INFO	:	Epoch 702 | loss: nan | val_loss: nan | Time: 4283.13 ms
[2021-11-28 02:30:34	                main:574]	:	INFO	:	Epoch 703 | loss: nan | val_loss: nan | Time: 4299.32 ms
[2021-11-28 02:30:38	                main:574]	:	INFO	:	Epoch 704 | loss: nan | val_loss: nan | Time: 4281.03 ms
[2021-11-28 02:30:43	                main:574]	:	INFO	:	Epoch 705 | loss: nan | val_loss: nan | Time: 4281.36 ms
[2021-11-28 02:30:47	                main:574]	:	INFO	:	Epoch 706 | loss: nan | val_loss: nan | Time: 4247.53 ms
[2021-11-28 02:30:51	                main:574]	:	INFO	:	Epoch 707 | loss: nan | val_loss: nan | Time: 4281.1 ms
[2021-11-28 02:30:55	                main:574]	:	INFO	:	Epoch 708 | loss: nan | val_loss: nan | Time: 4267.48 ms
[2021-11-28 02:31:00	                main:574]	:	INFO	:	Epoch 709 | loss: nan | val_loss: nan | Time: 4279.24 ms
[2021-11-28 02:31:04	                main:574]	:	INFO	:	Epoch 710 | loss: nan | val_loss: nan | Time: 4283.25 ms
[2021-11-28 02:31:08	                main:574]	:	INFO	:	Epoch 711 | loss: nan | val_loss: nan | Time: 4264.99 ms
[2021-11-28 02:31:12	                main:574]	:	INFO	:	Epoch 712 | loss: nan | val_loss: nan | Time: 4264.28 ms
[2021-11-28 02:31:17	                main:574]	:	INFO	:	Epoch 713 | loss: nan | val_loss: nan | Time: 4281.05 ms
[2021-11-28 02:31:21	                main:574]	:	INFO	:	Epoch 714 | loss: nan | val_loss: nan | Time: 4263.77 ms
[2021-11-28 02:31:25	                main:574]	:	INFO	:	Epoch 715 | loss: nan | val_loss: nan | Time: 4259.11 ms
[2021-11-28 02:31:30	                main:574]	:	INFO	:	Epoch 716 | loss: nan | val_loss: nan | Time: 4267.24 ms
[2021-11-28 02:31:34	                main:574]	:	INFO	:	Epoch 717 | loss: nan | val_loss: nan | Time: 4264.47 ms
[2021-11-28 02:31:38	                main:574]	:	INFO	:	Epoch 718 | loss: nan | val_loss: nan | Time: 4263.94 ms
[2021-11-28 02:31:42	                main:574]	:	INFO	:	Epoch 719 | loss: nan | val_loss: nan | Time: 4266.78 ms
[2021-11-28 02:31:47	                main:574]	:	INFO	:	Epoch 720 | loss: nan | val_loss: nan | Time: 4247.37 ms
[2021-11-28 02:31:51	                main:574]	:	INFO	:	Epoch 721 | loss: nan | val_loss: nan | Time: 4263.75 ms
[2021-11-28 02:31:55	                main:574]	:	INFO	:	Epoch 722 | loss: nan | val_loss: nan | Time: 4283.01 ms
[2021-11-28 02:31:59	                main:574]	:	INFO	:	Epoch 723 | loss: nan | val_loss: nan | Time: 4265.79 ms
[2021-11-28 02:32:04	                main:574]	:	INFO	:	Epoch 724 | loss: nan | val_loss: nan | Time: 4278.71 ms
[2021-11-28 02:32:08	                main:574]	:	INFO	:	Epoch 725 | loss: nan | val_loss: nan | Time: 4265.27 ms
[2021-11-28 02:32:12	                main:574]	:	INFO	:	Epoch 726 | loss: nan | val_loss: nan | Time: 4281.18 ms
[2021-11-28 02:32:16	                main:574]	:	INFO	:	Epoch 727 | loss: nan | val_loss: nan | Time: 4233.56 ms
[2021-11-28 02:32:21	                main:574]	:	INFO	:	Epoch 728 | loss: nan | val_loss: nan | Time: 4265.84 ms
[2021-11-28 02:32:25	                main:574]	:	INFO	:	Epoch 729 | loss: nan | val_loss: nan | Time: 4281.09 ms
[2021-11-28 02:32:29	                main:574]	:	INFO	:	Epoch 730 | loss: nan | val_loss: nan | Time: 4264.8 ms
[2021-11-28 02:32:34	                main:574]	:	INFO	:	Epoch 731 | loss: nan | val_loss: nan | Time: 4225.92 ms
[2021-11-28 02:32:38	                main:574]	:	INFO	:	Epoch 732 | loss: nan | val_loss: nan | Time: 4281.15 ms
[2021-11-28 02:32:42	                main:574]	:	INFO	:	Epoch 733 | loss: nan | val_loss: nan | Time: 4298.15 ms
[2021-11-28 02:32:46	                main:574]	:	INFO	:	Epoch 734 | loss: nan | val_loss: nan | Time: 4265.72 ms
[2021-11-28 02:32:51	                main:574]	:	INFO	:	Epoch 735 | loss: nan | val_loss: nan | Time: 4280.78 ms
[2021-11-28 02:32:55	                main:574]	:	INFO	:	Epoch 736 | loss: nan | val_loss: nan | Time: 4265.18 ms
[2021-11-28 02:32:59	                main:574]	:	INFO	:	Epoch 737 | loss: nan | val_loss: nan | Time: 4267.07 ms
[2021-11-28 02:33:03	                main:574]	:	INFO	:	Epoch 738 | loss: nan | val_loss: nan | Time: 4279.27 ms
[2021-11-28 02:33:08	                main:574]	:	INFO	:	Epoch 739 | loss: nan | val_loss: nan | Time: 4282.77 ms
[2021-11-28 02:33:12	                main:574]	:	INFO	:	Epoch 740 | loss: nan | val_loss: nan | Time: 4264.96 ms
[2021-11-28 02:33:16	                main:574]	:	INFO	:	Epoch 741 | loss: nan | val_loss: nan | Time: 4296 ms
[2021-11-28 02:33:21	                main:574]	:	INFO	:	Epoch 742 | loss: nan | val_loss: nan | Time: 4265.92 ms
[2021-11-28 02:33:25	                main:574]	:	INFO	:	Epoch 743 | loss: nan | val_loss: nan | Time: 4266.18 ms
[2021-11-28 02:33:29	                main:574]	:	INFO	:	Epoch 744 | loss: nan | val_loss: nan | Time: 4265.44 ms
[2021-11-28 02:33:33	                main:574]	:	INFO	:	Epoch 745 | loss: nan | val_loss: nan | Time: 4263.32 ms
[2021-11-28 02:33:38	                main:574]	:	INFO	:	Epoch 746 | loss: nan | val_loss: nan | Time: 4266.25 ms
[2021-11-28 02:33:42	                main:574]	:	INFO	:	Epoch 747 | loss: nan | val_loss: nan | Time: 4241.73 ms
[2021-11-28 02:33:46	                main:574]	:	INFO	:	Epoch 748 | loss: nan | val_loss: nan | Time: 4283.26 ms
[2021-11-28 02:33:50	                main:574]	:	INFO	:	Epoch 749 | loss: nan | val_loss: nan | Time: 4245.69 ms
[2021-11-28 02:33:55	                main:574]	:	INFO	:	Epoch 750 | loss: nan | val_loss: nan | Time: 4249.03 ms
[2021-11-28 02:33:59	                main:574]	:	INFO	:	Epoch 751 | loss: nan | val_loss: nan | Time: 4263.32 ms
[2021-11-28 02:34:03	                main:574]	:	INFO	:	Epoch 752 | loss: nan | val_loss: nan | Time: 4283.62 ms
[2021-11-28 02:34:08	                main:574]	:	INFO	:	Epoch 753 | loss: nan | val_loss: nan | Time: 4281.2 ms
[2021-11-28 02:34:12	                main:574]	:	INFO	:	Epoch 754 | loss: nan | val_loss: nan | Time: 4268.46 ms
[2021-11-28 02:34:16	                main:574]	:	INFO	:	Epoch 755 | loss: nan | val_loss: nan | Time: 4261.35 ms
[2021-11-28 02:34:20	                main:574]	:	INFO	:	Epoch 756 | loss: nan | val_loss: nan | Time: 4264.64 ms
[2021-11-28 02:34:25	                main:574]	:	INFO	:	Epoch 757 | loss: nan | val_loss: nan | Time: 4281.67 ms
[2021-11-28 02:34:29	                main:574]	:	INFO	:	Epoch 758 | loss: nan | val_loss: nan | Time: 4264.9 ms
[2021-11-28 02:34:33	                main:574]	:	INFO	:	Epoch 759 | loss: nan | val_loss: nan | Time: 4280.27 ms
[2021-11-28 02:34:37	                main:574]	:	INFO	:	Epoch 760 | loss: nan | val_loss: nan | Time: 4281.9 ms
[2021-11-28 02:34:42	                main:574]	:	INFO	:	Epoch 761 | loss: nan | val_loss: nan | Time: 4281.8 ms
[2021-11-28 02:34:46	                main:574]	:	INFO	:	Epoch 762 | loss: nan | val_loss: nan | Time: 4281.69 ms
[2021-11-28 02:34:50	                main:574]	:	INFO	:	Epoch 763 | loss: nan | val_loss: nan | Time: 4259.45 ms
[2021-11-28 02:34:55	                main:574]	:	INFO	:	Epoch 764 | loss: nan | val_loss: nan | Time: 4263.41 ms
[2021-11-28 02:34:59	                main:574]	:	INFO	:	Epoch 765 | loss: nan | val_loss: nan | Time: 4283.02 ms
[2021-11-28 02:35:03	                main:574]	:	INFO	:	Epoch 766 | loss: nan | val_loss: nan | Time: 4318.35 ms
[2021-11-28 02:35:07	                main:574]	:	INFO	:	Epoch 767 | loss: nan | val_loss: nan | Time: 4263 ms
[2021-11-28 02:35:12	                main:574]	:	INFO	:	Epoch 768 | loss: nan | val_loss: nan | Time: 4248.71 ms
[2021-11-28 02:35:16	                main:574]	:	INFO	:	Epoch 769 | loss: nan | val_loss: nan | Time: 4281.61 ms
[2021-11-28 02:35:20	                main:574]	:	INFO	:	Epoch 770 | loss: nan | val_loss: nan | Time: 4294.33 ms
[2021-11-28 02:35:25	                main:574]	:	INFO	:	Epoch 771 | loss: nan | val_loss: nan | Time: 4299.2 ms
[2021-11-28 02:35:29	                main:574]	:	INFO	:	Epoch 772 | loss: nan | val_loss: nan | Time: 4265.5 ms
[2021-11-28 02:35:33	                main:574]	:	INFO	:	Epoch 773 | loss: nan | val_loss: nan | Time: 4264.07 ms
[2021-11-28 02:35:37	                main:574]	:	INFO	:	Epoch 774 | loss: nan | val_loss: nan | Time: 4266.19 ms
[2021-11-28 02:35:42	                main:574]	:	INFO	:	Epoch 775 | loss: nan | val_loss: nan | Time: 4266.42 ms
[2021-11-28 02:35:46	                main:574]	:	INFO	:	Epoch 776 | loss: nan | val_loss: nan | Time: 4261.52 ms
[2021-11-28 02:35:50	                main:574]	:	INFO	:	Epoch 777 | loss: nan | val_loss: nan | Time: 4283.12 ms
[2021-11-28 02:35:54	                main:574]	:	INFO	:	Epoch 778 | loss: nan | val_loss: nan | Time: 4264.05 ms
[2021-11-28 02:35:59	                main:574]	:	INFO	:	Epoch 779 | loss: nan | val_loss: nan | Time: 4261.3 ms
[2021-11-28 02:36:03	                main:574]	:	INFO	:	Epoch 780 | loss: nan | val_loss: nan | Time: 4280.61 ms
[2021-11-28 02:36:07	                main:574]	:	INFO	:	Epoch 781 | loss: nan | val_loss: nan | Time: 4279.84 ms
[2021-11-28 02:36:12	                main:574]	:	INFO	:	Epoch 782 | loss: nan | val_loss: nan | Time: 4268.03 ms
[2021-11-28 02:36:16	                main:574]	:	INFO	:	Epoch 783 | loss: nan | val_loss: nan | Time: 4264.38 ms
[2021-11-28 02:36:20	                main:574]	:	INFO	:	Epoch 784 | loss: nan | val_loss: nan | Time: 4267.79 ms
[2021-11-28 02:36:24	                main:574]	:	INFO	:	Epoch 785 | loss: nan | val_loss: nan | Time: 4280.86 ms
[2021-11-28 02:36:29	                main:574]	:	INFO	:	Epoch 786 | loss: nan | val_loss: nan | Time: 4247.43 ms
[2021-11-28 02:36:33	                main:574]	:	INFO	:	Epoch 787 | loss: nan | val_loss: nan | Time: 4280.85 ms
[2021-11-28 02:36:37	                main:574]	:	INFO	:	Epoch 788 | loss: nan | val_loss: nan | Time: 4264.64 ms
[2021-11-28 02:36:41	                main:574]	:	INFO	:	Epoch 789 | loss: nan | val_loss: nan | Time: 4278.98 ms
[2021-11-28 02:36:46	                main:574]	:	INFO	:	Epoch 790 | loss: nan | val_loss: nan | Time: 4284.83 ms
[2021-11-28 02:36:50	                main:574]	:	INFO	:	Epoch 791 | loss: nan | val_loss: nan | Time: 4248.17 ms
[2021-11-28 02:36:54	                main:574]	:	INFO	:	Epoch 792 | loss: nan | val_loss: nan | Time: 4280.1 ms
[2021-11-28 02:36:59	                main:574]	:	INFO	:	Epoch 793 | loss: nan | val_loss: nan | Time: 4266.65 ms
[2021-11-28 02:37:03	                main:574]	:	INFO	:	Epoch 794 | loss: nan | val_loss: nan | Time: 4245.2 ms
[2021-11-28 02:37:07	                main:574]	:	INFO	:	Epoch 795 | loss: nan | val_loss: nan | Time: 4259.07 ms
[2021-11-28 02:37:11	                main:574]	:	INFO	:	Epoch 796 | loss: nan | val_loss: nan | Time: 4281.71 ms
[2021-11-28 02:37:16	                main:574]	:	INFO	:	Epoch 797 | loss: nan | val_loss: nan | Time: 4283.11 ms
[2021-11-28 02:37:20	                main:574]	:	INFO	:	Epoch 798 | loss: nan | val_loss: nan | Time: 4263.23 ms
[2021-11-28 02:37:24	                main:574]	:	INFO	:	Epoch 799 | loss: nan | val_loss: nan | Time: 4282.25 ms
[2021-11-28 02:37:28	                main:574]	:	INFO	:	Epoch 800 | loss: nan | val_loss: nan | Time: 4248.72 ms
[2021-11-28 02:37:33	                main:574]	:	INFO	:	Epoch 801 | loss: nan | val_loss: nan | Time: 4263.96 ms
[2021-11-28 02:37:37	                main:574]	:	INFO	:	Epoch 802 | loss: nan | val_loss: nan | Time: 4262.62 ms
[2021-11-28 02:37:41	                main:574]	:	INFO	:	Epoch 803 | loss: nan | val_loss: nan | Time: 4262.98 ms
[2021-11-28 02:37:46	                main:574]	:	INFO	:	Epoch 804 | loss: nan | val_loss: nan | Time: 4283.22 ms
[2021-11-28 02:37:50	                main:574]	:	INFO	:	Epoch 805 | loss: nan | val_loss: nan | Time: 4281.08 ms
[2021-11-28 02:37:54	                main:574]	:	INFO	:	Epoch 806 | loss: nan | val_loss: nan | Time: 4266.37 ms
[2021-11-28 02:37:58	                main:574]	:	INFO	:	Epoch 807 | loss: nan | val_loss: nan | Time: 4262.12 ms
[2021-11-28 02:38:03	                main:574]	:	INFO	:	Epoch 808 | loss: nan | val_loss: nan | Time: 4264.15 ms
[2021-11-28 02:38:07	                main:574]	:	INFO	:	Epoch 809 | loss: nan | val_loss: nan | Time: 4265.27 ms
[2021-11-28 02:38:11	                main:574]	:	INFO	:	Epoch 810 | loss: nan | val_loss: nan | Time: 4264.91 ms
[2021-11-28 02:38:15	                main:574]	:	INFO	:	Epoch 811 | loss: nan | val_loss: nan | Time: 4257.65 ms
[2021-11-28 02:38:20	                main:574]	:	INFO	:	Epoch 812 | loss: nan | val_loss: nan | Time: 4230.88 ms
[2021-11-28 02:38:24	                main:574]	:	INFO	:	Epoch 813 | loss: nan | val_loss: nan | Time: 4265.52 ms
[2021-11-28 02:38:28	                main:574]	:	INFO	:	Epoch 814 | loss: nan | val_loss: nan | Time: 4249.85 ms
[2021-11-28 02:38:32	                main:574]	:	INFO	:	Epoch 815 | loss: nan | val_loss: nan | Time: 4246.67 ms
[2021-11-28 02:38:37	                main:574]	:	INFO	:	Epoch 816 | loss: nan | val_loss: nan | Time: 4266.31 ms
[2021-11-28 02:38:41	                main:574]	:	INFO	:	Epoch 817 | loss: nan | val_loss: nan | Time: 4297.27 ms
[2021-11-28 02:38:45	                main:574]	:	INFO	:	Epoch 818 | loss: nan | val_loss: nan | Time: 4248.08 ms
[2021-11-28 02:38:49	                main:574]	:	INFO	:	Epoch 819 | loss: nan | val_loss: nan | Time: 4267.73 ms
[2021-11-28 02:38:54	                main:574]	:	INFO	:	Epoch 820 | loss: nan | val_loss: nan | Time: 4265.14 ms
[2021-11-28 02:38:58	                main:574]	:	INFO	:	Epoch 821 | loss: nan | val_loss: nan | Time: 4279.18 ms
[2021-11-28 02:39:02	                main:574]	:	INFO	:	Epoch 822 | loss: nan | val_loss: nan | Time: 4264.4 ms
[2021-11-28 02:39:07	                main:574]	:	INFO	:	Epoch 823 | loss: nan | val_loss: nan | Time: 4265.38 ms
[2021-11-28 02:39:11	                main:574]	:	INFO	:	Epoch 824 | loss: nan | val_loss: nan | Time: 4265.25 ms
[2021-11-28 02:39:15	                main:574]	:	INFO	:	Epoch 825 | loss: nan | val_loss: nan | Time: 4266.89 ms
[2021-11-28 02:39:19	                main:574]	:	INFO	:	Epoch 826 | loss: nan | val_loss: nan | Time: 4247.21 ms
[2021-11-28 02:39:24	                main:574]	:	INFO	:	Epoch 827 | loss: nan | val_loss: nan | Time: 4275.44 ms
[2021-11-28 02:39:28	                main:574]	:	INFO	:	Epoch 828 | loss: nan | val_loss: nan | Time: 4281.61 ms
[2021-11-28 02:39:32	                main:574]	:	INFO	:	Epoch 829 | loss: nan | val_loss: nan | Time: 4245.42 ms
[2021-11-28 02:39:36	                main:574]	:	INFO	:	Epoch 830 | loss: nan | val_loss: nan | Time: 4283.35 ms
[2021-11-28 02:39:41	                main:574]	:	INFO	:	Epoch 831 | loss: nan | val_loss: nan | Time: 4266.25 ms
[2021-11-28 02:39:45	                main:574]	:	INFO	:	Epoch 832 | loss: nan | val_loss: nan | Time: 4281.62 ms
[2021-11-28 02:39:49	                main:574]	:	INFO	:	Epoch 833 | loss: nan | val_loss: nan | Time: 4298.49 ms
[2021-11-28 02:39:54	                main:574]	:	INFO	:	Epoch 834 | loss: nan | val_loss: nan | Time: 4299.21 ms
[2021-11-28 02:39:58	                main:574]	:	INFO	:	Epoch 835 | loss: nan | val_loss: nan | Time: 4263.77 ms
[2021-11-28 02:40:02	                main:574]	:	INFO	:	Epoch 836 | loss: nan | val_loss: nan | Time: 4282.52 ms
[2021-11-28 02:40:06	                main:574]	:	INFO	:	Epoch 837 | loss: nan | val_loss: nan | Time: 4296.56 ms
[2021-11-28 02:40:11	                main:574]	:	INFO	:	Epoch 838 | loss: nan | val_loss: nan | Time: 4298.76 ms
[2021-11-28 02:40:15	                main:574]	:	INFO	:	Epoch 839 | loss: nan | val_loss: nan | Time: 4247.55 ms
[2021-11-28 02:40:19	                main:574]	:	INFO	:	Epoch 840 | loss: nan | val_loss: nan | Time: 4233.78 ms
[2021-11-28 02:40:24	                main:574]	:	INFO	:	Epoch 841 | loss: nan | val_loss: nan | Time: 4314.2 ms
[2021-11-28 02:40:28	                main:574]	:	INFO	:	Epoch 842 | loss: nan | val_loss: nan | Time: 4296.74 ms
[2021-11-28 02:40:32	                main:574]	:	INFO	:	Epoch 843 | loss: nan | val_loss: nan | Time: 4243.23 ms
[2021-11-28 02:40:36	                main:574]	:	INFO	:	Epoch 844 | loss: nan | val_loss: nan | Time: 4297.15 ms
[2021-11-28 02:40:41	                main:574]	:	INFO	:	Epoch 845 | loss: nan | val_loss: nan | Time: 4263.02 ms
[2021-11-28 02:40:45	                main:574]	:	INFO	:	Epoch 846 | loss: nan | val_loss: nan | Time: 4267.73 ms
[2021-11-28 02:40:49	                main:574]	:	INFO	:	Epoch 847 | loss: nan | val_loss: nan | Time: 4281.27 ms
[2021-11-28 02:40:53	                main:574]	:	INFO	:	Epoch 848 | loss: nan | val_loss: nan | Time: 4250.13 ms
[2021-11-28 02:40:58	                main:574]	:	INFO	:	Epoch 849 | loss: nan | val_loss: nan | Time: 4280.79 ms
[2021-11-28 02:41:02	                main:574]	:	INFO	:	Epoch 850 | loss: nan | val_loss: nan | Time: 4281.68 ms
[2021-11-28 02:41:06	                main:574]	:	INFO	:	Epoch 851 | loss: nan | val_loss: nan | Time: 4297.01 ms
[2021-11-28 02:41:11	                main:574]	:	INFO	:	Epoch 852 | loss: nan | val_loss: nan | Time: 4249.04 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1070 Ti)
[2021-11-28 08:28:35	                main:435]	:	INFO	:	Set logging level to 1
[2021-11-28 08:28:35	                main:441]	:	INFO	:	Running in BOINC Client mode
[2021-11-28 08:28:35	                main:444]	:	INFO	:	Resolving all filenames
[2021-11-28 08:28:35	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2021-11-28 08:28:35	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2021-11-28 08:28:35	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2021-11-28 08:28:35	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2021-11-28 08:28:35	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2021-11-28 08:28:35	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2021-11-28 08:28:35	                main:474]	:	INFO	:	Configuration: 
[2021-11-28 08:28:35	                main:475]	:	INFO	:	    Model type: GRU
[2021-11-28 08:28:35	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2021-11-28 08:28:35	                main:477]	:	INFO	:	    Max Epochs: 2048
[2021-11-28 08:28:35	                main:478]	:	INFO	:	    Batch Size: 128
[2021-11-28 08:28:35	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2021-11-28 08:28:35	                main:480]	:	INFO	:	    Patience: 10
[2021-11-28 08:28:35	                main:481]	:	INFO	:	    Hidden Width: 12
[2021-11-28 08:28:35	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2021-11-28 08:28:35	                main:483]	:	INFO	:	    # Backend Layers: 4
[2021-11-28 08:28:35	                main:484]	:	INFO	:	    # Threads: 1
[2021-11-28 08:28:35	                main:486]	:	INFO	:	Preparing Dataset
[2021-11-28 08:28:35	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2021-11-28 08:28:35	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2021-11-28 08:28:36	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2021-11-28 08:28:36	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2021-11-28 08:28:36	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2021-11-28 08:28:36	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2021-11-28 08:28:36	                main:494]	:	INFO	:	Creating Model
[2021-11-28 08:28:36	                main:507]	:	INFO	:	Preparing config file
[2021-11-28 08:28:36	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2021-11-28 08:28:36	                main:512]	:	INFO	:	Loading config


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFA6B524F69

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 11/28/21 08:28:36
Install Directory : E:\Program Files\BOINC\
Data Directory    : E:\ProgramData\BOINC\Data
Project Symstore  : 
LoadLibraryA( E:\ProgramData\BOINC\Data\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( E:\ProgramData\BOINC\Data\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( E:\ProgramData\BOINC\Data\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( E:\ProgramData\BOINC\Data\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: E:\ProgramData\BOINC\Data\slots\18;E:\ProgramData\BOINC\Data\projects\www.mlcathome.org_mlcathome


ModLoad: 0000000039f30000 00000000003df000 E:\ProgramData\BOINC\Data\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000006d910000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1288) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.19041.1023 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1023

ModLoad: 000000006cf80000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1348) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.19041.1348 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1348

ModLoad: 000000006b4f0000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1387) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.19041.1348 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1348

ModLoad: 000000006d220000 00000000001a1000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000006b4c0000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1387) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.19041.1387 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1387

ModLoad: 000000006c490000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202

ModLoad: 000000006b020000 000000000010d000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1387) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.19041.1387 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1387

ModLoad: 000000006b320000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 0000000065520000 0000000000058000 E:\ProgramData\BOINC\Data\slots\18\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000006b3c0000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 000000006d730000 00000000000ac000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1052) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000006c350000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.19041.546

ModLoad: 000000006c700000 000000000009b000 C:\WINDOWS\System32\sechost.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000006c570000 000000000012a000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1288) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000056770000 000000000008d000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.28.29910.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\9\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.28.29910.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.28.29910.0

ModLoad: 0000000064cf0000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.867

ModLoad: 00000000570f0000 000000000001a000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.28.29910.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\9\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.28.29910.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.28.29910.0

ModLoad: 0000000056070000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.28.29910.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\9\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.28.29910.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.28.29910.0

ModLoad: 00000000c0050000 000000000abe7000 E:\ProgramData\BOINC\Data\slots\18\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000046bb0000 000000000020d000 E:\ProgramData\BOINC\Data\slots\18\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 0000000021130000 00000000002db000 E:\ProgramData\BOINC\Data\slots\18\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000058170000 0000000000040000 E:\ProgramData\BOINC\Data\slots\18\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000cac40000 0000000024b49000 E:\ProgramData\BOINC\Data\slots\18\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000053d40000 0000000000045000 E:\ProgramData\BOINC\Data\slots\18\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000001d870000 00000000030a5000 E:\ProgramData\BOINC\Data\slots\18\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 0000000012460000 00000000034b2000 E:\ProgramData\BOINC\Data\slots\18\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 0000000066820000 0000000000010000 E:\ProgramData\BOINC\Data\slots\18\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 000000009bb00000 000000000919f000 E:\ProgramData\BOINC\Data\slots\18\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 0000000097da0000 0000000003d5b000 E:\ProgramData\BOINC\Data\slots\18\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 0000000009c20000 0000000001eca000 E:\ProgramData\BOINC\Data\slots\18\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000a4ca0000 000000001b3a4000 E:\ProgramData\BOINC\Data\slots\18\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 000000006c450000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000068ef0000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000006bb50000 0000000000472000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1237) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000006b7f0000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 000000006b7c0000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000006adc0000 0000000000034000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 000000006b840000 0000000000060000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1266) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.19041.1266 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1266

ModLoad: 000000006b1c0000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000006ac00000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000006c7a0000 0000000000744000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1387) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.19041.964 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.964

ModLoad: 00000000690f0000 0000000000794000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1387) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000006bff0000 0000000000355000 C:\WINDOWS\System32\combase.dll (6.2.19041.1348) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.19041.1320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1320

ModLoad: 000000006a990000 000000000002e000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000006c4c0000 00000000000ad000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1387) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000006d040000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000001d5b0000 00000000002b9000 C:\WINDOWS\system32\nvcuda.dll (30.0.14.9676) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r495\r496_65\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 30.0.14.9676
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.5.107 driver
    Product Version       : 30.0.14.9676

ModLoad: 0000000001f90000 0000000001679000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_b7184c0e1c94c102\nvcuda64.dll (30.0.14.9676) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r495\r496_65\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 30.0.14.9676
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.5.107 driver
    Product Version       : 30.0.14.9676

ModLoad: 0000000065e50000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000065bc0000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.19041.906 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.906

ModLoad: 0000000062710000 000000000014a000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : drvstore.pdb
    File Version          : 10.0.19041.1320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1320

ModLoad: 000000006a900000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000060fb0000 0000000000761000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.14.9676) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r495\r496_65\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 30.0.14.9676
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 30.0.14.9676

ModLoad: 000000006b130000 0000000000083000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1348) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.19041.1348 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1348



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3611, Write: 307, Other 608

- I/O Transfers Counters -
Read: 6731637, Write: 6057, Other 27920

- Paged Pool Usage -
QuotaPagedPoolUsage: 3438832, QuotaPeakPagedPoolUsage: 3438832
QuotaNonPagedPoolUsage: 37256, QuotaPeakNonPagedPoolUsage: 37256

- Virtual Memory Usage -
VirtualSize: -1372454912, PeakVirtualSize: -791789568

- Pagefile Usage -
PagefileUsage: -1372454912, PeakPagefileUsage: -1372434432

- Working Set Size -
WorkingSetSize: 1159020544, PeakWorkingSetSize: 1159024640, PageFaultCount: 395455

*** Dump of thread ID 29200 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 4218750.000000, User Time: 13437500.000000, Wait Time: 21139186.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFA6B524F69

- Registers -
rax=000000001f8e5d28 rbx=000000003a294910 rcx=000000000fec3e00 rdx=000000006d935b00 rsi=000000001f8e6590 rdi=0000000019930520
r8=000000001f8e5d50 r9=000000001f8e5d78 r10=0000000000000004 r11=000000001f8e5d88 r12=00000000000df710 r13=000000001f8e67a0
r14=000000006fcf3da0 r15=0000000000000000 rip=000000006b524f69 rsp=000000001f8e6430 rbp=000000001f8e6720
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
1f8e6500 3a1aa884 00000040 0000004f 000df600 000003bf KERNELBASE!RaiseException+0x0 
1f8e6560 39f51ca6 31540000 1f8e6639 12ab6df0 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
1f8e6610 39f5593b 00000000 00000030 00000020 00000008 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
1f8e6760 39f51a78 00000000 00000000 1f8e6a90 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
1f8e6830 39f51cfc 1f8e6a90 00000000 00000080 1f8e6d60 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
1f8e68f0 39f5c4dd 1f8e6d60 1f8e6d60 1f8e6d60 1f8e6d60 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
1f8e6be0 39f4b2fe 1f8e71f8 1f8e6d60 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
1f8ff980 3a18c6f8 330839d0 00000000 00000000 31550580 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
1f8ff9c0 6cf97034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
1f8ff9f0 6d962651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
1f8ffa70 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 27884 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 21139076.000000

- Registers -
rax=00000000000001d3 rbx=0000000031546080 rcx=0000000000000070 rdx=0000000031545d00 rsi=0000000031543e30 rdi=0000000031546080
r8=0000000000000008 r9=0000000000000040 r10=0000000000000540 r11=000000000000fe5f r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000006d9b07c4 rsp=000000001f9ffad8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
1f9ffad0 6d962dc7 00000000 00000000 31543e30 31546080 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
1f9ffdd0 6cf97034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
1f9ffe00 6d962651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
1f9ffe80 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 14052 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 21139076.000000

- Registers -
rax=00000000000001d3 rbx=00000000315464b0 rcx=0000000000000070 rdx=0000000031546130 rsi=0000000031543e30 rdi=00000000315464b0
r8=00000000000003e9 r9=0000000000000040 r10=00000000000003c0 r11=00000000fe1feffa r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000006d9b07c4 rsp=000000001faff808 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
1faff800 6d962dc7 00000000 00000000 31543e30 315464b0 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
1faffb00 6cf97034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
1faffb30 6d962651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
1faffbb0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 25548 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 21139076.000000

- Registers -
rax=00000000000001d3 rbx=000000003154b300 rcx=0000000000000070 rdx=000000003154af80 rsi=0000000031543e30 rdi=000000003154b300
r8=000000001fbfecd0 r9=0000000031544434 r10=000000000000006c r11=000000001fbfead0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000006d9b07c4 rsp=000000001fbff568 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
1fbff560 6d962dc7 00000000 00000000 31543e30 3154b300 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
1fbff860 6cf97034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
1fbff890 6d962651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
1fbff910 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 4660 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 21139180.000000

- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=000000001fdffaf0 rsi=0000000000000000 rdi=0000000000000064
r8=000000000000005a r9=0000000000000005 r10=000000001fdfe7e0 r11=0000000031521401 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000006d9ad3f4 rsp=000000001fdffac8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
1fdffac0 6b53962e 1fdffb88 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0 
1fdffb60 39f6a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0 
1fdffb90 6cf97034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
1fdffbc0 6d962651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
1fdffc40 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 28816 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 21139182.000000

- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=000000001feff4c0 rsi=0000000000000000 rdi=000000000000000d
r8=0000000033370730 r9=00000000332d4000 r10=0000000000000000 r11=000000001feff430 r12=0000000000000064 r13=000000001feff4c0
r14=000000001feff1c0 r15=0000000000000000 rip=000000006d9ad8c4 rsp=000000001feff168 rbp=00000000332d4000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
1feff160 6b53cb20 00000000 1f702000 6da7a4d0 1f702000 ntdll!ZwWaitForMultipleObjects+0x0 
1feff450 6b53ca1e 315574b0 004e0049 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
1feff490 02165be4 332d69a0 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
1feff6d0 0220d15d 00000000 332d4000 00000000 00000000 nvcuda64!+0x0 
1feff780 021655b3 0a1ed50c 0967e51a 33b71380 00000000 nvcuda64!cuProfilerStop+0x0 
1feff7b0 02494264 33b71380 00000000 00000000 00000000 nvcuda64!+0x0 
1feff7e0 6cf97034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
1feff810 6d962651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
1feff890 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 15048 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 21139114.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000000a0 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000000a0
r8=000000001ffff838 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=000000003326c550 r13=0000000000000000
r14=00000000000000a0 r15=0000000000000000 rip=000000006d9acdf4 rsp=000000001ffff5b8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
1ffff5b0 6b511a5e 00000000 00001f80 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0 
1ffff650 023895ee 33b710e0 00000000 00000000 000000a0 KERNELBASE!WaitForSingleObjectEx+0x0 
1ffff890 021655b3 00000000 33b710e0 01f90000 33283830 nvcuda64!cuProfilerStop+0x0 
1ffff8c0 02494264 33b710e0 00000000 00000000 00000000 nvcuda64!+0x0 
1ffff8f0 6cf97034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
1ffff920 6d962651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
1ffff9a0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)