Task 11103298

Name ParityModified-1639960621-28514-2-0_0
Workunit 8385848
Created 27 Jan 2022, 6:54:06 UTC
Sent 13 Feb 2022, 14:05:47 UTC
Report deadline 21 Feb 2022, 14:05:47 UTC
Received 13 Feb 2022, 15:45:12 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID 571
Run time 32 min 59 sec
CPU time 31 min 58 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 5,441.63 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 2.10 GB
Peak swap size 4.33 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.14.2</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code -1073741819 (0xc0000005)</message>
<stderr_txt>
[2022-02-13 15:35:27	                main:574]	:	INFO	:	Epoch 534 | loss: 0.0311689 | val_loss: 0.0311767 | Time: 2557.23 ms
[2022-02-13 15:35:30	                main:574]	:	INFO	:	Epoch 535 | loss: 0.0311658 | val_loss: 0.0311844 | Time: 2532.28 ms
[2022-02-13 15:35:32	                main:574]	:	INFO	:	Epoch 536 | loss: 0.0311668 | val_loss: 0.0311813 | Time: 2583.79 ms
[2022-02-13 15:35:35	                main:574]	:	INFO	:	Epoch 537 | loss: 0.0311733 | val_loss: 0.0311781 | Time: 2931.99 ms
[2022-02-13 15:35:38	                main:574]	:	INFO	:	Epoch 538 | loss: 0.0311691 | val_loss: 0.0311841 | Time: 2500.05 ms
[2022-02-13 15:35:40	                main:574]	:	INFO	:	Epoch 539 | loss: 0.0311716 | val_loss: 0.0311806 | Time: 2486.77 ms
[2022-02-13 15:35:43	                main:574]	:	INFO	:	Epoch 540 | loss: 0.0311702 | val_loss: 0.0311983 | Time: 2652.99 ms
[2022-02-13 15:35:46	                main:574]	:	INFO	:	Epoch 541 | loss: 0.0311734 | val_loss: 0.0311797 | Time: 2511.19 ms
[2022-02-13 15:35:48	                main:574]	:	INFO	:	Epoch 542 | loss: 0.0311716 | val_loss: 0.0311773 | Time: 2447.93 ms
[2022-02-13 15:35:51	                main:574]	:	INFO	:	Epoch 543 | loss: 0.0311638 | val_loss: 0.0311785 | Time: 2515.19 ms
[2022-02-13 15:35:53	                main:574]	:	INFO	:	Epoch 544 | loss: 0.0311663 | val_loss: 0.0311862 | Time: 2523.4 ms
[2022-02-13 15:35:56	                main:574]	:	INFO	:	Epoch 545 | loss: 0.0311708 | val_loss: 0.0311795 | Time: 2611.28 ms
[2022-02-13 15:35:59	                main:574]	:	INFO	:	Epoch 546 | loss: 0.0311682 | val_loss: 0.0311804 | Time: 2648.1 ms
[2022-02-13 15:36:01	                main:574]	:	INFO	:	Epoch 547 | loss: 0.0311691 | val_loss: 0.0311804 | Time: 2528.3 ms
[2022-02-13 15:36:04	                main:574]	:	INFO	:	Epoch 548 | loss: 0.0311702 | val_loss: 0.0311859 | Time: 2467.39 ms
[2022-02-13 15:36:06	                main:574]	:	INFO	:	Epoch 549 | loss: 0.0311713 | val_loss: 0.0311798 | Time: 2541.71 ms
[2022-02-13 15:36:09	                main:574]	:	INFO	:	Epoch 550 | loss: 0.0311716 | val_loss: 0.0311771 | Time: 2616.48 ms
[2022-02-13 15:36:12	                main:574]	:	INFO	:	Epoch 551 | loss: 0.0311668 | val_loss: 0.0311767 | Time: 2692.89 ms
[2022-02-13 15:36:15	                main:574]	:	INFO	:	Epoch 552 | loss: 0.0311663 | val_loss: 0.0311824 | Time: 2710.4 ms
[2022-02-13 15:36:17	                main:574]	:	INFO	:	Epoch 553 | loss: 0.0311698 | val_loss: 0.0311779 | Time: 2586.68 ms
[2022-02-13 15:36:20	                main:574]	:	INFO	:	Epoch 554 | loss: 0.0311655 | val_loss: 0.0311789 | Time: 2722.43 ms
[2022-02-13 15:36:23	                main:574]	:	INFO	:	Epoch 555 | loss: 0.031164 | val_loss: 0.0311822 | Time: 2561.95 ms
[2022-02-13 15:36:25	                main:574]	:	INFO	:	Epoch 556 | loss: 0.0311683 | val_loss: 0.0311803 | Time: 2410.51 ms
[2022-02-13 15:36:28	                main:574]	:	INFO	:	Epoch 557 | loss: 0.0311698 | val_loss: 0.0311806 | Time: 2535.13 ms
[2022-02-13 15:36:30	                main:574]	:	INFO	:	Epoch 558 | loss: 0.0311709 | val_loss: 0.0311769 | Time: 2568.31 ms
[2022-02-13 15:36:33	                main:574]	:	INFO	:	Epoch 559 | loss: 0.0311673 | val_loss: 0.0311849 | Time: 2499.12 ms
[2022-02-13 15:36:35	                main:574]	:	INFO	:	Epoch 560 | loss: 0.0311685 | val_loss: 0.031182 | Time: 2554.7 ms
[2022-02-13 15:36:38	                main:574]	:	INFO	:	Epoch 561 | loss: 0.0311676 | val_loss: 0.0311837 | Time: 2749.99 ms
[2022-02-13 15:36:41	                main:574]	:	INFO	:	Epoch 562 | loss: 0.0311665 | val_loss: 0.0311783 | Time: 2583.28 ms
[2022-02-13 15:36:43	                main:574]	:	INFO	:	Epoch 563 | loss: 0.0311648 | val_loss: 0.0311802 | Time: 2602.6 ms
[2022-02-13 15:36:46	                main:574]	:	INFO	:	Epoch 564 | loss: 0.0311637 | val_loss: 0.0311767 | Time: 2388.28 ms
[2022-02-13 15:36:48	                main:574]	:	INFO	:	Epoch 565 | loss: 0.0311692 | val_loss: 0.0311932 | Time: 2399.62 ms
[2022-02-13 15:36:51	                main:574]	:	INFO	:	Epoch 566 | loss: 0.0311703 | val_loss: 0.0311815 | Time: 2697.37 ms
[2022-02-13 15:36:54	                main:574]	:	INFO	:	Epoch 567 | loss: 0.031166 | val_loss: 0.0311805 | Time: 2478.19 ms
[2022-02-13 15:36:56	                main:574]	:	INFO	:	Epoch 568 | loss: 0.0311658 | val_loss: 0.0311787 | Time: 2548.86 ms
[2022-02-13 15:36:59	                main:574]	:	INFO	:	Epoch 569 | loss: 0.0311741 | val_loss: 0.0311871 | Time: 2679.22 ms
[2022-02-13 15:37:02	                main:574]	:	INFO	:	Epoch 570 | loss: 0.031175 | val_loss: 0.0311777 | Time: 2630.29 ms
[2022-02-13 15:37:04	                main:574]	:	INFO	:	Epoch 571 | loss: 0.0311747 | val_loss: 0.0311838 | Time: 2519 ms
[2022-02-13 15:37:07	                main:574]	:	INFO	:	Epoch 572 | loss: 0.0311713 | val_loss: 0.0311769 | Time: 2386.55 ms
[2022-02-13 15:37:09	                main:574]	:	INFO	:	Epoch 573 | loss: 0.0311667 | val_loss: 0.0311793 | Time: 2560.92 ms
[2022-02-13 15:37:12	                main:574]	:	INFO	:	Epoch 574 | loss: 0.0311693 | val_loss: 0.0311769 | Time: 2705 ms
[2022-02-13 15:37:14	                main:574]	:	INFO	:	Epoch 575 | loss: 0.0311649 | val_loss: 0.0311771 | Time: 2561.31 ms
[2022-02-13 15:37:17	                main:574]	:	INFO	:	Epoch 576 | loss: 0.0311693 | val_loss: 0.031191 | Time: 2508 ms
[2022-02-13 15:37:20	                main:574]	:	INFO	:	Epoch 577 | loss: 0.0311709 | val_loss: 0.0311803 | Time: 2614.66 ms
[2022-02-13 15:37:22	                main:574]	:	INFO	:	Epoch 578 | loss: 0.0311667 | val_loss: 0.0311761 | Time: 2616.22 ms
[2022-02-13 15:37:25	                main:574]	:	INFO	:	Epoch 579 | loss: 0.0311646 | val_loss: 0.0311841 | Time: 2416.94 ms
[2022-02-13 15:37:28	                main:574]	:	INFO	:	Epoch 580 | loss: 0.0311683 | val_loss: 0.0311826 | Time: 2966.99 ms
[2022-02-13 15:37:30	                main:574]	:	INFO	:	Epoch 581 | loss: 0.0311649 | val_loss: 0.0311778 | Time: 2643.52 ms
[2022-02-13 15:37:33	                main:574]	:	INFO	:	Epoch 582 | loss: 0.0311629 | val_loss: 0.031183 | Time: 2647.03 ms
[2022-02-13 15:37:36	                main:574]	:	INFO	:	Epoch 583 | loss: 0.0311661 | val_loss: 0.0311776 | Time: 2717.62 ms
[2022-02-13 15:37:39	                main:574]	:	INFO	:	Epoch 584 | loss: 0.0311671 | val_loss: 0.0311816 | Time: 2574.86 ms
[2022-02-13 15:37:41	                main:574]	:	INFO	:	Epoch 585 | loss: 0.031166 | val_loss: 0.0311753 | Time: 2407.38 ms
[2022-02-13 15:37:44	                main:574]	:	INFO	:	Epoch 586 | loss: 0.0311655 | val_loss: 0.0311804 | Time: 2592.65 ms
[2022-02-13 15:37:46	                main:574]	:	INFO	:	Epoch 587 | loss: 0.0311675 | val_loss: 0.031183 | Time: 2822.48 ms
[2022-02-13 15:37:49	                main:574]	:	INFO	:	Epoch 588 | loss: 0.0311682 | val_loss: 0.031183 | Time: 2414.48 ms
[2022-02-13 15:37:52	                main:574]	:	INFO	:	Epoch 589 | loss: 0.0311782 | val_loss: 0.031181 | Time: 2703.04 ms
[2022-02-13 15:37:54	                main:574]	:	INFO	:	Epoch 590 | loss: 0.0311752 | val_loss: 0.0311819 | Time: 2627.7 ms
[2022-02-13 15:37:57	                main:574]	:	INFO	:	Epoch 591 | loss: 0.0311745 | val_loss: 0.0311825 | Time: 3057.15 ms
[2022-02-13 15:38:00	                main:574]	:	INFO	:	Epoch 592 | loss: 0.0311738 | val_loss: 0.0311985 | Time: 2619.47 ms
[2022-02-13 15:38:03	                main:574]	:	INFO	:	Epoch 593 | loss: 0.031175 | val_loss: 0.0311817 | Time: 2490.19 ms
[2022-02-13 15:38:05	                main:574]	:	INFO	:	Epoch 594 | loss: 0.0311694 | val_loss: 0.0311793 | Time: 2453.12 ms
[2022-02-13 15:38:07	                main:574]	:	INFO	:	Epoch 595 | loss: 0.0311694 | val_loss: 0.0311885 | Time: 2369.82 ms
[2022-02-13 15:38:10	                main:574]	:	INFO	:	Epoch 596 | loss: 0.0311698 | val_loss: 0.0311818 | Time: 2443.04 ms
[2022-02-13 15:38:12	                main:574]	:	INFO	:	Epoch 597 | loss: 0.0311742 | val_loss: 0.0311789 | Time: 2372.97 ms
[2022-02-13 15:38:15	                main:574]	:	INFO	:	Epoch 598 | loss: 0.0311689 | val_loss: 0.0311763 | Time: 2624.73 ms
[2022-02-13 15:38:18	                main:574]	:	INFO	:	Epoch 599 | loss: 0.0311653 | val_loss: 0.0311814 | Time: 2927.78 ms
[2022-02-13 15:38:21	                main:574]	:	INFO	:	Epoch 600 | loss: 0.031166 | val_loss: 0.0311744 | Time: 2615.45 ms
[2022-02-13 15:38:23	                main:574]	:	INFO	:	Epoch 601 | loss: 0.0311649 | val_loss: 0.0311775 | Time: 2493.38 ms
[2022-02-13 15:38:26	                main:574]	:	INFO	:	Epoch 602 | loss: 0.0311657 | val_loss: 0.0311748 | Time: 2539.35 ms
[2022-02-13 15:38:28	                main:574]	:	INFO	:	Epoch 603 | loss: 0.0311657 | val_loss: 0.0311747 | Time: 2549.2 ms
[2022-02-13 15:38:31	                main:574]	:	INFO	:	Epoch 604 | loss: 0.0311658 | val_loss: 0.0311739 | Time: 2522.17 ms
[2022-02-13 15:38:34	                main:574]	:	INFO	:	Epoch 605 | loss: 0.0311671 | val_loss: 0.0311838 | Time: 2662.59 ms
[2022-02-13 15:38:36	                main:574]	:	INFO	:	Epoch 606 | loss: 0.0311734 | val_loss: 0.0311818 | Time: 2352.69 ms
[2022-02-13 15:38:39	                main:574]	:	INFO	:	Epoch 607 | loss: 0.0311674 | val_loss: 0.0311778 | Time: 2578.78 ms
[2022-02-13 15:38:41	                main:574]	:	INFO	:	Epoch 608 | loss: 0.0311664 | val_loss: 0.0311755 | Time: 2544.17 ms
[2022-02-13 15:38:44	                main:574]	:	INFO	:	Epoch 609 | loss: 0.031164 | val_loss: 0.0311782 | Time: 2726.47 ms
[2022-02-13 15:38:47	                main:574]	:	INFO	:	Epoch 610 | loss: 0.0311654 | val_loss: 0.0311791 | Time: 2697.39 ms
[2022-02-13 15:38:49	                main:574]	:	INFO	:	Epoch 611 | loss: 0.0311658 | val_loss: 0.0311722 | Time: 2600.09 ms
[2022-02-13 15:38:52	                main:574]	:	INFO	:	Epoch 612 | loss: 0.0311648 | val_loss: 0.0311837 | Time: 2482.67 ms
[2022-02-13 15:38:54	                main:574]	:	INFO	:	Epoch 613 | loss: 0.0311684 | val_loss: 0.0311763 | Time: 2438.31 ms
[2022-02-13 15:38:57	                main:574]	:	INFO	:	Epoch 614 | loss: 0.0311642 | val_loss: 0.0311726 | Time: 2366.8 ms
[2022-02-13 15:39:00	                main:574]	:	INFO	:	Epoch 615 | loss: 0.0311631 | val_loss: 0.0311745 | Time: 2789.84 ms
[2022-02-13 15:39:02	                main:574]	:	INFO	:	Epoch 616 | loss: 0.0311625 | val_loss: 0.0311782 | Time: 2550.14 ms
[2022-02-13 15:39:05	                main:574]	:	INFO	:	Epoch 617 | loss: 0.0311634 | val_loss: 0.0311757 | Time: 2512.04 ms
[2022-02-13 15:39:08	                main:574]	:	INFO	:	Epoch 618 | loss: 0.0311628 | val_loss: 0.0311752 | Time: 2668.18 ms
[2022-02-13 15:39:10	                main:574]	:	INFO	:	Epoch 619 | loss: 0.0311649 | val_loss: 0.0311799 | Time: 2626.26 ms
[2022-02-13 15:39:13	                main:574]	:	INFO	:	Epoch 620 | loss: 0.0311634 | val_loss: 0.0311778 | Time: 2531.76 ms
[2022-02-13 15:39:15	                main:574]	:	INFO	:	Epoch 621 | loss: 0.0311623 | val_loss: 0.0311753 | Time: 2408.29 ms
[2022-02-13 15:39:18	                main:574]	:	INFO	:	Epoch 622 | loss: 0.0311636 | val_loss: 0.0311861 | Time: 2469.92 ms
[2022-02-13 15:39:20	                main:574]	:	INFO	:	Epoch 623 | loss: 0.0311641 | val_loss: 0.0311918 | Time: 2632.73 ms
[2022-02-13 15:39:23	                main:574]	:	INFO	:	Epoch 624 | loss: 0.0311673 | val_loss: 0.0311746 | Time: 2598.64 ms
[2022-02-13 15:39:26	                main:574]	:	INFO	:	Epoch 625 | loss: 0.0311601 | val_loss: 0.0311757 | Time: 2497.87 ms
[2022-02-13 15:39:28	                main:574]	:	INFO	:	Epoch 626 | loss: 0.0311627 | val_loss: 0.0311745 | Time: 2589.82 ms
[2022-02-13 15:39:31	                main:574]	:	INFO	:	Epoch 627 | loss: 0.0311635 | val_loss: 0.0311839 | Time: 2698.37 ms
[2022-02-13 15:39:34	                main:574]	:	INFO	:	Epoch 628 | loss: 0.0311618 | val_loss: 0.0311711 | Time: 2495.37 ms
[2022-02-13 15:39:36	                main:574]	:	INFO	:	Epoch 629 | loss: 0.0311581 | val_loss: 0.0311729 | Time: 2450.98 ms
[2022-02-13 15:39:39	                main:574]	:	INFO	:	Epoch 630 | loss: 0.0311626 | val_loss: 0.0311819 | Time: 2687.88 ms
[2022-02-13 15:39:41	                main:574]	:	INFO	:	Epoch 631 | loss: 0.0311645 | val_loss: 0.0311855 | Time: 2678.05 ms
[2022-02-13 15:39:45	                main:574]	:	INFO	:	Epoch 632 | loss: 0.031166 | val_loss: 0.0311769 | Time: 3047.24 ms
[2022-02-13 15:39:47	                main:574]	:	INFO	:	Epoch 633 | loss: 0.0311644 | val_loss: 0.0311778 | Time: 2471.38 ms
[2022-02-13 15:39:50	                main:574]	:	INFO	:	Epoch 634 | loss: 0.0311601 | val_loss: 0.0311744 | Time: 2571.68 ms
[2022-02-13 15:39:52	                main:574]	:	INFO	:	Epoch 635 | loss: 0.031164 | val_loss: 0.0311753 | Time: 2487.67 ms
[2022-02-13 15:39:55	                main:574]	:	INFO	:	Epoch 636 | loss: 0.0311608 | val_loss: 0.0311765 | Time: 2416.93 ms
[2022-02-13 15:39:57	                main:574]	:	INFO	:	Epoch 637 | loss: 0.0311593 | val_loss: 0.0311711 | Time: 2584.74 ms
[2022-02-13 15:40:00	                main:574]	:	INFO	:	Epoch 638 | loss: 0.0311597 | val_loss: 0.03117 | Time: 2605.56 ms
[2022-02-13 15:40:02	                main:574]	:	INFO	:	Epoch 639 | loss: 0.0311575 | val_loss: 0.031173 | Time: 2533.76 ms
[2022-02-13 15:40:05	                main:574]	:	INFO	:	Epoch 640 | loss: 0.031156 | val_loss: 0.0311798 | Time: 2595.34 ms
[2022-02-13 15:40:08	                main:574]	:	INFO	:	Epoch 641 | loss: 0.0311591 | val_loss: 0.0311752 | Time: 2581.39 ms
[2022-02-13 15:40:10	                main:574]	:	INFO	:	Epoch 642 | loss: 0.0311663 | val_loss: 0.0311775 | Time: 2374.69 ms
[2022-02-13 15:40:13	                main:574]	:	INFO	:	Epoch 643 | loss: 0.0311619 | val_loss: 0.0311741 | Time: 2395.17 ms
[2022-02-13 15:40:15	                main:574]	:	INFO	:	Epoch 644 | loss: 0.0311634 | val_loss: 0.0311746 | Time: 2453.97 ms
[2022-02-13 15:40:18	                main:574]	:	INFO	:	Epoch 645 | loss: 0.0311636 | val_loss: 0.0311763 | Time: 2611.48 ms
[2022-02-13 15:40:20	                main:574]	:	INFO	:	Epoch 646 | loss: 0.0311626 | val_loss: 0.0311753 | Time: 2626.04 ms
[2022-02-13 15:40:23	                main:574]	:	INFO	:	Epoch 647 | loss: 0.0311619 | val_loss: 0.0311745 | Time: 2627.77 ms
[2022-02-13 15:40:26	                main:574]	:	INFO	:	Epoch 648 | loss: 0.0311617 | val_loss: 0.0311763 | Time: 2579.01 ms
[2022-02-13 15:40:28	                main:574]	:	INFO	:	Epoch 649 | loss: 0.0311614 | val_loss: 0.0311719 | Time: 2628.78 ms
[2022-02-13 15:40:31	                main:574]	:	INFO	:	Epoch 650 | loss: 0.0311639 | val_loss: 0.0311729 | Time: 2409.91 ms
[2022-02-13 15:40:33	                main:574]	:	INFO	:	Epoch 651 | loss: 0.0311629 | val_loss: 0.0311737 | Time: 2363 ms
[2022-02-13 15:40:36	                main:574]	:	INFO	:	Epoch 652 | loss: 0.0311621 | val_loss: 0.0311778 | Time: 2542.4 ms
[2022-02-13 15:40:38	                main:574]	:	INFO	:	Epoch 653 | loss: 0.0311606 | val_loss: 0.031177 | Time: 2496.48 ms
[2022-02-13 15:40:41	                main:574]	:	INFO	:	Epoch 654 | loss: 0.031159 | val_loss: 0.0311753 | Time: 2575.52 ms
[2022-02-13 15:40:44	                main:574]	:	INFO	:	Epoch 655 | loss: 0.0311586 | val_loss: 0.0311764 | Time: 2585.16 ms
[2022-02-13 15:40:47	                main:574]	:	INFO	:	Epoch 656 | loss: 0.0311601 | val_loss: 0.0311743 | Time: 3260.92 ms
[2022-02-13 15:40:49	                main:574]	:	INFO	:	Epoch 657 | loss: 0.0311579 | val_loss: 0.0311767 | Time: 2603.02 ms
[2022-02-13 15:40:52	                main:574]	:	INFO	:	Epoch 658 | loss: 0.0311594 | val_loss: 0.0311726 | Time: 2480.43 ms
[2022-02-13 15:40:55	                main:574]	:	INFO	:	Epoch 659 | loss: 0.031159 | val_loss: 0.0311774 | Time: 2565.51 ms
[2022-02-13 15:40:57	                main:574]	:	INFO	:	Epoch 660 | loss: 0.0311623 | val_loss: 0.0311805 | Time: 2687.08 ms
[2022-02-13 15:41:00	                main:574]	:	INFO	:	Epoch 661 | loss: 0.0311607 | val_loss: 0.0311717 | Time: 2506.52 ms
[2022-02-13 15:41:02	                main:574]	:	INFO	:	Epoch 662 | loss: 0.0311579 | val_loss: 0.0311759 | Time: 2511.61 ms
[2022-02-13 15:41:05	                main:574]	:	INFO	:	Epoch 663 | loss: 0.0311579 | val_loss: 0.0311735 | Time: 2642.89 ms
[2022-02-13 15:41:08	                main:574]	:	INFO	:	Epoch 664 | loss: 0.0311584 | val_loss: 0.0311725 | Time: 2477.66 ms
[2022-02-13 15:41:10	                main:574]	:	INFO	:	Epoch 665 | loss: 0.0311631 | val_loss: 0.031169 | Time: 2593.88 ms
[2022-02-13 15:41:13	                main:574]	:	INFO	:	Epoch 666 | loss: 0.0311593 | val_loss: 0.0311712 | Time: 2611.73 ms
[2022-02-13 15:41:15	                main:574]	:	INFO	:	Epoch 667 | loss: 0.0311562 | val_loss: 0.0311703 | Time: 2399.83 ms
[2022-02-13 15:41:18	                main:574]	:	INFO	:	Epoch 668 | loss: 0.0311551 | val_loss: 0.031174 | Time: 2367.37 ms
[2022-02-13 15:41:20	                main:574]	:	INFO	:	Epoch 669 | loss: 0.0311535 | val_loss: 0.0311737 | Time: 2559.61 ms
[2022-02-13 15:41:23	                main:574]	:	INFO	:	Epoch 670 | loss: 0.0311544 | val_loss: 0.0311699 | Time: 2605.67 ms
[2022-02-13 15:41:26	                main:574]	:	INFO	:	Epoch 671 | loss: 0.0311579 | val_loss: 0.0311763 | Time: 2581.2 ms
[2022-02-13 15:41:28	                main:574]	:	INFO	:	Epoch 672 | loss: 0.0311593 | val_loss: 0.0311729 | Time: 2512.48 ms
[2022-02-13 15:41:31	                main:574]	:	INFO	:	Epoch 673 | loss: 0.0311614 | val_loss: 0.0311717 | Time: 2640.55 ms
[2022-02-13 15:41:33	                main:574]	:	INFO	:	Epoch 674 | loss: 0.0311625 | val_loss: 0.0311733 | Time: 2531.8 ms
[2022-02-13 15:41:36	                main:574]	:	INFO	:	Epoch 675 | loss: 0.031157 | val_loss: 0.031178 | Time: 2427.75 ms
[2022-02-13 15:41:38	                main:574]	:	INFO	:	Epoch 676 | loss: 0.0311596 | val_loss: 0.031173 | Time: 2463.86 ms
[2022-02-13 15:41:41	                main:574]	:	INFO	:	Epoch 677 | loss: 0.0311581 | val_loss: 0.031177 | Time: 2522.45 ms
[2022-02-13 15:41:44	                main:574]	:	INFO	:	Epoch 678 | loss: 0.0311585 | val_loss: 0.031172 | Time: 2600.83 ms
[2022-02-13 15:41:46	                main:574]	:	INFO	:	Epoch 679 | loss: 0.0311559 | val_loss: 0.0311744 | Time: 2808.14 ms
[2022-02-13 15:41:49	                main:574]	:	INFO	:	Epoch 680 | loss: 0.0311547 | val_loss: 0.0311719 | Time: 2425.43 ms
[2022-02-13 15:41:51	                main:574]	:	INFO	:	Epoch 681 | loss: 0.0311549 | val_loss: 0.0311748 | Time: 2468.17 ms
[2022-02-13 15:41:54	                main:574]	:	INFO	:	Epoch 682 | loss: 0.0311565 | val_loss: 0.031174 | Time: 2553.69 ms
[2022-02-13 15:41:56	                main:574]	:	INFO	:	Epoch 683 | loss: 0.0311595 | val_loss: 0.0311749 | Time: 2398.64 ms
[2022-02-13 15:41:59	                main:574]	:	INFO	:	Epoch 684 | loss: 0.031163 | val_loss: 0.0311758 | Time: 2653.77 ms
[2022-02-13 15:42:02	                main:574]	:	INFO	:	Epoch 685 | loss: 0.031155 | val_loss: 0.031175 | Time: 2608.55 ms
[2022-02-13 15:42:04	                main:574]	:	INFO	:	Epoch 686 | loss: 0.0311553 | val_loss: 0.0311807 | Time: 2536.57 ms
[2022-02-13 15:42:07	                main:574]	:	INFO	:	Epoch 687 | loss: 0.0311615 | val_loss: 0.0311723 | Time: 2971.09 ms
[2022-02-13 15:42:10	                main:574]	:	INFO	:	Epoch 688 | loss: 0.0311568 | val_loss: 0.0311738 | Time: 2636.68 ms
[2022-02-13 15:42:12	                main:574]	:	INFO	:	Epoch 689 | loss: 0.0311583 | val_loss: 0.0311727 | Time: 2369.77 ms
[2022-02-13 15:42:15	                main:574]	:	INFO	:	Epoch 690 | loss: 0.0311575 | val_loss: 0.0311725 | Time: 2473.29 ms
[2022-02-13 15:42:17	                main:574]	:	INFO	:	Epoch 691 | loss: 0.0311558 | val_loss: 0.0311771 | Time: 2453.09 ms
[2022-02-13 15:42:21	                main:574]	:	INFO	:	Epoch 692 | loss: 0.0311571 | val_loss: 0.0311842 | Time: 3385.17 ms
[2022-02-13 15:42:23	                main:574]	:	INFO	:	Epoch 693 | loss: 0.0311615 | val_loss: 0.0311792 | Time: 2672.91 ms
[2022-02-13 15:42:26	                main:574]	:	INFO	:	Epoch 694 | loss: 0.0311643 | val_loss: 0.0311818 | Time: 2606.16 ms
[2022-02-13 15:42:29	                main:574]	:	INFO	:	Epoch 695 | loss: 0.0311636 | val_loss: 0.031172 | Time: 2452.46 ms
[2022-02-13 15:42:31	                main:574]	:	INFO	:	Epoch 696 | loss: 0.0311625 | val_loss: 0.0311801 | Time: 2588.88 ms
[2022-02-13 15:42:34	                main:574]	:	INFO	:	Epoch 697 | loss: 0.0311605 | val_loss: 0.0311732 | Time: 2422.74 ms
[2022-02-13 15:42:36	                main:574]	:	INFO	:	Epoch 698 | loss: 0.0311548 | val_loss: 0.0311743 | Time: 2308.71 ms
[2022-02-13 15:42:39	                main:574]	:	INFO	:	Epoch 699 | loss: 0.0311547 | val_loss: 0.0311829 | Time: 2530.63 ms
[2022-02-13 15:42:41	                main:574]	:	INFO	:	Epoch 700 | loss: 0.0311553 | val_loss: 0.0311747 | Time: 2502.75 ms
[2022-02-13 15:42:44	                main:574]	:	INFO	:	Epoch 701 | loss: 0.0311564 | val_loss: 0.0311845 | Time: 2641.77 ms
[2022-02-13 15:42:47	                main:574]	:	INFO	:	Epoch 702 | loss: 0.0311525 | val_loss: 0.0311759 | Time: 3009.75 ms
[2022-02-13 15:42:50	                main:574]	:	INFO	:	Epoch 703 | loss: 0.0311503 | val_loss: 0.0311739 | Time: 2617.06 ms
[2022-02-13 15:42:52	                main:574]	:	INFO	:	Epoch 704 | loss: 0.0311502 | val_loss: 0.0311752 | Time: 2541.97 ms
[2022-02-13 15:42:55	                main:574]	:	INFO	:	Epoch 705 | loss: 0.0311543 | val_loss: 0.0311838 | Time: 2466.51 ms
[2022-02-13 15:42:57	                main:574]	:	INFO	:	Epoch 706 | loss: 0.0311591 | val_loss: 0.0311772 | Time: 2634.13 ms
[2022-02-13 15:43:00	                main:574]	:	INFO	:	Epoch 707 | loss: 0.0311614 | val_loss: 0.0311803 | Time: 2681.04 ms
[2022-02-13 15:43:03	                main:574]	:	INFO	:	Epoch 708 | loss: 0.0311586 | val_loss: 0.0311797 | Time: 2616.67 ms
[2022-02-13 15:43:05	                main:574]	:	INFO	:	Epoch 709 | loss: 0.0311622 | val_loss: 0.0311774 | Time: 2532.53 ms
[2022-02-13 15:43:08	                main:574]	:	INFO	:	Epoch 710 | loss: 0.031164 | val_loss: 0.031176 | Time: 2699.49 ms
[2022-02-13 15:43:11	                main:574]	:	INFO	:	Epoch 711 | loss: 0.0311605 | val_loss: 0.0311841 | Time: 2688.91 ms
[2022-02-13 15:43:13	                main:574]	:	INFO	:	Epoch 712 | loss: 0.0311616 | val_loss: 0.03118 | Time: 2453.2 ms
[2022-02-13 15:43:16	                main:574]	:	INFO	:	Epoch 713 | loss: 0.031155 | val_loss: 0.0311726 | Time: 2421.44 ms
[2022-02-13 15:43:18	                main:574]	:	INFO	:	Epoch 714 | loss: 0.0311547 | val_loss: 0.0311747 | Time: 2561.07 ms
[2022-02-13 15:43:21	                main:574]	:	INFO	:	Epoch 715 | loss: 0.0311598 | val_loss: 0.031173 | Time: 2752.93 ms
[2022-02-13 15:43:24	                main:574]	:	INFO	:	Epoch 716 | loss: 0.0311598 | val_loss: 0.0311763 | Time: 2662.56 ms
[2022-02-13 15:43:26	                main:574]	:	INFO	:	Epoch 717 | loss: 0.031155 | val_loss: 0.0311732 | Time: 2482.17 ms
[2022-02-13 15:43:29	                main:574]	:	INFO	:	Epoch 718 | loss: 0.0311564 | val_loss: 0.0311748 | Time: 2598.73 ms
[2022-02-13 15:43:32	                main:574]	:	INFO	:	Epoch 719 | loss: 0.0311573 | val_loss: 0.0311774 | Time: 2656.14 ms
[2022-02-13 15:43:34	                main:574]	:	INFO	:	Epoch 720 | loss: 0.0311531 | val_loss: 0.0311743 | Time: 2491.57 ms
[2022-02-13 15:43:37	                main:574]	:	INFO	:	Epoch 721 | loss: 0.0311533 | val_loss: 0.031184 | Time: 2524.06 ms
[2022-02-13 15:43:39	                main:574]	:	INFO	:	Epoch 722 | loss: 0.0311557 | val_loss: 0.0311759 | Time: 2589.29 ms
[2022-02-13 15:43:42	                main:574]	:	INFO	:	Epoch 723 | loss: 0.0311535 | val_loss: 0.0311741 | Time: 2619.82 ms
[2022-02-13 15:43:45	                main:574]	:	INFO	:	Epoch 724 | loss: 0.0311528 | val_loss: 0.0311737 | Time: 2666.5 ms
[2022-02-13 15:43:47	                main:574]	:	INFO	:	Epoch 725 | loss: 0.0311543 | val_loss: 0.0311784 | Time: 2569.58 ms
[2022-02-13 15:43:50	                main:574]	:	INFO	:	Epoch 726 | loss: 0.0311574 | val_loss: 0.0311726 | Time: 2519.17 ms
[2022-02-13 15:43:52	                main:574]	:	INFO	:	Epoch 727 | loss: 0.0311534 | val_loss: 0.0311719 | Time: 2580.31 ms
[2022-02-13 15:43:55	                main:574]	:	INFO	:	Epoch 728 | loss: 0.0311525 | val_loss: 0.0311741 | Time: 2468.32 ms
[2022-02-13 15:43:58	                main:574]	:	INFO	:	Epoch 729 | loss: 0.0311528 | val_loss: 0.0311714 | Time: 2703.16 ms
[2022-02-13 15:44:00	                main:574]	:	INFO	:	Epoch 730 | loss: 0.0311578 | val_loss: 0.0311746 | Time: 2692.51 ms
[2022-02-13 15:44:03	                main:574]	:	INFO	:	Epoch 731 | loss: 0.0311597 | val_loss: 0.031183 | Time: 2572.88 ms
[2022-02-13 15:44:06	                main:574]	:	INFO	:	Epoch 732 | loss: 0.0311533 | val_loss: 0.0311783 | Time: 2652.98 ms
[2022-02-13 15:44:08	                main:574]	:	INFO	:	Epoch 733 | loss: 0.0311551 | val_loss: 0.0311754 | Time: 2599.2 ms
[2022-02-13 15:44:11	                main:574]	:	INFO	:	Epoch 734 | loss: 0.0311519 | val_loss: 0.0311732 | Time: 2491.93 ms
[2022-02-13 15:44:13	                main:574]	:	INFO	:	Epoch 735 | loss: 0.031151 | val_loss: 0.0311723 | Time: 2484.04 ms
[2022-02-13 15:44:16	                main:574]	:	INFO	:	Epoch 736 | loss: 0.0311527 | val_loss: 0.0311702 | Time: 2478.94 ms
[2022-02-13 15:44:19	                main:574]	:	INFO	:	Epoch 737 | loss: 0.0311507 | val_loss: 0.0311729 | Time: 2843.59 ms
[2022-02-13 15:44:22	                main:574]	:	INFO	:	Epoch 738 | loss: 0.0311516 | val_loss: 0.0311696 | Time: 2684.98 ms
[2022-02-13 15:44:24	                main:574]	:	INFO	:	Epoch 739 | loss: 0.0311529 | val_loss: 0.0311712 | Time: 2635.57 ms
[2022-02-13 15:44:27	                main:574]	:	INFO	:	Epoch 740 | loss: 0.031153 | val_loss: 0.0311714 | Time: 2727.86 ms
[2022-02-13 15:44:30	                main:574]	:	INFO	:	Epoch 741 | loss: 0.0311564 | val_loss: 0.0311706 | Time: 2566.56 ms
[2022-02-13 15:44:32	                main:574]	:	INFO	:	Epoch 742 | loss: 0.031154 | val_loss: 0.0311817 | Time: 2486.86 ms
[2022-02-13 15:44:35	                main:574]	:	INFO	:	Epoch 743 | loss: 0.0311536 | val_loss: 0.0311765 | Time: 2610.15 ms
[2022-02-13 15:44:37	                main:574]	:	INFO	:	Epoch 744 | loss: 0.0311515 | val_loss: 0.0311835 | Time: 2452.55 ms
[2022-02-13 15:44:40	                main:574]	:	INFO	:	Epoch 745 | loss: 0.0311609 | val_loss: 0.0311807 | Time: 2602.06 ms
[2022-02-13 15:44:43	                main:574]	:	INFO	:	Epoch 746 | loss: 0.0311513 | val_loss: 0.0311802 | Time: 2656.14 ms
[2022-02-13 15:44:45	                main:574]	:	INFO	:	Epoch 747 | loss: 0.0311501 | val_loss: 0.0311807 | Time: 2649.3 ms
[2022-02-13 15:44:48	                main:574]	:	INFO	:	Epoch 748 | loss: 0.0311503 | val_loss: 0.031174 | Time: 2443.45 ms
[2022-02-13 15:44:50	                main:574]	:	INFO	:	Epoch 749 | loss: 0.0311484 | val_loss: 0.0311813 | Time: 2483.15 ms
[2022-02-13 15:44:53	                main:574]	:	INFO	:	Epoch 750 | loss: 0.0311493 | val_loss: 0.0311738 | Time: 2448.89 ms
[2022-02-13 15:44:55	                main:574]	:	INFO	:	Epoch 751 | loss: 0.0311492 | val_loss: 0.0311814 | Time: 2606.2 ms
[2022-02-13 15:44:58	                main:574]	:	INFO	:	Epoch 752 | loss: 0.031149 | val_loss: 0.0311819 | Time: 2594.28 ms


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x00007FF9F2CEE7F5 read attempt to address 0xFFFFFFFF

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 02/13/22 15:45:00
Install Directory : H:\Program Files\BOINC\
Data Directory    : H:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( H:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( H:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( H:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( H:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: H:\ProgramData\BOINC\slots\121;H:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 000000006fa30000 00000000003df000 H:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000342c0000 00000000001f0000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.18362.815) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000032670000 00000000000b2000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.18362.959 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.959

ModLoad: 0000000031d60000 00000000002a4000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.18362.959 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.959

ModLoad: 00000000324b0000 0000000000194000 C:\WINDOWS\System32\USER32.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000032070000 0000000000021000 C:\WINDOWS\System32\win32u.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.18362.959 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.959

ModLoad: 0000000032840000 0000000000026000 C:\WINDOWS\System32\GDI32.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000320a0000 0000000000196000 C:\WINDOWS\System32\gdi32full.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.18362.959 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.959

ModLoad: 0000000031b70000 000000000009e000 C:\WINDOWS\System32\msvcp_win.dll (6.2.18362.815) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.18362.815 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.815

ModLoad: 00000000319f0000 00000000000fa000 C:\WINDOWS\System32\ucrtbase.dll (6.2.18362.815) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.18362.815 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.815

ModLoad: 0000000033b20000 00000000000a3000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.18362.752) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000032740000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.18362.1

ModLoad: 0000000033be0000 0000000000097000 C:\WINDOWS\System32\sechost.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000f7a60000 0000000000058000 H:\ProgramData\BOINC\slots\121\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000032aa0000 0000000000120000 C:\WINDOWS\System32\RPCRT4.dll (6.2.18362.628) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 000000001e700000 00000000001f4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000e9a60000 0000000000091000 H:\ProgramData\BOINC\slots\121\MSVCP140.dll (14.27.29112.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.27.29112.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.27.29112.0

ModLoad: 000000000b3a0000 000000000000c000 H:\ProgramData\BOINC\slots\121\VCRUNTIME140_1.dll (14.27.29112.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.27.29112.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.27.29112.0

ModLoad: 00000000fc130000 0000000000019000 H:\ProgramData\BOINC\slots\121\VCRUNTIME140.dll (14.27.29112.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.27.29112.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.27.29112.0

ModLoad: 00000000d6a20000 000000000abe7000 H:\ProgramData\BOINC\slots\121\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000e91c0000 00000000002db000 H:\ProgramData\BOINC\slots\121\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000e8fb0000 000000000020d000 H:\ProgramData\BOINC\slots\121\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 00000000f51b0000 0000000000040000 H:\ProgramData\BOINC\slots\121\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000005f0a0000 0000000024b49000 H:\ProgramData\BOINC\slots\121\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000e9a10000 0000000000045000 H:\ProgramData\BOINC\slots\121\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000005bff0000 00000000030a5000 H:\ProgramData\BOINC\slots\121\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 0000000058b30000 00000000034b2000 H:\ProgramData\BOINC\slots\121\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 000000000aeb0000 0000000000010000 H:\ProgramData\BOINC\slots\121\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 0000000054dd0000 0000000003d5b000 H:\ProgramData\BOINC\slots\121\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 0000000052f00000 0000000001eca000 H:\ProgramData\BOINC\slots\121\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 000000002e9b0000 000000001b3a4000 H:\ProgramData\BOINC\slots\121\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 0000000025810000 000000000919f000 H:\ProgramData\BOINC\slots\121\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 0000000032240000 0000000000080000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.18362.836) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.18362.836 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.836

ModLoad: 0000000033de0000 000000000002e000 C:\WINDOWS\System32\IMM32.DLL (6.2.18362.387) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.18362.387 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.387

ModLoad: 0000000031180000 0000000000011000 C:\WINDOWS\System32\kernel.appcore.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 000000002fe10000 0000000000020000 C:\WINDOWS\SYSTEM32\dxcore.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : DXCore.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000031b20000 000000000004a000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.18362.387) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.18362.387 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.387

ModLoad: 00000000334b0000 0000000000335000 C:\WINDOWS\System32\combase.dll (6.2.18362.900) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000033e10000 0000000000470000 C:\WINDOWS\System32\Setupapi.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000031af0000 0000000000026000 C:\WINDOWS\System32\bcrypt.dll (6.2.18362.267) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000030f10000 000000000002a000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.18362.387) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.18362.387 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.387

ModLoad: 0000000032010000 000000000005c000 C:\WINDOWS\System32\WINTRUST.dll (6.2.18362.387) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.18362.387 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.387

ModLoad: 00000000311a0000 0000000000012000 C:\WINDOWS\System32\MSASN1.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000031c10000 0000000000149000 C:\WINDOWS\System32\CRYPT32.dll (6.2.18362.592) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000032bc0000 00000000006e6000 C:\WINDOWS\System32\Shell32.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.18362.900 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.900

ModLoad: 00000000332b0000 00000000000a9000 C:\WINDOWS\System32\shcore.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000031260000 0000000000782000 C:\WINDOWS\System32\windows.storage.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 00000000311c0000 0000000000023000 C:\WINDOWS\System32\profapi.dll (6.2.18362.693) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : profapi.pdb
    File Version          : 10.0.18362.693 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.693

ModLoad: 00000000311f0000 000000000004a000 C:\WINDOWS\System32\powrprof.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : powrprof.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000031170000 0000000000010000 C:\WINDOWS\System32\UMPDC.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : UMPDC.pdb

ModLoad: 00000000327e0000 0000000000052000 C:\WINDOWS\System32\shlwapi.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000031240000 0000000000017000 C:\WINDOWS\System32\cryptsp.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptsp.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000017a30000 0000000000267000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.5730) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 27.21.14.5730
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.1.114 driver
    Product Version       : 27.21.14.5730

ModLoad: 000000002f150000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000f2b80000 000000000152c000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_5dcb5bbf5c3edcf2\nvcuda64.dll (27.21.14.5730) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 27.21.14.5730
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.1.114 driver
    Product Version       : 27.21.14.5730

ModLoad: 00000000338d0000 000000000006f000 C:\WINDOWS\System32\WS2_32.dll (6.2.18362.387) (-exported- Symbols Loaded)
    Linked PDB Filename   : ws2_32.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 000000002f120000 000000000002f000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000030ab0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 000000002f4a0000 0000000000099000 C:\WINDOWS\system32\uxtheme.dll (6.2.18362.449) (-exported- Symbols Loaded)
    Linked PDB Filename   : UxTheme.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 00000000295b0000 00000000006d6000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.5730) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 27.21.14.5730
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 27.21.14.5730

ModLoad: 0000000033c80000 0000000000157000 C:\WINDOWS\System32\OLE32.DLL (6.2.18362.693) (-exported- Symbols Loaded)
    Linked PDB Filename   : ole32.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000006180000 0000000000009000 H:\ProgramData\BOINC\slots\121\caffe2_nvrtc.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000024840000 0000000000fca000 H:\ProgramData\BOINC\slots\121\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6.14.11.9000
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.89 NVRTC Library
    Product Version       : 6.14.11.9000



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 4372, Write: 2858, Other 10013

- I/O Transfers Counters -
Read: 9621181, Write: 300431, Other 82954

- Paged Pool Usage -
QuotaPagedPoolUsage: 3535464, QuotaPeakPagedPoolUsage: 3535464
QuotaNonPagedPoolUsage: 59288, QuotaPeakNonPagedPoolUsage: 59760

- Virtual Memory Usage -
VirtualSize: 359059456, PeakVirtualSize: 978432000

- Pagefile Usage -
PagefileUsage: 359059456, PeakPagefileUsage: 359059456

- Working Set Size -
WorkingSetSize: -2126249984, PeakWorkingSetSize: -2040242176, PageFaultCount: 1003646

*** Dump of thread ID 9124 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 409375008.000000, User Time: 7777031168.000000, Wait Time: 354470208.000000

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x00007FF9F2CEE7F5 read attempt to address 0xFFFFFFFF

- Registers -
rax=0000000000000000 rbx=00000000b626fd90 rcx=00000000c93f99b0 rdx=00000000b626fd90 rsi=000000004ec211c0 rdi=00000000c93f99b0
r8=0000000000000080 r9=0000000000000001 r10=0000000000000018 r11=0000000000000094 r12=0000000000000001 r13=0000000000000001
r14=00000000b626fd90 r15=0000000000000003 rip=00000000f2cee7f5 rsp=00000000c93f9848 rbp=00000000c93f99a0
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00010246

- Callstack -
ChildEBP RetAddr  Args to Child
c93f9840 f2bb8363 b626fd90 c93f99b0 c93f98a8 4ec211c0 nvcuda64!+0x0 
c93f9890 f2bb890c 4ec211d0 4ec211c0 b626fd90 4ec211d0 nvcuda64!+0x0 
c93f9b20 f2d81108 00008000 2f940730 00000000 2f754de7 nvcuda64!+0x0 
c93f9c90 2f7529b6 00000001 00000080 00000000 2f940730 nvcuda64!cuLaunchKernel+0x0 
c93f9da0 2f74fdf4 2f940730 4d42ffd0 b626fd90 c93f9fc0 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
c93f9f20 2f933951 2f940730 00000000 2f940730 00000000 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
c93fa090 2f8be604 23817590 44342090 49284800 000000c0 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
c93fa2c0 2f8cf99d 00000000 30bc1500 00000000 2f940730 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
c93fa320 2f89703b 00000000 00000000 23817590 c93fa430 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
c93fa7b0 2f7b43bc 00000000 c93fa89c 00000000 cd4a8020 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
c93faa80 2f7b700e c93fad90 2f75bc3c c93faad8 2f754ce0 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
c93fab70 2f6b82ca cd4a8020 00000000 00000000 0000000c cudnn64_7!cudnnSetDropoutDescriptor+0x0 
c93fac40 2f6b62b3 00000000 0000000c c93fae80 00000002 cudnn64_7!cudnnSetAttnDescriptor+0x0 
c93fad90 2f6b9536 00000024 9a011710 942af330 00000000 cudnn64_7!cudnnSetAttnDescriptor+0x0 
c93faea0 2f6e5f37 49284800 cb18b930 00000000 00000000 cudnn64_7!cudnnSetAttnDescriptor+0x0 
c93fb4e0 2f6deafa 00000004 cb18b930 00000004 00000000 cudnn64_7!cudnnRNNForwardTrainingEx+0x0 
c93fb6a0 2f6f9738 cb18b930 00000400 cf8af200 9a011710 cudnn64_7!cudnnRNNForwardTrainingEx+0x0 
c93fd8b0 61e1af5a c93feea0 49280000 c93feea0 9a011710 cudnn64_7!cudnnRNNBackwardData+0x0 
c93fde40 61e19c90 00000010 00000000 c93fe7d0 c93fe7b8 torch_cuda!at::native::_cudnn_rnn_backward+0x0 
c93fe030 61e72808 c93fe220 c93fef08 c93fe110 00000004 torch_cuda!at::native::_cudnn_rnn_backward+0x0 
c93fe140 61e8103d c93fe7d0 c93fe7b0 c93feee8 00000000 torch_cuda!at::native::set_storage_cuda_+0x0 
c93fe250 dc46c201 c93fe7d0 dbfeea63 b7addff0 c93fe918 torch_cuda!at::native::set_storage_cuda_+0x0 
c93fe3e0 dc4bbfea c93feea0 00000000 00000007 df50f880 torch_cpu!at::native::mkldnn_sigmoid_+0x0 
c93fe510 dc4a34da e1344668 c93fe750 c93fef08 c93fe5f0 torch_cpu!at::bucketize_out+0x0 
c93fe600 dd79e0a9 c93fe750 c93feea0 c93fe740 00000000 torch_cpu!at::_cudnn_rnn_backward+0x0 
c93fe8e0 dd7aa94d b7adb4f0 ddc1794a 00000020 00000004 torch_cpu!torch::autograd::GraphRoot::apply+0x0 
c93fe9f0 dc46c201 c93feef8 b7adc4f0 c93feb80 ddc13e3f torch_cpu!torch::autograd::GraphRoot::apply+0x0 
c93feb80 dc4bbfea c93feea0 00000000 00000000 00000000 torch_cpu!at::native::mkldnn_sigmoid_+0x0 
c93fecb0 dc4a34da e1344668 c93ff020 c93fef08 c93fed90 torch_cpu!at::bucketize_out+0x0 
c93feda0 dd6a994d c93ff020 ca8df6b0 c93feee0 cd62c958 torch_cpu!at::_cudnn_rnn_backward+0x0 
c93ff240 dd6956b1 c72c4a70 c93ff548 00000000 f7a63bd6 torch_cpu!torch::autograd::generated::CudnnRnnBackward::apply+0x0 
c93ff450 ddbfd1ea c93ff560 c72c4a70 c93ff560 c72c4a70 torch_cpu!torch::autograd::Node::operator()+0x0 
c93ff630 ddbfdbdd 00000001 00000001 00000001 00000001 torch_cpu!torch::autograd::Engine::add_thread_pool_task+0x0 
c93ffb10 ddc02812 00000000 00000000 c72c4a60 ffffffff torch_cpu!torch::autograd::Engine::evaluate_function+0x0 
c93ffe00 ddc02471 e1126d10 c93ffe40 e1126d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0 
c93ffe50 ddbf9744 00080001 cd1f2130 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0 
c93ffe80 31a10e82 cd1f2130 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0 
c93ffeb0 32687bd4 00000000 00000000 00000000 00000000 ucrtbase!_beginthreadex+0x0 
c93ffee0 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
c93fff60 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 27776 (state: Waiting): ***

- Information -
Status: Wait Reason: Unknown, , Kernel Time: 1076718720.000000, User Time: 9911562240.000000, Wait Time: 354470208.000000

- Registers -
rax=00000000000001ca rbx=0000000000000000 rcx=00000000b7e8a388 rdx=0000000000000000 rsi=0000000000000000 rdi=0000000000000000
r8=0000000000000018 r9=0000000000000000 r10=00000000000003c0 r11=00000000c8ae5c40 r12=0000000000000003 r13=00000000000001c0
r14=00000000b7e8a338 r15=0000000000000000 rip=000000003435f9a4 rsp=00000000c8ae56b8 rbp=00000000b7e8a388
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
c8ae56b0 34320590 c8ae58d0 f2d44249 00000000 4e96ad90 ntdll!ZwWaitForAlertByThreadId+0x0 
c8ae5720 31d858fd b7e8a330 00000000 00000000 00008000 ntdll!RtlSleepConditionVariableSRW+0x0 
c8ae5760 e9a9ba8d c8ae58d0 00000000 00008000 c8ae5380 KERNELBASE!SleepConditionVariableSRW+0x0 
c8ae57a0 e9a72848 00000000 c8ae5380 e9a12e0d f7a82433 MSVCP140!__crtSetThreadpoolWait+0x0 
c8ae57d0 e9a72710 c8ae5c80 e9a72f17 00000000 dbff0231 MSVCP140!std::_Winerror_message+0x0 
c8ae5840 ddc0064b c72c4a70 000001c0 b7e8a330 b7e8a330 MSVCP140!std::_Winerror_message+0x0 
c8ae5880 ddc025b1 4cd03290 c72c4a60 c72c4a60 00000000 torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0 
c8ae5b70 ddbff15d c8ae5e50 c8ae5e50 c8ae5e50 4cd03290 torch_cpu!torch::autograd::Engine::thread_main+0x0 
c8ae5de0 ddbfeea0 b05f7f10 e1126d10 fffffffe 00000000 torch_cpu!torch::autograd::Engine::execute_with_graph_task+0x0 
c8ae5f10 ddbf56f9 c78e7d10 c78e7d10 c8ae5f00 c8ae6008 torch_cpu!torch::autograd::Engine::execute+0x0 
c8ae6430 ddbf5086 340c0d38 dc5c5dc2 00000000 c8ae6500 torch_cpu!torch::autograd::Engine::make_anomaly_metadata+0x0 
c8ae64d0 ddef09be b7ada3f0 c78e7d18 00000000 c8ae6470 torch_cpu!torch::autograd::backward+0x0 
c8ae65b0 dd921cd0 4e69de70 00000000 00000000 00000000 torch_cpu!torch::autograd::VariableType::allCUDATypes+0x0 
c8ae65e0 dc5c0a06 00000000 00000000 00010001 00000001 torch_cpu!torch::autograd::GraphRoot::apply+0x0 
c8ae6810 6fa47166 c8ae68e0 c8ae6920 c8ae68e0 c8ae6e80 torch_cpu!at::Tensor::backward+0x0 
c8ae6d10 6fa4b950 c8ae6e10 c8ae6e10 00000000 33151060 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0 
c8affab0 6fc8c6f8 4e736570 00000000 00000000 4e1d29c0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
c8affaf0 32687bd4 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
c8affb20 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
c8affba0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 6156 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 354470208.000000

- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000c8fffc60 rsi=0000000000000000 rdi=0000000000000064
r8=00000000c8fffc38 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000003435c6f4 rsp=00000000c8fffc38 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
c8fffc30 31da6891 c8fffcf8 00000000 00000000 00000000 ntdll!ZwDelayExecution+0x0 
c8fffcd0 6fa6a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0 
c8fffd00 32687bd4 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
c8fffd30 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
c8fffdb0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 19572 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 354470208.000000

- Registers -
rax=000000000000005b rbx=000000000000000b rcx=000000000000000b rdx=00000000c90ff830 rsi=0000000000000000 rdi=000000000000000b
r8=00000000c90ff4c8 r9=000000004e94f700 r10=0000000000000000 r11=00000000c90ff7a0 r12=0000000000000064 r13=00000000c90ff830
r14=00000000c90ff520 r15=0000000000000000 rip=000000003435cbc4 rsp=00000000c90ff4c8 rbp=000000004e94f700
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
c90ff4c0 31db8037 33ca3880 343337d4 00000000 c886c000 ntdll!NtWaitForMultipleObjects+0x0 
c90ff7c0 31db7f1e f3074b48 342c7619 0000000b 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
c90ff800 f2d2bb54 00000000 00000000 c90ff8c8 4ec23858 KERNELBASE!WaitForMultipleObjects+0x0 
c90ffa40 f2dc09ed 00000000 00000004 00000000 00000000 nvcuda64!+0x0 
c90ffaf0 f2d2b523 8dd2f39b faba3ea3 4ee79520 00000000 nvcuda64!cuProfilerStop+0x0 
c90ffb20 f303a750 4ee79520 00000000 00000000 00000000 nvcuda64!+0x0 
c90ffb50 32687bd4 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
c90ffb80 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
c90ffc00 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 28408 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 354344480.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002ac rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002ac
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=000000004e931010 r13=0000000000000000
r14=00000000000002ac r15=0000000000000000 rip=000000003435c0f4 rsp=00000000c91ffda8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
c91ffda0 31d98b03 00000000 00000000 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0 
c91ffe40 f2f3bf48 00000000 31d84975 00000000 000002ac KERNELBASE!WaitForSingleObjectEx+0x0 
c91ffeb0 f2d2b523 00000001 5c65ac50 4ee79b50 00000000 nvcuda64!cuProfilerStop+0x0 
c91ffee0 f303a750 4ee79b50 00000000 00000000 00000000 nvcuda64!+0x0 
c91fff10 32687bd4 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
c91fff40 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
c91fffc0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 20152 (state: Waiting): ***

- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 625000.000000, Wait Time: 354470208.000000

- Registers -
rax=00000000000001ca rbx=0000000000000000 rcx=000000004ec1f258 rdx=00000000c92ff6f8 rsi=00000000c92ff660 rdi=0000000000000000
r8=00000000000005b4 r9=0000000000000004 r10=0000000000000003 r11=00000000c92ff690 r12=00000000c92ff6f8 r13=0000000000000000
r14=000000004ec1f258 r15=000000004ec239d8 rip=000000003435f9a4 rsp=00000000c92ff638 rbp=00000000c92ff690
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
c92ff630 34320815 00000102 00000102 00000000 c92ff660 ntdll!ZwWaitForAlertByThreadId+0x0 
c92ff6a0 31ddc2b9 4ec211c0 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0 
c92ff6d0 f2cb223a 4ec211c0 4ec211c0 4ec211c0 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0 
c92ff730 f2d2b523 00000004 8ddc7cb5 8ddc7cb6 00000000 nvcuda64!+0x0 
c92ff760 f303a750 4ee799a0 00000000 00000000 00000000 nvcuda64!+0x0 
c92ff790 32687bd4 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
c92ff7c0 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
c92ff840 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)