Task 14597115
| Name | ParityModified-1647047161-7428-3-0_1 |
| Workunit | 11600312 |
| Created | 11 Apr 2022, 11:11:34 UTC |
| Sent | 11 Apr 2022, 11:11:49 UTC |
| Report deadline | 19 Apr 2022, 11:11:49 UTC |
| Received | 14 Apr 2022, 12:46:07 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | -529697949 (0xE06D7363) Unknown error code |
| Computer ID | 18018 |
| Run time | 29 min 49 sec |
| CPU time | 29 min 12 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 4,539.34 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.63 GB |
| Peak swap size | 3.60 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
1936 | val_loss: 0.0311974 | Time: 2237.63 ms
[2022-04-14 21:33:56 main:574] : INFO : Epoch 535 | loss: 0.0311937 | val_loss: 0.0312001 | Time: 2235.74 ms
[2022-04-14 21:33:58 main:574] : INFO : Epoch 536 | loss: 0.0311921 | val_loss: 0.0311977 | Time: 2233.56 ms
[2022-04-14 21:34:01 main:574] : INFO : Epoch 537 | loss: 0.031192 | val_loss: 0.0312036 | Time: 2233.25 ms
[2022-04-14 21:34:03 main:574] : INFO : Epoch 538 | loss: 0.0311969 | val_loss: 0.0312075 | Time: 2242.42 ms
[2022-04-14 21:34:05 main:574] : INFO : Epoch 539 | loss: 0.0311942 | val_loss: 0.0312004 | Time: 2254.83 ms
[2022-04-14 21:34:07 main:574] : INFO : Epoch 540 | loss: 0.0311934 | val_loss: 0.0311993 | Time: 2255.14 ms
[2022-04-14 21:34:10 main:574] : INFO : Epoch 541 | loss: 0.031195 | val_loss: 0.0312031 | Time: 2262.13 ms
[2022-04-14 21:34:12 main:574] : INFO : Epoch 542 | loss: 0.0311941 | val_loss: 0.0312011 | Time: 2234.4 ms
[2022-04-14 21:34:14 main:574] : INFO : Epoch 543 | loss: 0.031193 | val_loss: 0.0312033 | Time: 2243.14 ms
[2022-04-14 21:34:17 main:574] : INFO : Epoch 544 | loss: 0.0311915 | val_loss: 0.0311966 | Time: 2248.26 ms
[2022-04-14 21:34:19 main:574] : INFO : Epoch 545 | loss: 0.0311907 | val_loss: 0.0311986 | Time: 2220.53 ms
[2022-04-14 21:34:21 main:574] : INFO : Epoch 546 | loss: 0.0311939 | val_loss: 0.0311974 | Time: 2241.55 ms
[2022-04-14 21:34:23 main:574] : INFO : Epoch 547 | loss: 0.0311978 | val_loss: 0.0311959 | Time: 2269.77 ms
[2022-04-14 21:34:25 main:574] : INFO : Epoch 548 | loss: 0.0311937 | val_loss: 0.0311976 | Time: 2226.08 ms
[2022-04-14 21:34:28 main:574] : INFO : Epoch 549 | loss: 0.0311948 | val_loss: 0.0312022 | Time: 2244.37 ms
[2022-04-14 21:34:30 main:574] : INFO : Epoch 550 | loss: 0.0311947 | val_loss: 0.0311977 | Time: 2243.84 ms
[2022-04-14 21:34:32 main:574] : INFO : Epoch 551 | loss: 0.0311926 | val_loss: 0.0311969 | Time: 2268.98 ms
[2022-04-14 21:34:34 main:574] : INFO : Epoch 552 | loss: 0.031192 | val_loss: 0.0311986 | Time: 2225.05 ms
[2022-04-14 21:34:37 main:574] : INFO : Epoch 553 | loss: 0.0311901 | val_loss: 0.0311967 | Time: 2251.87 ms
[2022-04-14 21:34:39 main:574] : INFO : Epoch 554 | loss: 0.0311942 | val_loss: 0.0312023 | Time: 2237.72 ms
[2022-04-14 21:34:41 main:574] : INFO : Epoch 555 | loss: 0.0311931 | val_loss: 0.0312047 | Time: 2263.8 ms
[2022-04-14 21:34:44 main:574] : INFO : Epoch 556 | loss: 0.0311906 | val_loss: 0.0311973 | Time: 2238.29 ms
[2022-04-14 21:34:46 main:574] : INFO : Epoch 557 | loss: 0.0311879 | val_loss: 0.0311965 | Time: 2243.16 ms
[2022-04-14 21:34:48 main:574] : INFO : Epoch 558 | loss: 0.0311881 | val_loss: 0.0311957 | Time: 2250.13 ms
[2022-04-14 21:34:50 main:574] : INFO : Epoch 559 | loss: 0.0311915 | val_loss: 0.0311996 | Time: 2241.3 ms
[2022-04-14 21:34:52 main:574] : INFO : Epoch 560 | loss: 0.0311944 | val_loss: 0.0312076 | Time: 2233.44 ms
[2022-04-14 21:34:55 main:574] : INFO : Epoch 561 | loss: 0.0311943 | val_loss: 0.0311969 | Time: 2238.77 ms
[2022-04-14 21:34:57 main:574] : INFO : Epoch 562 | loss: 0.0311885 | val_loss: 0.0311988 | Time: 2234.57 ms
[2022-04-14 21:34:59 main:574] : INFO : Epoch 563 | loss: 0.0311882 | val_loss: 0.0311974 | Time: 2286.53 ms
[2022-04-14 21:35:02 main:574] : INFO : Epoch 564 | loss: 0.031191 | val_loss: 0.0312008 | Time: 2225.14 ms
[2022-04-14 21:35:04 main:574] : INFO : Epoch 565 | loss: 0.031194 | val_loss: 0.0312043 | Time: 2232.5 ms
[2022-04-14 21:35:06 main:574] : INFO : Epoch 566 | loss: 0.0311915 | val_loss: 0.0311976 | Time: 2242.36 ms
[2022-04-14 21:35:08 main:574] : INFO : Epoch 567 | loss: 0.0311899 | val_loss: 0.0312003 | Time: 2242.38 ms
[2022-04-14 21:35:10 main:574] : INFO : Epoch 568 | loss: 0.0311901 | val_loss: 0.0311963 | Time: 2244.29 ms
[2022-04-14 21:35:13 main:574] : INFO : Epoch 569 | loss: 0.0311901 | val_loss: 0.0311977 | Time: 2244.25 ms
[2022-04-14 21:35:15 main:574] : INFO : Epoch 570 | loss: 0.0311913 | val_loss: 0.0312048 | Time: 2291.91 ms
[2022-04-14 21:35:17 main:574] : INFO : Epoch 571 | loss: 0.0311886 | val_loss: 0.0312004 | Time: 2245.25 ms
[2022-04-14 21:35:20 main:574] : INFO : Epoch 572 | loss: 0.031189 | val_loss: 0.0311956 | Time: 2244.51 ms
[2022-04-14 21:35:22 main:574] : INFO : Epoch 573 | loss: 0.0311886 | val_loss: 0.0311991 | Time: 2244.08 ms
[2022-04-14 21:35:24 main:574] : INFO : Epoch 574 | loss: 0.0311882 | val_loss: 0.0311969 | Time: 2247.82 ms
[2022-04-14 21:35:26 main:574] : INFO : Epoch 575 | loss: 0.0311886 | val_loss: 0.0311974 | Time: 2232.32 ms
[2022-04-14 21:35:29 main:574] : INFO : Epoch 576 | loss: 0.0311883 | val_loss: 0.0311977 | Time: 2247.07 ms
[2022-04-14 21:35:31 main:574] : INFO : Epoch 577 | loss: 0.0311924 | val_loss: 0.0311982 | Time: 2235.79 ms
[2022-04-14 21:35:33 main:574] : INFO : Epoch 578 | loss: 0.0312059 | val_loss: 0.0312063 | Time: 2243.71 ms
[2022-04-14 21:35:35 main:574] : INFO : Epoch 579 | loss: 0.0311991 | val_loss: 0.0311939 | Time: 2233.95 ms
[2022-04-14 21:35:38 main:574] : INFO : Epoch 580 | loss: 0.0311921 | val_loss: 0.0311948 | Time: 2246.51 ms
[2022-04-14 21:35:40 main:574] : INFO : Epoch 581 | loss: 0.03119 | val_loss: 0.0311971 | Time: 2232.5 ms
[2022-04-14 21:35:42 main:574] : INFO : Epoch 582 | loss: 0.0311911 | val_loss: 0.0311964 | Time: 2247.59 ms
[2022-04-14 21:35:44 main:574] : INFO : Epoch 583 | loss: 0.0311903 | val_loss: 0.0311941 | Time: 2251.09 ms
[2022-04-14 21:35:47 main:574] : INFO : Epoch 584 | loss: 0.0311898 | val_loss: 0.0311945 | Time: 2244.12 ms
[2022-04-14 21:35:49 main:574] : INFO : Epoch 585 | loss: 0.0311904 | val_loss: 0.0311968 | Time: 2250.19 ms
[2022-04-14 21:35:51 main:574] : INFO : Epoch 586 | loss: 0.0311894 | val_loss: 0.0311922 | Time: 2243.26 ms
[2022-04-14 21:35:53 main:574] : INFO : Epoch 587 | loss: 0.0311876 | val_loss: 0.031196 | Time: 2255.9 ms
[2022-04-14 21:35:56 main:574] : INFO : Epoch 588 | loss: 0.0311903 | val_loss: 0.0311923 | Time: 2241.01 ms
[2022-04-14 21:35:58 main:574] : INFO : Epoch 589 | loss: 0.031187 | val_loss: 0.0311946 | Time: 2243.04 ms
[2022-04-14 21:36:00 main:574] : INFO : Epoch 590 | loss: 0.0311873 | val_loss: 0.0311932 | Time: 2240.96 ms
[2022-04-14 21:36:02 main:574] : INFO : Epoch 591 | loss: 0.0311886 | val_loss: 0.0311959 | Time: 2241.93 ms
[2022-04-14 21:36:05 main:574] : INFO : Epoch 592 | loss: 0.0311862 | val_loss: 0.0311944 | Time: 2238.03 ms
[2022-04-14 21:36:07 main:574] : INFO : Epoch 593 | loss: 0.0311879 | val_loss: 0.0312011 | Time: 2235.67 ms
[2022-04-14 21:36:09 main:574] : INFO : Epoch 594 | loss: 0.0311888 | val_loss: 0.0311948 | Time: 2243.19 ms
[2022-04-14 21:36:11 main:574] : INFO : Epoch 595 | loss: 0.0311887 | val_loss: 0.0311979 | Time: 2276.92 ms
[2022-04-14 21:36:14 main:574] : INFO : Epoch 596 | loss: 0.031189 | val_loss: 0.0311938 | Time: 2277.08 ms
[2022-04-14 21:36:16 main:574] : INFO : Epoch 597 | loss: 0.031186 | val_loss: 0.031194 | Time: 2173.98 ms
[2022-04-14 21:36:18 main:574] : INFO : Epoch 598 | loss: 0.0311879 | val_loss: 0.0311922 | Time: 2162.22 ms
[2022-04-14 21:36:20 main:574] : INFO : Epoch 599 | loss: 0.0311854 | val_loss: 0.0312072 | Time: 2212.74 ms
[2022-04-14 21:36:22 main:574] : INFO : Epoch 600 | loss: 0.0311879 | val_loss: 0.0311933 | Time: 2245.32 ms
[2022-04-14 21:36:25 main:574] : INFO : Epoch 601 | loss: 0.0311867 | val_loss: 0.0311935 | Time: 2228.83 ms
[2022-04-14 21:36:27 main:574] : INFO : Epoch 602 | loss: 0.0311914 | val_loss: 0.0311987 | Time: 2182.24 ms
[2022-04-14 21:36:29 main:574] : INFO : Epoch 603 | loss: 0.0311882 | val_loss: 0.0311927 | Time: 2217.69 ms
[2022-04-14 21:36:31 main:574] : INFO : Epoch 604 | loss: 0.0311863 | val_loss: 0.0311954 | Time: 2162.19 ms
[2022-04-14 21:36:33 main:574] : INFO : Epoch 605 | loss: 0.031184 | val_loss: 0.031195 | Time: 2178.17 ms
[2022-04-14 21:36:36 main:574] : INFO : Epoch 606 | loss: 0.0311895 | val_loss: 0.0312 | Time: 2197.46 ms
[2022-04-14 21:36:38 main:574] : INFO : Epoch 607 | loss: 0.031195 | val_loss: 0.0311934 | Time: 2183.33 ms
[2022-04-14 21:36:40 main:574] : INFO : Epoch 608 | loss: 0.0311853 | val_loss: 0.0311973 | Time: 2173.82 ms
[2022-04-14 21:36:42 main:574] : INFO : Epoch 609 | loss: 0.0311866 | val_loss: 0.031195 | Time: 2171.46 ms
[2022-04-14 21:36:44 main:574] : INFO : Epoch 610 | loss: 0.0311835 | val_loss: 0.031192 | Time: 2163.76 ms
[2022-04-14 21:36:46 main:574] : INFO : Epoch 611 | loss: 0.0311864 | val_loss: 0.0311967 | Time: 2162.93 ms
[2022-04-14 21:36:49 main:574] : INFO : Epoch 612 | loss: 0.0311849 | val_loss: 0.0311931 | Time: 2182.88 ms
[2022-04-14 21:36:51 main:574] : INFO : Epoch 613 | loss: 0.0311833 | val_loss: 0.031194 | Time: 2172.44 ms
[2022-04-14 21:36:53 main:574] : INFO : Epoch 614 | loss: 0.0311832 | val_loss: 0.0311914 | Time: 2163.25 ms
[2022-04-14 21:36:55 main:574] : INFO : Epoch 615 | loss: 0.0311864 | val_loss: 0.0311914 | Time: 2199.91 ms
[2022-04-14 21:36:57 main:574] : INFO : Epoch 616 | loss: 0.0311859 | val_loss: 0.0311918 | Time: 2174.17 ms
[2022-04-14 21:37:00 main:574] : INFO : Epoch 617 | loss: 0.0311836 | val_loss: 0.0311955 | Time: 2179.62 ms
[2022-04-14 21:37:02 main:574] : INFO : Epoch 618 | loss: 0.0311843 | val_loss: 0.0311969 | Time: 2169.95 ms
[2022-04-14 21:37:04 main:574] : INFO : Epoch 619 | loss: 0.0311847 | val_loss: 0.0311941 | Time: 2168.77 ms
[2022-04-14 21:37:06 main:574] : INFO : Epoch 620 | loss: 0.0311831 | val_loss: 0.0311909 | Time: 2167.35 ms
[2022-04-14 21:37:08 main:574] : INFO : Epoch 621 | loss: 0.0311831 | val_loss: 0.0311937 | Time: 2171.75 ms
[2022-04-14 21:37:11 main:574] : INFO : Epoch 622 | loss: 0.0311833 | val_loss: 0.0311969 | Time: 2215.08 ms
[2022-04-14 21:37:13 main:574] : INFO : Epoch 623 | loss: 0.0311834 | val_loss: 0.031192 | Time: 2189.88 ms
[2022-04-14 21:37:15 main:574] : INFO : Epoch 624 | loss: 0.0311805 | val_loss: 0.0311925 | Time: 2166.67 ms
[2022-04-14 21:37:17 main:574] : INFO : Epoch 625 | loss: 0.0311851 | val_loss: 0.0311932 | Time: 2187.63 ms
[2022-04-14 21:37:19 main:574] : INFO : Epoch 626 | loss: 0.0311851 | val_loss: 0.0312048 | Time: 2178.17 ms
[2022-04-14 21:37:21 main:574] : INFO : Epoch 627 | loss: 0.0311853 | val_loss: 0.0312057 | Time: 2158.78 ms
[2022-04-14 21:37:24 main:574] : INFO : Epoch 628 | loss: 0.031186 | val_loss: 0.0311968 | Time: 2181.6 ms
[2022-04-14 21:37:26 main:574] : INFO : Epoch 629 | loss: 0.0311823 | val_loss: 0.0311913 | Time: 2180.32 ms
[2022-04-14 21:37:28 main:574] : INFO : Epoch 630 | loss: 0.0311805 | val_loss: 0.0311985 | Time: 2164.83 ms
[2022-04-14 21:37:30 main:574] : INFO : Epoch 631 | loss: 0.0311813 | val_loss: 0.0311931 | Time: 2164.21 ms
[2022-04-14 21:37:32 main:574] : INFO : Epoch 632 | loss: 0.0311817 | val_loss: 0.0311919 | Time: 2166.09 ms
[2022-04-14 21:37:35 main:574] : INFO : Epoch 633 | loss: 0.0311857 | val_loss: 0.0311922 | Time: 2193.35 ms
[2022-04-14 21:37:37 main:574] : INFO : Epoch 634 | loss: 0.0311871 | val_loss: 0.03119 | Time: 2191.96 ms
[2022-04-14 21:37:39 main:574] : INFO : Epoch 635 | loss: 0.0311815 | val_loss: 0.0311924 | Time: 2212.15 ms
[2022-04-14 21:37:41 main:574] : INFO : Epoch 636 | loss: 0.0311816 | val_loss: 0.0311909 | Time: 2164.02 ms
[2022-04-14 21:37:43 main:574] : INFO : Epoch 637 | loss: 0.0311808 | val_loss: 0.0311934 | Time: 2187.09 ms
[2022-04-14 21:37:46 main:574] : INFO : Epoch 638 | loss: 0.0311801 | val_loss: 0.0311924 | Time: 2199.82 ms
[2022-04-14 21:37:48 main:574] : INFO : Epoch 639 | loss: 0.0311813 | val_loss: 0.0311897 | Time: 2215.42 ms
[2022-04-14 21:37:50 main:574] : INFO : Epoch 640 | loss: 0.0311837 | val_loss: 0.031197 | Time: 2203.76 ms
[2022-04-14 21:37:52 main:574] : INFO : Epoch 641 | loss: 0.0311813 | val_loss: 0.0311934 | Time: 2169.4 ms
[2022-04-14 21:37:54 main:574] : INFO : Epoch 642 | loss: 0.0311792 | val_loss: 0.0311914 | Time: 2202.17 ms
[2022-04-14 21:37:57 main:574] : INFO : Epoch 643 | loss: 0.0311794 | val_loss: 0.0311912 | Time: 2173.31 ms
[2022-04-14 21:37:59 main:574] : INFO : Epoch 644 | loss: 0.0311783 | val_loss: 0.0311942 | Time: 2181.22 ms
[2022-04-14 21:38:01 main:574] : INFO : Epoch 645 | loss: 0.0311794 | val_loss: 0.0311915 | Time: 2247.16 ms
[2022-04-14 21:38:03 main:574] : INFO : Epoch 646 | loss: 0.0311786 | val_loss: 0.0311977 | Time: 2184.51 ms
[2022-04-14 21:38:05 main:574] : INFO : Epoch 647 | loss: 0.0311777 | val_loss: 0.0311913 | Time: 2173.68 ms
[2022-04-14 21:38:08 main:574] : INFO : Epoch 648 | loss: 0.0311765 | val_loss: 0.0311932 | Time: 2182.3 ms
[2022-04-14 21:38:10 main:574] : INFO : Epoch 649 | loss: 0.0311799 | val_loss: 0.0311901 | Time: 2170.33 ms
[2022-04-14 21:38:12 main:574] : INFO : Epoch 650 | loss: 0.0311777 | val_loss: 0.0311907 | Time: 2162.2 ms
[2022-04-14 21:38:14 main:574] : INFO : Epoch 651 | loss: 0.0311823 | val_loss: 0.0312008 | Time: 2206.35 ms
[2022-04-14 21:38:16 main:574] : INFO : Epoch 652 | loss: 0.0311828 | val_loss: 0.0312103 | Time: 2168.58 ms
[2022-04-14 21:38:18 main:574] : INFO : Epoch 653 | loss: 0.0311857 | val_loss: 0.0311969 | Time: 2166.83 ms
[2022-04-14 21:38:21 main:574] : INFO : Epoch 654 | loss: 0.0311769 | val_loss: 0.0311943 | Time: 2197.43 ms
[2022-04-14 21:38:23 main:574] : INFO : Epoch 655 | loss: 0.0311771 | val_loss: 0.0312001 | Time: 2165.08 ms
[2022-04-14 21:38:25 main:574] : INFO : Epoch 656 | loss: 0.0311812 | val_loss: 0.0311921 | Time: 2183.88 ms
[2022-04-14 21:38:27 main:574] : INFO : Epoch 657 | loss: 0.0311775 | val_loss: 0.0311916 | Time: 2181.8 ms
[2022-04-14 21:38:29 main:574] : INFO : Epoch 658 | loss: 0.0311761 | val_loss: 0.0311939 | Time: 2167.89 ms
[2022-04-14 21:38:32 main:574] : INFO : Epoch 659 | loss: 0.0311743 | val_loss: 0.0311927 | Time: 2167.46 ms
[2022-04-14 21:38:34 main:574] : INFO : Epoch 660 | loss: 0.0311799 | val_loss: 0.0312038 | Time: 2149.14 ms
[2022-04-14 21:38:36 main:574] : INFO : Epoch 661 | loss: 0.0311792 | val_loss: 0.0311921 | Time: 2177.4 ms
[2022-04-14 21:38:38 main:574] : INFO : Epoch 662 | loss: 0.0311807 | val_loss: 0.0312015 | Time: 2163.36 ms
[2022-04-14 21:38:40 main:574] : INFO : Epoch 663 | loss: 0.0311807 | val_loss: 0.031193 | Time: 2184.85 ms
[2022-04-14 21:38:42 main:574] : INFO : Epoch 664 | loss: 0.031175 | val_loss: 0.0311958 | Time: 2161.89 ms
[2022-04-14 21:38:45 main:574] : INFO : Epoch 665 | loss: 0.0311817 | val_loss: 0.0311986 | Time: 2171.83 ms
[2022-04-14 21:38:47 main:574] : INFO : Epoch 666 | loss: 0.031181 | val_loss: 0.0311991 | Time: 2188.19 ms
[2022-04-14 21:38:49 main:574] : INFO : Epoch 667 | loss: 0.0311804 | val_loss: 0.0311913 | Time: 2229.91 ms
[2022-04-14 21:38:51 main:574] : INFO : Epoch 668 | loss: 0.0311774 | val_loss: 0.0311968 | Time: 2170.21 ms
[2022-04-14 21:38:53 main:574] : INFO : Epoch 669 | loss: 0.0311754 | val_loss: 0.031192 | Time: 2210.73 ms
[2022-04-14 21:38:56 main:574] : INFO : Epoch 670 | loss: 0.0311771 | val_loss: 0.0311948 | Time: 2155.71 ms
[2022-04-14 21:38:58 main:574] : INFO : Epoch 671 | loss: 0.0311806 | val_loss: 0.0311972 | Time: 2167.47 ms
[2022-04-14 21:39:00 main:574] : INFO : Epoch 672 | loss: 0.0311763 | val_loss: 0.031195 | Time: 2182.3 ms
[2022-04-14 21:39:02 main:574] : INFO : Epoch 673 | loss: 0.0311808 | val_loss: 0.0311902 | Time: 2166.56 ms
[2022-04-14 21:39:04 main:574] : INFO : Epoch 674 | loss: 0.0311821 | val_loss: 0.0311922 | Time: 2162.1 ms
[2022-04-14 21:39:06 main:574] : INFO : Epoch 675 | loss: 0.0311771 | val_loss: 0.0311891 | Time: 2182.51 ms
[2022-04-14 21:39:09 main:574] : INFO : Epoch 676 | loss: 0.0311765 | val_loss: 0.0311906 | Time: 2176.96 ms
[2022-04-14 21:39:11 main:574] : INFO : Epoch 677 | loss: 0.0311776 | val_loss: 0.0311931 | Time: 2152.13 ms
[2022-04-14 21:39:13 main:574] : INFO : Epoch 678 | loss: 0.0311784 | val_loss: 0.0311957 | Time: 2181.23 ms
[2022-04-14 21:39:15 main:574] : INFO : Epoch 679 | loss: 0.0311786 | val_loss: 0.0311904 | Time: 2230.73 ms
[2022-04-14 21:39:17 main:574] : INFO : Epoch 680 | loss: 0.0311756 | val_loss: 0.0311921 | Time: 2232.21 ms
[2022-04-14 21:39:20 main:574] : INFO : Epoch 681 | loss: 0.0311796 | val_loss: 0.0311919 | Time: 2261.52 ms
[2022-04-14 21:39:22 main:574] : INFO : Epoch 682 | loss: 0.0311778 | val_loss: 0.0311907 | Time: 2165.78 ms
[2022-04-14 21:39:24 main:574] : INFO : Epoch 683 | loss: 0.0311755 | val_loss: 0.0311894 | Time: 2167.78 ms
[2022-04-14 21:39:26 main:574] : INFO : Epoch 684 | loss: 0.0311755 | val_loss: 0.0311909 | Time: 2151.49 ms
[2022-04-14 21:39:28 main:574] : INFO : Epoch 685 | loss: 0.0311781 | val_loss: 0.0311984 | Time: 2188.17 ms
[2022-04-14 21:39:31 main:574] : INFO : Epoch 686 | loss: 0.03118 | val_loss: 0.0311909 | Time: 2168.37 ms
[2022-04-14 21:39:33 main:574] : INFO : Epoch 687 | loss: 0.0311739 | val_loss: 0.0311906 | Time: 2189.97 ms
[2022-04-14 21:39:35 main:574] : INFO : Epoch 688 | loss: 0.0311788 | val_loss: 0.0311998 | Time: 2233.32 ms
[2022-04-14 21:39:37 main:574] : INFO : Epoch 689 | loss: 0.0311814 | val_loss: 0.0311939 | Time: 2177.54 ms
[2022-04-14 21:39:39 main:574] : INFO : Epoch 690 | loss: 0.0311816 | val_loss: 0.0311877 | Time: 2158.06 ms
[2022-04-14 21:39:42 main:574] : INFO : Epoch 691 | loss: 0.0311794 | val_loss: 0.0311867 | Time: 2161.79 ms
[2022-04-14 21:39:44 main:574] : INFO : Epoch 692 | loss: 0.0311817 | val_loss: 0.0311878 | Time: 2164.17 ms
[2022-04-14 21:39:46 main:574] : INFO : Epoch 693 | loss: 0.03118 | val_loss: 0.031191 | Time: 2169.71 ms
[2022-04-14 21:39:48 main:574] : INFO : Epoch 694 | loss: 0.0311814 | val_loss: 0.0311984 | Time: 2174.52 ms
[2022-04-14 21:39:50 main:574] : INFO : Epoch 695 | loss: 0.0311874 | val_loss: 0.0311881 | Time: 2190.61 ms
[2022-04-14 21:39:53 main:574] : INFO : Epoch 696 | loss: 0.0311836 | val_loss: 0.031187 | Time: 2218.63 ms
[2022-04-14 21:39:55 main:574] : INFO : Epoch 697 | loss: 0.0311835 | val_loss: 0.0311924 | Time: 2175.86 ms
[2022-04-14 21:39:57 main:574] : INFO : Epoch 698 | loss: 0.0311819 | val_loss: 0.0311842 | Time: 2148.82 ms
[2022-04-14 21:39:59 main:574] : INFO : Epoch 699 | loss: 0.0311791 | val_loss: 0.0311865 | Time: 2171.65 ms
[2022-04-14 21:40:01 main:574] : INFO : Epoch 700 | loss: 0.0311792 | val_loss: 0.0311977 | Time: 2178.02 ms
[2022-04-14 21:40:03 main:574] : INFO : Epoch 701 | loss: 0.0311829 | val_loss: 0.0311928 | Time: 2166.94 ms
[2022-04-14 21:40:06 main:574] : INFO : Epoch 702 | loss: 0.0311763 | val_loss: 0.0311891 | Time: 2205.63 ms
[2022-04-14 21:40:08 main:574] : INFO : Epoch 703 | loss: 0.0311744 | val_loss: 0.0311939 | Time: 2203.59 ms
[2022-04-14 21:40:10 main:574] : INFO : Epoch 704 | loss: 0.0311781 | val_loss: 0.0311881 | Time: 2161.59 ms
[2022-04-14 21:40:12 main:574] : INFO : Epoch 705 | loss: 0.0311734 | val_loss: 0.0311898 | Time: 2183.78 ms
[2022-04-14 21:40:16 main:574] : INFO : Epoch 706 | loss: 0.0311741 | val_loss: 0.0311865 | Time: 3782.34 ms
[2022-04-14 21:41:22 main:574] : INFO : Epoch 707 | loss: 0.0311741 | val_loss: 0.0311883 | Time: 65815.4 ms
[2022-04-14 21:41:25 main:574] : INFO : Epoch 708 | loss: 0.0311724 | val_loss: 0.0311926 | Time: 2130.03 ms
[2022-04-14 21:41:27 main:574] : INFO : Epoch 709 | loss: 0.0311776 | val_loss: 0.0311868 | Time: 2194.82 ms
[2022-04-14 21:41:29 main:574] : INFO : Epoch 710 | loss: 0.0311748 | val_loss: 0.0311934 | Time: 2208.63 ms
[2022-04-14 21:41:31 main:574] : INFO : Epoch 711 | loss: 0.0311769 | val_loss: 0.0312029 | Time: 2230.26 ms
[2022-04-14 21:41:33 main:574] : INFO : Epoch 712 | loss: 0.0311872 | val_loss: 0.0311947 | Time: 2214.9 ms
[2022-04-14 21:41:36 main:574] : INFO : Epoch 713 | loss: 0.0311791 | val_loss: 0.0311957 | Time: 2291.68 ms
[2022-04-14 21:41:38 main:574] : INFO : Epoch 714 | loss: 0.0311785 | val_loss: 0.0311904 | Time: 2304.01 ms
[2022-04-14 21:41:40 main:574] : INFO : Epoch 715 | loss: 0.0311803 | val_loss: 0.0312032 | Time: 2278.52 ms
[2022-04-14 21:42:03 main:574] : INFO : Epoch 716 | loss: 0.0311771 | val_loss: 0.0311935 | Time: 22518 ms
[2022-04-14 21:42:05 main:574] : INFO : Epoch 717 | loss: 0.0311727 | val_loss: 0.0311907 | Time: 2266.83 ms
[2022-04-14 21:42:07 main:574] : INFO : Epoch 718 | loss: 0.0311726 | val_loss: 0.0311879 | Time: 2263.24 ms
[2022-04-14 21:42:10 main:574] : INFO : Epoch 719 | loss: 0.0311706 | val_loss: 0.0311876 | Time: 2236.61 ms
[2022-04-14 21:42:12 main:574] : INFO : Epoch 720 | loss: 0.0311723 | val_loss: 0.0311882 | Time: 2268.68 ms
[2022-04-14 21:42:14 main:574] : INFO : Epoch 721 | loss: 0.0311722 | val_loss: 0.0311875 | Time: 2257.28 ms
[2022-04-14 21:42:16 main:574] : INFO : Epoch 722 | loss: 0.0311694 | val_loss: 0.0311897 | Time: 2324.32 ms
[2022-04-14 21:42:19 main:574] : INFO : Epoch 723 | loss: 0.0311691 | val_loss: 0.0311873 | Time: 2274.37 ms
[2022-04-14 21:42:21 main:574] : INFO : Epoch 724 | loss: 0.0311712 | val_loss: 0.0311967 | Time: 2259.48 ms
[2022-04-14 21:42:23 main:574] : INFO : Epoch 725 | loss: 0.0311699 | val_loss: 0.0311879 | Time: 2284.49 ms
[2022-04-14 21:42:26 main:574] : INFO : Epoch 726 | loss: 0.031172 | val_loss: 0.0311856 | Time: 2275.37 ms
[2022-04-14 21:42:28 main:574] : INFO : Epoch 727 | loss: 0.0311747 | val_loss: 0.0311898 | Time: 2263.83 ms
[2022-04-14 21:42:30 main:574] : INFO : Epoch 728 | loss: 0.0311727 | val_loss: 0.0311906 | Time: 2246.4 ms
[2022-04-14 21:42:32 main:574] : INFO : Epoch 729 | loss: 0.0311712 | val_loss: 0.0311899 | Time: 2281.18 ms
[2022-04-14 21:42:35 main:574] : INFO : Epoch 730 | loss: 0.0311734 | val_loss: 0.0311876 | Time: 2264.24 ms
[2022-04-14 21:42:37 main:574] : INFO : Epoch 731 | loss: 0.0311729 | val_loss: 0.0311902 | Time: 2277.54 ms
[2022-04-14 21:42:39 main:574] : INFO : Epoch 732 | loss: 0.0311702 | val_loss: 0.0311885 | Time: 2253.34 ms
[2022-04-14 21:42:42 main:574] : INFO : Epoch 733 | loss: 0.0311719 | val_loss: 0.0311868 | Time: 2318.01 ms
[2022-04-14 21:42:44 main:574] : INFO : Epoch 734 | loss: 0.0311689 | val_loss: 0.0311899 | Time: 2276.27 ms
[2022-04-14 21:42:46 main:574] : INFO : Epoch 735 | loss: 0.0311695 | val_loss: 0.0311932 | Time: 2273.4 ms
[2022-04-14 21:42:48 main:574] : INFO : Epoch 736 | loss: 0.0311701 | val_loss: 0.0311894 | Time: 2295.68 ms
[2022-04-14 21:42:51 main:574] : INFO : Epoch 737 | loss: 0.0311709 | val_loss: 0.0311884 | Time: 2280.59 ms
[2022-04-14 21:42:53 main:574] : INFO : Epoch 738 | loss: 0.0311702 | val_loss: 0.0311885 | Time: 2262.93 ms
[2022-04-14 21:42:55 main:574] : INFO : Epoch 739 | loss: 0.0311687 | val_loss: 0.0311893 | Time: 2278.71 ms
[2022-04-14 21:42:58 main:574] : INFO : Epoch 740 | loss: 0.0311696 | val_loss: 0.0311926 | Time: 2339.65 ms
[2022-04-14 21:43:00 main:574] : INFO : Epoch 741 | loss: 0.0311726 | val_loss: 0.0311874 | Time: 2191.58 ms
[2022-04-14 21:43:02 main:574] : INFO : Epoch 742 | loss: 0.0311765 | val_loss: 0.0311878 | Time: 2197.88 ms
[2022-04-14 21:43:04 main:574] : INFO : Epoch 743 | loss: 0.0311748 | val_loss: 0.0311848 | Time: 2167.99 ms
[2022-04-14 21:43:06 main:574] : INFO : Epoch 744 | loss: 0.0311716 | val_loss: 0.031185 | Time: 2326.52 ms
[2022-04-14 21:43:09 main:574] : INFO : Epoch 745 | loss: 0.0311867 | val_loss: 0.0311915 | Time: 2216.41 ms
[2022-04-14 21:43:11 main:574] : INFO : Epoch 746 | loss: 0.0311902 | val_loss: 0.0311859 | Time: 2165.56 ms
[2022-04-14 21:43:13 main:574] : INFO : Epoch 747 | loss: 0.0311865 | val_loss: 0.0311869 | Time: 2165.7 ms
[2022-04-14 21:43:15 main:574] : INFO : Epoch 748 | loss: 0.0311858 | val_loss: 0.031196 | Time: 2182.12 ms
[2022-04-14 21:43:18 main:574] : INFO : Epoch 749 | loss: 0.0311858 | val_loss: 0.0311907 | Time: 2301.66 ms
[2022-04-14 21:43:20 main:574] : INFO : Epoch 750 | loss: 0.0311853 | val_loss: 0.0311908 | Time: 2172.73 ms
[2022-04-14 21:43:22 main:574] : INFO : Epoch 751 | loss: 0.0311825 | val_loss: 0.031183 | Time: 2179.44 ms
[2022-04-14 21:43:24 main:574] : INFO : Epoch 752 | loss: 0.0311783 | val_loss: 0.0311801 | Time: 2161.26 ms
[2022-04-14 21:43:26 main:574] : INFO : Epoch 753 | loss: 0.0311754 | val_loss: 0.0311796 | Time: 2238.33 ms
[2022-04-14 21:43:29 main:574] : INFO : Epoch 754 | loss: 0.031177 | val_loss: 0.031181 | Time: 2286.88 ms
[2022-04-14 21:43:31 main:574] : INFO : Epoch 755 | loss: 0.0311754 | val_loss: 0.0311798 | Time: 2254.94 ms
[2022-04-14 21:43:33 main:574] : INFO : Epoch 756 | loss: 0.0311741 | val_loss: 0.0311868 | Time: 2283.5 ms
[2022-04-14 21:43:36 main:574] : INFO : Epoch 757 | loss: 0.0311772 | val_loss: 0.0311814 | Time: 2276.4 ms
[2022-04-14 21:43:38 main:574] : INFO : Epoch 758 | loss: 0.0311771 | val_loss: 0.031188 | Time: 2272.08 ms
[2022-04-14 21:43:40 main:574] : INFO : Epoch 759 | loss: 0.031178 | val_loss: 0.0311798 | Time: 2271.1 ms
[2022-04-14 21:43:42 main:574] : INFO : Epoch 760 | loss: 0.0311742 | val_loss: 0.0311818 | Time: 2264.45 ms
[2022-04-14 21:43:45 main:574] : INFO : Epoch 761 | loss: 0.0311726 | val_loss: 0.0311806 | Time: 2252.01 ms
[2022-04-14 21:43:47 main:574] : INFO : Epoch 762 | loss: 0.0311721 | val_loss: 0.031183 | Time: 2280.72 ms
[2022-04-14 21:43:49 main:574] : INFO : Epoch 763 | loss: 0.0311712 | val_loss: 0.0311793 | Time: 2269.46 ms
[2022-04-14 21:43:52 main:574] : INFO : Epoch 764 | loss: 0.031169 | val_loss: 0.0311789 | Time: 2289.51 ms
[2022-04-14 21:43:54 main:574] : INFO : Epoch 765 | loss: 0.0311719 | val_loss: 0.0311795 | Time: 2274.61 ms
[2022-04-14 21:43:57 main:574] : INFO : Epoch 766 | loss: 0.0311723 | val_loss: 0.0311849 | Time: 2299.09 ms
[2022-04-14 21:44:00 main:574] : INFO : Epoch 767 | loss: 0.0311681 | val_loss: 0.0311792 | Time: 2276.63 ms
[2022-04-14 21:44:02 main:574] : INFO : Epoch 768 | loss: 0.031167 | val_loss: 0.0311821 | Time: 2180.71 ms
[2022-04-14 21:44:04 main:574] : INFO : Epoch 769 | loss: 0.0311703 | val_loss: 0.0311817 | Time: 2168.69 ms
[2022-04-14 21:44:06 main:574] : INFO : Epoch 770 | loss: 0.0311665 | val_loss: 0.0311833 | Time: 2225.22 ms
[2022-04-14 21:44:08 main:574] : INFO : Epoch 771 | loss: 0.0311663 | val_loss: 0.0311824 | Time: 2238.68 ms
[2022-04-14 21:44:11 main:574] : INFO : Epoch 772 | loss: 0.0311658 | val_loss: 0.031182 | Time: 2197.04 ms
[2022-04-14 21:44:13 main:574] : INFO : Epoch 773 | loss: 0.0311711 | val_loss: 0.0311885 | Time: 2170.78 ms
[2022-04-14 21:44:15 main:574] : INFO : Epoch 774 | loss: 0.0311675 | val_loss: 0.0311796 | Time: 2221.7 ms
[2022-04-14 21:44:18 main:574] : INFO : Epoch 775 | loss: 0.0311659 | val_loss: 0.0311846 | Time: 2273.07 ms
[2022-04-14 21:44:20 main:574] : INFO : Epoch 776 | loss: 0.0311653 | val_loss: 0.0311806 | Time: 2231.7 ms
[2022-04-14 21:44:22 main:574] : INFO : Epoch 777 | loss: 0.0311703 | val_loss: 0.0311879 | Time: 2148.03 ms
[2022-04-14 21:44:24 main:574] : INFO : Epoch 778 | loss: 0.0311693 | val_loss: 0.0311894 | Time: 2136.48 ms
[2022-04-14 21:44:26 main:574] : INFO : Epoch 779 | loss: 0.0311648 | val_loss: 0.0311796 | Time: 2251.26 ms
[2022-04-14 21:44:29 main:574] : INFO : Epoch 780 | loss: 0.0311675 | val_loss: 0.0311877 | Time: 2258.86 ms
[2022-04-14 21:44:31 main:574] : INFO : Epoch 781 | loss: 0.0311678 | val_loss: 0.0311855 | Time: 2176.57 ms
[2022-04-14 21:44:33 main:574] : INFO : Epoch 782 | loss: 0.0311639 | val_loss: 0.0311867 | Time: 2174.05 ms
[2022-04-14 21:44:35 main:574] : INFO : Epoch 783 | loss: 0.0311626 | val_loss: 0.0311827 | Time: 2198.63 ms
[2022-04-14 21:44:38 main:574] : INFO : Epoch 784 | loss: 0.0311618 | val_loss: 0.0311854 | Time: 2332.87 ms
[2022-04-14 21:44:40 main:574] : INFO : Epoch 785 | loss: 0.0311624 | val_loss: 0.031181 | Time: 2227.92 ms
[2022-04-14 21:44:42 main:574] : INFO : Epoch 786 | loss: 0.0311597 | val_loss: 0.0311816 | Time: 2202.67 ms
[2022-04-14 21:44:44 main:574] : INFO : Epoch 787 | loss: 0.0311652 | val_loss: 0.0311809 | Time: 2177.31 ms
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFFAAB24F69
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 04/14/22 21:44:47
Install Directory : C:\Program Files\BOINC\
Data Directory : C:\ProgramData\BOINC
Project Symstore :
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\0;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 0000000059820000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000ad190000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.1645 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : MicrosoftR WindowsR Operating System
Product Version : 10.0.19041.1645
ModLoad: 00000000acda0000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.1645 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : MicrosoftR WindowsR Operating System
Product Version : 10.0.19041.1645
ModLoad: 00000000aaaf0000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : MicrosoftR WindowsR Operating System
Product Version : 10.0.19041.1586
ModLoad: 00000000ab240000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.1645 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : MicrosoftR WindowsR Operating System
Product Version : 10.0.19041.1645
ModLoad: 00000000aaea0000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1586) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : MicrosoftR WindowsR Operating System
Product Version : 10.0.19041.1586
ModLoad: 00000000acc90000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.1202 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : MicrosoftR WindowsR Operating System
Product Version : 10.0.19041.1202
ModLoad: 00000000aa9e0000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : MicrosoftR WindowsR Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000aaed0000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : MicrosoftR WindowsR Operating System
Product Version : 10.0.19041.789
ModLoad: 00000000ab0c0000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : MicrosoftR WindowsR Operating System
Product Version : 10.0.19041.789
ModLoad: 0000000082cf0000 0000000000058000 C:\ProgramData\BOINC\slots\0\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000acfa0000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.1645 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : MicrosoftR WindowsR Operating System
Product Version : 10.0.19041.1645
ModLoad: 000000008f4b0000 000000000008d000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.28.29913.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\A01\_work\12\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.28.29913.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : MicrosoftR Visual StudioR
Product Version : 14.28.29913.0
ModLoad: 00000000abd50000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : MicrosoftR WindowsR Operating System
Product Version : 7.0.19041.546
ModLoad: 00000000a8610000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.867 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : MicrosoftR WindowsR Operating System
Product Version : 10.0.19041.867
ModLoad: 00000000abdf0000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.1586) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : MicrosoftR WindowsR Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000ab460000 0000000000125000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.1645 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : MicrosoftR WindowsR Operating System
Product Version : 10.0.19041.1645
ModLoad: 000000008f540000 000000000001a000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.28.29913.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\A01\_work\12\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.28.29913.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : MicrosoftR Visual StudioR
Product Version : 14.28.29913.0
ModLoad: 0000000090480000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.28.29913.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\A01\_work\12\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.28.29913.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : MicrosoftR Visual StudioR
Product Version : 14.28.29913.0
ModLoad: 000000003a230000 000000000abe7000 C:\ProgramData\BOINC\slots\0\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000635d0000 000000000020d000 C:\ProgramData\BOINC\slots\0\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 00000000632f0000 00000000002db000 C:\ProgramData\BOINC\slots\0\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000014300000 0000000024b49000 C:\ProgramData\BOINC\slots\0\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000082cb0000 0000000000040000 C:\ProgramData\BOINC\slots\0\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000082c60000 0000000000045000 C:\ProgramData\BOINC\slots\0\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000011250000 00000000030a5000 C:\ProgramData\BOINC\slots\0\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 000000000dd90000 00000000034b2000 C:\ProgramData\BOINC\slots\0\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 0000000099780000 0000000000010000 C:\ProgramData\BOINC\slots\0\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 00000000e9840000 000000000919f000 C:\ProgramData\BOINC\slots\0\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 00000000f29e0000 000000001b3a4000 C:\ProgramData\BOINC\slots\0\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 00000000e5ae0000 0000000003d5b000 C:\ProgramData\BOINC\slots\0\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 0000000052b10000 0000000001eca000 C:\ProgramData\BOINC\slots\0\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000accc0000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : MicrosoftR WindowsR Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000a9140000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : MicrosoftR WindowsR Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000ab740000 0000000000470000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.1645 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : MicrosoftR WindowsR Operating System
Product Version : 10.0.19041.1645
ModLoad: 00000000aadc0000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : MicrosoftR WindowsR Operating System
Product Version : 10.0.19041.1151
ModLoad: 00000000aafe0000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.1645 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : MicrosoftR WindowsR Operating System
Product Version : 10.0.19041.1645
ModLoad: 00000000aa620000 0000000000033000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : MicrosoftR WindowsR Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000aaf70000 0000000000068000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : MicrosoftR WindowsR Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000aa880000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.1645 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : MicrosoftR WindowsR Operating System
Product Version : 10.0.19041.1645
ModLoad: 00000000aa460000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : MicrosoftR WindowsR Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000ac420000 0000000000744000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.1645 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : MicrosoftR WindowsR Operating System
Product Version : 10.0.19041.1645
ModLoad: 00000000a8950000 0000000000794000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.1645 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : MicrosoftR WindowsR Operating System
Product Version : 10.0.19041.1645
ModLoad: 00000000abf70000 0000000000354000 C:\WINDOWS\System32\combase.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.1645 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : MicrosoftR WindowsR Operating System
Product Version : 10.0.19041.1645
ModLoad: 00000000aa2e0000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.1645 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : MicrosoftR WindowsR Operating System
Product Version : 10.0.19041.1645
ModLoad: 00000000accf0000 00000000000ad000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.1645 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : MicrosoftR WindowsR Operating System
Product Version : 10.0.19041.1645
ModLoad: 00000000ab3e0000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.1645 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : MicrosoftR WindowsR Operating System
Product Version : 10.0.19041.1645
ModLoad: 000000005bc40000 00000000002cd000 C:\WINDOWS\system32\nvcuda.dll (30.0.15.1165) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_37\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 30.0.15.1165
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.6.99 driver
Product Version : 30.0.15.1165
ModLoad: 000000005a5a0000 00000000016a0000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispsi.inf_amd64_145fe9c72c40de0a\nvcuda64.dll (30.0.15.1165) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_37\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 30.0.15.1165
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.6.99 driver
Product Version : 30.0.15.1165
ModLoad: 00000000a39d0000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : MicrosoftR WindowsR Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000a38e0000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.906 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : MicrosoftR WindowsR Operating System
Product Version : 10.0.19041.906
ModLoad: 00000000a1ed0000 0000000000148000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : drvstore.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : MicrosoftR WindowsR Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000aa250000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : MicrosoftR WindowsR Operating System
Product Version : 10.0.19041.546
ModLoad: 000000009df80000 0000000000768000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.15.1165) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_37\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 30.0.15.1165
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 30.0.15.1165
ModLoad: 00000000a6020000 0000000000009000 C:\ProgramData\BOINC\slots\0\caffe2_nvrtc.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000051b40000 0000000000fca000 C:\ProgramData\BOINC\slots\0\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6.14.11.9000
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.89 NVRTC Library
Product Version : 6.14.11.9000
ModLoad: 00000000aae10000 0000000000082000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.1415 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : MicrosoftR WindowsR Operating System
Product Version : 10.0.19041.1415
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 4411, Write: 3054, Other 14506
- I/O Transfers Counters -
Read: 9860070, Write: 745002, Other 83006
- Paged Pool Usage -
QuotaPagedPoolUsage: 3505800, QuotaPeakPagedPoolUsage: 3522184
QuotaNonPagedPoolUsage: 51944, QuotaPeakNonPagedPoolUsage: 52080
- Virtual Memory Usage -
VirtualSize: -411807744, PeakVirtualSize: 198103040
- Pagefile Usage -
PagefileUsage: -411807744, PeakPagefileUsage: -411275264
- Working Set Size -
WorkingSetSize: 1706516480, PeakWorkingSetSize: 1748451328, PageFaultCount: 627363
*** Dump of thread ID 14176 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 325781248.000000, User Time: 11144843264.000000, Wait Time: 63441056.000000
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFFAAB24F69
- Registers -
rax=0000000000000020 rbx=0000000017d7b320 rcx=000000002fca03e0 rdx=00000000170d0000 rsi=00000000f5bc44c0 rdi=0000000019930520
r8=0000000056660000 r9=000000008b25d000 r10=0000000082d0f630 r11=000000008b25d000 r12=000000000f01e200 r13=0000000012600000
r14=000000000f014800 r15=0000000000633450 rip=00000000aab24f69 rsp=00000000f5bc3fe0 rbp=00000000f5bc4250
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202
- Callstack -
ChildEBP RetAddr Args to Child
f5bc40b0 8f546480 17b51fc8 17b517f0 00000312 00000000 KERNELBASE!RaiseException+0x0
f5bc4110 17079724 17b4dbb8 11200000 f5bc42b8 10b00000 VCRUNTIME140!_CxxThrowException+0x0
f5bc45f0 170d25ea f5bc46b8 00000001 f5bc46b8 00000001 torch_cuda!at::native::_cudnn_rnn+0x0
f5bc46d0 170e0cbf f5bc4dc0 f5bc65c8 f5bc5710 ad1bb86b torch_cuda!at::native::set_storage_cuda_+0x0
f5bc47b0 3fc7b9fc f5bc4dc0 00000000 8b25db30 8b25db00 torch_cuda!at::native::set_storage_cuda_+0x0
f5bc4930 3fcb31a2 00000001 414267c2 f5bc4964 ad1bb86b torch_cpu!at::native::mkldnn_sigmoid_+0x0
f5bc4c10 40f62613 00000000 00000000 00000003 894f8f48 torch_cpu!at::_cudnn_rnn+0x0
f5bc5110 40f7080b 767d0dc2 9a9850b0 f5bc5240 00000004 torch_cpu!torch::autograd::NotImplemented::~NotImplemented+0x0
f5bc51f0 3fc7b9fc f5bc5770 41095878 f5bc5350 5a5c7a77 torch_cpu!torch::autograd::GraphRoot::apply+0x0
f5bc5370 3fcb31a2 9bd30950 00000000 767d1052 17f9a3f0 torch_cpu!at::native::mkldnn_sigmoid_+0x0
f5bc5650 170769a1 f5bc0001 00000001 00000004 00000004 torch_cpu!at::_cudnn_rnn+0x0
f5bc5820 17080117 00000000 f5bc65c8 82c62e0d f5bc5940 torch_cuda!at::native::_use_cudnn_ctc_loss+0x0
f5bc58b0 3fa0107b 44b51ac0 f5bc5bd0 b1bc2484 5a797783 torch_cuda!at::native::_cudnn_rnn_flatten_weight+0x0
f5bc5b20 3fa33b16 00000001 f5bc65c8 00000080 29214ca8 torch_cpu!at::native::fbgemm_pack_quantized_matrix+0x0
f5bc5cb0 3fdaae89 f5bc5d28 00000001 f5bc5d28 00000001 torch_cpu!at::native::gru+0x0
f5bc5d40 41099fa3 f5bc5e40 00000001 f5bc5fc0 f5bc65c8 torch_cpu!at::zeros_out+0x0
f5bc5dd0 3fd9dd35 82d41ea8 5800f460 00000000 82d41ea8 torch_cpu!torch::autograd::GraphRoot::apply+0x0
f5bc5e50 3fc788ec 44b575c8 3159cb00 9f295d50 f5bc6070 torch_cpu!at::zeros_out+0x0
f5bc5f50 3fcec1bb 0000000c 00000080 00000004 9a984700 torch_cpu!at::native::mkldnn_sigmoid_+0x0
f5bc5fd0 417d7294 f5bc60f0 3159cb00 f5bc60e0 f5bc6288 torch_cpu!at::gru+0x0
f5bc6200 417d62ab f5bc65a0 3fc0030e f5bc65a0 f5bc65c8 torch_cpu!torch::nn::GRUImpl::forward_helper+0x0
f5bc62f0 59832621 0000000c f5bc7000 00000000 82d41ea8 torch_cpu!torch::nn::GRUImpl::forward+0x0
f5bc64f0 5983705a 00000000 f5bc0000 f5bc0601 0000000c mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::error+0x0
f5bc69f0 5983b950 f5bc6af0 f5bc6af0 00000000 11bef680 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0
f5bdf790 59a7c6f8 584a03b0 00000000 00000000 580e7d00 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
f5bdf7d0 acdb7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
f5bdf800 ad1e2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
f5bdf880 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 14776 (state: Waiting): ***
- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 63441056.000000
- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000f62ffe20 rsi=0000000000000000 rdi=0000000000000064
r8=00000000f62ffdf8 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000ad22d3f4 rsp=00000000f62ffdf8 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
f62ffdf0 aab3962e f62ffeb8 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0
f62ffe90 5985a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0
f62ffec0 acdb7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
f62ffef0 ad1e2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
f62fff70 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 15696 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 63441056.000000
- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=00000000f63ff410 rsi=0000000000000000 rdi=000000000000000d
r8=00000000f63ff0b8 r9=0000000000000000 r10=0000000000000000 r11=00000000f63ff380 r12=0000000000000064 r13=00000000f63ff410
r14=00000000f63ff110 r15=0000000000000000 rip=00000000ad22d8c4 rsp=00000000f63ff0b8 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
f63ff0b0 aab3cb20 00000000 f5d4c000 ad2fa4d0 f5d4c000 ntdll!ZwWaitForMultipleObjects+0x0
f63ff3a0 aab3ca1e 566c2e20 004e0049 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
f63ff3e0 5a77d554 586b58b0 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0
f63ff620 5a8258cd 00000000 586b28b0 00000000 00000000 nvcuda64!+0x0
f63ff6d0 5a77cf23 fe4a73b5 fd5c22bf 58fadcf0 00000000 nvcuda64!cuProfilerStop+0x0
f63ff700 5aab44c4 58fadcf0 00000000 00000000 00000000 nvcuda64!+0x0
f63ff730 acdb7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
f63ff760 ad1e2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
f63ff7e0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 16028 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 63308080.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=0000000000000304 rdx=0000000000000000 rsi=0000000000000000 rdi=0000000000000304
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=00000000586799b0 r13=0000000000000000
r14=0000000000000304 r15=0000000000000000 rip=00000000ad22cdf4 rsp=00000000f64ff628 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
f64ff620 aab11a5e 00000000 00001f80 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0
f64ff6c0 5a9a5d0e 58453c50 00000000 00000000 00000304 KERNELBASE!WaitForSingleObjectEx+0x0
f64ff900 5a77cf23 00000000 58453c50 5a5a0000 586ee6f0 nvcuda64!cuProfilerStop+0x0
f64ff930 5aab44c4 58453c50 00000000 00000000 00000000 nvcuda64!+0x0
f64ff960 acdb7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
f64ff990 ad1e2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
f64ffa10 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 11480 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 365312512.000000, User Time: 5682500096.000000, Wait Time: 63441020.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=0000000088047388 rdx=0000000000000000 rsi=0000000000000000 rdi=0000000088047388
r8=00000000181665e8 r9=0000000000000001 r10=0000000000008000 r11=00000000000000ff r12=0000000000000000 r13=0000000000000000
r14=00000000f65ff7f0 r15=0000000088047338 rip=00000000ad230764 rsp=00000000f65ff7c8 rbp=00000000f65ff820
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
f65ff7c0 ad1f4021 f65ffac0 00000000 f65ff8c0 00000000 ntdll!NtWaitForAlertByThreadId+0x0
f65ff840 aab5cfa9 88047380 88047378 88047330 414105b4 ntdll!RtlSleepConditionVariableSRW+0x0
f65ff880 8f4c2549 00000000 9b1e4dc0 00000000 00000000 KERNELBASE!SleepConditionVariableSRW+0x0
f65ff8b0 8f4c27da c70c4a88 00000000 f65ffac0 88047378 MSVCP140!std::_Winerror_message+0x0
f65ff8e0 4141064b 88047330 f65ff9e0 88047330 9b1e4da0 MSVCP140!_Cnd_wait+0x0
f65ff920 414125b1 9fdc01a0 ffffffff 9b1e4da0 ffffffff torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
f65ffc10 41412471 44936d10 f65ffc50 44936d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0
f65ffc60 41409744 00080001 9f578930 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0
f65ffc90 ab0e1bb2 9f578930 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0
f65ffcc0 acdb7034 00000000 00000000 00000000 00000000 ucrtbase!_configthreadlocale+0x0
f65ffcf0 ad1e2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
f65ffd70 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 9712 (state: Waiting): ***
- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 63441024.000000
- Registers -
rax=00000000000001d3 rbx=0000000024122200 rcx=0000000000000080 rdx=0000000024121e80 rsi=00000000566b32e0 rdi=0000000024122200
r8=0000000000000008 r9=0000000000000020 r10=0000000000000000 r11=00000000f5effa40 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000ad2307c4 rsp=00000000f5effb68 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
f5effb60 ad1e2dc7 00000000 00000000 566b32e0 00000000 ntdll!ZwWaitForWorkViaWorkerFactory+0x0
f5effe60 acdb7034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0
f5effe90 ad1e2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
f5efff10 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)