Task 3470781
| Name | ParityModified-1609263759-2819-0_0 |
| Workunit | 1708726 |
| Created | 29 Dec 2020, 17:42:42 UTC |
| Sent | 4 Jan 2021, 15:57:51 UTC |
| Report deadline | 12 Jan 2021, 15:57:51 UTC |
| Received | 4 Jan 2021, 16:23:02 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | -529697949 (0xE06D7363) Unknown error code |
| Computer ID | 6527 |
| Run time | 23 min 57 sec |
| CPU time | 23 min 49 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 4,377.67 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.64 GB |
| Peak swap size | 3.62 GB |
| Peak disk usage | 1.53 GB |
Stderr output
<core_client_version>7.14.2</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code -529697949 (0xe06d7363)</message>
<stderr_txt>
Epoch 529 | loss: 0.0309999 | val_loss: 0.0313201 | Time: 1918.24 ms
[2021-01-04 10:14:41 main:574] : INFO : Epoch 530 | loss: 0.0309945 | val_loss: 0.0313703 | Time: 1804.16 ms
[2021-01-04 10:14:43 main:574] : INFO : Epoch 531 | loss: 0.0309903 | val_loss: 0.0313423 | Time: 1850.73 ms
[2021-01-04 10:14:45 main:574] : INFO : Epoch 532 | loss: 0.0309979 | val_loss: 0.0313742 | Time: 1840.38 ms
[2021-01-04 10:14:46 main:574] : INFO : Epoch 533 | loss: 0.0310073 | val_loss: 0.0313022 | Time: 1840.55 ms
[2021-01-04 10:14:48 main:574] : INFO : Epoch 534 | loss: 0.0309984 | val_loss: 0.0313527 | Time: 1860.2 ms
[2021-01-04 10:14:50 main:574] : INFO : Epoch 535 | loss: 0.0309915 | val_loss: 0.0313012 | Time: 1867.31 ms
[2021-01-04 10:14:52 main:574] : INFO : Epoch 536 | loss: 0.0309911 | val_loss: 0.0313441 | Time: 1840.94 ms
[2021-01-04 10:14:54 main:574] : INFO : Epoch 537 | loss: 0.0309924 | val_loss: 0.0313609 | Time: 1887.96 ms
[2021-01-04 10:14:56 main:574] : INFO : Epoch 538 | loss: 0.0309939 | val_loss: 0.0313311 | Time: 1872.05 ms
[2021-01-04 10:14:58 main:574] : INFO : Epoch 539 | loss: 0.0309908 | val_loss: 0.0313364 | Time: 1851.14 ms
[2021-01-04 10:15:00 main:574] : INFO : Epoch 540 | loss: 0.0309943 | val_loss: 0.0313328 | Time: 1867.1 ms
[2021-01-04 10:15:01 main:574] : INFO : Epoch 541 | loss: 0.0310042 | val_loss: 0.0313338 | Time: 1880.2 ms
[2021-01-04 10:15:03 main:574] : INFO : Epoch 542 | loss: 0.0310086 | val_loss: 0.031353 | Time: 1900.5 ms
[2021-01-04 10:15:05 main:574] : INFO : Epoch 543 | loss: 0.0309941 | val_loss: 0.0313327 | Time: 1832.98 ms
[2021-01-04 10:15:07 main:574] : INFO : Epoch 544 | loss: 0.0309904 | val_loss: 0.0313232 | Time: 1877.28 ms
[2021-01-04 10:15:09 main:574] : INFO : Epoch 545 | loss: 0.0309947 | val_loss: 0.0313565 | Time: 1895.03 ms
[2021-01-04 10:15:11 main:574] : INFO : Epoch 546 | loss: 0.030995 | val_loss: 0.0313641 | Time: 1882.15 ms
[2021-01-04 10:15:13 main:574] : INFO : Epoch 547 | loss: 0.0309928 | val_loss: 0.0313581 | Time: 1854.84 ms
[2021-01-04 10:15:15 main:574] : INFO : Epoch 548 | loss: 0.0309999 | val_loss: 0.0313108 | Time: 1842.73 ms
[2021-01-04 10:15:16 main:574] : INFO : Epoch 549 | loss: 0.0309994 | val_loss: 0.0312991 | Time: 1886.1 ms
[2021-01-04 10:15:18 main:574] : INFO : Epoch 550 | loss: 0.0309993 | val_loss: 0.0313444 | Time: 1888.55 ms
[2021-01-04 10:15:20 main:574] : INFO : Epoch 551 | loss: 0.0309946 | val_loss: 0.0313397 | Time: 1887.01 ms
[2021-01-04 10:15:22 main:574] : INFO : Epoch 552 | loss: 0.030991 | val_loss: 0.0313421 | Time: 1875.33 ms
[2021-01-04 10:15:24 main:574] : INFO : Epoch 553 | loss: 0.0309911 | val_loss: 0.0313146 | Time: 1886.07 ms
[2021-01-04 10:15:26 main:574] : INFO : Epoch 554 | loss: 0.0309937 | val_loss: 0.0313218 | Time: 1879.4 ms
[2021-01-04 10:15:28 main:574] : INFO : Epoch 555 | loss: 0.0309907 | val_loss: 0.0313517 | Time: 1851.44 ms
[2021-01-04 10:15:30 main:574] : INFO : Epoch 556 | loss: 0.030992 | val_loss: 0.0313386 | Time: 1860.43 ms
[2021-01-04 10:15:32 main:574] : INFO : Epoch 557 | loss: 0.0309964 | val_loss: 0.0313466 | Time: 1908.22 ms
[2021-01-04 10:15:33 main:574] : INFO : Epoch 558 | loss: 0.0309875 | val_loss: 0.0313467 | Time: 1898.77 ms
[2021-01-04 10:15:35 main:574] : INFO : Epoch 559 | loss: 0.0309939 | val_loss: 0.0313292 | Time: 1876.36 ms
[2021-01-04 10:15:37 main:574] : INFO : Epoch 560 | loss: 0.0309926 | val_loss: 0.0313843 | Time: 1877.23 ms
[2021-01-04 10:15:39 main:574] : INFO : Epoch 561 | loss: 0.0309997 | val_loss: 0.0313353 | Time: 1930.28 ms
[2021-01-04 10:15:41 main:574] : INFO : Epoch 562 | loss: 0.0310007 | val_loss: 0.0313262 | Time: 1901.5 ms
[2021-01-04 10:15:43 main:574] : INFO : Epoch 563 | loss: 0.0309888 | val_loss: 0.0313431 | Time: 1860.83 ms
[2021-01-04 10:15:45 main:574] : INFO : Epoch 564 | loss: 0.0309894 | val_loss: 0.0313407 | Time: 1878.99 ms
[2021-01-04 10:15:47 main:574] : INFO : Epoch 565 | loss: 0.0309904 | val_loss: 0.0313308 | Time: 1911.91 ms
[2021-01-04 10:15:49 main:574] : INFO : Epoch 566 | loss: 0.0309904 | val_loss: 0.0313413 | Time: 1860.63 ms
[2021-01-04 10:15:50 main:574] : INFO : Epoch 567 | loss: 0.0310003 | val_loss: 0.0313261 | Time: 1867.24 ms
[2021-01-04 10:15:52 main:574] : INFO : Epoch 568 | loss: 0.0309989 | val_loss: 0.031317 | Time: 1879.92 ms
[2021-01-04 10:15:54 main:574] : INFO : Epoch 569 | loss: 0.0310006 | val_loss: 0.0313375 | Time: 1869.19 ms
[2021-01-04 10:15:56 main:574] : INFO : Epoch 570 | loss: 0.0310011 | val_loss: 0.0313534 | Time: 1852.07 ms
[2021-01-04 10:15:58 main:574] : INFO : Epoch 571 | loss: 0.0309932 | val_loss: 0.0313356 | Time: 1867.82 ms
[2021-01-04 10:16:00 main:574] : INFO : Epoch 572 | loss: 0.0309945 | val_loss: 0.0313342 | Time: 1846.89 ms
[2021-01-04 10:16:02 main:574] : INFO : Epoch 573 | loss: 0.0309938 | val_loss: 0.0313425 | Time: 1863.83 ms
[2021-01-04 10:16:04 main:574] : INFO : Epoch 574 | loss: 0.0309909 | val_loss: 0.0313256 | Time: 1820.76 ms
[2021-01-04 10:16:05 main:574] : INFO : Epoch 575 | loss: 0.0309982 | val_loss: 0.0313511 | Time: 1841.79 ms
[2021-01-04 10:16:07 main:574] : INFO : Epoch 576 | loss: 0.0309915 | val_loss: 0.0313269 | Time: 1849.67 ms
[2021-01-04 10:16:09 main:574] : INFO : Epoch 577 | loss: 0.0309887 | val_loss: 0.0313309 | Time: 1903.68 ms
[2021-01-04 10:16:11 main:574] : INFO : Epoch 578 | loss: 0.0309981 | val_loss: 0.0313582 | Time: 1868.27 ms
[2021-01-04 10:16:13 main:574] : INFO : Epoch 579 | loss: 0.0309912 | val_loss: 0.0313358 | Time: 1888.43 ms
[2021-01-04 10:16:15 main:574] : INFO : Epoch 580 | loss: 0.0309938 | val_loss: 0.0313703 | Time: 1852.75 ms
[2021-01-04 10:16:17 main:574] : INFO : Epoch 581 | loss: 0.0309949 | val_loss: 0.031323 | Time: 1822.11 ms
[2021-01-04 10:16:18 main:574] : INFO : Epoch 582 | loss: 0.0309896 | val_loss: 0.0313428 | Time: 1888.6 ms
[2021-01-04 10:16:20 main:574] : INFO : Epoch 583 | loss: 0.0309943 | val_loss: 0.031318 | Time: 1852.95 ms
[2021-01-04 10:16:22 main:574] : INFO : Epoch 584 | loss: 0.0309908 | val_loss: 0.0313633 | Time: 1856.45 ms
[2021-01-04 10:16:24 main:574] : INFO : Epoch 585 | loss: 0.0309857 | val_loss: 0.0313393 | Time: 1877.95 ms
[2021-01-04 10:16:26 main:574] : INFO : Epoch 586 | loss: 0.0309864 | val_loss: 0.0313348 | Time: 1898.49 ms
[2021-01-04 10:16:28 main:574] : INFO : Epoch 587 | loss: 0.0309909 | val_loss: 0.0313234 | Time: 1907.41 ms
[2021-01-04 10:16:30 main:574] : INFO : Epoch 588 | loss: 0.0309935 | val_loss: 0.0313651 | Time: 1900.81 ms
[2021-01-04 10:16:32 main:574] : INFO : Epoch 589 | loss: 0.0309981 | val_loss: 0.0313335 | Time: 1954.86 ms
[2021-01-04 10:16:34 main:574] : INFO : Epoch 590 | loss: 0.0309884 | val_loss: 0.0313263 | Time: 1880.47 ms
[2021-01-04 10:16:36 main:574] : INFO : Epoch 591 | loss: 0.030992 | val_loss: 0.0313311 | Time: 1905.17 ms
[2021-01-04 10:16:37 main:574] : INFO : Epoch 592 | loss: 0.0309883 | val_loss: 0.0313531 | Time: 1881.7 ms
[2021-01-04 10:16:39 main:574] : INFO : Epoch 593 | loss: 0.0309937 | val_loss: 0.0313616 | Time: 1940.92 ms
[2021-01-04 10:16:41 main:574] : INFO : Epoch 594 | loss: 0.0309899 | val_loss: 0.031329 | Time: 1892.02 ms
[2021-01-04 10:16:43 main:574] : INFO : Epoch 595 | loss: 0.0309868 | val_loss: 0.0313192 | Time: 1954.79 ms
[2021-01-04 10:16:45 main:574] : INFO : Epoch 596 | loss: 0.0309951 | val_loss: 0.0313077 | Time: 1930.39 ms
[2021-01-04 10:16:47 main:574] : INFO : Epoch 597 | loss: 0.0310066 | val_loss: 0.0313238 | Time: 1941.29 ms
[2021-01-04 10:16:49 main:574] : INFO : Epoch 598 | loss: 0.0310102 | val_loss: 0.0313347 | Time: 1874.42 ms
[2021-01-04 10:16:51 main:574] : INFO : Epoch 599 | loss: 0.0309962 | val_loss: 0.0313406 | Time: 1934.78 ms
[2021-01-04 10:16:53 main:574] : INFO : Epoch 600 | loss: 0.0309967 | val_loss: 0.0313403 | Time: 1933.68 ms
[2021-01-04 10:16:55 main:574] : INFO : Epoch 601 | loss: 0.030993 | val_loss: 0.0312955 | Time: 1917.01 ms
[2021-01-04 10:16:57 main:574] : INFO : Epoch 602 | loss: 0.0309968 | val_loss: 0.031345 | Time: 1926.09 ms
[2021-01-04 10:16:59 main:574] : INFO : Epoch 603 | loss: 0.0309869 | val_loss: 0.0313413 | Time: 1907.98 ms
[2021-01-04 10:17:01 main:574] : INFO : Epoch 604 | loss: 0.0309986 | val_loss: 0.0313698 | Time: 1905.39 ms
[2021-01-04 10:17:03 main:574] : INFO : Epoch 605 | loss: 0.0309905 | val_loss: 0.0313332 | Time: 1886.79 ms
[2021-01-04 10:17:04 main:574] : INFO : Epoch 606 | loss: 0.0309877 | val_loss: 0.0313351 | Time: 1864.96 ms
[2021-01-04 10:17:06 main:574] : INFO : Epoch 607 | loss: 0.0309937 | val_loss: 0.0313593 | Time: 1927.4 ms
[2021-01-04 10:17:08 main:574] : INFO : Epoch 608 | loss: 0.0309968 | val_loss: 0.0313224 | Time: 1954.31 ms
[2021-01-04 10:17:10 main:574] : INFO : Epoch 609 | loss: 0.0309927 | val_loss: 0.0313343 | Time: 1887.22 ms
[2021-01-04 10:17:12 main:574] : INFO : Epoch 610 | loss: 0.0309965 | val_loss: 0.0313218 | Time: 1900.14 ms
[2021-01-04 10:17:14 main:574] : INFO : Epoch 611 | loss: 0.0309945 | val_loss: 0.0313308 | Time: 1925.63 ms
[2021-01-04 10:17:16 main:574] : INFO : Epoch 612 | loss: 0.0309848 | val_loss: 0.0313238 | Time: 1890.27 ms
[2021-01-04 10:17:18 main:574] : INFO : Epoch 613 | loss: 0.0309928 | val_loss: 0.0313279 | Time: 1882.07 ms
[2021-01-04 10:17:20 main:574] : INFO : Epoch 614 | loss: 0.0309976 | val_loss: 0.0313249 | Time: 1933.12 ms
[2021-01-04 10:17:22 main:574] : INFO : Epoch 615 | loss: 0.0309945 | val_loss: 0.0313319 | Time: 1942.06 ms
[2021-01-04 10:17:24 main:574] : INFO : Epoch 616 | loss: 0.030989 | val_loss: 0.0313228 | Time: 1879.11 ms
[2021-01-04 10:17:25 main:574] : INFO : Epoch 617 | loss: 0.0309898 | val_loss: 0.0313331 | Time: 1913.91 ms
[2021-01-04 10:17:27 main:574] : INFO : Epoch 618 | loss: 0.0309892 | val_loss: 0.0313493 | Time: 1922.22 ms
[2021-01-04 10:17:29 main:574] : INFO : Epoch 619 | loss: 0.0309906 | val_loss: 0.0313255 | Time: 1957.35 ms
[2021-01-04 10:17:31 main:574] : INFO : Epoch 620 | loss: 0.0309883 | val_loss: 0.0313158 | Time: 1882.57 ms
[2021-01-04 10:17:33 main:574] : INFO : Epoch 621 | loss: 0.0309915 | val_loss: 0.0313461 | Time: 1926.96 ms
[2021-01-04 10:17:35 main:574] : INFO : Epoch 622 | loss: 0.0309912 | val_loss: 0.0313758 | Time: 1871.25 ms
[2021-01-04 10:17:37 main:574] : INFO : Epoch 623 | loss: 0.0309962 | val_loss: 0.0313528 | Time: 1913.85 ms
[2021-01-04 10:17:39 main:574] : INFO : Epoch 624 | loss: 0.0309904 | val_loss: 0.0313595 | Time: 1890.92 ms
[2021-01-04 10:17:41 main:574] : INFO : Epoch 625 | loss: 0.0309896 | val_loss: 0.0313148 | Time: 1865.05 ms
[2021-01-04 10:17:43 main:574] : INFO : Epoch 626 | loss: 0.0309903 | val_loss: 0.0313366 | Time: 1829.65 ms
[2021-01-04 10:17:44 main:574] : INFO : Epoch 627 | loss: 0.0309908 | val_loss: 0.0313744 | Time: 1852.5 ms
[2021-01-04 10:17:46 main:574] : INFO : Epoch 628 | loss: 0.0309959 | val_loss: 0.03133 | Time: 1840.56 ms
[2021-01-04 10:17:48 main:574] : INFO : Epoch 629 | loss: 0.0310027 | val_loss: 0.0313076 | Time: 1841.9 ms
[2021-01-04 10:17:50 main:574] : INFO : Epoch 630 | loss: 0.0309993 | val_loss: 0.0313305 | Time: 1880.51 ms
[2021-01-04 10:17:52 main:574] : INFO : Epoch 631 | loss: 0.031001 | val_loss: 0.0313825 | Time: 1843.58 ms
[2021-01-04 10:17:54 main:574] : INFO : Epoch 632 | loss: 0.0309969 | val_loss: 0.0313454 | Time: 1862.49 ms
[2021-01-04 10:17:56 main:574] : INFO : Epoch 633 | loss: 0.0309954 | val_loss: 0.0313603 | Time: 1883.07 ms
[2021-01-04 10:17:58 main:574] : INFO : Epoch 634 | loss: 0.0309895 | val_loss: 0.0313465 | Time: 1854.65 ms
[2021-01-04 10:17:59 main:574] : INFO : Epoch 635 | loss: 0.0309921 | val_loss: 0.0313278 | Time: 1872.51 ms
[2021-01-04 10:18:01 main:574] : INFO : Epoch 636 | loss: 0.0309919 | val_loss: 0.0313245 | Time: 1878.64 ms
[2021-01-04 10:18:03 main:574] : INFO : Epoch 637 | loss: 0.0310018 | val_loss: 0.0313273 | Time: 1891.39 ms
[2021-01-04 10:18:05 main:574] : INFO : Epoch 638 | loss: 0.0309963 | val_loss: 0.0313176 | Time: 1807.88 ms
[2021-01-04 10:18:07 main:574] : INFO : Epoch 639 | loss: 0.031 | val_loss: 0.0313279 | Time: 1908.32 ms
[2021-01-04 10:18:09 main:574] : INFO : Epoch 640 | loss: 0.0309982 | val_loss: 0.0313509 | Time: 1883.28 ms
[2021-01-04 10:18:11 main:574] : INFO : Epoch 641 | loss: 0.0309982 | val_loss: 0.0313499 | Time: 1886.43 ms
[2021-01-04 10:18:13 main:574] : INFO : Epoch 642 | loss: 0.0309949 | val_loss: 0.0313094 | Time: 1867.18 ms
[2021-01-04 10:18:14 main:574] : INFO : Epoch 643 | loss: 0.0310223 | val_loss: 0.0312961 | Time: 1853.2 ms
[2021-01-04 10:18:16 main:574] : INFO : Epoch 644 | loss: 0.0310068 | val_loss: 0.0313438 | Time: 1849.98 ms
[2021-01-04 10:18:18 main:574] : INFO : Epoch 645 | loss: 0.0309972 | val_loss: 0.0313272 | Time: 1900.98 ms
[2021-01-04 10:18:20 main:574] : INFO : Epoch 646 | loss: 0.0309881 | val_loss: 0.0313451 | Time: 1882.74 ms
[2021-01-04 10:18:22 main:574] : INFO : Epoch 647 | loss: 0.0309872 | val_loss: 0.0313369 | Time: 1862.23 ms
[2021-01-04 10:18:24 main:574] : INFO : Epoch 648 | loss: 0.030989 | val_loss: 0.0313374 | Time: 1920.09 ms
[2021-01-04 10:18:26 main:574] : INFO : Epoch 649 | loss: 0.0309872 | val_loss: 0.0313294 | Time: 1881.92 ms
[2021-01-04 10:18:28 main:574] : INFO : Epoch 650 | loss: 0.0309876 | val_loss: 0.0313398 | Time: 1911.13 ms
[2021-01-04 10:18:30 main:574] : INFO : Epoch 651 | loss: 0.0309849 | val_loss: 0.0313329 | Time: 1910.04 ms
[2021-01-04 10:18:31 main:574] : INFO : Epoch 652 | loss: 0.030991 | val_loss: 0.0313383 | Time: 1876.72 ms
[2021-01-04 10:18:33 main:574] : INFO : Epoch 653 | loss: 0.0309995 | val_loss: 0.0313177 | Time: 1922.92 ms
[2021-01-04 10:18:35 main:574] : INFO : Epoch 654 | loss: 0.0310155 | val_loss: 0.0313467 | Time: 1863.25 ms
[2021-01-04 10:18:37 main:574] : INFO : Epoch 655 | loss: 0.0310038 | val_loss: 0.0313127 | Time: 1844.07 ms
[2021-01-04 10:18:39 main:574] : INFO : Epoch 656 | loss: 0.0309905 | val_loss: 0.0313427 | Time: 1843.85 ms
[2021-01-04 10:18:41 main:574] : INFO : Epoch 657 | loss: 0.0309856 | val_loss: 0.0313649 | Time: 1887.24 ms
[2021-01-04 10:18:43 main:574] : INFO : Epoch 658 | loss: 0.0309895 | val_loss: 0.0313803 | Time: 1914.19 ms
[2021-01-04 10:18:45 main:574] : INFO : Epoch 659 | loss: 0.0309932 | val_loss: 0.0313207 | Time: 1874.3 ms
[2021-01-04 10:18:47 main:574] : INFO : Epoch 660 | loss: 0.0309903 | val_loss: 0.0313195 | Time: 1869.2 ms
[2021-01-04 10:18:48 main:574] : INFO : Epoch 661 | loss: 0.0309893 | val_loss: 0.0313414 | Time: 1843.9 ms
[2021-01-04 10:18:50 main:574] : INFO : Epoch 662 | loss: 0.0309847 | val_loss: 0.0313459 | Time: 1875.6 ms
[2021-01-04 10:18:52 main:574] : INFO : Epoch 663 | loss: 0.0309906 | val_loss: 0.0313194 | Time: 1814.8 ms
[2021-01-04 10:18:54 main:574] : INFO : Epoch 664 | loss: 0.0309899 | val_loss: 0.0313378 | Time: 1824.62 ms
[2021-01-04 10:18:56 main:574] : INFO : Epoch 665 | loss: 0.0309942 | val_loss: 0.031383 | Time: 1907.18 ms
[2021-01-04 10:18:58 main:574] : INFO : Epoch 666 | loss: 0.0310032 | val_loss: 0.0313547 | Time: 1833.54 ms
[2021-01-04 10:19:00 main:574] : INFO : Epoch 667 | loss: 0.0309977 | val_loss: 0.0313234 | Time: 1898.37 ms
[2021-01-04 10:19:01 main:574] : INFO : Epoch 668 | loss: 0.0309899 | val_loss: 0.031329 | Time: 1830.03 ms
[2021-01-04 10:19:03 main:574] : INFO : Epoch 669 | loss: 0.030989 | val_loss: 0.0313526 | Time: 1846.18 ms
[2021-01-04 10:19:05 main:574] : INFO : Epoch 670 | loss: 0.0309965 | val_loss: 0.0312972 | Time: 1845.3 ms
[2021-01-04 10:19:07 main:574] : INFO : Epoch 671 | loss: 0.0310086 | val_loss: 0.0312931 | Time: 1874.36 ms
[2021-01-04 10:19:09 main:574] : INFO : Epoch 672 | loss: 0.0309995 | val_loss: 0.0313169 | Time: 1893.55 ms
[2021-01-04 10:19:11 main:574] : INFO : Epoch 673 | loss: 0.0309893 | val_loss: 0.0313547 | Time: 1881.5 ms
[2021-01-04 10:19:13 main:574] : INFO : Epoch 674 | loss: 0.0309896 | val_loss: 0.0313234 | Time: 1855.06 ms
[2021-01-04 10:19:15 main:574] : INFO : Epoch 675 | loss: 0.0309883 | val_loss: 0.0313559 | Time: 1825.3 ms
[2021-01-04 10:19:16 main:574] : INFO : Epoch 676 | loss: 0.0309971 | val_loss: 0.0313468 | Time: 1861.6 ms
[2021-01-04 10:19:18 main:574] : INFO : Epoch 677 | loss: 0.0309987 | val_loss: 0.0313544 | Time: 1884.06 ms
[2021-01-04 10:19:20 main:574] : INFO : Epoch 678 | loss: 0.0309969 | val_loss: 0.0313215 | Time: 1874.06 ms
[2021-01-04 10:19:22 main:574] : INFO : Epoch 679 | loss: 0.0309892 | val_loss: 0.0313185 | Time: 1865.81 ms
[2021-01-04 10:19:24 main:574] : INFO : Epoch 680 | loss: 0.0309859 | val_loss: 0.0313747 | Time: 1910.76 ms
[2021-01-04 10:19:26 main:574] : INFO : Epoch 681 | loss: 0.0309957 | val_loss: 0.0312951 | Time: 1892.82 ms
[2021-01-04 10:19:28 main:574] : INFO : Epoch 682 | loss: 0.030996 | val_loss: 0.0313337 | Time: 1876.49 ms
[2021-01-04 10:19:30 main:574] : INFO : Epoch 683 | loss: 0.0309905 | val_loss: 0.0313351 | Time: 1880.85 ms
[2021-01-04 10:19:31 main:574] : INFO : Epoch 684 | loss: 0.0309865 | val_loss: 0.0313746 | Time: 1814.02 ms
[2021-01-04 10:19:33 main:574] : INFO : Epoch 685 | loss: 0.0309854 | val_loss: 0.0313491 | Time: 1920.75 ms
[2021-01-04 10:19:35 main:574] : INFO : Epoch 686 | loss: 0.0309873 | val_loss: 0.0313322 | Time: 1823.91 ms
[2021-01-04 10:19:37 main:574] : INFO : Epoch 687 | loss: 0.0309895 | val_loss: 0.0313375 | Time: 1905.2 ms
[2021-01-04 10:19:39 main:574] : INFO : Epoch 688 | loss: 0.0309843 | val_loss: 0.0313287 | Time: 1861.81 ms
[2021-01-04 10:19:41 main:574] : INFO : Epoch 689 | loss: 0.0309876 | val_loss: 0.0313196 | Time: 1934.32 ms
[2021-01-04 10:19:43 main:574] : INFO : Epoch 690 | loss: 0.030994 | val_loss: 0.0313413 | Time: 1841.81 ms
[2021-01-04 10:19:45 main:574] : INFO : Epoch 691 | loss: 0.0309963 | val_loss: 0.0313055 | Time: 1866.53 ms
[2021-01-04 10:19:46 main:574] : INFO : Epoch 692 | loss: 0.0309962 | val_loss: 0.0313134 | Time: 1838.88 ms
[2021-01-04 10:19:48 main:574] : INFO : Epoch 693 | loss: 0.0309901 | val_loss: 0.0313628 | Time: 1891.07 ms
[2021-01-04 10:19:50 main:574] : INFO : Epoch 694 | loss: 0.0309915 | val_loss: 0.0313596 | Time: 1854.14 ms
[2021-01-04 10:19:52 main:574] : INFO : Epoch 695 | loss: 0.030995 | val_loss: 0.0313496 | Time: 1820.38 ms
[2021-01-04 10:19:54 main:574] : INFO : Epoch 696 | loss: 0.0309997 | val_loss: 0.0312885 | Time: 1857.75 ms
[2021-01-04 10:19:56 main:574] : INFO : Epoch 697 | loss: 0.0309994 | val_loss: 0.0313223 | Time: 1825.44 ms
[2021-01-04 10:19:58 main:574] : INFO : Epoch 698 | loss: 0.0309967 | val_loss: 0.0313232 | Time: 1883.07 ms
[2021-01-04 10:19:59 main:574] : INFO : Epoch 699 | loss: 0.0309893 | val_loss: 0.031323 | Time: 1836.01 ms
[2021-01-04 10:20:01 main:574] : INFO : Epoch 700 | loss: 0.0309978 | val_loss: 0.0312914 | Time: 1896.95 ms
[2021-01-04 10:20:03 main:574] : INFO : Epoch 701 | loss: 0.0309878 | val_loss: 0.0313211 | Time: 1894.54 ms
[2021-01-04 10:20:05 main:574] : INFO : Epoch 702 | loss: 0.030993 | val_loss: 0.0313276 | Time: 1885.09 ms
[2021-01-04 10:20:07 main:574] : INFO : Epoch 703 | loss: 0.0309904 | val_loss: 0.0313294 | Time: 1836.51 ms
[2021-01-04 10:20:09 main:574] : INFO : Epoch 704 | loss: 0.0309896 | val_loss: 0.031315 | Time: 1872.95 ms
[2021-01-04 10:20:11 main:574] : INFO : Epoch 705 | loss: 0.030988 | val_loss: 0.0313169 | Time: 1890.92 ms
[2021-01-04 10:20:13 main:574] : INFO : Epoch 706 | loss: 0.0309914 | val_loss: 0.0313273 | Time: 1901.59 ms
[2021-01-04 10:20:15 main:574] : INFO : Epoch 707 | loss: 0.0309979 | val_loss: 0.031339 | Time: 1852.32 ms
[2021-01-04 10:20:16 main:574] : INFO : Epoch 708 | loss: 0.0309896 | val_loss: 0.0313293 | Time: 1847.31 ms
[2021-01-04 10:20:18 main:574] : INFO : Epoch 709 | loss: 0.0309926 | val_loss: 0.0313277 | Time: 1874.02 ms
[2021-01-04 10:20:20 main:574] : INFO : Epoch 710 | loss: 0.0309862 | val_loss: 0.031309 | Time: 1858.43 ms
[2021-01-04 10:20:22 main:574] : INFO : Epoch 711 | loss: 0.0309864 | val_loss: 0.0313502 | Time: 1836.06 ms
[2021-01-04 10:20:24 main:574] : INFO : Epoch 712 | loss: 0.0309858 | val_loss: 0.0313371 | Time: 1893.57 ms
[2021-01-04 10:20:26 main:574] : INFO : Epoch 713 | loss: 0.0309829 | val_loss: 0.0313323 | Time: 1898.86 ms
[2021-01-04 10:20:28 main:574] : INFO : Epoch 714 | loss: 0.0309838 | val_loss: 0.0313649 | Time: 1858.38 ms
[2021-01-04 10:20:30 main:574] : INFO : Epoch 715 | loss: 0.0309896 | val_loss: 0.0313023 | Time: 1860.93 ms
[2021-01-04 10:20:31 main:574] : INFO : Epoch 716 | loss: 0.0309959 | val_loss: 0.0313465 | Time: 1859.08 ms
[2021-01-04 10:20:33 main:574] : INFO : Epoch 717 | loss: 0.0309929 | val_loss: 0.0313687 | Time: 1874.64 ms
[2021-01-04 10:20:35 main:574] : INFO : Epoch 718 | loss: 0.0309916 | val_loss: 0.0313121 | Time: 1899.94 ms
[2021-01-04 10:20:37 main:574] : INFO : Epoch 719 | loss: 0.0309903 | val_loss: 0.0313275 | Time: 1875.84 ms
[2021-01-04 10:20:39 main:574] : INFO : Epoch 720 | loss: 0.0309945 | val_loss: 0.031372 | Time: 1877.18 ms
[2021-01-04 10:20:41 main:574] : INFO : Epoch 721 | loss: 0.0309927 | val_loss: 0.0313216 | Time: 1875.09 ms
[2021-01-04 10:20:43 main:574] : INFO : Epoch 722 | loss: 0.0309894 | val_loss: 0.0313235 | Time: 1881.48 ms
[2021-01-04 10:20:45 main:574] : INFO : Epoch 723 | loss: 0.0309858 | val_loss: 0.0313755 | Time: 1855.55 ms
[2021-01-04 10:20:46 main:574] : INFO : Epoch 724 | loss: 0.0309872 | val_loss: 0.0313335 | Time: 1885.12 ms
[2021-01-04 10:20:48 main:574] : INFO : Epoch 725 | loss: 0.0309884 | val_loss: 0.0313431 | Time: 1887.8 ms
[2021-01-04 10:20:50 main:574] : INFO : Epoch 726 | loss: 0.0309898 | val_loss: 0.0313335 | Time: 1864.39 ms
[2021-01-04 10:20:52 main:574] : INFO : Epoch 727 | loss: 0.0309962 | val_loss: 0.0313386 | Time: 1831.36 ms
[2021-01-04 10:20:54 main:574] : INFO : Epoch 728 | loss: 0.030995 | val_loss: 0.0313311 | Time: 1898.34 ms
[2021-01-04 10:20:56 main:574] : INFO : Epoch 729 | loss: 0.0309906 | val_loss: 0.0313518 | Time: 1877.13 ms
[2021-01-04 10:20:58 main:574] : INFO : Epoch 730 | loss: 0.0309878 | val_loss: 0.0313332 | Time: 1866.09 ms
[2021-01-04 10:21:00 main:574] : INFO : Epoch 731 | loss: 0.0309969 | val_loss: 0.0313085 | Time: 1872.65 ms
[2021-01-04 10:21:02 main:574] : INFO : Epoch 732 | loss: 0.0309866 | val_loss: 0.0313254 | Time: 1894.87 ms
[2021-01-04 10:21:03 main:574] : INFO : Epoch 733 | loss: 0.0309879 | val_loss: 0.0313443 | Time: 1915.36 ms
[2021-01-04 10:21:05 main:574] : INFO : Epoch 734 | loss: 0.0309945 | val_loss: 0.0313082 | Time: 1907.14 ms
[2021-01-04 10:21:07 main:574] : INFO : Epoch 735 | loss: 0.0309886 | val_loss: 0.0313737 | Time: 1876.63 ms
[2021-01-04 10:21:09 main:574] : INFO : Epoch 736 | loss: 0.0309827 | val_loss: 0.0313256 | Time: 1851.62 ms
[2021-01-04 10:21:11 main:574] : INFO : Epoch 737 | loss: 0.0309896 | val_loss: 0.0313298 | Time: 1844.25 ms
[2021-01-04 10:21:13 main:574] : INFO : Epoch 738 | loss: 0.030997 | val_loss: 0.0313269 | Time: 1899.25 ms
[2021-01-04 10:21:15 main:574] : INFO : Epoch 739 | loss: 0.0309983 | val_loss: 0.0313347 | Time: 1846.28 ms
[2021-01-04 10:21:17 main:574] : INFO : Epoch 740 | loss: 0.030991 | val_loss: 0.0313515 | Time: 1851.78 ms
[2021-01-04 10:21:18 main:574] : INFO : Epoch 741 | loss: 0.0309864 | val_loss: 0.0313299 | Time: 1922.06 ms
[2021-01-04 10:21:20 main:574] : INFO : Epoch 742 | loss: 0.0309867 | val_loss: 0.0313179 | Time: 1905.86 ms
[2021-01-04 10:21:22 main:574] : INFO : Epoch 743 | loss: 0.03099 | val_loss: 0.0313411 | Time: 1850.63 ms
[2021-01-04 10:21:24 main:574] : INFO : Epoch 744 | loss: 0.0309921 | val_loss: 0.0313577 | Time: 1889.26 ms
[2021-01-04 10:21:26 main:574] : INFO : Epoch 745 | loss: 0.0309964 | val_loss: 0.0313066 | Time: 1895.93 ms
[2021-01-04 10:21:28 main:574] : INFO : Epoch 746 | loss: 0.030991 | val_loss: 0.031331 | Time: 1870.27 ms
[2021-01-04 10:21:30 main:574] : INFO : Epoch 747 | loss: 0.0309844 | val_loss: 0.0313297 | Time: 1892.7 ms
[2021-01-04 10:21:32 main:574] : INFO : Epoch 748 | loss: 0.0309829 | val_loss: 0.0313267 | Time: 1882.58 ms
[2021-01-04 10:21:34 main:574] : INFO : Epoch 749 | loss: 0.0309835 | val_loss: 0.0313358 | Time: 1876.46 ms
[2021-01-04 10:21:35 main:574] : INFO : Epoch 750 | loss: 0.0309919 | val_loss: 0.0313462 | Time: 1865.1 ms
[2021-01-04 10:21:37 main:574] : INFO : Epoch 751 | loss: 0.0309995 | val_loss: 0.0313112 | Time: 1874.04 ms
[2021-01-04 10:21:39 main:574] : INFO : Epoch 752 | loss: 0.0310015 | val_loss: 0.0312931 | Time: 1901.38 ms
[2021-01-04 10:21:41 main:574] : INFO : Epoch 753 | loss: 0.0310271 | val_loss: 0.0312951 | Time: 1887.43 ms
[2021-01-04 10:21:43 main:574] : INFO : Epoch 754 | loss: 0.0310058 | val_loss: 0.0313415 | Time: 1877.98 ms
[2021-01-04 10:21:45 main:574] : INFO : Epoch 755 | loss: 0.0309881 | val_loss: 0.0313463 | Time: 1896.24 ms
[2021-01-04 10:21:47 main:574] : INFO : Epoch 756 | loss: 0.0309877 | val_loss: 0.0313027 | Time: 1906.89 ms
[2021-01-04 10:21:49 main:574] : INFO : Epoch 757 | loss: 0.0309929 | val_loss: 0.031361 | Time: 1878.81 ms
[2021-01-04 10:21:51 main:574] : INFO : Epoch 758 | loss: 0.0309872 | val_loss: 0.0313191 | Time: 1835.95 ms
[2021-01-04 10:21:52 main:574] : INFO : Epoch 759 | loss: 0.0309832 | val_loss: 0.0313351 | Time: 1863.18 ms
THCudaCheck FAIL file=..\..\aten\src\THC\THCCachingHostAllocator.cpp line=278 error=719 : unspecified launch failure
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFFDBCCD759
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 01/04/21 10:21:54
Install Directory : C:\Program Files\BOINC\
Data Directory : C:\ProgramData\BOINC
Project Symstore :
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\7;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 00000000f70a0000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000de4b0000 00000000001f6000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.662
ModLoad: 00000000dcfc0000 00000000000bd000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.662
ModLoad: 00000000dbca0000 00000000002c9000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.662
ModLoad: 00000000dd390000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.685) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000dc180000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.662
ModLoad: 00000000de0e0000 000000000002a000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.685) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.685 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.685
ModLoad: 00000000dbf70000 0000000000109000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.685) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.685 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.685
ModLoad: 00000000dc470000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000dc1b0000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000dd6f0000 00000000000ac000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.610) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000de2b0000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.19041.546
ModLoad: 00000000de210000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000dd0f0000 000000000012b000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000c5b20000 0000000000058000 C:\ProgramData\BOINC\slots\7\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000bf760000 0000000000099000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.24.28127.4) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.24.28127.4 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.24.28127.4
ModLoad: 00000000da040000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.488) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.488 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.488
ModLoad: 00000000c0e60000 0000000000017000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.24.28127.4) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.24.28127.4 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.24.28127.4
ModLoad: 00000000b0420000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.24.28127.4) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.24.28127.4 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.24.28127.4
ModLoad: 0000000041360000 000000000abe7000 C:\ProgramData\BOINC\slots\7\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000007b2f0000 00000000002db000 C:\ProgramData\BOINC\slots\7\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000008b020000 000000000020d000 C:\ProgramData\BOINC\slots\7\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 00000000c5ae0000 0000000000040000 C:\ProgramData\BOINC\slots\7\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000001c810000 0000000024b49000 C:\ProgramData\BOINC\slots\7\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000c1310000 0000000000045000 C:\ProgramData\BOINC\slots\7\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000019350000 00000000034b2000 C:\ProgramData\BOINC\slots\7\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 00000000d6f80000 0000000000010000 C:\ProgramData\BOINC\slots\7\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 0000000051cd0000 00000000030a5000 C:\ProgramData\BOINC\slots\7\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 00000000155f0000 0000000003d5b000 C:\ProgramData\BOINC\slots\7\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000fa240000 000000001b3a4000 C:\ProgramData\BOINC\slots\7\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 00000000f8370000 0000000001eca000 C:\ProgramData\BOINC\slots\7\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000ef1d0000 000000000919f000 C:\ProgramData\BOINC\slots\7\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 00000000dd530000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000da840000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000ddac0000 0000000000467000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000dc100000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000dc150000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000db9a0000 000000000002c000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000dc410000 0000000000060000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.662
ModLoad: 00000000dc2b0000 000000000015d000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000db7e0000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000dc510000 0000000000742000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.329 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.329
ModLoad: 00000000d97e0000 0000000000795000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000dcc60000 0000000000356000 C:\WINDOWS\System32\combase.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000db660000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000dd640000 00000000000ae000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000dd220000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000007b050000 000000000029d000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.6089) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r460\r460_74\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 27.21.14.6089
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.2.66 driver
Product Version : 27.21.14.6089
ModLoad: 00000000d4520000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000edc00000 00000000015c2000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_2635d5c616c804dc\nvcuda64.dll (27.21.14.6089) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r460\r460_74\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 27.21.14.6089
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.2.66 driver
Product Version : 27.21.14.6089
ModLoad: 00000000dd5d0000 000000000006b000 C:\WINDOWS\System32\WS2_32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : ws2_32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000d4410000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000db5d0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000d8da0000 000000000009e000 C:\WINDOWS\system32\uxtheme.dll (6.2.19041.610) (-exported- Symbols Loaded)
Linked PDB Filename : UxTheme.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000c7570000 00000000006f0000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.6089) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r460\r460_74\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 27.21.14.6089
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 27.21.14.6089
ModLoad: 00000000dd8b0000 000000000012a000 C:\WINDOWS\System32\OLE32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : ole32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000d6f70000 0000000000009000 C:\ProgramData\BOINC\slots\7\caffe2_nvrtc.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000e2040000 0000000000fca000 C:\ProgramData\BOINC\slots\7\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6.14.11.9000
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.89 NVRTC Library
Product Version : 6.14.11.9000
ModLoad: 00000000dc080000 0000000000080000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.662
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 4393, Write: 2903, Other 8894
- I/O Transfers Counters -
Read: 6590486, Write: 586111, Other 56156
- Paged Pool Usage -
QuotaPagedPoolUsage: 3504640, QuotaPeakPagedPoolUsage: 3505232
QuotaNonPagedPoolUsage: 51944, QuotaPeakNonPagedPoolUsage: 52352
- Virtual Memory Usage -
VirtualSize: -404684800, PeakVirtualSize: 202883072
- Pagefile Usage -
PagefileUsage: -404684800, PeakPagefileUsage: -404152320
- Working Set Size -
WorkingSetSize: 1733083136, PeakWorkingSetSize: 1770500096, PageFaultCount: 638172
*** Dump of thread ID 20796 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 346249984.000000, User Time: 7779531264.000000, Wait Time: 1673644.000000
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFFDBCCD759
- Registers -
rax=0000000000000000 rbx=000000004b7d62f0 rcx=0000000000000000 rdx=0000000000000000 rsi=00000000d24e43b0 rdi=0000000019930520
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000000006000 r13=0000000000000000
r14=00000000d24e50f0 r15=00000000d24e5070 rip=00000000dbccd759 rsp=00000000d24e4250 rbp=00000000d24e4c58
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202
- Callstack -
ChildEBP RetAddr Args to Child
d24e4320 c0e64880 a5d3025c 00000000 d24e50f0 4692a014 KERNELBASE!RaiseException+0x0
d24e4380 46f25272 a5d302bc 00000000 000007cb 00000116 VCRUNTIME140!_CxxThrowException+0x0
d24e43d0 46f256d4 00000000 de4c786b 49f4d290 20075f68 torch_cpu!at::Tensor::zero_+0x0
d24e4c30 1f639ebe d24e4e60 20076850 20076880 000002cf torch_cpu!_THError+0x0
d24e4c70 1f635412 d24e4e60 d24e4dc0 56889450 204aa720 torch_cuda!__THCudaCheck+0x0
d24e4cb0 46bd59ff d24e5000 d24e4e60 d24e5330 c5b597b0 torch_cuda!at::native::set_storage_cuda_+0x0
d24e5040 46d7726f 1fcaf630 4692ea63 00000001 c5b3ef8f torch_cpu!at::native::empty_cpu+0x0
d24e5080 46d30615 d24e0000 d24e50f8 d24e52f0 c5b27ce6 torch_cpu!at::native::mkldnn_sigmoid_+0x0
d24e50c0 46d3204a d24e0000 d24e5100 5686aa00 1e976ae5 torch_cpu!at::native::mkldnn_sigmoid_+0x0
d24e5150 46d30615 00000000 4692ea63 d24e5230 d24e5330 torch_cpu!at::native::mkldnn_sigmoid_+0x0
d24e5190 46e01eb0 d24e0000 00000000 d24e5318 00000001 torch_cpu!at::native::mkldnn_sigmoid_+0x0
d24e5230 46e12eec e1e51083 c5b59c50 d24e5390 c5b23bd6 torch_cpu!at::bucketize_out+0x0
d24e5280 1ed3f160 d24e0000 00000000 d24e5390 00000000 torch_cpu!at::empty+0x0
d24e5620 1ed42de8 c5b59c50 46930528 57756870 c5b59c50 torch_cuda!at::native::cummin_helper_cuda+0x0
d24e5800 1ed44379 d24e5910 a129c6c0 d24e5d10 a129c6d8 torch_cuda!at::native::cummin_helper_cuda+0x0
d24e5a40 1ed43d64 d24e0000 d24e5d10 d24e5b50 d24e5d10 torch_cuda!at::native::cat_out_cuda+0x0
d24e5c40 1f5e1dd2 d24e5c98 00000001 d24e5c98 d24e5d10 torch_cuda!at::native::cat_cuda+0x0
d24e5cc0 1f5f4179 00000001 d24e5d00 57758cf8 04000000 torch_cuda!at::native::set_storage_cuda_+0x0
d24e5d00 46e01d7d 8f0b49c0 d24e6070 d24e6040 00000000 torch_cuda!at::native::set_storage_cuda_+0x0
d24e5d80 46de0d81 00000000 c5b43994 d24e6550 a1293760 torch_cpu!at::bucketize_out+0x0
d24e5dc0 46beb4a5 d24e5e00 57756470 d24e5ed0 d24e5f40 torch_cpu!at::_cat+0x0
d24e5e90 46ed27bd d24e5f60 00000101 d24e5ee8 c5b71ea8 torch_cpu!at::native::cat+0x0
d24e5f10 469929ae a129c840 a129c850 a129c858 d24e5ec8 torch_cpu!at::zeros_out+0x0
d24e5f50 46e01d7d d24e5f90 d24e6000 00000000 de4c5d21 torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0
d24e5fd0 46e075d1 d24e6570 4bc80640 d24e6550 a1293760 torch_cpu!at::bucketize_out+0x0
d24e6010 46bf7d4c d24e62a0 00000000 d24e62a0 00000000 torch_cpu!at::cat+0x0
d24e61d0 46eec38d d24e6228 00000001 d24e6228 d24e62a0 torch_cpu!at::native::stack+0x0
d24e6250 469929ae d24e6550 a1293760 00000000 00000000 torch_cpu!at::zeros_out+0x0
d24e6290 46e01d7d d24e62d0 d24e6340 00000000 49ba1c8f torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0
d24e6310 46e502e1 d24e6440 c5b43720 d24e6570 4bc80640 torch_cpu!at::bucketize_out+0x0
d24e6350 481e3839 d24e63d0 57755010 57755010 d24e6460 torch_cpu!at::stack+0x0
d24e6520 469929ae 00000000 d24e6670 00000000 d24e6610 torch_cpu!torch::autograd::GraphRoot::apply+0x0
d24e6560 46e01d7d d24e65a0 d24e6610 577588f0 00000000 torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0
d24e65e0 46e502e1 d24e6750 46929cac 9ffc0c00 a1293760 torch_cpu!at::bucketize_out+0x0
d24e6620 f70aff7e d24e66e8 9be95a90 9be95a90 d24e6830 torch_cpu!at::stack+0x0
d24e66c0 f70b2ef8 f70afe30 d24e6700 d24e6700 d24e6750 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::addCallback+0x0
d24e6720 f70b3ea4 33ba1510 de4c5d21 d24e68c0 55df0000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Object::getSlot+0x0
d24e6860 f70ad3d2 9ca54350 a1367bd0 d24e68c0 de4c95f1 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::markCompleted+0x0
d24e6890 f70b4541 00000000 a1367df0 38f92b60 de4c95f1 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Object::operator=+0x0
d24e6a40 f70b743a d24e6b10 00000000 d24e7550 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::markCompleted+0x0
d24e6f40 f70bb950 d24e7040 d24e7040 00000000 2cdae2a0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0
d24ffce0 f72fc6f8 5786dc70 00000000 00000000 57329a90 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
d24ffd20 dcfd7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
d24ffd50 de4fd0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
d24ffdd0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 7796 (state: Waiting): ***
- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 1673641.000000
- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000d29ffd50 rsi=0000000000000000 rdi=0000000000000064
r8=00000000d29ffd28 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000de54c634 rsp=00000000d29ffd28 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
d29ffd20 dbced84e d29ffde8 00000000 00000000 00000000 ntdll!ZwDelayExecution+0x0
d29ffdc0 f70da07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0
d29ffdf0 dcfd7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
d29ffe20 de4fd0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
d29ffea0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 14204 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 1673644.000000
- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=00000000d2affb10 rsi=0000000000000000 rdi=000000000000000d
r8=0000000057c8d090 r9=0000000057a11100 r10=0000000000000000 r11=00000000d2affa80 r12=0000000000000064 r13=00000000d2affb10
r14=00000000d2aff810 r15=0000000000000000 rip=00000000de54cb04 rsp=00000000d2aff7b8 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
d2aff7b0 dbcf0d40 00000000 d234e000 de61b4d0 d234e000 ntdll!NtWaitForMultipleObjects+0x0
d2affaa0 dbcf0c3e 55e050f0 004e0049 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
d2affae0 eddb66d4 57a14dd0 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0
d2affd20 ede4e51d 00000000 57a11110 00000000 00000000 nvcuda64!+0x0
d2affdd0 eddb60a3 e36ead39 e32ab6fb 57fd9fd0 00000000 nvcuda64!cuProfilerStop+0x0
d2affe00 ee0cd794 57fd9fd0 00000000 00000000 00000000 nvcuda64!+0x0
d2affe30 dcfd7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
d2affe60 de4fd0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
d2affee0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 9964 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 1673643.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=000000000000028c rdx=0000000000000000 rsi=00000000d2bff908 rdi=000000000000028c
r8=00000000d2bff908 r9=0000000000000005 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=000000000000028c r15=0000000000000001 rip=00000000de54c034 rsp=00000000d2bff8d8 rbp=00000000579f9dd0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
d2bff8d0 dbcba34e 00000000 00000000 00000000 00000000 ntdll!NtWaitForSingleObject+0x0
d2bff970 edfccd6e 57f99c60 dbcc2cb5 00000000 0000028c KERNELBASE!WaitForSingleObjectEx+0x0
d2bff9e0 eddb60a3 579f9dd0 584ac7d0 57fd9a60 00000000 nvcuda64!cuProfilerStop+0x0
d2bffa10 ee0cd794 57fd9a60 00000000 00000000 00000000 nvcuda64!+0x0
d2bffa40 dcfd7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
d2bffa70 de4fd0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
d2bffaf0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 20556 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 1673616.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=0000000057c90298 rdx=00000000d2cff9a8 rsi=00000000d2cff910 rdi=0000000000000000
r8=00000000d2cff8e8 r9=00000000d2cff940 r10=0000000000000000 r11=0000000000000246 r12=00000000d2cff9a8 r13=0000000000000000
r14=0000000057c90298 r15=0000000057c94a10 rip=00000000de54f9a4 rsp=00000000d2cff8e8 rbp=00000000d2cff940
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
d2cff8e0 de5154f5 00000102 00000102 00000000 d2cff910 ntdll!NtWaitForAlertByThreadId+0x0
d2cff950 dbd0b9d9 57c921f0 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0
d2cff980 edd34a5c 57c921f0 de4fa9f0 57c921f0 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0
d2cff9e0 eddb60a3 00000001 e336c7b2 00000000 00000000 nvcuda64!+0x0
d2cffa10 ee0cd794 57fd9760 00000000 00000000 00000000 nvcuda64!+0x0
d2cffa40 dcfd7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
d2cffa70 de4fd0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
d2cffaf0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 21308 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 335937504.000000, User Time: 5720625152.000000, Wait Time: 1673642.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000826d3908 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000826d3908
r8=0000000055d715c0 r9=0000000000000001 r10=0000000000008000 r11=00000000d2dfe100 r12=0000000000000000 r13=0000000000000000
r14=00000000d2dff6b0 r15=00000000826d38b8 rip=00000000de54f9a4 rsp=00000000d2dff688 rbp=00000000d2dff6e0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
d2dff680 de515281 9be6a5a8 9be6a5a8 d2dff7c0 9be6a5a8 ntdll!NtWaitForAlertByThreadId+0x0
d2dff700 dbd0ba89 826d38b0 826d38f8 00000000 00000000 ntdll!RtlSleepConditionVariableSRW+0x0
d2dff740 bf7953dd 47ef5310 47ef5310 47ef5310 00000000 KERNELBASE!SleepConditionVariableSRW+0x0
d2dff780 bf771fa8 9c536620 00000000 00000000 485405b4 MSVCP140!__crtSetThreadpoolWait+0x0
d2dff7b0 bf771e70 00000000 bf772677 00000000 9c536620 MSVCP140!std::_Winerror_message+0x0
d2dff820 4854064b 9c536600 000001c0 826d38b0 826d38b0 MSVCP140!std::_Winerror_message+0x0
d2dff860 485425b1 a17110a0 ffffffff 9c536600 ffffffff torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
d2dffb50 48542471 4ba66d10 d2dffb90 4ba66d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0
d2dffba0 48539744 00080001 a104d580 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0
d2dffbd0 dc1d14c2 a104d580 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0
d2dffc00 dcfd7034 00000000 00000000 00000000 00000000 ucrtbase!_configthreadlocale+0x0
d2dffc30 de4fd0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
d2dffcb0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)