Task 3201137
| Name | EightBitModified-1605931911-518-2_1 |
| Workunit | 1467951 |
| Created | 8 Dec 2020, 10:25:06 UTC |
| Sent | 8 Dec 2020, 11:53:51 UTC |
| Report deadline | 15 Dec 2020, 11:53:51 UTC |
| Received | 8 Dec 2020, 13:24:21 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | -529697949 (0xE06D7363) Unknown error code |
| Computer ID | 5172 |
| Run time | 29 min 41 sec |
| CPU time | 29 min 5 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 4,539.86 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.64 GB |
| Peak swap size | 3.62 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
0.000354735 | Time: 2295.16 ms
[2020-12-08 13:14:42 main:574] : INFO : Epoch 504 | loss: 0.000309556 | val_loss: 0.000313901 | Time: 2301.78 ms
[2020-12-08 13:14:44 main:574] : INFO : Epoch 505 | loss: 0.000292103 | val_loss: 0.000325624 | Time: 2276.22 ms
[2020-12-08 13:14:46 main:574] : INFO : Epoch 506 | loss: 0.000421872 | val_loss: 0.000467192 | Time: 2274.64 ms
[2020-12-08 13:14:49 main:574] : INFO : Epoch 507 | loss: 0.0003666 | val_loss: 0.000331051 | Time: 2526.15 ms
[2020-12-08 13:14:51 main:574] : INFO : Epoch 508 | loss: 0.000295562 | val_loss: 0.000305513 | Time: 2440.53 ms
[2020-12-08 13:14:54 main:574] : INFO : Epoch 509 | loss: 0.000362065 | val_loss: 0.00037924 | Time: 2420.64 ms
[2020-12-08 13:14:56 main:574] : INFO : Epoch 510 | loss: 0.000322729 | val_loss: 0.000326162 | Time: 2355.15 ms
[2020-12-08 13:14:58 main:574] : INFO : Epoch 511 | loss: 0.000309873 | val_loss: 0.000338862 | Time: 2279.8 ms
[2020-12-08 13:15:01 main:574] : INFO : Epoch 512 | loss: 0.000329581 | val_loss: 0.000455644 | Time: 2236.9 ms
[2020-12-08 13:15:03 main:574] : INFO : Epoch 513 | loss: 0.000360611 | val_loss: 0.000316696 | Time: 2366.86 ms
[2020-12-08 13:15:05 main:574] : INFO : Epoch 514 | loss: 0.000335384 | val_loss: 0.00036198 | Time: 2382.5 ms
[2020-12-08 13:15:08 main:574] : INFO : Epoch 515 | loss: 0.000296794 | val_loss: 0.000308223 | Time: 2397.1 ms
[2020-12-08 13:15:10 main:574] : INFO : Epoch 516 | loss: 0.000386054 | val_loss: 0.000389422 | Time: 2404.73 ms
[2020-12-08 13:15:13 main:574] : INFO : Epoch 517 | loss: 0.000349165 | val_loss: 0.000327222 | Time: 2317.26 ms
[2020-12-08 13:15:15 main:574] : INFO : Epoch 518 | loss: 0.000294041 | val_loss: 0.000312117 | Time: 2506.38 ms
[2020-12-08 13:15:18 main:574] : INFO : Epoch 519 | loss: 0.000370215 | val_loss: 0.000579118 | Time: 2348.07 ms
[2020-12-08 13:15:20 main:574] : INFO : Epoch 520 | loss: 0.000410212 | val_loss: 0.000349136 | Time: 2390.28 ms
[2020-12-08 13:15:22 main:574] : INFO : Epoch 521 | loss: 0.000305101 | val_loss: 0.000311223 | Time: 2421.66 ms
[2020-12-08 13:15:25 main:574] : INFO : Epoch 522 | loss: 0.000290371 | val_loss: 0.000387239 | Time: 2345.77 ms
[2020-12-08 13:15:27 main:574] : INFO : Epoch 523 | loss: 0.000455337 | val_loss: 0.000347207 | Time: 2411.39 ms
[2020-12-08 13:15:30 main:574] : INFO : Epoch 524 | loss: 0.000312453 | val_loss: 0.00031712 | Time: 2442.93 ms
[2020-12-08 13:15:32 main:574] : INFO : Epoch 525 | loss: 0.000289554 | val_loss: 0.000311748 | Time: 2491.48 ms
[2020-12-08 13:15:34 main:574] : INFO : Epoch 526 | loss: 0.000331621 | val_loss: 0.000471398 | Time: 2303.12 ms
[2020-12-08 13:15:37 main:574] : INFO : Epoch 527 | loss: 0.000347846 | val_loss: 0.000323567 | Time: 2408.85 ms
[2020-12-08 13:15:39 main:574] : INFO : Epoch 528 | loss: 0.000295709 | val_loss: 0.000347251 | Time: 2522.14 ms
[2020-12-08 13:15:42 main:574] : INFO : Epoch 529 | loss: 0.000370599 | val_loss: 0.000361264 | Time: 2615.81 ms
[2020-12-08 13:15:45 main:574] : INFO : Epoch 530 | loss: 0.000303659 | val_loss: 0.000308184 | Time: 2465.98 ms
[2020-12-08 13:15:47 main:574] : INFO : Epoch 531 | loss: 0.000342237 | val_loss: 0.000609443 | Time: 2544.65 ms
[2020-12-08 13:15:50 main:574] : INFO : Epoch 532 | loss: 0.000390132 | val_loss: 0.000333034 | Time: 2476.4 ms
[2020-12-08 13:15:52 main:574] : INFO : Epoch 533 | loss: 0.000294669 | val_loss: 0.000306227 | Time: 2486.55 ms
[2020-12-08 13:15:55 main:574] : INFO : Epoch 534 | loss: 0.000307076 | val_loss: 0.000422213 | Time: 2482.03 ms
[2020-12-08 13:15:57 main:574] : INFO : Epoch 535 | loss: 0.000423866 | val_loss: 0.000371126 | Time: 2670.07 ms
[2020-12-08 13:16:00 main:574] : INFO : Epoch 536 | loss: 0.000309964 | val_loss: 0.000305583 | Time: 2401.16 ms
[2020-12-08 13:16:02 main:574] : INFO : Epoch 537 | loss: 0.000282458 | val_loss: 0.000302065 | Time: 2369.85 ms
[2020-12-08 13:16:05 main:574] : INFO : Epoch 538 | loss: 0.000378618 | val_loss: 0.000892253 | Time: 2387.06 ms
[2020-12-08 13:16:07 main:574] : INFO : Epoch 539 | loss: 0.000478551 | val_loss: 0.000366056 | Time: 2481.91 ms
[2020-12-08 13:16:09 main:574] : INFO : Epoch 540 | loss: 0.000313733 | val_loss: 0.000306884 | Time: 2389.3 ms
[2020-12-08 13:16:12 main:574] : INFO : Epoch 541 | loss: 0.000282586 | val_loss: 0.000298265 | Time: 2351.21 ms
[2020-12-08 13:16:14 main:574] : INFO : Epoch 542 | loss: 0.000280674 | val_loss: 0.000333193 | Time: 2405.18 ms
[2020-12-08 13:16:17 main:574] : INFO : Epoch 543 | loss: 0.000418209 | val_loss: 0.000337679 | Time: 2394.46 ms
[2020-12-08 13:16:19 main:574] : INFO : Epoch 544 | loss: 0.000316865 | val_loss: 0.00032204 | Time: 2393.63 ms
[2020-12-08 13:16:21 main:574] : INFO : Epoch 545 | loss: 0.000298314 | val_loss: 0.000303795 | Time: 2329.04 ms
[2020-12-08 13:16:24 main:574] : INFO : Epoch 546 | loss: 0.000339762 | val_loss: 0.000574397 | Time: 2370.22 ms
[2020-12-08 13:16:26 main:574] : INFO : Epoch 547 | loss: 0.000408398 | val_loss: 0.000348105 | Time: 2412.48 ms
[2020-12-08 13:16:29 main:574] : INFO : Epoch 548 | loss: 0.000293839 | val_loss: 0.000302748 | Time: 2448.38 ms
[2020-12-08 13:16:31 main:574] : INFO : Epoch 549 | loss: 0.000287278 | val_loss: 0.000371441 | Time: 2494.35 ms
[2020-12-08 13:16:34 main:574] : INFO : Epoch 550 | loss: 0.000391868 | val_loss: 0.000348423 | Time: 2430.68 ms
[2020-12-08 13:16:36 main:574] : INFO : Epoch 551 | loss: 0.00030305 | val_loss: 0.000311522 | Time: 2377.21 ms
[2020-12-08 13:16:39 main:574] : INFO : Epoch 552 | loss: 0.00028362 | val_loss: 0.000305032 | Time: 2421.43 ms
[2020-12-08 13:16:41 main:574] : INFO : Epoch 553 | loss: 0.000430045 | val_loss: 0.0003585 | Time: 2497.14 ms
[2020-12-08 13:16:44 main:574] : INFO : Epoch 554 | loss: 0.00032918 | val_loss: 0.00031888 | Time: 2583.57 ms
[2020-12-08 13:16:46 main:574] : INFO : Epoch 555 | loss: 0.000302076 | val_loss: 0.000386958 | Time: 2396.08 ms
[2020-12-08 13:16:49 main:574] : INFO : Epoch 556 | loss: 0.000354489 | val_loss: 0.000304754 | Time: 2447.09 ms
[2020-12-08 13:16:51 main:574] : INFO : Epoch 557 | loss: 0.000282337 | val_loss: 0.000306006 | Time: 2617.82 ms
[2020-12-08 13:16:54 main:574] : INFO : Epoch 558 | loss: 0.000447628 | val_loss: 0.000401415 | Time: 2527.33 ms
[2020-12-08 13:16:56 main:574] : INFO : Epoch 559 | loss: 0.000324484 | val_loss: 0.000314479 | Time: 2498.8 ms
[2020-12-08 13:16:59 main:574] : INFO : Epoch 560 | loss: 0.000284858 | val_loss: 0.000298467 | Time: 2503.82 ms
[2020-12-08 13:17:01 main:574] : INFO : Epoch 561 | loss: 0.00027823 | val_loss: 0.000303551 | Time: 2507.85 ms
[2020-12-08 13:17:04 main:574] : INFO : Epoch 562 | loss: 0.000380259 | val_loss: 0.000387478 | Time: 2433.11 ms
[2020-12-08 13:17:06 main:574] : INFO : Epoch 563 | loss: 0.000351667 | val_loss: 0.000328272 | Time: 2504.15 ms
[2020-12-08 13:17:09 main:574] : INFO : Epoch 564 | loss: 0.000295003 | val_loss: 0.000305008 | Time: 2430.86 ms
[2020-12-08 13:17:11 main:574] : INFO : Epoch 565 | loss: 0.000302634 | val_loss: 0.000448251 | Time: 2528.06 ms
[2020-12-08 13:17:14 main:574] : INFO : Epoch 566 | loss: 0.000387276 | val_loss: 0.000337437 | Time: 2418.53 ms
[2020-12-08 13:17:16 main:574] : INFO : Epoch 567 | loss: 0.000302146 | val_loss: 0.000303294 | Time: 2456.85 ms
[2020-12-08 13:17:19 main:574] : INFO : Epoch 568 | loss: 0.000282889 | val_loss: 0.000342085 | Time: 2497.67 ms
[2020-12-08 13:17:21 main:574] : INFO : Epoch 569 | loss: 0.000450964 | val_loss: 0.000402952 | Time: 2460.4 ms
[2020-12-08 13:17:24 main:574] : INFO : Epoch 570 | loss: 0.000311959 | val_loss: 0.000309042 | Time: 2627.18 ms
[2020-12-08 13:17:26 main:574] : INFO : Epoch 571 | loss: 0.000282893 | val_loss: 0.000295742 | Time: 2433.92 ms
[2020-12-08 13:17:29 main:574] : INFO : Epoch 572 | loss: 0.000325096 | val_loss: 0.000648934 | Time: 2482.99 ms
[2020-12-08 13:17:31 main:574] : INFO : Epoch 573 | loss: 0.000432215 | val_loss: 0.000353259 | Time: 2380.1 ms
[2020-12-08 13:17:34 main:574] : INFO : Epoch 574 | loss: 0.000302473 | val_loss: 0.000306923 | Time: 2630.12 ms
[2020-12-08 13:17:37 main:574] : INFO : Epoch 575 | loss: 0.000279405 | val_loss: 0.000295439 | Time: 2582.06 ms
[2020-12-08 13:17:39 main:574] : INFO : Epoch 576 | loss: 0.000362948 | val_loss: 0.000345116 | Time: 2554.89 ms
[2020-12-08 13:17:42 main:574] : INFO : Epoch 577 | loss: 0.00031756 | val_loss: 0.000319099 | Time: 2414.71 ms
[2020-12-08 13:17:44 main:574] : INFO : Epoch 578 | loss: 0.00028901 | val_loss: 0.000297352 | Time: 2459.06 ms
[2020-12-08 13:17:47 main:574] : INFO : Epoch 579 | loss: 0.000396755 | val_loss: 0.000418076 | Time: 2445.92 ms
[2020-12-08 13:17:49 main:574] : INFO : Epoch 580 | loss: 0.00035498 | val_loss: 0.000337943 | Time: 2453.92 ms
[2020-12-08 13:17:51 main:574] : INFO : Epoch 581 | loss: 0.000296428 | val_loss: 0.000300959 | Time: 2441.17 ms
[2020-12-08 13:17:54 main:574] : INFO : Epoch 582 | loss: 0.000291223 | val_loss: 0.000360972 | Time: 2394.83 ms
[2020-12-08 13:17:56 main:574] : INFO : Epoch 583 | loss: 0.000372997 | val_loss: 0.0003426 | Time: 2409.45 ms
[2020-12-08 13:17:59 main:574] : INFO : Epoch 584 | loss: 0.000303595 | val_loss: 0.000301019 | Time: 2363.44 ms
[2020-12-08 13:18:01 main:574] : INFO : Epoch 585 | loss: 0.000284544 | val_loss: 0.000306411 | Time: 2517.97 ms
[2020-12-08 13:18:04 main:574] : INFO : Epoch 586 | loss: 0.000396661 | val_loss: 0.00046261 | Time: 2423.42 ms
[2020-12-08 13:18:06 main:574] : INFO : Epoch 587 | loss: 0.000369751 | val_loss: 0.000319666 | Time: 2531.63 ms
[2020-12-08 13:18:09 main:574] : INFO : Epoch 588 | loss: 0.000287987 | val_loss: 0.000300296 | Time: 2372.41 ms
[2020-12-08 13:18:11 main:574] : INFO : Epoch 589 | loss: 0.000290792 | val_loss: 0.000352796 | Time: 2425.91 ms
[2020-12-08 13:18:14 main:574] : INFO : Epoch 590 | loss: 0.000384827 | val_loss: 0.000357241 | Time: 2473.57 ms
[2020-12-08 13:18:16 main:574] : INFO : Epoch 591 | loss: 0.000302623 | val_loss: 0.000297344 | Time: 2469.67 ms
[2020-12-08 13:18:19 main:574] : INFO : Epoch 592 | loss: 0.000281191 | val_loss: 0.000295065 | Time: 2481.86 ms
[2020-12-08 13:18:21 main:574] : INFO : Epoch 593 | loss: 0.000315549 | val_loss: 0.000549461 | Time: 2468.62 ms
[2020-12-08 13:18:24 main:574] : INFO : Epoch 594 | loss: 0.000442804 | val_loss: 0.00036812 | Time: 2576.7 ms
[2020-12-08 13:18:26 main:574] : INFO : Epoch 595 | loss: 0.000310289 | val_loss: 0.000301492 | Time: 2508.75 ms
[2020-12-08 13:18:29 main:574] : INFO : Epoch 596 | loss: 0.000277677 | val_loss: 0.000294782 | Time: 2457.94 ms
[2020-12-08 13:18:31 main:574] : INFO : Epoch 597 | loss: 0.000338276 | val_loss: 0.000585696 | Time: 2534.77 ms
[2020-12-08 13:18:34 main:574] : INFO : Epoch 598 | loss: 0.000388566 | val_loss: 0.000363797 | Time: 2456.21 ms
[2020-12-08 13:18:36 main:574] : INFO : Epoch 599 | loss: 0.000299943 | val_loss: 0.000301629 | Time: 2461.85 ms
[2020-12-08 13:18:39 main:574] : INFO : Epoch 600 | loss: 0.000306049 | val_loss: 0.000423469 | Time: 2523.11 ms
[2020-12-08 13:18:41 main:574] : INFO : Epoch 601 | loss: 0.000372491 | val_loss: 0.000416661 | Time: 2476.53 ms
[2020-12-08 13:18:44 main:574] : INFO : Epoch 602 | loss: 0.000320194 | val_loss: 0.000308131 | Time: 2497.65 ms
[2020-12-08 13:18:46 main:574] : INFO : Epoch 603 | loss: 0.000284442 | val_loss: 0.000311574 | Time: 2628.17 ms
[2020-12-08 13:18:49 main:574] : INFO : Epoch 604 | loss: 0.000386816 | val_loss: 0.000394511 | Time: 2594.56 ms
[2020-12-08 13:18:52 main:574] : INFO : Epoch 605 | loss: 0.000315371 | val_loss: 0.000306256 | Time: 2507.49 ms
[2020-12-08 13:18:54 main:574] : INFO : Epoch 606 | loss: 0.000281289 | val_loss: 0.000302707 | Time: 2532.07 ms
[2020-12-08 13:18:57 main:574] : INFO : Epoch 607 | loss: 0.00033353 | val_loss: 0.00032386 | Time: 2555.26 ms
[2020-12-08 13:18:59 main:574] : INFO : Epoch 608 | loss: 0.000312159 | val_loss: 0.000303049 | Time: 2494.34 ms
[2020-12-08 13:19:02 main:574] : INFO : Epoch 609 | loss: 0.00028857 | val_loss: 0.000328611 | Time: 2692.05 ms
[2020-12-08 13:19:04 main:574] : INFO : Epoch 610 | loss: 0.000403497 | val_loss: 0.000404442 | Time: 2518.63 ms
[2020-12-08 13:19:07 main:574] : INFO : Epoch 611 | loss: 0.000318222 | val_loss: 0.000302836 | Time: 2462.55 ms
[2020-12-08 13:19:09 main:574] : INFO : Epoch 612 | loss: 0.000288151 | val_loss: 0.000304383 | Time: 2367.26 ms
[2020-12-08 13:19:12 main:574] : INFO : Epoch 613 | loss: 0.000288985 | val_loss: 0.000332356 | Time: 2408.1 ms
[2020-12-08 13:19:14 main:574] : INFO : Epoch 614 | loss: 0.000369499 | val_loss: 0.000374488 | Time: 2476.15 ms
[2020-12-08 13:19:17 main:574] : INFO : Epoch 615 | loss: 0.000344156 | val_loss: 0.000317543 | Time: 2697.19 ms
[2020-12-08 13:19:20 main:574] : INFO : Epoch 616 | loss: 0.000286288 | val_loss: 0.000306157 | Time: 2633.3 ms
[2020-12-08 13:19:22 main:574] : INFO : Epoch 617 | loss: 0.00036899 | val_loss: 0.000585951 | Time: 2632.82 ms
[2020-12-08 13:19:25 main:574] : INFO : Epoch 618 | loss: 0.000403159 | val_loss: 0.000342394 | Time: 2379.85 ms
[2020-12-08 13:19:27 main:574] : INFO : Epoch 619 | loss: 0.000298866 | val_loss: 0.000301059 | Time: 2294.03 ms
[2020-12-08 13:19:29 main:574] : INFO : Epoch 620 | loss: 0.000278449 | val_loss: 0.000303905 | Time: 2336.99 ms
[2020-12-08 13:19:32 main:574] : INFO : Epoch 621 | loss: 0.000346598 | val_loss: 0.000358746 | Time: 2315.78 ms
[2020-12-08 13:19:34 main:574] : INFO : Epoch 622 | loss: 0.000298436 | val_loss: 0.000307425 | Time: 2270.91 ms
[2020-12-08 13:19:36 main:574] : INFO : Epoch 623 | loss: 0.000284804 | val_loss: 0.000332295 | Time: 2345.24 ms
[2020-12-08 13:19:39 main:574] : INFO : Epoch 624 | loss: 0.000428521 | val_loss: 0.00062514 | Time: 2355.32 ms
[2020-12-08 13:19:41 main:574] : INFO : Epoch 625 | loss: 0.00040304 | val_loss: 0.000331856 | Time: 2345.79 ms
[2020-12-08 13:19:43 main:574] : INFO : Epoch 626 | loss: 0.000293346 | val_loss: 0.000301841 | Time: 2375.34 ms
[2020-12-08 13:19:46 main:574] : INFO : Epoch 627 | loss: 0.000275602 | val_loss: 0.000292284 | Time: 2341.55 ms
[2020-12-08 13:19:48 main:574] : INFO : Epoch 628 | loss: 0.000303068 | val_loss: 0.000465131 | Time: 2379.38 ms
[2020-12-08 13:19:51 main:574] : INFO : Epoch 629 | loss: 0.000353833 | val_loss: 0.000316808 | Time: 2433.25 ms
[2020-12-08 13:19:53 main:574] : INFO : Epoch 630 | loss: 0.00029211 | val_loss: 0.000315621 | Time: 2342.56 ms
[2020-12-08 13:19:55 main:574] : INFO : Epoch 631 | loss: 0.000310972 | val_loss: 0.000301649 | Time: 2323.87 ms
[2020-12-08 13:19:58 main:574] : INFO : Epoch 632 | loss: 0.000287729 | val_loss: 0.00032132 | Time: 2572.86 ms
[2020-12-08 13:20:00 main:574] : INFO : Epoch 633 | loss: 0.000410481 | val_loss: 0.000401813 | Time: 2286.26 ms
[2020-12-08 13:20:03 main:574] : INFO : Epoch 634 | loss: 0.000327655 | val_loss: 0.000326032 | Time: 2392.83 ms
[2020-12-08 13:20:05 main:574] : INFO : Epoch 635 | loss: 0.000292672 | val_loss: 0.000357011 | Time: 2310.94 ms
[2020-12-08 13:20:07 main:574] : INFO : Epoch 636 | loss: 0.000318431 | val_loss: 0.000329946 | Time: 2368.94 ms
[2020-12-08 13:20:10 main:574] : INFO : Epoch 637 | loss: 0.000290542 | val_loss: 0.000301465 | Time: 2406.48 ms
[2020-12-08 13:20:12 main:574] : INFO : Epoch 638 | loss: 0.000351747 | val_loss: 0.000539702 | Time: 2382.77 ms
[2020-12-08 13:20:15 main:574] : INFO : Epoch 639 | loss: 0.000393105 | val_loss: 0.000375713 | Time: 2351.87 ms
[2020-12-08 13:20:17 main:574] : INFO : Epoch 640 | loss: 0.000309095 | val_loss: 0.000305275 | Time: 2280.65 ms
[2020-12-08 13:20:19 main:574] : INFO : Epoch 641 | loss: 0.000280639 | val_loss: 0.000328139 | Time: 2308.38 ms
[2020-12-08 13:20:22 main:574] : INFO : Epoch 642 | loss: 0.000342951 | val_loss: 0.000358563 | Time: 2320.6 ms
[2020-12-08 13:20:24 main:574] : INFO : Epoch 643 | loss: 0.000314635 | val_loss: 0.000323501 | Time: 2347.42 ms
[2020-12-08 13:20:26 main:574] : INFO : Epoch 644 | loss: 0.000318408 | val_loss: 0.000299592 | Time: 2378.1 ms
[2020-12-08 13:20:29 main:574] : INFO : Epoch 645 | loss: 0.000281532 | val_loss: 0.000295329 | Time: 2394.94 ms
[2020-12-08 13:20:31 main:574] : INFO : Epoch 646 | loss: 0.000353967 | val_loss: 0.000562962 | Time: 2323.92 ms
[2020-12-08 13:20:33 main:574] : INFO : Epoch 647 | loss: 0.000426097 | val_loss: 0.00033463 | Time: 2271.78 ms
[2020-12-08 13:20:36 main:574] : INFO : Epoch 648 | loss: 0.00029725 | val_loss: 0.000294782 | Time: 2436.68 ms
[2020-12-08 13:20:38 main:574] : INFO : Epoch 649 | loss: 0.000271534 | val_loss: 0.000288373 | Time: 2379.92 ms
[2020-12-08 13:20:41 main:574] : INFO : Epoch 650 | loss: 0.000279233 | val_loss: 0.000353792 | Time: 2280.92 ms
[2020-12-08 13:20:43 main:574] : INFO : Epoch 651 | loss: 0.000446578 | val_loss: 0.000437727 | Time: 2372.16 ms
[2020-12-08 13:20:45 main:574] : INFO : Epoch 652 | loss: 0.000374651 | val_loss: 0.000319895 | Time: 2293.25 ms
[2020-12-08 13:20:48 main:574] : INFO : Epoch 653 | loss: 0.000287562 | val_loss: 0.000298167 | Time: 2320.68 ms
[2020-12-08 13:20:50 main:574] : INFO : Epoch 654 | loss: 0.000271822 | val_loss: 0.000298898 | Time: 2365.17 ms
[2020-12-08 13:20:52 main:574] : INFO : Epoch 655 | loss: 0.000317309 | val_loss: 0.000299584 | Time: 2292.4 ms
[2020-12-08 13:20:55 main:574] : INFO : Epoch 656 | loss: 0.000282569 | val_loss: 0.000294781 | Time: 2336.88 ms
[2020-12-08 13:20:57 main:574] : INFO : Epoch 657 | loss: 0.000337097 | val_loss: 0.000361378 | Time: 2295.3 ms
[2020-12-08 13:20:59 main:574] : INFO : Epoch 658 | loss: 0.000316685 | val_loss: 0.000321652 | Time: 2306.87 ms
[2020-12-08 13:21:02 main:574] : INFO : Epoch 659 | loss: 0.000282114 | val_loss: 0.000291994 | Time: 2366.04 ms
[2020-12-08 13:21:04 main:574] : INFO : Epoch 660 | loss: 0.000280713 | val_loss: 0.000402544 | Time: 2290.65 ms
[2020-12-08 13:21:06 main:574] : INFO : Epoch 661 | loss: 0.000564806 | val_loss: 0.000460521 | Time: 2356.62 ms
[2020-12-08 13:21:09 main:574] : INFO : Epoch 662 | loss: 0.000365459 | val_loss: 0.000332573 | Time: 2502.2 ms
[2020-12-08 13:21:11 main:574] : INFO : Epoch 663 | loss: 0.00028518 | val_loss: 0.00029402 | Time: 2423.28 ms
[2020-12-08 13:21:14 main:574] : INFO : Epoch 664 | loss: 0.00026997 | val_loss: 0.000288338 | Time: 2321.97 ms
[2020-12-08 13:21:16 main:574] : INFO : Epoch 665 | loss: 0.000299829 | val_loss: 0.000368218 | Time: 2372.67 ms
[2020-12-08 13:21:19 main:574] : INFO : Epoch 666 | loss: 0.000293732 | val_loss: 0.000299738 | Time: 2399.13 ms
[2020-12-08 13:21:21 main:574] : INFO : Epoch 667 | loss: 0.000292204 | val_loss: 0.000340274 | Time: 2411.12 ms
[2020-12-08 13:21:23 main:574] : INFO : Epoch 668 | loss: 0.000402932 | val_loss: 0.000325891 | Time: 2454.15 ms
[2020-12-08 13:21:26 main:574] : INFO : Epoch 669 | loss: 0.000295505 | val_loss: 0.000302561 | Time: 2465.34 ms
[2020-12-08 13:21:28 main:574] : INFO : Epoch 670 | loss: 0.000275853 | val_loss: 0.000313163 | Time: 2410.28 ms
[2020-12-08 13:21:31 main:574] : INFO : Epoch 671 | loss: 0.000401211 | val_loss: 0.000372252 | Time: 2507.73 ms
[2020-12-08 13:21:33 main:574] : INFO : Epoch 672 | loss: 0.000303113 | val_loss: 0.000296616 | Time: 2479.41 ms
[2020-12-08 13:21:36 main:574] : INFO : Epoch 673 | loss: 0.0002719 | val_loss: 0.000288162 | Time: 2417.07 ms
[2020-12-08 13:21:38 main:574] : INFO : Epoch 674 | loss: 0.000282209 | val_loss: 0.000392045 | Time: 2395.52 ms
[2020-12-08 13:21:41 main:574] : INFO : Epoch 675 | loss: 0.000412533 | val_loss: 0.000383086 | Time: 2433.48 ms
[2020-12-08 13:21:43 main:574] : INFO : Epoch 676 | loss: 0.000314213 | val_loss: 0.00029771 | Time: 2277.3 ms
[2020-12-08 13:21:46 main:574] : INFO : Epoch 677 | loss: 0.000272326 | val_loss: 0.000288527 | Time: 2488.42 ms
[2020-12-08 13:21:48 main:574] : INFO : Epoch 678 | loss: 0.000331945 | val_loss: 0.000471143 | Time: 2414.14 ms
[2020-12-08 13:21:50 main:574] : INFO : Epoch 679 | loss: 0.000348599 | val_loss: 0.000321682 | Time: 2420.82 ms
[2020-12-08 13:21:53 main:574] : INFO : Epoch 680 | loss: 0.000281915 | val_loss: 0.000294122 | Time: 2395.27 ms
[2020-12-08 13:21:55 main:574] : INFO : Epoch 681 | loss: 0.000267053 | val_loss: 0.000283758 | Time: 2465.24 ms
[2020-12-08 13:21:58 main:574] : INFO : Epoch 682 | loss: 0.000487473 | val_loss: 0.000564511 | Time: 2361.21 ms
[2020-12-08 13:22:00 main:574] : INFO : Epoch 683 | loss: 0.000587792 | val_loss: 0.000413994 | Time: 2313.93 ms
[2020-12-08 13:22:03 main:574] : INFO : Epoch 684 | loss: 0.000364718 | val_loss: 0.000329137 | Time: 2414.1 ms
[2020-12-08 13:22:05 main:574] : INFO : Epoch 685 | loss: 0.000285941 | val_loss: 0.000293371 | Time: 2371.23 ms
[2020-12-08 13:22:08 main:574] : INFO : Epoch 686 | loss: 0.000271399 | val_loss: 0.00031912 | Time: 2572.02 ms
[2020-12-08 13:22:10 main:574] : INFO : Epoch 687 | loss: 0.000311847 | val_loss: 0.000303958 | Time: 2480.49 ms
[2020-12-08 13:22:12 main:574] : INFO : Epoch 688 | loss: 0.000271281 | val_loss: 0.000287067 | Time: 2419.46 ms
[2020-12-08 13:22:15 main:574] : INFO : Epoch 689 | loss: 0.000316919 | val_loss: 0.000423727 | Time: 2457.47 ms
[2020-12-08 13:22:17 main:574] : INFO : Epoch 690 | loss: 0.000350224 | val_loss: 0.000323628 | Time: 2347.96 ms
[2020-12-08 13:22:20 main:574] : INFO : Epoch 691 | loss: 0.000282043 | val_loss: 0.000289235 | Time: 2492.08 ms
[2020-12-08 13:22:22 main:574] : INFO : Epoch 692 | loss: 0.000275854 | val_loss: 0.000330583 | Time: 2487.93 ms
[2020-12-08 13:22:25 main:574] : INFO : Epoch 693 | loss: 0.000364843 | val_loss: 0.000307271 | Time: 2469.02 ms
[2020-12-08 13:22:27 main:574] : INFO : Epoch 694 | loss: 0.000290826 | val_loss: 0.000296186 | Time: 2447.13 ms
[2020-12-08 13:22:30 main:574] : INFO : Epoch 695 | loss: 0.00027137 | val_loss: 0.00029516 | Time: 2357.4 ms
[2020-12-08 13:22:32 main:574] : INFO : Epoch 696 | loss: 0.000394287 | val_loss: 0.000404671 | Time: 2496.26 ms
[2020-12-08 13:22:35 main:574] : INFO : Epoch 697 | loss: 0.000316324 | val_loss: 0.000301044 | Time: 2481.49 ms
[2020-12-08 13:22:37 main:574] : INFO : Epoch 698 | loss: 0.000281849 | val_loss: 0.000322375 | Time: 2445.44 ms
[2020-12-08 13:22:40 main:574] : INFO : Epoch 699 | loss: 0.000376221 | val_loss: 0.000330646 | Time: 2455.98 ms
[2020-12-08 13:22:42 main:574] : INFO : Epoch 700 | loss: 0.000291918 | val_loss: 0.0002938 | Time: 2499.41 ms
[2020-12-08 13:22:45 main:574] : INFO : Epoch 701 | loss: 0.000267621 | val_loss: 0.000285373 | Time: 2360.65 ms
[2020-12-08 13:22:47 main:574] : INFO : Epoch 702 | loss: 0.000278356 | val_loss: 0.000433097 | Time: 2455.28 ms
[2020-12-08 13:22:49 main:574] : INFO : Epoch 703 | loss: 0.00043812 | val_loss: 0.000322595 | Time: 2424.46 ms
[2020-12-08 13:22:52 main:574] : INFO : Epoch 704 | loss: 0.000291686 | val_loss: 0.000297358 | Time: 2412.26 ms
[2020-12-08 13:22:54 main:574] : INFO : Epoch 705 | loss: 0.000269991 | val_loss: 0.000287232 | Time: 2392.6 ms
[2020-12-08 13:22:57 main:574] : INFO : Epoch 706 | loss: 0.000283457 | val_loss: 0.000458081 | Time: 2357.7 ms
[2020-12-08 13:22:59 main:574] : INFO : Epoch 707 | loss: 0.000379176 | val_loss: 0.000322348 | Time: 2466.35 ms
[2020-12-08 13:23:02 main:574] : INFO : Epoch 708 | loss: 0.000288086 | val_loss: 0.000301897 | Time: 2316.71 ms
[2020-12-08 13:23:04 main:574] : INFO : Epoch 709 | loss: 0.000273348 | val_loss: 0.000327815 | Time: 2409.15 ms
[2020-12-08 13:23:06 main:574] : INFO : Epoch 710 | loss: 0.000403026 | val_loss: 0.00031652 | Time: 2346.68 ms
[2020-12-08 13:23:09 main:574] : INFO : Epoch 711 | loss: 0.000296297 | val_loss: 0.000293344 | Time: 2449.98 ms
[2020-12-08 13:23:11 main:574] : INFO : Epoch 712 | loss: 0.000269566 | val_loss: 0.00029446 | Time: 2464.23 ms
[2020-12-08 13:23:14 main:574] : INFO : Epoch 713 | loss: 0.000290394 | val_loss: 0.000374215 | Time: 2495.07 ms
[2020-12-08 13:23:16 main:574] : INFO : Epoch 714 | loss: 0.000336941 | val_loss: 0.000325646 | Time: 2506.05 ms
[2020-12-08 13:23:19 main:574] : INFO : Epoch 715 | loss: 0.000295417 | val_loss: 0.000300974 | Time: 2409.63 ms
[2020-12-08 13:23:21 main:574] : INFO : Epoch 716 | loss: 0.000322512 | val_loss: 0.000638735 | Time: 2395.69 ms
[2020-12-08 13:23:24 main:574] : INFO : Epoch 717 | loss: 0.000387336 | val_loss: 0.000327034 | Time: 2382.8 ms
[2020-12-08 13:23:26 main:574] : INFO : Epoch 718 | loss: 0.000281781 | val_loss: 0.000290132 | Time: 2409.35 ms
[2020-12-08 13:23:28 main:574] : INFO : Epoch 719 | loss: 0.000280816 | val_loss: 0.000289825 | Time: 2317.84 ms
[2020-12-08 13:23:31 main:574] : INFO : Epoch 720 | loss: 0.000295842 | val_loss: 0.000365844 | Time: 2419.49 ms
[2020-12-08 13:23:33 main:574] : INFO : Epoch 721 | loss: 0.000348177 | val_loss: 0.000317211 | Time: 2418.73 ms
[2020-12-08 13:23:36 main:574] : INFO : Epoch 722 | loss: 0.000286742 | val_loss: 0.000306615 | Time: 2342.64 ms
[2020-12-08 13:23:38 main:574] : INFO : Epoch 723 | loss: 0.00031053 | val_loss: 0.000352756 | Time: 2409.18 ms
[2020-12-08 13:23:40 main:574] : INFO : Epoch 724 | loss: 0.000347743 | val_loss: 0.000322526 | Time: 2382.82 ms
[2020-12-08 13:23:43 main:574] : INFO : Epoch 725 | loss: 0.000298627 | val_loss: 0.000301122 | Time: 2388.25 ms
[2020-12-08 13:23:45 main:574] : INFO : Epoch 726 | loss: 0.000269307 | val_loss: 0.000286329 | Time: 2270.29 ms
THCudaCheck FAIL file=..\..\aten\src\THC\THCCachingHostAllocator.cpp line=278 error=719 : unspecified launch failure
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFC6C79D759
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 12/08/20 13:23:45
Install Directory : C:\Program Files\BOINC\
Data Directory : C:\ProgramData\BOINC
Project Symstore :
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\6;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 00000000eef60000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000006f510000 00000000001f6000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.662
ModLoad: 000000006f390000 00000000000bd000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.662
ModLoad: 000000006c770000 00000000002c9000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.662
ModLoad: 000000006f1f0000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.610) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 000000006ca40000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.662
ModLoad: 000000006dfa0000 000000000002a000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000006c360000 0000000000109000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.572) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.572 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.572
ModLoad: 000000006c620000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000006ca70000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000006def0000 00000000000ac000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.610) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 000000006d760000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.19041.546
ModLoad: 000000006cc10000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000006e9f0000 000000000012b000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 00000000fcee0000 0000000024b49000 C:\ProgramData\BOINC\slots\6\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000f22f0000 000000000abe7000 C:\ProgramData\BOINC\slots\6\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000062b40000 0000000000058000 C:\ProgramData\BOINC\slots\6\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000062de0000 0000000000045000 C:\ProgramData\BOINC\slots\6\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000028bc0000 00000000034b2000 C:\ProgramData\BOINC\slots\6\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 0000000068cd0000 0000000000010000 C:\ProgramData\BOINC\slots\6\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 00000000e9150000 000000000919f000 C:\ProgramData\BOINC\slots\6\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 0000000025b10000 00000000030a5000 C:\ProgramData\BOINC\slots\6\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 0000000062aa0000 0000000000091000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.25.28508.3) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\8\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.25.28508.3 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.25.28508.3
ModLoad: 0000000062bb0000 0000000000019000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.25.28508.3) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\8\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.25.28508.3 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.25.28508.3
ModLoad: 0000000062a90000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.25.28508.3) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\8\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.25.28508.3 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.25.28508.3
ModLoad: 00000000cdda0000 000000001b3a4000 C:\ProgramData\BOINC\slots\6\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 000000004d540000 000000000020d000 C:\ProgramData\BOINC\slots\6\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 0000000057300000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.488) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.488 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.488
ModLoad: 0000000044620000 00000000002db000 C:\ProgramData\BOINC\slots\6\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000005d3b0000 0000000000040000 C:\ProgramData\BOINC\slots\6\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000ca040000 0000000003d5b000 C:\ProgramData\BOINC\slots\6\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 0000000030d70000 0000000001eca000 C:\ProgramData\BOINC\slots\6\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 000000006cbd0000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000006a220000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000006e030000 0000000000467000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 000000006c470000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000006c740000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 000000006bf90000 000000000002c000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000006cb70000 0000000000060000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.662
ModLoad: 000000006c4c0000 000000000015d000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 000000006bdd0000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000006d010000 0000000000742000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 000000006a420000 0000000000795000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 000000006ccb0000 0000000000356000 C:\WINDOWS\System32\combase.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 000000006bc50000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 000000006e940000 00000000000ae000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 000000006d800000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 0000000035eb0000 0000000000267000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.5751) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 27.21.14.5751
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.1.114 driver
Product Version : 27.21.14.5751
ModLoad: 00000000665f0000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000032c40000 000000000152c000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_372920ce6be76248\nvcuda64.dll (27.21.14.5751) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 27.21.14.5751
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.1.114 driver
Product Version : 27.21.14.5751
ModLoad: 000000006de80000 000000000006b000 C:\WINDOWS\System32\WS2_32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : ws2_32.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 00000000665b0000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000006bbc0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000069d60000 000000000009e000 C:\WINDOWS\system32\uxtheme.dll (6.2.19041.610) (-exported- Symbols Loaded)
Linked PDB Filename : UxTheme.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 0000000060a40000 00000000006d6000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.5751) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 27.21.14.5751
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 27.21.14.5751
ModLoad: 000000006e4b0000 000000000012a000 C:\WINDOWS\System32\OLE32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : ole32.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 0000000062a80000 0000000000009000 C:\ProgramData\BOINC\slots\6\caffe2_nvrtc.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000024b40000 0000000000fca000 C:\ProgramData\BOINC\slots\6\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6.14.11.9000
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.89 NVRTC Library
Product Version : 6.14.11.9000
ModLoad: 000000006c6c0000 0000000000080000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.662
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 4351, Write: 3072, Other 12245
- I/O Transfers Counters -
Read: 9189758, Write: 1567355, Other 145968
- Paged Pool Usage -
QuotaPagedPoolUsage: 3505976, QuotaPeakPagedPoolUsage: 3506568
QuotaNonPagedPoolUsage: 51808, QuotaPeakNonPagedPoolUsage: 52360
- Virtual Memory Usage -
VirtualSize: -408731648, PeakVirtualSize: 205078528
- Pagefile Usage -
PagefileUsage: -408731648, PeakPagefileUsage: -408731648
- Working Set Size -
WorkingSetSize: 1724805120, PeakWorkingSetSize: 1760673792, PageFaultCount: 635958
*** Dump of thread ID 5112 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 743750016.000000, User Time: 9190468608.000000, Wait Time: 20365460.000000
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFC6C79D759
- Registers -
rax=0000000000000000 rbx=00000000fc7662f0 rcx=0000000000000000 rdx=0000000000000000 rsi=000000009d1e4300 rdi=0000000019930520
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000000006000 r13=0000000000000000
r14=000000009d1e5040 r15=000000009d1e4fc0 rip=000000006c79d759 rsp=000000009d1e41a0 rbp=000000009d1e4ba8
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000206
- Callstack -
ChildEBP RetAddr Args to Child
9d1e4270 62bb61e0 e6a3be95 00000000 9d1e5040 f78ba014 KERNELBASE!RaiseException+0x0
9d1e42d0 f7eb5272 e6a3bd35 00000000 000007cb 00000116 VCRUNTIME140!_CxxThrowException+0x0
9d1e4320 f7eb56d4 00000000 6f52786b faedd290 00745f68 torch_cpu!at::Tensor::zero_+0x0
9d1e4b80 ffd09ebe 9d1e4db0 00746850 00746880 000002cf torch_cpu!_THError+0x0
9d1e4bc0 ffd05412 9d1e4db0 9d1e4d10 cc0e86e0 00b7a720 torch_cuda!__THCudaCheck+0x0
9d1e4c00 f7b659ff 9d1e4f00 9d1e4db0 9d1e5280 62b797b0 torch_cuda!at::native::set_storage_cuda_+0x0
9d1e4f90 f7d0726f 0037f630 f78bea63 00000001 62b5ef8f torch_cpu!at::native::empty_cpu+0x0
9d1e4fd0 f7cc0615 9d1e0000 9d1e5048 9d1e5240 62b47ce6 torch_cpu!at::native::mkldnn_sigmoid_+0x0
9d1e5010 f7cc204a 9d1e0000 9d1e5000 cc0c4b00 ff046ae5 torch_cpu!at::native::mkldnn_sigmoid_+0x0
9d1e50a0 f7cc0615 00000000 f78bea63 9d1e5180 9d1e5280 torch_cpu!at::native::mkldnn_sigmoid_+0x0
9d1e50e0 f7d91eb0 9d1e0000 00000000 9d1e5268 00000001 torch_cpu!at::native::mkldnn_sigmoid_+0x0
9d1e5180 f7da2eec d6b82635 62b79c50 9d1e52e0 62b43bd6 torch_cpu!at::bucketize_out+0x0
9d1e51d0 ff40f160 9d1e0000 00000000 9d1e52e0 00000000 torch_cpu!at::empty+0x0
9d1e5570 ff412de8 62b79c50 f78c0528 ccfc77b0 62b79c50 torch_cuda!at::native::cummin_helper_cuda+0x0
9d1e5750 ff414379 9d1e5860 1ffb4160 9d1e5c60 1ffb4178 torch_cuda!at::native::cummin_helper_cuda+0x0
9d1e5990 ff413d64 9d1e0000 9d1e5c60 9d1e5aa0 9d1e5c60 torch_cuda!at::native::cat_out_cuda+0x0
9d1e5b90 ffcb1dd2 9d1e5be8 00000001 9d1e5be8 9d1e5c60 torch_cuda!at::native::cat_cuda+0x0
9d1e5c10 ffcc4179 00000001 9d1e5c50 ccfc9008 04000000 torch_cuda!at::native::set_storage_cuda_+0x0
9d1e5c50 f7d91d7d 0dded500 9d1e5fc0 9d1e5f90 00000000 torch_cuda!at::native::set_storage_cuda_+0x0
9d1e5cd0 f7d70d81 00000000 62b63994 9d1e64a0 1ffb3ae0 torch_cpu!at::bucketize_out+0x0
9d1e5d10 f7b7b4a5 9d1e5d50 ccfc73b0 9d1e5e20 9d1e5e90 torch_cpu!at::_cat+0x0
9d1e5de0 f7e627bd 9d1e5eb0 00000101 9d1e5e38 62b91ea8 torch_cpu!at::native::cat+0x0
9d1e5e60 f79229ae 1ffb45a0 1ffb45b0 1ffb45b8 9d1e5e18 torch_cpu!at::zeros_out+0x0
9d1e5ea0 f7d91d7d 9d1e5ee0 9d1e5f50 00000000 6f525d21 torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0
9d1e5f20 f7d975d1 9d1e64c0 fcc10640 9d1e64a0 1ffb3ae0 torch_cpu!at::bucketize_out+0x0
9d1e5f60 f7b87d4c 9d1e61f0 00000000 9d1e61f0 00000000 torch_cpu!at::cat+0x0
9d1e6120 f7e7c38d 9d1e6178 00000001 9d1e6178 9d1e61f0 torch_cpu!at::native::stack+0x0
9d1e61a0 f79229ae 9d1e64a0 1ffb3ae0 00000000 00000000 torch_cpu!at::zeros_out+0x0
9d1e61e0 f7d91d7d 9d1e6220 9d1e6290 00000000 fab31c8f torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0
9d1e6260 f7de02e1 9d1e6390 62b63720 9d1e64c0 fcc10640 torch_cpu!at::bucketize_out+0x0
9d1e62a0 f9173839 9d1e6320 ccfcc8f0 ccfcc8f0 9d1e63b0 torch_cpu!at::stack+0x0
9d1e6470 f79229ae 00000000 9d1e65c0 00000000 9d1e6560 torch_cpu!torch::autograd::GraphRoot::apply+0x0
9d1e64b0 f7d91d7d 9d1e64f0 9d1e6560 ccfca460 00000000 torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0
9d1e6530 f7de02e1 9d1e66a0 f78b9cac 1ee29440 1ffb3ae0 torch_cpu!at::bucketize_out+0x0
9d1e6570 eef6ff7e 9d1e6638 0e1b8ad0 0e1b8ad0 9d1e6780 torch_cpu!at::stack+0x0
9d1e6610 eef72ef8 eef6fe30 9d1e6650 9d1e6650 9d1e66a0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::addCallback+0x0
9d1e6670 eef73ea4 80fc1df0 6f525d21 9d1e6810 cb560000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Object::getSlot+0x0
9d1e67b0 eef6d3d2 1de23f10 22a64020 9d1e6810 6f5295f1 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::markCompleted+0x0
9d1e67e0 eef74541 00000000 22a66570 071d8890 6f5295f1 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Object::operator=+0x0
9d1e6990 eef7743a 9d1e6a60 00000000 9d1e74a0 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::markCompleted+0x0
9d1e6e90 eef7b950 9d1e6f90 9d1e6f90 00000000 a847ea60 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0
9d1ffc30 ef1bc6f8 cd03cf30 00000000 00000000 cb56af30 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
9d1ffc70 6f3a7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
9d1ffca0 6f55d0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
9d1ffd20 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 2880 (state: Waiting): ***
- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 20365460.000000
- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=000000009d8ffe60 rsi=0000000000000000 rdi=0000000000000064
r8=000000009d8ffe38 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000006f5ac634 rsp=000000009d8ffe38 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
9d8ffe30 6c7bd84e 9d8ffef8 00000000 00000000 00000000 ntdll!ZwDelayExecution+0x0
9d8ffed0 eef9a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0
9d8fff00 6f3a7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
9d8fff30 6f55d0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
9d8fffb0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 3024 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 20365460.000000
- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=000000009d9ff660 rsi=0000000000000000 rdi=000000000000000d
r8=0000000000000001 r9=0000000000000000 r10=0000000000000000 r11=000000009d9ff5d0 r12=0000000000000064 r13=000000009d9ff660
r14=000000009d9ff360 r15=0000000000000000 rip=000000006f5acb04 rsp=000000009d9ff308 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
9d9ff300 6c7c0d40 00000000 9d2b0000 6f67b4d0 9d2b0000 ntdll!NtWaitForMultipleObjects+0x0
9d9ff5f0 6c7c0c3e cb572100 004e0049 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
9d9ff630 32debb54 cd2448e0 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0
9d9ff870 32e809ed 00000000 00000004 00000000 00000000 nvcuda64!+0x0
9d9ff920 32deb523 e7bf70a5 e765ad23 cdaebd80 00000000 nvcuda64!cuProfilerStop+0x0
9d9ff950 330fa750 cdaebd80 00000000 00000000 00000000 nvcuda64!+0x0
9d9ff980 6f3a7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
9d9ff9b0 6f55d0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
9d9ffa30 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 6356 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 20365460.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000000c0 rdx=0000000000000000 rsi=000000009daff9b8 rdi=00000000000000c0
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=000000009daff890 r12=00000000cd2227e0 r13=0000000000000000
r14=00000000000000c0 r15=0000000000000001 rip=000000006f5ac034 rsp=000000009daff988 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
9daff980 6c78a34e 00000000 00000000 00000000 00000000 ntdll!NtWaitForSingleObject+0x0
9daffa20 32ffc0e7 00000000 6c792cb5 00000000 000000c0 KERNELBASE!WaitForSingleObjectEx+0x0
9daffa90 32deb523 00000001 cd58a730 cdaebb40 00000000 nvcuda64!cuProfilerStop+0x0
9daffac0 330fa750 cdaebb40 00000000 00000000 00000000 nvcuda64!+0x0
9daffaf0 6f3a7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
9daffb20 6f55d0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
9daffba0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 7440 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 20365440.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000cd4ab2c8 rdx=000000009dbffc28 rsi=000000009dbffb90 rdi=0000000000000000
r8=000000001dbab176 r9=000000001dbad106 r10=00000000cd4afa48 r11=000000007785bdc8 r12=000000009dbffc28 r13=0000000000000000
r14=00000000cd4ab2c8 r15=00000000cd4afa48 rip=000000006f5af9a4 rsp=000000009dbffb68 rbp=000000009dbffbc0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
9dbffb60 6f5754f5 00000102 00000102 00000000 9dbffb90 ntdll!NtWaitForAlertByThreadId+0x0
9dbffbd0 6c7db9d9 cd4ad230 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0
9dbffc00 32d7223a cd4ad230 6f55a9f0 cd4ad230 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0
9dbffc60 32deb523 00000001 e783d110 00000000 00000000 nvcuda64!+0x0
9dbffc90 330fa750 cdaeb660 00000000 00000000 00000000 nvcuda64!+0x0
9dbffcc0 6f3a7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
9dbffcf0 6f55d0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
9dbffd70 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 8740 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 425937504.000000, User Time: 7092499968.000000, Wait Time: 20365458.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=0000000006c69cb8 rdx=0000000000000000 rsi=0000000000000000 rdi=0000000006c69cb8
r8=0000000000000000 r9=0000000000000000 r10=0000000000008000 r11=00000000229e9fe0 r12=0000000000000000 r13=0000000000000000
r14=000000009dcff2e0 r15=0000000006c69c68 rip=000000006f5af9a4 rsp=000000009dcff2b8 rbp=000000009dcff310
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
9dcff2b0 6f575281 0e18fc58 0e18fc58 9dcff3f0 0e18fc58 ntdll!NtWaitForAlertByThreadId+0x0
9dcff330 6c7dba89 06c69c60 06c69ca8 00000000 00000000 ntdll!RtlSleepConditionVariableSRW+0x0
9dcff370 62adbc2d 093f9e40 093f9e40 093f9e40 00000000 KERNELBASE!SleepConditionVariableSRW+0x0
9dcff3b0 62ab28c8 1d8a9ab0 00000000 00000000 f94d05b4 MSVCP140!__crtSetThreadpoolWait+0x0
9dcff3e0 62ab2790 00000000 62ab2f97 00000000 1d8a9ab0 MSVCP140!std::_Winerror_message+0x0
9dcff450 f94d064b 1d8a9a90 000001c0 06c69c60 06c69c60 MSVCP140!std::_Winerror_message+0x0
9dcff490 f94d25b1 1fba5810 ffffffff 1d8a9a90 ffffffff torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
9dcff780 f94d2471 fc9f6d10 9dcff7c0 fc9f6d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0
9dcff7d0 f94c9744 00080001 1ffbe4f0 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0
9dcff800 6ca914c2 1ffbe4f0 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0
9dcff830 6f3a7034 00000000 00000000 00000000 00000000 ucrtbase!_configthreadlocale+0x0
9dcff860 6f55d0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
9dcff8e0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)