Task 3359088
| Name | ParityModified-1606530366-28907-2_1 |
| Workunit | 1517630 |
| Created | 19 Dec 2020, 10:41:04 UTC |
| Sent | 19 Dec 2020, 10:50:25 UTC |
| Report deadline | 26 Dec 2020, 10:50:25 UTC |
| Received | 19 Dec 2020, 14:58:30 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 197 (0x000000C5) EXIT_TIME_LIMIT_EXCEEDED |
| Computer ID | 5508 |
| Run time | 1 hours 15 min 23 sec |
| CPU time | 58 min 49 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 12,067.35 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.67 GB |
| Peak swap size | 3.71 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
exceeded elapsed time limit 4520.45 (1000000.00G/221.22G)</message>
<stderr_txt>
| loss: 0.0309367 | val_loss: 0.0313738 | Time: 6563.93 ms
[2020-12-19 15:33:04 main:574] : INFO : Epoch 506 | loss: 0.0309415 | val_loss: 0.0313601 | Time: 5955.74 ms
[2020-12-19 15:33:11 main:574] : INFO : Epoch 507 | loss: 0.0309448 | val_loss: 0.0313862 | Time: 5945.43 ms
[2020-12-19 15:33:17 main:574] : INFO : Epoch 508 | loss: 0.0309437 | val_loss: 0.0313722 | Time: 6251.61 ms
[2020-12-19 15:33:23 main:574] : INFO : Epoch 509 | loss: 0.0309399 | val_loss: 0.0313977 | Time: 5862.79 ms
[2020-12-19 15:33:29 main:574] : INFO : Epoch 510 | loss: 0.0309303 | val_loss: 0.0314152 | Time: 6053.12 ms
[2020-12-19 15:33:35 main:574] : INFO : Epoch 511 | loss: 0.0309382 | val_loss: 0.0313835 | Time: 5891.4 ms
[2020-12-19 15:33:41 main:574] : INFO : Epoch 512 | loss: 0.0309435 | val_loss: 0.0313688 | Time: 5976.69 ms
[2020-12-19 15:33:47 main:574] : INFO : Epoch 513 | loss: 0.0309395 | val_loss: 0.0313506 | Time: 5998.15 ms
[2020-12-19 15:33:53 main:574] : INFO : Epoch 514 | loss: 0.0309403 | val_loss: 0.0313566 | Time: 5958.67 ms
[2020-12-19 15:34:00 main:574] : INFO : Epoch 515 | loss: 0.0309368 | val_loss: 0.031373 | Time: 6723.42 ms
[2020-12-19 15:34:06 main:574] : INFO : Epoch 516 | loss: 0.0309287 | val_loss: 0.0313824 | Time: 6305.64 ms
[2020-12-19 15:34:12 main:574] : INFO : Epoch 517 | loss: 0.0309354 | val_loss: 0.0313506 | Time: 5997.23 ms
[2020-12-19 15:34:18 main:574] : INFO : Epoch 518 | loss: 0.0309286 | val_loss: 0.0313684 | Time: 5852.91 ms
[2020-12-19 15:34:24 main:574] : INFO : Epoch 519 | loss: 0.0309314 | val_loss: 0.0314052 | Time: 5946.56 ms
[2020-12-19 15:34:30 main:574] : INFO : Epoch 520 | loss: 0.030933 | val_loss: 0.0314374 | Time: 5783.46 ms
[2020-12-19 15:34:36 main:574] : INFO : Epoch 521 | loss: 0.0309348 | val_loss: 0.0313784 | Time: 5750.45 ms
[2020-12-19 15:34:42 main:574] : INFO : Epoch 522 | loss: 0.0309431 | val_loss: 0.0313753 | Time: 6201.8 ms
[2020-12-19 15:34:48 main:574] : INFO : Epoch 523 | loss: 0.0309458 | val_loss: 0.0314166 | Time: 5878.89 ms
[2020-12-19 15:34:54 main:574] : INFO : Epoch 524 | loss: 0.0309422 | val_loss: 0.0313765 | Time: 5719.18 ms
[2020-12-19 15:35:00 main:574] : INFO : Epoch 525 | loss: 0.0309324 | val_loss: 0.0313638 | Time: 6042.24 ms
[2020-12-19 15:35:06 main:574] : INFO : Epoch 526 | loss: 0.0309322 | val_loss: 0.0313119 | Time: 6142.12 ms
[2020-12-19 15:35:12 main:574] : INFO : Epoch 527 | loss: 0.0309408 | val_loss: 0.0313639 | Time: 6012.31 ms
[2020-12-19 15:35:19 main:574] : INFO : Epoch 528 | loss: 0.0309564 | val_loss: 0.0313567 | Time: 6304.97 ms
[2020-12-19 15:35:25 main:574] : INFO : Epoch 529 | loss: 0.0309371 | val_loss: 0.0313758 | Time: 6238.43 ms
[2020-12-19 15:35:31 main:574] : INFO : Epoch 530 | loss: 0.0309318 | val_loss: 0.0313781 | Time: 6179.46 ms
[2020-12-19 15:35:37 main:574] : INFO : Epoch 531 | loss: 0.030932 | val_loss: 0.0313862 | Time: 5667 ms
[2020-12-19 15:35:43 main:574] : INFO : Epoch 532 | loss: 0.0309274 | val_loss: 0.0313965 | Time: 6049.97 ms
[2020-12-19 15:35:49 main:574] : INFO : Epoch 533 | loss: 0.0309281 | val_loss: 0.0314265 | Time: 5792.51 ms
[2020-12-19 15:35:56 main:574] : INFO : Epoch 534 | loss: 0.0309412 | val_loss: 0.0314377 | Time: 6227.8 ms
[2020-12-19 15:36:02 main:574] : INFO : Epoch 535 | loss: 0.0309337 | val_loss: 0.0313626 | Time: 6119.65 ms
[2020-12-19 15:36:08 main:574] : INFO : Epoch 536 | loss: 0.0309209 | val_loss: 0.0313777 | Time: 6267.62 ms
[2020-12-19 15:36:15 main:574] : INFO : Epoch 537 | loss: 0.0309281 | val_loss: 0.0313899 | Time: 6571.63 ms
[2020-12-19 15:36:21 main:574] : INFO : Epoch 538 | loss: 0.0309282 | val_loss: 0.0313654 | Time: 6325.77 ms
[2020-12-19 15:36:27 main:574] : INFO : Epoch 539 | loss: 0.0309241 | val_loss: 0.031437 | Time: 5639.51 ms
[2020-12-19 15:36:33 main:574] : INFO : Epoch 540 | loss: 0.030933 | val_loss: 0.0313753 | Time: 5934.61 ms
[2020-12-19 15:36:39 main:574] : INFO : Epoch 541 | loss: 0.0309296 | val_loss: 0.0313613 | Time: 6216.68 ms
[2020-12-19 15:36:46 main:574] : INFO : Epoch 542 | loss: 0.0309353 | val_loss: 0.031359 | Time: 6365.93 ms
[2020-12-19 15:36:52 main:574] : INFO : Epoch 543 | loss: 0.0309251 | val_loss: 0.0313848 | Time: 5939.56 ms
[2020-12-19 15:36:58 main:574] : INFO : Epoch 544 | loss: 0.030929 | val_loss: 0.0314185 | Time: 6114.48 ms
[2020-12-19 15:37:04 main:574] : INFO : Epoch 545 | loss: 0.0309347 | val_loss: 0.0314323 | Time: 6525.7 ms
[2020-12-19 15:37:10 main:574] : INFO : Epoch 546 | loss: 0.0309359 | val_loss: 0.0313538 | Time: 6100.74 ms
[2020-12-19 15:37:16 main:574] : INFO : Epoch 547 | loss: 0.0309454 | val_loss: 0.0313638 | Time: 5761.68 ms
[2020-12-19 15:37:22 main:574] : INFO : Epoch 548 | loss: 0.0309387 | val_loss: 0.0313672 | Time: 6164.07 ms
[2020-12-19 15:37:29 main:574] : INFO : Epoch 549 | loss: 0.030938 | val_loss: 0.0313828 | Time: 6042.21 ms
[2020-12-19 15:37:35 main:574] : INFO : Epoch 550 | loss: 0.030932 | val_loss: 0.0313864 | Time: 6098.71 ms
[2020-12-19 15:37:41 main:574] : INFO : Epoch 551 | loss: 0.0309376 | val_loss: 0.0313825 | Time: 6019.87 ms
[2020-12-19 15:37:47 main:574] : INFO : Epoch 552 | loss: 0.0309281 | val_loss: 0.0313696 | Time: 6268.58 ms
[2020-12-19 15:37:53 main:574] : INFO : Epoch 553 | loss: 0.0309297 | val_loss: 0.031346 | Time: 5743.56 ms
[2020-12-19 15:37:59 main:574] : INFO : Epoch 554 | loss: 0.0309344 | val_loss: 0.0313798 | Time: 6220.92 ms
[2020-12-19 15:38:06 main:574] : INFO : Epoch 555 | loss: 0.0309316 | val_loss: 0.0313604 | Time: 6240.76 ms
[2020-12-19 15:38:12 main:574] : INFO : Epoch 556 | loss: 0.0309346 | val_loss: 0.0313947 | Time: 6477.91 ms
[2020-12-19 15:38:18 main:574] : INFO : Epoch 557 | loss: 0.0309254 | val_loss: 0.0313847 | Time: 6215.76 ms
[2020-12-19 15:38:24 main:574] : INFO : Epoch 558 | loss: 0.0309259 | val_loss: 0.0313866 | Time: 5954.85 ms
[2020-12-19 15:38:30 main:574] : INFO : Epoch 559 | loss: 0.0309314 | val_loss: 0.0313596 | Time: 5624.31 ms
[2020-12-19 15:38:36 main:574] : INFO : Epoch 560 | loss: 0.0309398 | val_loss: 0.0313987 | Time: 6160.06 ms
[2020-12-19 15:38:43 main:574] : INFO : Epoch 561 | loss: 0.0309324 | val_loss: 0.0314267 | Time: 6092.13 ms
[2020-12-19 15:38:49 main:574] : INFO : Epoch 562 | loss: 0.030938 | val_loss: 0.0313967 | Time: 6122.92 ms
[2020-12-19 15:38:55 main:574] : INFO : Epoch 563 | loss: 0.0309363 | val_loss: 0.0313865 | Time: 6023.91 ms
[2020-12-19 15:39:01 main:574] : INFO : Epoch 564 | loss: 0.0309402 | val_loss: 0.0314409 | Time: 6198 ms
[2020-12-19 15:39:08 main:574] : INFO : Epoch 565 | loss: 0.0309366 | val_loss: 0.0314238 | Time: 6295.8 ms
[2020-12-19 15:39:14 main:574] : INFO : Epoch 566 | loss: 0.0309396 | val_loss: 0.0314051 | Time: 6073.14 ms
[2020-12-19 15:39:20 main:574] : INFO : Epoch 567 | loss: 0.0309249 | val_loss: 0.0314083 | Time: 6050.9 ms
[2020-12-19 15:39:25 main:574] : INFO : Epoch 568 | loss: 0.0309248 | val_loss: 0.0314245 | Time: 5519.01 ms
[2020-12-19 15:39:31 main:574] : INFO : Epoch 569 | loss: 0.0309338 | val_loss: 0.0314036 | Time: 5840.22 ms
[2020-12-19 15:39:37 main:574] : INFO : Epoch 570 | loss: 0.030939 | val_loss: 0.0313427 | Time: 5910.5 ms
[2020-12-19 15:39:43 main:574] : INFO : Epoch 571 | loss: 0.0309411 | val_loss: 0.031369 | Time: 6198.6 ms
[2020-12-19 15:39:50 main:574] : INFO : Epoch 572 | loss: 0.0309288 | val_loss: 0.0313967 | Time: 6052.58 ms
[2020-12-19 15:39:56 main:574] : INFO : Epoch 573 | loss: 0.0309281 | val_loss: 0.0314026 | Time: 5910.18 ms
[2020-12-19 15:40:02 main:574] : INFO : Epoch 574 | loss: 0.0309349 | val_loss: 0.031409 | Time: 6528.32 ms
[2020-12-19 15:40:09 main:574] : INFO : Epoch 575 | loss: 0.0309397 | val_loss: 0.0313742 | Time: 6259.72 ms
[2020-12-19 15:40:15 main:574] : INFO : Epoch 576 | loss: 0.0309306 | val_loss: 0.031397 | Time: 6151.64 ms
[2020-12-19 15:40:21 main:574] : INFO : Epoch 577 | loss: 0.0309307 | val_loss: 0.0313815 | Time: 5952.82 ms
[2020-12-19 15:40:27 main:574] : INFO : Epoch 578 | loss: 0.0309285 | val_loss: 0.0314046 | Time: 5955.02 ms
[2020-12-19 15:40:32 main:574] : INFO : Epoch 579 | loss: 0.0309279 | val_loss: 0.0313662 | Time: 5417.38 ms
[2020-12-19 15:40:38 main:574] : INFO : Epoch 580 | loss: 0.0309318 | val_loss: 0.0313901 | Time: 5864.65 ms
[2020-12-19 15:40:44 main:574] : INFO : Epoch 581 | loss: 0.0309196 | val_loss: 0.0314252 | Time: 5941.83 ms
[2020-12-19 15:40:50 main:574] : INFO : Epoch 582 | loss: 0.0309303 | val_loss: 0.0314207 | Time: 5898.31 ms
[2020-12-19 15:40:57 main:574] : INFO : Epoch 583 | loss: 0.0309278 | val_loss: 0.0314515 | Time: 6183.83 ms
[2020-12-19 15:41:03 main:574] : INFO : Epoch 584 | loss: 0.0309389 | val_loss: 0.0314044 | Time: 6487.76 ms
[2020-12-19 15:41:09 main:574] : INFO : Epoch 585 | loss: 0.030952 | val_loss: 0.0314167 | Time: 6133.34 ms
[2020-12-19 15:41:15 main:574] : INFO : Epoch 586 | loss: 0.0309402 | val_loss: 0.031402 | Time: 5807.59 ms
[2020-12-19 15:41:21 main:574] : INFO : Epoch 587 | loss: 0.0309315 | val_loss: 0.0313837 | Time: 5944.97 ms
[2020-12-19 15:41:27 main:574] : INFO : Epoch 588 | loss: 0.0309273 | val_loss: 0.0314043 | Time: 6099.6 ms
[2020-12-19 15:41:33 main:574] : INFO : Epoch 589 | loss: 0.0309343 | val_loss: 0.0313574 | Time: 5730.03 ms
[2020-12-19 15:41:39 main:574] : INFO : Epoch 590 | loss: 0.0309498 | val_loss: 0.031392 | Time: 6177.17 ms
[2020-12-19 15:41:46 main:574] : INFO : Epoch 591 | loss: 0.0309438 | val_loss: 0.031421 | Time: 6005.31 ms
[2020-12-19 15:41:52 main:574] : INFO : Epoch 592 | loss: 0.0309472 | val_loss: 0.0313834 | Time: 6064.95 ms
[2020-12-19 15:41:58 main:574] : INFO : Epoch 593 | loss: 0.030932 | val_loss: 0.0313672 | Time: 6122.94 ms
[2020-12-19 15:42:05 main:574] : INFO : Epoch 594 | loss: 0.0309317 | val_loss: 0.0314309 | Time: 6584.36 ms
[2020-12-19 15:42:11 main:574] : INFO : Epoch 595 | loss: 0.0309306 | val_loss: 0.0313711 | Time: 6210.94 ms
[2020-12-19 15:42:17 main:574] : INFO : Epoch 596 | loss: 0.03093 | val_loss: 0.0314128 | Time: 6294.43 ms
[2020-12-19 15:42:23 main:574] : INFO : Epoch 597 | loss: 0.0309327 | val_loss: 0.0313913 | Time: 5721.18 ms
[2020-12-19 15:42:29 main:574] : INFO : Epoch 598 | loss: 0.0309359 | val_loss: 0.0314109 | Time: 5729.02 ms
[2020-12-19 15:42:35 main:574] : INFO : Epoch 599 | loss: 0.030928 | val_loss: 0.0313948 | Time: 6067.49 ms
[2020-12-19 15:42:42 main:574] : INFO : Epoch 600 | loss: 0.0309359 | val_loss: 0.0314229 | Time: 6519 ms
[2020-12-19 15:42:48 main:574] : INFO : Epoch 601 | loss: 0.0309283 | val_loss: 0.031359 | Time: 5978.36 ms
[2020-12-19 15:42:54 main:574] : INFO : Epoch 602 | loss: 0.0309315 | val_loss: 0.0313711 | Time: 5880.39 ms
[2020-12-19 15:42:59 main:574] : INFO : Epoch 603 | loss: 0.0309321 | val_loss: 0.0313693 | Time: 5802.91 ms
[2020-12-19 15:43:06 main:574] : INFO : Epoch 604 | loss: 0.0309304 | val_loss: 0.0313809 | Time: 6203.8 ms
[2020-12-19 15:43:12 main:574] : INFO : Epoch 605 | loss: 0.0309257 | val_loss: 0.0313993 | Time: 6362.92 ms
[2020-12-19 15:43:18 main:574] : INFO : Epoch 606 | loss: 0.0309334 | val_loss: 0.0313958 | Time: 6273.07 ms
[2020-12-19 15:43:25 main:574] : INFO : Epoch 607 | loss: 0.0309343 | val_loss: 0.0313891 | Time: 6219.05 ms
[2020-12-19 15:43:30 main:574] : INFO : Epoch 608 | loss: 0.0309288 | val_loss: 0.0313739 | Time: 5719.01 ms
[2020-12-19 15:43:36 main:574] : INFO : Epoch 609 | loss: 0.0309317 | val_loss: 0.0313797 | Time: 5816.11 ms
[2020-12-19 15:43:43 main:574] : INFO : Epoch 610 | loss: 0.0309333 | val_loss: 0.031355 | Time: 5980.9 ms
[2020-12-19 15:43:49 main:574] : INFO : Epoch 611 | loss: 0.0309257 | val_loss: 0.0314375 | Time: 6193.64 ms
[2020-12-19 15:43:55 main:574] : INFO : Epoch 612 | loss: 0.0309351 | val_loss: 0.0314029 | Time: 6099.02 ms
[2020-12-19 15:44:01 main:574] : INFO : Epoch 613 | loss: 0.0309295 | val_loss: 0.0313544 | Time: 6188.59 ms
[2020-12-19 15:44:07 main:574] : INFO : Epoch 614 | loss: 0.0309446 | val_loss: 0.0313785 | Time: 5939.17 ms
[2020-12-19 15:44:13 main:574] : INFO : Epoch 615 | loss: 0.0309425 | val_loss: 0.0314374 | Time: 5944.88 ms
[2020-12-19 15:44:20 main:574] : INFO : Epoch 616 | loss: 0.0309329 | val_loss: 0.0313642 | Time: 6174.99 ms
[2020-12-19 15:44:26 main:574] : INFO : Epoch 617 | loss: 0.0309343 | val_loss: 0.0313821 | Time: 5916.32 ms
[2020-12-19 15:44:32 main:574] : INFO : Epoch 618 | loss: 0.0309248 | val_loss: 0.0314463 | Time: 5933.08 ms
[2020-12-19 15:44:37 main:574] : INFO : Epoch 619 | loss: 0.0309211 | val_loss: 0.0313773 | Time: 5733.11 ms
[2020-12-19 15:44:44 main:574] : INFO : Epoch 620 | loss: 0.0309214 | val_loss: 0.0313804 | Time: 6086.52 ms
[2020-12-19 15:44:50 main:574] : INFO : Epoch 621 | loss: 0.0309222 | val_loss: 0.0313772 | Time: 6033.27 ms
[2020-12-19 15:44:57 main:574] : INFO : Epoch 622 | loss: 0.0309238 | val_loss: 0.0313815 | Time: 6893.38 ms
[2020-12-19 15:45:03 main:574] : INFO : Epoch 623 | loss: 0.0309305 | val_loss: 0.0314371 | Time: 6176.99 ms
[2020-12-19 15:45:09 main:574] : INFO : Epoch 624 | loss: 0.0309254 | val_loss: 0.0313813 | Time: 6101.17 ms
[2020-12-19 15:45:15 main:574] : INFO : Epoch 625 | loss: 0.0309277 | val_loss: 0.0314339 | Time: 6150.28 ms
[2020-12-19 15:45:21 main:574] : INFO : Epoch 626 | loss: 0.0309295 | val_loss: 0.0314071 | Time: 5698.57 ms
[2020-12-19 15:45:27 main:574] : INFO : Epoch 627 | loss: 0.0309261 | val_loss: 0.0314111 | Time: 5778.9 ms
[2020-12-19 15:45:33 main:574] : INFO : Epoch 628 | loss: 0.0309387 | val_loss: 0.031389 | Time: 5583.02 ms
[2020-12-19 15:45:39 main:574] : INFO : Epoch 629 | loss: 0.0309633 | val_loss: 0.0313528 | Time: 6483.89 ms
[2020-12-19 15:45:45 main:574] : INFO : Epoch 630 | loss: 0.0309428 | val_loss: 0.0313645 | Time: 6220.35 ms
[2020-12-19 15:45:51 main:574] : INFO : Epoch 631 | loss: 0.0309407 | val_loss: 0.0314 | Time: 5985.33 ms
[2020-12-19 15:45:58 main:574] : INFO : Epoch 632 | loss: 0.0309249 | val_loss: 0.0314494 | Time: 6172.17 ms
[2020-12-19 15:46:04 main:574] : INFO : Epoch 633 | loss: 0.0309249 | val_loss: 0.0314177 | Time: 6404.83 ms
[2020-12-19 15:46:10 main:574] : INFO : Epoch 634 | loss: 0.030923 | val_loss: 0.0314196 | Time: 6082.47 ms
[2020-12-19 15:46:16 main:574] : INFO : Epoch 635 | loss: 0.0309248 | val_loss: 0.0313923 | Time: 5806.5 ms
[2020-12-19 15:46:22 main:574] : INFO : Epoch 636 | loss: 0.0309202 | val_loss: 0.0313627 | Time: 5753.69 ms
[2020-12-19 15:46:28 main:574] : INFO : Epoch 637 | loss: 0.0309341 | val_loss: 0.0313457 | Time: 5684.47 ms
[2020-12-19 15:46:33 main:574] : INFO : Epoch 638 | loss: 0.0309259 | val_loss: 0.031394 | Time: 5723.9 ms
[2020-12-19 15:46:40 main:574] : INFO : Epoch 639 | loss: 0.0309278 | val_loss: 0.0313569 | Time: 6260.03 ms
[2020-12-19 15:46:46 main:574] : INFO : Epoch 640 | loss: 0.0309383 | val_loss: 0.0313559 | Time: 6579.69 ms
[2020-12-19 15:46:52 main:574] : INFO : Epoch 641 | loss: 0.0309206 | val_loss: 0.0314074 | Time: 5964.43 ms
[2020-12-19 15:46:59 main:574] : INFO : Epoch 642 | loss: 0.030924 | val_loss: 0.031448 | Time: 6431.21 ms
[2020-12-19 15:47:05 main:574] : INFO : Epoch 643 | loss: 0.0309307 | val_loss: 0.0313616 | Time: 6426.45 ms
[2020-12-19 15:47:11 main:574] : INFO : Epoch 644 | loss: 0.0309326 | val_loss: 0.0313517 | Time: 5819.97 ms
[2020-12-19 15:47:17 main:574] : INFO : Epoch 645 | loss: 0.0309426 | val_loss: 0.031461 | Time: 6016.46 ms
[2020-12-19 15:47:24 main:574] : INFO : Epoch 646 | loss: 0.0309383 | val_loss: 0.0313753 | Time: 6054.29 ms
[2020-12-19 15:47:29 main:574] : INFO : Epoch 647 | loss: 0.0309273 | val_loss: 0.0314019 | Time: 5543.68 ms
[2020-12-19 15:47:35 main:574] : INFO : Epoch 648 | loss: 0.0309204 | val_loss: 0.0314224 | Time: 5796.59 ms
[2020-12-19 15:47:42 main:574] : INFO : Epoch 649 | loss: 0.0309294 | val_loss: 0.031348 | Time: 6409.02 ms
[2020-12-19 15:47:48 main:574] : INFO : Epoch 650 | loss: 0.030932 | val_loss: 0.0313767 | Time: 6446.05 ms
[2020-12-19 15:47:55 main:574] : INFO : Epoch 651 | loss: 0.0309286 | val_loss: 0.0314242 | Time: 6777.93 ms
[2020-12-19 15:48:01 main:574] : INFO : Epoch 652 | loss: 0.030925 | val_loss: 0.031408 | Time: 5982.32 ms
[2020-12-19 15:48:07 main:574] : INFO : Epoch 653 | loss: 0.030929 | val_loss: 0.0314056 | Time: 5588.27 ms
[2020-12-19 15:48:13 main:574] : INFO : Epoch 654 | loss: 0.0309273 | val_loss: 0.0314092 | Time: 5848.78 ms
[2020-12-19 15:48:19 main:574] : INFO : Epoch 655 | loss: 0.030931 | val_loss: 0.0313738 | Time: 5918.72 ms
[2020-12-19 15:48:25 main:574] : INFO : Epoch 656 | loss: 0.0309266 | val_loss: 0.0314141 | Time: 6684.19 ms
[2020-12-19 15:48:32 main:574] : INFO : Epoch 657 | loss: 0.0309321 | val_loss: 0.031356 | Time: 6182.65 ms
[2020-12-19 15:48:38 main:574] : INFO : Epoch 658 | loss: 0.0309308 | val_loss: 0.0313994 | Time: 6051.14 ms
[2020-12-19 15:48:44 main:574] : INFO : Epoch 659 | loss: 0.0309211 | val_loss: 0.031385 | Time: 5936.72 ms
[2020-12-19 15:48:50 main:574] : INFO : Epoch 660 | loss: 0.0309215 | val_loss: 0.0314284 | Time: 6462.01 ms
[2020-12-19 15:48:57 main:574] : INFO : Epoch 661 | loss: 0.0309337 | val_loss: 0.0314013 | Time: 6490.25 ms
[2020-12-19 15:49:03 main:574] : INFO : Epoch 662 | loss: 0.0309334 | val_loss: 0.0314058 | Time: 6105.27 ms
[2020-12-19 15:49:09 main:574] : INFO : Epoch 663 | loss: 0.0309369 | val_loss: 0.0313569 | Time: 6198.33 ms
[2020-12-19 15:49:15 main:574] : INFO : Epoch 664 | loss: 0.0309358 | val_loss: 0.0313918 | Time: 5793.48 ms
[2020-12-19 15:49:21 main:574] : INFO : Epoch 665 | loss: 0.0309259 | val_loss: 0.0313909 | Time: 6039.87 ms
[2020-12-19 15:49:27 main:574] : INFO : Epoch 666 | loss: 0.030926 | val_loss: 0.0313832 | Time: 6136.09 ms
[2020-12-19 15:49:34 main:574] : INFO : Epoch 667 | loss: 0.0309172 | val_loss: 0.0313605 | Time: 6095.8 ms
[2020-12-19 15:49:39 main:574] : INFO : Epoch 668 | loss: 0.0309349 | val_loss: 0.0313973 | Time: 5899.17 ms
[2020-12-19 15:49:45 main:574] : INFO : Epoch 669 | loss: 0.0309349 | val_loss: 0.0313992 | Time: 5997.83 ms
[2020-12-19 15:49:52 main:574] : INFO : Epoch 670 | loss: 0.0309301 | val_loss: 0.0313375 | Time: 6342.1 ms
[2020-12-19 15:49:58 main:574] : INFO : Epoch 671 | loss: 0.0309316 | val_loss: 0.0313783 | Time: 5957.66 ms
[2020-12-19 15:50:04 main:574] : INFO : Epoch 672 | loss: 0.0309287 | val_loss: 0.0313726 | Time: 5933.24 ms
[2020-12-19 15:50:10 main:574] : INFO : Epoch 673 | loss: 0.0309371 | val_loss: 0.0313478 | Time: 5819.53 ms
[2020-12-19 15:50:16 main:574] : INFO : Epoch 674 | loss: 0.0309289 | val_loss: 0.031435 | Time: 5937.71 ms
[2020-12-19 15:50:22 main:574] : INFO : Epoch 675 | loss: 0.0309278 | val_loss: 0.0314085 | Time: 5679.14 ms
[2020-12-19 15:50:28 main:574] : INFO : Epoch 676 | loss: 0.0309271 | val_loss: 0.0314154 | Time: 5985.15 ms
[2020-12-19 15:50:34 main:574] : INFO : Epoch 677 | loss: 0.0309353 | val_loss: 0.0314094 | Time: 6046.19 ms
[2020-12-19 15:50:40 main:574] : INFO : Epoch 678 | loss: 0.0309267 | val_loss: 0.0314144 | Time: 6096.94 ms
[2020-12-19 15:50:46 main:574] : INFO : Epoch 679 | loss: 0.0309343 | val_loss: 0.0313664 | Time: 6112.14 ms
[2020-12-19 15:50:52 main:574] : INFO : Epoch 680 | loss: 0.0309326 | val_loss: 0.0313593 | Time: 5720.54 ms
[2020-12-19 15:50:58 main:574] : INFO : Epoch 681 | loss: 0.0309287 | val_loss: 0.0313923 | Time: 5665.82 ms
[2020-12-19 15:51:04 main:574] : INFO : Epoch 682 | loss: 0.0309221 | val_loss: 0.031397 | Time: 6017.57 ms
[2020-12-19 15:51:11 main:574] : INFO : Epoch 683 | loss: 0.0309271 | val_loss: 0.0314285 | Time: 6428.63 ms
[2020-12-19 15:51:17 main:574] : INFO : Epoch 684 | loss: 0.0309285 | val_loss: 0.0314199 | Time: 5989.26 ms
[2020-12-19 15:51:23 main:574] : INFO : Epoch 685 | loss: 0.0309242 | val_loss: 0.0314164 | Time: 6293.62 ms
[2020-12-19 15:51:29 main:574] : INFO : Epoch 686 | loss: 0.0309265 | val_loss: 0.0313473 | Time: 6148.71 ms
[2020-12-19 15:51:35 main:574] : INFO : Epoch 687 | loss: 0.0309322 | val_loss: 0.0313369 | Time: 6196.79 ms
[2020-12-19 15:51:42 main:574] : INFO : Epoch 688 | loss: 0.030953 | val_loss: 0.0313932 | Time: 6516.57 ms
[2020-12-19 15:51:48 main:574] : INFO : Epoch 689 | loss: 0.0309429 | val_loss: 0.0314025 | Time: 6448.53 ms
[2020-12-19 15:51:55 main:574] : INFO : Epoch 690 | loss: 0.0309271 | val_loss: 0.0314234 | Time: 6312 ms
[2020-12-19 15:52:01 main:574] : INFO : Epoch 691 | loss: 0.0309191 | val_loss: 0.0313887 | Time: 5687.42 ms
[2020-12-19 15:52:06 main:574] : INFO : Epoch 692 | loss: 0.0309204 | val_loss: 0.0313875 | Time: 5825.88 ms
[2020-12-19 15:52:12 main:574] : INFO : Epoch 693 | loss: 0.0309245 | val_loss: 0.0314014 | Time: 5488.21 ms
[2020-12-19 15:52:18 main:574] : INFO : Epoch 694 | loss: 0.030922 | val_loss: 0.0314246 | Time: 5802.18 ms
[2020-12-19 15:52:24 main:574] : INFO : Epoch 695 | loss: 0.0309307 | val_loss: 0.0314091 | Time: 6114.2 ms
[2020-12-19 15:52:31 main:574] : INFO : Epoch 696 | loss: 0.0309265 | val_loss: 0.0313728 | Time: 6618.29 ms
[2020-12-19 15:52:37 main:574] : INFO : Epoch 697 | loss: 0.0309314 | val_loss: 0.0313737 | Time: 6277.5 ms
[2020-12-19 15:52:43 main:574] : INFO : Epoch 698 | loss: 0.0309328 | val_loss: 0.0313635 | Time: 6145.55 ms
[2020-12-19 15:52:50 main:574] : INFO : Epoch 699 | loss: 0.0309243 | val_loss: 0.0313805 | Time: 6299.29 ms
[2020-12-19 15:52:56 main:574] : INFO : Epoch 700 | loss: 0.0309224 | val_loss: 0.0314429 | Time: 5876.51 ms
[2020-12-19 15:53:01 main:574] : INFO : Epoch 701 | loss: 0.0309293 | val_loss: 0.0313723 | Time: 5812.26 ms
[2020-12-19 15:53:08 main:574] : INFO : Epoch 702 | loss: 0.0309301 | val_loss: 0.031417 | Time: 6103.36 ms
[2020-12-19 15:53:14 main:574] : INFO : Epoch 703 | loss: 0.0309274 | val_loss: 0.0313534 | Time: 5914.92 ms
[2020-12-19 15:53:20 main:574] : INFO : Epoch 704 | loss: 0.0309235 | val_loss: 0.0314195 | Time: 5826.52 ms
[2020-12-19 15:53:26 main:574] : INFO : Epoch 705 | loss: 0.0309186 | val_loss: 0.0313928 | Time: 5874.16 ms
[2020-12-19 15:53:32 main:574] : INFO : Epoch 706 | loss: 0.0309554 | val_loss: 0.0313941 | Time: 6112.62 ms
[2020-12-19 15:53:38 main:574] : INFO : Epoch 707 | loss: 0.0309297 | val_loss: 0.0313737 | Time: 6415.36 ms
[2020-12-19 15:53:45 main:574] : INFO : Epoch 708 | loss: 0.0309191 | val_loss: 0.0314139 | Time: 6479.98 ms
[2020-12-19 15:53:51 main:574] : INFO : Epoch 709 | loss: 0.0309163 | val_loss: 0.0313922 | Time: 6228.93 ms
[2020-12-19 15:53:57 main:574] : INFO : Epoch 710 | loss: 0.0309707 | val_loss: 0.0313521 | Time: 5905.63 ms
[2020-12-19 15:54:03 main:574] : INFO : Epoch 711 | loss: 0.0309583 | val_loss: 0.031371 | Time: 5786.95 ms
[2020-12-19 15:54:09 main:574] : INFO : Epoch 712 | loss: 0.0309366 | val_loss: 0.0313845 | Time: 5819.57 ms
[2020-12-19 15:54:16 main:574] : INFO : Epoch 713 | loss: 0.0309219 | val_loss: 0.031421 | Time: 6674.72 ms
[2020-12-19 15:54:22 main:574] : INFO : Epoch 714 | loss: 0.0309188 | val_loss: 0.0314033 | Time: 6091.77 ms
[2020-12-19 15:54:28 main:574] : INFO : Epoch 715 | loss: 0.0309293 | val_loss: 0.0313698 | Time: 6256.39 ms
[2020-12-19 15:54:35 main:574] : INFO : Epoch 716 | loss: 0.0309246 | val_loss: 0.0314195 | Time: 6329.78 ms
[2020-12-19 15:54:41 main:574] : INFO : Epoch 717 | loss: 0.0309205 | val_loss: 0.0313703 | Time: 5823.98 ms
[2020-12-19 15:54:46 main:574] : INFO : Epoch 718 | loss: 0.0309431 | val_loss: 0.0313894 | Time: 5692.21 ms
[2020-12-19 15:54:52 main:574] : INFO : Epoch 719 | loss: 0.0309245 | val_loss: 0.0314007 | Time: 5806.85 ms
[2020-12-19 15:54:58 main:574] : INFO : Epoch 720 | loss: 0.030929 | val_loss: 0.0313597 | Time: 5945.39 ms
[2020-12-19 15:55:04 main:574] : INFO : Epoch 721 | loss: 0.0309287 | val_loss: 0.0314073 | Time: 5999.92 ms
[2020-12-19 15:55:10 main:574] : INFO : Epoch 722 | loss: 0.0309282 | val_loss: 0.0313337 | Time: 6077.01 ms
[2020-12-19 15:55:17 main:574] : INFO : Epoch 723 | loss: 0.0309341 | val_loss: 0.0313539 | Time: 6432.46 ms
[2020-12-19 15:55:23 main:574] : INFO : Epoch 724 | loss: 0.0309259 | val_loss: 0.0313826 | Time: 6104.45 ms
[2020-12-19 15:55:29 main:574] : INFO : Epoch 725 | loss: 0.0309229 | val_loss: 0.0313842 | Time: 6305.97 ms
[2020-12-19 15:55:36 main:574] : INFO : Epoch 726 | loss: 0.0309318 | val_loss: 0.0314025 | Time: 6131.38 ms
[2020-12-19 15:55:42 main:574] : INFO : Epoch 727 | loss: 0.030929 | val_loss: 0.0313853 | Time: 5991.68 ms
[2020-12-19 15:55:48 main:574] : INFO : Epoch 728 | loss: 0.0309224 | val_loss: 0.0313702 | Time: 5836.43 ms
[2020-12-19 15:55:54 main:574] : INFO : Epoch 729 | loss: 0.0309321 | val_loss: 0.031342 | Time: 5972.61 ms
[2020-12-19 15:56:00 main:574] : INFO : Epoch 730 | loss: 0.0309246 | val_loss: 0.0314034 | Time: 6018.79 ms
[2020-12-19 15:56:06 main:574] : INFO : Epoch 731 | loss: 0.030931 | val_loss: 0.0314037 | Time: 6312.15 ms
[2020-12-19 15:56:12 main:574] : INFO : Epoch 732 | loss: 0.0309299 | val_loss: 0.0313808 | Time: 6157.89 ms
[2020-12-19 15:56:19 main:574] : INFO : Epoch 733 | loss: 0.0309308 | val_loss: 0.0313891 | Time: 6334.3 ms
[2020-12-19 15:56:25 main:574] : INFO : Epoch 734 | loss: 0.0309257 | val_loss: 0.0314361 | Time: 5959.65 ms
[2020-12-19 15:56:31 main:574] : INFO : Epoch 735 | loss: 0.0309163 | val_loss: 0.031382 | Time: 6150.94 ms
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFA9FB49AD2
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 12/19/20 15:56:33
Install Directory : C:\Program Files\BOINC\
Data Directory : C:\ProgramData\BOINC
Project Symstore :
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\42;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 00000000765f0000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000a21b0000 00000000001f6000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.662
ModLoad: 00000000a0fd0000 00000000000bd000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.662
ModLoad: 000000009fa80000 00000000002c9000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.662
ModLoad: 00000000a1140000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.685) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 000000009fe50000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.662
ModLoad: 00000000a1bf0000 000000000002a000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.685) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.685 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.685
ModLoad: 000000009ff20000 0000000000109000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.685) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.685 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.685
ModLoad: 000000009fe80000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000009fd50000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000a1df0000 00000000000ac000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.610) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 00000000a1d50000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.19041.546
ModLoad: 00000000a1ff0000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000a0d10000 000000000012b000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 0000000093100000 0000000000058000 C:\ProgramData\BOINC\slots\42\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000932f0000 00000000000a7000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.13.26020.0) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp140.amd64.pdb
File Version : 14.13.26020.0 built by: VCTOOLSREL
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio® 2017
Product Version : 14.13.26020.0
ModLoad: 000000009a4c0000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.488) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.488 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.488
ModLoad: 000000009b110000 0000000000016000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.13.26020.0) (-exported- Symbols Loaded)
Linked PDB Filename : vcruntime140.amd64.pdb
File Version : 14.13.26020.0 built by: VCTOOLSREL
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio® 2017
Product Version : 14.13.26020.0
ModLoad: 000000009a760000 000000000000c000 C:\ProgramData\BOINC\slots\42\VCRUNTIME140_1.dll (14.27.29112.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.27.29112.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.27.29112.0
ModLoad: 0000000050450000 000000000abe7000 C:\ProgramData\BOINC\slots\42\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000077930000 00000000002db000 C:\ProgramData\BOINC\slots\42\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000098450000 0000000000040000 C:\ProgramData\BOINC\slots\42\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000007a5c0000 000000000020d000 C:\ProgramData\BOINC\slots\42\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 000000000e8f0000 0000000024b49000 C:\ProgramData\BOINC\slots\42\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000092e50000 0000000000045000 C:\ProgramData\BOINC\slots\42\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000004cf90000 00000000034b2000 C:\ProgramData\BOINC\slots\42\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 000000009a4b0000 0000000000010000 C:\ProgramData\BOINC\slots\42\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 0000000043df0000 000000000919f000 C:\ProgramData\BOINC\slots\42\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 000000005cd10000 00000000030a5000 C:\ProgramData\BOINC\slots\42\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 0000000040090000 0000000003d5b000 C:\ProgramData\BOINC\slots\42\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 000000003e1c0000 0000000001eca000 C:\ProgramData\BOINC\slots\42\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 0000000092840000 000000001b3a4000 C:\ProgramData\BOINC\slots\42\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 00000000a10a0000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000009d780000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000a0210000 0000000000467000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 00000000a0190000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000a01e0000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 000000009f5c0000 000000000002c000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000009f8f0000 0000000000060000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.662
ModLoad: 00000000a0030000 000000000015d000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 000000009f400000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000a1370000 0000000000742000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 000000009da60000 0000000000795000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 00000000a08e0000 0000000000356000 C:\WINDOWS\System32\combase.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 000000009f280000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 00000000a0680000 00000000000ae000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 00000000a1ad0000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 0000000076fc0000 0000000000267000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.5671) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r456_61\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 27.21.14.5671
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.1.96 driver
Product Version : 27.21.14.5671
ModLoad: 000000009ace0000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000073ef0000 000000000152a000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_feed726c6560f7a7\nvcuda64.dll (27.21.14.5671) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r456_61\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 27.21.14.5671
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.1.96 driver
Product Version : 27.21.14.5671
ModLoad: 00000000a0e40000 000000000006b000 C:\WINDOWS\System32\WS2_32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : ws2_32.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 000000009ac50000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000009f720000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000009d3a0000 000000000009e000 C:\WINDOWS\system32\uxtheme.dll (6.2.19041.610) (-exported- Symbols Loaded)
Linked PDB Filename : UxTheme.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 0000000089460000 00000000006d5000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.5671) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r456_61\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 27.21.14.5671
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 27.21.14.5671
ModLoad: 00000000a1c20000 000000000012a000 C:\WINDOWS\System32\OLE32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : ole32.pdb
File Version : 10.0.19041.561 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.561
ModLoad: 0000000098530000 0000000000009000 C:\ProgramData\BOINC\slots\42\caffe2_nvrtc.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000006fa50000 0000000000fca000 C:\ProgramData\BOINC\slots\42\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6.14.11.9000
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.89 NVRTC Library
Product Version : 6.14.11.9000
ModLoad: 000000009fa00000 0000000000080000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.662
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 4360, Write: 3658, Other 12893
- I/O Transfers Counters -
Read: 6734512, Write: 3597512, Other 148694
- Paged Pool Usage -
QuotaPagedPoolUsage: 3505576, QuotaPeakPagedPoolUsage: 3505576
QuotaNonPagedPoolUsage: 52080, QuotaPeakNonPagedPoolUsage: 52632
- Virtual Memory Usage -
VirtualSize: -309329920, PeakVirtualSize: 309321728
- Pagefile Usage -
PagefileUsage: -309329920, PeakPagefileUsage: -309329920
- Working Set Size -
WorkingSetSize: 1758310400, PeakWorkingSetSize: 1764134912, PageFaultCount: 636809
*** Dump of thread ID 5628 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 54908488.000000
- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFA9FB49AD2
- Registers -
rax=0000000000000000 rbx=0000000000000001 rcx=00000000768a8c40 rdx=00000000b75fe740 rsi=0000000000000000 rdi=0000000000000000
r8=00000000b75fe740 r9=00000000768a8c30 r10=0000000000000fff r11=0000000000000ff0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000009fb49ad2 rsp=00000000b75fe718 rbp=0000000000000000
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
b75fe710 76629100 00000001 b75fe740 b75fe740 768a8c30 KERNELBASE!DebugBreak+0x0
b75feb50 76629ce4 29c00000 b75feeb4 00000000 0000032c mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
b75ffab0 7662a084 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
b75ffae0 a0fe7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
b75ffb10 a21fd0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
b75ffb90 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 3040 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 2821406208.000000, User Time: 18255468544.000000, Wait Time: 54908484.000000
- Registers -
rax=00000000436d8320 rbx=00000000438ab490 rcx=0000000058921b64 rdx=00000000438ab490 rsi=00000000b70e0c00 rdi=000000003005fdd0
r8=000000003005fdd0 r9=00000000224b0000 r10=0000000058921b24 r11=00000000001fadd4 r12=000000005892199c r13=00000000b70e03b0
r14=0000000000000002 r15=00000000b70e0c00 rip=00000000741ca9dc rsp=00000000b70e00f8 rbp=0000000058921b64
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
b70e0100 741cbe62 438ab490 438ab490 b70e0c00 224b0000 nvcuda64!cuProfilerStop+0x0
b70e0350 7405d669 438ab400 438ab490 438ab490 00000000 nvcuda64!cuProfilerStop+0x0
b70e0970 741f26a2 00000100 00000001 b70e0a99 74075737 nvcuda64!+0x0
b70e0a90 73f2841d 3005fdd0 b70e0c00 3005fdd0 438ab490 nvcuda64!cuProfilerStop+0x0
b70e0ae0 73f2890c b70e0bf0 438ab490 3005fdd0 438ab4a0 nvcuda64!+0x0
b70e0d70 740f0ff8 00000000 41f40860 5987b3cc b70e1500 nvcuda64!+0x0
b70e0ee0 935e29b6 00000008 00000080 00000000 9370b340 nvcuda64!cuLaunchKernel+0x0
b70e0ff0 935dfdf4 9370b340 4221ffd0 3005fdd0 b70e1210 cudnn64_7!cudnnSetDropoutDescriptor+0x0
b70e1170 9370a4cb 9370b340 00000002 9370b340 00000009 cudnn64_7!cudnnSetDropoutDescriptor+0x0
b70e1290 9364e10c 1745a000 187ee000 17490bd0 3f800000 cudnn64_7!cudnnSetDropoutDescriptor+0x0
b70e13a0 935f8de0 00000001 b70e1520 92903010 b70e1560 cudnn64_7!cudnnSetDropoutDescriptor+0x0
b70e1510 9363cd01 00000000 b70e1f08 00000000 00000000 cudnn64_7!cudnnSetDropoutDescriptor+0x0
b70e1630 93645e12 00000000 00000000 92903010 00000000 cudnn64_7!cudnnSetDropoutDescriptor+0x0
b70e17b0 93644cd9 00000000 00000000 00000000 0000000f cudnn64_7!cudnnSetDropoutDescriptor+0x0
b70e18c0 93644504 92903010 00000000 00000000 00000024 cudnn64_7!cudnnSetDropoutDescriptor+0x0
b70e1b90 9364700e b70e1bd8 a4f76f90 92db3a40 4221ff40 cudnn64_7!cudnnSetDropoutDescriptor+0x0
b70e1c80 935482ca 92903010 00000000 00000000 00000024 cudnn64_7!cudnnSetDropoutDescriptor+0x0
b70e1d50 9355a9bb 0000000c 1745a000 00000001 00000000 cudnn64_7!cudnnSetAttnDescriptor+0x0
b70e2200 9354eff1 b70e44e8 1d4a86c0 00000005 a3b0d1c0 cudnn64_7!cudnnSetRNNProjectionLayers+0x0
b70e23a0 93557d8e a3f04600 00000000 a3b0d1c0 b70e2668 cudnn64_7!cudnnSetRNNProjectionLayers+0x0
b70e2540 9356dcd3 00000000 00000000 a7cc7670 b70e2660 cudnn64_7!cudnnSetRNNProjectionLayers+0x0
b70e46d0 116689fd a3f00260 17400000 a3f00260 1d4a86c0 cudnn64_7!cudnnRNNForwardTraining+0x0
b70e4bb0 116c25ea b70e4c78 00000001 b70e4c78 00000001 torch_cuda!at::native::_cudnn_rnn+0x0
b70e4c90 116d0cbf b70e5380 b70e6b88 b70e5cd0 000000b3 torch_cuda!at::native::set_storage_cuda_+0x0
b70e4d70 55e9b9fc b70e5380 00000000 9299dfc0 9299df90 torch_cuda!at::native::set_storage_cuda_+0x0
b70e4ef0 55ed31a2 00000001 a21c786b 03050265 000000b6 torch_cpu!at::native::mkldnn_sigmoid_+0x0
b70e51d0 57182613 00000000 00000000 00000003 809b90d8 torch_cpu!at::_cudnn_rnn+0x0
b70e56d0 5719080b fcc9b7a6 a7c63d60 b70e5800 00000004 torch_cpu!torch::autograd::NotImplemented::~NotImplemented+0x0
b70e57b0 55e9b9fc b70e5d30 73f15a07 b70e59e8 b70e5860 torch_cpu!torch::autograd::GraphRoot::apply+0x0
b70e5930 55ed31a2 a3b0d620 00000644 b70e5ad0 9330ba8e torch_cpu!at::native::mkldnn_sigmoid_+0x0
b70e5c10 116669a1 b70e0001 00000001 00000004 00000001 torch_cpu!at::_cudnn_rnn+0x0
b70e5de0 11670117 00000000 b70e6b88 92e52e0d b70e5f00 torch_cuda!at::native::_use_cudnn_ctc_loss+0x0
b70e5e70 55c2107b 5ad71ac0 b70e6190 b424a6ea 4370b580 torch_cuda!at::native::_cudnn_rnn_flatten_weight+0x0
b70e60e0 55c53b16 00000001 b70e6b88 00000080 a52c15e8 torch_cpu!at::native::fbgemm_pack_quantized_matrix+0x0
b70e6270 55fcae89 b70e62e8 00000001 b70e62e8 00000001 torch_cpu!at::native::gru+0x0
b70e6300 572b9fa3 b70e6400 00000001 b70e6580 b70e6b88 torch_cpu!at::zeros_out+0x0
b70e6390 55fbdd35 93151ea8 42fa6fc0 00000000 93151ea8 torch_cpu!torch::autograd::GraphRoot::apply+0x0
b70e6410 55e988ec 5ad775c8 19c1f080 a4263fa0 b70e6630 torch_cpu!at::zeros_out+0x0
b70e6510 55f0c1bb 0000000c 00000080 00000004 a7c63d00 torch_cpu!at::native::mkldnn_sigmoid_+0x0
b70e6590 579f7294 b70e66b0 19c1f080 b70e66a0 b70e6848 torch_cpu!at::gru+0x0
b70e67c0 579f62ab b70e6b60 55e2030e b70e6b60 b70e6b88 torch_cpu!torch::nn::GRUImpl::forward_helper+0x0
b70e68b0 76602621 00000009 b70e75c0 00000000 93151ea8 torch_cpu!torch::nn::GRUImpl::forward+0x0
b70e6ab0 7660705a 00000000 b70e0000 b70e0601 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::error+0x0
b70e6fb0 7660b950 b70e70b0 b70e70b0 00000000 18ef6030 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0
b70ffd50 7684c6f8 4343b2b0 00000000 00000000 41955d60 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
b70ffd90 a0fe7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
b70ffdc0 a21fd0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
b70ffe40 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 12484 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 54908480.000000
- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=00000000b76ff550 rsi=0000000000000000 rdi=000000000000000d
r8=00000000436d8320 r9=000000004364e900 r10=0000000000000000 r11=00000000b76ff4c0 r12=0000000000000064 r13=00000000b76ff550
r14=00000000b76ff250 r15=0000000000000000 rip=00000000a224cb04 rsp=00000000b76ff1f8 rbp=000000004364e9f0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
b76ff1f0 9fad0d40 00000000 b6f96000 a231b4d0 a21c786b ntdll!NtWaitForMultipleObjects+0x0
b76ff4e0 9fad0c3e 41968fc0 a21f630d 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
b76ff520 7409ba44 00000000 00000000 b76ff5e8 438adb28 KERNELBASE!WaitForMultipleObjects+0x0
b76ff760 741308dd 00000000 00000004 00000000 00000000 nvcuda64!+0x0
b76ff810 7409b413 8fc19e4f 0de6727a 43b6a9d0 00000000 nvcuda64!cuProfilerStop+0x0
b76ff840 743a9200 43b6a9d0 00000000 00000000 00000000 nvcuda64!+0x0
b76ff870 a0fe7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
b76ff8a0 a21fd0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
b76ff920 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 5816 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 54619656.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002b4 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002b4
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000043637430 r13=0000000000000000
r14=00000000000002b4 r15=0000000000000000 rip=00000000a224c034 rsp=00000000b77ff858 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
b77ff850 9fa9a34e 00000000 00000000 00000000 00000000 ntdll!NtWaitForSingleObject+0x0
b77ff8f0 742aa9f8 00000000 9faa2cb5 00000000 000002b4 KERNELBASE!WaitForSingleObjectEx+0x0
b77ff960 7409b413 00000001 4405f480 43b6b210 00000000 nvcuda64!cuProfilerStop+0x0
b77ff990 743a9200 43b6b210 00000000 00000000 00000000 nvcuda64!+0x0
b77ff9c0 a0fe7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
b77ff9f0 a21fd0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
b77ffa70 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 6552 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 54908476.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000436db4e8 rdx=00000000b78ffbe8 rsi=00000000b78ffb50 rdi=0000000000000000
r8=0000000000000004 r9=0000000000000004 r10=0000000000000003 r11=00000000b78ffb80 r12=00000000b78ffbe8 r13=0000000000000000
r14=00000000436db4e8 r15=00000000438adca8 rip=00000000a224f9a4 rsp=00000000b78ffb28 rbp=00000000b78ffb80
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
b78ffb20 a22154f5 00000102 00000102 00000000 b78ffb50 ntdll!NtWaitForAlertByThreadId+0x0
b78ffb90 9faeb9d9 438ab490 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0
b78ffbc0 740221da 438ab490 438ab490 438ab490 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0
b78ffc20 7409b413 00000004 8fbf39c2 8fbf39c3 00000000 nvcuda64!+0x0
b78ffc50 743a9200 43b6b8a0 00000000 00000000 00000000 nvcuda64!+0x0
b78ffc80 a0fe7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
b78ffcb0 a21fd0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
b78ffd30 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 7516 (state: Running): ***
- Information -
Status: Base Priority: Unknown, Priority: Unknown, , Kernel Time: 830937472.000000, User Time: 13390155776.000000, Wait Time: 54908468.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000a5395e08 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000a5395e08
r8=0000000041a61770 r9=00000000000000c0 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=00000000b79ff4e0 r15=00000000a5395db8 rip=00000000a224f9a4 rsp=00000000b79ff4b8 rbp=00000000b79ff510
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
b79ff4b0 a2215281 92d9efe8 ffffffff 92d9efe8 00000001 ntdll!NtWaitForAlertByThreadId+0x0
b79ff530 9faeba89 9330b260 a5395df8 a5395df8 a4ff3920 ntdll!RtlSleepConditionVariableSRW+0x0
b79ff570 9330b278 9330b260 b79ff5f0 a5395df8 a5395df8 KERNELBASE!SleepConditionVariableSRW+0x0
b79ff5a0 9330b4b0 00000000 9330ba8e 00000000 a2f871a0 MSVCP140!std::_Syserror_map+0x0
b79ff620 5763064b a2f87180 000001c0 a5395db0 a5395db0 MSVCP140!_Cnd_destroy+0x0
b79ff660 576325b1 a7e78330 ffffffff a2f87180 ffffffff torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
b79ff950 57632471 5ab56d10 b79ff990 5ab56d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0
b79ff9a0 57629744 00080001 a5be32a0 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0
b79ff9d0 9fd714c2 a5be32a0 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0
b79ffa00 a0fe7034 00000000 00000000 00000000 00000000 ucrtbase!_configthreadlocale+0x0
b79ffa30 a21fd0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
b79ffab0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)