Task 10593362
| Name | ParityModified-1638639358-2981-3-0_0 |
| Workunit | 7923782 |
| Created | 9 Jan 2022, 9:19:07 UTC |
| Sent | 26 Jan 2022, 20:30:23 UTC |
| Report deadline | 3 Feb 2022, 20:30:23 UTC |
| Received | 27 Jan 2022, 0:47:20 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | -529697949 (0xE06D7363) Unknown error code |
| Computer ID | 18384 |
| Run time | 1 hours 35 min 59 sec |
| CPU time | 1 hours 35 min 3 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 1,880.04 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.62 GB |
| Peak swap size | 3.58 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
NFO : Epoch 388 | loss: 0.0311765 | val_loss: 0.0311765 | Time: 13579 ms
[2022-01-26 17:56:21 main:574] : INFO : Epoch 389 | loss: 0.0311772 | val_loss: 0.0311753 | Time: 14116.7 ms
[2022-01-26 17:56:35 main:574] : INFO : Epoch 390 | loss: 0.0311766 | val_loss: 0.0311751 | Time: 13824.3 ms
[2022-01-26 17:56:49 main:574] : INFO : Epoch 391 | loss: 0.0311776 | val_loss: 0.0311754 | Time: 13937.1 ms
[2022-01-26 17:57:02 main:574] : INFO : Epoch 392 | loss: 0.031176 | val_loss: 0.0311755 | Time: 13230.9 ms
[2022-01-26 17:57:16 main:574] : INFO : Epoch 393 | loss: 0.0311761 | val_loss: 0.0311772 | Time: 13940.7 ms
[2022-01-26 17:57:30 main:574] : INFO : Epoch 394 | loss: 0.0311789 | val_loss: 0.0311828 | Time: 14158.3 ms
[2022-01-26 17:57:54 main:574] : INFO : Epoch 395 | loss: 0.0311782 | val_loss: 0.0311785 | Time: 23749.8 ms
[2022-01-26 17:58:07 main:574] : INFO : Epoch 396 | loss: 0.0311787 | val_loss: 0.0311792 | Time: 13443.7 ms
[2022-01-26 17:58:21 main:574] : INFO : Epoch 397 | loss: 0.03118 | val_loss: 0.0311833 | Time: 13827.8 ms
[2022-01-26 17:58:35 main:574] : INFO : Epoch 398 | loss: 0.0311787 | val_loss: 0.0311797 | Time: 13347.7 ms
[2022-01-26 17:58:48 main:574] : INFO : Epoch 399 | loss: 0.031176 | val_loss: 0.0311772 | Time: 13620.4 ms
[2022-01-26 17:59:11 main:574] : INFO : Epoch 400 | loss: 0.0311754 | val_loss: 0.0311744 | Time: 23192.9 ms
[2022-01-26 17:59:23 main:574] : INFO : Epoch 401 | loss: 0.0311747 | val_loss: 0.0311745 | Time: 11245.7 ms
[2022-01-26 17:59:34 main:574] : INFO : Epoch 402 | loss: 0.0311737 | val_loss: 0.0311744 | Time: 11659.4 ms
[2022-01-26 17:59:56 main:574] : INFO : Epoch 403 | loss: 0.031173 | val_loss: 0.0311743 | Time: 21844.9 ms
[2022-01-26 18:00:09 main:574] : INFO : Epoch 404 | loss: 0.0311751 | val_loss: 0.031175 | Time: 12560.6 ms
[2022-01-26 18:00:23 main:574] : INFO : Epoch 405 | loss: 0.031175 | val_loss: 0.0311782 | Time: 13707.5 ms
[2022-01-26 18:00:36 main:574] : INFO : Epoch 406 | loss: 0.0311733 | val_loss: 0.0311732 | Time: 13309.3 ms
[2022-01-26 18:00:50 main:574] : INFO : Epoch 407 | loss: 0.0311735 | val_loss: 0.0311737 | Time: 13780.2 ms
[2022-01-26 18:01:02 main:574] : INFO : Epoch 408 | loss: 0.0311729 | val_loss: 0.0311728 | Time: 12803.9 ms
[2022-01-26 18:01:16 main:574] : INFO : Epoch 409 | loss: 0.0311725 | val_loss: 0.031173 | Time: 13804.7 ms
[2022-01-26 18:01:30 main:574] : INFO : Epoch 410 | loss: 0.031173 | val_loss: 0.0311753 | Time: 13995.2 ms
[2022-01-26 18:01:45 main:574] : INFO : Epoch 411 | loss: 0.0311745 | val_loss: 0.031179 | Time: 14370.2 ms
[2022-01-26 18:01:59 main:574] : INFO : Epoch 412 | loss: 0.0311742 | val_loss: 0.0311739 | Time: 13978.4 ms
[2022-01-26 18:02:13 main:574] : INFO : Epoch 413 | loss: 0.0311752 | val_loss: 0.0311785 | Time: 14183.1 ms
[2022-01-26 18:02:26 main:574] : INFO : Epoch 414 | loss: 0.0311817 | val_loss: 0.0311783 | Time: 13628 ms
[2022-01-26 18:02:41 main:574] : INFO : Epoch 415 | loss: 0.0311807 | val_loss: 0.0311798 | Time: 14357.2 ms
[2022-01-26 18:02:54 main:574] : INFO : Epoch 416 | loss: 0.0311789 | val_loss: 0.0311761 | Time: 13640.4 ms
[2022-01-26 18:03:08 main:574] : INFO : Epoch 417 | loss: 0.0311764 | val_loss: 0.0311781 | Time: 13401.3 ms
[2022-01-26 18:03:22 main:574] : INFO : Epoch 418 | loss: 0.031177 | val_loss: 0.0311755 | Time: 14030.1 ms
[2022-01-26 18:03:36 main:574] : INFO : Epoch 419 | loss: 0.0311767 | val_loss: 0.0311753 | Time: 13896.8 ms
[2022-01-26 18:03:49 main:574] : INFO : Epoch 420 | loss: 0.0311755 | val_loss: 0.0311747 | Time: 13237.8 ms
[2022-01-26 18:04:03 main:574] : INFO : Epoch 421 | loss: 0.0311746 | val_loss: 0.0311754 | Time: 14065.4 ms
[2022-01-26 18:04:17 main:574] : INFO : Epoch 422 | loss: 0.0311746 | val_loss: 0.0311761 | Time: 13955.9 ms
[2022-01-26 18:04:31 main:574] : INFO : Epoch 423 | loss: 0.031181 | val_loss: 0.0311788 | Time: 13773.7 ms
[2022-01-26 18:04:45 main:574] : INFO : Epoch 424 | loss: 0.0311791 | val_loss: 0.0311755 | Time: 13716.6 ms
[2022-01-26 18:04:59 main:574] : INFO : Epoch 425 | loss: 0.0311778 | val_loss: 0.0311779 | Time: 13895.9 ms
[2022-01-26 18:05:12 main:574] : INFO : Epoch 426 | loss: 0.0311765 | val_loss: 0.0311765 | Time: 13780 ms
[2022-01-26 18:05:26 main:574] : INFO : Epoch 427 | loss: 0.0311761 | val_loss: 0.0311752 | Time: 13571.5 ms
[2022-01-26 18:05:50 main:574] : INFO : Epoch 428 | loss: 0.031176 | val_loss: 0.0311821 | Time: 23623.7 ms
[2022-01-26 18:06:03 main:574] : INFO : Epoch 429 | loss: 0.0311767 | val_loss: 0.0311747 | Time: 13393.7 ms
[2022-01-26 18:06:17 main:574] : INFO : Epoch 430 | loss: 0.031175 | val_loss: 0.0311754 | Time: 13584.6 ms
[2022-01-26 18:06:30 main:574] : INFO : Epoch 431 | loss: 0.0311744 | val_loss: 0.0311747 | Time: 13147.7 ms
[2022-01-26 18:06:43 main:574] : INFO : Epoch 432 | loss: 0.0311736 | val_loss: 0.0311734 | Time: 13468.4 ms
[2022-01-26 18:06:56 main:574] : INFO : Epoch 433 | loss: 0.0311726 | val_loss: 0.0311726 | Time: 13264.6 ms
[2022-01-26 18:07:10 main:574] : INFO : Epoch 434 | loss: 0.0311736 | val_loss: 0.0311743 | Time: 13634.6 ms
[2022-01-26 18:07:23 main:574] : INFO : Epoch 435 | loss: 0.0311734 | val_loss: 0.0311752 | Time: 12940.4 ms
[2022-01-26 18:07:37 main:574] : INFO : Epoch 436 | loss: 0.0311738 | val_loss: 0.0311769 | Time: 13504.9 ms
[2022-01-26 18:08:00 main:574] : INFO : Epoch 437 | loss: 0.0311754 | val_loss: 0.0311762 | Time: 23492.9 ms
[2022-01-26 18:08:14 main:574] : INFO : Epoch 438 | loss: 0.0311747 | val_loss: 0.0311758 | Time: 14094.9 ms
[2022-01-26 18:08:28 main:574] : INFO : Epoch 439 | loss: 0.0311722 | val_loss: 0.0311731 | Time: 13560.4 ms
[2022-01-26 18:08:41 main:574] : INFO : Epoch 440 | loss: 0.0311714 | val_loss: 0.0311737 | Time: 13684.3 ms
[2022-01-26 18:08:55 main:574] : INFO : Epoch 441 | loss: 0.0311729 | val_loss: 0.0311754 | Time: 13985.1 ms
[2022-01-26 18:09:09 main:574] : INFO : Epoch 442 | loss: 0.0311719 | val_loss: 0.0311726 | Time: 13542.3 ms
[2022-01-26 18:09:21 main:574] : INFO : Epoch 443 | loss: 0.0311749 | val_loss: 0.0311752 | Time: 12209.8 ms
[2022-01-26 18:09:34 main:574] : INFO : Epoch 444 | loss: 0.0311724 | val_loss: 0.0311769 | Time: 12682.1 ms
[2022-01-26 18:09:57 main:574] : INFO : Epoch 445 | loss: 0.0311747 | val_loss: 0.031194 | Time: 23062.6 ms
[2022-01-26 18:10:07 main:574] : INFO : Epoch 446 | loss: 0.0311991 | val_loss: 0.0312745 | Time: 10417.1 ms
[2022-01-26 18:10:19 main:574] : INFO : Epoch 447 | loss: 0.0321674 | val_loss: 0.0319526 | Time: 11576.9 ms
[2022-01-26 18:10:31 main:574] : INFO : Epoch 448 | loss: 0.0332861 | val_loss: 0.033214 | Time: 12158.9 ms
[2022-01-26 18:10:44 main:574] : INFO : Epoch 449 | loss: 0.0316972 | val_loss: 0.0313853 | Time: 12372.4 ms
[2022-01-26 18:10:57 main:574] : INFO : Epoch 450 | loss: 0.0313027 | val_loss: 0.0312575 | Time: 13241.4 ms
[2022-01-26 18:11:10 main:574] : INFO : Epoch 451 | loss: 0.031246 | val_loss: 0.0312292 | Time: 13419.1 ms
[2022-01-26 18:11:24 main:574] : INFO : Epoch 452 | loss: 0.031225 | val_loss: 0.0312154 | Time: 13881.8 ms
[2022-01-26 18:11:37 main:574] : INFO : Epoch 453 | loss: 0.0312119 | val_loss: 0.0312071 | Time: 13345.1 ms
[2022-01-26 18:12:01 main:574] : INFO : Epoch 454 | loss: 0.0312053 | val_loss: 0.0312013 | Time: 23364.2 ms
[2022-01-26 18:12:14 main:574] : INFO : Epoch 455 | loss: 0.031203 | val_loss: 0.0311999 | Time: 13520.5 ms
[2022-01-26 18:12:28 main:574] : INFO : Epoch 456 | loss: 0.0312025 | val_loss: 0.031204 | Time: 13818.7 ms
[2022-01-26 18:12:41 main:574] : INFO : Epoch 457 | loss: 0.0312018 | val_loss: 0.0312012 | Time: 13075.8 ms
[2022-01-26 18:12:55 main:574] : INFO : Epoch 458 | loss: 0.0312005 | val_loss: 0.0311979 | Time: 13497.3 ms
[2022-01-26 18:13:19 main:574] : INFO : Epoch 459 | loss: 0.031198 | val_loss: 0.0311921 | Time: 24028.9 ms
[2022-01-26 18:13:33 main:574] : INFO : Epoch 460 | loss: 0.0311922 | val_loss: 0.0311868 | Time: 14013.3 ms
[2022-01-26 18:13:46 main:574] : INFO : Epoch 461 | loss: 0.0311874 | val_loss: 0.0311833 | Time: 13331.9 ms
[2022-01-26 18:14:00 main:574] : INFO : Epoch 462 | loss: 0.0311861 | val_loss: 0.0311862 | Time: 14118.6 ms
[2022-01-26 18:14:14 main:574] : INFO : Epoch 463 | loss: 0.0311855 | val_loss: 0.0311851 | Time: 13720.7 ms
[2022-01-26 18:14:28 main:574] : INFO : Epoch 464 | loss: 0.0311836 | val_loss: 0.03118 | Time: 14156.9 ms
[2022-01-26 18:14:42 main:574] : INFO : Epoch 465 | loss: 0.0311818 | val_loss: 0.0311793 | Time: 13964 ms
[2022-01-26 18:14:56 main:574] : INFO : Epoch 466 | loss: 0.0311812 | val_loss: 0.0311793 | Time: 13854.5 ms
[2022-01-26 18:15:09 main:574] : INFO : Epoch 467 | loss: 0.0311806 | val_loss: 0.0311805 | Time: 13192.4 ms
[2022-01-26 18:15:23 main:574] : INFO : Epoch 468 | loss: 0.0311804 | val_loss: 0.0311794 | Time: 13594.6 ms
[2022-01-26 18:15:37 main:574] : INFO : Epoch 469 | loss: 0.0311826 | val_loss: 0.0311838 | Time: 14148.7 ms
[2022-01-26 18:15:51 main:574] : INFO : Epoch 470 | loss: 0.0311839 | val_loss: 0.0311836 | Time: 13982.3 ms
[2022-01-26 18:16:05 main:574] : INFO : Epoch 471 | loss: 0.0311804 | val_loss: 0.0311821 | Time: 13837.9 ms
[2022-01-26 18:16:18 main:574] : INFO : Epoch 472 | loss: 0.0311804 | val_loss: 0.031177 | Time: 13539.5 ms
[2022-01-26 18:16:32 main:574] : INFO : Epoch 473 | loss: 0.0311777 | val_loss: 0.0311765 | Time: 13665.3 ms
[2022-01-26 18:16:45 main:574] : INFO : Epoch 474 | loss: 0.0311771 | val_loss: 0.0311763 | Time: 12827.5 ms
[2022-01-26 18:17:29 main:574] : INFO : Epoch 475 | loss: 0.0311766 | val_loss: 0.0311761 | Time: 43905.6 ms
[2022-01-26 18:17:41 main:574] : INFO : Epoch 476 | loss: 0.0311767 | val_loss: 0.0311754 | Time: 12091 ms
[2022-01-26 18:17:53 main:574] : INFO : Epoch 477 | loss: 0.0311763 | val_loss: 0.0311761 | Time: 11966.6 ms
[2022-01-26 18:18:06 main:574] : INFO : Epoch 478 | loss: 0.0311754 | val_loss: 0.0311762 | Time: 12947.5 ms
[2022-01-26 18:18:19 main:574] : INFO : Epoch 479 | loss: 0.0311759 | val_loss: 0.0311774 | Time: 13376.3 ms
[2022-01-26 18:18:33 main:574] : INFO : Epoch 480 | loss: 0.0311773 | val_loss: 0.0311755 | Time: 13597.9 ms
[2022-01-26 18:18:47 main:574] : INFO : Epoch 481 | loss: 0.031175 | val_loss: 0.0311752 | Time: 13861.5 ms
[2022-01-26 18:19:00 main:574] : INFO : Epoch 482 | loss: 0.0311753 | val_loss: 0.0311744 | Time: 13459 ms
[2022-01-26 18:19:14 main:574] : INFO : Epoch 483 | loss: 0.0311747 | val_loss: 0.0311776 | Time: 13256 ms
[2022-01-26 18:19:27 main:574] : INFO : Epoch 484 | loss: 0.0311759 | val_loss: 0.0311767 | Time: 13807.5 ms
[2022-01-26 18:19:41 main:574] : INFO : Epoch 485 | loss: 0.0311745 | val_loss: 0.0311772 | Time: 13662 ms
[2022-01-26 18:19:55 main:574] : INFO : Epoch 486 | loss: 0.0311752 | val_loss: 0.0311775 | Time: 13941.2 ms
[2022-01-26 18:20:09 main:574] : INFO : Epoch 487 | loss: 0.0311747 | val_loss: 0.0311736 | Time: 13982.9 ms
[2022-01-26 18:20:22 main:574] : INFO : Epoch 488 | loss: 0.0311729 | val_loss: 0.0311746 | Time: 12913.3 ms
[2022-01-26 18:20:35 main:574] : INFO : Epoch 489 | loss: 0.0311726 | val_loss: 0.0311733 | Time: 12869.6 ms
[2022-01-26 18:20:48 main:574] : INFO : Epoch 490 | loss: 0.0311742 | val_loss: 0.0311752 | Time: 13007.9 ms
[2022-01-26 18:21:00 main:574] : INFO : Epoch 491 | loss: 0.031173 | val_loss: 0.0311728 | Time: 11799.4 ms
[2022-01-26 18:21:11 main:574] : INFO : Epoch 492 | loss: 0.0311733 | val_loss: 0.0311725 | Time: 11449.8 ms
[2022-01-26 18:21:23 main:574] : INFO : Epoch 493 | loss: 0.0311739 | val_loss: 0.0311739 | Time: 12133.3 ms
[2022-01-26 18:21:36 main:574] : INFO : Epoch 494 | loss: 0.0311723 | val_loss: 0.0311748 | Time: 12337.7 ms
[2022-01-26 18:21:48 main:574] : INFO : Epoch 495 | loss: 0.0311737 | val_loss: 0.0311731 | Time: 12745.1 ms
[2022-01-26 18:22:01 main:574] : INFO : Epoch 496 | loss: 0.0311735 | val_loss: 0.0311721 | Time: 12941.3 ms
[2022-01-26 18:22:14 main:574] : INFO : Epoch 497 | loss: 0.0311724 | val_loss: 0.031172 | Time: 12917 ms
[2022-01-26 18:22:28 main:574] : INFO : Epoch 498 | loss: 0.0311717 | val_loss: 0.0311727 | Time: 13586.1 ms
[2022-01-26 18:22:41 main:574] : INFO : Epoch 499 | loss: 0.0311716 | val_loss: 0.0311722 | Time: 13669.6 ms
[2022-01-26 18:22:55 main:574] : INFO : Epoch 500 | loss: 0.031171 | val_loss: 0.0311735 | Time: 13698.8 ms
[2022-01-26 18:23:19 main:574] : INFO : Epoch 501 | loss: 0.0311711 | val_loss: 0.0311751 | Time: 23436.3 ms
[2022-01-26 18:23:32 main:574] : INFO : Epoch 502 | loss: 0.0311728 | val_loss: 0.0311729 | Time: 13154.9 ms
[2022-01-26 18:23:45 main:574] : INFO : Epoch 503 | loss: 0.0311708 | val_loss: 0.0311747 | Time: 13127 ms
[2022-01-26 18:23:58 main:574] : INFO : Epoch 504 | loss: 0.0311711 | val_loss: 0.0311757 | Time: 13461.2 ms
[2022-01-26 18:24:12 main:574] : INFO : Epoch 505 | loss: 0.0311696 | val_loss: 0.0311731 | Time: 13324.2 ms
[2022-01-26 18:24:25 main:574] : INFO : Epoch 506 | loss: 0.0311695 | val_loss: 0.0311749 | Time: 13415.3 ms
[2022-01-26 18:24:49 main:574] : INFO : Epoch 507 | loss: 0.03117 | val_loss: 0.0311725 | Time: 23546.2 ms
[2022-01-26 18:25:02 main:574] : INFO : Epoch 508 | loss: 0.0311688 | val_loss: 0.0311745 | Time: 13291.7 ms
[2022-01-26 18:25:16 main:574] : INFO : Epoch 509 | loss: 0.0311693 | val_loss: 0.0311787 | Time: 13889.8 ms
[2022-01-26 18:25:30 main:574] : INFO : Epoch 510 | loss: 0.0311706 | val_loss: 0.0311744 | Time: 13779.5 ms
[2022-01-26 18:25:43 main:574] : INFO : Epoch 511 | loss: 0.0311687 | val_loss: 0.0311738 | Time: 12836.8 ms
[2022-01-26 18:26:06 main:574] : INFO : Epoch 512 | loss: 0.0311677 | val_loss: 0.0311734 | Time: 23468.4 ms
[2022-01-26 18:26:20 main:574] : INFO : Epoch 513 | loss: 0.0311677 | val_loss: 0.0311721 | Time: 13574.8 ms
[2022-01-26 18:26:33 main:574] : INFO : Epoch 514 | loss: 0.0311675 | val_loss: 0.031174 | Time: 13580.3 ms
[2022-01-26 18:26:47 main:574] : INFO : Epoch 515 | loss: 0.0311677 | val_loss: 0.0311742 | Time: 13468.7 ms
[2022-01-26 18:27:00 main:574] : INFO : Epoch 516 | loss: 0.0311673 | val_loss: 0.0311751 | Time: 13220.2 ms
[2022-01-26 18:27:13 main:574] : INFO : Epoch 517 | loss: 0.0311677 | val_loss: 0.0311727 | Time: 12975 ms
[2022-01-26 18:27:26 main:574] : INFO : Epoch 518 | loss: 0.0311663 | val_loss: 0.0311745 | Time: 13393 ms
[2022-01-26 18:27:41 main:574] : INFO : Epoch 519 | loss: 0.0311675 | val_loss: 0.0311736 | Time: 14338.2 ms
[2022-01-26 18:27:54 main:574] : INFO : Epoch 520 | loss: 0.0311675 | val_loss: 0.0311754 | Time: 13515.6 ms
[2022-01-26 18:28:08 main:574] : INFO : Epoch 521 | loss: 0.0311668 | val_loss: 0.0311725 | Time: 13844.5 ms
[2022-01-26 18:28:21 main:574] : INFO : Epoch 522 | loss: 0.0311696 | val_loss: 0.0311743 | Time: 13357.7 ms
[2022-01-26 18:28:35 main:574] : INFO : Epoch 523 | loss: 0.031168 | val_loss: 0.0311709 | Time: 13574.2 ms
[2022-01-26 18:28:48 main:574] : INFO : Epoch 524 | loss: 0.0311656 | val_loss: 0.0311715 | Time: 13312.1 ms
[2022-01-26 18:29:02 main:574] : INFO : Epoch 525 | loss: 0.031167 | val_loss: 0.0311793 | Time: 13227 ms
[2022-01-26 18:29:15 main:574] : INFO : Epoch 526 | loss: 0.0311692 | val_loss: 0.0311722 | Time: 13075.7 ms
[2022-01-26 18:29:28 main:574] : INFO : Epoch 527 | loss: 0.0311714 | val_loss: 0.0311801 | Time: 13609.7 ms
[2022-01-26 18:29:41 main:574] : INFO : Epoch 528 | loss: 0.0311675 | val_loss: 0.0311747 | Time: 12948.7 ms
[2022-01-26 18:29:55 main:574] : INFO : Epoch 529 | loss: 0.0311674 | val_loss: 0.0311719 | Time: 13991.4 ms
[2022-01-26 18:30:09 main:574] : INFO : Epoch 530 | loss: 0.0311649 | val_loss: 0.0311721 | Time: 13613.7 ms
[2022-01-26 18:30:22 main:574] : INFO : Epoch 531 | loss: 0.0311703 | val_loss: 0.0311733 | Time: 13600.5 ms
[2022-01-26 18:30:35 main:574] : INFO : Epoch 532 | loss: 0.0311683 | val_loss: 0.0311738 | Time: 12807.2 ms
[2022-01-26 18:30:48 main:574] : INFO : Epoch 533 | loss: 0.0311681 | val_loss: 0.0311735 | Time: 12775.3 ms
[2022-01-26 18:31:01 main:574] : INFO : Epoch 534 | loss: 0.0311681 | val_loss: 0.0311727 | Time: 12603.7 ms
[2022-01-26 18:31:13 main:574] : INFO : Epoch 535 | loss: 0.031171 | val_loss: 0.0311752 | Time: 12203.8 ms
[2022-01-26 18:31:25 main:574] : INFO : Epoch 536 | loss: 0.0311735 | val_loss: 0.0311705 | Time: 11934.1 ms
[2022-01-26 18:31:36 main:574] : INFO : Epoch 537 | loss: 0.0311684 | val_loss: 0.0311693 | Time: 11422.1 ms
[2022-01-26 18:31:47 main:574] : INFO : Epoch 538 | loss: 0.0311685 | val_loss: 0.0311704 | Time: 11167.2 ms
[2022-01-26 18:32:09 main:574] : INFO : Epoch 539 | loss: 0.0311676 | val_loss: 0.0311687 | Time: 21389.5 ms
[2022-01-26 18:32:22 main:574] : INFO : Epoch 540 | loss: 0.0311671 | val_loss: 0.0311702 | Time: 12898.7 ms
[2022-01-26 18:32:35 main:574] : INFO : Epoch 541 | loss: 0.0311666 | val_loss: 0.0311673 | Time: 13511 ms
[2022-01-26 18:32:49 main:574] : INFO : Epoch 542 | loss: 0.0311652 | val_loss: 0.0311678 | Time: 13617 ms
[2022-01-26 18:33:01 main:574] : INFO : Epoch 543 | loss: 0.0311658 | val_loss: 0.0311658 | Time: 12193.7 ms
[2022-01-26 18:33:15 main:574] : INFO : Epoch 544 | loss: 0.0311673 | val_loss: 0.0311674 | Time: 14079.1 ms
[2022-01-26 18:33:29 main:574] : INFO : Epoch 545 | loss: 0.0311648 | val_loss: 0.0311665 | Time: 13453.4 ms
[2022-01-26 18:33:43 main:574] : INFO : Epoch 546 | loss: 0.0311649 | val_loss: 0.0311677 | Time: 13993.6 ms
[2022-01-26 18:33:57 main:574] : INFO : Epoch 547 | loss: 0.0311645 | val_loss: 0.0311647 | Time: 13944.4 ms
[2022-01-26 18:34:10 main:574] : INFO : Epoch 548 | loss: 0.0311639 | val_loss: 0.0311668 | Time: 13696 ms
[2022-01-26 18:34:24 main:574] : INFO : Epoch 549 | loss: 0.0311633 | val_loss: 0.0311652 | Time: 13494.9 ms
[2022-01-26 18:34:38 main:574] : INFO : Epoch 550 | loss: 0.0311631 | val_loss: 0.0311657 | Time: 13708.4 ms
[2022-01-26 18:34:51 main:574] : INFO : Epoch 551 | loss: 0.0311627 | val_loss: 0.0311655 | Time: 13166.6 ms
[2022-01-26 18:35:05 main:574] : INFO : Epoch 552 | loss: 0.0311622 | val_loss: 0.0311661 | Time: 13764 ms
[2022-01-26 18:35:18 main:574] : INFO : Epoch 553 | loss: 0.0311629 | val_loss: 0.0311681 | Time: 13298.7 ms
[2022-01-26 18:35:32 main:574] : INFO : Epoch 554 | loss: 0.0311616 | val_loss: 0.0311661 | Time: 13846 ms
[2022-01-26 18:35:45 main:574] : INFO : Epoch 555 | loss: 0.0311618 | val_loss: 0.0311681 | Time: 13088.3 ms
[2022-01-26 18:35:59 main:574] : INFO : Epoch 556 | loss: 0.0311649 | val_loss: 0.031166 | Time: 13925.1 ms
[2022-01-26 18:36:12 main:574] : INFO : Epoch 557 | loss: 0.0311611 | val_loss: 0.0311664 | Time: 13327.1 ms
[2022-01-26 18:36:25 main:574] : INFO : Epoch 558 | loss: 0.0311591 | val_loss: 0.031168 | Time: 13326.2 ms
[2022-01-26 18:36:40 main:574] : INFO : Epoch 559 | loss: 0.0311599 | val_loss: 0.0311675 | Time: 14132.6 ms
[2022-01-26 18:36:53 main:574] : INFO : Epoch 560 | loss: 0.0311612 | val_loss: 0.0311653 | Time: 13779.9 ms
[2022-01-26 18:37:07 main:574] : INFO : Epoch 561 | loss: 0.0311597 | val_loss: 0.0311666 | Time: 13661.6 ms
[2022-01-26 18:37:20 main:574] : INFO : Epoch 562 | loss: 0.0311595 | val_loss: 0.0311664 | Time: 13038.4 ms
[2022-01-26 18:37:28 main:574] : INFO : Epoch 563 | loss: 0.031162 | val_loss: 0.0311668 | Time: 8346.59 ms
[2022-01-26 18:37:34 main:574] : INFO : Epoch 564 | loss: 0.0311606 | val_loss: 0.0311681 | Time: 5446.73 ms
[2022-01-26 18:37:39 main:574] : INFO : Epoch 565 | loss: 0.0311599 | val_loss: 0.0311662 | Time: 5565.98 ms
[2022-01-26 18:37:45 main:574] : INFO : Epoch 566 | loss: 0.0311595 | val_loss: 0.0311683 | Time: 5723.41 ms
[2022-01-26 18:37:51 main:574] : INFO : Epoch 567 | loss: 0.0311586 | val_loss: 0.0311649 | Time: 5873.12 ms
[2022-01-26 18:37:57 main:574] : INFO : Epoch 568 | loss: 0.031158 | val_loss: 0.0311644 | Time: 6002.28 ms
[2022-01-26 18:38:03 main:574] : INFO : Epoch 569 | loss: 0.0311568 | val_loss: 0.0311658 | Time: 5716.92 ms
[2022-01-26 18:38:08 main:574] : INFO : Epoch 570 | loss: 0.0311568 | val_loss: 0.0311642 | Time: 5701.37 ms
[2022-01-26 18:38:15 main:574] : INFO : Epoch 571 | loss: 0.0311562 | val_loss: 0.031165 | Time: 6142.78 ms
[2022-01-26 18:38:21 main:574] : INFO : Epoch 572 | loss: 0.0311561 | val_loss: 0.0311675 | Time: 6118.29 ms
[2022-01-26 18:38:27 main:574] : INFO : Epoch 573 | loss: 0.0311565 | val_loss: 0.0311657 | Time: 5835.87 ms
[2022-01-26 18:38:33 main:574] : INFO : Epoch 574 | loss: 0.0311568 | val_loss: 0.0311637 | Time: 6182.31 ms
[2022-01-26 18:38:39 main:574] : INFO : Epoch 575 | loss: 0.031156 | val_loss: 0.0311625 | Time: 6017.3 ms
[2022-01-26 18:38:55 main:574] : INFO : Epoch 576 | loss: 0.0311563 | val_loss: 0.031164 | Time: 15815.3 ms
[2022-01-26 18:39:00 main:574] : INFO : Epoch 577 | loss: 0.0311585 | val_loss: 0.0311617 | Time: 5763.1 ms
[2022-01-26 18:39:06 main:574] : INFO : Epoch 578 | loss: 0.0311574 | val_loss: 0.0311625 | Time: 5973.29 ms
[2022-01-26 18:39:12 main:574] : INFO : Epoch 579 | loss: 0.031181 | val_loss: 0.0311829 | Time: 5679.36 ms
[2022-01-26 18:39:18 main:574] : INFO : Epoch 580 | loss: 0.0311814 | val_loss: 0.0311805 | Time: 5751.02 ms
[2022-01-26 18:39:23 main:574] : INFO : Epoch 581 | loss: 0.0311788 | val_loss: 0.0311802 | Time: 5600.44 ms
[2022-01-26 18:39:29 main:574] : INFO : Epoch 582 | loss: 0.0311766 | val_loss: 0.0311748 | Time: 5902.43 ms
[2022-01-26 18:39:35 main:574] : INFO : Epoch 583 | loss: 0.0311738 | val_loss: 0.0311743 | Time: 5810.38 ms
[2022-01-26 18:39:41 main:574] : INFO : Epoch 584 | loss: 0.0311734 | val_loss: 0.0311728 | Time: 5558.69 ms
[2022-01-26 18:39:46 main:574] : INFO : Epoch 585 | loss: 0.0311723 | val_loss: 0.0311717 | Time: 5587.39 ms
[2022-01-26 18:39:52 main:574] : INFO : Epoch 586 | loss: 0.0311693 | val_loss: 0.0311718 | Time: 5881.87 ms
[2022-01-26 18:39:58 main:574] : INFO : Epoch 587 | loss: 0.0311687 | val_loss: 0.0311707 | Time: 5749.29 ms
[2022-01-26 18:40:14 main:574] : INFO : Epoch 588 | loss: 0.0311675 | val_loss: 0.0311699 | Time: 15723.5 ms
[2022-01-26 18:40:20 main:574] : INFO : Epoch 589 | loss: 0.0311664 | val_loss: 0.0311686 | Time: 5904.52 ms
[2022-01-26 18:40:25 main:574] : INFO : Epoch 590 | loss: 0.0311655 | val_loss: 0.0311688 | Time: 5693.7 ms
[2022-01-26 18:40:31 main:574] : INFO : Epoch 591 | loss: 0.0311647 | val_loss: 0.0311688 | Time: 5577.1 ms
[2022-01-26 18:40:37 main:574] : INFO : Epoch 592 | loss: 0.0311641 | val_loss: 0.0311692 | Time: 5872.18 ms
[2022-01-26 18:40:43 main:574] : INFO : Epoch 593 | loss: 0.0311627 | val_loss: 0.0311683 | Time: 5961.55 ms
[2022-01-26 18:40:49 main:574] : INFO : Epoch 594 | loss: 0.031163 | val_loss: 0.0311677 | Time: 5970.65 ms
[2022-01-26 18:40:55 main:574] : INFO : Epoch 595 | loss: 0.0311623 | val_loss: 0.0311656 | Time: 6183.81 ms
[2022-01-26 18:41:01 main:574] : INFO : Epoch 596 | loss: 0.0311608 | val_loss: 0.0311654 | Time: 6074.85 ms
[2022-01-26 18:41:07 main:574] : INFO : Epoch 597 | loss: 0.0311625 | val_loss: 0.0311661 | Time: 5782.68 ms
[2022-01-26 18:41:13 main:574] : INFO : Epoch 598 | loss: 0.0311622 | val_loss: 0.0311667 | Time: 6674.71 ms
[2022-01-26 18:41:20 main:574] : INFO : Epoch 599 | loss: 0.0311618 | val_loss: 0.0311662 | Time: 6519.71 ms
[2022-01-26 18:41:27 main:574] : INFO : Epoch 600 | loss: 0.0311621 | val_loss: 0.0311659 | Time: 6529.29 ms
[2022-01-26 18:41:33 main:574] : INFO : Epoch 601 | loss: 0.0311605 | val_loss: 0.0311647 | Time: 6272.43 ms
[2022-01-26 18:41:39 main:574] : INFO : Epoch 602 | loss: 0.0311593 | val_loss: 0.0311649 | Time: 6289.16 ms
[2022-01-26 18:41:46 main:574] : INFO : Epoch 603 | loss: 0.0311588 | val_loss: 0.0311655 | Time: 6531.89 ms
[2022-01-26 18:41:52 main:574] : INFO : Epoch 604 | loss: 0.0311606 | val_loss: 0.0311652 | Time: 6048.11 ms
[2022-01-26 18:41:58 main:574] : INFO : Epoch 605 | loss: 0.0311611 | val_loss: 0.0311667 | Time: 5860.17 ms
[2022-01-26 18:42:03 main:574] : INFO : Epoch 606 | loss: 0.0311596 | val_loss: 0.031165 | Time: 5523.67 ms
[2022-01-26 18:42:09 main:574] : INFO : Epoch 607 | loss: 0.031159 | val_loss: 0.0311657 | Time: 5925.95 ms
[2022-01-26 18:42:15 main:574] : INFO : Epoch 608 | loss: 0.0311579 | val_loss: 0.0311647 | Time: 6199.9 ms
[2022-01-26 18:42:21 main:574] : INFO : Epoch 609 | loss: 0.0311585 | val_loss: 0.0311638 | Time: 5893.14 ms
[2022-01-26 18:42:27 main:574] : INFO : Epoch 610 | loss: 0.0311573 | val_loss: 0.0311629 | Time: 6241.59 ms
[2022-01-26 18:42:33 main:574] : INFO : Epoch 611 | loss: 0.0311575 | val_loss: 0.0311637 | Time: 6116.54 ms
[2022-01-26 18:42:40 main:574] : INFO : Epoch 612 | loss: 0.0311575 | val_loss: 0.0311621 | Time: 6161.92 ms
[2022-01-26 18:42:45 main:574] : INFO : Epoch 613 | loss: 0.0311571 | val_loss: 0.031163 | Time: 5655.23 ms
[2022-01-26 18:42:51 main:574] : INFO : Epoch 614 | loss: 0.0311568 | val_loss: 0.0311651 | Time: 5954.83 ms
[2022-01-26 18:42:57 main:574] : INFO : Epoch 615 | loss: 0.0311583 | val_loss: 0.0311632 | Time: 5912.22 ms
[2022-01-26 18:43:03 main:574] : INFO : Epoch 616 | loss: 0.0311579 | val_loss: 0.0311638 | Time: 6027.51 ms
[2022-01-26 18:43:09 main:574] : INFO : Epoch 617 | loss: 0.0311591 | val_loss: 0.0311608 | Time: 5685.49 ms
[2022-01-26 18:43:25 main:574] : INFO : Epoch 618 | loss: 0.0311568 | val_loss: 0.0311612 | Time: 16488.2 ms
[2022-01-26 18:43:32 main:574] : INFO : Epoch 619 | loss: 0.0311555 | val_loss: 0.0311615 | Time: 6926.53 ms
[2022-01-26 18:43:39 main:574] : INFO : Epoch 620 | loss: 0.0311546 | val_loss: 0.0311604 | Time: 7118.31 ms
[2022-01-26 18:43:46 main:574] : INFO : Epoch 621 | loss: 0.0311545 | val_loss: 0.0311628 | Time: 6724.98 ms
[2022-01-26 18:43:52 main:574] : INFO : Epoch 622 | loss: 0.031157 | val_loss: 0.0311648 | Time: 6260.9 ms
[2022-01-26 18:43:59 main:574] : INFO : Epoch 623 | loss: 0.0311549 | val_loss: 0.031163 | Time: 6285.65 ms
[2022-01-26 18:44:05 main:574] : INFO : Epoch 624 | loss: 0.0311558 | val_loss: 0.0311612 | Time: 6277.91 ms
[2022-01-26 18:44:11 main:574] : INFO : Epoch 625 | loss: 0.0311562 | val_loss: 0.0311683 | Time: 6048.51 ms
[2022-01-26 18:44:18 main:574] : INFO : Epoch 626 | loss: 0.0311589 | val_loss: 0.0311651 | Time: 6490.7 ms
[2022-01-26 18:44:24 main:574] : INFO : Epoch 627 | loss: 0.0311572 | val_loss: 0.0311647 | Time: 6067.57 ms
[2022-01-26 18:44:30 main:574] : INFO : Epoch 628 | loss: 0.0311555 | val_loss: 0.0311651 | Time: 6401.67 ms
[2022-01-26 18:44:37 main:574] : INFO : Epoch 629 | loss: 0.0311561 | val_loss: 0.0311597 | Time: 6573.9 ms
[2022-01-26 18:44:53 main:574] : INFO : Epoch 630 | loss: 0.0311554 | val_loss: 0.0311608 | Time: 16304.7 ms
[2022-01-26 18:44:59 main:574] : INFO : Epoch 631 | loss: 0.0311547 | val_loss: 0.0311571 | Time: 6365.67 ms
[2022-01-26 18:45:06 main:574] : INFO : Epoch 632 | loss: 0.0311525 | val_loss: 0.0311585 | Time: 6344.48 ms
[2022-01-26 18:45:12 main:574] : INFO : Epoch 633 | loss: 0.0311534 | val_loss: 0.0311581 | Time: 6540.51 ms
[2022-01-26 18:45:19 main:574] : INFO : Epoch 634 | loss: 0.0311524 | val_loss: 0.0311563 | Time: 6915.91 ms
[2022-01-26 18:45:25 main:574] : INFO : Epoch 635 | loss: 0.0311512 | val_loss: 0.0311582 | Time: 6291.95 ms
[2022-01-26 18:45:32 main:574] : INFO : Epoch 636 | loss: 0.0311511 | val_loss: 0.0311568 | Time: 6558.32 ms
[2022-01-26 18:45:38 main:574] : INFO : Epoch 637 | loss: 0.0311508 | val_loss: 0.0311562 | Time: 6373.03 ms
[2022-01-26 18:45:45 main:574] : INFO : Epoch 638 | loss: 0.0311496 | val_loss: 0.0311555 | Time: 6844.44 ms
[2022-01-26 18:45:52 main:574] : INFO : Epoch 639 | loss: 0.0311499 | val_loss: 0.0311562 | Time: 6587.94 ms
[2022-01-26 18:46:08 main:574] : INFO : Epoch 640 | loss: 0.0311489 | val_loss: 0.0311542 | Time: 16631.2 ms
[2022-01-26 18:46:15 main:574] : INFO : Epoch 641 | loss: 0.0311514 | val_loss: 0.0311591 | Time: 6852.51 ms
[2022-01-26 18:46:22 main:574] : INFO : Epoch 642 | loss: 0.0311544 | val_loss: 0.0311571 | Time: 6826.41 ms
[2022-01-26 18:46:29 main:574] : INFO : Epoch 643 | loss: 0.0311539 | val_loss: 0.0311588 | Time: 6735.66 ms
[2022-01-26 18:46:36 main:574] : INFO : Epoch 644 | loss: 0.0311521 | val_loss: 0.0311555 | Time: 6916.66 ms
[2022-01-26 18:46:43 main:574] : INFO : Epoch 645 | loss: 0.0311504 | val_loss: 0.0311552 | Time: 6835.04 ms
[2022-01-26 18:46:49 main:574] : INFO : Epoch 646 | loss: 0.0311491 | val_loss: 0.031155 | Time: 6584.71 ms
[2022-01-26 18:46:56 main:574] : INFO : Epoch 647 | loss: 0.0311474 | val_loss: 0.0311528 | Time: 6662.09 ms
[2022-01-26 18:47:03 main:574] : INFO : Epoch 648 | loss: 0.0311478 | val_loss: 0.0311584 | Time: 7001.38 ms
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFF0BF5478C
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 01/26/22 18:47:07
Install Directory : C:\Program Files\BOINC\
Data Directory : C:\ProgramData\BOINC
Project Symstore :
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\2;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 00000000a7cd0000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000000e460000 0000000000207000 C:\windows\SYSTEM32\ntdll.dll (6.2.22000.434) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.22000.434 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.434
ModLoad: 000000000cb90000 00000000000bd000 C:\windows\System32\KERNEL32.DLL (6.2.22000.434) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.22000.434 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.434
ModLoad: 000000000bf10000 0000000000374000 C:\windows\System32\KERNELBASE.dll (6.2.22000.434) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.22000.434 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.434
ModLoad: 000000000d600000 00000000001ac000 C:\windows\System32\USER32.dll (6.2.22000.282) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 000000000ba70000 0000000000026000 C:\windows\System32\win32u.dll (6.2.22000.434) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.22000.434 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.434
ModLoad: 000000000d520000 0000000000029000 C:\windows\System32\GDI32.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 000000000bb20000 0000000000112000 C:\windows\System32\gdi32full.dll (6.2.22000.71) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.22000.71 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.71
ModLoad: 000000000be70000 000000000009d000 C:\windows\System32\msvcp_win.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 000000000b950000 0000000000111000 C:\windows\System32\ucrtbase.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 000000000c990000 00000000000ae000 C:\windows\System32\ADVAPI32.dll (6.2.22000.434) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 000000000caa0000 00000000000a3000 C:\windows\System32\msvcrt.dll (7.0.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.22000.1
ModLoad: 000000000df90000 000000000009e000 C:\windows\System32\sechost.dll (6.2.22000.434) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 000000000d140000 0000000000120000 C:\windows\System32\RPCRT4.dll (6.2.22000.434) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000b76d0000 0000000000058000 C:\ProgramData\BOINC\slots\2\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000a3ec0000 000000000008d000 C:\windows\SYSTEM32\MSVCP140.dll (14.29.30133.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.29.30133.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.29.30133.0
ModLoad: 00000000092b0000 0000000000221000 C:\windows\SYSTEM32\dbghelp.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000f40b0000 000000000001b000 C:\windows\SYSTEM32\VCRUNTIME140.dll (14.29.30133.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.29.30133.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.29.30133.0
ModLoad: 00000000f5e50000 000000000000c000 C:\windows\SYSTEM32\VCRUNTIME140_1.dll (14.29.30133.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.29.30133.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.29.30133.0
ModLoad: 0000000043900000 000000000abe7000 C:\ProgramData\BOINC\slots\2\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000b1860000 000000000020d000 C:\ProgramData\BOINC\slots\2\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 00000000b1580000 00000000002db000 C:\ProgramData\BOINC\slots\2\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000f5db0000 0000000000040000 C:\ProgramData\BOINC\slots\2\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000001edb0000 0000000024b49000 C:\ProgramData\BOINC\slots\2\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000c2280000 0000000000045000 C:\ProgramData\BOINC\slots\2\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000055d70000 00000000030a5000 C:\ProgramData\BOINC\slots\2\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 000000001b8f0000 00000000034b2000 C:\ProgramData\BOINC\slots\2\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 0000000000f30000 0000000000010000 C:\ProgramData\BOINC\slots\2\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 0000000017b90000 0000000003d5b000 C:\ProgramData\BOINC\slots\2\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 0000000002d00000 000000000919f000 C:\ProgramData\BOINC\slots\2\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 000000006d6b0000 0000000001eca000 C:\ProgramData\BOINC\slots\2\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000d40c0000 000000001b3a4000 C:\ProgramData\BOINC\slots\2\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 000000000cb50000 0000000000031000 C:\windows\System32\IMM32.DLL (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 000000000ab40000 0000000000018000 C:\windows\SYSTEM32\kernel.appcore.dll (6.2.22000.71) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.22000.71 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.71
ModLoad: 0000000008c00000 0000000000038000 C:\windows\SYSTEM32\dxcore.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : DXCore.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 000000000c520000 000000000046b000 C:\windows\System32\Setupapi.dll (6.2.22000.194) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 000000000b630000 000000000002c000 C:\windows\SYSTEM32\DEVOBJ.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 000000000b660000 000000000004c000 C:\windows\SYSTEM32\CFGMGR32.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 000000000c290000 0000000000066000 C:\windows\System32\WINTRUST.dll (6.2.22000.434) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.22000.434 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.434
ModLoad: 000000000bd00000 0000000000162000 C:\windows\System32\CRYPT32.dll (6.2.22000.348) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 000000000b210000 0000000000012000 C:\windows\SYSTEM32\MSASN1.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 000000000d7e0000 00000000007ae000 C:\windows\System32\Shell32.dll (6.2.22000.434) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.22000.184 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.184
ModLoad: 0000000009ad0000 0000000000867000 C:\windows\SYSTEM32\windows.storage.dll (6.2.22000.348) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.22000.184 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.184
ModLoad: 000000000cc50000 0000000000378000 C:\windows\System32\combase.dll (6.2.22000.282) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 0000000009960000 0000000000166000 C:\windows\SYSTEM32\wintypes.dll (6.2.22000.41) (-exported- Symbols Loaded)
Linked PDB Filename : WinTypes.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 000000000e190000 00000000000ea000 C:\windows\System32\SHCORE.dll (6.2.22000.71) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 000000000d3c0000 000000000005d000 C:\windows\System32\shlwapi.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000b12b0000 00000000002cc000 C:\windows\system32\nvcuda.dll (30.0.14.7118) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r470\r470_96\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 30.0.14.7118
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.4.56 driver
Product Version : 30.0.14.7118
ModLoad: 0000000001300000 000000000000a000 C:\windows\SYSTEM32\VERSION.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 000000006adb0000 00000000011cb000 C:\windows\system32\DriverStore\FileRepository\nvhm.inf_amd64_ec55af6d757ad0b1\nvcuda64.dll (30.0.14.7118) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r470\r470_96\drivers\gpgpu\_out\wddm2_ms_shipping_wddm2_amd64_release\nvcuda.pdb
File Version : 30.0.14.7118
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.4.56 driver
Product Version : 30.0.14.7118
ModLoad: 00000000fab90000 0000000000031000 C:\windows\SYSTEM32\cryptnet.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 000000000b1b0000 000000000000c000 C:\windows\SYSTEM32\cryptbase.dll (6.2.22000.1) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 0000000005030000 00000000000ac000 C:\windows\system32\uxtheme.dll (6.2.22000.120) (-exported- Symbols Loaded)
Linked PDB Filename : uxtheme.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000e78e0000 0000000000717000 C:\windows\SYSTEM32\nvapi64.dll (30.0.14.7118) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r470\r470_96\drivers\nvapi\gpu\_out\wddm2_ms_shipping_wddm2_amd64_release\nvapi64.pdb
File Version : 30.0.14.7118
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 30.0.14.7118
ModLoad: 000000000e280000 000000000019a000 C:\windows\System32\ole32.dll (6.2.22000.120) (-exported- Symbols Loaded)
Linked PDB Filename : ole32.pdb
File Version : 10.0.22000.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.1
ModLoad: 00000000f5ed0000 0000000000009000 C:\ProgramData\BOINC\slots\2\caffe2_nvrtc.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000069de0000 0000000000fca000 C:\ProgramData\BOINC\slots\2\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6.14.11.9000
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.89 NVRTC Library
Product Version : 6.14.11.9000
ModLoad: 000000000baa0000 000000000007f000 C:\windows\System32\bcryptPrimitives.dll (6.2.22000.376) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.22000.376 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.22000.376
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 4271, Write: 2901, Other 11632
- I/O Transfers Counters -
Read: 9267487, Write: 1816931, Other 76752
- Paged Pool Usage -
QuotaPagedPoolUsage: 3504664, QuotaPeakPagedPoolUsage: 3521048
QuotaNonPagedPoolUsage: 53656, QuotaPeakNonPagedPoolUsage: 53792
- Virtual Memory Usage -
VirtualSize: -441307136, PeakVirtualSize: 178466816
- Pagefile Usage -
PagefileUsage: -441307136, PeakPagefileUsage: -441307136
- Working Set Size -
WorkingSetSize: 897794048, PeakWorkingSetSize: 1744244736, PageFaultCount: 634591
*** Dump of thread ID 15260 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 16305468416.000000, User Time: 16190000128.000000, Wait Time: 51780772.000000
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFF0BF5478C
- Registers -
rax=000000000b9600a6 rbx=000000004dd76a28 rcx=0000000000000000 rdx=0000000000000008 rsi=00000000596e5d80 rdi=0000000019930520
r8=00000000596e5020 r9=00000000a3ef8480 r10=00000000596e4f30 r11=000000001ce79a60 r12=00000000596e5fa0 r13=00000000596e6490
r14=00000000596e6460 r15=00000000596e5f60 rip=000000000bf5478c rsp=00000000596e5c10 rbp=00000000596e5eb1
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000206
- Callstack -
ChildEBP RetAddr Args to Child
596e5ce0 f40b6480 00000000 05155788 00000000 4aadd75c KERNELBASE!RaiseException+0x0
596e5d40 4aae3ac5 596e5d80 cc15c430 cc15c430 4e006d10 VCRUNTIME140!_CxxThrowException+0x0
596e5dc0 4aadeea9 05154010 05154000 fffffffe 00000000 torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::wait+0x0
596e5ef0 4aad56f9 1ce798b0 1ce798b0 596e5ee0 596e5fe8 torch_cpu!torch::autograd::Engine::execute+0x0
596e6410 4aad5086 00000000 596e6878 1ce79b00 596e64e0 torch_cpu!torch::autograd::Engine::make_anomaly_metadata+0x0
596e64b0 4add09be 0b42d8a0 1ce798b8 00000000 596e6450 torch_cpu!torch::autograd::backward+0x0
596e6590 4a801cd0 d77909f0 00000000 00000000 00000000 torch_cpu!torch::autograd::VariableType::allCUDATypes+0x0
596e65c0 494a0a06 00000000 00000000 00010001 00000001 torch_cpu!torch::autograd::GraphRoot::apply+0x0
596e67f0 a7ce7166 596e68c0 596e6900 596e68c0 596e6e60 torch_cpu!at::Tensor::backward+0x0
596e6cf0 a7ceb950 596e6df0 596e6df0 00000000 a58df7b0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0
596ffa90 a7f2c6f8 d76a27d0 00000000 00000000 d70f4760 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
596ffad0 0cba54e0 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
596ffb00 0e46485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
596ffb80 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 24864 (state: Waiting): ***
- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 625000.000000, Wait Time: 51780772.000000
- Registers -
rax=0000000000000034 rbx=0000000059bff8e0 rcx=0000000000000000 rdx=0000000059bff8e0 rsi=00000000595be000 rdi=0000000000000000
r8=0000000059bfdd30 r9=0000000059bfe158 r10=0000000000000009 r11=0000000059bfdd48 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000000e5039e4 rsp=0000000059bff818 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
59bff810 0e4bb4c3 00000000 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0
59bff840 0bf5b3a1 00000000 00000000 00000000 00000000 ntdll!RtlDelayExecution+0x0
59bff8c0 a7d0a07f 00000000 00000000 fff0bdc0 00000000 KERNELBASE!SleepEx+0x0
59bff8f0 0cba54e0 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
59bff920 0e46485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
59bff9a0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 3852 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 312500.000000, User Time: 312500.000000, Wait Time: 51780772.000000
- Registers -
rax=000000000000005b rbx=0000000000000006 rcx=0000000000000006 rdx=0000000059cff550 rsi=0000000000000000 rdi=0000000000000006
r8=0000000059cff1f8 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000064 r13=0000000059cff550
r14=0000000059cff250 r15=0000000000000000 rip=000000000e503eb4 rsp=0000000059cff1f8 rbp=00000000d78ac650
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
59cff1f0 0bf5fb10 00000000 00000000 00000000 00000000 ntdll!NtWaitForMultipleObjects+0x0
59cff4e0 0bf5fa0e 6b2ef1b8 d79641f0 00000006 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
59cff520 6af80604 d78ae2d0 00000000 d78aa5b0 00000000 KERNELBASE!WaitForMultipleObjects+0x0
59cff760 6b026f0d 00000000 d78ac650 00000000 00000000 nvcuda64!+0x0
59cff810 6af7ffd3 c67b8c4a 8e4f9fea d7e8a0d0 00000000 nvcuda64!cuProfilerStop+0x0
59cff840 6b2b3e44 d7e8a0d0 00000000 00000000 00000000 nvcuda64!+0x0
59cff870 0cba54e0 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
59cff8a0 0e46485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
59cff920 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 3440 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 156250.000000, Wait Time: 51780752.000000
- Registers -
rax=00000000000001db rbx=0000000000000000 rcx=00000000d7b22600 rdx=0000000059dffbf8 rsi=0000000000000102 rdi=0000000000000000
r8=0000000000000000 r9=0000000000000000 r10=00000000d7b27350 r11=0000000059dffb90 r12=0000000059dffbf8 r13=0000000000000000
r14=00000000d7b27350 r15=00000000d7b22600 rip=000000000e506eb4 rsp=0000000059dffb38 rbp=0000000059dffb90
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
59dffb30 0e4ca1da 00000102 6b0617c8 00000000 59dffb60 ntdll!NtWaitForAlertByThreadId+0x0
59dffba0 0bf6d449 d7b24b30 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0
59dffbd0 6aeeeacc d7b24b30 d7b24b30 d7b24b30 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0
59dffc30 6af7ffd3 00000004 c63f1940 c5a5ad80 00000000 nvcuda64!+0x0
59dffc60 6b2b3e44 d7e89a10 00000000 00000000 00000000 nvcuda64!+0x0
59dffc90 0cba54e0 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
59dffcc0 0e46485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
59dffd40 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 18580 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 12845937664.000000, User Time: 11686250496.000000, Wait Time: 51780772.000000
- Registers -
rax=00000000000001db rbx=0000000000000000 rcx=0000000002a92318 rdx=0000000000000000 rsi=0000000000000000 rdi=0000000002a92318
r8=0000000000000100 r9=0000000019930520 r10=0000000000000014 r11=0000000059efb490 r12=0000000000000000 r13=0000000000000000
r14=0000000000000102 r15=0000000002a922c8 rip=000000000e506eb4 rsp=0000000059eff8a8 rbp=0000000059eff900
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
59eff8a0 0e4ca697 59effba0 00000000 59eff9a0 00000000 ntdll!NtWaitForAlertByThreadId+0x0
59eff920 0bf6d519 02a92310 02a92308 02a922c0 4aae0504 ntdll!RtlSleepConditionVariableSRW+0x0
59eff960 a3ed2959 00000000 0ba7e720 00000000 00000000 KERNELBASE!SleepConditionVariableSRW+0x0
59eff990 a3ed2bea 8125bb9c 02a922c0 59effba0 02a92308 MSVCP140!std::_Winerror_message+0x0
59eff9c0 4aae064b 02a922c0 59effac0 02a922c0 0ba7ee80 MSVCP140!_Cnd_wait+0x0
59effa00 4aae25b1 201355f0 ffffffff 0ba7ee80 ffffffff torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
59effcf0 4aae2471 4e006d10 59effd30 4e006d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0
59effd40 4aad9744 00080001 1ce6e1e0 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0
59effd70 0b976c0c 1ce6e1e0 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0
59effda0 0cba54e0 00000000 00000000 00000000 00000000 ucrtbase!_recalloc+0x0
59effdd0 0e46485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
59effe50 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 6732 (state: Waiting): ***
- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 51780728.000000
- Registers -
rax=00000000000001de rbx=000000001bb27b80 rcx=0000000000000074 rdx=000000001bb27800 rsi=00000000d5b57370 rdi=000000001bb27b80
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000000e506f14 rsp=00000000597ff508 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
597ff500 0e476b4f 00000000 00000000 d5b57370 00000000 ntdll!NtWaitForWorkViaWorkerFactory+0x0
597ff7f0 0cba54e0 00000000 00000000 00000000 00000000 ntdll!EtwNotificationRegister+0x0
597ff820 0e46485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
597ff8a0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)