Task 9432163
| Name | ParityModified-1638639065-25362-0_0 |
| Workunit | 6848276 |
| Created | 4 Dec 2021, 17:31:10 UTC |
| Sent | 14 Dec 2021, 15:26:10 UTC |
| Report deadline | 22 Dec 2021, 15:26:10 UTC |
| Received | 15 Dec 2021, 8:02:02 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | -529697949 (0xE06D7363) Unknown error code |
| Computer ID | 17492 |
| Run time | 57 min 7 sec |
| CPU time | 56 min 30 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 1,912.04 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.64 GB |
| Peak swap size | 3.60 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
6 main:574] : INFO : Epoch 426 | loss: 0.0310299 | val_loss: 0.0312719 | Time: 4907.56 ms
[2021-12-14 17:13:02 main:574] : INFO : Epoch 427 | loss: 0.0310301 | val_loss: 0.0312676 | Time: 5028.32 ms
[2021-12-14 17:13:07 main:574] : INFO : Epoch 428 | loss: 0.0310332 | val_loss: 0.0312648 | Time: 5581.58 ms
[2021-12-14 17:13:12 main:574] : INFO : Epoch 429 | loss: 0.0310294 | val_loss: 0.031269 | Time: 4903.43 ms
[2021-12-14 17:13:17 main:574] : INFO : Epoch 430 | loss: 0.0310322 | val_loss: 0.0312601 | Time: 4990.29 ms
[2021-12-14 17:13:22 main:574] : INFO : Epoch 431 | loss: 0.0310325 | val_loss: 0.0312713 | Time: 5177.79 ms
[2021-12-14 17:13:27 main:574] : INFO : Epoch 432 | loss: 0.0310313 | val_loss: 0.0312732 | Time: 4979.28 ms
[2021-12-14 17:13:32 main:574] : INFO : Epoch 433 | loss: 0.0310287 | val_loss: 0.0312549 | Time: 5087.23 ms
[2021-12-14 17:13:37 main:574] : INFO : Epoch 434 | loss: 0.0310298 | val_loss: 0.0312635 | Time: 5156.74 ms
[2021-12-14 17:13:43 main:574] : INFO : Epoch 435 | loss: 0.0310313 | val_loss: 0.0312558 | Time: 5171.68 ms
[2021-12-14 17:13:48 main:574] : INFO : Epoch 436 | loss: 0.0310303 | val_loss: 0.0312688 | Time: 5144.7 ms
[2021-12-14 17:13:53 main:574] : INFO : Epoch 437 | loss: 0.0310255 | val_loss: 0.0312554 | Time: 5208.21 ms
[2021-12-14 17:13:58 main:574] : INFO : Epoch 438 | loss: 0.031028 | val_loss: 0.0312398 | Time: 5093.85 ms
[2021-12-14 17:14:03 main:574] : INFO : Epoch 439 | loss: 0.0310476 | val_loss: 0.0312556 | Time: 5267.17 ms
[2021-12-14 17:14:09 main:574] : INFO : Epoch 440 | loss: 0.0310343 | val_loss: 0.0312598 | Time: 5190.01 ms
[2021-12-14 17:14:14 main:574] : INFO : Epoch 441 | loss: 0.0310304 | val_loss: 0.0312837 | Time: 4943.8 ms
[2021-12-14 17:14:19 main:574] : INFO : Epoch 442 | loss: 0.0310245 | val_loss: 0.0312748 | Time: 5291.34 ms
[2021-12-14 17:14:24 main:574] : INFO : Epoch 443 | loss: 0.0310245 | val_loss: 0.0312568 | Time: 5305.17 ms
[2021-12-14 17:14:29 main:574] : INFO : Epoch 444 | loss: 0.0310368 | val_loss: 0.0312696 | Time: 4993.35 ms
[2021-12-14 17:14:35 main:574] : INFO : Epoch 445 | loss: 0.0310341 | val_loss: 0.031283 | Time: 6181.35 ms
[2021-12-14 17:14:42 main:574] : INFO : Epoch 446 | loss: 0.0310372 | val_loss: 0.0312557 | Time: 6634.23 ms
[2021-12-14 17:14:47 main:574] : INFO : Epoch 447 | loss: 0.0310328 | val_loss: 0.0312661 | Time: 5185.4 ms
[2021-12-14 17:14:52 main:574] : INFO : Epoch 448 | loss: 0.0310348 | val_loss: 0.0312597 | Time: 4981.99 ms
[2021-12-14 17:14:57 main:574] : INFO : Epoch 449 | loss: 0.0310297 | val_loss: 0.0312718 | Time: 5210.59 ms
[2021-12-14 17:15:03 main:574] : INFO : Epoch 450 | loss: 0.0310349 | val_loss: 0.0312828 | Time: 5218.62 ms
[2021-12-14 17:15:08 main:574] : INFO : Epoch 451 | loss: 0.0310331 | val_loss: 0.0312726 | Time: 5122.3 ms
[2021-12-14 17:15:13 main:574] : INFO : Epoch 452 | loss: 0.0310348 | val_loss: 0.0312508 | Time: 5220.31 ms
[2021-12-14 17:15:18 main:574] : INFO : Epoch 453 | loss: 0.0310351 | val_loss: 0.0312733 | Time: 5056.8 ms
[2021-12-14 17:15:23 main:574] : INFO : Epoch 454 | loss: 0.0310302 | val_loss: 0.0312791 | Time: 5005.53 ms
[2021-12-14 17:15:28 main:574] : INFO : Epoch 455 | loss: 0.0310244 | val_loss: 0.0312711 | Time: 5012.37 ms
[2021-12-14 17:15:34 main:574] : INFO : Epoch 456 | loss: 0.0310291 | val_loss: 0.0312671 | Time: 5500.02 ms
[2021-12-14 17:15:39 main:574] : INFO : Epoch 457 | loss: 0.0310344 | val_loss: 0.0312806 | Time: 4983.04 ms
[2021-12-14 17:15:44 main:574] : INFO : Epoch 458 | loss: 0.0310271 | val_loss: 0.0312659 | Time: 5157.86 ms
[2021-12-14 17:15:50 main:574] : INFO : Epoch 459 | loss: 0.0310382 | val_loss: 0.0312651 | Time: 5807.91 ms
[2021-12-14 17:15:54 main:574] : INFO : Epoch 460 | loss: 0.0310369 | val_loss: 0.0312808 | Time: 4858.96 ms
[2021-12-14 17:16:00 main:574] : INFO : Epoch 461 | loss: 0.0310366 | val_loss: 0.031246 | Time: 5284.51 ms
[2021-12-14 17:16:05 main:574] : INFO : Epoch 462 | loss: 0.0310366 | val_loss: 0.0312659 | Time: 5194.62 ms
[2021-12-14 17:16:10 main:574] : INFO : Epoch 463 | loss: 0.0310318 | val_loss: 0.0312678 | Time: 5012.82 ms
[2021-12-14 17:16:15 main:574] : INFO : Epoch 464 | loss: 0.0310264 | val_loss: 0.0312731 | Time: 5010.85 ms
[2021-12-14 17:16:21 main:574] : INFO : Epoch 465 | loss: 0.0310288 | val_loss: 0.0312769 | Time: 6268.16 ms
[2021-12-14 17:16:26 main:574] : INFO : Epoch 466 | loss: 0.0310322 | val_loss: 0.0312703 | Time: 5269.59 ms
[2021-12-14 17:16:32 main:574] : INFO : Epoch 467 | loss: 0.0310309 | val_loss: 0.0312728 | Time: 5123.94 ms
[2021-12-14 17:16:37 main:574] : INFO : Epoch 468 | loss: 0.0310334 | val_loss: 0.0312758 | Time: 5127.87 ms
[2021-12-14 17:16:42 main:574] : INFO : Epoch 469 | loss: 0.0310299 | val_loss: 0.0312591 | Time: 5043.51 ms
[2021-12-14 17:16:47 main:574] : INFO : Epoch 470 | loss: 0.0310267 | val_loss: 0.0312654 | Time: 5058.65 ms
[2021-12-14 17:16:52 main:574] : INFO : Epoch 471 | loss: 0.0310267 | val_loss: 0.0312745 | Time: 5287.38 ms
[2021-12-14 17:16:57 main:574] : INFO : Epoch 472 | loss: 0.0310246 | val_loss: 0.0312555 | Time: 5243.27 ms
[2021-12-14 17:17:03 main:574] : INFO : Epoch 473 | loss: 0.0310282 | val_loss: 0.0312723 | Time: 5087.22 ms
[2021-12-14 17:17:08 main:574] : INFO : Epoch 474 | loss: 0.0310309 | val_loss: 0.0312798 | Time: 5063.39 ms
[2021-12-14 17:17:13 main:574] : INFO : Epoch 475 | loss: 0.0310269 | val_loss: 0.0312639 | Time: 5118.85 ms
[2021-12-14 17:17:18 main:574] : INFO : Epoch 476 | loss: 0.0310274 | val_loss: 0.0312744 | Time: 5169.95 ms
[2021-12-14 17:17:23 main:574] : INFO : Epoch 477 | loss: 0.0310263 | val_loss: 0.0312707 | Time: 5026.11 ms
[2021-12-14 17:17:28 main:574] : INFO : Epoch 478 | loss: 0.0310306 | val_loss: 0.0312703 | Time: 4967.68 ms
[2021-12-14 17:17:33 main:574] : INFO : Epoch 479 | loss: 0.0310276 | val_loss: 0.0312503 | Time: 4977.44 ms
[2021-12-14 17:17:38 main:574] : INFO : Epoch 480 | loss: 0.0310296 | val_loss: 0.0312613 | Time: 5092.72 ms
[2021-12-14 17:17:43 main:574] : INFO : Epoch 481 | loss: 0.0310304 | val_loss: 0.0312496 | Time: 5223.25 ms
[2021-12-14 17:17:48 main:574] : INFO : Epoch 482 | loss: 0.0310292 | val_loss: 0.0312726 | Time: 5089.04 ms
[2021-12-14 17:17:54 main:574] : INFO : Epoch 483 | loss: 0.0310372 | val_loss: 0.031263 | Time: 5408.3 ms
[2021-12-14 17:17:59 main:574] : INFO : Epoch 484 | loss: 0.0310339 | val_loss: 0.0312664 | Time: 5088.42 ms
[2021-12-14 17:18:04 main:574] : INFO : Epoch 485 | loss: 0.031029 | val_loss: 0.0312738 | Time: 4930.42 ms
[2021-12-14 17:18:09 main:574] : INFO : Epoch 486 | loss: 0.0310271 | val_loss: 0.0312472 | Time: 5122.35 ms
[2021-12-14 17:18:14 main:574] : INFO : Epoch 487 | loss: 0.031034 | val_loss: 0.0312981 | Time: 5239.29 ms
[2021-12-14 17:18:20 main:574] : INFO : Epoch 488 | loss: 0.0310276 | val_loss: 0.0312473 | Time: 5452.23 ms
[2021-12-14 17:18:25 main:574] : INFO : Epoch 489 | loss: 0.0310263 | val_loss: 0.0312887 | Time: 5460 ms
[2021-12-14 17:18:30 main:574] : INFO : Epoch 490 | loss: 0.0310294 | val_loss: 0.0312417 | Time: 5229.5 ms
[2021-12-14 17:18:35 main:574] : INFO : Epoch 491 | loss: 0.0310359 | val_loss: 0.0312849 | Time: 4990.39 ms
[2021-12-14 17:18:40 main:574] : INFO : Epoch 492 | loss: 0.0310353 | val_loss: 0.0312603 | Time: 4968.17 ms
[2021-12-14 17:18:46 main:574] : INFO : Epoch 493 | loss: 0.0310288 | val_loss: 0.0312937 | Time: 5306.5 ms
[2021-12-14 17:18:51 main:574] : INFO : Epoch 494 | loss: 0.0310373 | val_loss: 0.0312618 | Time: 5001.31 ms
[2021-12-14 17:18:56 main:574] : INFO : Epoch 495 | loss: 0.0310355 | val_loss: 0.0312551 | Time: 5239.86 ms
[2021-12-14 17:19:01 main:574] : INFO : Epoch 496 | loss: 0.0310357 | val_loss: 0.0312608 | Time: 5193.67 ms
[2021-12-14 17:19:07 main:574] : INFO : Epoch 497 | loss: 0.0310319 | val_loss: 0.0312762 | Time: 5699.63 ms
[2021-12-14 17:19:12 main:574] : INFO : Epoch 498 | loss: 0.0310304 | val_loss: 0.0312738 | Time: 5528.96 ms
[2021-12-14 17:19:18 main:574] : INFO : Epoch 499 | loss: 0.0310269 | val_loss: 0.0312618 | Time: 5706.54 ms
[2021-12-14 17:19:23 main:574] : INFO : Epoch 500 | loss: 0.0310462 | val_loss: 0.0312827 | Time: 5244.14 ms
[2021-12-14 17:19:29 main:574] : INFO : Epoch 501 | loss: 0.03103 | val_loss: 0.0312536 | Time: 5329.53 ms
[2021-12-14 17:19:34 main:574] : INFO : Epoch 502 | loss: 0.0310349 | val_loss: 0.0312438 | Time: 5369.43 ms
[2021-12-14 17:19:39 main:574] : INFO : Epoch 503 | loss: 0.0310278 | val_loss: 0.0312607 | Time: 5279.14 ms
[2021-12-14 17:19:44 main:574] : INFO : Epoch 504 | loss: 0.0310219 | val_loss: 0.0312577 | Time: 5034.66 ms
[2021-12-14 17:19:50 main:574] : INFO : Epoch 505 | loss: 0.0310309 | val_loss: 0.0312866 | Time: 5544.94 ms
[2021-12-14 17:19:55 main:574] : INFO : Epoch 506 | loss: 0.0310319 | val_loss: 0.0312696 | Time: 5220.39 ms
[2021-12-14 17:20:00 main:574] : INFO : Epoch 507 | loss: 0.0310302 | val_loss: 0.0312729 | Time: 5136.24 ms
[2021-12-14 17:20:06 main:574] : INFO : Epoch 508 | loss: 0.0310298 | val_loss: 0.0312631 | Time: 5532.17 ms
[2021-12-14 17:20:11 main:574] : INFO : Epoch 509 | loss: 0.0310335 | val_loss: 0.0312885 | Time: 5104.22 ms
[2021-12-14 17:20:16 main:574] : INFO : Epoch 510 | loss: 0.0310289 | val_loss: 0.0312801 | Time: 5213.58 ms
[2021-12-14 17:20:21 main:574] : INFO : Epoch 511 | loss: 0.0310236 | val_loss: 0.0312719 | Time: 5325.68 ms
[2021-12-14 17:20:27 main:574] : INFO : Epoch 512 | loss: 0.0310166 | val_loss: 0.0312932 | Time: 5206.18 ms
[2021-12-14 17:20:32 main:574] : INFO : Epoch 513 | loss: 0.0310217 | val_loss: 0.0312628 | Time: 5689.47 ms
[2021-12-14 17:20:38 main:574] : INFO : Epoch 514 | loss: 0.0310241 | val_loss: 0.0312606 | Time: 5391.91 ms
[2021-12-14 17:20:43 main:574] : INFO : Epoch 515 | loss: 0.0310206 | val_loss: 0.031265 | Time: 5275.69 ms
[2021-12-14 17:20:48 main:574] : INFO : Epoch 516 | loss: 0.0310218 | val_loss: 0.0312583 | Time: 5220.82 ms
[2021-12-14 17:20:55 main:574] : INFO : Epoch 517 | loss: 0.0310304 | val_loss: 0.0313037 | Time: 6331.99 ms
[2021-12-14 17:21:00 main:574] : INFO : Epoch 518 | loss: 0.0310453 | val_loss: 0.0312678 | Time: 5096.36 ms
[2021-12-14 17:21:05 main:574] : INFO : Epoch 519 | loss: 0.0310295 | val_loss: 0.0312634 | Time: 5316.98 ms
[2021-12-14 17:21:10 main:574] : INFO : Epoch 520 | loss: 0.031026 | val_loss: 0.031248 | Time: 5142.38 ms
[2021-12-14 17:21:16 main:574] : INFO : Epoch 521 | loss: 0.0310284 | val_loss: 0.0312625 | Time: 5351.63 ms
[2021-12-14 17:21:21 main:574] : INFO : Epoch 522 | loss: 0.0310253 | val_loss: 0.0312645 | Time: 5278.43 ms
[2021-12-14 17:21:26 main:574] : INFO : Epoch 523 | loss: 0.0310208 | val_loss: 0.0312731 | Time: 5145.73 ms
[2021-12-14 17:21:31 main:574] : INFO : Epoch 524 | loss: 0.0310228 | val_loss: 0.0312696 | Time: 5231.63 ms
[2021-12-14 17:21:37 main:574] : INFO : Epoch 525 | loss: 0.0310213 | val_loss: 0.0312788 | Time: 5236.27 ms
[2021-12-14 17:21:42 main:574] : INFO : Epoch 526 | loss: 0.0310197 | val_loss: 0.0312716 | Time: 5004.54 ms
[2021-12-14 17:21:47 main:574] : INFO : Epoch 527 | loss: 0.0310194 | val_loss: 0.0312759 | Time: 5503.33 ms
[2021-12-14 17:21:52 main:574] : INFO : Epoch 528 | loss: 0.0310307 | val_loss: 0.0312646 | Time: 5104.62 ms
[2021-12-14 17:21:57 main:574] : INFO : Epoch 529 | loss: 0.031027 | val_loss: 0.0312773 | Time: 5101.46 ms
[2021-12-14 17:22:03 main:574] : INFO : Epoch 530 | loss: 0.0310208 | val_loss: 0.0312885 | Time: 5513.35 ms
[2021-12-14 17:22:09 main:574] : INFO : Epoch 531 | loss: 0.0310253 | val_loss: 0.0312684 | Time: 5800.94 ms
[2021-12-14 17:22:24 main:574] : INFO : Epoch 532 | loss: 0.0310203 | val_loss: 0.0312771 | Time: 15287 ms
[2021-12-14 17:22:29 main:574] : INFO : Epoch 533 | loss: 0.0310258 | val_loss: 0.0312584 | Time: 5284.94 ms
[2021-12-14 17:22:34 main:574] : INFO : Epoch 534 | loss: 0.0310253 | val_loss: 0.0312678 | Time: 5074.38 ms
[2021-12-14 17:22:40 main:574] : INFO : Epoch 535 | loss: 0.0310245 | val_loss: 0.0312908 | Time: 5366.31 ms
[2021-12-14 17:22:45 main:574] : INFO : Epoch 536 | loss: 0.0310279 | val_loss: 0.0312452 | Time: 5320.93 ms
[2021-12-14 17:22:50 main:574] : INFO : Epoch 537 | loss: 0.0310218 | val_loss: 0.0312748 | Time: 5142.13 ms
[2021-12-14 17:22:55 main:574] : INFO : Epoch 538 | loss: 0.031022 | val_loss: 0.0312733 | Time: 5179.16 ms
[2021-12-14 17:23:01 main:574] : INFO : Epoch 539 | loss: 0.0310175 | val_loss: 0.0312933 | Time: 5383.52 ms
[2021-12-14 17:23:06 main:574] : INFO : Epoch 540 | loss: 0.0310204 | val_loss: 0.031298 | Time: 4997.41 ms
[2021-12-14 17:23:11 main:574] : INFO : Epoch 541 | loss: 0.0310226 | val_loss: 0.0312769 | Time: 5533.52 ms
[2021-12-14 17:23:17 main:574] : INFO : Epoch 542 | loss: 0.0310318 | val_loss: 0.0312351 | Time: 5813.12 ms
[2021-12-14 17:23:22 main:574] : INFO : Epoch 543 | loss: 0.0310351 | val_loss: 0.0312458 | Time: 5117.47 ms
[2021-12-14 17:23:28 main:574] : INFO : Epoch 544 | loss: 0.0310326 | val_loss: 0.0312595 | Time: 5388.69 ms
[2021-12-14 17:23:33 main:574] : INFO : Epoch 545 | loss: 0.0310256 | val_loss: 0.0312842 | Time: 5443.65 ms
[2021-12-14 17:23:38 main:574] : INFO : Epoch 546 | loss: 0.0310181 | val_loss: 0.03128 | Time: 5076.26 ms
[2021-12-14 17:23:43 main:574] : INFO : Epoch 547 | loss: 0.0310326 | val_loss: 0.0312627 | Time: 5113.05 ms
[2021-12-14 17:23:49 main:574] : INFO : Epoch 548 | loss: 0.0310236 | val_loss: 0.0312953 | Time: 5263.72 ms
[2021-12-14 17:23:54 main:574] : INFO : Epoch 549 | loss: 0.0310259 | val_loss: 0.0312398 | Time: 5599.27 ms
[2021-12-14 17:23:59 main:574] : INFO : Epoch 550 | loss: 0.0310282 | val_loss: 0.0312547 | Time: 5261.73 ms
[2021-12-14 17:24:05 main:574] : INFO : Epoch 551 | loss: 0.0310235 | val_loss: 0.0312653 | Time: 5149.55 ms
[2021-12-14 17:24:10 main:574] : INFO : Epoch 552 | loss: 0.0310212 | val_loss: 0.0312823 | Time: 5542.54 ms
[2021-12-14 17:24:15 main:574] : INFO : Epoch 553 | loss: 0.031024 | val_loss: 0.0312698 | Time: 4922.09 ms
[2021-12-14 17:24:20 main:574] : INFO : Epoch 554 | loss: 0.0310263 | val_loss: 0.0312629 | Time: 5080.85 ms
[2021-12-14 17:24:26 main:574] : INFO : Epoch 555 | loss: 0.0310262 | val_loss: 0.031272 | Time: 5750.94 ms
[2021-12-14 17:24:31 main:574] : INFO : Epoch 556 | loss: 0.0310256 | val_loss: 0.0312658 | Time: 5118.88 ms
[2021-12-14 17:24:36 main:574] : INFO : Epoch 557 | loss: 0.031022 | val_loss: 0.0312874 | Time: 5225.57 ms
[2021-12-14 17:24:42 main:574] : INFO : Epoch 558 | loss: 0.031019 | val_loss: 0.0312729 | Time: 5345.71 ms
[2021-12-14 17:24:47 main:574] : INFO : Epoch 559 | loss: 0.0310192 | val_loss: 0.0312653 | Time: 5106.95 ms
[2021-12-14 17:24:52 main:574] : INFO : Epoch 560 | loss: 0.0310207 | val_loss: 0.0312663 | Time: 5269.4 ms
[2021-12-14 17:24:57 main:574] : INFO : Epoch 561 | loss: 0.0310205 | val_loss: 0.0312889 | Time: 5246.47 ms
[2021-12-14 17:25:02 main:574] : INFO : Epoch 562 | loss: 0.0310275 | val_loss: 0.0312824 | Time: 5095.87 ms
[2021-12-14 17:25:08 main:574] : INFO : Epoch 563 | loss: 0.0310289 | val_loss: 0.0312602 | Time: 5181.27 ms
[2021-12-14 17:25:13 main:574] : INFO : Epoch 564 | loss: 0.0310276 | val_loss: 0.0312749 | Time: 5267.46 ms
[2021-12-14 17:25:18 main:574] : INFO : Epoch 565 | loss: 0.0310363 | val_loss: 0.0312716 | Time: 4839.09 ms
[2021-12-14 17:25:23 main:574] : INFO : Epoch 566 | loss: 0.0310275 | val_loss: 0.0312875 | Time: 5510.42 ms
[2021-12-14 17:25:29 main:574] : INFO : Epoch 567 | loss: 0.0310233 | val_loss: 0.0312816 | Time: 6134.14 ms
[2021-12-14 17:25:35 main:574] : INFO : Epoch 568 | loss: 0.0310226 | val_loss: 0.0312655 | Time: 5708.69 ms
[2021-12-14 17:25:41 main:574] : INFO : Epoch 569 | loss: 0.0310191 | val_loss: 0.0312741 | Time: 5644.27 ms
[2021-12-14 17:25:46 main:574] : INFO : Epoch 570 | loss: 0.0310196 | val_loss: 0.0312607 | Time: 5523.87 ms
[2021-12-14 17:25:52 main:574] : INFO : Epoch 571 | loss: 0.0310185 | val_loss: 0.0312711 | Time: 5521.6 ms
[2021-12-14 17:25:57 main:574] : INFO : Epoch 572 | loss: 0.0310208 | val_loss: 0.0312688 | Time: 5658.67 ms
[2021-12-14 17:26:03 main:574] : INFO : Epoch 573 | loss: 0.0310237 | val_loss: 0.0312914 | Time: 5478.99 ms
[2021-12-14 17:26:09 main:574] : INFO : Epoch 574 | loss: 0.0310241 | val_loss: 0.0312613 | Time: 6258.23 ms
[2021-12-14 17:26:15 main:574] : INFO : Epoch 575 | loss: 0.0310237 | val_loss: 0.0312588 | Time: 5746.36 ms
[2021-12-14 17:26:21 main:574] : INFO : Epoch 576 | loss: 0.0310231 | val_loss: 0.031289 | Time: 6013.19 ms
[2021-12-14 17:26:26 main:574] : INFO : Epoch 577 | loss: 0.031017 | val_loss: 0.0312851 | Time: 5324.26 ms
[2021-12-14 17:26:31 main:574] : INFO : Epoch 578 | loss: 0.0310217 | val_loss: 0.0312886 | Time: 5155.38 ms
[2021-12-14 17:26:37 main:574] : INFO : Epoch 579 | loss: 0.0310226 | val_loss: 0.0312875 | Time: 5178.57 ms
[2021-12-14 17:26:42 main:574] : INFO : Epoch 580 | loss: 0.0310245 | val_loss: 0.0312878 | Time: 5481.12 ms
[2021-12-14 17:26:47 main:574] : INFO : Epoch 581 | loss: 0.0310269 | val_loss: 0.0312422 | Time: 5268.74 ms
[2021-12-14 17:26:53 main:574] : INFO : Epoch 582 | loss: 0.0310323 | val_loss: 0.0312716 | Time: 5604.71 ms
[2021-12-14 17:26:59 main:574] : INFO : Epoch 583 | loss: 0.0310197 | val_loss: 0.0312896 | Time: 6065.83 ms
[2021-12-14 17:27:04 main:574] : INFO : Epoch 584 | loss: 0.0310154 | val_loss: 0.0312911 | Time: 5085.41 ms
[2021-12-14 17:27:10 main:574] : INFO : Epoch 585 | loss: 0.0310245 | val_loss: 0.0312727 | Time: 5325.14 ms
[2021-12-14 17:27:15 main:574] : INFO : Epoch 586 | loss: 0.0310339 | val_loss: 0.0312641 | Time: 5511.79 ms
[2021-12-14 17:27:20 main:574] : INFO : Epoch 587 | loss: 0.0310297 | val_loss: 0.0312571 | Time: 5219.43 ms
[2021-12-14 17:27:26 main:574] : INFO : Epoch 588 | loss: 0.0310245 | val_loss: 0.0312852 | Time: 5485.86 ms
[2021-12-14 17:27:31 main:574] : INFO : Epoch 589 | loss: 0.0310192 | val_loss: 0.031284 | Time: 5685.28 ms
[2021-12-14 17:27:37 main:574] : INFO : Epoch 590 | loss: 0.0310144 | val_loss: 0.0312919 | Time: 5582.41 ms
[2021-12-14 17:27:43 main:574] : INFO : Epoch 591 | loss: 0.0310247 | val_loss: 0.0312662 | Time: 5639.2 ms
[2021-12-14 17:27:48 main:574] : INFO : Epoch 592 | loss: 0.0310249 | val_loss: 0.0312493 | Time: 5225.93 ms
[2021-12-14 17:27:54 main:574] : INFO : Epoch 593 | loss: 0.0310349 | val_loss: 0.0312799 | Time: 5681.65 ms
[2021-12-14 17:27:59 main:574] : INFO : Epoch 594 | loss: 0.0310434 | val_loss: 0.0312739 | Time: 5443.31 ms
[2021-12-14 17:28:05 main:574] : INFO : Epoch 595 | loss: 0.031025 | val_loss: 0.0312841 | Time: 5582.47 ms
[2021-12-14 17:28:20 main:574] : INFO : Epoch 596 | loss: 0.0310334 | val_loss: 0.0312704 | Time: 15261.8 ms
[2021-12-14 17:28:26 main:574] : INFO : Epoch 597 | loss: 0.0310226 | val_loss: 0.0312639 | Time: 5891.76 ms
[2021-12-14 17:28:31 main:574] : INFO : Epoch 598 | loss: 0.0310215 | val_loss: 0.0312654 | Time: 5611.85 ms
[2021-12-14 17:28:36 main:574] : INFO : Epoch 599 | loss: 0.0310217 | val_loss: 0.0312779 | Time: 4889.95 ms
[2021-12-14 17:28:41 main:574] : INFO : Epoch 600 | loss: 0.0310213 | val_loss: 0.0312655 | Time: 4985.87 ms
[2021-12-14 17:28:47 main:574] : INFO : Epoch 601 | loss: 0.0310198 | val_loss: 0.0312778 | Time: 5464.77 ms
[2021-12-14 17:28:52 main:574] : INFO : Epoch 602 | loss: 0.0310172 | val_loss: 0.0312807 | Time: 5068.32 ms
[2021-12-14 17:28:57 main:574] : INFO : Epoch 603 | loss: 0.0310205 | val_loss: 0.0312677 | Time: 4961.67 ms
[2021-12-14 17:29:02 main:574] : INFO : Epoch 604 | loss: 0.0310283 | val_loss: 0.0312639 | Time: 5593.18 ms
[2021-12-14 17:29:08 main:574] : INFO : Epoch 605 | loss: 0.0310164 | val_loss: 0.0312732 | Time: 5391 ms
[2021-12-14 17:29:13 main:574] : INFO : Epoch 606 | loss: 0.0310164 | val_loss: 0.0312875 | Time: 5228.53 ms
[2021-12-14 17:29:19 main:574] : INFO : Epoch 607 | loss: 0.0310195 | val_loss: 0.0312688 | Time: 5709.05 ms
[2021-12-14 17:29:24 main:574] : INFO : Epoch 608 | loss: 0.0310202 | val_loss: 0.031259 | Time: 5220.71 ms
[2021-12-14 17:29:29 main:574] : INFO : Epoch 609 | loss: 0.0310359 | val_loss: 0.0313076 | Time: 5288.82 ms
[2021-12-14 17:29:35 main:574] : INFO : Epoch 610 | loss: 0.0310248 | val_loss: 0.0312892 | Time: 5413.26 ms
[2021-12-14 17:29:40 main:574] : INFO : Epoch 611 | loss: 0.0310218 | val_loss: 0.0312548 | Time: 5401.9 ms
[2021-12-14 17:29:45 main:574] : INFO : Epoch 612 | loss: 0.0310236 | val_loss: 0.0312831 | Time: 5188.67 ms
[2021-12-14 17:29:51 main:574] : INFO : Epoch 613 | loss: 0.0310243 | val_loss: 0.0312609 | Time: 5369.74 ms
[2021-12-14 17:29:56 main:574] : INFO : Epoch 614 | loss: 0.0310227 | val_loss: 0.0312772 | Time: 5229.22 ms
[2021-12-14 17:30:01 main:574] : INFO : Epoch 615 | loss: 0.0310188 | val_loss: 0.0312832 | Time: 5241.69 ms
[2021-12-14 17:30:07 main:574] : INFO : Epoch 616 | loss: 0.0310198 | val_loss: 0.0312595 | Time: 5238.74 ms
[2021-12-14 17:30:12 main:574] : INFO : Epoch 617 | loss: 0.0310222 | val_loss: 0.031283 | Time: 4996.79 ms
[2021-12-14 17:30:17 main:574] : INFO : Epoch 618 | loss: 0.0310226 | val_loss: 0.0312858 | Time: 5131.97 ms
[2021-12-14 17:30:22 main:574] : INFO : Epoch 619 | loss: 0.0310162 | val_loss: 0.0312783 | Time: 5226.97 ms
[2021-12-14 17:30:27 main:574] : INFO : Epoch 620 | loss: 0.0310168 | val_loss: 0.0312918 | Time: 5369.73 ms
[2021-12-14 17:30:32 main:574] : INFO : Epoch 621 | loss: 0.0310185 | val_loss: 0.0312639 | Time: 5061.49 ms
[2021-12-14 17:30:37 main:574] : INFO : Epoch 622 | loss: 0.0310087 | val_loss: 0.0312664 | Time: 5036 ms
[2021-12-14 17:30:43 main:574] : INFO : Epoch 623 | loss: 0.0310219 | val_loss: 0.0312737 | Time: 5317.5 ms
[2021-12-14 17:30:48 main:574] : INFO : Epoch 624 | loss: 0.0310197 | val_loss: 0.0312681 | Time: 5037.67 ms
[2021-12-14 17:30:53 main:574] : INFO : Epoch 625 | loss: 0.0310137 | val_loss: 0.0312968 | Time: 4933.71 ms
[2021-12-14 17:30:59 main:574] : INFO : Epoch 626 | loss: 0.031012 | val_loss: 0.0312781 | Time: 5917.88 ms
[2021-12-14 17:31:04 main:574] : INFO : Epoch 627 | loss: 0.0310171 | val_loss: 0.0312847 | Time: 5098.05 ms
[2021-12-14 17:31:09 main:574] : INFO : Epoch 628 | loss: 0.0310138 | val_loss: 0.0312647 | Time: 4956.02 ms
[2021-12-14 17:31:14 main:574] : INFO : Epoch 629 | loss: 0.0310182 | val_loss: 0.0313025 | Time: 5174.95 ms
[2021-12-14 17:31:19 main:574] : INFO : Epoch 630 | loss: 0.0310238 | val_loss: 0.0312815 | Time: 5296.35 ms
[2021-12-14 17:31:25 main:574] : INFO : Epoch 631 | loss: 0.0310239 | val_loss: 0.031281 | Time: 5459.08 ms
[2021-12-14 17:31:30 main:574] : INFO : Epoch 632 | loss: 0.031015 | val_loss: 0.0312579 | Time: 5285.87 ms
[2021-12-14 17:31:35 main:574] : INFO : Epoch 633 | loss: 0.0310248 | val_loss: 0.0312684 | Time: 5134.57 ms
[2021-12-14 17:31:40 main:574] : INFO : Epoch 634 | loss: 0.0310245 | val_loss: 0.0312737 | Time: 5144.82 ms
[2021-12-14 17:31:46 main:574] : INFO : Epoch 635 | loss: 0.0310313 | val_loss: 0.0312346 | Time: 5751.57 ms
[2021-12-14 17:31:51 main:574] : INFO : Epoch 636 | loss: 0.031031 | val_loss: 0.0312646 | Time: 5035.83 ms
[2021-12-14 17:31:57 main:574] : INFO : Epoch 637 | loss: 0.0310237 | val_loss: 0.0312374 | Time: 5802.05 ms
[2021-12-14 17:32:04 main:574] : INFO : Epoch 638 | loss: 0.0310225 | val_loss: 0.0312841 | Time: 6993.13 ms
[2021-12-14 17:32:09 main:574] : INFO : Epoch 639 | loss: 0.0310137 | val_loss: 0.0312764 | Time: 5421.04 ms
[2021-12-14 17:32:14 main:574] : INFO : Epoch 640 | loss: 0.0310205 | val_loss: 0.0312884 | Time: 4916 ms
[2021-12-14 17:32:19 main:574] : INFO : Epoch 641 | loss: 0.0310254 | val_loss: 0.0312652 | Time: 5159.11 ms
[2021-12-14 17:32:25 main:574] : INFO : Epoch 642 | loss: 0.0310163 | val_loss: 0.0312964 | Time: 5404.41 ms
[2021-12-14 17:32:30 main:574] : INFO : Epoch 643 | loss: 0.0310208 | val_loss: 0.0312557 | Time: 5464.78 ms
[2021-12-14 17:32:35 main:574] : INFO : Epoch 644 | loss: 0.0310224 | val_loss: 0.031244 | Time: 4856.73 ms
[2021-12-14 17:32:41 main:574] : INFO : Epoch 645 | loss: 0.0310148 | val_loss: 0.0312801 | Time: 5500.69 ms
[2021-12-14 17:32:46 main:574] : INFO : Epoch 646 | loss: 0.031021 | val_loss: 0.031292 | Time: 5183.49 ms
[2021-12-14 17:32:51 main:574] : INFO : Epoch 647 | loss: 0.031022 | val_loss: 0.0312909 | Time: 5056.79 ms
[2021-12-14 17:32:56 main:574] : INFO : Epoch 648 | loss: 0.0310199 | val_loss: 0.0312507 | Time: 5535.2 ms
[2021-12-14 17:33:02 main:574] : INFO : Epoch 649 | loss: 0.0310233 | val_loss: 0.0312579 | Time: 5118.14 ms
[2021-12-14 17:33:07 main:574] : INFO : Epoch 650 | loss: 0.0310208 | val_loss: 0.0313015 | Time: 5083.75 ms
[2021-12-14 17:33:12 main:574] : INFO : Epoch 651 | loss: 0.0310224 | val_loss: 0.0312801 | Time: 5441.25 ms
THCudaCheck FAIL file=..\..\aten\src\THC\THCCachingHostAllocator.cpp line=278 error=719 : unspecified launch failure
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFCB0884F69
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 12/14/21 17:33:14
Install Directory : C:\Program Files\BOINC\
Data Directory : C:\ProgramData\BOINC
Project Symstore :
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\1;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 00000000278e0000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000b2c30000 00000000001f5000 C:\Windows\SYSTEM32\ntdll.dll (6.2.19041.1288) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.1288 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema operativo Microsoft® Windows®
Product Version : 10.0.19041.1288
ModLoad: 00000000b2a60000 00000000000be000 C:\Windows\System32\KERNEL32.DLL (6.2.19041.1348) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.1348 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema operativo Microsoft® Windows®
Product Version : 10.0.19041.1348
ModLoad: 00000000b0850000 00000000002c8000 C:\Windows\System32\KERNELBASE.dll (6.2.19041.1348) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.1348 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema operativo Microsoft® Windows®
Product Version : 10.0.19041.1348
ModLoad: 00000000ad770000 0000000000090000 C:\Windows\SYSTEM32\apphelp.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : apphelp.pdb
File Version : 10.0.19041.1288 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema operativo Microsoft® Windows®
Product Version : 10.0.19041.1288
ModLoad: 00000000b0e50000 00000000001a1000 C:\Windows\System32\USER32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.1288 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema operativo Microsoft® Windows®
Product Version : 10.0.19041.1288
ModLoad: 00000000b06c0000 0000000000022000 C:\Windows\System32\win32u.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.1320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1320
ModLoad: 00000000b2930000 000000000002b000 C:\Windows\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.1202 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1202
ModLoad: 00000000b0b70000 000000000010b000 C:\Windows\System32\gdi32full.dll (6.2.19041.1110) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.1110 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1110
ModLoad: 00000000b04b0000 000000000009d000 C:\Windows\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 00000000b0750000 0000000000100000 C:\Windows\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 00000000b0da0000 00000000000ac000 C:\Windows\System32\ADVAPI32.dll (6.2.19041.1052) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.1288 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema operativo Microsoft® Windows®
Product Version : 10.0.19041.1288
ModLoad: 00000000b0c80000 000000000009e000 C:\Windows\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.19041.546
ModLoad: 00000000b13b0000 000000000009b000 C:\Windows\System32\sechost.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000b1130000 000000000012a000 C:\Windows\System32\RPCRT4.dll (6.2.19041.1288) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.1288 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema operativo Microsoft® Windows®
Product Version : 10.0.19041.1288
ModLoad: 0000000083a50000 0000000000058000 C:\ProgramData\BOINC\slots\1\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000002ed90000 0000000024b49000 C:\ProgramData\BOINC\slots\1\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000ae820000 00000000001e4000 C:\Windows\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.867 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.867
ModLoad: 000000009e110000 0000000000019000 C:\ProgramData\BOINC\slots\1\VCRUNTIME140.dll (14.27.29112.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.27.29112.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.27.29112.0
ModLoad: 00000000829e0000 0000000000091000 C:\ProgramData\BOINC\slots\1\MSVCP140.dll (14.27.29112.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.27.29112.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.27.29112.0
ModLoad: 00000000ad6e0000 000000000000c000 C:\ProgramData\BOINC\slots\1\VCRUNTIME140_1.dll (14.27.29112.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.27.29112.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.27.29112.0
ModLoad: 0000000083a00000 0000000000045000 C:\ProgramData\BOINC\slots\1\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000002b8d0000 00000000034b2000 C:\ProgramData\BOINC\slots\1\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 0000000020ce0000 000000000abe7000 C:\ProgramData\BOINC\slots\1\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000a9d00000 0000000000010000 C:\ProgramData\BOINC\slots\1\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 000000001dc30000 00000000030a5000 C:\ProgramData\BOINC\slots\1\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 0000000002880000 000000001b3a4000 C:\ProgramData\BOINC\slots\1\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 00000000827d0000 000000000020d000 C:\ProgramData\BOINC\slots\1\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 0000000074740000 00000000002db000 C:\ProgramData\BOINC\slots\1\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000008fde0000 0000000000040000 C:\ProgramData\BOINC\slots\1\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000feb20000 0000000003d5b000 C:\ProgramData\BOINC\slots\1\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000679b0000 0000000001eca000 C:\ProgramData\BOINC\slots\1\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000f5980000 000000000919f000 C:\ProgramData\BOINC\slots\1\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 00000000b12c0000 0000000000030000 C:\Windows\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000aebd0000 0000000000012000 C:\Windows\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000b1c00000 0000000000472000 C:\Windows\System32\Setupapi.dll (6.2.19041.1237) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.1288 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema operativo Microsoft® Windows®
Product Version : 10.0.19041.1288
ModLoad: 00000000b0b20000 000000000004e000 C:\Windows\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1151
ModLoad: 00000000b0690000 0000000000027000 C:\Windows\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.1288 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema operativo Microsoft® Windows®
Product Version : 10.0.19041.1288
ModLoad: 00000000b0110000 0000000000034000 C:\Windows\SYSTEM32\DEVOBJ.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1151
ModLoad: 00000000b06f0000 0000000000060000 C:\Windows\System32\WINTRUST.dll (6.2.19041.1266) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.1266 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1266
ModLoad: 00000000b0350000 0000000000156000 C:\Windows\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.1288 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema operativo Microsoft® Windows®
Product Version : 10.0.19041.1288
ModLoad: 00000000aff30000 0000000000012000 C:\Windows\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000b14c0000 000000000073f000 C:\Windows\System32\Shell32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.1288 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema operativo Microsoft® Windows®
Product Version : 10.0.19041.1288
ModLoad: 00000000adfd0000 0000000000790000 C:\Windows\SYSTEM32\windows.storage.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.1288 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema operativo Microsoft® Windows®
Product Version : 10.0.19041.1288
ModLoad: 00000000b2440000 0000000000355000 C:\Windows\System32\combase.dll (6.2.19041.1348) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.1288 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema operativo Microsoft® Windows®
Product Version : 10.0.19041.1288
ModLoad: 00000000afda0000 000000000002e000 C:\Windows\SYSTEM32\Wldp.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.1288 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema operativo Microsoft® Windows®
Product Version : 10.0.19041.1288
ModLoad: 00000000b1020000 00000000000ad000 C:\Windows\System32\SHCORE.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.1288 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema operativo Microsoft® Windows®
Product Version : 10.0.19041.1288
ModLoad: 00000000b1450000 0000000000055000 C:\Windows\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.1288 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema operativo Microsoft® Windows®
Product Version : 10.0.19041.1288
ModLoad: 00000000744a0000 000000000029d000 C:\Windows\system32\nvcuda.dll (27.21.14.6231) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r460\r462_23\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 27.21.14.6231
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.2.162 driver
Product Version : 27.21.14.6231
ModLoad: 00000000a9ae0000 000000000000a000 C:\Windows\SYSTEM32\VERSION.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000061ad0000 00000000015b8000 C:\Windows\system32\DriverStore\FileRepository\nvam.inf_amd64_abccf9a242036197\nvcuda64.dll (27.21.14.6231) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r460\r462_23\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 27.21.14.6231
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.2.162 driver
Product Version : 27.21.14.6231
ModLoad: 00000000b29f0000 000000000006b000 C:\Windows\System32\WS2_32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : ws2_32.pdb
File Version : 10.0.19041.1081 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema operativo Microsoft® Windows®
Product Version : 10.0.19041.1081
ModLoad: 00000000a8880000 0000000000031000 C:\Windows\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.906 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.906
ModLoad: 00000000afd10000 000000000000c000 C:\Windows\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000ad910000 000000000009e000 C:\Windows\system32\uxtheme.dll (6.2.19041.1266) (-exported- Symbols Loaded)
Linked PDB Filename : UxTheme.pdb
File Version : 10.0.19041.1288 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema operativo Microsoft® Windows®
Product Version : 10.0.19041.1288
ModLoad: 0000000095790000 00000000006f2000 C:\Windows\SYSTEM32\nvapi64.dll (27.21.14.6231) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r460\r462_23\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 27.21.14.6231
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 27.21.14.6231
ModLoad: 00000000b2310000 000000000012a000 C:\Windows\System32\OLE32.DLL (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : ole32.pdb
File Version : 10.0.19041.1288 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Sistema operativo Microsoft® Windows®
Product Version : 10.0.19041.1288
ModLoad: 00000000a97f0000 0000000000009000 C:\ProgramData\BOINC\slots\1\caffe2_nvrtc.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000f49b0000 0000000000fca000 C:\ProgramData\BOINC\slots\1\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6.14.11.9000
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.89 NVRTC Library
Product Version : 6.14.11.9000
ModLoad: 00000000b0550000 0000000000083000 C:\Windows\System32\bcryptPrimitives.dll (6.2.19041.1348) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.1348 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1348
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 4251, Write: 2689, Other 11091
- I/O Transfers Counters -
Read: 9162220, Write: 1023128, Other 77300
- Paged Pool Usage -
QuotaPagedPoolUsage: 3508464, QuotaPeakPagedPoolUsage: 3509264
QuotaNonPagedPoolUsage: 52080, QuotaPeakNonPagedPoolUsage: 52552
- Virtual Memory Usage -
VirtualSize: -424697856, PeakVirtualSize: 190304256
- Pagefile Usage -
PagefileUsage: -424697856, PeakPagefileUsage: -424697856
- Working Set Size -
WorkingSetSize: 280371200, PeakWorkingSetSize: 1770749952, PageFaultCount: 638211
*** Dump of thread ID 23236 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 653593728.000000, User Time: 18887813120.000000, Wait Time: 67294032.000000
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFCB0884F69
- Registers -
rax=0000000000000000 rbx=000000002b1562f0 rcx=0000000000000000 rdx=0000000000000000 rsi=00000000462f3f20 rdi=0000000019930520
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000000006000 r13=0000000000000000
r14=00000000462f4c60 r15=00000000462f4be0 rip=00000000b0884f69 rsp=00000000462f3dc0 rbp=00000000462f47c8
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000206
- Callstack -
ChildEBP RetAddr Args to Child
462f3e90 9e116220 566237dd 00000000 462f4c60 262aa014 KERNELBASE!RaiseException+0x0
462f3ef0 268a5272 5662343d 00000000 000007cb 00000116 VCRUNTIME140!_CxxThrowException+0x0
462f3f40 268a56d4 00000000 00000000 298cd290 325f5f68 torch_cpu!at::Tensor::zero_+0x0
462f47a0 31bb9ebe 462f49d0 325f6850 325f6880 000002cf torch_cpu!_THError+0x0
462f47e0 31bb5412 462f49d0 462f4930 c34c5d50 32a2a720 torch_cuda!__THCudaCheck+0x0
462f4820 265559ff 462f4c00 462f49d0 462f4ea0 83a897b0 torch_cuda!at::native::set_storage_cuda_+0x0
462f4bb0 266f726f 3222f630 262aea63 00000001 83a6ef8f torch_cpu!at::native::empty_cpu+0x0
462f4bf0 266b0615 462f0000 462f4c68 462f4e60 83a57ce6 torch_cpu!at::native::mkldnn_sigmoid_+0x0
462f4c30 266b204a 462f0000 462f4d00 c34a3700 30ef6ae5 torch_cpu!at::native::mkldnn_sigmoid_+0x0
462f4cc0 266b0615 00000000 262aea63 462f4da0 462f4ea0 torch_cpu!at::native::mkldnn_sigmoid_+0x0
462f4d00 26781eb0 462f0000 00000000 462f4e88 00000001 torch_cpu!at::native::mkldnn_sigmoid_+0x0
462f4da0 26792eec 636d86e6 83a89c50 462f4f00 83a53bd6 torch_cpu!at::bucketize_out+0x0
462f4df0 312bf160 462f0000 00000000 462f4f00 00000000 torch_cpu!at::empty+0x0
462f5190 312c2de8 83a89c50 262b0528 c43af050 83a89c50 torch_cuda!at::native::cummin_helper_cuda+0x0
462f5370 312c4379 462f5480 1ed6c350 462f5880 1ed6c368 torch_cuda!at::native::cummin_helper_cuda+0x0
462f55b0 312c3d64 462f0000 462f5880 462f56c0 462f5880 torch_cuda!at::native::cat_out_cuda+0x0
462f57b0 31b61dd2 462f5808 00000001 462f5808 462f5880 torch_cuda!at::native::cat_cuda+0x0
462f5830 31b74179 00000001 462f5870 c43b4db8 04000000 torch_cuda!at::native::set_storage_cuda_+0x0
462f5870 26781d7d 0c8c3060 462f5be0 462f5bb0 00000000 torch_cuda!at::native::set_storage_cuda_+0x0
462f58f0 26760d81 00000000 83a73994 462f60c0 1ed6bcf0 torch_cpu!at::bucketize_out+0x0
462f5930 2656b4a5 462f5970 c43aec50 462f5a40 462f5ab0 torch_cpu!at::_cat+0x0
462f5a00 268527bd 462f5ad0 00000101 462f5a58 83aa1ea8 torch_cpu!at::native::cat+0x0
462f5a80 263129ae 1ed6c610 1ed6c620 1ed6c628 462f5a38 torch_cpu!at::zeros_out+0x0
462f5ac0 26781d7d 462f5b00 462f5b70 00000000 b2c547b1 torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0
462f5b40 267875d1 462f60e0 2b600640 462f60c0 1ed6bcf0 torch_cpu!at::bucketize_out+0x0
462f5b80 26577d4c 462f5e10 00000000 462f5e10 00000000 torch_cpu!at::cat+0x0
462f5d40 2686c38d 462f5d98 00000001 462f5d98 462f5e10 torch_cpu!at::native::stack+0x0
462f5dc0 263129ae 462f60c0 1ed6bcf0 00000000 00000000 torch_cpu!at::zeros_out+0x0
462f5e00 26781d7d 462f5e40 462f5eb0 00000000 29521c8f torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0
462f5e80 267d02e1 462f5fb0 83a73720 462f60e0 2b600640 torch_cpu!at::bucketize_out+0x0
462f5ec0 27b63839 462f5f40 c43aec40 c43aec40 462f5fd0 torch_cpu!at::stack+0x0
462f6090 263129ae 00000000 462f61e0 00000000 462f6180 torch_cpu!torch::autograd::GraphRoot::apply+0x0
462f60d0 26781d7d 462f6110 462f6180 c43adc00 00000000 torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0
462f6150 267d02e1 462f62c0 262a9cac 1d4428d0 1ed6bcf0 torch_cpu!at::bucketize_out+0x0
462f6190 278eff7e 462f6258 197fd330 197fd330 462f63a0 torch_cpu!at::stack+0x0
462f6230 278f2ef8 278efe30 462f6270 462f6270 462f62c0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::addCallback+0x0
462f6290 278f3ea4 ec882430 b2c547b1 462f6430 c28d0000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Object::getSlot+0x0
462f63d0 278ed3d2 1cbeee10 1eb81020 462f6430 b2c55ba1 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::markCompleted+0x0
462f6400 278f4541 00000000 1eb849f0 96b92300 b2c55ba1 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Object::operator=+0x0
462f65b0 278f743a 462f6680 00000000 462f70c0 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::markCompleted+0x0
462f6ab0 278fb950 462f6bb0 462f6bb0 00000000 ed2a8840 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0
4630f850 27b3c6f8 c4504060 00000000 00000000 c28e5a60 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
4630f890 b2a77034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
4630f8c0 b2c82651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
4630f940 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 22744 (state: Waiting): ***
- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 468750.000000, User Time: 0.000000, Wait Time: 67294032.000000
- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=0000000046affd70 rsi=0000000000000000 rdi=0000000000000064
r8=000000000000000f r9=0000000046afee38 r10=0000000000000020 r11=0000000000000ff0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000b2ccd3f4 rsp=0000000046affd48 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
46affd40 b089962e 46affe08 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0
46affde0 2791a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0
46affe10 b2a77034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
46affe40 b2c82651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
46affec0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 24940 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 312500.000000, User Time: 468750.000000, Wait Time: 67294032.000000
- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=0000000046bffaf0 rsi=0000000000000000 rdi=000000000000000d
r8=0000000046bff798 r9=00000000c45d0790 r10=0000000000000000 r11=0000000046bffa60 r12=0000000000000064 r13=0000000046bffaf0
r14=0000000046bff7f0 r15=0000000000000000 rip=00000000b2ccd8c4 rsp=0000000046bff798 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
46bff790 b089cb20 00000000 46542000 b2d9a4d0 46542000 ntdll!ZwWaitForMultipleObjects+0x0
46bffa80 b089ca1e c28e5df0 006e0069 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
46bffac0 61c868e4 c45d5cb0 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0
46bffd00 61d1e8dd 00000000 c45d0790 00000000 00000000 nvcuda64!+0x0
46bffdb0 61c862b3 2aa50dba 2a108361 c4c33530 00000000 nvcuda64!cuProfilerStop+0x0
46bffde0 61f9e084 c4c33530 00000000 00000000 00000000 nvcuda64!+0x0
46bffe10 b2a77034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
46bffe40 b2c82651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
46bffec0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 20700 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 67294032.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002ac rdx=0000000000000000 rsi=0000000046cffdd8 rdi=00000000000002ac
r8=0000000000000300 r9=0000000000000000 r10=0000000000000000 r11=00000000c4cad034 r12=0000000000000000 r13=0000000000000000
r14=00000000000002ac r15=0000000000000001 rip=00000000b2cccdf4 rsp=0000000046cffda8 rbp=00000000c462ba60
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
46cffda0 b0871a5e 00000000 00000000 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0
46cffe40 61e9d58e c4cad020 b087a395 00000000 000002ac KERNELBASE!WaitForSingleObjectEx+0x0
46cffeb0 61c862b3 c462ba60 c4a500f0 c4c33d10 00000000 nvcuda64!cuProfilerStop+0x0
46cffee0 61f9e084 c4c33d10 00000000 00000000 00000000 nvcuda64!+0x0
46cfff10 b2a77034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
46cfff40 b2c82651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
46cfffc0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 21364 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 67294024.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000c46f2558 rdx=0000000046dffcc8 rsi=0000000046dffc30 rdi=0000000000000000
r8=000000000000004c r9=0000000000000098 r10=000000003fff4101 r11=0000000046dffc60 r12=0000000046dffcc8 r13=0000000000000000
r14=00000000c46f2558 r15=00000000c48b58b0 rip=00000000b2cd0764 rsp=0000000046dffc08 rbp=0000000046dffc60
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
46dffc00 b2c94295 00000102 61d59cbd 00000000 46dffc30 ntdll!NtWaitForAlertByThreadId+0x0
46dffc70 b08bcdd9 c48b3090 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0
46dffca0 61c04d1c c48b3090 c48b3090 c48b3090 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0
46dffd00 61c862b3 00000002 2a9db6e7 2a4ff6ab 00000000 nvcuda64!+0x0
46dffd30 61f9e084 c4c33590 00000000 00000000 00000000 nvcuda64!+0x0
46dffd60 b2a77034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
46dffd90 b2c82651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
46dffe10 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 18104 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 574531264.000000, User Time: 13778124800.000000, Wait Time: 67294032.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=0000000005d06818 rdx=0000000000000000 rsi=0000000000000000 rdi=0000000005d06818
r8=0000000000000000 r9=0000000000000064 r10=0000000000008000 r11=0000000046efb3e0 r12=0000000000000000 r13=0000000000000000
r14=0000000046eff6f0 r15=0000000005d067c8 rip=00000000b2cd0764 rsp=0000000046eff6c8 rbp=0000000046eff720
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
46eff6c0 b2c94021 197cf9b8 197cf9b8 46eff800 197cf9b8 ntdll!NtWaitForAlertByThreadId+0x0
46eff740 b08bce89 05d067c0 05d06808 00000000 00000000 ntdll!RtlSleepConditionVariableSRW+0x0
46eff780 82a1ba8d b6b53430 b6b53430 b6b53430 00000000 KERNELBASE!SleepConditionVariableSRW+0x0
46eff7c0 829f2848 0c9245b0 00000000 00000000 27ec05b4 MSVCP140!__crtSetThreadpoolWait+0x0
46eff7f0 829f2710 00000000 829f2f17 00000000 0c9245b0 MSVCP140!std::_Winerror_message+0x0
46eff860 27ec064b 0c924590 000001c0 05d067c0 05d067c0 MSVCP140!std::_Winerror_message+0x0
46eff8a0 27ec25b1 1edb1bc0 ffffffff 0c924590 ffffffff torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
46effb90 27ec2471 2b3e6d10 46effbd0 2b3e6d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0
46effbe0 27eb9744 00080001 1f1171b0 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0
46effc10 b0771bb2 1f1171b0 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0
46effc40 b2a77034 00000000 00000000 00000000 00000000 ucrtbase!_configthreadlocale+0x0
46effc70 b2c82651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
46effcf0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)