Task 7424195

Name ParityModified-1631732077-32724-1_0
Workunit 5096406
Created 17 Sep 2021, 18:49:04 UTC
Sent 26 Sep 2021, 1:58:30 UTC
Report deadline 3 Oct 2021, 1:58:30 UTC
Received 26 Sep 2021, 4:33:15 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 6824
Run time 1 hours 2 min 44 sec
CPU time 58 min 43 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 2,719.83 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 2.10 GB
Peak swap size 4.31 GB
Peak disk usage 1.53 GB

Stderr output

<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
11705 | Time: 5606.93 ms
[2021-09-25 21:48:11	                main:574]	:	INFO	:	Epoch 431 | loss: 0.0311569 | val_loss: 0.0311729 | Time: 5515.84 ms
[2021-09-25 21:48:17	                main:574]	:	INFO	:	Epoch 432 | loss: 0.031163 | val_loss: 0.0311703 | Time: 5419.11 ms
[2021-09-25 21:48:22	                main:574]	:	INFO	:	Epoch 433 | loss: 0.0311596 | val_loss: 0.031172 | Time: 5827.58 ms
[2021-09-25 21:48:28	                main:574]	:	INFO	:	Epoch 434 | loss: 0.0311572 | val_loss: 0.0311743 | Time: 5606.79 ms
[2021-09-25 21:48:33	                main:574]	:	INFO	:	Epoch 435 | loss: 0.0311633 | val_loss: 0.0311771 | Time: 5342.36 ms
[2021-09-25 21:48:39	                main:574]	:	INFO	:	Epoch 436 | loss: 0.0311744 | val_loss: 0.0311769 | Time: 5578.9 ms
[2021-09-25 21:48:45	                main:574]	:	INFO	:	Epoch 437 | loss: 0.0311717 | val_loss: 0.0311755 | Time: 6108.03 ms
[2021-09-25 21:48:51	                main:574]	:	INFO	:	Epoch 438 | loss: 0.0311701 | val_loss: 0.0311832 | Time: 5581.02 ms
[2021-09-25 21:48:56	                main:574]	:	INFO	:	Epoch 439 | loss: 0.0311688 | val_loss: 0.0311725 | Time: 5553.91 ms
[2021-09-25 21:49:02	                main:574]	:	INFO	:	Epoch 440 | loss: 0.0311641 | val_loss: 0.0311727 | Time: 5857.03 ms
[2021-09-25 21:49:08	                main:574]	:	INFO	:	Epoch 441 | loss: 0.0311648 | val_loss: 0.0311715 | Time: 5602.1 ms
[2021-09-25 21:49:14	                main:574]	:	INFO	:	Epoch 442 | loss: 0.0311641 | val_loss: 0.0311713 | Time: 5967.47 ms
[2021-09-25 21:49:19	                main:574]	:	INFO	:	Epoch 443 | loss: 0.0311647 | val_loss: 0.0311779 | Time: 5472.19 ms
[2021-09-25 21:49:25	                main:574]	:	INFO	:	Epoch 444 | loss: 0.0311633 | val_loss: 0.031171 | Time: 5645.11 ms
[2021-09-25 21:49:30	                main:574]	:	INFO	:	Epoch 445 | loss: 0.0311617 | val_loss: 0.0311687 | Time: 5673.62 ms
[2021-09-25 21:49:36	                main:574]	:	INFO	:	Epoch 446 | loss: 0.0311596 | val_loss: 0.0311695 | Time: 5486.83 ms
[2021-09-25 21:49:42	                main:574]	:	INFO	:	Epoch 447 | loss: 0.0311619 | val_loss: 0.0311701 | Time: 5603.65 ms
[2021-09-25 21:49:47	                main:574]	:	INFO	:	Epoch 448 | loss: 0.031161 | val_loss: 0.0311678 | Time: 5699.39 ms
[2021-09-25 21:49:53	                main:574]	:	INFO	:	Epoch 449 | loss: 0.0311588 | val_loss: 0.0311698 | Time: 5562.1 ms
[2021-09-25 21:49:58	                main:574]	:	INFO	:	Epoch 450 | loss: 0.0311589 | val_loss: 0.0311654 | Time: 5479.02 ms
[2021-09-25 21:50:04	                main:574]	:	INFO	:	Epoch 451 | loss: 0.0311566 | val_loss: 0.031171 | Time: 5559.08 ms
[2021-09-25 21:50:10	                main:574]	:	INFO	:	Epoch 452 | loss: 0.0311571 | val_loss: 0.0311697 | Time: 5847.58 ms
[2021-09-25 21:50:15	                main:574]	:	INFO	:	Epoch 453 | loss: 0.031157 | val_loss: 0.0311661 | Time: 5631.03 ms
[2021-09-25 21:50:21	                main:574]	:	INFO	:	Epoch 454 | loss: 0.0311559 | val_loss: 0.0311682 | Time: 5565.18 ms
[2021-09-25 21:50:27	                main:574]	:	INFO	:	Epoch 455 | loss: 0.0311559 | val_loss: 0.0311677 | Time: 5726.02 ms
[2021-09-25 21:50:33	                main:574]	:	INFO	:	Epoch 456 | loss: 0.0311542 | val_loss: 0.0311684 | Time: 6019.93 ms
[2021-09-25 21:50:39	                main:574]	:	INFO	:	Epoch 457 | loss: 0.0311537 | val_loss: 0.0311665 | Time: 5852.48 ms
[2021-09-25 21:50:44	                main:574]	:	INFO	:	Epoch 458 | loss: 0.0311554 | val_loss: 0.0311669 | Time: 5844.12 ms
[2021-09-25 21:50:50	                main:574]	:	INFO	:	Epoch 459 | loss: 0.0311578 | val_loss: 0.031167 | Time: 5621.85 ms
[2021-09-25 21:50:56	                main:574]	:	INFO	:	Epoch 460 | loss: 0.0311582 | val_loss: 0.0311663 | Time: 5715.93 ms
[2021-09-25 21:51:01	                main:574]	:	INFO	:	Epoch 461 | loss: 0.0311562 | val_loss: 0.0311692 | Time: 5632.15 ms
[2021-09-25 21:51:07	                main:574]	:	INFO	:	Epoch 462 | loss: 0.031157 | val_loss: 0.0311688 | Time: 5698.88 ms
[2021-09-25 21:51:13	                main:574]	:	INFO	:	Epoch 463 | loss: 0.0311554 | val_loss: 0.0311678 | Time: 5780.61 ms
[2021-09-25 21:51:19	                main:574]	:	INFO	:	Epoch 464 | loss: 0.0311559 | val_loss: 0.0311666 | Time: 5773.76 ms
[2021-09-25 21:51:25	                main:574]	:	INFO	:	Epoch 465 | loss: 0.031155 | val_loss: 0.0311643 | Time: 6015.05 ms
[2021-09-25 21:51:30	                main:574]	:	INFO	:	Epoch 466 | loss: 0.0311534 | val_loss: 0.0311685 | Time: 5621.95 ms
[2021-09-25 21:51:36	                main:574]	:	INFO	:	Epoch 467 | loss: 0.0311569 | val_loss: 0.0311715 | Time: 5600.07 ms
[2021-09-25 21:51:42	                main:574]	:	INFO	:	Epoch 468 | loss: 0.0311545 | val_loss: 0.0311663 | Time: 5670.75 ms
[2021-09-25 21:51:48	                main:574]	:	INFO	:	Epoch 469 | loss: 0.0311531 | val_loss: 0.031166 | Time: 6185.62 ms
[2021-09-25 21:51:53	                main:574]	:	INFO	:	Epoch 470 | loss: 0.0311519 | val_loss: 0.0311651 | Time: 5557.91 ms
[2021-09-25 21:51:59	                main:574]	:	INFO	:	Epoch 471 | loss: 0.0311511 | val_loss: 0.0311652 | Time: 5751.46 ms
[2021-09-25 21:52:05	                main:574]	:	INFO	:	Epoch 472 | loss: 0.0311496 | val_loss: 0.0311657 | Time: 5751.64 ms
[2021-09-25 21:52:11	                main:574]	:	INFO	:	Epoch 473 | loss: 0.0311513 | val_loss: 0.0311688 | Time: 5821.61 ms
[2021-09-25 21:52:17	                main:574]	:	INFO	:	Epoch 474 | loss: 0.031152 | val_loss: 0.0311664 | Time: 6027.02 ms
[2021-09-25 21:52:23	                main:574]	:	INFO	:	Epoch 475 | loss: 0.0311504 | val_loss: 0.0311672 | Time: 5936.35 ms
[2021-09-25 21:52:28	                main:574]	:	INFO	:	Epoch 476 | loss: 0.0311572 | val_loss: 0.0311881 | Time: 5868.4 ms
[2021-09-25 21:52:35	                main:574]	:	INFO	:	Epoch 477 | loss: nan | val_loss: nan | Time: 6095.71 ms
[2021-09-25 21:52:40	                main:574]	:	INFO	:	Epoch 478 | loss: nan | val_loss: nan | Time: 5680.05 ms
[2021-09-25 21:52:46	                main:574]	:	INFO	:	Epoch 479 | loss: nan | val_loss: nan | Time: 5735.82 ms
[2021-09-25 21:52:52	                main:574]	:	INFO	:	Epoch 480 | loss: nan | val_loss: nan | Time: 5929.74 ms
[2021-09-25 21:52:58	                main:574]	:	INFO	:	Epoch 481 | loss: nan | val_loss: nan | Time: 5815.74 ms
[2021-09-25 21:53:03	                main:574]	:	INFO	:	Epoch 482 | loss: nan | val_loss: nan | Time: 5571.26 ms
[2021-09-25 21:53:10	                main:574]	:	INFO	:	Epoch 483 | loss: nan | val_loss: nan | Time: 6197.67 ms
[2021-09-25 21:53:15	                main:574]	:	INFO	:	Epoch 484 | loss: nan | val_loss: nan | Time: 5610.15 ms
[2021-09-25 21:53:21	                main:574]	:	INFO	:	Epoch 485 | loss: nan | val_loss: nan | Time: 5624.59 ms
[2021-09-25 21:53:26	                main:574]	:	INFO	:	Epoch 486 | loss: nan | val_loss: nan | Time: 5569.5 ms
[2021-09-25 21:53:32	                main:574]	:	INFO	:	Epoch 487 | loss: nan | val_loss: nan | Time: 5599.18 ms
[2021-09-25 21:53:38	                main:574]	:	INFO	:	Epoch 488 | loss: nan | val_loss: nan | Time: 5687.46 ms
[2021-09-25 21:53:44	                main:574]	:	INFO	:	Epoch 489 | loss: nan | val_loss: nan | Time: 5962.63 ms
[2021-09-25 21:53:49	                main:574]	:	INFO	:	Epoch 490 | loss: nan | val_loss: nan | Time: 5647.22 ms
[2021-09-25 21:53:55	                main:574]	:	INFO	:	Epoch 491 | loss: nan | val_loss: nan | Time: 5841.43 ms
[2021-09-25 21:54:01	                main:574]	:	INFO	:	Epoch 492 | loss: nan | val_loss: nan | Time: 5772.92 ms
[2021-09-25 21:54:07	                main:574]	:	INFO	:	Epoch 493 | loss: nan | val_loss: nan | Time: 5881.85 ms
[2021-09-25 21:54:12	                main:574]	:	INFO	:	Epoch 494 | loss: nan | val_loss: nan | Time: 5517.68 ms
[2021-09-25 21:54:18	                main:574]	:	INFO	:	Epoch 495 | loss: nan | val_loss: nan | Time: 5674.58 ms
[2021-09-25 21:54:24	                main:574]	:	INFO	:	Epoch 496 | loss: nan | val_loss: nan | Time: 5904.19 ms
[2021-09-25 21:54:30	                main:574]	:	INFO	:	Epoch 497 | loss: nan | val_loss: nan | Time: 5616.53 ms
[2021-09-25 21:54:35	                main:574]	:	INFO	:	Epoch 498 | loss: nan | val_loss: nan | Time: 5521.84 ms
[2021-09-25 21:54:41	                main:574]	:	INFO	:	Epoch 499 | loss: nan | val_loss: nan | Time: 5597.7 ms
[2021-09-25 21:54:47	                main:574]	:	INFO	:	Epoch 500 | loss: nan | val_loss: nan | Time: 5933.63 ms
[2021-09-25 21:54:52	                main:574]	:	INFO	:	Epoch 501 | loss: nan | val_loss: nan | Time: 5867.28 ms
[2021-09-25 21:54:58	                main:574]	:	INFO	:	Epoch 502 | loss: nan | val_loss: nan | Time: 5597.53 ms
[2021-09-25 21:55:04	                main:574]	:	INFO	:	Epoch 503 | loss: nan | val_loss: nan | Time: 5703.79 ms
[2021-09-25 21:55:10	                main:574]	:	INFO	:	Epoch 504 | loss: nan | val_loss: nan | Time: 6056.73 ms
[2021-09-25 21:55:16	                main:574]	:	INFO	:	Epoch 505 | loss: nan | val_loss: nan | Time: 5884.43 ms
[2021-09-25 21:55:21	                main:574]	:	INFO	:	Epoch 506 | loss: nan | val_loss: nan | Time: 5703.26 ms
[2021-09-25 21:55:27	                main:574]	:	INFO	:	Epoch 507 | loss: nan | val_loss: nan | Time: 5687.89 ms
[2021-09-25 21:55:33	                main:574]	:	INFO	:	Epoch 508 | loss: nan | val_loss: nan | Time: 5900.2 ms
[2021-09-25 21:55:39	                main:574]	:	INFO	:	Epoch 509 | loss: nan | val_loss: nan | Time: 5779.71 ms
[2021-09-25 21:55:45	                main:574]	:	INFO	:	Epoch 510 | loss: nan | val_loss: nan | Time: 5843.65 ms
[2021-09-25 21:55:50	                main:574]	:	INFO	:	Epoch 511 | loss: nan | val_loss: nan | Time: 5762.8 ms
[2021-09-25 21:55:56	                main:574]	:	INFO	:	Epoch 512 | loss: nan | val_loss: nan | Time: 5564.7 ms
[2021-09-25 21:56:02	                main:574]	:	INFO	:	Epoch 513 | loss: nan | val_loss: nan | Time: 6045.72 ms
[2021-09-25 21:56:08	                main:574]	:	INFO	:	Epoch 514 | loss: nan | val_loss: nan | Time: 5978.36 ms
[2021-09-25 21:56:14	                main:574]	:	INFO	:	Epoch 515 | loss: nan | val_loss: nan | Time: 5967.1 ms
[2021-09-25 21:56:20	                main:574]	:	INFO	:	Epoch 516 | loss: nan | val_loss: nan | Time: 5690.41 ms
[2021-09-25 21:56:25	                main:574]	:	INFO	:	Epoch 517 | loss: nan | val_loss: nan | Time: 5659.92 ms
[2021-09-25 21:56:31	                main:574]	:	INFO	:	Epoch 518 | loss: nan | val_loss: nan | Time: 5706.61 ms
[2021-09-25 21:56:37	                main:574]	:	INFO	:	Epoch 519 | loss: nan | val_loss: nan | Time: 5732.07 ms
[2021-09-25 21:56:43	                main:574]	:	INFO	:	Epoch 520 | loss: nan | val_loss: nan | Time: 6073.97 ms
[2021-09-25 21:56:49	                main:574]	:	INFO	:	Epoch 521 | loss: nan | val_loss: nan | Time: 5726.48 ms
[2021-09-25 21:56:55	                main:574]	:	INFO	:	Epoch 522 | loss: nan | val_loss: nan | Time: 6065.68 ms
[2021-09-25 21:57:01	                main:574]	:	INFO	:	Epoch 523 | loss: nan | val_loss: nan | Time: 5892.53 ms
[2021-09-25 21:57:06	                main:574]	:	INFO	:	Epoch 524 | loss: nan | val_loss: nan | Time: 5794.81 ms
[2021-09-25 21:57:12	                main:574]	:	INFO	:	Epoch 525 | loss: nan | val_loss: nan | Time: 5904.4 ms
[2021-09-25 21:57:18	                main:574]	:	INFO	:	Epoch 526 | loss: nan | val_loss: nan | Time: 6048.2 ms
[2021-09-25 21:57:24	                main:574]	:	INFO	:	Epoch 527 | loss: nan | val_loss: nan | Time: 5985.83 ms
[2021-09-25 21:57:31	                main:574]	:	INFO	:	Epoch 528 | loss: nan | val_loss: nan | Time: 6188.34 ms
[2021-09-25 21:57:36	                main:574]	:	INFO	:	Epoch 529 | loss: nan | val_loss: nan | Time: 5432.2 ms
[2021-09-25 21:57:42	                main:574]	:	INFO	:	Epoch 530 | loss: nan | val_loss: nan | Time: 5656.05 ms
[2021-09-25 21:57:47	                main:574]	:	INFO	:	Epoch 531 | loss: nan | val_loss: nan | Time: 5650.89 ms
[2021-09-25 21:57:53	                main:574]	:	INFO	:	Epoch 532 | loss: nan | val_loss: nan | Time: 5776.86 ms
[2021-09-25 21:57:59	                main:574]	:	INFO	:	Epoch 533 | loss: nan | val_loss: nan | Time: 5680.47 ms
[2021-09-25 21:58:05	                main:574]	:	INFO	:	Epoch 534 | loss: nan | val_loss: nan | Time: 5799.72 ms
[2021-09-25 21:58:11	                main:574]	:	INFO	:	Epoch 535 | loss: nan | val_loss: nan | Time: 5923.53 ms
[2021-09-25 21:58:17	                main:574]	:	INFO	:	Epoch 536 | loss: nan | val_loss: nan | Time: 6108.11 ms
[2021-09-25 21:58:23	                main:574]	:	INFO	:	Epoch 537 | loss: nan | val_loss: nan | Time: 6115.59 ms
[2021-09-25 21:58:29	                main:574]	:	INFO	:	Epoch 538 | loss: nan | val_loss: nan | Time: 5759.35 ms
[2021-09-25 21:58:34	                main:574]	:	INFO	:	Epoch 539 | loss: nan | val_loss: nan | Time: 5865.76 ms
[2021-09-25 21:58:40	                main:574]	:	INFO	:	Epoch 540 | loss: nan | val_loss: nan | Time: 6026.04 ms
[2021-09-25 21:58:46	                main:574]	:	INFO	:	Epoch 541 | loss: nan | val_loss: nan | Time: 5614.83 ms
[2021-09-25 21:58:52	                main:574]	:	INFO	:	Epoch 542 | loss: nan | val_loss: nan | Time: 5745.58 ms
[2021-09-25 21:58:57	                main:574]	:	INFO	:	Epoch 543 | loss: nan | val_loss: nan | Time: 5616.71 ms
[2021-09-25 21:59:03	                main:574]	:	INFO	:	Epoch 544 | loss: nan | val_loss: nan | Time: 5902.6 ms
[2021-09-25 21:59:09	                main:574]	:	INFO	:	Epoch 545 | loss: nan | val_loss: nan | Time: 5698.93 ms
[2021-09-25 21:59:15	                main:574]	:	INFO	:	Epoch 546 | loss: nan | val_loss: nan | Time: 5695.49 ms
[2021-09-25 21:59:20	                main:574]	:	INFO	:	Epoch 547 | loss: nan | val_loss: nan | Time: 5722.85 ms
[2021-09-25 21:59:26	                main:574]	:	INFO	:	Epoch 548 | loss: nan | val_loss: nan | Time: 5757.34 ms
[2021-09-25 21:59:32	                main:574]	:	INFO	:	Epoch 549 | loss: nan | val_loss: nan | Time: 5768.13 ms
[2021-09-25 21:59:38	                main:574]	:	INFO	:	Epoch 550 | loss: nan | val_loss: nan | Time: 5822.82 ms
[2021-09-25 21:59:44	                main:574]	:	INFO	:	Epoch 551 | loss: nan | val_loss: nan | Time: 6031.08 ms
[2021-09-25 21:59:50	                main:574]	:	INFO	:	Epoch 552 | loss: nan | val_loss: nan | Time: 5688.81 ms
[2021-09-25 21:59:56	                main:574]	:	INFO	:	Epoch 553 | loss: nan | val_loss: nan | Time: 5961.26 ms
[2021-09-25 22:00:01	                main:574]	:	INFO	:	Epoch 554 | loss: nan | val_loss: nan | Time: 5773.3 ms
[2021-09-25 22:00:07	                main:574]	:	INFO	:	Epoch 555 | loss: nan | val_loss: nan | Time: 5985.69 ms
[2021-09-25 22:00:13	                main:574]	:	INFO	:	Epoch 556 | loss: nan | val_loss: nan | Time: 5877.77 ms
[2021-09-25 22:00:19	                main:574]	:	INFO	:	Epoch 557 | loss: nan | val_loss: nan | Time: 5718.64 ms
[2021-09-25 22:00:25	                main:574]	:	INFO	:	Epoch 558 | loss: nan | val_loss: nan | Time: 6229.78 ms
[2021-09-25 22:00:31	                main:574]	:	INFO	:	Epoch 559 | loss: nan | val_loss: nan | Time: 5825.77 ms
[2021-09-25 22:00:37	                main:574]	:	INFO	:	Epoch 560 | loss: nan | val_loss: nan | Time: 5854.17 ms
[2021-09-25 22:00:42	                main:574]	:	INFO	:	Epoch 561 | loss: nan | val_loss: nan | Time: 5645.84 ms
[2021-09-25 22:00:49	                main:574]	:	INFO	:	Epoch 562 | loss: nan | val_loss: nan | Time: 6362.71 ms
[2021-09-25 22:00:55	                main:574]	:	INFO	:	Epoch 563 | loss: nan | val_loss: nan | Time: 6082.82 ms
[2021-09-25 22:01:01	                main:574]	:	INFO	:	Epoch 564 | loss: nan | val_loss: nan | Time: 5650.49 ms
[2021-09-25 22:01:06	                main:574]	:	INFO	:	Epoch 565 | loss: nan | val_loss: nan | Time: 5537.12 ms
[2021-09-25 22:01:12	                main:574]	:	INFO	:	Epoch 566 | loss: nan | val_loss: nan | Time: 5919.39 ms
[2021-09-25 22:01:18	                main:574]	:	INFO	:	Epoch 567 | loss: nan | val_loss: nan | Time: 5541.83 ms
[2021-09-25 22:01:23	                main:574]	:	INFO	:	Epoch 568 | loss: nan | val_loss: nan | Time: 5861.85 ms
[2021-09-25 22:01:30	                main:574]	:	INFO	:	Epoch 569 | loss: nan | val_loss: nan | Time: 6056.32 ms
[2021-09-25 22:01:35	                main:574]	:	INFO	:	Epoch 570 | loss: nan | val_loss: nan | Time: 5860.22 ms
[2021-09-25 22:01:41	                main:574]	:	INFO	:	Epoch 571 | loss: nan | val_loss: nan | Time: 6058.05 ms
[2021-09-25 22:01:47	                main:574]	:	INFO	:	Epoch 572 | loss: nan | val_loss: nan | Time: 5664.56 ms
[2021-09-25 22:01:53	                main:574]	:	INFO	:	Epoch 573 | loss: nan | val_loss: nan | Time: 5811.43 ms
[2021-09-25 22:01:59	                main:574]	:	INFO	:	Epoch 574 | loss: nan | val_loss: nan | Time: 6027.72 ms
[2021-09-25 22:02:05	                main:574]	:	INFO	:	Epoch 575 | loss: nan | val_loss: nan | Time: 5820.61 ms
[2021-09-25 22:02:11	                main:574]	:	INFO	:	Epoch 576 | loss: nan | val_loss: nan | Time: 5897.77 ms
[2021-09-25 22:02:16	                main:574]	:	INFO	:	Epoch 577 | loss: nan | val_loss: nan | Time: 5733.74 ms
[2021-09-25 22:02:22	                main:574]	:	INFO	:	Epoch 578 | loss: nan | val_loss: nan | Time: 5698.2 ms
[2021-09-25 22:02:28	                main:574]	:	INFO	:	Epoch 579 | loss: nan | val_loss: nan | Time: 5705.98 ms
[2021-09-25 22:02:34	                main:574]	:	INFO	:	Epoch 580 | loss: nan | val_loss: nan | Time: 5694.38 ms
[2021-09-25 22:02:39	                main:574]	:	INFO	:	Epoch 581 | loss: nan | val_loss: nan | Time: 5596.34 ms
[2021-09-25 22:02:45	                main:574]	:	INFO	:	Epoch 582 | loss: nan | val_loss: nan | Time: 5757.68 ms
[2021-09-25 22:02:51	                main:574]	:	INFO	:	Epoch 583 | loss: nan | val_loss: nan | Time: 6042.43 ms
[2021-09-25 22:02:57	                main:574]	:	INFO	:	Epoch 584 | loss: nan | val_loss: nan | Time: 5828.27 ms
[2021-09-25 22:03:03	                main:574]	:	INFO	:	Epoch 585 | loss: nan | val_loss: nan | Time: 5773.99 ms
[2021-09-25 22:03:08	                main:574]	:	INFO	:	Epoch 586 | loss: nan | val_loss: nan | Time: 5716.97 ms
[2021-09-25 22:03:14	                main:574]	:	INFO	:	Epoch 587 | loss: nan | val_loss: nan | Time: 5848.74 ms
[2021-09-25 22:03:20	                main:574]	:	INFO	:	Epoch 588 | loss: nan | val_loss: nan | Time: 5792.85 ms
[2021-09-25 22:03:26	                main:574]	:	INFO	:	Epoch 589 | loss: nan | val_loss: nan | Time: 5592.61 ms
[2021-09-25 22:03:32	                main:574]	:	INFO	:	Epoch 590 | loss: nan | val_loss: nan | Time: 6068.87 ms
[2021-09-25 22:03:37	                main:574]	:	INFO	:	Epoch 591 | loss: nan | val_loss: nan | Time: 5782.67 ms
[2021-09-25 22:03:43	                main:574]	:	INFO	:	Epoch 592 | loss: nan | val_loss: nan | Time: 5747.6 ms
[2021-09-25 22:03:49	                main:574]	:	INFO	:	Epoch 593 | loss: nan | val_loss: nan | Time: 5981.18 ms
[2021-09-25 22:03:55	                main:574]	:	INFO	:	Epoch 594 | loss: nan | val_loss: nan | Time: 5728.92 ms
[2021-09-25 22:04:01	                main:574]	:	INFO	:	Epoch 595 | loss: nan | val_loss: nan | Time: 5950.08 ms
[2021-09-25 22:04:07	                main:574]	:	INFO	:	Epoch 596 | loss: nan | val_loss: nan | Time: 5748.44 ms
[2021-09-25 22:04:13	                main:574]	:	INFO	:	Epoch 597 | loss: nan | val_loss: nan | Time: 5937.69 ms
[2021-09-25 22:04:18	                main:574]	:	INFO	:	Epoch 598 | loss: nan | val_loss: nan | Time: 5912.66 ms
[2021-09-25 22:04:24	                main:574]	:	INFO	:	Epoch 599 | loss: nan | val_loss: nan | Time: 5582.09 ms
[2021-09-25 22:04:30	                main:574]	:	INFO	:	Epoch 600 | loss: nan | val_loss: nan | Time: 5729.04 ms
[2021-09-25 22:04:36	                main:574]	:	INFO	:	Epoch 601 | loss: nan | val_loss: nan | Time: 5740.5 ms
[2021-09-25 22:04:41	                main:574]	:	INFO	:	Epoch 602 | loss: nan | val_loss: nan | Time: 5806.26 ms
[2021-09-25 22:04:47	                main:574]	:	INFO	:	Epoch 603 | loss: nan | val_loss: nan | Time: 5648.07 ms
[2021-09-25 22:04:53	                main:574]	:	INFO	:	Epoch 604 | loss: nan | val_loss: nan | Time: 5692.27 ms
[2021-09-25 22:04:59	                main:574]	:	INFO	:	Epoch 605 | loss: nan | val_loss: nan | Time: 6059.72 ms
[2021-09-25 22:05:05	                main:574]	:	INFO	:	Epoch 606 | loss: nan | val_loss: nan | Time: 5891.04 ms
[2021-09-25 22:05:10	                main:574]	:	INFO	:	Epoch 607 | loss: nan | val_loss: nan | Time: 5632.3 ms
[2021-09-25 22:05:16	                main:574]	:	INFO	:	Epoch 608 | loss: nan | val_loss: nan | Time: 5756.28 ms
[2021-09-25 22:05:22	                main:574]	:	INFO	:	Epoch 609 | loss: nan | val_loss: nan | Time: 5729.88 ms
[2021-09-25 22:05:28	                main:574]	:	INFO	:	Epoch 610 | loss: nan | val_loss: nan | Time: 6367.59 ms
[2021-09-25 22:05:34	                main:574]	:	INFO	:	Epoch 611 | loss: nan | val_loss: nan | Time: 5782.54 ms
[2021-09-25 22:05:40	                main:574]	:	INFO	:	Epoch 612 | loss: nan | val_loss: nan | Time: 5660.49 ms
[2021-09-25 22:05:45	                main:574]	:	INFO	:	Epoch 613 | loss: nan | val_loss: nan | Time: 5649.58 ms
[2021-09-25 22:05:51	                main:574]	:	INFO	:	Epoch 614 | loss: nan | val_loss: nan | Time: 5846.09 ms
[2021-09-25 22:05:57	                main:574]	:	INFO	:	Epoch 615 | loss: nan | val_loss: nan | Time: 6018.68 ms
[2021-09-25 22:06:03	                main:574]	:	INFO	:	Epoch 616 | loss: nan | val_loss: nan | Time: 6148.79 ms
[2021-09-25 22:06:09	                main:574]	:	INFO	:	Epoch 617 | loss: nan | val_loss: nan | Time: 5669.43 ms
[2021-09-25 22:06:15	                main:574]	:	INFO	:	Epoch 618 | loss: nan | val_loss: nan | Time: 5635.69 ms
[2021-09-25 22:06:20	                main:574]	:	INFO	:	Epoch 619 | loss: nan | val_loss: nan | Time: 5876.92 ms
[2021-09-25 22:06:26	                main:574]	:	INFO	:	Epoch 620 | loss: nan | val_loss: nan | Time: 5901.21 ms
[2021-09-25 22:06:32	                main:574]	:	INFO	:	Epoch 621 | loss: nan | val_loss: nan | Time: 5538.4 ms
[2021-09-25 22:06:37	                main:574]	:	INFO	:	Epoch 622 | loss: nan | val_loss: nan | Time: 5488.16 ms
[2021-09-25 22:06:43	                main:574]	:	INFO	:	Epoch 623 | loss: nan | val_loss: nan | Time: 5498.92 ms
[2021-09-25 22:06:49	                main:574]	:	INFO	:	Epoch 624 | loss: nan | val_loss: nan | Time: 5987.96 ms
[2021-09-25 22:06:55	                main:574]	:	INFO	:	Epoch 625 | loss: nan | val_loss: nan | Time: 5686.6 ms
[2021-09-25 22:07:00	                main:574]	:	INFO	:	Epoch 626 | loss: nan | val_loss: nan | Time: 5756.2 ms
[2021-09-25 22:07:06	                main:574]	:	INFO	:	Epoch 627 | loss: nan | val_loss: nan | Time: 5749.11 ms
[2021-09-25 22:07:12	                main:574]	:	INFO	:	Epoch 628 | loss: nan | val_loss: nan | Time: 5931.68 ms
[2021-09-25 22:07:18	                main:574]	:	INFO	:	Epoch 629 | loss: nan | val_loss: nan | Time: 5589.2 ms
[2021-09-25 22:07:24	                main:574]	:	INFO	:	Epoch 630 | loss: nan | val_loss: nan | Time: 5938.98 ms
[2021-09-25 22:07:29	                main:574]	:	INFO	:	Epoch 631 | loss: nan | val_loss: nan | Time: 5838.86 ms
[2021-09-25 22:07:35	                main:574]	:	INFO	:	Epoch 632 | loss: nan | val_loss: nan | Time: 5748.82 ms
[2021-09-25 22:07:41	                main:574]	:	INFO	:	Epoch 633 | loss: nan | val_loss: nan | Time: 5667.94 ms
[2021-09-25 22:07:47	                main:574]	:	INFO	:	Epoch 634 | loss: nan | val_loss: nan | Time: 5893.63 ms
[2021-09-25 22:07:52	                main:574]	:	INFO	:	Epoch 635 | loss: nan | val_loss: nan | Time: 5567.33 ms
[2021-09-25 22:07:58	                main:574]	:	INFO	:	Epoch 636 | loss: nan | val_loss: nan | Time: 5828.83 ms
[2021-09-25 22:08:04	                main:574]	:	INFO	:	Epoch 637 | loss: nan | val_loss: nan | Time: 5728.15 ms
[2021-09-25 22:08:10	                main:574]	:	INFO	:	Epoch 638 | loss: nan | val_loss: nan | Time: 5662.1 ms
[2021-09-25 22:08:16	                main:574]	:	INFO	:	Epoch 639 | loss: nan | val_loss: nan | Time: 5956.46 ms
[2021-09-25 22:08:21	                main:574]	:	INFO	:	Epoch 640 | loss: nan | val_loss: nan | Time: 5687.77 ms
[2021-09-25 22:08:27	                main:574]	:	INFO	:	Epoch 641 | loss: nan | val_loss: nan | Time: 5720.42 ms
[2021-09-25 22:08:33	                main:574]	:	INFO	:	Epoch 642 | loss: nan | val_loss: nan | Time: 5898.92 ms
[2021-09-25 22:08:39	                main:574]	:	INFO	:	Epoch 643 | loss: nan | val_loss: nan | Time: 5764.25 ms
[2021-09-25 22:08:44	                main:574]	:	INFO	:	Epoch 644 | loss: nan | val_loss: nan | Time: 5584.73 ms
[2021-09-25 22:08:50	                main:574]	:	INFO	:	Epoch 645 | loss: nan | val_loss: nan | Time: 5841.01 ms
[2021-09-25 22:08:56	                main:574]	:	INFO	:	Epoch 646 | loss: nan | val_loss: nan | Time: 5621.93 ms
[2021-09-25 22:09:01	                main:574]	:	INFO	:	Epoch 647 | loss: nan | val_loss: nan | Time: 5623.32 ms
[2021-09-25 22:09:07	                main:574]	:	INFO	:	Epoch 648 | loss: nan | val_loss: nan | Time: 5718.36 ms
[2021-09-25 22:09:13	                main:574]	:	INFO	:	Epoch 649 | loss: nan | val_loss: nan | Time: 5544.16 ms
[2021-09-25 22:09:18	                main:574]	:	INFO	:	Epoch 650 | loss: nan | val_loss: nan | Time: 5611.82 ms
[2021-09-25 22:09:24	                main:574]	:	INFO	:	Epoch 651 | loss: nan | val_loss: nan | Time: 6004.46 ms
[2021-09-25 22:09:30	                main:574]	:	INFO	:	Epoch 652 | loss: nan | val_loss: nan | Time: 5898.85 ms
[2021-09-25 22:09:36	                main:574]	:	INFO	:	Epoch 653 | loss: nan | val_loss: nan | Time: 5493.09 ms
[2021-09-25 22:09:42	                main:574]	:	INFO	:	Epoch 654 | loss: nan | val_loss: nan | Time: 5957.84 ms
[2021-09-25 22:09:47	                main:574]	:	INFO	:	Epoch 655 | loss: nan | val_loss: nan | Time: 5766.43 ms
[2021-09-25 22:09:53	                main:574]	:	INFO	:	Epoch 656 | loss: nan | val_loss: nan | Time: 5679.89 ms
[2021-09-25 22:09:59	                main:574]	:	INFO	:	Epoch 657 | loss: nan | val_loss: nan | Time: 5680.81 ms
[2021-09-25 22:10:04	                main:574]	:	INFO	:	Epoch 658 | loss: nan | val_loss: nan | Time: 5726.68 ms
[2021-09-25 22:10:10	                main:574]	:	INFO	:	Epoch 659 | loss: nan | val_loss: nan | Time: 5979.35 ms
[2021-09-25 22:10:16	                main:574]	:	INFO	:	Epoch 660 | loss: nan | val_loss: nan | Time: 5929.21 ms
[2021-09-25 22:10:22	                main:574]	:	INFO	:	Epoch 661 | loss: nan | val_loss: nan | Time: 5713.47 ms
[2021-09-25 22:10:28	                main:574]	:	INFO	:	Epoch 662 | loss: nan | val_loss: nan | Time: 5511.42 ms
[2021-09-25 22:10:33	                main:574]	:	INFO	:	Epoch 663 | loss: nan | val_loss: nan | Time: 5729.08 ms
[2021-09-25 22:10:39	                main:574]	:	INFO	:	Epoch 664 | loss: nan | val_loss: nan | Time: 5761.18 ms
[2021-09-25 22:10:45	                main:574]	:	INFO	:	Epoch 665 | loss: nan | val_loss: nan | Time: 5733.45 ms
[2021-09-25 22:10:51	                main:574]	:	INFO	:	Epoch 666 | loss: nan | val_loss: nan | Time: 5910.68 ms
[2021-09-25 22:10:57	                main:574]	:	INFO	:	Epoch 667 | loss: nan | val_loss: nan | Time: 5905.63 ms
[2021-09-25 22:11:02	                main:574]	:	INFO	:	Epoch 668 | loss: nan | val_loss: nan | Time: 5772.4 ms
[2021-09-25 22:11:08	                main:574]	:	INFO	:	Epoch 669 | loss: nan | val_loss: nan | Time: 5968.49 ms
[2021-09-25 22:11:14	                main:574]	:	INFO	:	Epoch 670 | loss: nan | val_loss: nan | Time: 5587.67 ms
[2021-09-25 22:11:20	                main:574]	:	INFO	:	Epoch 671 | loss: nan | val_loss: nan | Time: 5701.25 ms
[2021-09-25 22:11:25	                main:574]	:	INFO	:	Epoch 672 | loss: nan | val_loss: nan | Time: 5681.36 ms
[2021-09-25 22:11:31	                main:574]	:	INFO	:	Epoch 673 | loss: nan | val_loss: nan | Time: 5600.76 ms
[2021-09-25 22:11:37	                main:574]	:	INFO	:	Epoch 674 | loss: nan | val_loss: nan | Time: 5644.68 ms
[2021-09-25 22:11:42	                main:574]	:	INFO	:	Epoch 675 | loss: nan | val_loss: nan | Time: 5538.19 ms
[2021-09-25 22:11:48	                main:574]	:	INFO	:	Epoch 676 | loss: nan | val_loss: nan | Time: 5572.46 ms
[2021-09-25 22:11:54	                main:574]	:	INFO	:	Epoch 677 | loss: nan | val_loss: nan | Time: 5767.4 ms
[2021-09-25 22:11:59	                main:574]	:	INFO	:	Epoch 678 | loss: nan | val_loss: nan | Time: 5636.55 ms
[2021-09-25 22:12:05	                main:574]	:	INFO	:	Epoch 679 | loss: nan | val_loss: nan | Time: 5799.51 ms
[2021-09-25 22:12:11	                main:574]	:	INFO	:	Epoch 680 | loss: nan | val_loss: nan | Time: 5554.21 ms
[2021-09-25 22:12:17	                main:574]	:	INFO	:	Epoch 681 | loss: nan | val_loss: nan | Time: 6015.56 ms
[2021-09-25 22:12:22	                main:574]	:	INFO	:	Epoch 682 | loss: nan | val_loss: nan | Time: 5655.55 ms
[2021-09-25 22:12:28	                main:574]	:	INFO	:	Epoch 683 | loss: nan | val_loss: nan | Time: 5595.54 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 1650)
[2021-09-25 22:33:01	                main:435]	:	INFO	:	Set logging level to 1
[2021-09-25 22:33:01	                main:441]	:	INFO	:	Running in BOINC Client mode
[2021-09-25 22:33:01	                main:444]	:	INFO	:	Resolving all filenames
[2021-09-25 22:33:01	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1)
[2021-09-25 22:33:01	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1631732077-32724-1_0_r1409763236_1 (exists = 1)
[2021-09-25 22:33:01	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1631732077-32724-1_0_r1409763236_0 (exists = 0)
[2021-09-25 22:33:01	                main:452]	:	INFO	:	Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1631732077-32724-1 (exists = 1)
[2021-09-25 22:33:01	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2021-09-25 22:33:01	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5
[2021-09-25 22:33:01	                main:474]	:	INFO	:	Configuration: 
[2021-09-25 22:33:01	                main:475]	:	INFO	:	    Model type: GRU
[2021-09-25 22:33:01	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2021-09-25 22:33:01	                main:477]	:	INFO	:	    Max Epochs: 2048
[2021-09-25 22:33:01	                main:478]	:	INFO	:	    Batch Size: 128
[2021-09-25 22:33:01	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2021-09-25 22:33:01	                main:480]	:	INFO	:	    Patience: 10
[2021-09-25 22:33:01	                main:481]	:	INFO	:	    Hidden Width: 12
[2021-09-25 22:33:01	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2021-09-25 22:33:01	                main:483]	:	INFO	:	    # Backend Layers: 4
[2021-09-25 22:33:01	                main:484]	:	INFO	:	    # Threads: 1
[2021-09-25 22:33:01	                main:486]	:	INFO	:	Preparing Dataset
[2021-09-25 22:33:01	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-09-25 22:33:02	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-09-25 22:33:04	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2021-09-25 22:33:04	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-09-25 22:33:04	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-09-25 22:33:04	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2021-09-25 22:33:04	                main:494]	:	INFO	:	Creating Model
[2021-09-25 22:33:04	                main:507]	:	INFO	:	Preparing config file
[2021-09-25 22:33:04	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2021-09-25 22:33:04	                main:512]	:	INFO	:	Loading config


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FF9967A4F99

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 09/25/21 22:33:04
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\3;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 00000000311b0000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000099050000 00000000001f5000 C:\windows\SYSTEM32\ntdll.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.19041.1023 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1023

ModLoad: 00000000984d0000 00000000000be000 C:\windows\System32\KERNEL32.DLL (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 0000000096770000 00000000002c9000 C:\windows\System32\KERNELBASE.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 0000000097150000 00000000001a1000 C:\windows\System32\USER32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000096dc0000 0000000000022000 C:\windows\System32\win32u.dll (6.2.19041.1237) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.19041.1237 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1237

ModLoad: 0000000098350000 000000000002b000 C:\windows\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202

ModLoad: 0000000096c10000 000000000010b000 C:\windows\System32\gdi32full.dll (6.2.19041.1110) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.19041.1110 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1110

ModLoad: 00000000527b0000 0000000000058000 C:\ProgramData\BOINC\slots\3\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000096d20000 000000000009d000 C:\windows\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 0000000096fa0000 0000000000100000 C:\windows\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 00000000970a0000 00000000000ac000 C:\windows\System32\ADVAPI32.dll (6.2.19041.1052) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000097f00000 000000000009e000 C:\windows\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.19041.546

ModLoad: 0000000097fa0000 000000000009b000 C:\windows\System32\sechost.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000098590000 000000000012a000 C:\windows\System32\RPCRT4.dll (6.2.19041.1081) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000047060000 000000000008d000 C:\windows\SYSTEM32\MSVCP140.dll (14.28.29910.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\9\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.28.29910.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.28.29910.0

ModLoad: 000000004d500000 000000000001a000 C:\windows\SYSTEM32\VCRUNTIME140.dll (14.28.29910.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\9\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.28.29910.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.28.29910.0

ModLoad: 000000007e380000 00000000001e4000 C:\windows\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.867

ModLoad: 000000004cc00000 000000000000c000 C:\windows\SYSTEM32\VCRUNTIME140_1.dll (14.28.29910.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\9\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.28.29910.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.28.29910.0

ModLoad: 00000000ca410000 0000000024b49000 C:\ProgramData\BOINC\slots\3\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000bf820000 000000000abe7000 C:\ProgramData\BOINC\slots\3\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000006c8c0000 0000000000045000 C:\ProgramData\BOINC\slots\3\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000332f0000 000000000020d000 C:\ProgramData\BOINC\slots\3\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 000000001b2e0000 00000000002db000 C:\ProgramData\BOINC\slots\3\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000f7290000 00000000034b2000 C:\ProgramData\BOINC\slots\3\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000fa750000 00000000030a5000 C:\ProgramData\BOINC\slots\3\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 00000000921e0000 0000000000010000 C:\ProgramData\BOINC\slots\3\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 000000008e1a0000 000000000919f000 C:\ProgramData\BOINC\slots\3\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000644a0000 0000000000040000 C:\ProgramData\BOINC\slots\3\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000008a440000 0000000003d5b000 C:\ProgramData\BOINC\slots\3\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000105b0000 0000000001eca000 C:\ProgramData\BOINC\slots\3\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000a4470000 000000001b3a4000 C:\ProgramData\BOINC\slots\3\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 0000000097a50000 0000000000030000 C:\windows\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000094670000 0000000000012000 C:\windows\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000097a80000 0000000000472000 C:\windows\System32\Setupapi.dll (6.2.19041.1237) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000096df0000 000000000004e000 C:\windows\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 0000000096aa0000 0000000000027000 C:\windows\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000096530000 0000000000034000 C:\windows\SYSTEM32\DEVOBJ.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 0000000096a40000 0000000000060000 C:\windows\System32\WINTRUST.dll (6.2.19041.1237) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.19041.1237 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1237

ModLoad: 0000000096e40000 0000000000156000 C:\windows\System32\CRYPT32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000096350000 0000000000012000 C:\windows\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000986c0000 000000000073f000 C:\windows\System32\Shell32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.19041.964 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.964

ModLoad: 0000000094870000 0000000000790000 C:\windows\SYSTEM32\windows.storage.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000097690000 0000000000355000 C:\windows\System32\combase.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202

ModLoad: 0000000096150000 000000000002c000 C:\windows\SYSTEM32\Wldp.dll (6.2.19041.662) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000983e0000 00000000000ae000 C:\windows\System32\SHCORE.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000098380000 0000000000055000 C:\windows\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000001b040000 000000000029d000 C:\windows\system32\nvcuda.dll (27.21.14.6280) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r460\r460_00\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 27.21.14.6280
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.2.162 driver
    Product Version       : 27.21.14.6280

ModLoad: 000000008e6f0000 000000000000a000 C:\windows\SYSTEM32\VERSION.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000f5cd0000 00000000015b8000 C:\windows\system32\DriverStore\FileRepository\nvhm.inf_amd64_6f7f22b0a5610d99\nvcuda64.dll (27.21.14.6280) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r460\r460_00\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 27.21.14.6280
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.2.162 driver
    Product Version       : 27.21.14.6280

ModLoad: 0000000098040000 000000000006b000 C:\windows\System32\WS2_32.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : ws2_32.pdb
    File Version          : 10.0.19041.1081 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1081

ModLoad: 0000000086b80000 0000000000031000 C:\windows\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.19041.906 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.906

ModLoad: 00000000960a0000 000000000000c000 C:\windows\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000941b0000 000000000009e000 C:\windows\system32\uxtheme.dll (6.2.19041.1081) (-exported- Symbols Loaded)
    Linked PDB Filename   : UxTheme.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000082f10000 00000000006f3000 C:\windows\SYSTEM32\nvapi64.dll (27.21.14.6280) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r460\r460_00\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 27.21.14.6280
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 27.21.14.6280

ModLoad: 0000000097490000 000000000012a000 C:\windows\System32\OLE32.DLL (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : ole32.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202

ModLoad: 0000000096ad0000 0000000000083000 C:\windows\System32\bcryptPrimitives.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3614, Write: 306, Other 726

- I/O Transfers Counters -
Read: 6608053, Write: 7299, Other 29298

- Paged Pool Usage -
QuotaPagedPoolUsage: 3451016, QuotaPeakPagedPoolUsage: 3451016
QuotaNonPagedPoolUsage: 40872, QuotaPeakNonPagedPoolUsage: 40872

- Virtual Memory Usage -
VirtualSize: -1302118400, PeakVirtualSize: -699666432

- Pagefile Usage -
PagefileUsage: -1302118400, PeakPagefileUsage: -1302118400

- Working Set Size -
WorkingSetSize: 1229344768, PeakWorkingSetSize: 1229348864, PageFaultCount: 427752

*** Dump of thread ID 13432 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 9687500.000000, User Time: 19531250.000000, Wait Time: 16098918.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FF9967A4F99

- Registers -
rax=00000000b82e6238 rbx=0000000031514910 rcx=000000005aac1200 rdx=0000000099075b00 rsi=00000000b82e6aa0 rdi=0000000019930520
r8=00000000b82e6260 r9=00000000b82e6288 r10=0000000000000004 r11=00000000b82e6298 r12=0000000038352650 r13=00000000b82e6cb0
r14=000000005ae9f6e0 r15=0000000000000000 rip=00000000967a4f99 rsp=00000000b82e6940 rbp=00000000b82e6c30
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
b82e6a10 3142a884 00000040 0000004f 38352a00 00000267 KERNELBASE!RaiseException+0x0 
b82e6a70 311d1ca6 73c20000 b82e6b49 530fc660 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
b82e6b20 311d593b 00000000 00000030 00000020 00000008 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
b82e6c70 311d1a78 00000000 00000000 b82e6fa0 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
b82e6d40 311d1cfc b82e6fa0 00000000 00000080 b82e7270 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
b82e6e00 311dc4dd b82e7270 b82e7270 b82e7270 b82e7270 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
b82e70f0 311cb2fe b82e7708 b82e7270 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
b82ffe90 3140c6f8 7563b7a0 00000000 00000000 75618e70 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
b82ffed0 984e7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
b82fff00 990a2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
b82fff80 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 4320 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 16098719.000000

- Registers -
rax=00000000000001d3 rbx=0000000073c25420 rcx=0000000000000074 rdx=0000000073c250a0 rsi=0000000073c23220 rdi=0000000073c25420
r8=000000008e6f5008 r9=00000000b83fef70 r10=000000008e6f00f0 r11=0000000000000001 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000990f07c4 rsp=00000000b83ff4c8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
b83ff4c0 990a2dc7 00000000 00000000 73c23220 73c25420 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
b83ff7c0 984e7034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
b83ff7f0 990a2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
b83ff870 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 13180 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 312500.000000, User Time: 0.000000, Wait Time: 16098720.000000

- Registers -
rax=00000000000001d3 rbx=0000000073c258a0 rcx=0000000000000074 rdx=0000000073c25520 rsi=0000000073c23220 rdi=0000000073c258a0
r8=0000000000000008 r9=0000000000000040 r10=0000000000000180 r11=0000000077aa23a1 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000990f07c4 rsp=00000000b84ff708 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
b84ff700 990a2dc7 00000000 00000000 73c23220 73c258a0 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
b84ffa00 984e7034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
b84ffa30 990a2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
b84ffab0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 12968 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 16098719.000000

- Registers -
rax=00000000000001d3 rbx=0000000073c319e0 rcx=0000000000000074 rdx=0000000073c31660 rsi=0000000073c23220 rdi=0000000073c319e0
r8=00000000000003ad r9=00000000000003ad r10=00000000000003ad r11=00000000000003ae r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000990f07c4 rsp=00000000b85ffa48 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
b85ffa40 990a2dc7 00000000 00000000 73c23220 73c319e0 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
b85ffd40 984e7034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
b85ffd70 990a2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
b85ffdf0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 8712 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 16098913.000000

- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000b87ffe10 rsi=0000000000000000 rdi=0000000000000064
r8=00000000b814e000 r9=00000000314687f0 r10=0000000000000fff r11=0000000000000ff0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000990ed3f4 rsp=00000000b87ffde8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
b87ffde0 967b967e b87ffea8 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0 
b87ffe80 311ea07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0 
b87ffeb0 984e7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
b87ffee0 990a2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
b87fff60 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 8716 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 16098916.000000

- Registers -
rax=000000000000005b rbx=0000000000000007 rcx=0000000000000007 rdx=00000000b88ff900 rsi=0000000000000000 rdi=0000000000000007
r8=00000000b88ff5a8 r9=000000007582ae10 r10=0000000000000000 r11=00000000b88ff870 r12=0000000000000064 r13=00000000b88ff900
r14=00000000b88ff600 r15=0000000000000000 rip=00000000990ed8c4 rsp=00000000b88ff5a8 rbp=000000007582ae10
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
b88ff5a0 967bcb70 00000000 b8143000 991ba4d0 b8143000 ntdll!ZwWaitForMultipleObjects+0x0 
b88ff890 967bca6e 73c2daf0 006e0069 00000007 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
b88ff8d0 f5e868b4 7582e890 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
b88ffb10 f5f1e8ad 00000000 7582ae10 00000000 00000000 nvcuda64!+0x0 
b88ffbc0 f5e86283 ad3a691c abdcdf30 76127120 00000000 nvcuda64!cuProfilerStop+0x0 
b88ffbf0 f619e004 76127120 00000000 00000000 00000000 nvcuda64!+0x0 
b88ffc20 984e7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
b88ffc50 990a2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
b88ffcd0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 8840 (state: Waiting): ***

- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 16098892.000000

- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=0000000075aac258 rdx=00000000b89ff968 rsi=00000000b89ff8d0 rdi=0000000000000000
r8=00000000b89ff948 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=00000000b89ff968 r13=0000000000000000
r14=0000000075aac258 r15=0000000075aaf5c0 rip=00000000990f0764 rsp=00000000b89ff8a8 rbp=00000000b89ff900
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
b89ff8a0 990b4295 00000102 00000102 00000000 b89ff8d0 ntdll!NtWaitForAlertByThreadId+0x0 
b89ff910 967dce39 75aacda0 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0 
b89ff940 f5e04d2c 75aacda0 990a07b0 75aacda0 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0 
b89ff9a0 f5e86283 00000001 ad0d749d 00000000 00000000 nvcuda64!+0x0 
b89ff9d0 f619e004 757644f0 00000000 00000000 00000000 nvcuda64!+0x0 
b89ffa00 984e7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
b89ffa30 990a2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
b89ffab0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)