Task 3156996

Name ParityMachine-1605152068-24379-4_0
Workunit 1458731
Created 2 Dec 2020, 2:44:14 UTC
Sent 3 Dec 2020, 14:46:40 UTC
Report deadline 10 Dec 2020, 14:46:40 UTC
Received 6 Dec 2020, 22:15:28 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 4186
Run time 27 min 37 sec
CPU time 23 min 30 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 7,469.70 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 2.06 GB
Peak swap size 4.36 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
20-12-03 16:59:15	                main:562]	:	INFO	:	Starting Training
[2020-12-03 16:59:18	                main:574]	:	INFO	:	Epoch 479 | loss: 0.0312587 | val_loss: 0.0312335 | Time: 2704.1 ms
[2020-12-03 16:59:20	                main:574]	:	INFO	:	Epoch 480 | loss: 0.0312326 | val_loss: 0.0312311 | Time: 2412.71 ms
[2020-12-03 16:59:23	                main:574]	:	INFO	:	Epoch 481 | loss: 0.0312314 | val_loss: 0.0312305 | Time: 2407.08 ms
[2020-12-03 16:59:25	                main:574]	:	INFO	:	Epoch 482 | loss: 0.0312328 | val_loss: 0.0312329 | Time: 2377.34 ms
[2020-12-03 16:59:28	                main:574]	:	INFO	:	Epoch 483 | loss: 0.0312315 | val_loss: 0.0312316 | Time: 2404.17 ms
[2020-12-03 16:59:30	                main:574]	:	INFO	:	Epoch 484 | loss: 0.031231 | val_loss: 0.0312303 | Time: 2422.31 ms
[2020-12-03 16:59:33	                main:574]	:	INFO	:	Epoch 485 | loss: 0.031231 | val_loss: 0.0312305 | Time: 2411.16 ms
[2020-12-03 16:59:35	                main:574]	:	INFO	:	Epoch 486 | loss: 0.0312309 | val_loss: 0.0312303 | Time: 2430.83 ms
[2020-12-03 16:59:38	                main:574]	:	INFO	:	Epoch 487 | loss: 0.0312308 | val_loss: 0.0312313 | Time: 2387.53 ms
[2020-12-03 16:59:40	                main:574]	:	INFO	:	Epoch 488 | loss: 0.0312305 | val_loss: 0.0312302 | Time: 2396.33 ms
[2020-12-03 16:59:42	                main:574]	:	INFO	:	Epoch 489 | loss: 0.0312308 | val_loss: 0.0312305 | Time: 2388.46 ms
[2020-12-03 16:59:45	                main:574]	:	INFO	:	Epoch 490 | loss: 0.0312305 | val_loss: 0.0312302 | Time: 2409.12 ms
[2020-12-03 16:59:47	                main:574]	:	INFO	:	Epoch 491 | loss: 0.0312305 | val_loss: 0.0312308 | Time: 2421.78 ms
[2020-12-03 16:59:50	                main:574]	:	INFO	:	Epoch 492 | loss: 0.0312309 | val_loss: 0.0312322 | Time: 2408.8 ms
[2020-12-03 16:59:52	                main:574]	:	INFO	:	Epoch 493 | loss: 0.0312317 | val_loss: 0.0312316 | Time: 2423.77 ms
[2020-12-03 16:59:55	                main:574]	:	INFO	:	Epoch 494 | loss: 0.0312308 | val_loss: 0.0312301 | Time: 2412.36 ms
[2020-12-03 16:59:57	                main:574]	:	INFO	:	Epoch 495 | loss: 0.0312305 | val_loss: 0.0312336 | Time: 2413.87 ms
[2020-12-03 17:00:00	                main:574]	:	INFO	:	Epoch 496 | loss: 0.0312317 | val_loss: 0.0312316 | Time: 2422.27 ms
[2020-12-03 17:00:02	                main:574]	:	INFO	:	Epoch 497 | loss: 0.0312309 | val_loss: 0.0312311 | Time: 2432.24 ms
[2020-12-03 17:00:04	                main:574]	:	INFO	:	Epoch 498 | loss: 0.0312307 | val_loss: 0.0312304 | Time: 2418.39 ms
[2020-12-03 17:00:07	                main:574]	:	INFO	:	Epoch 499 | loss: 0.0312302 | val_loss: 0.0312301 | Time: 2426.6 ms
[2020-12-03 17:00:09	                main:574]	:	INFO	:	Epoch 500 | loss: 0.0312301 | val_loss: 0.0312304 | Time: 2425.94 ms
[2020-12-03 17:00:12	                main:574]	:	INFO	:	Epoch 501 | loss: 0.0312305 | val_loss: 0.0312303 | Time: 2449.56 ms
[2020-12-03 17:00:14	                main:574]	:	INFO	:	Epoch 502 | loss: 0.0312306 | val_loss: 0.0312309 | Time: 2398.58 ms
[2020-12-03 17:00:17	                main:574]	:	INFO	:	Epoch 503 | loss: 0.0312303 | val_loss: 0.0312302 | Time: 2441.72 ms
[2020-12-03 17:00:19	                main:574]	:	INFO	:	Epoch 504 | loss: 0.0312304 | val_loss: 0.0312314 | Time: 2407.8 ms
[2020-12-03 17:00:22	                main:574]	:	INFO	:	Epoch 505 | loss: 0.0312309 | val_loss: 0.0312325 | Time: 2520.32 ms
[2020-12-03 17:00:24	                main:574]	:	INFO	:	Epoch 506 | loss: 0.0312305 | val_loss: 0.0312312 | Time: 2588.62 ms
[2020-12-03 17:00:27	                main:574]	:	INFO	:	Epoch 507 | loss: 0.0312306 | val_loss: 0.0312303 | Time: 2570.81 ms
[2020-12-03 17:00:30	                main:574]	:	INFO	:	Epoch 508 | loss: 0.031231 | val_loss: 0.0312326 | Time: 2626.37 ms
[2020-12-03 17:00:32	                main:574]	:	INFO	:	Epoch 509 | loss: 0.0312305 | val_loss: 0.031231 | Time: 2426.29 ms
[2020-12-03 17:00:35	                main:574]	:	INFO	:	Epoch 510 | loss: 0.0312303 | val_loss: 0.0312357 | Time: 2434.62 ms
[2020-12-03 17:00:37	                main:574]	:	INFO	:	Epoch 511 | loss: 0.0312324 | val_loss: 0.0312329 | Time: 2439.68 ms
[2020-12-03 17:00:40	                main:574]	:	INFO	:	Epoch 512 | loss: 0.0312317 | val_loss: 0.0312303 | Time: 2440.22 ms
[2020-12-03 17:00:42	                main:574]	:	INFO	:	Epoch 513 | loss: 0.0312301 | val_loss: 0.03123 | Time: 2429.1 ms
[2020-12-03 17:00:44	                main:574]	:	INFO	:	Epoch 514 | loss: 0.0312305 | val_loss: 0.0312313 | Time: 2406.02 ms
[2020-12-03 17:00:47	                main:574]	:	INFO	:	Epoch 515 | loss: 0.0312308 | val_loss: 0.0312301 | Time: 2399.33 ms
[2020-12-03 17:00:49	                main:574]	:	INFO	:	Epoch 516 | loss: 0.0312307 | val_loss: 0.0312302 | Time: 2435.83 ms
[2020-12-03 17:00:52	                main:574]	:	INFO	:	Epoch 517 | loss: 0.0312313 | val_loss: 0.0312307 | Time: 2424.97 ms
[2020-12-03 17:00:54	                main:574]	:	INFO	:	Epoch 518 | loss: 0.0312305 | val_loss: 0.03123 | Time: 2402.59 ms
[2020-12-03 17:00:57	                main:574]	:	INFO	:	Epoch 519 | loss: 0.0312299 | val_loss: 0.0312303 | Time: 2402.19 ms
[2020-12-03 17:00:59	                main:574]	:	INFO	:	Epoch 520 | loss: 0.0312305 | val_loss: 0.0312304 | Time: 2394.62 ms
[2020-12-03 17:01:02	                main:574]	:	INFO	:	Epoch 521 | loss: 0.0312307 | val_loss: 0.0312316 | Time: 2441.75 ms
[2020-12-03 17:01:04	                main:574]	:	INFO	:	Epoch 522 | loss: 0.0312308 | val_loss: 0.0312302 | Time: 2409.57 ms
[2020-12-03 17:01:06	                main:574]	:	INFO	:	Epoch 523 | loss: 0.0312304 | val_loss: 0.0312303 | Time: 2408.44 ms
[2020-12-03 17:01:09	                main:574]	:	INFO	:	Epoch 524 | loss: 0.0312304 | val_loss: 0.0312323 | Time: 2451.12 ms
[2020-12-03 17:01:11	                main:574]	:	INFO	:	Epoch 525 | loss: 0.031231 | val_loss: 0.0312318 | Time: 2421.59 ms
[2020-12-03 17:01:14	                main:574]	:	INFO	:	Epoch 526 | loss: 0.0312314 | val_loss: 0.031231 | Time: 2432.52 ms
[2020-12-03 17:01:16	                main:574]	:	INFO	:	Epoch 527 | loss: 0.0312311 | val_loss: 0.0312307 | Time: 2479.72 ms
[2020-12-03 17:01:19	                main:574]	:	INFO	:	Epoch 528 | loss: 0.0312303 | val_loss: 0.0312301 | Time: 2508.38 ms
[2020-12-03 17:01:22	                main:574]	:	INFO	:	Epoch 529 | loss: 0.0312302 | val_loss: 0.031231 | Time: 2495.87 ms
[2020-12-03 17:01:24	                main:574]	:	INFO	:	Epoch 530 | loss: 0.0312317 | val_loss: 0.0312319 | Time: 2476.69 ms
[2020-12-03 17:01:26	                main:574]	:	INFO	:	Epoch 531 | loss: 0.0312304 | val_loss: 0.0312313 | Time: 2445.57 ms
[2020-12-03 17:01:29	                main:574]	:	INFO	:	Epoch 532 | loss: 0.0312304 | val_loss: 0.0312307 | Time: 2463 ms
[2020-12-03 17:01:31	                main:574]	:	INFO	:	Epoch 533 | loss: 0.0312302 | val_loss: 0.0312306 | Time: 2407.86 ms
[2020-12-03 17:01:34	                main:574]	:	INFO	:	Epoch 534 | loss: 0.0312309 | val_loss: 0.0312314 | Time: 2437.57 ms
[2020-12-03 17:01:36	                main:574]	:	INFO	:	Epoch 535 | loss: 0.0312304 | val_loss: 0.0312307 | Time: 2456.4 ms
[2020-12-03 17:01:39	                main:574]	:	INFO	:	Epoch 536 | loss: 0.0312306 | val_loss: 0.0312307 | Time: 2450.05 ms
[2020-12-03 17:01:41	                main:574]	:	INFO	:	Epoch 537 | loss: 0.0312301 | val_loss: 0.031231 | Time: 2483.58 ms
[2020-12-03 17:01:44	                main:574]	:	INFO	:	Epoch 538 | loss: 0.0312321 | val_loss: 0.0312346 | Time: 2524.36 ms
[2020-12-03 17:01:46	                main:574]	:	INFO	:	Epoch 539 | loss: 0.0312329 | val_loss: 0.0312338 | Time: 2458.13 ms
[2020-12-03 17:01:49	                main:574]	:	INFO	:	Epoch 540 | loss: 0.0312324 | val_loss: 0.0312344 | Time: 2423.35 ms
[2020-12-03 17:01:51	                main:574]	:	INFO	:	Epoch 541 | loss: 0.0312312 | val_loss: 0.0312306 | Time: 2558.72 ms
[2020-12-03 17:01:54	                main:574]	:	INFO	:	Epoch 542 | loss: 0.0312319 | val_loss: 0.031231 | Time: 2494.02 ms
[2020-12-03 17:01:56	                main:574]	:	INFO	:	Epoch 543 | loss: 0.0312315 | val_loss: 0.0312311 | Time: 2440.52 ms
[2020-12-03 17:01:59	                main:574]	:	INFO	:	Epoch 544 | loss: 0.0312326 | val_loss: 0.0312305 | Time: 2460.45 ms
[2020-12-03 17:02:01	                main:574]	:	INFO	:	Epoch 545 | loss: 0.0312304 | val_loss: 0.0312305 | Time: 2440.95 ms
[2020-12-03 17:02:04	                main:574]	:	INFO	:	Epoch 546 | loss: 0.0312309 | val_loss: 0.0312303 | Time: 2447.68 ms
[2020-12-03 17:02:06	                main:574]	:	INFO	:	Epoch 547 | loss: 0.0312305 | val_loss: 0.0312302 | Time: 2510.75 ms
[2020-12-03 17:02:09	                main:574]	:	INFO	:	Epoch 548 | loss: 0.0312303 | val_loss: 0.03123 | Time: 2451.73 ms
[2020-12-03 17:02:11	                main:574]	:	INFO	:	Epoch 549 | loss: 0.0312306 | val_loss: 0.0312303 | Time: 2469.74 ms
[2020-12-03 17:02:14	                main:574]	:	INFO	:	Epoch 550 | loss: 0.0312308 | val_loss: 0.0312315 | Time: 2427.38 ms
[2020-12-03 17:02:16	                main:574]	:	INFO	:	Epoch 551 | loss: 0.0312305 | val_loss: 0.031233 | Time: 2437.02 ms
[2020-12-03 17:02:19	                main:574]	:	INFO	:	Epoch 552 | loss: 0.0312309 | val_loss: 0.0312309 | Time: 2487.45 ms
[2020-12-03 17:02:21	                main:574]	:	INFO	:	Epoch 553 | loss: 0.0312305 | val_loss: 0.0312317 | Time: 2461.1 ms
[2020-12-03 17:02:24	                main:574]	:	INFO	:	Epoch 554 | loss: 0.0312309 | val_loss: 0.0312301 | Time: 2511.87 ms
[2020-12-03 17:02:26	                main:574]	:	INFO	:	Epoch 555 | loss: 0.0312302 | val_loss: 0.031232 | Time: 2470.35 ms
[2020-12-03 17:02:29	                main:574]	:	INFO	:	Epoch 556 | loss: 0.031232 | val_loss: 0.0312323 | Time: 2530.96 ms
[2020-12-03 17:02:32	                main:574]	:	INFO	:	Epoch 557 | loss: 0.0312308 | val_loss: 0.0312303 | Time: 2435.49 ms
[2020-12-03 17:02:34	                main:574]	:	INFO	:	Epoch 558 | loss: 0.0312304 | val_loss: 0.0312302 | Time: 2448.67 ms
[2020-12-03 17:02:37	                main:574]	:	INFO	:	Epoch 559 | loss: 0.0312306 | val_loss: 0.0312318 | Time: 2521 ms
[2020-12-03 17:02:39	                main:574]	:	INFO	:	Epoch 560 | loss: 0.0312309 | val_loss: 0.0312301 | Time: 2499.37 ms
[2020-12-03 17:02:42	                main:574]	:	INFO	:	Epoch 561 | loss: 0.0312304 | val_loss: 0.0312301 | Time: 2497.46 ms
[2020-12-03 17:02:44	                main:574]	:	INFO	:	Epoch 562 | loss: 0.0312305 | val_loss: 0.0312315 | Time: 2443.28 ms
[2020-12-03 17:02:47	                main:574]	:	INFO	:	Epoch 563 | loss: 0.0312322 | val_loss: 0.0312316 | Time: 2523.69 ms
[2020-12-03 17:02:49	                main:574]	:	INFO	:	Epoch 564 | loss: 0.031231 | val_loss: 0.0312307 | Time: 2472.53 ms
[2020-12-03 17:02:52	                main:574]	:	INFO	:	Epoch 565 | loss: 0.0312306 | val_loss: 0.0312304 | Time: 2475.11 ms
[2020-12-03 17:02:54	                main:574]	:	INFO	:	Epoch 566 | loss: 0.0312308 | val_loss: 0.0312316 | Time: 2415.42 ms
[2020-12-03 17:02:57	                main:574]	:	INFO	:	Epoch 567 | loss: 0.0312302 | val_loss: 0.0312305 | Time: 2464.6 ms
[2020-12-03 17:02:59	                main:574]	:	INFO	:	Epoch 568 | loss: 0.0312304 | val_loss: 0.0312327 | Time: 2427.26 ms
[2020-12-03 17:03:02	                main:574]	:	INFO	:	Epoch 569 | loss: 0.0312308 | val_loss: 0.0312318 | Time: 2527.64 ms
[2020-12-03 17:03:04	                main:574]	:	INFO	:	Epoch 570 | loss: 0.031231 | val_loss: 0.0312301 | Time: 2426.35 ms
[2020-12-03 17:03:07	                main:574]	:	INFO	:	Epoch 571 | loss: 0.0312306 | val_loss: 0.0312309 | Time: 2483.58 ms
[2020-12-03 17:03:09	                main:574]	:	INFO	:	Epoch 572 | loss: 0.0312307 | val_loss: 0.0312314 | Time: 2494.89 ms
[2020-12-03 17:03:12	                main:574]	:	INFO	:	Epoch 573 | loss: 0.0312307 | val_loss: 0.0312318 | Time: 2506.63 ms
[2020-12-03 17:03:14	                main:574]	:	INFO	:	Epoch 574 | loss: 0.0312306 | val_loss: 0.031231 | Time: 2445.79 ms
[2020-12-03 17:03:17	                main:574]	:	INFO	:	Epoch 575 | loss: 0.0312305 | val_loss: 0.0312306 | Time: 2472.73 ms
[2020-12-03 17:03:19	                main:574]	:	INFO	:	Epoch 576 | loss: 0.0312309 | val_loss: 0.0312303 | Time: 2440.33 ms
[2020-12-03 17:03:22	                main:574]	:	INFO	:	Epoch 577 | loss: 0.03123 | val_loss: 0.03123 | Time: 2485.01 ms
[2020-12-03 17:03:24	                main:574]	:	INFO	:	Epoch 578 | loss: 0.0312307 | val_loss: 0.03123 | Time: 2454.85 ms
[2020-12-03 17:03:27	                main:574]	:	INFO	:	Epoch 579 | loss: 0.0312312 | val_loss: 0.0312303 | Time: 2454.35 ms
[2020-12-03 17:03:29	                main:574]	:	INFO	:	Epoch 580 | loss: 0.0312312 | val_loss: 0.0312317 | Time: 2450.25 ms
[2020-12-03 17:03:32	                main:574]	:	INFO	:	Epoch 581 | loss: 0.0312313 | val_loss: 0.0312305 | Time: 2482.37 ms
[2020-12-03 17:03:34	                main:574]	:	INFO	:	Epoch 582 | loss: 0.0312309 | val_loss: 0.0312302 | Time: 2481.18 ms
[2020-12-03 17:03:37	                main:574]	:	INFO	:	Epoch 583 | loss: 0.0312309 | val_loss: 0.0312304 | Time: 2503.87 ms
[2020-12-03 17:03:39	                main:574]	:	INFO	:	Epoch 584 | loss: 0.0312311 | val_loss: 0.0312302 | Time: 2535.86 ms
[2020-12-03 17:03:42	                main:574]	:	INFO	:	Epoch 585 | loss: 0.0312305 | val_loss: 0.0312315 | Time: 2444.96 ms
[2020-12-03 17:03:44	                main:574]	:	INFO	:	Epoch 586 | loss: 0.0312312 | val_loss: 0.0312299 | Time: 2466.57 ms
[2020-12-03 17:03:47	                main:574]	:	INFO	:	Epoch 587 | loss: 0.0312315 | val_loss: 0.0312306 | Time: 2480.21 ms
[2020-12-03 17:03:49	                main:574]	:	INFO	:	Epoch 588 | loss: 0.0312317 | val_loss: 0.0312312 | Time: 2503.74 ms
[2020-12-03 17:03:52	                main:574]	:	INFO	:	Epoch 589 | loss: 0.0312307 | val_loss: 0.0312327 | Time: 2512.47 ms
[2020-12-03 17:03:54	                main:574]	:	INFO	:	Epoch 590 | loss: 0.0312308 | val_loss: 0.03123 | Time: 2459.55 ms
[2020-12-03 17:03:57	                main:574]	:	INFO	:	Epoch 591 | loss: 0.0312303 | val_loss: 0.0312317 | Time: 2502.38 ms
[2020-12-03 17:03:59	                main:574]	:	INFO	:	Epoch 592 | loss: 0.0312308 | val_loss: 0.0312348 | Time: 2455.43 ms
[2020-12-03 17:04:02	                main:574]	:	INFO	:	Epoch 593 | loss: 0.0312314 | val_loss: 0.0312316 | Time: 2446.28 ms
[2020-12-03 17:04:04	                main:574]	:	INFO	:	Epoch 594 | loss: 0.0312316 | val_loss: 0.0312329 | Time: 2396.08 ms
[2020-12-03 17:04:07	                main:574]	:	INFO	:	Epoch 595 | loss: 0.0312312 | val_loss: 0.0312301 | Time: 2413.55 ms
[2020-12-03 17:04:09	                main:574]	:	INFO	:	Epoch 596 | loss: 0.0312302 | val_loss: 0.0312308 | Time: 2432.81 ms
[2020-12-03 17:04:12	                main:574]	:	INFO	:	Epoch 597 | loss: 0.0312305 | val_loss: 0.031231 | Time: 2455.64 ms
[2020-12-03 17:04:14	                main:574]	:	INFO	:	Epoch 598 | loss: 0.0312305 | val_loss: 0.0312301 | Time: 2401.2 ms
[2020-12-03 17:04:17	                main:574]	:	INFO	:	Epoch 599 | loss: 0.0312303 | val_loss: 0.0312301 | Time: 2530.11 ms
[2020-12-03 17:04:19	                main:574]	:	INFO	:	Epoch 600 | loss: 0.031231 | val_loss: 0.0312308 | Time: 2487.22 ms
[2020-12-03 17:04:22	                main:574]	:	INFO	:	Epoch 601 | loss: 0.0312303 | val_loss: 0.0312304 | Time: 2385.03 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce RTX 2070)
[2020-12-03 17:08:11	                main:435]	:	INFO	:	Set logging level to 1
[2020-12-03 17:08:11	                main:441]	:	INFO	:	Running in BOINC Client mode
[2020-12-03 17:08:11	                main:444]	:	INFO	:	Resolving all filenames
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce RTX 2070)
[2020-12-06 14:06:38	                main:435]	:	INFO	:	Set logging level to 1
[2020-12-06 14:06:38	                main:441]	:	INFO	:	Running in BOINC Client mode
[2020-12-06 14:06:38	                main:444]	:	INFO	:	Resolving all filenames
[2020-12-06 14:06:38	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 (exists = 1)
[2020-12-06 14:06:38	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityMachine-1605152068-24379-4_0_r618375387_1 (exists = 1)
[2020-12-06 14:06:38	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityMachine-1605152068-24379-4_0_r618375387_0 (exists = 0)
[2020-12-06 14:06:38	                main:452]	:	INFO	:	Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityMachine-1605152068-24379-4 (exists = 1)
[2020-12-06 14:06:38	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2020-12-06 14:06:38	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5
[2020-12-06 14:06:38	                main:474]	:	INFO	:	Configuration: 
[2020-12-06 14:06:38	                main:475]	:	INFO	:	    Model type: GRU
[2020-12-06 14:06:38	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2020-12-06 14:06:38	                main:477]	:	INFO	:	    Max Epochs: 1024
[2020-12-06 14:06:38	                main:478]	:	INFO	:	    Batch Size: 128
[2020-12-06 14:06:38	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2020-12-06 14:06:38	                main:480]	:	INFO	:	    Patience: 10
[2020-12-06 14:06:38	                main:481]	:	INFO	:	    Hidden Width: 12
[2020-12-06 14:06:38	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2020-12-06 14:06:38	                main:483]	:	INFO	:	    # Backend Layers: 4
[2020-12-06 14:06:38	                main:484]	:	INFO	:	    # Threads: 1
[2020-12-06 14:06:38	                main:486]	:	INFO	:	Preparing Dataset
[2020-12-06 14:06:38	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 into memory
[2020-12-06 14:06:38	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 into memory
[2020-12-06 14:06:40	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2020-12-06 14:06:41	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 into memory
[2020-12-06 14:06:41	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 into memory
[2020-12-06 14:06:41	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2020-12-06 14:06:41	                main:494]	:	INFO	:	Creating Model
[2020-12-06 14:06:41	                main:507]	:	INFO	:	Preparing config file
[2020-12-06 14:06:41	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2020-12-06 14:06:41	                main:512]	:	INFO	:	Loading config
[2020-12-06 14:06:41	                main:514]	:	INFO	:	Loading state
[2020-12-06 14:06:43	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2020-12-06 14:06:43	                main:562]	:	INFO	:	Starting Training
[2020-12-06 14:06:45	                main:574]	:	INFO	:	Epoch 599 | loss: nan | val_loss: nan | Time: 2703.15 ms
[2020-12-06 14:06:48	                main:574]	:	INFO	:	Epoch 600 | loss: nan | val_loss: nan | Time: 2155.81 ms
[2020-12-06 14:06:50	                main:574]	:	INFO	:	Epoch 601 | loss: nan | val_loss: nan | Time: 2151.26 ms
[2020-12-06 14:06:52	                main:574]	:	INFO	:	Epoch 602 | loss: nan | val_loss: nan | Time: 2125.09 ms
[2020-12-06 14:06:54	                main:574]	:	INFO	:	Epoch 603 | loss: nan | val_loss: nan | Time: 2055.87 ms
[2020-12-06 14:06:56	                main:574]	:	INFO	:	Epoch 604 | loss: nan | val_loss: nan | Time: 2053.33 ms
[2020-12-06 14:06:58	                main:574]	:	INFO	:	Epoch 605 | loss: nan | val_loss: nan | Time: 2050.54 ms
[2020-12-06 14:07:00	                main:574]	:	INFO	:	Epoch 606 | loss: nan | val_loss: nan | Time: 2051.62 ms
[2020-12-06 14:07:02	                main:574]	:	INFO	:	Epoch 607 | loss: nan | val_loss: nan | Time: 2051.45 ms
[2020-12-06 14:07:04	                main:574]	:	INFO	:	Epoch 608 | loss: nan | val_loss: nan | Time: 2054.72 ms
[2020-12-06 14:07:06	                main:574]	:	INFO	:	Epoch 609 | loss: nan | val_loss: nan | Time: 2052 ms
[2020-12-06 14:07:08	                main:574]	:	INFO	:	Epoch 610 | loss: nan | val_loss: nan | Time: 2051.69 ms
[2020-12-06 14:07:10	                main:574]	:	INFO	:	Epoch 611 | loss: nan | val_loss: nan | Time: 2055.97 ms
[2020-12-06 14:07:13	                main:574]	:	INFO	:	Epoch 612 | loss: nan | val_loss: nan | Time: 2060.47 ms
[2020-12-06 14:07:15	                main:574]	:	INFO	:	Epoch 613 | loss: nan | val_loss: nan | Time: 2052.69 ms
[2020-12-06 14:07:17	                main:574]	:	INFO	:	Epoch 614 | loss: nan | val_loss: nan | Time: 2049.88 ms
[2020-12-06 14:07:19	                main:574]	:	INFO	:	Epoch 615 | loss: nan | val_loss: nan | Time: 2045.28 ms
[2020-12-06 14:07:21	                main:574]	:	INFO	:	Epoch 616 | loss: nan | val_loss: nan | Time: 2051.05 ms
[2020-12-06 14:07:23	                main:574]	:	INFO	:	Epoch 617 | loss: nan | val_loss: nan | Time: 2043.99 ms
[2020-12-06 14:07:25	                main:574]	:	INFO	:	Epoch 618 | loss: nan | val_loss: nan | Time: 2055.01 ms
[2020-12-06 14:07:27	                main:574]	:	INFO	:	Epoch 619 | loss: nan | val_loss: nan | Time: 2053.31 ms
[2020-12-06 14:07:29	                main:574]	:	INFO	:	Epoch 620 | loss: nan | val_loss: nan | Time: 2046.52 ms
[2020-12-06 14:07:31	                main:574]	:	INFO	:	Epoch 621 | loss: nan | val_loss: nan | Time: 2049.97 ms
[2020-12-06 14:07:33	                main:574]	:	INFO	:	Epoch 622 | loss: nan | val_loss: nan | Time: 2054.21 ms
[2020-12-06 14:07:35	                main:574]	:	INFO	:	Epoch 623 | loss: nan | val_loss: nan | Time: 2047.22 ms
[2020-12-06 14:07:37	                main:574]	:	INFO	:	Epoch 624 | loss: nan | val_loss: nan | Time: 2068.31 ms
[2020-12-06 14:07:39	                main:574]	:	INFO	:	Epoch 625 | loss: nan | val_loss: nan | Time: 2046.59 ms
[2020-12-06 14:07:41	                main:574]	:	INFO	:	Epoch 626 | loss: nan | val_loss: nan | Time: 2043.57 ms
[2020-12-06 14:07:43	                main:574]	:	INFO	:	Epoch 627 | loss: nan | val_loss: nan | Time: 2042.16 ms
[2020-12-06 14:07:46	                main:574]	:	INFO	:	Epoch 628 | loss: nan | val_loss: nan | Time: 2055.57 ms
[2020-12-06 14:07:48	                main:574]	:	INFO	:	Epoch 629 | loss: nan | val_loss: nan | Time: 2055.2 ms
[2020-12-06 14:07:50	                main:574]	:	INFO	:	Epoch 630 | loss: nan | val_loss: nan | Time: 2056.22 ms
[2020-12-06 14:07:52	                main:574]	:	INFO	:	Epoch 631 | loss: nan | val_loss: nan | Time: 2052.27 ms
[2020-12-06 14:07:54	                main:574]	:	INFO	:	Epoch 632 | loss: nan | val_loss: nan | Time: 2050.84 ms
[2020-12-06 14:07:56	                main:574]	:	INFO	:	Epoch 633 | loss: nan | val_loss: nan | Time: 2051.04 ms
[2020-12-06 14:07:58	                main:574]	:	INFO	:	Epoch 634 | loss: nan | val_loss: nan | Time: 2051.21 ms
[2020-12-06 14:08:00	                main:574]	:	INFO	:	Epoch 635 | loss: nan | val_loss: nan | Time: 2044.88 ms
[2020-12-06 14:08:02	                main:574]	:	INFO	:	Epoch 636 | loss: nan | val_loss: nan | Time: 2055.43 ms
[2020-12-06 14:08:04	                main:574]	:	INFO	:	Epoch 637 | loss: nan | val_loss: nan | Time: 2042.49 ms
[2020-12-06 14:08:06	                main:574]	:	INFO	:	Epoch 638 | loss: nan | val_loss: nan | Time: 2045.25 ms
[2020-12-06 14:08:08	                main:574]	:	INFO	:	Epoch 639 | loss: nan | val_loss: nan | Time: 2038.51 ms
[2020-12-06 14:08:10	                main:574]	:	INFO	:	Epoch 640 | loss: nan | val_loss: nan | Time: 2049.75 ms
[2020-12-06 14:08:12	                main:574]	:	INFO	:	Epoch 641 | loss: nan | val_loss: nan | Time: 2051.83 ms
[2020-12-06 14:08:14	                main:574]	:	INFO	:	Epoch 642 | loss: nan | val_loss: nan | Time: 2053.65 ms
[2020-12-06 14:08:16	                main:574]	:	INFO	:	Epoch 643 | loss: nan | val_loss: nan | Time: 2042.61 ms
[2020-12-06 14:08:18	                main:574]	:	INFO	:	Epoch 644 | loss: nan | val_loss: nan | Time: 2040.51 ms
[2020-12-06 14:08:21	                main:574]	:	INFO	:	Epoch 645 | loss: nan | val_loss: nan | Time: 2051.41 ms
[2020-12-06 14:08:23	                main:574]	:	INFO	:	Epoch 646 | loss: nan | val_loss: nan | Time: 2047.15 ms
[2020-12-06 14:08:25	                main:574]	:	INFO	:	Epoch 647 | loss: nan | val_loss: nan | Time: 2053.95 ms
[2020-12-06 14:08:27	                main:574]	:	INFO	:	Epoch 648 | loss: nan | val_loss: nan | Time: 2059.83 ms
[2020-12-06 14:08:29	                main:574]	:	INFO	:	Epoch 649 | loss: nan | val_loss: nan | Time: 2053.92 ms
[2020-12-06 14:08:31	                main:574]	:	INFO	:	Epoch 650 | loss: nan | val_loss: nan | Time: 2049.89 ms
[2020-12-06 14:08:33	                main:574]	:	INFO	:	Epoch 651 | loss: nan | val_loss: nan | Time: 2058.33 ms
[2020-12-06 14:08:35	                main:574]	:	INFO	:	Epoch 652 | loss: nan | val_loss: nan | Time: 2048.53 ms
[2020-12-06 14:08:37	                main:574]	:	INFO	:	Epoch 653 | loss: nan | val_loss: nan | Time: 2030.72 ms
[2020-12-06 14:08:39	                main:574]	:	INFO	:	Epoch 654 | loss: nan | val_loss: nan | Time: 2186.06 ms
[2020-12-06 14:08:41	                main:574]	:	INFO	:	Epoch 655 | loss: nan | val_loss: nan | Time: 2081.67 ms
[2020-12-06 14:08:43	                main:574]	:	INFO	:	Epoch 656 | loss: nan | val_loss: nan | Time: 2079.93 ms
[2020-12-06 14:08:45	                main:574]	:	INFO	:	Epoch 657 | loss: nan | val_loss: nan | Time: 2086.21 ms
[2020-12-06 14:08:48	                main:574]	:	INFO	:	Epoch 658 | loss: nan | val_loss: nan | Time: 2078.68 ms
[2020-12-06 14:08:50	                main:574]	:	INFO	:	Epoch 659 | loss: nan | val_loss: nan | Time: 2075.49 ms
[2020-12-06 14:08:52	                main:574]	:	INFO	:	Epoch 660 | loss: nan | val_loss: nan | Time: 2082.89 ms
[2020-12-06 14:08:54	                main:574]	:	INFO	:	Epoch 661 | loss: nan | val_loss: nan | Time: 2071.23 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce RTX 2070)
[2020-12-06 14:13:40	                main:435]	:	INFO	:	Set logging level to 1
[2020-12-06 14:13:40	                main:441]	:	INFO	:	Running in BOINC Client mode
[2020-12-06 14:13:40	                main:444]	:	INFO	:	Resolving all filenames
[2020-12-06 14:13:40	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 (exists = 1)
[2020-12-06 14:13:40	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityMachine-1605152068-24379-4_0_r618375387_1 (exists = 1)
[2020-12-06 14:13:40	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityMachine-1605152068-24379-4_0_r618375387_0 (exists = 0)
[2020-12-06 14:13:40	                main:452]	:	INFO	:	Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityMachine-1605152068-24379-4 (exists = 1)
[2020-12-06 14:13:40	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2020-12-06 14:13:40	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5
[2020-12-06 14:13:40	                main:474]	:	INFO	:	Configuration: 
[2020-12-06 14:13:40	                main:475]	:	INFO	:	    Model type: GRU
[2020-12-06 14:13:40	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2020-12-06 14:13:40	                main:477]	:	INFO	:	    Max Epochs: 1024
[2020-12-06 14:13:40	                main:478]	:	INFO	:	    Batch Size: 128
[2020-12-06 14:13:40	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2020-12-06 14:13:40	                main:480]	:	INFO	:	    Patience: 10
[2020-12-06 14:13:40	                main:481]	:	INFO	:	    Hidden Width: 12
[2020-12-06 14:13:40	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2020-12-06 14:13:40	                main:483]	:	INFO	:	    # Backend Layers: 4
[2020-12-06 14:13:40	                main:484]	:	INFO	:	    # Threads: 1
[2020-12-06 14:13:40	                main:486]	:	INFO	:	Preparing Dataset
[2020-12-06 14:13:40	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 into memory
[2020-12-06 14:13:40	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 into memory
[2020-12-06 14:13:42	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2020-12-06 14:13:42	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 into memory
[2020-12-06 14:13:42	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 into memory
[2020-12-06 14:13:42	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2020-12-06 14:13:42	                main:494]	:	INFO	:	Creating Model
[2020-12-06 14:13:42	                main:507]	:	INFO	:	Preparing config file
[2020-12-06 14:13:42	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2020-12-06 14:13:42	                main:512]	:	INFO	:	Loading config


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFE77B53B29

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 12/06/20 14:13:42
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\0;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 000000001fb80000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000007ab40000 00000000001f0000 C:\Windows\SYSTEM32\ntdll.dll (6.2.18362.1171) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.18362.1171 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1171

ModLoad: 0000000079430000 00000000000b2000 C:\Windows\System32\KERNEL32.DLL (6.2.18362.1110) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.18362.1110 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1110

ModLoad: 0000000077b10000 00000000002a5000 C:\Windows\System32\KERNELBASE.dll (6.2.18362.1139) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.18362.1171 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1171

ModLoad: 000000007a0a0000 0000000000194000 C:\Windows\System32\USER32.dll (6.2.18362.1171) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.18362.650 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.650

ModLoad: 0000000077ae0000 0000000000021000 C:\Windows\System32\win32u.dll (6.2.18362.1198) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.18362.1198 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1198

ModLoad: 000000007aa00000 0000000000026000 C:\Windows\System32\GDI32.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000780f0000 0000000000196000 C:\Windows\System32\gdi32full.dll (6.2.18362.1139) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.18362.1139 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1139

ModLoad: 000000006f370000 0000000000058000 C:\ProgramData\BOINC\slots\0\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000077fa0000 000000000009e000 C:\Windows\System32\msvcp_win.dll (6.2.18362.1110) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.18362.1110 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1110

ModLoad: 0000000077e20000 00000000000fa000 C:\Windows\System32\ucrtbase.dll (6.2.18362.1110) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.18362.1110 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1110

ModLoad: 000000007a490000 00000000000a3000 C:\Windows\System32\ADVAPI32.dll (6.2.18362.752) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.18362.650 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.650

ModLoad: 0000000079d70000 000000000009e000 C:\Windows\System32\msvcrt.dll (7.0.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.18362.1

ModLoad: 0000000079c50000 0000000000097000 C:\Windows\System32\sechost.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.18362.650 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.650

ModLoad: 0000000079310000 0000000000120000 C:\Windows\System32\RPCRT4.dll (6.2.18362.1198) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.18362.650 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.650

ModLoad: 000000005c940000 0000000000091000 C:\Windows\SYSTEM32\MSVCP140.dll (14.26.28720.3) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.26.28720.3 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.26.28720.3

ModLoad: 0000000068430000 00000000001f4000 C:\Windows\SYSTEM32\dbghelp.dll (6.2.18362.1049) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.18362.1049 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1049

ModLoad: 000000005c920000 0000000000019000 C:\Windows\SYSTEM32\VCRUNTIME140.dll (14.26.28720.3) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.26.28720.3 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.26.28720.3

ModLoad: 000000005c910000 000000000000c000 C:\Windows\SYSTEM32\VCRUNTIME140_1.dll (14.26.28720.3) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.26.28720.3 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.26.28720.3

ModLoad: 00000000f14e0000 000000000abe7000 C:\ProgramData\BOINC\slots\0\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000057880000 000000000020d000 C:\ProgramData\BOINC\slots\0\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 0000000049d70000 00000000002db000 C:\ProgramData\BOINC\slots\0\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000006cf00000 0000000000040000 C:\ProgramData\BOINC\slots\0\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000cc990000 0000000024b49000 C:\ProgramData\BOINC\slots\0\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000659b0000 0000000000045000 C:\ProgramData\BOINC\slots\0\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000a4980000 00000000034b2000 C:\ProgramData\BOINC\slots\0\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 0000000003640000 00000000030a5000 C:\ProgramData\BOINC\slots\0\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 0000000074f30000 0000000000010000 C:\ProgramData\BOINC\slots\0\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 000000006d290000 000000000919f000 C:\ProgramData\BOINC\slots\0\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 0000000069530000 0000000003d5b000 C:\ProgramData\BOINC\slots\0\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 0000000025aa0000 0000000001eca000 C:\ProgramData\BOINC\slots\0\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 0000000076430000 000000001b3a4000 C:\ProgramData\BOINC\slots\0\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 0000000077f20000 0000000000080000 C:\Windows\System32\bcryptPrimitives.dll (6.2.18362.836) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.18362.836 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.836

ModLoad: 0000000078e00000 000000000002e000 C:\Windows\System32\IMM32.DLL (6.2.18362.387) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.18362.387 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.387

ModLoad: 0000000077a20000 0000000000011000 C:\Windows\System32\kernel.appcore.dll (6.2.18362.1171) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.18362.1171 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1171

ModLoad: 0000000076630000 0000000000020000 C:\Windows\SYSTEM32\dxcore.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : DXCore.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000078ba0000 000000000004a000 C:\Windows\System32\cfgmgr32.dll (6.2.18362.387) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.18362.387 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.387

ModLoad: 000000007a610000 0000000000335000 C:\Windows\System32\combase.dll (6.2.18362.1171) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.18362.650 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.650

ModLoad: 0000000078e30000 0000000000470000 C:\Windows\System32\Setupapi.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.18362.650 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.650

ModLoad: 00000000783e0000 0000000000026000 C:\Windows\System32\bcrypt.dll (6.2.18362.267) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.18362.650 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.650

ModLoad: 00000000777e0000 000000000002a000 C:\Windows\SYSTEM32\DEVOBJ.dll (6.2.18362.387) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.18362.387 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.387

ModLoad: 0000000077dc0000 000000000005c000 C:\Windows\System32\WINTRUST.dll (6.2.18362.1198) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.18362.1198 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1198

ModLoad: 0000000077a00000 0000000000012000 C:\Windows\System32\MSASN1.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000078290000 0000000000149000 C:\Windows\System32\CRYPT32.dll (6.2.18362.592) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.18362.650 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.650

ModLoad: 0000000079560000 00000000006e7000 C:\Windows\System32\Shell32.dll (6.2.18362.1171) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.18362.900 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.900

ModLoad: 000000007a950000 00000000000a9000 C:\Windows\System32\shcore.dll (6.2.18362.1171) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.18362.650 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.650

ModLoad: 0000000078410000 0000000000781000 C:\Windows\System32\windows.storage.dll (6.2.18362.1171) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.18362.650 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.650

ModLoad: 0000000077a90000 0000000000023000 C:\Windows\System32\profapi.dll (6.2.18362.693) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : profapi.pdb
    File Version          : 10.0.18362.693 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.693

ModLoad: 0000000077a40000 000000000004a000 C:\Windows\System32\powrprof.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : powrprof.pdb
    File Version          : 10.0.18362.650 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.650

ModLoad: 00000000779f0000 0000000000010000 C:\Windows\System32\UMPDC.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : UMPDC.pdb

ModLoad: 000000007a420000 0000000000052000 C:\Windows\System32\shlwapi.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.18362.650 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.650

ModLoad: 0000000077ac0000 0000000000017000 C:\Windows\System32\cryptsp.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptsp.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000047c10000 0000000000267000 C:\Windows\system32\nvcuda.dll (27.21.14.5709) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r456_87\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 27.21.14.5709
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.1.106 driver
    Product Version       : 27.21.14.5709

ModLoad: 00000000717d0000 000000000000a000 C:\Windows\SYSTEM32\VERSION.DLL (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000020340000 000000000152c000 C:\Windows\system32\DriverStore\FileRepository\nvhdci.inf_amd64_00c9faddb9788b91\nvcuda64.dll (27.21.14.5709) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r456_87\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 27.21.14.5709
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.1.106 driver
    Product Version       : 27.21.14.5709

ModLoad: 0000000079e20000 000000000006f000 C:\Windows\System32\WS2_32.dll (6.2.18362.387) (-exported- Symbols Loaded)
    Linked PDB Filename   : ws2_32.pdb
    File Version          : 10.0.18362.650 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.650

ModLoad: 0000000070fc0000 000000000002f000 C:\Windows\SYSTEM32\cryptnet.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000077410000 000000000000c000 C:\Windows\SYSTEM32\cryptbase.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000075c90000 0000000000099000 C:\Windows\system32\uxtheme.dll (6.2.18362.449) (-exported- Symbols Loaded)
    Linked PDB Filename   : UxTheme.pdb
    File Version          : 10.0.18362.650 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.650

ModLoad: 000000006e390000 00000000006d6000 C:\Windows\SYSTEM32\nvapi64.dll (27.21.14.5709) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r456_87\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 27.21.14.5709
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 27.21.14.5709

ModLoad: 000000007a2c0000 0000000000157000 C:\Windows\System32\OLE32.DLL (6.2.18362.1082) (-exported- Symbols Loaded)
    Linked PDB Filename   : ole32.pdb
    File Version          : 10.0.18362.650 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.650



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3613, Write: 309, Other 903

- I/O Transfers Counters -
Read: 6528110, Write: 7277, Other 32106

- Paged Pool Usage -
QuotaPagedPoolUsage: 3450920, QuotaPeakPagedPoolUsage: 3450920
QuotaNonPagedPoolUsage: 38480, QuotaPeakNonPagedPoolUsage: 38608

- Virtual Memory Usage -
VirtualSize: -1238315008, PeakVirtualSize: -634388480

- Pagefile Usage -
PagefileUsage: -1238315008, PeakPagefileUsage: -1238315008

- Working Set Size -
WorkingSetSize: 1227857920, PeakWorkingSetSize: 1227862016, PageFaultCount: 427525

*** Dump of thread ID 28056 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 6406250.000000, User Time: 15312500.000000, Wait Time: 78663608.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFE77B53B29

- Registers -
rax=0000000094ce5cb8 rbx=000000001fee4910 rcx=000000007248f200 rdx=0000000000000000 rsi=0000000094ce6520 rdi=0000000019930520
r8=0000000094ce5ce0 r9=0000000094ce5d08 r10=0000000000000004 r11=0000000094ce5d18 r12=0000000055f7dfb0 r13=0000000094ce6730
r14=0000000073b5f180 r15=0000000000000000 rip=0000000077b53b29 rsp=0000000094ce63c0 rbp=0000000094ce66b0
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
94ce6490 1fdfa884 00000040 0000004f 55f7cd00 6bfd3ad0 KERNELBASE!RaiseException+0x0 
94ce64f0 1fba1ca6 00000008 0bcd0000 6bfd4d90 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
94ce65a0 1fba593b 00000000 00000030 00000020 00000008 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
94ce66f0 1fba1a78 00000000 00000000 94ce6a20 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
94ce67c0 1fba1cfc 94ce6a20 00000000 00000080 94ce6cf0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
94ce6880 1fbac4dd 94ce6cf0 94ce6cf0 94ce6cf0 94ce6cf0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
94ce6b70 1fb9b2fe 94ce7188 94ce6cf0 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
94cff910 1fddc6f8 0d60a8b0 00000000 00000000 0d621370 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
94cff950 79447c24 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
94cff980 7abad4d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
94cffa00 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 25680 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 78663456.000000

- Registers -
rax=00000000000001cd rbx=000000000bcd5630 rcx=0000000000000074 rdx=000000000bcd52b0 rsi=000000000bcd33d0 rdi=000000000bcd5630
r8=0000000000000008 r9=0000000000000001 r10=0000000000000600 r11=000000000d7fc410 r12=0000000000000000 r13=000000000bcd3708
r14=0000000000000001 r15=0000000000000000 rip=000000007abe0084 rsp=0000000094dff808 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
94dff800 7ab73fe0 00000000 00000000 0bcd33d0 00000004 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
94dffbc0 79447c24 00000000 00000000 00000000 00000000 ntdll!RtlInitializeResource+0x0 
94dffbf0 7abad4d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
94dffc70 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 24408 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 468750.000000, User Time: 0.000000, Wait Time: 78663456.000000

- Registers -
rax=00000000000001cd rbx=000000000bcd5a60 rcx=0000000000000074 rdx=000000000bcd56e0 rsi=000000000bcd33d0 rdi=000000000bcd5a60
r8=0000000000000000 r9=0000000094eff6d8 r10=00000000794c826a r11=00000000794cc9c0 r12=0000000000000000 r13=000000000bcd3708
r14=0000000000000001 r15=0000000000000000 rip=000000007abe0084 rsp=0000000094eff818 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
94eff810 7ab73fe0 00000000 00000000 0bcd33d0 00000001 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
94effbd0 79447c24 00000000 00000000 00000000 00000000 ntdll!RtlInitializeResource+0x0 
94effc00 7abad4d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
94effc80 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 5260 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 625000.000000, User Time: 0.000000, Wait Time: 78663456.000000

- Registers -
rax=00000000000001cd rbx=000000000bcd8d00 rcx=0000000000000074 rdx=000000000bcd8980 rsi=000000000bcd33d0 rdi=000000000bcd8d00
r8=0000000000000761 r9=0000000000000004 r10=000000000d917b60 r11=0000000077d73f74 r12=0000000000000000 r13=000000000bcd3708
r14=0000000000000001 r15=0000000000000000 rip=000000007abe0084 rsp=0000000094fffa68 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
94fffa60 7ab73fe0 00000000 00000000 0bcd33d0 00000003 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
94fffe20 79447c24 00000000 00000000 00000000 00000000 ntdll!RtlInitializeResource+0x0 
94fffe50 7abad4d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
94fffed0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 23216 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 78663608.000000

- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000951ffb50 rsi=0000000000000000 rdi=0000000000000064
r8=00000000951ffb28 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000007abdcd74 rsp=00000000951ffb28 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
951ffb20 77b5fc21 951ffbe8 00000000 00000000 00000000 ntdll!ZwDelayExecution+0x0 
951ffbc0 1fbba07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0 
951ffbf0 79447c24 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
951ffc20 7abad4d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
951ffca0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 8912 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 78663608.000000

- Registers -
rax=000000000000005b rbx=000000000000000b rcx=000000000000000b rdx=00000000952ff7f0 rsi=0000000000000000 rdi=000000000000000b
r8=00000000952ff488 r9=000000000d868ab0 r10=0000000000000000 r11=0000000000000246 r12=0000000000000064 r13=00000000952ff7f0
r14=00000000952ff4e0 r15=0000000000000000 rip=000000007abdd244 rsp=00000000952ff488 rbp=000000000d868ab0
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
952ff480 77b62ae7 7a2e3880 7abb3e54 00000000 94b71000 ntdll!NtWaitForMultipleObjects+0x0 
952ff780 77b629ce 20834b48 0bce7100 0000000b 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
952ff7c0 204ebb54 0d86cd10 00000000 0d867850 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
952ffa00 205809ed 00000000 00000004 00000000 00000000 nvcuda64!+0x0 
952ffab0 204eb523 c449e3d1 c3417941 0dd53050 00000000 nvcuda64!cuProfilerStop+0x0 
952ffae0 207fa750 0dd53050 00000000 00000000 00000000 nvcuda64!+0x0 
952ffb10 79447c24 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
952ffb40 7abad4d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
952ffbc0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 11460 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 78663512.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002c8 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002c8
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=000000000d84f900 r13=0000000000000000
r14=00000000000002c8 r15=0000000000000000 rip=000000007abdc774 rsp=00000000953ff848 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
953ff840 77b51e93 00000000 00000000 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0 
953ff8e0 206fbf48 00000000 77b3dd05 00000000 000002c8 KERNELBASE!WaitForSingleObjectEx+0x0 
953ff950 204eb523 00000001 0dbd38d0 0dd52e10 00000000 nvcuda64!cuProfilerStop+0x0 
953ff980 207fa750 0dd52e10 00000000 00000000 00000000 nvcuda64!+0x0 
953ff9b0 79447c24 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
953ff9e0 7abad4d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
953ffa60 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 18660 (state: Waiting): ***

- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 78663584.000000

- Registers -
rax=00000000000001ca rbx=0000000000000000 rcx=000000000d91f038 rdx=00000000954ff928 rsi=00000000954ff890 rdi=0000000000000000
r8=0000000000000001 r9=00000000000048e4 r10=000000000d923c08 r11=00000000f3339cef r12=00000000954ff928 r13=0000000000000000
r14=000000000d91f038 r15=000000000d923c08 rip=000000007abe0024 rsp=00000000954ff868 rbp=00000000954ff8c0
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
954ff860 7aba0e95 00000102 00000102 00000000 954ff890 ntdll!ZwWaitForAlertByThreadId+0x0 
954ff8d0 77b8c849 0d9213f0 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0 
954ff900 2047223a 0d9213f0 00000000 0d9213f0 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0 
954ff960 204eb523 00000001 c41e3a96 00000000 00000000 nvcuda64!+0x0 
954ff990 207fa750 0dd535c0 00000000 00000000 00000000 nvcuda64!+0x0 
954ff9c0 79447c24 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
954ff9f0 7abad4d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
954ffa70 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)