Task 11531501

Name ParityModified-1639951104-21818-2-0_2
Workunit 8356716
Created 13 Feb 2022, 14:28:42 UTC
Sent 13 Feb 2022, 15:45:12 UTC
Report deadline 21 Feb 2022, 15:45:12 UTC
Received 13 Feb 2022, 16:54:01 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID 571
Run time 25 min 22 sec
CPU time 24 min 28 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 5,441.63 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 2.10 GB
Peak swap size 4.33 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.14.2</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code -1073741819 (0xc0000005)</message>
<stderr_txt>
me: 2944.39 ms
[2022-02-13 17:10:44	                main:574]	:	INFO	:	Epoch 370 | loss: 0.0311504 | val_loss: 0.0311705 | Time: 2533.71 ms
[2022-02-13 17:10:46	                main:574]	:	INFO	:	Epoch 371 | loss: 0.0311513 | val_loss: 0.0311715 | Time: 2415.78 ms
[2022-02-13 17:10:49	                main:574]	:	INFO	:	Epoch 372 | loss: 0.0311504 | val_loss: 0.0311692 | Time: 2572.22 ms
[2022-02-13 17:10:51	                main:574]	:	INFO	:	Epoch 373 | loss: 0.0311526 | val_loss: 0.0311739 | Time: 2522.13 ms
[2022-02-13 17:10:54	                main:574]	:	INFO	:	Epoch 374 | loss: 0.0311522 | val_loss: 0.031173 | Time: 2985.4 ms
[2022-02-13 17:10:57	                main:574]	:	INFO	:	Epoch 375 | loss: 0.0311523 | val_loss: 0.0311722 | Time: 2591.35 ms
[2022-02-13 17:10:59	                main:574]	:	INFO	:	Epoch 376 | loss: 0.0311506 | val_loss: 0.0311709 | Time: 2400.1 ms
[2022-02-13 17:11:02	                main:574]	:	INFO	:	Epoch 377 | loss: 0.0311497 | val_loss: 0.0311749 | Time: 2894.37 ms
[2022-02-13 17:11:05	                main:574]	:	INFO	:	Epoch 378 | loss: 0.0311568 | val_loss: 0.0311749 | Time: 2427.17 ms
[2022-02-13 17:11:07	                main:574]	:	INFO	:	Epoch 379 | loss: 0.0311547 | val_loss: 0.0311686 | Time: 2546.29 ms
[2022-02-13 17:11:10	                main:574]	:	INFO	:	Epoch 380 | loss: 0.0311523 | val_loss: 0.0311704 | Time: 2556.2 ms
[2022-02-13 17:11:12	                main:574]	:	INFO	:	Epoch 381 | loss: 0.0311535 | val_loss: 0.0311735 | Time: 2549.01 ms
[2022-02-13 17:11:15	                main:574]	:	INFO	:	Epoch 382 | loss: 0.0311531 | val_loss: 0.0311699 | Time: 2557.7 ms
[2022-02-13 17:11:17	                main:574]	:	INFO	:	Epoch 383 | loss: 0.0311552 | val_loss: 0.0311712 | Time: 2622.97 ms
[2022-02-13 17:11:20	                main:574]	:	INFO	:	Epoch 384 | loss: 0.0311569 | val_loss: 0.0311675 | Time: 2611.59 ms
[2022-02-13 17:11:23	                main:574]	:	INFO	:	Epoch 385 | loss: 0.0311549 | val_loss: 0.0311741 | Time: 2732.79 ms
[2022-02-13 17:11:25	                main:574]	:	INFO	:	Epoch 386 | loss: 0.0311545 | val_loss: 0.0311702 | Time: 2369.28 ms
[2022-02-13 17:11:28	                main:574]	:	INFO	:	Epoch 387 | loss: 0.0311527 | val_loss: 0.0311693 | Time: 2414.88 ms
[2022-02-13 17:11:30	                main:574]	:	INFO	:	Epoch 388 | loss: 0.0311537 | val_loss: 0.0311711 | Time: 2521.71 ms
[2022-02-13 17:11:34	                main:574]	:	INFO	:	Epoch 389 | loss: 0.0311546 | val_loss: 0.0311755 | Time: 3223.25 ms
[2022-02-13 17:11:36	                main:574]	:	INFO	:	Epoch 390 | loss: 0.0311553 | val_loss: 0.0311678 | Time: 2625.6 ms
[2022-02-13 17:11:39	                main:574]	:	INFO	:	Epoch 391 | loss: 0.0311533 | val_loss: 0.0311711 | Time: 2696.19 ms
[2022-02-13 17:11:42	                main:574]	:	INFO	:	Epoch 392 | loss: 0.0311517 | val_loss: 0.0311773 | Time: 2642.11 ms
[2022-02-13 17:11:44	                main:574]	:	INFO	:	Epoch 393 | loss: 0.0311528 | val_loss: 0.031173 | Time: 2523.64 ms
[2022-02-13 17:11:47	                main:574]	:	INFO	:	Epoch 394 | loss: 0.0311493 | val_loss: 0.0311709 | Time: 2475.26 ms
[2022-02-13 17:11:49	                main:574]	:	INFO	:	Epoch 395 | loss: 0.0311494 | val_loss: 0.0311691 | Time: 2371.06 ms
[2022-02-13 17:11:51	                main:574]	:	INFO	:	Epoch 396 | loss: 0.0311514 | val_loss: 0.0311716 | Time: 2228.01 ms
[2022-02-13 17:11:54	                main:574]	:	INFO	:	Epoch 397 | loss: 0.0311509 | val_loss: 0.0311686 | Time: 2297.91 ms
[2022-02-13 17:11:56	                main:574]	:	INFO	:	Epoch 398 | loss: 0.0311497 | val_loss: 0.0311691 | Time: 2308.77 ms
[2022-02-13 17:11:58	                main:574]	:	INFO	:	Epoch 399 | loss: 0.0311494 | val_loss: 0.0311712 | Time: 2259.67 ms
[2022-02-13 17:12:01	                main:574]	:	INFO	:	Epoch 400 | loss: 0.0311527 | val_loss: 0.0311712 | Time: 2243.01 ms
[2022-02-13 17:12:03	                main:574]	:	INFO	:	Epoch 401 | loss: 0.0311523 | val_loss: 0.0311717 | Time: 2181.08 ms
[2022-02-13 17:12:05	                main:574]	:	INFO	:	Epoch 402 | loss: 0.0311507 | val_loss: 0.031172 | Time: 2214.17 ms
[2022-02-13 17:12:08	                main:574]	:	INFO	:	Epoch 403 | loss: 0.0311502 | val_loss: 0.0311728 | Time: 2307.42 ms
[2022-02-13 17:12:10	                main:574]	:	INFO	:	Epoch 404 | loss: 0.031151 | val_loss: 0.031175 | Time: 2353.17 ms
[2022-02-13 17:12:13	                main:574]	:	INFO	:	Epoch 405 | loss: 0.0311523 | val_loss: 0.031173 | Time: 2298.17 ms
[2022-02-13 17:12:15	                main:574]	:	INFO	:	Epoch 406 | loss: 0.0311534 | val_loss: 0.0311729 | Time: 2381.95 ms
[2022-02-13 17:12:17	                main:574]	:	INFO	:	Epoch 407 | loss: 0.0311526 | val_loss: 0.0311742 | Time: 2262.96 ms
[2022-02-13 17:12:20	                main:574]	:	INFO	:	Epoch 408 | loss: 0.0311518 | val_loss: 0.0311715 | Time: 2258.82 ms
[2022-02-13 17:12:22	                main:574]	:	INFO	:	Epoch 409 | loss: 0.0311503 | val_loss: 0.0311736 | Time: 2147.92 ms
[2022-02-13 17:12:24	                main:574]	:	INFO	:	Epoch 410 | loss: 0.0311564 | val_loss: 0.0311734 | Time: 2190.78 ms
[2022-02-13 17:12:26	                main:574]	:	INFO	:	Epoch 411 | loss: 0.0311557 | val_loss: 0.0311715 | Time: 2256.89 ms
[2022-02-13 17:12:29	                main:574]	:	INFO	:	Epoch 412 | loss: 0.0311532 | val_loss: 0.031174 | Time: 2287.07 ms
[2022-02-13 17:12:31	                main:574]	:	INFO	:	Epoch 413 | loss: 0.0311521 | val_loss: 0.031173 | Time: 2298.17 ms
[2022-02-13 17:12:33	                main:574]	:	INFO	:	Epoch 414 | loss: 0.0311517 | val_loss: 0.0311719 | Time: 2213.15 ms
[2022-02-13 17:12:36	                main:574]	:	INFO	:	Epoch 415 | loss: 0.0311527 | val_loss: 0.0311723 | Time: 2309.26 ms
[2022-02-13 17:12:38	                main:574]	:	INFO	:	Epoch 416 | loss: 0.0311531 | val_loss: 0.0311741 | Time: 2222.53 ms
[2022-02-13 17:12:40	                main:574]	:	INFO	:	Epoch 417 | loss: 0.0311522 | val_loss: 0.0311709 | Time: 2174.72 ms
[2022-02-13 17:12:42	                main:574]	:	INFO	:	Epoch 418 | loss: 0.0311499 | val_loss: 0.0311739 | Time: 2225.35 ms
[2022-02-13 17:12:45	                main:574]	:	INFO	:	Epoch 419 | loss: 0.0311488 | val_loss: 0.0311723 | Time: 2225.21 ms
[2022-02-13 17:12:47	                main:574]	:	INFO	:	Epoch 420 | loss: 0.0311486 | val_loss: 0.0311729 | Time: 2237.44 ms
[2022-02-13 17:12:49	                main:574]	:	INFO	:	Epoch 421 | loss: 0.0311481 | val_loss: 0.0311742 | Time: 2275.1 ms
[2022-02-13 17:12:52	                main:574]	:	INFO	:	Epoch 422 | loss: 0.0311511 | val_loss: 0.0311749 | Time: 2341.19 ms
[2022-02-13 17:12:54	                main:574]	:	INFO	:	Epoch 423 | loss: 0.0311528 | val_loss: 0.0311729 | Time: 2261.26 ms
[2022-02-13 17:12:56	                main:574]	:	INFO	:	Epoch 424 | loss: 0.031153 | val_loss: 0.0311743 | Time: 2243.79 ms
[2022-02-13 17:12:58	                main:574]	:	INFO	:	Epoch 425 | loss: 0.031153 | val_loss: 0.0311741 | Time: 2243.62 ms
[2022-02-13 17:13:01	                main:574]	:	INFO	:	Epoch 426 | loss: 0.0311508 | val_loss: 0.031174 | Time: 2186.94 ms
[2022-02-13 17:13:03	                main:574]	:	INFO	:	Epoch 427 | loss: 0.0311486 | val_loss: 0.0311765 | Time: 2309.03 ms
[2022-02-13 17:13:05	                main:574]	:	INFO	:	Epoch 428 | loss: 0.0311472 | val_loss: 0.0311727 | Time: 2259.65 ms
[2022-02-13 17:13:08	                main:574]	:	INFO	:	Epoch 429 | loss: 0.031147 | val_loss: 0.0311738 | Time: 2535.14 ms
[2022-02-13 17:13:10	                main:574]	:	INFO	:	Epoch 430 | loss: 0.0311493 | val_loss: 0.0311776 | Time: 2394.85 ms
[2022-02-13 17:13:13	                main:574]	:	INFO	:	Epoch 431 | loss: 0.0311508 | val_loss: 0.0311748 | Time: 2533.79 ms
[2022-02-13 17:13:16	                main:574]	:	INFO	:	Epoch 432 | loss: 0.0311493 | val_loss: 0.0311742 | Time: 2635.97 ms
[2022-02-13 17:13:18	                main:574]	:	INFO	:	Epoch 433 | loss: 0.0311481 | val_loss: 0.0311734 | Time: 2363.82 ms
[2022-02-13 17:13:20	                main:574]	:	INFO	:	Epoch 434 | loss: 0.0311479 | val_loss: 0.0311712 | Time: 2199.86 ms
[2022-02-13 17:13:22	                main:574]	:	INFO	:	Epoch 435 | loss: 0.0311483 | val_loss: 0.0311702 | Time: 2284.1 ms
[2022-02-13 17:13:25	                main:574]	:	INFO	:	Epoch 436 | loss: 0.0311481 | val_loss: 0.0311728 | Time: 2239.73 ms
[2022-02-13 17:13:27	                main:574]	:	INFO	:	Epoch 437 | loss: 0.0311483 | val_loss: 0.0311736 | Time: 2206.32 ms
[2022-02-13 17:13:29	                main:574]	:	INFO	:	Epoch 438 | loss: 0.0311467 | val_loss: 0.0311721 | Time: 2404.29 ms
[2022-02-13 17:13:32	                main:574]	:	INFO	:	Epoch 439 | loss: 0.0311473 | val_loss: 0.0311728 | Time: 2272.04 ms
[2022-02-13 17:13:34	                main:574]	:	INFO	:	Epoch 440 | loss: 0.0311462 | val_loss: 0.0311739 | Time: 2185.5 ms
[2022-02-13 17:13:36	                main:574]	:	INFO	:	Epoch 441 | loss: 0.0311469 | val_loss: 0.0311759 | Time: 2160.55 ms
[2022-02-13 17:13:38	                main:574]	:	INFO	:	Epoch 442 | loss: 0.0311496 | val_loss: 0.0311739 | Time: 2196.58 ms
[2022-02-13 17:13:41	                main:574]	:	INFO	:	Epoch 443 | loss: 0.0311472 | val_loss: 0.031174 | Time: 2254.22 ms
[2022-02-13 17:13:43	                main:574]	:	INFO	:	Epoch 444 | loss: 0.0311458 | val_loss: 0.0311762 | Time: 2262.5 ms
[2022-02-13 17:13:45	                main:574]	:	INFO	:	Epoch 445 | loss: 0.0311448 | val_loss: 0.0311755 | Time: 2249.93 ms
[2022-02-13 17:13:47	                main:574]	:	INFO	:	Epoch 446 | loss: 0.0311441 | val_loss: 0.0311735 | Time: 2258.55 ms
[2022-02-13 17:13:50	                main:574]	:	INFO	:	Epoch 447 | loss: 0.0311442 | val_loss: 0.0311737 | Time: 2228.94 ms
[2022-02-13 17:13:52	                main:574]	:	INFO	:	Epoch 448 | loss: 0.0311452 | val_loss: 0.0311757 | Time: 2163.45 ms
[2022-02-13 17:13:54	                main:574]	:	INFO	:	Epoch 449 | loss: 0.0311465 | val_loss: 0.0311744 | Time: 2171.73 ms
[2022-02-13 17:13:56	                main:574]	:	INFO	:	Epoch 450 | loss: 0.0311463 | val_loss: 0.0311722 | Time: 2262.04 ms
[2022-02-13 17:13:59	                main:574]	:	INFO	:	Epoch 451 | loss: 0.0311454 | val_loss: 0.0311733 | Time: 2222.76 ms
[2022-02-13 17:14:01	                main:574]	:	INFO	:	Epoch 452 | loss: 0.0311477 | val_loss: 0.0311772 | Time: 2359.82 ms
[2022-02-13 17:14:03	                main:574]	:	INFO	:	Epoch 453 | loss: 0.0311463 | val_loss: 0.0311731 | Time: 2358.13 ms
[2022-02-13 17:14:06	                main:574]	:	INFO	:	Epoch 454 | loss: 0.031148 | val_loss: 0.0311757 | Time: 2249.12 ms
[2022-02-13 17:14:08	                main:574]	:	INFO	:	Epoch 455 | loss: 0.0311458 | val_loss: 0.0311754 | Time: 2252.7 ms
[2022-02-13 17:14:10	                main:574]	:	INFO	:	Epoch 456 | loss: 0.0311452 | val_loss: 0.0311728 | Time: 2168.55 ms
[2022-02-13 17:14:12	                main:574]	:	INFO	:	Epoch 457 | loss: 0.0311511 | val_loss: 0.0311731 | Time: 2172.9 ms
[2022-02-13 17:14:15	                main:574]	:	INFO	:	Epoch 458 | loss: 0.0311518 | val_loss: 0.0311727 | Time: 2221.12 ms
[2022-02-13 17:14:17	                main:574]	:	INFO	:	Epoch 459 | loss: 0.0311492 | val_loss: 0.0311696 | Time: 2363.81 ms
[2022-02-13 17:14:19	                main:574]	:	INFO	:	Epoch 460 | loss: 0.0311474 | val_loss: 0.0311736 | Time: 2282 ms
[2022-02-13 17:14:22	                main:574]	:	INFO	:	Epoch 461 | loss: 0.0311479 | val_loss: 0.0311737 | Time: 2305.78 ms
[2022-02-13 17:14:24	                main:574]	:	INFO	:	Epoch 462 | loss: 0.0311462 | val_loss: 0.0311716 | Time: 2257.24 ms
[2022-02-13 17:14:26	                main:574]	:	INFO	:	Epoch 463 | loss: 0.0311463 | val_loss: 0.0311733 | Time: 2280.55 ms
[2022-02-13 17:14:29	                main:574]	:	INFO	:	Epoch 464 | loss: 0.0311477 | val_loss: 0.0311712 | Time: 2471.41 ms
[2022-02-13 17:14:31	                main:574]	:	INFO	:	Epoch 465 | loss: 0.0311462 | val_loss: 0.0311714 | Time: 2271.17 ms
[2022-02-13 17:14:34	                main:574]	:	INFO	:	Epoch 466 | loss: 0.031148 | val_loss: 0.031172 | Time: 2608.81 ms
[2022-02-13 17:14:36	                main:574]	:	INFO	:	Epoch 467 | loss: 0.031148 | val_loss: 0.0311792 | Time: 2296.16 ms
[2022-02-13 17:14:38	                main:574]	:	INFO	:	Epoch 468 | loss: 0.0311496 | val_loss: 0.0311723 | Time: 2531.17 ms
[2022-02-13 17:14:41	                main:574]	:	INFO	:	Epoch 469 | loss: 0.0311504 | val_loss: 0.0311675 | Time: 2302.79 ms
[2022-02-13 17:14:43	                main:574]	:	INFO	:	Epoch 470 | loss: 0.0311594 | val_loss: 0.0311676 | Time: 2209.51 ms
[2022-02-13 17:14:45	                main:574]	:	INFO	:	Epoch 471 | loss: 0.031158 | val_loss: 0.0311666 | Time: 2219.99 ms
[2022-02-13 17:14:48	                main:574]	:	INFO	:	Epoch 472 | loss: 0.0311559 | val_loss: 0.0311676 | Time: 2212.03 ms
[2022-02-13 17:14:50	                main:574]	:	INFO	:	Epoch 473 | loss: 0.031155 | val_loss: 0.031169 | Time: 2224.12 ms
[2022-02-13 17:14:52	                main:574]	:	INFO	:	Epoch 474 | loss: 0.0311539 | val_loss: 0.0311662 | Time: 2280.4 ms
[2022-02-13 17:14:54	                main:574]	:	INFO	:	Epoch 475 | loss: 0.0311515 | val_loss: 0.03117 | Time: 2199.24 ms
[2022-02-13 17:14:57	                main:574]	:	INFO	:	Epoch 476 | loss: 0.0311515 | val_loss: 0.031167 | Time: 2278.74 ms
[2022-02-13 17:14:59	                main:574]	:	INFO	:	Epoch 477 | loss: 0.0311516 | val_loss: 0.0311661 | Time: 2242.29 ms
[2022-02-13 17:15:01	                main:574]	:	INFO	:	Epoch 478 | loss: 0.0311495 | val_loss: 0.0311709 | Time: 2165.67 ms
[2022-02-13 17:15:03	                main:574]	:	INFO	:	Epoch 479 | loss: 0.0311483 | val_loss: 0.0311667 | Time: 2179.02 ms
[2022-02-13 17:15:05	                main:574]	:	INFO	:	Epoch 480 | loss: 0.0311475 | val_loss: 0.0311685 | Time: 2145.01 ms
[2022-02-13 17:15:08	                main:574]	:	INFO	:	Epoch 481 | loss: 0.0311481 | val_loss: 0.0311698 | Time: 2259.24 ms
[2022-02-13 17:15:10	                main:574]	:	INFO	:	Epoch 482 | loss: 0.0311491 | val_loss: 0.0311692 | Time: 2411.92 ms
[2022-02-13 17:15:13	                main:574]	:	INFO	:	Epoch 483 | loss: 0.0311496 | val_loss: 0.0311718 | Time: 2459.91 ms
[2022-02-13 17:15:15	                main:574]	:	INFO	:	Epoch 484 | loss: 0.031152 | val_loss: 0.0311737 | Time: 2384.34 ms
[2022-02-13 17:15:18	                main:574]	:	INFO	:	Epoch 485 | loss: 0.0311536 | val_loss: 0.0311707 | Time: 2306.25 ms
[2022-02-13 17:15:20	                main:574]	:	INFO	:	Epoch 486 | loss: 0.0311513 | val_loss: 0.0311694 | Time: 2535.85 ms
[2022-02-13 17:15:23	                main:574]	:	INFO	:	Epoch 487 | loss: 0.0311535 | val_loss: 0.0311693 | Time: 2311.97 ms
[2022-02-13 17:15:25	                main:574]	:	INFO	:	Epoch 488 | loss: 0.0311494 | val_loss: 0.031174 | Time: 2195.91 ms
[2022-02-13 17:15:27	                main:574]	:	INFO	:	Epoch 489 | loss: 0.0311505 | val_loss: 0.0311685 | Time: 2299.04 ms
[2022-02-13 17:15:29	                main:574]	:	INFO	:	Epoch 490 | loss: 0.0311515 | val_loss: 0.0311706 | Time: 2312.1 ms
[2022-02-13 17:15:32	                main:574]	:	INFO	:	Epoch 491 | loss: 0.0311519 | val_loss: 0.0311699 | Time: 2352.36 ms
[2022-02-13 17:15:34	                main:574]	:	INFO	:	Epoch 492 | loss: 0.0311533 | val_loss: 0.0311659 | Time: 2238.24 ms
[2022-02-13 17:15:36	                main:574]	:	INFO	:	Epoch 493 | loss: 0.0311542 | val_loss: 0.0311684 | Time: 2237.71 ms
[2022-02-13 17:15:39	                main:574]	:	INFO	:	Epoch 494 | loss: 0.0311519 | val_loss: 0.0311714 | Time: 2189.33 ms
[2022-02-13 17:15:41	                main:574]	:	INFO	:	Epoch 495 | loss: 0.0311504 | val_loss: 0.031168 | Time: 2291.96 ms
[2022-02-13 17:15:43	                main:574]	:	INFO	:	Epoch 496 | loss: 0.0311502 | val_loss: 0.0311758 | Time: 2226.04 ms
[2022-02-13 17:15:45	                main:574]	:	INFO	:	Epoch 497 | loss: 0.0311516 | val_loss: 0.0311682 | Time: 2206.05 ms
[2022-02-13 17:15:48	                main:574]	:	INFO	:	Epoch 498 | loss: 0.0311513 | val_loss: 0.0311695 | Time: 2298 ms
[2022-02-13 17:15:50	                main:574]	:	INFO	:	Epoch 499 | loss: 0.0311466 | val_loss: 0.0311699 | Time: 2404.89 ms
[2022-02-13 17:15:53	                main:574]	:	INFO	:	Epoch 500 | loss: 0.031146 | val_loss: 0.0311717 | Time: 2210.81 ms
[2022-02-13 17:15:55	                main:574]	:	INFO	:	Epoch 501 | loss: 0.0311474 | val_loss: 0.0311701 | Time: 2538.17 ms
[2022-02-13 17:15:57	                main:574]	:	INFO	:	Epoch 502 | loss: 0.031146 | val_loss: 0.0311721 | Time: 2186.48 ms
[2022-02-13 17:16:00	                main:574]	:	INFO	:	Epoch 503 | loss: 0.0311469 | val_loss: 0.031169 | Time: 2959.61 ms
[2022-02-13 17:16:03	                main:574]	:	INFO	:	Epoch 504 | loss: 0.0311465 | val_loss: 0.031168 | Time: 2670.84 ms
[2022-02-13 17:16:06	                main:574]	:	INFO	:	Epoch 505 | loss: 0.0311461 | val_loss: 0.0311702 | Time: 3237.5 ms
[2022-02-13 17:16:09	                main:574]	:	INFO	:	Epoch 506 | loss: 0.0311455 | val_loss: 0.0311758 | Time: 2296.7 ms
[2022-02-13 17:16:11	                main:574]	:	INFO	:	Epoch 507 | loss: 0.0311445 | val_loss: 0.031174 | Time: 2266.63 ms
[2022-02-13 17:16:13	                main:574]	:	INFO	:	Epoch 508 | loss: 0.0311442 | val_loss: 0.0311728 | Time: 2217.72 ms
[2022-02-13 17:16:16	                main:574]	:	INFO	:	Epoch 509 | loss: 0.031144 | val_loss: 0.0311723 | Time: 2167.34 ms
[2022-02-13 17:16:18	                main:574]	:	INFO	:	Epoch 510 | loss: 0.0311472 | val_loss: 0.0311753 | Time: 2218.6 ms
[2022-02-13 17:16:20	                main:574]	:	INFO	:	Epoch 511 | loss: 0.0311446 | val_loss: 0.0311692 | Time: 2214.2 ms
[2022-02-13 17:16:22	                main:574]	:	INFO	:	Epoch 512 | loss: 0.0311456 | val_loss: 0.0311716 | Time: 2240.55 ms
[2022-02-13 17:16:25	                main:574]	:	INFO	:	Epoch 513 | loss: 0.0311461 | val_loss: 0.0311717 | Time: 2270.15 ms
[2022-02-13 17:16:27	                main:574]	:	INFO	:	Epoch 514 | loss: 0.0311481 | val_loss: 0.0311716 | Time: 2201.4 ms
[2022-02-13 17:16:30	                main:574]	:	INFO	:	Epoch 515 | loss: 0.0311473 | val_loss: 0.03117 | Time: 2619.06 ms
[2022-02-13 17:16:32	                main:574]	:	INFO	:	Epoch 516 | loss: 0.0311467 | val_loss: 0.0311705 | Time: 2214.5 ms
[2022-02-13 17:16:34	                main:574]	:	INFO	:	Epoch 517 | loss: 0.0311449 | val_loss: 0.0311751 | Time: 2479.76 ms
[2022-02-13 17:16:37	                main:574]	:	INFO	:	Epoch 518 | loss: 0.0311435 | val_loss: 0.0311726 | Time: 2326.35 ms
[2022-02-13 17:16:39	                main:574]	:	INFO	:	Epoch 519 | loss: 0.031142 | val_loss: 0.0311716 | Time: 2231.57 ms
[2022-02-13 17:16:41	                main:574]	:	INFO	:	Epoch 520 | loss: 0.0311424 | val_loss: 0.0311717 | Time: 2217.92 ms
[2022-02-13 17:16:44	                main:574]	:	INFO	:	Epoch 521 | loss: 0.0311409 | val_loss: 0.0311713 | Time: 2270.29 ms
[2022-02-13 17:16:46	                main:574]	:	INFO	:	Epoch 522 | loss: 0.0311401 | val_loss: 0.0311705 | Time: 2314.71 ms
[2022-02-13 17:16:48	                main:574]	:	INFO	:	Epoch 523 | loss: 0.0311403 | val_loss: 0.0311707 | Time: 2208.53 ms
[2022-02-13 17:16:50	                main:574]	:	INFO	:	Epoch 524 | loss: 0.0311405 | val_loss: 0.031173 | Time: 2190.22 ms
[2022-02-13 17:16:53	                main:574]	:	INFO	:	Epoch 525 | loss: 0.0311423 | val_loss: 0.0311682 | Time: 2496.55 ms
[2022-02-13 17:16:56	                main:574]	:	INFO	:	Epoch 526 | loss: 0.0311417 | val_loss: 0.0311747 | Time: 2448.33 ms
[2022-02-13 17:16:58	                main:574]	:	INFO	:	Epoch 527 | loss: 0.0311402 | val_loss: 0.0311718 | Time: 2416.07 ms
[2022-02-13 17:17:00	                main:574]	:	INFO	:	Epoch 528 | loss: 0.0311407 | val_loss: 0.0311736 | Time: 2405.78 ms
[2022-02-13 17:17:03	                main:574]	:	INFO	:	Epoch 529 | loss: 0.031141 | val_loss: 0.0311753 | Time: 2335.66 ms
[2022-02-13 17:17:05	                main:574]	:	INFO	:	Epoch 530 | loss: 0.0311504 | val_loss: 0.0311723 | Time: 2251.61 ms
[2022-02-13 17:17:07	                main:574]	:	INFO	:	Epoch 531 | loss: 0.0311521 | val_loss: 0.0311675 | Time: 2200.01 ms
[2022-02-13 17:17:10	                main:574]	:	INFO	:	Epoch 532 | loss: 0.0311508 | val_loss: 0.031168 | Time: 2333.19 ms
[2022-02-13 17:17:12	                main:574]	:	INFO	:	Epoch 533 | loss: 0.0311487 | val_loss: 0.031167 | Time: 2183.64 ms
[2022-02-13 17:17:14	                main:574]	:	INFO	:	Epoch 534 | loss: 0.0311461 | val_loss: 0.0311706 | Time: 2218.93 ms
[2022-02-13 17:17:17	                main:574]	:	INFO	:	Epoch 535 | loss: 0.0311465 | val_loss: 0.0311701 | Time: 2333.37 ms
[2022-02-13 17:17:19	                main:574]	:	INFO	:	Epoch 536 | loss: 0.0311446 | val_loss: 0.0311668 | Time: 2265.45 ms
[2022-02-13 17:17:21	                main:574]	:	INFO	:	Epoch 537 | loss: 0.0311453 | val_loss: 0.0311698 | Time: 2262.36 ms
[2022-02-13 17:17:24	                main:574]	:	INFO	:	Epoch 538 | loss: 0.0311465 | val_loss: 0.0311678 | Time: 2218.05 ms
[2022-02-13 17:17:26	                main:574]	:	INFO	:	Epoch 539 | loss: 0.031146 | val_loss: 0.0311694 | Time: 2315.48 ms
[2022-02-13 17:17:28	                main:574]	:	INFO	:	Epoch 540 | loss: 0.0311482 | val_loss: 0.0311669 | Time: 2223.72 ms
[2022-02-13 17:17:31	                main:574]	:	INFO	:	Epoch 541 | loss: 0.0311456 | val_loss: 0.0311671 | Time: 2289.64 ms
[2022-02-13 17:17:33	                main:574]	:	INFO	:	Epoch 542 | loss: 0.0311437 | val_loss: 0.0311751 | Time: 2271.21 ms
[2022-02-13 17:17:35	                main:574]	:	INFO	:	Epoch 543 | loss: 0.0311477 | val_loss: 0.0311688 | Time: 2238.61 ms
[2022-02-13 17:17:38	                main:574]	:	INFO	:	Epoch 544 | loss: 0.031146 | val_loss: 0.0311712 | Time: 2273.06 ms
[2022-02-13 17:17:40	                main:574]	:	INFO	:	Epoch 545 | loss: 0.0311448 | val_loss: 0.0311705 | Time: 2277.88 ms
[2022-02-13 17:17:42	                main:574]	:	INFO	:	Epoch 546 | loss: 0.031145 | val_loss: 0.0311684 | Time: 2362.5 ms
[2022-02-13 17:17:45	                main:574]	:	INFO	:	Epoch 547 | loss: 0.031146 | val_loss: 0.0311672 | Time: 2511.38 ms
[2022-02-13 17:17:47	                main:574]	:	INFO	:	Epoch 548 | loss: 0.0311465 | val_loss: 0.0311715 | Time: 2206.85 ms
[2022-02-13 17:17:49	                main:574]	:	INFO	:	Epoch 549 | loss: 0.0311507 | val_loss: 0.0311685 | Time: 2273.59 ms
[2022-02-13 17:17:52	                main:574]	:	INFO	:	Epoch 550 | loss: 0.0311482 | val_loss: 0.0311684 | Time: 2244.81 ms
[2022-02-13 17:17:54	                main:574]	:	INFO	:	Epoch 551 | loss: 0.0311517 | val_loss: 0.0311666 | Time: 2289.13 ms
[2022-02-13 17:17:56	                main:574]	:	INFO	:	Epoch 552 | loss: 0.0311524 | val_loss: 0.0311755 | Time: 2261.64 ms
[2022-02-13 17:17:59	                main:574]	:	INFO	:	Epoch 553 | loss: 0.0311496 | val_loss: 0.0311725 | Time: 2352.88 ms
[2022-02-13 17:18:01	                main:574]	:	INFO	:	Epoch 554 | loss: 0.0311466 | val_loss: 0.0311697 | Time: 2316.16 ms
[2022-02-13 17:18:03	                main:574]	:	INFO	:	Epoch 555 | loss: 0.0311465 | val_loss: 0.0311717 | Time: 2208.46 ms
[2022-02-13 17:18:06	                main:574]	:	INFO	:	Epoch 556 | loss: 0.0311475 | val_loss: 0.0311728 | Time: 2250.76 ms
[2022-02-13 17:18:08	                main:574]	:	INFO	:	Epoch 557 | loss: 0.0311446 | val_loss: 0.0311735 | Time: 2289.61 ms
[2022-02-13 17:18:10	                main:574]	:	INFO	:	Epoch 558 | loss: 0.0311442 | val_loss: 0.0311754 | Time: 2272.48 ms
[2022-02-13 17:18:13	                main:574]	:	INFO	:	Epoch 559 | loss: 0.0311455 | val_loss: 0.0311717 | Time: 2320.59 ms
[2022-02-13 17:18:15	                main:574]	:	INFO	:	Epoch 560 | loss: 0.0311451 | val_loss: 0.031177 | Time: 2179.24 ms
[2022-02-13 17:18:17	                main:574]	:	INFO	:	Epoch 561 | loss: 0.0311519 | val_loss: 0.0311691 | Time: 2376.5 ms
[2022-02-13 17:18:20	                main:574]	:	INFO	:	Epoch 562 | loss: 0.0311479 | val_loss: 0.0311691 | Time: 2192.54 ms
[2022-02-13 17:18:22	                main:574]	:	INFO	:	Epoch 563 | loss: 0.0311456 | val_loss: 0.0311682 | Time: 2191.6 ms
[2022-02-13 17:18:24	                main:574]	:	INFO	:	Epoch 564 | loss: 0.0311464 | val_loss: 0.0311717 | Time: 2475.4 ms
[2022-02-13 17:18:27	                main:574]	:	INFO	:	Epoch 565 | loss: 0.0311439 | val_loss: 0.0311687 | Time: 2252.6 ms
[2022-02-13 17:18:29	                main:574]	:	INFO	:	Epoch 566 | loss: 0.0311434 | val_loss: 0.0311667 | Time: 2379.54 ms
[2022-02-13 17:18:31	                main:574]	:	INFO	:	Epoch 567 | loss: 0.0311447 | val_loss: 0.0311692 | Time: 2284.61 ms
[2022-02-13 17:18:34	                main:574]	:	INFO	:	Epoch 568 | loss: 0.0311455 | val_loss: 0.0311693 | Time: 2166.77 ms
[2022-02-13 17:18:36	                main:574]	:	INFO	:	Epoch 569 | loss: 0.0311451 | val_loss: 0.0311706 | Time: 2162.69 ms
[2022-02-13 17:18:38	                main:574]	:	INFO	:	Epoch 570 | loss: 0.0311454 | val_loss: 0.0311709 | Time: 2189.22 ms
[2022-02-13 17:18:41	                main:574]	:	INFO	:	Epoch 571 | loss: 0.0311448 | val_loss: 0.0311734 | Time: 2833.3 ms
[2022-02-13 17:18:43	                main:574]	:	INFO	:	Epoch 572 | loss: 0.0311464 | val_loss: 0.0311711 | Time: 2269.02 ms
[2022-02-13 17:18:46	                main:574]	:	INFO	:	Epoch 573 | loss: 0.0311457 | val_loss: 0.0311719 | Time: 2350.14 ms
[2022-02-13 17:18:48	                main:574]	:	INFO	:	Epoch 574 | loss: 0.0311442 | val_loss: 0.0311693 | Time: 2264.96 ms
[2022-02-13 17:18:50	                main:574]	:	INFO	:	Epoch 575 | loss: 0.0311428 | val_loss: 0.0311693 | Time: 2312.29 ms
[2022-02-13 17:18:53	                main:574]	:	INFO	:	Epoch 576 | loss: 0.0311443 | val_loss: 0.0311698 | Time: 2312.9 ms
[2022-02-13 17:18:55	                main:574]	:	INFO	:	Epoch 577 | loss: 0.031144 | val_loss: 0.0311659 | Time: 2235.8 ms
[2022-02-13 17:18:57	                main:574]	:	INFO	:	Epoch 578 | loss: 0.0311452 | val_loss: 0.0311632 | Time: 2156.24 ms
[2022-02-13 17:18:59	                main:574]	:	INFO	:	Epoch 579 | loss: 0.0311459 | val_loss: 0.031166 | Time: 2242.8 ms
[2022-02-13 17:19:02	                main:574]	:	INFO	:	Epoch 580 | loss: 0.0311431 | val_loss: 0.0311709 | Time: 2379.24 ms
[2022-02-13 17:19:04	                main:574]	:	INFO	:	Epoch 581 | loss: 0.0311421 | val_loss: 0.0311671 | Time: 2318.85 ms
[2022-02-13 17:19:06	                main:574]	:	INFO	:	Epoch 582 | loss: 0.0311424 | val_loss: 0.0311692 | Time: 2248.11 ms
[2022-02-13 17:19:09	                main:574]	:	INFO	:	Epoch 583 | loss: 0.0311424 | val_loss: 0.0311706 | Time: 2229.56 ms
[2022-02-13 17:19:11	                main:574]	:	INFO	:	Epoch 584 | loss: 0.0311442 | val_loss: 0.0311692 | Time: 2272.19 ms
[2022-02-13 17:19:13	                main:574]	:	INFO	:	Epoch 585 | loss: 0.0311448 | val_loss: 0.0311684 | Time: 2245.03 ms
[2022-02-13 17:19:16	                main:574]	:	INFO	:	Epoch 586 | loss: 0.0311478 | val_loss: 0.0311702 | Time: 2265.38 ms
[2022-02-13 17:19:18	                main:574]	:	INFO	:	Epoch 587 | loss: 0.0311504 | val_loss: 0.0311702 | Time: 2229.91 ms
[2022-02-13 17:19:21	                main:574]	:	INFO	:	Epoch 588 | loss: 0.0311499 | val_loss: 0.0311698 | Time: 2557.16 ms


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x00007FF9F2CEE7F5 read attempt to address 0xFFFFFFFF

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 02/13/22 17:19:22
Install Directory : H:\Program Files\BOINC\
Data Directory    : H:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( H:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( H:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( H:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( H:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: H:\ProgramData\BOINC\slots\122;H:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 000000006fa30000 00000000003df000 H:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000342c0000 00000000001f0000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.18362.815) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000032670000 00000000000b2000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.18362.959 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.959

ModLoad: 0000000031d60000 00000000002a4000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.18362.959 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.959

ModLoad: 00000000324b0000 0000000000194000 C:\WINDOWS\System32\USER32.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000032070000 0000000000021000 C:\WINDOWS\System32\win32u.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.18362.959 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.959

ModLoad: 0000000032840000 0000000000026000 C:\WINDOWS\System32\GDI32.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000320a0000 0000000000196000 C:\WINDOWS\System32\gdi32full.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.18362.959 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.959

ModLoad: 0000000031b70000 000000000009e000 C:\WINDOWS\System32\msvcp_win.dll (6.2.18362.815) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.18362.815 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.815

ModLoad: 00000000319f0000 00000000000fa000 C:\WINDOWS\System32\ucrtbase.dll (6.2.18362.815) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.18362.815 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.815

ModLoad: 0000000033b20000 00000000000a3000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.18362.752) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000032740000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.18362.1

ModLoad: 0000000033be0000 0000000000097000 C:\WINDOWS\System32\sechost.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000032aa0000 0000000000120000 C:\WINDOWS\System32\RPCRT4.dll (6.2.18362.628) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 00000000f8c40000 0000000000058000 H:\ProgramData\BOINC\slots\122\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000f0f90000 0000000000091000 H:\ProgramData\BOINC\slots\122\MSVCP140.dll (14.27.29112.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.27.29112.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.27.29112.0

ModLoad: 000000001e700000 00000000001f4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 000000000c470000 0000000000019000 H:\ProgramData\BOINC\slots\122\VCRUNTIME140.dll (14.27.29112.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.27.29112.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.27.29112.0

ModLoad: 000000000b660000 000000000000c000 H:\ProgramData\BOINC\slots\122\VCRUNTIME140_1.dll (14.27.29112.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.27.29112.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.27.29112.0

ModLoad: 00000000d6a20000 000000000abe7000 H:\ProgramData\BOINC\slots\122\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000e91c0000 00000000002db000 H:\ProgramData\BOINC\slots\122\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000e8fb0000 000000000020d000 H:\ProgramData\BOINC\slots\122\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 00000000f51b0000 0000000000040000 H:\ProgramData\BOINC\slots\122\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000a4bd0000 0000000024b49000 H:\ProgramData\BOINC\slots\122\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000e4fe0000 00000000030a5000 H:\ProgramData\BOINC\slots\122\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 00000000e1b20000 00000000034b2000 H:\ProgramData\BOINC\slots\122\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 000000000aed0000 0000000000010000 H:\ProgramData\BOINC\slots\122\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 00000000f0f40000 0000000000045000 H:\ProgramData\BOINC\slots\122\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000089820000 000000001b3a4000 H:\ProgramData\BOINC\slots\122\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 0000000085ac0000 0000000003d5b000 H:\ProgramData\BOINC\slots\122\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 0000000083bf0000 0000000001eca000 H:\ProgramData\BOINC\slots\122\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 000000007aa50000 000000000919f000 H:\ProgramData\BOINC\slots\122\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 0000000032240000 0000000000080000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.18362.836) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.18362.836 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.836

ModLoad: 0000000033de0000 000000000002e000 C:\WINDOWS\System32\IMM32.DLL (6.2.18362.387) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.18362.387 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.387

ModLoad: 0000000031180000 0000000000011000 C:\WINDOWS\System32\kernel.appcore.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 000000002fe10000 0000000000020000 C:\WINDOWS\SYSTEM32\dxcore.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : DXCore.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000031b20000 000000000004a000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.18362.387) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.18362.387 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.387

ModLoad: 00000000334b0000 0000000000335000 C:\WINDOWS\System32\combase.dll (6.2.18362.900) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000033e10000 0000000000470000 C:\WINDOWS\System32\Setupapi.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000031af0000 0000000000026000 C:\WINDOWS\System32\bcrypt.dll (6.2.18362.267) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000030f10000 000000000002a000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.18362.387) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.18362.387 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.387

ModLoad: 0000000032010000 000000000005c000 C:\WINDOWS\System32\WINTRUST.dll (6.2.18362.387) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.18362.387 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.387

ModLoad: 00000000311a0000 0000000000012000 C:\WINDOWS\System32\MSASN1.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000031c10000 0000000000149000 C:\WINDOWS\System32\CRYPT32.dll (6.2.18362.592) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000032bc0000 00000000006e6000 C:\WINDOWS\System32\Shell32.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.18362.900 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.900

ModLoad: 00000000332b0000 00000000000a9000 C:\WINDOWS\System32\shcore.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000031260000 0000000000782000 C:\WINDOWS\System32\windows.storage.dll (6.2.18362.959) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 00000000311c0000 0000000000023000 C:\WINDOWS\System32\profapi.dll (6.2.18362.693) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : profapi.pdb
    File Version          : 10.0.18362.693 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.693

ModLoad: 00000000311f0000 000000000004a000 C:\WINDOWS\System32\powrprof.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : powrprof.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000031170000 0000000000010000 C:\WINDOWS\System32\UMPDC.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : UMPDC.pdb

ModLoad: 00000000327e0000 0000000000052000 C:\WINDOWS\System32\shlwapi.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000031240000 0000000000017000 C:\WINDOWS\System32\cryptsp.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptsp.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000017a30000 0000000000267000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.5730) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 27.21.14.5730
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.1.114 driver
    Product Version       : 27.21.14.5730

ModLoad: 000000002f150000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000f2b80000 000000000152c000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_5dcb5bbf5c3edcf2\nvcuda64.dll (27.21.14.5730) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 27.21.14.5730
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.1.114 driver
    Product Version       : 27.21.14.5730

ModLoad: 00000000338d0000 000000000006f000 C:\WINDOWS\System32\WS2_32.dll (6.2.18362.387) (-exported- Symbols Loaded)
    Linked PDB Filename   : ws2_32.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 000000002f120000 000000000002f000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000030ab0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 000000002f4a0000 0000000000099000 C:\WINDOWS\system32\uxtheme.dll (6.2.18362.449) (-exported- Symbols Loaded)
    Linked PDB Filename   : UxTheme.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 00000000295b0000 00000000006d6000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.5730) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 27.21.14.5730
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 27.21.14.5730

ModLoad: 0000000033c80000 0000000000157000 C:\WINDOWS\System32\OLE32.DLL (6.2.18362.693) (-exported- Symbols Loaded)
    Linked PDB Filename   : ole32.pdb
    File Version          : 10.0.18362.530 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.18362.530

ModLoad: 0000000006180000 0000000000009000 H:\ProgramData\BOINC\slots\122\caffe2_nvrtc.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000024840000 0000000000fca000 H:\ProgramData\BOINC\slots\122\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6.14.11.9000
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.89 NVRTC Library
    Product Version       : 6.14.11.9000



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 4211, Write: 2307, Other 8040

- I/O Transfers Counters -
Read: 8953858, Write: 258467, Other 72002

- Paged Pool Usage -
QuotaPagedPoolUsage: 3535464, QuotaPeakPagedPoolUsage: 3535464
QuotaNonPagedPoolUsage: 59288, QuotaPeakNonPagedPoolUsage: 59760

- Virtual Memory Usage -
VirtualSize: 356438016, PeakVirtualSize: 977223680

- Pagefile Usage -
PagefileUsage: 356438016, PeakPagefileUsage: 356438016

- Working Set Size -
WorkingSetSize: -2124488704, PeakWorkingSetSize: -2041114624, PageFaultCount: 864637

*** Dump of thread ID 3980 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 307187488.000000, User Time: 5734374912.000000, Wait Time: 354832576.000000

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x00007FF9F2CEE7F5 read attempt to address 0xFFFFFFFF

- Registers -
rax=0000000000000000 rbx=000000009607e520 rcx=000000006bef9340 rdx=000000009607e520 rsi=0000000043c9d1c0 rdi=000000006bef9340
r8=0000000000000080 r9=0000000000000001 r10=0000000000000018 r11=0000000000000094 r12=0000000000000001 r13=0000000000000001
r14=000000009607e520 r15=0000000000000003 rip=00000000f2cee7f5 rsp=000000006bef91d8 rbp=000000006bef9330
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00010246

- Callstack -
ChildEBP RetAddr  Args to Child
6bef91d0 f2bb8363 9607e520 6bef9340 6bef9238 43c9d1c0 nvcuda64!+0x0 
6bef9220 f2bb890c 43c9d1d0 43c9d1c0 9607e520 43c9d1d0 nvcuda64!+0x0 
6bef94b0 f2d81108 00008000 8a7b0730 00000000 8a5c4de7 nvcuda64!+0x0 
6bef9620 8a5c29b6 00000001 00000080 00000000 8a7b0730 nvcuda64!cuLaunchKernel+0x0 
6bef9730 8a5bfdf4 8a7b0730 423effd0 9607e520 6bef9950 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
6bef98b0 8a7a3951 8a7b0730 00000000 8a7b0730 00000000 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
6bef9a20 8a72e604 23815a90 3f68c090 39a81800 000000c0 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
6bef9c50 8a73f99d 00000000 8ba31500 00000000 8a7b0730 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
6bef9cb0 8a70703b 00000000 00000000 23815a90 6bef9dc0 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
6befa140 8a6243bc 00000000 6befa22c 00000000 cd403020 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
6befa410 8a62700e 6befa720 8a5cbc3c 6befa468 8a5c4ce0 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
6befa500 8a5282ca cd403020 00000000 00000000 0000000c cudnn64_7!cudnnSetDropoutDescriptor+0x0 
6befa5d0 8a5262b3 00000000 0000000c 6befa810 00000002 cudnn64_7!cudnnSetAttnDescriptor+0x0 
6befa720 8a529536 00000024 a21a80c0 c8a07ad0 00000000 cudnn64_7!cudnnSetAttnDescriptor+0x0 
6befa830 8a555f37 39a81800 cc0b0540 00000000 00000000 cudnn64_7!cudnnSetAttnDescriptor+0x0 
6befae70 8a54eafa 00000004 cc0b0540 00000004 00000000 cudnn64_7!cudnnRNNForwardTrainingEx+0x0 
6befb030 8a569738 cc0b0540 00000400 d07c3a00 a21a80c0 cudnn64_7!cudnnRNNForwardTrainingEx+0x0 
6befd240 a794af5a 6befe830 39a80000 6befe830 a21a80c0 cudnn64_7!cudnnRNNBackwardData+0x0 
6befd7d0 a7949c90 00000010 00000000 6befe160 6befe148 torch_cuda!at::native::_cudnn_rnn_backward+0x0 
6befd9c0 a79a2808 6befdbb0 6befe898 6befdaa0 00000004 torch_cuda!at::native::_cudnn_rnn_backward+0x0 
6befdad0 a79b103d 6befe160 6befe140 6befe878 00000000 torch_cuda!at::native::set_storage_cuda_+0x0 
6befdbe0 dc46c201 6befe160 dbfeea63 b8917140 6befe2a8 torch_cuda!at::native::set_storage_cuda_+0x0 
6befdd70 dc4bbfea 6befe830 00000000 00000007 df50f880 torch_cpu!at::native::mkldnn_sigmoid_+0x0 
6befdea0 dc4a34da e1344668 6befe0e0 6befe898 6befdf80 torch_cpu!at::bucketize_out+0x0 
6befdf90 dd79e0a9 6befe0e0 6befe830 6befe0d0 00000000 torch_cpu!at::_cudnn_rnn_backward+0x0 
6befe270 dd7aa94d b8917a40 ddc1794a 00000020 00000004 torch_cpu!torch::autograd::GraphRoot::apply+0x0 
6befe380 dc46c201 6befe888 b8916840 6befe510 ddc13e3f torch_cpu!torch::autograd::GraphRoot::apply+0x0 
6befe510 dc4bbfea 6befe830 00000000 00000000 00000000 torch_cpu!at::native::mkldnn_sigmoid_+0x0 
6befe640 dc4a34da e1344668 6befe9b0 6befe898 6befe720 torch_cpu!at::bucketize_out+0x0 
6befe730 dd6a994d 6befe9b0 ac0e5130 6befe870 cd66cba8 torch_cpu!at::_cudnn_rnn_backward+0x0 
6befebd0 dd6956b1 c80ef190 6befeed8 00000000 f8c43bd6 torch_cpu!torch::autograd::generated::CudnnRnnBackward::apply+0x0 
6befede0 ddbfd1ea 6befeef0 c80ef190 6befeef0 c80ef190 torch_cpu!torch::autograd::Node::operator()+0x0 
6befefc0 ddbfdbdd 00000001 00000001 00000001 00000001 torch_cpu!torch::autograd::Engine::add_thread_pool_task+0x0 
6beff4a0 ddc02812 00000000 00000000 c80ef180 ffffffff torch_cpu!torch::autograd::Engine::evaluate_function+0x0 
6beff790 ddc02471 e1126d10 6beff7d0 e1126d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0 
6beff7e0 ddbf9744 00080001 cd77b5f0 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0 
6beff810 31a10e82 cd77b5f0 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0 
6beff840 32687bd4 00000000 00000000 00000000 00000000 ucrtbase!_beginthreadex+0x0 
6beff870 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
6beff8f0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 22088 (state: Waiting): ***

- Information -
Status: Wait Reason: Unknown, , Kernel Time: 781093760.000000, User Time: 7861250048.000000, Wait Time: 354832576.000000

- Registers -
rax=00000000000001ca rbx=0000000000000000 rcx=00000000b8e177a8 rdx=0000000000000000 rsi=0000000000000000 rdi=0000000000000000
r8=0000000000000001 r9=0000000029568710 r10=0000000000000000 r11=000000004316f080 r12=0000000000000003 r13=00000000000001c0
r14=00000000b8e17758 r15=0000000000000000 rip=000000003435f9a4 rsp=000000006b355668 rbp=00000000b8e177a8
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
6b355660 34320590 6b355880 f2d44249 00000000 438752a0 ntdll!ZwWaitForAlertByThreadId+0x0 
6b3556d0 31d858fd b8e17750 00000000 00000000 00008000 ntdll!RtlSleepConditionVariableSRW+0x0 
6b355710 f0fcba8d 6b355880 00000000 00008000 6b355330 KERNELBASE!SleepConditionVariableSRW+0x0 
6b355750 f0fa2848 00000000 6b355330 f0f42e0d f8c62433 MSVCP140!__crtSetThreadpoolWait+0x0 
6b355780 f0fa2710 6b355c30 f0fa2f17 00000000 dbff0231 MSVCP140!std::_Winerror_message+0x0 
6b3557f0 ddc0064b c80ef190 000001c0 b8e17750 b8e17750 MSVCP140!std::_Winerror_message+0x0 
6b355830 ddc025b1 41d6f2b0 c80ef180 c80ef180 00000000 torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0 
6b355b20 ddbff15d 6b355e00 6b355e00 6b355e00 41d6f2b0 torch_cpu!torch::autograd::Engine::thread_main+0x0 
6b355d90 ddbfeea0 b11c4cc0 e1126d10 fffffffe 00000000 torch_cpu!torch::autograd::Engine::execute_with_graph_task+0x0 
6b355ec0 ddbf56f9 b85d50e0 b85d50e0 6b355eb0 6b355fb8 torch_cpu!torch::autograd::Engine::execute+0x0 
6b3563e0 ddbf5086 260b21b8 dc5c5dc2 00000000 6b3564b0 torch_cpu!torch::autograd::Engine::make_anomaly_metadata+0x0 
6b356480 ddef09be b8915040 b85d50e8 00000000 6b356420 torch_cpu!torch::autograd::backward+0x0 
6b356560 dd921cd0 43751e70 00000000 00000000 00000000 torch_cpu!torch::autograd::VariableType::allCUDATypes+0x0 
6b356590 dc5c0a06 00000000 00000000 00010001 00000001 torch_cpu!torch::autograd::GraphRoot::apply+0x0 
6b3567c0 6fa47166 6b356890 6b3568d0 6b356890 6b356e30 torch_cpu!at::Tensor::backward+0x0 
6b356cc0 6fa4b950 6b356dc0 6b356dc0 00000000 0e35a930 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0 
6b36fa60 6fc8c6f8 437d4a40 00000000 00000000 433d75c0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
6b36faa0 32687bd4 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
6b36fad0 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
6b36fb50 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 3792 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 354832544.000000

- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=000000006baff940 rsi=0000000000000000 rdi=0000000000000064
r8=00000000ffffffff r9=000000006fce86e0 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000003435c6f4 rsp=000000006baff918 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
6baff910 31da6891 6baff9d8 00000000 00000000 00000000 ntdll!ZwDelayExecution+0x0 
6baff9b0 6fa6a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0 
6baff9e0 32687bd4 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
6baffa10 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
6baffa90 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 28472 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 354832544.000000

- Registers -
rax=000000000000005b rbx=000000000000000b rcx=000000000000000b rdx=000000006bbff860 rsi=0000000000000000 rdi=000000000000000b
r8=00000000515a1ef0 r9=0000000043a16000 r10=0000000000000000 r11=000000006bbff7d0 r12=0000000000000064 r13=000000006bbff860
r14=000000006bbff550 r15=0000000000000000 rip=000000003435cbc4 rsp=000000006bbff4f8 rbp=0000000043a16080
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
6bbff4f0 31db8037 33ca3880 343337d4 00000000 6b4c4000 ntdll!NtWaitForMultipleObjects+0x0 
6bbff7f0 31db7f1e f3074b48 41d73300 0000000b 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
6bbff830 f2d2bb54 43a19080 00000000 43a14160 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
6bbffa70 f2dc09ed 00000000 00000004 00000000 00000000 nvcuda64!+0x0 
6bbffb20 f2d2b523 bc9ee87f 374f5817 43f05b50 00000000 nvcuda64!cuProfilerStop+0x0 
6bbffb50 f303a750 43f05b50 00000000 00000000 00000000 nvcuda64!+0x0 
6bbffb80 32687bd4 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
6bbffbb0 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
6bbffc30 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 18404 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 354735808.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000000a0 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000000a0
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=00000000439f8170 r13=0000000000000000
r14=00000000000000a0 r15=0000000000000000 rip=000000003435c0f4 rsp=000000006bcff5d8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
6bcff5d0 31d98b03 00000000 00000000 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0 
6bcff670 f2f3bf48 00000000 31d84975 00000000 000000a0 KERNELBASE!WaitForSingleObjectEx+0x0 
6bcff6e0 f2d2b523 00000001 443f61f0 43f05c70 00000000 nvcuda64!cuProfilerStop+0x0 
6bcff710 f303a750 43f05c70 00000000 00000000 00000000 nvcuda64!+0x0 
6bcff740 32687bd4 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
6bcff770 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
6bcff7f0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 10348 (state: Waiting): ***

- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 354832544.000000

- Registers -
rax=00000000000001ca rbx=0000000000000000 rcx=0000000043c9b258 rdx=000000006bdffe78 rsi=000000006bdffde0 rdi=0000000000000000
r8=000000006bdffdb8 r9=000000006bdffe10 r10=0000000000000000 r11=0000000000000246 r12=000000006bdffe78 r13=0000000000000000
r14=0000000043c9b258 r15=0000000043c9f9d8 rip=000000003435f9a4 rsp=000000006bdffdb8 rbp=000000006bdffe10
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
6bdffdb0 34320815 00000102 00000102 00000000 6bdffde0 ntdll!ZwWaitForAlertByThreadId+0x0 
6bdffe20 31ddc2b9 43c9d1c0 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0 
6bdffe50 f2cb223a 43c9d1c0 43c9d1c0 43c9d1c0 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0 
6bdffeb0 f2d2b523 00000004 bc634ccf bc634cd0 00000000 nvcuda64!+0x0 
6bdffee0 f303a750 43f05f40 00000000 00000000 00000000 nvcuda64!+0x0 
6bdfff10 32687bd4 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
6bdfff40 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
6bdfffc0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)