Task 11533453
| Name | ParityModified-1639959862-5013-2-0_1 |
| Workunit | 8386370 |
| Created | 13 Feb 2022, 16:33:58 UTC |
| Sent | 13 Feb 2022, 16:54:01 UTC |
| Report deadline | 21 Feb 2022, 16:54:01 UTC |
| Received | 13 Feb 2022, 18:19:09 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | -1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION |
| Computer ID | 571 |
| Run time | 24 min 38 sec |
| CPU time | 23 min 54 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 5,441.63 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 2.10 GB |
| Peak swap size | 4.33 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.14.2</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code -1073741819 (0xc0000005)</message>
<stderr_txt>
ms
[2022-02-13 18:09:38 main:574] : INFO : Epoch 388 | loss: nan | val_loss: nan | Time: 2110.63 ms
[2022-02-13 18:09:40 main:574] : INFO : Epoch 389 | loss: nan | val_loss: nan | Time: 2174.54 ms
[2022-02-13 18:09:43 main:574] : INFO : Epoch 390 | loss: nan | val_loss: nan | Time: 2550.6 ms
[2022-02-13 18:09:45 main:574] : INFO : Epoch 391 | loss: nan | val_loss: nan | Time: 2421.12 ms
[2022-02-13 18:09:47 main:574] : INFO : Epoch 392 | loss: nan | val_loss: nan | Time: 2141.37 ms
[2022-02-13 18:09:50 main:574] : INFO : Epoch 393 | loss: nan | val_loss: nan | Time: 2167.19 ms
[2022-02-13 18:09:52 main:574] : INFO : Epoch 394 | loss: nan | val_loss: nan | Time: 2148.78 ms
[2022-02-13 18:09:54 main:574] : INFO : Epoch 395 | loss: nan | val_loss: nan | Time: 2131.65 ms
[2022-02-13 18:09:56 main:574] : INFO : Epoch 396 | loss: nan | val_loss: nan | Time: 2301.68 ms
[2022-02-13 18:09:59 main:574] : INFO : Epoch 397 | loss: nan | val_loss: nan | Time: 2255.38 ms
[2022-02-13 18:10:01 main:574] : INFO : Epoch 398 | loss: nan | val_loss: nan | Time: 2384.56 ms
[2022-02-13 18:10:03 main:574] : INFO : Epoch 399 | loss: nan | val_loss: nan | Time: 2227.84 ms
[2022-02-13 18:10:06 main:574] : INFO : Epoch 400 | loss: nan | val_loss: nan | Time: 2189.68 ms
[2022-02-13 18:10:08 main:574] : INFO : Epoch 401 | loss: nan | val_loss: nan | Time: 2430.4 ms
[2022-02-13 18:10:10 main:574] : INFO : Epoch 402 | loss: nan | val_loss: nan | Time: 2249.42 ms
[2022-02-13 18:10:13 main:574] : INFO : Epoch 403 | loss: nan | val_loss: nan | Time: 2401.31 ms
[2022-02-13 18:10:15 main:574] : INFO : Epoch 404 | loss: nan | val_loss: nan | Time: 2404.93 ms
[2022-02-13 18:10:17 main:574] : INFO : Epoch 405 | loss: nan | val_loss: nan | Time: 2129.29 ms
[2022-02-13 18:10:20 main:574] : INFO : Epoch 406 | loss: nan | val_loss: nan | Time: 2241.33 ms
[2022-02-13 18:10:22 main:574] : INFO : Epoch 407 | loss: nan | val_loss: nan | Time: 2172.5 ms
[2022-02-13 18:10:24 main:574] : INFO : Epoch 408 | loss: nan | val_loss: nan | Time: 2149.32 ms
[2022-02-13 18:10:26 main:574] : INFO : Epoch 409 | loss: nan | val_loss: nan | Time: 2418.93 ms
[2022-02-13 18:10:29 main:574] : INFO : Epoch 410 | loss: nan | val_loss: nan | Time: 2260.3 ms
[2022-02-13 18:10:31 main:574] : INFO : Epoch 411 | loss: nan | val_loss: nan | Time: 2259.61 ms
[2022-02-13 18:10:33 main:574] : INFO : Epoch 412 | loss: nan | val_loss: nan | Time: 2262 ms
[2022-02-13 18:10:36 main:574] : INFO : Epoch 413 | loss: nan | val_loss: nan | Time: 2211.69 ms
[2022-02-13 18:10:38 main:574] : INFO : Epoch 414 | loss: nan | val_loss: nan | Time: 2165.11 ms
[2022-02-13 18:10:40 main:574] : INFO : Epoch 415 | loss: nan | val_loss: nan | Time: 2159.27 ms
[2022-02-13 18:10:42 main:574] : INFO : Epoch 416 | loss: nan | val_loss: nan | Time: 2139.59 ms
[2022-02-13 18:10:44 main:574] : INFO : Epoch 417 | loss: nan | val_loss: nan | Time: 2123.98 ms
[2022-02-13 18:10:47 main:574] : INFO : Epoch 418 | loss: nan | val_loss: nan | Time: 2799.88 ms
[2022-02-13 18:10:49 main:574] : INFO : Epoch 419 | loss: nan | val_loss: nan | Time: 2172.52 ms
[2022-02-13 18:10:52 main:574] : INFO : Epoch 420 | loss: nan | val_loss: nan | Time: 2188.58 ms
[2022-02-13 18:10:54 main:574] : INFO : Epoch 421 | loss: nan | val_loss: nan | Time: 2192.09 ms
[2022-02-13 18:10:56 main:574] : INFO : Epoch 422 | loss: nan | val_loss: nan | Time: 2269.39 ms
[2022-02-13 18:10:58 main:574] : INFO : Epoch 423 | loss: nan | val_loss: nan | Time: 2273.93 ms
[2022-02-13 18:11:01 main:574] : INFO : Epoch 424 | loss: nan | val_loss: nan | Time: 2502.51 ms
[2022-02-13 18:11:03 main:574] : INFO : Epoch 425 | loss: nan | val_loss: nan | Time: 2234.02 ms
[2022-02-13 18:11:05 main:574] : INFO : Epoch 426 | loss: nan | val_loss: nan | Time: 2220 ms
[2022-02-13 18:11:08 main:574] : INFO : Epoch 427 | loss: nan | val_loss: nan | Time: 2132.78 ms
[2022-02-13 18:11:10 main:574] : INFO : Epoch 428 | loss: nan | val_loss: nan | Time: 2437.51 ms
[2022-02-13 18:11:12 main:574] : INFO : Epoch 429 | loss: nan | val_loss: nan | Time: 2125.71 ms
[2022-02-13 18:11:15 main:574] : INFO : Epoch 430 | loss: nan | val_loss: nan | Time: 2239.1 ms
[2022-02-13 18:11:17 main:574] : INFO : Epoch 431 | loss: nan | val_loss: nan | Time: 2193.8 ms
[2022-02-13 18:11:19 main:574] : INFO : Epoch 432 | loss: nan | val_loss: nan | Time: 2177.6 ms
[2022-02-13 18:11:22 main:574] : INFO : Epoch 433 | loss: nan | val_loss: nan | Time: 2416.87 ms
[2022-02-13 18:11:24 main:574] : INFO : Epoch 434 | loss: nan | val_loss: nan | Time: 2329.73 ms
[2022-02-13 18:11:26 main:574] : INFO : Epoch 435 | loss: nan | val_loss: nan | Time: 2291.79 ms
[2022-02-13 18:11:29 main:574] : INFO : Epoch 436 | loss: nan | val_loss: nan | Time: 2258.15 ms
[2022-02-13 18:11:31 main:574] : INFO : Epoch 437 | loss: nan | val_loss: nan | Time: 2267.96 ms
[2022-02-13 18:11:33 main:574] : INFO : Epoch 438 | loss: nan | val_loss: nan | Time: 2183.95 ms
[2022-02-13 18:11:35 main:574] : INFO : Epoch 439 | loss: nan | val_loss: nan | Time: 2340.07 ms
[2022-02-13 18:11:38 main:574] : INFO : Epoch 440 | loss: nan | val_loss: nan | Time: 2173.55 ms
[2022-02-13 18:11:40 main:574] : INFO : Epoch 441 | loss: nan | val_loss: nan | Time: 2188.93 ms
[2022-02-13 18:11:42 main:574] : INFO : Epoch 442 | loss: nan | val_loss: nan | Time: 2297.11 ms
[2022-02-13 18:11:44 main:574] : INFO : Epoch 443 | loss: nan | val_loss: nan | Time: 2234.4 ms
[2022-02-13 18:11:47 main:574] : INFO : Epoch 444 | loss: nan | val_loss: nan | Time: 2168.48 ms
[2022-02-13 18:11:49 main:574] : INFO : Epoch 445 | loss: nan | val_loss: nan | Time: 2221.49 ms
[2022-02-13 18:11:51 main:574] : INFO : Epoch 446 | loss: nan | val_loss: nan | Time: 2292.24 ms
[2022-02-13 18:11:54 main:574] : INFO : Epoch 447 | loss: nan | val_loss: nan | Time: 2339.93 ms
[2022-02-13 18:11:56 main:574] : INFO : Epoch 448 | loss: nan | val_loss: nan | Time: 2357.37 ms
[2022-02-13 18:11:58 main:574] : INFO : Epoch 449 | loss: nan | val_loss: nan | Time: 2137.43 ms
[2022-02-13 18:12:00 main:574] : INFO : Epoch 450 | loss: nan | val_loss: nan | Time: 2163.61 ms
[2022-02-13 18:12:03 main:574] : INFO : Epoch 451 | loss: nan | val_loss: nan | Time: 2989.14 ms
[2022-02-13 18:12:06 main:574] : INFO : Epoch 452 | loss: nan | val_loss: nan | Time: 2242.11 ms
[2022-02-13 18:12:08 main:574] : INFO : Epoch 453 | loss: nan | val_loss: nan | Time: 2237.89 ms
[2022-02-13 18:12:10 main:574] : INFO : Epoch 454 | loss: nan | val_loss: nan | Time: 2241.5 ms
[2022-02-13 18:12:12 main:574] : INFO : Epoch 455 | loss: nan | val_loss: nan | Time: 2227.63 ms
[2022-02-13 18:12:15 main:574] : INFO : Epoch 456 | loss: nan | val_loss: nan | Time: 2144.77 ms
[2022-02-13 18:12:17 main:574] : INFO : Epoch 457 | loss: nan | val_loss: nan | Time: 2339.13 ms
[2022-02-13 18:12:19 main:574] : INFO : Epoch 458 | loss: nan | val_loss: nan | Time: 2234.74 ms
[2022-02-13 18:12:22 main:574] : INFO : Epoch 459 | loss: nan | val_loss: nan | Time: 2278.09 ms
[2022-02-13 18:12:24 main:574] : INFO : Epoch 460 | loss: nan | val_loss: nan | Time: 2151.61 ms
[2022-02-13 18:12:26 main:574] : INFO : Epoch 461 | loss: nan | val_loss: nan | Time: 2133.5 ms
[2022-02-13 18:12:28 main:574] : INFO : Epoch 462 | loss: nan | val_loss: nan | Time: 2214.36 ms
[2022-02-13 18:12:30 main:574] : INFO : Epoch 463 | loss: nan | val_loss: nan | Time: 2094.53 ms
[2022-02-13 18:12:33 main:574] : INFO : Epoch 464 | loss: nan | val_loss: nan | Time: 2278.02 ms
[2022-02-13 18:12:35 main:574] : INFO : Epoch 465 | loss: nan | val_loss: nan | Time: 2492.9 ms
[2022-02-13 18:12:37 main:574] : INFO : Epoch 466 | loss: nan | val_loss: nan | Time: 2258.64 ms
[2022-02-13 18:12:40 main:574] : INFO : Epoch 467 | loss: nan | val_loss: nan | Time: 2238.68 ms
[2022-02-13 18:12:42 main:574] : INFO : Epoch 468 | loss: nan | val_loss: nan | Time: 2177.75 ms
[2022-02-13 18:12:44 main:574] : INFO : Epoch 469 | loss: nan | val_loss: nan | Time: 2241.39 ms
[2022-02-13 18:12:46 main:574] : INFO : Epoch 470 | loss: nan | val_loss: nan | Time: 2108.76 ms
[2022-02-13 18:12:49 main:574] : INFO : Epoch 471 | loss: nan | val_loss: nan | Time: 2290.27 ms
[2022-02-13 18:12:51 main:574] : INFO : Epoch 472 | loss: nan | val_loss: nan | Time: 2220.59 ms
[2022-02-13 18:12:53 main:574] : INFO : Epoch 473 | loss: nan | val_loss: nan | Time: 2162.19 ms
[2022-02-13 18:12:55 main:574] : INFO : Epoch 474 | loss: nan | val_loss: nan | Time: 2182.57 ms
[2022-02-13 18:12:57 main:574] : INFO : Epoch 475 | loss: nan | val_loss: nan | Time: 2156.03 ms
[2022-02-13 18:13:00 main:574] : INFO : Epoch 476 | loss: nan | val_loss: nan | Time: 2125.38 ms
[2022-02-13 18:13:02 main:574] : INFO : Epoch 477 | loss: nan | val_loss: nan | Time: 2709.72 ms
[2022-02-13 18:13:05 main:574] : INFO : Epoch 478 | loss: nan | val_loss: nan | Time: 2286.46 ms
[2022-02-13 18:13:07 main:574] : INFO : Epoch 479 | loss: nan | val_loss: nan | Time: 2259.11 ms
[2022-02-13 18:13:09 main:574] : INFO : Epoch 480 | loss: nan | val_loss: nan | Time: 2263.34 ms
[2022-02-13 18:13:12 main:574] : INFO : Epoch 481 | loss: nan | val_loss: nan | Time: 2397.37 ms
[2022-02-13 18:13:14 main:574] : INFO : Epoch 482 | loss: nan | val_loss: nan | Time: 2146.55 ms
[2022-02-13 18:13:16 main:574] : INFO : Epoch 483 | loss: nan | val_loss: nan | Time: 2225.02 ms
[2022-02-13 18:13:18 main:574] : INFO : Epoch 484 | loss: nan | val_loss: nan | Time: 2175.68 ms
[2022-02-13 18:13:21 main:574] : INFO : Epoch 485 | loss: nan | val_loss: nan | Time: 2187.07 ms
[2022-02-13 18:13:23 main:574] : INFO : Epoch 486 | loss: nan | val_loss: nan | Time: 2166.2 ms
[2022-02-13 18:13:25 main:574] : INFO : Epoch 487 | loss: nan | val_loss: nan | Time: 2166.58 ms
[2022-02-13 18:13:27 main:574] : INFO : Epoch 488 | loss: nan | val_loss: nan | Time: 2202.27 ms
[2022-02-13 18:13:29 main:574] : INFO : Epoch 489 | loss: nan | val_loss: nan | Time: 2215.74 ms
[2022-02-13 18:13:32 main:574] : INFO : Epoch 490 | loss: nan | val_loss: nan | Time: 2249.88 ms
[2022-02-13 18:13:34 main:574] : INFO : Epoch 491 | loss: nan | val_loss: nan | Time: 2199.93 ms
[2022-02-13 18:13:36 main:574] : INFO : Epoch 492 | loss: nan | val_loss: nan | Time: 2203.19 ms
[2022-02-13 18:13:39 main:574] : INFO : Epoch 493 | loss: nan | val_loss: nan | Time: 2234.03 ms
[2022-02-13 18:13:41 main:574] : INFO : Epoch 494 | loss: nan | val_loss: nan | Time: 2449.02 ms
[2022-02-13 18:13:43 main:574] : INFO : Epoch 495 | loss: nan | val_loss: nan | Time: 2154.84 ms
[2022-02-13 18:13:45 main:574] : INFO : Epoch 496 | loss: nan | val_loss: nan | Time: 2122.21 ms
[2022-02-13 18:13:48 main:574] : INFO : Epoch 497 | loss: nan | val_loss: nan | Time: 2312.31 ms
[2022-02-13 18:13:50 main:574] : INFO : Epoch 498 | loss: nan | val_loss: nan | Time: 2214.35 ms
[2022-02-13 18:13:52 main:574] : INFO : Epoch 499 | loss: nan | val_loss: nan | Time: 2134.03 ms
[2022-02-13 18:13:54 main:574] : INFO : Epoch 500 | loss: nan | val_loss: nan | Time: 2124.78 ms
[2022-02-13 18:13:56 main:574] : INFO : Epoch 501 | loss: nan | val_loss: nan | Time: 2218.68 ms
[2022-02-13 18:13:59 main:574] : INFO : Epoch 502 | loss: nan | val_loss: nan | Time: 2319.08 ms
[2022-02-13 18:14:01 main:574] : INFO : Epoch 503 | loss: nan | val_loss: nan | Time: 2273.17 ms
[2022-02-13 18:14:03 main:574] : INFO : Epoch 504 | loss: nan | val_loss: nan | Time: 2201.29 ms
[2022-02-13 18:14:06 main:574] : INFO : Epoch 505 | loss: nan | val_loss: nan | Time: 2229.75 ms
[2022-02-13 18:14:08 main:574] : INFO : Epoch 506 | loss: nan | val_loss: nan | Time: 2101.2 ms
[2022-02-13 18:14:10 main:574] : INFO : Epoch 507 | loss: nan | val_loss: nan | Time: 2440.43 ms
[2022-02-13 18:14:13 main:574] : INFO : Epoch 508 | loss: nan | val_loss: nan | Time: 2395.41 ms
[2022-02-13 18:14:15 main:574] : INFO : Epoch 509 | loss: nan | val_loss: nan | Time: 2432.84 ms
[2022-02-13 18:14:18 main:574] : INFO : Epoch 510 | loss: nan | val_loss: nan | Time: 2289.41 ms
[2022-02-13 18:14:20 main:574] : INFO : Epoch 511 | loss: nan | val_loss: nan | Time: 2595.67 ms
[2022-02-13 18:14:22 main:574] : INFO : Epoch 512 | loss: nan | val_loss: nan | Time: 2159.39 ms
[2022-02-13 18:14:25 main:574] : INFO : Epoch 513 | loss: nan | val_loss: nan | Time: 2161.25 ms
[2022-02-13 18:14:27 main:574] : INFO : Epoch 514 | loss: nan | val_loss: nan | Time: 2186.46 ms
[2022-02-13 18:14:30 main:574] : INFO : Epoch 515 | loss: nan | val_loss: nan | Time: 2793.97 ms
[2022-02-13 18:14:32 main:574] : INFO : Epoch 516 | loss: nan | val_loss: nan | Time: 2323.39 ms
[2022-02-13 18:14:34 main:574] : INFO : Epoch 517 | loss: nan | val_loss: nan | Time: 2206.13 ms
[2022-02-13 18:14:36 main:574] : INFO : Epoch 518 | loss: nan | val_loss: nan | Time: 2121.45 ms
[2022-02-13 18:14:39 main:574] : INFO : Epoch 519 | loss: nan | val_loss: nan | Time: 2156.66 ms
[2022-02-13 18:14:41 main:574] : INFO : Epoch 520 | loss: nan | val_loss: nan | Time: 2211.15 ms
[2022-02-13 18:14:43 main:574] : INFO : Epoch 521 | loss: nan | val_loss: nan | Time: 2420.8 ms
[2022-02-13 18:14:46 main:574] : INFO : Epoch 522 | loss: nan | val_loss: nan | Time: 2246.6 ms
[2022-02-13 18:14:48 main:574] : INFO : Epoch 523 | loss: nan | val_loss: nan | Time: 2263.9 ms
[2022-02-13 18:14:51 main:574] : INFO : Epoch 524 | loss: nan | val_loss: nan | Time: 2994.95 ms
[2022-02-13 18:14:53 main:574] : INFO : Epoch 525 | loss: nan | val_loss: nan | Time: 2368.26 ms
[2022-02-13 18:14:56 main:574] : INFO : Epoch 526 | loss: nan | val_loss: nan | Time: 2203.74 ms
[2022-02-13 18:14:58 main:574] : INFO : Epoch 527 | loss: nan | val_loss: nan | Time: 2291.59 ms
[2022-02-13 18:15:00 main:574] : INFO : Epoch 528 | loss: nan | val_loss: nan | Time: 2151.83 ms
[2022-02-13 18:15:02 main:574] : INFO : Epoch 529 | loss: nan | val_loss: nan | Time: 2234.58 ms
[2022-02-13 18:15:05 main:574] : INFO : Epoch 530 | loss: nan | val_loss: nan | Time: 2182.04 ms
[2022-02-13 18:15:07 main:574] : INFO : Epoch 531 | loss: nan | val_loss: nan | Time: 2141.03 ms
[2022-02-13 18:15:09 main:574] : INFO : Epoch 532 | loss: nan | val_loss: nan | Time: 2212.03 ms
[2022-02-13 18:15:11 main:574] : INFO : Epoch 533 | loss: nan | val_loss: nan | Time: 2218.64 ms
[2022-02-13 18:15:14 main:574] : INFO : Epoch 534 | loss: nan | val_loss: nan | Time: 2223.83 ms
[2022-02-13 18:15:16 main:574] : INFO : Epoch 535 | loss: nan | val_loss: nan | Time: 2221.4 ms
[2022-02-13 18:15:18 main:574] : INFO : Epoch 536 | loss: nan | val_loss: nan | Time: 2134.38 ms
[2022-02-13 18:15:20 main:574] : INFO : Epoch 537 | loss: nan | val_loss: nan | Time: 2115.15 ms
[2022-02-13 18:15:22 main:574] : INFO : Epoch 538 | loss: nan | val_loss: nan | Time: 2173.74 ms
[2022-02-13 18:15:25 main:574] : INFO : Epoch 539 | loss: nan | val_loss: nan | Time: 2543.43 ms
[2022-02-13 18:15:27 main:574] : INFO : Epoch 540 | loss: nan | val_loss: nan | Time: 2149.11 ms
[2022-02-13 18:15:29 main:574] : INFO : Epoch 541 | loss: nan | val_loss: nan | Time: 2266.41 ms
[2022-02-13 18:15:31 main:574] : INFO : Epoch 542 | loss: nan | val_loss: nan | Time: 2131.33 ms
[2022-02-13 18:15:34 main:574] : INFO : Epoch 543 | loss: nan | val_loss: nan | Time: 2192.62 ms
[2022-02-13 18:15:36 main:574] : INFO : Epoch 544 | loss: nan | val_loss: nan | Time: 2250.92 ms
[2022-02-13 18:15:38 main:574] : INFO : Epoch 545 | loss: nan | val_loss: nan | Time: 2247.77 ms
[2022-02-13 18:15:41 main:574] : INFO : Epoch 546 | loss: nan | val_loss: nan | Time: 2247.38 ms
[2022-02-13 18:15:43 main:574] : INFO : Epoch 547 | loss: nan | val_loss: nan | Time: 2357.07 ms
[2022-02-13 18:15:45 main:574] : INFO : Epoch 548 | loss: nan | val_loss: nan | Time: 2215.46 ms
[2022-02-13 18:15:48 main:574] : INFO : Epoch 549 | loss: nan | val_loss: nan | Time: 2328.42 ms
[2022-02-13 18:15:50 main:574] : INFO : Epoch 550 | loss: nan | val_loss: nan | Time: 2171.32 ms
[2022-02-13 18:15:52 main:574] : INFO : Epoch 551 | loss: nan | val_loss: nan | Time: 2318.89 ms
[2022-02-13 18:15:54 main:574] : INFO : Epoch 552 | loss: nan | val_loss: nan | Time: 2139.97 ms
[2022-02-13 18:15:56 main:574] : INFO : Epoch 553 | loss: nan | val_loss: nan | Time: 2134.31 ms
[2022-02-13 18:15:59 main:574] : INFO : Epoch 554 | loss: nan | val_loss: nan | Time: 2100.37 ms
[2022-02-13 18:16:01 main:574] : INFO : Epoch 555 | loss: nan | val_loss: nan | Time: 2284.98 ms
[2022-02-13 18:16:03 main:574] : INFO : Epoch 556 | loss: nan | val_loss: nan | Time: 2232.07 ms
[2022-02-13 18:16:05 main:574] : INFO : Epoch 557 | loss: nan | val_loss: nan | Time: 2216.4 ms
[2022-02-13 18:16:08 main:574] : INFO : Epoch 558 | loss: nan | val_loss: nan | Time: 2498.12 ms
[2022-02-13 18:16:10 main:574] : INFO : Epoch 559 | loss: nan | val_loss: nan | Time: 2426.62 ms
[2022-02-13 18:16:13 main:574] : INFO : Epoch 560 | loss: nan | val_loss: nan | Time: 2133.5 ms
[2022-02-13 18:16:15 main:574] : INFO : Epoch 561 | loss: nan | val_loss: nan | Time: 2132.86 ms
[2022-02-13 18:16:17 main:574] : INFO : Epoch 562 | loss: nan | val_loss: nan | Time: 2369.45 ms
[2022-02-13 18:16:20 main:574] : INFO : Epoch 563 | loss: nan | val_loss: nan | Time: 2311.58 ms
[2022-02-13 18:16:22 main:574] : INFO : Epoch 564 | loss: nan | val_loss: nan | Time: 2287.97 ms
[2022-02-13 18:16:24 main:574] : INFO : Epoch 565 | loss: nan | val_loss: nan | Time: 2134.8 ms
[2022-02-13 18:16:26 main:574] : INFO : Epoch 566 | loss: nan | val_loss: nan | Time: 2268.28 ms
[2022-02-13 18:16:29 main:574] : INFO : Epoch 567 | loss: nan | val_loss: nan | Time: 2344.65 ms
[2022-02-13 18:16:31 main:574] : INFO : Epoch 568 | loss: nan | val_loss: nan | Time: 2253.44 ms
[2022-02-13 18:16:33 main:574] : INFO : Epoch 569 | loss: nan | val_loss: nan | Time: 2253.47 ms
[2022-02-13 18:16:36 main:574] : INFO : Epoch 570 | loss: nan | val_loss: nan | Time: 2928.88 ms
[2022-02-13 18:16:38 main:574] : INFO : Epoch 571 | loss: nan | val_loss: nan | Time: 2217.43 ms
[2022-02-13 18:16:41 main:574] : INFO : Epoch 572 | loss: nan | val_loss: nan | Time: 2154.82 ms
[2022-02-13 18:16:43 main:574] : INFO : Epoch 573 | loss: nan | val_loss: nan | Time: 2203.67 ms
[2022-02-13 18:16:45 main:574] : INFO : Epoch 574 | loss: nan | val_loss: nan | Time: 2133.73 ms
[2022-02-13 18:16:47 main:574] : INFO : Epoch 575 | loss: nan | val_loss: nan | Time: 2113.08 ms
[2022-02-13 18:16:49 main:574] : INFO : Epoch 576 | loss: nan | val_loss: nan | Time: 2249.18 ms
[2022-02-13 18:16:52 main:574] : INFO : Epoch 577 | loss: nan | val_loss: nan | Time: 2196.93 ms
[2022-02-13 18:16:54 main:574] : INFO : Epoch 578 | loss: nan | val_loss: nan | Time: 2115.56 ms
[2022-02-13 18:16:56 main:574] : INFO : Epoch 579 | loss: nan | val_loss: nan | Time: 2134.87 ms
[2022-02-13 18:16:59 main:574] : INFO : Epoch 580 | loss: nan | val_loss: nan | Time: 2503.93 ms
[2022-02-13 18:17:01 main:574] : INFO : Epoch 581 | loss: nan | val_loss: nan | Time: 2358.12 ms
[2022-02-13 18:17:03 main:574] : INFO : Epoch 582 | loss: nan | val_loss: nan | Time: 2240.16 ms
[2022-02-13 18:17:05 main:574] : INFO : Epoch 583 | loss: nan | val_loss: nan | Time: 2168.89 ms
[2022-02-13 18:17:08 main:574] : INFO : Epoch 584 | loss: nan | val_loss: nan | Time: 2154.2 ms
[2022-02-13 18:17:10 main:574] : INFO : Epoch 585 | loss: nan | val_loss: nan | Time: 2187.66 ms
[2022-02-13 18:17:12 main:574] : INFO : Epoch 586 | loss: nan | val_loss: nan | Time: 2133.7 ms
[2022-02-13 18:17:14 main:574] : INFO : Epoch 587 | loss: nan | val_loss: nan | Time: 2147.11 ms
[2022-02-13 18:17:16 main:574] : INFO : Epoch 588 | loss: nan | val_loss: nan | Time: 2241.91 ms
[2022-02-13 18:17:19 main:574] : INFO : Epoch 589 | loss: nan | val_loss: nan | Time: 2241.94 ms
[2022-02-13 18:17:21 main:574] : INFO : Epoch 590 | loss: nan | val_loss: nan | Time: 2138.09 ms
[2022-02-13 18:17:23 main:574] : INFO : Epoch 591 | loss: nan | val_loss: nan | Time: 2107.88 ms
[2022-02-13 18:17:25 main:574] : INFO : Epoch 592 | loss: nan | val_loss: nan | Time: 2315.43 ms
[2022-02-13 18:17:28 main:574] : INFO : Epoch 593 | loss: nan | val_loss: nan | Time: 2282.78 ms
[2022-02-13 18:17:30 main:574] : INFO : Epoch 594 | loss: nan | val_loss: nan | Time: 2232.34 ms
[2022-02-13 18:17:32 main:574] : INFO : Epoch 595 | loss: nan | val_loss: nan | Time: 2123.63 ms
[2022-02-13 18:17:34 main:574] : INFO : Epoch 596 | loss: nan | val_loss: nan | Time: 2167.4 ms
[2022-02-13 18:17:37 main:574] : INFO : Epoch 597 | loss: nan | val_loss: nan | Time: 2138.27 ms
[2022-02-13 18:17:39 main:574] : INFO : Epoch 598 | loss: nan | val_loss: nan | Time: 2153.08 ms
[2022-02-13 18:17:41 main:574] : INFO : Epoch 599 | loss: nan | val_loss: nan | Time: 2394.44 ms
[2022-02-13 18:17:44 main:574] : INFO : Epoch 600 | loss: nan | val_loss: nan | Time: 2306.4 ms
[2022-02-13 18:17:46 main:574] : INFO : Epoch 601 | loss: nan | val_loss: nan | Time: 2253.15 ms
[2022-02-13 18:17:48 main:574] : INFO : Epoch 602 | loss: nan | val_loss: nan | Time: 2209.13 ms
[2022-02-13 18:17:50 main:574] : INFO : Epoch 603 | loss: nan | val_loss: nan | Time: 2137.23 ms
[2022-02-13 18:17:52 main:574] : INFO : Epoch 604 | loss: nan | val_loss: nan | Time: 2212.4 ms
[2022-02-13 18:17:55 main:574] : INFO : Epoch 605 | loss: nan | val_loss: nan | Time: 2238.67 ms
[2022-02-13 18:17:57 main:574] : INFO : Epoch 606 | loss: nan | val_loss: nan | Time: 2254.78 ms
[2022-02-13 18:17:59 main:574] : INFO : Epoch 607 | loss: nan | val_loss: nan | Time: 2130.16 ms
[2022-02-13 18:18:01 main:574] : INFO : Epoch 608 | loss: nan | val_loss: nan | Time: 2177.47 ms
[2022-02-13 18:18:04 main:574] : INFO : Epoch 609 | loss: nan | val_loss: nan | Time: 2152.18 ms
[2022-02-13 18:18:06 main:574] : INFO : Epoch 610 | loss: nan | val_loss: nan | Time: 2541.27 ms
[2022-02-13 18:18:08 main:574] : INFO : Epoch 611 | loss: nan | val_loss: nan | Time: 2259.04 ms
[2022-02-13 18:18:11 main:574] : INFO : Epoch 612 | loss: nan | val_loss: nan | Time: 2301.72 ms
[2022-02-13 18:18:13 main:574] : INFO : Epoch 613 | loss: nan | val_loss: nan | Time: 2236.76 ms
[2022-02-13 18:18:15 main:574] : INFO : Epoch 614 | loss: nan | val_loss: nan | Time: 2358.17 ms
[2022-02-13 18:18:18 main:574] : INFO : Epoch 615 | loss: nan | val_loss: nan | Time: 2276.05 ms
[2022-02-13 18:18:20 main:574] : INFO : Epoch 616 | loss: nan | val_loss: nan | Time: 2156.92 ms
[2022-02-13 18:18:22 main:574] : INFO : Epoch 617 | loss: nan | val_loss: nan | Time: 2124.54 ms
[2022-02-13 18:18:24 main:574] : INFO : Epoch 618 | loss: nan | val_loss: nan | Time: 2199.89 ms
[2022-02-13 18:18:26 main:574] : INFO : Epoch 619 | loss: nan | val_loss: nan | Time: 2170.05 ms
[2022-02-13 18:18:29 main:574] : INFO : Epoch 620 | loss: nan | val_loss: nan | Time: 2183.6 ms
[2022-02-13 18:18:31 main:574] : INFO : Epoch 621 | loss: nan | val_loss: nan | Time: 2144.06 ms
[2022-02-13 18:18:33 main:574] : INFO : Epoch 622 | loss: nan | val_loss: nan | Time: 2238.79 ms
[2022-02-13 18:18:36 main:574] : INFO : Epoch 623 | loss: nan | val_loss: nan | Time: 2701.99 ms
[2022-02-13 18:18:38 main:574] : INFO : Epoch 624 | loss: nan | val_loss: nan | Time: 2476.33 ms
[2022-02-13 18:18:41 main:574] : INFO : Epoch 625 | loss: nan | val_loss: nan | Time: 2229.31 ms
[2022-02-13 18:18:43 main:574] : INFO : Epoch 626 | loss: nan | val_loss: nan | Time: 2294.17 ms
[2022-02-13 18:18:45 main:574] : INFO : Epoch 627 | loss: nan | val_loss: nan | Time: 2218.66 ms
[2022-02-13 18:18:48 main:574] : INFO : Epoch 628 | loss: nan | val_loss: nan | Time: 2899.89 ms
[2022-02-13 18:18:50 main:574] : INFO : Epoch 629 | loss: nan | val_loss: nan | Time: 2175.53 ms
[2022-02-13 18:18:53 main:574] : INFO : Epoch 630 | loss: nan | val_loss: nan | Time: 2240.7 ms
[2022-02-13 18:18:55 main:574] : INFO : Epoch 631 | loss: nan | val_loss: nan | Time: 2225.83 ms
[2022-02-13 18:18:57 main:574] : INFO : Epoch 632 | loss: nan | val_loss: nan | Time: 2481.85 ms
[2022-02-13 18:19:00 main:574] : INFO : Epoch 633 | loss: nan | val_loss: nan | Time: 2159.46 ms
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x00007FF9F2CEE7F5 read attempt to address 0xFFFFFFFF
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 02/13/22 18:19:02
Install Directory : H:\Program Files\BOINC\
Data Directory : H:\ProgramData\BOINC
Project Symstore :
LoadLibraryA( H:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( H:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( H:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( H:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: H:\ProgramData\BOINC\slots\122;H:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 000000006fa30000 00000000003df000 H:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000342c0000 00000000001f0000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.18362.815) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 0000000032670000 00000000000b2000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.18362.959) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.18362.959 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.959
ModLoad: 0000000031d60000 00000000002a4000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.18362.959) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.18362.959 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.959
ModLoad: 00000000324b0000 0000000000194000 C:\WINDOWS\System32\USER32.dll (6.2.18362.959) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 0000000032070000 0000000000021000 C:\WINDOWS\System32\win32u.dll (6.2.18362.959) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.18362.959 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.959
ModLoad: 0000000032840000 0000000000026000 C:\WINDOWS\System32\GDI32.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 00000000320a0000 0000000000196000 C:\WINDOWS\System32\gdi32full.dll (6.2.18362.959) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.18362.959 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.959
ModLoad: 0000000031b70000 000000000009e000 C:\WINDOWS\System32\msvcp_win.dll (6.2.18362.815) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.18362.815 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.815
ModLoad: 00000000319f0000 00000000000fa000 C:\WINDOWS\System32\ucrtbase.dll (6.2.18362.815) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.18362.815 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.815
ModLoad: 0000000033b20000 00000000000a3000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.18362.752) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 0000000032740000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.18362.1
ModLoad: 0000000033be0000 0000000000097000 C:\WINDOWS\System32\sechost.dll (6.2.18362.959) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 0000000032aa0000 0000000000120000 C:\WINDOWS\System32\RPCRT4.dll (6.2.18362.628) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 00000000f8c40000 0000000000058000 H:\ProgramData\BOINC\slots\122\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000f1dd0000 0000000000091000 H:\ProgramData\BOINC\slots\122\MSVCP140.dll (14.27.29112.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.27.29112.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.27.29112.0
ModLoad: 000000001e700000 00000000001f4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 000000000c440000 0000000000019000 H:\ProgramData\BOINC\slots\122\VCRUNTIME140.dll (14.27.29112.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.27.29112.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.27.29112.0
ModLoad: 000000000b660000 000000000000c000 H:\ProgramData\BOINC\slots\122\VCRUNTIME140_1.dll (14.27.29112.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.27.29112.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.27.29112.0
ModLoad: 00000000d6a20000 000000000abe7000 H:\ProgramData\BOINC\slots\122\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000ec2d0000 00000000002db000 H:\ProgramData\BOINC\slots\122\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000ec0c0000 000000000020d000 H:\ProgramData\BOINC\slots\122\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 00000000f7a80000 0000000000040000 H:\ProgramData\BOINC\slots\122\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000ae190000 0000000024b49000 H:\ProgramData\BOINC\slots\122\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000f51c0000 0000000000045000 H:\ProgramData\BOINC\slots\122\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000e4fe0000 00000000030a5000 H:\ProgramData\BOINC\slots\122\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 00000000e1b20000 00000000034b2000 H:\ProgramData\BOINC\slots\122\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 000000000aed0000 0000000000010000 H:\ProgramData\BOINC\slots\122\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 00000000aa430000 0000000003d5b000 H:\ProgramData\BOINC\slots\122\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000a1290000 000000000919f000 H:\ProgramData\BOINC\slots\122\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 000000009f3c0000 0000000001eca000 H:\ProgramData\BOINC\slots\122\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 0000000084010000 000000001b3a4000 H:\ProgramData\BOINC\slots\122\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 0000000032240000 0000000000080000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.18362.836) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.18362.836 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.836
ModLoad: 0000000033de0000 000000000002e000 C:\WINDOWS\System32\IMM32.DLL (6.2.18362.387) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.18362.387 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.387
ModLoad: 0000000031180000 0000000000011000 C:\WINDOWS\System32\kernel.appcore.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 000000002fe10000 0000000000020000 C:\WINDOWS\SYSTEM32\dxcore.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : DXCore.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 0000000031b20000 000000000004a000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.18362.387) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.18362.387 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.387
ModLoad: 00000000334b0000 0000000000335000 C:\WINDOWS\System32\combase.dll (6.2.18362.900) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 0000000033e10000 0000000000470000 C:\WINDOWS\System32\Setupapi.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 0000000031af0000 0000000000026000 C:\WINDOWS\System32\bcrypt.dll (6.2.18362.267) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 0000000030f10000 000000000002a000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.18362.387) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.18362.387 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.387
ModLoad: 0000000032010000 000000000005c000 C:\WINDOWS\System32\WINTRUST.dll (6.2.18362.387) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.18362.387 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.387
ModLoad: 00000000311a0000 0000000000012000 C:\WINDOWS\System32\MSASN1.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 0000000031c10000 0000000000149000 C:\WINDOWS\System32\CRYPT32.dll (6.2.18362.592) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 0000000032bc0000 00000000006e6000 C:\WINDOWS\System32\Shell32.dll (6.2.18362.959) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.18362.900 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.900
ModLoad: 00000000332b0000 00000000000a9000 C:\WINDOWS\System32\shcore.dll (6.2.18362.959) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 0000000031260000 0000000000782000 C:\WINDOWS\System32\windows.storage.dll (6.2.18362.959) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 00000000311c0000 0000000000023000 C:\WINDOWS\System32\profapi.dll (6.2.18362.693) (-nosymbols- Symbols Loaded)
Linked PDB Filename : profapi.pdb
File Version : 10.0.18362.693 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.693
ModLoad: 00000000311f0000 000000000004a000 C:\WINDOWS\System32\powrprof.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : powrprof.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 0000000031170000 0000000000010000 C:\WINDOWS\System32\UMPDC.dll (-exported- Symbols Loaded)
Linked PDB Filename : UMPDC.pdb
ModLoad: 00000000327e0000 0000000000052000 C:\WINDOWS\System32\shlwapi.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 0000000031240000 0000000000017000 C:\WINDOWS\System32\cryptsp.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : cryptsp.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 0000000017a30000 0000000000267000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.5730) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 27.21.14.5730
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.1.114 driver
Product Version : 27.21.14.5730
ModLoad: 000000002f150000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 00000000f2b80000 000000000152c000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_5dcb5bbf5c3edcf2\nvcuda64.dll (27.21.14.5730) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 27.21.14.5730
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.1.114 driver
Product Version : 27.21.14.5730
ModLoad: 00000000338d0000 000000000006f000 C:\WINDOWS\System32\WS2_32.dll (6.2.18362.387) (-exported- Symbols Loaded)
Linked PDB Filename : ws2_32.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 000000002f120000 000000000002f000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 0000000030ab0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 000000002f4a0000 0000000000099000 C:\WINDOWS\system32\uxtheme.dll (6.2.18362.449) (-exported- Symbols Loaded)
Linked PDB Filename : UxTheme.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 00000000295b0000 00000000006d6000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.5730) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 27.21.14.5730
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 27.21.14.5730
ModLoad: 0000000033c80000 0000000000157000 C:\WINDOWS\System32\OLE32.DLL (6.2.18362.693) (-exported- Symbols Loaded)
Linked PDB Filename : ole32.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 000000002ad30000 0000000000009000 H:\ProgramData\BOINC\slots\122\caffe2_nvrtc.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000eb0f0000 0000000000fca000 H:\ProgramData\BOINC\slots\122\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6.14.11.9000
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.89 NVRTC Library
Product Version : 6.14.11.9000
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 4254, Write: 2431, Other 8585
- I/O Transfers Counters -
Read: 9138242, Write: 257975, Other 74864
- Paged Pool Usage -
QuotaPagedPoolUsage: 3535464, QuotaPeakPagedPoolUsage: 3535464
QuotaNonPagedPoolUsage: 59424, QuotaPeakNonPagedPoolUsage: 59896
- Virtual Memory Usage -
VirtualSize: 358854656, PeakVirtualSize: 987103232
- Pagefile Usage -
PagefileUsage: 358854656, PeakPagefileUsage: 358854656
- Working Set Size -
WorkingSetSize: -2104336384, PeakWorkingSetSize: -2035236864, PageFaultCount: 856193
*** Dump of thread ID 11464 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 460000000.000000, User Time: 7782499840.000000, Wait Time: 355061664.000000
- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x00007FF9F2CEE7F5 read attempt to address 0xFFFFFFFF
- Registers -
rax=0000000000000000 rbx=00000000bce5f7f0 rcx=0000000002940800 rdx=00000000bce5f7f0 rsi=00000000d0170610 rdi=0000000002940800
r8=0000000000000100 r9=0000000000000001 r10=0000000000000018 r11=0000000000000094 r12=0000000000000001 r13=0000000000000001
r14=00000000bce5f7f0 r15=0000000000000003 rip=00000000f2cee7f5 rsp=0000000002940698 rbp=00000000029407f0
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00010246
- Callstack -
ChildEBP RetAddr Args to Child
02940690 f2bb8363 bce5f7f0 02940800 029406f8 d0170610 nvcuda64!+0x0
029406e0 f2bb890c d0170620 d0170610 bce5f7f0 d0170620 nvcuda64!+0x0
02940970 f2d81108 00004000 85030b00 00000000 84db4de7 nvcuda64!+0x0
02940ae0 84db29b6 00000001 00000100 00000000 85030b00 nvcuda64!cuLaunchKernel+0x0
02940bf0 84dafdf4 85030b00 ce8dffd0 bce5f7f0 02940e10 cudnn64_7!cudnnSetDropoutDescriptor+0x0
02940d70 8501bb21 85030b00 00000000 85030b00 00000000 cudnn64_7!cudnnSetDropoutDescriptor+0x0
02940ee0 84f1de74 39090bd0 38cf0000 39048000 00000090 cudnn64_7!cudnnSetDropoutDescriptor+0x0
02941110 84f2f99d 00000000 86221400 00000000 85030b00 cudnn64_7!cudnnSetDropoutDescriptor+0x0
02941170 84ef703b 00000000 00000000 39090bd0 02941280 cudnn64_7!cudnnSetDropoutDescriptor+0x0
02941600 84e143bc 00000000 029416ec 00000000 39d2f7d0 cudnn64_7!cudnnSetDropoutDescriptor+0x0
029418d0 84e1700e 02941918 39d52c80 50219f70 ce8dff40 cudnn64_7!cudnnSetDropoutDescriptor+0x0
029419c0 84d182ca 39d2f7d0 00000000 00000000 00000024 cudnn64_7!cudnnSetDropoutDescriptor+0x0
02941a90 84d2a9bb 0000000c 39048000 00000001 00000000 cudnn64_7!cudnnSetAttnDescriptor+0x0
02941f40 84d1eff1 00000000 bc6cbb50 02944208 4b16dc20 cudnn64_7!cudnnSetRNNProjectionLayers+0x0
029420e0 84d27d8e 4febda00 00000000 4b16dc20 02942388 cudnn64_7!cudnnSetRNNProjectionLayers+0x0
02942280 84d3d24a 02942388 02942388 02942388 02942388 cudnn64_7!cudnnSetRNNProjectionLayers+0x0
029443f0 b0f08bd1 4feb51c0 39000000 4feb51c0 bc6cbb50 cudnn64_7!cudnnRNNForwardInference+0x0
029448d0 b0f625ea 02944998 00000001 02944998 00000001 torch_cuda!at::native::_cudnn_rnn+0x0
029449b0 b0f70cbf 029450a0 02946898 029459f0 00000001 torch_cuda!at::native::set_storage_cuda_+0x0
02944a90 dc46b9fc 029450a0 02945780 00000000 02944ba8 torch_cuda!at::native::set_storage_cuda_+0x0
02944c10 dc4a31a2 02944fa0 00000001 00000000 00000000 torch_cpu!at::native::mkldnn_sigmoid_+0x0
02944ef0 dd752613 00000000 02945a00 02945a00 02945000 torch_cpu!at::_cudnn_rnn+0x0
029453f0 dd76080b 00c8ae5f 4c505fa0 02945520 00000004 torch_cpu!torch::autograd::NotImplemented::~NotImplemented+0x0
029454d0 dc46b9fc 02945a50 f2ba5a07 02945708 02945580 torch_cpu!torch::autograd::GraphRoot::apply+0x0
02945650 dc4a31a2 4b16f550 00000000 00c8a8cf b1e2a3f0 torch_cpu!at::native::mkldnn_sigmoid_+0x0
02945930 b0f069a1 02940001 00000001 00000004 00000004 torch_cpu!at::_cudnn_rnn+0x0
02945b00 b0f10117 00000000 02946898 f51c2e0d 02945c20 torch_cuda!at::native::_use_cudnn_ctc_loss+0x0
02945b90 dc1f107b e1341ac0 02945eb0 96494cff cfef83c0 torch_cuda!at::native::_cudnn_rnn_flatten_weight+0x0
02945e00 dc223b16 00000001 02946898 00000080 50294568 torch_cpu!at::native::fbgemm_pack_quantized_matrix+0x0
02945f90 dc59ae89 02946008 00000001 02946008 00000001 torch_cpu!at::native::gru+0x0
02946020 dd889fa3 02946120 00000001 029462a0 02946898 torch_cpu!at::zeros_out+0x0
029460b0 dc58dd35 f8c91ea8 cf83b5a0 00000000 f8c91ea8 torch_cpu!torch::autograd::GraphRoot::apply+0x0
02946130 dc4688ec e13475c8 1b93a020 df904d98 b5b51d70 torch_cpu!at::zeros_out+0x0
02946230 dc4dc1bb 0000000c 00000080 00000004 4c505800 torch_cpu!at::native::mkldnn_sigmoid_+0x0
029462b0 ddfc7294 029463d0 b5b51d70 029463c0 02946568 torch_cpu!at::gru+0x0
029464e0 ddfc62ab 02946878 dc3f030e 02946878 02946898 torch_cpu!torch::nn::GRUImpl::forward_helper+0x0
029465d0 6fa42621 884ec060 6fa43f05 0000c000 f8c91ea8 torch_cpu!torch::nn::GRUImpl::forward+0x0
029467d0 6fa47e98 00000000 02940000 00000601 02947280 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::error+0x0
02946c70 6fa4b964 02946d70 02946d70 00000000 8b6d18f0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Object::unsafeRemoveSlot+0x0
0295fa10 6fc8c6f8 cfcca9b0 00000000 00000000 ce14a840 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
0295fa50 32687bd4 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
0295fa80 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
0295fb00 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 16608 (state: Waiting): ***
- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 355061664.000000
- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000030ff8a0 rsi=0000000000000000 rdi=0000000000000064
r8=00000000030fe9c0 r9=00000000ffffebb0 r10=0000000000000001 r11=00000000030fe638 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000003435c6f4 rsp=00000000030ff878 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
030ff870 31da6891 030ff938 00000000 00000000 00000000 ntdll!ZwDelayExecution+0x0
030ff910 6fa6a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0
030ff940 32687bd4 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
030ff970 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
030ff9f0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 5848 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 355061664.000000
- Registers -
rax=000000000000005b rbx=000000000000000b rcx=000000000000000b rdx=00000000031ff7e0 rsi=0000000000000000 rdi=000000000000000b
r8=00000000cfef92c0 r9=000000000000000b r10=00000000cf408070 r11=000000006a00730f r12=0000000000000064 r13=00000000031ff7e0
r14=00000000031ff4d0 r15=0000000000000000 rip=000000003435cbc4 rsp=00000000031ff478 rbp=00000000cfe913b0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
031ff470 31db8037 33ca3880 343337d4 00000000 02b78000 ntdll!NtWaitForMultipleObjects+0x0
031ff770 31db7f1e f3074b48 ce153310 0000000b 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
031ff7b0 f2d2bb54 cfe978f0 00000000 cfe90390 00000000 KERNELBASE!WaitForMultipleObjects+0x0
031ff9f0 f2dc09ed 00000000 00000004 00000000 00000000 nvcuda64!+0x0
031ffaa0 f2d2b523 1218b12d a7fac685 d04071b0 00000000 nvcuda64!cuProfilerStop+0x0
031ffad0 f303a750 d04071b0 00000000 00000000 00000000 nvcuda64!+0x0
031ffb00 32687bd4 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
031ffb30 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
031ffbb0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 22844 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 354967808.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=0000000000000298 rdx=0000000000000000 rsi=0000000000000000 rdi=0000000000000298
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=00000000cfee4c20 r13=0000000000000000
r14=0000000000000298 r15=0000000000000000 rip=000000003435c0f4 rsp=00000000032ffd58 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
032ffd50 31d98b03 00000000 00000000 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0
032ffdf0 f2f3bf48 00000000 31d84975 00000000 00000298 KERNELBASE!WaitForSingleObjectEx+0x0
032ffe60 f2d2b523 00000001 d089be80 d0406d60 00000000 nvcuda64!cuProfilerStop+0x0
032ffe90 f303a750 d0406d60 00000000 00000000 00000000 nvcuda64!+0x0
032ffec0 32687bd4 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
032ffef0 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
032fff70 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 6688 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 355061632.000000
- Registers -
rax=00000000000001ca rbx=0000000000000000 rcx=00000000d016e258 rdx=00000000033ffa48 rsi=00000000033ff9b0 rdi=0000000000000000
r8=0000000000000001 r9=0000000000001a20 r10=00000000d0172e28 r11=000000006a00730f r12=00000000033ffa48 r13=0000000000000000
r14=00000000d016e258 r15=00000000d0172e28 rip=000000003435f9a4 rsp=00000000033ff988 rbp=00000000033ff9e0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
033ff980 34320815 00000102 00000102 00000000 033ff9b0 ntdll!ZwWaitForAlertByThreadId+0x0
033ff9f0 31ddc2b9 d0170610 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0
033ffa20 f2cb223a d0170610 d0170610 d0170610 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0
033ffa80 f2d2b523 00000004 12080078 12080078 00000000 nvcuda64!+0x0
033ffab0 f303a750 d04075a0 00000000 00000000 00000000 nvcuda64!+0x0
033ffae0 32687bd4 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
033ffb10 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
033ffb90 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 18228 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 252968752.000000, User Time: 5844062720.000000, Wait Time: 355061664.000000
- Registers -
rax=00000000000001ca rbx=0000000000000000 rcx=000000003436c458 rdx=0000000000000000 rsi=0000000000000000 rdi=0000000000000000
r8=00000000034fa000 r9=00000000034f9fc8 r10=00000000d016b090 r11=00000000034f9f80 r12=0000000000000003 r13=00000000000001c0
r14=000000003436c408 r15=0000000000000000 rip=000000003435f9a4 rsp=00000000034ff978 rbp=000000003436c458
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
034ff970 34320590 034ffaa0 3a10a228 034ffce0 ddc0092a ntdll!ZwWaitForAlertByThreadId+0x0
034ff9e0 31d858fd 3436c400 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableSRW+0x0
034ffa20 f1e0ba8d 39dc76f0 39dc76f0 39dc76f0 00000000 KERNELBASE!SleepConditionVariableSRW+0x0
034ffa60 f1de2848 39df15b0 00000000 00000000 ddc005b4 MSVCP140!__crtSetThreadpoolWait+0x0
034ffa90 f1de2710 00000000 f1de2f17 00000000 39df15b0 MSVCP140!std::_Winerror_message+0x0
034ffb00 ddc0064b 39df1590 000001c0 3436c400 3436c400 MSVCP140!std::_Winerror_message+0x0
034ffb40 ddc025b1 4ff70aa0 ffffffff 39df1590 ffffffff torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
034ffe30 ddc02471 e1126d10 034ffe70 e1126d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0
034ffe80 ddbf9744 00080001 4cc43180 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0
034ffeb0 31a10e82 4cc43180 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0
034ffee0 32687bd4 00000000 00000000 00000000 00000000 ucrtbase!_beginthreadex+0x0
034fff10 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
034fff90 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)