Task 13961060
| Name | ParityModified-1647039934-13822-1-0_1 |
| Workunit | 10147637 |
| Created | 29 Mar 2022, 4:18:13 UTC |
| Sent | 29 Mar 2022, 5:30:43 UTC |
| Report deadline | 6 Apr 2022, 5:30:43 UTC |
| Received | 29 Mar 2022, 20:27:44 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | -529697949 (0xE06D7363) Unknown error code |
| Computer ID | 17584 |
| Run time | 1 hours 40 min 15 sec |
| CPU time | 26 min 58 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 5,112.04 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 2.88 GB |
| Peak swap size | 4.31 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
6 ms
[2022-03-29 21:06:05 main:574] : INFO : Epoch 351 | loss: 0.0312499 | val_loss: 0.0312508 | Time: 2264.1 ms
[2022-03-29 21:06:23 main:574] : INFO : Epoch 352 | loss: 0.0312501 | val_loss: 0.0312511 | Time: 18734.2 ms
[2022-03-29 21:06:26 main:574] : INFO : Epoch 353 | loss: 0.0312503 | val_loss: 0.0312509 | Time: 2266.92 ms
[2022-03-29 21:06:28 main:574] : INFO : Epoch 354 | loss: 0.0312508 | val_loss: 0.0312517 | Time: 2319.44 ms
[2022-03-29 21:06:30 main:574] : INFO : Epoch 355 | loss: 0.0312509 | val_loss: 0.0312519 | Time: 2262.97 ms
[2022-03-29 21:06:32 main:574] : INFO : Epoch 356 | loss: 0.03125 | val_loss: 0.0312504 | Time: 2296.38 ms
[2022-03-29 21:06:36 main:574] : INFO : Epoch 357 | loss: 0.0312503 | val_loss: 0.0312508 | Time: 3433.58 ms
[2022-03-29 21:06:38 main:574] : INFO : Epoch 358 | loss: 0.0312497 | val_loss: 0.0312505 | Time: 2333.75 ms
[2022-03-29 21:06:41 main:574] : INFO : Epoch 359 | loss: 0.0312499 | val_loss: 0.0312508 | Time: 2313.88 ms
[2022-03-29 21:06:43 main:574] : INFO : Epoch 360 | loss: 0.0312498 | val_loss: 0.0312505 | Time: 2305.07 ms
[2022-03-29 21:06:45 main:574] : INFO : Epoch 361 | loss: 0.031251 | val_loss: 0.0312536 | Time: 2278.68 ms
[2022-03-29 21:07:07 main:574] : INFO : Epoch 362 | loss: 0.0312506 | val_loss: 0.031251 | Time: 21663.6 ms
[2022-03-29 21:07:10 main:574] : INFO : Epoch 363 | loss: 0.0312503 | val_loss: 0.0312511 | Time: 3395.24 ms
[2022-03-29 21:07:13 main:574] : INFO : Epoch 364 | loss: 0.0312497 | val_loss: 0.031253 | Time: 2264.13 ms
[2022-03-29 21:07:15 main:574] : INFO : Epoch 365 | loss: 0.0312504 | val_loss: 0.0312506 | Time: 2320.5 ms
[2022-03-29 21:07:17 main:574] : INFO : Epoch 366 | loss: 0.0312501 | val_loss: 0.0312506 | Time: 2333.3 ms
[2022-03-29 21:07:20 main:574] : INFO : Epoch 367 | loss: 0.0312509 | val_loss: 0.0312522 | Time: 2315.26 ms
[2022-03-29 21:07:52 main:574] : INFO : Epoch 368 | loss: 0.0312508 | val_loss: 0.0312502 | Time: 32732.4 ms
[2022-03-29 21:07:55 main:574] : INFO : Epoch 369 | loss: 0.0312495 | val_loss: 0.0312503 | Time: 2307.95 ms
[2022-03-29 21:07:58 main:574] : INFO : Epoch 370 | loss: 0.0312496 | val_loss: 0.0312503 | Time: 3460.33 ms
[2022-03-29 21:08:00 main:574] : INFO : Epoch 371 | loss: 0.0312498 | val_loss: 0.0312506 | Time: 2289.35 ms
[2022-03-29 21:08:03 main:574] : INFO : Epoch 372 | loss: 0.0312503 | val_loss: 0.0312511 | Time: 2314.5 ms
[2022-03-29 21:08:05 main:574] : INFO : Epoch 373 | loss: 0.0312497 | val_loss: 0.0312501 | Time: 2300.57 ms
[2022-03-29 21:08:07 main:574] : INFO : Epoch 374 | loss: 0.0312498 | val_loss: 0.0312509 | Time: 2316.39 ms
[2022-03-29 21:08:10 main:574] : INFO : Epoch 375 | loss: 0.0312498 | val_loss: 0.0312507 | Time: 2318.57 ms
[2022-03-29 21:08:13 main:574] : INFO : Epoch 376 | loss: 0.0312506 | val_loss: 0.0312519 | Time: 3074.75 ms
[2022-03-29 21:08:16 main:574] : INFO : Epoch 377 | loss: 0.0312498 | val_loss: 0.0312502 | Time: 2322.45 ms
[2022-03-29 21:08:18 main:574] : INFO : Epoch 378 | loss: 0.0312497 | val_loss: 0.0312505 | Time: 2298.57 ms
[2022-03-29 21:08:39 main:574] : INFO : Epoch 379 | loss: 0.0312498 | val_loss: 0.0312507 | Time: 21454.5 ms
[2022-03-29 21:08:42 main:574] : INFO : Epoch 380 | loss: 0.0312497 | val_loss: 0.0312509 | Time: 2336.88 ms
[2022-03-29 21:08:44 main:574] : INFO : Epoch 381 | loss: 0.0312504 | val_loss: 0.0312513 | Time: 2293.84 ms
[2022-03-29 21:08:47 main:574] : INFO : Epoch 382 | loss: 0.0312497 | val_loss: 0.0312502 | Time: 3441.59 ms
[2022-03-29 21:08:50 main:574] : INFO : Epoch 383 | loss: 0.0312498 | val_loss: 0.0312516 | Time: 2304.08 ms
[2022-03-29 21:08:52 main:574] : INFO : Epoch 384 | loss: 0.0312496 | val_loss: 0.0312506 | Time: 2274.97 ms
[2022-03-29 21:08:54 main:574] : INFO : Epoch 385 | loss: 0.0312494 | val_loss: 0.0312506 | Time: 2309.84 ms
[2022-03-29 21:08:57 main:574] : INFO : Epoch 386 | loss: 0.031249 | val_loss: 0.0312498 | Time: 2341.94 ms
[2022-03-29 21:09:00 main:574] : INFO : Epoch 387 | loss: 0.0312497 | val_loss: 0.0312503 | Time: 3439.32 ms
[2022-03-29 21:09:02 main:574] : INFO : Epoch 388 | loss: 0.0312496 | val_loss: 0.03125 | Time: 2294.22 ms
[2022-03-29 21:09:05 main:574] : INFO : Epoch 389 | loss: 0.0312503 | val_loss: 0.0312513 | Time: 2296.15 ms
[2022-03-29 21:09:07 main:574] : INFO : Epoch 390 | loss: 0.0312507 | val_loss: 0.0312504 | Time: 2279.64 ms
[2022-03-29 21:09:11 main:574] : INFO : Epoch 391 | loss: 0.0312493 | val_loss: 0.03125 | Time: 3741.71 ms
[2022-03-29 21:09:24 main:574] : INFO : Epoch 392 | loss: 0.0312494 | val_loss: 0.0312498 | Time: 4666.17 ms
[2022-03-29 21:09:26 main:574] : INFO : Epoch 393 | loss: 0.0312495 | val_loss: 0.0312509 | Time: 2309.92 ms
[2022-03-29 21:09:28 main:574] : INFO : Epoch 394 | loss: 0.0312509 | val_loss: 0.0312513 | Time: 2298.99 ms
[2022-03-29 21:09:31 main:574] : INFO : Epoch 395 | loss: 0.0312491 | val_loss: 0.0312499 | Time: 2336.56 ms
[2022-03-29 21:09:36 main:574] : INFO : Epoch 396 | loss: 0.0312496 | val_loss: 0.0312517 | Time: 2436 ms
[2022-03-29 21:09:38 main:574] : INFO : Epoch 397 | loss: 0.0312501 | val_loss: 0.0312503 | Time: 2295.18 ms
[2022-03-29 21:09:40 main:574] : INFO : Epoch 398 | loss: 0.0312508 | val_loss: 0.0312517 | Time: 2296.3 ms
[2022-03-29 21:09:43 main:574] : INFO : Epoch 399 | loss: 0.0312506 | val_loss: 0.031252 | Time: 2283.67 ms
[2022-03-29 21:09:45 main:574] : INFO : Epoch 400 | loss: 0.0312499 | val_loss: 0.0312518 | Time: 2322.32 ms
[2022-03-29 21:09:48 main:574] : INFO : Epoch 401 | loss: 0.0312505 | val_loss: 0.0312528 | Time: 3406.3 ms
[2022-03-29 21:09:51 main:574] : INFO : Epoch 402 | loss: 0.0312517 | val_loss: 0.0312512 | Time: 2309.03 ms
[2022-03-29 21:09:53 main:574] : INFO : Epoch 403 | loss: 0.0312495 | val_loss: 0.0312501 | Time: 2304.46 ms
[2022-03-29 21:10:03 main:574] : INFO : Epoch 404 | loss: 0.0312493 | val_loss: 0.0312495 | Time: 9773.93 ms
[2022-03-29 21:10:09 main:574] : INFO : Epoch 405 | loss: 0.0312493 | val_loss: 0.0312519 | Time: 2377.75 ms
[2022-03-29 21:10:11 main:574] : INFO : Epoch 406 | loss: 0.0312496 | val_loss: 0.0312503 | Time: 2315.24 ms
[2022-03-29 21:10:14 main:574] : INFO : Epoch 407 | loss: 0.0312488 | val_loss: 0.0312499 | Time: 2312.71 ms
[2022-03-29 21:10:16 main:574] : INFO : Epoch 408 | loss: 0.0312486 | val_loss: 0.0312536 | Time: 2295.23 ms
[2022-03-29 21:10:19 main:574] : INFO : Epoch 409 | loss: 0.0312524 | val_loss: 0.0312552 | Time: 3429.36 ms
[2022-03-29 21:10:22 main:574] : INFO : Epoch 410 | loss: 0.0312514 | val_loss: 0.0312503 | Time: 2317.66 ms
[2022-03-29 21:10:24 main:574] : INFO : Epoch 411 | loss: 0.0312494 | val_loss: 0.0312499 | Time: 2391.06 ms
[2022-03-29 21:10:27 main:574] : INFO : Epoch 412 | loss: 0.0312501 | val_loss: 0.0312507 | Time: 2333.56 ms
[2022-03-29 21:10:29 main:574] : INFO : Epoch 413 | loss: 0.0312494 | val_loss: 0.0312506 | Time: 2285.5 ms
[2022-03-29 21:10:32 main:574] : INFO : Epoch 414 | loss: 0.0312494 | val_loss: 0.0312499 | Time: 3422.55 ms
[2022-03-29 21:10:35 main:574] : INFO : Epoch 415 | loss: 0.0312491 | val_loss: 0.0312502 | Time: 2683.07 ms
[2022-03-29 21:10:54 main:574] : INFO : Epoch 416 | loss: 0.0312492 | val_loss: 0.0312507 | Time: 13951.2 ms
[2022-03-29 21:10:56 main:574] : INFO : Epoch 417 | loss: 0.0312495 | val_loss: 0.0312496 | Time: 2304.45 ms
[2022-03-29 21:11:00 main:574] : INFO : Epoch 418 | loss: 0.0312494 | val_loss: 0.0312495 | Time: 3400.63 ms
[2022-03-29 21:11:02 main:574] : INFO : Epoch 419 | loss: 0.0312487 | val_loss: 0.0312496 | Time: 2317.56 ms
[2022-03-29 21:11:04 main:574] : INFO : Epoch 420 | loss: 0.0312492 | val_loss: 0.0312503 | Time: 2326.6 ms
[2022-03-29 21:11:09 main:574] : INFO : Epoch 421 | loss: 0.0312499 | val_loss: 0.0312494 | Time: 4302.39 ms
[2022-03-29 21:11:38 main:574] : INFO : Epoch 422 | loss: 0.0312495 | val_loss: 0.0312506 | Time: 24200.5 ms
[2022-03-29 21:11:40 main:574] : INFO : Epoch 423 | loss: 0.0312492 | val_loss: 0.0312497 | Time: 2318.9 ms
[2022-03-29 21:11:43 main:574] : INFO : Epoch 424 | loss: 0.0312494 | val_loss: 0.0312514 | Time: 2287.28 ms
[2022-03-29 21:11:46 main:574] : INFO : Epoch 425 | loss: 0.0312497 | val_loss: 0.0312505 | Time: 3438.06 ms
[2022-03-29 21:11:48 main:574] : INFO : Epoch 426 | loss: 0.0312516 | val_loss: 0.0312524 | Time: 2312.87 ms
[2022-03-29 21:11:51 main:574] : INFO : Epoch 427 | loss: 0.0312502 | val_loss: 0.0312511 | Time: 2340.15 ms
[2022-03-29 21:11:53 main:574] : INFO : Epoch 428 | loss: 0.0312489 | val_loss: 0.0312497 | Time: 2310.67 ms
[2022-03-29 21:11:55 main:574] : INFO : Epoch 429 | loss: 0.0312493 | val_loss: 0.0312493 | Time: 2286.89 ms
[2022-03-29 21:11:59 main:574] : INFO : Epoch 430 | loss: 0.0312488 | val_loss: 0.0312499 | Time: 3441.71 ms
[2022-03-29 21:12:01 main:574] : INFO : Epoch 431 | loss: 0.0312487 | val_loss: 0.0312493 | Time: 2296.98 ms
[2022-03-29 21:12:03 main:574] : INFO : Epoch 432 | loss: 0.0312486 | val_loss: 0.0312501 | Time: 2261.65 ms
[2022-03-29 21:12:06 main:574] : INFO : Epoch 433 | loss: 0.03125 | val_loss: 0.031251 | Time: 2241.6 ms
[2022-03-29 21:12:08 main:574] : INFO : Epoch 434 | loss: 0.0312493 | val_loss: 0.0312496 | Time: 2268.87 ms
[2022-03-29 21:12:10 main:574] : INFO : Epoch 435 | loss: 0.0312491 | val_loss: 0.03125 | Time: 2227.87 ms
[2022-03-29 21:12:14 main:574] : INFO : Epoch 436 | loss: 0.0312495 | val_loss: 0.0312509 | Time: 3525.22 ms
[2022-03-29 21:12:16 main:574] : INFO : Epoch 437 | loss: 0.0312503 | val_loss: 0.0312509 | Time: 2298.01 ms
[2022-03-29 21:12:18 main:574] : INFO : Epoch 438 | loss: 0.0312501 | val_loss: 0.0312509 | Time: 2312.19 ms
[2022-03-29 21:12:21 main:574] : INFO : Epoch 439 | loss: 0.0312491 | val_loss: 0.0312501 | Time: 2294.1 ms
[2022-03-29 21:12:23 main:574] : INFO : Epoch 440 | loss: 0.0312489 | val_loss: 0.0312529 | Time: 2294.72 ms
[2022-03-29 21:12:26 main:574] : INFO : Epoch 441 | loss: 0.0312494 | val_loss: 0.0312494 | Time: 3549.65 ms
[2022-03-29 21:12:29 main:574] : INFO : Epoch 442 | loss: 0.0312488 | val_loss: 0.0312498 | Time: 2317.71 ms
[2022-03-29 21:12:48 main:574] : INFO : Epoch 443 | loss: 0.0312487 | val_loss: 0.0312511 | Time: 19640.3 ms
[2022-03-29 21:12:51 main:574] : INFO : Epoch 444 | loss: 0.031249 | val_loss: 0.0312503 | Time: 2298.04 ms
[2022-03-29 21:12:53 main:574] : INFO : Epoch 445 | loss: 0.0312486 | val_loss: 0.0312517 | Time: 2289.57 ms
[2022-03-29 21:12:55 main:574] : INFO : Epoch 446 | loss: 0.0312488 | val_loss: 0.0312498 | Time: 2326.82 ms
[2022-03-29 21:12:59 main:574] : INFO : Epoch 447 | loss: 0.0312489 | val_loss: 0.0312507 | Time: 3455.69 ms
[2022-03-29 21:13:01 main:574] : INFO : Epoch 448 | loss: 0.0312518 | val_loss: 0.0312521 | Time: 2324.12 ms
[2022-03-29 21:13:03 main:574] : INFO : Epoch 449 | loss: 0.0312495 | val_loss: 0.0312498 | Time: 2287.73 ms
[2022-03-29 21:13:06 main:574] : INFO : Epoch 450 | loss: 0.0312488 | val_loss: 0.0312496 | Time: 2475.3 ms
[2022-03-29 21:13:08 main:574] : INFO : Epoch 451 | loss: 0.0312487 | val_loss: 0.0312494 | Time: 2363.46 ms
[2022-03-29 21:13:12 main:574] : INFO : Epoch 452 | loss: 0.031249 | val_loss: 0.0312507 | Time: 3425.06 ms
[2022-03-29 21:13:14 main:574] : INFO : Epoch 453 | loss: 0.0312491 | val_loss: 0.0312552 | Time: 2318.96 ms
[2022-03-29 21:13:16 main:574] : INFO : Epoch 454 | loss: 0.0312531 | val_loss: 0.0312504 | Time: 2324.85 ms
[2022-03-29 21:13:19 main:574] : INFO : Epoch 455 | loss: 0.0312505 | val_loss: 0.0312523 | Time: 2332.94 ms
[2022-03-29 21:13:52 main:574] : INFO : Epoch 456 | loss: 0.0312501 | val_loss: 0.0312511 | Time: 33466.7 ms
[2022-03-29 21:13:55 main:574] : INFO : Epoch 457 | loss: 0.0312503 | val_loss: 0.03125 | Time: 2304.24 ms
[2022-03-29 21:13:58 main:574] : INFO : Epoch 458 | loss: 0.0312507 | val_loss: 0.0312556 | Time: 3424.01 ms
[2022-03-29 21:14:00 main:574] : INFO : Epoch 459 | loss: 0.0312506 | val_loss: 0.0312513 | Time: 2308.26 ms
[2022-03-29 21:14:03 main:574] : INFO : Epoch 460 | loss: 0.0312494 | val_loss: 0.0312519 | Time: 2297.17 ms
[2022-03-29 21:14:05 main:574] : INFO : Epoch 461 | loss: 0.0312492 | val_loss: 0.0312497 | Time: 2300.32 ms
[2022-03-29 21:14:07 main:574] : INFO : Epoch 462 | loss: 0.0312491 | val_loss: 0.0312505 | Time: 2306.72 ms
[2022-03-29 21:14:38 main:574] : INFO : Epoch 463 | loss: 0.0312492 | val_loss: 0.0312497 | Time: 30530.8 ms
[2022-03-29 21:14:40 main:574] : INFO : Epoch 464 | loss: 0.0312492 | val_loss: 0.0312495 | Time: 2289.64 ms
[2022-03-29 21:14:44 main:574] : INFO : Epoch 465 | loss: 0.031249 | val_loss: 0.0312522 | Time: 3478.96 ms
[2022-03-29 21:14:48 main:574] : INFO : Epoch 466 | loss: 0.0312497 | val_loss: 0.0312499 | Time: 4849.59 ms
[2022-03-29 21:14:51 main:574] : INFO : Epoch 467 | loss: 0.0312491 | val_loss: 0.0312506 | Time: 2331.69 ms
[2022-03-29 21:14:53 main:574] : INFO : Epoch 468 | loss: 0.0312495 | val_loss: 0.0312504 | Time: 2286.03 ms
[2022-03-29 21:14:55 main:574] : INFO : Epoch 469 | loss: 0.0312493 | val_loss: 0.0312493 | Time: 2314.73 ms
[2022-03-29 21:14:59 main:574] : INFO : Epoch 470 | loss: 0.0312493 | val_loss: 0.0312497 | Time: 3444.57 ms
[2022-03-29 21:15:01 main:574] : INFO : Epoch 471 | loss: 0.0312486 | val_loss: 0.0312497 | Time: 2316.66 ms
[2022-03-29 21:15:04 main:574] : INFO : Epoch 472 | loss: 0.0312489 | val_loss: 0.0312494 | Time: 2321.15 ms
[2022-03-29 21:15:23 main:574] : INFO : Epoch 473 | loss: 0.0312531 | val_loss: 0.0312593 | Time: 19418.3 ms
[2022-03-29 21:15:25 main:574] : INFO : Epoch 474 | loss: 0.0312514 | val_loss: 0.0312496 | Time: 2318.14 ms
[2022-03-29 21:15:28 main:574] : INFO : Epoch 475 | loss: 0.0312489 | val_loss: 0.0312517 | Time: 2299.21 ms
[2022-03-29 21:15:30 main:574] : INFO : Epoch 476 | loss: 0.0312494 | val_loss: 0.0312498 | Time: 2315.55 ms
[2022-03-29 21:15:50 main:574] : INFO : Epoch 477 | loss: 0.0312493 | val_loss: 0.0312514 | Time: 20062.7 ms
[2022-03-29 21:15:53 main:574] : INFO : Epoch 478 | loss: 0.0312491 | val_loss: 0.0312504 | Time: 3417.08 ms
[2022-03-29 21:15:56 main:574] : INFO : Epoch 479 | loss: 0.0312488 | val_loss: 0.0312511 | Time: 2331.98 ms
[2022-03-29 21:15:58 main:574] : INFO : Epoch 480 | loss: 0.0312491 | val_loss: 0.0312492 | Time: 2349.34 ms
[2022-03-29 21:16:13 main:574] : INFO : Epoch 481 | loss: 0.0312492 | val_loss: 0.0312512 | Time: 4488.62 ms
[2022-03-29 21:16:15 main:574] : INFO : Epoch 482 | loss: 0.0312488 | val_loss: 0.0312497 | Time: 2297.02 ms
[2022-03-29 21:16:17 main:574] : INFO : Epoch 483 | loss: 0.0312488 | val_loss: 0.0312495 | Time: 2305.75 ms
[2022-03-29 21:16:53 main:574] : INFO : Epoch 484 | loss: 0.0312485 | val_loss: 0.03125 | Time: 35461.1 ms
[2022-03-29 21:17:36 main:574] : INFO : Epoch 485 | loss: 0.03125 | val_loss: 0.0312497 | Time: 43475.4 ms
[2022-03-29 21:17:39 main:574] : INFO : Epoch 486 | loss: 0.0312486 | val_loss: 0.0312501 | Time: 2311.61 ms
[2022-03-29 21:17:42 main:574] : INFO : Epoch 487 | loss: 0.0312491 | val_loss: 0.0312511 | Time: 3724.84 ms
[2022-03-29 21:17:51 main:574] : INFO : Epoch 488 | loss: 0.031249 | val_loss: 0.0312492 | Time: 2431.75 ms
[2022-03-29 21:17:54 main:574] : INFO : Epoch 489 | loss: 0.0312485 | val_loss: 0.0312506 | Time: 2313.14 ms
[2022-03-29 21:17:56 main:574] : INFO : Epoch 490 | loss: 0.0312499 | val_loss: 0.03125 | Time: 2288.83 ms
[2022-03-29 21:17:58 main:574] : INFO : Epoch 491 | loss: 0.0312497 | val_loss: 0.0312528 | Time: 2328.54 ms
[2022-03-29 21:18:01 main:574] : INFO : Epoch 492 | loss: 0.0312494 | val_loss: 0.03125 | Time: 2285.36 ms
[2022-03-29 21:18:04 main:574] : INFO : Epoch 493 | loss: 0.0312494 | val_loss: 0.0312492 | Time: 3478.55 ms
[2022-03-29 21:18:07 main:574] : INFO : Epoch 494 | loss: 0.0312488 | val_loss: 0.0312523 | Time: 2355.29 ms
[2022-03-29 21:18:09 main:574] : INFO : Epoch 495 | loss: 0.0312502 | val_loss: 0.0312497 | Time: 2318.05 ms
[2022-03-29 21:18:13 main:574] : INFO : Epoch 496 | loss: 0.0312489 | val_loss: 0.0312506 | Time: 3704.82 ms
[2022-03-29 21:18:15 main:574] : INFO : Epoch 497 | loss: 0.0312494 | val_loss: 0.0312533 | Time: 2247.93 ms
[2022-03-29 21:18:17 main:574] : INFO : Epoch 498 | loss: 0.0312516 | val_loss: 0.031252 | Time: 2295.03 ms
[2022-03-29 21:18:20 main:574] : INFO : Epoch 499 | loss: 0.0312497 | val_loss: 0.0312492 | Time: 2286.52 ms
[2022-03-29 21:18:22 main:574] : INFO : Epoch 500 | loss: 0.0312488 | val_loss: 0.0312496 | Time: 2308.42 ms
[2022-03-29 21:18:24 main:574] : INFO : Epoch 501 | loss: 0.0312488 | val_loss: 0.0312499 | Time: 2299.24 ms
[2022-03-29 21:18:28 main:574] : INFO : Epoch 502 | loss: 0.0312488 | val_loss: 0.0312494 | Time: 3398.83 ms
[2022-03-29 21:18:30 main:574] : INFO : Epoch 503 | loss: 0.0312494 | val_loss: 0.031251 | Time: 2320.64 ms
[2022-03-29 21:18:32 main:574] : INFO : Epoch 504 | loss: 0.0312494 | val_loss: 0.0312494 | Time: 2346.07 ms
[2022-03-29 21:18:43 main:574] : INFO : Epoch 505 | loss: 0.0312487 | val_loss: 0.0312498 | Time: 5118.5 ms
[2022-03-29 21:18:45 main:574] : INFO : Epoch 506 | loss: 0.0312492 | val_loss: 0.0312499 | Time: 2298.99 ms
[2022-03-29 21:18:47 main:574] : INFO : Epoch 507 | loss: 0.0312484 | val_loss: 0.0312496 | Time: 2325.99 ms
[2022-03-29 21:18:50 main:574] : INFO : Epoch 508 | loss: 0.0312486 | val_loss: 0.0312494 | Time: 2301.01 ms
[2022-03-29 21:18:52 main:574] : INFO : Epoch 509 | loss: 0.0312505 | val_loss: 0.03125 | Time: 2299.98 ms
[2022-03-29 21:18:55 main:574] : INFO : Epoch 510 | loss: 0.0312496 | val_loss: 0.0312498 | Time: 3457.57 ms
[2022-03-29 21:18:58 main:574] : INFO : Epoch 511 | loss: 0.031249 | val_loss: 0.0312494 | Time: 2298.88 ms
[2022-03-29 21:19:00 main:574] : INFO : Epoch 512 | loss: 0.0312485 | val_loss: 0.0312518 | Time: 2323.23 ms
[2022-03-29 21:19:04 main:574] : INFO : Epoch 513 | loss: 0.0312493 | val_loss: 0.0312496 | Time: 3836.58 ms
[2022-03-29 21:19:09 main:574] : INFO : Epoch 514 | loss: 0.0312499 | val_loss: 0.0312513 | Time: 2443.04 ms
[2022-03-29 21:19:11 main:574] : INFO : Epoch 515 | loss: 0.0312497 | val_loss: 0.0312495 | Time: 2281.2 ms
[2022-03-29 21:19:13 main:574] : INFO : Epoch 516 | loss: 0.0312493 | val_loss: 0.0312491 | Time: 2298.23 ms
[2022-03-29 21:19:16 main:574] : INFO : Epoch 517 | loss: 0.0312483 | val_loss: 0.0312492 | Time: 2315.11 ms
[2022-03-29 21:19:18 main:574] : INFO : Epoch 518 | loss: 0.0312484 | val_loss: 0.0312492 | Time: 2278.64 ms
[2022-03-29 21:19:21 main:574] : INFO : Epoch 519 | loss: 0.0312489 | val_loss: 0.0312493 | Time: 3448.96 ms
[2022-03-29 21:19:24 main:574] : INFO : Epoch 520 | loss: 0.0312485 | val_loss: 0.0312492 | Time: 2319.49 ms
[2022-03-29 21:19:28 main:574] : INFO : Epoch 521 | loss: 0.0312492 | val_loss: 0.0312492 | Time: 4483.6 ms
[2022-03-29 21:19:30 main:574] : INFO : Epoch 522 | loss: 0.0312494 | val_loss: 0.0312498 | Time: 2282 ms
[2022-03-29 21:19:33 main:574] : INFO : Epoch 523 | loss: 0.0312498 | val_loss: 0.0312495 | Time: 2282.96 ms
[2022-03-29 21:19:36 main:574] : INFO : Epoch 524 | loss: 0.0312493 | val_loss: 0.0312491 | Time: 3437.86 ms
[2022-03-29 21:19:39 main:574] : INFO : Epoch 525 | loss: 0.0312482 | val_loss: 0.0312491 | Time: 2309.33 ms
[2022-03-29 21:19:52 main:574] : INFO : Epoch 526 | loss: 0.0312486 | val_loss: 0.0312495 | Time: 13221.4 ms
[2022-03-29 21:19:54 main:574] : INFO : Epoch 527 | loss: 0.0312485 | val_loss: 0.0312499 | Time: 2319.06 ms
[2022-03-29 21:19:56 main:574] : INFO : Epoch 528 | loss: 0.0312487 | val_loss: 0.0312498 | Time: 2302.62 ms
[2022-03-29 21:20:00 main:574] : INFO : Epoch 529 | loss: 0.0312486 | val_loss: 0.0312495 | Time: 3411.59 ms
[2022-03-29 21:20:36 main:574] : INFO : Epoch 530 | loss: 0.0312485 | val_loss: 0.0312495 | Time: 36004.5 ms
[2022-03-29 21:20:38 main:574] : INFO : Epoch 531 | loss: 0.0312491 | val_loss: 0.0312506 | Time: 2273.59 ms
[2022-03-29 21:20:40 main:574] : INFO : Epoch 532 | loss: 0.0312483 | val_loss: 0.0312491 | Time: 2273.58 ms
[2022-03-29 21:21:24 main:574] : INFO : Epoch 533 | loss: 0.0312485 | val_loss: 0.0312492 | Time: 43441.2 ms
[2022-03-29 21:21:26 main:574] : INFO : Epoch 534 | loss: 0.0312487 | val_loss: 0.0312503 | Time: 2274.11 ms
[2022-03-29 21:21:30 main:574] : INFO : Epoch 535 | loss: 0.0312497 | val_loss: 0.0312493 | Time: 3693.78 ms
[2022-03-29 21:21:32 main:574] : INFO : Epoch 536 | loss: 0.03125 | val_loss: 0.0312493 | Time: 2292.53 ms
[2022-03-29 21:21:34 main:574] : INFO : Epoch 537 | loss: 0.0312493 | val_loss: 0.031252 | Time: 2298 ms
[2022-03-29 21:21:37 main:574] : INFO : Epoch 538 | loss: 0.0312504 | val_loss: 0.0312494 | Time: 2326.18 ms
[2022-03-29 21:21:39 main:574] : INFO : Epoch 539 | loss: 0.0312488 | val_loss: 0.0312493 | Time: 2315.04 ms
[2022-03-29 21:21:43 main:574] : INFO : Epoch 540 | loss: 0.0312492 | val_loss: 0.0312523 | Time: 3481.97 ms
[2022-03-29 21:21:45 main:574] : INFO : Epoch 541 | loss: 0.0312498 | val_loss: 0.0312501 | Time: 2271.54 ms
[2022-03-29 21:21:47 main:574] : INFO : Epoch 542 | loss: 0.031249 | val_loss: 0.0312497 | Time: 2309.1 ms
[2022-03-29 21:21:50 main:574] : INFO : Epoch 543 | loss: 0.0312513 | val_loss: 0.03125 | Time: 2352.2 ms
[2022-03-29 21:21:52 main:574] : INFO : Epoch 544 | loss: 0.0312502 | val_loss: 0.0312502 | Time: 2324.76 ms
[2022-03-29 21:22:08 main:574] : INFO : Epoch 545 | loss: 0.0312484 | val_loss: 0.0312503 | Time: 16001 ms
[2022-03-29 21:22:11 main:574] : INFO : Epoch 546 | loss: 0.031249 | val_loss: 0.0312492 | Time: 3420.19 ms
[2022-03-29 21:22:14 main:574] : INFO : Epoch 547 | loss: 0.0312485 | val_loss: 0.0312502 | Time: 2313.36 ms
[2022-03-29 21:22:16 main:574] : INFO : Epoch 548 | loss: 0.0312496 | val_loss: 0.0312498 | Time: 2310.84 ms
[2022-03-29 21:22:18 main:574] : INFO : Epoch 549 | loss: 0.0312506 | val_loss: 0.0312494 | Time: 2332.19 ms
[2022-03-29 21:22:21 main:574] : INFO : Epoch 550 | loss: 0.0312496 | val_loss: 0.0312494 | Time: 2328.53 ms
[2022-03-29 21:22:24 main:574] : INFO : Epoch 551 | loss: 0.0312485 | val_loss: 0.0312496 | Time: 3422.75 ms
[2022-03-29 21:22:26 main:574] : INFO : Epoch 552 | loss: 0.0312493 | val_loss: 0.0312513 | Time: 2307.57 ms
[2022-03-29 21:22:29 main:574] : INFO : Epoch 553 | loss: 0.0312494 | val_loss: 0.0312492 | Time: 2307.76 ms
[2022-03-29 21:22:43 main:574] : INFO : Epoch 554 | loss: 0.0312486 | val_loss: 0.0312512 | Time: 14642.2 ms
[2022-03-29 21:22:54 main:574] : INFO : Epoch 555 | loss: 0.031249 | val_loss: 0.0312492 | Time: 2388.25 ms
[2022-03-29 21:22:56 main:574] : INFO : Epoch 556 | loss: 0.0312487 | val_loss: 0.0312502 | Time: 2289.49 ms
[2022-03-29 21:22:58 main:574] : INFO : Epoch 557 | loss: 0.0312489 | val_loss: 0.0312504 | Time: 2303.25 ms
[2022-03-29 21:23:30 main:574] : INFO : Epoch 558 | loss: 0.0312485 | val_loss: 0.0312505 | Time: 31092 ms
[2022-03-29 21:23:32 main:574] : INFO : Epoch 559 | loss: 0.0312491 | val_loss: 0.0312498 | Time: 2282.34 ms
[2022-03-29 21:23:34 main:574] : INFO : Epoch 560 | loss: 0.0312484 | val_loss: 0.0312491 | Time: 2318.87 ms
[2022-03-29 21:23:36 main:574] : INFO : Epoch 561 | loss: 0.0312487 | val_loss: 0.03125 | Time: 2278.34 ms
[2022-03-29 21:23:40 main:574] : INFO : Epoch 562 | loss: 0.0312486 | val_loss: 0.0312496 | Time: 3439.31 ms
[2022-03-29 21:23:42 main:574] : INFO : Epoch 563 | loss: 0.0312484 | val_loss: 0.0312493 | Time: 2316.75 ms
[2022-03-29 21:23:45 main:574] : INFO : Epoch 564 | loss: 0.0312491 | val_loss: 0.0312501 | Time: 2302.23 ms
[2022-03-29 21:23:47 main:574] : INFO : Epoch 565 | loss: 0.0312492 | val_loss: 0.0312496 | Time: 2326.32 ms
[2022-03-29 21:23:49 main:574] : INFO : Epoch 566 | loss: 0.0312486 | val_loss: 0.0312491 | Time: 2295.05 ms
[2022-03-29 21:23:53 main:574] : INFO : Epoch 567 | loss: 0.0312488 | val_loss: 0.0312501 | Time: 3462.15 ms
[2022-03-29 21:23:55 main:574] : INFO : Epoch 568 | loss: 0.0312489 | val_loss: 0.0312505 | Time: 2390.45 ms
[2022-03-29 21:24:03 main:574] : INFO : Epoch 569 | loss: 0.0312504 | val_loss: 0.0312494 | Time: 2371.53 ms
[2022-03-29 21:24:05 main:574] : INFO : Epoch 570 | loss: 0.0312498 | val_loss: 0.0312493 | Time: 2305.44 ms
[2022-03-29 21:24:08 main:574] : INFO : Epoch 571 | loss: 0.0312483 | val_loss: 0.0312515 | Time: 2304.6 ms
[2022-03-29 21:24:10 main:574] : INFO : Epoch 572 | loss: 0.0312495 | val_loss: 0.031249 | Time: 2316.66 ms
[2022-03-29 21:24:18 main:574] : INFO : Epoch 573 | loss: 0.0312486 | val_loss: 0.0312491 | Time: 7922.44 ms
[2022-03-29 21:24:20 main:574] : INFO : Epoch 574 | loss: 0.0312484 | val_loss: 0.0312492 | Time: 2299.91 ms
[2022-03-29 21:24:23 main:574] : INFO : Epoch 575 | loss: 0.0312497 | val_loss: 0.0312493 | Time: 2675.69 ms
[2022-03-29 21:24:25 main:574] : INFO : Epoch 576 | loss: 0.0312487 | val_loss: 0.0312504 | Time: 2307.25 ms
[2022-03-29 21:24:29 main:574] : INFO : Epoch 577 | loss: 0.0312494 | val_loss: 0.0312496 | Time: 3424.7 ms
[2022-03-29 21:24:31 main:574] : INFO : Epoch 578 | loss: 0.0312498 | val_loss: 0.0312541 | Time: 2268.1 ms
[2022-03-29 21:24:33 main:574] : INFO : Epoch 579 | loss: 0.0312499 | val_loss: 0.0312496 | Time: 2326.93 ms
[2022-03-29 21:24:36 main:574] : INFO : Epoch 580 | loss: 0.0312494 | val_loss: 0.0312494 | Time: 2319.93 ms
[2022-03-29 21:24:38 main:574] : INFO : Epoch 581 | loss: 0.0312489 | val_loss: 0.0312529 | Time: 2337.35 ms
[2022-03-29 21:24:41 main:574] : INFO : Epoch 582 | loss: 0.0312503 | val_loss: 0.0312529 | Time: 3433.07 ms
[2022-03-29 21:24:44 main:574] : INFO : Epoch 583 | loss: 0.0312493 | val_loss: 0.0312492 | Time: 2331.82 ms
[2022-03-29 21:25:09 main:574] : INFO : Epoch 584 | loss: 0.0312486 | val_loss: 0.03125 | Time: 19600.5 ms
[2022-03-29 21:25:11 main:574] : INFO : Epoch 585 | loss: 0.0312494 | val_loss: 0.0312501 | Time: 2292.58 ms
[2022-03-29 21:25:13 main:574] : INFO : Epoch 586 | loss: 0.0312485 | val_loss: 0.0312493 | Time: 2322.82 ms
[2022-03-29 21:25:17 main:574] : INFO : Epoch 587 | loss: 0.0312485 | val_loss: 0.0312492 | Time: 3774.57 ms
[2022-03-29 21:25:21 main:574] : INFO : Epoch 588 | loss: 0.0312489 | val_loss: 0.0312498 | Time: 3255.71 ms
[2022-03-29 21:25:23 main:574] : INFO : Epoch 589 | loss: 0.0312494 | val_loss: 0.0312518 | Time: 2265.03 ms
[2022-03-29 21:25:26 main:574] : INFO : Epoch 590 | loss: 0.0312488 | val_loss: 0.0312492 | Time: 2327.06 ms
[2022-03-29 21:25:53 main:574] : INFO : Epoch 591 | loss: 0.0312487 | val_loss: 0.0312507 | Time: 26794.6 ms
[2022-03-29 21:25:55 main:574] : INFO : Epoch 592 | loss: 0.0312483 | val_loss: 0.0312495 | Time: 2300.9 ms
[2022-03-29 21:25:57 main:574] : INFO : Epoch 593 | loss: 0.0312485 | val_loss: 0.0312492 | Time: 2295.99 ms
[2022-03-29 21:26:01 main:574] : INFO : Epoch 594 | loss: 0.0312488 | val_loss: 0.0312503 | Time: 3453.64 ms
[2022-03-29 21:26:03 main:574] : INFO : Epoch 595 | loss: 0.0312487 | val_loss: 0.0312491 | Time: 2286.01 ms
[2022-03-29 21:26:05 main:574] : INFO : Epoch 596 | loss: 0.0312485 | val_loss: 0.0312498 | Time: 2301.98 ms
[2022-03-29 21:26:24 main:574] : INFO : Epoch 597 | loss: 0.0312485 | val_loss: 0.031249 | Time: 18416.4 ms
[2022-03-29 21:26:26 main:574] : INFO : Epoch 598 | loss: 0.0312484 | val_loss: 0.0312498 | Time: 2294.14 ms
[2022-03-29 21:26:28 main:574] : INFO : Epoch 599 | loss: 0.0312484 | val_loss: 0.0312503 | Time: 2314.33 ms
[2022-03-29 21:26:32 main:574] : INFO : Epoch 600 | loss: 0.0312488 | val_loss: 0.0312505 | Time: 3419.43 ms
[2022-03-29 21:26:34 main:574] : INFO : Epoch 601 | loss: 0.0312498 | val_loss: 0.0312533 | Time: 2314.88 ms
[2022-03-29 21:26:36 main:574] : INFO : Epoch 602 | loss: 0.0312497 | val_loss: 0.0312494 | Time: 2350.6 ms
[2022-03-29 21:26:39 main:574] : INFO : Epoch 603 | loss: 0.0312484 | val_loss: 0.0312495 | Time: 2314.01 ms
[2022-03-29 21:26:41 main:574] : INFO : Epoch 604 | loss: 0.0312485 | val_loss: 0.0312496 | Time: 2321.8 ms
[2022-03-29 21:26:43 main:574] : INFO : Epoch 605 | loss: 0.0312483 | val_loss: 0.0312492 | Time: 2280.43 ms
[2022-03-29 21:26:47 main:574] : INFO : Epoch 606 | loss: 0.0312485 | val_loss: 0.0312493 | Time: 3430.21 ms
[2022-03-29 21:26:49 main:574] : INFO : Epoch 607 | loss: 0.0312482 | val_loss: 0.0312492 | Time: 2290.35 ms
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FF92E4C4F69
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 03/29/22 21:26:51
Install Directory : C:\Program Files\BOINC\
Data Directory : C:\ProgramData\BOINC
Project Symstore :
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\0;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 00000000be8e0000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000030ab0000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.1586
ModLoad: 000000002f7c0000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.1586
ModLoad: 000000002e490000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.1586
ModLoad: 00000000308d0000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.1586
ModLoad: 000000002e2e0000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1586) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1586
ModLoad: 00000000308a0000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.1202 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1202
ModLoad: 000000002e1d0000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 000000002e9c0000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 000000002e390000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 000000002f940000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.1586
ModLoad: 0000000030340000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.19041.546
ModLoad: 0000000030740000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.1586) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000002f5b0000 0000000000125000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.1586
ModLoad: 0000000022d00000 0000000000058000 C:\ProgramData\BOINC\slots\0\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000001d1b0000 0000000000091000 C:\ProgramData\BOINC\slots\0\MSVCP140.dll (14.27.29112.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.27.29112.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.27.29112.0
ModLoad: 0000000027790000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.867 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.867
ModLoad: 0000000029720000 0000000000019000 C:\ProgramData\BOINC\slots\0\VCRUNTIME140.dll (14.27.29112.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.27.29112.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.27.29112.0
ModLoad: 0000000029710000 000000000000c000 C:\ProgramData\BOINC\slots\0\VCRUNTIME140_1.dll (14.27.29112.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.27.29112.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.27.29112.0
ModLoad: 00000000b0f90000 0000000024b49000 C:\ProgramData\BOINC\slots\0\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000018870000 0000000000045000 C:\ProgramData\BOINC\slots\0\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000ee5d0000 00000000034b2000 C:\ProgramData\BOINC\slots\0\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 00000000a63a0000 000000000abe7000 C:\ProgramData\BOINC\slots\0\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000296e0000 0000000000010000 C:\ProgramData\BOINC\slots\0\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 00000000eb520000 00000000030a5000 C:\ProgramData\BOINC\slots\0\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 0000000084b70000 000000001b3a4000 C:\ProgramData\BOINC\slots\0\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 00000000122c0000 000000000020d000 C:\ProgramData\BOINC\slots\0\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 0000000005bd0000 00000000002db000 C:\ProgramData\BOINC\slots\0\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000186d0000 0000000000040000 C:\ProgramData\BOINC\slots\0\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000005fac0000 000000000919f000 C:\ProgramData\BOINC\slots\0\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 00000000e77c0000 0000000003d5b000 C:\ProgramData\BOINC\slots\0\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000e58f0000 0000000001eca000 C:\ProgramData\BOINC\slots\0\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 000000002f790000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000002c100000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000002fa70000 0000000000470000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.1586
ModLoad: 000000002e310000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1151
ModLoad: 000000002e360000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.1586
ModLoad: 000000002df70000 0000000000033000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 000000002e760000 0000000000068000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 000000002e860000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.1586
ModLoad: 000000002ddb0000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000002ed70000 0000000000744000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.1586
ModLoad: 000000002c300000 0000000000794000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.1586
ModLoad: 00000000303e0000 0000000000354000 C:\WINDOWS\System32\combase.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.1586
ModLoad: 000000002dc30000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.1586
ModLoad: 000000002f6e0000 00000000000ad000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.1586
ModLoad: 000000002eb10000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.19041.1586
ModLoad: 00000000a0a70000 00000000002b9000 C:\WINDOWS\system32\nvcuda.dll (30.0.14.9729) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r495\r497_25\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 30.0.14.9729
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.5.125 driver
Product Version : 30.0.14.9729
ModLoad: 0000000073540000 0000000001679000 C:\WINDOWS\system32\DriverStore\FileRepository\nvmdi.inf_amd64_697983dd21312b3c\nvcuda64.dll (30.0.14.9729) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r495\r497_25\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 30.0.14.9729
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.5.125 driver
Product Version : 30.0.14.9729
ModLoad: 00000000283e0000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000028380000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.906 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.906
ModLoad: 0000000026230000 0000000000148000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : drvstore.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 000000002dba0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000001a020000 0000000000762000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.14.9729) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r495\r497_25\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 30.0.14.9729
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 30.0.14.9729
ModLoad: 00000000296b0000 0000000000009000 C:\ProgramData\BOINC\slots\0\caffe2_nvrtc.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000a1290000 0000000000fca000 C:\ProgramData\BOINC\slots\0\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6.14.11.9000
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.89 NVRTC Library
Product Version : 6.14.11.9000
ModLoad: 000000002e7d0000 0000000000082000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.1415 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1415
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 4226, Write: 3137, Other 11065
- I/O Transfers Counters -
Read: 9027502, Write: 3217789, Other 74412
- Paged Pool Usage -
QuotaPagedPoolUsage: 3534768, QuotaPeakPagedPoolUsage: 3551152
QuotaNonPagedPoolUsage: 58608, QuotaPeakNonPagedPoolUsage: 58744
- Virtual Memory Usage -
VirtualSize: 342704128, PeakVirtualSize: 969744384
- Pagefile Usage -
PagefileUsage: 342704128, PeakPagefileUsage: 343281664
- Working Set Size -
WorkingSetSize: -1782104064, PeakWorkingSetSize: -1185734656, PageFaultCount: 6655226
*** Dump of thread ID 100872 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 139062496.000000, User Time: 13198906368.000000, Wait Time: 49880036.000000
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FF92E4C4F69
- Registers -
rax=0000000000000103 rbx=00000000b4a0af00 rcx=00000000ce536500 rdx=00000000346bb550 rsi=00000000b2555790 rdi=0000000019930520
r8=00000000735837af r9=0000000000000001 r10=00000000ce536540 r11=0000000000000009 r12=000000004c354b40 r13=000000004af96520
r14=00000000b2556548 r15=000000004bb6cfb0 rip=000000002e4c4f69 rsp=00000000b2555570 rbp=00000000b25557b0
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000206
- Callstack -
ChildEBP RetAddr Args to Child
b2555640 29726220 b2555730 4c2502e0 4bb6cfb0 000009bc KERNELBASE!RaiseException+0x0
b25556a0 b2f7094a b4333020 00000000 b2555750 000002cf VCRUNTIME140!_CxxThrowException+0x0
b2555860 b2f71e02 22d39c50 b2555a70 b2556fd0 b2555b00 torch_cuda!at::native::searchsorted_out_cuda+0x0
b2555a40 b2f7205a 00000001 b2556548 00000001 b2555ab8 torch_cuda!at::native::searchsorted_out_cuda+0x0
b2555a80 b3d63684 b2555b00 00000001 b2555ab8 00000001 torch_cuda!at::native::_local_scalar_dense_cuda+0x0
b2555ad0 b3d71107 b2555bf0 ab98bfac 00000001 b2555ab0 torch_cuda!at::native::set_storage_cuda_+0x0
b2555b20 abe26bbe b0cc0640 ce2ed940 00000000 ad872f07 torch_cuda!at::native::set_storage_cuda_+0x0
b2555d30 ad0d3c5e 00000000 b2556548 b2556548 b25560e0 torch_cpu!at::_local_scalar_dense+0x0
b2555d70 abdb29c7 b2556200 ab98bfac b2555e90 b2555e40 torch_cpu!torch::autograd::NotImplemented::~NotImplemented+0x0
b2555dc0 abe26bbe b0cc0640 b25561b8 00000000 b2556fd0 torch_cpu!at::native::mkldnn_sigmoid_+0x0
b2555fd0 abbddead b2555f58 00000001 b2556240 b25560e0 torch_cpu!at::_local_scalar_dense+0x0
b2556190 abf1d1e1 b25561c8 00000001 b2556240 b2556548 torch_cpu!at::native::item+0x0
b25561e0 ad134d4e b2556240 00000001 b25561c0 22d51ea8 torch_cpu!at::zeros_out+0x0
b2556210 abdb29c7 4c355420 ab98bfac 4c355430 22d51ea8 torch_cpu!torch::autograd::GraphRoot::apply+0x0
b2556260 abf4e69e b0cc0640 b2556290 b0cc0640 abf6129f torch_cpu!at::native::mkldnn_sigmoid_+0x0
b2556470 abf3a68e b25565d0 abc24e49 b2556590 b25565d0 torch_cpu!at::Tensor::item+0x0
b25564c0 be8f712b b2556590 b2556590 b2556590 b2556fd0 torch_cpu!at::Tensor::item<double>+0x0
b25569c0 be8fb950 b2556ac0 b2556ac0 00000000 a34cd9e0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0
b256f760 beb3c6f8 ce07a780 00000000 00000000 ce301ef0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
b256f7a0 2f7d7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
b256f7d0 30b02651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
b256f850 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 281460 (state: Waiting): ***
- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 49880068.000000
- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000b2cff7b0 rsi=0000000000000000 rdi=0000000000000064
r8=00000000000003ff r9=0000000000000000 r10=00000000b2cfe3a0 r11=00000000b2cfe50a r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000030b4d3f4 rsp=00000000b2cff788 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
b2cff780 2e4d962e b2cff848 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0
b2cff820 be91a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0
b2cff850 2f7d7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
b2cff880 30b02651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
b2cff900 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 227020 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 156250.000000, User Time: 156250.000000, Wait Time: 49880068.000000
- Registers -
rax=000000000000005b rbx=000000000000000e rcx=000000000000000e rdx=00000000b2dff5e0 rsi=0000000000000000 rdi=000000000000000e
r8=00000000ce531090 r9=0000000000000000 r10=0000000000000000 r11=00000000b2dff550 r12=0000000000000064 r13=00000000b2dff5e0
r14=00000000b2dff2e0 r15=0000000000000000 rip=0000000030b4d8c4 rsp=00000000b2dff288 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
b2dff280 2e4dcb20 00000000 b27d6000 30c1a4d0 b27d6000 ntdll!ZwWaitForMultipleObjects+0x0
b2dff570 2e4dca1e cc5627f0 004e0049 0000000e 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
b2dff5b0 73715be4 ce2b2e80 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0
b2dff7f0 737bd15d 00000000 ce2b0240 00000000 00000000 nvcuda64!+0x0
b2dff8a0 737155b3 a0ba5294 a01062f2 ce835ae0 00000000 nvcuda64!cuProfilerStop+0x0
b2dff8d0 73a44264 ce835ae0 00000000 00000000 00000000 nvcuda64!+0x0
b2dff900 2f7d7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
b2dff930 30b02651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
b2dff9b0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 177964 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 49880072.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=0000000000000084 rdx=0000000000000000 rsi=00000000b2effbe8 rdi=0000000000000084
r8=00000000b2effe38 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=00000000ce2947c0 r13=0000000000000000
r14=0000000000000084 r15=0000000000000001 rip=0000000030b4cdf4 rsp=00000000b2effbb8 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
b2effbb0 2e4b1a5e 0000001b 308ed489 b2effc58 00000000 ntdll!ZwWaitForSingleObject+0x0
b2effc50 739395ee cda471c0 00000000 00000000 00000084 KERNELBASE!WaitForSingleObjectEx+0x0
b2effe90 737155b3 00000000 ce8359c0 73540000 ce2eec50 nvcuda64!cuProfilerStop+0x0
b2effec0 73a44264 ce8359c0 00000000 00000000 00000000 nvcuda64!+0x0
b2effef0 2f7d7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
b2efff20 30b02651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
b2efffa0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 155300 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 137500000.000000, User Time: 2712812544.000000, Wait Time: 49879992.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000345b7318 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000345b7318
r8=00000000cc721800 r9=0000000000000001 r10=00000000b2ffb0f0 r11=00000000b2ff2000 r12=0000000000000000 r13=0000000000000000
r14=00000000b2fff360 r15=00000000345b72c8 rip=0000000030b50764 rsp=00000000b2fff338 rbp=00000000b2fff390
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
b2fff330 30b14021 38ed56c8 38ed56c8 b2fff470 38ed56c8 ntdll!NtWaitForAlertByThreadId+0x0
b2fff3b0 2e4fcfa9 345b72c0 345b7308 00000000 00000000 ntdll!RtlSleepConditionVariableSRW+0x0
b2fff3f0 1d1eba8d 1f752c30 1f752c30 1f752c30 00000000 KERNELBASE!SleepConditionVariableSRW+0x0
b2fff430 1d1c2848 4619e5b0 00000000 00000000 ad5805b4 MSVCP140!__crtSetThreadpoolWait+0x0
b2fff460 1d1c2710 00000000 1d1c2f17 00000000 4619e5b0 MSVCP140!std::_Winerror_message+0x0
b2fff4d0 ad58064b 4619e590 000001c0 345b72c0 345b72c0 MSVCP140!std::_Winerror_message+0x0
b2fff510 ad5825b1 4c1ca7a0 ffffffff 4619e590 ffffffff torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
b2fff800 ad582471 b0aa6d10 b2fff840 b0aa6d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0
b2fff850 ad579744 00080001 4c25de10 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0
b2fff880 2e3b1bb2 4c25de10 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0
b2fff8b0 2f7d7034 00000000 00000000 00000000 00000000 ucrtbase!_configthreadlocale+0x0
b2fff8e0 30b02651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
b2fff960 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 308748 (state: Ready): ***
- Information -
Status: Base Priority: Unknown, Priority: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 49880024.000000
- Registers -
rax=00000000000001d3 rbx=000000008eb7fe50 rcx=0000000000000070 rdx=000000008eb7fad0 rsi=00000000cc5530b0 rdi=000000008eb7fe50
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000030b507c4 rsp=00000000b28ff458 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
b28ff450 30b02dc7 00000000 00000000 cc5530b0 00000000 ntdll!ZwWaitForWorkViaWorkerFactory+0x0
b28ff750 2f7d7034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0
b28ff780 30b02651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
b28ff800 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)