Task 7553808

Name ParityModified-1631727172-21859-1_2
Workunit 5068647
Created 23 Sep 2021, 20:59:04 UTC
Sent 23 Sep 2021, 22:01:04 UTC
Report deadline 30 Sep 2021, 22:01:04 UTC
Received 24 Sep 2021, 2:00:40 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 9683
Run time 19 min 14 sec
CPU time 18 min 49 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 15,279.89 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 2.10 GB
Peak swap size 4.44 GB
Peak disk usage 1.53 GB

Stderr output

<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
ms
[2021-09-24 03:16:19	                main:574]	:	INFO	:	Epoch 399 | loss: 0.0310933 | val_loss: 0.0311811 | Time: 1808.39 ms
[2021-09-24 03:16:20	                main:574]	:	INFO	:	Epoch 400 | loss: 0.031079 | val_loss: 0.031188 | Time: 1770.07 ms
[2021-09-24 03:16:22	                main:574]	:	INFO	:	Epoch 401 | loss: 0.0310729 | val_loss: 0.0311717 | Time: 1711.87 ms
[2021-09-24 03:16:34	                main:574]	:	INFO	:	Epoch 402 | loss: 0.0310638 | val_loss: 0.0311852 | Time: 12038.1 ms
[2021-09-24 03:16:36	                main:574]	:	INFO	:	Epoch 403 | loss: 0.031061 | val_loss: 0.0311902 | Time: 1678.43 ms
[2021-09-24 03:16:37	                main:574]	:	INFO	:	Epoch 404 | loss: 0.0310583 | val_loss: 0.0311937 | Time: 1667.88 ms
[2021-09-24 03:16:39	                main:574]	:	INFO	:	Epoch 405 | loss: 0.0310634 | val_loss: 0.031184 | Time: 1788.62 ms
[2021-09-24 03:16:41	                main:574]	:	INFO	:	Epoch 406 | loss: 0.0310672 | val_loss: 0.0311855 | Time: 1818.36 ms
[2021-09-24 03:16:43	                main:574]	:	INFO	:	Epoch 407 | loss: 0.0310643 | val_loss: 0.0311869 | Time: 1803.7 ms
[2021-09-24 03:16:45	                main:574]	:	INFO	:	Epoch 408 | loss: 0.0310553 | val_loss: 0.0311957 | Time: 1815.12 ms
[2021-09-24 03:16:46	                main:574]	:	INFO	:	Epoch 409 | loss: 0.0310489 | val_loss: 0.0311903 | Time: 1801.33 ms
[2021-09-24 03:16:48	                main:574]	:	INFO	:	Epoch 410 | loss: 0.0310522 | val_loss: 0.0311938 | Time: 1686.63 ms
[2021-09-24 03:16:50	                main:574]	:	INFO	:	Epoch 411 | loss: 0.0310656 | val_loss: 0.0311886 | Time: 1697.05 ms
[2021-09-24 03:16:52	                main:574]	:	INFO	:	Epoch 412 | loss: 0.0310602 | val_loss: 0.0312016 | Time: 1672.97 ms
[2021-09-24 03:16:53	                main:574]	:	INFO	:	Epoch 413 | loss: 0.0310556 | val_loss: 0.0311927 | Time: 1799.19 ms
[2021-09-24 03:17:05	                main:574]	:	INFO	:	Epoch 414 | loss: 0.0310489 | val_loss: 0.0311993 | Time: 11920.8 ms
[2021-09-24 03:17:07	                main:574]	:	INFO	:	Epoch 415 | loss: 0.031042 | val_loss: 0.0311986 | Time: 1794.39 ms
[2021-09-24 03:17:09	                main:574]	:	INFO	:	Epoch 416 | loss: 0.0310433 | val_loss: 0.0311885 | Time: 1827.19 ms
[2021-09-24 03:17:11	                main:574]	:	INFO	:	Epoch 417 | loss: 0.0310649 | val_loss: 0.0311927 | Time: 1813.75 ms
[2021-09-24 03:17:12	                main:574]	:	INFO	:	Epoch 418 | loss: 0.0310534 | val_loss: 0.0312004 | Time: 1706.16 ms
[2021-09-24 03:17:14	                main:574]	:	INFO	:	Epoch 419 | loss: 0.0310497 | val_loss: 0.0311921 | Time: 1768.95 ms
[2021-09-24 03:17:16	                main:574]	:	INFO	:	Epoch 420 | loss: 0.0310434 | val_loss: 0.0312043 | Time: 1711.46 ms
[2021-09-24 03:17:18	                main:574]	:	INFO	:	Epoch 421 | loss: 0.0310471 | val_loss: 0.0312061 | Time: 1758.94 ms
[2021-09-24 03:17:20	                main:574]	:	INFO	:	Epoch 422 | loss: 0.0310448 | val_loss: 0.0311971 | Time: 1824.12 ms
[2021-09-24 03:17:21	                main:574]	:	INFO	:	Epoch 423 | loss: 0.0310458 | val_loss: 0.0312002 | Time: 1853.68 ms
[2021-09-24 03:17:23	                main:574]	:	INFO	:	Epoch 424 | loss: 0.0310454 | val_loss: 0.0312034 | Time: 1841.11 ms
[2021-09-24 03:17:35	                main:574]	:	INFO	:	Epoch 425 | loss: 0.0310481 | val_loss: 0.0312096 | Time: 11925.4 ms
[2021-09-24 03:17:37	                main:574]	:	INFO	:	Epoch 426 | loss: 0.0310518 | val_loss: 0.0312026 | Time: 1887.54 ms
[2021-09-24 03:17:39	                main:574]	:	INFO	:	Epoch 427 | loss: 0.031049 | val_loss: 0.0311991 | Time: 1795.33 ms
[2021-09-24 03:17:41	                main:574]	:	INFO	:	Epoch 428 | loss: 0.0310449 | val_loss: 0.0312028 | Time: 1705.61 ms
[2021-09-24 03:17:42	                main:574]	:	INFO	:	Epoch 429 | loss: 0.0310463 | val_loss: 0.0311998 | Time: 1721.57 ms
[2021-09-24 03:17:44	                main:574]	:	INFO	:	Epoch 430 | loss: 0.0310435 | val_loss: 0.0312005 | Time: 1697.43 ms
[2021-09-24 03:17:46	                main:574]	:	INFO	:	Epoch 431 | loss: 0.0310474 | val_loss: 0.0312112 | Time: 1834.97 ms
[2021-09-24 03:17:48	                main:574]	:	INFO	:	Epoch 432 | loss: 0.0310497 | val_loss: 0.0312341 | Time: 1799.19 ms
[2021-09-24 03:17:50	                main:574]	:	INFO	:	Epoch 433 | loss: 0.0317495 | val_loss: 0.0314247 | Time: 1841.08 ms
[2021-09-24 03:17:51	                main:574]	:	INFO	:	Epoch 434 | loss: 0.0322389 | val_loss: 0.0313349 | Time: 1829.79 ms
[2021-09-24 03:17:53	                main:574]	:	INFO	:	Epoch 435 | loss: 0.0312881 | val_loss: 0.0312246 | Time: 1855.22 ms
[2021-09-24 03:17:55	                main:574]	:	INFO	:	Epoch 436 | loss: 0.0311918 | val_loss: 0.031168 | Time: 1761.92 ms
[2021-09-24 03:17:57	                main:574]	:	INFO	:	Epoch 437 | loss: 0.0311528 | val_loss: 0.0311577 | Time: 1744.97 ms
[2021-09-24 03:17:59	                main:574]	:	INFO	:	Epoch 438 | loss: 0.0311358 | val_loss: 0.0311598 | Time: 1812.08 ms
[2021-09-24 03:18:00	                main:574]	:	INFO	:	Epoch 439 | loss: 0.0311267 | val_loss: 0.0311538 | Time: 1727.77 ms
[2021-09-24 03:18:02	                main:574]	:	INFO	:	Epoch 440 | loss: 0.0311184 | val_loss: 0.0311575 | Time: 1809.67 ms
[2021-09-24 03:18:04	                main:574]	:	INFO	:	Epoch 441 | loss: 0.0311137 | val_loss: 0.0311613 | Time: 1885.63 ms
[2021-09-24 03:18:17	                main:574]	:	INFO	:	Epoch 442 | loss: 0.0311055 | val_loss: 0.0311537 | Time: 12546 ms
[2021-09-24 03:18:18	                main:574]	:	INFO	:	Epoch 443 | loss: 0.0310993 | val_loss: 0.0311588 | Time: 1818.65 ms
[2021-09-24 03:18:20	                main:574]	:	INFO	:	Epoch 444 | loss: 0.0310961 | val_loss: 0.0311628 | Time: 1667.31 ms
[2021-09-24 03:18:22	                main:574]	:	INFO	:	Epoch 445 | loss: 0.0310938 | val_loss: 0.0311598 | Time: 1785.71 ms
[2021-09-24 03:18:24	                main:574]	:	INFO	:	Epoch 446 | loss: 0.0310887 | val_loss: 0.0311646 | Time: 1834.6 ms
[2021-09-24 03:18:25	                main:574]	:	INFO	:	Epoch 447 | loss: 0.031088 | val_loss: 0.03116 | Time: 1813.42 ms
[2021-09-24 03:18:27	                main:574]	:	INFO	:	Epoch 448 | loss: 0.0310871 | val_loss: 0.0311615 | Time: 1845.74 ms
[2021-09-24 03:18:29	                main:574]	:	INFO	:	Epoch 449 | loss: 0.0310845 | val_loss: 0.0311637 | Time: 1826.44 ms
[2021-09-24 03:18:31	                main:574]	:	INFO	:	Epoch 450 | loss: 0.0311523 | val_loss: 0.0312717 | Time: 1783.52 ms
[2021-09-24 03:18:33	                main:574]	:	INFO	:	Epoch 451 | loss: 0.0312644 | val_loss: 0.0312543 | Time: 1695.46 ms
[2021-09-24 03:18:34	                main:574]	:	INFO	:	Epoch 452 | loss: nan | val_loss: nan | Time: 1703.2 ms
[2021-09-24 03:18:36	                main:574]	:	INFO	:	Epoch 453 | loss: nan | val_loss: nan | Time: 1706.11 ms
[2021-09-24 03:18:38	                main:574]	:	INFO	:	Epoch 454 | loss: nan | val_loss: nan | Time: 1803.83 ms
[2021-09-24 03:18:40	                main:574]	:	INFO	:	Epoch 455 | loss: nan | val_loss: nan | Time: 1818.36 ms
[2021-09-24 03:18:42	                main:574]	:	INFO	:	Epoch 456 | loss: nan | val_loss: nan | Time: 1822.7 ms
[2021-09-24 03:18:43	                main:574]	:	INFO	:	Epoch 457 | loss: nan | val_loss: nan | Time: 1831.99 ms
[2021-09-24 03:18:45	                main:574]	:	INFO	:	Epoch 458 | loss: nan | val_loss: nan | Time: 1833.88 ms
[2021-09-24 03:18:47	                main:574]	:	INFO	:	Epoch 459 | loss: nan | val_loss: nan | Time: 1757.81 ms
[2021-09-24 03:18:49	                main:574]	:	INFO	:	Epoch 460 | loss: nan | val_loss: nan | Time: 1740.23 ms
[2021-09-24 03:18:50	                main:574]	:	INFO	:	Epoch 461 | loss: nan | val_loss: nan | Time: 1707.06 ms
[2021-09-24 03:18:52	                main:574]	:	INFO	:	Epoch 462 | loss: nan | val_loss: nan | Time: 1748.91 ms
[2021-09-24 03:18:54	                main:574]	:	INFO	:	Epoch 463 | loss: nan | val_loss: nan | Time: 1836.6 ms
[2021-09-24 03:19:06	                main:574]	:	INFO	:	Epoch 464 | loss: nan | val_loss: nan | Time: 12296.2 ms
[2021-09-24 03:19:08	                main:574]	:	INFO	:	Epoch 465 | loss: nan | val_loss: nan | Time: 1798.6 ms
[2021-09-24 03:19:10	                main:574]	:	INFO	:	Epoch 466 | loss: nan | val_loss: nan | Time: 1832.59 ms
[2021-09-24 03:19:12	                main:574]	:	INFO	:	Epoch 467 | loss: nan | val_loss: nan | Time: 1853.2 ms
[2021-09-24 03:19:14	                main:574]	:	INFO	:	Epoch 468 | loss: nan | val_loss: nan | Time: 1844.08 ms
[2021-09-24 03:19:16	                main:574]	:	INFO	:	Epoch 469 | loss: nan | val_loss: nan | Time: 1837.06 ms
[2021-09-24 03:19:17	                main:574]	:	INFO	:	Epoch 470 | loss: nan | val_loss: nan | Time: 1737.41 ms
[2021-09-24 03:19:19	                main:574]	:	INFO	:	Epoch 471 | loss: nan | val_loss: nan | Time: 1662.4 ms
[2021-09-24 03:19:21	                main:574]	:	INFO	:	Epoch 472 | loss: nan | val_loss: nan | Time: 1731.96 ms
[2021-09-24 03:19:22	                main:574]	:	INFO	:	Epoch 473 | loss: nan | val_loss: nan | Time: 1758.21 ms
[2021-09-24 03:19:24	                main:574]	:	INFO	:	Epoch 474 | loss: nan | val_loss: nan | Time: 1857.19 ms
[2021-09-24 03:19:47	                main:574]	:	INFO	:	Epoch 475 | loss: nan | val_loss: nan | Time: 22449.3 ms
[2021-09-24 03:19:49	                main:574]	:	INFO	:	Epoch 476 | loss: nan | val_loss: nan | Time: 1765.1 ms
[2021-09-24 03:19:50	                main:574]	:	INFO	:	Epoch 477 | loss: nan | val_loss: nan | Time: 1836.34 ms
[2021-09-24 03:19:52	                main:574]	:	INFO	:	Epoch 478 | loss: nan | val_loss: nan | Time: 1835.2 ms
[2021-09-24 03:19:54	                main:574]	:	INFO	:	Epoch 479 | loss: nan | val_loss: nan | Time: 1819.58 ms
[2021-09-24 03:19:56	                main:574]	:	INFO	:	Epoch 480 | loss: nan | val_loss: nan | Time: 1838.46 ms
[2021-09-24 03:19:58	                main:574]	:	INFO	:	Epoch 481 | loss: nan | val_loss: nan | Time: 1827.03 ms
[2021-09-24 03:20:00	                main:574]	:	INFO	:	Epoch 482 | loss: nan | val_loss: nan | Time: 1750.32 ms
[2021-09-24 03:20:01	                main:574]	:	INFO	:	Epoch 483 | loss: nan | val_loss: nan | Time: 1735.27 ms
[2021-09-24 03:20:03	                main:574]	:	INFO	:	Epoch 484 | loss: nan | val_loss: nan | Time: 1711.94 ms
[2021-09-24 03:20:05	                main:574]	:	INFO	:	Epoch 485 | loss: nan | val_loss: nan | Time: 1728.99 ms
[2021-09-24 03:20:07	                main:574]	:	INFO	:	Epoch 486 | loss: nan | val_loss: nan | Time: 1799.14 ms
[2021-09-24 03:20:08	                main:574]	:	INFO	:	Epoch 487 | loss: nan | val_loss: nan | Time: 1807.67 ms
[2021-09-24 03:20:10	                main:574]	:	INFO	:	Epoch 488 | loss: nan | val_loss: nan | Time: 1807.24 ms
[2021-09-24 03:20:12	                main:574]	:	INFO	:	Epoch 489 | loss: nan | val_loss: nan | Time: 1801.49 ms
[2021-09-24 03:20:14	                main:574]	:	INFO	:	Epoch 490 | loss: nan | val_loss: nan | Time: 1748.59 ms
[2021-09-24 03:20:15	                main:574]	:	INFO	:	Epoch 491 | loss: nan | val_loss: nan | Time: 1693.49 ms
[2021-09-24 03:20:17	                main:574]	:	INFO	:	Epoch 492 | loss: nan | val_loss: nan | Time: 1769.52 ms
[2021-09-24 03:20:19	                main:574]	:	INFO	:	Epoch 493 | loss: nan | val_loss: nan | Time: 1754.09 ms
[2021-09-24 03:20:21	                main:574]	:	INFO	:	Epoch 494 | loss: nan | val_loss: nan | Time: 1814.92 ms
[2021-09-24 03:20:23	                main:574]	:	INFO	:	Epoch 495 | loss: nan | val_loss: nan | Time: 1852.45 ms
[2021-09-24 03:20:25	                main:574]	:	INFO	:	Epoch 496 | loss: nan | val_loss: nan | Time: 1817.8 ms
[2021-09-24 03:20:26	                main:574]	:	INFO	:	Epoch 497 | loss: nan | val_loss: nan | Time: 1811.92 ms
[2021-09-24 03:20:38	                main:574]	:	INFO	:	Epoch 498 | loss: nan | val_loss: nan | Time: 12119.6 ms
[2021-09-24 03:20:40	                main:574]	:	INFO	:	Epoch 499 | loss: nan | val_loss: nan | Time: 1842.79 ms
[2021-09-24 03:20:42	                main:574]	:	INFO	:	Epoch 500 | loss: nan | val_loss: nan | Time: 1801.01 ms
[2021-09-24 03:20:44	                main:574]	:	INFO	:	Epoch 501 | loss: nan | val_loss: nan | Time: 1764.48 ms
[2021-09-24 03:20:46	                main:574]	:	INFO	:	Epoch 502 | loss: nan | val_loss: nan | Time: 1739.71 ms
[2021-09-24 03:20:47	                main:574]	:	INFO	:	Epoch 503 | loss: nan | val_loss: nan | Time: 1730.62 ms
[2021-09-24 03:20:49	                main:574]	:	INFO	:	Epoch 504 | loss: nan | val_loss: nan | Time: 1732.65 ms
[2021-09-24 03:20:51	                main:574]	:	INFO	:	Epoch 505 | loss: nan | val_loss: nan | Time: 1841.59 ms
[2021-09-24 03:20:53	                main:574]	:	INFO	:	Epoch 506 | loss: nan | val_loss: nan | Time: 1853.21 ms
[2021-09-24 03:20:55	                main:574]	:	INFO	:	Epoch 507 | loss: nan | val_loss: nan | Time: 1836.04 ms
[2021-09-24 03:20:57	                main:574]	:	INFO	:	Epoch 508 | loss: nan | val_loss: nan | Time: 1842.71 ms
[2021-09-24 03:20:58	                main:574]	:	INFO	:	Epoch 509 | loss: nan | val_loss: nan | Time: 1829.8 ms
[2021-09-24 03:21:00	                main:574]	:	INFO	:	Epoch 510 | loss: nan | val_loss: nan | Time: 1861.01 ms
[2021-09-24 03:21:02	                main:574]	:	INFO	:	Epoch 511 | loss: nan | val_loss: nan | Time: 1694.03 ms
[2021-09-24 03:21:04	                main:574]	:	INFO	:	Epoch 512 | loss: nan | val_loss: nan | Time: 1694.66 ms
[2021-09-24 03:21:05	                main:574]	:	INFO	:	Epoch 513 | loss: nan | val_loss: nan | Time: 1734.75 ms
[2021-09-24 03:21:17	                main:574]	:	INFO	:	Epoch 514 | loss: nan | val_loss: nan | Time: 12077.3 ms
[2021-09-24 03:21:19	                main:574]	:	INFO	:	Epoch 515 | loss: nan | val_loss: nan | Time: 1791.64 ms
[2021-09-24 03:21:21	                main:574]	:	INFO	:	Epoch 516 | loss: nan | val_loss: nan | Time: 1865.92 ms
[2021-09-24 03:21:23	                main:574]	:	INFO	:	Epoch 517 | loss: nan | val_loss: nan | Time: 1852.48 ms
[2021-09-24 03:21:25	                main:574]	:	INFO	:	Epoch 518 | loss: nan | val_loss: nan | Time: 1825.77 ms
[2021-09-24 03:21:27	                main:574]	:	INFO	:	Epoch 519 | loss: nan | val_loss: nan | Time: 1844.8 ms
[2021-09-24 03:21:39	                main:574]	:	INFO	:	Epoch 520 | loss: nan | val_loss: nan | Time: 12012 ms
[2021-09-24 03:21:40	                main:574]	:	INFO	:	Epoch 521 | loss: nan | val_loss: nan | Time: 1815.24 ms
[2021-09-24 03:21:42	                main:574]	:	INFO	:	Epoch 522 | loss: nan | val_loss: nan | Time: 1745.03 ms
[2021-09-24 03:21:44	                main:574]	:	INFO	:	Epoch 523 | loss: nan | val_loss: nan | Time: 1720.13 ms
[2021-09-24 03:21:46	                main:574]	:	INFO	:	Epoch 524 | loss: nan | val_loss: nan | Time: 1734.6 ms
[2021-09-24 03:21:48	                main:574]	:	INFO	:	Epoch 525 | loss: nan | val_loss: nan | Time: 1756.01 ms
[2021-09-24 03:21:49	                main:574]	:	INFO	:	Epoch 526 | loss: nan | val_loss: nan | Time: 1849.67 ms
[2021-09-24 03:21:51	                main:574]	:	INFO	:	Epoch 527 | loss: nan | val_loss: nan | Time: 1835.59 ms
[2021-09-24 03:21:53	                main:574]	:	INFO	:	Epoch 528 | loss: nan | val_loss: nan | Time: 1845.71 ms
[2021-09-24 03:21:55	                main:574]	:	INFO	:	Epoch 529 | loss: nan | val_loss: nan | Time: 1859.72 ms
[2021-09-24 03:21:57	                main:574]	:	INFO	:	Epoch 530 | loss: nan | val_loss: nan | Time: 1821.26 ms
[2021-09-24 03:21:58	                main:574]	:	INFO	:	Epoch 531 | loss: nan | val_loss: nan | Time: 1710.62 ms
[2021-09-24 03:22:00	                main:574]	:	INFO	:	Epoch 532 | loss: nan | val_loss: nan | Time: 1743.12 ms
[2021-09-24 03:22:02	                main:574]	:	INFO	:	Epoch 533 | loss: nan | val_loss: nan | Time: 1748.07 ms
[2021-09-24 03:22:04	                main:574]	:	INFO	:	Epoch 534 | loss: nan | val_loss: nan | Time: 1761.02 ms
[2021-09-24 03:22:06	                main:574]	:	INFO	:	Epoch 535 | loss: nan | val_loss: nan | Time: 1861.4 ms
[2021-09-24 03:22:07	                main:574]	:	INFO	:	Epoch 536 | loss: nan | val_loss: nan | Time: 1848.31 ms
[2021-09-24 03:22:09	                main:574]	:	INFO	:	Epoch 537 | loss: nan | val_loss: nan | Time: 1819.35 ms
[2021-09-24 03:22:11	                main:574]	:	INFO	:	Epoch 538 | loss: nan | val_loss: nan | Time: 1851.05 ms
[2021-09-24 03:22:13	                main:574]	:	INFO	:	Epoch 539 | loss: nan | val_loss: nan | Time: 1833.11 ms
[2021-09-24 03:22:15	                main:574]	:	INFO	:	Epoch 540 | loss: nan | val_loss: nan | Time: 1786.85 ms
[2021-09-24 03:22:17	                main:574]	:	INFO	:	Epoch 541 | loss: nan | val_loss: nan | Time: 1768.95 ms
[2021-09-24 03:22:39	                main:574]	:	INFO	:	Epoch 542 | loss: nan | val_loss: nan | Time: 22074.5 ms
[2021-09-24 03:22:40	                main:574]	:	INFO	:	Epoch 543 | loss: nan | val_loss: nan | Time: 1724.13 ms
[2021-09-24 03:22:42	                main:574]	:	INFO	:	Epoch 544 | loss: nan | val_loss: nan | Time: 1742.22 ms
[2021-09-24 03:22:44	                main:574]	:	INFO	:	Epoch 545 | loss: nan | val_loss: nan | Time: 1747.8 ms
[2021-09-24 03:22:46	                main:574]	:	INFO	:	Epoch 546 | loss: nan | val_loss: nan | Time: 1813.84 ms
[2021-09-24 03:22:48	                main:574]	:	INFO	:	Epoch 547 | loss: nan | val_loss: nan | Time: 1839.33 ms
[2021-09-24 03:22:49	                main:574]	:	INFO	:	Epoch 548 | loss: nan | val_loss: nan | Time: 1823.01 ms
[2021-09-24 03:22:51	                main:574]	:	INFO	:	Epoch 549 | loss: nan | val_loss: nan | Time: 1817.78 ms
[2021-09-24 03:22:53	                main:574]	:	INFO	:	Epoch 550 | loss: nan | val_loss: nan | Time: 1771.56 ms
[2021-09-24 03:22:55	                main:574]	:	INFO	:	Epoch 551 | loss: nan | val_loss: nan | Time: 1699.04 ms
[2021-09-24 03:22:57	                main:574]	:	INFO	:	Epoch 552 | loss: nan | val_loss: nan | Time: 1846.65 ms
[2021-09-24 03:22:58	                main:574]	:	INFO	:	Epoch 553 | loss: nan | val_loss: nan | Time: 1730.19 ms
[2021-09-24 03:23:00	                main:574]	:	INFO	:	Epoch 554 | loss: nan | val_loss: nan | Time: 1886 ms
[2021-09-24 03:23:02	                main:574]	:	INFO	:	Epoch 555 | loss: nan | val_loss: nan | Time: 1826.84 ms
[2021-09-24 03:23:04	                main:574]	:	INFO	:	Epoch 556 | loss: nan | val_loss: nan | Time: 1808.32 ms
[2021-09-24 03:23:06	                main:574]	:	INFO	:	Epoch 557 | loss: nan | val_loss: nan | Time: 1803.09 ms
[2021-09-24 03:23:07	                main:574]	:	INFO	:	Epoch 558 | loss: nan | val_loss: nan | Time: 1823.24 ms
[2021-09-24 03:23:09	                main:574]	:	INFO	:	Epoch 559 | loss: nan | val_loss: nan | Time: 1798.16 ms
[2021-09-24 03:23:11	                main:574]	:	INFO	:	Epoch 560 | loss: nan | val_loss: nan | Time: 1722.83 ms
[2021-09-24 03:23:13	                main:574]	:	INFO	:	Epoch 561 | loss: nan | val_loss: nan | Time: 1698.52 ms
[2021-09-24 03:23:14	                main:574]	:	INFO	:	Epoch 562 | loss: nan | val_loss: nan | Time: 1681.2 ms
[2021-09-24 03:23:16	                main:574]	:	INFO	:	Epoch 563 | loss: nan | val_loss: nan | Time: 1800.38 ms
[2021-09-24 03:23:18	                main:574]	:	INFO	:	Epoch 564 | loss: nan | val_loss: nan | Time: 1802.63 ms
[2021-09-24 03:23:20	                main:574]	:	INFO	:	Epoch 565 | loss: nan | val_loss: nan | Time: 1826 ms
[2021-09-24 03:23:22	                main:574]	:	INFO	:	Epoch 566 | loss: nan | val_loss: nan | Time: 1829.03 ms
[2021-09-24 03:23:24	                main:574]	:	INFO	:	Epoch 567 | loss: nan | val_loss: nan | Time: 1812.57 ms
[2021-09-24 03:23:25	                main:574]	:	INFO	:	Epoch 568 | loss: nan | val_loss: nan | Time: 1773.96 ms
[2021-09-24 03:23:27	                main:574]	:	INFO	:	Epoch 569 | loss: nan | val_loss: nan | Time: 1712.77 ms
[2021-09-24 03:23:39	                main:574]	:	INFO	:	Epoch 570 | loss: nan | val_loss: nan | Time: 11885.2 ms
[2021-09-24 03:23:41	                main:574]	:	INFO	:	Epoch 571 | loss: nan | val_loss: nan | Time: 1798.63 ms
[2021-09-24 03:23:42	                main:574]	:	INFO	:	Epoch 572 | loss: nan | val_loss: nan | Time: 1774.41 ms
[2021-09-24 03:23:44	                main:574]	:	INFO	:	Epoch 573 | loss: nan | val_loss: nan | Time: 1849.86 ms
[2021-09-24 03:23:46	                main:574]	:	INFO	:	Epoch 574 | loss: nan | val_loss: nan | Time: 1840.83 ms
[2021-09-24 03:23:48	                main:574]	:	INFO	:	Epoch 575 | loss: nan | val_loss: nan | Time: 1823.54 ms
[2021-09-24 03:23:50	                main:574]	:	INFO	:	Epoch 576 | loss: nan | val_loss: nan | Time: 1822.19 ms
[2021-09-24 03:23:52	                main:574]	:	INFO	:	Epoch 577 | loss: nan | val_loss: nan | Time: 1761.18 ms
[2021-09-24 03:23:53	                main:574]	:	INFO	:	Epoch 578 | loss: nan | val_loss: nan | Time: 1678.17 ms
[2021-09-24 03:23:55	                main:574]	:	INFO	:	Epoch 579 | loss: nan | val_loss: nan | Time: 1712.69 ms
[2021-09-24 03:23:57	                main:574]	:	INFO	:	Epoch 580 | loss: nan | val_loss: nan | Time: 1771.97 ms
[2021-09-24 03:23:59	                main:574]	:	INFO	:	Epoch 581 | loss: nan | val_loss: nan | Time: 1802.19 ms
[2021-09-24 03:24:00	                main:574]	:	INFO	:	Epoch 582 | loss: nan | val_loss: nan | Time: 1787.65 ms
[2021-09-24 03:24:02	                main:574]	:	INFO	:	Epoch 583 | loss: nan | val_loss: nan | Time: 1788.94 ms
[2021-09-24 03:24:04	                main:574]	:	INFO	:	Epoch 584 | loss: nan | val_loss: nan | Time: 1824.26 ms
[2021-09-24 03:24:06	                main:574]	:	INFO	:	Epoch 585 | loss: nan | val_loss: nan | Time: 1757.36 ms
[2021-09-24 03:24:07	                main:574]	:	INFO	:	Epoch 586 | loss: nan | val_loss: nan | Time: 1714.25 ms
[2021-09-24 03:24:09	                main:574]	:	INFO	:	Epoch 587 | loss: nan | val_loss: nan | Time: 1731.4 ms
[2021-09-24 03:24:11	                main:574]	:	INFO	:	Epoch 588 | loss: nan | val_loss: nan | Time: 1699.2 ms
[2021-09-24 03:24:13	                main:574]	:	INFO	:	Epoch 589 | loss: nan | val_loss: nan | Time: 1777.43 ms
[2021-09-24 03:24:15	                main:574]	:	INFO	:	Epoch 590 | loss: nan | val_loss: nan | Time: 1785.08 ms
[2021-09-24 03:24:16	                main:574]	:	INFO	:	Epoch 591 | loss: nan | val_loss: nan | Time: 1803.51 ms
[2021-09-24 03:24:18	                main:574]	:	INFO	:	Epoch 592 | loss: nan | val_loss: nan | Time: 1813.3 ms
[2021-09-24 03:24:40	                main:574]	:	INFO	:	Epoch 593 | loss: nan | val_loss: nan | Time: 22018 ms
[2021-09-24 03:24:42	                main:574]	:	INFO	:	Epoch 594 | loss: nan | val_loss: nan | Time: 1738.18 ms
[2021-09-24 03:24:44	                main:574]	:	INFO	:	Epoch 595 | loss: nan | val_loss: nan | Time: 1663.4 ms
[2021-09-24 03:24:45	                main:574]	:	INFO	:	Epoch 596 | loss: nan | val_loss: nan | Time: 1692.8 ms
[2021-09-24 03:24:47	                main:574]	:	INFO	:	Epoch 597 | loss: nan | val_loss: nan | Time: 1752.98 ms
[2021-09-24 03:24:49	                main:574]	:	INFO	:	Epoch 598 | loss: nan | val_loss: nan | Time: 1818.41 ms
[2021-09-24 03:24:51	                main:574]	:	INFO	:	Epoch 599 | loss: nan | val_loss: nan | Time: 1776.91 ms
[2021-09-24 03:24:52	                main:574]	:	INFO	:	Epoch 600 | loss: nan | val_loss: nan | Time: 1814.66 ms
[2021-09-24 03:24:54	                main:574]	:	INFO	:	Epoch 601 | loss: nan | val_loss: nan | Time: 1812.73 ms
[2021-09-24 03:24:56	                main:574]	:	INFO	:	Epoch 602 | loss: nan | val_loss: nan | Time: 1710.64 ms
[2021-09-24 03:24:58	                main:574]	:	INFO	:	Epoch 603 | loss: nan | val_loss: nan | Time: 1703.8 ms
[2021-09-24 03:24:59	                main:574]	:	INFO	:	Epoch 604 | loss: nan | val_loss: nan | Time: 1715.86 ms
[2021-09-24 03:25:01	                main:574]	:	INFO	:	Epoch 605 | loss: nan | val_loss: nan | Time: 1747.89 ms
[2021-09-24 03:25:03	                main:574]	:	INFO	:	Epoch 606 | loss: nan | val_loss: nan | Time: 1794.98 ms
[2021-09-24 03:25:05	                main:574]	:	INFO	:	Epoch 607 | loss: nan | val_loss: nan | Time: 1819.2 ms
[2021-09-24 03:25:07	                main:574]	:	INFO	:	Epoch 608 | loss: nan | val_loss: nan | Time: 1824.79 ms
[2021-09-24 03:25:08	                main:574]	:	INFO	:	Epoch 609 | loss: nan | val_loss: nan | Time: 1817.06 ms
[2021-09-24 03:25:10	                main:574]	:	INFO	:	Epoch 610 | loss: nan | val_loss: nan | Time: 1695.79 ms
[2021-09-24 03:25:12	                main:574]	:	INFO	:	Epoch 611 | loss: nan | val_loss: nan | Time: 1703.23 ms
[2021-09-24 03:25:14	                main:574]	:	INFO	:	Epoch 612 | loss: nan | val_loss: nan | Time: 1691.27 ms
[2021-09-24 03:25:15	                main:574]	:	INFO	:	Epoch 613 | loss: nan | val_loss: nan | Time: 1766.74 ms
[2021-09-24 03:25:17	                main:574]	:	INFO	:	Epoch 614 | loss: nan | val_loss: nan | Time: 1804.06 ms
[2021-09-24 03:25:19	                main:574]	:	INFO	:	Epoch 615 | loss: nan | val_loss: nan | Time: 1814.24 ms
[2021-09-24 03:25:21	                main:574]	:	INFO	:	Epoch 616 | loss: nan | val_loss: nan | Time: 1802.3 ms
[2021-09-24 03:25:23	                main:574]	:	INFO	:	Epoch 617 | loss: nan | val_loss: nan | Time: 1838.11 ms
[2021-09-24 03:25:24	                main:574]	:	INFO	:	Epoch 618 | loss: nan | val_loss: nan | Time: 1698.3 ms
[2021-09-24 03:25:26	                main:574]	:	INFO	:	Epoch 619 | loss: nan | val_loss: nan | Time: 1680.49 ms
[2021-09-24 03:25:28	                main:574]	:	INFO	:	Epoch 620 | loss: nan | val_loss: nan | Time: 1694.67 ms
[2021-09-24 03:25:29	                main:574]	:	INFO	:	Epoch 621 | loss: nan | val_loss: nan | Time: 1781.15 ms
[2021-09-24 03:25:42	                main:574]	:	INFO	:	Epoch 622 | loss: nan | val_loss: nan | Time: 12362.9 ms
[2021-09-24 03:25:44	                main:574]	:	INFO	:	Epoch 623 | loss: nan | val_loss: nan | Time: 1738.89 ms
[2021-09-24 03:25:45	                main:574]	:	INFO	:	Epoch 624 | loss: nan | val_loss: nan | Time: 1768.44 ms
[2021-09-24 03:25:47	                main:574]	:	INFO	:	Epoch 625 | loss: nan | val_loss: nan | Time: 1816.14 ms
[2021-09-24 03:25:49	                main:574]	:	INFO	:	Epoch 626 | loss: nan | val_loss: nan | Time: 1822.81 ms
[2021-09-24 03:25:51	                main:574]	:	INFO	:	Epoch 627 | loss: nan | val_loss: nan | Time: 1827.78 ms
[2021-09-24 03:25:53	                main:574]	:	INFO	:	Epoch 628 | loss: nan | val_loss: nan | Time: 1831.25 ms
[2021-09-24 03:25:54	                main:574]	:	INFO	:	Epoch 629 | loss: nan | val_loss: nan | Time: 1783.28 ms
[2021-09-24 03:25:56	                main:574]	:	INFO	:	Epoch 630 | loss: nan | val_loss: nan | Time: 1725.18 ms
[2021-09-24 03:25:58	                main:574]	:	INFO	:	Epoch 631 | loss: nan | val_loss: nan | Time: 1739.17 ms
[2021-09-24 03:26:00	                main:574]	:	INFO	:	Epoch 632 | loss: nan | val_loss: nan | Time: 1697.44 ms
[2021-09-24 03:26:02	                main:574]	:	INFO	:	Epoch 633 | loss: nan | val_loss: nan | Time: 1827.01 ms
[2021-09-24 03:26:03	                main:574]	:	INFO	:	Epoch 634 | loss: nan | val_loss: nan | Time: 1820.16 ms
[2021-09-24 03:26:05	                main:574]	:	INFO	:	Epoch 635 | loss: nan | val_loss: nan | Time: 1807.35 ms
[2021-09-24 03:26:07	                main:574]	:	INFO	:	Epoch 636 | loss: nan | val_loss: nan | Time: 1837.16 ms
[2021-09-24 03:26:09	                main:574]	:	INFO	:	Epoch 637 | loss: nan | val_loss: nan | Time: 1815.15 ms
[2021-09-24 03:26:11	                main:574]	:	INFO	:	Epoch 638 | loss: nan | val_loss: nan | Time: 1715.2 ms
[2021-09-24 03:26:23	                main:574]	:	INFO	:	Epoch 639 | loss: nan | val_loss: nan | Time: 12375.2 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce RTX 2080 Ti)
[2021-09-24 03:49:16	                main:435]	:	INFO	:	Set logging level to 1
[2021-09-24 03:49:16	                main:441]	:	INFO	:	Running in BOINC Client mode
[2021-09-24 03:49:16	                main:444]	:	INFO	:	Resolving all filenames
[2021-09-24 03:49:16	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1)
[2021-09-24 03:49:16	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1631727172-21859-1_2_r1369318675_1 (exists = 1)
[2021-09-24 03:49:16	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1631727172-21859-1_2_r1369318675_0 (exists = 0)
[2021-09-24 03:49:16	                main:452]	:	INFO	:	Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1631727172-21859-1 (exists = 1)
[2021-09-24 03:49:16	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2021-09-24 03:49:16	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5
[2021-09-24 03:49:16	                main:474]	:	INFO	:	Configuration: 
[2021-09-24 03:49:16	                main:475]	:	INFO	:	    Model type: GRU
[2021-09-24 03:49:16	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2021-09-24 03:49:16	                main:477]	:	INFO	:	    Max Epochs: 2048
[2021-09-24 03:49:16	                main:478]	:	INFO	:	    Batch Size: 128
[2021-09-24 03:49:16	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2021-09-24 03:49:16	                main:480]	:	INFO	:	    Patience: 10
[2021-09-24 03:49:16	                main:481]	:	INFO	:	    Hidden Width: 12
[2021-09-24 03:49:16	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2021-09-24 03:49:16	                main:483]	:	INFO	:	    # Backend Layers: 4
[2021-09-24 03:49:16	                main:484]	:	INFO	:	    # Threads: 1
[2021-09-24 03:49:16	                main:486]	:	INFO	:	Preparing Dataset
[2021-09-24 03:49:16	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-09-24 03:49:16	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-09-24 03:49:18	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2021-09-24 03:49:18	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-09-24 03:49:18	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-09-24 03:49:18	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2021-09-24 03:49:18	                main:494]	:	INFO	:	Creating Model
[2021-09-24 03:49:18	                main:507]	:	INFO	:	Preparing config file
[2021-09-24 03:49:18	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2021-09-24 03:49:18	                main:512]	:	INFO	:	Loading config


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFEE1164F99

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 09/24/21 03:49:18
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\1;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 000000002e610000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000e3530000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1165

ModLoad: 00000000e2f10000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1165

ModLoad: 00000000e1130000 00000000002c9000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1165

ModLoad: 00000000e2d60000 00000000001a1000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1165

ModLoad: 00000000e1450000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1237) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.19041.1237 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1237

ModLoad: 00000000e1c80000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202

ModLoad: 00000000e0db0000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1110) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.19041.1110 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1110

ModLoad: 00000000e0f50000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 000000009edf0000 0000000000058000 C:\ProgramData\BOINC\slots\1\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000e1480000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 00000000e1de0000 00000000000ac000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1052) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1165

ModLoad: 00000000e27d0000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.19041.546

ModLoad: 00000000e2fd0000 000000000009b000 C:\WINDOWS\System32\sechost.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000e1cb0000 000000000012a000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1081) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1165

ModLoad: 00000000c9930000 000000000008d000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.29.30133.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.29.30133.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.29.30133.0

ModLoad: 00000000ca530000 000000000001b000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.29.30133.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.29.30133.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.29.30133.0

ModLoad: 00000000df290000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.867

ModLoad: 00000000c8c90000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.29.30133.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.29.30133.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.29.30133.0

ModLoad: 000000007ba40000 000000000abe7000 C:\ProgramData\BOINC\slots\1\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000008b600000 000000000020d000 C:\ProgramData\BOINC\slots\1\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 000000008b320000 00000000002db000 C:\ProgramData\BOINC\slots\1\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000b1a50000 0000000000040000 C:\ProgramData\BOINC\slots\1\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000e9970000 0000000024b49000 C:\ProgramData\BOINC\slots\1\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000009ec60000 0000000000045000 C:\ProgramData\BOINC\slots\1\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000078990000 00000000030a5000 C:\ProgramData\BOINC\slots\1\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 00000000754d0000 00000000034b2000 C:\ProgramData\BOINC\slots\1\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000dc350000 0000000000010000 C:\ProgramData\BOINC\slots\1\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 00000000c5420000 000000000919f000 C:\ProgramData\BOINC\slots\1\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 0000000071770000 0000000003d5b000 C:\ProgramData\BOINC\slots\1\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 000000004d220000 0000000001eca000 C:\ProgramData\BOINC\slots\1\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000ce5c0000 000000001b3a4000 C:\ProgramData\BOINC\slots\1\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 00000000e2b50000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000df4b0000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000e3070000 0000000000472000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1237) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1165

ModLoad: 00000000e1400000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 00000000e1100000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1165

ModLoad: 00000000e09f0000 0000000000034000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 00000000e10a0000 0000000000060000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1237) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.19041.1237 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1237

ModLoad: 00000000e0c50000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1165

ModLoad: 00000000e0830000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000e2090000 000000000073f000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1165

ModLoad: 00000000de8c0000 0000000000790000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1165

ModLoad: 00000000e16a0000 0000000000355000 C:\WINDOWS\System32\combase.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1202

ModLoad: 00000000e05c0000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.662) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1165

ModLoad: 00000000e2aa0000 00000000000ae000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1165

ModLoad: 00000000e1e90000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1165

ModLoad: 000000008b080000 000000000029d000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.6079) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r460\r460_74\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 27.21.14.6079
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.2.66 driver
    Product Version       : 27.21.14.6079

ModLoad: 00000000d8b70000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000890a0000 00000000015c2000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_8e68f77150e57b50\nvcuda64.dll (27.21.14.6079) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r460\r460_74\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 27.21.14.6079
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.2.66 driver
    Product Version       : 27.21.14.6079

ModLoad: 00000000e1ab0000 000000000006b000 C:\WINDOWS\System32\WS2_32.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : ws2_32.pdb
    File Version          : 10.0.19041.1081 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1081

ModLoad: 00000000d6bb0000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.19041.906 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.906

ModLoad: 00000000e0530000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000de130000 000000000009e000 C:\WINDOWS\system32\uxtheme.dll (6.2.19041.1081) (-exported- Symbols Loaded)
    Linked PDB Filename   : UxTheme.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1165

ModLoad: 00000000d46f0000 00000000006f0000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.6079) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r460\r460_74\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 27.21.14.6079
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 27.21.14.6079

ModLoad: 00000000e28d0000 000000000012a000 C:\WINDOWS\System32\OLE32.DLL (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : ole32.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1202

ModLoad: 00000000e0ec0000 0000000000083000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3612, Write: 307, Other 967

- I/O Transfers Counters -
Read: 6550660, Write: 7305, Other 32356

- Paged Pool Usage -
QuotaPagedPoolUsage: 3456192, QuotaPeakPagedPoolUsage: 3456192
QuotaNonPagedPoolUsage: 38344, QuotaPeakNonPagedPoolUsage: 38352

- Virtual Memory Usage -
VirtualSize: -1153593344, PeakVirtualSize: -560963584

- Pagefile Usage -
PagefileUsage: -1153593344, PeakPagefileUsage: -1153540096

- Working Set Size -
WorkingSetSize: 1235988480, PeakWorkingSetSize: 1235992576, PageFaultCount: 433937

*** Dump of thread ID 15048 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 4687500.000000, User Time: 17343750.000000, Wait Time: 23120448.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFEE1164F99

- Registers -
rax=00000000559061a8 rbx=000000002e974910 rcx=0000000000000000 rdx=00000000e3555b00 rsi=0000000055906a10 rdi=0000000019930520
r8=00000000559061d0 r9=00000000559061f8 r10=0000000000000004 r11=0000000055906208 r12=00000000f0365ce0 r13=0000000055906c20
r14=00000000f1620eb0 r15=0000000000000000 rip=00000000e1164f99 rsp=00000000559068b0 rbp=0000000055906ba0
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
55906980 2e88a884 00000040 0000004f f0366200 00000207 KERNELBASE!RaiseException+0x0 
559069e0 2e631ca6 00000080 8ae80000 bda94a18 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
55906a90 2e63593b 00000000 00000030 00000020 00000008 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
55906be0 2e631a78 00000000 00000000 55906f10 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
55906cb0 2e631cfc 55906f10 00000000 00000080 559071e0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
55906d70 2e63c4dd 559071e0 559071e0 559071e0 559071e0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
55907060 2e62b2fe 55907678 559071e0 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
5591fe00 2e86c6f8 8c9a61b0 00000000 00000000 8ae8da90 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
5591fe40 e2f27034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
5591fe70 e3582651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
5591fef0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 26440 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 312500.000000, User Time: 0.000000, Wait Time: 23120308.000000

- Registers -
rax=00000000000001d3 rbx=000000008ae86650 rcx=0000000000000070 rdx=000000008ae862d0 rsi=000000008ae84400 rdi=000000008ae86650
r8=0000000000000359 r9=00000000e1e709c8 r10=000000008ca99100 r11=00000000e1e77ea8 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000e35d07c4 rsp=0000000055cff678 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
55cff670 e3582dc7 00000000 00000000 8ae84400 8ae86650 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
55cff970 e2f27034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
55cff9a0 e3582651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
55cffa20 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 10960 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 312500.000000, User Time: 0.000000, Wait Time: 23120308.000000

- Registers -
rax=00000000000001d3 rbx=000000008ae86a80 rcx=0000000000000070 rdx=000000008ae86700 rsi=000000008ae84400 rdi=000000008ae86a80
r8=0000000000000008 r9=0000000000000040 r10=00000000000001c0 r11=00000000e75c3f71 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000e35d07c4 rsp=0000000055dff9e8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
55dff9e0 e3582dc7 00000000 00000000 8ae84400 8ae86a80 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
55dffce0 e2f27034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
55dffd10 e3582651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
55dffd90 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 34876 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 23120308.000000

- Registers -
rax=00000000000001d3 rbx=000000008ae86eb0 rcx=0000000000000070 rdx=000000008ae86b30 rsi=000000008ae84400 rdi=000000008ae86eb0
r8=00000000d8b75008 r9=0000000055eff250 r10=00000000d8b700f0 r11=0000000000000001 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000e35d07c4 rsp=0000000055eff7a8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
55eff7a0 e3582dc7 00000000 00000000 8ae84400 8ae86eb0 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
55effaa0 e2f27034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
55effad0 e3582651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
55effb50 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 34312 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 23120440.000000

- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000560ff840 rsi=0000000000000000 rdi=0000000000000064
r8=00000000560ff818 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000e35cd3f4 rsp=00000000560ff818 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
560ff810 e117967e 560ff8d8 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0 
560ff8b0 2e64a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0 
560ff8e0 e2f27034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
560ff910 e3582651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
560ff990 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 31004 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 23120444.000000

- Registers -
rax=000000000000005b rbx=000000000000000e rcx=000000000000000e rdx=00000000561ff670 rsi=0000000000000000 rdi=000000000000000e
r8=000000008d17b710 r9=000000000000000e r10=000000008c0fedd0 r11=00000000f6e8100f r12=0000000000000064 r13=00000000561ff670
r14=00000000561ff370 r15=0000000000000000 rip=00000000e35cd8c4 rsp=00000000561ff318 rbp=000000008cb75db0
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
561ff310 e117cb70 00000000 55a7e000 e369a4d0 55a7e000 ntdll!ZwWaitForMultipleObjects+0x0 
561ff600 e117ca6e 8ae94d10 004e0049 0000000e 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
561ff640 892566d4 8cb7bdb0 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
561ff880 892ee51d 00000000 8cb75db0 00000000 00000000 nvcuda64!+0x0 
561ff930 892560a3 1e20aaeb 1d2444f3 8d1bb260 00000000 nvcuda64!cuProfilerStop+0x0 
561ff960 8956d794 8d1bb260 00000000 00000000 00000000 nvcuda64!+0x0 
561ff990 e2f27034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
561ff9c0 e3582651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
561ffa40 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 32552 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 23120348.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002b4 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002b4
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000000000000 r13=0000000000000000
r14=00000000000002b4 r15=0000000000000000 rip=00000000e35ccdf4 rsp=00000000562ffb28 rbp=000000008cbc2270
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
562ffb20 e1151a8e 00000000 00000000 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0 
562ffbc0 8946cd6e 8d1bbb90 e115a3c5 00000000 000002b4 KERNELBASE!WaitForSingleObjectEx+0x0 
562ffc30 892560a3 8cbc2270 8d5f2a80 8d1bbb90 00000000 nvcuda64!cuProfilerStop+0x0 
562ffc60 8956d794 8d1bbb90 00000000 00000000 00000000 nvcuda64!+0x0 
562ffc90 e2f27034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
562ffcc0 e3582651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
562ffd40 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 13624 (state: Waiting): ***

- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 23120418.000000

- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=000000008ce80298 rdx=00000000563ffcb8 rsi=00000000563ffc20 rdi=0000000000000000
r8=0000000000000000 r9=0000000000000000 r10=000000008ce84e70 r11=00000000563ffc50 r12=00000000563ffcb8 r13=0000000000000000
r14=000000008ce80298 r15=000000008ce84e70 rip=00000000e35d0764 rsp=00000000563ffbf8 rbp=00000000563ffc50
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
563ffbf0 e3594295 00000102 00000102 00000000 563ffc20 ntdll!NtWaitForAlertByThreadId+0x0 
563ffc60 e119ce39 8ce82650 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0 
563ffc90 891d4a5c 8ce82650 e35807b0 8ce82650 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0 
563ffcf0 892560a3 00000001 1dfecaee 00000000 00000000 nvcuda64!+0x0 
563ffd20 8956d794 8d1bb6e0 00000000 00000000 00000000 nvcuda64!+0x0 
563ffd50 e2f27034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
563ffd80 e3582651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
563ffe00 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)