Task 14226663

Name ParityModified-1647045462-10436-2-0_2
Workunit 10636820
Created 2 Apr 2022, 3:58:44 UTC
Sent 2 Apr 2022, 6:44:13 UTC
Report deadline 10 Apr 2022, 6:44:13 UTC
Received 8 Apr 2022, 12:55:21 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 13173
Run time 1 hours 13 min 20 sec
CPU time 1 hours 8 min 34 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 1,168.88 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.63 GB
Peak swap size 3.58 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
02 | loss: 0.0311826 | val_loss: 0.0311856 | Time: 6581.81 ms
[2022-04-06 23:38:51	                main:574]	:	INFO	:	Epoch 403 | loss: 0.0311823 | val_loss: 0.0311855 | Time: 6562.88 ms
[2022-04-06 23:38:58	                main:574]	:	INFO	:	Epoch 404 | loss: 0.0311832 | val_loss: 0.0311901 | Time: 6604.02 ms
[2022-04-06 23:39:04	                main:574]	:	INFO	:	Epoch 405 | loss: 0.0311857 | val_loss: 0.0311899 | Time: 6568.4 ms
[2022-04-06 23:39:11	                main:574]	:	INFO	:	Epoch 406 | loss: 0.0311811 | val_loss: 0.0311845 | Time: 6560.53 ms
[2022-04-06 23:39:17	                main:574]	:	INFO	:	Epoch 407 | loss: 0.0311807 | val_loss: 0.0311855 | Time: 6573.76 ms
[2022-04-06 23:39:24	                main:574]	:	INFO	:	Epoch 408 | loss: 0.031181 | val_loss: 0.0311871 | Time: 6575.93 ms
[2022-04-06 23:39:31	                main:574]	:	INFO	:	Epoch 409 | loss: 0.0311824 | val_loss: 0.0311869 | Time: 6559.39 ms
[2022-04-06 23:39:37	                main:574]	:	INFO	:	Epoch 410 | loss: 0.0311828 | val_loss: 0.0311882 | Time: 6565.8 ms
[2022-04-06 23:39:44	                main:574]	:	INFO	:	Epoch 411 | loss: 0.0311827 | val_loss: 0.0311864 | Time: 6577.03 ms
[2022-04-06 23:39:50	                main:574]	:	INFO	:	Epoch 412 | loss: 0.0311803 | val_loss: 0.0311856 | Time: 6564.81 ms
[2022-04-06 23:39:57	                main:574]	:	INFO	:	Epoch 413 | loss: 0.0311801 | val_loss: 0.0311883 | Time: 6558.39 ms
[2022-04-06 23:40:03	                main:574]	:	INFO	:	Epoch 414 | loss: 0.0311799 | val_loss: 0.0311864 | Time: 6603.79 ms
[2022-04-06 23:40:10	                main:574]	:	INFO	:	Epoch 415 | loss: 0.0311796 | val_loss: 0.0311847 | Time: 6568.15 ms
[2022-04-06 23:40:17	                main:574]	:	INFO	:	Epoch 416 | loss: 0.031181 | val_loss: 0.0311855 | Time: 6554.81 ms
[2022-04-06 23:40:23	                main:574]	:	INFO	:	Epoch 417 | loss: 0.0311806 | val_loss: 0.0311861 | Time: 6568.23 ms
[2022-04-06 23:40:30	                main:574]	:	INFO	:	Epoch 418 | loss: 0.0311806 | val_loss: 0.0311935 | Time: 6578.9 ms
[2022-04-06 23:40:36	                main:574]	:	INFO	:	Epoch 419 | loss: 0.0311819 | val_loss: 0.0311876 | Time: 6548.09 ms
[2022-04-06 23:40:43	                main:574]	:	INFO	:	Epoch 420 | loss: 0.031179 | val_loss: 0.0311857 | Time: 6600.11 ms
[2022-04-06 23:40:49	                main:574]	:	INFO	:	Epoch 421 | loss: 0.0311785 | val_loss: 0.0311843 | Time: 6579.91 ms
[2022-04-06 23:40:56	                main:574]	:	INFO	:	Epoch 422 | loss: 0.0311778 | val_loss: 0.0311851 | Time: 6560.88 ms
[2022-04-06 23:41:03	                main:574]	:	INFO	:	Epoch 423 | loss: 0.0311789 | val_loss: 0.0311905 | Time: 6561.57 ms
[2022-04-06 23:41:09	                main:574]	:	INFO	:	Epoch 424 | loss: 0.0311856 | val_loss: 0.0311847 | Time: 6732.35 ms
[2022-04-06 23:41:16	                main:574]	:	INFO	:	Epoch 425 | loss: 0.0311816 | val_loss: 0.0311891 | Time: 6566.72 ms
[2022-04-06 23:41:22	                main:574]	:	INFO	:	Epoch 426 | loss: 0.0311818 | val_loss: 0.031185 | Time: 6557.04 ms
[2022-04-06 23:41:29	                main:574]	:	INFO	:	Epoch 427 | loss: 0.0311789 | val_loss: 0.0311848 | Time: 6575.54 ms
[2022-04-06 23:41:36	                main:574]	:	INFO	:	Epoch 428 | loss: 0.0311781 | val_loss: 0.0311842 | Time: 6581.8 ms
[2022-04-06 23:41:42	                main:574]	:	INFO	:	Epoch 429 | loss: 0.0311803 | val_loss: 0.0311856 | Time: 6559.14 ms
[2022-04-06 23:41:49	                main:574]	:	INFO	:	Epoch 430 | loss: 0.0311783 | val_loss: 0.0311836 | Time: 6572.86 ms
[2022-04-06 23:41:55	                main:574]	:	INFO	:	Epoch 431 | loss: 0.0311772 | val_loss: 0.0311836 | Time: 6581.4 ms
[2022-04-06 23:42:02	                main:574]	:	INFO	:	Epoch 432 | loss: 0.0311761 | val_loss: 0.0311856 | Time: 6563.9 ms
[2022-04-06 23:42:09	                main:574]	:	INFO	:	Epoch 433 | loss: 0.0311777 | val_loss: 0.0311845 | Time: 6571.65 ms
[2022-04-06 23:42:15	                main:574]	:	INFO	:	Epoch 434 | loss: 0.0311783 | val_loss: 0.0311877 | Time: 6573.51 ms
[2022-04-06 23:42:22	                main:574]	:	INFO	:	Epoch 435 | loss: 0.0311789 | val_loss: 0.0311874 | Time: 6549.11 ms
[2022-04-06 23:42:28	                main:574]	:	INFO	:	Epoch 436 | loss: 0.0311827 | val_loss: 0.0311916 | Time: 6581.77 ms
[2022-04-06 23:42:35	                main:574]	:	INFO	:	Epoch 437 | loss: 0.0311806 | val_loss: 0.0311858 | Time: 6570.86 ms
[2022-04-06 23:42:41	                main:574]	:	INFO	:	Epoch 438 | loss: 0.0311785 | val_loss: 0.0311848 | Time: 6570.89 ms
[2022-04-06 23:42:48	                main:574]	:	INFO	:	Epoch 439 | loss: 0.031178 | val_loss: 0.0311872 | Time: 6554.92 ms
[2022-04-06 23:42:55	                main:574]	:	INFO	:	Epoch 440 | loss: 0.0311769 | val_loss: 0.0311841 | Time: 6587.54 ms
[2022-04-06 23:43:01	                main:574]	:	INFO	:	Epoch 441 | loss: 0.0311773 | val_loss: 0.0311837 | Time: 6581.09 ms
[2022-04-06 23:43:08	                main:574]	:	INFO	:	Epoch 442 | loss: 0.0311804 | val_loss: 0.0311886 | Time: 6553.93 ms
[2022-04-06 23:43:14	                main:574]	:	INFO	:	Epoch 443 | loss: 0.0311793 | val_loss: 0.0311893 | Time: 6572.68 ms
[2022-04-06 23:43:21	                main:574]	:	INFO	:	Epoch 444 | loss: 0.0311797 | val_loss: 0.0311842 | Time: 6576.22 ms
[2022-04-06 23:43:27	                main:574]	:	INFO	:	Epoch 445 | loss: 0.0311768 | val_loss: 0.0311849 | Time: 6547.14 ms
[2022-04-06 23:43:34	                main:574]	:	INFO	:	Epoch 446 | loss: 0.0311819 | val_loss: 0.0311943 | Time: 6570.98 ms
[2022-04-06 23:43:41	                main:574]	:	INFO	:	Epoch 447 | loss: 0.0311908 | val_loss: 0.0311889 | Time: 6577.67 ms
[2022-04-06 23:43:47	                main:574]	:	INFO	:	Epoch 448 | loss: 0.0311878 | val_loss: 0.031188 | Time: 6566.65 ms
[2022-04-06 23:43:54	                main:574]	:	INFO	:	Epoch 449 | loss: 0.0311856 | val_loss: 0.0311871 | Time: 6571.47 ms
[2022-04-06 23:44:00	                main:574]	:	INFO	:	Epoch 450 | loss: 0.0311847 | val_loss: 0.0311885 | Time: 6571.38 ms
[2022-04-06 23:44:07	                main:574]	:	INFO	:	Epoch 451 | loss: 0.031184 | val_loss: 0.0311875 | Time: 6571.8 ms
[2022-04-06 23:44:13	                main:574]	:	INFO	:	Epoch 452 | loss: 0.0311837 | val_loss: 0.0311903 | Time: 6562.5 ms
[2022-04-06 23:44:20	                main:574]	:	INFO	:	Epoch 453 | loss: 0.0311825 | val_loss: 0.0311896 | Time: 6573.82 ms
[2022-04-06 23:44:27	                main:574]	:	INFO	:	Epoch 454 | loss: 0.0311825 | val_loss: 0.0311862 | Time: 6575.75 ms
[2022-04-06 23:44:33	                main:574]	:	INFO	:	Epoch 455 | loss: 0.0311814 | val_loss: 0.0311895 | Time: 6547.54 ms
[2022-04-06 23:44:40	                main:574]	:	INFO	:	Epoch 456 | loss: 0.0311811 | val_loss: 0.0311856 | Time: 6582.41 ms
[2022-04-06 23:44:46	                main:574]	:	INFO	:	Epoch 457 | loss: 0.0311805 | val_loss: 0.0311871 | Time: 6576.52 ms
[2022-04-06 23:44:53	                main:574]	:	INFO	:	Epoch 458 | loss: 0.0311809 | val_loss: 0.0311872 | Time: 6557.62 ms
[2022-04-06 23:44:59	                main:574]	:	INFO	:	Epoch 459 | loss: 0.0311829 | val_loss: 0.0311866 | Time: 6564.96 ms
[2022-04-06 23:45:06	                main:574]	:	INFO	:	Epoch 460 | loss: 0.0311816 | val_loss: 0.0311861 | Time: 6569.47 ms
[2022-04-06 23:45:13	                main:574]	:	INFO	:	Epoch 461 | loss: 0.031178 | val_loss: 0.0311866 | Time: 6559.06 ms
[2022-04-06 23:45:19	                main:574]	:	INFO	:	Epoch 462 | loss: 0.0311798 | val_loss: 0.0311856 | Time: 6566.9 ms
[2022-04-06 23:45:26	                main:574]	:	INFO	:	Epoch 463 | loss: 0.031178 | val_loss: 0.0311874 | Time: 6601.75 ms
[2022-04-06 23:45:32	                main:574]	:	INFO	:	Epoch 464 | loss: 0.0311788 | val_loss: 0.0311864 | Time: 6566.55 ms
[2022-04-06 23:45:39	                main:574]	:	INFO	:	Epoch 465 | loss: 0.0311772 | val_loss: 0.031186 | Time: 6557.62 ms
[2022-04-06 23:45:45	                main:574]	:	INFO	:	Epoch 466 | loss: 0.0311769 | val_loss: 0.0311862 | Time: 6579.26 ms
[2022-04-06 23:45:52	                main:574]	:	INFO	:	Epoch 467 | loss: 0.0311761 | val_loss: 0.0311871 | Time: 6574.84 ms
[2022-04-06 23:45:59	                main:574]	:	INFO	:	Epoch 468 | loss: 0.0311773 | val_loss: 0.0311895 | Time: 6564.02 ms
[2022-04-06 23:46:05	                main:574]	:	INFO	:	Epoch 469 | loss: 0.0311787 | val_loss: 0.0311943 | Time: 6586.19 ms
[2022-04-06 23:46:12	                main:574]	:	INFO	:	Epoch 470 | loss: 0.0311789 | val_loss: 0.0311909 | Time: 6577.13 ms
[2022-04-06 23:46:18	                main:574]	:	INFO	:	Epoch 471 | loss: 0.031179 | val_loss: 0.031187 | Time: 6556.26 ms
[2022-04-06 23:46:25	                main:574]	:	INFO	:	Epoch 472 | loss: 0.0311758 | val_loss: 0.0311889 | Time: 6568.81 ms
[2022-04-06 23:46:31	                main:574]	:	INFO	:	Epoch 473 | loss: 0.0311764 | val_loss: 0.0311879 | Time: 6587.72 ms
[2022-04-06 23:46:38	                main:574]	:	INFO	:	Epoch 474 | loss: 0.0311762 | val_loss: 0.0311876 | Time: 6580.19 ms
[2022-04-06 23:46:45	                main:574]	:	INFO	:	Epoch 475 | loss: 0.0311755 | val_loss: 0.0311882 | Time: 6567.85 ms
[2022-04-06 23:46:51	                main:574]	:	INFO	:	Epoch 476 | loss: 0.0311765 | val_loss: 0.0311903 | Time: 6578.64 ms
[2022-04-06 23:46:58	                main:574]	:	INFO	:	Epoch 477 | loss: 0.0311754 | val_loss: 0.0311898 | Time: 6571.3 ms
[2022-04-06 23:47:04	                main:574]	:	INFO	:	Epoch 478 | loss: 0.0311753 | val_loss: 0.0311884 | Time: 6559.03 ms
[2022-04-06 23:47:11	                main:574]	:	INFO	:	Epoch 479 | loss: 0.0311745 | val_loss: 0.0311914 | Time: 6578.45 ms
[2022-04-06 23:47:18	                main:574]	:	INFO	:	Epoch 480 | loss: 0.0311776 | val_loss: 0.0311949 | Time: 6579.03 ms
[2022-04-06 23:47:24	                main:574]	:	INFO	:	Epoch 481 | loss: 0.0311773 | val_loss: 0.0311899 | Time: 6546.52 ms
[2022-04-06 23:47:31	                main:574]	:	INFO	:	Epoch 482 | loss: 0.0311742 | val_loss: 0.0311883 | Time: 6583.04 ms
[2022-04-06 23:47:37	                main:574]	:	INFO	:	Epoch 483 | loss: 0.0311732 | val_loss: 0.0311893 | Time: 6576.32 ms
[2022-04-06 23:47:44	                main:574]	:	INFO	:	Epoch 484 | loss: 0.031173 | val_loss: 0.0311894 | Time: 6567.04 ms
[2022-04-06 23:47:50	                main:574]	:	INFO	:	Epoch 485 | loss: 0.0311735 | val_loss: 0.0311893 | Time: 6576.19 ms
[2022-04-06 23:47:57	                main:574]	:	INFO	:	Epoch 486 | loss: 0.0311745 | val_loss: 0.031189 | Time: 6576.25 ms
[2022-04-06 23:48:04	                main:574]	:	INFO	:	Epoch 487 | loss: 0.0311728 | val_loss: 0.0311913 | Time: 6566.56 ms
[2022-04-06 23:48:10	                main:574]	:	INFO	:	Epoch 488 | loss: 0.0311729 | val_loss: 0.0311874 | Time: 6568.71 ms
[2022-04-06 23:48:17	                main:574]	:	INFO	:	Epoch 489 | loss: 0.0311721 | val_loss: 0.0311888 | Time: 6589.6 ms
[2022-04-06 23:48:23	                main:574]	:	INFO	:	Epoch 490 | loss: 0.0311721 | val_loss: 0.03119 | Time: 6584.5 ms
[2022-04-06 23:48:30	                main:574]	:	INFO	:	Epoch 491 | loss: 0.0311724 | val_loss: 0.03119 | Time: 6571.86 ms
[2022-04-06 23:48:36	                main:574]	:	INFO	:	Epoch 492 | loss: 0.0311716 | val_loss: 0.0311891 | Time: 6584.94 ms
[2022-04-06 23:48:43	                main:574]	:	INFO	:	Epoch 493 | loss: 0.031172 | val_loss: 0.0311896 | Time: 6583.12 ms
[2022-04-06 23:48:50	                main:574]	:	INFO	:	Epoch 494 | loss: 0.0311713 | val_loss: 0.031191 | Time: 6554.28 ms
[2022-04-06 23:48:56	                main:574]	:	INFO	:	Epoch 495 | loss: 0.0311722 | val_loss: 0.0311918 | Time: 6571.14 ms
[2022-04-06 23:49:03	                main:574]	:	INFO	:	Epoch 496 | loss: 0.031172 | val_loss: 0.031189 | Time: 6574.82 ms
[2022-04-06 23:49:09	                main:574]	:	INFO	:	Epoch 497 | loss: 0.031172 | val_loss: 0.0311973 | Time: 6555.14 ms
[2022-04-06 23:49:16	                main:574]	:	INFO	:	Epoch 498 | loss: 0.031173 | val_loss: 0.0311885 | Time: 6580.28 ms
[2022-04-06 23:49:22	                main:574]	:	INFO	:	Epoch 499 | loss: 0.0311724 | val_loss: 0.0311893 | Time: 6572.64 ms
[2022-04-06 23:49:29	                main:574]	:	INFO	:	Epoch 500 | loss: 0.0311711 | val_loss: 0.031194 | Time: 6570.42 ms
[2022-04-06 23:49:36	                main:574]	:	INFO	:	Epoch 501 | loss: 0.0311715 | val_loss: 0.0311902 | Time: 6571.84 ms
[2022-04-06 23:49:42	                main:574]	:	INFO	:	Epoch 502 | loss: 0.0311725 | val_loss: 0.031189 | Time: 6574.13 ms
[2022-04-06 23:49:49	                main:574]	:	INFO	:	Epoch 503 | loss: 0.0322681 | val_loss: 0.0320596 | Time: 6574.21 ms
[2022-04-06 23:49:55	                main:574]	:	INFO	:	Epoch 504 | loss: 0.0336408 | val_loss: 0.0318705 | Time: 6574.89 ms
[2022-04-06 23:50:02	                main:574]	:	INFO	:	Epoch 505 | loss: 0.0315299 | val_loss: 0.0313101 | Time: 6577.33 ms
[2022-04-06 23:50:09	                main:574]	:	INFO	:	Epoch 506 | loss: 0.0312865 | val_loss: 0.0312693 | Time: 6580.53 ms
[2022-04-06 23:50:15	                main:574]	:	INFO	:	Epoch 507 | loss: 0.0312571 | val_loss: 0.0312504 | Time: 6553.88 ms
[2022-04-06 23:50:22	                main:574]	:	INFO	:	Epoch 508 | loss: 0.0312509 | val_loss: 0.0312505 | Time: 6585.52 ms
[2022-04-06 23:50:28	                main:574]	:	INFO	:	Epoch 509 | loss: 0.0312497 | val_loss: 0.0312485 | Time: 6576.04 ms
[2022-04-06 23:50:35	                main:574]	:	INFO	:	Epoch 510 | loss: 0.0312491 | val_loss: 0.0312483 | Time: 6562.64 ms
[2022-04-06 23:50:41	                main:574]	:	INFO	:	Epoch 511 | loss: 0.0312491 | val_loss: 0.0312488 | Time: 6572.45 ms
[2022-04-06 23:50:48	                main:574]	:	INFO	:	Epoch 512 | loss: 0.0312486 | val_loss: 0.0312482 | Time: 6576.61 ms
[2022-04-06 23:50:55	                main:574]	:	INFO	:	Epoch 513 | loss: 0.0312484 | val_loss: 0.0312489 | Time: 6568.71 ms
[2022-04-06 23:51:01	                main:574]	:	INFO	:	Epoch 514 | loss: 0.0312491 | val_loss: 0.0312492 | Time: 6579.33 ms
[2022-04-06 23:51:08	                main:574]	:	INFO	:	Epoch 515 | loss: 0.0312489 | val_loss: 0.0312477 | Time: 6595.06 ms
[2022-04-06 23:51:14	                main:574]	:	INFO	:	Epoch 516 | loss: 0.0312479 | val_loss: 0.0312482 | Time: 6565.02 ms
[2022-04-06 23:51:21	                main:574]	:	INFO	:	Epoch 517 | loss: 0.0312482 | val_loss: 0.031248 | Time: 6550.44 ms
[2022-04-06 23:51:27	                main:574]	:	INFO	:	Epoch 518 | loss: 0.0312483 | val_loss: 0.0312484 | Time: 6578.5 ms
[2022-04-06 23:51:34	                main:574]	:	INFO	:	Epoch 519 | loss: 0.0312483 | val_loss: 0.0312479 | Time: 6579.33 ms
[2022-04-06 23:51:41	                main:574]	:	INFO	:	Epoch 520 | loss: 0.031248 | val_loss: 0.0312488 | Time: 6569.06 ms
[2022-04-06 23:51:47	                main:574]	:	INFO	:	Epoch 521 | loss: 0.0312487 | val_loss: 0.0312485 | Time: 6576.6 ms
[2022-04-06 23:51:54	                main:574]	:	INFO	:	Epoch 522 | loss: 0.0312482 | val_loss: 0.0312481 | Time: 6600.83 ms
[2022-04-06 23:52:00	                main:574]	:	INFO	:	Epoch 523 | loss: 0.0312484 | val_loss: 0.0312478 | Time: 6559.89 ms
[2022-04-06 23:52:07	                main:574]	:	INFO	:	Epoch 524 | loss: 0.0312485 | val_loss: 0.0312479 | Time: 6604.05 ms
[2022-04-06 23:52:14	                main:574]	:	INFO	:	Epoch 525 | loss: 0.0312481 | val_loss: 0.0312477 | Time: 6593.78 ms
[2022-04-06 23:52:20	                main:574]	:	INFO	:	Epoch 526 | loss: 0.0312487 | val_loss: 0.031249 | Time: 6559.8 ms
[2022-04-06 23:51:12	                main:574]	:	INFO	:	Epoch 527 | loss: 0.0312493 | val_loss: 0.0312479 | Time: 6646.47 ms
[2022-04-06 23:51:19	                main:574]	:	INFO	:	Epoch 528 | loss: 0.0312484 | val_loss: 0.0312477 | Time: 6571.19 ms
[2022-04-06 23:51:26	                main:574]	:	INFO	:	Epoch 529 | loss: 0.0312483 | val_loss: 0.0312478 | Time: 6573.03 ms
[2022-04-06 23:51:32	                main:574]	:	INFO	:	Epoch 530 | loss: 0.0312482 | val_loss: 0.031248 | Time: 6558.53 ms
[2022-04-06 23:51:39	                main:574]	:	INFO	:	Epoch 531 | loss: 0.0312484 | val_loss: 0.0312481 | Time: 6580.94 ms
[2022-04-06 23:51:45	                main:574]	:	INFO	:	Epoch 532 | loss: 0.0312481 | val_loss: 0.031248 | Time: 6610.83 ms
[2022-04-06 23:51:52	                main:574]	:	INFO	:	Epoch 533 | loss: 0.0312481 | val_loss: 0.0312482 | Time: 6562.51 ms
[2022-04-06 23:51:58	                main:574]	:	INFO	:	Epoch 534 | loss: nan | val_loss: nan | Time: 6588.6 ms
[2022-04-06 23:52:05	                main:574]	:	INFO	:	Epoch 535 | loss: nan | val_loss: nan | Time: 6574.36 ms
[2022-04-06 23:52:12	                main:574]	:	INFO	:	Epoch 536 | loss: nan | val_loss: nan | Time: 6563.32 ms
[2022-04-06 23:52:18	                main:574]	:	INFO	:	Epoch 537 | loss: nan | val_loss: nan | Time: 6575.3 ms
[2022-04-06 23:52:25	                main:574]	:	INFO	:	Epoch 538 | loss: nan | val_loss: nan | Time: 6581.04 ms
[2022-04-06 23:52:31	                main:574]	:	INFO	:	Epoch 539 | loss: nan | val_loss: nan | Time: 6562.2 ms
[2022-04-06 23:52:38	                main:574]	:	INFO	:	Epoch 540 | loss: nan | val_loss: nan | Time: 6576.65 ms
[2022-04-06 23:52:44	                main:574]	:	INFO	:	Epoch 541 | loss: nan | val_loss: nan | Time: 6567.9 ms
[2022-04-06 23:52:51	                main:574]	:	INFO	:	Epoch 542 | loss: nan | val_loss: nan | Time: 6582.01 ms
[2022-04-06 23:52:58	                main:574]	:	INFO	:	Epoch 543 | loss: nan | val_loss: nan | Time: 6568.86 ms
[2022-04-06 23:53:04	                main:574]	:	INFO	:	Epoch 544 | loss: nan | val_loss: nan | Time: 6575.91 ms
[2022-04-06 23:53:11	                main:574]	:	INFO	:	Epoch 545 | loss: nan | val_loss: nan | Time: 6577.13 ms
[2022-04-06 23:53:17	                main:574]	:	INFO	:	Epoch 546 | loss: nan | val_loss: nan | Time: 6553.18 ms
[2022-04-06 23:53:24	                main:574]	:	INFO	:	Epoch 547 | loss: nan | val_loss: nan | Time: 6583.2 ms
[2022-04-06 23:53:30	                main:574]	:	INFO	:	Epoch 548 | loss: nan | val_loss: nan | Time: 6575.8 ms
[2022-04-06 23:53:37	                main:574]	:	INFO	:	Epoch 549 | loss: nan | val_loss: nan | Time: 6558.93 ms
[2022-04-06 23:53:44	                main:574]	:	INFO	:	Epoch 550 | loss: nan | val_loss: nan | Time: 6577.8 ms
[2022-04-06 23:53:50	                main:574]	:	INFO	:	Epoch 551 | loss: nan | val_loss: nan | Time: 6584.92 ms
[2022-04-06 23:53:57	                main:574]	:	INFO	:	Epoch 552 | loss: nan | val_loss: nan | Time: 6565.9 ms
[2022-04-06 23:54:03	                main:574]	:	INFO	:	Epoch 553 | loss: nan | val_loss: nan | Time: 6570.35 ms
[2022-04-06 23:54:10	                main:574]	:	INFO	:	Epoch 554 | loss: nan | val_loss: nan | Time: 6581.15 ms
[2022-04-06 23:54:17	                main:574]	:	INFO	:	Epoch 555 | loss: nan | val_loss: nan | Time: 6582 ms
[2022-04-06 23:54:23	                main:574]	:	INFO	:	Epoch 556 | loss: nan | val_loss: nan | Time: 6565.07 ms
[2022-04-06 23:54:30	                main:574]	:	INFO	:	Epoch 557 | loss: nan | val_loss: nan | Time: 6592 ms
[2022-04-06 23:54:36	                main:574]	:	INFO	:	Epoch 558 | loss: nan | val_loss: nan | Time: 6574.72 ms
[2022-04-06 23:54:43	                main:574]	:	INFO	:	Epoch 559 | loss: nan | val_loss: nan | Time: 6564.55 ms
[2022-04-06 23:54:49	                main:574]	:	INFO	:	Epoch 560 | loss: nan | val_loss: nan | Time: 6574.84 ms
[2022-04-06 23:54:56	                main:574]	:	INFO	:	Epoch 561 | loss: nan | val_loss: nan | Time: 6603.25 ms
[2022-04-06 23:55:03	                main:574]	:	INFO	:	Epoch 562 | loss: nan | val_loss: nan | Time: 6553.22 ms
[2022-04-06 23:55:09	                main:574]	:	INFO	:	Epoch 563 | loss: nan | val_loss: nan | Time: 6575.39 ms
[2022-04-06 23:55:16	                main:574]	:	INFO	:	Epoch 564 | loss: nan | val_loss: nan | Time: 6583.65 ms
[2022-04-06 23:55:22	                main:574]	:	INFO	:	Epoch 565 | loss: nan | val_loss: nan | Time: 6559.02 ms
[2022-04-06 23:55:29	                main:574]	:	INFO	:	Epoch 566 | loss: nan | val_loss: nan | Time: 6565.85 ms
[2022-04-06 23:55:35	                main:574]	:	INFO	:	Epoch 567 | loss: nan | val_loss: nan | Time: 6580.69 ms
[2022-04-06 23:55:42	                main:574]	:	INFO	:	Epoch 568 | loss: nan | val_loss: nan | Time: 6572.3 ms
[2022-04-06 23:55:49	                main:574]	:	INFO	:	Epoch 569 | loss: nan | val_loss: nan | Time: 6560.18 ms
[2022-04-06 23:55:55	                main:574]	:	INFO	:	Epoch 570 | loss: nan | val_loss: nan | Time: 6573.56 ms
[2022-04-06 23:56:02	                main:574]	:	INFO	:	Epoch 571 | loss: nan | val_loss: nan | Time: 6593.96 ms
[2022-04-06 23:56:08	                main:574]	:	INFO	:	Epoch 572 | loss: nan | val_loss: nan | Time: 6558.83 ms
[2022-04-06 23:56:15	                main:574]	:	INFO	:	Epoch 573 | loss: nan | val_loss: nan | Time: 6654.7 ms
[2022-04-06 23:56:22	                main:574]	:	INFO	:	Epoch 574 | loss: nan | val_loss: nan | Time: 6580.59 ms
[2022-04-06 23:56:28	                main:574]	:	INFO	:	Epoch 575 | loss: nan | val_loss: nan | Time: 6753.68 ms
[2022-04-06 23:56:35	                main:574]	:	INFO	:	Epoch 576 | loss: nan | val_loss: nan | Time: 6583.9 ms
[2022-04-06 23:56:42	                main:574]	:	INFO	:	Epoch 577 | loss: nan | val_loss: nan | Time: 6578.2 ms
[2022-04-06 23:56:48	                main:574]	:	INFO	:	Epoch 578 | loss: nan | val_loss: nan | Time: 6555.22 ms
[2022-04-06 23:56:55	                main:574]	:	INFO	:	Epoch 579 | loss: nan | val_loss: nan | Time: 6587.21 ms
[2022-04-06 23:57:01	                main:574]	:	INFO	:	Epoch 580 | loss: nan | val_loss: nan | Time: 6580.29 ms
[2022-04-06 23:57:08	                main:574]	:	INFO	:	Epoch 581 | loss: nan | val_loss: nan | Time: 6565.43 ms
[2022-04-06 23:57:14	                main:574]	:	INFO	:	Epoch 582 | loss: nan | val_loss: nan | Time: 6573.07 ms
[2022-04-06 23:57:21	                main:574]	:	INFO	:	Epoch 583 | loss: nan | val_loss: nan | Time: 6573.91 ms
[2022-04-06 23:57:28	                main:574]	:	INFO	:	Epoch 584 | loss: nan | val_loss: nan | Time: 6586.04 ms
[2022-04-06 23:57:34	                main:574]	:	INFO	:	Epoch 585 | loss: nan | val_loss: nan | Time: 6546.54 ms
[2022-04-06 23:57:41	                main:574]	:	INFO	:	Epoch 586 | loss: nan | val_loss: nan | Time: 6584.42 ms
[2022-04-06 23:57:47	                main:574]	:	INFO	:	Epoch 587 | loss: nan | val_loss: nan | Time: 6582.26 ms
[2022-04-06 23:57:54	                main:574]	:	INFO	:	Epoch 588 | loss: nan | val_loss: nan | Time: 6562.39 ms
[2022-04-06 23:58:00	                main:574]	:	INFO	:	Epoch 589 | loss: nan | val_loss: nan | Time: 6589.34 ms
[2022-04-06 23:58:07	                main:574]	:	INFO	:	Epoch 590 | loss: nan | val_loss: nan | Time: 6572.51 ms
[2022-04-06 23:58:14	                main:574]	:	INFO	:	Epoch 591 | loss: nan | val_loss: nan | Time: 6568.41 ms
[2022-04-06 23:58:20	                main:574]	:	INFO	:	Epoch 592 | loss: nan | val_loss: nan | Time: 6576.15 ms
[2022-04-06 23:58:27	                main:574]	:	INFO	:	Epoch 593 | loss: nan | val_loss: nan | Time: 6566.84 ms
[2022-04-06 23:58:33	                main:574]	:	INFO	:	Epoch 594 | loss: nan | val_loss: nan | Time: 6561.73 ms
[2022-04-06 23:58:40	                main:574]	:	INFO	:	Epoch 595 | loss: nan | val_loss: nan | Time: 6581.53 ms
[2022-04-06 23:58:46	                main:574]	:	INFO	:	Epoch 596 | loss: nan | val_loss: nan | Time: 6569.49 ms
[2022-04-06 23:58:53	                main:574]	:	INFO	:	Epoch 597 | loss: nan | val_loss: nan | Time: 6581.27 ms
[2022-04-06 23:59:00	                main:574]	:	INFO	:	Epoch 598 | loss: nan | val_loss: nan | Time: 6551.51 ms
[2022-04-06 23:59:06	                main:574]	:	INFO	:	Epoch 599 | loss: nan | val_loss: nan | Time: 6583.76 ms
[2022-04-06 23:59:13	                main:574]	:	INFO	:	Epoch 600 | loss: nan | val_loss: nan | Time: 6572.33 ms
[2022-04-06 23:59:19	                main:574]	:	INFO	:	Epoch 601 | loss: nan | val_loss: nan | Time: 6558.83 ms
[2022-04-06 23:59:26	                main:574]	:	INFO	:	Epoch 602 | loss: nan | val_loss: nan | Time: 6579.72 ms
[2022-04-06 23:59:33	                main:574]	:	INFO	:	Epoch 603 | loss: nan | val_loss: nan | Time: 6578.94 ms
[2022-04-06 23:59:39	                main:574]	:	INFO	:	Epoch 604 | loss: nan | val_loss: nan | Time: 6569.12 ms
[2022-04-06 23:59:46	                main:574]	:	INFO	:	Epoch 605 | loss: nan | val_loss: nan | Time: 6565.1 ms
[2022-04-06 23:59:52	                main:574]	:	INFO	:	Epoch 606 | loss: nan | val_loss: nan | Time: 6579.18 ms
[2022-04-06 23:59:59	                main:574]	:	INFO	:	Epoch 607 | loss: nan | val_loss: nan | Time: 6558.76 ms
[2022-04-07 00:00:05	                main:574]	:	INFO	:	Epoch 608 | loss: nan | val_loss: nan | Time: 6577.84 ms
[2022-04-07 00:00:12	                main:574]	:	INFO	:	Epoch 609 | loss: nan | val_loss: nan | Time: 6580.51 ms
[2022-04-07 00:00:19	                main:574]	:	INFO	:	Epoch 610 | loss: nan | val_loss: nan | Time: 6581.97 ms
[2022-04-07 00:00:25	                main:574]	:	INFO	:	Epoch 611 | loss: nan | val_loss: nan | Time: 6589.57 ms
[2022-04-07 00:00:32	                main:574]	:	INFO	:	Epoch 612 | loss: nan | val_loss: nan | Time: 6572.99 ms
[2022-04-07 00:00:38	                main:574]	:	INFO	:	Epoch 613 | loss: nan | val_loss: nan | Time: 6581.26 ms
[2022-04-07 00:00:45	                main:574]	:	INFO	:	Epoch 614 | loss: nan | val_loss: nan | Time: 6562.89 ms
[2022-04-07 00:00:51	                main:574]	:	INFO	:	Epoch 615 | loss: nan | val_loss: nan | Time: 6558.93 ms
[2022-04-07 00:00:58	                main:574]	:	INFO	:	Epoch 616 | loss: nan | val_loss: nan | Time: 6579.68 ms
[2022-04-07 00:01:05	                main:574]	:	INFO	:	Epoch 617 | loss: nan | val_loss: nan | Time: 6557.25 ms
[2022-04-07 00:01:11	                main:574]	:	INFO	:	Epoch 618 | loss: nan | val_loss: nan | Time: 6568.35 ms
[2022-04-07 00:01:18	                main:574]	:	INFO	:	Epoch 619 | loss: nan | val_loss: nan | Time: 6579.11 ms
[2022-04-07 00:01:24	                main:574]	:	INFO	:	Epoch 620 | loss: nan | val_loss: nan | Time: 6566.59 ms
[2022-04-07 00:01:31	                main:574]	:	INFO	:	Epoch 621 | loss: nan | val_loss: nan | Time: 6566.75 ms
[2022-04-07 00:01:37	                main:574]	:	INFO	:	Epoch 622 | loss: nan | val_loss: nan | Time: 6572.62 ms
[2022-04-07 00:01:44	                main:574]	:	INFO	:	Epoch 623 | loss: nan | val_loss: nan | Time: 6569.34 ms
[2022-04-07 00:01:51	                main:574]	:	INFO	:	Epoch 624 | loss: nan | val_loss: nan | Time: 6562.79 ms
[2022-04-07 00:01:57	                main:574]	:	INFO	:	Epoch 625 | loss: nan | val_loss: nan | Time: 6824.46 ms
[2022-04-07 00:02:04	                main:574]	:	INFO	:	Epoch 626 | loss: nan | val_loss: nan | Time: 6574.69 ms
[2022-04-07 00:02:11	                main:574]	:	INFO	:	Epoch 627 | loss: nan | val_loss: nan | Time: 6554.28 ms
[2022-04-07 00:02:17	                main:574]	:	INFO	:	Epoch 628 | loss: nan | val_loss: nan | Time: 6580.6 ms
[2022-04-07 00:02:24	                main:574]	:	INFO	:	Epoch 629 | loss: nan | val_loss: nan | Time: 6599.22 ms
[2022-04-07 00:02:30	                main:574]	:	INFO	:	Epoch 630 | loss: nan | val_loss: nan | Time: 6566.43 ms
[2022-04-07 00:02:37	                main:574]	:	INFO	:	Epoch 631 | loss: nan | val_loss: nan | Time: 6576.37 ms
[2022-04-07 00:02:44	                main:574]	:	INFO	:	Epoch 632 | loss: nan | val_loss: nan | Time: 6582.3 ms
[2022-04-07 00:02:50	                main:574]	:	INFO	:	Epoch 633 | loss: nan | val_loss: nan | Time: 6565.63 ms
[2022-04-07 00:02:57	                main:574]	:	INFO	:	Epoch 634 | loss: nan | val_loss: nan | Time: 6580.03 ms
[2022-04-07 00:03:03	                main:574]	:	INFO	:	Epoch 635 | loss: nan | val_loss: nan | Time: 6568.85 ms
[2022-04-07 00:03:10	                main:574]	:	INFO	:	Epoch 636 | loss: nan | val_loss: nan | Time: 6572.32 ms
[2022-04-07 00:03:16	                main:574]	:	INFO	:	Epoch 637 | loss: nan | val_loss: nan | Time: 6557.58 ms
[2022-04-07 00:03:23	                main:574]	:	INFO	:	Epoch 638 | loss: nan | val_loss: nan | Time: 6578.45 ms
[2022-04-07 00:03:30	                main:574]	:	INFO	:	Epoch 639 | loss: nan | val_loss: nan | Time: 6577.39 ms
[2022-04-07 00:03:36	                main:574]	:	INFO	:	Epoch 640 | loss: nan | val_loss: nan | Time: 6555.1 ms
[2022-04-07 00:03:43	                main:574]	:	INFO	:	Epoch 641 | loss: nan | val_loss: nan | Time: 6574.25 ms
[2022-04-07 00:03:49	                main:574]	:	INFO	:	Epoch 642 | loss: nan | val_loss: nan | Time: 6579.11 ms
[2022-04-07 00:03:56	                main:574]	:	INFO	:	Epoch 643 | loss: nan | val_loss: nan | Time: 6564.54 ms
[2022-04-07 00:04:02	                main:574]	:	INFO	:	Epoch 644 | loss: nan | val_loss: nan | Time: 6568.72 ms
[2022-04-07 00:04:09	                main:574]	:	INFO	:	Epoch 645 | loss: nan | val_loss: nan | Time: 6580.03 ms
[2022-04-07 00:04:16	                main:574]	:	INFO	:	Epoch 646 | loss: nan | val_loss: nan | Time: 6559.44 ms
[2022-04-07 00:04:22	                main:574]	:	INFO	:	Epoch 647 | loss: nan | val_loss: nan | Time: 6556.55 ms
[2022-04-07 00:04:29	                main:574]	:	INFO	:	Epoch 648 | loss: nan | val_loss: nan | Time: 6576.78 ms
[2022-04-07 00:04:35	                main:574]	:	INFO	:	Epoch 649 | loss: nan | val_loss: nan | Time: 6563.57 ms
[2022-04-07 00:04:42	                main:574]	:	INFO	:	Epoch 650 | loss: nan | val_loss: nan | Time: 6558.91 ms
[2022-04-07 00:04:48	                main:574]	:	INFO	:	Epoch 651 | loss: nan | val_loss: nan | Time: 6587.19 ms
[2022-04-07 00:04:55	                main:574]	:	INFO	:	Epoch 652 | loss: nan | val_loss: nan | Time: 6608.15 ms
[2022-04-07 00:05:02	                main:574]	:	INFO	:	Epoch 653 | loss: nan | val_loss: nan | Time: 6552.83 ms
[2022-04-07 00:05:08	                main:574]	:	INFO	:	Epoch 654 | loss: nan | val_loss: nan | Time: 6571.4 ms
[2022-04-07 00:05:15	                main:574]	:	INFO	:	Epoch 655 | loss: nan | val_loss: nan | Time: 6573.28 ms
[2022-04-07 00:05:21	                main:574]	:	INFO	:	Epoch 656 | loss: nan | val_loss: nan | Time: 6564.49 ms
[2022-04-07 00:05:28	                main:574]	:	INFO	:	Epoch 657 | loss: nan | val_loss: nan | Time: 6565.09 ms
[2022-04-07 00:05:34	                main:574]	:	INFO	:	Epoch 658 | loss: nan | val_loss: nan | Time: 6576.18 ms
[2022-04-07 00:05:41	                main:574]	:	INFO	:	Epoch 659 | loss: nan | val_loss: nan | Time: 6559.82 ms
[2022-04-07 00:05:48	                main:574]	:	INFO	:	Epoch 660 | loss: nan | val_loss: nan | Time: 6566.38 ms
[2022-04-07 00:05:54	                main:574]	:	INFO	:	Epoch 661 | loss: nan | val_loss: nan | Time: 6567.55 ms
[2022-04-07 00:06:01	                main:574]	:	INFO	:	Epoch 662 | loss: nan | val_loss: nan | Time: 6571.98 ms
[2022-04-07 00:06:07	                main:574]	:	INFO	:	Epoch 663 | loss: nan | val_loss: nan | Time: 6560.62 ms
[2022-04-07 00:06:14	                main:574]	:	INFO	:	Epoch 664 | loss: nan | val_loss: nan | Time: 6574.12 ms
[2022-04-07 00:06:20	                main:574]	:	INFO	:	Epoch 665 | loss: nan | val_loss: nan | Time: 6580.6 ms
[2022-04-07 00:06:27	                main:574]	:	INFO	:	Epoch 666 | loss: nan | val_loss: nan | Time: 6551.25 ms
[2022-04-07 00:06:34	                main:574]	:	INFO	:	Epoch 667 | loss: nan | val_loss: nan | Time: 6586.85 ms
[2022-04-07 00:06:40	                main:574]	:	INFO	:	Epoch 668 | loss: nan | val_loss: nan | Time: 6580.47 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GT 1030)
[2022-04-08 19:52:31	                main:435]	:	INFO	:	Set logging level to 1
[2022-04-08 19:52:31	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-04-08 19:52:31	                main:444]	:	INFO	:	Resolving all filenames
[2022-04-08 19:52:31	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-08 19:52:31	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-08 19:52:31	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-08 19:52:31	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-08 19:52:31	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-08 19:52:31	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-04-08 19:52:31	                main:474]	:	INFO	:	Configuration: 
[2022-04-08 19:52:31	                main:475]	:	INFO	:	    Model type: GRU
[2022-04-08 19:52:31	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-04-08 19:52:31	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-04-08 19:52:31	                main:478]	:	INFO	:	    Batch Size: 128
[2022-04-08 19:52:31	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-04-08 19:52:31	                main:480]	:	INFO	:	    Patience: 10
[2022-04-08 19:52:31	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-04-08 19:52:31	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-04-08 19:52:31	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-04-08 19:52:31	                main:484]	:	INFO	:	    # Threads: 1
[2022-04-08 19:52:31	                main:486]	:	INFO	:	Preparing Dataset
[2022-04-08 19:52:31	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-08 19:52:32	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-08 19:54:11	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-04-08 19:54:11	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-08 19:54:11	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-08 19:54:11	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-04-08 19:54:11	                main:494]	:	INFO	:	Creating Model
[2022-04-08 19:54:11	                main:507]	:	INFO	:	Preparing config file
[2022-04-08 19:54:11	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-04-08 19:54:11	                main:512]	:	INFO	:	Loading config


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFBA9974F69

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 04/08/22 19:54:11
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\5;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 00000000ac060000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000ac130000 00000000001f5000 C:\Windows\SYSTEM32\ntdll.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 00000000ab9b0000 00000000000be000 C:\Windows\System32\KERNEL32.DLL (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 00000000a9940000 00000000002c8000 C:\Windows\System32\KERNELBASE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 00000000aaf60000 00000000001a0000 C:\Windows\System32\USER32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000a9ef0000 0000000000022000 C:\Windows\System32\win32u.dll (6.2.19041.1586) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1586

ModLoad: 00000000abd40000 000000000002b000 C:\Windows\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202

ModLoad: 00000000a9f20000 000000000010b000 C:\Windows\System32\gdi32full.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 00000000a9cc0000 000000000009d000 C:\Windows\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 00000000a9df0000 0000000000100000 C:\Windows\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 00000000abc80000 00000000000ae000 C:\Windows\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000ab850000 000000000009e000 C:\Windows\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.19041.546

ModLoad: 00000000abb50000 000000000009c000 C:\Windows\System32\sechost.dll (6.2.19041.1586) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000aa3f0000 0000000000125000 C:\Windows\System32\RPCRT4.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000008adc0000 0000000000058000 C:\ProgramData\BOINC\slots\5\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000091320000 0000000000092000 C:\Windows\SYSTEM32\MSVCP140.dll (14.28.29334.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\6\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.28.29334.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.28.29334.0

ModLoad: 000000009f270000 00000000001e4000 C:\Windows\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.867

ModLoad: 0000000091fe0000 0000000000019000 C:\Windows\SYSTEM32\VCRUNTIME140.dll (14.28.29334.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\6\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.28.29334.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.28.29334.0

ModLoad: 0000000091fb0000 000000000000c000 C:\Windows\SYSTEM32\VCRUNTIME140_1.dll (14.28.29334.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\6\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.28.29334.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.28.29334.0

ModLoad: 0000000028da0000 0000000024b49000 C:\ProgramData\BOINC\slots\5\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000008ad70000 0000000000045000 C:\ProgramData\BOINC\slots\5\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000258e0000 00000000034b2000 C:\ProgramData\BOINC\slots\5\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000535f0000 00000000030a5000 C:\ProgramData\BOINC\slots\5\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 000000000a530000 000000001b3a4000 C:\ProgramData\BOINC\slots\5\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 00000000a04e0000 0000000000010000 C:\ProgramData\BOINC\slots\5\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 00000000ff940000 000000000abe7000 C:\ProgramData\BOINC\slots\5\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000804b0000 000000000020d000 C:\ProgramData\BOINC\slots\5\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 00000000f67a0000 000000000919f000 C:\ProgramData\BOINC\slots\5\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 0000000062d60000 00000000002db000 C:\ProgramData\BOINC\slots\5\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000f2a40000 0000000003d5b000 C:\ProgramData\BOINC\slots\5\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 000000008b930000 0000000000040000 C:\ProgramData\BOINC\slots\5\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000f0b70000 0000000001eca000 C:\ProgramData\BOINC\slots\5\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000aab30000 0000000000030000 C:\Windows\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000a7780000 0000000000012000 C:\Windows\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000aa520000 0000000000470000 C:\Windows\System32\Setupapi.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000a9850000 000000000004e000 C:\Windows\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 00000000a98a0000 0000000000027000 C:\Windows\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000a95f0000 0000000000033000 C:\Windows\SYSTEM32\DEVOBJ.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 00000000a98d0000 0000000000068000 C:\Windows\System32\WINTRUST.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 00000000aa030000 0000000000156000 C:\Windows\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000a9430000 0000000000012000 C:\Windows\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000ab100000 0000000000744000 C:\Windows\System32\Shell32.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.19041.964 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.964

ModLoad: 00000000a7980000 0000000000794000 C:\Windows\SYSTEM32\windows.storage.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000abd70000 0000000000354000 C:\Windows\System32\combase.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.19041.1320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1320

ModLoad: 00000000a92b0000 000000000002c000 C:\Windows\SYSTEM32\Wldp.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000ab900000 00000000000ad000 C:\Windows\System32\SHCORE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000aaad0000 0000000000055000 C:\Windows\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000061f30000 00000000002cc000 C:\Windows\system32\nvcuda.dll (30.0.14.7141) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r470\r471_34\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 30.0.14.7141
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.4.94 driver
    Product Version       : 30.0.14.7141

ModLoad: 00000000a2b20000 000000000000a000 C:\Windows\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000ef550000 000000000161a000 C:\Windows\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_5d5c294bb8d17217\nvcuda64.dll (30.0.14.7141) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r470\r471_34\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 30.0.14.7141
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.4.94 driver
    Product Version       : 30.0.14.7141

ModLoad: 00000000a2ae0000 0000000000031000 C:\Windows\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.19041.906 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.906

ModLoad: 00000000a2730000 0000000000148000 C:\Windows\SYSTEM32\drvstore.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : drvstore.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 00000000a9190000 000000000000c000 C:\Windows\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000a72a0000 000000000009e000 C:\Windows\system32\uxtheme.dll (6.2.19041.1266) (-exported- Symbols Loaded)
    Linked PDB Filename   : UxTheme.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000a0940000 0000000000719000 C:\Windows\SYSTEM32\nvapi64.dll (30.0.14.7141) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r470\r471_34\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 30.0.14.7141
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 30.0.14.7141

ModLoad: 00000000aae30000 000000000012a000 C:\Windows\System32\ole32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : ole32.pdb
    File Version          : 10.0.19041.1320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1320

ModLoad: 00000000a9d60000 0000000000082000 C:\Windows\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.19041.1415 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1415



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3610, Write: 307, Other 912

- I/O Transfers Counters -
Read: 6627358, Write: 6049, Other 29934

- Paged Pool Usage -
QuotaPagedPoolUsage: 3449344, QuotaPeakPagedPoolUsage: 3449344
QuotaNonPagedPoolUsage: 37800, QuotaPeakNonPagedPoolUsage: 37864

- Virtual Memory Usage -
VirtualSize: -1471586304, PeakVirtualSize: -869621760

- Pagefile Usage -
PagefileUsage: -1471586304, PeakPagefileUsage: -1471586304

- Working Set Size -
WorkingSetSize: 1138122752, PeakWorkingSetSize: 1138126848, PageFaultCount: 395339

*** Dump of thread ID 11744 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 24531250.000000, User Time: 35625000.000000, Wait Time: 76820424.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFBA9974F69

- Registers -
rax=00000000ac15b3c7 rbx=00000000ac3c4910 rcx=00000000070c0000 rdx=0000000000000000 rsi=00000000861e6430 rdi=0000000019930520
r8=000000000000004e r9=0000000000000027 r10=00000000ac15b86b r11=0000000003d30196 r12=000000003d530370 r13=00000000861e6640
r14=000000005f68bbb0 r15=0000000000000000 rip=00000000a9974f69 rsp=00000000861e62d0 rbp=00000000861e65c0
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
861e63a0 ac2da884 00000040 0000004f 3d530800 000006c4 KERNELBASE!RaiseException+0x0 
861e6400 ac081ca6 00000001 06ed0000 61e8d0e8 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
861e64b0 ac08593b 00000000 00000030 00000020 00000008 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
861e6600 ac081a78 00000000 00000000 861e6930 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
861e66d0 ac081cfc 861e6930 00000000 00000080 861e6c00 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
861e6790 ac08c4dd 861e6c00 861e6c00 861e6c00 861e6c00 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
861e6a80 ac07b2fe 861e7098 861e6c00 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
861ff820 ac2bc6f8 089abd50 00000000 00000000 08c3fd90 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
861ff860 ab9c7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
861ff890 ac182651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
861ff910 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 6420 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 76820416.000000

- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000868ff740 rsi=0000000000000000 rdi=0000000000000064
r8=0000000086200000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000ac1cd3f4 rsp=00000000868ff718 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
868ff710 a998962e 868ff7d8 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0 
868ff7b0 ac09a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0 
868ff7e0 ab9c7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
868ff810 ac182651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
868ff890 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 404 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 76820416.000000

- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=00000000869ff5f0 rsi=0000000000000000 rdi=000000000000000d
r8=0000000008c91750 r9=0000000008bd3b00 r10=0000000000000000 r11=00000000869ff560 r12=0000000000000064 r13=00000000869ff5f0
r14=00000000869ff2f0 r15=0000000000000000 rip=00000000ac1cd8c4 rsp=00000000869ff298 rbp=0000000008bd3b70
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
869ff290 a998cb20 00000000 863f4000 ac29a4d0 863f4000 ntdll!ZwWaitForMultipleObjects+0x0 
869ff580 a998ca1e 06ee38b0 006e0069 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
869ff5c0 ef721264 08bd73b0 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
869ff800 ef7c7f5d 00000000 08bd3b70 00000000 00000000 nvcuda64!+0x0 
869ff8b0 ef720c33 c0c02114 8549924b 09193c90 00000000 nvcuda64!cuProfilerStop+0x0 
869ff8e0 efa56824 09193c90 00000000 00000000 00000000 nvcuda64!+0x0 
869ff910 ab9c7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
869ff940 ac182651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
869ff9c0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 12120 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 76814128.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002a4 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002a4
r8=0000000086affdd8 r9=0000000000000000 r10=0000000000000000 r11=0000000086affe38 r12=0000000000000000 r13=0000000000000000
r14=00000000000002a4 r15=0000000000000000 rip=00000000ac1ccdf4 rsp=0000000086affb38 rbp=0000000008b9ab90
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
86affb30 a9961a5e 00000000 ac182630 0000027f 00000000 ntdll!ZwWaitForSingleObject+0x0 
86affbd0 ef94e0ad 091941a0 00000000 00000000 000002a4 KERNELBASE!WaitForSingleObjectEx+0x0 
86affe30 ef720c33 00000000 091941a0 ef550000 08bf1790 nvcuda64!cuProfilerStop+0x0 
86affe60 efa56824 091941a0 00000000 00000000 00000000 nvcuda64!+0x0 
86affe90 ab9c7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
86affec0 ac182651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
86afff40 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 13032 (state: Waiting): ***

- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 76820408.000000

- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=0000000008e5cf80 rdx=0000000086bffba8 rsi=0000000086bffb10 rdi=0000000000000000
r8=0000000000000004 r9=0000000000000004 r10=0000000000000003 r11=0000000086bffb40 r12=0000000086bffba8 r13=0000000000000000
r14=0000000008e5cf80 r15=0000000008e60320 rip=00000000ac1d0764 rsp=0000000086bffae8 rbp=0000000086bffb40
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
86bffae0 ac194295 00000102 00000102 00000000 86bffb10 ntdll!NtWaitForAlertByThreadId+0x0 
86bffb50 a99acef9 08e5db00 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0 
86bffb80 ef68effc 08e5db00 08e5db00 08e5db00 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0 
86bffbe0 ef720c33 00000005 bfe4e9dc c081457a 00000000 nvcuda64!+0x0 
86bffc10 efa56824 09194bc0 00000000 00000000 00000000 nvcuda64!+0x0 
86bffc40 ab9c7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
86bffc70 ac182651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
86bffcf0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)