Task 7663276

Name ParityModified-1631730999-19184-2_1
Workunit 5253923
Created 28 Sep 2021, 1:59:09 UTC
Sent 28 Sep 2021, 2:36:03 UTC
Report deadline 5 Oct 2021, 2:36:03 UTC
Received 29 Sep 2021, 17:28:39 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 6043
Run time 1 hours 10 min 17 sec
CPU time 59 min 56 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 957.46 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.54 GB
Peak swap size 3.44 GB
Peak disk usage 1.53 GB

Stderr output

<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
              main:574]	:	INFO	:	Epoch 332 | loss: nan | val_loss: nan | Time: 7129.02 ms
[2021-09-28 21:33:47	                main:574]	:	INFO	:	Epoch 333 | loss: nan | val_loss: nan | Time: 7194.79 ms
[2021-09-28 21:33:54	                main:574]	:	INFO	:	Epoch 334 | loss: nan | val_loss: nan | Time: 7196 ms
[2021-09-28 21:34:01	                main:574]	:	INFO	:	Epoch 335 | loss: nan | val_loss: nan | Time: 7436.64 ms
[2021-09-28 21:34:09	                main:574]	:	INFO	:	Epoch 336 | loss: nan | val_loss: nan | Time: 7055.23 ms
[2021-09-28 21:34:16	                main:574]	:	INFO	:	Epoch 337 | loss: nan | val_loss: nan | Time: 6931.98 ms
[2021-09-28 21:34:23	                main:574]	:	INFO	:	Epoch 338 | loss: nan | val_loss: nan | Time: 7080.15 ms
[2021-09-28 21:34:30	                main:574]	:	INFO	:	Epoch 339 | loss: nan | val_loss: nan | Time: 7071.46 ms
[2021-09-28 21:34:37	                main:574]	:	INFO	:	Epoch 340 | loss: nan | val_loss: nan | Time: 7065.32 ms
[2021-09-28 21:34:44	                main:574]	:	INFO	:	Epoch 341 | loss: nan | val_loss: nan | Time: 7154.12 ms
[2021-09-28 21:34:51	                main:574]	:	INFO	:	Epoch 342 | loss: nan | val_loss: nan | Time: 7115.9 ms
[2021-09-28 21:34:59	                main:574]	:	INFO	:	Epoch 343 | loss: nan | val_loss: nan | Time: 7167.24 ms
[2021-09-28 21:35:06	                main:574]	:	INFO	:	Epoch 344 | loss: nan | val_loss: nan | Time: 7563.8 ms
[2021-09-28 21:35:14	                main:574]	:	INFO	:	Epoch 345 | loss: nan | val_loss: nan | Time: 7227 ms
[2021-09-28 21:35:21	                main:574]	:	INFO	:	Epoch 346 | loss: nan | val_loss: nan | Time: 7045.81 ms
[2021-09-28 21:35:28	                main:574]	:	INFO	:	Epoch 347 | loss: nan | val_loss: nan | Time: 7226.65 ms
[2021-09-28 21:35:36	                main:574]	:	INFO	:	Epoch 348 | loss: nan | val_loss: nan | Time: 7767.24 ms
[2021-09-28 21:35:43	                main:574]	:	INFO	:	Epoch 349 | loss: nan | val_loss: nan | Time: 7368.02 ms
[2021-09-28 21:35:50	                main:574]	:	INFO	:	Epoch 350 | loss: nan | val_loss: nan | Time: 7100.15 ms
[2021-09-28 21:35:58	                main:574]	:	INFO	:	Epoch 351 | loss: nan | val_loss: nan | Time: 7311.62 ms
[2021-09-28 21:36:05	                main:574]	:	INFO	:	Epoch 352 | loss: nan | val_loss: nan | Time: 7314.29 ms
[2021-09-28 21:36:12	                main:574]	:	INFO	:	Epoch 353 | loss: nan | val_loss: nan | Time: 7173.51 ms
[2021-09-28 21:36:20	                main:574]	:	INFO	:	Epoch 354 | loss: nan | val_loss: nan | Time: 7351.76 ms
[2021-09-28 21:36:27	                main:574]	:	INFO	:	Epoch 355 | loss: nan | val_loss: nan | Time: 7285.79 ms
[2021-09-28 21:36:35	                main:574]	:	INFO	:	Epoch 356 | loss: nan | val_loss: nan | Time: 7636.57 ms
[2021-09-28 21:36:42	                main:574]	:	INFO	:	Epoch 357 | loss: nan | val_loss: nan | Time: 7037.9 ms
[2021-09-28 21:36:49	                main:574]	:	INFO	:	Epoch 358 | loss: nan | val_loss: nan | Time: 7161.92 ms
[2021-09-28 21:36:56	                main:574]	:	INFO	:	Epoch 359 | loss: nan | val_loss: nan | Time: 7169.91 ms
[2021-09-28 21:37:04	                main:574]	:	INFO	:	Epoch 360 | loss: nan | val_loss: nan | Time: 7317.45 ms
[2021-09-28 21:37:11	                main:574]	:	INFO	:	Epoch 361 | loss: nan | val_loss: nan | Time: 7094.54 ms
[2021-09-28 21:37:18	                main:574]	:	INFO	:	Epoch 362 | loss: nan | val_loss: nan | Time: 7283.65 ms
[2021-09-28 21:37:26	                main:574]	:	INFO	:	Epoch 363 | loss: nan | val_loss: nan | Time: 7087.18 ms
[2021-09-28 21:37:32	                main:574]	:	INFO	:	Epoch 364 | loss: nan | val_loss: nan | Time: 6847.52 ms
[2021-09-28 21:37:40	                main:574]	:	INFO	:	Epoch 365 | loss: nan | val_loss: nan | Time: 6932.13 ms
[2021-09-28 21:37:47	                main:574]	:	INFO	:	Epoch 366 | loss: nan | val_loss: nan | Time: 7128.47 ms
[2021-09-28 21:37:54	                main:574]	:	INFO	:	Epoch 367 | loss: nan | val_loss: nan | Time: 7490.42 ms
[2021-09-28 21:38:03	                main:574]	:	INFO	:	Epoch 368 | loss: nan | val_loss: nan | Time: 8534.92 ms
[2021-09-28 21:38:10	                main:574]	:	INFO	:	Epoch 369 | loss: nan | val_loss: nan | Time: 7234.01 ms
[2021-09-28 21:38:18	                main:574]	:	INFO	:	Epoch 370 | loss: nan | val_loss: nan | Time: 7691.29 ms
[2021-09-28 21:38:26	                main:574]	:	INFO	:	Epoch 371 | loss: nan | val_loss: nan | Time: 7485.99 ms
[2021-09-28 21:38:37	                main:574]	:	INFO	:	Epoch 372 | loss: nan | val_loss: nan | Time: 11270.2 ms
[2021-09-28 21:38:49	                main:574]	:	INFO	:	Epoch 373 | loss: nan | val_loss: nan | Time: 12273.2 ms
[2021-09-28 21:38:56	                main:574]	:	INFO	:	Epoch 374 | loss: nan | val_loss: nan | Time: 7143.12 ms
[2021-09-28 21:39:04	                main:574]	:	INFO	:	Epoch 375 | loss: nan | val_loss: nan | Time: 7312.15 ms
[2021-09-28 21:39:11	                main:574]	:	INFO	:	Epoch 376 | loss: nan | val_loss: nan | Time: 7341.91 ms
[2021-09-28 21:39:18	                main:574]	:	INFO	:	Epoch 377 | loss: nan | val_loss: nan | Time: 7090.79 ms
[2021-09-28 21:39:26	                main:574]	:	INFO	:	Epoch 378 | loss: nan | val_loss: nan | Time: 7120.12 ms
[2021-09-28 21:39:33	                main:574]	:	INFO	:	Epoch 379 | loss: nan | val_loss: nan | Time: 7464.31 ms
[2021-09-28 21:39:40	                main:574]	:	INFO	:	Epoch 380 | loss: nan | val_loss: nan | Time: 7304.98 ms
[2021-09-28 21:39:48	                main:574]	:	INFO	:	Epoch 381 | loss: nan | val_loss: nan | Time: 7215.08 ms
[2021-09-28 21:39:55	                main:574]	:	INFO	:	Epoch 382 | loss: nan | val_loss: nan | Time: 7183.67 ms
[2021-09-28 21:40:02	                main:574]	:	INFO	:	Epoch 383 | loss: nan | val_loss: nan | Time: 7346.57 ms
[2021-09-28 21:40:10	                main:574]	:	INFO	:	Epoch 384 | loss: nan | val_loss: nan | Time: 7309.05 ms
[2021-09-28 21:40:18	                main:574]	:	INFO	:	Epoch 385 | loss: nan | val_loss: nan | Time: 7698.04 ms
[2021-09-28 21:40:25	                main:574]	:	INFO	:	Epoch 386 | loss: nan | val_loss: nan | Time: 7297.76 ms
[2021-09-28 21:40:33	                main:574]	:	INFO	:	Epoch 387 | loss: nan | val_loss: nan | Time: 7426.09 ms
[2021-09-28 21:40:40	                main:574]	:	INFO	:	Epoch 388 | loss: nan | val_loss: nan | Time: 7292.53 ms
[2021-09-28 21:40:47	                main:574]	:	INFO	:	Epoch 389 | loss: nan | val_loss: nan | Time: 7350.78 ms
[2021-09-28 21:40:55	                main:574]	:	INFO	:	Epoch 390 | loss: nan | val_loss: nan | Time: 7277.49 ms
[2021-09-28 21:41:02	                main:574]	:	INFO	:	Epoch 391 | loss: nan | val_loss: nan | Time: 7274.92 ms
[2021-09-28 21:41:09	                main:574]	:	INFO	:	Epoch 392 | loss: nan | val_loss: nan | Time: 7196.89 ms
[2021-09-28 21:41:17	                main:574]	:	INFO	:	Epoch 393 | loss: nan | val_loss: nan | Time: 7372.75 ms
[2021-09-28 21:41:24	                main:574]	:	INFO	:	Epoch 394 | loss: nan | val_loss: nan | Time: 7001.84 ms
[2021-09-28 21:41:32	                main:574]	:	INFO	:	Epoch 395 | loss: nan | val_loss: nan | Time: 7415.22 ms
[2021-09-28 21:41:39	                main:574]	:	INFO	:	Epoch 396 | loss: nan | val_loss: nan | Time: 7023.86 ms
[2021-09-28 21:41:46	                main:574]	:	INFO	:	Epoch 397 | loss: nan | val_loss: nan | Time: 6988.76 ms
[2021-09-28 21:41:53	                main:574]	:	INFO	:	Epoch 398 | loss: nan | val_loss: nan | Time: 7036.58 ms
[2021-09-28 21:42:00	                main:574]	:	INFO	:	Epoch 399 | loss: nan | val_loss: nan | Time: 7437.34 ms
[2021-09-28 21:42:08	                main:574]	:	INFO	:	Epoch 400 | loss: nan | val_loss: nan | Time: 7322.77 ms
[2021-09-28 21:42:15	                main:574]	:	INFO	:	Epoch 401 | loss: nan | val_loss: nan | Time: 7241.33 ms
[2021-09-28 21:42:23	                main:574]	:	INFO	:	Epoch 402 | loss: nan | val_loss: nan | Time: 7621.22 ms
[2021-09-28 21:42:30	                main:574]	:	INFO	:	Epoch 403 | loss: nan | val_loss: nan | Time: 7158.57 ms
[2021-09-28 21:42:38	                main:574]	:	INFO	:	Epoch 404 | loss: nan | val_loss: nan | Time: 7417.67 ms
[2021-09-28 21:42:46	                main:574]	:	INFO	:	Epoch 405 | loss: nan | val_loss: nan | Time: 8576.64 ms
[2021-09-28 21:42:54	                main:574]	:	INFO	:	Epoch 406 | loss: nan | val_loss: nan | Time: 7249.16 ms
[2021-09-28 21:43:02	                main:574]	:	INFO	:	Epoch 407 | loss: nan | val_loss: nan | Time: 8035.08 ms
[2021-09-28 21:43:09	                main:574]	:	INFO	:	Epoch 408 | loss: nan | val_loss: nan | Time: 7421.59 ms
[2021-09-28 21:43:16	                main:574]	:	INFO	:	Epoch 409 | loss: nan | val_loss: nan | Time: 7302.96 ms
[2021-09-28 21:43:24	                main:574]	:	INFO	:	Epoch 410 | loss: nan | val_loss: nan | Time: 7224.2 ms
[2021-09-28 21:43:31	                main:574]	:	INFO	:	Epoch 411 | loss: nan | val_loss: nan | Time: 7307.89 ms
[2021-09-28 21:43:39	                main:574]	:	INFO	:	Epoch 412 | loss: nan | val_loss: nan | Time: 7465.73 ms
[2021-09-28 21:43:46	                main:574]	:	INFO	:	Epoch 413 | loss: nan | val_loss: nan | Time: 7230.38 ms
[2021-09-28 21:43:53	                main:574]	:	INFO	:	Epoch 414 | loss: nan | val_loss: nan | Time: 7268.07 ms
[2021-09-28 21:44:01	                main:574]	:	INFO	:	Epoch 415 | loss: nan | val_loss: nan | Time: 7548.77 ms
[2021-09-28 21:44:08	                main:574]	:	INFO	:	Epoch 416 | loss: nan | val_loss: nan | Time: 7357.31 ms
[2021-09-28 21:44:16	                main:574]	:	INFO	:	Epoch 417 | loss: nan | val_loss: nan | Time: 7707.71 ms
[2021-09-28 21:44:24	                main:574]	:	INFO	:	Epoch 418 | loss: nan | val_loss: nan | Time: 7133.15 ms
[2021-09-28 21:44:32	                main:574]	:	INFO	:	Epoch 419 | loss: nan | val_loss: nan | Time: 8326.16 ms
[2021-09-28 21:44:39	                main:574]	:	INFO	:	Epoch 420 | loss: nan | val_loss: nan | Time: 7289.08 ms
[2021-09-28 21:44:47	                main:574]	:	INFO	:	Epoch 421 | loss: nan | val_loss: nan | Time: 7312.75 ms
[2021-09-28 21:44:54	                main:574]	:	INFO	:	Epoch 422 | loss: nan | val_loss: nan | Time: 7294.65 ms
[2021-09-28 21:45:02	                main:574]	:	INFO	:	Epoch 423 | loss: nan | val_loss: nan | Time: 7844.92 ms
[2021-09-28 21:45:10	                main:574]	:	INFO	:	Epoch 424 | loss: nan | val_loss: nan | Time: 7236.26 ms
[2021-09-28 21:45:17	                main:574]	:	INFO	:	Epoch 425 | loss: nan | val_loss: nan | Time: 7306.41 ms
[2021-09-28 21:45:24	                main:574]	:	INFO	:	Epoch 426 | loss: nan | val_loss: nan | Time: 7329.21 ms
[2021-09-28 21:45:33	                main:574]	:	INFO	:	Epoch 427 | loss: nan | val_loss: nan | Time: 8142.25 ms
[2021-09-28 21:45:41	                main:574]	:	INFO	:	Epoch 428 | loss: nan | val_loss: nan | Time: 7955.02 ms
[2021-09-28 21:45:48	                main:574]	:	INFO	:	Epoch 429 | loss: nan | val_loss: nan | Time: 7271.35 ms
[2021-09-28 21:45:57	                main:574]	:	INFO	:	Epoch 430 | loss: nan | val_loss: nan | Time: 8926.05 ms
[2021-09-28 21:46:04	                main:574]	:	INFO	:	Epoch 431 | loss: nan | val_loss: nan | Time: 7463.82 ms
[2021-09-28 21:46:11	                main:574]	:	INFO	:	Epoch 432 | loss: nan | val_loss: nan | Time: 7006.27 ms
[2021-09-28 21:46:19	                main:574]	:	INFO	:	Epoch 433 | loss: nan | val_loss: nan | Time: 7211.15 ms
[2021-09-28 21:46:26	                main:574]	:	INFO	:	Epoch 434 | loss: nan | val_loss: nan | Time: 7030 ms
[2021-09-28 21:46:34	                main:574]	:	INFO	:	Epoch 435 | loss: nan | val_loss: nan | Time: 7810.25 ms
[2021-09-28 21:46:41	                main:574]	:	INFO	:	Epoch 436 | loss: nan | val_loss: nan | Time: 7326.2 ms
[2021-09-28 21:46:49	                main:574]	:	INFO	:	Epoch 437 | loss: nan | val_loss: nan | Time: 7238.92 ms
[2021-09-28 21:46:56	                main:574]	:	INFO	:	Epoch 438 | loss: nan | val_loss: nan | Time: 7014.43 ms
[2021-09-28 21:47:03	                main:574]	:	INFO	:	Epoch 439 | loss: nan | val_loss: nan | Time: 7333.92 ms
[2021-09-28 21:47:10	                main:574]	:	INFO	:	Epoch 440 | loss: nan | val_loss: nan | Time: 7066.39 ms
[2021-09-28 21:47:18	                main:574]	:	INFO	:	Epoch 441 | loss: nan | val_loss: nan | Time: 7321.6 ms
[2021-09-28 21:47:25	                main:574]	:	INFO	:	Epoch 442 | loss: nan | val_loss: nan | Time: 7039.28 ms
[2021-09-28 21:47:32	                main:574]	:	INFO	:	Epoch 443 | loss: nan | val_loss: nan | Time: 7023.55 ms
[2021-09-28 21:47:39	                main:574]	:	INFO	:	Epoch 444 | loss: nan | val_loss: nan | Time: 7211.15 ms
[2021-09-28 21:47:46	                main:574]	:	INFO	:	Epoch 445 | loss: nan | val_loss: nan | Time: 6987.39 ms
[2021-09-28 21:47:53	                main:574]	:	INFO	:	Epoch 446 | loss: nan | val_loss: nan | Time: 7091.51 ms
[2021-09-28 21:48:01	                main:574]	:	INFO	:	Epoch 447 | loss: nan | val_loss: nan | Time: 7273.81 ms
[2021-09-28 21:48:08	                main:574]	:	INFO	:	Epoch 448 | loss: nan | val_loss: nan | Time: 7286.43 ms
[2021-09-28 21:48:15	                main:574]	:	INFO	:	Epoch 449 | loss: nan | val_loss: nan | Time: 7165.87 ms
[2021-09-28 21:48:22	                main:574]	:	INFO	:	Epoch 450 | loss: nan | val_loss: nan | Time: 7194.15 ms
[2021-09-28 21:48:30	                main:574]	:	INFO	:	Epoch 451 | loss: nan | val_loss: nan | Time: 7022.79 ms
[2021-09-28 21:48:37	                main:574]	:	INFO	:	Epoch 452 | loss: nan | val_loss: nan | Time: 7028.3 ms
[2021-09-28 21:48:44	                main:574]	:	INFO	:	Epoch 453 | loss: nan | val_loss: nan | Time: 7122.51 ms
[2021-09-28 21:48:51	                main:574]	:	INFO	:	Epoch 454 | loss: nan | val_loss: nan | Time: 7073.66 ms
[2021-09-28 21:48:58	                main:574]	:	INFO	:	Epoch 455 | loss: nan | val_loss: nan | Time: 7099.41 ms
[2021-09-28 21:49:06	                main:574]	:	INFO	:	Epoch 456 | loss: nan | val_loss: nan | Time: 7274.67 ms
[2021-09-28 21:49:13	                main:574]	:	INFO	:	Epoch 457 | loss: nan | val_loss: nan | Time: 7131.17 ms
[2021-09-28 21:49:20	                main:574]	:	INFO	:	Epoch 458 | loss: nan | val_loss: nan | Time: 7340.69 ms
[2021-09-28 21:49:28	                main:574]	:	INFO	:	Epoch 459 | loss: nan | val_loss: nan | Time: 8035.7 ms
[2021-09-28 21:49:35	                main:574]	:	INFO	:	Epoch 460 | loss: nan | val_loss: nan | Time: 6931.87 ms
[2021-09-28 21:49:43	                main:574]	:	INFO	:	Epoch 461 | loss: nan | val_loss: nan | Time: 7139.81 ms
[2021-09-28 21:49:50	                main:574]	:	INFO	:	Epoch 462 | loss: nan | val_loss: nan | Time: 7056.61 ms
[2021-09-28 21:49:57	                main:574]	:	INFO	:	Epoch 463 | loss: nan | val_loss: nan | Time: 7127.24 ms
[2021-09-28 21:50:04	                main:574]	:	INFO	:	Epoch 464 | loss: nan | val_loss: nan | Time: 7128.04 ms
[2021-09-28 21:50:12	                main:574]	:	INFO	:	Epoch 465 | loss: nan | val_loss: nan | Time: 7360.03 ms
[2021-09-28 21:50:19	                main:574]	:	INFO	:	Epoch 466 | loss: nan | val_loss: nan | Time: 7359.16 ms
[2021-09-28 21:50:26	                main:574]	:	INFO	:	Epoch 467 | loss: nan | val_loss: nan | Time: 7098.66 ms
[2021-09-28 21:50:33	                main:574]	:	INFO	:	Epoch 468 | loss: nan | val_loss: nan | Time: 7109.8 ms
[2021-09-28 21:50:41	                main:574]	:	INFO	:	Epoch 469 | loss: nan | val_loss: nan | Time: 7206.16 ms
[2021-09-28 21:50:48	                main:574]	:	INFO	:	Epoch 470 | loss: nan | val_loss: nan | Time: 7379.66 ms
[2021-09-28 21:50:55	                main:574]	:	INFO	:	Epoch 471 | loss: nan | val_loss: nan | Time: 7212.26 ms
[2021-09-28 21:51:03	                main:574]	:	INFO	:	Epoch 472 | loss: nan | val_loss: nan | Time: 7279.44 ms
[2021-09-28 21:51:10	                main:574]	:	INFO	:	Epoch 473 | loss: nan | val_loss: nan | Time: 7112.08 ms
[2021-09-28 21:51:17	                main:574]	:	INFO	:	Epoch 474 | loss: nan | val_loss: nan | Time: 7077.41 ms
[2021-09-28 21:51:24	                main:574]	:	INFO	:	Epoch 475 | loss: nan | val_loss: nan | Time: 7261.15 ms
[2021-09-28 21:51:31	                main:574]	:	INFO	:	Epoch 476 | loss: nan | val_loss: nan | Time: 7001.08 ms
[2021-09-28 21:51:38	                main:574]	:	INFO	:	Epoch 477 | loss: nan | val_loss: nan | Time: 6945.02 ms
[2021-09-28 21:51:46	                main:574]	:	INFO	:	Epoch 478 | loss: nan | val_loss: nan | Time: 7061.04 ms
[2021-09-28 21:51:53	                main:574]	:	INFO	:	Epoch 479 | loss: nan | val_loss: nan | Time: 7318.18 ms
[2021-09-28 21:52:00	                main:574]	:	INFO	:	Epoch 480 | loss: nan | val_loss: nan | Time: 7201.86 ms
[2021-09-28 21:52:07	                main:574]	:	INFO	:	Epoch 481 | loss: nan | val_loss: nan | Time: 6947.68 ms
[2021-09-28 21:52:15	                main:574]	:	INFO	:	Epoch 482 | loss: nan | val_loss: nan | Time: 7325.03 ms
[2021-09-28 21:52:22	                main:574]	:	INFO	:	Epoch 483 | loss: nan | val_loss: nan | Time: 7360.8 ms
[2021-09-28 21:52:30	                main:574]	:	INFO	:	Epoch 484 | loss: nan | val_loss: nan | Time: 7327.14 ms
[2021-09-28 21:52:37	                main:574]	:	INFO	:	Epoch 485 | loss: nan | val_loss: nan | Time: 7290.89 ms
[2021-09-28 21:52:44	                main:574]	:	INFO	:	Epoch 486 | loss: nan | val_loss: nan | Time: 7385.31 ms
[2021-09-28 21:52:53	                main:574]	:	INFO	:	Epoch 487 | loss: nan | val_loss: nan | Time: 8646.34 ms
[2021-09-28 21:53:00	                main:574]	:	INFO	:	Epoch 488 | loss: nan | val_loss: nan | Time: 7368.47 ms
[2021-09-28 21:53:09	                main:574]	:	INFO	:	Epoch 489 | loss: nan | val_loss: nan | Time: 8296.92 ms
[2021-09-28 21:53:16	                main:574]	:	INFO	:	Epoch 490 | loss: nan | val_loss: nan | Time: 7147.08 ms
[2021-09-28 21:53:23	                main:574]	:	INFO	:	Epoch 491 | loss: nan | val_loss: nan | Time: 7287.35 ms
[2021-09-28 21:53:31	                main:574]	:	INFO	:	Epoch 492 | loss: nan | val_loss: nan | Time: 7301.27 ms
[2021-09-28 21:53:38	                main:574]	:	INFO	:	Epoch 493 | loss: nan | val_loss: nan | Time: 7303.2 ms
[2021-09-28 21:53:46	                main:574]	:	INFO	:	Epoch 494 | loss: nan | val_loss: nan | Time: 7202.62 ms
[2021-09-28 21:53:53	                main:574]	:	INFO	:	Epoch 495 | loss: nan | val_loss: nan | Time: 7260.67 ms
[2021-09-28 21:54:00	                main:574]	:	INFO	:	Epoch 496 | loss: nan | val_loss: nan | Time: 7487.26 ms
[2021-09-28 21:54:08	                main:574]	:	INFO	:	Epoch 497 | loss: nan | val_loss: nan | Time: 7119.93 ms
[2021-09-28 21:54:15	                main:574]	:	INFO	:	Epoch 498 | loss: nan | val_loss: nan | Time: 7257.49 ms
[2021-09-28 21:54:22	                main:574]	:	INFO	:	Epoch 499 | loss: nan | val_loss: nan | Time: 7475.24 ms
[2021-09-28 21:54:30	                main:574]	:	INFO	:	Epoch 500 | loss: nan | val_loss: nan | Time: 7222.88 ms
[2021-09-28 21:54:37	                main:574]	:	INFO	:	Epoch 501 | loss: nan | val_loss: nan | Time: 7018.33 ms
[2021-09-28 21:54:44	                main:574]	:	INFO	:	Epoch 502 | loss: nan | val_loss: nan | Time: 7179.61 ms
[2021-09-28 21:54:51	                main:574]	:	INFO	:	Epoch 503 | loss: nan | val_loss: nan | Time: 7091.96 ms
[2021-09-28 21:54:58	                main:574]	:	INFO	:	Epoch 504 | loss: nan | val_loss: nan | Time: 7089.39 ms
[2021-09-28 21:55:06	                main:574]	:	INFO	:	Epoch 505 | loss: nan | val_loss: nan | Time: 7455.07 ms
[2021-09-28 21:55:13	                main:574]	:	INFO	:	Epoch 506 | loss: nan | val_loss: nan | Time: 7227.31 ms
[2021-09-28 21:55:20	                main:574]	:	INFO	:	Epoch 507 | loss: nan | val_loss: nan | Time: 7157 ms
[2021-09-28 21:55:28	                main:574]	:	INFO	:	Epoch 508 | loss: nan | val_loss: nan | Time: 7224.33 ms
[2021-09-28 21:55:35	                main:574]	:	INFO	:	Epoch 509 | loss: nan | val_loss: nan | Time: 7141.56 ms
[2021-09-28 21:55:42	                main:574]	:	INFO	:	Epoch 510 | loss: nan | val_loss: nan | Time: 7212.3 ms
[2021-09-28 21:55:49	                main:574]	:	INFO	:	Epoch 511 | loss: nan | val_loss: nan | Time: 6964.13 ms
[2021-09-28 21:55:56	                main:574]	:	INFO	:	Epoch 512 | loss: nan | val_loss: nan | Time: 7145.9 ms
[2021-09-28 21:56:04	                main:574]	:	INFO	:	Epoch 513 | loss: nan | val_loss: nan | Time: 7165.86 ms
[2021-09-28 21:56:11	                main:574]	:	INFO	:	Epoch 514 | loss: nan | val_loss: nan | Time: 7120.12 ms
[2021-09-28 21:56:19	                main:574]	:	INFO	:	Epoch 515 | loss: nan | val_loss: nan | Time: 7620.99 ms
[2021-09-28 21:56:26	                main:574]	:	INFO	:	Epoch 516 | loss: nan | val_loss: nan | Time: 7196.93 ms
[2021-09-28 21:56:34	                main:574]	:	INFO	:	Epoch 517 | loss: nan | val_loss: nan | Time: 7904.53 ms
[2021-09-28 21:56:42	                main:574]	:	INFO	:	Epoch 518 | loss: nan | val_loss: nan | Time: 7839.41 ms
[2021-09-28 21:56:49	                main:574]	:	INFO	:	Epoch 519 | loss: nan | val_loss: nan | Time: 7236.32 ms
[2021-09-28 21:56:57	                main:574]	:	INFO	:	Epoch 520 | loss: nan | val_loss: nan | Time: 7335.16 ms
[2021-09-28 21:57:04	                main:574]	:	INFO	:	Epoch 521 | loss: nan | val_loss: nan | Time: 7295.2 ms
[2021-09-28 21:57:11	                main:574]	:	INFO	:	Epoch 522 | loss: nan | val_loss: nan | Time: 7000.37 ms
[2021-09-28 21:57:18	                main:574]	:	INFO	:	Epoch 523 | loss: nan | val_loss: nan | Time: 7155.96 ms
[2021-09-28 21:57:26	                main:574]	:	INFO	:	Epoch 524 | loss: nan | val_loss: nan | Time: 7088.52 ms
[2021-09-28 21:57:33	                main:574]	:	INFO	:	Epoch 525 | loss: nan | val_loss: nan | Time: 7116.6 ms
[2021-09-28 21:57:40	                main:574]	:	INFO	:	Epoch 526 | loss: nan | val_loss: nan | Time: 7264.17 ms
[2021-09-28 21:57:48	                main:574]	:	INFO	:	Epoch 527 | loss: nan | val_loss: nan | Time: 7343.35 ms
[2021-09-28 21:57:55	                main:574]	:	INFO	:	Epoch 528 | loss: nan | val_loss: nan | Time: 7096.83 ms
[2021-09-28 21:58:02	                main:574]	:	INFO	:	Epoch 529 | loss: nan | val_loss: nan | Time: 7417.5 ms
[2021-09-28 21:58:11	                main:574]	:	INFO	:	Epoch 530 | loss: nan | val_loss: nan | Time: 8312.92 ms
[2021-09-28 21:58:18	                main:574]	:	INFO	:	Epoch 531 | loss: nan | val_loss: nan | Time: 7503.7 ms
[2021-09-28 21:58:25	                main:574]	:	INFO	:	Epoch 532 | loss: nan | val_loss: nan | Time: 7144.28 ms
[2021-09-28 21:58:33	                main:574]	:	INFO	:	Epoch 533 | loss: nan | val_loss: nan | Time: 7164.51 ms
[2021-09-28 21:58:40	                main:574]	:	INFO	:	Epoch 534 | loss: nan | val_loss: nan | Time: 7132.05 ms
[2021-09-28 21:58:47	                main:574]	:	INFO	:	Epoch 535 | loss: nan | val_loss: nan | Time: 7276.13 ms
[2021-09-28 21:58:55	                main:574]	:	INFO	:	Epoch 536 | loss: nan | val_loss: nan | Time: 7126.91 ms
[2021-09-28 21:59:02	                main:574]	:	INFO	:	Epoch 537 | loss: nan | val_loss: nan | Time: 7360.28 ms
[2021-09-28 21:59:09	                main:574]	:	INFO	:	Epoch 538 | loss: nan | val_loss: nan | Time: 7185.64 ms
[2021-09-28 21:59:17	                main:574]	:	INFO	:	Epoch 539 | loss: nan | val_loss: nan | Time: 7145.96 ms
[2021-09-28 21:59:24	                main:574]	:	INFO	:	Epoch 540 | loss: nan | val_loss: nan | Time: 7177.42 ms
[2021-09-28 21:59:31	                main:574]	:	INFO	:	Epoch 541 | loss: nan | val_loss: nan | Time: 7100.67 ms
[2021-09-28 21:59:38	                main:574]	:	INFO	:	Epoch 542 | loss: nan | val_loss: nan | Time: 7121.2 ms
[2021-09-28 21:59:45	                main:574]	:	INFO	:	Epoch 543 | loss: nan | val_loss: nan | Time: 7187.51 ms
[2021-09-28 21:59:52	                main:574]	:	INFO	:	Epoch 544 | loss: nan | val_loss: nan | Time: 6976.98 ms
[2021-09-28 21:59:59	                main:574]	:	INFO	:	Epoch 545 | loss: nan | val_loss: nan | Time: 6886.14 ms
[2021-09-28 22:00:07	                main:574]	:	INFO	:	Epoch 546 | loss: nan | val_loss: nan | Time: 7328.15 ms
[2021-09-28 22:00:14	                main:574]	:	INFO	:	Epoch 547 | loss: nan | val_loss: nan | Time: 7094.81 ms
[2021-09-28 22:00:21	                main:574]	:	INFO	:	Epoch 548 | loss: nan | val_loss: nan | Time: 7084.49 ms
[2021-09-28 22:00:28	                main:574]	:	INFO	:	Epoch 549 | loss: nan | val_loss: nan | Time: 7261.42 ms
[2021-09-28 22:00:37	                main:574]	:	INFO	:	Epoch 550 | loss: nan | val_loss: nan | Time: 8697.31 ms
[2021-09-28 22:00:45	                main:574]	:	INFO	:	Epoch 551 | loss: nan | val_loss: nan | Time: 7236.19 ms
[2021-09-28 22:00:52	                main:574]	:	INFO	:	Epoch 552 | loss: nan | val_loss: nan | Time: 7125.78 ms
[2021-09-28 22:00:59	                main:574]	:	INFO	:	Epoch 553 | loss: nan | val_loss: nan | Time: 7112.69 ms
[2021-09-28 22:01:06	                main:574]	:	INFO	:	Epoch 554 | loss: nan | val_loss: nan | Time: 7340.16 ms
[2021-09-28 22:01:14	                main:574]	:	INFO	:	Epoch 555 | loss: nan | val_loss: nan | Time: 7121.53 ms
[2021-09-28 22:01:21	                main:574]	:	INFO	:	Epoch 556 | loss: nan | val_loss: nan | Time: 7061.87 ms
[2021-09-28 22:01:28	                main:574]	:	INFO	:	Epoch 557 | loss: nan | val_loss: nan | Time: 7140.69 ms
[2021-09-28 22:01:35	                main:574]	:	INFO	:	Epoch 558 | loss: nan | val_loss: nan | Time: 7026.16 ms
[2021-09-28 22:01:43	                main:574]	:	INFO	:	Epoch 559 | loss: nan | val_loss: nan | Time: 7961.46 ms
[2021-09-28 22:01:50	                main:574]	:	INFO	:	Epoch 560 | loss: nan | val_loss: nan | Time: 7219.24 ms
[2021-09-28 22:01:58	                main:574]	:	INFO	:	Epoch 561 | loss: nan | val_loss: nan | Time: 7162.26 ms
[2021-09-28 22:02:05	                main:574]	:	INFO	:	Epoch 562 | loss: nan | val_loss: nan | Time: 7297.32 ms
[2021-09-28 22:02:12	                main:574]	:	INFO	:	Epoch 563 | loss: nan | val_loss: nan | Time: 7151.56 ms
[2021-09-28 22:02:20	                main:574]	:	INFO	:	Epoch 564 | loss: nan | val_loss: nan | Time: 7575.86 ms
[2021-09-28 22:02:27	                main:574]	:	INFO	:	Epoch 565 | loss: nan | val_loss: nan | Time: 7480.47 ms
[2021-09-28 22:02:35	                main:574]	:	INFO	:	Epoch 566 | loss: nan | val_loss: nan | Time: 7441.08 ms
[2021-09-28 22:02:42	                main:574]	:	INFO	:	Epoch 567 | loss: nan | val_loss: nan | Time: 7179.9 ms
[2021-09-28 22:02:49	                main:574]	:	INFO	:	Epoch 568 | loss: nan | val_loss: nan | Time: 7139.39 ms
[2021-09-28 22:02:58	                main:574]	:	INFO	:	Epoch 569 | loss: nan | val_loss: nan | Time: 8637.89 ms
[2021-09-28 22:03:06	                main:574]	:	INFO	:	Epoch 570 | loss: nan | val_loss: nan | Time: 7308.78 ms
[2021-09-28 22:03:15	                main:574]	:	INFO	:	Epoch 571 | loss: nan | val_loss: nan | Time: 9520.45 ms
[2021-09-28 22:03:23	                main:574]	:	INFO	:	Epoch 572 | loss: nan | val_loss: nan | Time: 7316.11 ms
[2021-09-28 22:03:30	                main:574]	:	INFO	:	Epoch 573 | loss: nan | val_loss: nan | Time: 7294.75 ms
[2021-09-28 22:03:37	                main:574]	:	INFO	:	Epoch 574 | loss: nan | val_loss: nan | Time: 7103.91 ms
[2021-09-28 22:03:44	                main:574]	:	INFO	:	Epoch 575 | loss: nan | val_loss: nan | Time: 7264.12 ms
[2021-09-28 22:03:54	                main:574]	:	INFO	:	Epoch 576 | loss: nan | val_loss: nan | Time: 9086.64 ms
[2021-09-28 22:04:01	                main:574]	:	INFO	:	Epoch 577 | loss: nan | val_loss: nan | Time: 7265.48 ms
[2021-09-28 22:04:11	                main:574]	:	INFO	:	Epoch 578 | loss: nan | val_loss: nan | Time: 10132.2 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce 940MX)
[2021-09-29 11:27:05	                main:435]	:	INFO	:	Set logging level to 1
[2021-09-29 11:27:05	                main:441]	:	INFO	:	Running in BOINC Client mode
[2021-09-29 11:27:07	                main:444]	:	INFO	:	Resolving all filenames
[2021-09-29 11:27:08	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1)
[2021-09-29 11:27:09	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1631730999-19184-2_1_r1322189162_1 (exists = 1)
[2021-09-29 11:27:10	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1631730999-19184-2_1_r1322189162_0 (exists = 0)
[2021-09-29 11:27:10	                main:452]	:	INFO	:	Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1631730999-19184-2 (exists = 1)
[2021-09-29 11:27:11	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2021-09-29 11:27:11	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5
[2021-09-29 11:27:12	                main:474]	:	INFO	:	Configuration: 
[2021-09-29 11:27:12	                main:475]	:	INFO	:	    Model type: GRU
[2021-09-29 11:27:13	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2021-09-29 11:27:13	                main:477]	:	INFO	:	    Max Epochs: 2048
[2021-09-29 11:27:14	                main:478]	:	INFO	:	    Batch Size: 128
[2021-09-29 11:27:14	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2021-09-29 11:27:15	                main:480]	:	INFO	:	    Patience: 10
[2021-09-29 11:27:15	                main:481]	:	INFO	:	    Hidden Width: 12
[2021-09-29 11:27:16	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2021-09-29 11:27:16	                main:483]	:	INFO	:	    # Backend Layers: 4
[2021-09-29 11:27:16	                main:484]	:	INFO	:	    # Threads: 1
[2021-09-29 11:27:16	                main:486]	:	INFO	:	Preparing Dataset
[2021-09-29 11:27:16	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-09-29 11:27:17	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-09-29 11:27:25	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2021-09-29 11:27:25	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-09-29 11:27:26	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-09-29 11:27:26	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2021-09-29 11:27:26	                main:494]	:	INFO	:	Creating Model
[2021-09-29 11:27:26	                main:507]	:	INFO	:	Preparing config file
[2021-09-29 11:27:26	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2021-09-29 11:27:26	                main:512]	:	INFO	:	Loading config


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFEBE734F99

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 09/29/21 11:27:27
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\3;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 00000000121f0000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000c0fb0000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.19041.1023 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1023

ModLoad: 00000000c0410000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 00000000be700000 00000000002c9000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 00000000c06f0000 00000000001a1000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000be6d0000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1237) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.19041.1237 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1237

ModLoad: 00000000c0600000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202

ModLoad: 00000000bece0000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1110) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.19041.1110 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1110

ModLoad: 00000000bec10000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 00000000beb10000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 0000000072b00000 0000000000058000 C:\ProgramData\BOINC\slots\3\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000c0630000 00000000000ac000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1052) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000bf8c0000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.19041.546

ModLoad: 00000000bf820000 000000000009b000 C:\WINDOWS\System32\sechost.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000b7a90000 000000000008d000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.28.29910.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\9\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.28.29910.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.28.29910.0

ModLoad: 00000000bcde0000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.867

ModLoad: 00000000b7b20000 000000000001a000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.28.29910.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\9\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.28.29910.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.28.29910.0

ModLoad: 00000000b7a80000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.28.29910.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\9\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.28.29910.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.28.29910.0

ModLoad: 00000000c04d0000 000000000012a000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1081) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000f90d0000 000000000abe7000 C:\ProgramData\BOINC\slots\3\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000003cc0000 0000000024b49000 C:\ProgramData\BOINC\slots\3\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000063a50000 00000000002db000 C:\ProgramData\BOINC\slots\3\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000006f330000 000000000020d000 C:\ProgramData\BOINC\slots\3\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 0000000072ab0000 0000000000045000 C:\ProgramData\BOINC\slots\3\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000030720000 00000000030a5000 C:\ProgramData\BOINC\slots\3\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 00000000f5c10000 00000000034b2000 C:\ProgramData\BOINC\slots\3\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000b3f10000 0000000000010000 C:\ProgramData\BOINC\slots\3\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 00000000d16c0000 000000000919f000 C:\ProgramData\BOINC\slots\3\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000ca630000 0000000003d5b000 C:\ProgramData\BOINC\slots\3\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000a52d0000 0000000000040000 C:\ProgramData\BOINC\slots\3\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000002e850000 0000000001eca000 C:\ProgramData\BOINC\slots\3\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000da860000 000000001b3a4000 C:\ProgramData\BOINC\slots\3\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 00000000bf000000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000bd170000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000bfa30000 0000000000472000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1237) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000bef50000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 00000000becb0000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000be4a0000 0000000000034000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 00000000befa0000 0000000000060000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1237) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.19041.1237 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1237

ModLoad: 00000000bedf0000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000be2b0000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000bf0e0000 000000000073f000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.19041.964 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.964

ModLoad: 00000000bc3e0000 0000000000790000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000bfeb0000 0000000000355000 C:\WINDOWS\System32\combase.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202

ModLoad: 00000000be120000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.662) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000bf030000 00000000000ae000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000c0df0000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000634a0000 00000000002cc000 C:\WINDOWS\system32\nvcuda.dll (30.0.14.7212) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r470\r470_00\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 30.0.14.7212
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.4.136 driver
    Product Version       : 30.0.14.7212

ModLoad: 00000000b4960000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000cfee0000 00000000017e0000 C:\WINDOWS\system32\DriverStore\FileRepository\nvhmi.inf_amd64_39276359f2086d3e\nvcuda64.dll (30.0.14.7212) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r470\r470_00\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 30.0.14.7212
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.4.136 driver
    Product Version       : 30.0.14.7212

ModLoad: 00000000b4920000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.19041.906 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.906

ModLoad: 00000000adcb0000 000000000014a000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.19041.1081) (-exported- Symbols Loaded)
    Linked PDB Filename   : drvstore.pdb
    File Version          : 10.0.19041.1081 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1081

ModLoad: 00000000be090000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000bbce0000 000000000009e000 C:\WINDOWS\system32\uxtheme.dll (6.2.19041.1081) (-exported- Symbols Loaded)
    Linked PDB Filename   : UxTheme.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000ad340000 0000000000719000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.14.7212) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r470\r470_00\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 30.0.14.7212
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 30.0.14.7212

ModLoad: 00000000c09e0000 000000000012a000 C:\WINDOWS\System32\ole32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : ole32.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202

ModLoad: 00000000be9d0000 0000000000083000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3608, Write: 306, Other 747

- I/O Transfers Counters -
Read: 6522702, Write: 7307, Other 29494

- Paged Pool Usage -
QuotaPagedPoolUsage: 3479048, QuotaPeakPagedPoolUsage: 3479048
QuotaNonPagedPoolUsage: 37664, QuotaPeakNonPagedPoolUsage: 37664

- Virtual Memory Usage -
VirtualSize: -1512558592, PeakVirtualSize: -1010950144

- Pagefile Usage -
PagefileUsage: -1512558592, PeakPagefileUsage: -1512493056

- Working Set Size -
WorkingSetSize: 1138909184, PeakWorkingSetSize: 1138913280, PageFaultCount: 376712

*** Dump of thread ID 16956 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 12812500.000000, User Time: 29375000.000000, Wait Time: 33133520.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFEBE734F99

- Registers -
rax=00000000fec68b93 rbx=0000000012554910 rcx=00000000165b5cd0 rdx=0000000000000001 rsi=00000000165b6610 rdi=0000000019930520
r8=00000000165b5d68 r9=0000000000000000 r10=0000000000000000 r11=00000000b155ef00 r12=000000009a8f0ee0 r13=00000000165b6820
r14=00000000ab42adb0 r15=0000000000000000 rip=00000000be734f99 rsp=00000000165b64b0 rbp=00000000165b67a0
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
165b6580 1246a884 00000040 0000004f 9a8f0c00 000006b0 KERNELBASE!RaiseException+0x0 
165b65e0 12211ca6 e0a50000 165b66b9 b29380c8 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
165b6690 1221593b 00000000 00000030 00000020 00000008 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
165b67e0 12211a78 00000000 00000000 165b6b10 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
165b68b0 12211cfc 165b6b10 00000000 00000080 165b6de0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
165b6970 1221c4dd 165b6de0 165b6de0 165b6de0 165b6de0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
165b6c60 1220b2fe 165b7278 165b6de0 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
165cfa00 1244c6f8 e245f940 00000000 00000000 e24c6d80 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
165cfa40 c0427034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
165cfa70 c1002651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
165cfaf0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 20832 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 312500.000000, User Time: 0.000000, Wait Time: 33131904.000000

- Registers -
rax=00000000000001d3 rbx=00000000e0a55820 rcx=0000000000000074 rdx=00000000e0a554a0 rsi=00000000e0a53620 rdi=00000000e0a55820
r8=0000000000000008 r9=0000000000000040 r10=0000000000000640 r11=00000000c5fdfff9 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000c10507c4 rsp=00000000168ff618 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
168ff610 c1002dc7 00000000 00000000 e0a53620 e0a55820 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
168ff910 c0427034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
168ff940 c1002651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
168ff9c0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 22712 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 33131904.000000

- Registers -
rax=00000000000001d3 rbx=00000000e0a55ca0 rcx=0000000000000074 rdx=00000000e0a55920 rsi=00000000e0a53620 rdi=00000000e0a55ca0
r8=0000000000000648 r9=0000000000000024 r10=0000000000000000 r11=0000000007645688 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000c10507c4 rsp=00000000169ff608 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
169ff600 c1002dc7 00000000 00000000 e0a53620 e0a55ca0 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
169ff900 c0427034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
169ff930 c1002651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
169ff9b0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 24436 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 33131756.000000

- Registers -
rax=00000000000001d3 rbx=00000000e0a56f20 rcx=0000000000000074 rdx=00000000e0a56ba0 rsi=00000000e0a53620 rdi=00000000e0a56f20
r8=00000000000002a8 r9=000000000000000a r10=0000000000000000 r11=00000000f5bc82a8 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000c10507c4 rsp=0000000016aff558 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
16aff550 c1002dc7 00000000 00000000 e0a53620 e0a56f20 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
16aff850 c0427034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
16aff880 c1002651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
16aff900 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 25780 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 33133520.000000

- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=0000000016cff700 rsi=0000000000000000 rdi=0000000000000064
r8=0000000016cff6d8 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000c104d3f4 rsp=0000000016cff6d8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
16cff6d0 be74967e 16cff798 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0 
16cff770 1222a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0 
16cff7a0 c0427034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
16cff7d0 c1002651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
16cff850 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 16004 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 33133520.000000

- Registers -
rax=000000000000005b rbx=000000000000000a rcx=000000000000000a rdx=0000000016dff4a0 rsi=0000000000000000 rdi=000000000000000a
r8=0000000016dff148 r9=00000000e267c150 r10=0000000000000000 r11=0000000016dff410 r12=0000000000000064 r13=0000000016dff4a0
r14=0000000016dff1a0 r15=0000000000000000 rip=00000000c104d8c4 rsp=0000000016dff148 rbp=00000000e267c150
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
16dff140 be74cb70 00000000 167bd000 c111a4d0 167bd000 ntdll!ZwWaitForMultipleObjects+0x0 
16dff430 be74ca6e e0a62a50 004e0049 0000000a 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
16dff470 d00b12c4 e267e250 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
16dff6b0 d015806d 00000000 e267c150 00000000 00000000 nvcuda64!+0x0 
16dff760 d00b0c93 655a480b 5f3f90ad e2bfa380 00000000 nvcuda64!cuProfilerStop+0x0 
16dff790 d03e6b84 e2bfa380 00000000 00000000 00000000 nvcuda64!+0x0 
16dff7c0 c0427034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
16dff7f0 c1002651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
16dff870 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 24228 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 33132990.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002dc rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002dc
r8=0000000016eff7f8 r9=0000000000000000 r10=0000000000000000 r11=0000000016eff858 r12=0000000000000000 r13=0000000000000000
r14=00000000000002dc r15=0000000000000000 rip=00000000c104cdf4 rsp=0000000016eff558 rbp=00000000e2662120
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
16eff550 be721a8e 00000000 c1002630 0000027f 00000000 ntdll!ZwWaitForSingleObject+0x0 
16eff5f0 d02de2cd e2bfa2c0 00000000 00000000 000002dc KERNELBASE!WaitForSingleObjectEx+0x0 
16eff850 d00b0c93 00000000 e2bfa2c0 cfee0000 e26ba0c0 nvcuda64!cuProfilerStop+0x0 
16eff880 d03e6b84 e2bfa2c0 00000000 00000000 00000000 nvcuda64!+0x0 
16eff8b0 c0427034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
16eff8e0 c1002651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
16eff960 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 22632 (state: Waiting): ***

- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 33133512.000000

- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000e28f0f80 rdx=0000000016fffbc8 rsi=0000000016fffb30 rdi=0000000000000000
r8=0000000000000004 r9=0000000000000004 r10=0000000000000003 r11=0000000016fffb60 r12=0000000016fffbc8 r13=0000000000000000
r14=00000000e28f0f80 r15=00000000e28f5730 rip=00000000c1050764 rsp=0000000016fffb08 rbp=0000000016fffb60
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
16fffb00 c1014295 00000102 00000102 00000000 16fffb30 ntdll!NtWaitForAlertByThreadId+0x0 
16fffb70 be76ce39 e28f2f10 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0 
16fffba0 d001f18c e28f2f10 e28f2f10 e28f2f10 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0 
16fffc00 d00b0c93 00000005 63af8e03 65e2ca20 00000000 nvcuda64!+0x0 
16fffc30 d03e6b84 e2bfabc0 00000000 00000000 00000000 nvcuda64!+0x0 
16fffc60 c0427034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
16fffc90 c1002651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
16fffd10 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)