Task 14239747

Name ParityModified-1647048293-3656-2-0_0
Workunit 11297500
Created 2 Apr 2022, 9:32:21 UTC
Sent 10 Apr 2022, 1:13:21 UTC
Report deadline 18 Apr 2022, 1:13:21 UTC
Received 11 Apr 2022, 6:36:59 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 5898
Run time 48 min 59 sec
CPU time 43 min 39 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 11,340.57 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 2.08 GB
Peak swap size 4.37 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
4-11 00:23:19	                main:574]	:	INFO	:	Epoch 1334 | loss: nan | val_loss: nan | Time: 1830.67 ms
[2022-04-11 00:23:21	                main:574]	:	INFO	:	Epoch 1335 | loss: nan | val_loss: nan | Time: 1740.62 ms
[2022-04-11 00:23:23	                main:574]	:	INFO	:	Epoch 1336 | loss: nan | val_loss: nan | Time: 1731.15 ms
[2022-04-11 00:23:25	                main:574]	:	INFO	:	Epoch 1337 | loss: nan | val_loss: nan | Time: 1818.8 ms
[2022-04-11 00:23:27	                main:574]	:	INFO	:	Epoch 1338 | loss: nan | val_loss: nan | Time: 1761.64 ms
[2022-04-11 00:23:29	                main:574]	:	INFO	:	Epoch 1339 | loss: nan | val_loss: nan | Time: 1911.35 ms
[2022-04-11 00:23:31	                main:574]	:	INFO	:	Epoch 1340 | loss: nan | val_loss: nan | Time: 1918.42 ms
[2022-04-11 00:23:33	                main:574]	:	INFO	:	Epoch 1341 | loss: nan | val_loss: nan | Time: 1895.18 ms
[2022-04-11 00:23:35	                main:574]	:	INFO	:	Epoch 1342 | loss: nan | val_loss: nan | Time: 1784.73 ms
[2022-04-11 00:23:37	                main:574]	:	INFO	:	Epoch 1343 | loss: nan | val_loss: nan | Time: 1923.89 ms
[2022-04-11 00:23:39	                main:574]	:	INFO	:	Epoch 1344 | loss: nan | val_loss: nan | Time: 1831.24 ms
[2022-04-11 00:23:41	                main:574]	:	INFO	:	Epoch 1345 | loss: nan | val_loss: nan | Time: 1790.76 ms
[2022-04-11 00:23:43	                main:574]	:	INFO	:	Epoch 1346 | loss: nan | val_loss: nan | Time: 1814.22 ms
[2022-04-11 00:23:45	                main:574]	:	INFO	:	Epoch 1347 | loss: nan | val_loss: nan | Time: 1910.33 ms
[2022-04-11 00:23:47	                main:574]	:	INFO	:	Epoch 1348 | loss: nan | val_loss: nan | Time: 1855.26 ms
[2022-04-11 00:23:49	                main:574]	:	INFO	:	Epoch 1349 | loss: nan | val_loss: nan | Time: 1777.23 ms
[2022-04-11 00:23:51	                main:574]	:	INFO	:	Epoch 1350 | loss: nan | val_loss: nan | Time: 1762.37 ms
[2022-04-11 00:23:53	                main:574]	:	INFO	:	Epoch 1351 | loss: nan | val_loss: nan | Time: 1816.78 ms
[2022-04-11 00:23:55	                main:574]	:	INFO	:	Epoch 1352 | loss: nan | val_loss: nan | Time: 1733.26 ms
[2022-04-11 00:23:56	                main:574]	:	INFO	:	Epoch 1353 | loss: nan | val_loss: nan | Time: 1724.35 ms
[2022-04-11 00:23:58	                main:574]	:	INFO	:	Epoch 1354 | loss: nan | val_loss: nan | Time: 1848.27 ms
[2022-04-11 00:24:00	                main:574]	:	INFO	:	Epoch 1355 | loss: nan | val_loss: nan | Time: 1731.77 ms
[2022-04-11 00:24:02	                main:574]	:	INFO	:	Epoch 1356 | loss: nan | val_loss: nan | Time: 1740.99 ms
[2022-04-11 00:24:04	                main:574]	:	INFO	:	Epoch 1357 | loss: nan | val_loss: nan | Time: 1767.25 ms
[2022-04-11 00:24:06	                main:574]	:	INFO	:	Epoch 1358 | loss: nan | val_loss: nan | Time: 1809.68 ms
[2022-04-11 00:24:08	                main:574]	:	INFO	:	Epoch 1359 | loss: nan | val_loss: nan | Time: 1726.83 ms
[2022-04-11 00:24:10	                main:574]	:	INFO	:	Epoch 1360 | loss: nan | val_loss: nan | Time: 1764.16 ms
[2022-04-11 00:24:12	                main:574]	:	INFO	:	Epoch 1361 | loss: nan | val_loss: nan | Time: 1733.18 ms
[2022-04-11 00:24:14	                main:574]	:	INFO	:	Epoch 1362 | loss: nan | val_loss: nan | Time: 1902.45 ms
[2022-04-11 00:24:16	                main:574]	:	INFO	:	Epoch 1363 | loss: nan | val_loss: nan | Time: 1776.65 ms
[2022-04-11 00:24:18	                main:574]	:	INFO	:	Epoch 1364 | loss: nan | val_loss: nan | Time: 1786.9 ms
[2022-04-11 00:24:20	                main:574]	:	INFO	:	Epoch 1365 | loss: nan | val_loss: nan | Time: 1829.89 ms
[2022-04-11 00:24:22	                main:574]	:	INFO	:	Epoch 1366 | loss: nan | val_loss: nan | Time: 1790.36 ms
[2022-04-11 00:24:23	                main:574]	:	INFO	:	Epoch 1367 | loss: nan | val_loss: nan | Time: 1722.81 ms
[2022-04-11 00:24:25	                main:574]	:	INFO	:	Epoch 1368 | loss: nan | val_loss: nan | Time: 1753.21 ms
[2022-04-11 00:24:27	                main:574]	:	INFO	:	Epoch 1369 | loss: nan | val_loss: nan | Time: 1796.81 ms
[2022-04-11 00:24:29	                main:574]	:	INFO	:	Epoch 1370 | loss: nan | val_loss: nan | Time: 1808.39 ms
[2022-04-11 00:24:31	                main:574]	:	INFO	:	Epoch 1371 | loss: nan | val_loss: nan | Time: 1776.43 ms
[2022-04-11 00:24:33	                main:574]	:	INFO	:	Epoch 1372 | loss: nan | val_loss: nan | Time: 1820.29 ms
[2022-04-11 00:24:35	                main:574]	:	INFO	:	Epoch 1373 | loss: nan | val_loss: nan | Time: 1770.66 ms
[2022-04-11 00:24:37	                main:574]	:	INFO	:	Epoch 1374 | loss: nan | val_loss: nan | Time: 1763.66 ms
[2022-04-11 00:24:39	                main:574]	:	INFO	:	Epoch 1375 | loss: nan | val_loss: nan | Time: 1749.88 ms
[2022-04-11 00:24:41	                main:574]	:	INFO	:	Epoch 1376 | loss: nan | val_loss: nan | Time: 1818.85 ms
[2022-04-11 00:24:43	                main:574]	:	INFO	:	Epoch 1377 | loss: nan | val_loss: nan | Time: 1744.73 ms
[2022-04-11 00:24:45	                main:574]	:	INFO	:	Epoch 1378 | loss: nan | val_loss: nan | Time: 1866.97 ms
[2022-04-11 00:24:47	                main:574]	:	INFO	:	Epoch 1379 | loss: nan | val_loss: nan | Time: 1750.28 ms
[2022-04-11 00:24:48	                main:574]	:	INFO	:	Epoch 1380 | loss: nan | val_loss: nan | Time: 1823.26 ms
[2022-04-11 00:24:50	                main:574]	:	INFO	:	Epoch 1381 | loss: nan | val_loss: nan | Time: 1749.96 ms
[2022-04-11 00:24:52	                main:574]	:	INFO	:	Epoch 1382 | loss: nan | val_loss: nan | Time: 1772.07 ms
[2022-04-11 00:24:54	                main:574]	:	INFO	:	Epoch 1383 | loss: nan | val_loss: nan | Time: 1740.5 ms
[2022-04-11 00:24:56	                main:574]	:	INFO	:	Epoch 1384 | loss: nan | val_loss: nan | Time: 1750.7 ms
[2022-04-11 00:24:58	                main:574]	:	INFO	:	Epoch 1385 | loss: nan | val_loss: nan | Time: 1764.67 ms
[2022-04-11 00:25:00	                main:574]	:	INFO	:	Epoch 1386 | loss: nan | val_loss: nan | Time: 1748.51 ms
[2022-04-11 00:25:02	                main:574]	:	INFO	:	Epoch 1387 | loss: nan | val_loss: nan | Time: 1776.89 ms
[2022-04-11 00:25:04	                main:574]	:	INFO	:	Epoch 1388 | loss: nan | val_loss: nan | Time: 1723.29 ms
[2022-04-11 00:25:05	                main:574]	:	INFO	:	Epoch 1389 | loss: nan | val_loss: nan | Time: 1763.86 ms
[2022-04-11 00:25:07	                main:574]	:	INFO	:	Epoch 1390 | loss: nan | val_loss: nan | Time: 1759.88 ms
[2022-04-11 00:25:09	                main:574]	:	INFO	:	Epoch 1391 | loss: nan | val_loss: nan | Time: 1745.52 ms
[2022-04-11 00:25:11	                main:574]	:	INFO	:	Epoch 1392 | loss: nan | val_loss: nan | Time: 1729.06 ms
[2022-04-11 00:25:13	                main:574]	:	INFO	:	Epoch 1393 | loss: nan | val_loss: nan | Time: 1873.64 ms
[2022-04-11 00:25:15	                main:574]	:	INFO	:	Epoch 1394 | loss: nan | val_loss: nan | Time: 1725.64 ms
[2022-04-11 00:25:17	                main:574]	:	INFO	:	Epoch 1395 | loss: nan | val_loss: nan | Time: 1842.59 ms
[2022-04-11 00:25:19	                main:574]	:	INFO	:	Epoch 1396 | loss: nan | val_loss: nan | Time: 1812.38 ms
[2022-04-11 00:25:21	                main:574]	:	INFO	:	Epoch 1397 | loss: nan | val_loss: nan | Time: 1929.95 ms
[2022-04-11 00:25:23	                main:574]	:	INFO	:	Epoch 1398 | loss: nan | val_loss: nan | Time: 1738.15 ms
[2022-04-11 00:25:25	                main:574]	:	INFO	:	Epoch 1399 | loss: nan | val_loss: nan | Time: 1725.23 ms
[2022-04-11 00:25:27	                main:574]	:	INFO	:	Epoch 1400 | loss: nan | val_loss: nan | Time: 1734.2 ms
[2022-04-11 00:25:29	                main:574]	:	INFO	:	Epoch 1401 | loss: nan | val_loss: nan | Time: 1759.45 ms
[2022-04-11 00:25:30	                main:574]	:	INFO	:	Epoch 1402 | loss: nan | val_loss: nan | Time: 1729.45 ms
[2022-04-11 00:25:33	                main:574]	:	INFO	:	Epoch 1403 | loss: nan | val_loss: nan | Time: 1946.3 ms
[2022-04-11 00:25:35	                main:574]	:	INFO	:	Epoch 1404 | loss: nan | val_loss: nan | Time: 1861.94 ms
[2022-04-11 00:25:37	                main:574]	:	INFO	:	Epoch 1405 | loss: nan | val_loss: nan | Time: 1903.28 ms
[2022-04-11 00:25:38	                main:574]	:	INFO	:	Epoch 1406 | loss: nan | val_loss: nan | Time: 1776.88 ms
[2022-04-11 00:25:40	                main:574]	:	INFO	:	Epoch 1407 | loss: nan | val_loss: nan | Time: 1775.22 ms
[2022-04-11 00:25:42	                main:574]	:	INFO	:	Epoch 1408 | loss: nan | val_loss: nan | Time: 1914.14 ms
[2022-04-11 00:25:44	                main:574]	:	INFO	:	Epoch 1409 | loss: nan | val_loss: nan | Time: 1788.47 ms
[2022-04-11 00:25:46	                main:574]	:	INFO	:	Epoch 1410 | loss: nan | val_loss: nan | Time: 1735.33 ms
[2022-04-11 00:25:48	                main:574]	:	INFO	:	Epoch 1411 | loss: nan | val_loss: nan | Time: 1794.62 ms
[2022-04-11 00:25:50	                main:574]	:	INFO	:	Epoch 1412 | loss: nan | val_loss: nan | Time: 1726.7 ms
[2022-04-11 00:25:52	                main:574]	:	INFO	:	Epoch 1413 | loss: nan | val_loss: nan | Time: 1725.49 ms
[2022-04-11 00:25:54	                main:574]	:	INFO	:	Epoch 1414 | loss: nan | val_loss: nan | Time: 1908.85 ms
[2022-04-11 00:25:56	                main:574]	:	INFO	:	Epoch 1415 | loss: nan | val_loss: nan | Time: 1762.27 ms
[2022-04-11 00:25:58	                main:574]	:	INFO	:	Epoch 1416 | loss: nan | val_loss: nan | Time: 1759.91 ms
[2022-04-11 00:26:00	                main:574]	:	INFO	:	Epoch 1417 | loss: nan | val_loss: nan | Time: 1791.25 ms
[2022-04-11 00:26:02	                main:574]	:	INFO	:	Epoch 1418 | loss: nan | val_loss: nan | Time: 1819.98 ms
[2022-04-11 00:26:04	                main:574]	:	INFO	:	Epoch 1419 | loss: nan | val_loss: nan | Time: 1810.21 ms
[2022-04-11 00:26:06	                main:574]	:	INFO	:	Epoch 1420 | loss: nan | val_loss: nan | Time: 1807.51 ms
[2022-04-11 00:26:08	                main:574]	:	INFO	:	Epoch 1421 | loss: nan | val_loss: nan | Time: 1790.61 ms
[2022-04-11 00:26:09	                main:574]	:	INFO	:	Epoch 1422 | loss: nan | val_loss: nan | Time: 1813.8 ms
[2022-04-11 00:26:12	                main:574]	:	INFO	:	Epoch 1423 | loss: nan | val_loss: nan | Time: 1736.66 ms
[2022-04-11 00:26:13	                main:574]	:	INFO	:	Epoch 1424 | loss: nan | val_loss: nan | Time: 1748.41 ms
[2022-04-11 00:26:15	                main:574]	:	INFO	:	Epoch 1425 | loss: nan | val_loss: nan | Time: 1779.4 ms
[2022-04-11 00:26:17	                main:574]	:	INFO	:	Epoch 1426 | loss: nan | val_loss: nan | Time: 1773.66 ms
[2022-04-11 00:26:19	                main:574]	:	INFO	:	Epoch 1427 | loss: nan | val_loss: nan | Time: 1830.62 ms
[2022-04-11 00:26:21	                main:574]	:	INFO	:	Epoch 1428 | loss: nan | val_loss: nan | Time: 1863.1 ms
[2022-04-11 00:26:23	                main:574]	:	INFO	:	Epoch 1429 | loss: nan | val_loss: nan | Time: 1832.54 ms
[2022-04-11 00:26:25	                main:574]	:	INFO	:	Epoch 1430 | loss: nan | val_loss: nan | Time: 1849.28 ms
[2022-04-11 00:26:27	                main:574]	:	INFO	:	Epoch 1431 | loss: nan | val_loss: nan | Time: 1730.53 ms
[2022-04-11 00:26:29	                main:574]	:	INFO	:	Epoch 1432 | loss: nan | val_loss: nan | Time: 1788.89 ms
[2022-04-11 00:26:31	                main:574]	:	INFO	:	Epoch 1433 | loss: nan | val_loss: nan | Time: 1854.62 ms
[2022-04-11 00:26:33	                main:574]	:	INFO	:	Epoch 1434 | loss: nan | val_loss: nan | Time: 1750.77 ms
[2022-04-11 00:26:35	                main:574]	:	INFO	:	Epoch 1435 | loss: nan | val_loss: nan | Time: 1769.96 ms
[2022-04-11 00:26:37	                main:574]	:	INFO	:	Epoch 1436 | loss: nan | val_loss: nan | Time: 1768.37 ms
[2022-04-11 00:26:38	                main:574]	:	INFO	:	Epoch 1437 | loss: nan | val_loss: nan | Time: 1740.66 ms
[2022-04-11 00:26:40	                main:574]	:	INFO	:	Epoch 1438 | loss: nan | val_loss: nan | Time: 1826.53 ms
[2022-04-11 00:26:42	                main:574]	:	INFO	:	Epoch 1439 | loss: nan | val_loss: nan | Time: 1751.87 ms
[2022-04-11 00:26:44	                main:574]	:	INFO	:	Epoch 1440 | loss: nan | val_loss: nan | Time: 1758.09 ms
[2022-04-11 00:26:46	                main:574]	:	INFO	:	Epoch 1441 | loss: nan | val_loss: nan | Time: 1745.96 ms
[2022-04-11 00:26:48	                main:574]	:	INFO	:	Epoch 1442 | loss: nan | val_loss: nan | Time: 1794.99 ms
[2022-04-11 00:26:50	                main:574]	:	INFO	:	Epoch 1443 | loss: nan | val_loss: nan | Time: 1748.9 ms
[2022-04-11 00:26:52	                main:574]	:	INFO	:	Epoch 1444 | loss: nan | val_loss: nan | Time: 1895.33 ms
[2022-04-11 00:26:54	                main:574]	:	INFO	:	Epoch 1445 | loss: nan | val_loss: nan | Time: 1772.34 ms
[2022-04-11 00:26:56	                main:574]	:	INFO	:	Epoch 1446 | loss: nan | val_loss: nan | Time: 1754.48 ms
[2022-04-11 00:26:58	                main:574]	:	INFO	:	Epoch 1447 | loss: nan | val_loss: nan | Time: 1854.19 ms
[2022-04-11 00:27:00	                main:574]	:	INFO	:	Epoch 1448 | loss: nan | val_loss: nan | Time: 1797.07 ms
[2022-04-11 00:27:01	                main:574]	:	INFO	:	Epoch 1449 | loss: nan | val_loss: nan | Time: 1722.79 ms
[2022-04-11 00:27:03	                main:574]	:	INFO	:	Epoch 1450 | loss: nan | val_loss: nan | Time: 1719.44 ms
[2022-04-11 00:27:05	                main:574]	:	INFO	:	Epoch 1451 | loss: nan | val_loss: nan | Time: 1741.46 ms
[2022-04-11 00:27:07	                main:574]	:	INFO	:	Epoch 1452 | loss: nan | val_loss: nan | Time: 1720.28 ms
[2022-04-11 00:27:09	                main:574]	:	INFO	:	Epoch 1453 | loss: nan | val_loss: nan | Time: 1808.52 ms
[2022-04-11 00:27:11	                main:574]	:	INFO	:	Epoch 1454 | loss: nan | val_loss: nan | Time: 1748.7 ms
[2022-04-11 00:27:13	                main:574]	:	INFO	:	Epoch 1455 | loss: nan | val_loss: nan | Time: 1757.62 ms
[2022-04-11 00:27:15	                main:574]	:	INFO	:	Epoch 1456 | loss: nan | val_loss: nan | Time: 1852.35 ms
[2022-04-11 00:27:17	                main:574]	:	INFO	:	Epoch 1457 | loss: nan | val_loss: nan | Time: 1719.44 ms
[2022-04-11 00:27:18	                main:574]	:	INFO	:	Epoch 1458 | loss: nan | val_loss: nan | Time: 1729.27 ms
[2022-04-11 00:27:20	                main:574]	:	INFO	:	Epoch 1459 | loss: nan | val_loss: nan | Time: 1760.41 ms
[2022-04-11 00:27:22	                main:574]	:	INFO	:	Epoch 1460 | loss: nan | val_loss: nan | Time: 1739.53 ms
[2022-04-11 00:27:24	                main:574]	:	INFO	:	Epoch 1461 | loss: nan | val_loss: nan | Time: 1774.55 ms
[2022-04-11 00:27:26	                main:574]	:	INFO	:	Epoch 1462 | loss: nan | val_loss: nan | Time: 1764.25 ms
[2022-04-11 00:27:28	                main:574]	:	INFO	:	Epoch 1463 | loss: nan | val_loss: nan | Time: 1743.16 ms
[2022-04-11 00:27:30	                main:574]	:	INFO	:	Epoch 1464 | loss: nan | val_loss: nan | Time: 1745.02 ms
[2022-04-11 00:27:32	                main:574]	:	INFO	:	Epoch 1465 | loss: nan | val_loss: nan | Time: 1771.79 ms
[2022-04-11 00:27:33	                main:574]	:	INFO	:	Epoch 1466 | loss: nan | val_loss: nan | Time: 1796.13 ms
[2022-04-11 00:27:35	                main:574]	:	INFO	:	Epoch 1467 | loss: nan | val_loss: nan | Time: 1808.25 ms
[2022-04-11 00:27:37	                main:574]	:	INFO	:	Epoch 1468 | loss: nan | val_loss: nan | Time: 1792.24 ms
[2022-04-11 00:27:39	                main:574]	:	INFO	:	Epoch 1469 | loss: nan | val_loss: nan | Time: 1916.42 ms
[2022-04-11 00:27:41	                main:574]	:	INFO	:	Epoch 1470 | loss: nan | val_loss: nan | Time: 1795.74 ms
[2022-04-11 00:27:43	                main:574]	:	INFO	:	Epoch 1471 | loss: nan | val_loss: nan | Time: 1799.32 ms
[2022-04-11 00:27:45	                main:574]	:	INFO	:	Epoch 1472 | loss: nan | val_loss: nan | Time: 1794.73 ms
[2022-04-11 00:27:47	                main:574]	:	INFO	:	Epoch 1473 | loss: nan | val_loss: nan | Time: 1829.9 ms
[2022-04-11 00:27:49	                main:574]	:	INFO	:	Epoch 1474 | loss: nan | val_loss: nan | Time: 1730.78 ms
[2022-04-11 00:27:51	                main:574]	:	INFO	:	Epoch 1475 | loss: nan | val_loss: nan | Time: 1734.18 ms
[2022-04-11 00:27:53	                main:574]	:	INFO	:	Epoch 1476 | loss: nan | val_loss: nan | Time: 1758.25 ms
[2022-04-11 00:27:55	                main:574]	:	INFO	:	Epoch 1477 | loss: nan | val_loss: nan | Time: 1759.37 ms
[2022-04-11 00:27:57	                main:574]	:	INFO	:	Epoch 1478 | loss: nan | val_loss: nan | Time: 1882.03 ms
[2022-04-11 00:27:59	                main:574]	:	INFO	:	Epoch 1479 | loss: nan | val_loss: nan | Time: 1752.22 ms
[2022-04-11 00:28:00	                main:574]	:	INFO	:	Epoch 1480 | loss: nan | val_loss: nan | Time: 1767.84 ms
[2022-04-11 00:28:02	                main:574]	:	INFO	:	Epoch 1481 | loss: nan | val_loss: nan | Time: 1841.58 ms
[2022-04-11 00:28:04	                main:574]	:	INFO	:	Epoch 1482 | loss: nan | val_loss: nan | Time: 1783.38 ms
[2022-04-11 00:28:06	                main:574]	:	INFO	:	Epoch 1483 | loss: nan | val_loss: nan | Time: 1728.19 ms
[2022-04-11 00:28:08	                main:574]	:	INFO	:	Epoch 1484 | loss: nan | val_loss: nan | Time: 1792.45 ms
[2022-04-11 00:28:10	                main:574]	:	INFO	:	Epoch 1485 | loss: nan | val_loss: nan | Time: 1722.96 ms
[2022-04-11 00:28:12	                main:574]	:	INFO	:	Epoch 1486 | loss: nan | val_loss: nan | Time: 1760.32 ms
[2022-04-11 00:28:14	                main:574]	:	INFO	:	Epoch 1487 | loss: nan | val_loss: nan | Time: 1916.16 ms
[2022-04-11 00:28:16	                main:574]	:	INFO	:	Epoch 1488 | loss: nan | val_loss: nan | Time: 1776.28 ms
[2022-04-11 00:28:18	                main:574]	:	INFO	:	Epoch 1489 | loss: nan | val_loss: nan | Time: 1724.36 ms
[2022-04-11 00:28:20	                main:574]	:	INFO	:	Epoch 1490 | loss: nan | val_loss: nan | Time: 1826.24 ms
[2022-04-11 00:28:22	                main:574]	:	INFO	:	Epoch 1491 | loss: nan | val_loss: nan | Time: 1735.35 ms
[2022-04-11 00:28:23	                main:574]	:	INFO	:	Epoch 1492 | loss: nan | val_loss: nan | Time: 1734.8 ms
[2022-04-11 00:28:25	                main:574]	:	INFO	:	Epoch 1493 | loss: nan | val_loss: nan | Time: 1799.44 ms
[2022-04-11 00:28:27	                main:574]	:	INFO	:	Epoch 1494 | loss: nan | val_loss: nan | Time: 1723.3 ms
[2022-04-11 00:28:29	                main:574]	:	INFO	:	Epoch 1495 | loss: nan | val_loss: nan | Time: 1742.2 ms
[2022-04-11 00:28:31	                main:574]	:	INFO	:	Epoch 1496 | loss: nan | val_loss: nan | Time: 1812.68 ms
[2022-04-11 00:28:33	                main:574]	:	INFO	:	Epoch 1497 | loss: nan | val_loss: nan | Time: 1744.6 ms
[2022-04-11 00:28:35	                main:574]	:	INFO	:	Epoch 1498 | loss: nan | val_loss: nan | Time: 1733.84 ms
[2022-04-11 00:28:37	                main:574]	:	INFO	:	Epoch 1499 | loss: nan | val_loss: nan | Time: 1814.06 ms
[2022-04-11 00:28:39	                main:574]	:	INFO	:	Epoch 1500 | loss: nan | val_loss: nan | Time: 1829.33 ms
[2022-04-11 00:28:41	                main:574]	:	INFO	:	Epoch 1501 | loss: nan | val_loss: nan | Time: 1725.23 ms
[2022-04-11 00:28:43	                main:574]	:	INFO	:	Epoch 1502 | loss: nan | val_loss: nan | Time: 1734.18 ms
[2022-04-11 00:28:44	                main:574]	:	INFO	:	Epoch 1503 | loss: nan | val_loss: nan | Time: 1719.42 ms
[2022-04-11 00:28:46	                main:574]	:	INFO	:	Epoch 1504 | loss: nan | val_loss: nan | Time: 1822.05 ms
[2022-04-11 00:28:48	                main:574]	:	INFO	:	Epoch 1505 | loss: nan | val_loss: nan | Time: 1732.81 ms
[2022-04-11 00:28:50	                main:574]	:	INFO	:	Epoch 1506 | loss: nan | val_loss: nan | Time: 1753.91 ms
[2022-04-11 00:28:52	                main:574]	:	INFO	:	Epoch 1507 | loss: nan | val_loss: nan | Time: 1779.81 ms
[2022-04-11 00:28:54	                main:574]	:	INFO	:	Epoch 1508 | loss: nan | val_loss: nan | Time: 1743.35 ms
[2022-04-11 00:28:56	                main:574]	:	INFO	:	Epoch 1509 | loss: nan | val_loss: nan | Time: 1757.05 ms
[2022-04-11 00:28:58	                main:574]	:	INFO	:	Epoch 1510 | loss: nan | val_loss: nan | Time: 1900.79 ms
[2022-04-11 00:29:00	                main:574]	:	INFO	:	Epoch 1511 | loss: nan | val_loss: nan | Time: 1741.54 ms
[2022-04-11 00:29:02	                main:574]	:	INFO	:	Epoch 1512 | loss: nan | val_loss: nan | Time: 1776.62 ms
[2022-04-11 00:29:04	                main:574]	:	INFO	:	Epoch 1513 | loss: nan | val_loss: nan | Time: 1780.72 ms
[2022-04-11 00:29:06	                main:574]	:	INFO	:	Epoch 1514 | loss: nan | val_loss: nan | Time: 1813.45 ms
[2022-04-11 00:29:07	                main:574]	:	INFO	:	Epoch 1515 | loss: nan | val_loss: nan | Time: 1718.43 ms
[2022-04-11 00:29:09	                main:574]	:	INFO	:	Epoch 1516 | loss: nan | val_loss: nan | Time: 1724.92 ms
[2022-04-11 00:29:11	                main:574]	:	INFO	:	Epoch 1517 | loss: nan | val_loss: nan | Time: 1733.07 ms
[2022-04-11 00:29:13	                main:574]	:	INFO	:	Epoch 1518 | loss: nan | val_loss: nan | Time: 1859.07 ms
[2022-04-11 00:29:15	                main:574]	:	INFO	:	Epoch 1519 | loss: nan | val_loss: nan | Time: 1747.51 ms
[2022-04-11 00:29:17	                main:574]	:	INFO	:	Epoch 1520 | loss: nan | val_loss: nan | Time: 1745.96 ms
[2022-04-11 00:29:19	                main:574]	:	INFO	:	Epoch 1521 | loss: nan | val_loss: nan | Time: 1815.69 ms
[2022-04-11 00:29:21	                main:574]	:	INFO	:	Epoch 1522 | loss: nan | val_loss: nan | Time: 1814.58 ms
[2022-04-11 00:29:23	                main:574]	:	INFO	:	Epoch 1523 | loss: nan | val_loss: nan | Time: 1861.9 ms
[2022-04-11 00:29:25	                main:574]	:	INFO	:	Epoch 1524 | loss: nan | val_loss: nan | Time: 1905.7 ms
[2022-04-11 00:29:27	                main:574]	:	INFO	:	Epoch 1525 | loss: nan | val_loss: nan | Time: 1851.48 ms
[2022-04-11 00:29:29	                main:574]	:	INFO	:	Epoch 1526 | loss: nan | val_loss: nan | Time: 1779.53 ms
[2022-04-11 00:29:31	                main:574]	:	INFO	:	Epoch 1527 | loss: nan | val_loss: nan | Time: 1726.82 ms
[2022-04-11 00:29:33	                main:574]	:	INFO	:	Epoch 1528 | loss: nan | val_loss: nan | Time: 1729.52 ms
[2022-04-11 00:29:34	                main:574]	:	INFO	:	Epoch 1529 | loss: nan | val_loss: nan | Time: 1770.66 ms
[2022-04-11 00:29:36	                main:574]	:	INFO	:	Epoch 1530 | loss: nan | val_loss: nan | Time: 1862.2 ms
[2022-04-11 00:29:39	                main:574]	:	INFO	:	Epoch 1531 | loss: nan | val_loss: nan | Time: 1892.36 ms
[2022-04-11 00:29:41	                main:574]	:	INFO	:	Epoch 1532 | loss: nan | val_loss: nan | Time: 1917.68 ms
[2022-04-11 00:29:42	                main:574]	:	INFO	:	Epoch 1533 | loss: nan | val_loss: nan | Time: 1726.36 ms
[2022-04-11 00:29:44	                main:574]	:	INFO	:	Epoch 1534 | loss: nan | val_loss: nan | Time: 1730.61 ms
[2022-04-11 00:29:46	                main:574]	:	INFO	:	Epoch 1535 | loss: nan | val_loss: nan | Time: 1723.33 ms
[2022-04-11 00:29:48	                main:574]	:	INFO	:	Epoch 1536 | loss: nan | val_loss: nan | Time: 1733.8 ms
[2022-04-11 00:29:50	                main:574]	:	INFO	:	Epoch 1537 | loss: nan | val_loss: nan | Time: 1750.81 ms
[2022-04-11 00:29:52	                main:574]	:	INFO	:	Epoch 1538 | loss: nan | val_loss: nan | Time: 1735.18 ms
[2022-04-11 00:29:54	                main:574]	:	INFO	:	Epoch 1539 | loss: nan | val_loss: nan | Time: 1737.34 ms
[2022-04-11 00:29:56	                main:574]	:	INFO	:	Epoch 1540 | loss: nan | val_loss: nan | Time: 1741.4 ms
[2022-04-11 00:29:58	                main:574]	:	INFO	:	Epoch 1541 | loss: nan | val_loss: nan | Time: 1778.21 ms
[2022-04-11 00:30:00	                main:574]	:	INFO	:	Epoch 1542 | loss: nan | val_loss: nan | Time: 1836.11 ms
[2022-04-11 00:30:02	                main:574]	:	INFO	:	Epoch 1543 | loss: nan | val_loss: nan | Time: 1787.19 ms
[2022-04-11 00:30:04	                main:574]	:	INFO	:	Epoch 1544 | loss: nan | val_loss: nan | Time: 1731.07 ms
[2022-04-11 00:30:06	                main:574]	:	INFO	:	Epoch 1545 | loss: nan | val_loss: nan | Time: 1761.98 ms
[2022-04-11 00:30:08	                main:574]	:	INFO	:	Epoch 1546 | loss: nan | val_loss: nan | Time: 1902.83 ms
[2022-04-11 00:30:09	                main:574]	:	INFO	:	Epoch 1547 | loss: nan | val_loss: nan | Time: 1724.06 ms
[2022-04-11 00:30:11	                main:574]	:	INFO	:	Epoch 1548 | loss: nan | val_loss: nan | Time: 1760.63 ms
[2022-04-11 00:30:13	                main:574]	:	INFO	:	Epoch 1549 | loss: nan | val_loss: nan | Time: 1794.46 ms
[2022-04-11 00:30:15	                main:574]	:	INFO	:	Epoch 1550 | loss: nan | val_loss: nan | Time: 1848.09 ms
[2022-04-11 00:30:17	                main:574]	:	INFO	:	Epoch 1551 | loss: nan | val_loss: nan | Time: 1756.18 ms
[2022-04-11 00:30:19	                main:574]	:	INFO	:	Epoch 1552 | loss: nan | val_loss: nan | Time: 1752.34 ms
[2022-04-11 00:30:21	                main:574]	:	INFO	:	Epoch 1553 | loss: nan | val_loss: nan | Time: 1860.23 ms
[2022-04-11 00:30:23	                main:574]	:	INFO	:	Epoch 1554 | loss: nan | val_loss: nan | Time: 1731.68 ms
[2022-04-11 00:30:25	                main:574]	:	INFO	:	Epoch 1555 | loss: nan | val_loss: nan | Time: 1848.59 ms
[2022-04-11 00:30:27	                main:574]	:	INFO	:	Epoch 1556 | loss: nan | val_loss: nan | Time: 1762.38 ms
[2022-04-11 00:30:29	                main:574]	:	INFO	:	Epoch 1557 | loss: nan | val_loss: nan | Time: 1832.95 ms
[2022-04-11 00:30:31	                main:574]	:	INFO	:	Epoch 1558 | loss: nan | val_loss: nan | Time: 1835.23 ms
[2022-04-11 00:30:33	                main:574]	:	INFO	:	Epoch 1559 | loss: nan | val_loss: nan | Time: 1755.05 ms
[2022-04-11 00:30:35	                main:574]	:	INFO	:	Epoch 1560 | loss: nan | val_loss: nan | Time: 1780.5 ms
[2022-04-11 00:30:36	                main:574]	:	INFO	:	Epoch 1561 | loss: nan | val_loss: nan | Time: 1726.01 ms
[2022-04-11 00:30:38	                main:574]	:	INFO	:	Epoch 1562 | loss: nan | val_loss: nan | Time: 1723.93 ms
[2022-04-11 00:30:40	                main:574]	:	INFO	:	Epoch 1563 | loss: nan | val_loss: nan | Time: 1735.33 ms
[2022-04-11 00:30:42	                main:574]	:	INFO	:	Epoch 1564 | loss: nan | val_loss: nan | Time: 1780.02 ms
[2022-04-11 00:30:44	                main:574]	:	INFO	:	Epoch 1565 | loss: nan | val_loss: nan | Time: 1743.34 ms
[2022-04-11 00:30:46	                main:574]	:	INFO	:	Epoch 1566 | loss: nan | val_loss: nan | Time: 1774 ms
[2022-04-11 00:30:48	                main:574]	:	INFO	:	Epoch 1567 | loss: nan | val_loss: nan | Time: 1744.86 ms
[2022-04-11 00:30:50	                main:574]	:	INFO	:	Epoch 1568 | loss: nan | val_loss: nan | Time: 1752.52 ms
[2022-04-11 00:30:52	                main:574]	:	INFO	:	Epoch 1569 | loss: nan | val_loss: nan | Time: 1761.56 ms
[2022-04-11 00:30:53	                main:574]	:	INFO	:	Epoch 1570 | loss: nan | val_loss: nan | Time: 1773.95 ms
[2022-04-11 00:30:55	                main:574]	:	INFO	:	Epoch 1571 | loss: nan | val_loss: nan | Time: 1761.25 ms
[2022-04-11 00:30:57	                main:574]	:	INFO	:	Epoch 1572 | loss: nan | val_loss: nan | Time: 1737.32 ms
[2022-04-11 00:30:59	                main:574]	:	INFO	:	Epoch 1573 | loss: nan | val_loss: nan | Time: 1799.71 ms
[2022-04-11 00:31:01	                main:574]	:	INFO	:	Epoch 1574 | loss: nan | val_loss: nan | Time: 1816.72 ms
[2022-04-11 00:31:03	                main:574]	:	INFO	:	Epoch 1575 | loss: nan | val_loss: nan | Time: 1803.92 ms
[2022-04-11 00:31:05	                main:574]	:	INFO	:	Epoch 1576 | loss: nan | val_loss: nan | Time: 1824.83 ms
[2022-04-11 00:31:07	                main:574]	:	INFO	:	Epoch 1577 | loss: nan | val_loss: nan | Time: 1730.23 ms
[2022-04-11 00:31:09	                main:574]	:	INFO	:	Epoch 1578 | loss: nan | val_loss: nan | Time: 1902.33 ms
[2022-04-11 00:31:11	                main:574]	:	INFO	:	Epoch 1579 | loss: nan | val_loss: nan | Time: 1794.07 ms
[2022-04-11 00:31:13	                main:574]	:	INFO	:	Epoch 1580 | loss: nan | val_loss: nan | Time: 1759.38 ms
[2022-04-11 00:31:15	                main:574]	:	INFO	:	Epoch 1581 | loss: nan | val_loss: nan | Time: 1734.93 ms
[2022-04-11 00:31:17	                main:574]	:	INFO	:	Epoch 1582 | loss: nan | val_loss: nan | Time: 1840.48 ms
[2022-04-11 00:31:19	                main:574]	:	INFO	:	Epoch 1583 | loss: nan | val_loss: nan | Time: 1780.06 ms
[2022-04-11 00:31:20	                main:574]	:	INFO	:	Epoch 1584 | loss: nan | val_loss: nan | Time: 1733.2 ms
[2022-04-11 00:31:22	                main:574]	:	INFO	:	Epoch 1585 | loss: nan | val_loss: nan | Time: 1732.55 ms
[2022-04-11 00:31:24	                main:574]	:	INFO	:	Epoch 1586 | loss: nan | val_loss: nan | Time: 1736.47 ms
[2022-04-11 00:31:26	                main:574]	:	INFO	:	Epoch 1587 | loss: nan | val_loss: nan | Time: 1730.64 ms
[2022-04-11 00:31:28	                main:574]	:	INFO	:	Epoch 1588 | loss: nan | val_loss: nan | Time: 1752.57 ms
[2022-04-11 00:31:30	                main:574]	:	INFO	:	Epoch 1589 | loss: nan | val_loss: nan | Time: 1769.65 ms
[2022-04-11 00:31:32	                main:574]	:	INFO	:	Epoch 1590 | loss: nan | val_loss: nan | Time: 1766.16 ms
[2022-04-11 00:31:34	                main:574]	:	INFO	:	Epoch 1591 | loss: nan | val_loss: nan | Time: 1755.49 ms
[2022-04-11 00:31:36	                main:574]	:	INFO	:	Epoch 1592 | loss: nan | val_loss: nan | Time: 1781.69 ms
[2022-04-11 00:31:37	                main:574]	:	INFO	:	Epoch 1593 | loss: nan | val_loss: nan | Time: 1724.18 ms
[2022-04-11 00:31:39	                main:574]	:	INFO	:	Epoch 1594 | loss: nan | val_loss: nan | Time: 1720.43 ms
[2022-04-11 00:31:41	                main:574]	:	INFO	:	Epoch 1595 | loss: nan | val_loss: nan | Time: 1806.25 ms
[2022-04-11 00:31:43	                main:574]	:	INFO	:	Epoch 1596 | loss: nan | val_loss: nan | Time: 1768.11 ms
[2022-04-11 00:31:45	                main:574]	:	INFO	:	Epoch 1597 | loss: nan | val_loss: nan | Time: 1783.2 ms
[2022-04-11 00:31:47	                main:574]	:	INFO	:	Epoch 1598 | loss: nan | val_loss: nan | Time: 1747.16 ms
[2022-04-11 00:31:49	                main:574]	:	INFO	:	Epoch 1599 | loss: nan | val_loss: nan | Time: 1754.74 ms
[2022-04-11 00:31:51	                main:574]	:	INFO	:	Epoch 1600 | loss: nan | val_loss: nan | Time: 1717.16 ms
[2022-04-11 00:31:53	                main:574]	:	INFO	:	Epoch 1601 | loss: nan | val_loss: nan | Time: 1844.87 ms
[2022-04-11 00:31:54	                main:574]	:	INFO	:	Epoch 1602 | loss: nan | val_loss: nan | Time: 1741.56 ms
[2022-04-11 00:31:56	                main:574]	:	INFO	:	Epoch 1603 | loss: nan | val_loss: nan | Time: 1832.82 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 2080 SUPER)
[2022-04-11 00:34:48	                main:435]	:	INFO	:	Set logging level to 1
[2022-04-11 00:34:48	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-04-11 00:34:48	                main:444]	:	INFO	:	Resolving all filenames
[2022-04-11 00:34:48	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-11 00:34:48	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-11 00:34:49	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-11 00:34:49	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-11 00:34:49	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-11 00:34:49	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-04-11 00:34:49	                main:474]	:	INFO	:	Configuration: 
[2022-04-11 00:34:49	                main:475]	:	INFO	:	    Model type: GRU
[2022-04-11 00:34:49	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-04-11 00:34:49	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-04-11 00:34:50	                main:478]	:	INFO	:	    Batch Size: 128
[2022-04-11 00:34:50	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-04-11 00:34:50	                main:480]	:	INFO	:	    Patience: 10
[2022-04-11 00:34:50	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-04-11 00:34:50	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-04-11 00:34:50	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-04-11 00:34:50	                main:484]	:	INFO	:	    # Threads: 1
[2022-04-11 00:34:51	                main:486]	:	INFO	:	Preparing Dataset
[2022-04-11 00:34:51	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-11 00:34:51	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-11 00:34:53	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-04-11 00:34:53	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-11 00:34:53	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-11 00:34:54	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-04-11 00:34:54	                main:494]	:	INFO	:	Creating Model
[2022-04-11 00:34:54	                main:507]	:	INFO	:	Preparing config file
[2022-04-11 00:34:54	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-04-11 00:34:54	                main:512]	:	INFO	:	Loading config


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFE8F664F69

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 04/11/22 00:34:54
Install Directory : C:\Program Files\BOINC\
Data Directory    : J:\BOINC_Data
Project Symstore  : 
LoadLibraryA( J:\BOINC_Data\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( J:\BOINC_Data\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( J:\BOINC_Data\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( J:\BOINC_Data\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: J:\BOINC_Data\slots\3;J:\BOINC_Data\projects\www.mlcathome.org_mlcathome


ModLoad: 000000002e7c0000 00000000003df000 J:\BOINC_Data\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000091d10000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 000000008fec0000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 000000008f630000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 00000000910e0000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000008fb00000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1586) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1586

ModLoad: 0000000090140000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202

ModLoad: 000000008fc60000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 000000008f590000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 000000008f950000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 0000000070e30000 0000000000058000 J:\BOINC_Data\slots\3\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000008ff80000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000008fe20000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.19041.546

ModLoad: 0000000091040000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.1586) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000090a00000 0000000000125000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000077740000 000000000008d000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.29.30133.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.29.30133.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.29.30133.0

ModLoad: 000000008dad0000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.867

ModLoad: 0000000079120000 000000000001b000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.29.30133.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.29.30133.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.29.30133.0

ModLoad: 0000000079110000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.29.30133.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.29.30133.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.29.30133.0

ModLoad: 0000000029230000 000000000abe7000 J:\BOINC_Data\slots\3\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000058d00000 000000000020d000 J:\BOINC_Data\slots\3\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 0000000058660000 00000000002db000 J:\BOINC_Data\slots\3\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000075900000 0000000000040000 J:\BOINC_Data\slots\3\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000d6150000 0000000024b49000 J:\BOINC_Data\slots\3\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000006e1d0000 0000000000045000 J:\BOINC_Data\slots\3\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000049260000 00000000034b2000 J:\BOINC_Data\slots\3\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 000000003baa0000 00000000030a5000 J:\BOINC_Data\slots\3\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 000000008b070000 0000000000010000 J:\BOINC_Data\slots\3\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 00000000199e0000 0000000003d5b000 J:\BOINC_Data\slots\3\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 0000000039bd0000 0000000001eca000 J:\BOINC_Data\slots\3\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000b1c00000 000000000919f000 J:\BOINC_Data\slots\3\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000bada0000 000000001b3a4000 J:\BOINC_Data\slots\3\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 00000000900a0000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000008dcf0000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000091390000 0000000000470000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000008f900000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 000000008fbc0000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000008f1d0000 0000000000033000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 000000008fbf0000 0000000000068000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 000000008f430000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000008f010000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000902a0000 0000000000744000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.19041.964 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.964

ModLoad: 000000008d330000 0000000000794000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000918e0000 0000000000354000 C:\WINDOWS\System32\combase.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.19041.1320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1320

ModLoad: 000000008ee90000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000008fd70000 00000000000ad000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000090040000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000058390000 00000000002cd000 C:\WINDOWS\system32\nvcuda.dll (30.0.15.1179) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_75\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 30.0.15.1179
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.6.110 driver
    Product Version       : 30.0.15.1179

ModLoad: 0000000027b90000 00000000016a0000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispig.inf_amd64_3b12ac0f95b18b9d\nvcuda64.dll (30.0.15.1179) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_75\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 30.0.15.1179
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.6.110 driver
    Product Version       : 30.0.15.1179

ModLoad: 0000000087fc0000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000087f80000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.19041.906 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.906

ModLoad: 0000000084ae0000 0000000000148000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : drvstore.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 000000008ee00000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000007fbb0000 0000000000768000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.15.1179) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_75\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 30.0.15.1179
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 30.0.15.1179

ModLoad: 000000008fb30000 0000000000082000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.19041.1415 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1415



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3622, Write: 308, Other 613

- I/O Transfers Counters -
Read: 6775184, Write: 6063, Other 26330

- Paged Pool Usage -
QuotaPagedPoolUsage: 3447856, QuotaPeakPagedPoolUsage: 3447856
QuotaNonPagedPoolUsage: 37392, QuotaPeakNonPagedPoolUsage: 37392

- Virtual Memory Usage -
VirtualSize: -1215791104, PeakVirtualSize: -620249088

- Pagefile Usage -
PagefileUsage: -1215791104, PeakPagefileUsage: -1215791104

- Working Set Size -
WorkingSetSize: 1223503872, PeakWorkingSetSize: 1223507968, PageFaultCount: 425310

*** Dump of thread ID 24268 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 5156250.000000, User Time: 17031250.000000, Wait Time: 27631264.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFE8F664F69

- Registers -
rax=000000003db85c80 rbx=000000002eb24910 rcx=000000003d006100 rdx=0000000091d3b800 rsi=000000003db86ae0 rdi=0000000019930520
r8=0000000070e4edca r9=000000002675ba88 r10=0000000000000001 r11=00000000f61a02e1 r12=00000000065bb8a0 r13=000000003db86cf0
r14=0000000001b4cef0 r15=0000000000000000 rip=000000008f664f69 rsp=000000003db86980 rbp=000000003db86c70
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
3db86a50 2ea3a884 00000040 0000004f 065ba200 000006dc KERNELBASE!RaiseException+0x0 
3db86ab0 2e7e1ca6 3de80000 3db86b89 168928a8 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
3db86b60 2e7e593b 00000000 00000030 00000020 00000008 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
3db86cb0 2e7e1a78 00000000 00000000 3db86fe0 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
3db86d80 2e7e1cfc 3db86fe0 00000000 00000080 3db872b0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
3db86e40 2e7ec4dd 3db872b0 3db872b0 3db872b0 3db872b0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
3db87130 2e7db2fe 3db87748 3db872b0 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
3db9fed0 2ea1c6f8 3f782ec0 00000000 00000000 3de859f0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
3db9ff10 8fed7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
3db9ff40 91d62651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
3db9ffc0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 29308 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 27630836.000000

- Registers -
rax=00000000000001d3 rbx=000000003de855a0 rcx=0000000000000070 rdx=000000003de85220 rsi=000000003de83350 rdi=000000003de855a0
r8=0000000000000008 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000091db07c4 rsp=000000003deff978 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
3deff970 91d62dc7 00000000 00000000 3de83350 3de855a0 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
3deffc70 8fed7034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
3deffca0 91d62651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
3deffd20 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 27688 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 27630836.000000

- Registers -
rax=00000000000001d3 rbx=000000003de859d0 rcx=0000000000000070 rdx=000000003de85650 rsi=000000003de83350 rdi=000000003de859d0
r8=0000000087fc5008 r9=000000003dffefd0 r10=0000000087fc00f0 r11=0000000000000001 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000091db07c4 rsp=000000003dfff528 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
3dfff520 91d62dc7 00000000 00000000 3de83350 3de859d0 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
3dfff820 8fed7034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
3dfff850 91d62651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
3dfff8d0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 4228 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 312500.000000, User Time: 0.000000, Wait Time: 27630836.000000

- Registers -
rax=00000000000001d3 rbx=000000003de86250 rcx=0000000000000070 rdx=000000003de85ed0 rsi=000000003de83350 rdi=000000003de86250
r8=0000000000000008 r9=0000000000000040 r10=0000000000000540 r11=0000000000000200 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000091db07c4 rsp=000000003e0ff638 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
3e0ff630 91d62dc7 00000000 00000000 3de83350 3de86250 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
3e0ff930 8fed7034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
3e0ff960 91d62651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
3e0ff9e0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 27512 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 27631264.000000

- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=000000003e2ff920 rsi=0000000000000000 rdi=0000000000000064
r8=000000003e2ff8f8 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000091dad3f4 rsp=000000003e2ff8f8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
3e2ff8f0 8f67962e 3e2ff9b8 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0 
3e2ff990 2e7fa07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0 
3e2ff9c0 8fed7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
3e2ff9f0 91d62651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
3e2ffa70 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 6108 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 27631264.000000

- Registers -
rax=000000000000005b rbx=000000000000000e rcx=000000000000000e rdx=000000003e3ff7d0 rsi=0000000000000000 rdi=000000000000000e
r8=0000000000000001 r9=000000003f9aa2e0 r10=0000000000000000 r11=000000003e3ff740 r12=0000000000000064 r13=000000003e3ff7d0
r14=000000003e3ff4d0 r15=0000000000000000 rip=0000000091dad8c4 rsp=000000003e3ff478 rbp=000000003f9aa2e0
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
3e3ff470 8f67cb20 00000000 3dc8f000 91e7a4d0 3dc8f000 ntdll!ZwWaitForMultipleObjects+0x0 
3e3ff760 8f67ca1e 3de930a0 004e0049 0000000e 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
3e3ff7a0 27d6d554 3f9ad1c0 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
3e3ff9e0 27e158cd 00000000 3f9aa2e0 00000000 00000000 nvcuda64!+0x0 
3e3ffa90 27d6cf23 38cb66b6 36c4918f 3ff48d80 00000000 nvcuda64!cuProfilerStop+0x0 
3e3ffac0 280a4594 3ff48d80 00000000 00000000 00000000 nvcuda64!+0x0 
3e3ffaf0 8fed7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
3e3ffb20 91d62651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
3e3ffba0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 11172 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 27631094.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002b8 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002b8
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=000000003f9714e0 r13=0000000000000000
r14=00000000000002b8 r15=0000000000000000 rip=0000000091dacdf4 rsp=000000003e4ff968 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
3e4ff960 8f651a5e 00000000 00001f80 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0 
3e4ffa00 27f95d0e 3ff48a50 00000000 00000000 000002b8 KERNELBASE!WaitForSingleObjectEx+0x0 
3e4ffc40 27d6cf23 00000000 3ff48a50 27b90000 3faca6e0 nvcuda64!cuProfilerStop+0x0 
3e4ffc70 280a4594 3ff48a50 00000000 00000000 00000000 nvcuda64!+0x0 
3e4ffca0 8fed7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
3e4ffcd0 91d62651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
3e4ffd50 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)