Task 3496072
| Name | ParityModified-1608764218-12230-4_3 |
| Workunit | 1677590 |
| Created | 31 Dec 2020, 19:54:05 UTC |
| Sent | 31 Dec 2020, 20:38:07 UTC |
| Report deadline | 7 Jan 2021, 20:38:07 UTC |
| Received | 1 Jan 2021, 3:05:55 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | -529697949 (0xE06D7363) Unknown error code |
| Computer ID | 157 |
| Run time | 1 hours 29 min 14 sec |
| CPU time | 1 hours 25 min 11 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 4,473.99 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.64 GB |
| Peak swap size | 3.62 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
ch 1377 | loss: nan | val_loss: nan | Time: 3200.04 ms
[2020-12-31 19:48:40 main:574] : INFO : Epoch 1378 | loss: nan | val_loss: nan | Time: 3235.26 ms
[2020-12-31 19:48:44 main:574] : INFO : Epoch 1379 | loss: nan | val_loss: nan | Time: 3133.36 ms
[2020-12-31 19:48:47 main:574] : INFO : Epoch 1380 | loss: nan | val_loss: nan | Time: 3218.52 ms
[2020-12-31 19:48:50 main:574] : INFO : Epoch 1381 | loss: nan | val_loss: nan | Time: 3233.01 ms
[2020-12-31 19:48:53 main:574] : INFO : Epoch 1382 | loss: nan | val_loss: nan | Time: 3145.92 ms
[2020-12-31 19:48:57 main:574] : INFO : Epoch 1383 | loss: nan | val_loss: nan | Time: 3237.69 ms
[2020-12-31 19:49:00 main:574] : INFO : Epoch 1384 | loss: nan | val_loss: nan | Time: 3267.1 ms
[2020-12-31 19:49:03 main:574] : INFO : Epoch 1385 | loss: nan | val_loss: nan | Time: 3135.67 ms
[2020-12-31 19:49:07 main:574] : INFO : Epoch 1386 | loss: nan | val_loss: nan | Time: 3259.96 ms
[2020-12-31 19:49:10 main:574] : INFO : Epoch 1387 | loss: nan | val_loss: nan | Time: 3261.82 ms
[2020-12-31 19:49:13 main:574] : INFO : Epoch 1388 | loss: nan | val_loss: nan | Time: 3144.26 ms
[2020-12-31 19:49:16 main:574] : INFO : Epoch 1389 | loss: nan | val_loss: nan | Time: 3247.3 ms
[2020-12-31 19:49:20 main:574] : INFO : Epoch 1390 | loss: nan | val_loss: nan | Time: 3384.26 ms
[2020-12-31 19:49:23 main:574] : INFO : Epoch 1391 | loss: nan | val_loss: nan | Time: 3158.22 ms
[2020-12-31 19:49:26 main:574] : INFO : Epoch 1392 | loss: nan | val_loss: nan | Time: 3215.28 ms
[2020-12-31 19:49:30 main:574] : INFO : Epoch 1393 | loss: nan | val_loss: nan | Time: 3222 ms
[2020-12-31 19:49:33 main:574] : INFO : Epoch 1394 | loss: nan | val_loss: nan | Time: 3157.95 ms
[2020-12-31 19:49:36 main:574] : INFO : Epoch 1395 | loss: nan | val_loss: nan | Time: 3246.25 ms
[2020-12-31 19:49:40 main:574] : INFO : Epoch 1396 | loss: nan | val_loss: nan | Time: 3230.59 ms
[2020-12-31 19:49:43 main:574] : INFO : Epoch 1397 | loss: nan | val_loss: nan | Time: 3180.11 ms
[2020-12-31 19:49:46 main:574] : INFO : Epoch 1398 | loss: nan | val_loss: nan | Time: 3231.44 ms
[2020-12-31 19:49:49 main:574] : INFO : Epoch 1399 | loss: nan | val_loss: nan | Time: 3202.24 ms
[2020-12-31 19:49:53 main:574] : INFO : Epoch 1400 | loss: nan | val_loss: nan | Time: 3174.59 ms
[2020-12-31 19:49:56 main:574] : INFO : Epoch 1401 | loss: nan | val_loss: nan | Time: 3185.82 ms
[2020-12-31 19:49:59 main:574] : INFO : Epoch 1402 | loss: nan | val_loss: nan | Time: 3206.68 ms
[2020-12-31 19:50:02 main:574] : INFO : Epoch 1403 | loss: nan | val_loss: nan | Time: 3154.38 ms
[2020-12-31 19:50:06 main:574] : INFO : Epoch 1404 | loss: nan | val_loss: nan | Time: 3186.35 ms
[2020-12-31 19:50:09 main:574] : INFO : Epoch 1405 | loss: nan | val_loss: nan | Time: 3202.74 ms
[2020-12-31 19:50:12 main:574] : INFO : Epoch 1406 | loss: nan | val_loss: nan | Time: 3137.72 ms
[2020-12-31 19:50:15 main:574] : INFO : Epoch 1407 | loss: nan | val_loss: nan | Time: 3190.9 ms
[2020-12-31 19:50:19 main:574] : INFO : Epoch 1408 | loss: nan | val_loss: nan | Time: 3212.21 ms
[2020-12-31 19:50:22 main:574] : INFO : Epoch 1409 | loss: nan | val_loss: nan | Time: 3154.48 ms
[2020-12-31 19:50:25 main:574] : INFO : Epoch 1410 | loss: nan | val_loss: nan | Time: 3178.65 ms
[2020-12-31 19:50:28 main:574] : INFO : Epoch 1411 | loss: nan | val_loss: nan | Time: 3208.35 ms
[2020-12-31 19:50:32 main:574] : INFO : Epoch 1412 | loss: nan | val_loss: nan | Time: 3212.63 ms
[2020-12-31 19:50:35 main:574] : INFO : Epoch 1413 | loss: nan | val_loss: nan | Time: 3159.56 ms
[2020-12-31 19:50:38 main:574] : INFO : Epoch 1414 | loss: nan | val_loss: nan | Time: 3172.43 ms
[2020-12-31 19:50:41 main:574] : INFO : Epoch 1415 | loss: nan | val_loss: nan | Time: 3271.31 ms
[2020-12-31 19:50:45 main:574] : INFO : Epoch 1416 | loss: nan | val_loss: nan | Time: 3200.15 ms
[2020-12-31 19:50:48 main:574] : INFO : Epoch 1417 | loss: nan | val_loss: nan | Time: 3194.73 ms
[2020-12-31 19:50:51 main:574] : INFO : Epoch 1418 | loss: nan | val_loss: nan | Time: 3182.48 ms
[2020-12-31 19:50:54 main:574] : INFO : Epoch 1419 | loss: nan | val_loss: nan | Time: 3151.87 ms
[2020-12-31 19:50:58 main:574] : INFO : Epoch 1420 | loss: nan | val_loss: nan | Time: 3202.96 ms
[2020-12-31 19:51:01 main:574] : INFO : Epoch 1421 | loss: nan | val_loss: nan | Time: 3208.03 ms
[2020-12-31 19:51:04 main:574] : INFO : Epoch 1422 | loss: nan | val_loss: nan | Time: 3130.4 ms
[2020-12-31 19:51:07 main:574] : INFO : Epoch 1423 | loss: nan | val_loss: nan | Time: 3184.83 ms
[2020-12-31 19:51:11 main:574] : INFO : Epoch 1424 | loss: nan | val_loss: nan | Time: 3212.9 ms
[2020-12-31 19:51:14 main:574] : INFO : Epoch 1425 | loss: nan | val_loss: nan | Time: 3119.39 ms
[2020-12-31 19:51:17 main:574] : INFO : Epoch 1426 | loss: nan | val_loss: nan | Time: 3209.1 ms
[2020-12-31 19:51:20 main:574] : INFO : Epoch 1427 | loss: nan | val_loss: nan | Time: 3197.42 ms
[2020-12-31 19:51:24 main:574] : INFO : Epoch 1428 | loss: nan | val_loss: nan | Time: 3135.77 ms
[2020-12-31 19:51:27 main:574] : INFO : Epoch 1429 | loss: nan | val_loss: nan | Time: 3226.95 ms
[2020-12-31 19:51:30 main:574] : INFO : Epoch 1430 | loss: nan | val_loss: nan | Time: 3177.62 ms
[2020-12-31 19:51:33 main:574] : INFO : Epoch 1431 | loss: nan | val_loss: nan | Time: 3124.83 ms
[2020-12-31 19:51:37 main:574] : INFO : Epoch 1432 | loss: nan | val_loss: nan | Time: 3183.64 ms
[2020-12-31 19:51:40 main:574] : INFO : Epoch 1433 | loss: nan | val_loss: nan | Time: 3216.17 ms
[2020-12-31 19:51:43 main:574] : INFO : Epoch 1434 | loss: nan | val_loss: nan | Time: 3154.41 ms
[2020-12-31 19:51:46 main:574] : INFO : Epoch 1435 | loss: nan | val_loss: nan | Time: 3152.97 ms
[2020-12-31 19:51:50 main:574] : INFO : Epoch 1436 | loss: nan | val_loss: nan | Time: 3216.24 ms
[2020-12-31 19:51:53 main:574] : INFO : Epoch 1437 | loss: nan | val_loss: nan | Time: 3157.17 ms
[2020-12-31 19:51:56 main:574] : INFO : Epoch 1438 | loss: nan | val_loss: nan | Time: 3184.38 ms
[2020-12-31 19:51:59 main:574] : INFO : Epoch 1439 | loss: nan | val_loss: nan | Time: 3237.46 ms
[2020-12-31 19:52:03 main:574] : INFO : Epoch 1440 | loss: nan | val_loss: nan | Time: 3181.34 ms
[2020-12-31 19:52:06 main:574] : INFO : Epoch 1441 | loss: nan | val_loss: nan | Time: 3246.3 ms
[2020-12-31 19:52:09 main:574] : INFO : Epoch 1442 | loss: nan | val_loss: nan | Time: 3220.97 ms
[2020-12-31 19:52:12 main:574] : INFO : Epoch 1443 | loss: nan | val_loss: nan | Time: 3139.74 ms
[2020-12-31 19:52:16 main:574] : INFO : Epoch 1444 | loss: nan | val_loss: nan | Time: 3158.45 ms
[2020-12-31 19:52:19 main:574] : INFO : Epoch 1445 | loss: nan | val_loss: nan | Time: 3246.26 ms
[2020-12-31 19:52:22 main:574] : INFO : Epoch 1446 | loss: nan | val_loss: nan | Time: 3147.32 ms
[2020-12-31 19:52:25 main:574] : INFO : Epoch 1447 | loss: nan | val_loss: nan | Time: 3146.95 ms
[2020-12-31 19:52:29 main:574] : INFO : Epoch 1448 | loss: nan | val_loss: nan | Time: 3167.55 ms
[2020-12-31 19:52:32 main:574] : INFO : Epoch 1449 | loss: nan | val_loss: nan | Time: 3186.62 ms
[2020-12-31 19:52:35 main:574] : INFO : Epoch 1450 | loss: nan | val_loss: nan | Time: 3175.54 ms
[2020-12-31 19:52:38 main:574] : INFO : Epoch 1451 | loss: nan | val_loss: nan | Time: 3200.52 ms
[2020-12-31 19:52:42 main:574] : INFO : Epoch 1452 | loss: nan | val_loss: nan | Time: 3255.61 ms
[2020-12-31 19:52:45 main:574] : INFO : Epoch 1453 | loss: nan | val_loss: nan | Time: 3147.8 ms
[2020-12-31 19:52:48 main:574] : INFO : Epoch 1454 | loss: nan | val_loss: nan | Time: 3185.8 ms
[2020-12-31 19:52:51 main:574] : INFO : Epoch 1455 | loss: nan | val_loss: nan | Time: 3208.33 ms
[2020-12-31 19:52:55 main:574] : INFO : Epoch 1456 | loss: nan | val_loss: nan | Time: 3160.64 ms
[2020-12-31 19:52:58 main:574] : INFO : Epoch 1457 | loss: nan | val_loss: nan | Time: 3205.31 ms
[2020-12-31 19:53:01 main:574] : INFO : Epoch 1458 | loss: nan | val_loss: nan | Time: 3234.48 ms
[2020-12-31 19:53:04 main:574] : INFO : Epoch 1459 | loss: nan | val_loss: nan | Time: 3129.13 ms
[2020-12-31 19:53:08 main:574] : INFO : Epoch 1460 | loss: nan | val_loss: nan | Time: 3202.62 ms
[2020-12-31 19:53:11 main:574] : INFO : Epoch 1461 | loss: nan | val_loss: nan | Time: 3229.01 ms
[2020-12-31 19:53:14 main:574] : INFO : Epoch 1462 | loss: nan | val_loss: nan | Time: 3146.13 ms
[2020-12-31 19:53:17 main:574] : INFO : Epoch 1463 | loss: nan | val_loss: nan | Time: 3214.19 ms
[2020-12-31 19:53:21 main:574] : INFO : Epoch 1464 | loss: nan | val_loss: nan | Time: 3204.54 ms
[2020-12-31 19:53:24 main:574] : INFO : Epoch 1465 | loss: nan | val_loss: nan | Time: 3170.72 ms
[2020-12-31 19:53:27 main:574] : INFO : Epoch 1466 | loss: nan | val_loss: nan | Time: 3186.01 ms
[2020-12-31 19:53:30 main:574] : INFO : Epoch 1467 | loss: nan | val_loss: nan | Time: 3208.96 ms
[2020-12-31 19:53:34 main:574] : INFO : Epoch 1468 | loss: nan | val_loss: nan | Time: 3142.56 ms
[2020-12-31 19:53:37 main:574] : INFO : Epoch 1469 | loss: nan | val_loss: nan | Time: 3173.95 ms
[2020-12-31 19:53:40 main:574] : INFO : Epoch 1470 | loss: nan | val_loss: nan | Time: 3177.46 ms
[2020-12-31 19:53:43 main:574] : INFO : Epoch 1471 | loss: nan | val_loss: nan | Time: 3171.04 ms
[2020-12-31 19:53:47 main:574] : INFO : Epoch 1472 | loss: nan | val_loss: nan | Time: 3192.88 ms
[2020-12-31 19:53:50 main:574] : INFO : Epoch 1473 | loss: nan | val_loss: nan | Time: 3199.62 ms
[2020-12-31 19:53:53 main:574] : INFO : Epoch 1474 | loss: nan | val_loss: nan | Time: 3132.92 ms
[2020-12-31 19:53:56 main:574] : INFO : Epoch 1475 | loss: nan | val_loss: nan | Time: 3221.43 ms
[2020-12-31 19:54:00 main:574] : INFO : Epoch 1476 | loss: nan | val_loss: nan | Time: 3244.28 ms
[2020-12-31 19:54:03 main:574] : INFO : Epoch 1477 | loss: nan | val_loss: nan | Time: 3146.27 ms
[2020-12-31 19:54:06 main:574] : INFO : Epoch 1478 | loss: nan | val_loss: nan | Time: 3210.73 ms
[2020-12-31 19:54:10 main:574] : INFO : Epoch 1479 | loss: nan | val_loss: nan | Time: 3224 ms
[2020-12-31 19:54:13 main:574] : INFO : Epoch 1480 | loss: nan | val_loss: nan | Time: 3151.7 ms
[2020-12-31 19:54:16 main:574] : INFO : Epoch 1481 | loss: nan | val_loss: nan | Time: 3193.61 ms
[2020-12-31 19:54:19 main:574] : INFO : Epoch 1482 | loss: nan | val_loss: nan | Time: 3209.65 ms
[2020-12-31 19:54:23 main:574] : INFO : Epoch 1483 | loss: nan | val_loss: nan | Time: 3194.8 ms
[2020-12-31 19:54:26 main:574] : INFO : Epoch 1484 | loss: nan | val_loss: nan | Time: 3390.58 ms
[2020-12-31 19:54:29 main:574] : INFO : Epoch 1485 | loss: nan | val_loss: nan | Time: 3251.73 ms
[2020-12-31 19:54:32 main:574] : INFO : Epoch 1486 | loss: nan | val_loss: nan | Time: 3156.94 ms
[2020-12-31 19:54:36 main:574] : INFO : Epoch 1487 | loss: nan | val_loss: nan | Time: 3223.14 ms
[2020-12-31 19:54:39 main:574] : INFO : Epoch 1488 | loss: nan | val_loss: nan | Time: 3215.48 ms
[2020-12-31 19:54:42 main:574] : INFO : Epoch 1489 | loss: nan | val_loss: nan | Time: 3176.91 ms
[2020-12-31 19:54:46 main:574] : INFO : Epoch 1490 | loss: nan | val_loss: nan | Time: 3179.63 ms
[2020-12-31 19:54:49 main:574] : INFO : Epoch 1491 | loss: nan | val_loss: nan | Time: 3226.84 ms
[2020-12-31 19:54:52 main:574] : INFO : Epoch 1492 | loss: nan | val_loss: nan | Time: 3187.92 ms
[2020-12-31 19:54:55 main:574] : INFO : Epoch 1493 | loss: nan | val_loss: nan | Time: 3169.75 ms
[2020-12-31 19:54:59 main:574] : INFO : Epoch 1494 | loss: nan | val_loss: nan | Time: 3212.48 ms
[2020-12-31 19:55:02 main:574] : INFO : Epoch 1495 | loss: nan | val_loss: nan | Time: 3251.61 ms
[2020-12-31 19:55:05 main:574] : INFO : Epoch 1496 | loss: nan | val_loss: nan | Time: 3136.6 ms
[2020-12-31 19:55:08 main:574] : INFO : Epoch 1497 | loss: nan | val_loss: nan | Time: 3221.16 ms
[2020-12-31 19:55:12 main:574] : INFO : Epoch 1498 | loss: nan | val_loss: nan | Time: 3226.63 ms
[2020-12-31 19:55:15 main:574] : INFO : Epoch 1499 | loss: nan | val_loss: nan | Time: 3165.56 ms
[2020-12-31 19:55:18 main:574] : INFO : Epoch 1500 | loss: nan | val_loss: nan | Time: 3187.22 ms
[2020-12-31 19:55:22 main:574] : INFO : Epoch 1501 | loss: nan | val_loss: nan | Time: 3225.8 ms
[2020-12-31 19:55:25 main:574] : INFO : Epoch 1502 | loss: nan | val_loss: nan | Time: 3202.03 ms
[2020-12-31 19:55:28 main:574] : INFO : Epoch 1503 | loss: nan | val_loss: nan | Time: 3209.65 ms
[2020-12-31 19:55:31 main:574] : INFO : Epoch 1504 | loss: nan | val_loss: nan | Time: 3184.6 ms
[2020-12-31 19:55:35 main:574] : INFO : Epoch 1505 | loss: nan | val_loss: nan | Time: 3184.06 ms
[2020-12-31 19:55:38 main:574] : INFO : Epoch 1506 | loss: nan | val_loss: nan | Time: 3211.93 ms
[2020-12-31 19:55:41 main:574] : INFO : Epoch 1507 | loss: nan | val_loss: nan | Time: 3234.01 ms
[2020-12-31 19:55:44 main:574] : INFO : Epoch 1508 | loss: nan | val_loss: nan | Time: 3175.9 ms
[2020-12-31 19:55:48 main:574] : INFO : Epoch 1509 | loss: nan | val_loss: nan | Time: 3183.19 ms
[2020-12-31 19:55:51 main:574] : INFO : Epoch 1510 | loss: nan | val_loss: nan | Time: 3257.94 ms
[2020-12-31 19:55:54 main:574] : INFO : Epoch 1511 | loss: nan | val_loss: nan | Time: 3167.65 ms
[2020-12-31 19:55:58 main:574] : INFO : Epoch 1512 | loss: nan | val_loss: nan | Time: 3219.76 ms
[2020-12-31 19:56:01 main:574] : INFO : Epoch 1513 | loss: nan | val_loss: nan | Time: 3234.41 ms
[2020-12-31 19:56:04 main:574] : INFO : Epoch 1514 | loss: nan | val_loss: nan | Time: 3313.04 ms
[2020-12-31 19:56:07 main:574] : INFO : Epoch 1515 | loss: nan | val_loss: nan | Time: 3172.8 ms
[2020-12-31 19:56:11 main:574] : INFO : Epoch 1516 | loss: nan | val_loss: nan | Time: 3190.65 ms
[2020-12-31 19:56:14 main:574] : INFO : Epoch 1517 | loss: nan | val_loss: nan | Time: 3139.41 ms
[2020-12-31 19:56:17 main:574] : INFO : Epoch 1518 | loss: nan | val_loss: nan | Time: 3204.9 ms
[2020-12-31 19:56:20 main:574] : INFO : Epoch 1519 | loss: nan | val_loss: nan | Time: 3227.12 ms
[2020-12-31 19:56:24 main:574] : INFO : Epoch 1520 | loss: nan | val_loss: nan | Time: 3137.51 ms
[2020-12-31 19:56:27 main:574] : INFO : Epoch 1521 | loss: nan | val_loss: nan | Time: 3241.06 ms
[2020-12-31 19:56:30 main:574] : INFO : Epoch 1522 | loss: nan | val_loss: nan | Time: 3223.61 ms
[2020-12-31 19:56:33 main:574] : INFO : Epoch 1523 | loss: nan | val_loss: nan | Time: 3132.93 ms
[2020-12-31 19:56:37 main:574] : INFO : Epoch 1524 | loss: nan | val_loss: nan | Time: 3203.81 ms
[2020-12-31 19:56:40 main:574] : INFO : Epoch 1525 | loss: nan | val_loss: nan | Time: 3177.72 ms
[2020-12-31 19:56:43 main:574] : INFO : Epoch 1526 | loss: nan | val_loss: nan | Time: 3214.23 ms
[2020-12-31 19:56:47 main:574] : INFO : Epoch 1527 | loss: nan | val_loss: nan | Time: 3224.95 ms
[2020-12-31 19:56:50 main:574] : INFO : Epoch 1528 | loss: nan | val_loss: nan | Time: 3200.72 ms
[2020-12-31 19:56:53 main:574] : INFO : Epoch 1529 | loss: nan | val_loss: nan | Time: 3172.53 ms
[2020-12-31 19:56:56 main:574] : INFO : Epoch 1530 | loss: nan | val_loss: nan | Time: 3184.22 ms
[2020-12-31 19:57:00 main:574] : INFO : Epoch 1531 | loss: nan | val_loss: nan | Time: 3176.95 ms
[2020-12-31 19:57:03 main:574] : INFO : Epoch 1532 | loss: nan | val_loss: nan | Time: 3165.3 ms
[2020-12-31 19:57:06 main:574] : INFO : Epoch 1533 | loss: nan | val_loss: nan | Time: 3186.01 ms
[2020-12-31 19:57:09 main:574] : INFO : Epoch 1534 | loss: nan | val_loss: nan | Time: 3233.91 ms
[2020-12-31 19:57:13 main:574] : INFO : Epoch 1535 | loss: nan | val_loss: nan | Time: 3175.84 ms
[2020-12-31 19:57:16 main:574] : INFO : Epoch 1536 | loss: nan | val_loss: nan | Time: 3202.92 ms
[2020-12-31 19:57:19 main:574] : INFO : Epoch 1537 | loss: nan | val_loss: nan | Time: 3241.63 ms
[2020-12-31 19:57:22 main:574] : INFO : Epoch 1538 | loss: nan | val_loss: nan | Time: 3220.65 ms
[2020-12-31 19:57:26 main:574] : INFO : Epoch 1539 | loss: nan | val_loss: nan | Time: 3165.2 ms
[2020-12-31 19:57:29 main:574] : INFO : Epoch 1540 | loss: nan | val_loss: nan | Time: 3209.19 ms
[2020-12-31 19:57:32 main:574] : INFO : Epoch 1541 | loss: nan | val_loss: nan | Time: 3213.47 ms
[2020-12-31 19:57:35 main:574] : INFO : Epoch 1542 | loss: nan | val_loss: nan | Time: 3175.91 ms
[2020-12-31 19:57:39 main:574] : INFO : Epoch 1543 | loss: nan | val_loss: nan | Time: 3190.08 ms
[2020-12-31 19:57:42 main:574] : INFO : Epoch 1544 | loss: nan | val_loss: nan | Time: 3220.34 ms
[2020-12-31 19:57:45 main:574] : INFO : Epoch 1545 | loss: nan | val_loss: nan | Time: 3201.6 ms
[2020-12-31 19:57:48 main:574] : INFO : Epoch 1546 | loss: nan | val_loss: nan | Time: 3200.63 ms
[2020-12-31 19:57:52 main:574] : INFO : Epoch 1547 | loss: nan | val_loss: nan | Time: 3201.52 ms
[2020-12-31 19:57:55 main:574] : INFO : Epoch 1548 | loss: nan | val_loss: nan | Time: 3182 ms
[2020-12-31 19:57:58 main:574] : INFO : Epoch 1549 | loss: nan | val_loss: nan | Time: 3186.14 ms
[2020-12-31 19:58:02 main:574] : INFO : Epoch 1550 | loss: nan | val_loss: nan | Time: 3253.3 ms
[2020-12-31 19:58:05 main:574] : INFO : Epoch 1551 | loss: nan | val_loss: nan | Time: 3173.51 ms
[2020-12-31 19:58:08 main:574] : INFO : Epoch 1552 | loss: nan | val_loss: nan | Time: 3188.21 ms
[2020-12-31 19:58:11 main:574] : INFO : Epoch 1553 | loss: nan | val_loss: nan | Time: 3222.46 ms
[2020-12-31 19:58:15 main:574] : INFO : Epoch 1554 | loss: nan | val_loss: nan | Time: 3154.74 ms
[2020-12-31 19:58:18 main:574] : INFO : Epoch 1555 | loss: nan | val_loss: nan | Time: 3312.73 ms
[2020-12-31 19:58:21 main:574] : INFO : Epoch 1556 | loss: nan | val_loss: nan | Time: 3331.91 ms
[2020-12-31 19:58:25 main:574] : INFO : Epoch 1557 | loss: nan | val_loss: nan | Time: 3188.51 ms
[2020-12-31 19:58:28 main:574] : INFO : Epoch 1558 | loss: nan | val_loss: nan | Time: 3177.82 ms
[2020-12-31 19:58:31 main:574] : INFO : Epoch 1559 | loss: nan | val_loss: nan | Time: 3188.5 ms
[2020-12-31 19:58:34 main:574] : INFO : Epoch 1560 | loss: nan | val_loss: nan | Time: 3152.77 ms
[2020-12-31 19:58:38 main:574] : INFO : Epoch 1561 | loss: nan | val_loss: nan | Time: 3169.02 ms
[2020-12-31 19:58:41 main:574] : INFO : Epoch 1562 | loss: nan | val_loss: nan | Time: 3235.41 ms
[2020-12-31 19:58:44 main:574] : INFO : Epoch 1563 | loss: nan | val_loss: nan | Time: 3152.89 ms
[2020-12-31 19:58:47 main:574] : INFO : Epoch 1564 | loss: nan | val_loss: nan | Time: 3199.45 ms
[2020-12-31 19:58:51 main:574] : INFO : Epoch 1565 | loss: nan | val_loss: nan | Time: 3186.41 ms
[2020-12-31 19:58:54 main:574] : INFO : Epoch 1566 | loss: nan | val_loss: nan | Time: 3110.67 ms
[2020-12-31 19:58:57 main:574] : INFO : Epoch 1567 | loss: nan | val_loss: nan | Time: 3173.11 ms
[2020-12-31 19:59:00 main:574] : INFO : Epoch 1568 | loss: nan | val_loss: nan | Time: 3224.44 ms
[2020-12-31 19:59:04 main:574] : INFO : Epoch 1569 | loss: nan | val_loss: nan | Time: 3148.19 ms
[2020-12-31 19:59:07 main:574] : INFO : Epoch 1570 | loss: nan | val_loss: nan | Time: 3182.68 ms
[2020-12-31 19:59:10 main:574] : INFO : Epoch 1571 | loss: nan | val_loss: nan | Time: 3230.99 ms
[2020-12-31 19:59:13 main:574] : INFO : Epoch 1572 | loss: nan | val_loss: nan | Time: 3137.53 ms
[2020-12-31 19:59:17 main:574] : INFO : Epoch 1573 | loss: nan | val_loss: nan | Time: 3185.11 ms
[2020-12-31 19:59:20 main:574] : INFO : Epoch 1574 | loss: nan | val_loss: nan | Time: 3268.09 ms
[2020-12-31 19:59:23 main:574] : INFO : Epoch 1575 | loss: nan | val_loss: nan | Time: 3141.68 ms
[2020-12-31 19:59:26 main:574] : INFO : Epoch 1576 | loss: nan | val_loss: nan | Time: 3214.94 ms
[2020-12-31 19:59:30 main:574] : INFO : Epoch 1577 | loss: nan | val_loss: nan | Time: 3203.85 ms
[2020-12-31 19:59:33 main:574] : INFO : Epoch 1578 | loss: nan | val_loss: nan | Time: 3195.37 ms
[2020-12-31 19:59:36 main:574] : INFO : Epoch 1579 | loss: nan | val_loss: nan | Time: 3176.89 ms
[2020-12-31 19:59:40 main:574] : INFO : Epoch 1580 | loss: nan | val_loss: nan | Time: 3418.56 ms
[2020-12-31 19:59:43 main:574] : INFO : Epoch 1581 | loss: nan | val_loss: nan | Time: 3185.38 ms
[2020-12-31 19:59:46 main:574] : INFO : Epoch 1582 | loss: nan | val_loss: nan | Time: 3173.58 ms
[2020-12-31 19:59:49 main:574] : INFO : Epoch 1583 | loss: nan | val_loss: nan | Time: 3229.03 ms
[2020-12-31 19:59:53 main:574] : INFO : Epoch 1584 | loss: nan | val_loss: nan | Time: 3152.71 ms
[2020-12-31 19:59:56 main:574] : INFO : Epoch 1585 | loss: nan | val_loss: nan | Time: 3192.38 ms
[2020-12-31 19:59:59 main:574] : INFO : Epoch 1586 | loss: nan | val_loss: nan | Time: 3222.07 ms
[2020-12-31 20:00:03 main:574] : INFO : Epoch 1587 | loss: nan | val_loss: nan | Time: 3206.84 ms
[2020-12-31 20:00:06 main:574] : INFO : Epoch 1588 | loss: nan | val_loss: nan | Time: 3145.92 ms
[2020-12-31 20:00:09 main:574] : INFO : Epoch 1589 | loss: nan | val_loss: nan | Time: 3146.5 ms
[2020-12-31 20:00:12 main:574] : INFO : Epoch 1590 | loss: nan | val_loss: nan | Time: 3198.56 ms
[2020-12-31 20:00:15 main:574] : INFO : Epoch 1591 | loss: nan | val_loss: nan | Time: 3160.18 ms
[2020-12-31 20:00:19 main:574] : INFO : Epoch 1592 | loss: nan | val_loss: nan | Time: 3158.37 ms
[2020-12-31 20:00:22 main:574] : INFO : Epoch 1593 | loss: nan | val_loss: nan | Time: 3200.25 ms
[2020-12-31 20:00:25 main:574] : INFO : Epoch 1594 | loss: nan | val_loss: nan | Time: 3414.56 ms
[2020-12-31 20:00:29 main:574] : INFO : Epoch 1595 | loss: nan | val_loss: nan | Time: 3243.36 ms
[2020-12-31 20:00:32 main:574] : INFO : Epoch 1596 | loss: nan | val_loss: nan | Time: 3191.98 ms
[2020-12-31 20:00:35 main:574] : INFO : Epoch 1597 | loss: nan | val_loss: nan | Time: 3187.1 ms
[2020-12-31 20:00:38 main:574] : INFO : Epoch 1598 | loss: nan | val_loss: nan | Time: 3196.24 ms
[2020-12-31 20:00:42 main:574] : INFO : Epoch 1599 | loss: nan | val_loss: nan | Time: 3167.94 ms
[2020-12-31 20:00:45 main:574] : INFO : Epoch 1600 | loss: nan | val_loss: nan | Time: 3139.84 ms
[2020-12-31 20:00:48 main:574] : INFO : Epoch 1601 | loss: nan | val_loss: nan | Time: 3134.4 ms
[2020-12-31 20:00:51 main:574] : INFO : Epoch 1602 | loss: nan | val_loss: nan | Time: 3209.92 ms
[2020-12-31 20:00:55 main:574] : INFO : Epoch 1603 | loss: nan | val_loss: nan | Time: 3162.64 ms
[2020-12-31 20:00:58 main:574] : INFO : Epoch 1604 | loss: nan | val_loss: nan | Time: 3215.01 ms
[2020-12-31 20:01:01 main:574] : INFO : Epoch 1605 | loss: nan | val_loss: nan | Time: 3239.6 ms
[2020-12-31 20:01:04 main:574] : INFO : Epoch 1606 | loss: nan | val_loss: nan | Time: 3155.08 ms
[2020-12-31 20:01:08 main:574] : INFO : Epoch 1607 | loss: nan | val_loss: nan | Time: 3203.66 ms
[2020-12-31 20:01:11 main:574] : INFO : Epoch 1608 | loss: nan | val_loss: nan | Time: 3188.09 ms
[2020-12-31 20:01:14 main:574] : INFO : Epoch 1609 | loss: nan | val_loss: nan | Time: 3143.81 ms
[2020-12-31 20:01:17 main:574] : INFO : Epoch 1610 | loss: nan | val_loss: nan | Time: 3168.74 ms
[2020-12-31 20:01:21 main:574] : INFO : Epoch 1611 | loss: nan | val_loss: nan | Time: 3172.23 ms
[2020-12-31 20:01:24 main:574] : INFO : Epoch 1612 | loss: nan | val_loss: nan | Time: 3140.42 ms
[2020-12-31 20:01:27 main:574] : INFO : Epoch 1613 | loss: nan | val_loss: nan | Time: 3178.73 ms
[2020-12-31 20:01:30 main:574] : INFO : Epoch 1614 | loss: nan | val_loss: nan | Time: 3182.29 ms
[2020-12-31 20:01:34 main:574] : INFO : Epoch 1615 | loss: nan | val_loss: nan | Time: 3143.65 ms
[2020-12-31 20:01:37 main:574] : INFO : Epoch 1616 | loss: nan | val_loss: nan | Time: 3212.13 ms
[2020-12-31 20:01:40 main:574] : INFO : Epoch 1617 | loss: nan | val_loss: nan | Time: 3246.09 ms
[2020-12-31 20:01:43 main:574] : INFO : Epoch 1618 | loss: nan | val_loss: nan | Time: 3135.96 ms
[2020-12-31 20:01:47 main:574] : INFO : Epoch 1619 | loss: nan | val_loss: nan | Time: 3189.61 ms
[2020-12-31 20:01:50 main:574] : INFO : Epoch 1620 | loss: nan | val_loss: nan | Time: 3177.98 ms
[2020-12-31 20:01:53 main:574] : INFO : Epoch 1621 | loss: nan | val_loss: nan | Time: 3162 ms
[2020-12-31 20:01:56 main:574] : INFO : Epoch 1622 | loss: nan | val_loss: nan | Time: 3195.7 ms
[2020-12-31 20:02:00 main:574] : INFO : Epoch 1623 | loss: nan | val_loss: nan | Time: 3231.75 ms
[2020-12-31 20:02:03 main:574] : INFO : Epoch 1624 | loss: nan | val_loss: nan | Time: 3175.18 ms
[2020-12-31 20:02:06 main:574] : INFO : Epoch 1625 | loss: nan | val_loss: nan | Time: 3166.58 ms
[2020-12-31 20:02:09 main:574] : INFO : Epoch 1626 | loss: nan | val_loss: nan | Time: 3192.19 ms
[2020-12-31 20:02:13 main:574] : INFO : Epoch 1627 | loss: nan | val_loss: nan | Time: 3212.62 ms
[2020-12-31 20:02:16 main:574] : INFO : Epoch 1628 | loss: nan | val_loss: nan | Time: 3119.2 ms
[2020-12-31 20:02:19 main:574] : INFO : Epoch 1629 | loss: nan | val_loss: nan | Time: 3229.18 ms
[2020-12-31 20:02:22 main:574] : INFO : Epoch 1630 | loss: nan | val_loss: nan | Time: 3195.56 ms
[2020-12-31 20:02:25 main:574] : INFO : Epoch 1631 | loss: nan | val_loss: nan | Time: 3159.19 ms
[2020-12-31 20:02:29 main:574] : INFO : Epoch 1632 | loss: nan | val_loss: nan | Time: 3180.62 ms
[2020-12-31 20:02:32 main:574] : INFO : Epoch 1633 | loss: nan | val_loss: nan | Time: 3213.04 ms
[2020-12-31 20:02:35 main:574] : INFO : Epoch 1634 | loss: nan | val_loss: nan | Time: 3154.07 ms
[2020-12-31 20:02:38 main:574] : INFO : Epoch 1635 | loss: nan | val_loss: nan | Time: 3187.69 ms
[2020-12-31 20:02:42 main:574] : INFO : Epoch 1636 | loss: nan | val_loss: nan | Time: 3197.96 ms
[2020-12-31 20:02:45 main:574] : INFO : Epoch 1637 | loss: nan | val_loss: nan | Time: 3176.63 ms
[2020-12-31 20:02:48 main:574] : INFO : Epoch 1638 | loss: nan | val_loss: nan | Time: 3189.76 ms
[2020-12-31 20:02:52 main:574] : INFO : Epoch 1639 | loss: nan | val_loss: nan | Time: 3178.18 ms
[2020-12-31 20:02:55 main:574] : INFO : Epoch 1640 | loss: nan | val_loss: nan | Time: 3180.18 ms
[2020-12-31 20:02:58 main:574] : INFO : Epoch 1641 | loss: nan | val_loss: nan | Time: 3184.59 ms
[2020-12-31 20:03:01 main:574] : INFO : Epoch 1642 | loss: nan | val_loss: nan | Time: 3209.42 ms
[2020-12-31 20:03:05 main:574] : INFO : Epoch 1643 | loss: nan | val_loss: nan | Time: 3181.32 ms
[2020-12-31 20:03:08 main:574] : INFO : Epoch 1644 | loss: nan | val_loss: nan | Time: 3165.82 ms
[2020-12-31 20:03:11 main:574] : INFO : Epoch 1645 | loss: nan | val_loss: nan | Time: 3223.01 ms
[2020-12-31 20:03:14 main:574] : INFO : Epoch 1646 | loss: nan | val_loss: nan | Time: 3151.58 ms
[2020-12-31 20:03:17 main:574] : INFO : Epoch 1647 | loss: nan | val_loss: nan | Time: 3179.13 ms
[2020-12-31 20:03:21 main:574] : INFO : Epoch 1648 | loss: nan | val_loss: nan | Time: 3222.76 ms
[2020-12-31 20:03:24 main:574] : INFO : Epoch 1649 | loss: nan | val_loss: nan | Time: 3156.16 ms
[2020-12-31 20:03:27 main:574] : INFO : Epoch 1650 | loss: nan | val_loss: nan | Time: 3190.38 ms
[2020-12-31 20:03:31 main:574] : INFO : Epoch 1651 | loss: nan | val_loss: nan | Time: 3233.45 ms
[2020-12-31 20:03:34 main:574] : INFO : Epoch 1652 | loss: nan | val_loss: nan | Time: 3144.93 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 1060 6GB)Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 1060 6GB)
[2020-12-31 20:05:28 main:435] : INFO : Set logging level to 1
[2020-12-31 20:05:28 main:441] : INFO : Running in BOINC Client mode
[2020-12-31 20:05:29 main:444] : INFO : Resolving all filenames
[2020-12-31 20:05:29 main:452] : INFO : Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1)
[2020-12-31 20:05:29 main:452] : INFO : Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1608764218-12230-4_3_r2099668679_1 (exists = 1)
[2020-12-31 20:05:29 main:452] : INFO : Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1608764218-12230-4_3_r2099668679_0 (exists = 0)
[2020-12-31 20:05:29 main:452] : INFO : Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1608764218-12230-4 (exists = 1)
[2020-12-31 20:05:29 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2020-12-31 20:05:29 main:472] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5
[2020-12-31 20:05:29 main:474] : INFO : Configuration:
[2020-12-31 20:05:29 main:475] : INFO : Model type: GRU
[2020-12-31 20:05:29 main:476] : INFO : Validation Loss Threshold: 0.0001
[2020-12-31 20:05:29 main:477] : INFO : Max Epochs: 2048
[2020-12-31 20:05:29 main:478] : INFO : Batch Size: 128
[2020-12-31 20:05:29 main:479] : INFO : Learning Rate: 0.01
[2020-12-31 20:05:29 main:480] : INFO : Patience: 10
[2020-12-31 20:05:29 main:481] : INFO : Hidden Width: 12
[2020-12-31 20:05:30 main:482] : INFO : # Recurrent Layers: 4
[2020-12-31 20:05:30 main:483] : INFO : # Backend Layers: 4
[2020-12-31 20:05:30 main:484] : INFO : # Threads: 1
[2020-12-31 20:05:30 main:486] : INFO : Preparing Dataset
[2020-12-31 20:05:30 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2020-12-31 20:05:30 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2020-12-31 20:05:35 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2020-12-31 20:05:35 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2020-12-31 20:05:36 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2020-12-31 20:05:36 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2020-12-31 20:05:36 main:494] : INFO : Creating Model
[2020-12-31 20:05:36 main:507] : INFO : Preparing config file
[2020-12-31 20:05:36 main:511] : INFO : Found checkpoint, attempting to load...
[2020-12-31 20:05:36 main:512] : INFO : Loading config
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFCCB6DD759
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 12/31/20 20:05:36
Install Directory : D:\Program Files\
Data Directory : D:\ProgramData
Project Symstore :
LoadLibraryA( D:\ProgramData\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( D:\ProgramData\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( D:\ProgramData\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( D:\ProgramData\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: D:\ProgramData\slots\1;D:\ProgramData\projects\www.mlcathome.org_mlcathome
ModLoad: 0000000047180000 00000000003df000 D:\ProgramData\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000cdb30000 00000000001f6000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.662
ModLoad: 00000000cd870000 00000000000bd000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.662
ModLoad: 00000000cb6b0000 00000000002c9000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.662
ModLoad: 00000000c7030000 00000000000d4000 C:\Program Files\Bitdefender\Bitdefender Security\atcuf\264968492627633626\atcuf64.dll (1.34.268.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\Bamboo\home\xml-data\build-dir\ATC-DEFAULT-SOURCES\bin\x64\Release\atcuf64\atcuf64.pdb
File Version : 1.34.268.0 #0x011f0aa
Company Name : Bitdefender S.R.L. Bucharest, ROMANIA
Product Name : Bitdefender® ATC
Product Version : 13
ModLoad: 00000000cc690000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.685) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000cb2d0000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.662
ModLoad: 00000000cc830000 000000000002a000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.685) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.685 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.685
ModLoad: 00000000cb980000 0000000000109000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.685) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.685 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.685
ModLoad: 00000000cb610000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000cba90000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000cc240000 00000000000ac000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.610) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000cd9e0000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.19041.546
ModLoad: 00000000cc4d0000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000cc2f0000 000000000012b000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000094ac0000 0000000000058000 D:\ProgramData\slots\1\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000041390000 0000000024b49000 D:\ProgramData\slots\1\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000027bd0000 000000000abe7000 D:\ProgramData\slots\1\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000b9aa0000 0000000000092000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.28.29301.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\agent\_work\26\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.28.29301.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.28.29301.0
ModLoad: 00000000c3fe0000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.488) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.488 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.488
ModLoad: 00000000b9be0000 0000000000019000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.28.29301.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\agent\_work\26\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.28.29301.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.28.29301.0
ModLoad: 00000000b9d30000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.28.29301.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\agent\_work\26\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.28.29301.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.28.29301.0
ModLoad: 0000000088da0000 0000000000045000 D:\ProgramData\slots\1\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000065a80000 00000000030a5000 D:\ProgramData\slots\1\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 00000000583e0000 00000000034b2000 D:\ProgramData\slots\1\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 000000000c820000 000000001b3a4000 D:\ProgramData\slots\1\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 00000000c6dc0000 0000000000010000 D:\ProgramData\slots\1\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 0000000003680000 000000000919f000 D:\ProgramData\slots\1\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 00000000ff920000 0000000003d5b000 D:\ProgramData\slots\1\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 0000000079190000 000000000020d000 D:\ProgramData\slots\1\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 0000000070930000 00000000002db000 D:\ProgramData\slots\1\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000069f30000 0000000001eca000 D:\ProgramData\slots\1\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000b6350000 0000000000040000 D:\ProgramData\slots\1\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000cd940000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000c91e0000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000cbcc0000 0000000000467000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000cb5c0000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000cb590000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000cafb0000 000000000002c000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000cb270000 0000000000060000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.662
ModLoad: 00000000cb430000 000000000015d000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000cadf0000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000cd010000 0000000000742000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.329 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.329
ModLoad: 00000000c93e0000 0000000000795000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000cc990000 0000000000356000 C:\WINDOWS\System32\combase.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000cac70000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000cd7c0000 00000000000ae000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000cd760000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000088df0000 0000000000267000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.5638) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r456_26\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 27.21.14.5638
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.1.70 driver
Product Version : 27.21.14.5638
ModLoad: 00000000c6180000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000006be00000 000000000152d000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispsi.inf_amd64_98b8327e9bd736d9\nvcuda64.dll (27.21.14.5638) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r456_26\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 27.21.14.5638
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.1.70 driver
Product Version : 27.21.14.5638
ModLoad: 00000000cd970000 000000000006b000 C:\WINDOWS\System32\WS2_32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : ws2_32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000c8d20000 000000000009e000 C:\WINDOWS\system32\uxtheme.dll (6.2.19041.610) (-exported- Symbols Loaded)
Linked PDB Filename : UxTheme.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000bdd80000 00000000006d3000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.5638) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r456_26\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 27.21.14.5638
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 27.21.14.5638
ModLoad: 00000000cc860000 000000000012a000 C:\WINDOWS\System32\OLE32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : ole32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000cb3b0000 0000000000080000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.662 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.662
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 3630, Write: 306, Other 862
- I/O Transfers Counters -
Read: 6514380, Write: 7307, Other 37374
- Paged Pool Usage -
QuotaPagedPoolUsage: 3445536, QuotaPeakPagedPoolUsage: 3445536
QuotaNonPagedPoolUsage: 40456, QuotaPeakNonPagedPoolUsage: 40600
- Virtual Memory Usage -
VirtualSize: -1419743232, PeakVirtualSize: -809676800
- Pagefile Usage -
PagefileUsage: -1419743232, PeakPagefileUsage: -1419743232
- Working Set Size -
WorkingSetSize: 1165701120, PeakWorkingSetSize: 1165705216, PageFaultCount: 397920
*** Dump of thread ID 14320 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 9218750.000000, User Time: 31562500.000000, Wait Time: 109494784.000000
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFCCB6DD759
- Registers -
rax=0000000040860000 rbx=00000000474e4910 rcx=00000000408602b0 rdx=00000000000000c6 rsi=00000000554e6700 rdi=0000000019930520
r8=0000000000000040 r9=0000000000000030 r10=0000000000000004 r11=0000000000000000 r12=000000002c13ccb0 r13=00000000554e6910
r14=000000008b426d20 r15=0000000000000000 rip=00000000cb6dd759 rsp=00000000554e65a0 rbp=00000000554e6890
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000206
- Callstack -
ChildEBP RetAddr Args to Child
554e6670 473fa884 00000040 0000004f 2c13d600 554e6738 KERNELBASE!RaiseException+0x0
554e66d0 471a1ca6 856f4e80 47f23ca2 856f55d0 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
554e6780 471a593b 00000074 554e69e8 00000800 00000001 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
554e68d0 471a1a78 00000000 00000000 554e6c00 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
554e69a0 471a1cfc 554e6c00 00000000 00000080 554e6ed0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
554e6a60 471ac4dd 554e6ed0 554e6ed0 554e6ed0 554e6ed0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
554e6d50 4719b2fe 554e7368 554e6ed0 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
554ffaf0 473dc6f8 675f6f00 00000000 00000000 67639b30 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
554ffb30 cd887034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
554ffb60 cdb7d0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
554ffbe0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 21168 (state: Waiting): ***
- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 109494776.000000
- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000556ff910 rsi=0000000000000000 rdi=0000000000000064
r8=00000000556ff8e8 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000cdbcc634 rsp=00000000556ff8e8 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
556ff8e0 cb6fd84e 556ff9a8 00000000 00000000 00000000 ntdll!ZwDelayExecution+0x0
556ff980 471ba07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0
556ff9b0 cd887034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
556ff9e0 cdb7d0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
556ffa60 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 14864 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 109494776.000000
- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=00000000557ff5d0 rsi=0000000000000000 rdi=000000000000000d
r8=00000000557ff278 r9=00000000677e97c0 r10=0000000000000000 r11=0000000000000246 r12=0000000000000064 r13=00000000557ff5d0
r14=00000000557ff2d0 r15=0000000000000000 rip=00000000cdbccb04 rsp=00000000557ff278 rbp=00000000677e97c0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
557ff270 cb700d40 00000000 00000000 00000000 00000000 ntdll!NtWaitForMultipleObjects+0x0
557ff560 cb700c3e 00000000 004e0049 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
557ff5a0 6bfab8d4 677ecee0 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0
557ff7e0 6c04076d 00000000 00000004 00000000 00000000 nvcuda64!+0x0
557ff890 6bfab2a3 664071fa 6315fa12 6811cac0 00000000 nvcuda64!cuProfilerStop+0x0
557ff8c0 6c2b8de0 6811cac0 00000000 00000000 00000000 nvcuda64!+0x0
557ff8f0 cd887034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
557ff920 cdb7d0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
557ff9a0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 9732 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 109494488.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=0000000000000294 rdx=0000000000000000 rsi=0000000000000000 rdi=0000000000000294
r8=0000000000000002 r9=00000000558ff5e8 r10=0000000000000000 r11=0000000000000246 r12=00000000677d1ff0 r13=0000000000000000
r14=0000000000000294 r15=0000000000000000 rip=00000000cdbcc034 rsp=00000000558ff7e8 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
558ff7e0 cb6ca34e 6811ce50 6be00000 00000001 00000288 ntdll!NtWaitForSingleObject+0x0
558ff880 6c1ba5f8 00000000 00000000 00000000 00000294 KERNELBASE!WaitForSingleObjectEx+0x0
558ff8f0 6bfab2a3 00000001 67c3eef0 6811ce50 00000000 nvcuda64!cuProfilerStop+0x0
558ff920 6c2b8de0 6811ce50 00000000 00000000 00000000 nvcuda64!+0x0
558ff950 cd887034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
558ff980 cdb7d0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
558ffa00 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 19348 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 109494752.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=0000000067a69258 rdx=00000000559ff6f8 rsi=00000000559ff660 rdi=0000000000000000
r8=00000000559ff638 r9=00000000559ff690 r10=0000000000000000 r11=0000000000000246 r12=00000000559ff6f8 r13=0000000000000000
r14=0000000067a69258 r15=0000000067a6d9d8 rip=00000000cdbcf9a4 rsp=00000000559ff638 rbp=00000000559ff690
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
559ff630 cdb954f5 00000102 00000102 00000000 559ff660 ntdll!NtWaitForAlertByThreadId+0x0
559ff6a0 cb71b9d9 67a6b1c0 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0
559ff6d0 6bf3209a 67a6b1c0 67a6b1c0 67a6b1c0 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0
559ff730 6bfab2a3 00000004 65c072c2 665a6222 00000000 nvcuda64!+0x0
559ff760 6c2b8de0 6811d390 00000000 00000000 00000000 nvcuda64!+0x0
559ff790 cd887034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
559ff7c0 cdb7d0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
559ff840 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)