Task 5759402
| Name | ParityMachine-1625097662-27948-2_0 |
| Workunit | 3590303 |
| Created | 10 Jul 2021, 17:46:29 UTC |
| Sent | 17 Jul 2021, 23:05:43 UTC |
| Report deadline | 24 Jul 2021, 23:05:43 UTC |
| Received | 18 Jul 2021, 0:54:28 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | -529697949 (0xE06D7363) Unknown error code |
| Computer ID | 9955 |
| Run time | 1 hours 46 min 55 sec |
| CPU time | 1 hours 45 min 16 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 1,883.38 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.64 GB |
| Peak swap size | 3.60 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
7-18 02:39:12 main:574] : INFO : Epoch 1554 | loss: 0.0311273 | val_loss: 0.0311458 | Time: 3542.13 ms
[2021-07-18 02:39:16 main:574] : INFO : Epoch 1555 | loss: 0.0311328 | val_loss: 0.0311439 | Time: 3667.09 ms
[2021-07-18 02:39:19 main:574] : INFO : Epoch 1556 | loss: 0.0311308 | val_loss: 0.0311444 | Time: 3625.27 ms
[2021-07-18 02:39:23 main:574] : INFO : Epoch 1557 | loss: 0.0311288 | val_loss: 0.0311448 | Time: 3610.64 ms
[2021-07-18 02:39:27 main:574] : INFO : Epoch 1558 | loss: 0.0311291 | val_loss: 0.031146 | Time: 3518.71 ms
[2021-07-18 02:39:30 main:574] : INFO : Epoch 1559 | loss: 0.0311285 | val_loss: 0.0311396 | Time: 3470.99 ms
[2021-07-18 02:39:34 main:574] : INFO : Epoch 1560 | loss: 0.0311259 | val_loss: 0.0311372 | Time: 3449.19 ms
[2021-07-18 02:39:37 main:574] : INFO : Epoch 1561 | loss: 0.0311251 | val_loss: 0.0311368 | Time: 3652.35 ms
[2021-07-18 02:39:41 main:574] : INFO : Epoch 1562 | loss: 0.0311267 | val_loss: 0.0311498 | Time: 3535.07 ms
[2021-07-18 02:39:45 main:574] : INFO : Epoch 1563 | loss: 0.0311289 | val_loss: 0.0311397 | Time: 3822.62 ms
[2021-07-18 02:39:48 main:574] : INFO : Epoch 1564 | loss: 0.0311279 | val_loss: 0.0311373 | Time: 3544.53 ms
[2021-07-18 02:39:52 main:574] : INFO : Epoch 1565 | loss: 0.0311275 | val_loss: 0.0311377 | Time: 3670.94 ms
[2021-07-18 02:39:55 main:574] : INFO : Epoch 1566 | loss: 0.0311273 | val_loss: 0.0311401 | Time: 3629.48 ms
[2021-07-18 02:39:59 main:574] : INFO : Epoch 1567 | loss: 0.0311266 | val_loss: 0.0311414 | Time: 3544.17 ms
[2021-07-18 02:40:03 main:574] : INFO : Epoch 1568 | loss: 0.0311267 | val_loss: 0.0311379 | Time: 3555.07 ms
[2021-07-18 02:40:06 main:574] : INFO : Epoch 1569 | loss: 0.0311287 | val_loss: 0.0311462 | Time: 3654.46 ms
[2021-07-18 02:40:10 main:574] : INFO : Epoch 1570 | loss: 0.031126 | val_loss: 0.0311399 | Time: 3497.92 ms
[2021-07-18 02:40:13 main:574] : INFO : Epoch 1571 | loss: 0.0311245 | val_loss: 0.0311372 | Time: 3653.45 ms
[2021-07-18 02:40:17 main:574] : INFO : Epoch 1572 | loss: 0.031124 | val_loss: 0.0311402 | Time: 3631.69 ms
[2021-07-18 02:40:21 main:574] : INFO : Epoch 1573 | loss: 0.0311252 | val_loss: 0.0311389 | Time: 3545.66 ms
[2021-07-18 02:40:24 main:574] : INFO : Epoch 1574 | loss: 0.0311289 | val_loss: 0.0311382 | Time: 3476.16 ms
[2021-07-18 02:40:28 main:574] : INFO : Epoch 1575 | loss: 0.0311298 | val_loss: 0.0311392 | Time: 3511.98 ms
[2021-07-18 02:40:31 main:574] : INFO : Epoch 1576 | loss: 0.03113 | val_loss: 0.0311386 | Time: 3542.79 ms
[2021-07-18 02:40:35 main:574] : INFO : Epoch 1577 | loss: 0.0311303 | val_loss: 0.0311402 | Time: 3562.53 ms
[2021-07-18 02:40:38 main:574] : INFO : Epoch 1578 | loss: 0.0311281 | val_loss: 0.0311373 | Time: 3551.87 ms
[2021-07-18 02:40:42 main:574] : INFO : Epoch 1579 | loss: 0.031127 | val_loss: 0.0311403 | Time: 3623.34 ms
[2021-07-18 02:40:46 main:574] : INFO : Epoch 1580 | loss: 0.0311253 | val_loss: 0.0311399 | Time: 3658.74 ms
[2021-07-18 02:40:49 main:574] : INFO : Epoch 1581 | loss: 0.0311287 | val_loss: 0.0311463 | Time: 3491.52 ms
[2021-07-18 02:40:53 main:574] : INFO : Epoch 1582 | loss: 0.0311283 | val_loss: 0.03114 | Time: 3454.22 ms
[2021-07-18 02:40:56 main:574] : INFO : Epoch 1583 | loss: 0.0311308 | val_loss: 0.0311412 | Time: 3606.65 ms
[2021-07-18 02:41:00 main:574] : INFO : Epoch 1584 | loss: 0.0311284 | val_loss: 0.0311407 | Time: 3524.51 ms
[2021-07-18 02:41:03 main:574] : INFO : Epoch 1585 | loss: 0.0311337 | val_loss: 0.0311588 | Time: 3513.5 ms
[2021-07-18 02:41:07 main:574] : INFO : Epoch 1586 | loss: 0.031139 | val_loss: 0.0311445 | Time: 3525.5 ms
[2021-07-18 02:41:10 main:574] : INFO : Epoch 1587 | loss: 0.0311367 | val_loss: 0.0311459 | Time: 3535.68 ms
[2021-07-18 02:41:14 main:574] : INFO : Epoch 1588 | loss: 0.0311371 | val_loss: 0.0311476 | Time: 3566.59 ms
[2021-07-18 02:41:17 main:574] : INFO : Epoch 1589 | loss: 0.0311308 | val_loss: 0.0311416 | Time: 3547.86 ms
[2021-07-18 02:41:21 main:574] : INFO : Epoch 1590 | loss: 0.0311267 | val_loss: 0.0311454 | Time: 3560.82 ms
[2021-07-18 02:41:25 main:574] : INFO : Epoch 1591 | loss: 0.0311276 | val_loss: 0.0311417 | Time: 3530.12 ms
[2021-07-18 02:41:28 main:574] : INFO : Epoch 1592 | loss: 0.0311258 | val_loss: 0.03114 | Time: 3589.97 ms
[2021-07-18 02:41:32 main:574] : INFO : Epoch 1593 | loss: 0.0311283 | val_loss: 0.0311426 | Time: 3550.81 ms
[2021-07-18 02:41:35 main:574] : INFO : Epoch 1594 | loss: 0.0311286 | val_loss: 0.0311425 | Time: 3512.33 ms
[2021-07-18 02:41:39 main:574] : INFO : Epoch 1595 | loss: 0.0311322 | val_loss: 0.0311388 | Time: 3613.7 ms
[2021-07-18 02:41:42 main:574] : INFO : Epoch 1596 | loss: 0.0311291 | val_loss: 0.031141 | Time: 3571.75 ms
[2021-07-18 02:41:46 main:574] : INFO : Epoch 1597 | loss: 0.0311282 | val_loss: 0.0311417 | Time: 3613.59 ms
[2021-07-18 02:41:50 main:574] : INFO : Epoch 1598 | loss: 0.0311275 | val_loss: 0.0311425 | Time: 3481.57 ms
[2021-07-18 02:41:53 main:574] : INFO : Epoch 1599 | loss: 0.0311259 | val_loss: 0.0311461 | Time: 3561.71 ms
[2021-07-18 02:41:57 main:574] : INFO : Epoch 1600 | loss: 0.031127 | val_loss: 0.0311428 | Time: 3500 ms
[2021-07-18 02:42:00 main:574] : INFO : Epoch 1601 | loss: 0.0311306 | val_loss: 0.0311512 | Time: 3562.35 ms
[2021-07-18 02:42:04 main:574] : INFO : Epoch 1602 | loss: 0.0311298 | val_loss: 0.0311406 | Time: 3502.78 ms
[2021-07-18 02:42:07 main:574] : INFO : Epoch 1603 | loss: 0.0311289 | val_loss: 0.0311405 | Time: 3457.91 ms
[2021-07-18 02:42:11 main:574] : INFO : Epoch 1604 | loss: 0.0311283 | val_loss: 0.0311462 | Time: 3527.38 ms
[2021-07-18 02:42:14 main:574] : INFO : Epoch 1605 | loss: 0.0311253 | val_loss: 0.0311394 | Time: 3604.42 ms
[2021-07-18 02:42:18 main:574] : INFO : Epoch 1606 | loss: 0.0311249 | val_loss: 0.031146 | Time: 3547.12 ms
[2021-07-18 02:42:21 main:574] : INFO : Epoch 1607 | loss: 0.031126 | val_loss: 0.0311405 | Time: 3537.22 ms
[2021-07-18 02:42:25 main:574] : INFO : Epoch 1608 | loss: 0.0311258 | val_loss: 0.0311455 | Time: 3427.72 ms
[2021-07-18 02:42:28 main:574] : INFO : Epoch 1609 | loss: 0.0311288 | val_loss: 0.0311485 | Time: 3545.59 ms
[2021-07-18 02:42:32 main:574] : INFO : Epoch 1610 | loss: 0.0311314 | val_loss: 0.0311436 | Time: 3530.03 ms
[2021-07-18 02:42:36 main:574] : INFO : Epoch 1611 | loss: 0.0311276 | val_loss: 0.0311421 | Time: 3498.02 ms
[2021-07-18 02:42:39 main:574] : INFO : Epoch 1612 | loss: 0.0311252 | val_loss: 0.0311421 | Time: 3558.08 ms
[2021-07-18 02:42:43 main:574] : INFO : Epoch 1613 | loss: 0.0311255 | val_loss: 0.0311432 | Time: 3604.76 ms
[2021-07-18 02:42:46 main:574] : INFO : Epoch 1614 | loss: 0.031125 | val_loss: 0.031146 | Time: 3535.25 ms
[2021-07-18 02:42:50 main:574] : INFO : Epoch 1615 | loss: 0.0311394 | val_loss: 0.0311517 | Time: 3578 ms
[2021-07-18 02:42:53 main:574] : INFO : Epoch 1616 | loss: 0.0311419 | val_loss: 0.0311468 | Time: 3564.11 ms
[2021-07-18 02:42:57 main:574] : INFO : Epoch 1617 | loss: 0.0311378 | val_loss: 0.0311448 | Time: 3557.03 ms
[2021-07-18 02:43:01 main:574] : INFO : Epoch 1618 | loss: 0.0311364 | val_loss: 0.0311442 | Time: 3561.71 ms
[2021-07-18 02:43:04 main:574] : INFO : Epoch 1619 | loss: 0.0311338 | val_loss: 0.0311454 | Time: 3530.99 ms
[2021-07-18 02:43:08 main:574] : INFO : Epoch 1620 | loss: 0.0311364 | val_loss: 0.0311449 | Time: 3514.22 ms
[2021-07-18 02:43:11 main:574] : INFO : Epoch 1621 | loss: 0.0311379 | val_loss: 0.0311416 | Time: 3550.75 ms
[2021-07-18 02:43:15 main:574] : INFO : Epoch 1622 | loss: 0.0311301 | val_loss: 0.03114 | Time: 3503.78 ms
[2021-07-18 02:43:18 main:574] : INFO : Epoch 1623 | loss: 0.0311292 | val_loss: 0.0311463 | Time: 3466.35 ms
[2021-07-18 02:43:22 main:574] : INFO : Epoch 1624 | loss: 0.0311301 | val_loss: 0.0311399 | Time: 3535.39 ms
[2021-07-18 02:43:25 main:574] : INFO : Epoch 1625 | loss: 0.0311287 | val_loss: 0.0311404 | Time: 3657.72 ms
[2021-07-18 02:43:29 main:574] : INFO : Epoch 1626 | loss: 0.0311275 | val_loss: 0.0311399 | Time: 3667.6 ms
[2021-07-18 02:43:33 main:574] : INFO : Epoch 1627 | loss: 0.0311271 | val_loss: 0.03114 | Time: 3623.99 ms
[2021-07-18 02:43:36 main:574] : INFO : Epoch 1628 | loss: 0.0311275 | val_loss: 0.0311387 | Time: 3560.02 ms
[2021-07-18 02:43:40 main:574] : INFO : Epoch 1629 | loss: 0.0311269 | val_loss: 0.031141 | Time: 3658.47 ms
[2021-07-18 02:43:44 main:574] : INFO : Epoch 1630 | loss: 0.0311282 | val_loss: 0.0311508 | Time: 3655.46 ms
[2021-07-18 02:43:47 main:574] : INFO : Epoch 1631 | loss: 0.0311302 | val_loss: 0.0311383 | Time: 3525.9 ms
[2021-07-18 02:43:51 main:574] : INFO : Epoch 1632 | loss: 0.0311273 | val_loss: 0.0311388 | Time: 3626.73 ms
[2021-07-18 02:43:54 main:574] : INFO : Epoch 1633 | loss: 0.0311291 | val_loss: 0.0311421 | Time: 3620.58 ms
[2021-07-18 02:43:58 main:574] : INFO : Epoch 1634 | loss: 0.0311293 | val_loss: 0.0311397 | Time: 3704.08 ms
[2021-07-18 02:44:02 main:574] : INFO : Epoch 1635 | loss: 0.0311274 | val_loss: 0.0311471 | Time: 3496.24 ms
[2021-07-18 02:44:05 main:574] : INFO : Epoch 1636 | loss: 0.0311304 | val_loss: 0.03114 | Time: 3559.61 ms
[2021-07-18 02:44:09 main:574] : INFO : Epoch 1637 | loss: 0.0311268 | val_loss: 0.0311407 | Time: 3471.51 ms
[2021-07-18 02:44:12 main:574] : INFO : Epoch 1638 | loss: 0.0311247 | val_loss: 0.0311429 | Time: 3513.68 ms
[2021-07-18 02:44:16 main:574] : INFO : Epoch 1639 | loss: 0.0311239 | val_loss: 0.031138 | Time: 3529.14 ms
[2021-07-18 02:44:19 main:574] : INFO : Epoch 1640 | loss: 0.031124 | val_loss: 0.0311454 | Time: 3614.31 ms
[2021-07-18 02:44:23 main:574] : INFO : Epoch 1641 | loss: 0.0311239 | val_loss: 0.0311419 | Time: 3527.34 ms
[2021-07-18 02:44:27 main:574] : INFO : Epoch 1642 | loss: 0.0311243 | val_loss: 0.0311409 | Time: 3563.45 ms
[2021-07-18 02:44:30 main:574] : INFO : Epoch 1643 | loss: 0.0311275 | val_loss: 0.0311415 | Time: 3647.24 ms
[2021-07-18 02:44:34 main:574] : INFO : Epoch 1644 | loss: 0.0311284 | val_loss: 0.0311406 | Time: 3514.62 ms
[2021-07-18 02:44:37 main:574] : INFO : Epoch 1645 | loss: 0.0311269 | val_loss: 0.0311426 | Time: 3446.55 ms
[2021-07-18 02:44:41 main:574] : INFO : Epoch 1646 | loss: 0.0311289 | val_loss: 0.0311408 | Time: 3558.69 ms
[2021-07-18 02:44:44 main:574] : INFO : Epoch 1647 | loss: 0.0311292 | val_loss: 0.0311394 | Time: 3657.63 ms
[2021-07-18 02:44:48 main:574] : INFO : Epoch 1648 | loss: 0.031126 | val_loss: 0.0311395 | Time: 3519.23 ms
[2021-07-18 02:44:52 main:574] : INFO : Epoch 1649 | loss: 0.0311299 | val_loss: 0.0311544 | Time: 3544.8 ms
[2021-07-18 02:44:55 main:574] : INFO : Epoch 1650 | loss: 0.0311312 | val_loss: 0.0311466 | Time: 3544.16 ms
[2021-07-18 02:44:59 main:574] : INFO : Epoch 1651 | loss: 0.0311272 | val_loss: 0.0311424 | Time: 3590.14 ms
[2021-07-18 02:45:02 main:574] : INFO : Epoch 1652 | loss: 0.0311274 | val_loss: 0.0311438 | Time: 3567.72 ms
[2021-07-18 02:45:06 main:574] : INFO : Epoch 1653 | loss: 0.0311298 | val_loss: 0.031139 | Time: 3501.25 ms
[2021-07-18 02:45:09 main:574] : INFO : Epoch 1654 | loss: 0.0311248 | val_loss: 0.0311378 | Time: 3516.99 ms
[2021-07-18 02:45:13 main:574] : INFO : Epoch 1655 | loss: 0.0311244 | val_loss: 0.0311427 | Time: 3506.01 ms
[2021-07-18 02:45:16 main:574] : INFO : Epoch 1656 | loss: 0.0311238 | val_loss: 0.0311389 | Time: 3538.97 ms
[2021-07-18 02:45:20 main:574] : INFO : Epoch 1657 | loss: 0.0311224 | val_loss: 0.0311379 | Time: 3512.94 ms
[2021-07-18 02:45:23 main:574] : INFO : Epoch 1658 | loss: 0.0311219 | val_loss: 0.0311384 | Time: 3522.37 ms
[2021-07-18 02:45:27 main:574] : INFO : Epoch 1659 | loss: 0.031121 | val_loss: 0.0311402 | Time: 3598.18 ms
[2021-07-18 02:45:31 main:574] : INFO : Epoch 1660 | loss: 0.0311229 | val_loss: 0.0311371 | Time: 3628.16 ms
[2021-07-18 02:45:34 main:574] : INFO : Epoch 1661 | loss: 0.0311257 | val_loss: 0.0311471 | Time: 3607.71 ms
[2021-07-18 02:45:38 main:574] : INFO : Epoch 1662 | loss: 0.0311259 | val_loss: 0.0311418 | Time: 3649.14 ms
[2021-07-18 02:45:42 main:574] : INFO : Epoch 1663 | loss: 0.0311235 | val_loss: 0.0311438 | Time: 3618.77 ms
[2021-07-18 02:45:45 main:574] : INFO : Epoch 1664 | loss: 0.0311242 | val_loss: 0.0311456 | Time: 3635.64 ms
[2021-07-18 02:45:49 main:574] : INFO : Epoch 1665 | loss: 0.0311257 | val_loss: 0.0311495 | Time: 3543.33 ms
[2021-07-18 02:45:52 main:574] : INFO : Epoch 1666 | loss: 0.0311255 | val_loss: 0.0311397 | Time: 3470.1 ms
[2021-07-18 02:45:56 main:574] : INFO : Epoch 1667 | loss: 0.0311245 | val_loss: 0.0311421 | Time: 3682.62 ms
[2021-07-18 02:46:00 main:574] : INFO : Epoch 1668 | loss: 0.0311262 | val_loss: 0.0311415 | Time: 3716.77 ms
[2021-07-18 02:46:03 main:574] : INFO : Epoch 1669 | loss: 0.0311247 | val_loss: 0.0311463 | Time: 3620.35 ms
[2021-07-18 02:46:07 main:574] : INFO : Epoch 1670 | loss: 0.0311262 | val_loss: 0.0311444 | Time: 3652.36 ms
[2021-07-18 02:46:11 main:574] : INFO : Epoch 1671 | loss: 0.0311278 | val_loss: 0.0311431 | Time: 3615.03 ms
[2021-07-18 02:46:14 main:574] : INFO : Epoch 1672 | loss: 0.0311286 | val_loss: 0.0311498 | Time: 3556.83 ms
[2021-07-18 02:46:18 main:574] : INFO : Epoch 1673 | loss: 0.0311359 | val_loss: 0.0311457 | Time: 3567.4 ms
[2021-07-18 02:46:21 main:574] : INFO : Epoch 1674 | loss: 0.0311333 | val_loss: 0.0311489 | Time: 3606.8 ms
[2021-07-18 02:46:25 main:574] : INFO : Epoch 1675 | loss: 0.0311307 | val_loss: 0.0311474 | Time: 3511.53 ms
[2021-07-18 02:46:28 main:574] : INFO : Epoch 1676 | loss: 0.0311285 | val_loss: 0.0311497 | Time: 3523.07 ms
[2021-07-18 02:46:32 main:574] : INFO : Epoch 1677 | loss: 0.0311274 | val_loss: 0.0311488 | Time: 3529.26 ms
[2021-07-18 02:46:35 main:574] : INFO : Epoch 1678 | loss: 0.0311288 | val_loss: 0.0311472 | Time: 3419.79 ms
[2021-07-18 02:46:39 main:574] : INFO : Epoch 1679 | loss: 0.0311288 | val_loss: 0.0311453 | Time: 3543.89 ms
[2021-07-18 02:46:43 main:574] : INFO : Epoch 1680 | loss: 0.0311292 | val_loss: 0.0311479 | Time: 3584.31 ms
[2021-07-18 02:46:46 main:574] : INFO : Epoch 1681 | loss: 0.0311292 | val_loss: 0.0311494 | Time: 3525.21 ms
[2021-07-18 02:46:50 main:574] : INFO : Epoch 1682 | loss: 0.0311266 | val_loss: 0.0311446 | Time: 3511.34 ms
[2021-07-18 02:46:53 main:574] : INFO : Epoch 1683 | loss: 0.0311251 | val_loss: 0.0311429 | Time: 3608.84 ms
[2021-07-18 02:46:57 main:574] : INFO : Epoch 1684 | loss: 0.0311275 | val_loss: 0.0311486 | Time: 3549 ms
[2021-07-18 02:47:00 main:574] : INFO : Epoch 1685 | loss: 0.0311292 | val_loss: 0.0311533 | Time: 3647.07 ms
[2021-07-18 02:47:04 main:574] : INFO : Epoch 1686 | loss: 0.0311287 | val_loss: 0.0311433 | Time: 3569.73 ms
[2021-07-18 02:47:08 main:574] : INFO : Epoch 1687 | loss: 0.0311236 | val_loss: 0.031144 | Time: 3680.73 ms
[2021-07-18 02:47:11 main:574] : INFO : Epoch 1688 | loss: 0.0311224 | val_loss: 0.0311413 | Time: 3604.38 ms
[2021-07-18 02:47:15 main:574] : INFO : Epoch 1689 | loss: 0.0311237 | val_loss: 0.0311426 | Time: 3600.81 ms
[2021-07-18 02:47:18 main:574] : INFO : Epoch 1690 | loss: 0.031122 | val_loss: 0.0311473 | Time: 3535.61 ms
[2021-07-18 02:47:22 main:574] : INFO : Epoch 1691 | loss: 0.0311227 | val_loss: 0.0311452 | Time: 3560.67 ms
[2021-07-18 02:47:26 main:574] : INFO : Epoch 1692 | loss: 0.0311212 | val_loss: 0.0311442 | Time: 3485.21 ms
[2021-07-18 02:47:29 main:574] : INFO : Epoch 1693 | loss: 0.0311213 | val_loss: 0.0311452 | Time: 3627.4 ms
[2021-07-18 02:47:33 main:574] : INFO : Epoch 1694 | loss: 0.0311229 | val_loss: 0.0311436 | Time: 3583.52 ms
[2021-07-18 02:47:36 main:574] : INFO : Epoch 1695 | loss: 0.0311243 | val_loss: 0.0311457 | Time: 3667.01 ms
[2021-07-18 02:47:40 main:574] : INFO : Epoch 1696 | loss: 0.0311245 | val_loss: 0.0311441 | Time: 3538.33 ms
[2021-07-18 02:47:44 main:574] : INFO : Epoch 1697 | loss: 0.0311201 | val_loss: 0.0311422 | Time: 3624.44 ms
[2021-07-18 02:47:47 main:574] : INFO : Epoch 1698 | loss: 0.0311195 | val_loss: 0.0311439 | Time: 3628.24 ms
[2021-07-18 02:47:51 main:574] : INFO : Epoch 1699 | loss: 0.0311196 | val_loss: 0.0311416 | Time: 3704.2 ms
[2021-07-18 02:47:55 main:574] : INFO : Epoch 1700 | loss: 0.0311198 | val_loss: 0.0311434 | Time: 3622.48 ms
[2021-07-18 02:47:58 main:574] : INFO : Epoch 1701 | loss: 0.0311208 | val_loss: 0.0311441 | Time: 3476.41 ms
[2021-07-18 02:48:02 main:574] : INFO : Epoch 1702 | loss: 0.0311232 | val_loss: 0.031148 | Time: 3538.66 ms
[2021-07-18 02:48:05 main:574] : INFO : Epoch 1703 | loss: 0.0311235 | val_loss: 0.0311418 | Time: 3471.66 ms
[2021-07-18 02:48:09 main:574] : INFO : Epoch 1704 | loss: 0.0311216 | val_loss: 0.0311422 | Time: 3647.66 ms
[2021-07-18 02:48:12 main:574] : INFO : Epoch 1705 | loss: 0.0311201 | val_loss: 0.0311403 | Time: 3549.37 ms
[2021-07-18 02:48:16 main:574] : INFO : Epoch 1706 | loss: 0.0311197 | val_loss: 0.0311361 | Time: 3765.41 ms
[2021-07-18 02:48:20 main:574] : INFO : Epoch 1707 | loss: 0.0311186 | val_loss: 0.0311348 | Time: 3641.94 ms
[2021-07-18 02:48:23 main:574] : INFO : Epoch 1708 | loss: 0.0311212 | val_loss: 0.0311404 | Time: 3649.84 ms
[2021-07-18 02:48:27 main:574] : INFO : Epoch 1709 | loss: 0.0311252 | val_loss: 0.0311393 | Time: 3596.56 ms
[2021-07-18 02:48:31 main:574] : INFO : Epoch 1710 | loss: 0.0311218 | val_loss: 0.031136 | Time: 3517.15 ms
[2021-07-18 02:48:34 main:574] : INFO : Epoch 1711 | loss: 0.0311197 | val_loss: 0.0311367 | Time: 3532.26 ms
[2021-07-18 02:48:38 main:574] : INFO : Epoch 1712 | loss: 0.0311194 | val_loss: 0.031135 | Time: 3589.06 ms
[2021-07-18 02:48:41 main:574] : INFO : Epoch 1713 | loss: 0.031117 | val_loss: 0.0311361 | Time: 3706.18 ms
[2021-07-18 02:48:45 main:574] : INFO : Epoch 1714 | loss: 0.0311168 | val_loss: 0.0311388 | Time: 3734.53 ms
[2021-07-18 02:48:49 main:574] : INFO : Epoch 1715 | loss: 0.0311214 | val_loss: 0.0311388 | Time: 3447.64 ms
[2021-07-18 02:48:52 main:574] : INFO : Epoch 1716 | loss: 0.03112 | val_loss: 0.0311374 | Time: 3496.85 ms
[2021-07-18 02:48:56 main:574] : INFO : Epoch 1717 | loss: 0.0311188 | val_loss: 0.0311366 | Time: 3566.76 ms
[2021-07-18 02:48:59 main:574] : INFO : Epoch 1718 | loss: 0.0311188 | val_loss: 0.0311369 | Time: 3681.31 ms
[2021-07-18 02:49:03 main:574] : INFO : Epoch 1719 | loss: 0.0311169 | val_loss: 0.0311354 | Time: 3531.18 ms
[2021-07-18 02:49:07 main:574] : INFO : Epoch 1720 | loss: 0.0311206 | val_loss: 0.0311392 | Time: 3532.06 ms
[2021-07-18 02:49:10 main:574] : INFO : Epoch 1721 | loss: 0.0311239 | val_loss: 0.0311428 | Time: 3749.25 ms
[2021-07-18 02:49:14 main:574] : INFO : Epoch 1722 | loss: 0.0311207 | val_loss: 0.0311335 | Time: 3659.65 ms
[2021-07-18 02:49:17 main:574] : INFO : Epoch 1723 | loss: 0.0311169 | val_loss: 0.0311346 | Time: 3512.77 ms
[2021-07-18 02:49:21 main:574] : INFO : Epoch 1724 | loss: 0.031117 | val_loss: 0.0311364 | Time: 3643.01 ms
[2021-07-18 02:49:25 main:574] : INFO : Epoch 1725 | loss: 0.0311175 | val_loss: 0.0311361 | Time: 3599.4 ms
[2021-07-18 02:49:28 main:574] : INFO : Epoch 1726 | loss: 0.0311158 | val_loss: 0.0311351 | Time: 3594.82 ms
[2021-07-18 02:49:32 main:574] : INFO : Epoch 1727 | loss: 0.0311171 | val_loss: 0.0311431 | Time: 3512.49 ms
[2021-07-18 02:49:35 main:574] : INFO : Epoch 1728 | loss: 0.0311152 | val_loss: 0.031134 | Time: 3513.4 ms
[2021-07-18 02:49:39 main:574] : INFO : Epoch 1729 | loss: 0.0311148 | val_loss: 0.031136 | Time: 3543.62 ms
[2021-07-18 02:49:43 main:574] : INFO : Epoch 1730 | loss: 0.0311162 | val_loss: 0.0311386 | Time: 3578.24 ms
[2021-07-18 02:49:46 main:574] : INFO : Epoch 1731 | loss: 0.031117 | val_loss: 0.0311326 | Time: 3582.77 ms
[2021-07-18 02:49:50 main:574] : INFO : Epoch 1732 | loss: 0.0311176 | val_loss: 0.0311367 | Time: 3571.14 ms
[2021-07-18 02:49:53 main:574] : INFO : Epoch 1733 | loss: 0.0311132 | val_loss: 0.0311346 | Time: 3545.78 ms
[2021-07-18 02:49:57 main:574] : INFO : Epoch 1734 | loss: 0.0311133 | val_loss: 0.0311405 | Time: 3520.42 ms
[2021-07-18 02:50:00 main:574] : INFO : Epoch 1735 | loss: 0.0311149 | val_loss: 0.0311321 | Time: 3472.45 ms
[2021-07-18 02:50:04 main:574] : INFO : Epoch 1736 | loss: 0.0311151 | val_loss: 0.0311385 | Time: 3593.08 ms
[2021-07-18 02:50:07 main:574] : INFO : Epoch 1737 | loss: 0.0311164 | val_loss: 0.0311349 | Time: 3551.99 ms
[2021-07-18 02:50:11 main:574] : INFO : Epoch 1738 | loss: 0.0311136 | val_loss: 0.031132 | Time: 3766.24 ms
[2021-07-18 02:50:15 main:574] : INFO : Epoch 1739 | loss: 0.0311147 | val_loss: 0.0311329 | Time: 3494.82 ms
[2021-07-18 02:50:18 main:574] : INFO : Epoch 1740 | loss: 0.0311163 | val_loss: 0.0311337 | Time: 3517.04 ms
[2021-07-18 02:50:22 main:574] : INFO : Epoch 1741 | loss: 0.0311169 | val_loss: 0.0311329 | Time: 3736.76 ms
[2021-07-18 02:50:26 main:574] : INFO : Epoch 1742 | loss: 0.0311158 | val_loss: 0.0311362 | Time: 3608.63 ms
[2021-07-18 02:50:29 main:574] : INFO : Epoch 1743 | loss: 0.0311217 | val_loss: 0.0311411 | Time: 3576.03 ms
[2021-07-18 02:50:33 main:574] : INFO : Epoch 1744 | loss: 0.0311203 | val_loss: 0.0311363 | Time: 3510.15 ms
[2021-07-18 02:50:36 main:574] : INFO : Epoch 1745 | loss: 0.031117 | val_loss: 0.0311309 | Time: 3528.74 ms
[2021-07-18 02:50:40 main:574] : INFO : Epoch 1746 | loss: 0.0311162 | val_loss: 0.0311329 | Time: 3587.2 ms
[2021-07-18 02:50:43 main:574] : INFO : Epoch 1747 | loss: 0.0311153 | val_loss: 0.0311364 | Time: 3446.04 ms
[2021-07-18 02:50:47 main:574] : INFO : Epoch 1748 | loss: 0.0311142 | val_loss: 0.0311358 | Time: 3551.52 ms
[2021-07-18 02:50:50 main:574] : INFO : Epoch 1749 | loss: 0.0311139 | val_loss: 0.0311339 | Time: 3493.36 ms
[2021-07-18 02:50:54 main:574] : INFO : Epoch 1750 | loss: 0.0311148 | val_loss: 0.0311301 | Time: 3607.74 ms
[2021-07-18 02:50:58 main:574] : INFO : Epoch 1751 | loss: 0.0311139 | val_loss: 0.0311307 | Time: 3604.17 ms
[2021-07-18 02:51:01 main:574] : INFO : Epoch 1752 | loss: 0.0311124 | val_loss: 0.0311299 | Time: 3591.92 ms
[2021-07-18 02:51:05 main:574] : INFO : Epoch 1753 | loss: 0.0311136 | val_loss: 0.0311347 | Time: 3518.89 ms
[2021-07-18 02:51:08 main:574] : INFO : Epoch 1754 | loss: 0.0311165 | val_loss: 0.0311424 | Time: 3639.83 ms
[2021-07-18 02:51:12 main:574] : INFO : Epoch 1755 | loss: 0.031114 | val_loss: 0.0311346 | Time: 3704.42 ms
[2021-07-18 02:51:16 main:574] : INFO : Epoch 1756 | loss: 0.0311121 | val_loss: 0.0311397 | Time: 3774.55 ms
[2021-07-18 02:51:20 main:574] : INFO : Epoch 1757 | loss: 0.0311134 | val_loss: 0.0311356 | Time: 3588.72 ms
[2021-07-18 02:51:23 main:574] : INFO : Epoch 1758 | loss: 0.0311151 | val_loss: 0.0311354 | Time: 3701.97 ms
[2021-07-18 02:51:27 main:574] : INFO : Epoch 1759 | loss: 0.0311146 | val_loss: 0.0311332 | Time: 3600.23 ms
[2021-07-18 02:51:31 main:574] : INFO : Epoch 1760 | loss: 0.0311157 | val_loss: 0.0311357 | Time: 3643.57 ms
[2021-07-18 02:51:34 main:574] : INFO : Epoch 1761 | loss: 0.031116 | val_loss: 0.031137 | Time: 3573 ms
[2021-07-18 02:51:38 main:574] : INFO : Epoch 1762 | loss: 0.0311159 | val_loss: 0.0311403 | Time: 3541.85 ms
[2021-07-18 02:51:41 main:574] : INFO : Epoch 1763 | loss: 0.031117 | val_loss: 0.0311429 | Time: 3602.48 ms
[2021-07-18 02:51:45 main:574] : INFO : Epoch 1764 | loss: 0.0311213 | val_loss: 0.0311489 | Time: 3685.91 ms
[2021-07-18 02:51:49 main:574] : INFO : Epoch 1765 | loss: 0.0311242 | val_loss: 0.0311406 | Time: 3590.71 ms
[2021-07-18 02:51:52 main:574] : INFO : Epoch 1766 | loss: 0.0311175 | val_loss: 0.031138 | Time: 3694.52 ms
[2021-07-18 02:51:56 main:574] : INFO : Epoch 1767 | loss: 0.0311176 | val_loss: 0.0311402 | Time: 3663.62 ms
[2021-07-18 02:52:00 main:574] : INFO : Epoch 1768 | loss: 0.0311155 | val_loss: 0.03114 | Time: 3606.22 ms
[2021-07-18 02:52:03 main:574] : INFO : Epoch 1769 | loss: 0.0311145 | val_loss: 0.031138 | Time: 3572 ms
[2021-07-18 02:52:07 main:574] : INFO : Epoch 1770 | loss: 0.0311143 | val_loss: 0.0311411 | Time: 3592.27 ms
[2021-07-18 02:52:10 main:574] : INFO : Epoch 1771 | loss: 0.0311148 | val_loss: 0.0311429 | Time: 3609.53 ms
[2021-07-18 02:52:14 main:574] : INFO : Epoch 1772 | loss: 0.0311156 | val_loss: 0.0311394 | Time: 3592.37 ms
[2021-07-18 02:52:18 main:574] : INFO : Epoch 1773 | loss: 0.0311141 | val_loss: 0.0311393 | Time: 3614.66 ms
[2021-07-18 02:52:21 main:574] : INFO : Epoch 1774 | loss: 0.0311145 | val_loss: 0.0311447 | Time: 3591 ms
[2021-07-18 02:52:25 main:574] : INFO : Epoch 1775 | loss: 0.0311141 | val_loss: 0.0311392 | Time: 3515.27 ms
[2021-07-18 02:52:28 main:574] : INFO : Epoch 1776 | loss: 0.031112 | val_loss: 0.03114 | Time: 3541.66 ms
[2021-07-18 02:52:32 main:574] : INFO : Epoch 1777 | loss: 0.0311118 | val_loss: 0.03114 | Time: 3551.15 ms
[2021-07-18 02:52:35 main:574] : INFO : Epoch 1778 | loss: 0.0311131 | val_loss: 0.0311401 | Time: 3544.05 ms
[2021-07-18 02:52:39 main:574] : INFO : Epoch 1779 | loss: 0.0311103 | val_loss: 0.0311438 | Time: 3521.08 ms
[2021-07-18 02:52:43 main:574] : INFO : Epoch 1780 | loss: 0.0311094 | val_loss: 0.0311384 | Time: 3660.15 ms
[2021-07-18 02:52:47 main:574] : INFO : Epoch 1781 | loss: 0.0311097 | val_loss: 0.0311384 | Time: 3983.15 ms
THCudaCheck FAIL file=..\..\aten\src\THC\THCCachingHostAllocator.cpp line=278 error=719 : unspecified launch failure
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFC426E4ED9
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 07/18/21 02:52:47
Install Directory : C:\Program Files\BOINC\
Data Directory : C:\ProgramData\BOINC
Project Symstore :
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\3;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 000000002d3b0000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000044970000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1110) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 0000000044690000 00000000000bd000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 00000000426b0000 00000000002c9000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1110) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 0000000042bd0000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 0000000042230000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1110) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.1110 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1110
ModLoad: 0000000042ea0000 000000000002a000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.746) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.746 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.746
ModLoad: 00000000422f0000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1110) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.1110 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1110
ModLoad: 0000000042610000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 0000000042100000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 0000000043bc0000 00000000000ac000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1052) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 0000000042ac0000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.19041.546
ModLoad: 00000000436c0000 000000000009b000 C:\WINDOWS\System32\sechost.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.320
ModLoad: 0000000043d00000 000000000012a000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1081) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 00000000d3d70000 0000000024b49000 C:\ProgramData\BOINC\slots\3\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000c9180000 000000000abe7000 C:\ProgramData\BOINC\slots\3\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000308f0000 0000000000058000 C:\ProgramData\BOINC\slots\3\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000003b650000 0000000000045000 C:\ProgramData\BOINC\slots\3\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000f9230000 00000000034b2000 C:\ProgramData\BOINC\slots\3\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 000000003dcf0000 0000000000010000 C:\ProgramData\BOINC\slots\3\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 00000000c60d0000 00000000030a5000 C:\ProgramData\BOINC\slots\3\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 000000006fc60000 000000001b3a4000 C:\ProgramData\BOINC\slots\3\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 0000000025f90000 0000000000091000 C:\ProgramData\BOINC\slots\3\MSVCP140.dll (14.27.29112.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.27.29112.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.27.29112.0
ModLoad: 000000003ca30000 0000000000019000 C:\ProgramData\BOINC\slots\3\VCRUNTIME140.dll (14.27.29112.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.27.29112.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.27.29112.0
ModLoad: 000000003c9c0000 000000000000c000 C:\ProgramData\BOINC\slots\3\VCRUNTIME140_1.dll (14.27.29112.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.27.29112.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.27.29112.0
ModLoad: 0000000022180000 000000000020d000 C:\ProgramData\BOINC\slots\3\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 00000000c5df0000 00000000002db000 C:\ProgramData\BOINC\slots\3\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000003b2b0000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.867 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.867
ModLoad: 00000000308b0000 0000000000040000 C:\ProgramData\BOINC\slots\3\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000c2090000 0000000003d5b000 C:\ProgramData\BOINC\slots\3\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 000000009beb0000 000000000919f000 C:\ProgramData\BOINC\slots\3\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 00000000c01c0000 0000000001eca000 C:\ProgramData\BOINC\slots\3\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 0000000043b90000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000003ffe0000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000043e30000 0000000000469000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.844) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 00000000420b0000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000042200000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 0000000041e60000 000000000002c000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000042980000 0000000000060000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1110) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.1110 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1110
ModLoad: 00000000424b0000 000000000015f000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.844) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 0000000041ca0000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000042f80000 000000000073f000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 00000000401e0000 0000000000791000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1081) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 0000000043760000 0000000000355000 C:\WINDOWS\System32\combase.dll (6.2.19041.1081) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 0000000041b20000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 0000000042ed0000 00000000000ae000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 00000000447b0000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 00000000f89b0000 0000000000267000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.5730) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 27.21.14.5730
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.1.114 driver
Product Version : 27.21.14.5730
ModLoad: 000000003cee0000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000a5050000 000000000152c000 C:\WINDOWS\system32\DriverStore\FileRepository\nvhqi.inf_amd64_6e271d4dca2c455f\nvcuda64.dll (27.21.14.5730) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 27.21.14.5730
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.1.114 driver
Product Version : 27.21.14.5730
ModLoad: 00000000448c0000 000000000006b000 C:\WINDOWS\System32\WS2_32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : ws2_32.pdb
File Version : 10.0.19041.1081 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1081
ModLoad: 000000003bd90000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.906 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.906
ModLoad: 0000000041a80000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000003fb20000 000000000009e000 C:\WINDOWS\system32\uxtheme.dll (6.2.19041.1081) (-exported- Symbols Loaded)
Linked PDB Filename : UxTheme.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 000000001a790000 00000000006d6000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.5730) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 27.21.14.5730
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 27.21.14.5730
ModLoad: 0000000042d70000 000000000012a000 C:\WINDOWS\System32\OLE32.DLL (6.2.19041.746) (-exported- Symbols Loaded)
Linked PDB Filename : ole32.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operativsystem
Product Version : 10.0.19041.1100
ModLoad: 0000000039c20000 0000000000009000 C:\ProgramData\BOINC\slots\3\caffe2_nvrtc.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000bb250000 0000000000fca000 C:\ProgramData\BOINC\slots\3\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6.14.11.9000
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.89 NVRTC Library
Product Version : 6.14.11.9000
ModLoad: 0000000042260000 0000000000083000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.1023 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1023
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 5408, Write: 6972, Other 28002
- I/O Transfers Counters -
Read: 6907537, Write: 2072500, Other 292054
- Paged Pool Usage -
QuotaPagedPoolUsage: 3505160, QuotaPeakPagedPoolUsage: 3505752
QuotaNonPagedPoolUsage: 51808, QuotaPeakNonPagedPoolUsage: 52344
- Virtual Memory Usage -
VirtualSize: -431996928, PeakVirtualSize: 181174272
- Pagefile Usage -
PagefileUsage: -431996928, PeakPagefileUsage: -431996928
- Working Set Size -
WorkingSetSize: 1725972480, PeakWorkingSetSize: 1762492416, PageFaultCount: 634635
*** Dump of thread ID 10284 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 4497031168.000000, User Time: 32590469120.000000, Wait Time: 19742488.000000
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFC426E4ED9
- Registers -
rax=0000000000000000 rbx=00000000d35f62f0 rcx=0000000000000000 rdx=0000000000000000 rsi=00000000ce3040a0 rdi=0000000019930520
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000000006000 r13=0000000000000000
r14=00000000ce304de0 r15=00000000ce304d60 rip=00000000426e4ed9 rsp=00000000ce303f40 rbp=00000000ce304948
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202
- Callstack -
ChildEBP RetAddr Args to Child
ce304010 3ca36220 c67f3ce6 00000000 ce304de0 ce74a014 KERNELBASE!RaiseException+0x0
ce304070 ced45272 c67f3c06 00000000 000007cb 00000116 VCRUNTIME140!_CxxThrowException+0x0
ce3040c0 ced456d4 00000000 00000000 d1d6d290 d75d5f68 torch_cpu!at::Tensor::zero_+0x0
ce304920 d6b99ebe ce304b50 d75d6850 d75d6880 000002cf torch_cpu!_THError+0x0
ce304960 d6b95412 ce304b50 ce304ab0 fd0111a0 d7a0a720 torch_cuda!__THCudaCheck+0x0
ce3049a0 ce9f59ff ce304d00 ce304b50 ce305020 309297b0 torch_cuda!at::native::set_storage_cuda_+0x0
ce304d30 ceb9726f d720f630 ce74ea63 00000001 3090ef8f torch_cpu!at::native::empty_cpu+0x0
ce304d70 ceb50615 ce300000 ce304de8 ce304fe0 308f7ce6 torch_cpu!at::native::mkldnn_sigmoid_+0x0
ce304db0 ceb5204a ce300000 ce304e00 fcff4f00 d5ed6ae5 torch_cpu!at::native::mkldnn_sigmoid_+0x0
ce304e40 ceb50615 00000000 ce74ea63 ce304f20 ce305020 torch_cpu!at::native::mkldnn_sigmoid_+0x0
ce304e80 cec21eb0 ce300000 00000000 ce305008 00000001 torch_cpu!at::native::mkldnn_sigmoid_+0x0
ce304f20 cec32eec df225a20 30929c50 ce305080 308f3bd6 torch_cpu!at::bucketize_out+0x0
ce304f70 d629f160 ce300000 00000000 ce305080 00000000 torch_cpu!at::empty+0x0
ce305310 d62a2de8 30929c50 ce750528 fdee4100 30929c50 torch_cuda!at::native::cummin_helper_cuda+0x0
ce3054f0 d62a4379 ce305600 1e444870 ce305a00 1e444888 torch_cuda!at::native::cummin_helper_cuda+0x0
ce305730 d62a3d64 ce300000 ce305a00 ce305840 ce305a00 torch_cuda!at::native::cat_out_cuda+0x0
ce305930 d6b41dd2 ce305988 00000001 ce305988 ce305a00 torch_cuda!at::native::cat_cuda+0x0
ce3059b0 d6b54179 00000001 ce3059f0 fdee0408 04000000 torch_cuda!at::native::set_storage_cuda_+0x0
ce3059f0 cec21d7d 0bdfa6b0 ce305d60 ce305d30 00000000 torch_cuda!at::native::set_storage_cuda_+0x0
ce305a70 cec00d81 00000000 30913994 ce306240 1e443ad0 torch_cpu!at::bucketize_out+0x0
ce305ab0 cea0b4a5 ce305af0 fdee3d00 ce305bc0 ce305c30 torch_cpu!at::_cat+0x0
ce305b80 cecf27bd ce305c50 00000101 ce305bd8 30941ea8 torch_cpu!at::native::cat+0x0
ce305c00 ce7b29ae 1e4444f0 1e444500 1e444508 ce305bb8 torch_cpu!at::zeros_out+0x0
ce305c40 cec21d7d ce305c80 ce305cf0 00000000 449947b1 torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0
ce305cc0 cec275d1 ce306260 d3aa0640 ce306240 1e443ad0 torch_cpu!at::bucketize_out+0x0
ce305d00 cea17d4c ce305f90 00000000 ce305f90 00000000 torch_cpu!at::cat+0x0
ce305ec0 ced0c38d ce305f18 00000001 ce305f18 ce305f90 torch_cpu!at::native::stack+0x0
ce305f40 ce7b29ae ce306240 1e443ad0 00000000 00000000 torch_cpu!at::zeros_out+0x0
ce305f80 cec21d7d ce305fc0 ce306030 00000000 d19c1c8f torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0
ce306000 cec702e1 ce306130 30913720 ce306260 d3aa0640 torch_cpu!at::bucketize_out+0x0
ce306040 d0003839 ce3060c0 fdee1c70 fdee1c70 ce306150 torch_cpu!at::stack+0x0
ce306210 ce7b29ae 00000000 ce306360 00000000 ce306300 torch_cpu!torch::autograd::GraphRoot::apply+0x0
ce306250 cec21d7d ce306290 ce306300 fdee1040 00000000 torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0
ce3062d0 cec702e1 ce306440 ce749cac d5ad8230 1e443ad0 torch_cpu!at::bucketize_out+0x0
ce306310 2d3bff7e ce3063d8 0c278b30 0c278b30 ce306520 torch_cpu!at::stack+0x0
ce3063b0 2d3c2ef8 2d3bfe30 ce3063f0 ce3063f0 ce306440 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::addCallback+0x0
ce306410 2d3c3ea4 b8aa5fa0 449947b1 ce3065b0 fc570000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Object::getSlot+0x0
ce306550 2d3bd3d2 1ca1d6f0 1e9b2020 ce3065b0 44995ba1 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::markCompleted+0x0
ce306580 2d3c4541 00000000 1e9c05b0 d4e31e80 44995ba1 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Object::operator=+0x0
ce306730 2d3c743a ce306800 00000000 ce307240 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::markCompleted+0x0
ce306c30 2d3cb950 ce306d30 ce306d30 00000000 d56aeda0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0
ce31f9d0 2d60c6f8 fdf6eb90 00000000 00000000 fdb3b3d0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
ce31fa10 446a7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
ce31fa40 449c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
ce31fac0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 10300 (state: Waiting): ***
- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 19742484.000000
- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000ceaff6a0 rsi=0000000000000000 rdi=0000000000000064
r8=00000000ceaff678 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000044a0d4a4 rsp=00000000ceaff678 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
ceaff670 426f95be ceaff738 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0
ceaff710 2d3ea07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0
ceaff740 446a7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
ceaff770 449c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
ceaff7f0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 2416 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 19742486.000000
- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=00000000cebff8c0 rsi=0000000000000000 rdi=000000000000000d
r8=0000000000000001 r9=0000000000000000 r10=0000000000000000 r11=00000000cebff830 r12=0000000000000064 r13=00000000cebff8c0
r14=00000000cebff5c0 r15=0000000000000000 rip=0000000044a0d974 rsp=00000000cebff568 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
cebff560 426fcab0 00000000 ce4dc000 44ada4d0 ce4dc000 ntdll!ZwWaitForMultipleObjects+0x0
cebff850 426fc9ae fc57e310 004e0049 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
cebff890 a51fbb54 fe130a60 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0
cebffad0 a52909ed 00000000 00000004 00000000 00000000 nvcuda64!+0x0
cebffb80 a51fb523 3abd226c 3a554bb5 fe64eb90 00000000 nvcuda64!cuProfilerStop+0x0
cebffbb0 a550a750 fe64eb90 00000000 00000000 00000000 nvcuda64!+0x0
cebffbe0 446a7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
cebffc10 449c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
cebffc90 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 9464 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 19742484.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002ac rdx=0000000000000000 rsi=00000000cecff7d8 rdi=00000000000002ac
r8=00000000cecff7a8 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=00000000fe16f820 r13=0000000000000000
r14=00000000000002ac r15=0000000000000001 rip=0000000044a0cea4 rsp=00000000cecff7a8 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
cecff7a0 426d19ce 00000000 00000000 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0
cecff840 a540c0e7 00000000 426da305 00000000 000002ac KERNELBASE!WaitForSingleObjectEx+0x0
cecff8b0 a51fb523 00000001 fec7ea00 fe64e980 00000000 nvcuda64!cuProfilerStop+0x0
cecff8e0 a550a750 fe64e980 00000000 00000000 00000000 nvcuda64!+0x0
cecff910 446a7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
cecff940 449c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
cecff9c0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 5680 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 312500.000000, Wait Time: 19742466.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000fe3e7258 rdx=00000000cedff828 rsi=00000000cedff790 rdi=0000000000000000
r8=0000000000000000 r9=0000000000000000 r10=00000000fe3ea5c8 r11=00000000cedff7c0 r12=00000000cedff828 r13=0000000000000000
r14=00000000fe3e7258 r15=00000000fe3ea5c8 rip=0000000044a10814 rsp=00000000cedff768 rbp=00000000cedff7c0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
cedff760 449d4295 00000102 a52c965d 00000000 cedff790 ntdll!NtWaitForAlertByThreadId+0x0
cedff7d0 4271cd79 fe3e7db0 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0
cedff800 a518223a fe3e7db0 fe3e7db0 fe3e7db0 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0
cedff860 a51fb523 00000002 3abf8364 00000000 00000000 nvcuda64!+0x0
cedff890 a550a750 fe64f9a0 00000000 00000000 00000000 nvcuda64!+0x0
cedff8c0 446a7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
cedff8f0 449c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
cedff970 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 10372 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 1241562496.000000, User Time: 24830312448.000000, Wait Time: 19742484.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000093a3d18 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000093a3d18
r8=000000000000000a r9=0000000000000004 r10=0000000000000000 r11=000000000000c000 r12=0000000000000000 r13=0000000000000000
r14=00000000ceeff7c0 r15=00000000093a3cc8 rip=0000000044a10814 rsp=00000000ceeff798 rbp=00000000ceeff7f0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
ceeff790 449d4021 0c247708 0c247708 ceeff8d0 0c247708 ntdll!NtWaitForAlertByThreadId+0x0
ceeff810 4271ce29 093a3cc0 093a3d08 00000000 00000000 ntdll!RtlSleepConditionVariableSRW+0x0
ceeff850 25fcba8d 09ca5720 09ca5720 09ca5720 00000000 KERNELBASE!SleepConditionVariableSRW+0x0
ceeff890 25fa2848 1c4a2f30 00000000 00000000 d03605b4 MSVCP140!__crtSetThreadpoolWait+0x0
ceeff8c0 25fa2710 00000000 25fa2f17 00000000 1c4a2f30 MSVCP140!std::_Winerror_message+0x0
ceeff930 d036064b 1c4a2f10 000001c0 093a3cc0 093a3cc0 MSVCP140!std::_Winerror_message+0x0
ceeff970 d03625b1 1e5dc310 ffffffff 1c4a2f10 ffffffff torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
ceeffc60 d0362471 d3886d10 ceeffca0 d3886d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0
ceeffcb0 d0359744 00080001 1e568c50 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0
ceeffce0 42121bb2 1e568c50 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0
ceeffd10 446a7034 00000000 00000000 00000000 00000000 ucrtbase!_configthreadlocale+0x0
ceeffd40 449c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
ceeffdc0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)