Task 14513295
| Name | ParityModified-1647046567-7076-3-0_0 |
| Workunit | 11552788 |
| Created | 6 Apr 2022, 23:50:50 UTC |
| Sent | 10 Apr 2022, 11:36:44 UTC |
| Report deadline | 18 Apr 2022, 11:36:44 UTC |
| Received | 11 Apr 2022, 9:19:00 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 197 (0x000000C5) EXIT_TIME_LIMIT_EXCEEDED |
| Computer ID | 21690 |
| Run time | 6 hours 28 min 14 sec |
| CPU time | 1 hours 37 min 25 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 11,433.61 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 2.86 GB |
| Peak swap size | 4.64 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
exceeded elapsed time limit 23293.05 (4000000.00G/171.73G)</message>
<stderr_txt>
1 | loss: 0.0312456 | val_loss: 0.0312468 | Time: 5054.6 ms
[2022-04-11 15:54:29 main:574] : INFO : Epoch 1372 | loss: 0.0312445 | val_loss: 0.0312467 | Time: 8958.47 ms
[2022-04-11 15:54:36 main:574] : INFO : Epoch 1373 | loss: 0.0312446 | val_loss: 0.0312468 | Time: 5568.23 ms
[2022-04-11 15:54:43 main:574] : INFO : Epoch 1374 | loss: 0.0312446 | val_loss: 0.0312468 | Time: 7514.17 ms
[2022-04-11 15:54:50 main:574] : INFO : Epoch 1375 | loss: 0.0312441 | val_loss: 0.0312472 | Time: 6160.79 ms
[2022-04-11 15:54:56 main:574] : INFO : Epoch 1376 | loss: 0.0312454 | val_loss: 0.0312487 | Time: 5023.79 ms
[2022-04-11 15:55:02 main:574] : INFO : Epoch 1377 | loss: 0.0312456 | val_loss: 0.0312466 | Time: 5002.12 ms
[2022-04-11 15:55:07 main:574] : INFO : Epoch 1378 | loss: 0.0312452 | val_loss: 0.0312467 | Time: 4915.97 ms
[2022-04-11 15:55:13 main:574] : INFO : Epoch 1379 | loss: 0.0312445 | val_loss: 0.0312464 | Time: 5113.67 ms
[2022-04-11 15:55:18 main:574] : INFO : Epoch 1380 | loss: 0.0312447 | val_loss: 0.0312462 | Time: 5163.56 ms
[2022-04-11 15:55:24 main:574] : INFO : Epoch 1381 | loss: 0.0312446 | val_loss: 0.031249 | Time: 5250.73 ms
[2022-04-11 15:55:30 main:574] : INFO : Epoch 1382 | loss: 0.0312459 | val_loss: 0.0312471 | Time: 5113.43 ms
[2022-04-11 15:55:36 main:574] : INFO : Epoch 1383 | loss: 0.0312449 | val_loss: 0.0312468 | Time: 5022.38 ms
[2022-04-11 15:55:42 main:574] : INFO : Epoch 1384 | loss: 0.0312442 | val_loss: 0.0312473 | Time: 5484.74 ms
[2022-04-11 15:55:48 main:574] : INFO : Epoch 1385 | loss: 0.0312446 | val_loss: 0.0312464 | Time: 5181.41 ms
[2022-04-11 15:55:54 main:574] : INFO : Epoch 1386 | loss: 0.0312452 | val_loss: 0.0312483 | Time: 5180.63 ms
[2022-04-11 15:56:00 main:574] : INFO : Epoch 1387 | loss: 0.0312448 | val_loss: 0.0312462 | Time: 5293.6 ms
[2022-04-11 15:56:05 main:574] : INFO : Epoch 1388 | loss: 0.0312441 | val_loss: 0.0312461 | Time: 4975.96 ms
[2022-04-11 15:56:11 main:574] : INFO : Epoch 1389 | loss: 0.0312443 | val_loss: 0.0312461 | Time: 5159.38 ms
[2022-04-11 15:56:16 main:574] : INFO : Epoch 1390 | loss: 0.0312442 | val_loss: 0.0312463 | Time: 5095.84 ms
[2022-04-11 15:56:22 main:574] : INFO : Epoch 1391 | loss: 0.0312446 | val_loss: 0.0312463 | Time: 5023.63 ms
[2022-04-11 15:56:28 main:574] : INFO : Epoch 1392 | loss: 0.0312446 | val_loss: 0.0312479 | Time: 5028.81 ms
[2022-04-11 15:56:33 main:574] : INFO : Epoch 1393 | loss: 0.0312451 | val_loss: 0.0312461 | Time: 5123.77 ms
[2022-04-11 15:56:39 main:574] : INFO : Epoch 1394 | loss: 0.0312442 | val_loss: 0.0312465 | Time: 5351.97 ms
[2022-04-11 15:56:45 main:574] : INFO : Epoch 1395 | loss: 0.031244 | val_loss: 0.0312467 | Time: 5127.23 ms
[2022-04-11 15:56:51 main:574] : INFO : Epoch 1396 | loss: 0.031245 | val_loss: 0.0312461 | Time: 5310.82 ms
[2022-04-11 15:56:57 main:574] : INFO : Epoch 1397 | loss: 0.0312452 | val_loss: 0.0312495 | Time: 5292.55 ms
[2022-04-11 15:57:02 main:574] : INFO : Epoch 1398 | loss: 0.0312456 | val_loss: 0.0312473 | Time: 4980.58 ms
[2022-04-11 15:57:08 main:574] : INFO : Epoch 1399 | loss: 0.0312446 | val_loss: 0.0312463 | Time: 5227.35 ms
[2022-04-11 15:57:13 main:574] : INFO : Epoch 1400 | loss: 0.0312442 | val_loss: 0.0312474 | Time: 5180.8 ms
[2022-04-11 15:57:19 main:574] : INFO : Epoch 1401 | loss: 0.0312442 | val_loss: 0.0312469 | Time: 5136.7 ms
[2022-04-11 15:57:25 main:574] : INFO : Epoch 1402 | loss: 0.0312443 | val_loss: 0.0312465 | Time: 5205.27 ms
[2022-04-11 15:57:30 main:574] : INFO : Epoch 1403 | loss: 0.0312454 | val_loss: 0.0312461 | Time: 5171.01 ms
[2022-04-11 15:57:36 main:574] : INFO : Epoch 1404 | loss: 0.0312442 | val_loss: 0.0312485 | Time: 5149.88 ms
[2022-04-11 15:57:42 main:574] : INFO : Epoch 1405 | loss: 0.0312457 | val_loss: 0.0312472 | Time: 5104.49 ms
[2022-04-11 15:57:47 main:574] : INFO : Epoch 1406 | loss: 0.0312452 | val_loss: 0.0312497 | Time: 5077.98 ms
[2022-04-11 15:57:53 main:574] : INFO : Epoch 1407 | loss: 0.0312449 | val_loss: 0.0312463 | Time: 5096.73 ms
[2022-04-11 15:57:59 main:574] : INFO : Epoch 1408 | loss: 0.0312453 | val_loss: 0.0312498 | Time: 5166.33 ms
[2022-04-11 15:58:05 main:574] : INFO : Epoch 1409 | loss: 0.0312447 | val_loss: 0.0312468 | Time: 5231.54 ms
[2022-04-11 15:58:11 main:574] : INFO : Epoch 1410 | loss: 0.0312449 | val_loss: 0.0312494 | Time: 5051.72 ms
[2022-04-11 15:58:16 main:574] : INFO : Epoch 1411 | loss: 0.0312445 | val_loss: 0.0312461 | Time: 5095.9 ms
[2022-04-11 15:58:22 main:574] : INFO : Epoch 1412 | loss: 0.0312441 | val_loss: 0.0312463 | Time: 5178.14 ms
[2022-04-11 15:58:28 main:574] : INFO : Epoch 1413 | loss: 0.0312443 | val_loss: 0.0312469 | Time: 5148.47 ms
[2022-04-11 15:58:34 main:574] : INFO : Epoch 1414 | loss: 0.0312445 | val_loss: 0.0312476 | Time: 5326.97 ms
[2022-04-11 15:58:40 main:574] : INFO : Epoch 1415 | loss: 0.031246 | val_loss: 0.0312464 | Time: 5118.86 ms
[2022-04-11 15:58:45 main:574] : INFO : Epoch 1416 | loss: 0.0312442 | val_loss: 0.0312464 | Time: 5149.77 ms
[2022-04-11 15:58:51 main:574] : INFO : Epoch 1417 | loss: 0.0312441 | val_loss: 0.0312461 | Time: 5367.34 ms
[2022-04-11 15:58:58 main:574] : INFO : Epoch 1418 | loss: 0.0312441 | val_loss: 0.0312464 | Time: 5445.71 ms
[2022-04-11 15:59:03 main:574] : INFO : Epoch 1419 | loss: 0.0312444 | val_loss: 0.0312461 | Time: 5117.14 ms
[2022-04-11 15:59:09 main:574] : INFO : Epoch 1420 | loss: 0.031244 | val_loss: 0.0312461 | Time: 5140.28 ms
[2022-04-11 15:59:15 main:574] : INFO : Epoch 1421 | loss: 0.0312447 | val_loss: 0.0312462 | Time: 5112.27 ms
[2022-04-11 15:59:21 main:574] : INFO : Epoch 1422 | loss: 0.0312445 | val_loss: 0.0312466 | Time: 5114.84 ms
[2022-04-11 15:59:26 main:574] : INFO : Epoch 1423 | loss: 0.0312444 | val_loss: 0.0312471 | Time: 4984.52 ms
[2022-04-11 15:59:32 main:574] : INFO : Epoch 1424 | loss: 0.0312445 | val_loss: 0.0312475 | Time: 5273.58 ms
[2022-04-11 15:59:38 main:574] : INFO : Epoch 1425 | loss: 0.0312452 | val_loss: 0.0312469 | Time: 5286.94 ms
[2022-04-11 15:59:44 main:574] : INFO : Epoch 1426 | loss: 0.0312447 | val_loss: 0.0312464 | Time: 5121.44 ms
[2022-04-11 15:59:50 main:574] : INFO : Epoch 1427 | loss: 0.0312459 | val_loss: 0.0312473 | Time: 5272.58 ms
[2022-04-11 15:59:56 main:574] : INFO : Epoch 1428 | loss: 0.0312462 | val_loss: 0.0312475 | Time: 5096.09 ms
[2022-04-11 16:00:01 main:574] : INFO : Epoch 1429 | loss: 0.0312454 | val_loss: 0.0312494 | Time: 5129.54 ms
[2022-04-11 16:00:07 main:574] : INFO : Epoch 1430 | loss: 0.0312472 | val_loss: 0.0312481 | Time: 5132 ms
[2022-04-11 16:00:13 main:574] : INFO : Epoch 1431 | loss: 0.0312452 | val_loss: 0.0312468 | Time: 5108.92 ms
[2022-04-11 16:00:18 main:574] : INFO : Epoch 1432 | loss: 0.0312449 | val_loss: 0.0312488 | Time: 4938.63 ms
[2022-04-11 16:00:23 main:574] : INFO : Epoch 1433 | loss: 0.0312448 | val_loss: 0.0312472 | Time: 4980.99 ms
[2022-04-11 16:00:29 main:574] : INFO : Epoch 1434 | loss: 0.0312443 | val_loss: 0.031247 | Time: 5290.86 ms
[2022-04-11 16:00:34 main:574] : INFO : Epoch 1435 | loss: 0.0312445 | val_loss: 0.0312467 | Time: 4936.21 ms
[2022-04-11 16:00:40 main:574] : INFO : Epoch 1436 | loss: 0.0312441 | val_loss: 0.0312461 | Time: 4959.5 ms
[2022-04-11 16:00:45 main:574] : INFO : Epoch 1437 | loss: 0.0312442 | val_loss: 0.0312463 | Time: 5141.86 ms
[2022-04-11 16:00:51 main:574] : INFO : Epoch 1438 | loss: 0.0312449 | val_loss: 0.0312469 | Time: 5027.31 ms
[2022-04-11 16:00:57 main:574] : INFO : Epoch 1439 | loss: 0.0312453 | val_loss: 0.0312471 | Time: 5005.2 ms
[2022-04-11 16:01:02 main:574] : INFO : Epoch 1440 | loss: 0.0312449 | val_loss: 0.0312462 | Time: 4960.31 ms
[2022-04-11 16:01:08 main:574] : INFO : Epoch 1441 | loss: 0.0312443 | val_loss: 0.0312466 | Time: 5262.35 ms
[2022-04-11 16:01:14 main:574] : INFO : Epoch 1442 | loss: 0.0312445 | val_loss: 0.0312466 | Time: 5210.16 ms
[2022-04-11 16:01:20 main:574] : INFO : Epoch 1443 | loss: 0.0312443 | val_loss: 0.0312469 | Time: 5417.71 ms
[2022-04-11 16:01:25 main:574] : INFO : Epoch 1444 | loss: 0.0312453 | val_loss: 0.0312471 | Time: 4982.33 ms
[2022-04-11 16:01:31 main:574] : INFO : Epoch 1445 | loss: 0.0312444 | val_loss: 0.0312471 | Time: 5004.15 ms
[2022-04-11 16:01:37 main:574] : INFO : Epoch 1446 | loss: 0.0312443 | val_loss: 0.0312463 | Time: 5181.8 ms
[2022-04-11 16:01:43 main:574] : INFO : Epoch 1447 | loss: 0.0312443 | val_loss: 0.0312468 | Time: 5303.4 ms
[2022-04-11 16:01:49 main:574] : INFO : Epoch 1448 | loss: 0.0312457 | val_loss: 0.031249 | Time: 5093.33 ms
[2022-04-11 16:01:55 main:574] : INFO : Epoch 1449 | loss: 0.0312443 | val_loss: 0.0312482 | Time: 5171.56 ms
[2022-04-11 16:02:00 main:574] : INFO : Epoch 1450 | loss: 0.031245 | val_loss: 0.0312467 | Time: 4991.64 ms
[2022-04-11 16:02:06 main:574] : INFO : Epoch 1451 | loss: 0.0312443 | val_loss: 0.0312468 | Time: 5079.2 ms
[2022-04-11 16:02:11 main:574] : INFO : Epoch 1452 | loss: 0.0312443 | val_loss: 0.0312463 | Time: 5163.08 ms
[2022-04-11 16:02:17 main:574] : INFO : Epoch 1453 | loss: 0.0312442 | val_loss: 0.0312462 | Time: 5032.81 ms
[2022-04-11 16:02:22 main:574] : INFO : Epoch 1454 | loss: 0.0312444 | val_loss: 0.0312464 | Time: 4972.38 ms
[2022-04-11 16:02:28 main:574] : INFO : Epoch 1455 | loss: 0.0312442 | val_loss: 0.0312463 | Time: 5203.59 ms
[2022-04-11 16:02:33 main:574] : INFO : Epoch 1456 | loss: 0.0312444 | val_loss: 0.0312467 | Time: 4921.67 ms
[2022-04-11 16:02:40 main:574] : INFO : Epoch 1457 | loss: 0.0312443 | val_loss: 0.0312487 | Time: 5293.82 ms
[2022-04-11 16:02:45 main:574] : INFO : Epoch 1458 | loss: 0.0312451 | val_loss: 0.0312472 | Time: 5071 ms
[2022-04-11 16:02:51 main:574] : INFO : Epoch 1459 | loss: 0.0312446 | val_loss: 0.0312462 | Time: 4989.33 ms
[2022-04-11 16:02:56 main:574] : INFO : Epoch 1460 | loss: 0.0312447 | val_loss: 0.0312482 | Time: 5073.65 ms
[2022-04-11 16:03:01 main:574] : INFO : Epoch 1461 | loss: 0.0312449 | val_loss: 0.031248 | Time: 4993.46 ms
[2022-04-11 16:03:07 main:574] : INFO : Epoch 1462 | loss: 0.0312493 | val_loss: 0.0312547 | Time: 5012.27 ms
[2022-04-11 16:03:13 main:574] : INFO : Epoch 1463 | loss: 0.0312468 | val_loss: 0.0312468 | Time: 5073.31 ms
[2022-04-11 16:03:18 main:574] : INFO : Epoch 1464 | loss: 0.0312456 | val_loss: 0.0312481 | Time: 4875.26 ms
[2022-04-11 16:03:23 main:574] : INFO : Epoch 1465 | loss: 0.0312449 | val_loss: 0.0312475 | Time: 5089.68 ms
[2022-04-11 16:03:29 main:574] : INFO : Epoch 1466 | loss: 0.0312443 | val_loss: 0.0312468 | Time: 4985.74 ms
[2022-04-11 16:03:35 main:574] : INFO : Epoch 1467 | loss: 0.0312444 | val_loss: 0.0312468 | Time: 5138.47 ms
[2022-04-11 16:03:41 main:574] : INFO : Epoch 1468 | loss: 0.0312443 | val_loss: 0.0312468 | Time: 5319.28 ms
[2022-04-11 16:03:46 main:574] : INFO : Epoch 1469 | loss: 0.0312441 | val_loss: 0.0312464 | Time: 5148.34 ms
[2022-04-11 16:03:52 main:574] : INFO : Epoch 1470 | loss: 0.0312442 | val_loss: 0.0312464 | Time: 5164.41 ms
[2022-04-11 16:03:58 main:574] : INFO : Epoch 1471 | loss: 0.0312444 | val_loss: 0.0312474 | Time: 4972.41 ms
[2022-04-11 16:04:05 main:574] : INFO : Epoch 1472 | loss: 0.0312444 | val_loss: 0.0312476 | Time: 5352.5 ms
[2022-04-11 16:04:11 main:574] : INFO : Epoch 1473 | loss: 0.0312448 | val_loss: 0.0312463 | Time: 5237.76 ms
[2022-04-11 16:04:16 main:574] : INFO : Epoch 1474 | loss: 0.0312459 | val_loss: 0.0312504 | Time: 5191.18 ms
[2022-04-11 16:04:22 main:574] : INFO : Epoch 1475 | loss: 0.0312454 | val_loss: 0.0312495 | Time: 5008.64 ms
[2022-04-11 16:04:28 main:574] : INFO : Epoch 1476 | loss: 0.0312448 | val_loss: 0.0312475 | Time: 5233.73 ms
[2022-04-11 16:04:33 main:574] : INFO : Epoch 1477 | loss: 0.0312447 | val_loss: 0.0312479 | Time: 5291 ms
[2022-04-11 16:04:38 main:574] : INFO : Epoch 1478 | loss: 0.0312446 | val_loss: 0.0312475 | Time: 4819.51 ms
[2022-04-11 16:04:44 main:574] : INFO : Epoch 1479 | loss: 0.0312448 | val_loss: 0.031248 | Time: 5112.35 ms
[2022-04-11 16:04:49 main:574] : INFO : Epoch 1480 | loss: 0.0312457 | val_loss: 0.0312508 | Time: 4998.43 ms
[2022-04-11 16:04:55 main:574] : INFO : Epoch 1481 | loss: 0.0312462 | val_loss: 0.0312491 | Time: 5136 ms
[2022-04-11 16:05:01 main:574] : INFO : Epoch 1482 | loss: 0.0312455 | val_loss: 0.0312475 | Time: 5157.35 ms
[2022-04-11 16:05:07 main:574] : INFO : Epoch 1483 | loss: 0.0312455 | val_loss: 0.0312489 | Time: 5344.88 ms
[2022-04-11 16:05:12 main:574] : INFO : Epoch 1484 | loss: 0.031246 | val_loss: 0.031247 | Time: 4993.59 ms
[2022-04-11 16:05:18 main:574] : INFO : Epoch 1485 | loss: 0.0312447 | val_loss: 0.0312466 | Time: 5170.04 ms
[2022-04-11 16:05:24 main:574] : INFO : Epoch 1486 | loss: 0.0312445 | val_loss: 0.0312472 | Time: 4988.9 ms
[2022-04-11 16:05:29 main:574] : INFO : Epoch 1487 | loss: 0.0312451 | val_loss: 0.0312463 | Time: 4967.75 ms
[2022-04-11 16:05:36 main:574] : INFO : Epoch 1488 | loss: 0.0312448 | val_loss: 0.0312473 | Time: 5465.87 ms
[2022-04-11 16:05:41 main:574] : INFO : Epoch 1489 | loss: 0.0312442 | val_loss: 0.0312464 | Time: 5045.66 ms
[2022-04-11 16:05:47 main:574] : INFO : Epoch 1490 | loss: 0.0312444 | val_loss: 0.0312461 | Time: 5093.72 ms
[2022-04-11 16:05:53 main:574] : INFO : Epoch 1491 | loss: 0.0312443 | val_loss: 0.0312479 | Time: 5158.54 ms
[2022-04-11 16:05:58 main:574] : INFO : Epoch 1492 | loss: 0.0312443 | val_loss: 0.0312467 | Time: 4959.91 ms
[2022-04-11 16:06:04 main:574] : INFO : Epoch 1493 | loss: 0.0312442 | val_loss: 0.0312463 | Time: 4900.5 ms
[2022-04-11 16:06:09 main:574] : INFO : Epoch 1494 | loss: 0.0312442 | val_loss: 0.0312472 | Time: 4942.43 ms
[2022-04-11 16:06:15 main:574] : INFO : Epoch 1495 | loss: 0.0312445 | val_loss: 0.0312469 | Time: 5126.03 ms
[2022-04-11 16:06:20 main:574] : INFO : Epoch 1496 | loss: 0.0312441 | val_loss: 0.0312473 | Time: 5050.77 ms
[2022-04-11 16:06:26 main:574] : INFO : Epoch 1497 | loss: 0.0312446 | val_loss: 0.0312464 | Time: 4966.64 ms
[2022-04-11 16:06:32 main:574] : INFO : Epoch 1498 | loss: 0.031244 | val_loss: 0.0312463 | Time: 5093.53 ms
[2022-04-11 16:06:37 main:574] : INFO : Epoch 1499 | loss: 0.0312447 | val_loss: 0.0312466 | Time: 5001.48 ms
[2022-04-11 16:06:43 main:574] : INFO : Epoch 1500 | loss: 0.0312455 | val_loss: 0.0312481 | Time: 5137.4 ms
[2022-04-11 16:06:49 main:574] : INFO : Epoch 1501 | loss: 0.0312443 | val_loss: 0.0312467 | Time: 5462.46 ms
[2022-04-11 16:06:56 main:574] : INFO : Epoch 1502 | loss: 0.0312446 | val_loss: 0.031247 | Time: 5763.78 ms
[2022-04-11 16:07:01 main:574] : INFO : Epoch 1503 | loss: 0.0312457 | val_loss: 0.0312463 | Time: 5200.29 ms
[2022-04-11 16:07:07 main:574] : INFO : Epoch 1504 | loss: 0.0312442 | val_loss: 0.0312466 | Time: 5035.1 ms
[2022-04-11 16:07:13 main:574] : INFO : Epoch 1505 | loss: 0.0312447 | val_loss: 0.0312484 | Time: 4844.22 ms
[2022-04-11 16:07:18 main:574] : INFO : Epoch 1506 | loss: 0.0312453 | val_loss: 0.0312466 | Time: 5210.73 ms
[2022-04-11 16:07:24 main:574] : INFO : Epoch 1507 | loss: 0.031245 | val_loss: 0.0312483 | Time: 5111.13 ms
[2022-04-11 16:07:30 main:574] : INFO : Epoch 1508 | loss: 0.0312448 | val_loss: 0.0312465 | Time: 5084.68 ms
[2022-04-11 16:07:36 main:574] : INFO : Epoch 1509 | loss: 0.0312443 | val_loss: 0.0312466 | Time: 5182.57 ms
[2022-04-11 16:07:41 main:574] : INFO : Epoch 1510 | loss: 0.0312442 | val_loss: 0.031247 | Time: 5163.22 ms
[2022-04-11 16:07:47 main:574] : INFO : Epoch 1511 | loss: 0.0312442 | val_loss: 0.0312479 | Time: 5288.11 ms
[2022-04-11 16:07:53 main:574] : INFO : Epoch 1512 | loss: 0.0312451 | val_loss: 0.0312463 | Time: 5214.12 ms
[2022-04-11 16:07:59 main:574] : INFO : Epoch 1513 | loss: 0.0312439 | val_loss: 0.0312472 | Time: 5154.63 ms
[2022-04-11 16:08:04 main:574] : INFO : Epoch 1514 | loss: 0.0312443 | val_loss: 0.0312484 | Time: 5152.83 ms
[2022-04-11 16:08:11 main:574] : INFO : Epoch 1515 | loss: 0.0312449 | val_loss: 0.031247 | Time: 5367.45 ms
[2022-04-11 16:08:17 main:574] : INFO : Epoch 1516 | loss: 0.0312445 | val_loss: 0.0312479 | Time: 5300.85 ms
[2022-04-11 16:08:22 main:574] : INFO : Epoch 1517 | loss: 0.0312447 | val_loss: 0.0312479 | Time: 5076.35 ms
[2022-04-11 16:08:28 main:574] : INFO : Epoch 1518 | loss: 0.0312452 | val_loss: 0.0312469 | Time: 5052.5 ms
[2022-04-11 16:08:33 main:574] : INFO : Epoch 1519 | loss: 0.0312448 | val_loss: 0.0312469 | Time: 5000 ms
[2022-04-11 16:08:39 main:574] : INFO : Epoch 1520 | loss: 0.0312442 | val_loss: 0.0312466 | Time: 5141.05 ms
[2022-04-11 16:08:45 main:574] : INFO : Epoch 1521 | loss: 0.0312442 | val_loss: 0.031247 | Time: 5111.32 ms
[2022-04-11 16:08:51 main:574] : INFO : Epoch 1522 | loss: 0.0312455 | val_loss: 0.0312468 | Time: 5203.08 ms
[2022-04-11 16:08:56 main:574] : INFO : Epoch 1523 | loss: 0.031245 | val_loss: 0.0312471 | Time: 4923.69 ms
[2022-04-11 16:09:02 main:574] : INFO : Epoch 1524 | loss: 0.0312454 | val_loss: 0.0312474 | Time: 5135.76 ms
[2022-04-11 16:09:08 main:574] : INFO : Epoch 1525 | loss: 0.0312458 | val_loss: 0.0312509 | Time: 5435.72 ms
[2022-04-11 16:09:14 main:574] : INFO : Epoch 1526 | loss: 0.0312457 | val_loss: 0.0312465 | Time: 5054.12 ms
[2022-04-11 16:09:19 main:574] : INFO : Epoch 1527 | loss: 0.0312444 | val_loss: 0.0312461 | Time: 5045.87 ms
[2022-04-11 16:09:25 main:574] : INFO : Epoch 1528 | loss: 0.0312441 | val_loss: 0.0312463 | Time: 5082.5 ms
[2022-04-11 16:09:30 main:574] : INFO : Epoch 1529 | loss: 0.0312442 | val_loss: 0.0312462 | Time: 5004.96 ms
[2022-04-11 16:09:36 main:574] : INFO : Epoch 1530 | loss: 0.0312444 | val_loss: 0.0312469 | Time: 5079.14 ms
[2022-04-11 16:09:42 main:574] : INFO : Epoch 1531 | loss: 0.0312445 | val_loss: 0.0312464 | Time: 5096.66 ms
[2022-04-11 16:09:47 main:574] : INFO : Epoch 1532 | loss: 0.0312442 | val_loss: 0.0312465 | Time: 5086.63 ms
[2022-04-11 16:09:53 main:574] : INFO : Epoch 1533 | loss: 0.0312445 | val_loss: 0.0312467 | Time: 4813.58 ms
[2022-04-11 16:09:58 main:574] : INFO : Epoch 1534 | loss: 0.0312443 | val_loss: 0.0312477 | Time: 4985.44 ms
[2022-04-11 16:10:04 main:574] : INFO : Epoch 1535 | loss: 0.0312444 | val_loss: 0.0312469 | Time: 5062.57 ms
[2022-04-11 16:10:10 main:574] : INFO : Epoch 1536 | loss: 0.0312442 | val_loss: 0.0312466 | Time: 5314.37 ms
[2022-04-11 16:10:15 main:574] : INFO : Epoch 1537 | loss: 0.031244 | val_loss: 0.0312464 | Time: 5141.42 ms
[2022-04-11 16:10:21 main:574] : INFO : Epoch 1538 | loss: 0.0312443 | val_loss: 0.0312473 | Time: 5234.64 ms
[2022-04-11 16:10:27 main:574] : INFO : Epoch 1539 | loss: 0.0312442 | val_loss: 0.0312464 | Time: 5118.46 ms
[2022-04-11 16:10:33 main:574] : INFO : Epoch 1540 | loss: 0.0312444 | val_loss: 0.0312462 | Time: 5300.44 ms
[2022-04-11 16:10:39 main:574] : INFO : Epoch 1541 | loss: 0.0312443 | val_loss: 0.031247 | Time: 5165.28 ms
[2022-04-11 16:10:44 main:574] : INFO : Epoch 1542 | loss: 0.0312441 | val_loss: 0.0312465 | Time: 5119.89 ms
[2022-04-11 16:10:50 main:574] : INFO : Epoch 1543 | loss: 0.0312442 | val_loss: 0.0312471 | Time: 5335.18 ms
[2022-04-11 16:10:56 main:574] : INFO : Epoch 1544 | loss: 0.0312443 | val_loss: 0.0312467 | Time: 4926.28 ms
[2022-04-11 16:11:02 main:574] : INFO : Epoch 1545 | loss: 0.0312442 | val_loss: 0.0312461 | Time: 5099.45 ms
[2022-04-11 16:11:07 main:574] : INFO : Epoch 1546 | loss: 0.031245 | val_loss: 0.0312476 | Time: 4956.08 ms
[2022-04-11 16:11:13 main:574] : INFO : Epoch 1547 | loss: 0.0312448 | val_loss: 0.0312465 | Time: 5104.75 ms
[2022-04-11 16:11:19 main:574] : INFO : Epoch 1548 | loss: 0.0312447 | val_loss: 0.0312464 | Time: 4965.44 ms
[2022-04-11 16:11:24 main:574] : INFO : Epoch 1549 | loss: 0.0312449 | val_loss: 0.0312476 | Time: 5128.41 ms
[2022-04-11 16:11:30 main:574] : INFO : Epoch 1550 | loss: 0.0312446 | val_loss: 0.0312473 | Time: 5045.94 ms
[2022-04-11 16:11:36 main:574] : INFO : Epoch 1551 | loss: 0.0312448 | val_loss: 0.0312477 | Time: 5270.56 ms
[2022-04-11 16:11:42 main:574] : INFO : Epoch 1552 | loss: 0.0312449 | val_loss: 0.0312467 | Time: 5250.12 ms
[2022-04-11 16:11:48 main:574] : INFO : Epoch 1553 | loss: 0.0312444 | val_loss: 0.0312475 | Time: 5038.64 ms
[2022-04-11 16:11:53 main:574] : INFO : Epoch 1554 | loss: 0.0312448 | val_loss: 0.0312467 | Time: 4957.5 ms
[2022-04-11 16:11:58 main:574] : INFO : Epoch 1555 | loss: 0.0312443 | val_loss: 0.0312466 | Time: 5019.51 ms
[2022-04-11 16:12:04 main:574] : INFO : Epoch 1556 | loss: 0.0312443 | val_loss: 0.0312467 | Time: 4992.41 ms
[2022-04-11 16:12:10 main:574] : INFO : Epoch 1557 | loss: 0.031245 | val_loss: 0.0312478 | Time: 5098.51 ms
[2022-04-11 16:12:15 main:574] : INFO : Epoch 1558 | loss: 0.0312447 | val_loss: 0.0312466 | Time: 5159.37 ms
[2022-04-11 16:12:21 main:574] : INFO : Epoch 1559 | loss: 0.0312442 | val_loss: 0.0312473 | Time: 5124.03 ms
[2022-04-11 16:12:27 main:574] : INFO : Epoch 1560 | loss: 0.0312446 | val_loss: 0.0312471 | Time: 5273.47 ms
[2022-04-11 16:12:32 main:574] : INFO : Epoch 1561 | loss: 0.0312442 | val_loss: 0.0312461 | Time: 5084.05 ms
[2022-04-11 16:12:38 main:574] : INFO : Epoch 1562 | loss: 0.0312442 | val_loss: 0.0312465 | Time: 4947.82 ms
[2022-04-11 16:12:44 main:574] : INFO : Epoch 1563 | loss: 0.0312442 | val_loss: 0.0312465 | Time: 5128.58 ms
[2022-04-11 16:12:50 main:574] : INFO : Epoch 1564 | loss: 0.0312442 | val_loss: 0.0312464 | Time: 5231.73 ms
[2022-04-11 16:12:55 main:574] : INFO : Epoch 1565 | loss: 0.0312447 | val_loss: 0.0312483 | Time: 4969.69 ms
[2022-04-11 16:13:01 main:574] : INFO : Epoch 1566 | loss: 0.0312457 | val_loss: 0.0312548 | Time: 4947.14 ms
[2022-04-11 16:13:06 main:574] : INFO : Epoch 1567 | loss: 0.0312483 | val_loss: 0.0312477 | Time: 4988.06 ms
[2022-04-11 16:13:12 main:574] : INFO : Epoch 1568 | loss: 0.0312452 | val_loss: 0.0312488 | Time: 4961.53 ms
[2022-04-11 16:13:17 main:574] : INFO : Epoch 1569 | loss: 0.0312449 | val_loss: 0.0312481 | Time: 4825.78 ms
[2022-04-11 16:13:23 main:574] : INFO : Epoch 1570 | loss: 0.0312442 | val_loss: 0.0312464 | Time: 5161.06 ms
[2022-04-11 16:13:29 main:574] : INFO : Epoch 1571 | loss: 0.031244 | val_loss: 0.0312469 | Time: 5159.79 ms
[2022-04-11 16:13:35 main:574] : INFO : Epoch 1572 | loss: 0.0312441 | val_loss: 0.0312461 | Time: 5167.74 ms
[2022-04-11 16:13:40 main:574] : INFO : Epoch 1573 | loss: 0.0312449 | val_loss: 0.0312467 | Time: 5145.49 ms
[2022-04-11 16:13:46 main:574] : INFO : Epoch 1574 | loss: 0.0312444 | val_loss: 0.0312463 | Time: 5312.92 ms
[2022-04-11 16:13:52 main:574] : INFO : Epoch 1575 | loss: 0.0312441 | val_loss: 0.0312473 | Time: 5149.05 ms
[2022-04-11 16:13:57 main:574] : INFO : Epoch 1576 | loss: 0.0312442 | val_loss: 0.0312467 | Time: 4993.58 ms
[2022-04-11 16:14:03 main:574] : INFO : Epoch 1577 | loss: 0.0312441 | val_loss: 0.0312464 | Time: 5083.49 ms
[2022-04-11 16:14:09 main:574] : INFO : Epoch 1578 | loss: 0.0312441 | val_loss: 0.0312462 | Time: 5167.36 ms
[2022-04-11 16:14:14 main:574] : INFO : Epoch 1579 | loss: 0.0312451 | val_loss: 0.0312461 | Time: 5001.54 ms
[2022-04-11 16:14:20 main:574] : INFO : Epoch 1580 | loss: 0.0312468 | val_loss: 0.0312688 | Time: 5164.39 ms
[2022-04-11 16:14:26 main:574] : INFO : Epoch 1581 | loss: 0.034525 | val_loss: 0.0325882 | Time: 4980.88 ms
[2022-04-11 16:14:32 main:574] : INFO : Epoch 1582 | loss: 0.0324978 | val_loss: 0.0314064 | Time: 5139.52 ms
[2022-04-11 16:14:37 main:574] : INFO : Epoch 1583 | loss: 0.0313685 | val_loss: 0.0312694 | Time: 5004.48 ms
[2022-04-11 16:14:43 main:574] : INFO : Epoch 1584 | loss: 0.0312692 | val_loss: 0.0312556 | Time: 5254.67 ms
[2022-04-11 16:14:49 main:574] : INFO : Epoch 1585 | loss: 0.0312504 | val_loss: 0.0312497 | Time: 4972.74 ms
[2022-04-11 16:14:54 main:574] : INFO : Epoch 1586 | loss: 0.0312467 | val_loss: 0.0312482 | Time: 5128.66 ms
[2022-04-11 16:15:00 main:574] : INFO : Epoch 1587 | loss: 0.0312461 | val_loss: 0.0312479 | Time: 5249.18 ms
[2022-04-11 16:15:06 main:574] : INFO : Epoch 1588 | loss: 0.0312458 | val_loss: 0.0312473 | Time: 5159.49 ms
[2022-04-11 16:15:12 main:574] : INFO : Epoch 1589 | loss: 0.031246 | val_loss: 0.0312474 | Time: 5022.53 ms
[2022-04-11 16:15:17 main:574] : INFO : Epoch 1590 | loss: 0.0312455 | val_loss: 0.031247 | Time: 4969.29 ms
[2022-04-11 16:15:23 main:574] : INFO : Epoch 1591 | loss: 0.0312453 | val_loss: 0.0312476 | Time: 5153 ms
[2022-04-11 16:15:28 main:574] : INFO : Epoch 1592 | loss: 0.0312453 | val_loss: 0.0312478 | Time: 5126.56 ms
[2022-04-11 16:15:34 main:574] : INFO : Epoch 1593 | loss: 0.0312447 | val_loss: 0.0312468 | Time: 4968.62 ms
[2022-04-11 16:15:39 main:574] : INFO : Epoch 1594 | loss: 0.0312446 | val_loss: 0.0312469 | Time: 4975.36 ms
[2022-04-11 16:15:45 main:574] : INFO : Epoch 1595 | loss: 0.0312445 | val_loss: 0.0312477 | Time: 5260.37 ms
[2022-04-11 16:15:51 main:574] : INFO : Epoch 1596 | loss: 0.0312461 | val_loss: 0.031248 | Time: 5088.36 ms
[2022-04-11 16:15:57 main:574] : INFO : Epoch 1597 | loss: 0.0312446 | val_loss: 0.0312473 | Time: 5257.22 ms
[2022-04-11 16:16:02 main:574] : INFO : Epoch 1598 | loss: 0.0312446 | val_loss: 0.0312468 | Time: 4997.91 ms
[2022-04-11 16:16:08 main:574] : INFO : Epoch 1599 | loss: 0.0312444 | val_loss: 0.031247 | Time: 5327.32 ms
[2022-04-11 16:16:13 main:574] : INFO : Epoch 1600 | loss: 0.0312449 | val_loss: 0.0312466 | Time: 4932.39 ms
[2022-04-11 16:16:19 main:574] : INFO : Epoch 1601 | loss: 0.0312446 | val_loss: 0.0312468 | Time: 5123.3 ms
[2022-04-11 16:16:25 main:574] : INFO : Epoch 1602 | loss: 0.0312444 | val_loss: 0.0312467 | Time: 5082.1 ms
[2022-04-11 16:16:31 main:574] : INFO : Epoch 1603 | loss: 0.0312448 | val_loss: 0.0312466 | Time: 5139.67 ms
[2022-04-11 16:16:36 main:574] : INFO : Epoch 1604 | loss: 0.0312444 | val_loss: 0.0312469 | Time: 5145.46 ms
[2022-04-11 16:16:42 main:574] : INFO : Epoch 1605 | loss: 0.0312443 | val_loss: 0.0312466 | Time: 5170.57 ms
[2022-04-11 16:16:47 main:574] : INFO : Epoch 1606 | loss: 0.0312444 | val_loss: 0.0312466 | Time: 4944.21 ms
[2022-04-11 16:16:53 main:574] : INFO : Epoch 1607 | loss: 0.0312442 | val_loss: 0.0312466 | Time: 4962.97 ms
[2022-04-11 16:16:58 main:574] : INFO : Epoch 1608 | loss: 0.0312441 | val_loss: 0.0312471 | Time: 5001.95 ms
[2022-04-11 16:17:04 main:574] : INFO : Epoch 1609 | loss: 0.0312443 | val_loss: 0.0312483 | Time: 5148.54 ms
[2022-04-11 16:17:10 main:574] : INFO : Epoch 1610 | loss: 0.0312443 | val_loss: 0.0312464 | Time: 5291.45 ms
[2022-04-11 16:17:16 main:574] : INFO : Epoch 1611 | loss: 0.0312441 | val_loss: 0.0312468 | Time: 5003.36 ms
[2022-04-11 16:17:21 main:574] : INFO : Epoch 1612 | loss: 0.0312442 | val_loss: 0.031247 | Time: 5295.53 ms
[2022-04-11 16:17:27 main:574] : INFO : Epoch 1613 | loss: 0.0312441 | val_loss: 0.0312468 | Time: 5296.3 ms
[2022-04-11 16:17:33 main:574] : INFO : Epoch 1614 | loss: 0.0312453 | val_loss: 0.0312469 | Time: 5140.39 ms
[2022-04-11 16:17:39 main:574] : INFO : Epoch 1615 | loss: 0.0312444 | val_loss: 0.0312482 | Time: 5188.64 ms
[2022-04-11 16:17:45 main:574] : INFO : Epoch 1616 | loss: 0.0312455 | val_loss: 0.0312479 | Time: 5105.28 ms
[2022-04-11 16:17:50 main:574] : INFO : Epoch 1617 | loss: 0.0312441 | val_loss: 0.0312467 | Time: 4823.15 ms
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FF83D3990D2
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 04/11/22 16:17:54
Install Directory : D:\BOINC\
Data Directory : E:\BOINC
Project Symstore :
LoadLibraryA( E:\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( E:\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( E:\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( E:\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: E:\BOINC\slots\20;E:\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 00000000a0210000 00000000003df000 E:\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000003f9d0000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 000000003e630000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 000000003d2d0000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 000000003f5c0000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 000000003d200000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1586) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 000000003e410000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.1202 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1202
ModLoad: 000000003d0f0000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1566
ModLoad: 000000003d230000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.789
ModLoad: 000000003d610000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.789
ModLoad: 000000003dd30000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 000000003f8f0000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 7.0.19041.546
ModLoad: 000000003eb00000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.1586) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.320
ModLoad: 000000003f3e0000 0000000000125000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 0000000031660000 0000000000058000 E:\BOINC\slots\20\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000b1e60000 000000000abe7000 E:\BOINC\slots\20\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000027e90000 000000000008d000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.29.29917.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.29.29917.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft? Visual Studio?
Product Version : 14.29.29917.0
ModLoad: 000000002ef30000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.867 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.867
ModLoad: 0000000027f20000 000000000001a000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.29.29917.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.29.29917.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft? Visual Studio?
Product Version : 14.29.29917.0
ModLoad: 0000000027360000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.29.29917.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.29.29917.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft? Visual Studio?
Product Version : 14.29.29917.0
ModLoad: 000000001a200000 000000000020d000 E:\BOINC\slots\20\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 0000000004810000 00000000002db000 E:\BOINC\slots\20\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000031600000 0000000000040000 E:\BOINC\slots\20\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000054170000 0000000024b49000 E:\BOINC\slots\20\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000cdb50000 00000000030a5000 E:\BOINC\slots\20\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 00000000ae9a0000 00000000034b2000 E:\BOINC\slots\20\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 0000000038dc0000 000000001b3a4000 E:\BOINC\slots\20\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 0000000038c50000 0000000000010000 E:\BOINC\slots\20\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 00000000a5800000 000000000919f000 E:\BOINC\slots\20\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 00000000a1aa0000 0000000003d5b000 E:\BOINC\slots\20\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000db610000 0000000001eca000 E:\BOINC\slots\20\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000315b0000 0000000000045000 E:\BOINC\slots\20\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000003ead0000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.546
ModLoad: 000000003b020000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.546
ModLoad: 000000003de40000 0000000000470000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 000000003d9e0000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1151
ModLoad: 000000003d9b0000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 000000003ce90000 0000000000033000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1566
ModLoad: 000000003d5a0000 0000000000068000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1566
ModLoad: 000000003d710000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 000000003ccd0000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.546
ModLoad: 000000003eba0000 0000000000744000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 000000003b220000 0000000000794000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 000000003e6f0000 0000000000354000 C:\WINDOWS\System32\combase.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 000000003cb50000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 000000003e570000 00000000000ad000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 000000003dde0000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 00000000f9690000 00000000002cd000 C:\WINDOWS\system32\nvcuda.dll (30.0.15.1215) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r512_08\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 30.0.15.1215
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.6.127 driver
Product Version : 30.0.15.1215
ModLoad: 00000000d8b60000 000000000169f000 C:\WINDOWS\system32\DriverStore\FileRepository\nvmdi.inf_amd64_2b01a28ee7b06750\nvcuda64.dll (30.0.15.1215) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r512_08\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 30.0.15.1215
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.6.127 driver
Product Version : 30.0.15.1215
ModLoad: 0000000035d20000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000035ce0000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.906 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.906
ModLoad: 0000000035b90000 0000000000148000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : drvstore.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1566
ModLoad: 000000003caa0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.546
ModLoad: 000000002f1f0000 0000000000768000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.15.1215) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r512_08\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 30.0.15.1215
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 30.0.15.1215
ModLoad: 00000000f09c0000 00000000008b3000 C:\WINDOWS\System32\DriverStore\FileRepository\nvmdi.inf_amd64_2b01a28ee7b06750\nvptxJitCompiler64.dll (30.0.15.1215) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 30.0.15.1215
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows PTX JIT Compiler
Product Version : 30.0.15.1215
ModLoad: 0000000032610000 0000000000009000 E:\BOINC\slots\20\caffe2_nvrtc.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000e9c80000 0000000000fca000 E:\BOINC\slots\20\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6.14.11.9000
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.89 NVRTC Library
Product Version : 6.14.11.9000
ModLoad: 000000003d920000 0000000000082000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.1415 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1415
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 6754, Write: 12208, Other 104530
- I/O Transfers Counters -
Read: 35873078, Write: -1928346309, Other 499818
- Paged Pool Usage -
QuotaPagedPoolUsage: 3538424, QuotaPeakPagedPoolUsage: 3538424
QuotaNonPagedPoolUsage: 58880, QuotaPeakNonPagedPoolUsage: 76288
- Virtual Memory Usage -
VirtualSize: 313581568, PeakVirtualSize: 1565364224
- Pagefile Usage -
PagefileUsage: 313581568, PeakPagefileUsage: 771026944
- Working Set Size -
WorkingSetSize: -1962024960, PeakWorkingSetSize: -1157771264, PageFaultCount: 41788161
*** Dump of thread ID 26044 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 54467216.000000
- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FF83D3990D2
- Registers -
rax=0000000000000000 rbx=0000000000000001 rcx=00000000a04c8c40 rdx=000000002bcfe5b0 rsi=0000000000000000 rdi=0000000000000000
r8=000000002bcfe5b0 r9=00000000a04c8c30 r10=0000000000000fff r11=0000000000000ff0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000003d3990d2 rsp=000000002bcfe588 rbp=0000000000000000
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
2bcfe580 a0249100 00000001 2bcfe5b0 2bcfe5b0 a04c8c30 KERNELBASE!DebugBreak+0x0
2bcfe9c0 a0249ce4 99400000 2bcfed24 00000000 00000318 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
2bcff920 a024a084 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
2bcff950 3e647034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
2bcff980 3fa22651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
2bcffa00 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 13776 (state: Ready): ***
- Information -
Status: Base Priority: Above Normal, Priority: Above Normal, , Kernel Time: 747187520.000000, User Time: 44081250304.000000, Wait Time: 54467212.000000
- Registers -
rax=0000000000000000 rbx=0000000000000006 rcx=000000003afd14d0 rdx=0000000039cc5598 rsi=000000002b5e1390 rdi=000000002b5e0db0
r8=0000000038dc0000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=000000002b5e12a0 r13=000000002b5e1390
r14=000000002b5e12a0 r15=0000000000000006 rip=0000000039cc559a rsp=000000002b5e0d38 rbp=000000002b5e1820
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
2b5e0d30 39ccaaa5 00000000 00000000 00000000 00000000 cudnn64_7!cudnnSetDropoutDescriptor+0x0
2b5e0d70 39e064f0 2b5e1900 00000006 00000000 00000000 cudnn64_7!cudnnSetDropoutDescriptor+0x0
2b5e1110 39ce04ed 00000000 3aa6dac0 3ae5ed00 3accf1b0 cudnn64_7!cudnnSetDropoutDescriptor+0x0
2b5e11d0 39ce0631 00000000 00000000 2b5e1858 00400000 cudnn64_7!cudnnSetDropoutDescriptor+0x0
2b5e1220 39ca6b7d 00000000 2b5e1820 2b5e17f8 00400000 cudnn64_7!cudnnSetDropoutDescriptor+0x0
2b5e1300 39ca7185 ea8b0410 2b5e18c8 2b5e17f8 2b5e1f88 cudnn64_7!cudnnSetDropoutDescriptor+0x0
2b5e16e0 39bc4098 0000035c 2b5e17cc 0000035c 00000024 cudnn64_7!cudnnSetDropoutDescriptor+0x0
2b5e19b0 39bc700e 39a51000 00000000 00000024 00000000 cudnn64_7!cudnnSetDropoutDescriptor+0x0
2b5e1aa0 39ac82ca ea8b0410 00000000 00000000 00000024 cudnn64_7!cudnnSetDropoutDescriptor+0x0
2b5e1b70 39ac62b3 39a16800 00000024 2b5e1db0 000002b3 cudnn64_7!cudnnSetAttnDescriptor+0x0
2b5e1cc0 39ac9536 39a16800 8f7f2060 00000000 00000000 cudnn64_7!cudnnSetAttnDescriptor+0x0
2b5e1dd0 39adb06f 000002b4 39a51000 00000000 00000000 cudnn64_7!cudnnSetAttnDescriptor+0x0
2b5e2280 39aceff1 2b5e4568 8f7f2060 00000005 edf286e0 cudnn64_7!cudnnSetRNNProjectionLayers+0x0
2b5e2420 39ad7d8e ee81ed00 00000000 edf286e0 2b5e26e8 cudnn64_7!cudnnSetRNNProjectionLayers+0x0
2b5e25c0 39aedcd3 00000000 00000000 81547670 2b5e26e0 cudnn64_7!cudnnSetRNNProjectionLayers+0x0
2b5e4750 56ee89fd ee82b9a0 39a00000 ee82b9a0 8f7f2060 cudnn64_7!cudnnRNNForwardTraining+0x0
2b5e4c30 56f425ea 2b5e4cf8 00000001 2b5e4cf8 00000001 torch_cuda!at::native::_cudnn_rnn+0x0
2b5e4d10 56f50cbf 2b5e5400 2b5e6c08 2b5e5d50 3f9fb86b torch_cuda!at::native::set_storage_cuda_+0x0
2b5e4df0 b78ab9fc 2b5e5400 00000000 f082bfd0 f082bfa0 torch_cuda!at::native::set_storage_cuda_+0x0
2b5e4f70 b78e31a2 00000001 b90567c2 2b5e4fa4 3f9fb86b torch_cpu!at::native::mkldnn_sigmoid_+0x0
2b5e5250 b8b92613 00000000 00000000 00000003 c4c2a088 torch_cpu!at::_cudnn_rnn+0x0
2b5e5750 b8ba080b b1436709 4cc62360 2b5e5880 00000004 torch_cpu!torch::autograd::NotImplemented::~NotImplemented+0x0
2b5e5830 b78ab9fc 2b5e5db0 b8cc5878 2b5e5990 d8b87a77 torch_cpu!torch::autograd::GraphRoot::apply+0x0
2b5e59b0 b78e31a2 edf2a130 00000000 b1436a99 57e0a3f0 torch_cpu!at::native::mkldnn_sigmoid_+0x0
2b5e5c90 56ee69a1 2b5e0001 00000001 00000004 00000004 torch_cpu!at::_cudnn_rnn+0x0
2b5e5e60 56ef0117 00000000 2b5e6c08 315b2e0d 2b5e5f80 torch_cuda!at::native::_use_cudnn_ctc_loss+0x0
2b5e5ef0 b763107b bc781ac0 2b5e6210 170d3e58 d8d57783 torch_cuda!at::native::_cudnn_rnn_flatten_weight+0x0
2b5e6160 b7663b16 00000001 2b5e6c08 00000080 61c8ee18 torch_cpu!at::native::fbgemm_pack_quantized_matrix+0x0
2b5e62f0 b79dae89 2b5e6368 00000001 2b5e6368 00000001 torch_cpu!at::native::gru+0x0
2b5e6380 b8cc9fa3 2b5e6480 00000001 2b5e6600 2b5e6c08 torch_cpu!at::zeros_out+0x0
2b5e6410 b79cdd35 316b1ea8 0ca1e570 00000000 316b1ea8 torch_cpu!torch::autograd::GraphRoot::apply+0x0
2b5e6490 b78a88ec bc7875c8 1abfe530 c6b13ec0 2b5e66b0 torch_cpu!at::zeros_out+0x0
2b5e6590 b791c1bb 0000000c 00000080 00000004 4cc62a00 torch_cpu!at::native::mkldnn_sigmoid_+0x0
2b5e6610 b9407294 2b5e6730 1abfe530 2b5e6720 2b5e68c8 torch_cpu!at::gru+0x0
2b5e6840 b94062ab 2b5e6be0 b783030e 2b5e6be0 2b5e6c08 torch_cpu!torch::nn::GRUImpl::forward_helper+0x0
2b5e6930 a0222621 0000000e 2b5e7640 00000000 316b1ea8 torch_cpu!torch::nn::GRUImpl::forward+0x0
2b5e6b30 a022705a 00000000 2b5e0000 2b5e0601 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::error+0x0
2b5e7030 a022b950 2b5e7130 2b5e7130 00000000 5a537170 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0
2b5ffdd0 a046c6f8 0cedec50 00000000 00000000 0cf09c70 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
2b5ffe10 3e647034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
2b5ffe40 3fa22651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
2b5ffec0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 3172 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 54467212.000000
- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=000000002bdff8b0 rsi=0000000000000000 rdi=000000000000000d
r8=000000002bdff558 r9=000000000d066df0 r10=0000000000000000 r11=0000000000000246 r12=0000000000000064 r13=000000002bdff8b0
r14=000000002bdff5b0 r15=0000000000000000 rip=000000003fa6d8c4 rsp=000000002bdff558 rbp=000000000d066df0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
2bdff550 3d31cb20 00000000 2b7f2000 3fb3a4d0 2b7f2000 ntdll!ZwWaitForMultipleObjects+0x0
2bdff840 3d31ca1e 0b0b2900 004e0049 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
2bdff880 d8d3d554 0d06a570 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0
2bdffac0 d8de58cd 00000000 0d066df0 00000000 00000000 nvcuda64!+0x0
2bdffb70 d8d3cf23 86342d7b 898e524e 0d694f50 00000000 nvcuda64!cuProfilerStop+0x0
2bdffba0 d90741e4 0d694f50 00000000 00000000 00000000 nvcuda64!+0x0
2bdffbd0 3e647034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
2bdffc00 3fa22651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
2bdffc80 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 28076 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 52977528.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=0000000000000094 rdx=0000000000000000 rsi=0000000000000000 rdi=0000000000000094
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=000000000d0a4180 r13=0000000000000000
r14=0000000000000094 r15=0000000000000000 rip=000000003fa6cdf4 rsp=000000002beff6b8 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
2beff6b0 3d2f1a5e 00000000 00001f80 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0
2beff750 d8f6596e 0d695670 00000000 00000000 00000094 KERNELBASE!WaitForSingleObjectEx+0x0
2beff990 d8d3cf23 00000000 0d695670 d8b60000 0d0d7d70 nvcuda64!cuProfilerStop+0x0
2beff9c0 d90741e4 0d695670 00000000 00000000 00000000 nvcuda64!+0x0
2beff9f0 3e647034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
2beffa20 3fa22651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
2beffaa0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 5000 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 354375008.000000, User Time: 13278125056.000000, Wait Time: 54467208.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000660740c8 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000660740c8
r8=000000002b8fd628 r9=000000002b8fcef8 r10=0000000000000038 r11=000000002b8fce70 r12=0000000000000000 r13=0000000000000000
r14=000000002b8ff940 r15=0000000066074078 rip=000000003fa70764 rsp=000000002b8ff918 rbp=000000002b8ff970
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
2b8ff910 3fa34021 2b8ffc10 00000000 2b8ffa10 00000000 ntdll!NtWaitForAlertByThreadId+0x0
2b8ff990 3d33cfa9 660740c0 660740b8 66074070 b90405b4 ntdll!RtlSleepConditionVariableSRW+0x0
2b8ff9d0 27ea2879 00000000 da67fe40 00000000 00000000 KERNELBASE!SleepConditionVariableSRW+0x0
2b8ffa00 27ea2b0a 10270d4b 00000000 2b8ffc10 660740b8 MSVCP140!std::_Winerror_message+0x0
2b8ffa30 b904064b 66074070 2b8ffb30 66074070 da67fe20 MSVCP140!_Cnd_wait+0x0
2b8ffa70 b90425b1 ed1adc20 ffffffff da67fe20 ffffffff torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
2b8ffd60 b9042471 bc566d10 2b8ffda0 bc566d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0
2b8ffdb0 b9039744 00080001 93f63a30 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0
2b8ffde0 3d631bb2 93f63a30 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0
2b8ffe10 3e647034 00000000 00000000 00000000 00000000 ucrtbase!_configthreadlocale+0x0
2b8ffe40 3fa22651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
2b8ffec0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)