Task 10421477
| Name | ParityModified-1639958701-31149-1-0_0 |
| Workunit | 7765033 |
| Created | 4 Jan 2022, 1:08:37 UTC |
| Sent | 17 Jan 2022, 19:05:06 UTC |
| Report deadline | 25 Jan 2022, 19:05:06 UTC |
| Received | 24 Jan 2022, 3:41:59 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | -529697949 (0xE06D7363) Unknown error code |
| Computer ID | 157 |
| Run time | 18 hours 14 min 10 sec |
| CPU time | 4 hours 40 min 22 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 4,474.06 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.62 GB |
| Peak swap size | 3.61 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
: 22386 ms
[2022-01-23 19:23:57 main:574] : INFO : Epoch 1275 | loss: 0.031103 | val_loss: 0.0311553 | Time: 20550.8 ms
[2022-01-23 19:24:13 main:574] : INFO : Epoch 1276 | loss: 0.0311039 | val_loss: 0.0311619 | Time: 16025.4 ms
[2022-01-23 19:24:29 main:574] : INFO : Epoch 1277 | loss: 0.031114 | val_loss: 0.0311562 | Time: 15938.9 ms
[2022-01-23 19:24:44 main:574] : INFO : Epoch 1278 | loss: 0.031111 | val_loss: 0.0311585 | Time: 15338.9 ms
[2022-01-23 19:25:00 main:574] : INFO : Epoch 1279 | loss: 0.0311057 | val_loss: 0.0311601 | Time: 15510.9 ms
[2022-01-23 19:25:16 main:574] : INFO : Epoch 1280 | loss: 0.0311041 | val_loss: 0.0311614 | Time: 16081.2 ms
[2022-01-23 19:25:31 main:574] : INFO : Epoch 1281 | loss: 0.0311025 | val_loss: 0.0311663 | Time: 15371.1 ms
[2022-01-23 19:25:47 main:574] : INFO : Epoch 1282 | loss: 0.0310987 | val_loss: 0.0311636 | Time: 16217.1 ms
[2022-01-23 19:26:03 main:574] : INFO : Epoch 1283 | loss: 0.0311054 | val_loss: 0.0311583 | Time: 15147.6 ms
[2022-01-23 19:26:19 main:574] : INFO : Epoch 1284 | loss: 0.0311105 | val_loss: 0.0311629 | Time: 16094.6 ms
[2022-01-23 19:26:34 main:574] : INFO : Epoch 1285 | loss: 0.0311125 | val_loss: 0.0311597 | Time: 15389.7 ms
[2022-01-23 19:26:50 main:574] : INFO : Epoch 1286 | loss: 0.0311124 | val_loss: 0.031165 | Time: 15406.1 ms
[2022-01-23 19:27:06 main:574] : INFO : Epoch 1287 | loss: 0.0311069 | val_loss: 0.0311667 | Time: 16571.6 ms
[2022-01-23 19:27:21 main:574] : INFO : Epoch 1288 | loss: 0.0311053 | val_loss: 0.0311706 | Time: 14718.6 ms
[2022-01-23 19:27:38 main:574] : INFO : Epoch 1289 | loss: 0.0311045 | val_loss: 0.0311651 | Time: 17127.4 ms
[2022-01-23 19:27:53 main:574] : INFO : Epoch 1290 | loss: 0.0311062 | val_loss: 0.0311687 | Time: 15390.4 ms
[2022-01-23 19:28:09 main:574] : INFO : Epoch 1291 | loss: 0.0311062 | val_loss: 0.0311634 | Time: 15812.3 ms
[2022-01-23 19:28:25 main:574] : INFO : Epoch 1292 | loss: 0.0311027 | val_loss: 0.0311608 | Time: 15574.5 ms
[2022-01-23 19:28:40 main:574] : INFO : Epoch 1293 | loss: 0.0311003 | val_loss: 0.0311631 | Time: 14682.2 ms
[2022-01-23 19:28:55 main:574] : INFO : Epoch 1294 | loss: 0.0311018 | val_loss: 0.0311588 | Time: 15550.3 ms
[2022-01-23 19:29:11 main:574] : INFO : Epoch 1295 | loss: 0.0311064 | val_loss: 0.0311635 | Time: 15587.3 ms
[2022-01-23 19:29:27 main:574] : INFO : Epoch 1296 | loss: 0.0311074 | val_loss: 0.0311693 | Time: 16107.2 ms
[2022-01-23 19:29:43 main:574] : INFO : Epoch 1297 | loss: 0.0311064 | val_loss: 0.0311638 | Time: 15538.7 ms
[2022-01-23 19:29:59 main:574] : INFO : Epoch 1298 | loss: 0.0311025 | val_loss: 0.0311603 | Time: 15734.3 ms
[2022-01-23 19:30:14 main:574] : INFO : Epoch 1299 | loss: 0.0311039 | val_loss: 0.0311571 | Time: 15320.1 ms
[2022-01-23 19:30:30 main:574] : INFO : Epoch 1300 | loss: 0.0311123 | val_loss: 0.0311628 | Time: 15676.4 ms
[2022-01-23 19:30:45 main:574] : INFO : Epoch 1301 | loss: 0.0311122 | val_loss: 0.0311575 | Time: 15788.7 ms
[2022-01-23 19:31:01 main:574] : INFO : Epoch 1302 | loss: 0.0311103 | val_loss: 0.0311558 | Time: 15547.7 ms
[2022-01-23 19:31:17 main:574] : INFO : Epoch 1303 | loss: 0.0311065 | val_loss: 0.0311598 | Time: 15887.5 ms
[2022-01-23 19:31:32 main:574] : INFO : Epoch 1304 | loss: 0.0311038 | val_loss: 0.0311624 | Time: 15164.8 ms
[2022-01-23 19:31:48 main:574] : INFO : Epoch 1305 | loss: 0.031102 | val_loss: 0.0311605 | Time: 16050.1 ms
[2022-01-23 19:32:04 main:574] : INFO : Epoch 1306 | loss: 0.0311031 | val_loss: 0.0311643 | Time: 15594.8 ms
[2022-01-23 19:32:20 main:574] : INFO : Epoch 1307 | loss: 0.0311061 | val_loss: 0.0311635 | Time: 15723.2 ms
[2022-01-23 19:32:35 main:574] : INFO : Epoch 1308 | loss: 0.0311028 | val_loss: 0.0311627 | Time: 15770.3 ms
[2022-01-23 19:32:50 main:574] : INFO : Epoch 1309 | loss: 0.0311018 | val_loss: 0.0311626 | Time: 14818.1 ms
[2022-01-23 19:33:06 main:574] : INFO : Epoch 1310 | loss: 0.0311009 | val_loss: 0.0311679 | Time: 15956.4 ms
[2022-01-23 19:33:22 main:574] : INFO : Epoch 1311 | loss: 0.0311093 | val_loss: 0.0311655 | Time: 15560.7 ms
[2022-01-23 19:33:38 main:574] : INFO : Epoch 1312 | loss: 0.0311122 | val_loss: 0.0311609 | Time: 16420.8 ms
[2022-01-23 19:33:54 main:574] : INFO : Epoch 1313 | loss: 0.0311082 | val_loss: 0.0311714 | Time: 15537.5 ms
[2022-01-23 19:34:09 main:574] : INFO : Epoch 1314 | loss: 0.0311103 | val_loss: 0.0311625 | Time: 15353.3 ms
[2022-01-23 19:34:25 main:574] : INFO : Epoch 1315 | loss: 0.0311106 | val_loss: 0.0311621 | Time: 15461.7 ms
[2022-01-23 19:34:40 main:574] : INFO : Epoch 1316 | loss: 0.0311207 | val_loss: 0.0311609 | Time: 15163.3 ms
[2022-01-23 19:34:56 main:574] : INFO : Epoch 1317 | loss: 0.0311252 | val_loss: 0.0311603 | Time: 15754.7 ms
[2022-01-23 19:35:11 main:574] : INFO : Epoch 1318 | loss: 0.0311261 | val_loss: 0.0311572 | Time: 15366 ms
[2022-01-23 19:35:27 main:574] : INFO : Epoch 1319 | loss: 0.0311239 | val_loss: 0.0311606 | Time: 15608 ms
[2022-01-23 19:35:42 main:574] : INFO : Epoch 1320 | loss: 0.0311242 | val_loss: 0.0311588 | Time: 15310.7 ms
[2022-01-23 19:35:58 main:574] : INFO : Epoch 1321 | loss: 0.0311192 | val_loss: 0.0311593 | Time: 15916.3 ms
[2022-01-23 19:36:14 main:574] : INFO : Epoch 1322 | loss: 0.0311334 | val_loss: 0.0311609 | Time: 15762.6 ms
[2022-01-23 19:36:30 main:574] : INFO : Epoch 1323 | loss: 0.0311354 | val_loss: 0.0311529 | Time: 15832.2 ms
[2022-01-23 19:36:45 main:574] : INFO : Epoch 1324 | loss: 0.0311282 | val_loss: 0.0311547 | Time: 15415 ms
[2022-01-23 19:37:01 main:574] : INFO : Epoch 1325 | loss: 0.0311253 | val_loss: 0.0311573 | Time: 15402.4 ms
[2022-01-23 19:37:17 main:574] : INFO : Epoch 1326 | loss: 0.0311231 | val_loss: 0.031153 | Time: 15924.4 ms
[2022-01-23 19:37:33 main:574] : INFO : Epoch 1327 | loss: 0.0311229 | val_loss: 0.03116 | Time: 15789.9 ms
[2022-01-23 19:37:49 main:574] : INFO : Epoch 1328 | loss: 0.0311265 | val_loss: 0.0311582 | Time: 15840.2 ms
[2022-01-23 19:38:04 main:574] : INFO : Epoch 1329 | loss: 0.0311209 | val_loss: 0.0311568 | Time: 15080.3 ms
[2022-01-23 19:38:20 main:574] : INFO : Epoch 1330 | loss: 0.0311186 | val_loss: 0.0311572 | Time: 15791 ms
[2022-01-23 19:38:35 main:574] : INFO : Epoch 1331 | loss: 0.0311202 | val_loss: 0.0311558 | Time: 15548.1 ms
[2022-01-23 19:38:51 main:574] : INFO : Epoch 1332 | loss: 0.031124 | val_loss: 0.0311604 | Time: 15796 ms
[2022-01-23 19:39:07 main:574] : INFO : Epoch 1333 | loss: 0.0311222 | val_loss: 0.0311603 | Time: 16061.4 ms
[2022-01-23 19:39:22 main:574] : INFO : Epoch 1334 | loss: 0.0311219 | val_loss: 0.0311633 | Time: 15395.8 ms
[2022-01-23 19:39:38 main:574] : INFO : Epoch 1335 | loss: 0.0311176 | val_loss: 0.0311557 | Time: 15640.6 ms
[2022-01-23 19:39:53 main:574] : INFO : Epoch 1336 | loss: 0.0311151 | val_loss: 0.0311552 | Time: 15223.8 ms
[2022-01-23 19:40:09 main:574] : INFO : Epoch 1337 | loss: 0.031113 | val_loss: 0.0311603 | Time: 15641.3 ms
[2022-01-23 19:40:26 main:574] : INFO : Epoch 1338 | loss: 0.0311119 | val_loss: 0.0311598 | Time: 16803.1 ms
[2022-01-23 19:40:42 main:574] : INFO : Epoch 1339 | loss: 0.0311108 | val_loss: 0.0311555 | Time: 15502.8 ms
[2022-01-23 19:40:57 main:574] : INFO : Epoch 1340 | loss: 0.0311124 | val_loss: 0.0311603 | Time: 15634.5 ms
[2022-01-23 19:41:12 main:574] : INFO : Epoch 1341 | loss: 0.0311185 | val_loss: 0.0311514 | Time: 14744.5 ms
[2022-01-23 19:41:28 main:574] : INFO : Epoch 1342 | loss: 0.031116 | val_loss: 0.0311513 | Time: 15850.2 ms
[2022-01-23 19:41:44 main:574] : INFO : Epoch 1343 | loss: 0.0311118 | val_loss: 0.0311522 | Time: 15802.8 ms
[2022-01-23 19:42:00 main:574] : INFO : Epoch 1344 | loss: 0.0311195 | val_loss: 0.0311544 | Time: 15859.1 ms
[2022-01-23 19:42:15 main:574] : INFO : Epoch 1345 | loss: 0.0311187 | val_loss: 0.031163 | Time: 15301.2 ms
[2022-01-23 19:42:31 main:574] : INFO : Epoch 1346 | loss: 0.031114 | val_loss: 0.0311611 | Time: 15472 ms
[2022-01-23 19:42:47 main:574] : INFO : Epoch 1347 | loss: 0.0311131 | val_loss: 0.0311633 | Time: 16310.6 ms
[2022-01-23 19:43:02 main:574] : INFO : Epoch 1348 | loss: 0.0311107 | val_loss: 0.0311594 | Time: 15424.9 ms
[2022-01-23 19:43:18 main:574] : INFO : Epoch 1349 | loss: 0.0311107 | val_loss: 0.0311579 | Time: 15944.1 ms
[2022-01-23 19:43:34 main:574] : INFO : Epoch 1350 | loss: 0.0311078 | val_loss: 0.0311535 | Time: 15319.3 ms
[2022-01-23 19:43:49 main:574] : INFO : Epoch 1351 | loss: 0.0311074 | val_loss: 0.0311656 | Time: 15604 ms
[2022-01-23 19:44:05 main:574] : INFO : Epoch 1352 | loss: 0.0311071 | val_loss: 0.0311608 | Time: 15604.9 ms
[2022-01-23 19:44:21 main:574] : INFO : Epoch 1353 | loss: 0.0311064 | val_loss: 0.0311602 | Time: 15673 ms
[2022-01-23 19:44:37 main:574] : INFO : Epoch 1354 | loss: 0.0311092 | val_loss: 0.0311589 | Time: 15901.6 ms
[2022-01-23 19:44:52 main:574] : INFO : Epoch 1355 | loss: 0.0311084 | val_loss: 0.0311579 | Time: 15088.2 ms
[2022-01-23 19:45:08 main:574] : INFO : Epoch 1356 | loss: 0.0311084 | val_loss: 0.0311646 | Time: 15717.1 ms
[2022-01-23 19:45:23 main:574] : INFO : Epoch 1357 | loss: 0.0311063 | val_loss: 0.031156 | Time: 15698.6 ms
[2022-01-23 19:45:40 main:574] : INFO : Epoch 1358 | loss: 0.0311063 | val_loss: 0.0311588 | Time: 16078.5 ms
[2022-01-23 19:45:55 main:574] : INFO : Epoch 1359 | loss: 0.0311113 | val_loss: 0.0311553 | Time: 15754.1 ms
[2022-01-23 19:46:11 main:574] : INFO : Epoch 1360 | loss: 0.0311106 | val_loss: 0.0311615 | Time: 15385.5 ms
[2022-01-23 19:46:26 main:574] : INFO : Epoch 1361 | loss: 0.0311082 | val_loss: 0.0311595 | Time: 15362.2 ms
[2022-01-23 19:46:42 main:574] : INFO : Epoch 1362 | loss: 0.0311132 | val_loss: 0.031159 | Time: 15276.6 ms
[2022-01-23 19:46:57 main:574] : INFO : Epoch 1363 | loss: 0.0311096 | val_loss: 0.0311507 | Time: 15633 ms
[2022-01-23 19:47:13 main:574] : INFO : Epoch 1364 | loss: 0.0311077 | val_loss: 0.031157 | Time: 15349.7 ms
[2022-01-23 19:47:28 main:574] : INFO : Epoch 1365 | loss: 0.0311114 | val_loss: 0.0311575 | Time: 15765 ms
[2022-01-23 19:47:44 main:574] : INFO : Epoch 1366 | loss: 0.0311061 | val_loss: 0.0311558 | Time: 15228.4 ms
[2022-01-23 19:48:00 main:574] : INFO : Epoch 1367 | loss: 0.0311037 | val_loss: 0.031155 | Time: 15926.1 ms
[2022-01-23 19:48:15 main:574] : INFO : Epoch 1368 | loss: 0.0311029 | val_loss: 0.0311606 | Time: 15368.4 ms
[2022-01-23 19:48:31 main:574] : INFO : Epoch 1369 | loss: 0.0311018 | val_loss: 0.0311625 | Time: 15608 ms
[2022-01-23 19:48:46 main:574] : INFO : Epoch 1370 | loss: 0.0310998 | val_loss: 0.0311601 | Time: 15543.2 ms
[2022-01-23 19:49:01 main:574] : INFO : Epoch 1371 | loss: 0.031105 | val_loss: 0.0311622 | Time: 15107.9 ms
[2022-01-23 19:49:18 main:574] : INFO : Epoch 1372 | loss: 0.0311108 | val_loss: 0.0311742 | Time: 16392.9 ms
[2022-01-23 19:49:33 main:574] : INFO : Epoch 1373 | loss: 0.0311174 | val_loss: 0.0311934 | Time: 15193 ms
[2022-01-23 19:49:49 main:574] : INFO : Epoch 1374 | loss: 0.0348584 | val_loss: 0.0325824 | Time: 15744.6 ms
[2022-01-23 19:50:05 main:574] : INFO : Epoch 1375 | loss: nan | val_loss: nan | Time: 15705.2 ms
[2022-01-23 19:50:21 main:574] : INFO : Epoch 1376 | loss: nan | val_loss: nan | Time: 15727.2 ms
[2022-01-23 19:50:36 main:574] : INFO : Epoch 1377 | loss: nan | val_loss: nan | Time: 15114.5 ms
[2022-01-23 19:50:52 main:574] : INFO : Epoch 1378 | loss: nan | val_loss: nan | Time: 15788.2 ms
[2022-01-23 19:51:07 main:574] : INFO : Epoch 1379 | loss: nan | val_loss: nan | Time: 15646.3 ms
[2022-01-23 19:51:25 main:574] : INFO : Epoch 1380 | loss: nan | val_loss: nan | Time: 17661.2 ms
[2022-01-23 19:51:43 main:574] : INFO : Epoch 1381 | loss: nan | val_loss: nan | Time: 18326.1 ms
[2022-01-23 19:51:59 main:574] : INFO : Epoch 1382 | loss: nan | val_loss: nan | Time: 16038.3 ms
[2022-01-23 19:52:15 main:574] : INFO : Epoch 1383 | loss: nan | val_loss: nan | Time: 15985.4 ms
[2022-01-23 19:52:31 main:574] : INFO : Epoch 1384 | loss: nan | val_loss: nan | Time: 15698 ms
[2022-01-23 19:52:47 main:574] : INFO : Epoch 1385 | loss: nan | val_loss: nan | Time: 15436.2 ms
[2022-01-23 19:53:02 main:574] : INFO : Epoch 1386 | loss: nan | val_loss: nan | Time: 15229.9 ms
[2022-01-23 19:53:18 main:574] : INFO : Epoch 1387 | loss: nan | val_loss: nan | Time: 15657.3 ms
[2022-01-23 19:53:33 main:574] : INFO : Epoch 1388 | loss: nan | val_loss: nan | Time: 15468.5 ms
[2022-01-23 19:53:49 main:574] : INFO : Epoch 1389 | loss: nan | val_loss: nan | Time: 16035.7 ms
[2022-01-23 19:54:05 main:574] : INFO : Epoch 1390 | loss: nan | val_loss: nan | Time: 15747.3 ms
[2022-01-23 19:54:21 main:574] : INFO : Epoch 1391 | loss: nan | val_loss: nan | Time: 16065 ms
[2022-01-23 19:54:36 main:574] : INFO : Epoch 1392 | loss: nan | val_loss: nan | Time: 15342.9 ms
[2022-01-23 19:54:52 main:574] : INFO : Epoch 1393 | loss: nan | val_loss: nan | Time: 15497.4 ms
[2022-01-23 19:55:08 main:574] : INFO : Epoch 1394 | loss: nan | val_loss: nan | Time: 16077.9 ms
[2022-01-23 19:55:23 main:574] : INFO : Epoch 1395 | loss: nan | val_loss: nan | Time: 15275 ms
[2022-01-23 19:55:39 main:574] : INFO : Epoch 1396 | loss: nan | val_loss: nan | Time: 15707.3 ms
[2022-01-23 19:55:54 main:574] : INFO : Epoch 1397 | loss: nan | val_loss: nan | Time: 14771.7 ms
[2022-01-23 19:56:10 main:574] : INFO : Epoch 1398 | loss: nan | val_loss: nan | Time: 15883.1 ms
[2022-01-23 19:56:25 main:574] : INFO : Epoch 1399 | loss: nan | val_loss: nan | Time: 15541.4 ms
[2022-01-23 19:56:41 main:574] : INFO : Epoch 1400 | loss: nan | val_loss: nan | Time: 15904 ms
[2022-01-23 19:56:57 main:574] : INFO : Epoch 1401 | loss: nan | val_loss: nan | Time: 15356.6 ms
[2022-01-23 19:57:12 main:574] : INFO : Epoch 1402 | loss: nan | val_loss: nan | Time: 15259.1 ms
[2022-01-23 19:57:28 main:574] : INFO : Epoch 1403 | loss: nan | val_loss: nan | Time: 15529.4 ms
[2022-01-23 19:57:43 main:574] : INFO : Epoch 1404 | loss: nan | val_loss: nan | Time: 15312.1 ms
[2022-01-23 19:58:00 main:574] : INFO : Epoch 1405 | loss: nan | val_loss: nan | Time: 16531.3 ms
[2022-01-23 19:58:15 main:574] : INFO : Epoch 1406 | loss: nan | val_loss: nan | Time: 15724.5 ms
[2022-01-23 19:58:31 main:574] : INFO : Epoch 1407 | loss: nan | val_loss: nan | Time: 15542 ms
[2022-01-23 19:58:46 main:574] : INFO : Epoch 1408 | loss: nan | val_loss: nan | Time: 15383.4 ms
[2022-01-23 19:59:02 main:574] : INFO : Epoch 1409 | loss: nan | val_loss: nan | Time: 15561.5 ms
[2022-01-23 19:59:18 main:574] : INFO : Epoch 1410 | loss: nan | val_loss: nan | Time: 15536.8 ms
[2022-01-23 19:59:33 main:574] : INFO : Epoch 1411 | loss: nan | val_loss: nan | Time: 15121.9 ms
[2022-01-23 19:59:48 main:574] : INFO : Epoch 1412 | loss: nan | val_loss: nan | Time: 15441.9 ms
[2022-01-23 20:00:03 main:574] : INFO : Epoch 1413 | loss: nan | val_loss: nan | Time: 14636.6 ms
[2022-01-23 20:00:20 main:574] : INFO : Epoch 1414 | loss: nan | val_loss: nan | Time: 16739.3 ms
[2022-01-23 20:00:35 main:574] : INFO : Epoch 1415 | loss: nan | val_loss: nan | Time: 15308 ms
[2022-01-23 20:00:51 main:574] : INFO : Epoch 1416 | loss: nan | val_loss: nan | Time: 15619.7 ms
[2022-01-23 20:01:06 main:574] : INFO : Epoch 1417 | loss: nan | val_loss: nan | Time: 15403.9 ms
[2022-01-23 20:01:22 main:574] : INFO : Epoch 1418 | loss: nan | val_loss: nan | Time: 15568.2 ms
[2022-01-23 20:01:37 main:574] : INFO : Epoch 1419 | loss: nan | val_loss: nan | Time: 15401.2 ms
[2022-01-23 20:01:53 main:574] : INFO : Epoch 1420 | loss: nan | val_loss: nan | Time: 15421.5 ms
[2022-01-23 20:02:08 main:574] : INFO : Epoch 1421 | loss: nan | val_loss: nan | Time: 15870.4 ms
[2022-01-23 20:02:24 main:574] : INFO : Epoch 1422 | loss: nan | val_loss: nan | Time: 15419.7 ms
[2022-01-23 20:02:40 main:574] : INFO : Epoch 1423 | loss: nan | val_loss: nan | Time: 16026.6 ms
[2022-01-23 20:02:55 main:574] : INFO : Epoch 1424 | loss: nan | val_loss: nan | Time: 15056.4 ms
[2022-01-23 20:03:11 main:574] : INFO : Epoch 1425 | loss: nan | val_loss: nan | Time: 16024.1 ms
[2022-01-23 20:03:27 main:574] : INFO : Epoch 1426 | loss: nan | val_loss: nan | Time: 15450.8 ms
[2022-01-23 20:03:42 main:574] : INFO : Epoch 1427 | loss: nan | val_loss: nan | Time: 15521.2 ms
[2022-01-23 20:03:58 main:574] : INFO : Epoch 1428 | loss: nan | val_loss: nan | Time: 15404.9 ms
[2022-01-23 20:04:13 main:574] : INFO : Epoch 1429 | loss: nan | val_loss: nan | Time: 15232.3 ms
[2022-01-23 20:04:29 main:574] : INFO : Epoch 1430 | loss: nan | val_loss: nan | Time: 16021.2 ms
[2022-01-23 20:04:44 main:574] : INFO : Epoch 1431 | loss: nan | val_loss: nan | Time: 14985.4 ms
[2022-01-23 20:05:00 main:574] : INFO : Epoch 1432 | loss: nan | val_loss: nan | Time: 16101.4 ms
[2022-01-23 20:05:16 main:574] : INFO : Epoch 1433 | loss: nan | val_loss: nan | Time: 15477.4 ms
[2022-01-23 20:05:31 main:574] : INFO : Epoch 1434 | loss: nan | val_loss: nan | Time: 15685 ms
[2022-01-23 20:05:47 main:574] : INFO : Epoch 1435 | loss: nan | val_loss: nan | Time: 15432.1 ms
[2022-01-23 20:06:03 main:574] : INFO : Epoch 1436 | loss: nan | val_loss: nan | Time: 15912.6 ms
[2022-01-23 20:06:19 main:574] : INFO : Epoch 1437 | loss: nan | val_loss: nan | Time: 15628.2 ms
[2022-01-23 20:06:34 main:574] : INFO : Epoch 1438 | loss: nan | val_loss: nan | Time: 15443.2 ms
[2022-01-23 20:06:50 main:574] : INFO : Epoch 1439 | loss: nan | val_loss: nan | Time: 15693.7 ms
[2022-01-23 20:07:06 main:574] : INFO : Epoch 1440 | loss: nan | val_loss: nan | Time: 15874.6 ms
[2022-01-23 20:07:22 main:574] : INFO : Epoch 1441 | loss: nan | val_loss: nan | Time: 15839.2 ms
[2022-01-23 20:07:37 main:574] : INFO : Epoch 1442 | loss: nan | val_loss: nan | Time: 15619.1 ms
[2022-01-23 20:07:53 main:574] : INFO : Epoch 1443 | loss: nan | val_loss: nan | Time: 15459.9 ms
[2022-01-23 20:08:08 main:574] : INFO : Epoch 1444 | loss: nan | val_loss: nan | Time: 15245.8 ms
[2022-01-23 20:08:23 main:574] : INFO : Epoch 1445 | loss: nan | val_loss: nan | Time: 15108.1 ms
[2022-01-23 20:08:39 main:574] : INFO : Epoch 1446 | loss: nan | val_loss: nan | Time: 15762.2 ms
[2022-01-23 20:08:55 main:574] : INFO : Epoch 1447 | loss: nan | val_loss: nan | Time: 15408.3 ms
[2022-01-23 20:09:11 main:574] : INFO : Epoch 1448 | loss: nan | val_loss: nan | Time: 16255.9 ms
[2022-01-23 20:09:26 main:574] : INFO : Epoch 1449 | loss: nan | val_loss: nan | Time: 15327.1 ms
[2022-01-23 20:09:43 main:574] : INFO : Epoch 1450 | loss: nan | val_loss: nan | Time: 16349.3 ms
[2022-01-23 20:09:59 main:574] : INFO : Epoch 1451 | loss: nan | val_loss: nan | Time: 15724.9 ms
[2022-01-23 20:10:14 main:574] : INFO : Epoch 1452 | loss: nan | val_loss: nan | Time: 15395.7 ms
[2022-01-23 20:10:31 main:574] : INFO : Epoch 1453 | loss: nan | val_loss: nan | Time: 16888.4 ms
[2022-01-23 20:10:46 main:574] : INFO : Epoch 1454 | loss: nan | val_loss: nan | Time: 15381.8 ms
[2022-01-23 20:11:02 main:574] : INFO : Epoch 1455 | loss: nan | val_loss: nan | Time: 15948.5 ms
[2022-01-23 20:11:18 main:574] : INFO : Epoch 1456 | loss: nan | val_loss: nan | Time: 15454.3 ms
[2022-01-23 20:11:33 main:574] : INFO : Epoch 1457 | loss: nan | val_loss: nan | Time: 15566.2 ms
[2022-01-23 20:11:50 main:574] : INFO : Epoch 1458 | loss: nan | val_loss: nan | Time: 16280 ms
[2022-01-23 20:12:06 main:574] : INFO : Epoch 1459 | loss: nan | val_loss: nan | Time: 15741.2 ms
[2022-01-23 20:12:21 main:574] : INFO : Epoch 1460 | loss: nan | val_loss: nan | Time: 15383.8 ms
[2022-01-23 20:12:37 main:574] : INFO : Epoch 1461 | loss: nan | val_loss: nan | Time: 16020.8 ms
[2022-01-23 20:12:53 main:574] : INFO : Epoch 1462 | loss: nan | val_loss: nan | Time: 15908.4 ms
[2022-01-23 20:13:09 main:574] : INFO : Epoch 1463 | loss: nan | val_loss: nan | Time: 15789.8 ms
[2022-01-23 20:13:24 main:574] : INFO : Epoch 1464 | loss: nan | val_loss: nan | Time: 14909.2 ms
[2022-01-23 20:13:39 main:574] : INFO : Epoch 1465 | loss: nan | val_loss: nan | Time: 15411.3 ms
[2022-01-23 20:13:55 main:574] : INFO : Epoch 1466 | loss: nan | val_loss: nan | Time: 15615.1 ms
[2022-01-23 20:14:11 main:574] : INFO : Epoch 1467 | loss: nan | val_loss: nan | Time: 16015.2 ms
[2022-01-23 20:14:27 main:574] : INFO : Epoch 1468 | loss: nan | val_loss: nan | Time: 15530.2 ms
[2022-01-23 20:14:43 main:574] : INFO : Epoch 1469 | loss: nan | val_loss: nan | Time: 15754.7 ms
[2022-01-23 20:14:58 main:574] : INFO : Epoch 1470 | loss: nan | val_loss: nan | Time: 15410.3 ms
[2022-01-23 20:15:14 main:574] : INFO : Epoch 1471 | loss: nan | val_loss: nan | Time: 15354.5 ms
[2022-01-23 20:15:29 main:574] : INFO : Epoch 1472 | loss: nan | val_loss: nan | Time: 15868.6 ms
[2022-01-23 20:15:45 main:574] : INFO : Epoch 1473 | loss: nan | val_loss: nan | Time: 15522 ms
[2022-01-23 20:16:01 main:574] : INFO : Epoch 1474 | loss: nan | val_loss: nan | Time: 15624 ms
[2022-01-23 20:16:16 main:574] : INFO : Epoch 1475 | loss: nan | val_loss: nan | Time: 15211.8 ms
[2022-01-23 20:16:32 main:574] : INFO : Epoch 1476 | loss: nan | val_loss: nan | Time: 15836.3 ms
[2022-01-23 20:16:47 main:574] : INFO : Epoch 1477 | loss: nan | val_loss: nan | Time: 15386.6 ms
[2022-01-23 20:17:03 main:574] : INFO : Epoch 1478 | loss: nan | val_loss: nan | Time: 15815.1 ms
[2022-01-23 20:17:19 main:574] : INFO : Epoch 1479 | loss: nan | val_loss: nan | Time: 15577.2 ms
[2022-01-23 20:17:34 main:574] : INFO : Epoch 1480 | loss: nan | val_loss: nan | Time: 15026.6 ms
[2022-01-23 20:17:50 main:574] : INFO : Epoch 1481 | loss: nan | val_loss: nan | Time: 15641.5 ms
[2022-01-23 20:18:05 main:574] : INFO : Epoch 1482 | loss: nan | val_loss: nan | Time: 15091.3 ms
[2022-01-23 20:18:21 main:574] : INFO : Epoch 1483 | loss: nan | val_loss: nan | Time: 15740.1 ms
[2022-01-23 20:18:36 main:574] : INFO : Epoch 1484 | loss: nan | val_loss: nan | Time: 15633.3 ms
[2022-01-23 20:18:52 main:574] : INFO : Epoch 1485 | loss: nan | val_loss: nan | Time: 15692.1 ms
[2022-01-23 20:19:08 main:574] : INFO : Epoch 1486 | loss: nan | val_loss: nan | Time: 15643.9 ms
[2022-01-23 20:19:23 main:574] : INFO : Epoch 1487 | loss: nan | val_loss: nan | Time: 15497 ms
[2022-01-23 20:19:39 main:574] : INFO : Epoch 1488 | loss: nan | val_loss: nan | Time: 15566.3 ms
[2022-01-23 20:19:55 main:574] : INFO : Epoch 1489 | loss: nan | val_loss: nan | Time: 15957.3 ms
[2022-01-23 20:20:11 main:574] : INFO : Epoch 1490 | loss: nan | val_loss: nan | Time: 15825.7 ms
[2022-01-23 20:20:26 main:574] : INFO : Epoch 1491 | loss: nan | val_loss: nan | Time: 15231 ms
[2022-01-23 20:20:42 main:574] : INFO : Epoch 1492 | loss: nan | val_loss: nan | Time: 15916.9 ms
[2022-01-23 20:20:57 main:574] : INFO : Epoch 1493 | loss: nan | val_loss: nan | Time: 15138.9 ms
[2022-01-23 20:21:13 main:574] : INFO : Epoch 1494 | loss: nan | val_loss: nan | Time: 15917.8 ms
[2022-01-23 20:21:29 main:574] : INFO : Epoch 1495 | loss: nan | val_loss: nan | Time: 15533.9 ms
[2022-01-23 20:21:44 main:574] : INFO : Epoch 1496 | loss: nan | val_loss: nan | Time: 15235.8 ms
[2022-01-23 20:22:00 main:574] : INFO : Epoch 1497 | loss: nan | val_loss: nan | Time: 15958 ms
[2022-01-23 20:22:16 main:574] : INFO : Epoch 1498 | loss: nan | val_loss: nan | Time: 15784.9 ms
[2022-01-23 20:22:32 main:574] : INFO : Epoch 1499 | loss: nan | val_loss: nan | Time: 15911.1 ms
[2022-01-23 20:22:48 main:574] : INFO : Epoch 1500 | loss: nan | val_loss: nan | Time: 15357.2 ms
[2022-01-23 20:23:03 main:574] : INFO : Epoch 1501 | loss: nan | val_loss: nan | Time: 15670.4 ms
[2022-01-23 20:23:18 main:574] : INFO : Epoch 1502 | loss: nan | val_loss: nan | Time: 15188.4 ms
[2022-01-23 20:23:34 main:574] : INFO : Epoch 1503 | loss: nan | val_loss: nan | Time: 15422.1 ms
[2022-01-23 20:23:52 main:574] : INFO : Epoch 1504 | loss: nan | val_loss: nan | Time: 17594.3 ms
[2022-01-23 20:24:14 main:574] : INFO : Epoch 1505 | loss: nan | val_loss: nan | Time: 21936.6 ms
[2022-01-23 20:24:34 main:574] : INFO : Epoch 1506 | loss: nan | val_loss: nan | Time: 20441 ms
[2022-01-23 20:24:53 main:574] : INFO : Epoch 1507 | loss: nan | val_loss: nan | Time: 18660.8 ms
[2022-01-23 20:25:08 main:574] : INFO : Epoch 1508 | loss: nan | val_loss: nan | Time: 15527.6 ms
[2022-01-23 20:25:24 main:574] : INFO : Epoch 1509 | loss: nan | val_loss: nan | Time: 15616.7 ms
[2022-01-23 20:25:39 main:574] : INFO : Epoch 1510 | loss: nan | val_loss: nan | Time: 15253.7 ms
[2022-01-23 20:25:54 main:574] : INFO : Epoch 1511 | loss: nan | val_loss: nan | Time: 14929 ms
[2022-01-23 20:26:10 main:574] : INFO : Epoch 1512 | loss: nan | val_loss: nan | Time: 15318.1 ms
[2022-01-23 20:26:25 main:574] : INFO : Epoch 1513 | loss: nan | val_loss: nan | Time: 15169.3 ms
[2022-01-23 20:26:40 main:574] : INFO : Epoch 1514 | loss: nan | val_loss: nan | Time: 15314.2 ms
[2022-01-23 20:26:56 main:574] : INFO : Epoch 1515 | loss: nan | val_loss: nan | Time: 15431.8 ms
[2022-01-23 20:27:12 main:574] : INFO : Epoch 1516 | loss: nan | val_loss: nan | Time: 16397.6 ms
[2022-01-23 20:27:28 main:574] : INFO : Epoch 1517 | loss: nan | val_loss: nan | Time: 15279 ms
[2022-01-23 20:27:43 main:574] : INFO : Epoch 1518 | loss: nan | val_loss: nan | Time: 15444.1 ms
[2022-01-23 20:27:59 main:574] : INFO : Epoch 1519 | loss: nan | val_loss: nan | Time: 15905.8 ms
[2022-01-23 20:28:15 main:574] : INFO : Epoch 1520 | loss: nan | val_loss: nan | Time: 15546.9 ms
[2022-01-23 20:28:30 main:574] : INFO : Epoch 1521 | loss: nan | val_loss: nan | Time: 15442.8 ms
[2022-01-23 20:28:45 main:574] : INFO : Epoch 1522 | loss: nan | val_loss: nan | Time: 14645.5 ms
[2022-01-23 20:29:01 main:574] : INFO : Epoch 1523 | loss: nan | val_loss: nan | Time: 15812.7 ms
[2022-01-23 20:29:16 main:574] : INFO : Epoch 1524 | loss: nan | val_loss: nan | Time: 15020.5 ms
[2022-01-23 20:29:32 main:574] : INFO : Epoch 1525 | loss: nan | val_loss: nan | Time: 15844 ms
[2022-01-23 20:29:47 main:574] : INFO : Epoch 1526 | loss: nan | val_loss: nan | Time: 15184.3 ms
[2022-01-23 20:30:02 main:574] : INFO : Epoch 1527 | loss: nan | val_loss: nan | Time: 15379.2 ms
[2022-01-23 20:30:18 main:574] : INFO : Epoch 1528 | loss: nan | val_loss: nan | Time: 15228.3 ms
[2022-01-23 20:30:33 main:574] : INFO : Epoch 1529 | loss: nan | val_loss: nan | Time: 15663.9 ms
[2022-01-23 20:30:49 main:574] : INFO : Epoch 1530 | loss: nan | val_loss: nan | Time: 15152.2 ms
[2022-01-23 20:31:04 main:574] : INFO : Epoch 1531 | loss: nan | val_loss: nan | Time: 15602.5 ms
[2022-01-23 20:31:19 main:574] : INFO : Epoch 1532 | loss: nan | val_loss: nan | Time: 14923.2 ms
[2022-01-23 20:31:35 main:574] : INFO : Epoch 1533 | loss: nan | val_loss: nan | Time: 15241.9 ms
[2022-01-23 20:31:50 main:574] : INFO : Epoch 1534 | loss: nan | val_loss: nan | Time: 15200.5 ms
[2022-01-23 20:32:05 main:574] : INFO : Epoch 1535 | loss: nan | val_loss: nan | Time: 15326.9 ms
[2022-01-23 20:32:21 main:574] : INFO : Epoch 1536 | loss: nan | val_loss: nan | Time: 15688.1 ms
[2022-01-23 20:32:36 main:574] : INFO : Epoch 1537 | loss: nan | val_loss: nan | Time: 14887.7 ms
[2022-01-23 20:32:52 main:574] : INFO : Epoch 1538 | loss: nan | val_loss: nan | Time: 15528.7 ms
[2022-01-23 20:33:07 main:574] : INFO : Epoch 1539 | loss: nan | val_loss: nan | Time: 15204.8 ms
[2022-01-23 20:33:23 main:574] : INFO : Epoch 1540 | loss: nan | val_loss: nan | Time: 15982.1 ms
[2022-01-23 20:33:38 main:574] : INFO : Epoch 1541 | loss: nan | val_loss: nan | Time: 15519.2 ms
[2022-01-23 20:33:54 main:574] : INFO : Epoch 1542 | loss: nan | val_loss: nan | Time: 15613.7 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1060 6GB)
[2022-01-23 20:41:16 main:435] : INFO : Set logging level to 1
[2022-01-23 20:41:16 main:441] : INFO : Running in BOINC Client mode
[2022-01-23 20:41:16 main:444] : INFO : Resolving all filenames
[2022-01-23 20:41:16 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-01-23 20:41:16 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-01-23 20:41:16 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-01-23 20:41:16 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-01-23 20:41:16 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-01-23 20:41:16 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-01-23 20:41:16 main:474] : INFO : Configuration:
[2022-01-23 20:41:16 main:475] : INFO : Model type: GRU
[2022-01-23 20:41:16 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-01-23 20:41:16 main:477] : INFO : Max Epochs: 2048
[2022-01-23 20:41:16 main:478] : INFO : Batch Size: 128
[2022-01-23 20:41:16 main:479] : INFO : Learning Rate: 0.01
[2022-01-23 20:41:16 main:480] : INFO : Patience: 10
[2022-01-23 20:41:17 main:481] : INFO : Hidden Width: 12
[2022-01-23 20:41:17 main:482] : INFO : # Recurrent Layers: 4
[2022-01-23 20:41:17 main:483] : INFO : # Backend Layers: 4
[2022-01-23 20:41:17 main:484] : INFO : # Threads: 1
[2022-01-23 20:41:17 main:486] : INFO : Preparing Dataset
[2022-01-23 20:41:17 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-01-23 20:41:17 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
[2022-01-23 20:41:21 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2022-01-23 20:41:21 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory
[2022-01-23 20:41:22 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory
[2022-01-23 20:41:22 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2022-01-23 20:41:22 main:494] : INFO : Creating Model
[2022-01-23 20:41:22 main:507] : INFO : Preparing config file
[2022-01-23 20:41:22 main:511] : INFO : Found checkpoint, attempting to load...
[2022-01-23 20:41:22 main:512] : INFO : Loading config
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FF828D04F69
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 01/23/22 20:41:22
Install Directory : D:\Program Files\
Data Directory : D:\ProgramData
Project Symstore :
LoadLibraryA( D:\ProgramData\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( D:\ProgramData\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( D:\ProgramData\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( D:\ProgramData\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: D:\ProgramData\slots\5;D:\ProgramData\projects\www.mlcathome.org_mlcathome
ModLoad: 00000000e1d90000 00000000003df000 D:\ProgramData\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000002b510000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1466
ModLoad: 000000002b2a0000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1466
ModLoad: 0000000028cd0000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1466
ModLoad: 00000000ea710000 00000000000c9000 C:\Program Files\Bitdefender\Bitdefender Security\bdhkm\dlls_265699272481876373\bdhkm64.dll (1.3.215.0) (-exported- Symbols Loaded)
Linked PDB Filename : E:\builds\BDHKM_DEFAULT_SOURCES\master\bin\x64\Release\bdhkm64\bdhkm64.pdb
File Version : 1.3.215.0 #0x17eeba6
Company Name : BitDefender S.R.L. Bucharest, ROMANIA
Product Name : BitDefender® AntiVirus
Product Version : 1
ModLoad: 00000000ea5f0000 0000000000111000 C:\Program Files\Bitdefender\Bitdefender Security\atcuf\dlls_265681087729559574\atcuf64.dll (1.45.321.0) (-exported- Symbols Loaded)
Linked PDB Filename : E:\builds\ATC-DEFAULT-SOURCES\bin\x64\Release\atcuf64\atcuf64.pdb
File Version : 1.45.321.0 #0xc1c07b8bc
Company Name : Bitdefender S.R.L. Bucharest, ROMANIA
Product Name : Bitdefender® ATC
Product Version : 4
ModLoad: 0000000029790000 00000000001a1000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000029360000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1466
ModLoad: 0000000029940000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.1202 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1202
ModLoad: 00000000290d0000 000000000010d000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1466
ModLoad: 0000000029030000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 0000000029260000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 000000002b130000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000029fd0000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.19041.546
ModLoad: 000000002b360000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000002a0d0000 0000000000125000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000fbfc0000 0000000000058000 D:\ProgramData\slots\5\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000a2320000 0000000024b49000 D:\ProgramData\slots\5\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000097730000 000000000abe7000 D:\ProgramData\slots\5\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000000d080000 000000000008e000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.30.30704.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\a01\_work\3\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.30.30704.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.30.30704.0
ModLoad: 000000001f850000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.867 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.867
ModLoad: 000000000d030000 000000000001b000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.30.30704.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\a01\_work\3\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.30.30704.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.30.30704.0
ModLoad: 000000000fda0000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.30.30704.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\a01\_work\3\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.30.30704.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.30.30704.0
ModLoad: 00000000fbf70000 0000000000045000 D:\ProgramData\slots\5\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000094680000 00000000030a5000 D:\ProgramData\slots\5\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 00000000911c0000 00000000034b2000 D:\ProgramData\slots\5\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 0000000075e10000 000000001b3a4000 D:\ProgramData\slots\5\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 0000000023000000 0000000000010000 D:\ProgramData\slots\5\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 0000000066590000 000000000919f000 D:\ProgramData\slots\5\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 00000000720b0000 0000000003d5b000 D:\ProgramData\slots\5\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000e15d0000 000000000020d000 D:\ProgramData\slots\5\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 00000000e12f0000 00000000002db000 D:\ProgramData\slots\5\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000701e0000 0000000001eca000 D:\ProgramData\slots\5\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 000000000b1f0000 0000000000040000 D:\ProgramData\slots\5\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000001e760000 000000000002c000 C:\WINDOWS\SYSTEM32\dbgcore.DLL (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : dbgcore.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 000000002af50000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000026b30000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000029b50000 0000000000472000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1237) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000029210000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1151
ModLoad: 00000000291e0000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000028950000 0000000000034000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1151
ModLoad: 00000000294f0000 0000000000060000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1466
ModLoad: 0000000029390000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000028790000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000002a710000 0000000000744000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.964 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.964
ModLoad: 0000000026d30000 0000000000795000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000002a3b0000 0000000000355000 C:\WINDOWS\System32\combase.dll (6.2.19041.1348) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.1320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1320
ModLoad: 00000000285a0000 000000000002e000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000029970000 00000000000ad000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1387) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000029af0000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000df450000 00000000002cc000 C:\WINDOWS\system32\nvcuda.dll (30.0.14.7247) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r470\r470_00\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 30.0.14.7247
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.4.158 driver
Product Version : 30.0.14.7247
ModLoad: 0000000021550000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000c9ac0000 00000000017e8000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispsi.inf_amd64_a316fd2790791cc1\nvcuda64.dll (30.0.14.7247) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r470\r470_00\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 30.0.14.7247
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.4.158 driver
Product Version : 30.0.14.7247
ModLoad: 0000000021c80000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.906 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.906
ModLoad: 000000001e0a0000 000000000014a000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : drvstore.pdb
File Version : 10.0.19041.1320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1320
ModLoad: 0000000028510000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000026650000 000000000009e000 C:\WINDOWS\system32\uxtheme.dll (6.2.19041.1266) (-exported- Symbols Loaded)
Linked PDB Filename : UxTheme.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000001cb00000 0000000000719000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.14.7247) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r470\r470_00\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 30.0.14.7247
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 30.0.14.7247
ModLoad: 0000000029640000 000000000012a000 C:\WINDOWS\System32\ole32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : ole32.pdb
File Version : 10.0.19041.1320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1320
ModLoad: 0000000028fa0000 0000000000082000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.1415 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1415
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 3638, Write: 308, Other 897
- I/O Transfers Counters -
Read: 6680853, Write: 6059, Other 38451
- Paged Pool Usage -
QuotaPagedPoolUsage: 3452040, QuotaPeakPagedPoolUsage: 3452040
QuotaNonPagedPoolUsage: 41952, QuotaPeakNonPagedPoolUsage: 41952
- Virtual Memory Usage -
VirtualSize: -1436504064, PeakVirtualSize: -826716160
- Pagefile Usage -
PagefileUsage: -1436504064, PeakPagefileUsage: -1436504064
- Working Set Size -
WorkingSetSize: 1156354048, PeakWorkingSetSize: 1156358144, PageFaultCount: 393865
*** Dump of thread ID 12372 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 9375000.000000, User Time: 25468750.000000, Wait Time: 27150544.000000
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FF828D04F69
- Registers -
rax=0000000000000000 rbx=00000000e20f4910 rcx=00000000ffffffff rdx=00000000902e6300 rsi=00000000902e6a10 rdi=0000000019930520
r8=000000006064db10 r9=0000000000000001 r10=000000002b53b86b r11=0000000004260185 r12=0000000016c03720 r13=00000000902e6c20
r14=000000003f710c20 r15=0000000000000000 rip=0000000028d04f69 rsp=00000000902e68b0 rbp=00000000902e6ba0
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202
- Callstack -
ChildEBP RetAddr Args to Child
902e6980 e200a884 00000040 0000004f 16c03300 00000563 KERNELBASE!RaiseException+0x0
902e69e0 e1db1ca6 5fc90000 902e6ab9 2dc40f70 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
902e6a90 e1db593b 00000000 00000030 00000020 00000008 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
902e6be0 e1db1a78 00000000 00000000 902e6f10 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
902e6cb0 e1db1cfc 902e6f10 00000000 00000080 902e71e0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
902e6d70 e1dbc4dd 902e71e0 902e71e0 902e71e0 902e71e0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
902e7060 e1dab2fe 902e7678 902e71e0 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
902ffe00 e1fec6f8 61fc3350 00000000 00000000 61bf09c0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
902ffe40 2b2b7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
902ffe70 2b562651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
902ffef0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 16456 (state: Waiting): ***
- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 27150536.000000
- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000904ffa90 rsi=0000000000000000 rdi=0000000000000064
r8=00000000904ffa68 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000002b5ad3f4 rsp=00000000904ffa68 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
904ffa60 28d1962e 904ffb28 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0
904ffb00 e1dca07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0
904ffb30 2b2b7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
904ffb60 2b562651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
904ffbe0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 18240 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 27150542.000000
- Registers -
rax=000000000000005b rbx=0000000000000006 rcx=0000000000000006 rdx=00000000905ff5c0 rsi=0000000000000000 rdi=0000000000000006
r8=00000000905ff268 r9=00000000621bca00 r10=0000000000000000 r11=0000000000000246 r12=0000000000000064 r13=00000000905ff5c0
r14=00000000905ff2c0 r15=0000000000000000 rip=000000002b5ad8c4 rsp=00000000905ff268 rbp=00000000621bca00
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
905ff260 28d1cb20 27970a50 ea7d0838 27930000 905ff688 ntdll!ZwWaitForMultipleObjects+0x0
905ff550 28d1ca1e ea7d0ec8 00000000 00000006 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
905ff590 c9c91324 621be380 ffffffff 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0
905ff7d0 c9d380dd 00000000 621bca00 00000000 00000000 nvcuda64!+0x0
905ff880 c9c90cf3 bc159450 b8ef8829 62b6e010 00000000 nvcuda64!cuProfilerStop+0x0
905ff8b0 c9fc6cf4 62b6e010 00000000 00000000 00000000 nvcuda64!+0x0
905ff8e0 2b2b7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
905ff910 2b562651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
905ff990 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 9408 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 27150522.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=000000006243df90 rdx=00000000906ffd08 rsi=00000000906ffc70 rdi=0000000000000000
r8=0000000000000001 r9=00000000000024c0 r10=0000000062442740 r11=00000000f1096f1d r12=00000000906ffd08 r13=0000000000000000
r14=000000006243df90 r15=0000000062442740 rip=000000002b5b0764 rsp=00000000906ffc48 rbp=00000000906ffca0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
906ffc40 2b574295 00000102 00000102 00000000 906ffc70 ntdll!NtWaitForAlertByThreadId+0x0
906ffcb0 28d3cdd9 6243ff20 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0
906ffce0 c9bff12c 6243ff20 6243ff20 6243ff20 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0
906ffd40 c9c90cf3 00000005 bb55c8be bbf11d4f 00000000 nvcuda64!+0x0
906ffd70 c9fc6cf4 62b6e100 00000000 00000000 00000000 nvcuda64!+0x0
906ffda0 2b2b7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
906ffdd0 2b562651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
906ffe50 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)