Task 9922612
| Name | ParityModified-1636228029-9320-3-0_1 |
| Workunit | 6775660 |
| Created | 17 Dec 2021, 1:21:55 UTC |
| Sent | 17 Dec 2021, 4:06:37 UTC |
| Report deadline | 25 Dec 2021, 4:06:37 UTC |
| Received | 18 Dec 2021, 17:53:25 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | -529697949 (0xE06D7363) Unknown error code |
| Computer ID | 563 |
| Run time | 54 min 24 sec |
| CPU time | 51 min 49 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 5,442.56 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 2.10 GB |
| Peak swap size | 4.33 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
36 | Time: 2116.25 ms
[2021-12-18 18:43:02 main:574] : INFO : Epoch 1272 | loss: 0.0310363 | val_loss: 0.0311031 | Time: 2074.02 ms
[2021-12-18 18:43:04 main:574] : INFO : Epoch 1273 | loss: 0.0310441 | val_loss: 0.0311155 | Time: 2138.49 ms
[2021-12-18 18:43:06 main:574] : INFO : Epoch 1274 | loss: 0.0310435 | val_loss: 0.0311069 | Time: 2159.4 ms
[2021-12-18 18:43:09 main:574] : INFO : Epoch 1275 | loss: 0.0310404 | val_loss: 0.0311046 | Time: 2103.93 ms
[2021-12-18 18:43:11 main:574] : INFO : Epoch 1276 | loss: 0.0310437 | val_loss: 0.0311103 | Time: 2078.96 ms
[2021-12-18 18:43:13 main:574] : INFO : Epoch 1277 | loss: 0.0310391 | val_loss: 0.0311047 | Time: 2058.57 ms
[2021-12-18 18:43:15 main:574] : INFO : Epoch 1278 | loss: 0.0310452 | val_loss: 0.0310963 | Time: 2062.6 ms
[2021-12-18 18:43:17 main:574] : INFO : Epoch 1279 | loss: 0.0310426 | val_loss: 0.0311014 | Time: 2069.94 ms
[2021-12-18 18:43:19 main:574] : INFO : Epoch 1280 | loss: 0.0310409 | val_loss: 0.031094 | Time: 2121.52 ms
[2021-12-18 18:43:22 main:574] : INFO : Epoch 1281 | loss: 0.0310386 | val_loss: 0.0310922 | Time: 2151.6 ms
[2021-12-18 18:43:24 main:574] : INFO : Epoch 1282 | loss: 0.0310363 | val_loss: 0.0310957 | Time: 2131.61 ms
[2021-12-18 18:43:26 main:574] : INFO : Epoch 1283 | loss: 0.0310361 | val_loss: 0.0310978 | Time: 2105.78 ms
[2021-12-18 18:43:28 main:574] : INFO : Epoch 1284 | loss: 0.0310332 | val_loss: 0.0311027 | Time: 2087.81 ms
[2021-12-18 18:43:30 main:574] : INFO : Epoch 1285 | loss: 0.0310381 | val_loss: 0.0310938 | Time: 2041.91 ms
[2021-12-18 18:43:32 main:574] : INFO : Epoch 1286 | loss: 0.0310359 | val_loss: 0.0311031 | Time: 2099.73 ms
[2021-12-18 18:43:35 main:574] : INFO : Epoch 1287 | loss: 0.0310371 | val_loss: 0.0311136 | Time: 2107.99 ms
[2021-12-18 18:43:37 main:574] : INFO : Epoch 1288 | loss: 0.0310387 | val_loss: 0.0311016 | Time: 2128.62 ms
[2021-12-18 18:43:39 main:574] : INFO : Epoch 1289 | loss: 0.031035 | val_loss: 0.0310996 | Time: 2084.04 ms
[2021-12-18 18:43:41 main:574] : INFO : Epoch 1290 | loss: 0.0310373 | val_loss: 0.031103 | Time: 2050.75 ms
[2021-12-18 18:43:43 main:574] : INFO : Epoch 1291 | loss: 0.0310372 | val_loss: 0.031102 | Time: 2128.52 ms
[2021-12-18 18:43:45 main:574] : INFO : Epoch 1292 | loss: 0.0310358 | val_loss: 0.0311041 | Time: 2118.52 ms
[2021-12-18 18:43:48 main:574] : INFO : Epoch 1293 | loss: 0.0310349 | val_loss: 0.0311069 | Time: 2070.67 ms
[2021-12-18 18:43:50 main:574] : INFO : Epoch 1294 | loss: 0.0310389 | val_loss: 0.0311019 | Time: 2081.41 ms
[2021-12-18 18:43:52 main:574] : INFO : Epoch 1295 | loss: 0.0310438 | val_loss: 0.0310959 | Time: 2090.22 ms
[2021-12-18 18:43:54 main:574] : INFO : Epoch 1296 | loss: 0.0310406 | val_loss: 0.0311034 | Time: 2079.44 ms
[2021-12-18 18:43:56 main:574] : INFO : Epoch 1297 | loss: 0.0310405 | val_loss: 0.0311065 | Time: 2153.35 ms
[2021-12-18 18:43:59 main:574] : INFO : Epoch 1298 | loss: 0.0310783 | val_loss: 0.0311175 | Time: 2118.29 ms
[2021-12-18 18:44:01 main:574] : INFO : Epoch 1299 | loss: 0.0310745 | val_loss: 0.0310957 | Time: 2084.38 ms
[2021-12-18 18:44:03 main:574] : INFO : Epoch 1300 | loss: 0.0310617 | val_loss: 0.0310968 | Time: 2117.01 ms
[2021-12-18 18:44:05 main:574] : INFO : Epoch 1301 | loss: 0.0310549 | val_loss: 0.0310986 | Time: 2088.2 ms
[2021-12-18 18:44:07 main:574] : INFO : Epoch 1302 | loss: 0.0310479 | val_loss: 0.0311018 | Time: 2069.77 ms
[2021-12-18 18:44:09 main:574] : INFO : Epoch 1303 | loss: 0.0310449 | val_loss: 0.0310919 | Time: 2090.43 ms
[2021-12-18 18:44:12 main:574] : INFO : Epoch 1304 | loss: 0.0310471 | val_loss: 0.0310953 | Time: 2120.89 ms
[2021-12-18 18:44:14 main:574] : INFO : Epoch 1305 | loss: 0.0310496 | val_loss: 0.0311026 | Time: 2123 ms
[2021-12-18 18:44:16 main:574] : INFO : Epoch 1306 | loss: 0.0310463 | val_loss: 0.0310999 | Time: 2170.59 ms
[2021-12-18 18:44:18 main:574] : INFO : Epoch 1307 | loss: 0.0310467 | val_loss: 0.03109 | Time: 2142.67 ms
[2021-12-18 18:44:20 main:574] : INFO : Epoch 1308 | loss: 0.0310499 | val_loss: 0.0310913 | Time: 2066.08 ms
[2021-12-18 18:44:23 main:574] : INFO : Epoch 1309 | loss: 0.0310418 | val_loss: 0.0310955 | Time: 2121.58 ms
[2021-12-18 18:44:25 main:574] : INFO : Epoch 1310 | loss: 0.0310396 | val_loss: 0.0310987 | Time: 2102.05 ms
[2021-12-18 18:44:27 main:574] : INFO : Epoch 1311 | loss: 0.031039 | val_loss: 0.0310918 | Time: 2113.77 ms
[2021-12-18 18:44:29 main:574] : INFO : Epoch 1312 | loss: 0.0310348 | val_loss: 0.0310993 | Time: 2105.2 ms
[2021-12-18 18:44:31 main:574] : INFO : Epoch 1313 | loss: 0.0310401 | val_loss: 0.0311009 | Time: 2034.61 ms
[2021-12-18 18:44:33 main:574] : INFO : Epoch 1314 | loss: 0.0310435 | val_loss: 0.031089 | Time: 2105.45 ms
[2021-12-18 18:44:36 main:574] : INFO : Epoch 1315 | loss: 0.0310449 | val_loss: 0.031095 | Time: 2168.23 ms
[2021-12-18 18:44:38 main:574] : INFO : Epoch 1316 | loss: 0.0310516 | val_loss: 0.0310916 | Time: 2132.87 ms
[2021-12-18 18:44:40 main:574] : INFO : Epoch 1317 | loss: 0.0310463 | val_loss: 0.0310998 | Time: 2152.64 ms
[2021-12-18 18:44:42 main:574] : INFO : Epoch 1318 | loss: 0.0310406 | val_loss: 0.0310973 | Time: 2040.57 ms
[2021-12-18 18:44:44 main:574] : INFO : Epoch 1319 | loss: 0.0310376 | val_loss: 0.0310953 | Time: 2077.12 ms
[2021-12-18 18:44:47 main:574] : INFO : Epoch 1320 | loss: 0.0310336 | val_loss: 0.0310929 | Time: 2127.03 ms
[2021-12-18 18:44:49 main:574] : INFO : Epoch 1321 | loss: 0.0310312 | val_loss: 0.0311035 | Time: 2091.55 ms
[2021-12-18 18:44:51 main:574] : INFO : Epoch 1322 | loss: 0.0310316 | val_loss: 0.0310967 | Time: 2090.41 ms
[2021-12-18 18:44:53 main:574] : INFO : Epoch 1323 | loss: 0.0310325 | val_loss: 0.0310989 | Time: 2132.07 ms
[2021-12-18 18:44:55 main:574] : INFO : Epoch 1324 | loss: 0.0310319 | val_loss: 0.031095 | Time: 2145.48 ms
[2021-12-18 18:44:58 main:574] : INFO : Epoch 1325 | loss: 0.0310322 | val_loss: 0.0310931 | Time: 2138.55 ms
[2021-12-18 18:45:00 main:574] : INFO : Epoch 1326 | loss: 0.0310357 | val_loss: 0.0310885 | Time: 2151.2 ms
[2021-12-18 18:45:02 main:574] : INFO : Epoch 1327 | loss: 0.0310299 | val_loss: 0.0310923 | Time: 2082.35 ms
[2021-12-18 18:45:04 main:574] : INFO : Epoch 1328 | loss: 0.031032 | val_loss: 0.0310894 | Time: 2109.39 ms
[2021-12-18 18:45:06 main:574] : INFO : Epoch 1329 | loss: 0.0310311 | val_loss: 0.0311023 | Time: 2098.11 ms
[2021-12-18 18:45:08 main:574] : INFO : Epoch 1330 | loss: 0.0310302 | val_loss: 0.0310982 | Time: 2129.95 ms
[2021-12-18 18:45:11 main:574] : INFO : Epoch 1331 | loss: 0.0310317 | val_loss: 0.0310911 | Time: 2107.04 ms
[2021-12-18 18:45:13 main:574] : INFO : Epoch 1332 | loss: 0.0310332 | val_loss: 0.0310936 | Time: 2070.71 ms
[2021-12-18 18:45:15 main:574] : INFO : Epoch 1333 | loss: 0.0310359 | val_loss: 0.0310921 | Time: 2096.52 ms
[2021-12-18 18:45:17 main:574] : INFO : Epoch 1334 | loss: 0.0310374 | val_loss: 0.0311047 | Time: 2004.71 ms
[2021-12-18 18:45:19 main:574] : INFO : Epoch 1335 | loss: 0.0310384 | val_loss: 0.0311034 | Time: 2121.43 ms
[2021-12-18 18:45:21 main:574] : INFO : Epoch 1336 | loss: 0.0310406 | val_loss: 0.0310921 | Time: 2042.14 ms
[2021-12-18 18:45:23 main:574] : INFO : Epoch 1337 | loss: 0.0310358 | val_loss: 0.0310892 | Time: 2073.35 ms
[2021-12-18 18:45:25 main:574] : INFO : Epoch 1338 | loss: 0.0310342 | val_loss: 0.0310949 | Time: 2092.2 ms
[2021-12-18 18:45:28 main:574] : INFO : Epoch 1339 | loss: 0.0310348 | val_loss: 0.0310986 | Time: 2116.72 ms
[2021-12-18 18:45:30 main:574] : INFO : Epoch 1340 | loss: 0.0310336 | val_loss: 0.0311023 | Time: 2139.61 ms
[2021-12-18 18:45:32 main:574] : INFO : Epoch 1341 | loss: 0.0310335 | val_loss: 0.0311035 | Time: 2054.3 ms
[2021-12-18 18:45:34 main:574] : INFO : Epoch 1342 | loss: 0.0310315 | val_loss: 0.0311008 | Time: 2085.23 ms
[2021-12-18 18:45:36 main:574] : INFO : Epoch 1343 | loss: 0.0310342 | val_loss: 0.0310897 | Time: 2092.25 ms
[2021-12-18 18:45:38 main:574] : INFO : Epoch 1344 | loss: 0.0310338 | val_loss: 0.0310939 | Time: 2126.84 ms
[2021-12-18 18:45:41 main:574] : INFO : Epoch 1345 | loss: 0.0310323 | val_loss: 0.0310921 | Time: 2128.84 ms
[2021-12-18 18:45:43 main:574] : INFO : Epoch 1346 | loss: 0.0310348 | val_loss: 0.0310932 | Time: 2105.28 ms
[2021-12-18 18:45:45 main:574] : INFO : Epoch 1347 | loss: 0.0310312 | val_loss: 0.031096 | Time: 2102.51 ms
[2021-12-18 18:45:47 main:574] : INFO : Epoch 1348 | loss: 0.0310286 | val_loss: 0.0310933 | Time: 2072.09 ms
[2021-12-18 18:45:49 main:574] : INFO : Epoch 1349 | loss: 0.0310269 | val_loss: 0.0310981 | Time: 2087.43 ms
[2021-12-18 18:45:52 main:574] : INFO : Epoch 1350 | loss: 0.0310263 | val_loss: 0.0310944 | Time: 2087.94 ms
[2021-12-18 18:45:54 main:574] : INFO : Epoch 1351 | loss: 0.0310268 | val_loss: 0.0310935 | Time: 2084.79 ms
[2021-12-18 18:45:56 main:574] : INFO : Epoch 1352 | loss: 0.0310281 | val_loss: 0.0310954 | Time: 2107.99 ms
[2021-12-18 18:45:58 main:574] : INFO : Epoch 1353 | loss: 0.0310267 | val_loss: 0.0311056 | Time: 2121.6 ms
[2021-12-18 18:46:00 main:574] : INFO : Epoch 1354 | loss: 0.0310351 | val_loss: 0.0311036 | Time: 2126.95 ms
[2021-12-18 18:46:02 main:574] : INFO : Epoch 1355 | loss: 0.0315125 | val_loss: 0.0735857 | Time: 2055.24 ms
[2021-12-18 18:46:04 main:574] : INFO : Epoch 1356 | loss: 0.0434155 | val_loss: 0.0396891 | Time: 2093.82 ms
[2021-12-18 18:46:07 main:574] : INFO : Epoch 1357 | loss: 0.0339333 | val_loss: 0.0322438 | Time: 2134.88 ms
[2021-12-18 18:46:09 main:574] : INFO : Epoch 1358 | loss: 0.0316523 | val_loss: 0.0313363 | Time: 2019.74 ms
[2021-12-18 18:46:11 main:574] : INFO : Epoch 1359 | loss: 0.0313171 | val_loss: 0.0312964 | Time: 2065.72 ms
[2021-12-18 18:46:13 main:574] : INFO : Epoch 1360 | loss: 0.0312673 | val_loss: 0.03126 | Time: 2057.73 ms
[2021-12-18 18:46:15 main:574] : INFO : Epoch 1361 | loss: 0.0312567 | val_loss: 0.0312558 | Time: 2049.53 ms
[2021-12-18 18:46:17 main:574] : INFO : Epoch 1362 | loss: 0.0312551 | val_loss: 0.0312552 | Time: 2080.27 ms
[2021-12-18 18:46:19 main:574] : INFO : Epoch 1363 | loss: 0.0312531 | val_loss: 0.031254 | Time: 2111.33 ms
[2021-12-18 18:46:21 main:574] : INFO : Epoch 1364 | loss: 0.0312526 | val_loss: 0.0312547 | Time: 2119.73 ms
[2021-12-18 18:46:24 main:574] : INFO : Epoch 1365 | loss: 0.0312512 | val_loss: 0.0312518 | Time: 2093.39 ms
[2021-12-18 18:46:26 main:574] : INFO : Epoch 1366 | loss: 0.0312499 | val_loss: 0.0312505 | Time: 2103.88 ms
[2021-12-18 18:46:28 main:574] : INFO : Epoch 1367 | loss: 0.0312489 | val_loss: 0.0312493 | Time: 2031.17 ms
[2021-12-18 18:46:30 main:574] : INFO : Epoch 1368 | loss: 0.0312472 | val_loss: 0.0312486 | Time: 2086.14 ms
[2021-12-18 18:46:32 main:574] : INFO : Epoch 1369 | loss: 0.0312456 | val_loss: 0.0312452 | Time: 2069.12 ms
[2021-12-18 18:46:34 main:574] : INFO : Epoch 1370 | loss: 0.0312421 | val_loss: 0.0312412 | Time: 2087.33 ms
[2021-12-18 18:46:36 main:574] : INFO : Epoch 1371 | loss: 0.031237 | val_loss: 0.0312343 | Time: 2097.13 ms
[2021-12-18 18:46:38 main:574] : INFO : Epoch 1372 | loss: 0.0312309 | val_loss: 0.0312284 | Time: 2072.46 ms
[2021-12-18 18:46:41 main:574] : INFO : Epoch 1373 | loss: 0.0312253 | val_loss: 0.031222 | Time: 2107.52 ms
[2021-12-18 18:46:43 main:574] : INFO : Epoch 1374 | loss: 0.0312194 | val_loss: 0.0312168 | Time: 2072.13 ms
[2021-12-18 18:46:45 main:574] : INFO : Epoch 1375 | loss: 0.0312144 | val_loss: 0.0312134 | Time: 2115.05 ms
[2021-12-18 18:46:47 main:574] : INFO : Epoch 1376 | loss: 0.0312093 | val_loss: 0.0312058 | Time: 2036.97 ms
[2021-12-18 18:46:49 main:574] : INFO : Epoch 1377 | loss: 0.0312042 | val_loss: 0.0312007 | Time: 2058.24 ms
[2021-12-18 18:46:51 main:574] : INFO : Epoch 1378 | loss: 0.0311976 | val_loss: 0.031196 | Time: 2073 ms
[2021-12-18 18:46:53 main:574] : INFO : Epoch 1379 | loss: 0.0311902 | val_loss: 0.0311846 | Time: 2100.43 ms
[2021-12-18 18:46:56 main:574] : INFO : Epoch 1380 | loss: 0.0311807 | val_loss: 0.0311776 | Time: 2100.22 ms
[2021-12-18 18:46:58 main:574] : INFO : Epoch 1381 | loss: 0.031175 | val_loss: 0.0311696 | Time: 2055.79 ms
[2021-12-18 18:47:00 main:574] : INFO : Epoch 1382 | loss: 0.0311677 | val_loss: 0.0311717 | Time: 2056.6 ms
[2021-12-18 18:47:02 main:574] : INFO : Epoch 1383 | loss: 0.0311634 | val_loss: 0.0311603 | Time: 2100.33 ms
[2021-12-18 18:47:04 main:574] : INFO : Epoch 1384 | loss: 0.0311525 | val_loss: 0.031146 | Time: 2062.25 ms
[2021-12-18 18:47:06 main:574] : INFO : Epoch 1385 | loss: 0.0311369 | val_loss: 0.0311361 | Time: 2026.69 ms
[2021-12-18 18:47:08 main:574] : INFO : Epoch 1386 | loss: 0.0311317 | val_loss: 0.0311342 | Time: 2066.06 ms
[2021-12-18 18:47:10 main:574] : INFO : Epoch 1387 | loss: 0.0311265 | val_loss: 0.0311282 | Time: 2115.55 ms
[2021-12-18 18:47:13 main:574] : INFO : Epoch 1388 | loss: 0.0311226 | val_loss: 0.0311268 | Time: 2159.92 ms
[2021-12-18 18:47:15 main:574] : INFO : Epoch 1389 | loss: 0.0311203 | val_loss: 0.0311264 | Time: 2134.25 ms
[2021-12-18 18:47:17 main:574] : INFO : Epoch 1390 | loss: 0.0311196 | val_loss: 0.031129 | Time: 2133.96 ms
[2021-12-18 18:47:19 main:574] : INFO : Epoch 1391 | loss: 0.031116 | val_loss: 0.0311239 | Time: 2028.68 ms
[2021-12-18 18:47:21 main:574] : INFO : Epoch 1392 | loss: 0.031117 | val_loss: 0.031127 | Time: 2040.72 ms
[2021-12-18 18:47:23 main:574] : INFO : Epoch 1393 | loss: 0.0311171 | val_loss: 0.0311272 | Time: 2043.56 ms
[2021-12-18 18:47:25 main:574] : INFO : Epoch 1394 | loss: 0.0311134 | val_loss: 0.0311301 | Time: 2041.52 ms
[2021-12-18 18:47:27 main:574] : INFO : Epoch 1395 | loss: 0.0311107 | val_loss: 0.0311217 | Time: 2050.99 ms
[2021-12-18 18:47:30 main:574] : INFO : Epoch 1396 | loss: 0.0311093 | val_loss: 0.0311266 | Time: 2091.31 ms
[2021-12-18 18:47:32 main:574] : INFO : Epoch 1397 | loss: 0.0311149 | val_loss: 0.0311298 | Time: 2155.85 ms
[2021-12-18 18:47:34 main:574] : INFO : Epoch 1398 | loss: 0.0311154 | val_loss: 0.031123 | Time: 2097.33 ms
[2021-12-18 18:47:36 main:574] : INFO : Epoch 1399 | loss: 0.0311116 | val_loss: 0.0311208 | Time: 2078.64 ms
[2021-12-18 18:47:38 main:574] : INFO : Epoch 1400 | loss: 0.0311139 | val_loss: 0.031122 | Time: 2064.58 ms
[2021-12-18 18:47:40 main:574] : INFO : Epoch 1401 | loss: 0.0311166 | val_loss: 0.03112 | Time: 2071.93 ms
[2021-12-18 18:47:42 main:574] : INFO : Epoch 1402 | loss: 0.0311142 | val_loss: 0.0311235 | Time: 2058.24 ms
[2021-12-18 18:47:45 main:574] : INFO : Epoch 1403 | loss: 0.0311147 | val_loss: 0.0311259 | Time: 2086.51 ms
[2021-12-18 18:47:47 main:574] : INFO : Epoch 1404 | loss: 0.0311123 | val_loss: 0.0311189 | Time: 2074.99 ms
[2021-12-18 18:47:49 main:574] : INFO : Epoch 1405 | loss: 0.0311063 | val_loss: 0.0311153 | Time: 2051.63 ms
[2021-12-18 18:47:51 main:574] : INFO : Epoch 1406 | loss: 0.0311051 | val_loss: 0.031117 | Time: 2128.04 ms
[2021-12-18 18:47:53 main:574] : INFO : Epoch 1407 | loss: 0.0311056 | val_loss: 0.0311215 | Time: 2102.89 ms
[2021-12-18 18:47:55 main:574] : INFO : Epoch 1408 | loss: 0.031106 | val_loss: 0.0311133 | Time: 2125.83 ms
[2021-12-18 18:47:57 main:574] : INFO : Epoch 1409 | loss: 0.0311018 | val_loss: 0.0311135 | Time: 2107.27 ms
[2021-12-18 18:48:00 main:574] : INFO : Epoch 1410 | loss: 0.0311003 | val_loss: 0.0311108 | Time: 2064.03 ms
[2021-12-18 18:48:02 main:574] : INFO : Epoch 1411 | loss: 0.0310992 | val_loss: 0.0311217 | Time: 2050.89 ms
[2021-12-18 18:48:04 main:574] : INFO : Epoch 1412 | loss: 0.0310974 | val_loss: 0.0311132 | Time: 2051.34 ms
[2021-12-18 18:48:06 main:574] : INFO : Epoch 1413 | loss: 0.0310922 | val_loss: 0.0311182 | Time: 2154.6 ms
[2021-12-18 18:48:08 main:574] : INFO : Epoch 1414 | loss: 0.0310931 | val_loss: 0.0311078 | Time: 2071.07 ms
[2021-12-18 18:48:10 main:574] : INFO : Epoch 1415 | loss: 0.0310915 | val_loss: 0.031102 | Time: 2084.78 ms
[2021-12-18 18:48:12 main:574] : INFO : Epoch 1416 | loss: 0.0310831 | val_loss: 0.0311041 | Time: 2068.1 ms
[2021-12-18 18:48:15 main:574] : INFO : Epoch 1417 | loss: 0.0310804 | val_loss: 0.0311071 | Time: 2115.41 ms
[2021-12-18 18:48:17 main:574] : INFO : Epoch 1418 | loss: 0.0310781 | val_loss: 0.0311049 | Time: 2079.51 ms
[2021-12-18 18:48:19 main:574] : INFO : Epoch 1419 | loss: 0.0310759 | val_loss: 0.0311037 | Time: 2078.02 ms
[2021-12-18 18:48:21 main:574] : INFO : Epoch 1420 | loss: 0.0310747 | val_loss: 0.0310984 | Time: 2029.55 ms
[2021-12-18 18:48:23 main:574] : INFO : Epoch 1421 | loss: 0.0310758 | val_loss: 0.0311005 | Time: 1997.15 ms
[2021-12-18 18:48:25 main:574] : INFO : Epoch 1422 | loss: 0.0310746 | val_loss: 0.0311054 | Time: 2085.28 ms
[2021-12-18 18:48:27 main:574] : INFO : Epoch 1423 | loss: 0.0310771 | val_loss: 0.0310974 | Time: 2095.39 ms
[2021-12-18 18:48:29 main:574] : INFO : Epoch 1424 | loss: 0.031069 | val_loss: 0.0310968 | Time: 2099.86 ms
[2021-12-18 18:48:32 main:574] : INFO : Epoch 1425 | loss: 0.031067 | val_loss: 0.0310942 | Time: 2056.11 ms
[2021-12-18 18:48:34 main:574] : INFO : Epoch 1426 | loss: 0.0310664 | val_loss: 0.0311006 | Time: 2082.9 ms
[2021-12-18 18:48:36 main:574] : INFO : Epoch 1427 | loss: 0.0310638 | val_loss: 0.0310995 | Time: 2049.09 ms
[2021-12-18 18:48:38 main:574] : INFO : Epoch 1428 | loss: 0.031061 | val_loss: 0.0311067 | Time: 2079.3 ms
[2021-12-18 18:48:40 main:574] : INFO : Epoch 1429 | loss: 0.0310621 | val_loss: 0.0311057 | Time: 2052.48 ms
[2021-12-18 18:48:42 main:574] : INFO : Epoch 1430 | loss: 0.0310638 | val_loss: 0.031091 | Time: 2092.6 ms
[2021-12-18 18:48:44 main:574] : INFO : Epoch 1431 | loss: 0.031063 | val_loss: 0.0310962 | Time: 2105.56 ms
[2021-12-18 18:48:47 main:574] : INFO : Epoch 1432 | loss: 0.0310646 | val_loss: 0.0310959 | Time: 2116.99 ms
[2021-12-18 18:48:49 main:574] : INFO : Epoch 1433 | loss: 0.0310645 | val_loss: 0.0310952 | Time: 2081.03 ms
[2021-12-18 18:48:51 main:574] : INFO : Epoch 1434 | loss: 0.0310599 | val_loss: 0.0310921 | Time: 2104.2 ms
[2021-12-18 18:48:53 main:574] : INFO : Epoch 1435 | loss: 0.0310633 | val_loss: 0.0310906 | Time: 2071.19 ms
[2021-12-18 18:48:55 main:574] : INFO : Epoch 1436 | loss: 0.0310696 | val_loss: 0.0311005 | Time: 2081.52 ms
[2021-12-18 18:48:57 main:574] : INFO : Epoch 1437 | loss: 0.0310647 | val_loss: 0.0310922 | Time: 2079.24 ms
[2021-12-18 18:48:59 main:574] : INFO : Epoch 1438 | loss: 0.03106 | val_loss: 0.0310889 | Time: 2040.12 ms
[2021-12-18 18:49:02 main:574] : INFO : Epoch 1439 | loss: 0.0310597 | val_loss: 0.0310875 | Time: 2063 ms
[2021-12-18 18:49:04 main:574] : INFO : Epoch 1440 | loss: 0.0310584 | val_loss: 0.0310896 | Time: 2059.14 ms
[2021-12-18 18:49:06 main:574] : INFO : Epoch 1441 | loss: 0.0310556 | val_loss: 0.0310879 | Time: 2068.77 ms
[2021-12-18 18:49:08 main:574] : INFO : Epoch 1442 | loss: 0.0310525 | val_loss: 0.0310938 | Time: 2178.16 ms
[2021-12-18 18:49:10 main:574] : INFO : Epoch 1443 | loss: 0.0310533 | val_loss: 0.0310873 | Time: 2069.37 ms
[2021-12-18 18:49:12 main:574] : INFO : Epoch 1444 | loss: 0.0310538 | val_loss: 0.0310859 | Time: 2075.9 ms
[2021-12-18 18:49:14 main:574] : INFO : Epoch 1445 | loss: 0.0310503 | val_loss: 0.0310879 | Time: 2120.56 ms
[2021-12-18 18:49:17 main:574] : INFO : Epoch 1446 | loss: 0.031051 | val_loss: 0.0310879 | Time: 2128.23 ms
[2021-12-18 18:49:19 main:574] : INFO : Epoch 1447 | loss: 0.031054 | val_loss: 0.0310906 | Time: 2048 ms
[2021-12-18 18:49:21 main:574] : INFO : Epoch 1448 | loss: 0.0310547 | val_loss: 0.0310893 | Time: 2088.57 ms
[2021-12-18 18:49:23 main:574] : INFO : Epoch 1449 | loss: 0.0310529 | val_loss: 0.0310904 | Time: 2071.25 ms
[2021-12-18 18:49:25 main:574] : INFO : Epoch 1450 | loss: 0.0310512 | val_loss: 0.0310894 | Time: 2095.21 ms
[2021-12-18 18:49:27 main:574] : INFO : Epoch 1451 | loss: 0.0310522 | val_loss: 0.0310835 | Time: 2113.31 ms
[2021-12-18 18:49:30 main:574] : INFO : Epoch 1452 | loss: 0.0310548 | val_loss: 0.0310964 | Time: 2097.49 ms
[2021-12-18 18:49:32 main:574] : INFO : Epoch 1453 | loss: 0.0310561 | val_loss: 0.0310918 | Time: 2073.17 ms
[2021-12-18 18:49:34 main:574] : INFO : Epoch 1454 | loss: 0.0310549 | val_loss: 0.0310887 | Time: 2104.55 ms
[2021-12-18 18:49:36 main:574] : INFO : Epoch 1455 | loss: 0.0310518 | val_loss: 0.0310931 | Time: 2132.4 ms
[2021-12-18 18:49:38 main:574] : INFO : Epoch 1456 | loss: 0.0310543 | val_loss: 0.0310929 | Time: 2115.07 ms
[2021-12-18 18:49:40 main:574] : INFO : Epoch 1457 | loss: 0.0310522 | val_loss: 0.0310928 | Time: 2106.68 ms
[2021-12-18 18:49:43 main:574] : INFO : Epoch 1458 | loss: 0.0310509 | val_loss: 0.0310953 | Time: 2115.41 ms
[2021-12-18 18:49:45 main:574] : INFO : Epoch 1459 | loss: 0.031054 | val_loss: 0.0310947 | Time: 2102.4 ms
[2021-12-18 18:49:47 main:574] : INFO : Epoch 1460 | loss: 0.0310585 | val_loss: 0.0310917 | Time: 2114.67 ms
[2021-12-18 18:49:49 main:574] : INFO : Epoch 1461 | loss: 0.0310547 | val_loss: 0.0310932 | Time: 2110.41 ms
[2021-12-18 18:49:51 main:574] : INFO : Epoch 1462 | loss: 0.0310543 | val_loss: 0.0310919 | Time: 2103.76 ms
[2021-12-18 18:49:53 main:574] : INFO : Epoch 1463 | loss: 0.0310567 | val_loss: 0.0310885 | Time: 2073.75 ms
[2021-12-18 18:49:55 main:574] : INFO : Epoch 1464 | loss: 0.0310541 | val_loss: 0.0310921 | Time: 2113.05 ms
[2021-12-18 18:49:58 main:574] : INFO : Epoch 1465 | loss: 0.0310554 | val_loss: 0.0310935 | Time: 2089.93 ms
[2021-12-18 18:50:00 main:574] : INFO : Epoch 1466 | loss: 0.0310536 | val_loss: 0.0310983 | Time: 2089.24 ms
[2021-12-18 18:50:02 main:574] : INFO : Epoch 1467 | loss: 0.0310504 | val_loss: 0.0310937 | Time: 2163.07 ms
[2021-12-18 18:50:04 main:574] : INFO : Epoch 1468 | loss: 0.0310583 | val_loss: 0.0310919 | Time: 2128.95 ms
[2021-12-18 18:50:06 main:574] : INFO : Epoch 1469 | loss: 0.0310644 | val_loss: 0.0310972 | Time: 2071.44 ms
[2021-12-18 18:50:08 main:574] : INFO : Epoch 1470 | loss: 0.0310627 | val_loss: 0.0310889 | Time: 2056.95 ms
[2021-12-18 18:50:10 main:574] : INFO : Epoch 1471 | loss: 0.0310603 | val_loss: 0.0310911 | Time: 2052.66 ms
[2021-12-18 18:50:13 main:574] : INFO : Epoch 1472 | loss: 0.0310605 | val_loss: 0.0310869 | Time: 2037.63 ms
[2021-12-18 18:50:15 main:574] : INFO : Epoch 1473 | loss: 0.0310613 | val_loss: 0.0310916 | Time: 2089.86 ms
[2021-12-18 18:50:17 main:574] : INFO : Epoch 1474 | loss: 0.0310599 | val_loss: 0.0310884 | Time: 2083.88 ms
[2021-12-18 18:50:19 main:574] : INFO : Epoch 1475 | loss: 0.0310623 | val_loss: 0.0310862 | Time: 2066.68 ms
[2021-12-18 18:50:21 main:574] : INFO : Epoch 1476 | loss: 0.0310539 | val_loss: 0.0310818 | Time: 2080.9 ms
[2021-12-18 18:50:23 main:574] : INFO : Epoch 1477 | loss: 0.0310583 | val_loss: 0.0310922 | Time: 2111.26 ms
[2021-12-18 18:50:25 main:574] : INFO : Epoch 1478 | loss: 0.0310544 | val_loss: 0.0310867 | Time: 2045.99 ms
[2021-12-18 18:50:27 main:574] : INFO : Epoch 1479 | loss: 0.0310561 | val_loss: 0.031085 | Time: 2045.58 ms
[2021-12-18 18:50:29 main:574] : INFO : Epoch 1480 | loss: 0.031053 | val_loss: 0.0310883 | Time: 2035.57 ms
[2021-12-18 18:50:32 main:574] : INFO : Epoch 1481 | loss: 0.0310517 | val_loss: 0.0310931 | Time: 2123.59 ms
[2021-12-18 18:50:34 main:574] : INFO : Epoch 1482 | loss: 0.0310487 | val_loss: 0.031084 | Time: 2070.22 ms
[2021-12-18 18:50:36 main:574] : INFO : Epoch 1483 | loss: 0.0310462 | val_loss: 0.0310934 | Time: 2082.66 ms
[2021-12-18 18:50:38 main:574] : INFO : Epoch 1484 | loss: 0.0310498 | val_loss: 0.0310964 | Time: 2056.79 ms
[2021-12-18 18:50:40 main:574] : INFO : Epoch 1485 | loss: 0.0310477 | val_loss: 0.0310973 | Time: 2133.62 ms
[2021-12-18 18:50:42 main:574] : INFO : Epoch 1486 | loss: 0.031052 | val_loss: 0.0310897 | Time: 2122.6 ms
[2021-12-18 18:50:44 main:574] : INFO : Epoch 1487 | loss: 0.0310475 | val_loss: 0.0310938 | Time: 2039.91 ms
[2021-12-18 18:50:47 main:574] : INFO : Epoch 1488 | loss: 0.0310507 | val_loss: 0.0310881 | Time: 2124.56 ms
[2021-12-18 18:50:49 main:574] : INFO : Epoch 1489 | loss: 0.0310483 | val_loss: 0.0310989 | Time: 2054.85 ms
[2021-12-18 18:50:51 main:574] : INFO : Epoch 1490 | loss: 0.031048 | val_loss: 0.031096 | Time: 2102.7 ms
[2021-12-18 18:50:53 main:574] : INFO : Epoch 1491 | loss: 0.0310509 | val_loss: 0.0310999 | Time: 2092.5 ms
[2021-12-18 18:50:55 main:574] : INFO : Epoch 1492 | loss: 0.0310473 | val_loss: 0.0310976 | Time: 2075.79 ms
[2021-12-18 18:50:57 main:574] : INFO : Epoch 1493 | loss: 0.0310475 | val_loss: 0.0310897 | Time: 2067.19 ms
[2021-12-18 18:51:00 main:574] : INFO : Epoch 1494 | loss: 0.0310508 | val_loss: 0.03108 | Time: 2041.94 ms
[2021-12-18 18:51:02 main:574] : INFO : Epoch 1495 | loss: 0.0310507 | val_loss: 0.0310825 | Time: 2057.58 ms
[2021-12-18 18:51:04 main:574] : INFO : Epoch 1496 | loss: 0.0310487 | val_loss: 0.0310783 | Time: 2011.61 ms
[2021-12-18 18:51:06 main:574] : INFO : Epoch 1497 | loss: 0.0310482 | val_loss: 0.0310838 | Time: 2077.86 ms
[2021-12-18 18:51:08 main:574] : INFO : Epoch 1498 | loss: 0.0310484 | val_loss: 0.0310894 | Time: 2039.38 ms
[2021-12-18 18:51:10 main:574] : INFO : Epoch 1499 | loss: 0.0310469 | val_loss: 0.0310879 | Time: 2123.86 ms
[2021-12-18 18:51:12 main:574] : INFO : Epoch 1500 | loss: 0.0310526 | val_loss: 0.0310853 | Time: 2094.19 ms
[2021-12-18 18:51:14 main:574] : INFO : Epoch 1501 | loss: 0.0310461 | val_loss: 0.0310865 | Time: 2070 ms
[2021-12-18 18:51:16 main:574] : INFO : Epoch 1502 | loss: 0.0310506 | val_loss: 0.0310815 | Time: 2043.53 ms
[2021-12-18 18:51:19 main:574] : INFO : Epoch 1503 | loss: 0.0310485 | val_loss: 0.0310832 | Time: 2081.52 ms
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFBF36C3B29
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 12/18/21 18:51:21
Install Directory : H:\Program Files\BOINC\
Data Directory : H:\ProgramData\BOINC
Project Symstore :
LoadLibraryA( H:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( H:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( H:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( H:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: H:\ProgramData\BOINC\slots\31;H:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 00000000d50e0000 00000000003df000 H:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000f6520000 00000000001f0000 C:\Windows\SYSTEM32\ntdll.dll (6.2.18362.1171) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.18362.1171 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.1171
ModLoad: 00000000f5020000 00000000000b2000 C:\Windows\System32\KERNEL32.DLL (6.2.18362.1110) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.18362.1110 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.1110
ModLoad: 00000000f3680000 00000000002a5000 C:\Windows\System32\KERNELBASE.dll (6.2.18362.1237) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.18362.1171 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.1171
ModLoad: 00000000f45d0000 0000000000194000 C:\Windows\System32\USER32.dll (6.2.18362.1256) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 00000000f45a0000 0000000000021000 C:\Windows\System32\win32u.dll (6.2.18362.1237) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.18362.1237 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1237
ModLoad: 00000000f4ff0000 0000000000026000 C:\Windows\System32\GDI32.dll (6.2.18362.1256) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.18362.1256 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1256
ModLoad: 00000000f3a30000 0000000000196000 C:\Windows\System32\gdi32full.dll (6.2.18362.1256) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.18362.1256 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1256
ModLoad: 00000000f4500000 000000000009e000 C:\Windows\System32\msvcp_win.dll (6.2.18362.1110) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.18362.1110 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1110
ModLoad: 00000000f3520000 00000000000fa000 C:\Windows\System32\ucrtbase.dll (6.2.18362.1110) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.18362.1110 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1110
ModLoad: 00000000f5d90000 00000000000a3000 C:\Windows\System32\ADVAPI32.dll (6.2.18362.752) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 00000000f63e0000 000000000009e000 C:\Windows\System32\msvcrt.dll (7.0.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.18362.1
ModLoad: 00000000f4ea0000 0000000000097000 C:\Windows\System32\sechost.dll (6.2.18362.1237) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 00000000f5e40000 0000000000120000 C:\Windows\System32\RPCRT4.dll (6.2.18362.1237) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 00000000e7380000 0000000000058000 H:\ProgramData\BOINC\slots\31\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000d0550000 0000000000091000 C:\Windows\SYSTEM32\MSVCP140.dll (14.27.29112.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.27.29112.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.27.29112.0
ModLoad: 00000000dd0a0000 00000000001f4000 C:\Windows\SYSTEM32\dbghelp.dll (6.2.18362.1049) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.18362.1049 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1049
ModLoad: 00000000f0610000 0000000000019000 C:\Windows\SYSTEM32\VCRUNTIME140.dll (14.27.29112.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.27.29112.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.27.29112.0
ModLoad: 00000000f0640000 000000000000c000 C:\Windows\SYSTEM32\VCRUNTIME140_1.dll (14.27.29112.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.27.29112.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.27.29112.0
ModLoad: 000000000bdd0000 000000000abe7000 H:\ProgramData\BOINC\slots\31\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000c75e0000 00000000002db000 H:\ProgramData\BOINC\slots\31\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000c1c80000 000000000020d000 H:\ProgramData\BOINC\slots\31\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 00000000dbda0000 0000000000040000 H:\ProgramData\BOINC\slots\31\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000003af10000 0000000024b49000 H:\ProgramData\BOINC\slots\31\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000effd0000 0000000000045000 H:\ProgramData\BOINC\slots\31\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000009b880000 00000000034b2000 H:\ProgramData\BOINC\slots\31\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 00000000f04d0000 0000000000010000 H:\ProgramData\BOINC\slots\31\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 0000000084180000 00000000030a5000 H:\ProgramData\BOINC\slots\31\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 0000000080420000 0000000003d5b000 H:\ProgramData\BOINC\slots\31\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000bbaf0000 0000000001eca000 H:\ProgramData\BOINC\slots\31\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 0000000063840000 000000000919f000 H:\ProgramData\BOINC\slots\31\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 000000001fb60000 000000001b3a4000 H:\ProgramData\BOINC\slots\31\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 00000000f3490000 0000000000081000 C:\Windows\System32\bcryptPrimitives.dll (6.2.18362.1237) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.18362.1237 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1237
ModLoad: 00000000f4d10000 000000000002e000 C:\Windows\System32\IMM32.DLL (6.2.18362.387) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.18362.387 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.387
ModLoad: 00000000f33f0000 0000000000011000 C:\Windows\System32\kernel.appcore.dll (6.2.18362.1171) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.18362.1171 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1171
ModLoad: 00000000f1990000 0000000000020000 C:\Windows\SYSTEM32\dxcore.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : DXCore.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 00000000f39e0000 000000000004a000 C:\Windows\System32\cfgmgr32.dll (6.2.18362.387) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.18362.387 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.387
ModLoad: 00000000f60a0000 0000000000336000 C:\Windows\System32\combase.dll (6.2.18362.1237) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 00000000f4790000 0000000000470000 C:\Windows\System32\Setupapi.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 00000000f3bf0000 0000000000026000 C:\Windows\System32\bcrypt.dll (6.2.18362.1237) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 00000000f31b0000 000000000002a000 C:\Windows\SYSTEM32\DEVOBJ.dll (6.2.18362.387) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.18362.387 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.387
ModLoad: 00000000f3620000 000000000005c000 C:\Windows\System32\WINTRUST.dll (6.2.18362.1237) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.18362.1237 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1237
ModLoad: 00000000f33d0000 0000000000012000 C:\Windows\System32\MSASN1.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 00000000f3c20000 0000000000149000 C:\Windows\System32\CRYPT32.dll (6.2.18362.592) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 00000000f55d0000 00000000006e7000 C:\Windows\System32\Shell32.dll (6.2.18362.1237) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.18362.900 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.900
ModLoad: 00000000f4f40000 00000000000a9000 C:\Windows\System32\shcore.dll (6.2.18362.1237) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 00000000f3d70000 0000000000781000 C:\Windows\System32\windows.storage.dll (6.2.18362.1171) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 00000000f3410000 0000000000023000 C:\Windows\System32\profapi.dll (6.2.18362.693) (-nosymbols- Symbols Loaded)
Linked PDB Filename : profapi.pdb
File Version : 10.0.18362.693 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.693
ModLoad: 00000000f3440000 000000000004a000 C:\Windows\System32\powrprof.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : powrprof.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 00000000f33c0000 0000000000010000 C:\Windows\System32\UMPDC.dll (-exported- Symbols Loaded)
Linked PDB Filename : UMPDC.pdb
ModLoad: 00000000f5f60000 0000000000052000 C:\Windows\System32\shlwapi.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 00000000f3bd0000 0000000000017000 C:\Windows\System32\cryptsp.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : cryptsp.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 00000000d4de0000 0000000000267000 C:\Windows\system32\nvcuda.dll (27.21.14.5709) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r456_87\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 27.21.14.5709
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.1.106 driver
Product Version : 27.21.14.5709
ModLoad: 00000000edcb0000 000000000000a000 C:\Windows\SYSTEM32\VERSION.DLL (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 00000000be060000 000000000152c000 C:\Windows\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_983b03c2be43c272\nvcuda64.dll (27.21.14.5709) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r456_87\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 27.21.14.5709
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.1.106 driver
Product Version : 27.21.14.5709
ModLoad: 00000000f6030000 000000000006f000 C:\Windows\System32\WS2_32.dll (6.2.18362.387) (-exported- Symbols Loaded)
Linked PDB Filename : ws2_32.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 00000000edae0000 000000000002f000 C:\Windows\SYSTEM32\cryptnet.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 00000000f27d0000 000000000000c000 C:\Windows\SYSTEM32\cryptbase.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 00000000f29f0000 0000000000099000 C:\Windows\system32\uxtheme.dll (6.2.18362.449) (-exported- Symbols Loaded)
Linked PDB Filename : UxTheme.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 00000000e1ba0000 00000000006d6000 C:\Windows\SYSTEM32\nvapi64.dll (27.21.14.5709) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r456_87\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 27.21.14.5709
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 27.21.14.5709
ModLoad: 00000000f5290000 0000000000157000 C:\Windows\System32\OLE32.DLL (6.2.18362.1082) (-exported- Symbols Loaded)
Linked PDB Filename : ole32.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 00000000f04b0000 0000000000009000 H:\ProgramData\BOINC\slots\31\caffe2_nvrtc.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000007a6b0000 0000000000fca000 H:\ProgramData\BOINC\slots\31\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6.14.11.9000
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.89 NVRTC Library
Product Version : 6.14.11.9000
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 5125, Write: 5566, Other 14348
- I/O Transfers Counters -
Read: 12697586, Write: 686146, Other 174252
- Paged Pool Usage -
QuotaPagedPoolUsage: 3536488, QuotaPeakPagedPoolUsage: 3552872
QuotaNonPagedPoolUsage: 59696, QuotaPeakNonPagedPoolUsage: 59832
- Virtual Memory Usage -
VirtualSize: 368734208, PeakVirtualSize: 994713600
- Pagefile Usage -
PagefileUsage: 368734208, PeakPagefileUsage: 369295360
- Working Set Size -
WorkingSetSize: -2033872896, PeakWorkingSetSize: -2033364992, PageFaultCount: 853064
*** Dump of thread ID 16916 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 4980937728.000000, User Time: 14492187648.000000, Wait Time: 1346383872.000000
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFBF36C3B29
- Registers -
rax=0000000000000009 rbx=000000003e98b320 rcx=0000000000000087 rdx=00000000c814cb10 rsi=0000000094ee4b40 rdi=0000000019930520
r8=0000000011d10000 r9=00000000ba7cce40 r10=0000000000000103 r11=00000000ba7cce40 r12=000000002381e200 r13=00000000cd61b900
r14=0000000023814800 r15=0000000000633450 rip=00000000f36c3b29 rsp=0000000094ee4660 rbp=0000000094ee48d0
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000206
- Callstack -
ChildEBP RetAddr Args to Child
94ee4730 f0616220 3e761fc8 3e7617f0 00000321 00000000 KERNELBASE!RaiseException+0x0
94ee4790 3dc88f53 3e75dbb8 39000000 94ee4938 38900000 VCRUNTIME140!_CxxThrowException+0x0
94ee4c70 3dce25ea 94ee4d38 00000001 94ee4d38 00000001 torch_cuda!at::native::_cudnn_rnn+0x0
94ee4d50 3dcf0cbf 94ee5440 94ee6c38 94ee5d90 00000001 torch_cuda!at::native::set_storage_cuda_+0x0
94ee4e30 1181b9fc 94ee5440 94ee5b20 00000000 94ee4f48 torch_cuda!at::native::set_storage_cuda_+0x0
94ee4fb0 118531a2 94ee5340 00000001 00000000 00000000 torch_cpu!at::native::mkldnn_sigmoid_+0x0
94ee5290 12b02613 00000000 94ee5da0 94ee5da0 94ee53a0 torch_cpu!at::_cudnn_rnn+0x0
94ee5790 12b1080b 398b66e7 cc9c2860 94ee58c0 00000004 torch_cpu!torch::autograd::NotImplemented::~NotImplemented+0x0
94ee5870 1181b9fc 94ee5df0 be085a07 94ee5aa8 94ee5920 torch_cpu!torch::autograd::GraphRoot::apply+0x0
94ee59f0 118531a2 cb815380 00000000 398b6877 3ebaa3f0 torch_cpu!at::native::mkldnn_sigmoid_+0x0
94ee5cd0 3dc869a1 94ee0001 00000001 00000004 00000004 torch_cpu!at::_cudnn_rnn+0x0
94ee5ea0 3dc90117 00000000 94ee6c38 effd2e0d 94ee5fc0 torch_cuda!at::native::_use_cudnn_ctc_loss+0x0
94ee5f30 115a107b 166f1ac0 94ee6250 b8f54504 13925040 torch_cuda!at::native::_cudnn_rnn_flatten_weight+0x0
94ee61a0 115d3b16 00000001 94ee6c38 00000080 cd61b278 torch_cpu!at::native::fbgemm_pack_quantized_matrix+0x0
94ee6330 1194ae89 94ee63a8 00000001 94ee63a8 00000001 torch_cpu!at::native::gru+0x0
94ee63c0 12c39fa3 94ee64c0 00000001 94ee6640 94ee6c38 torch_cpu!at::zeros_out+0x0
94ee6450 1193dd35 e73d1ea8 13266a20 00000000 e73d1ea8 torch_cpu!torch::autograd::GraphRoot::apply+0x0
94ee64d0 118188ec 166f75c8 74482bf0 9fb2ed30 94ee66f0 torch_cpu!at::zeros_out+0x0
94ee65d0 1188c1bb 0000000c 00000080 00000004 cc9c2700 torch_cpu!at::native::mkldnn_sigmoid_+0x0
94ee6650 13377294 94ee6770 74482bf0 94ee6760 94ee6908 torch_cpu!at::gru+0x0
94ee6880 133762ab 94ee6c18 117a030e 94ee6c18 94ee6c38 torch_cpu!torch::nn::GRUImpl::forward_helper+0x0
94ee6970 d50f2621 7a44dda0 d50f3f05 0000dd00 e73d1ea8 torch_cpu!torch::nn::GRUImpl::forward+0x0
94ee6b70 d50f7e98 00000000 94ee0000 00000601 94ee7620 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::error+0x0
94ee7010 d50fb964 94ee7110 94ee7110 00000000 5822b4b0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Object::unsafeRemoveSlot+0x0
94effdb0 d533c6f8 136f2730 00000000 00000000 13737ef0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
94effdf0 f5037c24 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
94effe20 f658d4d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
94effea0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 2800 (state: Waiting): ***
- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 1346383872.000000
- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000953ff970 rsi=0000000000000000 rdi=0000000000000064
r8=00000000953ff948 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000f65bcd74 rsp=00000000953ff948 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
953ff940 f36cfc21 953ffa08 00000000 00000000 00000000 ntdll!ZwDelayExecution+0x0
953ff9e0 d511a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0
953ffa10 f5037c24 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
953ffa40 f658d4d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
953ffac0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 12308 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 1346383872.000000
- Registers -
rax=000000000000005b rbx=000000000000000b rcx=000000000000000b rdx=00000000954ff9e0 rsi=0000000000000000 rdi=000000000000000b
r8=00000000139c55a0 r9=0000000000000000 r10=0000000000000000 r11=00000000954ff950 r12=0000000000000064 r13=00000000954ff9e0
r14=00000000954ff6d0 r15=0000000000000000 rip=00000000f65bd244 rsp=00000000954ff678 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
954ff670 f36d2ae7 f52b3880 f6593e54 00000000 94c46000 ntdll!NtWaitForMultipleObjects+0x0
954ff970 f36d29ce be554b48 11c227a0 0000000b 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
954ff9b0 be20bb54 138c50b0 00000000 138bdcd0 00000000 KERNELBASE!WaitForMultipleObjects+0x0
954ffbf0 be2a09ed 00000000 00000004 00000000 00000000 nvcuda64!+0x0
954ffca0 be20b523 29faa266 299f844c 13d6e310 00000000 nvcuda64!cuProfilerStop+0x0
954ffcd0 be51a750 13d6e310 00000000 00000000 00000000 nvcuda64!+0x0
954ffd00 f5037c24 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
954ffd30 f658d4d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
954ffdb0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 15116 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 1346383872.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002c8 rdx=0000000000000000 rsi=00000000955ff878 rdi=00000000000002c8
r8=00000000955ff888 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=000000001390ea70 r13=0000000000000000
r14=00000000000002c8 r15=0000000000000001 rip=00000000f65bc774 rsp=00000000955ff848 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
955ff840 f36c1e93 00000000 00000000 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0
955ff8e0 be41c0e7 00000000 f36add05 00000000 000002c8 KERNELBASE!WaitForSingleObjectEx+0x0
955ff950 be20b523 00000001 217a8aa0 13d6e3d0 00000000 nvcuda64!cuProfilerStop+0x0
955ff980 be51a750 13d6e3d0 00000000 00000000 00000000 nvcuda64!+0x0
955ff9b0 f5037c24 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
955ff9e0 f658d4d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
955ffa60 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 15656 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 1346383872.000000
- Registers -
rax=00000000000001ca rbx=0000000000000000 rcx=00000000139c8768 rdx=00000000956ffd38 rsi=00000000956ffca0 rdi=0000000000000000
r8=00000000000005b4 r9=0000000000000004 r10=0000000000000003 r11=00000000956ffcd0 r12=00000000956ffd38 r13=0000000000000000
r14=00000000139c8768 r15=0000000013b8acb8 rip=00000000f65c0024 rsp=00000000956ffc78 rbp=00000000956ffcd0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
956ffc70 f6580e95 00000102 00000102 00000000 956ffca0 ntdll!ZwWaitForAlertByThreadId+0x0
956ffce0 f36fc849 13b884a0 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0
956ffd10 be19223a 13b884a0 13b884a0 13b884a0 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0
956ffd70 be20b523 00000004 29cd5530 29cd5530 00000000 nvcuda64!+0x0
956ffda0 be51a750 13d6e250 00000000 00000000 00000000 nvcuda64!+0x0
956ffdd0 f5037c24 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
956ffe00 f658d4d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
956ffe80 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 12844 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 673281280.000000, User Time: 10945156096.000000, Wait Time: 1346383872.000000
- Registers -
rax=00000000000001ca rbx=0000000000000000 rcx=00000000adcd7898 rdx=0000000000000000 rsi=0000000000000000 rdi=0000000000000000
r8=0000000000000000 r9=00000000957f9b40 r10=0000000000000100 r11=0000000000000000 r12=0000000000000003 r13=00000000000001c0
r14=00000000adcd7848 r15=0000000000000000 rip=00000000f65c0024 rsp=00000000957ff898 rbp=00000000adcd7898
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
957ff890 f6580c10 957ff9c0 bad10e28 957ffc00 12fb092a ntdll!ZwWaitForAlertByThreadId+0x0
957ff900 f36aec8d adcd7840 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableSRW+0x0
957ff940 d058ba8d ba7e6aa0 ba7e6aa0 ba7e6aa0 00000000 KERNELBASE!SleepConditionVariableSRW+0x0
957ff980 d0562848 c7d6ea80 00000000 00000000 12fb05b4 MSVCP140!__crtSetThreadpoolWait+0x0
957ff9b0 d0562710 00000000 d0562f17 00000000 c7d6ea80 MSVCP140!std::_Winerror_message+0x0
957ffa20 12fb064b c7d6ea60 000001c0 adcd7840 adcd7840 MSVCP140!std::_Winerror_message+0x0
957ffa60 12fb25b1 cff543e0 ffffffff c7d6ea60 ffffffff torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
957ffd50 12fb2471 164d6d10 957ffd90 164d6d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0
957ffda0 12fa9744 00080001 cfedfc60 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0
957ffdd0 f35410b2 cfedfc60 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0
957ffe00 f5037c24 00000000 00000000 00000000 00000000 ucrtbase!_beginthreadex+0x0
957ffe30 f658d4d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
957ffeb0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)