Task 3260602
| Name | EightBitModified-1605931394-15878-4_0 |
| Workunit | 1535388 |
| Created | 13 Dec 2020, 10:10:28 UTC |
| Sent | 15 Dec 2020, 4:22:55 UTC |
| Report deadline | 22 Dec 2020, 4:22:55 UTC |
| Received | 21 Dec 2020, 14:34:04 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 197 (0x000000C5) EXIT_TIME_LIMIT_EXCEEDED |
| Computer ID | 1756 |
| Run time | 3 hours 23 min 11 sec |
| CPU time | 3 hours 21 min 55 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 4,468.98 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.56 GB |
| Peak swap size | 2.65 GB |
| Peak disk usage | 1.53 GB |
Stderr output
<core_client_version>7.16.7</core_client_version>
<![CDATA[
<message>
exceeded elapsed time limit 12190.15 (1000000.00G/80.84G)</message>
<stderr_txt>
07251 | val_loss: 0.000416676 | Time: 30516.2 ms
[2020-12-21 07:05:20 main:574] : INFO : Epoch 226 | loss: 0.000449436 | val_loss: 0.000619371 | Time: 30601.5 ms
[2020-12-21 07:05:51 main:574] : INFO : Epoch 227 | loss: 0.000525704 | val_loss: 0.000479374 | Time: 30584.9 ms
[2020-12-21 07:06:21 main:574] : INFO : Epoch 228 | loss: 0.000446702 | val_loss: 0.000433761 | Time: 30569.6 ms
[2020-12-21 07:06:52 main:574] : INFO : Epoch 229 | loss: 0.000412033 | val_loss: 0.000420708 | Time: 30561.7 ms
[2020-12-21 07:07:22 main:574] : INFO : Epoch 230 | loss: 0.000411551 | val_loss: 0.000463424 | Time: 30512.5 ms
[2020-12-21 07:07:53 main:574] : INFO : Epoch 231 | loss: 0.00049303 | val_loss: 0.000452141 | Time: 30725.8 ms
[2020-12-21 07:08:24 main:574] : INFO : Epoch 232 | loss: 0.000418893 | val_loss: 0.000422264 | Time: 30444.3 ms
[2020-12-21 07:08:54 main:574] : INFO : Epoch 233 | loss: 0.000426457 | val_loss: 0.000514698 | Time: 30624.6 ms
[2020-12-21 07:09:25 main:574] : INFO : Epoch 234 | loss: 0.000450936 | val_loss: 0.000420115 | Time: 30652.3 ms
[2020-12-21 07:09:55 main:574] : INFO : Epoch 235 | loss: 0.000410462 | val_loss: 0.00042821 | Time: 30655.2 ms
[2020-12-21 07:10:26 main:574] : INFO : Epoch 236 | loss: 0.000545405 | val_loss: 0.000521767 | Time: 30316.1 ms
[2020-12-21 07:10:56 main:574] : INFO : Epoch 237 | loss: 0.000455871 | val_loss: 0.000446356 | Time: 30416.9 ms
[2020-12-21 07:11:27 main:574] : INFO : Epoch 238 | loss: 0.00044607 | val_loss: 0.000440625 | Time: 30416.6 ms
[2020-12-21 07:11:57 main:574] : INFO : Epoch 239 | loss: 0.000414419 | val_loss: 0.000428665 | Time: 30551 ms
[2020-12-21 07:12:28 main:574] : INFO : Epoch 240 | loss: 0.000518408 | val_loss: 0.000457487 | Time: 30472.6 ms
[2020-12-21 07:12:58 main:574] : INFO : Epoch 241 | loss: 0.000430447 | val_loss: 0.00043855 | Time: 30414.3 ms
[2020-12-21 07:13:29 main:574] : INFO : Epoch 242 | loss: 0.000436154 | val_loss: 0.000447722 | Time: 30810 ms
[2020-12-21 07:14:00 main:574] : INFO : Epoch 243 | loss: 0.000476599 | val_loss: 0.00045879 | Time: 30394 ms
[2020-12-21 07:14:30 main:574] : INFO : Epoch 244 | loss: 0.000437325 | val_loss: 0.000428087 | Time: 30493.6 ms
[2020-12-21 07:15:01 main:574] : INFO : Epoch 245 | loss: 0.000410045 | val_loss: 0.000416004 | Time: 30623.5 ms
[2020-12-21 07:15:32 main:574] : INFO : Epoch 246 | loss: 0.000459275 | val_loss: 0.000491325 | Time: 30726.8 ms
[2020-12-21 07:16:02 main:574] : INFO : Epoch 247 | loss: 0.000456395 | val_loss: 0.000428144 | Time: 30392.8 ms
[2020-12-21 07:16:33 main:574] : INFO : Epoch 248 | loss: 0.000410534 | val_loss: 0.000417197 | Time: 30913.7 ms
[2020-12-21 07:17:04 main:574] : INFO : Epoch 249 | loss: 0.000405091 | val_loss: 0.000436992 | Time: 30789.6 ms
[2020-12-21 07:17:34 main:574] : INFO : Epoch 250 | loss: 0.00053628 | val_loss: 0.000504525 | Time: 30480.1 ms
[2020-12-21 07:18:05 main:574] : INFO : Epoch 251 | loss: 0.000474435 | val_loss: 0.000465133 | Time: 30596.5 ms
[2020-12-21 07:18:35 main:574] : INFO : Epoch 252 | loss: 0.000418828 | val_loss: 0.000417641 | Time: 30329.1 ms
[2020-12-21 07:19:06 main:574] : INFO : Epoch 253 | loss: 0.000405082 | val_loss: 0.000424838 | Time: 30583.8 ms
[2020-12-21 07:19:36 main:574] : INFO : Epoch 254 | loss: 0.000539232 | val_loss: 0.000462836 | Time: 30657.6 ms
[2020-12-21 07:20:07 main:574] : INFO : Epoch 255 | loss: 0.000442357 | val_loss: 0.000433581 | Time: 30922.2 ms
[2020-12-21 07:20:38 main:574] : INFO : Epoch 256 | loss: 0.000419579 | val_loss: 0.000433478 | Time: 30710.4 ms
[2020-12-21 07:21:09 main:574] : INFO : Epoch 257 | loss: 0.000409833 | val_loss: 0.000413887 | Time: 30793.8 ms
[2020-12-21 07:21:40 main:574] : INFO : Epoch 258 | loss: 0.00043264 | val_loss: 0.000610144 | Time: 30610.7 ms
[2020-12-21 07:22:10 main:574] : INFO : Epoch 259 | loss: 0.000505895 | val_loss: 0.000453032 | Time: 30513.8 ms
[2020-12-21 07:22:41 main:574] : INFO : Epoch 260 | loss: 0.000420697 | val_loss: 0.000417239 | Time: 30412 ms
[2020-12-21 07:23:11 main:574] : INFO : Epoch 261 | loss: 0.000435764 | val_loss: 0.000620802 | Time: 30552.7 ms
[2020-12-21 07:23:42 main:574] : INFO : Epoch 262 | loss: 0.000499045 | val_loss: 0.000457047 | Time: 30877 ms
[2020-12-21 07:24:13 main:574] : INFO : Epoch 263 | loss: 0.000420535 | val_loss: 0.000421074 | Time: 30391.3 ms
[2020-12-21 07:24:43 main:574] : INFO : Epoch 264 | loss: 0.000407253 | val_loss: 0.000413808 | Time: 30952.5 ms
[2020-12-21 07:25:14 main:574] : INFO : Epoch 265 | loss: 0.000423237 | val_loss: 0.000597327 | Time: 30650.7 ms
[2020-12-21 07:25:45 main:574] : INFO : Epoch 266 | loss: 0.00054516 | val_loss: 0.00047366 | Time: 30753.6 ms
[2020-12-21 07:26:16 main:574] : INFO : Epoch 267 | loss: 0.000450512 | val_loss: 0.000435825 | Time: 30637 ms
[2020-12-21 07:26:46 main:574] : INFO : Epoch 268 | loss: 0.000411954 | val_loss: 0.000415529 | Time: 30476.3 ms
[2020-12-21 07:27:17 main:574] : INFO : Epoch 269 | loss: 0.00040408 | val_loss: 0.000416299 | Time: 30797.7 ms
[2020-12-21 07:27:48 main:574] : INFO : Epoch 270 | loss: 0.000590185 | val_loss: 0.000561347 | Time: 30771.7 ms
[2020-12-21 07:28:19 main:574] : INFO : Epoch 271 | loss: 0.000562081 | val_loss: 0.000498697 | Time: 30913.5 ms
[2020-12-21 07:28:50 main:574] : INFO : Epoch 272 | loss: 0.000442393 | val_loss: 0.000426748 | Time: 30815.7 ms
[2020-12-21 07:29:20 main:574] : INFO : Epoch 273 | loss: 0.000408702 | val_loss: 0.000415492 | Time: 30732.1 ms
[2020-12-21 07:29:51 main:574] : INFO : Epoch 274 | loss: 0.000402241 | val_loss: 0.00041301 | Time: 30752.5 ms
[2020-12-21 07:30:22 main:574] : INFO : Epoch 275 | loss: 0.000401405 | val_loss: 0.000414973 | Time: 30829 ms
[2020-12-21 07:30:53 main:574] : INFO : Epoch 276 | loss: 0.000521662 | val_loss: 0.000700745 | Time: 30803.7 ms
[2020-12-21 07:31:23 main:574] : INFO : Epoch 277 | loss: 0.000531913 | val_loss: 0.000455189 | Time: 30475.9 ms
[2020-12-21 07:31:54 main:574] : INFO : Epoch 278 | loss: 0.000423387 | val_loss: 0.000422629 | Time: 30766.1 ms
[2020-12-21 07:32:25 main:574] : INFO : Epoch 279 | loss: 0.00040566 | val_loss: 0.000415403 | Time: 30962 ms
[2020-12-21 07:32:56 main:574] : INFO : Epoch 280 | loss: 0.000402747 | val_loss: 0.000416707 | Time: 30710.9 ms
[2020-12-21 07:33:26 main:574] : INFO : Epoch 281 | loss: 0.000419736 | val_loss: 0.000434984 | Time: 30708.7 ms
[2020-12-21 07:33:57 main:574] : INFO : Epoch 282 | loss: 0.00041083 | val_loss: 0.000427005 | Time: 30607.8 ms
[2020-12-21 07:34:28 main:574] : INFO : Epoch 283 | loss: 0.000466224 | val_loss: 0.00060134 | Time: 30468.8 ms
[2020-12-21 07:34:58 main:574] : INFO : Epoch 284 | loss: 0.000474353 | val_loss: 0.000443802 | Time: 30691.5 ms
[2020-12-21 07:35:29 main:574] : INFO : Epoch 285 | loss: 0.000419071 | val_loss: 0.000418447 | Time: 30712.1 ms
[2020-12-21 07:35:59 main:574] : INFO : Epoch 286 | loss: 0.000408018 | val_loss: 0.000429909 | Time: 30361.1 ms
[2020-12-21 07:36:30 main:574] : INFO : Epoch 287 | loss: 0.000475332 | val_loss: 0.000463928 | Time: 30410.9 ms
[2020-12-21 07:37:00 main:574] : INFO : Epoch 288 | loss: 0.000464296 | val_loss: 0.000465992 | Time: 30689.5 ms
[2020-12-21 07:37:31 main:574] : INFO : Epoch 289 | loss: 0.000422413 | val_loss: 0.000420615 | Time: 30536.2 ms
[2020-12-21 07:38:02 main:574] : INFO : Epoch 290 | loss: 0.000530409 | val_loss: 0.000561634 | Time: 30674.5 ms
[2020-12-21 07:38:32 main:574] : INFO : Epoch 291 | loss: 0.000479763 | val_loss: 0.00047575 | Time: 30785.4 ms
[2020-12-21 07:39:03 main:574] : INFO : Epoch 292 | loss: 0.000481586 | val_loss: 0.000443268 | Time: 30599.8 ms
[2020-12-21 07:39:34 main:574] : INFO : Epoch 293 | loss: 0.000414848 | val_loss: 0.000417462 | Time: 30569.4 ms
[2020-12-21 07:40:04 main:574] : INFO : Epoch 294 | loss: 0.000505604 | val_loss: 0.000594072 | Time: 30557.5 ms
[2020-12-21 07:40:35 main:574] : INFO : Epoch 295 | loss: 0.000496727 | val_loss: 0.000483827 | Time: 30710.3 ms
[2020-12-21 07:41:06 main:574] : INFO : Epoch 296 | loss: 0.000428694 | val_loss: 0.000421107 | Time: 30638.9 ms
[2020-12-21 07:41:36 main:574] : INFO : Epoch 297 | loss: 0.000405745 | val_loss: 0.000413989 | Time: 30860.8 ms
[2020-12-21 07:42:07 main:574] : INFO : Epoch 298 | loss: 0.000404302 | val_loss: 0.000431061 | Time: 30863.9 ms
[2020-12-21 07:42:38 main:574] : INFO : Epoch 299 | loss: 0.000535428 | val_loss: 0.000594343 | Time: 30452.6 ms
[2020-12-21 07:43:08 main:574] : INFO : Epoch 300 | loss: 0.000488555 | val_loss: 0.000440546 | Time: 30524.4 ms
[2020-12-21 07:43:39 main:574] : INFO : Epoch 301 | loss: 0.000415543 | val_loss: 0.000417769 | Time: 30616.1 ms
[2020-12-21 07:44:10 main:574] : INFO : Epoch 302 | loss: 0.000403609 | val_loss: 0.000414072 | Time: 30673.9 ms
[2020-12-21 07:44:40 main:574] : INFO : Epoch 303 | loss: 0.000435543 | val_loss: 0.000491043 | Time: 30544.8 ms
[2020-12-21 07:45:11 main:574] : INFO : Epoch 304 | loss: 0.000427276 | val_loss: 0.000428171 | Time: 30443.5 ms
[2020-12-21 07:45:41 main:574] : INFO : Epoch 305 | loss: 0.000415354 | val_loss: 0.000447462 | Time: 30620 ms
[2020-12-21 07:46:12 main:574] : INFO : Epoch 306 | loss: 0.000443989 | val_loss: 0.000449073 | Time: 30523.4 ms
[2020-12-21 07:46:43 main:574] : INFO : Epoch 307 | loss: 0.000448796 | val_loss: 0.000419526 | Time: 30665.2 ms
[2020-12-21 07:47:13 main:574] : INFO : Epoch 308 | loss: 0.000417192 | val_loss: 0.000462145 | Time: 30640.8 ms
[2020-12-21 07:47:44 main:574] : INFO : Epoch 309 | loss: 0.000461785 | val_loss: 0.000462925 | Time: 30537.6 ms
[2020-12-21 07:48:14 main:574] : INFO : Epoch 310 | loss: 0.000419694 | val_loss: 0.000420538 | Time: 30655.2 ms
[2020-12-21 07:48:45 main:574] : INFO : Epoch 311 | loss: 0.000412297 | val_loss: 0.000438011 | Time: 30551.1 ms
[2020-12-21 07:49:16 main:574] : INFO : Epoch 312 | loss: 0.000527527 | val_loss: 0.00061697 | Time: 30486.9 ms
[2020-12-21 07:49:46 main:574] : INFO : Epoch 313 | loss: 0.000525644 | val_loss: 0.000463264 | Time: 30612.2 ms
[2020-12-21 07:50:17 main:574] : INFO : Epoch 314 | loss: 0.000426711 | val_loss: 0.000418749 | Time: 30521.8 ms
[2020-12-21 07:50:47 main:574] : INFO : Epoch 315 | loss: 0.000403182 | val_loss: 0.000413618 | Time: 30553.3 ms
[2020-12-21 07:51:18 main:574] : INFO : Epoch 316 | loss: 0.00040356 | val_loss: 0.000445066 | Time: 30750.6 ms
[2020-12-21 07:51:48 main:574] : INFO : Epoch 317 | loss: 0.000523454 | val_loss: 0.000550785 | Time: 30410.7 ms
[2020-12-21 07:52:19 main:574] : INFO : Epoch 318 | loss: 0.000450747 | val_loss: 0.000435512 | Time: 30855.1 ms
[2020-12-21 07:52:50 main:574] : INFO : Epoch 319 | loss: 0.000412779 | val_loss: 0.000421561 | Time: 30661.3 ms
[2020-12-21 07:53:21 main:574] : INFO : Epoch 320 | loss: 0.000445625 | val_loss: 0.000437975 | Time: 30679.2 ms
[2020-12-21 07:53:52 main:574] : INFO : Epoch 321 | loss: 0.000420197 | val_loss: 0.000419374 | Time: 30632.4 ms
[2020-12-21 07:54:22 main:574] : INFO : Epoch 322 | loss: 0.000404822 | val_loss: 0.000419857 | Time: 30832.5 ms
[2020-12-21 07:54:53 main:574] : INFO : Epoch 323 | loss: 0.000475457 | val_loss: 0.000489812 | Time: 30518.9 ms
[2020-12-21 07:55:23 main:574] : INFO : Epoch 324 | loss: 0.000436903 | val_loss: 0.000425354 | Time: 30288.6 ms
[2020-12-21 07:55:54 main:574] : INFO : Epoch 325 | loss: 0.000419124 | val_loss: 0.000495493 | Time: 30915 ms
[2020-12-21 07:56:25 main:574] : INFO : Epoch 326 | loss: 0.000479451 | val_loss: 0.000444012 | Time: 30522.3 ms
[2020-12-21 07:56:55 main:574] : INFO : Epoch 327 | loss: 0.000424619 | val_loss: 0.000465101 | Time: 30386 ms
[2020-12-21 07:57:26 main:574] : INFO : Epoch 328 | loss: 0.000468081 | val_loss: 0.000450958 | Time: 30786.4 ms
[2020-12-21 07:57:57 main:574] : INFO : Epoch 329 | loss: 0.000448702 | val_loss: 0.000429521 | Time: 30735.2 ms
[2020-12-21 07:58:27 main:574] : INFO : Epoch 330 | loss: 0.000410077 | val_loss: 0.00041217 | Time: 30849.9 ms
[2020-12-21 07:58:58 main:574] : INFO : Epoch 331 | loss: 0.000404123 | val_loss: 0.000442134 | Time: 30673.4 ms
[2020-12-21 07:59:29 main:574] : INFO : Epoch 332 | loss: 0.000662098 | val_loss: 0.000645331 | Time: 30900 ms
[2020-12-21 08:00:00 main:574] : INFO : Epoch 333 | loss: 0.000527188 | val_loss: 0.000466046 | Time: 31162.3 ms
[2020-12-21 08:00:31 main:574] : INFO : Epoch 334 | loss: 0.000427759 | val_loss: 0.000421631 | Time: 30442.3 ms
[2020-12-21 08:01:01 main:574] : INFO : Epoch 335 | loss: 0.000406199 | val_loss: 0.000412826 | Time: 30490.2 ms
[2020-12-21 08:01:32 main:574] : INFO : Epoch 336 | loss: 0.000402049 | val_loss: 0.000422018 | Time: 30694.9 ms
[2020-12-21 08:02:03 main:574] : INFO : Epoch 337 | loss: 0.000529932 | val_loss: 0.000510774 | Time: 30832 ms
[2020-12-21 08:02:33 main:574] : INFO : Epoch 338 | loss: 0.000474397 | val_loss: 0.000456118 | Time: 30421.1 ms
[2020-12-21 08:03:04 main:574] : INFO : Epoch 339 | loss: 0.000420603 | val_loss: 0.000417947 | Time: 30839.8 ms
[2020-12-21 08:03:35 main:574] : INFO : Epoch 340 | loss: 0.000402931 | val_loss: 0.000413868 | Time: 30578.1 ms
[2020-12-21 08:04:05 main:574] : INFO : Epoch 341 | loss: 0.000400735 | val_loss: 0.00041669 | Time: 30753.7 ms
[2020-12-21 08:04:36 main:574] : INFO : Epoch 342 | loss: 0.000557464 | val_loss: 0.000540037 | Time: 30673.8 ms
[2020-12-21 08:05:07 main:574] : INFO : Epoch 343 | loss: 0.000492198 | val_loss: 0.000451484 | Time: 30587.9 ms
[2020-12-21 08:05:37 main:574] : INFO : Epoch 344 | loss: 0.000422132 | val_loss: 0.000417663 | Time: 30738.9 ms
[2020-12-21 08:06:08 main:574] : INFO : Epoch 345 | loss: 0.000406486 | val_loss: 0.000413253 | Time: 30741.3 ms
[2020-12-21 08:06:39 main:574] : INFO : Epoch 346 | loss: 0.0004014 | val_loss: 0.000414735 | Time: 30345.7 ms
[2020-12-21 08:07:09 main:574] : INFO : Epoch 347 | loss: 0.00052089 | val_loss: 0.000535587 | Time: 30466.3 ms
[2020-12-21 08:07:40 main:574] : INFO : Epoch 348 | loss: 0.00045142 | val_loss: 0.000438087 | Time: 30729.5 ms
[2020-12-21 08:08:11 main:574] : INFO : Epoch 349 | loss: 0.000412973 | val_loss: 0.000414043 | Time: 30681.2 ms
[2020-12-21 08:08:41 main:574] : INFO : Epoch 350 | loss: 0.000400531 | val_loss: 0.000411231 | Time: 30755.6 ms
[2020-12-21 08:09:12 main:574] : INFO : Epoch 351 | loss: 0.000475351 | val_loss: 0.000540805 | Time: 30680.6 ms
[2020-12-21 08:09:43 main:574] : INFO : Epoch 352 | loss: 0.000507294 | val_loss: 0.000440481 | Time: 30700.8 ms
[2020-12-21 08:10:13 main:574] : INFO : Epoch 353 | loss: 0.000417941 | val_loss: 0.000419574 | Time: 30625.8 ms
[2020-12-21 08:10:44 main:574] : INFO : Epoch 354 | loss: 0.00040364 | val_loss: 0.000411386 | Time: 30612 ms
[2020-12-21 08:11:15 main:574] : INFO : Epoch 355 | loss: 0.000404629 | val_loss: 0.000428235 | Time: 30473.5 ms
[2020-12-21 08:11:45 main:574] : INFO : Epoch 356 | loss: 0.000554074 | val_loss: 0.000479606 | Time: 30632.3 ms
[2020-12-21 08:12:16 main:574] : INFO : Epoch 357 | loss: 0.00045258 | val_loss: 0.000431017 | Time: 30683.2 ms
[2020-12-21 08:12:47 main:574] : INFO : Epoch 358 | loss: 0.000414824 | val_loss: 0.000413499 | Time: 30910 ms
[2020-12-21 08:13:18 main:574] : INFO : Epoch 359 | loss: 0.000404638 | val_loss: 0.000416498 | Time: 30757.4 ms
[2020-12-21 08:13:48 main:574] : INFO : Epoch 360 | loss: 0.000433932 | val_loss: 0.00046592 | Time: 30673 ms
[2020-12-21 08:14:19 main:574] : INFO : Epoch 361 | loss: 0.000416309 | val_loss: 0.000424356 | Time: 30677.1 ms
[2020-12-21 08:14:50 main:574] : INFO : Epoch 362 | loss: 0.000435035 | val_loss: 0.000505103 | Time: 30818.1 ms
[2020-12-21 08:15:20 main:574] : INFO : Epoch 363 | loss: 0.000432605 | val_loss: 0.000432081 | Time: 30411.6 ms
[2020-12-21 08:15:51 main:574] : INFO : Epoch 364 | loss: 0.000477975 | val_loss: 0.000487605 | Time: 30732.1 ms
[2020-12-21 08:16:22 main:574] : INFO : Epoch 365 | loss: 0.000441979 | val_loss: 0.000429767 | Time: 30548.8 ms
[2020-12-21 08:16:52 main:574] : INFO : Epoch 366 | loss: 0.000441997 | val_loss: 0.000502786 | Time: 30608 ms
[2020-12-21 08:17:23 main:574] : INFO : Epoch 367 | loss: 0.00044672 | val_loss: 0.000431109 | Time: 30829.2 ms
[2020-12-21 08:17:54 main:574] : INFO : Epoch 368 | loss: 0.000410489 | val_loss: 0.00041518 | Time: 30958.9 ms
[2020-12-21 08:18:25 main:574] : INFO : Epoch 369 | loss: 0.000427017 | val_loss: 0.000509476 | Time: 30872.8 ms
[2020-12-21 08:18:56 main:574] : INFO : Epoch 370 | loss: 0.000439002 | val_loss: 0.000433634 | Time: 30647.6 ms
[2020-12-21 08:19:26 main:574] : INFO : Epoch 371 | loss: 0.000452642 | val_loss: 0.000439287 | Time: 30736.6 ms
[2020-12-21 08:19:57 main:574] : INFO : Epoch 372 | loss: 0.000414224 | val_loss: 0.000414923 | Time: 30837.9 ms
[2020-12-21 08:20:28 main:574] : INFO : Epoch 373 | loss: 0.000514496 | val_loss: 0.00049682 | Time: 30874.9 ms
[2020-12-21 08:20:59 main:574] : INFO : Epoch 374 | loss: 0.000480169 | val_loss: 0.000474023 | Time: 30543.2 ms
[2020-12-21 08:21:30 main:574] : INFO : Epoch 375 | loss: 0.000431642 | val_loss: 0.000423548 | Time: 30919.1 ms
[2020-12-21 08:22:00 main:574] : INFO : Epoch 376 | loss: 0.000424741 | val_loss: 0.000468467 | Time: 30489.3 ms
[2020-12-21 08:22:31 main:574] : INFO : Epoch 377 | loss: 0.000438727 | val_loss: 0.000425548 | Time: 30834.9 ms
[2020-12-21 08:23:02 main:574] : INFO : Epoch 378 | loss: 0.000441352 | val_loss: 0.000504203 | Time: 30798.8 ms
[2020-12-21 08:23:32 main:574] : INFO : Epoch 379 | loss: 0.000440202 | val_loss: 0.000421674 | Time: 30420.7 ms
[2020-12-21 08:24:03 main:574] : INFO : Epoch 380 | loss: 0.000406608 | val_loss: 0.00042742 | Time: 30744.7 ms
[2020-12-21 08:24:34 main:574] : INFO : Epoch 381 | loss: 0.000478973 | val_loss: 0.000444847 | Time: 30940.8 ms
[2020-12-21 08:25:05 main:574] : INFO : Epoch 382 | loss: 0.000426451 | val_loss: 0.000444756 | Time: 30705.7 ms
[2020-12-21 08:25:36 main:574] : INFO : Epoch 383 | loss: 0.000500348 | val_loss: 0.000495842 | Time: 30779.9 ms
[2020-12-21 08:26:06 main:574] : INFO : Epoch 384 | loss: 0.000438503 | val_loss: 0.000423153 | Time: 30666 ms
[2020-12-21 08:26:37 main:574] : INFO : Epoch 385 | loss: 0.000405529 | val_loss: 0.000411738 | Time: 30729.6 ms
[2020-12-21 08:27:08 main:574] : INFO : Epoch 386 | loss: 0.000399949 | val_loss: 0.000422039 | Time: 30582.7 ms
[2020-12-21 08:27:38 main:574] : INFO : Epoch 387 | loss: 0.000539689 | val_loss: 0.000507262 | Time: 30540.3 ms
[2020-12-21 08:28:09 main:574] : INFO : Epoch 388 | loss: 0.000446118 | val_loss: 0.000428423 | Time: 30660 ms
[2020-12-21 08:28:39 main:574] : INFO : Epoch 389 | loss: 0.000408058 | val_loss: 0.000411904 | Time: 30558.9 ms
[2020-12-21 08:29:10 main:574] : INFO : Epoch 390 | loss: 0.000401231 | val_loss: 0.000421724 | Time: 30754.2 ms
[2020-12-21 08:29:41 main:574] : INFO : Epoch 391 | loss: 0.000469246 | val_loss: 0.000486201 | Time: 30537.3 ms
[2020-12-21 08:30:11 main:574] : INFO : Epoch 392 | loss: 0.000562278 | val_loss: 0.00049271 | Time: 30669.2 ms
[2020-12-21 08:30:42 main:574] : INFO : Epoch 393 | loss: 0.000440665 | val_loss: 0.000435381 | Time: 30639.1 ms
[2020-12-21 08:31:13 main:574] : INFO : Epoch 394 | loss: 0.000410596 | val_loss: 0.00041505 | Time: 30726.6 ms
[2020-12-21 08:31:43 main:574] : INFO : Epoch 395 | loss: 0.000400505 | val_loss: 0.000410667 | Time: 30626 ms
[2020-12-21 08:32:14 main:574] : INFO : Epoch 396 | loss: 0.000401153 | val_loss: 0.000431364 | Time: 30561.7 ms
[2020-12-21 08:32:45 main:574] : INFO : Epoch 397 | loss: 0.000523232 | val_loss: 0.000474731 | Time: 30962.5 ms
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x000007FEFD290932
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 12/21/20 08:32:57
Install Directory : C:\Program Files\BOINC\
Data Directory : C:\ProgramData\BOINC
Project Symstore :
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\24;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 000000003fab0000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000077630000 000000000019f000 C:\Windows\SYSTEM32\ntdll.dll (6.1.7601.24545) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 6.1.7600.16385 (win7_rtm.090713-1255)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 6.1.7600.16385
ModLoad: 0000000077510000 000000000011f000 C:\Windows\system32\kernel32.dll (6.1.7601.24545) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 6.1.7601.18015 (win7sp1_gdr.121129-1432)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 6.1.7601.18015
ModLoad: 00000000fd260000 0000000000067000 C:\Windows\system32\KERNELBASE.dll (6.1.7601.24545) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 6.1.7601.18015 (win7sp1_gdr.121129-1432)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 6.1.7601.18015
ModLoad: 00000000f92e0000 0000000000058000 C:\ProgramData\BOINC\slots\24\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000f63b0000 000000000009e000 C:\Windows\system32\MSVCP140.dll (14.0.23026.0) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp140.amd64.pdb
File Version : 14.00.23026.0 built by: WCSETUP
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio® 2015
Product Version : 14.00.23026.0
ModLoad: 00000000faa40000 0000000000017000 C:\Windows\system32\VCRUNTIME140.dll (14.0.23026.0) (-exported- Symbols Loaded)
Linked PDB Filename : vcruntime140.amd64.pdb
File Version : 14.00.23026.0 built by: WCSETUP
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio® 2015
Product Version : 14.00.23026.0
ModLoad: 00000000fb7b0000 0000000000004000 C:\Windows\system32\api-ms-win-crt-runtime-l1-1-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
Linked PDB Filename : api-ms-win-crt-runtime-l1-1-0.pdb
File Version : 10.0.14393.2990 (rs1_release_1.190410-1803)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.14393.2990
ModLoad: 00000000f3ef0000 00000000000f4000 C:\Windows\system32\ucrtbase.DLL (10.0.14393.2990) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.14393.2990 (rs1_release_1.190410-1803)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.14393.2990
ModLoad: 00000000fab20000 0000000000003000 C:\Windows\system32\api-ms-win-core-timezone-l1-1-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
Linked PDB Filename : api-ms-win-core-timezone-l1-1-0.pdb
File Version : 10.0.14393.2990 (rs1_release_1.190410-1803)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.14393.2990
ModLoad: 00000000fb530000 0000000000003000 C:\Windows\system32\api-ms-win-core-file-l2-1-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
Linked PDB Filename : api-ms-win-core-file-l2-1-0.pdb
File Version : 10.0.14393.2990 (rs1_release_1.190410-1803)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.14393.2990
ModLoad: 00000000fab10000 0000000000003000 C:\Windows\system32\api-ms-win-core-localization-l1-2-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
Linked PDB Filename : api-ms-win-core-localization-l1-2-0.pdb
File Version : 10.0.14393.2990 (rs1_release_1.190410-1803)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.14393.2990
ModLoad: 00000000fc3e0000 0000000000003000 C:\Windows\system32\api-ms-win-core-synch-l1-2-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
Linked PDB Filename : api-ms-win-core-synch-l1-2-0.pdb
File Version : 10.0.14393.2990 (rs1_release_1.190410-1803)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.14393.2990
ModLoad: 00000000fab00000 0000000000003000 C:\Windows\system32\api-ms-win-core-processthreads-l1-1-1.dll (10.0.14393.2990) (-exported- Symbols Loaded)
Linked PDB Filename : api-ms-win-core-processthreads-l1-1-1.pdb
File Version : 10.0.14393.2990 (rs1_release_1.190410-1803)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.14393.2990
ModLoad: 00000000faaf0000 0000000000003000 C:\Windows\system32\api-ms-win-core-file-l1-2-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
Linked PDB Filename : api-ms-win-core-file-l1-2-0.pdb
File Version : 10.0.14393.2990 (rs1_release_1.190410-1803)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.14393.2990
ModLoad: 00000000faae0000 0000000000004000 C:\Windows\system32\api-ms-win-crt-string-l1-1-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
Linked PDB Filename : api-ms-win-crt-string-l1-1-0.pdb
File Version : 10.0.14393.2990 (rs1_release_1.190410-1803)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.14393.2990
ModLoad: 00000000faad0000 0000000000003000 C:\Windows\system32\api-ms-win-crt-heap-l1-1-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
Linked PDB Filename : api-ms-win-crt-heap-l1-1-0.pdb
File Version : 10.0.14393.2990 (rs1_release_1.190410-1803)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.14393.2990
ModLoad: 00000000faa30000 0000000000004000 C:\Windows\system32\api-ms-win-crt-stdio-l1-1-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
Linked PDB Filename : api-ms-win-crt-stdio-l1-1-0.pdb
File Version : 10.0.14393.2990 (rs1_release_1.190410-1803)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.14393.2990
ModLoad: 00000000faa20000 0000000000004000 C:\Windows\system32\api-ms-win-crt-convert-l1-1-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
Linked PDB Filename : api-ms-win-crt-convert-l1-1-0.pdb
File Version : 10.0.14393.2990 (rs1_release_1.190410-1803)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.14393.2990
ModLoad: 00000000fd920000 00000000000db000 C:\Windows\system32\ADVAPI32.dll (6.1.7601.24545) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 6.1.7601.24545 (win7sp1_ldr_escrow.200102-1707)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 6.1.7601.24545
ModLoad: 00000000ff680000 000000000009f000 C:\Windows\system32\msvcrt.dll (7.0.7601.17744) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.7601.17744 (win7sp1_gdr.111215-1535)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.7601.17744
ModLoad: 00000000fe3d0000 000000000001f000 C:\Windows\SYSTEM32\sechost.dll (6.1.7601.18869) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 6.1.7600.16385 (win7_rtm.090713-1255)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 6.1.7600.16385
ModLoad: 00000000fe280000 000000000012c000 C:\Windows\system32\RPCRT4.dll (6.1.7601.24545) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 6.1.7600.16385 (win7_rtm.090713-1255)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 6.1.7600.16385
ModLoad: 00000000faa10000 0000000000003000 C:\Windows\system32\api-ms-win-crt-locale-l1-1-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
Linked PDB Filename : api-ms-win-crt-locale-l1-1-0.pdb
File Version : 10.0.14393.2990 (rs1_release_1.190410-1803)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.14393.2990
ModLoad: 00000000faa00000 0000000000005000 C:\Windows\system32\api-ms-win-crt-math-l1-1-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
Linked PDB Filename : api-ms-win-crt-math-l1-1-0.pdb
File Version : 10.0.14393.2990 (rs1_release_1.190410-1803)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.14393.2990
ModLoad: 00000000fa9f0000 0000000000005000 C:\Windows\system32\api-ms-win-crt-multibyte-l1-1-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
Linked PDB Filename : api-ms-win-crt-multibyte-l1-1-0.pdb
File Version : 10.0.14393.2990 (rs1_release_1.190410-1803)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.14393.2990
ModLoad: 00000000fa9e0000 0000000000003000 C:\Windows\system32\api-ms-win-crt-time-l1-1-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
Linked PDB Filename : api-ms-win-crt-time-l1-1-0.pdb
File Version : 10.0.14393.2990 (rs1_release_1.190410-1803)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.14393.2990
ModLoad: 00000000fa9d0000 0000000000003000 C:\Windows\system32\api-ms-win-crt-filesystem-l1-1-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
Linked PDB Filename : api-ms-win-crt-filesystem-l1-1-0.pdb
File Version : 10.0.14393.2990 (rs1_release_1.190410-1803)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.14393.2990
ModLoad: 00000000f9c80000 0000000000003000 C:\Windows\system32\api-ms-win-crt-environment-l1-1-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
Linked PDB Filename : api-ms-win-crt-environment-l1-1-0.pdb
File Version : 10.0.14393.2990 (rs1_release_1.190410-1803)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.14393.2990
ModLoad: 00000000f6480000 0000000000003000 C:\Windows\system32\api-ms-win-crt-utility-l1-1-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
Linked PDB Filename : api-ms-win-crt-utility-l1-1-0.pdb
File Version : 10.0.14393.2990 (rs1_release_1.190410-1803)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.14393.2990
ModLoad: 00000000f5720000 0000000000125000 C:\Windows\system32\dbghelp.dll (6.1.7601.17514) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 6.1.7601.17514
ModLoad: 00000000f9c90000 000000000000c000 C:\ProgramData\BOINC\slots\24\VCRUNTIME140_1.dll (14.27.29112.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.27.29112.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.27.29112.0
ModLoad: 0000000004870000 0000000024b49000 C:\ProgramData\BOINC\slots\24\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000f1650000 0000000000045000 C:\ProgramData\BOINC\slots\24\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000745e0000 00000000030a5000 C:\ProgramData\BOINC\slots\24\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 0000000071120000 00000000034b2000 C:\ProgramData\BOINC\slots\24\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 000000008d220000 000000001b3a4000 C:\ProgramData\BOINC\slots\24\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 00000000fb7c0000 0000000000010000 C:\ProgramData\BOINC\slots\24\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 0000000082630000 000000000abe7000 C:\ProgramData\BOINC\slots\24\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000e78e0000 000000000020d000 C:\ProgramData\BOINC\slots\24\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 00000000e5e10000 00000000002db000 C:\ProgramData\BOINC\slots\24\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000f1610000 0000000000040000 C:\ProgramData\BOINC\slots\24\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000f61d0000 0000000000003000 C:\Windows\system32\api-ms-win-crt-process-l1-1-0.dll (10.0.14393.2990) (-exported- Symbols Loaded)
Linked PDB Filename : api-ms-win-crt-process-l1-1-0.pdb
File Version : 10.0.14393.2990 (rs1_release_1.190410-1803)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.14393.2990
ModLoad: 0000000000460000 000000000919f000 C:\ProgramData\BOINC\slots\24\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 000000007e8d0000 0000000003d5b000 C:\ProgramData\BOINC\slots\24\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000e3f40000 0000000001eca000 C:\ProgramData\BOINC\slots\24\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 0000000077410000 00000000000fa000 C:\Windows\system32\USER32.dll (6.1.7601.24546) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 6.1.7601.17514
ModLoad: 00000000fe850000 0000000000067000 C:\Windows\system32\GDI32.dll (6.1.7601.24540) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 6.1.7601.24540 (win7sp1_ldr_escrow.191127-1706)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 6.1.7601.24540
ModLoad: 00000000fe270000 000000000000e000 C:\Windows\system32\LPK.dll (6.1.7601.24537) (-exported- Symbols Loaded)
Linked PDB Filename : lpk.pdb
File Version : 6.1.7601.24537 (win7sp1_ldr_escrow.191114-1547)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 6.1.7601.24537
ModLoad: 00000000fda00000 00000000000cb000 C:\Windows\system32\USP10.dll (1.626.7601.24535) (-exported- Symbols Loaded)
Linked PDB Filename : usp10.pdb
File Version : 1.0626.7601.24535 (win7sp1_ldr_escrow.191105-1059)
Company Name : Microsoft Corporation
Product Name : Microsoft(R) Uniscribe Unicode script processor
Product Version : 1.0626.7601.24535
ModLoad: 00000000ff650000 000000000002e000 C:\Windows\system32\IMM32.DLL (6.1.7600.16385) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 6.1.7600.16385 (win7_rtm.090713-1255)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 6.1.7600.16385
ModLoad: 00000000fe6c0000 000000000010b000 C:\Windows\system32\MSCTF.dll (6.1.7601.24520) (-exported- Symbols Loaded)
Linked PDB Filename : msctf.pdb
File Version : 6.1.7600.16385 (win7_rtm.090713-1255)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 6.1.7600.16385
ModLoad: 00000000e63d0000 00000000010e7000 C:\Windows\system32\nvcuda.dll (26.21.14.4614) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r445\r445_85\drivers\gpgpu\_out\wddm_amd64_release\nvcuda.pdb
File Version : 26.21.14.4614
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.0.140 driver
Product Version : 26.21.14.4614
ModLoad: 00000000fc3a0000 000000000000c000 C:\Windows\system32\VERSION.dll (6.1.7600.16385) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 6.1.7600.16385 (win7_rtm.090713-1255)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 6.1.7600.16385
ModLoad: 00000000fe8c0000 0000000000d8b000 C:\Windows\system32\SHELL32.dll (6.1.7601.24468) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 6.1.7601.17514
ModLoad: 00000000fd5e0000 0000000000071000 C:\Windows\system32\SHLWAPI.dll (6.1.7601.17514) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 6.1.7600.16385 (win7_rtm.090713-1255)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 6.1.7600.16385
ModLoad: 00000000fd660000 00000000001d7000 C:\Windows\system32\SETUPAPI.dll (6.1.7601.17514) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 6.1.7600.16385 (win7_rtm.090713-1255)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 6.1.7600.16385
ModLoad: 00000000fd500000 0000000000036000 C:\Windows\system32\CFGMGR32.dll (6.1.7601.17514) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 6.1.7601.17514
Get Product Name Failed.
ModLoad: 00000000fd840000 00000000000db000 C:\Windows\system32\OLEAUT32.dll (6.1.7601.24537) (-exported- Symbols Loaded)
Linked PDB Filename : oleaut32.pdb
File Version : 6.1.7601.24537
Company Name : Microsoft Corporation
Product Name :
Product Version : 6.1.7601.24537
ModLoad: 00000000ff720000 00000000001ff000 C:\Windows\system32\ole32.dll (6.1.7601.24537) (-exported- Symbols Loaded)
Linked PDB Filename : ole32.pdb
File Version : 6.1.7601.24537 (win7sp1_ldr_escrow.191114-1547)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 6.1.7601.24537
ModLoad: 00000000fd1f0000 000000000001a000 C:\Windows\system32\DEVOBJ.dll (6.1.7600.16385) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 6.1.7600.16385 (win7_rtm.090713-1255)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 6.1.7600.16385
ModLoad: 00000000fdad0000 000000000004d000 C:\Windows\system32\WS2_32.dll (6.1.7601.23451) (-exported- Symbols Loaded)
Linked PDB Filename : ws2_32.pdb
File Version : 6.1.7600.16385 (win7_rtm.090713-1255)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 6.1.7600.16385
ModLoad: 00000000fe260000 0000000000008000 C:\Windows\system32\NSI.dll (6.1.7601.23889) (-exported- Symbols Loaded)
Linked PDB Filename : nsi.pdb
File Version : 6.1.7601.23889 (win7sp1_ldr.170810-1615)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 6.1.7601.23889
ModLoad: 00000000f4de0000 00000000004c0000 C:\Windows\system32\nvapi64.dll (26.21.14.4614) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r445\r445_85\drivers\nvapi\gpu\_out\wddm_amd64_release\nvapi64.pdb
File Version : 26.21.14.4614
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 26.21.14.4614
ModLoad: 00000000f9230000 000000000005d000 C:\Windows\system32\dxgi.dll (6.2.9200.16492) (-exported- Symbols Loaded)
Linked PDB Filename : dxgi.pdb
File Version : 6.2.9200.16492 (win8_gdr_oobssr.130113-0015)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 6.2.9200.16492
ModLoad: 00000000fb730000 0000000000018000 C:\Windows\system32\dwmapi.dll (6.1.7601.18917) (-exported- Symbols Loaded)
Linked PDB Filename : dwmapi.pdb
File Version : 6.1.7600.16385 (win7_rtm.090713-1255)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 6.1.7600.16385
ModLoad: 00000000f96b0000 000000000009c000 C:\Windows\system32\mscms.dll (6.1.7601.24537) (-exported- Symbols Loaded)
Linked PDB Filename : mscms.pdb
File Version : 6.1.7600.16385 (win7_rtm.090713-1255)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 6.1.7600.16385
ModLoad: 00000000fd220000 000000000001f000 C:\Windows\system32\USERENV.dll (6.1.7601.24535) (-exported- Symbols Loaded)
Linked PDB Filename : userenv.pdb
File Version : 6.1.7600.16385 (win7_rtm.090713-1255)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 6.1.7600.16385
ModLoad: 00000000fd190000 000000000000f000 C:\Windows\system32\profapi.dll (6.1.7600.16385) (-nosymbols- Symbols Loaded)
Linked PDB Filename : profapi.pdb
File Version : 6.1.7600.16385 (win7_rtm.090713-1255)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 6.1.7600.16385
ModLoad: 00000000fbb60000 0000000000056000 C:\Windows\system32\uxtheme.dll (6.1.7600.16385) (-exported- Symbols Loaded)
Linked PDB Filename : UxTheme.pdb
File Version : 6.1.7600.16385 (win7_rtm.090713-1255)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 6.1.7600.16385
ModLoad: 00000000fd1a0000 000000000003b000 C:\Windows\system32\WINTRUST.dll (6.1.7601.24542) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 6.1.7601.24542 (win7sp1_ldr_escrow.191209-2211)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 6.1.7601.24542
ModLoad: 00000000fd390000 000000000016d000 C:\Windows\system32\CRYPT32.dll (6.1.7601.24542) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 6.1.7601.24542 (win7sp1_ldr_escrow.191209-2211)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 6.1.7601.24542
ModLoad: 00000000fd180000 000000000000f000 C:\Windows\system32\MSASN1.dll (6.1.7601.17514) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 6.1.7601.17514
ModLoad: 00000000f7540000 0000000000009000 C:\ProgramData\BOINC\slots\24\caffe2_nvrtc.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000e2980000 0000000000fca000 C:\ProgramData\BOINC\slots\24\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6.14.11.9000
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.89 NVRTC Library
Product Version : 6.14.11.9000
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 4022, Write: 3157, Other 5972
- I/O Transfers Counters -
Read: 9275115, Write: 5663349, Other 46796
- Paged Pool Usage -
QuotaPagedPoolUsage: 20249544, QuotaPeakPagedPoolUsage: 20572616
QuotaNonPagedPoolUsage: 4212856, QuotaPeakNonPagedPoolUsage: 4212976
- Virtual Memory Usage -
VirtualSize: -1452675072, PeakVirtualSize: -1059856384
- Pagefile Usage -
PagefileUsage: -1452675072, PeakPagefileUsage: -1443106816
- Working Set Size -
WorkingSetSize: 1678901248, PeakWorkingSetSize: 1685135360, PageFaultCount: 569197
*** Dump of thread ID 787972 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 443128288.000000
- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x000007FEFD290932
- Registers -
rax=0000000000000000 rbx=0000000000000001 rcx=000000003fd68c40 rdx=000000000e78e890 rsi=0000000000000000 rdi=0000000000000000
r8=000000000e78e890 r9=000000003fd68c30 r10=0000000000000fff r11=0000000000000ff0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000fd290932 rsp=000000000e78e868 rbp=0000000000000000
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
0e78e860 3fae9100 00000001 0e78e890 0e78e890 3fd68c30 KERNELBASE!DebugBreak+0x0
0e78eca0 3fae9ce4 96000000 0e78f004 00000000 000001e8 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
0e78fc00 3faea084 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
0e78fc30 7752556d 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
0e78fc60 7768372d 00000000 00000000 00000000 00000000 kernel32!BaseThreadInitThunk+0x0
0e78fcb0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 788380 (state: Running): ***
- Information -
Status: Base Priority: Above Normal, Priority: Highest, , Kernel Time: 7834370048.000000, User Time: 60049154048.000000, Wait Time: 443128224.000000
- Registers -
rax=0000000000160bc0 rbx=0000000000160ed0 rcx=000000000a5a9190 rdx=000000002af59850 rsi=000000002af59850 rdi=0000000000000002
r8=0000000000000001 r9=00000000613c0a90 r10=0000000000160b78 r11=0000000000160b60 r12=0000000000000000 r13=000000002a7b47c0
r14=0000000000000010 r15=0000000013adb2f0 rip=00000000e671ad98 rsp=0000000000160a70 rbp=000000000a5a9190
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000202
- Callstack -
ChildEBP RetAddr Args to Child
00160ac0 e641abb6 000001e7 0000000f 00160ed0 19dec158 nvcuda!cuProfilerStop+0x0
00160b30 e66a561c 56d37f00 0a5a13d0 13adb2f0 00000002 nvcuda!+0x0
00160b60 e65126fa 0bafc900 19dec16c 4eb4c6b0 4eb4c6b0 nvcuda!cuProfilerStop+0x0
00161380 e6681bf2 00000000 00000000 00000001 18d6b988 nvcuda!+0x0
001614a0 e63ee119 4eb4c6b0 00161600 4eb4c6b0 56d37f00 nvcuda!cuProfilerStop+0x0
001614f0 e63ee646 0bafc900 56d37f00 0bafc900 00000001 nvcuda!+0x0
00161750 e65999ac 8df8c000 8df8c020 00161ef8 00161f10 nvcuda!+0x0
001618b0 8dfc29b6 00000100 00000000 00000006 00000001 nvcuda!cuLaunchKernel+0x0
001619c0 8dfbfdf4 8df2d5d0 0a35e8b0 4eb4c6b0 00161bd0 cudnn64_7!cudnnSetDropoutDescriptor+0x0
00161b40 8df32719 8df2d5d0 00000002 8df2d5d0 0000000c cudnn64_7!cudnnSetDropoutDescriptor+0x0
00161c60 8df2ce23 0000000c 0000000c 00000080 00000080 cudnn64_7!cudnnSetRNNProjectionLayers+0x0
00161d40 8df3b483 00000002 00000001 134cf000 00000000 cudnn64_7!cudnnSetRNNProjectionLayers+0x0
001621f0 8df2eff1 001644d8 46e17710 00000005 65bd46b0 cudnn64_7!cudnnSetRNNProjectionLayers+0x0
00162390 8df37d8e 63547600 00000000 65bd46b0 00162658 cudnn64_7!cudnnSetRNNProjectionLayers+0x0
00162530 8df4dcd3 00000000 00000000 6649cbe0 00162650 cudnn64_7!cudnnSetRNNProjectionLayers+0x0
001646c0 075e89fd 6373a040 11760000 6373a040 46e17710 cudnn64_7!cudnnRNNForwardTraining+0x0
00164ba0 076425ea 00164c68 00000001 00164c68 00000001 torch_cuda!at::native::_cudnn_rnn+0x0
00164c80 07650cbf 00165370 00166b78 00165cc0 00000000 torch_cuda!at::native::set_storage_cuda_+0x0
00164d60 8807b9fc 00165370 000000f8 01d20090 00320430 torch_cuda!at::native::set_storage_cuda_+0x0
00164ee0 880b31a2 00000001 898267c2 00164f14 00000001 torch_cpu!at::native::mkldnn_sigmoid_+0x0
001651c0 89362613 00000000 00000000 00000003 5603a418 torch_cpu!at::_cudnn_rnn+0x0
001656c0 8937080b 17d08120 664febf0 001657f0 00000004 torch_cpu!torch::autograd::NotImplemented::~NotImplemented+0x0
001657a0 8807b9fc 00165d20 89495878 00000000 e63de7cc torch_cpu!torch::autograd::GraphRoot::apply+0x0
00165920 880b31a2 00165cd0 00000000 17d083d0 00165a40 torch_cpu!at::native::mkldnn_sigmoid_+0x0
00165c00 075e69a1 00160001 00000001 00000004 00000001 torch_cpu!at::_cudnn_rnn+0x0
00165dd0 075f0117 00000000 00166b78 f1652e0d 00165ef0 torch_cuda!at::native::_use_cudnn_ctc_loss+0x0
00165e60 87e0107b 8cf51ac0 00166180 102ca1c7 e6569926 torch_cuda!at::native::_cudnn_rnn_flatten_weight+0x0
001660d0 87e33b16 00000001 00166b78 10314557 00166470 torch_cpu!at::native::fbgemm_pack_quantized_matrix+0x0
00166260 881aae89 001662d8 00000001 001662d8 00000001 torch_cpu!at::native::gru+0x0
001662f0 89499fa3 001663f0 00000001 00166570 00166b78 torch_cpu!at::zeros_out+0x0
00166380 8819dd35 f9331ea8 0b214b00 00000000 f9331ea8 torch_cpu!torch::autograd::GraphRoot::apply+0x0
00166400 880788ec 8cf575c8 468e1eb0 6364dc30 00166620 torch_cpu!at::zeros_out+0x0
00166500 880ec1bb 0000000c 00000080 00000004 664fd200 torch_cpu!at::native::mkldnn_sigmoid_+0x0
00166580 89bd7294 001666a0 468e1eb0 00166690 00166838 torch_cpu!at::gru+0x0
001667b0 89bd62ab 00166b50 8800030e 00166b50 00166b78 torch_cpu!torch::nn::GRUImpl::forward_helper+0x0
001668a0 3fac2621 00000007 001675b0 00000000 f9331ea8 torch_cpu!torch::nn::GRUImpl::forward+0x0
00166aa0 3fac705a 00000000 00160000 00160601 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::error+0x0
00166fa0 3facb950 001670a0 001670a0 00000000 45c57e20 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0
0017fd40 3fd0c6f8 0b324300 00000000 00000000 0b0d3790 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
0017fd80 7752556d 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
0017fdb0 7768372d 00000000 00000000 00000000 00000000 kernel32!BaseThreadInitThunk+0x0
0017fe00 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 788116 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 156001.000000, Wait Time: 443128288.000000
- Registers -
rax=0000000000000058 rbx=0000000018bffae0 rcx=0000000000000008 rdx=0000000018bffa50 rsi=0000000000000000 rdi=0000000000000008
r8=0000000018bff9a8 r9=0000000000000008 r10=0000000000000000 r11=0000000000000246 r12=0000000018bff9f8 r13=0000000018bffa50
r14=0000000000000000 r15=0000000000000064 rip=0000000077699d5a rsp=0000000018bff9a8 rbp=0000000000000008
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
18bff9a0 fd261420 00000000 00000000 00000000 00000000 ntdll!ZwWaitForMultipleObjects+0x0
18bffaa0 77520260 18bffb20 18bffae0 00000000 18bffdb0 KERNELBASE!GetCurrentProcess+0x0
18bffb30 e65498f4 0b8984a0 0b8c5f10 00000008 0a5a1320 kernel32!WaitForMultipleObjects+0x0
18bffd70 e65d2b08 00000064 00000000 0b8c5f10 0a5a1320 nvcuda!+0x0
18bffe20 e65492c3 f4af809f dc079bd3 0be47990 00000000 nvcuda!cuProfilerStop+0x0
18bffe50 e680c440 0be47990 00000000 00000000 00000000 nvcuda!+0x0
18bffe80 7752556d 00000000 00000000 00000000 00000000 nvcuda!cuProfilerStop+0x0
18bffeb0 7768372d 00000000 00000000 00000000 00000000 kernel32!BaseThreadInitThunk+0x0
18bfff00 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 787160 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 442347104.000000
- Registers -
rax=0000000000000001 rbx=0000000000000000 rcx=0000000000000130 rdx=0000000000000000 rsi=00000000ffffffff rdi=0000000000000130
r8=0000000018d1fd68 r9=0000000000000000 r10=0000000000000000 r11=0000000000000217 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000776997ea rsp=0000000018d1fde8 rbp=0000000000000001
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
18d1fde0 fd2610dc 00000000 00000000 00000000 fd2610dc ntdll!NtWaitForSingleObject+0x0
18d1fe80 e672a317 00000000 0b899da0 00000000 00000130 KERNELBASE!WaitForSingleObjectEx+0x0
18d1fed0 e65492c3 00000000 0be47ba0 00000000 e63d0000 nvcuda!cuProfilerStop+0x0
18d1ff00 e680c440 0be47ba0 00000000 00000000 00000000 nvcuda!+0x0
18d1ff30 7752556d 00000000 00000000 00000000 00000000 nvcuda!cuProfilerStop+0x0
18d1ff60 7768372d 00000000 00000000 00000000 00000000 kernel32!BaseThreadInitThunk+0x0
18d1ffb0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 786600 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 156001.000000, Wait Time: 443128288.000000
- Registers -
rax=000000000000018c rbx=0000000000000000 rcx=0000000000000000 rdx=000000001b05f830 rsi=000000000baff128 rdi=0000000000000000
r8=000000001b05f8b8 r9=000000000baff0f8 r10=000000000baff128 r11=000000001b05f830 r12=000000001b05f8b8 r13=0000000000000000
r14=0000000000000004 r15=000000000baff0f8 rip=000000007769b09a rsp=000000001b05f808 rbp=000000000baff0f8
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
1b05f800 776f0004 1b05f830 0baff128 00000000 00000001 ntdll!ZwWaitForKeyedEvent+0x0
1b05f860 7755b3e8 0bafc900 00000001 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0
1b05f890 e64dd04a 0bafc900 00000001 00000000 ffb3b4c0 kernel32!SleepConditionVariableCS+0x0
1b05f8f0 e65492c3 00000004 f4acf215 f4acf216 00000000 nvcuda!+0x0
1b05f920 e680c440 0be47ea0 00000000 00000000 00000000 nvcuda!+0x0
1b05f950 7752556d 00000000 00000000 00000000 00000000 nvcuda!cuProfilerStop+0x0
1b05f980 7768372d 00000000 00000000 00000000 00000000 kernel32!BaseThreadInitThunk+0x0
1b05f9d0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 787556 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 5956898304.000000, User Time: 47321657344.000000, Wait Time: 443128288.000000
- Registers -
rax=000000000000018c rbx=0000000000000000 rcx=0000000000000000 rdx=000000006014f410 rsi=000000006163c938 rdi=0000000000000000
r8=000000000000000f r9=000000000b875a80 r10=000000006014bf78 r11=000000006014bf60 r12=000000006163c8e8 r13=0000000000000000
r14=0000000000000000 r15=000000006163c8e0 rip=000000007769b09a rsp=000000006014f3e8 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
6014f3e0 776f131d 62e25ff8 00000001 65b2c0a0 65b2c090 ntdll!ZwWaitForKeyedEvent+0x0
6014f450 7755b398 f63c8350 00000000 6163c928 57ad7400 ntdll!RtlSleepConditionVariableSRW+0x0
6014f490 f63c8368 f63c8350 00000000 6163c928 6163c928 kernel32!SleepConditionVariableSRW+0x0
6014f4c0 f63c8530 65b2c0a0 6014f520 6163c928 f63c8a23 MSVCP140!std::_Syserror_map+0x0
6014f540 8981064b 65b2c0a0 000001c0 6163c8e0 6014f640 MSVCP140!_Cnd_destroy+0x0
6014f580 898125b1 6611d930 ffffffff 65b2c0a0 ffffffff torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
6014f870 89812471 8cd36d10 6014f8b0 8cd36d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0
6014f8c0 89809744 f3fd5b38 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0
6014f8f0 f3f0f4a0 00000000 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0
6014f920 7752556d 00000000 00000000 00000000 00000000 ucrtbase!_o__realloc_base+0x0
6014f950 7768372d 00000000 00000000 00000000 00000000 kernel32!BaseThreadInitThunk+0x0
6014f9a0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiti
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)