Task 7563673
| Name | ParityModified-1631729200-7795-1_2 |
| Workunit | 5093959 |
| Created | 24 Sep 2021, 11:09:32 UTC |
| Sent | 24 Sep 2021, 12:53:02 UTC |
| Report deadline | 1 Oct 2021, 12:53:02 UTC |
| Received | 27 Sep 2021, 22:38:43 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 197 (0x000000C5) EXIT_TIME_LIMIT_EXCEEDED |
| Computer ID | 4503 |
| Run time | 10 hours 23 min 46 sec |
| CPU time | 20 min 5 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 10,073.32 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 2.08 GB |
| Peak swap size | 4.37 GB |
| Peak disk usage | 1.53 GB |
Stderr output
<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
exceeded elapsed time limit 37423.06 (4000000.00G/106.89G)</message>
<stderr_txt>
7256 | val_loss: 0.0315148 | Time: 124587 ms
[2021-09-27 10:15:50 main:574] : INFO : Epoch 232 | loss: 0.0314633 | val_loss: 0.0313017 | Time: 22551.9 ms
[2021-09-27 10:17:17 main:574] : INFO : Epoch 233 | loss: 0.0312853 | val_loss: 0.0312664 | Time: 87283.4 ms
[2021-09-27 10:20:14 main:574] : INFO : Epoch 234 | loss: 0.0312587 | val_loss: 0.0312544 | Time: 172189 ms
[2021-09-27 10:22:07 main:574] : INFO : Epoch 235 | loss: 0.0312529 | val_loss: 0.031253 | Time: 112801 ms
[2021-09-27 10:23:43 main:574] : INFO : Epoch 236 | loss: 0.0312516 | val_loss: 0.0312513 | Time: 86834.1 ms
[2021-09-27 10:25:54 main:574] : INFO : Epoch 237 | loss: 0.0312511 | val_loss: 0.0312509 | Time: 130882 ms
[2021-09-27 10:27:25 main:574] : INFO : Epoch 238 | loss: 0.0312507 | val_loss: 0.031251 | Time: 90906.3 ms
[2021-09-27 10:30:15 main:574] : INFO : Epoch 239 | loss: 0.0312508 | val_loss: 0.0312507 | Time: 169934 ms
[2021-09-27 10:33:08 main:574] : INFO : Epoch 240 | loss: 0.0312505 | val_loss: 0.0312505 | Time: 168631 ms
[2021-09-27 10:36:09 main:574] : INFO : Epoch 241 | loss: 0.0312504 | val_loss: 0.0312509 | Time: 180858 ms
[2021-09-27 10:38:35 main:574] : INFO : Epoch 242 | loss: 0.0312506 | val_loss: 0.0312503 | Time: 145675 ms
[2021-09-27 10:38:51 main:574] : INFO : Epoch 243 | loss: 0.0312502 | val_loss: 0.0312505 | Time: 16513.3 ms
[2021-09-27 10:39:13 main:574] : INFO : Epoch 244 | loss: 0.0312502 | val_loss: 0.0312504 | Time: 21686.1 ms
[2021-09-27 10:39:16 main:574] : INFO : Epoch 245 | loss: 0.0312502 | val_loss: 0.0312503 | Time: 2936.71 ms
[2021-09-27 10:39:20 main:574] : INFO : Epoch 246 | loss: 0.0312503 | val_loss: 0.0312507 | Time: 3847.01 ms
[2021-09-27 10:40:01 main:574] : INFO : Epoch 247 | loss: 0.03125 | val_loss: 0.0312501 | Time: 41169.6 ms
[2021-09-27 10:40:04 main:574] : INFO : Epoch 248 | loss: 0.0312499 | val_loss: 0.0312501 | Time: 3044.94 ms
[2021-09-27 10:40:08 main:574] : INFO : Epoch 249 | loss: 0.0312502 | val_loss: 0.0312513 | Time: 3283.14 ms
[2021-09-27 10:42:01 main:574] : INFO : Epoch 250 | loss: 0.0312502 | val_loss: 0.0312501 | Time: 111921 ms
[2021-09-27 10:44:47 main:574] : INFO : Epoch 251 | loss: 0.0312499 | val_loss: 0.0312502 | Time: 166242 ms
[2021-09-27 10:45:46 main:574] : INFO : Epoch 252 | loss: 0.0312499 | val_loss: 0.0312501 | Time: 58881.3 ms
[2021-09-27 10:48:59 main:574] : INFO : Epoch 253 | loss: 0.0312502 | val_loss: 0.0312502 | Time: 186643 ms
[2021-09-27 10:50:48 main:574] : INFO : Epoch 254 | loss: 0.03125 | val_loss: 0.03125 | Time: 108841 ms
[2021-09-27 10:53:08 main:574] : INFO : Epoch 255 | loss: 0.0312496 | val_loss: 0.0312499 | Time: 140787 ms
[2021-09-27 10:53:49 main:574] : INFO : Epoch 256 | loss: 0.0312496 | val_loss: 0.0312502 | Time: 40175.1 ms
[2021-09-27 10:56:00 main:574] : INFO : Epoch 257 | loss: 0.0312498 | val_loss: 0.0312499 | Time: 131131 ms
[2021-09-27 10:56:32 main:574] : INFO : Epoch 258 | loss: 0.0312497 | val_loss: 0.0312515 | Time: 32662.5 ms
[2021-09-27 10:58:23 main:574] : INFO : Epoch 259 | loss: 0.0312502 | val_loss: 0.03125 | Time: 105710 ms
[2021-09-27 11:01:26 main:574] : INFO : Epoch 260 | loss: 0.0312497 | val_loss: 0.0312501 | Time: 178122 ms
[2021-09-27 11:03:21 main:574] : INFO : Epoch 261 | loss: 0.0312497 | val_loss: 0.0312502 | Time: 115193 ms
[2021-09-27 11:05:33 main:574] : INFO : Epoch 262 | loss: 0.0312495 | val_loss: 0.0312498 | Time: 131505 ms
[2021-09-27 11:06:09 main:574] : INFO : Epoch 263 | loss: 0.0312496 | val_loss: 0.0312499 | Time: 31217.8 ms
[2021-09-27 11:08:59 main:574] : INFO : Epoch 264 | loss: 0.0312493 | val_loss: 0.0312516 | Time: 170183 ms
[2021-09-27 11:10:30 main:574] : INFO : Epoch 265 | loss: 0.03125 | val_loss: 0.031251 | Time: 90769.8 ms
[2021-09-27 11:13:18 main:574] : INFO : Epoch 266 | loss: 0.0312499 | val_loss: 0.0312499 | Time: 161519 ms
[2021-09-27 11:15:43 main:574] : INFO : Epoch 267 | loss: 0.0312496 | val_loss: 0.0312498 | Time: 145036 ms
[2021-09-27 11:17:50 main:574] : INFO : Epoch 268 | loss: 0.0312492 | val_loss: 0.0312496 | Time: 127444 ms
[2021-09-27 11:18:33 main:574] : INFO : Epoch 269 | loss: 0.0312492 | val_loss: 0.0312496 | Time: 43311 ms
[2021-09-27 11:18:36 main:574] : INFO : Epoch 270 | loss: 0.0312492 | val_loss: 0.0312508 | Time: 2818.05 ms
[2021-09-27 11:18:39 main:574] : INFO : Epoch 271 | loss: 0.0312494 | val_loss: 0.0312492 | Time: 2882.11 ms
[2021-09-27 11:18:42 main:574] : INFO : Epoch 272 | loss: 0.031249 | val_loss: 0.0312492 | Time: 3064.51 ms
[2021-09-27 11:20:45 main:574] : INFO : Epoch 273 | loss: 0.0312491 | val_loss: 0.0312493 | Time: 123014 ms
[2021-09-27 11:23:43 main:574] : INFO : Epoch 274 | loss: 0.0312488 | val_loss: 0.0312497 | Time: 177431 ms
[2021-09-27 11:23:46 main:574] : INFO : Epoch 275 | loss: 0.0312485 | val_loss: 0.0312491 | Time: 2962.21 ms
[2021-09-27 11:23:49 main:574] : INFO : Epoch 276 | loss: 0.0312486 | val_loss: 0.0312494 | Time: 3212.18 ms
[2021-09-27 11:25:23 main:574] : INFO : Epoch 277 | loss: 0.0312492 | val_loss: 0.0312486 | Time: 93231.5 ms
[2021-09-27 11:25:59 main:574] : INFO : Epoch 278 | loss: 0.0312488 | val_loss: 0.0312494 | Time: 31389.8 ms
[2021-09-27 11:29:22 main:574] : INFO : Epoch 279 | loss: 0.0312486 | val_loss: 0.031248 | Time: 203727 ms
[2021-09-27 11:31:55 main:574] : INFO : Epoch 280 | loss: 0.0312491 | val_loss: 0.0312491 | Time: 152418 ms
[2021-09-27 11:35:02 main:574] : INFO : Epoch 281 | loss: 0.0312477 | val_loss: 0.0312478 | Time: 181711 ms
[2021-09-27 11:35:40 main:574] : INFO : Epoch 282 | loss: 0.0312472 | val_loss: 0.0312472 | Time: 33701.7 ms
[2021-09-27 11:35:43 main:574] : INFO : Epoch 283 | loss: 0.0312467 | val_loss: 0.0312467 | Time: 2997.68 ms
[2021-09-27 11:36:14 main:574] : INFO : Epoch 284 | loss: 0.0312467 | val_loss: 0.0312473 | Time: 30140.1 ms
[2021-09-27 11:37:27 main:574] : INFO : Epoch 285 | loss: 0.0312465 | val_loss: 0.0312474 | Time: 73643.7 ms
[2021-09-27 11:39:33 main:574] : INFO : Epoch 286 | loss: 0.0312465 | val_loss: 0.0312461 | Time: 125831 ms
[2021-09-27 11:40:21 main:574] : INFO : Epoch 287 | loss: 0.0312457 | val_loss: 0.0312465 | Time: 47265.1 ms
[2021-09-27 11:40:23 main:574] : INFO : Epoch 288 | loss: 0.0312462 | val_loss: 0.0312562 | Time: 2802.59 ms
[2021-09-27 11:43:11 main:574] : INFO : Epoch 289 | loss: 0.0312462 | val_loss: 0.0312462 | Time: 161508 ms
[2021-09-27 11:45:48 main:574] : INFO : Epoch 290 | loss: 0.0312446 | val_loss: 0.0312445 | Time: 157526 ms
[2021-09-27 11:48:37 main:574] : INFO : Epoch 291 | loss: 0.0312454 | val_loss: 0.0312445 | Time: 169005 ms
[2021-09-27 11:51:03 main:574] : INFO : Epoch 292 | loss: 0.0312447 | val_loss: 0.0312419 | Time: 146030 ms
[2021-09-27 11:52:49 main:574] : INFO : Epoch 293 | loss: 0.0312448 | val_loss: 0.0312448 | Time: 105777 ms
[2021-09-27 11:53:02 main:574] : INFO : Epoch 294 | loss: 0.0312447 | val_loss: 0.0312407 | Time: 12879.2 ms
[2021-09-27 11:53:20 main:574] : INFO : Epoch 295 | loss: 0.0312405 | val_loss: 0.0312403 | Time: 18364.4 ms
[2021-09-27 11:53:53 main:574] : INFO : Epoch 296 | loss: 0.0312403 | val_loss: 0.0312389 | Time: 32640.8 ms
[2021-09-27 11:54:53 main:574] : INFO : Epoch 297 | loss: 0.0312387 | val_loss: 0.0312375 | Time: 60391.2 ms
[2021-09-27 11:55:39 main:574] : INFO : Epoch 298 | loss: 0.0312375 | val_loss: 0.0312378 | Time: 45898 ms
[2021-09-27 11:55:43 main:574] : INFO : Epoch 299 | loss: 0.0312381 | val_loss: 0.0312365 | Time: 3139.45 ms
[2021-09-27 11:57:21 main:574] : INFO : Epoch 300 | loss: 0.0312364 | val_loss: 0.0312383 | Time: 97014.4 ms
[2021-09-27 11:57:36 main:574] : INFO : Epoch 301 | loss: 0.0312361 | val_loss: 0.0312387 | Time: 14948.9 ms
[2021-09-27 11:59:44 main:574] : INFO : Epoch 302 | loss: 0.031237 | val_loss: 0.0312343 | Time: 113112 ms
[2021-09-27 11:59:47 main:574] : INFO : Epoch 303 | loss: 0.0312402 | val_loss: 0.0312383 | Time: 3144.31 ms
[2021-09-27 11:59:51 main:574] : INFO : Epoch 304 | loss: 0.0312352 | val_loss: 0.0312329 | Time: 3173.31 ms
[2021-09-27 12:03:27 main:574] : INFO : Epoch 305 | loss: 0.0312337 | val_loss: 0.031234 | Time: 216681 ms
[2021-09-27 12:04:15 main:574] : INFO : Epoch 306 | loss: 0.0312348 | val_loss: 0.0312336 | Time: 47641 ms
[2021-09-27 12:04:20 main:574] : INFO : Epoch 307 | loss: 0.0312346 | val_loss: 0.0312354 | Time: 4786.78 ms
[2021-09-27 12:05:15 main:574] : INFO : Epoch 308 | loss: 0.0312344 | val_loss: 0.0312332 | Time: 55533.4 ms
[2021-09-27 12:05:56 main:574] : INFO : Epoch 309 | loss: 0.0312331 | val_loss: 0.0312307 | Time: 36154.8 ms
[2021-09-27 12:06:09 main:574] : INFO : Epoch 310 | loss: 0.0312325 | val_loss: 0.0312322 | Time: 12789.1 ms
[2021-09-27 12:06:53 main:574] : INFO : Epoch 311 | loss: 0.0312346 | val_loss: 0.0312333 | Time: 44074.8 ms
[2021-09-27 12:08:32 main:574] : INFO : Epoch 312 | loss: 0.0312349 | val_loss: 0.031241 | Time: 98671.7 ms
[2021-09-27 12:08:35 main:574] : INFO : Epoch 313 | loss: 0.0312325 | val_loss: 0.0312285 | Time: 3173.04 ms
[2021-09-27 12:08:39 main:574] : INFO : Epoch 314 | loss: 0.0312307 | val_loss: 0.0312332 | Time: 3350.17 ms
[2021-09-27 12:10:32 main:574] : INFO : Epoch 315 | loss: 0.0312371 | val_loss: 0.0312285 | Time: 106873 ms
[2021-09-27 12:13:13 main:574] : INFO : Epoch 316 | loss: 0.0312304 | val_loss: 0.0312288 | Time: 161483 ms
[2021-09-27 12:15:48 main:574] : INFO : Epoch 317 | loss: 0.0312301 | val_loss: 0.0312374 | Time: 154995 ms
[2021-09-27 12:16:12 main:574] : INFO : Epoch 318 | loss: 0.0312378 | val_loss: 0.0312342 | Time: 23825.8 ms
[2021-09-27 12:16:15 main:574] : INFO : Epoch 319 | loss: 0.0312342 | val_loss: 0.031229 | Time: 2864 ms
[2021-09-27 12:16:18 main:574] : INFO : Epoch 320 | loss: 0.0312293 | val_loss: 0.0312268 | Time: 3277.4 ms
[2021-09-27 12:16:59 main:574] : INFO : Epoch 321 | loss: 0.0312282 | val_loss: 0.0312264 | Time: 40492 ms
[2021-09-27 12:20:15 main:574] : INFO : Epoch 322 | loss: 0.031229 | val_loss: 0.0312255 | Time: 195731 ms
[2021-09-27 12:22:46 main:574] : INFO : Epoch 323 | loss: 0.0312285 | val_loss: 0.0312317 | Time: 150806 ms
[2021-09-27 12:23:53 main:574] : INFO : Epoch 324 | loss: 0.0312298 | val_loss: 0.0312307 | Time: 67159.8 ms
[2021-09-27 12:24:54 main:574] : INFO : Epoch 325 | loss: 0.0312352 | val_loss: 0.031232 | Time: 51384.1 ms
[2021-09-27 12:26:54 main:574] : INFO : Epoch 326 | loss: 0.0312298 | val_loss: 0.0312259 | Time: 114932 ms
[2021-09-27 12:29:52 main:574] : INFO : Epoch 327 | loss: 0.031231 | val_loss: 0.0312254 | Time: 177577 ms
[2021-09-27 12:32:41 main:574] : INFO : Epoch 328 | loss: 0.0312341 | val_loss: 0.0312285 | Time: 164744 ms
[2021-09-27 12:35:51 main:574] : INFO : Epoch 329 | loss: 0.0312338 | val_loss: 0.0312314 | Time: 184078 ms
[2021-09-27 12:39:00 main:574] : INFO : Epoch 330 | loss: 0.0312311 | val_loss: 0.0312315 | Time: 189837 ms
[2021-09-27 12:39:11 main:574] : INFO : Epoch 331 | loss: 0.0312304 | val_loss: 0.0312365 | Time: 5196.47 ms
[2021-09-27 12:39:14 main:574] : INFO : Epoch 332 | loss: 0.0312335 | val_loss: 0.0312395 | Time: 2659.47 ms
[2021-09-27 12:39:17 main:574] : INFO : Epoch 333 | loss: 0.0312349 | val_loss: 0.0312333 | Time: 3022.66 ms
[2021-09-27 12:40:29 main:574] : INFO : Epoch 334 | loss: 0.0312314 | val_loss: 0.0312296 | Time: 72344.4 ms
[2021-09-27 12:40:33 main:574] : INFO : Epoch 335 | loss: 0.0312299 | val_loss: 0.0312287 | Time: 3293.1 ms
[2021-09-27 12:43:22 main:574] : INFO : Epoch 336 | loss: 0.0312274 | val_loss: 0.0312259 | Time: 169441 ms
[2021-09-27 12:45:14 main:574] : INFO : Epoch 337 | loss: 0.0312255 | val_loss: 0.0312242 | Time: 111146 ms
[2021-09-27 12:47:04 main:574] : INFO : Epoch 338 | loss: 0.0312298 | val_loss: 0.0312255 | Time: 105699 ms
[2021-09-27 12:50:06 main:574] : INFO : Epoch 339 | loss: 0.0312282 | val_loss: 0.0312242 | Time: 181080 ms
[2021-09-27 12:50:57 main:574] : INFO : Epoch 340 | loss: 0.0312254 | val_loss: 0.0312266 | Time: 51272.6 ms
[2021-09-27 12:53:08 main:574] : INFO : Epoch 341 | loss: 0.0312272 | val_loss: 0.03123 | Time: 130686 ms
[2021-09-27 12:53:48 main:574] : INFO : Epoch 342 | loss: 0.031229 | val_loss: 0.031224 | Time: 40464.5 ms
[2021-09-27 12:54:49 main:574] : INFO : Epoch 343 | loss: 0.0312263 | val_loss: 0.0312322 | Time: 60578.3 ms
[2021-09-27 12:56:37 main:574] : INFO : Epoch 344 | loss: 0.0312292 | val_loss: 0.03123 | Time: 103101 ms
[2021-09-27 12:59:30 main:574] : INFO : Epoch 345 | loss: 0.0312291 | val_loss: 0.0312262 | Time: 163454 ms
[2021-09-27 13:02:03 main:574] : INFO : Epoch 346 | loss: 0.0312256 | val_loss: 0.0312235 | Time: 143670 ms
[2021-09-27 13:05:12 main:574] : INFO : Epoch 347 | loss: 0.0312311 | val_loss: 0.0312327 | Time: 188817 ms
[2021-09-27 13:06:14 main:574] : INFO : Epoch 348 | loss: 0.0312271 | val_loss: 0.0312279 | Time: 57478.6 ms
[2021-09-27 13:09:05 main:574] : INFO : Epoch 349 | loss: 0.0312303 | val_loss: 0.0312302 | Time: 170932 ms
[2021-09-27 13:11:38 main:574] : INFO : Epoch 350 | loss: 0.0312264 | val_loss: 0.0312237 | Time: 146237 ms
[2021-09-27 13:13:30 main:574] : INFO : Epoch 351 | loss: 0.031226 | val_loss: 0.0312232 | Time: 107542 ms
[2021-09-27 13:15:48 main:574] : INFO : Epoch 352 | loss: 0.0312256 | val_loss: 0.0312279 | Time: 137931 ms
[2021-09-27 13:18:24 main:574] : INFO : Epoch 353 | loss: 0.0312299 | val_loss: 0.0312364 | Time: 150243 ms
[2021-09-27 13:18:49 main:574] : INFO : Epoch 354 | loss: 0.0312304 | val_loss: 0.0312301 | Time: 24865 ms
[2021-09-27 13:18:52 main:574] : INFO : Epoch 355 | loss: 0.0312282 | val_loss: 0.0312321 | Time: 2908.33 ms
[2021-09-27 13:18:55 main:574] : INFO : Epoch 356 | loss: 0.0312278 | val_loss: 0.0312254 | Time: 3269.54 ms
[2021-09-27 13:20:51 main:574] : INFO : Epoch 357 | loss: 0.0312255 | val_loss: 0.0312233 | Time: 110243 ms
[2021-09-27 13:23:12 main:574] : INFO : Epoch 358 | loss: 0.0312281 | val_loss: 0.0312235 | Time: 132481 ms
[2021-09-27 13:23:52 main:574] : INFO : Epoch 359 | loss: 0.0312282 | val_loss: 0.0312478 | Time: 40597.6 ms
[2021-09-27 13:24:16 main:574] : INFO : Epoch 360 | loss: 0.0312314 | val_loss: 0.031232 | Time: 24199.1 ms
[2021-09-27 13:24:19 main:574] : INFO : Epoch 361 | loss: 0.0312327 | val_loss: 0.0312268 | Time: 2932.66 ms
[2021-09-27 13:24:22 main:574] : INFO : Epoch 362 | loss: 0.031228 | val_loss: 0.0312238 | Time: 2953.04 ms
[2021-09-27 13:26:03 main:574] : INFO : Epoch 363 | loss: 0.0312256 | val_loss: 0.0312238 | Time: 98522.3 ms
[2021-09-27 13:27:34 main:574] : INFO : Epoch 364 | loss: 0.0312246 | val_loss: 0.0312251 | Time: 91065 ms
[2021-09-27 13:27:36 main:574] : INFO : Epoch 365 | loss: 0.0312309 | val_loss: 0.0312353 | Time: 2126.79 ms
[2021-09-27 13:30:02 main:574] : INFO : Epoch 366 | loss: 0.0312298 | val_loss: 0.0312315 | Time: 140717 ms
[2021-09-27 13:32:32 main:574] : INFO : Epoch 367 | loss: 0.0312294 | val_loss: 0.0312255 | Time: 144023 ms
[2021-09-27 13:34:13 main:574] : INFO : Epoch 368 | loss: 0.0312266 | val_loss: 0.0312279 | Time: 92629.5 ms
[2021-09-27 13:36:18 main:574] : INFO : Epoch 369 | loss: 0.0312261 | val_loss: 0.0312237 | Time: 125570 ms
[2021-09-27 13:36:45 main:574] : INFO : Epoch 370 | loss: 0.0312255 | val_loss: 0.0312226 | Time: 27292.7 ms
[2021-09-27 13:36:48 main:574] : INFO : Epoch 371 | loss: 0.0312244 | val_loss: 0.0312234 | Time: 2863.79 ms
[2021-09-27 13:36:51 main:574] : INFO : Epoch 372 | loss: 0.0312245 | val_loss: 0.0312223 | Time: 2949.49 ms
[2021-09-27 13:37:47 main:574] : INFO : Epoch 373 | loss: 0.0312241 | val_loss: 0.0312223 | Time: 55985 ms
[2021-09-27 13:39:00 main:574] : INFO : Epoch 374 | loss: 0.031224 | val_loss: 0.031221 | Time: 72448.2 ms
[2021-09-27 13:41:32 main:574] : INFO : Epoch 375 | loss: 0.031225 | val_loss: 0.0312221 | Time: 152562 ms
[2021-09-27 13:43:32 main:574] : INFO : Epoch 376 | loss: 0.0312235 | val_loss: 0.0312226 | Time: 119550 ms
[2021-09-27 13:45:32 main:574] : INFO : Epoch 377 | loss: 0.0312253 | val_loss: 0.0312278 | Time: 120272 ms
[2021-09-27 13:47:04 main:574] : INFO : Epoch 378 | loss: 0.0312278 | val_loss: 0.031222 | Time: 91726.6 ms
[2021-09-27 13:49:45 main:574] : INFO : Epoch 379 | loss: 0.0312233 | val_loss: 0.0312214 | Time: 151988 ms
[2021-09-27 13:52:32 main:574] : INFO : Epoch 380 | loss: 0.0312246 | val_loss: 0.0312205 | Time: 167446 ms
[2021-09-27 13:53:07 main:574] : INFO : Epoch 381 | loss: 0.0312231 | val_loss: 0.0312208 | Time: 30553 ms
[2021-09-27 13:53:16 main:574] : INFO : Epoch 382 | loss: 0.0312223 | val_loss: 0.0312216 | Time: 8998.16 ms
[2021-09-27 13:53:19 main:574] : INFO : Epoch 383 | loss: 0.0312235 | val_loss: 0.0312201 | Time: 2837.5 ms
[2021-09-27 13:53:23 main:574] : INFO : Epoch 384 | loss: 0.031225 | val_loss: 0.0312259 | Time: 3201.74 ms
[2021-09-27 13:53:47 main:574] : INFO : Epoch 385 | loss: 0.0312271 | val_loss: 0.0312205 | Time: 24574.7 ms
[2021-09-27 13:54:58 main:574] : INFO : Epoch 386 | loss: 0.0312263 | val_loss: 0.0312338 | Time: 70329.6 ms
[2021-09-27 13:56:21 main:574] : INFO : Epoch 387 | loss: 0.0312252 | val_loss: 0.0312236 | Time: 82925.5 ms
[2021-09-27 13:56:24 main:574] : INFO : Epoch 388 | loss: 0.0312266 | val_loss: 0.0312204 | Time: 2798.95 ms
[2021-09-27 13:56:27 main:574] : INFO : Epoch 389 | loss: 0.0312241 | val_loss: 0.0312195 | Time: 2920.55 ms
[2021-09-27 13:56:30 main:574] : INFO : Epoch 390 | loss: 0.0312264 | val_loss: 0.0312212 | Time: 3485.46 ms
[2021-09-27 13:56:49 main:574] : INFO : Epoch 391 | loss: 0.0312307 | val_loss: 0.03123 | Time: 18856.4 ms
[2021-09-27 13:59:48 main:574] : INFO : Epoch 392 | loss: 0.0312237 | val_loss: 0.0312197 | Time: 178973 ms
[2021-09-27 13:59:51 main:574] : INFO : Epoch 393 | loss: 0.0312216 | val_loss: 0.0312234 | Time: 2970.49 ms
[2021-09-27 13:59:55 main:574] : INFO : Epoch 394 | loss: 0.0312265 | val_loss: 0.0312249 | Time: 3532.21 ms
[2021-09-27 14:02:17 main:574] : INFO : Epoch 395 | loss: 0.0312218 | val_loss: 0.0312212 | Time: 142041 ms
[2021-09-27 14:04:17 main:574] : INFO : Epoch 396 | loss: 0.0312215 | val_loss: 0.0312191 | Time: 119602 ms
[2021-09-27 14:04:20 main:574] : INFO : Epoch 397 | loss: 0.031222 | val_loss: 0.0312192 | Time: 2843.9 ms
[2021-09-27 14:04:23 main:574] : INFO : Epoch 398 | loss: 0.0312208 | val_loss: 0.0312194 | Time: 3130.9 ms
[2021-09-27 14:04:44 main:574] : INFO : Epoch 399 | loss: 0.0312207 | val_loss: 0.0312196 | Time: 20974.8 ms
[2021-09-27 14:06:11 main:574] : INFO : Epoch 400 | loss: 0.0312203 | val_loss: 0.0312213 | Time: 82399.4 ms
[2021-09-27 14:06:15 main:574] : INFO : Epoch 401 | loss: 0.0312211 | val_loss: 0.0312191 | Time: 2968.07 ms
[2021-09-27 14:06:18 main:574] : INFO : Epoch 402 | loss: 0.0312208 | val_loss: 0.0312191 | Time: 3226.76 ms
[2021-09-27 14:09:06 main:574] : INFO : Epoch 403 | loss: 0.0312231 | val_loss: 0.0312284 | Time: 166131 ms
[2021-09-27 14:09:39 main:574] : INFO : Epoch 404 | loss: 0.0312223 | val_loss: 0.0312184 | Time: 33278.7 ms
[2021-09-27 14:11:20 main:574] : INFO : Epoch 405 | loss: 0.0312233 | val_loss: 0.0312182 | Time: 100592 ms
[2021-09-27 14:13:28 main:574] : INFO : Epoch 406 | loss: 0.0312275 | val_loss: 0.0312212 | Time: 127876 ms
[2021-09-27 14:15:49 main:574] : INFO : Epoch 407 | loss: 0.0312233 | val_loss: 0.0312283 | Time: 140867 ms
[2021-09-27 14:16:58 main:574] : INFO : Epoch 408 | loss: 0.0312235 | val_loss: 0.0312182 | Time: 68569.8 ms
[2021-09-27 14:19:03 main:574] : INFO : Epoch 409 | loss: 0.0312201 | val_loss: 0.0312185 | Time: 125276 ms
[2021-09-27 14:20:52 main:574] : INFO : Epoch 410 | loss: 0.0312217 | val_loss: 0.0312189 | Time: 94895.4 ms
[2021-09-27 14:23:53 main:574] : INFO : Epoch 411 | loss: 0.0312225 | val_loss: 0.0312255 | Time: 180854 ms
[2021-09-27 14:26:04 main:574] : INFO : Epoch 412 | loss: 0.0312219 | val_loss: 0.0312272 | Time: 131313 ms
[2021-09-27 14:26:59 main:574] : INFO : Epoch 413 | loss: 0.0312286 | val_loss: 0.0312202 | Time: 54420.2 ms
[2021-09-27 14:27:01 main:574] : INFO : Epoch 414 | loss: 0.0312276 | val_loss: 0.0312255 | Time: 2889.24 ms
[2021-09-27 14:27:05 main:574] : INFO : Epoch 415 | loss: 0.0312216 | val_loss: 0.0312195 | Time: 3029.88 ms
[2021-09-27 14:27:36 main:574] : INFO : Epoch 416 | loss: 0.0312203 | val_loss: 0.0312211 | Time: 31346.1 ms
[2021-09-27 14:30:34 main:574] : INFO : Epoch 417 | loss: 0.0312202 | val_loss: 0.0312169 | Time: 177859 ms
[2021-09-27 14:32:50 main:574] : INFO : Epoch 418 | loss: 0.0312189 | val_loss: 0.0312165 | Time: 136268 ms
[2021-09-27 14:35:40 main:574] : INFO : Epoch 419 | loss: 0.0312208 | val_loss: 0.0312216 | Time: 165071 ms
[2021-09-27 14:38:40 main:574] : INFO : Epoch 420 | loss: 0.0312199 | val_loss: 0.0312175 | Time: 179312 ms
[2021-09-27 14:39:54 main:574] : INFO : Epoch 421 | loss: 0.0312183 | val_loss: 0.0312158 | Time: 68916.5 ms
[2021-09-27 14:39:57 main:574] : INFO : Epoch 422 | loss: 0.0312179 | val_loss: 0.0312171 | Time: 2921.26 ms
[2021-09-27 14:40:01 main:574] : INFO : Epoch 423 | loss: 0.0312224 | val_loss: 0.0312178 | Time: 3178.83 ms
[2021-09-27 14:40:55 main:574] : INFO : Epoch 424 | loss: 0.0312187 | val_loss: 0.0312154 | Time: 54071.7 ms
[2021-09-27 14:41:32 main:574] : INFO : Epoch 425 | loss: 0.0312173 | val_loss: 0.0312186 | Time: 37149.4 ms
[2021-09-27 14:41:35 main:574] : INFO : Epoch 426 | loss: 0.0312216 | val_loss: 0.0312271 | Time: 3151.13 ms
[2021-09-27 14:44:31 main:574] : INFO : Epoch 427 | loss: 0.0312204 | val_loss: 0.0312198 | Time: 174082 ms
[2021-09-27 14:47:05 main:574] : INFO : Epoch 428 | loss: 0.0312202 | val_loss: 0.0312171 | Time: 148362 ms
[2021-09-27 14:50:08 main:574] : INFO : Epoch 429 | loss: 0.0312183 | val_loss: 0.0312162 | Time: 178133 ms
[2021-09-27 14:53:08 main:574] : INFO : Epoch 430 | loss: 0.0312191 | val_loss: 0.0312153 | Time: 174970 ms
[2021-09-27 14:53:34 main:574] : INFO : Epoch 431 | loss: 0.0312228 | val_loss: 0.031218 | Time: 26305.9 ms
[2021-09-27 14:54:59 main:574] : INFO : Epoch 432 | loss: 0.031218 | val_loss: 0.0312163 | Time: 84919.4 ms
[2021-09-27 14:56:11 main:574] : INFO : Epoch 433 | loss: 0.03122 | val_loss: 0.0312168 | Time: 71175.2 ms
[2021-09-27 14:59:02 main:574] : INFO : Epoch 434 | loss: 0.0312286 | val_loss: 0.0312268 | Time: 166256 ms
[2021-09-27 15:02:22 main:574] : INFO : Epoch 435 | loss: 0.0312282 | val_loss: 0.0312246 | Time: 199475 ms
[2021-09-27 15:05:06 main:574] : INFO : Epoch 436 | loss: 0.0312258 | val_loss: 0.0312327 | Time: 163903 ms
[2021-09-27 15:06:40 main:574] : INFO : Epoch 437 | loss: 0.0312264 | val_loss: 0.0312225 | Time: 89374.6 ms
[2021-09-27 15:09:06 main:574] : INFO : Epoch 438 | loss: 0.0312238 | val_loss: 0.0312211 | Time: 140889 ms
[2021-09-27 15:09:55 main:574] : INFO : Epoch 439 | loss: 0.0312215 | val_loss: 0.0312204 | Time: 48721.4 ms
[2021-09-27 15:10:37 main:574] : INFO : Epoch 440 | loss: 0.0312221 | val_loss: 0.0312203 | Time: 36780.1 ms
[2021-09-27 15:13:28 main:574] : INFO : Epoch 441 | loss: 0.0312207 | val_loss: 0.0312199 | Time: 171042 ms
[2021-09-27 15:14:27 main:574] : INFO : Epoch 442 | loss: 0.0312217 | val_loss: 0.0312261 | Time: 58760.8 ms
[2021-09-27 15:16:35 main:574] : INFO : Epoch 443 | loss: 0.0312224 | val_loss: 0.03122 | Time: 123527 ms
[2021-09-27 15:17:11 main:574] : INFO : Epoch 444 | loss: 0.0312214 | val_loss: 0.0312198 | Time: 30561.9 ms
[2021-09-27 15:19:26 main:574] : INFO : Epoch 445 | loss: 0.0312207 | val_loss: 0.0312187 | Time: 135189 ms
[2021-09-27 15:19:29 main:574] : INFO : Epoch 446 | loss: 0.0312203 | val_loss: 0.0312184 | Time: 2806.24 ms
[2021-09-27 15:19:34 main:574] : INFO : Epoch 447 | loss: 0.0312202 | val_loss: 0.0312182 | Time: 3340.46 ms
[2021-09-27 15:22:26 main:574] : INFO : Epoch 448 | loss: 0.0312207 | val_loss: 0.0312206 | Time: 171781 ms
[2021-09-27 15:23:14 main:574] : INFO : Epoch 449 | loss: 0.0312196 | val_loss: 0.0312189 | Time: 47865.3 ms
[2021-09-27 15:24:05 main:574] : INFO : Epoch 450 | loss: 0.0312204 | val_loss: 0.0312232 | Time: 45431 ms
[2021-09-27 15:24:55 main:574] : INFO : Epoch 451 | loss: 0.0312196 | val_loss: 0.0312208 | Time: 50808.4 ms
[2021-09-27 15:25:04 main:574] : INFO : Epoch 452 | loss: 0.0312209 | val_loss: 0.0312206 | Time: 8721.77 ms
[2021-09-27 15:26:05 main:574] : INFO : Epoch 453 | loss: 0.03122 | val_loss: 0.0312231 | Time: 56082 ms
[2021-09-27 15:27:18 main:574] : INFO : Epoch 454 | loss: 0.0312184 | val_loss: 0.0312182 | Time: 72963.1 ms
[2021-09-27 15:29:24 main:574] : INFO : Epoch 455 | loss: 0.031217 | val_loss: 0.0312173 | Time: 121118 ms
[2021-09-27 15:32:22 main:574] : INFO : Epoch 456 | loss: 0.0312178 | val_loss: 0.0312192 | Time: 178106 ms
[2021-09-27 15:35:11 main:574] : INFO : Epoch 457 | loss: 0.0312196 | val_loss: 0.0312172 | Time: 168631 ms
[2021-09-27 15:36:21 main:574] : INFO : Epoch 458 | loss: 0.0312171 | val_loss: 0.0312189 | Time: 69399.6 ms
[2021-09-27 15:37:18 main:574] : INFO : Epoch 459 | loss: 0.0312184 | val_loss: 0.031217 | Time: 57924.9 ms
[2021-09-27 15:37:21 main:574] : INFO : Epoch 460 | loss: 0.0312178 | val_loss: 0.031218 | Time: 2912.19 ms
[2021-09-27 15:37:25 main:574] : INFO : Epoch 461 | loss: 0.031219 | val_loss: 0.031219 | Time: 3419.15 ms
[2021-09-27 15:39:18 main:574] : INFO : Epoch 462 | loss: 0.0312183 | val_loss: 0.0312157 | Time: 112993 ms
[2021-09-27 15:40:43 main:574] : INFO : Epoch 463 | loss: 0.0312156 | val_loss: 0.0312169 | Time: 84621 ms
[2021-09-27 15:44:13 main:574] : INFO : Epoch 464 | loss: 0.0312178 | val_loss: 0.031218 | Time: 209865 ms
[2021-09-27 15:47:01 main:574] : INFO : Epoch 465 | loss: 0.0312177 | val_loss: 0.0312153 | Time: 168581 ms
[2021-09-27 15:49:36 main:574] : INFO : Epoch 466 | loss: 0.0312173 | val_loss: 0.0312166 | Time: 154658 ms
[2021-09-27 15:52:36 main:574] : INFO : Epoch 467 | loss: 0.031216 | val_loss: 0.031219 | Time: 174581 ms
[2021-09-27 15:53:28 main:574] : INFO : Epoch 468 | loss: 0.0312174 | val_loss: 0.0312158 | Time: 51448.2 ms
[2021-09-27 15:53:31 main:574] : INFO : Epoch 469 | loss: 0.031216 | val_loss: 0.0312153 | Time: 2971.79 ms
[2021-09-27 15:54:01 main:574] : INFO : Epoch 470 | loss: 0.0312164 | val_loss: 0.031217 | Time: 29608.5 ms
[2021-09-27 15:55:01 main:574] : INFO : Epoch 471 | loss: 0.031217 | val_loss: 0.0312175 | Time: 54555.9 ms
[2021-09-27 15:56:19 main:574] : INFO : Epoch 472 | loss: 0.0312171 | val_loss: 0.0312168 | Time: 78424.1 ms
[2021-09-27 15:57:42 main:574] : INFO : Epoch 473 | loss: 0.0312199 | val_loss: 0.031217 | Time: 73851.6 ms
[2021-09-27 15:59:38 main:574] : INFO : Epoch 474 | loss: 0.0312168 | val_loss: 0.0312203 | Time: 94733.4 ms
[2021-09-27 15:59:41 main:574] : INFO : Epoch 475 | loss: 0.031218 | val_loss: 0.031218 | Time: 2790.81 ms
[2021-09-27 15:59:45 main:574] : INFO : Epoch 476 | loss: 0.0312161 | val_loss: 0.031235 | Time: 3359.97 ms
[2021-09-27 16:03:35 main:574] : INFO : Epoch 477 | loss: 0.0312215 | val_loss: 0.0312297 | Time: 229264 ms
[2021-09-27 16:03:47 main:574] : INFO : Epoch 478 | loss: 0.0312195 | val_loss: 0.031221 | Time: 12030.6 ms
[2021-09-27 16:03:50 main:574] : INFO : Epoch 479 | loss: 0.0312167 | val_loss: 0.0312144 | Time: 2828.92 ms
[2021-09-27 16:03:54 main:574] : INFO : Epoch 480 | loss: 0.0312139 | val_loss: 0.0312138 | Time: 3535.14 ms
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFAE99B9B92
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 09/27/21 16:04:17
Install Directory : C:\Program Files\BOINC\
Data Directory : C:\ProgramData\BOINC
Project Symstore :
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\16;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 00000000d27f0000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000ec010000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.1023 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1023
ModLoad: 00000000ea4e0000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1151
ModLoad: 00000000e98f0000 00000000002c9000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1151
ModLoad: 00000000eae90000 00000000001a1000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000e9e80000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1237) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.1237 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1237
ModLoad: 00000000ebb10000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.1202 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1202
ModLoad: 00000000e9d70000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1110) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.1110 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1110
ModLoad: 00000000e9850000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 00000000e9eb0000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 00000000ea100000 00000000000ac000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1052) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000eb8f0000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.19041.546
ModLoad: 00000000ea060000 000000000009b000 C:\WINDOWS\System32\sechost.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000eb7b0000 000000000012a000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1081) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000c15f0000 0000000000058000 C:\ProgramData\BOINC\slots\16\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000cd5a0000 0000000000092000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.28.29334.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\6\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.28.29334.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.28.29334.0
ModLoad: 00000000da520000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.867 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.867
ModLoad: 00000000cd640000 0000000000019000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.28.29334.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\6\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.28.29334.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.28.29334.0
ModLoad: 00000000cd660000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.28.29334.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\6\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.28.29334.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.28.29334.0
ModLoad: 0000000037970000 0000000024b49000 C:\ProgramData\BOINC\slots\16\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000c47a0000 0000000000045000 C:\ProgramData\BOINC\slots\16\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000006b000000 00000000034b2000 C:\ProgramData\BOINC\slots\16\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 000000002cd80000 000000000abe7000 C:\ProgramData\BOINC\slots\16\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000e2fe0000 0000000000010000 C:\ProgramData\BOINC\slots\16\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 0000000061b70000 00000000030a5000 C:\ProgramData\BOINC\slots\16\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 00000000302d0000 000000001b3a4000 C:\ProgramData\BOINC\slots\16\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 000000008c540000 000000000020d000 C:\ProgramData\BOINC\slots\16\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 000000008ba90000 00000000002db000 C:\ProgramData\BOINC\slots\16\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000c5010000 0000000000040000 C:\ProgramData\BOINC\slots\16\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000001c5a0000 0000000003d5b000 C:\ProgramData\BOINC\slots\16\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 0000000069130000 0000000001eca000 C:\ProgramData\BOINC\slots\16\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 000000005b9e0000 000000000919f000 C:\ProgramData\BOINC\slots\16\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 00000000ea2e0000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000e7650000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000ebb50000 0000000000472000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1237) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000e9bc0000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1151
ModLoad: 00000000e97c0000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000e94d0000 0000000000034000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1151
ModLoad: 00000000e97f0000 0000000000060000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1237) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.1237 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1237
ModLoad: 00000000e9c10000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000e9310000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000ea5a0000 000000000073f000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.964 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.964
ModLoad: 00000000e7850000 0000000000790000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000eb3f0000 0000000000355000 C:\WINDOWS\System32\combase.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.1202 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1202
ModLoad: 00000000e9180000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000ea320000 00000000000ae000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000eb300000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000008b7c0000 00000000002cc000 C:\WINDOWS\system32\nvcuda.dll (30.0.14.7141) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r470\r471_34\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 30.0.14.7141
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.4.94 driver
Product Version : 30.0.14.7141
ModLoad: 00000000e3950000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000067110000 000000000161a000 C:\WINDOWS\system32\DriverStore\FileRepository\nvhdc.inf_amd64_75e4d75cf672cb89\nvcuda64.dll (30.0.14.7141) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r470\r471_34\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 30.0.14.7141
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.4.94 driver
Product Version : 30.0.14.7141
ModLoad: 00000000e0930000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.906 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.906
ModLoad: 00000000d9730000 000000000014a000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.19041.1081) (-exported- Symbols Loaded)
Linked PDB Filename : drvstore.pdb
File Version : 10.0.19041.1081 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1081
ModLoad: 00000000e90f0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000e7190000 000000000009e000 C:\WINDOWS\system32\uxtheme.dll (6.2.19041.1081) (-exported- Symbols Loaded)
Linked PDB Filename : UxTheme.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000f0d00000 0000000000719000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.14.7141) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r470\r471_34\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 30.0.14.7141
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 30.0.14.7141
ModLoad: 00000000ea1b0000 000000000012a000 C:\WINDOWS\System32\ole32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : ole32.pdb
File Version : 10.0.19041.1202 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1202
ModLoad: 00000000db030000 0000000000009000 C:\ProgramData\BOINC\slots\16\caffe2_nvrtc.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000066140000 0000000000fca000 C:\ProgramData\BOINC\slots\16\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6.14.11.9000
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.89 NVRTC Library
Product Version : 6.14.11.9000
ModLoad: 00000000e9730000 0000000000083000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.1202 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1202
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 4105, Write: 5441, Other 14377
- I/O Transfers Counters -
Read: 6585228, Write: 12695465, Other 143194
- Paged Pool Usage -
QuotaPagedPoolUsage: 3545304, QuotaPeakPagedPoolUsage: 3545576
QuotaNonPagedPoolUsage: 59016, QuotaPeakNonPagedPoolUsage: 59424
- Virtual Memory Usage -
VirtualSize: 394690560, PeakVirtualSize: 1025421312
- Pagefile Usage -
PagefileUsage: 394690560, PeakPagefileUsage: 396468224
- Working Set Size -
WorkingSetSize: -2121011200, PeakWorkingSetSize: -2051641344, PageFaultCount: 896894
*** Dump of thread ID 15004 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 312500.000000, Wait Time: 68688456.000000
- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFAE99B9B92
- Registers -
rax=0000000000000000 rbx=0000000000000001 rcx=00000000d2aa8c40 rdx=00000000e23fead0 rsi=0000000000000000 rdi=0000000000000000
r8=00000000e23fead0 r9=00000000d2aa8c30 r10=0000000000000fff r11=0000000000000ff0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000e99b9b92 rsp=00000000e23feaa8 rbp=0000000000000000
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
e23feaa0 d2829100 00000001 e23fead0 e23fead0 d2aa8c30 KERNELBASE!DebugBreak+0x0
e23feee0 d2829ce4 cd800000 e23ff244 00000000 00000320 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
e23ffe40 d282a084 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
e23ffe70 ea4f7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
e23ffea0 ec062651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
e23fff20 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 13248 (state: Ready): ***
- Information -
Status: Base Priority: Above Normal, Priority: Highest, , Kernel Time: 224375008.000000, User Time: 6518281216.000000, Wait Time: 68688200.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000bbeacc38 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000bbeacc38
r8=00000000ffffffff r9=0000000000000000 r10=00000000bbb02918 r11=00000000e1ee47a0 r12=0000000000000000 r13=0000000000000000
r14=00000000e1ee5750 r15=00000000bbeacbe8 rip=00000000ec0b0764 rsp=00000000e1ee5728 rbp=00000000e1ee5780
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
e1ee5720 ec074021 00000000 3234ea63 05d444f0 e1ee5760 ntdll!NtWaitForAlertByThreadId+0x0
e1ee57a0 e995cee9 bbeacc30 bbeacc28 bbeacbe0 e1ee53c0 ntdll!RtlSleepConditionVariableSRW+0x0
e1ee57e0 cd5dbf3d 00000000 e1ee53c0 c47a2e0d c1612433 KERNELBASE!SleepConditionVariableSRW+0x0
e1ee5820 cd5b2798 00000000 32350231 c1629c50 00000000 MSVCP140!__crtSetThreadpoolWait+0x0
e1ee5850 cd5b2a4a 05f7aa9c bbeacbe0 bbb38b30 bbeacc28 MSVCP140!std::_Winerror_message+0x0
e1ee5880 33f6064b bbeacbe0 e1ee5980 bbeacbe0 ffffffff MSVCP140!_Cnd_wait+0x0
e1ee58c0 33f625b1 052c4c50 bbb38b20 bbb38b20 00000000 torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
e1ee5bb0 33f5f15d e1ee5e90 e1ee5e90 e1ee5e90 052c4c50 torch_cpu!torch::autograd::Engine::thread_main+0x0
e1ee5e20 33f5eea0 b8691c80 37486d10 fffffffe 00000000 torch_cpu!torch::autograd::Engine::execute_with_graph_task+0x0
e1ee5f50 33f556f9 cfb06270 cfb06270 e1ee5f40 e1ee6048 torch_cpu!torch::autograd::Engine::execute+0x0
e1ee6470 33f55086 00000000 e1ee68d8 cfb06100 e1ee6540 torch_cpu!torch::autograd::Engine::make_anomaly_metadata+0x0
e1ee6510 342509be bbb033c0 cfb06278 00000000 e1ee64b0 torch_cpu!torch::autograd::backward+0x0
e1ee65f0 33c81cd0 06d56a30 00000000 00000000 00000000 torch_cpu!torch::autograd::VariableType::allCUDATypes+0x0
e1ee6620 32920a06 00000000 00000000 00010001 00000001 torch_cpu!torch::autograd::GraphRoot::apply+0x0
e1ee6850 d2807166 e1ee6920 e1ee6960 e1ee6920 e1ee6ec0 torch_cpu!at::Tensor::backward+0x0
e1ee6d50 d280b950 e1ee6e50 e1ee6e50 00000000 6d258170 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0
e1effaf0 d2a4c6f8 06cd0c50 00000000 00000000 06e211e0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
e1effb30 ea4f7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
e1effb60 ec062651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
e1effbe0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 10004 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 312500.000000, Wait Time: 68688456.000000
- Registers -
rax=000000000000005b rbx=000000000000000e rcx=000000000000000e rdx=00000000e24ff6a0 rsi=0000000000000000 rdi=000000000000000e
r8=00000000e24ff348 r9=0000000006e481e0 r10=0000000000000000 r11=0000000000000246 r12=0000000000000064 r13=00000000e24ff6a0
r14=00000000e24ff3a0 r15=0000000000000000 rip=00000000ec0ad8c4 rsp=00000000e24ff348 rbp=0000000006e481e0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
e24ff340 e993cb70 00000000 e1c2a000 ec17a4d0 e1c2a000 ntdll!ZwWaitForMultipleObjects+0x0
e24ff630 e993ca6e 052c1d90 004e0049 0000000e 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
e24ff670 672e1264 06e4cbc0 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0
e24ff8b0 67387f5d 00000000 06e481e0 00000000 00000000 nvcuda64!+0x0
e24ff960 672e0c33 e04637e5 5bdba580 07497a30 00000000 nvcuda64!cuProfilerStop+0x0
e24ff990 67616824 07497a30 00000000 00000000 00000000 nvcuda64!+0x0
e24ff9c0 ea4f7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
e24ff9f0 ec062651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
e24ffa70 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 16600 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 66172956.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002c4 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002c4
r8=00000000e25ffc98 r9=0000000000000000 r10=0000000000000000 r11=00000000e25ffcf8 r12=0000000000000000 r13=0000000000000000
r14=00000000000002c4 r15=0000000000000000 rip=00000000ec0acdf4 rsp=00000000e25ff9f8 rbp=0000000006eb7780
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
e25ff9f0 e9911a8e 00000000 ec062630 0000027f 00000000 ntdll!ZwWaitForSingleObject+0x0
e25ffa90 6750e0ad 07497670 00000000 00000000 000002c4 KERNELBASE!WaitForSingleObjectEx+0x0
e25ffcf0 672e0c33 00000000 07497670 67110000 06ecee90 nvcuda64!cuProfilerStop+0x0
e25ffd20 67616824 07497670 00000000 00000000 00000000 nvcuda64!+0x0
e25ffd50 ea4f7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
e25ffd80 ec062651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
e25ffe00 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 6716 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 68688432.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=0000000006f8ea50 rdx=00000000e26ff7f8 rsi=00000000e26ff760 rdi=0000000000000000
r8=0000000000000004 r9=0000000000000004 r10=0000000000000003 r11=00000000e26ff790 r12=00000000e26ff7f8 r13=0000000000000000
r14=0000000006f8ea50 r15=0000000006f937a0 rip=00000000ec0b0764 rsp=00000000e26ff738 rbp=00000000e26ff790
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
e26ff730 ec074295 00000102 673c2c16 00000000 e26ff760 ntdll!NtWaitForAlertByThreadId+0x0
e26ff7a0 e995ce39 06f90f80 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0
e26ff7d0 6724effc 06f90f80 06f90f80 06f90f80 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0
e26ff830 672e0c33 00000003 e033245d d2421b97 00000000 nvcuda64!+0x0
e26ff860 67616824 07497f40 00000000 00000000 00000000 nvcuda64!+0x0
e26ff890 ea4f7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
e26ff8c0 ec062651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
e26ff940 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 17724 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 197187504.000000, User Time: 5108749824.000000, Wait Time: 68688200.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000aeaf7388 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000aeaf7388
r8=0000000000000080 r9=0000000000008000 r10=0000000000000000 r11=00000000941f9600 r12=0000000000000000 r13=0000000000000000
r14=00000000e27ff7a0 r15=00000000aeaf7338 rip=00000000ec0b0764 rsp=00000000e27ff778 rbp=00000000e27ff7d0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
e27ff770 ec074021 bbeacc28 cd5b2f97 bbb38b30 bbb38b20 ntdll!NtWaitForAlertByThreadId+0x0
e27ff7f0 e995cee9 aeaf7380 aeaf7378 aeaf7330 00000000 ntdll!RtlSleepConditionVariableSRW+0x0
e27ff830 cd5dbf3d bbb38b50 00000000 00000000 33f605b4 KERNELBASE!SleepConditionVariableSRW+0x0
e27ff870 cd5b2798 00000000 bbb38b50 00000000 00000000 MSVCP140!__crtSetThreadpoolWait+0x0
e27ff8a0 cd5b2a4a 06660a2c 00000000 e27ffab0 aeaf7378 MSVCP140!std::_Winerror_message+0x0
e27ff8d0 33f6064b aeaf7330 e27ff9d0 aeaf7330 bbb38b30 MSVCP140!_Cnd_wait+0x0
e27ff910 33f625b1 d0490a30 ffffffff bbb38b30 ffffffff torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
e27ffc00 33f62471 37486d10 e27ffc40 37486d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0
e27ffc50 33f59744 00080001 cfafecf0 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0
e27ffc80 e9ed1bb2 cfafecf0 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0
e27ffcb0 ea4f7034 00000000 00000000 00000000 00000000 ucrtbase!_configthreadlocale+0x0
e27ffce0 ec062651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
e27ffd60 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)