Task 5577081
| Name | ParityMachine-1624572206-14330-0_1 |
| Workunit | 3298952 |
| Created | 3 Jul 2021, 4:13:48 UTC |
| Sent | 3 Jul 2021, 6:04:22 UTC |
| Report deadline | 11 Jul 2021, 6:04:22 UTC |
| Received | 3 Jul 2021, 7:34:18 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | -529697949 (0xE06D7363) Unknown error code |
| Computer ID | 7258 |
| Run time | 1 hours 6 min 59 sec |
| CPU time | 1 hours 6 min 49 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 1,132.78 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 2.14 GB |
| Peak swap size | 3.57 GB |
| Peak disk usage | 1.53 GB |
Stderr output
<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
189 | loss: 0.0310572 | val_loss: 0.0312655 | Time: 9321.67 ms
[2021-07-03 08:53:18 main:574] : INFO : Epoch 190 | loss: 0.0310571 | val_loss: 0.0312703 | Time: 9213.2 ms
[2021-07-03 08:53:27 main:574] : INFO : Epoch 191 | loss: 0.0310584 | val_loss: 0.0312443 | Time: 9294.04 ms
[2021-07-03 08:53:36 main:574] : INFO : Epoch 192 | loss: 0.0310595 | val_loss: 0.031284 | Time: 9309.43 ms
[2021-07-03 08:53:46 main:574] : INFO : Epoch 193 | loss: 0.0310599 | val_loss: 0.0312566 | Time: 9340.29 ms
[2021-07-03 08:53:55 main:574] : INFO : Epoch 194 | loss: 0.0310559 | val_loss: 0.0312416 | Time: 9422.92 ms
[2021-07-03 08:54:05 main:574] : INFO : Epoch 195 | loss: 0.0310544 | val_loss: 0.0312454 | Time: 9325.62 ms
[2021-07-03 08:54:14 main:574] : INFO : Epoch 196 | loss: 0.031062 | val_loss: 0.0312284 | Time: 9330.63 ms
[2021-07-03 08:54:23 main:574] : INFO : Epoch 197 | loss: 0.0310638 | val_loss: 0.031272 | Time: 9221.3 ms
[2021-07-03 08:54:33 main:574] : INFO : Epoch 198 | loss: 0.0310567 | val_loss: 0.0312781 | Time: 9199.15 ms
[2021-07-03 08:54:42 main:574] : INFO : Epoch 199 | loss: 0.0310549 | val_loss: 0.0312897 | Time: 9231.31 ms
[2021-07-03 08:54:51 main:574] : INFO : Epoch 200 | loss: 0.0310576 | val_loss: 0.0312804 | Time: 9271.05 ms
[2021-07-03 08:55:00 main:574] : INFO : Epoch 201 | loss: 0.031059 | val_loss: 0.0312843 | Time: 9339.32 ms
[2021-07-03 08:55:10 main:574] : INFO : Epoch 202 | loss: 0.0310527 | val_loss: 0.0312757 | Time: 9358.82 ms
[2021-07-03 08:55:19 main:574] : INFO : Epoch 203 | loss: 0.0310498 | val_loss: 0.0312684 | Time: 9312.37 ms
[2021-07-03 08:55:29 main:574] : INFO : Epoch 204 | loss: 0.0310548 | val_loss: 0.0312624 | Time: 9198.66 ms
[2021-07-03 08:55:38 main:574] : INFO : Epoch 205 | loss: 0.0310555 | val_loss: 0.0312797 | Time: 9379.24 ms
[2021-07-03 08:55:47 main:574] : INFO : Epoch 206 | loss: 0.0310572 | val_loss: 0.0312508 | Time: 9362.47 ms
[2021-07-03 08:55:57 main:574] : INFO : Epoch 207 | loss: 0.0310594 | val_loss: 0.0312839 | Time: 9307.91 ms
[2021-07-03 08:56:06 main:574] : INFO : Epoch 208 | loss: 0.0310551 | val_loss: 0.0312496 | Time: 9188.85 ms
[2021-07-03 08:56:15 main:574] : INFO : Epoch 209 | loss: 0.0310513 | val_loss: 0.0312542 | Time: 9418.92 ms
[2021-07-03 08:56:24 main:574] : INFO : Epoch 210 | loss: 0.0310494 | val_loss: 0.0312726 | Time: 9216.44 ms
[2021-07-03 08:56:34 main:574] : INFO : Epoch 211 | loss: 0.0310465 | val_loss: 0.0312517 | Time: 9259.08 ms
[2021-07-03 08:56:43 main:574] : INFO : Epoch 212 | loss: 0.0310452 | val_loss: 0.0312917 | Time: 9312.29 ms
[2021-07-03 08:56:53 main:574] : INFO : Epoch 213 | loss: 0.0310419 | val_loss: 0.0312638 | Time: 9437.8 ms
[2021-07-03 08:57:02 main:574] : INFO : Epoch 214 | loss: 0.0310468 | val_loss: 0.0312658 | Time: 9343.92 ms
[2021-07-03 08:57:11 main:574] : INFO : Epoch 215 | loss: 0.0310494 | val_loss: 0.031277 | Time: 9316.7 ms
[2021-07-03 08:57:21 main:574] : INFO : Epoch 216 | loss: 0.0310435 | val_loss: 0.0312603 | Time: 9287.43 ms
[2021-07-03 08:57:30 main:574] : INFO : Epoch 217 | loss: 0.0310392 | val_loss: 0.0312865 | Time: 9250.4 ms
[2021-07-03 08:57:39 main:574] : INFO : Epoch 218 | loss: 0.0310453 | val_loss: 0.0312791 | Time: 9233.3 ms
[2021-07-03 08:57:48 main:574] : INFO : Epoch 219 | loss: 0.0310477 | val_loss: 0.0312611 | Time: 9180.77 ms
[2021-07-03 08:57:58 main:574] : INFO : Epoch 220 | loss: 0.0310408 | val_loss: 0.0312661 | Time: 9241.29 ms
[2021-07-03 08:58:07 main:574] : INFO : Epoch 221 | loss: 0.0310424 | val_loss: 0.0312767 | Time: 9302.6 ms
[2021-07-03 08:58:16 main:574] : INFO : Epoch 222 | loss: 0.03104 | val_loss: 0.0312547 | Time: 9414.45 ms
[2021-07-03 08:58:26 main:574] : INFO : Epoch 223 | loss: 0.0310512 | val_loss: 0.0312788 | Time: 9196.04 ms
[2021-07-03 08:58:35 main:574] : INFO : Epoch 224 | loss: 0.0310462 | val_loss: 0.0312891 | Time: 9224.05 ms
[2021-07-03 08:58:44 main:574] : INFO : Epoch 225 | loss: 0.0310419 | val_loss: 0.0312633 | Time: 9360.31 ms
[2021-07-03 08:58:54 main:574] : INFO : Epoch 226 | loss: 0.0310345 | val_loss: 0.0312862 | Time: 9241.67 ms
[2021-07-03 08:59:03 main:574] : INFO : Epoch 227 | loss: 0.0310338 | val_loss: 0.0312835 | Time: 9172.21 ms
[2021-07-03 08:59:12 main:574] : INFO : Epoch 228 | loss: 0.0310462 | val_loss: 0.031313 | Time: 9212.73 ms
[2021-07-03 08:59:21 main:574] : INFO : Epoch 229 | loss: 0.0310368 | val_loss: 0.0313082 | Time: 9352.98 ms
[2021-07-03 08:59:31 main:574] : INFO : Epoch 230 | loss: 0.0310375 | val_loss: 0.0312461 | Time: 9346.09 ms
[2021-07-03 08:59:40 main:574] : INFO : Epoch 231 | loss: 0.0310407 | val_loss: 0.0312983 | Time: 9258.1 ms
[2021-07-03 08:59:50 main:574] : INFO : Epoch 232 | loss: 0.0310388 | val_loss: 0.0312895 | Time: 9410.97 ms
[2021-07-03 08:59:59 main:574] : INFO : Epoch 233 | loss: 0.0310443 | val_loss: 0.0313329 | Time: 9331.43 ms
[2021-07-03 09:00:08 main:574] : INFO : Epoch 234 | loss: 0.0310425 | val_loss: 0.0312791 | Time: 9444.39 ms
[2021-07-03 09:00:18 main:574] : INFO : Epoch 235 | loss: 0.0310388 | val_loss: 0.0312954 | Time: 9275.69 ms
[2021-07-03 09:00:27 main:574] : INFO : Epoch 236 | loss: 0.0310384 | val_loss: 0.0312904 | Time: 9229.69 ms
[2021-07-03 09:00:36 main:574] : INFO : Epoch 237 | loss: 0.0310315 | val_loss: 0.0312786 | Time: 9302.82 ms
[2021-07-03 09:00:46 main:574] : INFO : Epoch 238 | loss: 0.031035 | val_loss: 0.0312954 | Time: 9289.95 ms
[2021-07-03 09:00:55 main:574] : INFO : Epoch 239 | loss: 0.0310344 | val_loss: 0.0313119 | Time: 9337.35 ms
[2021-07-03 09:01:04 main:574] : INFO : Epoch 240 | loss: 0.0310351 | val_loss: 0.031287 | Time: 9322.44 ms
[2021-07-03 09:01:14 main:574] : INFO : Epoch 241 | loss: 0.031031 | val_loss: 0.031291 | Time: 9306.76 ms
[2021-07-03 09:01:23 main:574] : INFO : Epoch 242 | loss: 0.0310353 | val_loss: 0.0313051 | Time: 9357.9 ms
[2021-07-03 09:01:32 main:574] : INFO : Epoch 243 | loss: 0.0310398 | val_loss: 0.0313199 | Time: 9432.74 ms
[2021-07-03 09:01:42 main:574] : INFO : Epoch 244 | loss: 0.0310334 | val_loss: 0.0312936 | Time: 9304.53 ms
[2021-07-03 09:01:51 main:574] : INFO : Epoch 245 | loss: 0.0310282 | val_loss: 0.0313323 | Time: 9422.51 ms
[2021-07-03 09:02:01 main:574] : INFO : Epoch 246 | loss: 0.0310339 | val_loss: 0.0312527 | Time: 9374.66 ms
[2021-07-03 09:02:10 main:574] : INFO : Epoch 247 | loss: 0.031041 | val_loss: 0.0312942 | Time: 9370.75 ms
[2021-07-03 09:02:19 main:574] : INFO : Epoch 248 | loss: 0.0310338 | val_loss: 0.0313083 | Time: 9219.02 ms
[2021-07-03 09:02:29 main:574] : INFO : Epoch 249 | loss: 0.0310438 | val_loss: 0.0312793 | Time: 9317.43 ms
[2021-07-03 09:02:38 main:574] : INFO : Epoch 250 | loss: 0.0310443 | val_loss: 0.0313038 | Time: 9386.63 ms
[2021-07-03 09:02:47 main:574] : INFO : Epoch 251 | loss: 0.0310335 | val_loss: 0.0313163 | Time: 9268.59 ms
[2021-07-03 09:02:57 main:574] : INFO : Epoch 252 | loss: 0.0310309 | val_loss: 0.0313417 | Time: 9322.76 ms
[2021-07-03 09:03:06 main:574] : INFO : Epoch 253 | loss: 0.0310336 | val_loss: 0.0313179 | Time: 9206.7 ms
[2021-07-03 09:03:16 main:574] : INFO : Epoch 254 | loss: 0.0310244 | val_loss: 0.0312798 | Time: 9356.61 ms
[2021-07-03 09:03:25 main:574] : INFO : Epoch 255 | loss: 0.0310244 | val_loss: 0.0313302 | Time: 9301.06 ms
[2021-07-03 09:03:34 main:574] : INFO : Epoch 256 | loss: 0.0310199 | val_loss: 0.0312869 | Time: 9287.03 ms
[2021-07-03 09:03:44 main:574] : INFO : Epoch 257 | loss: 0.0310219 | val_loss: 0.0312935 | Time: 9406.74 ms
[2021-07-03 09:03:53 main:574] : INFO : Epoch 258 | loss: 0.031019 | val_loss: 0.0313246 | Time: 9214.8 ms
[2021-07-03 09:04:02 main:574] : INFO : Epoch 259 | loss: 0.0310198 | val_loss: 0.0312902 | Time: 9296.23 ms
[2021-07-03 09:04:12 main:574] : INFO : Epoch 260 | loss: 0.0310228 | val_loss: 0.0313296 | Time: 9355.38 ms
[2021-07-03 09:04:21 main:574] : INFO : Epoch 261 | loss: 0.0310264 | val_loss: 0.0312912 | Time: 9362.7 ms
[2021-07-03 09:04:30 main:574] : INFO : Epoch 262 | loss: 0.0310404 | val_loss: 0.0313285 | Time: 9392.35 ms
[2021-07-03 09:04:40 main:574] : INFO : Epoch 263 | loss: 0.0310287 | val_loss: 0.0312851 | Time: 9435.47 ms
[2021-07-03 09:04:49 main:574] : INFO : Epoch 264 | loss: 0.0310317 | val_loss: 0.0313911 | Time: 9431.08 ms
[2021-07-03 09:04:59 main:574] : INFO : Epoch 265 | loss: 0.0310373 | val_loss: 0.0313005 | Time: 9238.4 ms
[2021-07-03 09:05:08 main:574] : INFO : Epoch 266 | loss: 0.031027 | val_loss: 0.0313172 | Time: 9338.94 ms
[2021-07-03 09:05:17 main:574] : INFO : Epoch 267 | loss: 0.0310259 | val_loss: 0.0313064 | Time: 9302.45 ms
[2021-07-03 09:05:26 main:574] : INFO : Epoch 268 | loss: 0.0310222 | val_loss: 0.0313369 | Time: 9226.13 ms
[2021-07-03 09:05:36 main:574] : INFO : Epoch 269 | loss: 0.0310179 | val_loss: 0.0313018 | Time: 9381.17 ms
[2021-07-03 09:05:45 main:574] : INFO : Epoch 270 | loss: 0.0310202 | val_loss: 0.0312738 | Time: 9275.85 ms
[2021-07-03 09:05:54 main:574] : INFO : Epoch 271 | loss: 0.0310395 | val_loss: 0.0312667 | Time: 9254.48 ms
[2021-07-03 09:06:04 main:574] : INFO : Epoch 272 | loss: 0.0310318 | val_loss: 0.0313151 | Time: 9346.73 ms
[2021-07-03 09:06:13 main:574] : INFO : Epoch 273 | loss: 0.0310209 | val_loss: 0.0312914 | Time: 9260.67 ms
[2021-07-03 09:06:23 main:574] : INFO : Epoch 274 | loss: 0.0310191 | val_loss: 0.0313254 | Time: 9431.66 ms
[2021-07-03 09:06:32 main:574] : INFO : Epoch 275 | loss: 0.0310178 | val_loss: 0.0312929 | Time: 9322.7 ms
[2021-07-03 09:06:41 main:574] : INFO : Epoch 276 | loss: 0.0310215 | val_loss: 0.0312985 | Time: 9303.35 ms
[2021-07-03 09:06:51 main:574] : INFO : Epoch 277 | loss: 0.031015 | val_loss: 0.0313106 | Time: 9219.29 ms
[2021-07-03 09:07:00 main:574] : INFO : Epoch 278 | loss: 0.0310143 | val_loss: 0.0312941 | Time: 9282.15 ms
[2021-07-03 09:07:09 main:574] : INFO : Epoch 279 | loss: 0.0310149 | val_loss: 0.0313156 | Time: 9176.46 ms
[2021-07-03 09:07:18 main:574] : INFO : Epoch 280 | loss: 0.0310171 | val_loss: 0.031312 | Time: 9126.2 ms
[2021-07-03 09:07:28 main:574] : INFO : Epoch 281 | loss: 0.0310135 | val_loss: 0.0313312 | Time: 9357.75 ms
[2021-07-03 09:07:37 main:574] : INFO : Epoch 282 | loss: 0.0310114 | val_loss: 0.0312907 | Time: 9212.7 ms
[2021-07-03 09:07:46 main:574] : INFO : Epoch 283 | loss: 0.0310166 | val_loss: 0.031295 | Time: 9224.68 ms
[2021-07-03 09:07:55 main:574] : INFO : Epoch 284 | loss: 0.0310203 | val_loss: 0.0312935 | Time: 9295.5 ms
[2021-07-03 09:08:05 main:574] : INFO : Epoch 285 | loss: 0.0310141 | val_loss: 0.0313257 | Time: 9378.48 ms
[2021-07-03 09:08:14 main:574] : INFO : Epoch 286 | loss: 0.0310297 | val_loss: 0.0313115 | Time: 9238.2 ms
[2021-07-03 09:08:23 main:574] : INFO : Epoch 287 | loss: 0.0310187 | val_loss: 0.0313386 | Time: 9209.89 ms
[2021-07-03 09:08:33 main:574] : INFO : Epoch 288 | loss: 0.0310179 | val_loss: 0.0313218 | Time: 9321.53 ms
[2021-07-03 09:08:42 main:574] : INFO : Epoch 289 | loss: 0.0310104 | val_loss: 0.031341 | Time: 9276.7 ms
[2021-07-03 09:08:51 main:574] : INFO : Epoch 290 | loss: 0.0310146 | val_loss: 0.0312982 | Time: 9312.49 ms
[2021-07-03 09:09:01 main:574] : INFO : Epoch 291 | loss: 0.0310189 | val_loss: 0.0313597 | Time: 9328.02 ms
[2021-07-03 09:09:10 main:574] : INFO : Epoch 292 | loss: 0.0310128 | val_loss: 0.0313336 | Time: 9160.35 ms
[2021-07-03 09:09:19 main:574] : INFO : Epoch 293 | loss: 0.0310116 | val_loss: 0.031287 | Time: 9318.49 ms
[2021-07-03 09:09:28 main:574] : INFO : Epoch 294 | loss: 0.0310154 | val_loss: 0.0313436 | Time: 9385.28 ms
[2021-07-03 09:09:38 main:574] : INFO : Epoch 295 | loss: 0.0310128 | val_loss: 0.0312596 | Time: 9245.7 ms
[2021-07-03 09:09:47 main:574] : INFO : Epoch 296 | loss: 0.0310228 | val_loss: 0.031314 | Time: 9345.82 ms
[2021-07-03 09:09:57 main:574] : INFO : Epoch 297 | loss: 0.0310184 | val_loss: 0.0313333 | Time: 9223.15 ms
[2021-07-03 09:10:06 main:574] : INFO : Epoch 298 | loss: 0.0310037 | val_loss: 0.0313241 | Time: 9314.65 ms
[2021-07-03 09:10:15 main:574] : INFO : Epoch 299 | loss: 0.0310095 | val_loss: 0.0313166 | Time: 9297.37 ms
[2021-07-03 09:10:24 main:574] : INFO : Epoch 300 | loss: 0.0310131 | val_loss: 0.0312995 | Time: 9214.2 ms
[2021-07-03 09:10:34 main:574] : INFO : Epoch 301 | loss: 0.0310112 | val_loss: 0.0313217 | Time: 9324.7 ms
[2021-07-03 09:10:43 main:574] : INFO : Epoch 302 | loss: 0.031005 | val_loss: 0.0313133 | Time: 9328.17 ms
[2021-07-03 09:10:53 main:574] : INFO : Epoch 303 | loss: 0.0310037 | val_loss: 0.0313339 | Time: 9339.03 ms
[2021-07-03 09:11:02 main:574] : INFO : Epoch 304 | loss: 0.0310056 | val_loss: 0.0313444 | Time: 9268.3 ms
[2021-07-03 09:11:11 main:574] : INFO : Epoch 305 | loss: 0.0310129 | val_loss: 0.0312885 | Time: 9265 ms
[2021-07-03 09:11:20 main:574] : INFO : Epoch 306 | loss: 0.0310214 | val_loss: 0.0312962 | Time: 9305.86 ms
[2021-07-03 09:11:30 main:574] : INFO : Epoch 307 | loss: 0.0310103 | val_loss: 0.0313049 | Time: 9389.83 ms
[2021-07-03 09:11:39 main:574] : INFO : Epoch 308 | loss: 0.0310061 | val_loss: 0.0313374 | Time: 9227.4 ms
[2021-07-03 09:11:49 main:574] : INFO : Epoch 309 | loss: 0.0310049 | val_loss: 0.0313184 | Time: 9347.38 ms
[2021-07-03 09:11:58 main:574] : INFO : Epoch 310 | loss: 0.031003 | val_loss: 0.0313205 | Time: 9255.63 ms
[2021-07-03 09:12:07 main:574] : INFO : Epoch 311 | loss: 0.031015 | val_loss: 0.0312794 | Time: 9302.56 ms
[2021-07-03 09:12:17 main:574] : INFO : Epoch 312 | loss: 0.0310308 | val_loss: 0.0312721 | Time: 9374.67 ms
[2021-07-03 09:12:26 main:574] : INFO : Epoch 313 | loss: 0.0310171 | val_loss: 0.0313207 | Time: 9440.08 ms
[2021-07-03 09:12:35 main:574] : INFO : Epoch 314 | loss: 0.0310156 | val_loss: 0.031275 | Time: 9402.77 ms
[2021-07-03 09:12:45 main:574] : INFO : Epoch 315 | loss: 0.0310084 | val_loss: 0.0313104 | Time: 9408.33 ms
[2021-07-03 09:12:54 main:574] : INFO : Epoch 316 | loss: 0.0310017 | val_loss: 0.0313392 | Time: 9314.49 ms
[2021-07-03 09:13:04 main:574] : INFO : Epoch 317 | loss: 0.031006 | val_loss: 0.0313316 | Time: 9422.09 ms
[2021-07-03 09:13:13 main:574] : INFO : Epoch 318 | loss: 0.0310024 | val_loss: 0.0313397 | Time: 9364.28 ms
[2021-07-03 09:13:22 main:574] : INFO : Epoch 319 | loss: 0.0310034 | val_loss: 0.031335 | Time: 9336.68 ms
[2021-07-03 09:13:32 main:574] : INFO : Epoch 320 | loss: 0.0310121 | val_loss: 0.0313059 | Time: 9333.9 ms
[2021-07-03 09:13:41 main:574] : INFO : Epoch 321 | loss: 0.0310189 | val_loss: 0.0313492 | Time: 9257.57 ms
[2021-07-03 09:13:50 main:574] : INFO : Epoch 322 | loss: 0.0310118 | val_loss: 0.0313023 | Time: 9316.29 ms
[2021-07-03 09:14:00 main:574] : INFO : Epoch 323 | loss: 0.0310094 | val_loss: 0.0312891 | Time: 9244.46 ms
[2021-07-03 09:14:09 main:574] : INFO : Epoch 324 | loss: 0.0310073 | val_loss: 0.0313708 | Time: 9487.22 ms
[2021-07-03 09:14:19 main:574] : INFO : Epoch 325 | loss: 0.0310032 | val_loss: 0.0313342 | Time: 9439.02 ms
[2021-07-03 09:14:28 main:574] : INFO : Epoch 326 | loss: 0.0310057 | val_loss: 0.0313445 | Time: 9375.79 ms
[2021-07-03 09:14:37 main:574] : INFO : Epoch 327 | loss: 0.0309986 | val_loss: 0.0313129 | Time: 9333.3 ms
[2021-07-03 09:14:47 main:574] : INFO : Epoch 328 | loss: 0.031 | val_loss: 0.0313399 | Time: 9362.54 ms
[2021-07-03 09:14:56 main:574] : INFO : Epoch 329 | loss: 0.0310037 | val_loss: 0.0312912 | Time: 9359.51 ms
[2021-07-03 09:15:06 main:574] : INFO : Epoch 330 | loss: 0.0310038 | val_loss: 0.0313535 | Time: 9279.15 ms
[2021-07-03 09:15:15 main:574] : INFO : Epoch 331 | loss: 0.0310028 | val_loss: 0.0313199 | Time: 9235.98 ms
[2021-07-03 09:15:24 main:574] : INFO : Epoch 332 | loss: 0.0310018 | val_loss: 0.0313269 | Time: 9194.16 ms
[2021-07-03 09:15:33 main:574] : INFO : Epoch 333 | loss: 0.031004 | val_loss: 0.0313288 | Time: 9377.83 ms
[2021-07-03 09:15:43 main:574] : INFO : Epoch 334 | loss: 0.0309981 | val_loss: 0.0313135 | Time: 9449.09 ms
[2021-07-03 09:15:52 main:574] : INFO : Epoch 335 | loss: 0.0309992 | val_loss: 0.0313525 | Time: 9166.64 ms
[2021-07-03 09:16:01 main:574] : INFO : Epoch 336 | loss: 0.0310093 | val_loss: 0.0312878 | Time: 9293.15 ms
[2021-07-03 09:16:11 main:574] : INFO : Epoch 337 | loss: 0.0310067 | val_loss: 0.0313466 | Time: 9219.51 ms
[2021-07-03 09:16:20 main:574] : INFO : Epoch 338 | loss: 0.031003 | val_loss: 0.031332 | Time: 9407.98 ms
[2021-07-03 09:16:29 main:574] : INFO : Epoch 339 | loss: 0.0309986 | val_loss: 0.0313429 | Time: 9209.66 ms
[2021-07-03 09:16:39 main:574] : INFO : Epoch 340 | loss: 0.0309954 | val_loss: 0.0313048 | Time: 9334.51 ms
[2021-07-03 09:16:48 main:574] : INFO : Epoch 341 | loss: 0.0309969 | val_loss: 0.0313196 | Time: 9207.46 ms
[2021-07-03 09:16:57 main:574] : INFO : Epoch 342 | loss: 0.0310011 | val_loss: 0.0313303 | Time: 9169.84 ms
[2021-07-03 09:17:06 main:574] : INFO : Epoch 343 | loss: 0.0309944 | val_loss: 0.0313197 | Time: 9201.24 ms
[2021-07-03 09:17:16 main:574] : INFO : Epoch 344 | loss: 0.0310023 | val_loss: 0.0313486 | Time: 9274.35 ms
[2021-07-03 09:17:25 main:574] : INFO : Epoch 345 | loss: 0.0310077 | val_loss: 0.0313299 | Time: 9337.56 ms
[2021-07-03 09:17:34 main:574] : INFO : Epoch 346 | loss: 0.030997 | val_loss: 0.0313358 | Time: 9276.98 ms
[2021-07-03 09:17:44 main:574] : INFO : Epoch 347 | loss: 0.0309918 | val_loss: 0.031347 | Time: 9283.96 ms
[2021-07-03 09:17:53 main:574] : INFO : Epoch 348 | loss: 0.0309958 | val_loss: 0.0313278 | Time: 9240 ms
[2021-07-03 09:18:02 main:574] : INFO : Epoch 349 | loss: 0.0309901 | val_loss: 0.0313554 | Time: 9330.92 ms
[2021-07-03 09:18:12 main:574] : INFO : Epoch 350 | loss: 0.0309944 | val_loss: 0.0313659 | Time: 9333.05 ms
[2021-07-03 09:18:21 main:574] : INFO : Epoch 351 | loss: 0.0310055 | val_loss: 0.0313087 | Time: 9441.11 ms
[2021-07-03 09:18:31 main:574] : INFO : Epoch 352 | loss: 0.0310008 | val_loss: 0.0313542 | Time: 9322.96 ms
[2021-07-03 09:18:40 main:574] : INFO : Epoch 353 | loss: 0.0309987 | val_loss: 0.0313194 | Time: 9310.68 ms
[2021-07-03 09:18:49 main:574] : INFO : Epoch 354 | loss: 0.0309972 | val_loss: 0.0313212 | Time: 9328.12 ms
[2021-07-03 09:18:59 main:574] : INFO : Epoch 355 | loss: 0.0309998 | val_loss: 0.0313365 | Time: 9299.48 ms
[2021-07-03 09:19:08 main:574] : INFO : Epoch 356 | loss: 0.0310001 | val_loss: 0.0313189 | Time: 9224.02 ms
[2021-07-03 09:19:17 main:574] : INFO : Epoch 357 | loss: 0.0309945 | val_loss: 0.0313605 | Time: 9459.45 ms
[2021-07-03 09:19:27 main:574] : INFO : Epoch 358 | loss: 0.0309878 | val_loss: 0.0313563 | Time: 9230.75 ms
[2021-07-03 09:19:36 main:574] : INFO : Epoch 359 | loss: 0.0309955 | val_loss: 0.0313753 | Time: 9310.62 ms
[2021-07-03 09:19:45 main:574] : INFO : Epoch 360 | loss: 0.0309938 | val_loss: 0.031324 | Time: 9291.69 ms
[2021-07-03 09:19:55 main:574] : INFO : Epoch 361 | loss: 0.0309949 | val_loss: 0.0313528 | Time: 9364.65 ms
[2021-07-03 09:20:04 main:574] : INFO : Epoch 362 | loss: 0.0309977 | val_loss: 0.0313187 | Time: 9347.39 ms
[2021-07-03 09:20:13 main:574] : INFO : Epoch 363 | loss: 0.0309941 | val_loss: 0.0313144 | Time: 9195.31 ms
[2021-07-03 09:20:22 main:574] : INFO : Epoch 364 | loss: 0.0309977 | val_loss: 0.0313213 | Time: 9311.58 ms
[2021-07-03 09:20:32 main:574] : INFO : Epoch 365 | loss: 0.0309991 | val_loss: 0.031332 | Time: 9348.38 ms
[2021-07-03 09:20:41 main:574] : INFO : Epoch 366 | loss: 0.0309956 | val_loss: 0.0313106 | Time: 9522.19 ms
[2021-07-03 09:20:51 main:574] : INFO : Epoch 367 | loss: 0.0309897 | val_loss: 0.0313377 | Time: 9308.78 ms
[2021-07-03 09:21:00 main:574] : INFO : Epoch 368 | loss: 0.0309806 | val_loss: 0.0313634 | Time: 9192.4 ms
[2021-07-03 09:21:09 main:574] : INFO : Epoch 369 | loss: 0.0309905 | val_loss: 0.0313472 | Time: 9294.55 ms
[2021-07-03 09:21:19 main:574] : INFO : Epoch 370 | loss: 0.0310087 | val_loss: 0.0313936 | Time: 9446.06 ms
[2021-07-03 09:21:28 main:574] : INFO : Epoch 371 | loss: 0.0310026 | val_loss: 0.0313156 | Time: 9199.55 ms
[2021-07-03 09:21:37 main:574] : INFO : Epoch 372 | loss: 0.0309963 | val_loss: 0.0313177 | Time: 9459.8 ms
[2021-07-03 09:21:47 main:574] : INFO : Epoch 373 | loss: 0.0309873 | val_loss: 0.0313284 | Time: 9257.16 ms
[2021-07-03 09:21:56 main:574] : INFO : Epoch 374 | loss: 0.0309842 | val_loss: 0.0313514 | Time: 9282.06 ms
[2021-07-03 09:22:05 main:574] : INFO : Epoch 375 | loss: 0.0309945 | val_loss: 0.0313038 | Time: 9253.85 ms
[2021-07-03 09:22:15 main:574] : INFO : Epoch 376 | loss: 0.0310089 | val_loss: 0.0313282 | Time: 9393.38 ms
[2021-07-03 09:22:24 main:574] : INFO : Epoch 377 | loss: 0.0309967 | val_loss: 0.0313447 | Time: 9380.2 ms
[2021-07-03 09:22:33 main:574] : INFO : Epoch 378 | loss: 0.0309865 | val_loss: 0.0313118 | Time: 9298.21 ms
[2021-07-03 09:22:43 main:574] : INFO : Epoch 379 | loss: 0.0309905 | val_loss: 0.0313742 | Time: 9344.46 ms
[2021-07-03 09:22:52 main:574] : INFO : Epoch 380 | loss: 0.0309929 | val_loss: 0.0313082 | Time: 9334.1 ms
[2021-07-03 09:23:02 main:574] : INFO : Epoch 381 | loss: 0.0309875 | val_loss: 0.0313842 | Time: 9411.93 ms
[2021-07-03 09:23:11 main:574] : INFO : Epoch 382 | loss: 0.0309884 | val_loss: 0.0313656 | Time: 9326.18 ms
[2021-07-03 09:23:20 main:574] : INFO : Epoch 383 | loss: 0.0309935 | val_loss: 0.0313376 | Time: 9333.88 ms
[2021-07-03 09:23:30 main:574] : INFO : Epoch 384 | loss: 0.0309912 | val_loss: 0.0313427 | Time: 9375.27 ms
[2021-07-03 09:23:39 main:574] : INFO : Epoch 385 | loss: 0.0309811 | val_loss: 0.0313237 | Time: 9374.4 ms
[2021-07-03 09:23:48 main:574] : INFO : Epoch 386 | loss: 0.0309827 | val_loss: 0.0313278 | Time: 9312.5 ms
[2021-07-03 09:23:58 main:574] : INFO : Epoch 387 | loss: 0.0309918 | val_loss: 0.0313631 | Time: 9439.59 ms
[2021-07-03 09:24:07 main:574] : INFO : Epoch 388 | loss: 0.030999 | val_loss: 0.0313404 | Time: 9194.82 ms
[2021-07-03 09:24:16 main:574] : INFO : Epoch 389 | loss: 0.0310002 | val_loss: 0.0313466 | Time: 9423.08 ms
[2021-07-03 09:24:25 main:574] : INFO : Epoch 390 | loss: 0.0309939 | val_loss: 0.0313459 | Time: 9114.52 ms
[2021-07-03 09:24:35 main:574] : INFO : Epoch 391 | loss: 0.030982 | val_loss: 0.0313468 | Time: 9426.73 ms
[2021-07-03 09:24:44 main:574] : INFO : Epoch 392 | loss: 0.0309819 | val_loss: 0.0313228 | Time: 9337.72 ms
[2021-07-03 09:24:54 main:574] : INFO : Epoch 393 | loss: 0.0309913 | val_loss: 0.0314011 | Time: 9360.27 ms
[2021-07-03 09:25:03 main:574] : INFO : Epoch 394 | loss: 0.0309972 | val_loss: 0.0313326 | Time: 9380.46 ms
[2021-07-03 09:25:13 main:574] : INFO : Epoch 395 | loss: 0.0309923 | val_loss: 0.0313513 | Time: 9348.02 ms
[2021-07-03 09:25:22 main:574] : INFO : Epoch 396 | loss: 0.0309946 | val_loss: 0.031361 | Time: 9195.9 ms
[2021-07-03 09:25:31 main:574] : INFO : Epoch 397 | loss: 0.0309842 | val_loss: 0.0313223 | Time: 9186.15 ms
[2021-07-03 09:25:40 main:574] : INFO : Epoch 398 | loss: 0.0309901 | val_loss: 0.0313237 | Time: 9276.73 ms
[2021-07-03 09:25:49 main:574] : INFO : Epoch 399 | loss: 0.0309852 | val_loss: 0.0313189 | Time: 8713.71 ms
[2021-07-03 09:25:53 main:574] : INFO : Epoch 400 | loss: 0.0309852 | val_loss: 0.0313319 | Time: 4444.26 ms
[2021-07-03 09:25:57 main:574] : INFO : Epoch 401 | loss: 0.0309838 | val_loss: 0.0313414 | Time: 3861.7 ms
[2021-07-03 09:26:01 main:574] : INFO : Epoch 402 | loss: 0.0309921 | val_loss: 0.0313111 | Time: 3909.8 ms
[2021-07-03 09:26:10 main:574] : INFO : Epoch 403 | loss: 0.0309819 | val_loss: 0.0313461 | Time: 8710.47 ms
[2021-07-03 09:26:19 main:574] : INFO : Epoch 404 | loss: 0.0309756 | val_loss: 0.0313371 | Time: 9550.23 ms
[2021-07-03 09:26:27 main:574] : INFO : Epoch 405 | loss: 0.0309823 | val_loss: 0.0313282 | Time: 7929.77 ms
[2021-07-03 09:26:36 main:574] : INFO : Epoch 406 | loss: 0.0309926 | val_loss: 0.0313254 | Time: 8991.49 ms
[2021-07-03 09:26:45 main:574] : INFO : Epoch 407 | loss: 0.0309985 | val_loss: 0.0313559 | Time: 9010.72 ms
[2021-07-03 09:26:54 main:574] : INFO : Epoch 408 | loss: 0.0309942 | val_loss: 0.031351 | Time: 9020.81 ms
[2021-07-03 09:27:03 main:574] : INFO : Epoch 409 | loss: 0.0309731 | val_loss: 0.0313482 | Time: 8951.11 ms
[2021-07-03 09:27:12 main:574] : INFO : Epoch 410 | loss: 0.0309856 | val_loss: 0.0313329 | Time: 9112.67 ms
[2021-07-03 09:27:22 main:574] : INFO : Epoch 411 | loss: 0.0309909 | val_loss: 0.0313265 | Time: 9067.07 ms
[2021-07-03 09:27:31 main:574] : INFO : Epoch 412 | loss: 0.0309935 | val_loss: 0.0313523 | Time: 9139.58 ms
[2021-07-03 09:27:40 main:574] : INFO : Epoch 413 | loss: 0.0309863 | val_loss: 0.0313357 | Time: 9040.79 ms
[2021-07-03 09:27:49 main:574] : INFO : Epoch 414 | loss: 0.0309781 | val_loss: 0.0313277 | Time: 8861.35 ms
[2021-07-03 09:27:58 main:574] : INFO : Epoch 415 | loss: 0.0309937 | val_loss: 0.0313278 | Time: 9147.46 ms
[2021-07-03 09:28:07 main:574] : INFO : Epoch 416 | loss: 0.0309986 | val_loss: 0.0313766 | Time: 9039.05 ms
[2021-07-03 09:28:14 main:574] : INFO : Epoch 417 | loss: 0.0310142 | val_loss: 0.0313385 | Time: 7616.66 ms
[2021-07-03 09:28:25 main:574] : INFO : Epoch 418 | loss: 0.0309955 | val_loss: 0.0313399 | Time: 10575.5 ms
[2021-07-03 09:28:34 main:574] : INFO : Epoch 419 | loss: 0.0309798 | val_loss: 0.0313098 | Time: 9137.88 ms
[2021-07-03 09:28:42 main:574] : INFO : Epoch 420 | loss: 0.0309785 | val_loss: 0.0313494 | Time: 7730.01 ms
[2021-07-03 09:28:51 main:574] : INFO : Epoch 421 | loss: 0.0309908 | val_loss: 0.0313616 | Time: 8935.41 ms
[2021-07-03 09:29:00 main:574] : INFO : Epoch 422 | loss: 0.0309916 | val_loss: 0.03134 | Time: 9102.13 ms
[2021-07-03 09:29:09 main:574] : INFO : Epoch 423 | loss: 0.0309905 | val_loss: 0.0313331 | Time: 9078.29 ms
[2021-07-03 09:29:18 main:574] : INFO : Epoch 424 | loss: 0.0309862 | val_loss: 0.0313479 | Time: 8956.5 ms
[2021-07-03 09:29:27 main:574] : INFO : Epoch 425 | loss: 0.0309846 | val_loss: 0.0313466 | Time: 8850.09 ms
[2021-07-03 09:29:36 main:574] : INFO : Epoch 426 | loss: 0.0309932 | val_loss: 0.0313162 | Time: 9009.54 ms
[2021-07-03 09:29:45 main:574] : INFO : Epoch 427 | loss: 0.0309797 | val_loss: 0.031308 | Time: 9013.85 ms
[2021-07-03 09:29:54 main:574] : INFO : Epoch 428 | loss: 0.0309817 | val_loss: 0.0313812 | Time: 8780.21 ms
[2021-07-03 09:30:01 main:574] : INFO : Epoch 429 | loss: 0.0309797 | val_loss: 0.0313094 | Time: 7612.09 ms
[2021-07-03 09:30:10 main:574] : INFO : Epoch 430 | loss: 0.030978 | val_loss: 0.0313642 | Time: 8994.99 ms
[2021-07-03 09:30:19 main:574] : INFO : Epoch 431 | loss: 0.0309758 | val_loss: 0.0313448 | Time: 8891.11 ms
[2021-07-03 09:30:28 main:574] : INFO : Epoch 432 | loss: 0.0309793 | val_loss: 0.0313378 | Time: 8888.52 ms
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFC23624B89
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 07/03/21 09:30:37
Install Directory : C:\Program Files\BOINC\
Data Directory : C:\ProgramData\BOINC
Project Symstore :
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\2;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 00000000f09f0000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000025d10000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.1023 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1023
ModLoad: 00000000245c0000 00000000000bd000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.1023 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1023
ModLoad: 00000000235f0000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.1023 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1023
ModLoad: 0000000024850000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1100
ModLoad: 0000000023b70000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1052) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.1052 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1052
ModLoad: 00000000244d0000 000000000002a000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.746) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.746 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.746
ModLoad: 0000000023480000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.928) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.928 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.928
ModLoad: 0000000023ba0000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 0000000023a20000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 0000000023f90000 00000000000ac000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1052) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.320
ModLoad: 0000000025c30000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.19041.546
ModLoad: 0000000024220000 000000000009b000 C:\WINDOWS\System32\sechost.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.320
ModLoad: 0000000025a30000 000000000012b000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1052) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.320
ModLoad: 00000000f9f70000 0000000000058000 C:\ProgramData\BOINC\slots\2\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000000e3f0000 0000000000091000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.25.28508.3) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\8\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.25.28508.3 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.25.28508.3
ModLoad: 000000001c760000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.867 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.867
ModLoad: 0000000015f30000 0000000000019000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.25.28508.3) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\8\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.25.28508.3 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.25.28508.3
ModLoad: 0000000015f20000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.25.28508.3) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\8\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.25.28508.3 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.25.28508.3
ModLoad: 00000000ac530000 000000000abe7000 C:\ProgramData\BOINC\slots\2\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000879e0000 0000000024b49000 C:\ProgramData\BOINC\slots\2\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000018210000 0000000000045000 C:\ProgramData\BOINC\slots\2\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000084930000 00000000030a5000 C:\ProgramData\BOINC\slots\2\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 00000000d7770000 00000000002db000 C:\ProgramData\BOINC\slots\2\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000d7560000 000000000020d000 C:\ProgramData\BOINC\slots\2\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 000000001ba40000 0000000000010000 C:\ProgramData\BOINC\slots\2\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 0000000081470000 00000000034b2000 C:\ProgramData\BOINC\slots\2\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 000000007d710000 0000000003d5b000 C:\ProgramData\BOINC\slots\2\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 000000000c3f0000 0000000000040000 C:\ProgramData\BOINC\slots\2\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000007b840000 0000000001eca000 C:\ProgramData\BOINC\slots\2\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 0000000060490000 000000001b3a4000 C:\ProgramData\BOINC\slots\2\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 00000000572f0000 000000000919f000 C:\ProgramData\BOINC\slots\2\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 0000000025980000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000021d40000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000254b0000 0000000000469000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.844) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1100
ModLoad: 0000000023b20000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000023450000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.320
ModLoad: 0000000023200000 000000000002c000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000023590000 0000000000060000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1052) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.1052 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1052
ModLoad: 00000000238c0000 000000000015f000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.844) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1100
ModLoad: 0000000023040000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000249f0000 000000000073f000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1100
ModLoad: 0000000021510000 0000000000790000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1100
ModLoad: 0000000025150000 0000000000355000 C:\WINDOWS\System32\combase.dll (6.2.19041.1052) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.320
ModLoad: 0000000022ec0000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.662) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.320
ModLoad: 00000000240c0000 00000000000ae000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1100
ModLoad: 0000000024560000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1100
ModLoad: 00000000c7500000 00000000002b4000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.6677) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r465\r466_61\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 27.21.14.6677
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.3.121 driver
Product Version : 27.21.14.6677
ModLoad: 000000001ced0000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000050560000 00000000015db000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_b2801df14ec7de03\nvcuda64.dll (27.21.14.6677) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r465\r466_61\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 27.21.14.6677
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.3.121 driver
Product Version : 27.21.14.6677
ModLoad: 000000001cef0000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.906 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.906
ModLoad: 0000000022e20000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000020b10000 000000000009e000 C:\WINDOWS\system32\uxtheme.dll (6.2.19041.746) (-exported- Symbols Loaded)
Linked PDB Filename : UxTheme.pdb
File Version : 10.0.19041.1100 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1100
ModLoad: 00000000057f0000 0000000000708000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.6677) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r465\r466_61\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 27.21.14.6677
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 27.21.14.6677
ModLoad: 0000000024720000 000000000012a000 C:\WINDOWS\System32\OLE32.DLL (6.2.19041.746) (-exported- Symbols Loaded)
Linked PDB Filename : ole32.pdb
File Version : 10.0.19041.320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.320
ModLoad: 000000001a920000 0000000000009000 C:\ProgramData\BOINC\slots\2\caffe2_nvrtc.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000bd920000 0000000000fca000 C:\ProgramData\BOINC\slots\2\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6.14.11.9000
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.89 NVRTC Library
Product Version : 6.14.11.9000
ModLoad: 0000000023c40000 0000000000083000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.1023 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1023
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 4080, Write: 2485, Other 6953
- I/O Transfers Counters -
Read: 6769559, Write: 2707967, Other 52754
- Paged Pool Usage -
QuotaPagedPoolUsage: 3506832, QuotaPeakPagedPoolUsage: 3523216
QuotaNonPagedPoolUsage: 52624, QuotaPeakNonPagedPoolUsage: 52760
- Virtual Memory Usage -
VirtualSize: -448987136, PeakVirtualSize: 165892096
- Pagefile Usage -
PagefileUsage: -448987136, PeakPagefileUsage: -448868352
- Working Set Size -
WorkingSetSize: 2043949056, PeakWorkingSetSize: -1992429568, PageFaultCount: 990659
*** Dump of thread ID 24440 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 189375008.000000, User Time: 37875625984.000000, Wait Time: 37005664.000000
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFC23624B89
- Registers -
rax=00000000b4d667c0 rbx=000000008b45af00 rcx=0000000000000020 rdx=00000000506f7523 rsi=000000009ab55850 rdi=0000000019930520
r8=00000000000002bc r9=0000000000000000 r10=000000009ab55160 r11=000000009ab55178 r12=000000001de2d720 r13=000000001c97eb70
r14=000000009ab56608 r15=000000001d0ac530 rip=0000000023624b89 rsp=000000009ab55630 rbp=000000009ab55870
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202
- Callstack -
ChildEBP RetAddr Args to Child
9ab55700 15f361e0 9ab557f0 1e06b890 1d0ac530 000009bc KERNELBASE!RaiseException+0x0
9ab55760 899c094a 8ad83020 00000000 9ab55810 000002bc VCRUNTIME140!_CxxThrowException+0x0
9ab55920 899c1e02 f9fa9c50 9ab55b30 9ab57090 9ab55bc0 torch_cuda!at::native::searchsorted_out_cuda+0x0
9ab55b00 899c205a 00000001 9ab56608 00000001 9ab55b78 torch_cuda!at::native::searchsorted_out_cuda+0x0
9ab55b40 8a7b3684 9ab55bc0 00000001 9ab55b78 00000001 torch_cuda!at::native::_local_scalar_dense_cuda+0x0
9ab55b90 8a7c1107 9ab55cb0 b1b1bfac 00000001 9ab55b70 torch_cuda!at::native::set_storage_cuda_+0x0
9ab55be0 b1fb6bbe b6e50640 00000001 00000000 b3a02f07 torch_cuda!at::native::set_storage_cuda_+0x0
9ab55df0 b3263c5e 00000000 9ab56608 9ab56608 9ab561a0 torch_cpu!at::_local_scalar_dense+0x0
9ab55e30 b1f429c7 9ab562c0 b1b1bfac 9ab55f50 9ab55f00 torch_cpu!torch::autograd::NotImplemented::~NotImplemented+0x0
9ab55e80 b1fb6bbe b6e50640 9ab56278 00000000 9ab57090 torch_cpu!at::native::mkldnn_sigmoid_+0x0
9ab56090 b1d6dead 9ab56018 00000001 9ab56300 9ab561a0 torch_cpu!at::_local_scalar_dense+0x0
9ab56250 b20ad1e1 9ab56288 00000001 9ab56300 9ab56608 torch_cpu!at::native::item+0x0
9ab562a0 b32c4d4e 9ab56300 00000001 9ab56280 f9fc1ea8 torch_cpu!at::zeros_out+0x0
9ab562d0 b1f429c7 1de2dd20 b1b1bfac 1de2dd30 f9fc1ea8 torch_cpu!torch::autograd::GraphRoot::apply+0x0
9ab56320 b20de69e b6e50640 9ab56350 b6e50640 b20f129f torch_cpu!at::native::mkldnn_sigmoid_+0x0
9ab56530 b20ca68e 9ab56690 b1db4e49 9ab56650 9ab56690 torch_cpu!at::Tensor::item+0x0
9ab56580 f0a0712b 9ab56650 9ab56650 9ab56650 9ab57090 torch_cpu!at::Tensor::item<double>+0x0
9ab56a80 f0a0b950 f0a3d95f f0a3d95f 00000000 e8763cd0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0
9ab6f820 f0c4c6f8 a6ec8550 00000000 00000000 a6e5abe0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
9ab6f860 245d7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
9ab6f890 25d62651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
9ab6f910 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 5432 (state: Waiting): ***
- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 37005668.000000
- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=000000009b2ffb40 rsi=0000000000000000 rdi=0000000000000064
r8=000000009b2ffb18 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000025dad4a4 rsp=000000009b2ffb18 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
9b2ffb10 236390ae 9b2ffbd8 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0
9b2ffbb0 f0a2a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0
9b2ffbe0 245d7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
9b2ffc10 25d62651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
9b2ffc90 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 12556 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 37005668.000000
- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=000000009b3ff5a0 rsi=0000000000000000 rdi=000000000000000d
r8=00000000a706b570 r9=000000000000000d r10=00000000a6111fb0 r11=00000000f86aa73f r12=0000000000000064 r13=000000009b3ff5a0
r14=000000009b3ff2a0 r15=0000000000000000 rip=0000000025dad974 rsp=000000009b3ff248 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
9b3ff240 2363c5a0 00000000 9adff000 25e7a4d0 9adff000 ntdll!ZwWaitForMultipleObjects+0x0
9b3ff530 2363c49e a53712a0 004e0049 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
9b3ff570 50722634 a7052f40 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0
9b3ff7b0 507c465d 00000000 a704d8a0 00000000 00000000 nvcuda64!+0x0
9b3ff860 50722003 426622f2 422b094a a7635170 00000000 nvcuda64!cuProfilerStop+0x0
9b3ff890 50a458e4 a7635170 00000000 00000000 00000000 nvcuda64!+0x0
9b3ff8c0 245d7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
9b3ff8f0 25d62651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
9b3ff970 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 22984 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 36748628.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=0000000000000274 rdx=0000000000000000 rsi=0000000000000000 rdi=0000000000000274
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000000000000 r13=0000000000000000
r14=0000000000000274 r15=0000000000000000 rip=0000000025dacea4 rsp=000000009b4ff638 rbp=00000000a7037010
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
9b4ff630 2361168e 00000000 25d62630 0000027f 00000000 ntdll!ZwWaitForSingleObject+0x0
9b4ff6d0 50942d1d a7636130 00000000 00000000 00000274 KERNELBASE!WaitForSingleObjectEx+0x0
9b4ff930 50722003 00000000 a7636130 50560000 a706ea40 nvcuda64!cuProfilerStop+0x0
9b4ff960 50a458e4 a7636130 00000000 00000000 00000000 nvcuda64!+0x0
9b4ff990 245d7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
9b4ff9c0 25d62651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
9b4ffa40 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 9972 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 37005660.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000a711f1c8 rdx=000000009b5ffb68 rsi=000000009b5ffad0 rdi=0000000000000000
r8=00000000b94f30a4 r9=00000000b94f5728 r10=00000000a72e1cb8 r11=00000000f86aa73f r12=000000009b5ffb68 r13=0000000000000000
r14=00000000a711f1c8 r15=00000000a72e1cb8 rip=0000000025db0814 rsp=000000009b5ffaa8 rbp=000000009b5ffb00
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
9b5ffaa0 25d74295 00000102 507fdec8 00000000 9b5ffad0 ntdll!NtWaitForAlertByThreadId+0x0
9b5ffb10 2365c849 a72df4a0 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0
9b5ffb40 50699a5c a72df4a0 a72df4a0 a72df4a0 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0
9b5ffba0 50722003 00000004 423474f8 00000000 00000000 nvcuda64!+0x0
9b5ffbd0 50a458e4 a7636250 00000000 00000000 00000000 nvcuda64!+0x0
9b5ffc00 245d7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
9b5ffc30 25d62651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
9b5ffcb0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 12448 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 101406248.000000, User Time: 1861874944.000000, Wait Time: 37005552.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=0000000006de6998 rdx=0000000000000000 rsi=0000000000000000 rdi=0000000006de6998
r8=000000000000004a r9=0000000000000040 r10=0000000000000040 r11=0000000008000000 r12=0000000000000000 r13=0000000000000000
r14=000000009b6ff800 r15=0000000006de6948 rip=0000000025db0814 rsp=000000009b6ff7d8 rbp=000000009b6ff830
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
9b6ff7d0 25d74021 091d5978 091d5978 9b6ff910 091d5978 ntdll!NtWaitForAlertByThreadId+0x0
9b6ff850 2365c8f9 06de6940 06de6988 00000000 00000000 ntdll!RtlSleepConditionVariableSRW+0x0
9b6ff890 0e42bc2d 83f828f0 83f828f0 83f828f0 00000000 KERNELBASE!SleepConditionVariableSRW+0x0
9b6ff8d0 0e4028c8 08d88ec0 00000000 00000000 b37105b4 MSVCP140!__crtSetThreadpoolWait+0x0
9b6ff900 0e402790 00000000 0e402f97 00000000 08d88ec0 MSVCP140!std::_Winerror_message+0x0
9b6ff970 b371064b 08d88ea0 000001c0 06de6940 06de6940 MSVCP140!std::_Winerror_message+0x0
9b6ff9b0 b37125b1 1ded1210 ffffffff 08d88ea0 ffffffff torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
9b6ffca0 b3712471 b6c36d10 9b6ffce0 b6c36d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0
9b6ffcf0 b3709744 00080001 1d28e6b0 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0
9b6ffd20 23a41bb2 1d28e6b0 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0
9b6ffd50 245d7034 00000000 00000000 00000000 00000000 ucrtbase!_configthreadlocale+0x0
9b6ffd80 25d62651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
9b6ffe00 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 13344 (state: Waiting): ***
- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 37005656.000000
- Registers -
rax=00000000000001d3 rbx=00000000eede61e0 rcx=0000000000000074 rdx=00000000eede5e60 rsi=00000000a53633d0 rdi=00000000eede61e0
r8=000000009aeff660 r9=0000000000000008 r10=0000000000000000 r11=0000000000000000 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000025db0874 rsp=000000009aeff518 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
9aeff510 25d62dc7 00000000 00000000 a53633d0 00000000 ntdll!ZwWaitForWorkViaWorkerFactory+0x0
9aeff810 245d7034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0
9aeff840 25d62651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
9aeff8c0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)