Task 3279728
| Name | ParityModified-1605151076-30256-8_1 |
| Workunit | 1523334 |
| Created | 14 Dec 2020, 16:44:02 UTC |
| Sent | 14 Dec 2020, 17:20:11 UTC |
| Report deadline | 21 Dec 2020, 17:20:11 UTC |
| Received | 19 Dec 2020, 8:19:08 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | -529697949 (0xE06D7363) Unknown error code |
| Computer ID | 1709 |
| Run time | 20 min |
| CPU time | 18 min |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 7,468.51 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 2.10 GB |
| Peak swap size | 4.37 GB |
| Peak disk usage | 1.53 GB |
Stderr output
<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
188 | loss: 0.0311695 | val_loss: 0.0311724 | Time: 2902.95 ms
[2020-12-19 09:07:15 main:574] : INFO : Epoch 189 | loss: 0.0311692 | val_loss: 0.0311721 | Time: 2765.09 ms
[2020-12-19 09:07:18 main:574] : INFO : Epoch 190 | loss: 0.0311691 | val_loss: 0.0311743 | Time: 2912.76 ms
[2020-12-19 09:07:21 main:574] : INFO : Epoch 191 | loss: 0.0311697 | val_loss: 0.0311727 | Time: 2890.1 ms
[2020-12-19 09:07:24 main:574] : INFO : Epoch 192 | loss: 0.0311722 | val_loss: 0.0311756 | Time: 3071.68 ms
[2020-12-19 09:07:27 main:574] : INFO : Epoch 193 | loss: 0.0311724 | val_loss: 0.0311785 | Time: 2963.9 ms
[2020-12-19 09:07:30 main:574] : INFO : Epoch 194 | loss: 0.0311726 | val_loss: 0.0311778 | Time: 2903.42 ms
[2020-12-19 09:07:33 main:574] : INFO : Epoch 195 | loss: 0.0311679 | val_loss: 0.0311712 | Time: 3090.87 ms
[2020-12-19 09:07:36 main:574] : INFO : Epoch 196 | loss: 0.031167 | val_loss: 0.0311718 | Time: 2988.65 ms
[2020-12-19 09:07:39 main:574] : INFO : Epoch 197 | loss: 0.0311658 | val_loss: 0.0311727 | Time: 3218.22 ms
[2020-12-19 09:07:42 main:574] : INFO : Epoch 198 | loss: 0.0311703 | val_loss: 0.0311719 | Time: 3187.95 ms
[2020-12-19 09:07:45 main:574] : INFO : Epoch 199 | loss: 0.0311675 | val_loss: 0.0311735 | Time: 3093.37 ms
[2020-12-19 09:07:48 main:574] : INFO : Epoch 200 | loss: 0.0311688 | val_loss: 0.0311727 | Time: 2956.09 ms
[2020-12-19 09:07:52 main:574] : INFO : Epoch 201 | loss: 0.0311692 | val_loss: 0.0311757 | Time: 3320.56 ms
[2020-12-19 09:07:55 main:574] : INFO : Epoch 202 | loss: 0.0311679 | val_loss: 0.031172 | Time: 3146.46 ms
[2020-12-19 09:07:58 main:574] : INFO : Epoch 203 | loss: 0.0311663 | val_loss: 0.0311741 | Time: 3138.52 ms
[2020-12-19 09:08:02 main:574] : INFO : Epoch 204 | loss: 0.0311653 | val_loss: 0.0311742 | Time: 3435.08 ms
[2020-12-19 09:08:04 main:574] : INFO : Epoch 205 | loss: 0.0311666 | val_loss: 0.0311766 | Time: 2977.4 ms
[2020-12-19 09:08:07 main:574] : INFO : Epoch 206 | loss: 0.0311715 | val_loss: 0.0311755 | Time: 2990.33 ms
[2020-12-19 09:08:11 main:574] : INFO : Epoch 207 | loss: 0.0311727 | val_loss: 0.0311762 | Time: 3099.17 ms
[2020-12-19 09:08:14 main:574] : INFO : Epoch 208 | loss: 0.0311718 | val_loss: 0.0311744 | Time: 2919.22 ms
[2020-12-19 09:08:17 main:574] : INFO : Epoch 209 | loss: 0.0311696 | val_loss: 0.0311754 | Time: 3071.68 ms
[2020-12-19 09:08:19 main:574] : INFO : Epoch 210 | loss: 0.0311715 | val_loss: 0.0311738 | Time: 2819.81 ms
[2020-12-19 09:08:22 main:574] : INFO : Epoch 211 | loss: 0.0311698 | val_loss: 0.0311762 | Time: 2865.99 ms
[2020-12-19 09:08:25 main:574] : INFO : Epoch 212 | loss: 0.0311705 | val_loss: 0.0311737 | Time: 2866.38 ms
[2020-12-19 09:08:28 main:574] : INFO : Epoch 213 | loss: 0.0311682 | val_loss: 0.0311737 | Time: 2972.39 ms
[2020-12-19 09:08:31 main:574] : INFO : Epoch 214 | loss: 0.0311694 | val_loss: 0.0311742 | Time: 3059.61 ms
[2020-12-19 09:08:34 main:574] : INFO : Epoch 215 | loss: 0.0311733 | val_loss: 0.0311749 | Time: 3063.97 ms
[2020-12-19 09:08:37 main:574] : INFO : Epoch 216 | loss: 0.0311736 | val_loss: 0.031174 | Time: 2934.47 ms
[2020-12-19 09:08:40 main:574] : INFO : Epoch 217 | loss: 0.0311725 | val_loss: 0.0311736 | Time: 2935.14 ms
[2020-12-19 09:08:43 main:574] : INFO : Epoch 218 | loss: 0.0311719 | val_loss: 0.0311734 | Time: 2943.36 ms
[2020-12-19 09:08:46 main:574] : INFO : Epoch 219 | loss: 0.0311708 | val_loss: 0.031171 | Time: 3043.66 ms
[2020-12-19 09:08:50 main:574] : INFO : Epoch 220 | loss: 0.0311707 | val_loss: 0.0311704 | Time: 3871.08 ms
[2020-12-19 09:08:53 main:574] : INFO : Epoch 221 | loss: 0.0311709 | val_loss: 0.0311739 | Time: 3068.42 ms
[2020-12-19 09:08:57 main:574] : INFO : Epoch 222 | loss: 0.0311716 | val_loss: 0.031174 | Time: 3318.45 ms
[2020-12-19 09:09:00 main:574] : INFO : Epoch 223 | loss: 0.0311692 | val_loss: 0.0311737 | Time: 3227.67 ms
[2020-12-19 09:09:03 main:574] : INFO : Epoch 224 | loss: 0.0311695 | val_loss: 0.0311811 | Time: 3354.69 ms
[2020-12-19 09:09:06 main:574] : INFO : Epoch 225 | loss: 0.0311718 | val_loss: 0.0311727 | Time: 3083.95 ms
[2020-12-19 09:09:10 main:574] : INFO : Epoch 226 | loss: 0.0311739 | val_loss: 0.0311737 | Time: 3106.97 ms
[2020-12-19 09:09:13 main:574] : INFO : Epoch 227 | loss: 0.0311753 | val_loss: 0.0311859 | Time: 3219.14 ms
[2020-12-19 09:09:16 main:574] : INFO : Epoch 228 | loss: 0.0311727 | val_loss: 0.0311732 | Time: 2920.45 ms
[2020-12-19 09:09:19 main:574] : INFO : Epoch 229 | loss: 0.0311703 | val_loss: 0.0311729 | Time: 3111 ms
[2020-12-19 09:09:22 main:574] : INFO : Epoch 230 | loss: 0.0311686 | val_loss: 0.0311735 | Time: 3030.82 ms
[2020-12-19 09:09:25 main:574] : INFO : Epoch 231 | loss: 0.0311674 | val_loss: 0.0311767 | Time: 2966.15 ms
[2020-12-19 09:09:28 main:574] : INFO : Epoch 232 | loss: 0.0311679 | val_loss: 0.0311762 | Time: 3057.05 ms
[2020-12-19 09:09:31 main:574] : INFO : Epoch 233 | loss: 0.031168 | val_loss: 0.0311755 | Time: 2732.39 ms
[2020-12-19 09:09:34 main:574] : INFO : Epoch 234 | loss: 0.0311686 | val_loss: 0.0311756 | Time: 3211.43 ms
[2020-12-19 09:09:37 main:574] : INFO : Epoch 235 | loss: 0.0311726 | val_loss: 0.0311783 | Time: 3036.03 ms
[2020-12-19 09:09:40 main:574] : INFO : Epoch 236 | loss: 0.031172 | val_loss: 0.0311771 | Time: 3062.9 ms
[2020-12-19 09:09:43 main:574] : INFO : Epoch 237 | loss: 0.0311707 | val_loss: 0.0311762 | Time: 3014.86 ms
[2020-12-19 09:09:46 main:574] : INFO : Epoch 238 | loss: 0.0311691 | val_loss: 0.031175 | Time: 3060.76 ms
[2020-12-19 09:09:49 main:574] : INFO : Epoch 239 | loss: 0.0311689 | val_loss: 0.0311749 | Time: 3079.51 ms
[2020-12-19 09:09:52 main:574] : INFO : Epoch 240 | loss: 0.0311719 | val_loss: 0.0311753 | Time: 3113.21 ms
[2020-12-19 09:09:55 main:574] : INFO : Epoch 241 | loss: 0.0311712 | val_loss: 0.0311786 | Time: 3042.59 ms
[2020-12-19 09:09:58 main:574] : INFO : Epoch 242 | loss: 0.0311715 | val_loss: 0.0311757 | Time: 3122.29 ms
[2020-12-19 09:10:02 main:574] : INFO : Epoch 243 | loss: 0.0311742 | val_loss: 0.0311781 | Time: 3498.62 ms
[2020-12-19 09:10:05 main:574] : INFO : Epoch 244 | loss: 0.0311703 | val_loss: 0.0311791 | Time: 3276.5 ms
[2020-12-19 09:10:09 main:574] : INFO : Epoch 245 | loss: 0.0311682 | val_loss: 0.0311748 | Time: 3162.45 ms
[2020-12-19 09:10:12 main:574] : INFO : Epoch 246 | loss: 0.0311702 | val_loss: 0.0311734 | Time: 3283.87 ms
[2020-12-19 09:10:15 main:574] : INFO : Epoch 247 | loss: 0.0311703 | val_loss: 0.031174 | Time: 3342.54 ms
[2020-12-19 09:10:19 main:574] : INFO : Epoch 248 | loss: 0.0311713 | val_loss: 0.0311723 | Time: 3259.5 ms
[2020-12-19 09:10:22 main:574] : INFO : Epoch 249 | loss: 0.0311694 | val_loss: 0.0311714 | Time: 3123.93 ms
[2020-12-19 09:10:25 main:574] : INFO : Epoch 250 | loss: 0.0311683 | val_loss: 0.0311735 | Time: 3239.64 ms
[2020-12-19 09:10:28 main:574] : INFO : Epoch 251 | loss: 0.0311711 | val_loss: 0.0311735 | Time: 3395.11 ms
[2020-12-19 09:10:32 main:574] : INFO : Epoch 252 | loss: 0.0311704 | val_loss: 0.0311773 | Time: 3200.96 ms
[2020-12-19 09:10:35 main:574] : INFO : Epoch 253 | loss: 0.0311705 | val_loss: 0.0311733 | Time: 3117.24 ms
[2020-12-19 09:10:38 main:574] : INFO : Epoch 254 | loss: 0.0311684 | val_loss: 0.0311736 | Time: 3021.98 ms
[2020-12-19 09:10:41 main:574] : INFO : Epoch 255 | loss: 0.0311695 | val_loss: 0.0311743 | Time: 3184.24 ms
[2020-12-19 09:10:44 main:574] : INFO : Epoch 256 | loss: 0.0311674 | val_loss: 0.0311733 | Time: 3061.23 ms
[2020-12-19 09:10:47 main:574] : INFO : Epoch 257 | loss: 0.0311673 | val_loss: 0.0311734 | Time: 3060.01 ms
[2020-12-19 09:10:50 main:574] : INFO : Epoch 258 | loss: 0.0311674 | val_loss: 0.0311762 | Time: 3055.37 ms
[2020-12-19 09:10:53 main:574] : INFO : Epoch 259 | loss: 0.0311684 | val_loss: 0.031174 | Time: 3004.06 ms
[2020-12-19 09:10:57 main:574] : INFO : Epoch 260 | loss: 0.0311696 | val_loss: 0.0311801 | Time: 3359.49 ms
[2020-12-19 09:11:00 main:574] : INFO : Epoch 261 | loss: 0.0311674 | val_loss: 0.031175 | Time: 3356.8 ms
[2020-12-19 09:11:03 main:574] : INFO : Epoch 262 | loss: 0.0311666 | val_loss: 0.0311762 | Time: 3336 ms
[2020-12-19 09:11:06 main:574] : INFO : Epoch 263 | loss: 0.0311675 | val_loss: 0.0311734 | Time: 3130.35 ms
[2020-12-19 09:11:10 main:574] : INFO : Epoch 264 | loss: 0.0311686 | val_loss: 0.0311746 | Time: 3403.24 ms
[2020-12-19 09:11:13 main:574] : INFO : Epoch 265 | loss: 0.0311659 | val_loss: 0.0311763 | Time: 3384.64 ms
[2020-12-19 09:11:16 main:574] : INFO : Epoch 266 | loss: 0.0311701 | val_loss: 0.031176 | Time: 3186.94 ms
[2020-12-19 09:11:20 main:574] : INFO : Epoch 267 | loss: 0.031168 | val_loss: 0.0311738 | Time: 3150.03 ms
[2020-12-19 09:11:23 main:574] : INFO : Epoch 268 | loss: 0.0311661 | val_loss: 0.0311749 | Time: 3719.47 ms
[2020-12-19 09:11:27 main:574] : INFO : Epoch 269 | loss: 0.031167 | val_loss: 0.0311778 | Time: 3118.68 ms
[2020-12-19 09:11:30 main:574] : INFO : Epoch 270 | loss: 0.0311661 | val_loss: 0.0311772 | Time: 3006.73 ms
[2020-12-19 09:11:33 main:574] : INFO : Epoch 271 | loss: 0.0311705 | val_loss: 0.0311863 | Time: 3039.63 ms
[2020-12-19 09:11:36 main:574] : INFO : Epoch 272 | loss: 0.0311682 | val_loss: 0.0311759 | Time: 3183.28 ms
[2020-12-19 09:11:39 main:574] : INFO : Epoch 273 | loss: 0.0311661 | val_loss: 0.031179 | Time: 2978.15 ms
[2020-12-19 09:11:42 main:574] : INFO : Epoch 274 | loss: 0.0311673 | val_loss: 0.0311759 | Time: 3309.13 ms
[2020-12-19 09:11:45 main:574] : INFO : Epoch 275 | loss: 0.0311669 | val_loss: 0.031176 | Time: 2985.76 ms
[2020-12-19 09:11:48 main:574] : INFO : Epoch 276 | loss: 0.0311687 | val_loss: 0.0311759 | Time: 3025.66 ms
[2020-12-19 09:11:52 main:574] : INFO : Epoch 277 | loss: 0.0311663 | val_loss: 0.0311747 | Time: 3653.51 ms
[2020-12-19 09:11:55 main:574] : INFO : Epoch 278 | loss: 0.0311678 | val_loss: 0.0311779 | Time: 3144.16 ms
[2020-12-19 09:11:58 main:574] : INFO : Epoch 279 | loss: 0.0311676 | val_loss: 0.0311783 | Time: 3202.96 ms
[2020-12-19 09:12:01 main:574] : INFO : Epoch 280 | loss: 0.0311693 | val_loss: 0.0311763 | Time: 3150.89 ms
[2020-12-19 09:12:05 main:574] : INFO : Epoch 281 | loss: 0.0311702 | val_loss: 0.0311787 | Time: 3475.55 ms
[2020-12-19 09:12:09 main:574] : INFO : Epoch 282 | loss: 0.0311719 | val_loss: 0.031177 | Time: 3482.91 ms
[2020-12-19 09:12:12 main:574] : INFO : Epoch 283 | loss: 0.0311734 | val_loss: 0.0311788 | Time: 3202.16 ms
[2020-12-19 09:12:16 main:574] : INFO : Epoch 284 | loss: 0.0311725 | val_loss: 0.031176 | Time: 4019.24 ms
[2020-12-19 09:12:19 main:574] : INFO : Epoch 285 | loss: 0.0311736 | val_loss: 0.0311798 | Time: 3438.5 ms
[2020-12-19 09:12:23 main:574] : INFO : Epoch 286 | loss: 0.0311763 | val_loss: 0.031179 | Time: 3277.65 ms
[2020-12-19 09:12:26 main:574] : INFO : Epoch 287 | loss: 0.0311756 | val_loss: 0.0311826 | Time: 3343.33 ms
[2020-12-19 09:12:30 main:574] : INFO : Epoch 288 | loss: 0.0311792 | val_loss: 0.0311832 | Time: 3309.91 ms
[2020-12-19 09:12:33 main:574] : INFO : Epoch 289 | loss: 0.0319123 | val_loss: 0.0727404 | Time: 3146.07 ms
[2020-12-19 09:12:36 main:574] : INFO : Epoch 290 | loss: 0.0387725 | val_loss: 0.0317124 | Time: 3785.02 ms
[2020-12-19 09:12:40 main:574] : INFO : Epoch 291 | loss: 0.0318499 | val_loss: 0.0313443 | Time: 3482.63 ms
[2020-12-19 09:12:43 main:574] : INFO : Epoch 292 | loss: 0.0313682 | val_loss: 0.0312595 | Time: 3388.68 ms
[2020-12-19 09:12:47 main:574] : INFO : Epoch 293 | loss: 0.0312471 | val_loss: 0.0312231 | Time: 3218.15 ms
[2020-12-19 09:12:50 main:574] : INFO : Epoch 294 | loss: 0.0312218 | val_loss: 0.0312153 | Time: 3312.85 ms
[2020-12-19 09:12:53 main:574] : INFO : Epoch 295 | loss: 0.0312121 | val_loss: 0.0312072 | Time: 3367.02 ms
[2020-12-19 09:12:56 main:574] : INFO : Epoch 296 | loss: 0.0312049 | val_loss: 0.0312015 | Time: 3028.79 ms
[2020-12-19 09:13:00 main:574] : INFO : Epoch 297 | loss: 0.0312003 | val_loss: 0.0311963 | Time: 3076.02 ms
[2020-12-19 09:13:03 main:574] : INFO : Epoch 298 | loss: 0.0311965 | val_loss: 0.031193 | Time: 3425.23 ms
[2020-12-19 09:13:07 main:574] : INFO : Epoch 299 | loss: 0.0311946 | val_loss: 0.0311913 | Time: 3730.31 ms
[2020-12-19 09:13:10 main:574] : INFO : Epoch 300 | loss: 0.0311935 | val_loss: 0.0311909 | Time: 3267.72 ms
[2020-12-19 09:13:13 main:574] : INFO : Epoch 301 | loss: 0.0311923 | val_loss: 0.0311905 | Time: 3231.33 ms
[2020-12-19 09:13:17 main:574] : INFO : Epoch 302 | loss: 0.0311914 | val_loss: 0.0311914 | Time: 3675.7 ms
[2020-12-19 09:13:20 main:574] : INFO : Epoch 303 | loss: 0.031192 | val_loss: 0.0311915 | Time: 3373.45 ms
[2020-12-19 09:13:24 main:574] : INFO : Epoch 304 | loss: 0.0311924 | val_loss: 0.0311895 | Time: 3172.87 ms
[2020-12-19 09:13:27 main:574] : INFO : Epoch 305 | loss: 0.0311909 | val_loss: 0.0311891 | Time: 3690 ms
[2020-12-19 09:13:31 main:574] : INFO : Epoch 306 | loss: 0.0311902 | val_loss: 0.0311908 | Time: 3253.12 ms
[2020-12-19 09:13:34 main:574] : INFO : Epoch 307 | loss: 0.0311905 | val_loss: 0.0311913 | Time: 3079.08 ms
[2020-12-19 09:13:37 main:574] : INFO : Epoch 308 | loss: 0.0311906 | val_loss: 0.031191 | Time: 3095.19 ms
[2020-12-19 09:13:40 main:574] : INFO : Epoch 309 | loss: 0.0311901 | val_loss: 0.0311905 | Time: 3138.52 ms
[2020-12-19 09:13:43 main:574] : INFO : Epoch 310 | loss: 0.0311899 | val_loss: 0.0311887 | Time: 3209.97 ms
[2020-12-19 09:13:46 main:574] : INFO : Epoch 311 | loss: 0.0311893 | val_loss: 0.0311902 | Time: 3002.94 ms
[2020-12-19 09:13:49 main:574] : INFO : Epoch 312 | loss: 0.0311939 | val_loss: 0.0311923 | Time: 2854.7 ms
[2020-12-19 09:13:52 main:574] : INFO : Epoch 313 | loss: 0.0311957 | val_loss: 0.0311903 | Time: 3113.02 ms
[2020-12-19 09:13:56 main:574] : INFO : Epoch 314 | loss: 0.031194 | val_loss: 0.0311898 | Time: 3221.42 ms
[2020-12-19 09:13:59 main:574] : INFO : Epoch 315 | loss: 0.0311912 | val_loss: 0.0311889 | Time: 3179.54 ms
[2020-12-19 09:14:02 main:574] : INFO : Epoch 316 | loss: 0.0311899 | val_loss: 0.031188 | Time: 3357.12 ms
[2020-12-19 09:14:05 main:574] : INFO : Epoch 317 | loss: 0.0311888 | val_loss: 0.0311873 | Time: 3031.38 ms
[2020-12-19 09:14:08 main:574] : INFO : Epoch 318 | loss: 0.031189 | val_loss: 0.031188 | Time: 3044.04 ms
[2020-12-19 09:14:12 main:574] : INFO : Epoch 319 | loss: 0.0311884 | val_loss: 0.0311846 | Time: 3353.81 ms
[2020-12-19 09:14:15 main:574] : INFO : Epoch 320 | loss: 0.0311865 | val_loss: 0.0311846 | Time: 3511.67 ms
[2020-12-19 09:14:19 main:574] : INFO : Epoch 321 | loss: 0.0311853 | val_loss: 0.0311849 | Time: 3522.28 ms
[2020-12-19 09:14:22 main:574] : INFO : Epoch 322 | loss: 0.031185 | val_loss: 0.0311838 | Time: 3600.79 ms
[2020-12-19 09:14:26 main:574] : INFO : Epoch 323 | loss: 0.0311843 | val_loss: 0.0311835 | Time: 3178.12 ms
[2020-12-19 09:14:29 main:574] : INFO : Epoch 324 | loss: 0.031184 | val_loss: 0.0311841 | Time: 3958.03 ms
[2020-12-19 09:14:33 main:574] : INFO : Epoch 325 | loss: 0.0311849 | val_loss: 0.0311846 | Time: 3733.48 ms
[2020-12-19 09:14:37 main:574] : INFO : Epoch 326 | loss: 0.031184 | val_loss: 0.0311841 | Time: 3430.94 ms
[2020-12-19 09:14:40 main:574] : INFO : Epoch 327 | loss: 0.0311835 | val_loss: 0.0311832 | Time: 3216.61 ms
[2020-12-19 09:14:43 main:574] : INFO : Epoch 328 | loss: 0.0311834 | val_loss: 0.0311844 | Time: 3391.67 ms
[2020-12-19 09:14:47 main:574] : INFO : Epoch 329 | loss: 0.0311826 | val_loss: 0.0311846 | Time: 3128.55 ms
[2020-12-19 09:14:50 main:574] : INFO : Epoch 330 | loss: 0.0311828 | val_loss: 0.0311834 | Time: 3344.12 ms
[2020-12-19 09:14:53 main:574] : INFO : Epoch 331 | loss: 0.031183 | val_loss: 0.031182 | Time: 3148.14 ms
[2020-12-19 09:14:56 main:574] : INFO : Epoch 332 | loss: 0.0311811 | val_loss: 0.0311833 | Time: 3273.71 ms
[2020-12-19 09:14:59 main:574] : INFO : Epoch 333 | loss: 0.0311806 | val_loss: 0.0311812 | Time: 2987.32 ms
[2020-12-19 09:15:02 main:574] : INFO : Epoch 334 | loss: 0.0311805 | val_loss: 0.031181 | Time: 3015.4 ms
[2020-12-19 09:15:06 main:574] : INFO : Epoch 335 | loss: 0.03118 | val_loss: 0.0311805 | Time: 3123.23 ms
[2020-12-19 09:15:09 main:574] : INFO : Epoch 336 | loss: 0.0311797 | val_loss: 0.0311808 | Time: 3146.72 ms
[2020-12-19 09:15:12 main:574] : INFO : Epoch 337 | loss: 0.0311798 | val_loss: 0.0311792 | Time: 3496.66 ms
[2020-12-19 09:15:15 main:574] : INFO : Epoch 338 | loss: 0.0311786 | val_loss: 0.031179 | Time: 3068.51 ms
[2020-12-19 09:15:18 main:574] : INFO : Epoch 339 | loss: 0.0311781 | val_loss: 0.0311804 | Time: 3169.04 ms
[2020-12-19 09:15:22 main:574] : INFO : Epoch 340 | loss: 0.0311783 | val_loss: 0.0311795 | Time: 3138.24 ms
[2020-12-19 09:15:25 main:574] : INFO : Epoch 341 | loss: 0.0311781 | val_loss: 0.0311786 | Time: 3178.12 ms
[2020-12-19 09:15:28 main:574] : INFO : Epoch 342 | loss: 0.0311769 | val_loss: 0.0311782 | Time: 3410.58 ms
[2020-12-19 09:15:32 main:574] : INFO : Epoch 343 | loss: 0.0311761 | val_loss: 0.0311785 | Time: 3258.63 ms
[2020-12-19 09:15:35 main:574] : INFO : Epoch 344 | loss: 0.0311763 | val_loss: 0.0311785 | Time: 3520.7 ms
[2020-12-19 09:15:38 main:574] : INFO : Epoch 345 | loss: 0.0311758 | val_loss: 0.0311782 | Time: 3064.68 ms
[2020-12-19 09:15:41 main:574] : INFO : Epoch 346 | loss: 0.0311761 | val_loss: 0.0311783 | Time: 3083.83 ms
[2020-12-19 09:15:45 main:574] : INFO : Epoch 347 | loss: 0.031177 | val_loss: 0.0311789 | Time: 3168.49 ms
[2020-12-19 09:15:48 main:574] : INFO : Epoch 348 | loss: 0.0311763 | val_loss: 0.0311797 | Time: 3371.42 ms
[2020-12-19 09:15:52 main:574] : INFO : Epoch 349 | loss: 0.0311767 | val_loss: 0.0311797 | Time: 3615.98 ms
[2020-12-19 09:15:55 main:574] : INFO : Epoch 350 | loss: 0.0311758 | val_loss: 0.0311795 | Time: 3780.88 ms
[2020-12-19 09:15:59 main:574] : INFO : Epoch 351 | loss: 0.0311747 | val_loss: 0.0311782 | Time: 3244.39 ms
[2020-12-19 09:16:02 main:574] : INFO : Epoch 352 | loss: 0.0311732 | val_loss: 0.0311781 | Time: 3093.34 ms
[2020-12-19 09:16:05 main:574] : INFO : Epoch 353 | loss: 0.0311735 | val_loss: 0.0311785 | Time: 3239.64 ms
[2020-12-19 09:16:08 main:574] : INFO : Epoch 354 | loss: 0.0311731 | val_loss: 0.0311792 | Time: 3162.5 ms
[2020-12-19 09:16:12 main:574] : INFO : Epoch 355 | loss: 0.0311727 | val_loss: 0.0311778 | Time: 3228.03 ms
[2020-12-19 09:16:15 main:574] : INFO : Epoch 356 | loss: 0.0311735 | val_loss: 0.0311789 | Time: 3489.77 ms
[2020-12-19 09:16:18 main:574] : INFO : Epoch 357 | loss: 0.0311741 | val_loss: 0.0311787 | Time: 3099.69 ms
[2020-12-19 09:16:21 main:574] : INFO : Epoch 358 | loss: 0.0311732 | val_loss: 0.0311784 | Time: 3199.29 ms
[2020-12-19 09:16:25 main:574] : INFO : Epoch 359 | loss: 0.0311726 | val_loss: 0.0311779 | Time: 3413 ms
[2020-12-19 09:16:28 main:574] : INFO : Epoch 360 | loss: 0.0311719 | val_loss: 0.0311776 | Time: 2998.77 ms
[2020-12-19 09:16:31 main:574] : INFO : Epoch 361 | loss: 0.0311721 | val_loss: 0.0311777 | Time: 3128.27 ms
[2020-12-19 09:16:35 main:574] : INFO : Epoch 362 | loss: 0.0311716 | val_loss: 0.0311776 | Time: 3525.73 ms
[2020-12-19 09:16:38 main:574] : INFO : Epoch 363 | loss: 0.0311719 | val_loss: 0.0311793 | Time: 3719.55 ms
[2020-12-19 09:16:42 main:574] : INFO : Epoch 364 | loss: 0.0311717 | val_loss: 0.0311779 | Time: 3237.3 ms
[2020-12-19 09:16:45 main:574] : INFO : Epoch 365 | loss: 0.0311735 | val_loss: 0.0311785 | Time: 3121.74 ms
[2020-12-19 09:16:48 main:574] : INFO : Epoch 366 | loss: 0.0311726 | val_loss: 0.0311781 | Time: 3317.31 ms
[2020-12-19 09:16:51 main:574] : INFO : Epoch 367 | loss: 0.0311721 | val_loss: 0.0311771 | Time: 3196.25 ms
[2020-12-19 09:16:55 main:574] : INFO : Epoch 368 | loss: 0.0311716 | val_loss: 0.0311772 | Time: 3249.88 ms
[2020-12-19 09:16:58 main:574] : INFO : Epoch 369 | loss: 0.0311717 | val_loss: 0.0311769 | Time: 3142.06 ms
[2020-12-19 09:17:01 main:574] : INFO : Epoch 370 | loss: 0.0311716 | val_loss: 0.0311791 | Time: 3196.6 ms
[2020-12-19 09:17:04 main:574] : INFO : Epoch 371 | loss: 0.0311725 | val_loss: 0.031179 | Time: 2993.22 ms
[2020-12-19 09:17:07 main:574] : INFO : Epoch 372 | loss: 0.0311724 | val_loss: 0.0311762 | Time: 3088.72 ms
[2020-12-19 09:17:10 main:574] : INFO : Epoch 373 | loss: 0.0311739 | val_loss: 0.0311805 | Time: 3173.04 ms
[2020-12-19 09:17:13 main:574] : INFO : Epoch 374 | loss: 0.0311724 | val_loss: 0.031179 | Time: 3067.04 ms
[2020-12-19 09:17:17 main:574] : INFO : Epoch 375 | loss: 0.0311727 | val_loss: 0.0311774 | Time: 3563.89 ms
[2020-12-19 09:17:21 main:574] : INFO : Epoch 376 | loss: 0.031171 | val_loss: 0.0311776 | Time: 3935.38 ms
[2020-12-19 09:17:24 main:574] : INFO : Epoch 377 | loss: 0.0311709 | val_loss: 0.0311771 | Time: 3303.51 ms
[2020-12-19 09:17:28 main:574] : INFO : Epoch 378 | loss: 0.0311716 | val_loss: 0.0311757 | Time: 3461.56 ms
[2020-12-19 09:17:32 main:574] : INFO : Epoch 379 | loss: 0.0311713 | val_loss: 0.0311756 | Time: 3851.56 ms
[2020-12-19 09:17:35 main:574] : INFO : Epoch 380 | loss: 0.0311706 | val_loss: 0.0311746 | Time: 3339.69 ms
[2020-12-19 09:17:39 main:574] : INFO : Epoch 381 | loss: 0.0311708 | val_loss: 0.031175 | Time: 3622.2 ms
[2020-12-19 09:17:42 main:574] : INFO : Epoch 382 | loss: 0.0311704 | val_loss: 0.0311755 | Time: 3238.45 ms
[2020-12-19 09:17:45 main:574] : INFO : Epoch 383 | loss: 0.03117 | val_loss: 0.0311753 | Time: 3214.18 ms
THCudaCheck FAIL file=..\..\aten\src\THC\THCCachingHostAllocator.cpp line=278 error=719 : unspecified launch failure
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFACD83A859
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 12/19/20 09:17:48
Install Directory : C:\Program Files\BOINC\
Data Directory : C:\ProgramData\BOINC
Project Symstore :
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\35;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 00000000fa850000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000cfd60000 00000000001f0000 C:\Windows\SYSTEM32\ntdll.dll (6.2.18362.719) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.18362.830 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.830
ModLoad: 00000000ceec0000 00000000000b2000 C:\Windows\System32\KERNEL32.DLL (6.2.18362.329) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.18362.830 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.830
ModLoad: 00000000cd800000 00000000002a3000 C:\Windows\System32\KERNELBASE.dll (6.2.18362.719) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.18362.830 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.830
ModLoad: 00000000cdf50000 0000000000194000 C:\Windows\System32\USER32.dll (6.2.18362.719) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.18362.830 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.830
ModLoad: 00000000cdbb0000 0000000000021000 C:\Windows\System32\win32u.dll (6.2.18362.719) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.18362.719 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.719
ModLoad: 00000000ce0f0000 0000000000026000 C:\Windows\System32\GDI32.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 00000000cd510000 0000000000194000 C:\Windows\System32\gdi32full.dll (6.2.18362.719) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.18362.719 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.719
ModLoad: 00000000cd470000 000000000009e000 C:\Windows\System32\msvcp_win.dll (6.2.18362.387) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.18362.387 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.387
ModLoad: 00000000cdab0000 00000000000fa000 C:\Windows\System32\ucrtbase.dll (6.2.18362.387) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.18362.387 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.387
ModLoad: 00000000cde20000 00000000000a3000 C:\Windows\System32\ADVAPI32.dll (6.2.18362.329) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.18362.830 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.830
ModLoad: 00000000cf020000 000000000009e000 C:\Windows\System32\msvcrt.dll (7.0.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.18362.1
ModLoad: 00000000cef80000 0000000000097000 C:\Windows\System32\sechost.dll (6.2.18362.693) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 00000000cf0c0000 0000000000120000 C:\Windows\System32\RPCRT4.dll (6.2.18362.628) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.18362.830 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.830
ModLoad: 00000000bb8a0000 0000000000058000 C:\ProgramData\BOINC\slots\35\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000a87f0000 0000000000092000 C:\Windows\SYSTEM32\MSVCP140.dll (14.28.29325.2) (-exported- Symbols Loaded)
Linked PDB Filename : D:\agent\_work\49\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.28.29325.2 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.28.29325.2
ModLoad: 00000000a85f0000 00000000001f4000 C:\Windows\SYSTEM32\dbghelp.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 00000000a8570000 0000000000019000 C:\Windows\SYSTEM32\VCRUNTIME140.dll (14.28.29325.2) (-exported- Symbols Loaded)
Linked PDB Filename : D:\agent\_work\49\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.28.29325.2 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.28.29325.2
ModLoad: 00000000a8560000 000000000000c000 C:\Windows\SYSTEM32\VCRUNTIME140_1.dll (14.28.29325.2) (-exported- Symbols Loaded)
Linked PDB Filename : D:\agent\_work\49\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.28.29325.2 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.28.29325.2
ModLoad: 0000000072430000 000000000abe7000 C:\ProgramData\BOINC\slots\35\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000a1470000 00000000002db000 C:\ProgramData\BOINC\slots\35\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000a1260000 000000000020d000 C:\ProgramData\BOINC\slots\35\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 00000000bcb40000 0000000000040000 C:\ProgramData\BOINC\slots\35\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000004b6c0000 0000000024b49000 C:\ProgramData\BOINC\slots\35\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000bb310000 0000000000045000 C:\ProgramData\BOINC\slots\35\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000009dda0000 00000000034b2000 C:\ProgramData\BOINC\slots\35\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 00000000c95d0000 0000000000010000 C:\ProgramData\BOINC\slots\35\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 00000000896a0000 00000000030a5000 C:\ProgramData\BOINC\slots\35\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 000000006da20000 0000000003d5b000 C:\ProgramData\BOINC\slots\35\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 000000005d4a0000 000000000919f000 C:\ProgramData\BOINC\slots\35\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 00000000ba590000 000000001b3a4000 C:\ProgramData\BOINC\slots\35\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 000000006bb50000 0000000001eca000 C:\ProgramData\BOINC\slots\35\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000cdc60000 0000000000080000 C:\Windows\System32\bcryptPrimitives.dll (6.2.18362.295) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.18362.295 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.295
ModLoad: 00000000cea00000 000000000002e000 C:\Windows\System32\IMM32.DLL (6.2.18362.387) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.18362.387 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.387
ModLoad: 00000000ccca0000 0000000000011000 C:\Windows\System32\kernel.appcore.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 00000000cb890000 0000000000020000 C:\Windows\SYSTEM32\dxcore.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : DXCore.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 00000000cddc0000 000000000004a000 C:\Windows\System32\cfgmgr32.dll (6.2.18362.387) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.18362.387 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.387
ModLoad: 00000000cf570000 0000000000336000 C:\Windows\System32\combase.dll (6.2.18362.693) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.18362.830 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.830
ModLoad: 00000000cf8b0000 0000000000470000 C:\Windows\System32\Setupapi.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.18362.830 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.830
ModLoad: 00000000cdd90000 0000000000026000 C:\Windows\System32\bcrypt.dll (6.2.18362.267) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.18362.830 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.830
ModLoad: 00000000cca20000 000000000002a000 C:\Windows\SYSTEM32\DEVOBJ.dll (6.2.18362.387) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.18362.387 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.387
ModLoad: 00000000cdbe0000 000000000005c000 C:\Windows\System32\WINTRUST.dll (6.2.18362.387) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.18362.387 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.387
ModLoad: 00000000ccc80000 0000000000012000 C:\Windows\System32\MSASN1.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 00000000cd6b0000 0000000000149000 C:\Windows\System32\CRYPT32.dll (6.2.18362.592) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.18362.830 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.830
ModLoad: 00000000ce260000 00000000006e5000 C:\Windows\System32\Shell32.dll (6.2.18362.719) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.18362.830 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.830
ModLoad: 00000000cecd0000 00000000000a9000 C:\Windows\System32\shcore.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.18362.830 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.830
ModLoad: 00000000cccf0000 0000000000780000 C:\Windows\System32\windows.storage.dll (6.2.18362.719) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.18362.830 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.830
ModLoad: 00000000cccc0000 0000000000023000 C:\Windows\System32\profapi.dll (6.2.18362.693) (-nosymbols- Symbols Loaded)
Linked PDB Filename : profapi.pdb
File Version : 10.0.18362.693 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.693
ModLoad: 00000000ccc30000 000000000004a000 C:\Windows\System32\powrprof.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : powrprof.pdb
File Version : 10.0.18362.830 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.830
ModLoad: 00000000ccc20000 0000000000010000 C:\Windows\System32\UMPDC.dll (-exported- Symbols Loaded)
Linked PDB Filename : UMPDC.pdb
ModLoad: 00000000cf2b0000 0000000000052000 C:\Windows\System32\shlwapi.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.18362.830 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.830
ModLoad: 00000000cdc40000 0000000000017000 C:\Windows\System32\cryptsp.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : cryptsp.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 00000000e48b0000 0000000000267000 C:\Windows\system32\nvcuda.dll (27.21.14.5751) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 27.21.14.5751
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.1.114 driver
Product Version : 27.21.14.5751
ModLoad: 00000000c3af0000 000000000000a000 C:\Windows\SYSTEM32\VERSION.DLL (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 00000000e3380000 000000000152c000 C:\Windows\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_7ad69efe14475762\nvcuda64.dll (27.21.14.5751) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 27.21.14.5751
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.1.114 driver
Product Version : 27.21.14.5751
ModLoad: 00000000cedf0000 000000000006f000 C:\Windows\System32\WS2_32.dll (6.2.18362.387) (-exported- Symbols Loaded)
Linked PDB Filename : ws2_32.pdb
File Version : 10.0.18362.830 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.830
ModLoad: 00000000c1290000 000000000002f000 C:\Windows\SYSTEM32\cryptnet.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 00000000cc600000 000000000000c000 C:\Windows\SYSTEM32\cryptbase.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 00000000cafa0000 0000000000099000 C:\Windows\system32\uxtheme.dll (6.2.18362.449) (-exported- Symbols Loaded)
Linked PDB Filename : UxTheme.pdb
File Version : 10.0.18362.830 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.830
ModLoad: 00000000ac6a0000 00000000006d6000 C:\Windows\SYSTEM32\nvapi64.dll (27.21.14.5751) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 27.21.14.5751
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 27.21.14.5751
ModLoad: 00000000cea30000 0000000000157000 C:\Windows\System32\OLE32.DLL (6.2.18362.693) (-exported- Symbols Loaded)
Linked PDB Filename : ole32.pdb
File Version : 10.0.18362.830 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.830
ModLoad: 00000000c95c0000 0000000000009000 C:\ProgramData\BOINC\slots\35\caffe2_nvrtc.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000886d0000 0000000000fca000 C:\ProgramData\BOINC\slots\35\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6.14.11.9000
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.89 NVRTC Library
Product Version : 6.14.11.9000
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 4007, Write: 1921, Other 6898
- I/O Transfers Counters -
Read: 6540361, Write: 806277, Other 87464
- Paged Pool Usage -
QuotaPagedPoolUsage: 3536712, QuotaPeakPagedPoolUsage: 3537272
QuotaNonPagedPoolUsage: 59424, QuotaPeakNonPagedPoolUsage: 59552
- Virtual Memory Usage -
VirtualSize: 394448896, PeakVirtualSize: 1013600256
- Pagefile Usage -
PagefileUsage: 394448896, PeakPagefileUsage: 394448896
- Working Set Size -
WorkingSetSize: -2044186624, PeakWorkingSetSize: -2037907456, PageFaultCount: 850456
*** Dump of thread ID 10672 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 354218752.000000, User Time: 5916093952.000000, Wait Time: 3193166.000000
- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFACD83A859
- Registers -
rax=0000000000000000 rbx=000000007c8a62f0 rcx=0000000000000000 rdx=0000000000000000 rsi=00000000fa383de0 rdi=0000000019930520
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000000006000 r13=0000000000000000
r14=00000000fa384b20 r15=00000000fa384aa0 rip=00000000cd83a859 rsp=00000000fa383c80 rbp=00000000fa384688
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202
- Callstack -
ChildEBP RetAddr Args to Child
fa383d50 a8576220 23180414 00000000 fa384b20 779fa014 KERNELBASE!RaiseException+0x0
fa383db0 77ff5272 23180474 cdab7de0 000007cb 00000116 VCRUNTIME140!_CxxThrowException+0x0
fa383e00 77ff56d4 00000000 cd821efb 7b01d290 4ef25f68 torch_cpu!at::Tensor::zero_+0x0
fa384660 4e4e9ebe fa384890 4ef26850 4ef26880 000002cf torch_cpu!_THError+0x0
fa3846a0 4e4e5412 fa384890 fa3847f0 cb2b6440 4f35a720 torch_cuda!__THCudaCheck+0x0
fa3846e0 77ca59ff fa384a00 fa384890 fa384d60 bb8d97b0 torch_cuda!at::native::set_storage_cuda_+0x0
fa384a70 77e4726f 4eb5f630 779fea63 00000001 bb8bef8f torch_cpu!at::native::empty_cpu+0x0
fa384ab0 77e00615 fa380000 fa384b28 fa384d20 bb8a7ce6 torch_cpu!at::native::mkldnn_sigmoid_+0x0
fa384af0 77e0204a fa380000 fa384b00 cb29a100 4d826ae5 torch_cpu!at::native::mkldnn_sigmoid_+0x0
fa384b80 77e00615 00000000 779fea63 fa384c60 fa384d60 torch_cpu!at::native::mkldnn_sigmoid_+0x0
fa384bc0 77ed1eb0 fa380000 00000000 fa384d48 00000001 torch_cpu!at::native::mkldnn_sigmoid_+0x0
fa384c60 77ee2eec 9ca2b84f bb8d9c50 fa384dc0 bb8a3bd6 torch_cpu!at::bucketize_out+0x0
fa384cb0 4dbef160 fa380000 00000000 fa384dc0 00000000 torch_cpu!at::empty+0x0
fa385050 4dbf2de8 bb8d9c50 77a00528 16548360 bb8d9c50 torch_cuda!at::native::cummin_helper_cuda+0x0
fa385230 4dbf4379 fa385340 504c5930 fa385740 504c5948 torch_cuda!at::native::cummin_helper_cuda+0x0
fa385470 4dbf3d64 fa380000 fa385740 fa385580 fa385740 torch_cuda!at::native::cat_out_cuda+0x0
fa385670 4e491dd2 fa3856c8 00000001 fa3856c8 fa385740 torch_cuda!at::native::cat_cuda+0x0
fa3856f0 4e4a4179 00000001 fa385730 16547f48 04000000 torch_cuda!at::native::set_storage_cuda_+0x0
fa385730 77ed1d7d 3c17ab00 7cd50640 00000080 fa385aa0 torch_cuda!at::native::set_storage_cuda_+0x0
fa3857b0 77eb0d81 00000000 bb8c3994 fa385f80 504ba8d0 torch_cpu!at::bucketize_out+0x0
fa3857f0 77cbb4a5 fa385830 16547f60 fa385900 fa385970 torch_cpu!at::_cat+0x0
fa3858c0 77fa27bd fa385990 00000101 fa385918 bb8f1ea8 torch_cpu!at::native::cat+0x0
fa385940 77a629ae 504c5870 504c5880 504c5888 fa3858f8 torch_cpu!at::zeros_out+0x0
fa385980 77ed1d7d fa3859c0 fa385a30 00000000 cfd9fc11 torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0
fa385a00 77ed75d1 fa385fa0 7cd50640 fa385f80 504ba8d0 torch_cpu!at::bucketize_out+0x0
fa385a40 77cc7d4c fa385cd0 00000000 fa385cd0 00000000 torch_cpu!at::cat+0x0
fa385c00 77fbc38d fa385c58 00000001 fa385c58 fa385cd0 torch_cpu!at::native::stack+0x0
fa385c80 77a629ae fa385e70 fa385e90 fa385f80 504ba8d0 torch_cpu!at::zeros_out+0x0
fa385cc0 77ed1d7d fa385d00 fa385d70 00000000 7ac71c8f torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0
fa385d40 77f202e1 fa385e70 bb8c3720 fa385fa0 7cd50640 torch_cpu!at::bucketize_out+0x0
fa385d80 792b3839 fa385e00 16548b80 16548b80 fa385e90 torch_cpu!at::stack+0x0
fa385f50 77a629ae bb8f1ea8 fa385fa0 00000000 fa386040 torch_cpu!torch::autograd::GraphRoot::apply+0x0
fa385f90 77ed1d7d fa385fd0 fa386040 4af502c0 373511b8 torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0
fa386010 77f202e1 fa386180 779f9cac 4b2a4740 504ba8d0 torch_cpu!at::bucketize_out+0x0
fa386050 fa85ff7e fa386118 4af502c0 4af502c0 fa386260 torch_cpu!at::stack+0x0
fa3860f0 fa862ef8 fa85fe30 fa386130 fa386130 fa386180 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::addCallback+0x0
fa386150 fa863ea4 9f41a1d0 cfd9fc11 fa3862f0 ca7e0000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Object::getSlot+0x0
fa386290 fa85d3d2 501c7400 cfd9fc11 fa3862f0 53015010 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::markCompleted+0x0
fa3862c0 fa864541 00000000 50d8ab60 00000000 cdac14cb mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Object::operator=+0x0
fa386470 fa86743a fa386540 00000000 fa386f80 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::markCompleted+0x0
fa386970 fa86b950 fa386a70 fa386a70 00000000 acdd5e00 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0
fa39f710 faaac6f8 cc201170 00000000 00000000 cc18ded0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
fa39f750 ceed7bd4 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
fa39f780 cfdcced1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
fa39f800 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 9440 (state: Waiting): ***
- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 1093750.000000, User Time: 0.000000, Wait Time: 3193150.000000
- Registers -
rax=00000000000001cd rbx=00000000ca7e5570 rcx=0000000000000070 rdx=00000000ca7e51f0 rsi=00000000ca7e3210 rdi=00000000ca7e5570
r8=00000000fa6ff0c0 r9=00000000fa6ff2ff r10=000000000000006c r11=00000000fa6feec0 r12=0000000000000000 r13=00000000ca7e4710
r14=0000000000000001 r15=0000000000000002 rip=00000000cfdffa54 rsp=00000000fa6ff958 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
fa6ff950 cfd94060 00000002 00000002 ca7e3210 00000011 ntdll!ZwWaitForWorkViaWorkerFactory+0x0
fa6ffd10 ceed7bd4 00000000 00000000 00000000 00000000 ntdll!RtlInitializeResource+0x0
fa6ffd40 cfdcced1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
fa6ffdc0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 6988 (state: Waiting): ***
- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 2968750.000000, User Time: 0.000000, Wait Time: 3193150.000000
- Registers -
rax=00000000000001cd rbx=00000000ca7e59a0 rcx=0000000000000070 rdx=00000000ca7e5620 rsi=00000000ca7e3210 rdi=00000000ca7e59a0
r8=0000000000000008 r9=0000000000000001 r10=0000000000000140 r11=000000003c14ff40 r12=0000000000000000 r13=00000000ca7e4710
r14=0000000000000001 r15=0000000000000002 rip=00000000cfdffa54 rsp=00000000fa7ff8e8 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
fa7ff8e0 cfd94060 00000002 00000002 ca7e3210 00000013 ntdll!ZwWaitForWorkViaWorkerFactory+0x0
fa7ffca0 ceed7bd4 00000000 00000000 00000000 00000000 ntdll!RtlInitializeResource+0x0
fa7ffcd0 cfdcced1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
fa7ffd50 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 3756 (state: Waiting): ***
- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 781250.000000, User Time: 0.000000, Wait Time: 3193150.000000
- Registers -
rax=00000000000001cd rbx=00000000ca7e63d0 rcx=0000000000000070 rdx=00000000ca7e6050 rsi=00000000ca7e3210 rdi=00000000ca7e63d0
r8=0000000000000562 r9=0000000000000562 r10=0000000000000507 r11=00000000000005bd r12=0000000000000000 r13=00000000ca7e4710
r14=0000000000000001 r15=0000000000000002 rip=00000000cfdffa54 rsp=00000000fa8ff838 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
fa8ff830 cfd94060 00000002 00000002 ca7e3210 00000010 ntdll!ZwWaitForWorkViaWorkerFactory+0x0
fa8ffbf0 ceed7bd4 00000000 00000000 00000000 00000000 ntdll!RtlInitializeResource+0x0
fa8ffc20 cfdcced1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
fa8ffca0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 7696 (state: Waiting): ***
- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 3193166.000000
- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000faaff730 rsi=0000000000000000 rdi=0000000000000064
r8=00000000faafe7d8 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000cfdfc744 rsp=00000000faaff708 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
faaff700 cd846951 faaff7c8 00000000 00000000 00000000 ntdll!ZwDelayExecution+0x0
faaff7a0 fa88a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0
faaff7d0 ceed7bd4 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
faaff800 cfdcced1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
faaff880 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 9708 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 3193165.000000
- Registers -
rax=000000000000005b rbx=000000000000000b rcx=000000000000000b rdx=00000000fabff670 rsi=0000000000000000 rdi=000000000000000b
r8=00000000cc8e0290 r9=00000000cc3b0200 r10=0000000000000000 r11=00000000fabff5e0 r12=0000000000000064 r13=00000000fabff670
r14=00000000fabff360 r15=0000000000000000 rip=00000000cfdfcc14 rsp=00000000fabff308 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
fabff300 cd8580f7 cea53880 cfdd3854 00000000 fa41f000 ntdll!NtWaitForMultipleObjects+0x0
fabff600 cd857fde e3874b48 ca7f27c0 0000000b 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
fabff640 e352bb54 cc3b32a0 00000000 cc3af3a0 00000000 KERNELBASE!WaitForMultipleObjects+0x0
fabff880 e35c09ed 00000000 00000004 00000000 00000000 nvcuda64!+0x0
fabff930 e352b523 2b4a5a45 2afdd26b cc935710 00000000 nvcuda64!cuProfilerStop+0x0
fabff960 e383a750 cc935710 00000000 00000000 00000000 nvcuda64!+0x0
fabff990 ceed7bd4 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
fabff9c0 cfdcced1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
fabffa40 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 8284 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 3193165.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002c4 rdx=0000000000000000 rsi=00000000facffd18 rdi=00000000000002c4
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=00000000cc41ba50 r13=0000000000000000
r14=00000000000002c4 r15=0000000000000001 rip=00000000cfdfc144 rsp=00000000facffce8 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
facffce0 cd838bc3 00000000 00000000 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0
facffd80 e373c0e7 00000000 cd824a35 00000000 000002c4 KERNELBASE!WaitForSingleObjectEx+0x0
facffdf0 e352b523 00000001 ccb82410 cc935830 00000000 nvcuda64!cuProfilerStop+0x0
facffe20 e383a750 cc935830 00000000 00000000 00000000 nvcuda64!+0x0
facffe50 ceed7bd4 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
facffe80 cfdcced1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
facfff00 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 10736 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 3193150.000000
- Registers -
rax=00000000000001ca rbx=0000000000000000 rcx=00000000cc4c4de8 rdx=00000000fadffdb8 rsi=00000000fadffd20 rdi=0000000000000000
r8=00000000c304f74c r9=00000000c304f444 r10=00000000cc4c4de8 r11=00000000dc50c4e8 r12=00000000fadffdb8 r13=0000000000000000
r14=00000000cc4c4de8 r15=00000000cc4c99b8 rip=00000000cfdff9f4 rsp=00000000fadffcf8 rbp=00000000fadffd50
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
fadffcf0 cfdc0895 00000102 00000102 00000000 fadffd20 ntdll!ZwWaitForAlertByThreadId+0x0
fadffd60 cd87c379 cc4c71a0 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0
fadffd90 e34b223a cc4c71a0 cc4c71a0 cc4c71a0 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0
fadffdf0 e352b523 00000002 2b2433f3 b3079df5 00000000 nvcuda64!+0x0
fadffe20 e383a750 cc9354d0 00000000 00000000 00000000 nvcuda64!+0x0
fadffe50 ceed7bd4 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
fadffe80 cfdcced1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
fadfff00 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 7432 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 251093744.000000, User Time: 4279531264.000000, Wait Time: 3193162.000000
- Registers -
rax=00000000000001ca rbx=0000000000000000 rcx=000000002fcbfb58 rdx=0000000000000000 rsi=0000000000000000 rdi=000000002fcbfb00
r8=0000000000000000 r9=000000004b2a4780 r10=0000000000000080 r11=0000000000000000 r12=0000000000000003 r13=00000000000001c0
r14=000000002fcbfb08 r15=0000000000000000 rip=00000000cfdff9f4 rsp=00000000faeff598 rbp=000000002fcbfb58
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
faeff590 cfdc0610 4b2c7460 4b2c7450 3c50b178 7960c0b7 ntdll!ZwWaitForAlertByThreadId+0x0
faeff600 cd8259bd 2fcbfb50 2fcbfb00 00000000 00000000 ntdll!RtlSleepConditionVariableSRW+0x0
faeff640 a882bf3d 4b2c7480 00000000 00000000 796105b4 KERNELBASE!SleepConditionVariableSRW+0x0
faeff680 a8802798 00000000 4b2c7480 00000000 00000000 MSVCP140!__crtSetThreadpoolWait+0x0
faeff6b0 a8802a4a 9b0c09cf 00000000 faeff8c0 2fcbfb48 MSVCP140!std::_Winerror_message+0x0
faeff6e0 7961064b 2fcbfb00 faeff7e0 2fcbfb00 4b2c7460 MSVCP140!_Cnd_wait+0x0
faeff720 796125b1 530d8f70 ffffffff 4b2c7460 ffffffff torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
faeffa10 79612471 7cb36d10 faeffa50 7cb36d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0
faeffa60 79609744 00080001 53016a90 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0
faeffa90 cdad0e72 53016a90 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0
faeffac0 ceed7bd4 00000000 00000000 00000000 00000000 ucrtbase!_beginthreadex+0x0
faeffaf0 cfdcced1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
faeffb70 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)