| Name | ParityModified-1647040135-26442-2-0_0 |
| Workunit | 10817352 |
| Created | 24 Mar 2022, 23:21:37 UTC |
| Sent | 31 Mar 2022, 2:51:00 UTC |
| Report deadline | 8 Apr 2022, 2:51:00 UTC |
| Received | 3 Apr 2022, 17:18:43 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 197 (0x000000C5) EXIT_TIME_LIMIT_EXCEEDED |
| Computer ID | 4503 |
| Run time | 8 hours 36 min 15 sec |
| CPU time | 14 min 56 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 10,073.24 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 2.08 GB |
| Peak swap size | 4.40 GB |
| Peak disk usage | 1.54 GB |
<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
exceeded elapsed time limit 30969.09 (4000000.00G/129.16G)</message>
<stderr_txt>
al_loss: 0.0311558 | Time: 25717.7 ms
[2022-04-03 04:31:29 main:574] : INFO : Epoch 76 | loss: 0.0310918 | val_loss: 0.0311498 | Time: 50672.5 ms
[2022-04-03 04:31:33 main:574] : INFO : Epoch 77 | loss: 0.0310916 | val_loss: 0.0311423 | Time: 4000.09 ms
[2022-04-03 04:32:17 main:574] : INFO : Epoch 78 | loss: 0.0311121 | val_loss: 0.0311573 | Time: 43736.4 ms
[2022-04-03 04:35:15 main:574] : INFO : Epoch 79 | loss: 0.0311303 | val_loss: 0.0311478 | Time: 173387 ms
[2022-04-03 04:37:44 main:574] : INFO : Epoch 80 | loss: 0.0311111 | val_loss: 0.0311421 | Time: 144123 ms
[2022-04-03 04:38:49 main:574] : INFO : Epoch 81 | loss: 0.0310989 | val_loss: 0.0311406 | Time: 65175.3 ms
[2022-04-03 04:40:50 main:574] : INFO : Epoch 82 | loss: 0.0310942 | val_loss: 0.0311452 | Time: 114732 ms
[2022-04-03 04:42:15 main:574] : INFO : Epoch 83 | loss: 0.0310979 | val_loss: 0.0311434 | Time: 77161.6 ms
[2022-04-03 04:42:19 main:574] : INFO : Epoch 84 | loss: 0.0310944 | val_loss: 0.0311366 | Time: 4633.64 ms
[2022-04-03 04:42:26 main:574] : INFO : Epoch 85 | loss: 0.0310931 | val_loss: 0.031142 | Time: 6407.37 ms
[2022-04-03 04:44:01 main:574] : INFO : Epoch 86 | loss: 0.0310921 | val_loss: 0.0311428 | Time: 94313.7 ms
[2022-04-03 04:44:41 main:574] : INFO : Epoch 87 | loss: 0.0310918 | val_loss: 0.0311384 | Time: 34941.8 ms
[2022-04-03 04:44:46 main:574] : INFO : Epoch 88 | loss: 0.0310883 | val_loss: 0.031142 | Time: 4602.27 ms
[2022-04-03 04:44:56 main:574] : INFO : Epoch 89 | loss: 0.0310859 | val_loss: 0.031148 | Time: 10016.4 ms
[2022-04-03 04:45:35 main:574] : INFO : Epoch 90 | loss: 0.0310911 | val_loss: 0.0311475 | Time: 38739.5 ms
[2022-04-03 04:48:16 main:574] : INFO : Epoch 91 | loss: 0.0310896 | val_loss: 0.0311427 | Time: 155574 ms
[2022-04-03 04:50:29 main:574] : INFO : Epoch 92 | loss: 0.0310848 | val_loss: 0.0311398 | Time: 132987 ms
[2022-04-03 04:52:48 main:574] : INFO : Epoch 93 | loss: 0.0310829 | val_loss: 0.0311489 | Time: 138917 ms
[2022-04-03 04:53:22 main:574] : INFO : Epoch 94 | loss: 0.0310846 | val_loss: 0.031142 | Time: 34821 ms
[2022-04-03 04:56:20 main:574] : INFO : Epoch 95 | loss: 0.0310814 | val_loss: 0.031146 | Time: 167464 ms
[2022-04-03 04:58:11 main:574] : INFO : Epoch 96 | loss: 0.0310811 | val_loss: 0.0311493 | Time: 106110 ms
[2022-04-03 05:00:34 main:574] : INFO : Epoch 97 | loss: 0.0310789 | val_loss: 0.031146 | Time: 137480 ms
[2022-04-03 05:01:44 main:574] : INFO : Epoch 98 | loss: 0.0310798 | val_loss: 0.0311463 | Time: 70341.3 ms
[2022-04-03 05:03:46 main:574] : INFO : Epoch 99 | loss: 0.0310819 | val_loss: 0.0311513 | Time: 116754 ms
[2022-04-03 05:06:22 main:574] : INFO : Epoch 100 | loss: 0.031083 | val_loss: 0.0311428 | Time: 150802 ms
[2022-04-03 05:07:40 main:574] : INFO : Epoch 101 | loss: 0.0310847 | val_loss: 0.0311599 | Time: 78020.9 ms
[2022-04-03 05:09:56 main:574] : INFO : Epoch 102 | loss: 0.0311848 | val_loss: 0.0312164 | Time: 136195 ms
[2022-04-03 05:12:13 main:574] : INFO : Epoch 103 | loss: 0.0312098 | val_loss: 0.0311987 | Time: 130637 ms
[2022-04-03 05:14:53 main:574] : INFO : Epoch 104 | loss: 0.0312039 | val_loss: 0.0312063 | Time: 160315 ms
[2022-04-03 05:15:17 main:574] : INFO : Epoch 105 | loss: 0.0311996 | val_loss: 0.0311948 | Time: 18664.8 ms
[2022-04-03 05:15:21 main:574] : INFO : Epoch 106 | loss: 0.0311953 | val_loss: 0.0311902 | Time: 4425.16 ms
[2022-04-03 05:17:38 main:574] : INFO : Epoch 107 | loss: 0.0311936 | val_loss: 0.031196 | Time: 135684 ms
[2022-04-03 05:19:40 main:574] : INFO : Epoch 108 | loss: 0.0311905 | val_loss: 0.0311861 | Time: 116370 ms
[2022-04-03 05:21:51 main:574] : INFO : Epoch 109 | loss: 0.0311874 | val_loss: 0.0311835 | Time: 131285 ms
[2022-04-03 05:24:34 main:574] : INFO : Epoch 110 | loss: 0.0311866 | val_loss: 0.0311872 | Time: 157970 ms
[2022-04-03 05:27:12 main:574] : INFO : Epoch 111 | loss: 0.0311848 | val_loss: 0.0311827 | Time: 153198 ms
[2022-04-03 05:30:01 main:574] : INFO : Epoch 112 | loss: 0.0311823 | val_loss: 0.0311814 | Time: 168636 ms
[2022-04-03 05:30:40 main:574] : INFO : Epoch 113 | loss: 0.0311824 | val_loss: 0.0311893 | Time: 34865.8 ms
[2022-04-03 05:33:13 main:574] : INFO : Epoch 114 | loss: 0.0311815 | val_loss: 0.0311831 | Time: 152765 ms
[2022-04-03 05:35:34 main:574] : INFO : Epoch 115 | loss: 0.031181 | val_loss: 0.0311797 | Time: 141276 ms
[2022-04-03 05:37:46 main:574] : INFO : Epoch 116 | loss: 0.0311767 | val_loss: 0.0311793 | Time: 131409 ms
[2022-04-03 05:38:09 main:574] : INFO : Epoch 117 | loss: 0.0311763 | val_loss: 0.0311776 | Time: 23258.1 ms
[2022-04-03 05:40:29 main:574] : INFO : Epoch 118 | loss: 0.0311741 | val_loss: 0.0311783 | Time: 128844 ms
[2022-04-03 05:42:52 main:574] : INFO : Epoch 119 | loss: 0.0311731 | val_loss: 0.0311773 | Time: 137980 ms
[2022-04-03 05:42:56 main:574] : INFO : Epoch 120 | loss: 0.0311745 | val_loss: 0.0311804 | Time: 3648.75 ms
[2022-04-03 05:43:00 main:574] : INFO : Epoch 121 | loss: 0.0311731 | val_loss: 0.031179 | Time: 3800.2 ms
[2022-04-03 05:44:51 main:574] : INFO : Epoch 122 | loss: 0.0311707 | val_loss: 0.0311747 | Time: 110672 ms
[2022-04-03 05:47:20 main:574] : INFO : Epoch 123 | loss: 0.0311698 | val_loss: 0.0311756 | Time: 149593 ms
[2022-04-03 05:49:48 main:574] : INFO : Epoch 124 | loss: 0.0311701 | val_loss: 0.0311764 | Time: 147241 ms
[2022-04-03 05:51:57 main:574] : INFO : Epoch 125 | loss: 0.0311693 | val_loss: 0.0311783 | Time: 129167 ms
[2022-04-03 05:53:57 main:574] : INFO : Epoch 126 | loss: 0.0311677 | val_loss: 0.0311744 | Time: 115200 ms
[2022-04-03 05:56:32 main:574] : INFO : Epoch 127 | loss: 0.0311674 | val_loss: 0.0311743 | Time: 155558 ms
[2022-04-03 05:59:13 main:574] : INFO : Epoch 128 | loss: 0.0311662 | val_loss: 0.0311752 | Time: 155572 ms
[2022-04-03 06:00:36 main:574] : INFO : Epoch 129 | loss: 0.0311662 | val_loss: 0.0311731 | Time: 82805.5 ms
[2022-04-03 06:03:36 main:574] : INFO : Epoch 130 | loss: 0.0311672 | val_loss: 0.0311758 | Time: 180213 ms
[2022-04-03 06:05:41 main:574] : INFO : Epoch 131 | loss: 0.0311657 | val_loss: 0.0311742 | Time: 120841 ms
[2022-04-03 06:07:41 main:574] : INFO : Epoch 132 | loss: 0.0311643 | val_loss: 0.031172 | Time: 107848 ms
[2022-04-03 06:10:12 main:574] : INFO : Epoch 133 | loss: 0.0311644 | val_loss: 0.0311743 | Time: 150434 ms
[2022-04-03 06:10:25 main:574] : INFO : Epoch 134 | loss: 0.0311633 | val_loss: 0.0311732 | Time: 13225.9 ms
[2022-04-03 06:10:29 main:574] : INFO : Epoch 135 | loss: 0.031162 | val_loss: 0.0311713 | Time: 3772.6 ms
[2022-04-03 06:10:33 main:574] : INFO : Epoch 136 | loss: 0.0311617 | val_loss: 0.0311718 | Time: 3779.69 ms
[2022-04-03 06:11:31 main:574] : INFO : Epoch 137 | loss: 0.0311624 | val_loss: 0.0311732 | Time: 58507.5 ms
[2022-04-03 06:13:43 main:574] : INFO : Epoch 138 | loss: 0.031162 | val_loss: 0.0311709 | Time: 131779 ms
[2022-04-03 06:16:06 main:574] : INFO : Epoch 139 | loss: 0.0311628 | val_loss: 0.0311723 | Time: 142528 ms
[2022-04-03 06:18:45 main:574] : INFO : Epoch 140 | loss: 0.0311616 | val_loss: 0.0311702 | Time: 154404 ms
[2022-04-03 06:21:28 main:574] : INFO : Epoch 141 | loss: 0.0311613 | val_loss: 0.0311711 | Time: 157972 ms
[2022-04-03 06:24:19 main:574] : INFO : Epoch 142 | loss: 0.0311609 | val_loss: 0.0311756 | Time: 166255 ms
[2022-04-03 06:26:20 main:574] : INFO : Epoch 143 | loss: 0.0311612 | val_loss: 0.0311723 | Time: 121445 ms
[2022-04-03 06:26:23 main:574] : INFO : Epoch 144 | loss: 0.0311614 | val_loss: 0.0311705 | Time: 3037.01 ms
[2022-04-03 06:26:28 main:574] : INFO : Epoch 145 | loss: 0.0311616 | val_loss: 0.0311743 | Time: 4326.04 ms
[2022-04-03 06:27:05 main:574] : INFO : Epoch 146 | loss: 0.0311611 | val_loss: 0.0311715 | Time: 35453.7 ms
[2022-04-03 06:27:08 main:574] : INFO : Epoch 147 | loss: 0.0311607 | val_loss: 0.0311735 | Time: 3075.52 ms
[2022-04-03 06:27:57 main:574] : INFO : Epoch 148 | loss: 0.031161 | val_loss: 0.031175 | Time: 48837.8 ms
[2022-04-03 06:30:18 main:574] : INFO : Epoch 149 | loss: 0.0311632 | val_loss: 0.0311727 | Time: 136576 ms
[2022-04-03 06:32:12 main:574] : INFO : Epoch 150 | loss: 0.0311605 | val_loss: 0.031171 | Time: 109266 ms
[2022-04-03 06:32:25 main:574] : INFO : Epoch 151 | loss: 0.031158 | val_loss: 0.0311694 | Time: 12328.4 ms
[2022-04-03 06:33:09 main:574] : INFO : Epoch 152 | loss: 0.0311591 | val_loss: 0.0311699 | Time: 43159.6 ms
[2022-04-03 06:34:12 main:574] : INFO : Epoch 153 | loss: 0.0311603 | val_loss: 0.0311669 | Time: 62555.6 ms
[2022-04-03 06:34:16 main:574] : INFO : Epoch 154 | loss: 0.0311585 | val_loss: 0.0311667 | Time: 3857.51 ms
[2022-04-03 06:36:05 main:574] : INFO : Epoch 155 | loss: 0.031157 | val_loss: 0.031167 | Time: 107956 ms
[2022-04-03 06:37:48 main:574] : INFO : Epoch 156 | loss: 0.0311547 | val_loss: 0.0311675 | Time: 102560 ms
[2022-04-03 06:39:07 main:574] : INFO : Epoch 157 | loss: 0.0311541 | val_loss: 0.0311684 | Time: 79500.2 ms
[2022-04-03 06:39:11 main:574] : INFO : Epoch 158 | loss: 0.0311542 | val_loss: 0.031171 | Time: 4044.02 ms
[2022-04-03 06:39:33 main:574] : INFO : Epoch 159 | loss: 0.0311565 | val_loss: 0.0311668 | Time: 21288.3 ms
[2022-04-03 06:39:37 main:574] : INFO : Epoch 160 | loss: 0.0311533 | val_loss: 0.0311665 | Time: 3803.57 ms
[2022-04-03 06:40:23 main:574] : INFO : Epoch 161 | loss: 0.031152 | val_loss: 0.0311677 | Time: 44875.2 ms
[2022-04-03 06:43:26 main:574] : INFO : Epoch 162 | loss: 0.0311535 | val_loss: 0.0311689 | Time: 178142 ms
[2022-04-03 06:45:46 main:574] : INFO : Epoch 163 | loss: 0.0311532 | val_loss: 0.0311703 | Time: 135289 ms
[2022-04-03 06:47:41 main:574] : INFO : Epoch 164 | loss: 0.0311529 | val_loss: 0.0311661 | Time: 110297 ms
[2022-04-03 06:50:35 main:574] : INFO : Epoch 165 | loss: 0.0311517 | val_loss: 0.0311683 | Time: 173830 ms
[2022-04-03 06:51:02 main:574] : INFO : Epoch 166 | loss: 0.0311524 | val_loss: 0.0311745 | Time: 21401.1 ms
[2022-04-03 06:51:08 main:574] : INFO : Epoch 167 | loss: 0.031154 | val_loss: 0.0311749 | Time: 5157.04 ms
[2022-04-03 06:52:49 main:574] : INFO : Epoch 168 | loss: 0.0311504 | val_loss: 0.0311712 | Time: 99875.8 ms
[2022-04-03 06:52:53 main:574] : INFO : Epoch 169 | loss: 0.0311515 | val_loss: 0.0311696 | Time: 3720.3 ms
[2022-04-03 06:52:57 main:574] : INFO : Epoch 170 | loss: 0.0311518 | val_loss: 0.0311705 | Time: 4021.47 ms
[2022-04-03 06:53:26 main:574] : INFO : Epoch 171 | loss: 0.0311514 | val_loss: 0.0311691 | Time: 28211 ms
[2022-04-03 06:53:31 main:574] : INFO : Epoch 172 | loss: 0.0311512 | val_loss: 0.031168 | Time: 5105.31 ms
[2022-04-03 06:56:42 main:574] : INFO : Epoch 173 | loss: 0.0311523 | val_loss: 0.0311683 | Time: 188806 ms
[2022-04-03 06:59:15 main:574] : INFO : Epoch 174 | loss: 0.0311498 | val_loss: 0.0311665 | Time: 153209 ms
[2022-04-03 07:00:38 main:574] : INFO : Epoch 175 | loss: 0.0311515 | val_loss: 0.0311692 | Time: 74655.3 ms
[2022-04-03 07:02:51 main:574] : INFO : Epoch 176 | loss: 0.03115 | val_loss: 0.0311665 | Time: 133315 ms
[2022-04-03 07:05:36 main:574] : INFO : Epoch 177 | loss: 0.0311501 | val_loss: 0.0311702 | Time: 154402 ms
[2022-04-03 07:07:29 main:574] : INFO : Epoch 178 | loss: 0.0311526 | val_loss: 0.0311718 | Time: 112807 ms
[2022-04-03 07:09:03 main:574] : INFO : Epoch 179 | loss: 0.0311542 | val_loss: 0.0311699 | Time: 79536.9 ms
[2022-04-03 07:11:32 main:574] : INFO : Epoch 180 | loss: 0.0311538 | val_loss: 0.0311688 | Time: 143717 ms
[2022-04-03 07:13:45 main:574] : INFO : Epoch 181 | loss: 0.0311507 | val_loss: 0.0311673 | Time: 128271 ms
[2022-04-03 07:16:17 main:574] : INFO : Epoch 182 | loss: 0.0311483 | val_loss: 0.0311676 | Time: 147277 ms
[2022-04-03 07:18:51 main:574] : INFO : Epoch 183 | loss: 0.0311466 | val_loss: 0.0311676 | Time: 149628 ms
[2022-04-03 07:21:00 main:574] : INFO : Epoch 184 | loss: 0.0311479 | val_loss: 0.0311718 | Time: 128551 ms
[2022-04-03 07:23:21 main:574] : INFO : Epoch 185 | loss: 0.0311466 | val_loss: 0.0311682 | Time: 141107 ms
[2022-04-03 07:23:25 main:574] : INFO : Epoch 186 | loss: 0.0311499 | val_loss: 0.031167 | Time: 4388.31 ms
[2022-04-03 07:25:17 main:574] : INFO : Epoch 187 | loss: 0.031152 | val_loss: 0.0311677 | Time: 111630 ms
[2022-04-03 07:27:58 main:574] : INFO : Epoch 188 | loss: 0.0311516 | val_loss: 0.0311658 | Time: 161008 ms
[2022-04-03 07:30:13 main:574] : INFO : Epoch 189 | loss: 0.0311516 | val_loss: 0.0311669 | Time: 129432 ms
[2022-04-03 07:32:48 main:574] : INFO : Epoch 190 | loss: 0.0311537 | val_loss: 0.0311719 | Time: 154971 ms
[2022-04-03 07:34:49 main:574] : INFO : Epoch 191 | loss: 0.0311471 | val_loss: 0.0311676 | Time: 120981 ms
[2022-04-03 07:37:21 main:574] : INFO : Epoch 192 | loss: 0.0311475 | val_loss: 0.0311665 | Time: 144576 ms
[2022-04-03 07:39:20 main:574] : INFO : Epoch 193 | loss: 0.0311446 | val_loss: 0.0311687 | Time: 114652 ms
[2022-04-03 07:41:37 main:574] : INFO : Epoch 194 | loss: 0.0311451 | val_loss: 0.0311653 | Time: 131831 ms
[2022-04-03 07:44:07 main:574] : INFO : Epoch 195 | loss: 0.0311466 | val_loss: 0.0311641 | Time: 144854 ms
[2022-04-03 07:46:04 main:574] : INFO : Epoch 196 | loss: 0.0311465 | val_loss: 0.031166 | Time: 117553 ms
[2022-04-03 07:48:31 main:574] : INFO : Epoch 197 | loss: 0.0311454 | val_loss: 0.0311649 | Time: 147268 ms
[2022-04-03 07:50:53 main:574] : INFO : Epoch 198 | loss: 0.0311435 | val_loss: 0.0311692 | Time: 141870 ms
[2022-04-03 07:53:23 main:574] : INFO : Epoch 199 | loss: 0.0311429 | val_loss: 0.0311669 | Time: 144882 ms
[2022-04-03 07:56:11 main:574] : INFO : Epoch 200 | loss: 0.0311457 | val_loss: 0.0311703 | Time: 167432 ms
[2022-04-03 07:58:44 main:574] : INFO : Epoch 201 | loss: 0.0311434 | val_loss: 0.0311682 | Time: 153163 ms
[2022-04-03 07:59:38 main:574] : INFO : Epoch 202 | loss: 0.0311447 | val_loss: 0.0311656 | Time: 54073.2 ms
[2022-04-03 07:59:42 main:574] : INFO : Epoch 203 | loss: 0.0311438 | val_loss: 0.0311693 | Time: 4056.16 ms
[2022-04-03 08:00:02 main:574] : INFO : Epoch 204 | loss: 0.0311526 | val_loss: 0.031172 | Time: 20143.4 ms
[2022-04-03 08:01:43 main:574] : INFO : Epoch 205 | loss: 0.0311702 | val_loss: 0.0311729 | Time: 100298 ms
[2022-04-03 08:03:45 main:574] : INFO : Epoch 206 | loss: 0.0311785 | val_loss: 0.0311779 | Time: 121699 ms
[2022-04-03 08:05:19 main:574] : INFO : Epoch 207 | loss: 0.0311787 | val_loss: 0.0311763 | Time: 89096.9 ms
[2022-04-03 08:07:11 main:574] : INFO : Epoch 208 | loss: 0.0311746 | val_loss: 0.0311707 | Time: 102136 ms
[2022-04-03 08:07:45 main:574] : INFO : Epoch 209 | loss: 0.0311712 | val_loss: 0.0311708 | Time: 29606.6 ms
[2022-04-03 08:10:27 main:574] : INFO : Epoch 210 | loss: 0.0311698 | val_loss: 0.0311692 | Time: 162001 ms
[2022-04-03 08:12:51 main:574] : INFO : Epoch 211 | loss: 0.0311687 | val_loss: 0.0311681 | Time: 138941 ms
[2022-04-03 08:14:53 main:574] : INFO : Epoch 212 | loss: 0.0311673 | val_loss: 0.0311705 | Time: 122297 ms
[2022-04-03 08:17:22 main:574] : INFO : Epoch 213 | loss: 0.0311664 | val_loss: 0.0311688 | Time: 149149 ms
[2022-04-03 08:19:16 main:574] : INFO : Epoch 214 | loss: 0.0311646 | val_loss: 0.0311676 | Time: 108331 ms
[2022-04-03 08:19:20 main:574] : INFO : Epoch 215 | loss: 0.0311633 | val_loss: 0.0311649 | Time: 3752.53 ms
[2022-04-03 08:19:24 main:574] : INFO : Epoch 216 | loss: 0.0311624 | val_loss: 0.0311685 | Time: 4733.2 ms
[2022-04-03 08:22:37 main:574] : INFO : Epoch 217 | loss: 0.031162 | val_loss: 0.0311644 | Time: 190809 ms
[2022-04-03 08:25:34 main:574] : INFO : Epoch 218 | loss: 0.0311588 | val_loss: 0.0311629 | Time: 172288 ms
[2022-04-03 08:28:35 main:574] : INFO : Epoch 219 | loss: 0.0311586 | val_loss: 0.0311654 | Time: 161510 ms
[2022-04-03 08:31:25 main:574] : INFO : Epoch 220 | loss: 0.0311617 | val_loss: 0.031165 | Time: 153185 ms
[2022-04-03 08:34:05 main:574] : INFO : Epoch 221 | loss: 0.0311577 | val_loss: 0.0311634 | Time: 160806 ms
[2022-04-03 08:35:43 main:574] : INFO : Epoch 222 | loss: 0.0311565 | val_loss: 0.0311644 | Time: 87020.5 ms
[2022-04-03 08:35:47 main:574] : INFO : Epoch 223 | loss: 0.0311564 | val_loss: 0.0311626 | Time: 4549.99 ms
[2022-04-03 08:36:57 main:574] : INFO : Epoch 224 | loss: 0.0311545 | val_loss: 0.0311616 | Time: 69899.7 ms
[2022-04-03 08:37:01 main:574] : INFO : Epoch 225 | loss: 0.0311565 | val_loss: 0.0311652 | Time: 4024.06 ms
[2022-04-03 08:37:51 main:574] : INFO : Epoch 226 | loss: 0.0311562 | val_loss: 0.0311631 | Time: 49153 ms
[2022-04-03 08:39:26 main:574] : INFO : Epoch 227 | loss: 0.0311558 | val_loss: 0.0311619 | Time: 95449.2 ms
[2022-04-03 08:41:20 main:574] : INFO : Epoch 228 | loss: 0.0311694 | val_loss: 0.0311699 | Time: 114142 ms
[2022-04-03 08:42:03 main:574] : INFO : Epoch 229 | loss: 0.0311637 | val_loss: 0.0311641 | Time: 33415.3 ms
[2022-04-03 08:42:08 main:574] : INFO : Epoch 230 | loss: 0.0311604 | val_loss: 0.0311674 | Time: 4513.63 ms
[2022-04-03 08:43:44 main:574] : INFO : Epoch 231 | loss: 0.0311602 | val_loss: 0.0311636 | Time: 95959.1 ms
[2022-04-03 08:43:57 main:574] : INFO : Epoch 232 | loss: 0.0311583 | val_loss: 0.0311626 | Time: 8234.95 ms
[2022-04-03 08:44:02 main:574] : INFO : Epoch 233 | loss: 0.0311558 | val_loss: 0.0311656 | Time: 4968.14 ms
[2022-04-03 08:46:09 main:574] : INFO : Epoch 234 | loss: 0.0311552 | val_loss: 0.0311639 | Time: 125710 ms
[2022-04-03 08:48:19 main:574] : INFO : Epoch 235 | loss: 0.0311536 | val_loss: 0.0311646 | Time: 124347 ms
[2022-04-03 08:48:24 main:574] : INFO : Epoch 236 | loss: 0.0311535 | val_loss: 0.0311631 | Time: 4706.96 ms
[2022-04-03 08:48:31 main:574] : INFO : Epoch 237 | loss: 0.0311518 | val_loss: 0.0311642 | Time: 6980.23 ms
[2022-04-03 08:48:35 main:574] : INFO : Epoch 238 | loss: 0.031151 | val_loss: 0.0311668 | Time: 3751.37 ms
[2022-04-03 08:48:39 main:574] : INFO : Epoch 239 | loss: 0.0311505 | val_loss: 0.0311639 | Time: 4450.61 ms
[2022-04-03 08:50:12 main:574] : INFO : Epoch 240 | loss: 0.0311499 | val_loss: 0.0311645 | Time: 92696.1 ms
[2022-04-03 08:52:48 main:574] : INFO : Epoch 241 | loss: 0.0311524 | val_loss: 0.0311675 | Time: 155559 ms
[2022-04-03 08:55:20 main:574] : INFO : Epoch 242 | loss: 0.0311627 | val_loss: 0.0311654 | Time: 151988 ms
[2022-04-03 08:57:54 main:574] : INFO : Epoch 243 | loss: 0.031166 | val_loss: 0.0311653 | Time: 148453 ms
[2022-04-03 09:00:28 main:574] : INFO : Epoch 244 | loss: 0.0311603 | val_loss: 0.0311653 | Time: 153704 ms
[2022-04-03 09:00:42 main:574] : INFO : Epoch 245 | loss: 0.0311583 | val_loss: 0.0311738 | Time: 14154.8 ms
[2022-04-03 09:02:16 main:574] : INFO : Epoch 246 | loss: 0.031157 | val_loss: 0.0311652 | Time: 94047.7 ms
[2022-04-03 09:02:20 main:574] : INFO : Epoch 247 | loss: 0.0311571 | val_loss: 0.0311621 | Time: 3776.54 ms
[2022-04-03 09:02:55 main:574] : INFO : Epoch 248 | loss: 0.0311534 | val_loss: 0.0311614 | Time: 34170.5 ms
[2022-04-03 09:03:00 main:574] : INFO : Epoch 249 | loss: 0.0311521 | val_loss: 0.0311633 | Time: 4899.02 ms
[2022-04-03 09:03:59 main:574] : INFO : Epoch 250 | loss: 0.0311513 | val_loss: 0.031163 | Time: 59171.9 ms
[2022-04-03 09:06:21 main:574] : INFO : Epoch 251 | loss: 0.0311502 | val_loss: 0.0311675 | Time: 136396 ms
[2022-04-03 09:07:48 main:574] : INFO : Epoch 252 | loss: 0.0311505 | val_loss: 0.0311604 | Time: 82057.8 ms
[2022-04-03 09:10:46 main:574] : INFO : Epoch 253 | loss: 0.03115 | val_loss: 0.0311604 | Time: 177997 ms
[2022-04-03 09:13:03 main:574] : INFO : Epoch 254 | loss: 0.0311508 | val_loss: 0.0311619 | Time: 136987 ms
[2022-04-03 09:15:33 main:574] : INFO : Epoch 255 | loss: 0.03115 | val_loss: 0.031161 | Time: 144901 ms
[2022-04-03 09:17:31 main:574] : INFO : Epoch 256 | loss: 0.0311479 | val_loss: 0.031159 | Time: 112553 ms
[2022-04-03 09:19:34 main:574] : INFO : Epoch 257 | loss: 0.0311492 | val_loss: 0.0311608 | Time: 118257 ms
[2022-04-03 09:22:02 main:574] : INFO : Epoch 258 | loss: 0.0311503 | val_loss: 0.0311668 | Time: 142514 ms
[2022-04-03 09:24:29 main:574] : INFO : Epoch 259 | loss: 0.0311476 | val_loss: 0.0311665 | Time: 142531 ms
[2022-04-03 09:26:28 main:574] : INFO : Epoch 260 | loss: 0.0311463 | val_loss: 0.0311582 | Time: 114466 ms
[2022-04-03 09:29:10 main:574] : INFO : Epoch 261 | loss: 0.0311441 | val_loss: 0.0311592 | Time: 156784 ms
[2022-04-03 09:30:47 main:574] : INFO : Epoch 262 | loss: 0.0311439 | val_loss: 0.0311627 | Time: 88264.2 ms
[2022-04-03 09:31:58 main:574] : INFO : Epoch 263 | loss: 0.0311434 | val_loss: 0.0311613 | Time: 71322.8 ms
[2022-04-03 09:32:22 main:574] : INFO : Epoch 264 | loss: 0.0311443 | val_loss: 0.031161 | Time: 18442.2 ms
[2022-04-03 09:32:27 main:574] : INFO : Epoch 265 | loss: 0.0311429 | val_loss: 0.0311606 | Time: 4547.82 ms
[2022-04-03 09:32:31 main:574] : INFO : Epoch 266 | loss: 0.0311427 | val_loss: 0.0311612 | Time: 3883.38 ms
[2022-04-03 09:35:09 main:574] : INFO : Epoch 267 | loss: 0.031142 | val_loss: 0.0311602 | Time: 156807 ms
[2022-04-03 09:37:32 main:574] : INFO : Epoch 268 | loss: 0.0311429 | val_loss: 0.0311599 | Time: 138241 ms
[2022-04-03 09:39:18 main:574] : INFO : Epoch 269 | loss: 0.0311424 | val_loss: 0.0311619 | Time: 84956.7 ms
[2022-04-03 09:41:48 main:574] : INFO : Epoch 270 | loss: 0.0311427 | val_loss: 0.0311631 | Time: 143900 ms
[2022-04-03 09:43:59 main:574] : INFO : Epoch 271 | loss: 0.0311463 | val_loss: 0.0311696 | Time: 120632 ms
[2022-04-03 09:46:35 main:574] : INFO : Epoch 272 | loss: 0.0311459 | val_loss: 0.0311639 | Time: 150820 ms
[2022-04-03 09:48:39 main:574] : INFO : Epoch 273 | loss: 0.0311439 | val_loss: 0.0311651 | Time: 123866 ms
[2022-04-03 09:51:02 main:574] : INFO : Epoch 274 | loss: 0.0311434 | val_loss: 0.0311604 | Time: 137737 ms
[2022-04-03 09:53:41 main:574] : INFO : Epoch 275 | loss: 0.0311385 | val_loss: 0.0311607 | Time: 159123 ms
[2022-04-03 09:55:36 main:574] : INFO : Epoch 276 | loss: 0.031139 | val_loss: 0.0311608 | Time: 114787 ms
[2022-04-03 09:58:20 main:574] : INFO : Epoch 277 | loss: 0.031137 | val_loss: 0.0311625 | Time: 156722 ms
[2022-04-03 10:00:42 main:574] : INFO : Epoch 278 | loss: 0.0311366 | val_loss: 0.0311636 | Time: 141855 ms
[2022-04-03 10:02:31 main:574] : INFO : Epoch 279 | loss: 0.0311361 | val_loss: 0.0311598 | Time: 109333 ms
[2022-04-03 10:04:52 main:574] : INFO : Epoch 280 | loss: 0.0311357 | val_loss: 0.0311603 | Time: 134186 ms
[2022-04-03 10:07:14 main:574] : INFO : Epoch 281 | loss: 0.031136 | val_loss: 0.0311589 | Time: 142394 ms
[2022-04-03 10:09:24 main:574] : INFO : Epoch 282 | loss: 0.0311357 | val_loss: 0.0311635 | Time: 124707 ms
[2022-04-03 10:11:28 main:574] : INFO : Epoch 283 | loss: 0.0311355 | val_loss: 0.0311604 | Time: 119175 ms
[2022-04-03 10:14:02 main:574] : INFO : Epoch 284 | loss: 0.031136 | val_loss: 0.0311647 | Time: 148460 ms
[2022-04-03 10:16:41 main:574] : INFO : Epoch 285 | loss: 0.0311341 | val_loss: 0.0311629 | Time: 154704 ms
[2022-04-03 10:17:43 main:574] : INFO : Epoch 286 | loss: 0.0311351 | val_loss: 0.031161 | Time: 56237.9 ms
[2022-04-03 10:17:48 main:574] : INFO : Epoch 287 | loss: 0.0311379 | val_loss: 0.0311596 | Time: 4715.27 ms
[2022-04-03 10:19:31 main:574] : INFO : Epoch 288 | loss: 0.0311367 | val_loss: 0.0311623 | Time: 102704 ms
[2022-04-03 10:22:16 main:574] : INFO : Epoch 289 | loss: 0.0311413 | val_loss: 0.0311597 | Time: 165034 ms
[2022-04-03 10:25:04 main:574] : INFO : Epoch 290 | loss: 0.0311414 | val_loss: 0.0311608 | Time: 168628 ms
[2022-04-03 10:27:01 main:574] : INFO : Epoch 291 | loss: 0.0311374 | val_loss: 0.0311612 | Time: 112131 ms
[2022-04-03 10:28:38 main:574] : INFO : Epoch 292 | loss: 0.031135 | val_loss: 0.0311629 | Time: 91241.1 ms
[2022-04-03 10:28:43 main:574] : INFO : Epoch 293 | loss: 0.0311374 | val_loss: 0.0311601 | Time: 4484.05 ms
[2022-04-03 10:30:19 main:574] : INFO : Epoch 294 | loss: 0.0311366 | val_loss: 0.0311639 | Time: 96505.1 ms
[2022-04-03 10:31:24 main:574] : INFO : Epoch 295 | loss: 0.0311353 | val_loss: 0.0311601 | Time: 59986.2 ms
[2022-04-03 10:33:46 main:574] : INFO : Epoch 296 | loss: 0.0311343 | val_loss: 0.0311624 | Time: 130714 ms
[2022-04-03 10:36:22 main:574] : INFO : Epoch 297 | loss: 0.0311341 | val_loss: 0.0311636 | Time: 146085 ms
[2022-04-03 10:37:54 main:574] : INFO : Epoch 298 | loss: 0.0311317 | val_loss: 0.0311667 | Time: 87269.4 ms
[2022-04-03 10:40:30 main:574] : INFO : Epoch 299 | loss: 0.0311316 | val_loss: 0.0311626 | Time: 155983 ms
[2022-04-03 10:42:50 main:574] : INFO : Epoch 300 | loss: 0.031136 | val_loss: 0.0311628 | Time: 134218 ms
[2022-04-03 10:45:12 main:574] : INFO : Epoch 301 | loss: 0.0311414 | val_loss: 0.0311648 | Time: 131465 ms
[2022-04-03 10:45:16 main:574] : INFO : Epoch 302 | loss: 0.0311384 | val_loss: 0.0311617 | Time: 3768.25 ms
[2022-04-03 10:45:21 main:574] : INFO : Epoch 303 | loss: 0.0311366 | val_loss: 0.0311594 | Time: 5023.96 ms
[2022-04-03 10:47:17 main:574] : INFO : Epoch 304 | loss: 0.0311347 | val_loss: 0.0311632 | Time: 114657 ms
[2022-04-03 10:47:21 main:574] : INFO : Epoch 305 | loss: 0.0311315 | val_loss: 0.0311599 | Time: 3756.4 ms
[2022-04-03 10:47:25 main:574] : INFO : Epoch 306 | loss: 0.0311323 | val_loss: 0.0311624 | Time: 4381.86 ms
[2022-04-03 10:50:47 main:574] : INFO : Epoch 307 | loss: 0.0311319 | val_loss: 0.0311652 | Time: 200325 ms
[2022-04-03 10:51:19 main:574] : INFO : Epoch 308 | loss: 0.0311401 | val_loss: 0.0311655 | Time: 26912.9 ms
[2022-04-03 10:51:22 main:574] : INFO : Epoch 309 | loss: 0.0311372 | val_loss: 0.0311635 | Time: 3320.12 ms
[2022-04-03 10:51:30 main:574] : INFO : Epoch 310 | loss: 0.0311362 | val_loss: 0.0311593 | Time: 5395.32 ms
[2022-04-03 10:52:46 main:574] : INFO : Epoch 311 | loss: 0.0311325 | val_loss: 0.0311614 | Time: 67566.2 ms
[2022-04-03 10:52:49 main:574] : INFO : Epoch 312 | loss: 0.0311332 | val_loss: 0.0311634 | Time: 3099.46 ms
[2022-04-03 10:53:05 main:574] : INFO : Epoch 313 | loss: 0.0311327 | val_loss: 0.0311604 | Time: 15194.4 ms
[2022-04-03 10:55:50 main:574] : INFO : Epoch 314 | loss: 0.0311337 | val_loss: 0.0311669 | Time: 160339 ms
[2022-04-03 10:56:35 main:574] : INFO : Epoch 315 | loss: 0.0311426 | val_loss: 0.0311637 | Time: 45002.5 ms
[2022-04-03 10:56:38 main:574] : INFO : Epoch 316 | loss: 0.0311387 | val_loss: 0.0311647 | Time: 2974.83 ms
[2022-04-03 10:56:42 main:574] : INFO : Epoch 317 | loss: 0.0311392 | val_loss: 0.0311615 | Time: 3518.57 ms
[2022-04-03 10:57:06 main:574] : INFO : Epoch 318 | loss: 0.0311396 | val_loss: 0.0311697 | Time: 22302.8 ms
[2022-04-03 10:57:09 main:574] : INFO : Epoch 319 | loss: 0.0311388 | val_loss: 0.0311588 | Time: 3114.15 ms
[2022-04-03 10:57:56 main:574] : INFO : Epoch 320 | loss: 0.0311331 | val_loss: 0.0311628 | Time: 45630.9 ms
[2022-04-03 11:00:26 main:574] : INFO : Epoch 321 | loss: 0.0311318 | val_loss: 0.0311583 | Time: 143280 ms
[2022-04-03 11:00:46 main:574] : INFO : Epoch 322 | loss: 0.0311326 | val_loss: 0.0311612 | Time: 14466.7 ms
[2022-04-03 11:04:10 main:574] : INFO : Epoch 323 | loss: 0.0311305 | val_loss: 0.0311611 | Time: 204630 ms
[2022-04-03 11:06:07 main:574] : INFO : Epoch 324 | loss: 0.0311292 | val_loss: 0.0311626 | Time: 116445 ms
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFF273290D2
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 04/03/22 11:07:25
Install Directory : C:\Program Files\BOINC\
Data Directory : C:\ProgramData\BOINC
Project Symstore :
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\13;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 000000002c280000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000294d0000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 0000000028900000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 0000000027260000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000283d0000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000026c90000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1586) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1586
ModLoad: 0000000027740000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.1202 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1202
ModLoad: 0000000026f90000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 0000000026bf0000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 00000000270a0000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 0000000028850000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000293e0000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.19041.546
ModLoad: 0000000027770000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.1586) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000027870000 0000000000125000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000007af60000 0000000024b49000 C:\ProgramData\BOINC\slots\13\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000fa1b0000 0000000000058000 C:\ProgramData\BOINC\slots\13\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000f8da0000 0000000000045000 C:\ProgramData\BOINC\slots\13\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000bb810000 00000000034b2000 C:\ProgramData\BOINC\slots\13\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 00000000b8760000 00000000030a5000 C:\ProgramData\BOINC\slots\13\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 0000000014130000 0000000000010000 C:\ProgramData\BOINC\slots\13\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 000000005fbb0000 000000001b3a4000 C:\ProgramData\BOINC\slots\13\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 00000000aad10000 000000000abe7000 C:\ProgramData\BOINC\slots\13\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000007c40000 0000000000092000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.28.29334.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\6\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.28.29334.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.28.29334.0
ModLoad: 000000000cd10000 0000000000019000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.28.29334.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\6\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.28.29334.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.28.29334.0
ModLoad: 000000000d570000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.28.29334.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\6\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.28.29334.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.28.29334.0
ModLoad: 00000000ca510000 000000000020d000 C:\ProgramData\BOINC\slots\13\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 000000001a230000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.867 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.867
ModLoad: 00000000c5d00000 00000000002db000 C:\ProgramData\BOINC\slots\13\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000faf00000 0000000000040000 C:\ProgramData\BOINC\slots\13\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000005be50000 0000000003d5b000 C:\ProgramData\BOINC\slots\13\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000a8e40000 0000000001eca000 C:\ProgramData\BOINC\slots\13\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000d0e80000 000000000919f000 C:\ProgramData\BOINC\slots\13\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 0000000028710000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000024a40000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000289c0000 0000000000470000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000271a0000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1151
ModLoad: 0000000026cc0000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000269b0000 0000000000033000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000271f0000 0000000000068000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 0000000026d80000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000267d0000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000027a50000 0000000000744000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.964 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.964
ModLoad: 0000000024d20000 0000000000794000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000028e30000 0000000000354000 C:\WINDOWS\System32\combase.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.1320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1320
ModLoad: 0000000026650000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000027690000 00000000000ad000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000275a0000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000c5040000 00000000002cc000 C:\WINDOWS\system32\nvcuda.dll (30.0.14.7208) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r470\r470_00\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 30.0.14.7208
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.4.136 driver
Product Version : 30.0.14.7208
ModLoad: 00000000216e0000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000a7c70000 00000000011c5000 C:\WINDOWS\system32\DriverStore\FileRepository\nvhdc.inf_amd64_312d953c81546f4f\nvcuda64.dll (30.0.14.7208) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r470\r470_00\drivers\gpgpu\_out\wddm2_ms_shipping_wddm2_amd64_release\nvcuda.pdb
File Version : 30.0.14.7208
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.4.136 driver
Product Version : 30.0.14.7208
ModLoad: 000000001dc70000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.906 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.906
ModLoad: 0000000018c60000 0000000000148000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : drvstore.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000265c0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000024640000 000000000009e000 C:\WINDOWS\system32\uxtheme.dll (6.2.19041.1266) (-exported- Symbols Loaded)
Linked PDB Filename : UxTheme.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000005070000 0000000000719000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.14.7208) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r470\r470_00\drivers\nvapi\gpu\_out\wddm2_ms_shipping_wddm2_amd64_release\nvapi64.pdb
File Version : 30.0.14.7208
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 30.0.14.7208
ModLoad: 00000000285e0000 000000000012a000 C:\WINDOWS\System32\ole32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : ole32.pdb
File Version : 10.0.19041.1320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1320
ModLoad: 00000000140e0000 0000000000009000 C:\ProgramData\BOINC\slots\13\caffe2_nvrtc.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000b6db0000 0000000000fca000 C:\ProgramData\BOINC\slots\13\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6.14.11.9000
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.89 NVRTC Library
Product Version : 6.14.11.9000
ModLoad: 0000000026cf0000 0000000000082000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.1415 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1415
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 3945, Write: 3930, Other 10673
- I/O Transfers Counters -
Read: 7970773, Write: 8942953, Other 67592
- Paged Pool Usage -
QuotaPagedPoolUsage: 3536712, QuotaPeakPagedPoolUsage: 3536760
QuotaNonPagedPoolUsage: 59152, QuotaPeakNonPagedPoolUsage: 59560
- Virtual Memory Usage -
VirtualSize: 395661312, PeakVirtualSize: 1021173760
- Pagefile Usage -
PagefileUsage: 395661312, PeakPagefileUsage: 395661312
- Working Set Size -
WorkingSetSize: -2139807744, PeakWorkingSetSize: -2054004736, PageFaultCount: 898156
*** Dump of thread ID 7344 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 139260448.000000
- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFF273290D2
- Registers -
rax=0000000000000000 rbx=0000000000000001 rcx=000000002c538c40 rdx=000000008bafe9b0 rsi=0000000000000000 rdi=0000000000000000
r8=000000008bafe9b0 r9=000000002c538c30 r10=0000000000000fff r11=0000000000000ff0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000273290d2 rsp=000000008bafe988 rbp=0000000000000000
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
8bafe980 2c2b9100 00000001 8bafe9b0 8bafe9b0 2c538c30 KERNELBASE!DebugBreak+0x0
8bafedc0 2c2b9ce4 cd800000 8baff124 00000000 00000304 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
8baffd20 2c2ba084 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
8baffd50 28917034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
8baffd80 29522651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
8baffe00 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 15316 (state: Running): ***
- Information -
Status: Base Priority: Above Normal, Priority: Highest, , Kernel Time: 212812496.000000, User Time: 4895312384.000000, Wait Time: 139260448.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=000000003d4b02b8 rdx=0000000000000000 rsi=0000000000000000 rdi=000000003d4b02b8
r8=000000008b386210 r9=000000008b386540 r10=000000008b385f88 r11=000000008b3862b0 r12=0000000000000000 r13=0000000000000000
r14=000000008b385800 r15=000000003d4b0268 rip=0000000029570764 rsp=000000008b3857d8 rbp=000000008b385830
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
8b3857d0 29534021 00000000 b02dea63 b1a1b970 8b385810 ntdll!NtWaitForAlertByThreadId+0x0
8b385850 272ccfa9 3d4b02b0 3d4b02a8 3d4b0260 8b385470 ntdll!RtlSleepConditionVariableSRW+0x0
8b385890 07c7bf3d 00000000 8b385470 f8da2e0d fa1d2433 KERNELBASE!SleepConditionVariableSRW+0x0
8b3858d0 07c52798 00000000 b02e0231 fa1e9c50 00000000 MSVCP140!__crtSetThreadpoolWait+0x0
8b385900 07c52a4a 8f34a5a7 3d4b0260 4aece990 3d4b02a8 MSVCP140!std::_Winerror_message+0x0
8b385930 b1ef064b 3d4b0260 8b385a30 3d4b0260 ffffffff MSVCP140!_Cnd_wait+0x0
8b385970 b1ef25b1 b0f75070 4aece980 4aece980 00000000 torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
8b385c60 b1eef15d 8b385f40 8b385f40 8b385f40 b0f75070 torch_cpu!torch::autograd::Engine::thread_main+0x0
8b385ed0 b1eeeea0 37d70d70 b5416d10 fffffffe 00000000 torch_cpu!torch::autograd::Engine::execute_with_graph_task+0x0
8b386000 b1ee56f9 4eb00880 4eb00880 8b385ff0 8b3860f8 torch_cpu!torch::autograd::Engine::execute+0x0
8b386520 b1ee5086 00000000 8b386988 4eb00900 8b3865f0 torch_cpu!torch::autograd::Engine::make_anomaly_metadata+0x0
8b3865c0 b21e09be 3d1248a0 4eb00888 00000000 8b386560 torch_cpu!torch::autograd::backward+0x0
8b3866a0 b1c11cd0 b28d15a0 00000000 00000000 00000000 torch_cpu!torch::autograd::VariableType::allCUDATypes+0x0
8b3866d0 b08b0a06 00000000 00000000 00010001 00000001 torch_cpu!torch::autograd::GraphRoot::apply+0x0
8b386900 2c297166 8b3869d0 8b386a10 8b3869d0 8b386f70 torch_cpu!at::Tensor::backward+0x0
8b386e00 2c29b950 2c2cd95f 2c2cd95f 00000000 8eb87600 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0
8b39fba0 2c4dc6f8 b299fb30 00000000 00000000 b0f6ca00 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
8b39fbe0 28917034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
8b39fc10 29522651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
8b39fc90 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 19764 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 139260432.000000
- Registers -
rax=000000000000005b rbx=000000000000000e rcx=000000000000000e rdx=000000008bbff920 rsi=0000000000000000 rdi=000000000000000e
r8=000000008bbff5c8 r9=00000000b2bc2b20 r10=0000000000000000 r11=0000000000000246 r12=0000000000000064 r13=000000008bbff920
r14=000000008bbff620 r15=0000000000000000 rip=000000002956d8c4 rsp=000000008bbff5c8 rbp=00000000b2bc2b20
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
8bbff5c0 272acb20 00000000 8b515000 2963a4d0 8b515000 ntdll!ZwWaitForMultipleObjects+0x0
8bbff8b0 272aca1e b0f70520 004e0049 0000000e 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
8bbff8f0 a7e41224 b2bc58e0 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0
8bbffb30 a7ee7fcd 00000000 b2bc2b20 00000000 00000000 nvcuda64!+0x0
8bbffbe0 a7e40bf3 4766a12c 61bf2be8 b3180820 00000000 nvcuda64!cuProfilerStop+0x0
8bbffc10 a81758a4 b3180820 00000000 00000000 00000000 nvcuda64!+0x0
8bbffc40 28917034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
8bbffc70 29522651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
8bbffcf0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 10960 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 137257008.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002d4 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002d4
r8=000000008bcffdc8 r9=0000000000000000 r10=0000000000000000 r11=000000008bcffe28 r12=0000000000000000 r13=0000000000000000
r14=00000000000002d4 r15=0000000000000000 rip=000000002956cdf4 rsp=000000008bcffb28 rbp=00000000b2b983a0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
8bcffb20 27281a5e 00000000 29522630 0000027f 00000000 ntdll!ZwWaitForSingleObject+0x0
8bcffbc0 a806d50d b31803a0 00000000 00000000 000002d4 KERNELBASE!WaitForSingleObjectEx+0x0
8bcffe20 a7e40bf3 00000000 b31803a0 a7c70000 b2bafda0 nvcuda64!cuProfilerStop+0x0
8bcffe50 a81758a4 b31803a0 00000000 00000000 00000000 nvcuda64!+0x0
8bcffe80 28917034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
8bcffeb0 29522651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
8bcfff30 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 14684 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 139260416.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000b2e46f80 rdx=000000008bdffc28 rsi=000000008bdffb90 rdi=0000000000000000
r8=000000008bdffb68 r9=000000008bdffbc0 r10=0000000000000000 r11=0000000000000246 r12=000000008bdffc28 r13=0000000000000000
r14=00000000b2e46f80 r15=00000000b2e4a320 rip=0000000029570764 rsp=000000008bdffb68 rbp=000000008bdffbc0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
8bdffb60 29534295 00000102 a7f228c6 00000000 8bdffb90 ntdll!NtWaitForAlertByThreadId+0x0
8bdffbd0 272ccef9 b2e47b00 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0
8bdffc00 a7daf0ec b2e47b00 b2e47b00 b2e47b00 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0
8bdffc60 a7e40bf3 00000003 47264423 3fc895a4 00000000 nvcuda64!+0x0
8bdffc90 a81758a4 b3181210 00000000 00000000 00000000 nvcuda64!+0x0
8bdffcc0 28917034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
8bdffcf0 29522651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
8bdffd70 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 6504 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 150624992.000000, User Time: 3700624896.000000, Wait Time: 139260352.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=000000003220dbd8 rdx=0000000000000000 rsi=0000000000000000 rdi=000000003220dbd8
r8=00000000b1131440 r9=0000000000000001 r10=0000000000008000 r11=000000008befe0d0 r12=0000000000000000 r13=0000000000000000
r14=000000008beff950 r15=000000003220db88 rip=0000000029570764 rsp=000000008beff928 rbp=000000008beff980
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
8beff920 29534021 3d4b02a8 07c52f97 4aece990 4aece980 ntdll!NtWaitForAlertByThreadId+0x0
8beff9a0 272ccfa9 3220dbd0 3220dbc8 3220db80 00000000 ntdll!RtlSleepConditionVariableSRW+0x0
8beff9e0 07c7bf3d 4aece9b0 00000000 00000000 b1ef05b4 KERNELBASE!SleepConditionVariableSRW+0x0
8beffa20 07c52798 00000000 4aece9b0 00000000 00000000 MSVCP140!__crtSetThreadpoolWait+0x0
8beffa50 07c52a4a 8fe30777 00000000 8beffc60 3220dbc8 MSVCP140!std::_Winerror_message+0x0
8beffa80 b1ef064b 3220db80 8beffb80 3220db80 4aece990 MSVCP140!_Cnd_wait+0x0
8beffac0 b1ef25b1 524b8230 ffffffff 4aece990 ffffffff torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
8beffdb0 b1ef2471 b5416d10 8beffdf0 b5416d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0
8beffe00 b1ee9744 00080001 4f90b4e0 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0
8beffe30 270c1bb2 4f90b4e0 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0
8beffe60 28917034 00000000 00000000 00000000 00000000 ucrtbase!_configthreadlocale+0x0
8beffe90 29522651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
8befff10 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)