Task 14179911
| Name | ParityModified-1647044305-8001-3-0_0 |
| Workunit | 11241959 |
| Created | 1 Apr 2022, 6:23:20 UTC |
| Sent | 5 Apr 2022, 17:23:22 UTC |
| Report deadline | 13 Apr 2022, 17:23:22 UTC |
| Received | 6 Apr 2022, 7:12:53 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 197 (0x000000C5) EXIT_TIME_LIMIT_EXCEEDED |
| Computer ID | 4503 |
| Run time | 8 hours 13 min 25 sec |
| CPU time | 33 min 1 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 10,073.24 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 2.08 GB |
| Peak swap size | 4.40 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
exceeded elapsed time limit 29602.85 (4000000.00G/136.49G)</message>
<stderr_txt>
1785 | val_loss: 0.0311978 | Time: 1677.98 ms
[2022-04-05 16:59:52 main:574] : INFO : Epoch 1055 | loss: 0.0311799 | val_loss: 0.0311963 | Time: 1659.31 ms
[2022-04-05 16:59:53 main:574] : INFO : Epoch 1056 | loss: 0.0311873 | val_loss: 0.0311961 | Time: 1764.76 ms
[2022-04-05 16:59:55 main:574] : INFO : Epoch 1057 | loss: 0.0311834 | val_loss: 0.0311965 | Time: 1709.09 ms
[2022-04-05 16:59:57 main:574] : INFO : Epoch 1058 | loss: 0.0311799 | val_loss: 0.0311943 | Time: 1715.2 ms
[2022-04-05 16:59:58 main:574] : INFO : Epoch 1059 | loss: 0.0311796 | val_loss: 0.0311943 | Time: 1737.96 ms
[2022-04-05 17:00:00 main:574] : INFO : Epoch 1060 | loss: 0.0311797 | val_loss: 0.0311977 | Time: 1760.48 ms
[2022-04-05 17:00:02 main:574] : INFO : Epoch 1061 | loss: 0.0311791 | val_loss: 0.0311967 | Time: 1739.21 ms
[2022-04-05 17:00:04 main:574] : INFO : Epoch 1062 | loss: 0.0311787 | val_loss: 0.0311955 | Time: 1763.97 ms
[2022-04-05 17:00:05 main:574] : INFO : Epoch 1063 | loss: 0.0311797 | val_loss: 0.0312037 | Time: 1637.65 ms
[2022-04-05 17:00:07 main:574] : INFO : Epoch 1064 | loss: 0.0311792 | val_loss: 0.0311963 | Time: 1689.35 ms
[2022-04-05 17:00:09 main:574] : INFO : Epoch 1065 | loss: 0.0311782 | val_loss: 0.0311955 | Time: 1998.4 ms
[2022-04-05 17:00:11 main:574] : INFO : Epoch 1066 | loss: 0.0311787 | val_loss: 0.0311971 | Time: 2246.56 ms
[2022-04-05 17:00:14 main:574] : INFO : Epoch 1067 | loss: 0.0311797 | val_loss: 0.0311997 | Time: 2588.27 ms
[2022-04-05 17:00:17 main:574] : INFO : Epoch 1068 | loss: 0.0311831 | val_loss: 0.0312033 | Time: 2959.41 ms
[2022-04-05 17:00:20 main:574] : INFO : Epoch 1069 | loss: 0.0311815 | val_loss: 0.031201 | Time: 2967.43 ms
[2022-04-05 17:00:23 main:574] : INFO : Epoch 1070 | loss: 0.0311811 | val_loss: 0.0312 | Time: 2938.86 ms
[2022-04-05 17:00:26 main:574] : INFO : Epoch 1071 | loss: 0.0311864 | val_loss: 0.0312072 | Time: 2878.69 ms
[2022-04-05 17:00:29 main:574] : INFO : Epoch 1072 | loss: 0.0312059 | val_loss: 0.0312105 | Time: 2900.94 ms
[2022-04-05 17:00:32 main:574] : INFO : Epoch 1073 | loss: 0.0312088 | val_loss: 0.0312117 | Time: 2988.42 ms
[2022-04-05 17:00:35 main:574] : INFO : Epoch 1074 | loss: 0.0312062 | val_loss: 0.0312081 | Time: 2974.74 ms
[2022-04-05 17:00:38 main:574] : INFO : Epoch 1075 | loss: 0.0312056 | val_loss: 0.0312162 | Time: 2939.69 ms
[2022-04-05 17:00:41 main:574] : INFO : Epoch 1076 | loss: 0.0312055 | val_loss: 0.0312051 | Time: 2966.06 ms
[2022-04-05 17:00:44 main:574] : INFO : Epoch 1077 | loss: 0.0312033 | val_loss: 0.0312061 | Time: 2952.6 ms
[2022-04-05 17:00:48 main:574] : INFO : Epoch 1078 | loss: 0.0312009 | val_loss: 0.0312036 | Time: 4117.7 ms
[2022-04-05 17:02:04 main:574] : INFO : Epoch 1079 | loss: 0.0312003 | val_loss: 0.0312041 | Time: 76223.4 ms
[2022-04-05 17:02:38 main:574] : INFO : Epoch 1080 | loss: 0.031199 | val_loss: 0.0312039 | Time: 27955.9 ms
[2022-04-05 17:06:00 main:574] : INFO : Epoch 1081 | loss: 0.0311985 | val_loss: 0.0312024 | Time: 196574 ms
[2022-04-05 17:09:43 main:574] : INFO : Epoch 1082 | loss: 0.031197 | val_loss: 0.0312019 | Time: 223402 ms
[2022-04-05 17:10:51 main:574] : INFO : Epoch 1083 | loss: 0.0311967 | val_loss: 0.0312029 | Time: 67039.1 ms
[2022-04-05 17:14:13 main:574] : INFO : Epoch 1084 | loss: 0.0311994 | val_loss: 0.0312059 | Time: 196946 ms
[2022-04-05 17:17:27 main:574] : INFO : Epoch 1085 | loss: 0.0311964 | val_loss: 0.0312024 | Time: 188794 ms
[2022-04-05 17:20:26 main:574] : INFO : Epoch 1086 | loss: 0.0311948 | val_loss: 0.0312014 | Time: 179337 ms
[2022-04-05 17:22:46 main:574] : INFO : Epoch 1087 | loss: 0.0311952 | val_loss: 0.0312071 | Time: 134464 ms
[2022-04-05 17:23:58 main:574] : INFO : Epoch 1088 | loss: 0.0311994 | val_loss: 0.0312063 | Time: 72747.9 ms
[2022-04-05 17:27:40 main:574] : INFO : Epoch 1089 | loss: 0.031198 | val_loss: 0.0312085 | Time: 217335 ms
[2022-04-05 17:30:41 main:574] : INFO : Epoch 1090 | loss: 0.0311959 | val_loss: 0.0312047 | Time: 171004 ms
[2022-04-05 17:32:35 main:574] : INFO : Epoch 1091 | loss: 0.0311933 | val_loss: 0.0312032 | Time: 114185 ms
[2022-04-05 17:34:50 main:574] : INFO : Epoch 1092 | loss: 0.0311942 | val_loss: 0.0312032 | Time: 135151 ms
[2022-04-05 17:35:58 main:574] : INFO : Epoch 1093 | loss: 0.0311938 | val_loss: 0.0312052 | Time: 68064.8 ms
[2022-04-05 17:38:56 main:574] : INFO : Epoch 1094 | loss: 0.0311941 | val_loss: 0.0312128 | Time: 177732 ms
[2022-04-05 17:39:42 main:574] : INFO : Epoch 1095 | loss: 0.0311938 | val_loss: 0.0312038 | Time: 41427.1 ms
[2022-04-05 17:42:55 main:574] : INFO : Epoch 1096 | loss: 0.031191 | val_loss: 0.0312038 | Time: 187667 ms
[2022-04-05 17:46:34 main:574] : INFO : Epoch 1097 | loss: 0.0311912 | val_loss: 0.0312017 | Time: 214930 ms
[2022-04-05 17:49:56 main:574] : INFO : Epoch 1098 | loss: 0.0311912 | val_loss: 0.0312021 | Time: 201885 ms
[2022-04-05 17:52:43 main:574] : INFO : Epoch 1099 | loss: 0.0311905 | val_loss: 0.0312017 | Time: 161981 ms
[2022-04-05 17:55:08 main:574] : INFO : Epoch 1100 | loss: 0.0311901 | val_loss: 0.031203 | Time: 145071 ms
[2022-04-05 17:58:17 main:574] : INFO : Epoch 1101 | loss: 0.0311911 | val_loss: 0.0312012 | Time: 184079 ms
[2022-04-05 18:00:56 main:574] : INFO : Epoch 1102 | loss: 0.0311915 | val_loss: 0.0312023 | Time: 154328 ms
[2022-04-05 18:02:43 main:574] : INFO : Epoch 1103 | loss: 0.0311924 | val_loss: 0.0312039 | Time: 101743 ms
[2022-04-05 18:05:56 main:574] : INFO : Epoch 1104 | loss: 0.0311936 | val_loss: 0.0312021 | Time: 192470 ms
[2022-04-05 18:09:17 main:574] : INFO : Epoch 1105 | loss: 0.0311927 | val_loss: 0.0312055 | Time: 195945 ms
[2022-04-05 18:11:25 main:574] : INFO : Epoch 1106 | loss: 0.0311945 | val_loss: 0.0312042 | Time: 128225 ms
[2022-04-05 18:14:35 main:574] : INFO : Epoch 1107 | loss: 0.0311977 | val_loss: 0.0312086 | Time: 185260 ms
[2022-04-05 18:17:57 main:574] : INFO : Epoch 1108 | loss: 0.0311929 | val_loss: 0.0312035 | Time: 201866 ms
[2022-04-05 18:20:49 main:574] : INFO : Epoch 1109 | loss: 0.0311908 | val_loss: 0.0312051 | Time: 166741 ms
[2022-04-05 18:22:40 main:574] : INFO : Epoch 1110 | loss: 0.0311919 | val_loss: 0.0312037 | Time: 111692 ms
[2022-04-05 18:25:33 main:574] : INFO : Epoch 1111 | loss: 0.031191 | val_loss: 0.0312016 | Time: 172242 ms
[2022-04-05 18:29:08 main:574] : INFO : Epoch 1112 | loss: 0.0311902 | val_loss: 0.0312032 | Time: 210171 ms
[2022-04-05 18:32:09 main:574] : INFO : Epoch 1113 | loss: 0.0311893 | val_loss: 0.0312019 | Time: 181130 ms
[2022-04-05 18:34:02 main:574] : INFO : Epoch 1114 | loss: 0.031192 | val_loss: 0.0312039 | Time: 107484 ms
[2022-04-05 18:36:55 main:574] : INFO : Epoch 1115 | loss: 0.0311889 | val_loss: 0.0312012 | Time: 166855 ms
[2022-04-05 18:39:46 main:574] : INFO : Epoch 1116 | loss: 0.0311913 | val_loss: 0.0312014 | Time: 166775 ms
[2022-04-05 18:42:36 main:574] : INFO : Epoch 1117 | loss: 0.0311896 | val_loss: 0.0312017 | Time: 169297 ms
[2022-04-05 18:44:17 main:574] : INFO : Epoch 1118 | loss: 0.0311903 | val_loss: 0.0312065 | Time: 96184.1 ms
[2022-04-05 18:47:22 main:574] : INFO : Epoch 1119 | loss: 0.0311908 | val_loss: 0.0312045 | Time: 185232 ms
[2022-04-05 18:50:27 main:574] : INFO : Epoch 1120 | loss: 0.0311919 | val_loss: 0.031203 | Time: 185238 ms
[2022-04-05 18:52:08 main:574] : INFO : Epoch 1121 | loss: 0.0311926 | val_loss: 0.0312173 | Time: 92293.5 ms
[2022-04-05 18:52:59 main:574] : INFO : Epoch 1122 | loss: 0.0311905 | val_loss: 0.0312049 | Time: 45718.4 ms
[2022-04-05 18:56:14 main:574] : INFO : Epoch 1123 | loss: 0.031189 | val_loss: 0.0312036 | Time: 194722 ms
[2022-04-05 18:59:24 main:574] : INFO : Epoch 1124 | loss: 0.031187 | val_loss: 0.0312059 | Time: 189954 ms
[2022-04-05 19:02:37 main:574] : INFO : Epoch 1125 | loss: 0.0311893 | val_loss: 0.0312118 | Time: 193080 ms
[2022-04-05 19:05:25 main:574] : INFO : Epoch 1126 | loss: 0.0311893 | val_loss: 0.031201 | Time: 168243 ms
[2022-04-05 19:06:01 main:574] : INFO : Epoch 1127 | loss: 0.0311887 | val_loss: 0.0312028 | Time: 28034.3 ms
[2022-04-05 19:09:15 main:574] : INFO : Epoch 1128 | loss: 0.0311883 | val_loss: 0.0312003 | Time: 188818 ms
[2022-04-05 19:11:29 main:574] : INFO : Epoch 1129 | loss: 0.031189 | val_loss: 0.0312033 | Time: 134193 ms
[2022-04-05 19:14:58 main:574] : INFO : Epoch 1130 | loss: 0.0311889 | val_loss: 0.0312005 | Time: 203052 ms
[2022-04-05 19:18:21 main:574] : INFO : Epoch 1131 | loss: 0.0311891 | val_loss: 0.0312042 | Time: 203075 ms
[2022-04-05 19:20:54 main:574] : INFO : Epoch 1132 | loss: 0.0311892 | val_loss: 0.0312025 | Time: 152514 ms
[2022-04-05 19:23:42 main:574] : INFO : Epoch 1133 | loss: 0.0311881 | val_loss: 0.0312014 | Time: 162183 ms
[2022-04-05 19:26:49 main:574] : INFO : Epoch 1134 | loss: 0.0311915 | val_loss: 0.0312067 | Time: 181678 ms
[2022-04-05 19:30:04 main:574] : INFO : Epoch 1135 | loss: 0.0311936 | val_loss: 0.0312099 | Time: 194750 ms
[2022-04-05 19:32:45 main:574] : INFO : Epoch 1136 | loss: 0.0311905 | val_loss: 0.0312036 | Time: 160763 ms
[2022-04-05 19:34:11 main:574] : INFO : Epoch 1137 | loss: 0.031188 | val_loss: 0.0312032 | Time: 86086.1 ms
[2022-04-05 19:34:17 main:574] : INFO : Epoch 1138 | loss: 0.0311885 | val_loss: 0.0311994 | Time: 6483.51 ms
[2022-04-05 19:34:23 main:574] : INFO : Epoch 1139 | loss: 0.0311886 | val_loss: 0.0312063 | Time: 5735.07 ms
[2022-04-05 19:35:39 main:574] : INFO : Epoch 1140 | loss: 0.0311897 | val_loss: 0.0312037 | Time: 73920.6 ms
[2022-04-05 19:35:46 main:574] : INFO : Epoch 1141 | loss: 0.0311914 | val_loss: 0.0311997 | Time: 6390.65 ms
[2022-04-05 19:36:01 main:574] : INFO : Epoch 1142 | loss: 0.0311875 | val_loss: 0.0311993 | Time: 14843.4 ms
[2022-04-05 19:36:07 main:574] : INFO : Epoch 1143 | loss: 0.0311865 | val_loss: 0.0312 | Time: 6310.32 ms
[2022-04-05 19:37:19 main:574] : INFO : Epoch 1144 | loss: 0.031188 | val_loss: 0.0312051 | Time: 71767.1 ms
[2022-04-05 19:37:26 main:574] : INFO : Epoch 1145 | loss: 0.031189 | val_loss: 0.0311997 | Time: 5965.24 ms
[2022-04-05 19:37:32 main:574] : INFO : Epoch 1146 | loss: 0.0311895 | val_loss: 0.0311993 | Time: 6429.37 ms
[2022-04-05 19:38:06 main:574] : INFO : Epoch 1147 | loss: 0.0311909 | val_loss: 0.0312026 | Time: 33697.7 ms
[2022-04-05 19:38:11 main:574] : INFO : Epoch 1148 | loss: 0.0311941 | val_loss: 0.0311997 | Time: 5120.88 ms
[2022-04-05 19:38:17 main:574] : INFO : Epoch 1149 | loss: 0.0311946 | val_loss: 0.0312028 | Time: 5466.46 ms
[2022-04-05 19:40:22 main:574] : INFO : Epoch 1150 | loss: 0.0311972 | val_loss: 0.0311993 | Time: 123133 ms
[2022-04-05 19:40:30 main:574] : INFO : Epoch 1151 | loss: 0.0311944 | val_loss: 0.0312018 | Time: 7283.45 ms
[2022-04-05 19:44:02 main:574] : INFO : Epoch 1152 | loss: 0.0312008 | val_loss: 0.0312 | Time: 211481 ms
[2022-04-05 19:47:31 main:574] : INFO : Epoch 1153 | loss: 0.031196 | val_loss: 0.0311997 | Time: 203070 ms
[2022-04-05 19:48:30 main:574] : INFO : Epoch 1154 | loss: 0.0311935 | val_loss: 0.031197 | Time: 59599.3 ms
[2022-04-05 19:50:12 main:574] : INFO : Epoch 1155 | loss: nan | val_loss: nan | Time: 101824 ms
[2022-04-05 19:50:42 main:574] : INFO : Epoch 1156 | loss: nan | val_loss: nan | Time: 25538 ms
[2022-04-05 19:51:50 main:574] : INFO : Epoch 1157 | loss: nan | val_loss: nan | Time: 67609.6 ms
[2022-04-05 19:53:16 main:574] : INFO : Epoch 1158 | loss: nan | val_loss: nan | Time: 85913.4 ms
[2022-04-05 19:53:42 main:574] : INFO : Epoch 1159 | loss: nan | val_loss: nan | Time: 25853.6 ms
[2022-04-05 19:53:49 main:574] : INFO : Epoch 1160 | loss: nan | val_loss: nan | Time: 6652.16 ms
[2022-04-05 19:54:04 main:574] : INFO : Epoch 1161 | loss: nan | val_loss: nan | Time: 15068.2 ms
[2022-04-05 19:55:22 main:574] : INFO : Epoch 1162 | loss: nan | val_loss: nan | Time: 76943.6 ms
[2022-04-05 19:58:30 main:574] : INFO : Epoch 1163 | loss: nan | val_loss: nan | Time: 181708 ms
[2022-04-05 20:00:58 main:574] : INFO : Epoch 1164 | loss: nan | val_loss: nan | Time: 143697 ms
[2022-04-05 20:02:37 main:574] : INFO : Epoch 1165 | loss: nan | val_loss: nan | Time: 89068 ms
[2022-04-05 20:05:26 main:574] : INFO : Epoch 1166 | loss: nan | val_loss: nan | Time: 169801 ms
[2022-04-05 20:06:00 main:574] : INFO : Epoch 1167 | loss: nan | val_loss: nan | Time: 29005.1 ms
[2022-04-05 20:09:26 main:574] : INFO : Epoch 1168 | loss: nan | val_loss: nan | Time: 200716 ms
[2022-04-05 20:10:38 main:574] : INFO : Epoch 1169 | loss: nan | val_loss: nan | Time: 66510.3 ms
[2022-04-05 20:13:40 main:574] : INFO : Epoch 1170 | loss: nan | val_loss: nan | Time: 182859 ms
[2022-04-05 20:16:43 main:574] : INFO : Epoch 1171 | loss: nan | val_loss: nan | Time: 178096 ms
[2022-04-05 20:19:59 main:574] : INFO : Epoch 1172 | loss: nan | val_loss: nan | Time: 195919 ms
[2022-04-05 20:22:27 main:574] : INFO : Epoch 1173 | loss: nan | val_loss: nan | Time: 147267 ms
[2022-04-05 20:22:46 main:574] : INFO : Epoch 1174 | loss: nan | val_loss: nan | Time: 14579.3 ms
[2022-04-05 20:26:22 main:574] : INFO : Epoch 1175 | loss: nan | val_loss: nan | Time: 210192 ms
[2022-04-05 20:29:48 main:574] : INFO : Epoch 1176 | loss: nan | val_loss: nan | Time: 206596 ms
[2022-04-05 20:32:44 main:574] : INFO : Epoch 1177 | loss: nan | val_loss: nan | Time: 175348 ms
[2022-04-05 20:35:57 main:574] : INFO : Epoch 1178 | loss: nan | val_loss: nan | Time: 187823 ms
[2022-04-05 20:39:19 main:574] : INFO : Epoch 1179 | loss: nan | val_loss: nan | Time: 202295 ms
[2022-04-05 20:39:51 main:574] : INFO : Epoch 1180 | loss: nan | val_loss: nan | Time: 27182.6 ms
[2022-04-05 20:43:10 main:574] : INFO : Epoch 1181 | loss: nan | val_loss: nan | Time: 199034 ms
[2022-04-05 20:45:28 main:574] : INFO : Epoch 1182 | loss: nan | val_loss: nan | Time: 138087 ms
[2022-04-05 20:48:53 main:574] : INFO : Epoch 1183 | loss: nan | val_loss: nan | Time: 198321 ms
[2022-04-05 20:50:51 main:574] : INFO : Epoch 1184 | loss: nan | val_loss: nan | Time: 117451 ms
[2022-04-05 20:52:53 main:574] : INFO : Epoch 1185 | loss: nan | val_loss: nan | Time: 122143 ms
[2022-04-05 20:56:28 main:574] : INFO : Epoch 1186 | loss: nan | val_loss: nan | Time: 215175 ms
[2022-04-05 20:59:56 main:574] : INFO : Epoch 1187 | loss: nan | val_loss: nan | Time: 203084 ms
[2022-04-05 21:02:41 main:574] : INFO : Epoch 1188 | loss: nan | val_loss: nan | Time: 160552 ms
[2022-04-05 21:05:13 main:574] : INFO : Epoch 1189 | loss: nan | val_loss: nan | Time: 152345 ms
[2022-04-05 21:07:32 main:574] : INFO : Epoch 1190 | loss: nan | val_loss: nan | Time: 138300 ms
[2022-04-05 21:09:48 main:574] : INFO : Epoch 1191 | loss: nan | val_loss: nan | Time: 135916 ms
[2022-04-05 21:11:39 main:574] : INFO : Epoch 1192 | loss: nan | val_loss: nan | Time: 111155 ms
[2022-04-05 21:15:09 main:574] : INFO : Epoch 1193 | loss: nan | val_loss: nan | Time: 200092 ms
[2022-04-05 21:18:11 main:574] : INFO : Epoch 1194 | loss: nan | val_loss: nan | Time: 172686 ms
[2022-04-05 21:20:58 main:574] : INFO : Epoch 1195 | loss: nan | val_loss: nan | Time: 156605 ms
[2022-04-05 21:22:50 main:574] : INFO : Epoch 1196 | loss: nan | val_loss: nan | Time: 111865 ms
[2022-04-05 21:24:51 main:574] : INFO : Epoch 1197 | loss: nan | val_loss: nan | Time: 121598 ms
[2022-04-05 21:27:58 main:574] : INFO : Epoch 1198 | loss: nan | val_loss: nan | Time: 186427 ms
[2022-04-05 21:30:48 main:574] : INFO : Epoch 1199 | loss: nan | val_loss: nan | Time: 170566 ms
[2022-04-05 21:32:49 main:574] : INFO : Epoch 1200 | loss: nan | val_loss: nan | Time: 115439 ms
[2022-04-05 21:35:36 main:574] : INFO : Epoch 1201 | loss: nan | val_loss: nan | Time: 166583 ms
[2022-04-05 21:35:52 main:574] : INFO : Epoch 1202 | loss: nan | val_loss: nan | Time: 16718.6 ms
[2022-04-05 21:38:56 main:574] : INFO : Epoch 1203 | loss: nan | val_loss: nan | Time: 178161 ms
[2022-04-05 21:39:46 main:574] : INFO : Epoch 1204 | loss: nan | val_loss: nan | Time: 45151.3 ms
[2022-04-05 21:43:25 main:574] : INFO : Epoch 1205 | loss: nan | val_loss: nan | Time: 219049 ms
[2022-04-05 21:46:36 main:574] : INFO : Epoch 1206 | loss: nan | val_loss: nan | Time: 191189 ms
[2022-04-05 21:50:10 main:574] : INFO : Epoch 1207 | loss: nan | val_loss: nan | Time: 208991 ms
[2022-04-05 21:52:47 main:574] : INFO : Epoch 1208 | loss: nan | val_loss: nan | Time: 157360 ms
[2022-04-05 21:55:27 main:574] : INFO : Epoch 1209 | loss: nan | val_loss: nan | Time: 159707 ms
[2022-04-05 21:58:32 main:574] : INFO : Epoch 1210 | loss: nan | val_loss: nan | Time: 180479 ms
[2022-04-05 22:01:37 main:574] : INFO : Epoch 1211 | loss: nan | val_loss: nan | Time: 185253 ms
[2022-04-05 22:02:47 main:574] : INFO : Epoch 1212 | loss: nan | val_loss: nan | Time: 65121.5 ms
[2022-04-05 22:05:40 main:574] : INFO : Epoch 1213 | loss: nan | val_loss: nan | Time: 167865 ms
[2022-04-05 22:07:47 main:574] : INFO : Epoch 1214 | loss: nan | val_loss: nan | Time: 121125 ms
[2022-04-05 22:09:52 main:574] : INFO : Epoch 1215 | loss: nan | val_loss: nan | Time: 125456 ms
[2022-04-05 22:10:59 main:574] : INFO : Epoch 1216 | loss: nan | val_loss: nan | Time: 66806.3 ms
[2022-04-05 22:13:53 main:574] : INFO : Epoch 1217 | loss: nan | val_loss: nan | Time: 163172 ms
[2022-04-05 22:14:50 main:574] : INFO : Epoch 1218 | loss: nan | val_loss: nan | Time: 51041.1 ms
[2022-04-05 22:15:03 main:574] : INFO : Epoch 1219 | loss: nan | val_loss: nan | Time: 12588.7 ms
[2022-04-05 22:15:09 main:574] : INFO : Epoch 1220 | loss: nan | val_loss: nan | Time: 6026.93 ms
[2022-04-05 22:16:56 main:574] : INFO : Epoch 1221 | loss: nan | val_loss: nan | Time: 107128 ms
[2022-04-05 22:17:02 main:574] : INFO : Epoch 1222 | loss: nan | val_loss: nan | Time: 5708.13 ms
[2022-04-05 22:17:18 main:574] : INFO : Epoch 1223 | loss: nan | val_loss: nan | Time: 15454.4 ms
[2022-04-05 22:17:25 main:574] : INFO : Epoch 1224 | loss: nan | val_loss: nan | Time: 6735.91 ms
[2022-04-05 22:20:20 main:574] : INFO : Epoch 1225 | loss: nan | val_loss: nan | Time: 175670 ms
[2022-04-05 22:20:55 main:574] : INFO : Epoch 1226 | loss: nan | val_loss: nan | Time: 34142.8 ms
[2022-04-05 22:22:56 main:574] : INFO : Epoch 1227 | loss: nan | val_loss: nan | Time: 115530 ms
[2022-04-05 22:25:00 main:574] : INFO : Epoch 1228 | loss: nan | val_loss: nan | Time: 124661 ms
[2022-04-05 22:26:48 main:574] : INFO : Epoch 1229 | loss: nan | val_loss: nan | Time: 99139.1 ms
[2022-04-05 22:26:54 main:574] : INFO : Epoch 1230 | loss: nan | val_loss: nan | Time: 6192.43 ms
[2022-04-05 22:29:26 main:574] : INFO : Epoch 1231 | loss: nan | val_loss: nan | Time: 151107 ms
[2022-04-05 22:29:56 main:574] : INFO : Epoch 1232 | loss: nan | val_loss: nan | Time: 30393 ms
[2022-04-05 22:30:08 main:574] : INFO : Epoch 1233 | loss: nan | val_loss: nan | Time: 6969.72 ms
[2022-04-05 22:30:38 main:574] : INFO : Epoch 1234 | loss: nan | val_loss: nan | Time: 28372.1 ms
[2022-04-05 22:30:58 main:574] : INFO : Epoch 1235 | loss: nan | val_loss: nan | Time: 20081.3 ms
[2022-04-05 22:31:05 main:574] : INFO : Epoch 1236 | loss: nan | val_loss: nan | Time: 6481.9 ms
[2022-04-05 22:31:39 main:574] : INFO : Epoch 1237 | loss: nan | val_loss: nan | Time: 32202.8 ms
[2022-04-05 22:31:48 main:574] : INFO : Epoch 1238 | loss: nan | val_loss: nan | Time: 8843.53 ms
[2022-04-05 22:31:55 main:574] : INFO : Epoch 1239 | loss: nan | val_loss: nan | Time: 6735.29 ms
[2022-04-05 22:32:48 main:574] : INFO : Epoch 1240 | loss: nan | val_loss: nan | Time: 51775.7 ms
[2022-04-05 22:36:00 main:574] : INFO : Epoch 1241 | loss: nan | val_loss: nan | Time: 186441 ms
[2022-04-05 22:39:25 main:574] : INFO : Epoch 1242 | loss: nan | val_loss: nan | Time: 204811 ms
[2022-04-05 22:39:54 main:574] : INFO : Epoch 1243 | loss: nan | val_loss: nan | Time: 29662.7 ms
[2022-04-05 22:43:57 main:574] : INFO : Epoch 1244 | loss: nan | val_loss: nan | Time: 242847 ms
[2022-04-05 22:45:53 main:574] : INFO : Epoch 1245 | loss: nan | val_loss: nan | Time: 115657 ms
[2022-04-05 22:49:14 main:574] : INFO : Epoch 1246 | loss: nan | val_loss: nan | Time: 191187 ms
[2022-04-05 22:50:54 main:574] : INFO : Epoch 1247 | loss: nan | val_loss: nan | Time: 100163 ms
[2022-04-05 22:52:57 main:574] : INFO : Epoch 1248 | loss: nan | val_loss: nan | Time: 122069 ms
[2022-04-05 22:56:36 main:574] : INFO : Epoch 1249 | loss: nan | val_loss: nan | Time: 219478 ms
[2022-04-05 23:00:09 main:574] : INFO : Epoch 1250 | loss: nan | val_loss: nan | Time: 207791 ms
[2022-04-05 23:02:45 main:574] : INFO : Epoch 1251 | loss: nan | val_loss: nan | Time: 156271 ms
[2022-04-05 23:04:44 main:574] : INFO : Epoch 1252 | loss: nan | val_loss: nan | Time: 119228 ms
[2022-04-05 23:06:30 main:574] : INFO : Epoch 1253 | loss: nan | val_loss: nan | Time: 100922 ms
[2022-04-05 23:09:51 main:574] : INFO : Epoch 1254 | loss: nan | val_loss: nan | Time: 201367 ms
[2022-04-05 23:11:10 main:574] : INFO : Epoch 1255 | loss: nan | val_loss: nan | Time: 78881.3 ms
[2022-04-05 23:13:51 main:574] : INFO : Epoch 1256 | loss: nan | val_loss: nan | Time: 156437 ms
[2022-04-05 23:17:07 main:574] : INFO : Epoch 1257 | loss: nan | val_loss: nan | Time: 189986 ms
[2022-04-05 23:19:59 main:574] : INFO : Epoch 1258 | loss: nan | val_loss: nan | Time: 171079 ms
[2022-04-05 23:20:52 main:574] : INFO : Epoch 1259 | loss: nan | val_loss: nan | Time: 45366.7 ms
[2022-04-05 23:22:54 main:574] : INFO : Epoch 1260 | loss: nan | val_loss: nan | Time: 121909 ms
[2022-04-05 23:25:32 main:574] : INFO : Epoch 1261 | loss: nan | val_loss: nan | Time: 152849 ms
[2022-04-05 23:28:52 main:574] : INFO : Epoch 1262 | loss: nan | val_loss: nan | Time: 194769 ms
[2022-04-05 23:31:42 main:574] : INFO : Epoch 1263 | loss: nan | val_loss: nan | Time: 165071 ms
[2022-04-05 23:33:16 main:574] : INFO : Epoch 1264 | loss: nan | val_loss: nan | Time: 94386.1 ms
[2022-04-05 23:35:35 main:574] : INFO : Epoch 1265 | loss: nan | val_loss: nan | Time: 138876 ms
[2022-04-05 23:37:11 main:574] : INFO : Epoch 1266 | loss: nan | val_loss: nan | Time: 90849.4 ms
[2022-04-05 23:39:48 main:574] : INFO : Epoch 1267 | loss: nan | val_loss: nan | Time: 157431 ms
[2022-04-05 23:42:58 main:574] : INFO : Epoch 1268 | loss: nan | val_loss: nan | Time: 189306 ms
[2022-04-05 23:46:27 main:574] : INFO : Epoch 1269 | loss: nan | val_loss: nan | Time: 204260 ms
[2022-04-05 23:49:32 main:574] : INFO : Epoch 1270 | loss: nan | val_loss: nan | Time: 180493 ms
[2022-04-05 23:50:59 main:574] : INFO : Epoch 1271 | loss: nan | val_loss: nan | Time: 87179.4 ms
[2022-04-05 23:52:51 main:574] : INFO : Epoch 1272 | loss: nan | val_loss: nan | Time: 111540 ms
[2022-04-05 23:55:11 main:574] : INFO : Epoch 1273 | loss: nan | val_loss: nan | Time: 140274 ms
[2022-04-05 23:58:28 main:574] : INFO : Epoch 1274 | loss: nan | val_loss: nan | Time: 192394 ms
[2022-04-06 00:01:33 main:574] : INFO : Epoch 1275 | loss: nan | val_loss: nan | Time: 180527 ms
[2022-04-06 00:04:08 main:574] : INFO : Epoch 1276 | loss: nan | val_loss: nan | Time: 150247 ms
[2022-04-06 00:05:53 main:574] : INFO : Epoch 1277 | loss: nan | val_loss: nan | Time: 100044 ms
[2022-04-06 00:09:38 main:574] : INFO : Epoch 1278 | loss: nan | val_loss: nan | Time: 224743 ms
[2022-04-06 00:11:26 main:574] : INFO : Epoch 1279 | loss: nan | val_loss: nan | Time: 103870 ms
[2022-04-06 00:14:30 main:574] : INFO : Epoch 1280 | loss: nan | val_loss: nan | Time: 177641 ms
[2022-04-06 00:17:41 main:574] : INFO : Epoch 1281 | loss: nan | val_loss: nan | Time: 186449 ms
[2022-04-06 00:20:56 main:574] : INFO : Epoch 1282 | loss: nan | val_loss: nan | Time: 185817 ms
[2022-04-06 00:22:28 main:574] : INFO : Epoch 1283 | loss: nan | val_loss: nan | Time: 91463.5 ms
[2022-04-06 00:23:03 main:574] : INFO : Epoch 1284 | loss: nan | val_loss: nan | Time: 30056 ms
[2022-04-06 00:26:11 main:574] : INFO : Epoch 1285 | loss: nan | val_loss: nan | Time: 182879 ms
[2022-04-06 00:29:32 main:574] : INFO : Epoch 1286 | loss: nan | val_loss: nan | Time: 201843 ms
[2022-04-06 00:32:47 main:574] : INFO : Epoch 1287 | loss: nan | val_loss: nan | Time: 194837 ms
[2022-04-06 00:34:20 main:574] : INFO : Epoch 1288 | loss: nan | val_loss: nan | Time: 92161.7 ms
[2022-04-06 00:36:01 main:574] : INFO : Epoch 1289 | loss: nan | val_loss: nan | Time: 96032.4 ms
[2022-04-06 00:39:54 main:574] : INFO : Epoch 1290 | loss: nan | val_loss: nan | Time: 233032 ms
[2022-04-06 00:43:07 main:574] : INFO : Epoch 1291 | loss: nan | val_loss: nan | Time: 193053 ms
[2022-04-06 00:46:40 main:574] : INFO : Epoch 1292 | loss: nan | val_loss: nan | Time: 207798 ms
[2022-04-06 00:49:33 main:574] : INFO : Epoch 1293 | loss: nan | val_loss: nan | Time: 172243 ms
[2022-04-06 00:51:04 main:574] : INFO : Epoch 1294 | loss: nan | val_loss: nan | Time: 91252.6 ms
[2022-04-06 00:52:11 main:574] : INFO : Epoch 1295 | loss: nan | val_loss: nan | Time: 66725.1 ms
[2022-04-06 00:53:08 main:574] : INFO : Epoch 1296 | loss: nan | val_loss: nan | Time: 52169.7 ms
[2022-04-06 00:53:15 main:574] : INFO : Epoch 1297 | loss: nan | val_loss: nan | Time: 7090.77 ms
[2022-04-06 00:54:21 main:574] : INFO : Epoch 1298 | loss: nan | val_loss: nan | Time: 60863.4 ms
[2022-04-06 00:54:29 main:574] : INFO : Epoch 1299 | loss: nan | val_loss: nan | Time: 7244.57 ms
[2022-04-06 00:58:17 main:574] : INFO : Epoch 1300 | loss: nan | val_loss: nan | Time: 228530 ms
[2022-04-06 00:59:21 main:574] : INFO : Epoch 1301 | loss: nan | val_loss: nan | Time: 58930 ms
[2022-04-06 00:59:27 main:574] : INFO : Epoch 1302 | loss: nan | val_loss: nan | Time: 6077.25 ms
[2022-04-06 01:02:56 main:574] : INFO : Epoch 1303 | loss: nan | val_loss: nan | Time: 206920 ms
[2022-04-06 01:05:24 main:574] : INFO : Epoch 1304 | loss: nan | val_loss: nan | Time: 147947 ms
[2022-04-06 01:05:59 main:574] : INFO : Epoch 1305 | loss: nan | val_loss: nan | Time: 34848.8 ms
[2022-04-06 01:06:53 main:574] : INFO : Epoch 1306 | loss: nan | val_loss: nan | Time: 54319 ms
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFF273290D2
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 04/06/22 01:06:59
Install Directory : C:\Program Files\BOINC\
Data Directory : C:\ProgramData\BOINC
Project Symstore :
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\1;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 000000002c280000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000294d0000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 0000000028900000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 0000000027260000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000283d0000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000026c90000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1586) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1586
ModLoad: 0000000027740000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.1202 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1202
ModLoad: 0000000026f90000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 0000000026bf0000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 00000000270a0000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 0000000028850000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000293e0000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.19041.546
ModLoad: 0000000027770000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.1586) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000027870000 0000000000125000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000006140000 0000000000058000 C:\ProgramData\BOINC\slots\1\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000007c40000 0000000000092000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.28.29334.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\6\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.28.29334.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.28.29334.0
ModLoad: 000000001a230000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.867 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.867
ModLoad: 000000000cd10000 0000000000019000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.28.29334.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\6\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.28.29334.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.28.29334.0
ModLoad: 000000000d570000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.28.29334.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\6\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.28.29334.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.28.29334.0
ModLoad: 00000000aad10000 000000000abe7000 C:\ProgramData\BOINC\slots\1\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000e8c50000 00000000002db000 C:\ProgramData\BOINC\slots\1\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000f62f0000 000000000020d000 C:\ProgramData\BOINC\slots\1\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 00000000140f0000 0000000000040000 C:\ProgramData\BOINC\slots\1\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000007af60000 0000000024b49000 C:\ProgramData\BOINC\slots\1\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000060f0000 0000000000045000 C:\ProgramData\BOINC\slots\1\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000bd1e0000 00000000034b2000 C:\ProgramData\BOINC\slots\1\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 00000000219e0000 0000000000010000 C:\ProgramData\BOINC\slots\1\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 00000000ba130000 00000000030a5000 C:\ProgramData\BOINC\slots\1\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 0000000071dc0000 000000000919f000 C:\ProgramData\BOINC\slots\1\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 000000006e060000 0000000003d5b000 C:\ProgramData\BOINC\slots\1\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 0000000052cb0000 000000001b3a4000 C:\ProgramData\BOINC\slots\1\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 00000000b6aa0000 0000000001eca000 C:\ProgramData\BOINC\slots\1\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 0000000028710000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000024a40000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000289c0000 0000000000470000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000271a0000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1151
ModLoad: 0000000026cc0000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000269b0000 0000000000033000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000271f0000 0000000000068000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 0000000026d80000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000267d0000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000027a50000 0000000000744000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.964 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.964
ModLoad: 0000000024d20000 0000000000794000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000028e30000 0000000000354000 C:\WINDOWS\System32\combase.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.1320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1320
ModLoad: 0000000026650000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000027690000 00000000000ad000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000275a0000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000e4550000 00000000002cc000 C:\WINDOWS\system32\nvcuda.dll (30.0.14.7208) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r470\r470_00\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 30.0.14.7208
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.4.136 driver
Product Version : 30.0.14.7208
ModLoad: 00000000216e0000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000a9b40000 00000000011c5000 C:\WINDOWS\system32\DriverStore\FileRepository\nvhdc.inf_amd64_312d953c81546f4f\nvcuda64.dll (30.0.14.7208) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r470\r470_00\drivers\gpgpu\_out\wddm2_ms_shipping_wddm2_amd64_release\nvcuda.pdb
File Version : 30.0.14.7208
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.4.136 driver
Product Version : 30.0.14.7208
ModLoad: 000000001dc70000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.906 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.906
ModLoad: 0000000018c60000 0000000000148000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : drvstore.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1566
ModLoad: 00000000265c0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000024640000 000000000009e000 C:\WINDOWS\system32\uxtheme.dll (6.2.19041.1266) (-exported- Symbols Loaded)
Linked PDB Filename : UxTheme.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000005070000 0000000000719000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.14.7208) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r470\r470_00\drivers\nvapi\gpu\_out\wddm2_ms_shipping_wddm2_amd64_release\nvapi64.pdb
File Version : 30.0.14.7208
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 30.0.14.7208
ModLoad: 00000000285e0000 000000000012a000 C:\WINDOWS\System32\ole32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : ole32.pdb
File Version : 10.0.19041.1320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1320
ModLoad: 00000000219d0000 0000000000009000 C:\ProgramData\BOINC\slots\1\caffe2_nvrtc.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000b9160000 0000000000fca000 C:\ProgramData\BOINC\slots\1\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6.14.11.9000
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.89 NVRTC Library
Product Version : 6.14.11.9000
ModLoad: 0000000026cf0000 0000000000082000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.1415 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1415
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 4926, Write: 9591, Other 26858
- I/O Transfers Counters -
Read: 11890359, Write: 19824500, Other 130776
- Paged Pool Usage -
QuotaPagedPoolUsage: 3536712, QuotaPeakPagedPoolUsage: 3536760
QuotaNonPagedPoolUsage: 59016, QuotaPeakNonPagedPoolUsage: 59560
- Virtual Memory Usage -
VirtualSize: 396554240, PeakVirtualSize: 1018294272
- Pagefile Usage -
PagefileUsage: 396554240, PeakPagefileUsage: 398766080
- Working Set Size -
WorkingSetSize: -2128502784, PeakWorkingSetSize: -2051252224, PageFaultCount: 898447
*** Dump of thread ID 18180 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 153543600.000000
- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFF273290D2
- Registers -
rax=0000000000000000 rbx=0000000000000001 rcx=000000002c538c40 rdx=00000000646fe680 rsi=0000000000000000 rdi=0000000000000000
r8=00000000646fe680 r9=000000002c538c30 r10=0000000000000fff r11=0000000000000ff0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000273290d2 rsp=00000000646fe658 rbp=0000000000000000
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
646fe650 2c2b9100 00000001 646fe680 646fe680 2c538c30 KERNELBASE!DebugBreak+0x0
646fea90 2c2b9ce4 cd800000 646fedf4 00000000 00000368 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
646ff9f0 2c2ba084 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
646ffa20 28917034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
646ffa50 29522651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
646ffad0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 17628 (state: Ready): ***
- Information -
Status: Base Priority: Above Normal, Priority: Above Normal, , Kernel Time: 441562496.000000, User Time: 11051249664.000000, Wait Time: 153543600.000000
- Registers -
rax=0000000000000000 rbx=000000003d20ffe0 rcx=000000003d20ffe0 rdx=000000004f40fc60 rsi=0000000000000024 rdi=000000004f40fc60
r8=0000000000000000 r9=0000000000000000 r10=000000000000000c r11=0000000000000080 r12=0000000000000000 r13=000000004de191d0
r14=000000000000000c r15=000000003d20ffe0 rip=0000000053a646b6 rsp=0000000063fb17d0 rbp=0000000063fb1930
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000202
- Callstack -
ChildEBP RetAddr Args to Child
63fb1800 539b61be 3d20ffe0 4f40fc60 3c61f800 00000024 cudnn64_7!cudnnSetDropoutDescriptor+0x0
63fb1950 539b9536 3c61f800 b3c00d90 00000000 00000000 cudnn64_7!cudnnSetAttnDescriptor+0x0
63fb1a60 539cb06f 4ed981c0 00000000 00000000 00000000 cudnn64_7!cudnnSetAttnDescriptor+0x0
63fb1f10 539beff1 63fb41f8 b3c00d90 00000005 4de191d0 cudnn64_7!cudnnSetRNNProjectionLayers+0x0
63fb20b0 539c7d8e 4ed95d00 00000000 4de191d0 63fb2378 cudnn64_7!cudnnSetRNNProjectionLayers+0x0
63fb2250 539ddcd3 00000000 00000000 4ff1b710 63fb2370 cudnn64_7!cudnnSetRNNProjectionLayers+0x0
63fb43e0 7dcd89fd 4eda2a00 3c600000 4eda2a00 b3c00d90 cudnn64_7!cudnnRNNForwardTraining+0x0
63fb48c0 7dd325ea 63fb4988 00000001 63fb4988 00000001 torch_cuda!at::native::_cudnn_rnn+0x0
63fb49a0 7dd40cbf 63fb5090 63fb6898 63fb59e0 294fb86b torch_cuda!at::native::set_storage_cuda_+0x0
63fb4a80 b075b9fc 63fb5090 00000000 3d24a020 3d249ff0 torch_cuda!at::native::set_storage_cuda_+0x0
63fb4c00 b07931a2 00000001 b1f067c2 63fb4c34 294fb86b torch_cpu!at::native::mkldnn_sigmoid_+0x0
63fb4ee0 b1a42613 00000000 00000000 00000003 335d40d8 torch_cpu!at::_cudnn_rnn+0x0
63fb53e0 b1a5080b aa49774d 4f762a80 63fb5510 00000004 torch_cpu!torch::autograd::NotImplemented::~NotImplemented+0x0
63fb54c0 b075b9fc 63fb5a40 b1b75878 63fb5620 a9b66167 torch_cpu!torch::autograd::GraphRoot::apply+0x0
63fb5640 b07931a2 4de18790 00000000 aa4971fd 7ebfa3f0 torch_cpu!at::native::mkldnn_sigmoid_+0x0
63fb5920 7dcd69a1 63fb0001 00000001 00000004 00000004 torch_cpu!at::_cudnn_rnn+0x0
63fb5af0 7dce0117 00000000 63fb6898 060f2e0d 63fb5c10 torch_cuda!at::native::_use_cudnn_ctc_loss+0x0
63fb5b80 b04e107b b5631ac0 63fb5ea0 e6d31e6e a9d2abc3 torch_cuda!at::native::_cudnn_rnn_flatten_weight+0x0
63fb5df0 b0513b16 00000001 63fb6898 00000080 4fc81488 torch_cpu!at::native::fbgemm_pack_quantized_matrix+0x0
63fb5f80 b088ae89 63fb5ff8 00000001 63fb5ff8 00000001 torch_cpu!at::native::gru+0x0
63fb6010 b1b79fa3 63fb6110 00000001 63fb6290 63fb6898 torch_cpu!at::zeros_out+0x0
63fb60a0 b087dd35 06191ea8 c56dd000 00000000 06191ea8 torch_cpu!torch::autograd::GraphRoot::apply+0x0
63fb6120 b07588ec b56375c8 abce8470 4f40fdb0 63fb6340 torch_cpu!at::zeros_out+0x0
63fb6220 b07cc1bb 0000000c 00000080 00000004 4f762e00 torch_cpu!at::native::mkldnn_sigmoid_+0x0
63fb62a0 b22b7294 63fb63c0 abce8470 63fb63b0 63fb6558 torch_cpu!at::gru+0x0
63fb64d0 b22b62ab 63fb6870 b06e030e 63fb6870 63fb6898 torch_cpu!torch::nn::GRUImpl::forward_helper+0x0
63fb65c0 2c292621 0000000f 63fb72d0 00000000 06191ea8 torch_cpu!torch::nn::GRUImpl::forward+0x0
63fb67c0 2c29705a 00000000 63fb0000 63fb0601 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::error+0x0
63fb6cc0 2c29b950 2c2cd95f 2c2cd95f 00000000 9f0d4c00 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0
63fcfa60 2c4dc6f8 c5b5dc70 00000000 00000000 c5a1d060 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
63fcfaa0 28917034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
63fcfad0 29522651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
63fcfb50 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 14120 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 153543600.000000
- Registers -
rax=000000000000005b rbx=000000000000000e rcx=000000000000000e rdx=00000000647ff880 rsi=0000000000000000 rdi=000000000000000e
r8=0000000000000001 r9=00000000c5d51f00 r10=0000000000000000 r11=00000000647ff7f0 r12=0000000000000064 r13=00000000647ff880
r14=00000000647ff580 r15=0000000000000000 rip=000000002956d8c4 rsp=00000000647ff528 rbp=00000000c5d51f50
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
647ff520 272acb20 00000000 64193000 2963a4d0 64193000 ntdll!ZwWaitForMultipleObjects+0x0
647ff810 272aca1e c40b11d0 004e0049 0000000e 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
647ff850 a9d11224 c5d56f90 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0
647ffa90 a9db7fcd 00000000 c5d51f50 00000000 00000000 nvcuda64!+0x0
647ffb40 a9d10bf3 e2e385b0 f0a81cf1 c637a150 00000000 nvcuda64!cuProfilerStop+0x0
647ffb70 aa0458a4 c637a150 00000000 00000000 00000000 nvcuda64!+0x0
647ffba0 28917034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
647ffbd0 29522651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
647ffc50 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 10256 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 151593504.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002c0 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002c0
r8=00000000648ffae8 r9=0000000000000000 r10=0000000000000000 r11=00000000648ffb48 r12=0000000000000000 r13=0000000000000000
r14=00000000000002c0 r15=0000000000000000 rip=000000002956cdf4 rsp=00000000648ff848 rbp=00000000c5d799d0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
648ff840 27281a5e 00000000 29522630 0000027f 00000000 ntdll!ZwWaitForSingleObject+0x0
648ff8e0 a9f3d50d c6379d00 00000000 00000000 000002c0 KERNELBASE!WaitForSingleObjectEx+0x0
648ffb40 a9d10bf3 00000000 c6379d00 a9b40000 c5d8f970 nvcuda64!cuProfilerStop+0x0
648ffb70 aa0458a4 c6379d00 00000000 00000000 00000000 nvcuda64!+0x0
648ffba0 28917034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
648ffbd0 29522651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
648ffc50 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 2608 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 153543600.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000c5e3edf0 rdx=00000000649ff858 rsi=00000000649ff7c0 rdi=0000000000000000
r8=0000000000000004 r9=0000000000000004 r10=0000000000000003 r11=00000000649ff7f0 r12=00000000649ff858 r13=0000000000000000
r14=00000000c5e3edf0 r15=00000000c60028b0 rip=0000000029570764 rsp=00000000649ff798 rbp=00000000649ff7f0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
649ff790 29534295 00000102 00000102 00000000 649ff7c0 ntdll!NtWaitForAlertByThreadId+0x0
649ff800 272ccef9 c6000090 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0
649ff830 a9c7f0ec c6000090 c6000090 c6000090 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0
649ff890 a9d10bf3 00000003 e2dc5e91 c25bff5a 00000000 nvcuda64!+0x0
649ff8c0 aa0458a4 c6379ee0 00000000 00000000 00000000 nvcuda64!+0x0
649ff8f0 28917034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
649ff920 29522651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
649ff9a0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 16184 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 415781248.000000, User Time: 7907500032.000000, Wait Time: 153543584.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000334ffd28 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000334ffd28
r8=00000000c4272040 r9=0000000000000001 r10=0000000000008000 r11=0000000064afd160 r12=0000000000000000 r13=0000000000000000
r14=0000000064aff570 r15=00000000334ffcd8 rip=0000000029570764 rsp=0000000064aff548 rbp=0000000064aff5a0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
64aff540 29534021 00000000 07c52f97 4a383db0 4a383da0 ntdll!NtWaitForAlertByThreadId+0x0
64aff5c0 272ccfa9 334ffd20 334ffd18 334ffcd0 00000001 ntdll!RtlSleepConditionVariableSRW+0x0
64aff600 07c7bf3d 000001c0 00000003 4a381d30 b1ee9a79 KERNELBASE!SleepConditionVariableSRW+0x0
64aff640 07c52798 00000000 4a383dd0 00000000 00000000 MSVCP140!__crtSetThreadpoolWait+0x0
64aff670 07c52a4a ccde3a05 334ffcd0 4a381d30 334ffd18 MSVCP140!std::_Winerror_message+0x0
64aff6a0 b1ef064b 334ffcd0 64aff7a0 334ffcd0 ffffffff MSVCP140!_Cnd_wait+0x0
64aff6e0 b1ef25b1 4fdac220 4a381d20 4a381d20 ffffffff torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
64aff9d0 b1ef2471 b5416d10 64affa10 b5416d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0
64affa20 b1ee9744 00080001 4fafcea0 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0
64affa50 270c1bb2 4fafcea0 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0
64affa80 28917034 00000000 00000000 00000000 00000000 ucrtbase!_configthreadlocale+0x0
64affab0 29522651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
64affb30 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)