Task 14627577

Name ParityModified-1647045629-20427-3-0_2
Workunit 11352674
Created 23 Apr 2022, 19:12:52 UTC
Sent 23 Apr 2022, 19:14:34 UTC
Report deadline 1 May 2022, 19:14:34 UTC
Received 23 Apr 2022, 20:05:13 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 5309
Run time 33 min 22 sec
CPU time 32 min 50 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 11,247.82 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 2.08 GB
Peak swap size 4.38 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
loss: nan | val_loss: nan | Time: 1943.33 ms
[2022-04-23 21:50:39	                main:574]	:	INFO	:	Epoch 1081 | loss: nan | val_loss: nan | Time: 1937.02 ms
[2022-04-23 21:50:41	                main:574]	:	INFO	:	Epoch 1082 | loss: nan | val_loss: nan | Time: 1950.84 ms
[2022-04-23 21:50:43	                main:574]	:	INFO	:	Epoch 1083 | loss: nan | val_loss: nan | Time: 1959.64 ms
[2022-04-23 21:50:45	                main:574]	:	INFO	:	Epoch 1084 | loss: nan | val_loss: nan | Time: 1947.68 ms
[2022-04-23 21:50:47	                main:574]	:	INFO	:	Epoch 1085 | loss: nan | val_loss: nan | Time: 2065.08 ms
[2022-04-23 21:50:49	                main:574]	:	INFO	:	Epoch 1086 | loss: nan | val_loss: nan | Time: 2031.82 ms
[2022-04-23 21:50:51	                main:574]	:	INFO	:	Epoch 1087 | loss: nan | val_loss: nan | Time: 2089.04 ms
[2022-04-23 21:50:53	                main:574]	:	INFO	:	Epoch 1088 | loss: nan | val_loss: nan | Time: 2058.08 ms
[2022-04-23 21:50:55	                main:574]	:	INFO	:	Epoch 1089 | loss: nan | val_loss: nan | Time: 1973.94 ms
[2022-04-23 21:50:57	                main:574]	:	INFO	:	Epoch 1090 | loss: nan | val_loss: nan | Time: 2068.53 ms
[2022-04-23 21:50:59	                main:574]	:	INFO	:	Epoch 1091 | loss: nan | val_loss: nan | Time: 2070.6 ms
[2022-04-23 21:51:01	                main:574]	:	INFO	:	Epoch 1092 | loss: nan | val_loss: nan | Time: 2074.26 ms
[2022-04-23 21:51:03	                main:574]	:	INFO	:	Epoch 1093 | loss: nan | val_loss: nan | Time: 2027.19 ms
[2022-04-23 21:51:05	                main:574]	:	INFO	:	Epoch 1094 | loss: nan | val_loss: nan | Time: 2098.94 ms
[2022-04-23 21:51:07	                main:574]	:	INFO	:	Epoch 1095 | loss: nan | val_loss: nan | Time: 2060.18 ms
[2022-04-23 21:51:09	                main:574]	:	INFO	:	Epoch 1096 | loss: nan | val_loss: nan | Time: 2033.74 ms
[2022-04-23 21:51:11	                main:574]	:	INFO	:	Epoch 1097 | loss: nan | val_loss: nan | Time: 2041.71 ms
[2022-04-23 21:51:13	                main:574]	:	INFO	:	Epoch 1098 | loss: nan | val_loss: nan | Time: 1981.86 ms
[2022-04-23 21:51:16	                main:574]	:	INFO	:	Epoch 1099 | loss: nan | val_loss: nan | Time: 2698.54 ms
[2022-04-23 21:51:20	                main:574]	:	INFO	:	Epoch 1100 | loss: nan | val_loss: nan | Time: 3745.16 ms
[2022-04-23 21:51:22	                main:574]	:	INFO	:	Epoch 1101 | loss: nan | val_loss: nan | Time: 2540.4 ms
[2022-04-23 21:51:25	                main:574]	:	INFO	:	Epoch 1102 | loss: nan | val_loss: nan | Time: 2237.99 ms
[2022-04-23 21:51:27	                main:574]	:	INFO	:	Epoch 1103 | loss: nan | val_loss: nan | Time: 2160.69 ms
[2022-04-23 21:51:29	                main:574]	:	INFO	:	Epoch 1104 | loss: nan | val_loss: nan | Time: 2049.66 ms
[2022-04-23 21:51:31	                main:574]	:	INFO	:	Epoch 1105 | loss: nan | val_loss: nan | Time: 1946.04 ms
[2022-04-23 21:51:33	                main:574]	:	INFO	:	Epoch 1106 | loss: nan | val_loss: nan | Time: 2070.53 ms
[2022-04-23 21:51:35	                main:574]	:	INFO	:	Epoch 1107 | loss: nan | val_loss: nan | Time: 2140.52 ms
[2022-04-23 21:51:37	                main:574]	:	INFO	:	Epoch 1108 | loss: nan | val_loss: nan | Time: 2041.23 ms
[2022-04-23 21:51:39	                main:574]	:	INFO	:	Epoch 1109 | loss: nan | val_loss: nan | Time: 1946 ms
[2022-04-23 21:51:41	                main:574]	:	INFO	:	Epoch 1110 | loss: nan | val_loss: nan | Time: 1995.77 ms
[2022-04-23 21:51:43	                main:574]	:	INFO	:	Epoch 1111 | loss: nan | val_loss: nan | Time: 2037.29 ms
[2022-04-23 21:51:45	                main:574]	:	INFO	:	Epoch 1112 | loss: nan | val_loss: nan | Time: 1966.3 ms
[2022-04-23 21:51:47	                main:574]	:	INFO	:	Epoch 1113 | loss: nan | val_loss: nan | Time: 1978.56 ms
[2022-04-23 21:51:49	                main:574]	:	INFO	:	Epoch 1114 | loss: nan | val_loss: nan | Time: 2189.19 ms
[2022-04-23 21:51:52	                main:574]	:	INFO	:	Epoch 1115 | loss: nan | val_loss: nan | Time: 2250.17 ms
[2022-04-23 21:51:54	                main:574]	:	INFO	:	Epoch 1116 | loss: nan | val_loss: nan | Time: 2122.37 ms
[2022-04-23 21:51:56	                main:574]	:	INFO	:	Epoch 1117 | loss: nan | val_loss: nan | Time: 2103.83 ms
[2022-04-23 21:51:58	                main:574]	:	INFO	:	Epoch 1118 | loss: nan | val_loss: nan | Time: 2071.88 ms
[2022-04-23 21:52:00	                main:574]	:	INFO	:	Epoch 1119 | loss: nan | val_loss: nan | Time: 2065.28 ms
[2022-04-23 21:52:02	                main:574]	:	INFO	:	Epoch 1120 | loss: nan | val_loss: nan | Time: 2161.57 ms
[2022-04-23 21:52:04	                main:574]	:	INFO	:	Epoch 1121 | loss: nan | val_loss: nan | Time: 1979.37 ms
[2022-04-23 21:52:06	                main:574]	:	INFO	:	Epoch 1122 | loss: nan | val_loss: nan | Time: 2081.03 ms
[2022-04-23 21:52:08	                main:574]	:	INFO	:	Epoch 1123 | loss: nan | val_loss: nan | Time: 2039.18 ms
[2022-04-23 21:52:10	                main:574]	:	INFO	:	Epoch 1124 | loss: nan | val_loss: nan | Time: 2102.2 ms
[2022-04-23 21:52:12	                main:574]	:	INFO	:	Epoch 1125 | loss: nan | val_loss: nan | Time: 2061.34 ms
[2022-04-23 21:52:14	                main:574]	:	INFO	:	Epoch 1126 | loss: nan | val_loss: nan | Time: 2113.22 ms
[2022-04-23 21:52:17	                main:574]	:	INFO	:	Epoch 1127 | loss: nan | val_loss: nan | Time: 2114.02 ms
[2022-04-23 21:52:19	                main:574]	:	INFO	:	Epoch 1128 | loss: nan | val_loss: nan | Time: 2044.91 ms
[2022-04-23 21:52:21	                main:574]	:	INFO	:	Epoch 1129 | loss: nan | val_loss: nan | Time: 2012.48 ms
[2022-04-23 21:52:23	                main:574]	:	INFO	:	Epoch 1130 | loss: nan | val_loss: nan | Time: 2013.03 ms
[2022-04-23 21:52:25	                main:574]	:	INFO	:	Epoch 1131 | loss: nan | val_loss: nan | Time: 2045.86 ms
[2022-04-23 21:52:27	                main:574]	:	INFO	:	Epoch 1132 | loss: nan | val_loss: nan | Time: 2046.17 ms
[2022-04-23 21:52:29	                main:574]	:	INFO	:	Epoch 1133 | loss: nan | val_loss: nan | Time: 1944.75 ms
[2022-04-23 21:52:31	                main:574]	:	INFO	:	Epoch 1134 | loss: nan | val_loss: nan | Time: 2109.78 ms
[2022-04-23 21:52:33	                main:574]	:	INFO	:	Epoch 1135 | loss: nan | val_loss: nan | Time: 2059.65 ms
[2022-04-23 21:52:35	                main:574]	:	INFO	:	Epoch 1136 | loss: nan | val_loss: nan | Time: 2037.48 ms
[2022-04-23 21:52:37	                main:574]	:	INFO	:	Epoch 1137 | loss: nan | val_loss: nan | Time: 2168.47 ms
[2022-04-23 21:52:39	                main:574]	:	INFO	:	Epoch 1138 | loss: nan | val_loss: nan | Time: 2107.85 ms
[2022-04-23 21:52:41	                main:574]	:	INFO	:	Epoch 1139 | loss: nan | val_loss: nan | Time: 2124.67 ms
[2022-04-23 21:52:43	                main:574]	:	INFO	:	Epoch 1140 | loss: nan | val_loss: nan | Time: 2123.95 ms
[2022-04-23 21:52:46	                main:574]	:	INFO	:	Epoch 1141 | loss: nan | val_loss: nan | Time: 2051.28 ms
[2022-04-23 21:52:48	                main:574]	:	INFO	:	Epoch 1142 | loss: nan | val_loss: nan | Time: 2046.82 ms
[2022-04-23 21:52:50	                main:574]	:	INFO	:	Epoch 1143 | loss: nan | val_loss: nan | Time: 2040.48 ms
[2022-04-23 21:52:52	                main:574]	:	INFO	:	Epoch 1144 | loss: nan | val_loss: nan | Time: 1930.81 ms
[2022-04-23 21:52:54	                main:574]	:	INFO	:	Epoch 1145 | loss: nan | val_loss: nan | Time: 1950.86 ms
[2022-04-23 21:52:55	                main:574]	:	INFO	:	Epoch 1146 | loss: nan | val_loss: nan | Time: 1929.66 ms
[2022-04-23 21:52:57	                main:574]	:	INFO	:	Epoch 1147 | loss: nan | val_loss: nan | Time: 1929.41 ms
[2022-04-23 21:52:59	                main:574]	:	INFO	:	Epoch 1148 | loss: nan | val_loss: nan | Time: 1953.66 ms
[2022-04-23 21:53:01	                main:574]	:	INFO	:	Epoch 1149 | loss: nan | val_loss: nan | Time: 1921.18 ms
[2022-04-23 21:53:03	                main:574]	:	INFO	:	Epoch 1150 | loss: nan | val_loss: nan | Time: 1932.76 ms
[2022-04-23 21:53:05	                main:574]	:	INFO	:	Epoch 1151 | loss: nan | val_loss: nan | Time: 1911.07 ms
[2022-04-23 21:53:07	                main:574]	:	INFO	:	Epoch 1152 | loss: nan | val_loss: nan | Time: 2021.69 ms
[2022-04-23 21:53:09	                main:574]	:	INFO	:	Epoch 1153 | loss: nan | val_loss: nan | Time: 2092.73 ms
[2022-04-23 21:53:11	                main:574]	:	INFO	:	Epoch 1154 | loss: nan | val_loss: nan | Time: 2078.55 ms
[2022-04-23 21:53:13	                main:574]	:	INFO	:	Epoch 1155 | loss: nan | val_loss: nan | Time: 1996.01 ms
[2022-04-23 21:53:15	                main:574]	:	INFO	:	Epoch 1156 | loss: nan | val_loss: nan | Time: 1972.69 ms
[2022-04-23 21:53:17	                main:574]	:	INFO	:	Epoch 1157 | loss: nan | val_loss: nan | Time: 1938.43 ms
[2022-04-23 21:53:19	                main:574]	:	INFO	:	Epoch 1158 | loss: nan | val_loss: nan | Time: 1962.63 ms
[2022-04-23 21:53:21	                main:574]	:	INFO	:	Epoch 1159 | loss: nan | val_loss: nan | Time: 1953.99 ms
[2022-04-23 21:53:23	                main:574]	:	INFO	:	Epoch 1160 | loss: nan | val_loss: nan | Time: 1927.54 ms
[2022-04-23 21:53:25	                main:574]	:	INFO	:	Epoch 1161 | loss: nan | val_loss: nan | Time: 1951.65 ms
[2022-04-23 21:53:27	                main:574]	:	INFO	:	Epoch 1162 | loss: nan | val_loss: nan | Time: 1913.1 ms
[2022-04-23 21:53:29	                main:574]	:	INFO	:	Epoch 1163 | loss: nan | val_loss: nan | Time: 1932.04 ms
[2022-04-23 21:53:31	                main:574]	:	INFO	:	Epoch 1164 | loss: nan | val_loss: nan | Time: 1923.39 ms
[2022-04-23 21:53:33	                main:574]	:	INFO	:	Epoch 1165 | loss: nan | val_loss: nan | Time: 1926.63 ms
[2022-04-23 21:53:35	                main:574]	:	INFO	:	Epoch 1166 | loss: nan | val_loss: nan | Time: 1977.97 ms
[2022-04-23 21:53:37	                main:574]	:	INFO	:	Epoch 1167 | loss: nan | val_loss: nan | Time: 1956.33 ms
[2022-04-23 21:53:39	                main:574]	:	INFO	:	Epoch 1168 | loss: nan | val_loss: nan | Time: 1939.06 ms
[2022-04-23 21:53:41	                main:574]	:	INFO	:	Epoch 1169 | loss: nan | val_loss: nan | Time: 1929.7 ms
[2022-04-23 21:53:43	                main:574]	:	INFO	:	Epoch 1170 | loss: nan | val_loss: nan | Time: 1926.87 ms
[2022-04-23 21:53:44	                main:574]	:	INFO	:	Epoch 1171 | loss: nan | val_loss: nan | Time: 1925.94 ms
[2022-04-23 21:53:46	                main:574]	:	INFO	:	Epoch 1172 | loss: nan | val_loss: nan | Time: 1910.81 ms
[2022-04-23 21:53:48	                main:574]	:	INFO	:	Epoch 1173 | loss: nan | val_loss: nan | Time: 1921.11 ms
[2022-04-23 21:53:50	                main:574]	:	INFO	:	Epoch 1174 | loss: nan | val_loss: nan | Time: 1930.77 ms
[2022-04-23 21:53:52	                main:574]	:	INFO	:	Epoch 1175 | loss: nan | val_loss: nan | Time: 1918.79 ms
[2022-04-23 21:53:54	                main:574]	:	INFO	:	Epoch 1176 | loss: nan | val_loss: nan | Time: 2013.65 ms
[2022-04-23 21:53:56	                main:574]	:	INFO	:	Epoch 1177 | loss: nan | val_loss: nan | Time: 2032.32 ms
[2022-04-23 21:53:58	                main:574]	:	INFO	:	Epoch 1178 | loss: nan | val_loss: nan | Time: 1975.96 ms
[2022-04-23 21:54:00	                main:574]	:	INFO	:	Epoch 1179 | loss: nan | val_loss: nan | Time: 1997.41 ms
[2022-04-23 21:54:02	                main:574]	:	INFO	:	Epoch 1180 | loss: nan | val_loss: nan | Time: 1980.95 ms
[2022-04-23 21:54:04	                main:574]	:	INFO	:	Epoch 1181 | loss: nan | val_loss: nan | Time: 2110.43 ms
[2022-04-23 21:54:06	                main:574]	:	INFO	:	Epoch 1182 | loss: nan | val_loss: nan | Time: 1991.15 ms
[2022-04-23 21:54:08	                main:574]	:	INFO	:	Epoch 1183 | loss: nan | val_loss: nan | Time: 1935.43 ms
[2022-04-23 21:54:10	                main:574]	:	INFO	:	Epoch 1184 | loss: nan | val_loss: nan | Time: 1994.3 ms
[2022-04-23 21:54:12	                main:574]	:	INFO	:	Epoch 1185 | loss: nan | val_loss: nan | Time: 1981.27 ms
[2022-04-23 21:54:14	                main:574]	:	INFO	:	Epoch 1186 | loss: nan | val_loss: nan | Time: 1923.13 ms
[2022-04-23 21:54:16	                main:574]	:	INFO	:	Epoch 1187 | loss: nan | val_loss: nan | Time: 1938.58 ms
[2022-04-23 21:54:18	                main:574]	:	INFO	:	Epoch 1188 | loss: nan | val_loss: nan | Time: 1927.73 ms
[2022-04-23 21:54:20	                main:574]	:	INFO	:	Epoch 1189 | loss: nan | val_loss: nan | Time: 1918.6 ms
[2022-04-23 21:54:22	                main:574]	:	INFO	:	Epoch 1190 | loss: nan | val_loss: nan | Time: 1927.7 ms
[2022-04-23 21:54:24	                main:574]	:	INFO	:	Epoch 1191 | loss: nan | val_loss: nan | Time: 1929.86 ms
[2022-04-23 21:54:26	                main:574]	:	INFO	:	Epoch 1192 | loss: nan | val_loss: nan | Time: 1952.28 ms
[2022-04-23 21:54:28	                main:574]	:	INFO	:	Epoch 1193 | loss: nan | val_loss: nan | Time: 1953.44 ms
[2022-04-23 21:54:30	                main:574]	:	INFO	:	Epoch 1194 | loss: nan | val_loss: nan | Time: 1930.2 ms
[2022-04-23 21:54:33	                main:574]	:	INFO	:	Epoch 1195 | loss: nan | val_loss: nan | Time: 3513.74 ms
[2022-04-23 21:54:35	                main:574]	:	INFO	:	Epoch 1196 | loss: nan | val_loss: nan | Time: 1935.14 ms
[2022-04-23 21:54:37	                main:574]	:	INFO	:	Epoch 1197 | loss: nan | val_loss: nan | Time: 1926.66 ms
[2022-04-23 21:54:39	                main:574]	:	INFO	:	Epoch 1198 | loss: nan | val_loss: nan | Time: 1936.75 ms
[2022-04-23 21:54:41	                main:574]	:	INFO	:	Epoch 1199 | loss: nan | val_loss: nan | Time: 1943.87 ms
[2022-04-23 21:54:43	                main:574]	:	INFO	:	Epoch 1200 | loss: nan | val_loss: nan | Time: 1952.75 ms
[2022-04-23 21:54:45	                main:574]	:	INFO	:	Epoch 1201 | loss: nan | val_loss: nan | Time: 1939.77 ms
[2022-04-23 21:54:47	                main:574]	:	INFO	:	Epoch 1202 | loss: nan | val_loss: nan | Time: 1928.91 ms
[2022-04-23 21:54:49	                main:574]	:	INFO	:	Epoch 1203 | loss: nan | val_loss: nan | Time: 1920.46 ms
[2022-04-23 21:54:51	                main:574]	:	INFO	:	Epoch 1204 | loss: nan | val_loss: nan | Time: 1950.31 ms
[2022-04-23 21:54:53	                main:574]	:	INFO	:	Epoch 1205 | loss: nan | val_loss: nan | Time: 1921.24 ms
[2022-04-23 21:54:55	                main:574]	:	INFO	:	Epoch 1206 | loss: nan | val_loss: nan | Time: 1915.96 ms
[2022-04-23 21:54:56	                main:574]	:	INFO	:	Epoch 1207 | loss: nan | val_loss: nan | Time: 1912.56 ms
[2022-04-23 21:54:58	                main:574]	:	INFO	:	Epoch 1208 | loss: nan | val_loss: nan | Time: 1910.79 ms
[2022-04-23 21:55:00	                main:574]	:	INFO	:	Epoch 1209 | loss: nan | val_loss: nan | Time: 1932.56 ms
[2022-04-23 21:55:02	                main:574]	:	INFO	:	Epoch 1210 | loss: nan | val_loss: nan | Time: 1923.04 ms
[2022-04-23 21:55:04	                main:574]	:	INFO	:	Epoch 1211 | loss: nan | val_loss: nan | Time: 1923.66 ms
[2022-04-23 21:55:06	                main:574]	:	INFO	:	Epoch 1212 | loss: nan | val_loss: nan | Time: 1934.13 ms
[2022-04-23 21:55:08	                main:574]	:	INFO	:	Epoch 1213 | loss: nan | val_loss: nan | Time: 1908.65 ms
[2022-04-23 21:55:10	                main:574]	:	INFO	:	Epoch 1214 | loss: nan | val_loss: nan | Time: 1922.99 ms
[2022-04-23 21:55:12	                main:574]	:	INFO	:	Epoch 1215 | loss: nan | val_loss: nan | Time: 1923.24 ms
[2022-04-23 21:55:14	                main:574]	:	INFO	:	Epoch 1216 | loss: nan | val_loss: nan | Time: 1990.18 ms
[2022-04-23 21:55:16	                main:574]	:	INFO	:	Epoch 1217 | loss: nan | val_loss: nan | Time: 2131.43 ms
[2022-04-23 21:55:18	                main:574]	:	INFO	:	Epoch 1218 | loss: nan | val_loss: nan | Time: 1935.82 ms
[2022-04-23 21:55:20	                main:574]	:	INFO	:	Epoch 1219 | loss: nan | val_loss: nan | Time: 1936.17 ms
[2022-04-23 21:55:22	                main:574]	:	INFO	:	Epoch 1220 | loss: nan | val_loss: nan | Time: 1959.79 ms
[2022-04-23 21:55:24	                main:574]	:	INFO	:	Epoch 1221 | loss: nan | val_loss: nan | Time: 1935.02 ms
[2022-04-23 21:55:26	                main:574]	:	INFO	:	Epoch 1222 | loss: nan | val_loss: nan | Time: 1954.77 ms
[2022-04-23 21:55:28	                main:574]	:	INFO	:	Epoch 1223 | loss: nan | val_loss: nan | Time: 1908.46 ms
[2022-04-23 21:55:30	                main:574]	:	INFO	:	Epoch 1224 | loss: nan | val_loss: nan | Time: 1954.06 ms
[2022-04-23 21:55:32	                main:574]	:	INFO	:	Epoch 1225 | loss: nan | val_loss: nan | Time: 1937.22 ms
[2022-04-23 21:55:33	                main:574]	:	INFO	:	Epoch 1226 | loss: nan | val_loss: nan | Time: 1948.65 ms
[2022-04-23 21:55:35	                main:574]	:	INFO	:	Epoch 1227 | loss: nan | val_loss: nan | Time: 1933.4 ms
[2022-04-23 21:55:37	                main:574]	:	INFO	:	Epoch 1228 | loss: nan | val_loss: nan | Time: 1928.24 ms
[2022-04-23 21:55:39	                main:574]	:	INFO	:	Epoch 1229 | loss: nan | val_loss: nan | Time: 1930.25 ms
[2022-04-23 21:55:41	                main:574]	:	INFO	:	Epoch 1230 | loss: nan | val_loss: nan | Time: 1954.44 ms
[2022-04-23 21:55:43	                main:574]	:	INFO	:	Epoch 1231 | loss: nan | val_loss: nan | Time: 1954.09 ms
[2022-04-23 21:55:45	                main:574]	:	INFO	:	Epoch 1232 | loss: nan | val_loss: nan | Time: 2002.6 ms
[2022-04-23 21:55:47	                main:574]	:	INFO	:	Epoch 1233 | loss: nan | val_loss: nan | Time: 2003.91 ms
[2022-04-23 21:55:49	                main:574]	:	INFO	:	Epoch 1234 | loss: nan | val_loss: nan | Time: 2073.39 ms
[2022-04-23 21:55:52	                main:574]	:	INFO	:	Epoch 1235 | loss: nan | val_loss: nan | Time: 2387.41 ms
[2022-04-23 21:55:54	                main:574]	:	INFO	:	Epoch 1236 | loss: nan | val_loss: nan | Time: 2025.25 ms
[2022-04-23 21:55:56	                main:574]	:	INFO	:	Epoch 1237 | loss: nan | val_loss: nan | Time: 2104.93 ms
[2022-04-23 21:55:58	                main:574]	:	INFO	:	Epoch 1238 | loss: nan | val_loss: nan | Time: 2133.72 ms
[2022-04-23 21:56:00	                main:574]	:	INFO	:	Epoch 1239 | loss: nan | val_loss: nan | Time: 2132.79 ms
[2022-04-23 21:56:02	                main:574]	:	INFO	:	Epoch 1240 | loss: nan | val_loss: nan | Time: 1986.02 ms
[2022-04-23 21:56:04	                main:574]	:	INFO	:	Epoch 1241 | loss: nan | val_loss: nan | Time: 1956.45 ms
[2022-04-23 21:56:06	                main:574]	:	INFO	:	Epoch 1242 | loss: nan | val_loss: nan | Time: 1927.8 ms
[2022-04-23 21:56:08	                main:574]	:	INFO	:	Epoch 1243 | loss: nan | val_loss: nan | Time: 1951.83 ms
[2022-04-23 21:56:10	                main:574]	:	INFO	:	Epoch 1244 | loss: nan | val_loss: nan | Time: 1922.74 ms
[2022-04-23 21:56:12	                main:574]	:	INFO	:	Epoch 1245 | loss: nan | val_loss: nan | Time: 1972.9 ms
[2022-04-23 21:56:14	                main:574]	:	INFO	:	Epoch 1246 | loss: nan | val_loss: nan | Time: 1945.28 ms
[2022-04-23 21:56:16	                main:574]	:	INFO	:	Epoch 1247 | loss: nan | val_loss: nan | Time: 1952.57 ms
[2022-04-23 21:56:18	                main:574]	:	INFO	:	Epoch 1248 | loss: nan | val_loss: nan | Time: 1966.06 ms
[2022-04-23 21:56:20	                main:574]	:	INFO	:	Epoch 1249 | loss: nan | val_loss: nan | Time: 1996.86 ms
[2022-04-23 21:56:22	                main:574]	:	INFO	:	Epoch 1250 | loss: nan | val_loss: nan | Time: 2007.24 ms
[2022-04-23 21:56:24	                main:574]	:	INFO	:	Epoch 1251 | loss: nan | val_loss: nan | Time: 2008.76 ms
[2022-04-23 21:56:26	                main:574]	:	INFO	:	Epoch 1252 | loss: nan | val_loss: nan | Time: 2007.34 ms
[2022-04-23 21:56:28	                main:574]	:	INFO	:	Epoch 1253 | loss: nan | val_loss: nan | Time: 2032.62 ms
[2022-04-23 21:56:30	                main:574]	:	INFO	:	Epoch 1254 | loss: nan | val_loss: nan | Time: 2030.93 ms
[2022-04-23 21:56:32	                main:574]	:	INFO	:	Epoch 1255 | loss: nan | val_loss: nan | Time: 2131.19 ms
[2022-04-23 21:56:34	                main:574]	:	INFO	:	Epoch 1256 | loss: nan | val_loss: nan | Time: 2188.56 ms
[2022-04-23 21:56:36	                main:574]	:	INFO	:	Epoch 1257 | loss: nan | val_loss: nan | Time: 2206.7 ms
[2022-04-23 21:56:39	                main:574]	:	INFO	:	Epoch 1258 | loss: nan | val_loss: nan | Time: 2120.66 ms
[2022-04-23 21:56:41	                main:574]	:	INFO	:	Epoch 1259 | loss: nan | val_loss: nan | Time: 2010.06 ms
[2022-04-23 21:56:43	                main:574]	:	INFO	:	Epoch 1260 | loss: nan | val_loss: nan | Time: 2124.46 ms
[2022-04-23 21:56:45	                main:574]	:	INFO	:	Epoch 1261 | loss: nan | val_loss: nan | Time: 2228.18 ms
[2022-04-23 21:56:47	                main:574]	:	INFO	:	Epoch 1262 | loss: nan | val_loss: nan | Time: 2173.54 ms
[2022-04-23 21:56:49	                main:574]	:	INFO	:	Epoch 1263 | loss: nan | val_loss: nan | Time: 2199.81 ms
[2022-04-23 21:56:51	                main:574]	:	INFO	:	Epoch 1264 | loss: nan | val_loss: nan | Time: 2101.92 ms
[2022-04-23 21:56:54	                main:574]	:	INFO	:	Epoch 1265 | loss: nan | val_loss: nan | Time: 2223.24 ms
[2022-04-23 21:56:56	                main:574]	:	INFO	:	Epoch 1266 | loss: nan | val_loss: nan | Time: 2182.06 ms
[2022-04-23 21:56:58	                main:574]	:	INFO	:	Epoch 1267 | loss: nan | val_loss: nan | Time: 1992.99 ms
[2022-04-23 21:57:00	                main:574]	:	INFO	:	Epoch 1268 | loss: nan | val_loss: nan | Time: 2052.16 ms
[2022-04-23 21:57:02	                main:574]	:	INFO	:	Epoch 1269 | loss: nan | val_loss: nan | Time: 2022.87 ms
[2022-04-23 21:57:04	                main:574]	:	INFO	:	Epoch 1270 | loss: nan | val_loss: nan | Time: 2034.3 ms
[2022-04-23 21:57:06	                main:574]	:	INFO	:	Epoch 1271 | loss: nan | val_loss: nan | Time: 2007.28 ms
[2022-04-23 21:57:08	                main:574]	:	INFO	:	Epoch 1272 | loss: nan | val_loss: nan | Time: 2010.19 ms
[2022-04-23 21:57:10	                main:574]	:	INFO	:	Epoch 1273 | loss: nan | val_loss: nan | Time: 2055.66 ms
[2022-04-23 21:57:12	                main:574]	:	INFO	:	Epoch 1274 | loss: nan | val_loss: nan | Time: 2046.76 ms
[2022-04-23 21:57:14	                main:574]	:	INFO	:	Epoch 1275 | loss: nan | val_loss: nan | Time: 2096.45 ms
[2022-04-23 21:57:16	                main:574]	:	INFO	:	Epoch 1276 | loss: nan | val_loss: nan | Time: 2104.22 ms
[2022-04-23 21:57:18	                main:574]	:	INFO	:	Epoch 1277 | loss: nan | val_loss: nan | Time: 2168.22 ms
[2022-04-23 21:57:21	                main:574]	:	INFO	:	Epoch 1278 | loss: nan | val_loss: nan | Time: 2175.4 ms
[2022-04-23 21:57:23	                main:574]	:	INFO	:	Epoch 1279 | loss: nan | val_loss: nan | Time: 2255.18 ms
[2022-04-23 21:57:25	                main:574]	:	INFO	:	Epoch 1280 | loss: nan | val_loss: nan | Time: 2141.71 ms
[2022-04-23 21:57:27	                main:574]	:	INFO	:	Epoch 1281 | loss: nan | val_loss: nan | Time: 2307.51 ms
[2022-04-23 21:57:29	                main:574]	:	INFO	:	Epoch 1282 | loss: nan | val_loss: nan | Time: 2145.96 ms
[2022-04-23 21:57:32	                main:574]	:	INFO	:	Epoch 1283 | loss: nan | val_loss: nan | Time: 2112.92 ms
[2022-04-23 21:57:34	                main:574]	:	INFO	:	Epoch 1284 | loss: nan | val_loss: nan | Time: 2120.63 ms
[2022-04-23 21:57:36	                main:574]	:	INFO	:	Epoch 1285 | loss: nan | val_loss: nan | Time: 2097.11 ms
[2022-04-23 21:57:38	                main:574]	:	INFO	:	Epoch 1286 | loss: nan | val_loss: nan | Time: 2117.37 ms
[2022-04-23 21:57:40	                main:574]	:	INFO	:	Epoch 1287 | loss: nan | val_loss: nan | Time: 2059.93 ms
[2022-04-23 21:57:42	                main:574]	:	INFO	:	Epoch 1288 | loss: nan | val_loss: nan | Time: 2097.51 ms
[2022-04-23 21:57:44	                main:574]	:	INFO	:	Epoch 1289 | loss: nan | val_loss: nan | Time: 2059.68 ms
[2022-04-23 21:57:46	                main:574]	:	INFO	:	Epoch 1290 | loss: nan | val_loss: nan | Time: 2103.79 ms
[2022-04-23 21:57:48	                main:574]	:	INFO	:	Epoch 1291 | loss: nan | val_loss: nan | Time: 2064.5 ms
[2022-04-23 21:57:50	                main:574]	:	INFO	:	Epoch 1292 | loss: nan | val_loss: nan | Time: 2060.1 ms
[2022-04-23 21:57:53	                main:574]	:	INFO	:	Epoch 1293 | loss: nan | val_loss: nan | Time: 2086.95 ms
[2022-04-23 21:57:55	                main:574]	:	INFO	:	Epoch 1294 | loss: nan | val_loss: nan | Time: 2081.51 ms
[2022-04-23 21:57:57	                main:574]	:	INFO	:	Epoch 1295 | loss: nan | val_loss: nan | Time: 2047.69 ms
[2022-04-23 21:57:59	                main:574]	:	INFO	:	Epoch 1296 | loss: nan | val_loss: nan | Time: 2058.58 ms
[2022-04-23 21:58:01	                main:574]	:	INFO	:	Epoch 1297 | loss: nan | val_loss: nan | Time: 2112.28 ms
[2022-04-23 21:58:03	                main:574]	:	INFO	:	Epoch 1298 | loss: nan | val_loss: nan | Time: 2131.99 ms
[2022-04-23 21:58:05	                main:574]	:	INFO	:	Epoch 1299 | loss: nan | val_loss: nan | Time: 2090.93 ms
[2022-04-23 21:58:07	                main:574]	:	INFO	:	Epoch 1300 | loss: nan | val_loss: nan | Time: 2108.16 ms
[2022-04-23 21:58:09	                main:574]	:	INFO	:	Epoch 1301 | loss: nan | val_loss: nan | Time: 2129.09 ms
[2022-04-23 21:58:11	                main:574]	:	INFO	:	Epoch 1302 | loss: nan | val_loss: nan | Time: 2133.21 ms
[2022-04-23 21:58:14	                main:574]	:	INFO	:	Epoch 1303 | loss: nan | val_loss: nan | Time: 2156.5 ms
[2022-04-23 21:58:16	                main:574]	:	INFO	:	Epoch 1304 | loss: nan | val_loss: nan | Time: 2140.28 ms
[2022-04-23 21:58:18	                main:574]	:	INFO	:	Epoch 1305 | loss: nan | val_loss: nan | Time: 2150.72 ms
[2022-04-23 21:58:20	                main:574]	:	INFO	:	Epoch 1306 | loss: nan | val_loss: nan | Time: 2193.89 ms
[2022-04-23 21:58:22	                main:574]	:	INFO	:	Epoch 1307 | loss: nan | val_loss: nan | Time: 2177.66 ms
[2022-04-23 21:58:24	                main:574]	:	INFO	:	Epoch 1308 | loss: nan | val_loss: nan | Time: 2148.11 ms
[2022-04-23 21:58:27	                main:574]	:	INFO	:	Epoch 1309 | loss: nan | val_loss: nan | Time: 2247.77 ms
[2022-04-23 21:58:29	                main:574]	:	INFO	:	Epoch 1310 | loss: nan | val_loss: nan | Time: 2182.52 ms
[2022-04-23 21:58:31	                main:574]	:	INFO	:	Epoch 1311 | loss: nan | val_loss: nan | Time: 2149.24 ms
[2022-04-23 21:58:33	                main:574]	:	INFO	:	Epoch 1312 | loss: nan | val_loss: nan | Time: 2253.17 ms
[2022-04-23 21:58:35	                main:574]	:	INFO	:	Epoch 1313 | loss: nan | val_loss: nan | Time: 2166.98 ms
[2022-04-23 21:58:38	                main:574]	:	INFO	:	Epoch 1314 | loss: nan | val_loss: nan | Time: 2228.51 ms
[2022-04-23 21:58:40	                main:574]	:	INFO	:	Epoch 1315 | loss: nan | val_loss: nan | Time: 2156.36 ms
[2022-04-23 21:58:42	                main:574]	:	INFO	:	Epoch 1316 | loss: nan | val_loss: nan | Time: 2175.41 ms
[2022-04-23 21:58:44	                main:574]	:	INFO	:	Epoch 1317 | loss: nan | val_loss: nan | Time: 2198.13 ms
[2022-04-23 21:58:46	                main:574]	:	INFO	:	Epoch 1318 | loss: nan | val_loss: nan | Time: 2171.45 ms
[2022-04-23 21:58:49	                main:574]	:	INFO	:	Epoch 1319 | loss: nan | val_loss: nan | Time: 2224.33 ms
[2022-04-23 21:58:51	                main:574]	:	INFO	:	Epoch 1320 | loss: nan | val_loss: nan | Time: 2169.49 ms
[2022-04-23 21:58:53	                main:574]	:	INFO	:	Epoch 1321 | loss: nan | val_loss: nan | Time: 2141.52 ms
[2022-04-23 21:58:55	                main:574]	:	INFO	:	Epoch 1322 | loss: nan | val_loss: nan | Time: 2111.61 ms
[2022-04-23 21:58:57	                main:574]	:	INFO	:	Epoch 1323 | loss: nan | val_loss: nan | Time: 2145.94 ms
[2022-04-23 21:58:59	                main:574]	:	INFO	:	Epoch 1324 | loss: nan | val_loss: nan | Time: 2112.83 ms
[2022-04-23 21:59:02	                main:574]	:	INFO	:	Epoch 1325 | loss: nan | val_loss: nan | Time: 2123.95 ms
[2022-04-23 21:59:04	                main:574]	:	INFO	:	Epoch 1326 | loss: nan | val_loss: nan | Time: 2116.23 ms
[2022-04-23 21:59:06	                main:574]	:	INFO	:	Epoch 1327 | loss: nan | val_loss: nan | Time: 2067.12 ms
[2022-04-23 21:59:08	                main:574]	:	INFO	:	Epoch 1328 | loss: nan | val_loss: nan | Time: 2112.74 ms
[2022-04-23 21:59:10	                main:574]	:	INFO	:	Epoch 1329 | loss: nan | val_loss: nan | Time: 2113.56 ms
[2022-04-23 21:59:12	                main:574]	:	INFO	:	Epoch 1330 | loss: nan | val_loss: nan | Time: 2097.42 ms
[2022-04-23 21:59:14	                main:574]	:	INFO	:	Epoch 1331 | loss: nan | val_loss: nan | Time: 2101.08 ms
[2022-04-23 21:59:16	                main:574]	:	INFO	:	Epoch 1332 | loss: nan | val_loss: nan | Time: 2106.54 ms
[2022-04-23 21:59:18	                main:574]	:	INFO	:	Epoch 1333 | loss: nan | val_loss: nan | Time: 2137.57 ms
[2022-04-23 21:59:21	                main:574]	:	INFO	:	Epoch 1334 | loss: nan | val_loss: nan | Time: 2133.62 ms
[2022-04-23 21:59:23	                main:574]	:	INFO	:	Epoch 1335 | loss: nan | val_loss: nan | Time: 2145.57 ms
[2022-04-23 21:59:25	                main:574]	:	INFO	:	Epoch 1336 | loss: nan | val_loss: nan | Time: 2133.97 ms
[2022-04-23 21:59:27	                main:574]	:	INFO	:	Epoch 1337 | loss: nan | val_loss: nan | Time: 2122.69 ms
[2022-04-23 21:59:29	                main:574]	:	INFO	:	Epoch 1338 | loss: nan | val_loss: nan | Time: 2102.75 ms
[2022-04-23 21:59:31	                main:574]	:	INFO	:	Epoch 1339 | loss: nan | val_loss: nan | Time: 2053.44 ms
[2022-04-23 21:59:33	                main:574]	:	INFO	:	Epoch 1340 | loss: nan | val_loss: nan | Time: 2111.79 ms
[2022-04-23 21:59:35	                main:574]	:	INFO	:	Epoch 1341 | loss: nan | val_loss: nan | Time: 2069.52 ms
[2022-04-23 21:59:37	                main:574]	:	INFO	:	Epoch 1342 | loss: nan | val_loss: nan | Time: 2125.07 ms
[2022-04-23 21:59:40	                main:574]	:	INFO	:	Epoch 1343 | loss: nan | val_loss: nan | Time: 2109.75 ms
[2022-04-23 21:59:42	                main:574]	:	INFO	:	Epoch 1344 | loss: nan | val_loss: nan | Time: 2112.98 ms
[2022-04-23 21:59:44	                main:574]	:	INFO	:	Epoch 1345 | loss: nan | val_loss: nan | Time: 2106.99 ms
[2022-04-23 21:59:46	                main:574]	:	INFO	:	Epoch 1346 | loss: nan | val_loss: nan | Time: 2138.18 ms
[2022-04-23 21:59:48	                main:574]	:	INFO	:	Epoch 1347 | loss: nan | val_loss: nan | Time: 2093.41 ms
[2022-04-23 21:59:50	                main:574]	:	INFO	:	Epoch 1348 | loss: nan | val_loss: nan | Time: 2310.78 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 2080 SUPER)
[2022-04-23 22:02:54	                main:435]	:	INFO	:	Set logging level to 1
[2022-04-23 22:02:54	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-04-23 22:02:54	                main:444]	:	INFO	:	Resolving all filenames
[2022-04-23 22:02:54	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-23 22:02:54	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-23 22:02:54	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-23 22:02:54	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-23 22:02:54	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-23 22:02:54	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-04-23 22:02:54	                main:474]	:	INFO	:	Configuration: 
[2022-04-23 22:02:54	                main:475]	:	INFO	:	    Model type: GRU
[2022-04-23 22:02:54	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-04-23 22:02:54	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-04-23 22:02:54	                main:478]	:	INFO	:	    Batch Size: 128
[2022-04-23 22:02:54	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-04-23 22:02:54	                main:480]	:	INFO	:	    Patience: 10
[2022-04-23 22:02:54	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-04-23 22:02:54	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-04-23 22:02:54	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-04-23 22:02:54	                main:484]	:	INFO	:	    # Threads: 1
[2022-04-23 22:02:54	                main:486]	:	INFO	:	Preparing Dataset
[2022-04-23 22:02:54	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-23 22:02:54	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-23 22:02:57	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-04-23 22:02:57	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-23 22:02:57	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-23 22:02:57	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-04-23 22:02:57	                main:494]	:	INFO	:	Creating Model
[2022-04-23 22:02:57	                main:507]	:	INFO	:	Preparing config file
[2022-04-23 22:02:57	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-04-23 22:02:57	                main:512]	:	INFO	:	Loading config


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFF4D5A4F69

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 04/23/22 22:02:57
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\0;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 0000000040e00000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000004fa90000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 000000004f750000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1645) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 000000004d570000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1645) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 000000004f810000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.19041.1645 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1645

ModLoad: 000000004d2e0000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1645) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.19041.1645 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1645

ModLoad: 000000004ddd0000 000000000002a000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1620) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.19041.1620 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1620

ModLoad: 000000004d410000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1620) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.19041.1620 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1620

ModLoad: 000000004da50000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 000000004d1e0000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 000000004db00000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000004e670000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.19041.546

ModLoad: 000000004f9b0000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.1586) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000004e910000 0000000000125000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1645) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000194c0000 0000000000058000 C:\ProgramData\BOINC\slots\0\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000034420000 000000000008d000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.29.30139.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\12\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.29.30139.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.29.30139.0

ModLoad: 0000000039e80000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.867

ModLoad: 00000000342f0000 000000000001b000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.29.30139.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\12\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.29.30139.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.29.30139.0

ModLoad: 0000000036330000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.29.30139.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\12\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.29.30139.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.29.30139.0

ModLoad: 00000000d3a60000 0000000024b49000 C:\ProgramData\BOINC\slots\0\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000019470000 0000000000045000 C:\ProgramData\BOINC\slots\0\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000d05a0000 00000000034b2000 C:\ProgramData\BOINC\slots\0\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000c59b0000 000000000abe7000 C:\ProgramData\BOINC\slots\0\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000c2900000 00000000030a5000 C:\ProgramData\BOINC\slots\0\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 0000000038f50000 0000000000010000 C:\ProgramData\BOINC\slots\0\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 00000000a7550000 000000001b3a4000 C:\ProgramData\BOINC\slots\0\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 0000000019260000 000000000020d000 C:\ProgramData\BOINC\slots\0\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 00000000a7270000 00000000002db000 C:\ProgramData\BOINC\slots\0\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000019220000 0000000000040000 C:\ProgramData\BOINC\slots\0\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000a3510000 0000000003d5b000 C:\ProgramData\BOINC\slots\0\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 000000009a370000 000000000919f000 C:\ProgramData\BOINC\slots\0\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000984a0000 0000000001eca000 C:\ProgramData\BOINC\slots\0\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 000000004f6c0000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000004ba80000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000004ef60000 000000000046a000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1620) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.19041.1645 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1645

ModLoad: 000000004d520000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1620) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.19041.1620 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1620

ModLoad: 000000004d1b0000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000004cf60000 000000000002c000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1620) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.19041.1620 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1620

ModLoad: 000000004d310000 0000000000068000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 000000004d840000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.19041.1645 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1645

ModLoad: 000000004cda0000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000004df20000 0000000000744000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.19041.1645 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1645

ModLoad: 000000004b2d0000 0000000000794000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.19041.1645 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1645

ModLoad: 000000004ec00000 0000000000354000 C:\WINDOWS\System32\combase.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.19041.1320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1320

ModLoad: 000000004cc20000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000004e7d0000 00000000000ad000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1645) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.19041.1645 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1645

ModLoad: 000000004e770000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.19041.1645 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1645

ModLoad: 00000000981e0000 00000000002b9000 C:\WINDOWS\system32\nvcuda.dll (30.0.14.9676) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r495\r496_65\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 30.0.14.9676
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.5.107 driver
    Product Version       : 30.0.14.9676

ModLoad: 0000000096b60000 0000000001679000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_b7184c0e1c94c102\nvcuda64.dll (30.0.14.9676) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r495\r496_65\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 30.0.14.9676
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.5.107 driver
    Product Version       : 30.0.14.9676

ModLoad: 000000004aae0000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000044fb0000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.19041.906 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.906

ModLoad: 0000000040180000 0000000000148000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : drvstore.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 000000004cb90000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000003c4b0000 0000000000761000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.14.9676) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r495\r496_65\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 30.0.14.9676
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 30.0.14.9676

ModLoad: 000000004d380000 0000000000082000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.19041.1415 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1415



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3610, Write: 308, Other 928

- I/O Transfers Counters -
Read: 6677731, Write: 6063, Other 28930

- Paged Pool Usage -
QuotaPagedPoolUsage: 3447216, QuotaPeakPagedPoolUsage: 3447216
QuotaNonPagedPoolUsage: 37392, QuotaPeakNonPagedPoolUsage: 37456

- Virtual Memory Usage -
VirtualSize: -1217478656, PeakVirtualSize: -619630592

- Pagefile Usage -
PagefileUsage: -1217478656, PeakPagefileUsage: -1217478656

- Working Set Size -
WorkingSetSize: 1224200192, PeakWorkingSetSize: 1224204288, PageFaultCount: 424317

*** Dump of thread ID 15116 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 5000000.000000, User Time: 14375000.000000, Wait Time: 10381.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFF4D5A4F69

- Registers -
rax=0000000058ae6078 rbx=0000000041164910 rcx=000000003ca75900 rdx=000000004fab5b00 rsi=0000000058ae68e0 rdi=0000000019930520
r8=0000000058ae60a0 r9=0000000058ae60c8 r10=0000000000000004 r11=0000000058ae60d8 r12=0000000016384a40 r13=0000000058ae6af0
r14=00000000399088c0 r15=0000000000000000 rip=000000004d5a4f69 rsp=0000000058ae6780 rbp=0000000058ae6a70
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
58ae6850 4107a884 00000040 0000004f 16384b00 000001c6 KERNELBASE!RaiseException+0x0 
58ae68b0 40e21ca6 00000004 4fa90000 166ff9a0 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
58ae6960 40e2593b 00000000 00000030 00000020 00000008 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
58ae6ab0 40e21a78 00000000 00000000 58ae6de0 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
58ae6b80 40e21cfc 58ae6de0 00000000 00000080 58ae70b0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
58ae6c40 40e2c4dd 58ae70b0 58ae70b0 58ae70b0 58ae70b0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
58ae6f30 40e1b2fe 58ae7548 58ae70b0 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
58affcd0 4105c6f8 514beb80 00000000 00000000 5149e980 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
58affd10 4f767034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
58affd40 4fae2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
58affdc0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 14228 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 10168.000000

- Registers -
rax=00000000000001d3 rbx=000000004fa95c60 rcx=0000000000000074 rdx=000000004fa958e0 rsi=000000004fa93a10 rdi=000000004fa95c60
r8=00000000000003b6 r9=00000000000003b6 r10=0000000000000003 r11=000000000000076a r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000004fb307c4 rsp=0000000058bff578 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
58bff570 4fae2dc7 00000000 00000000 4fa93a10 4fa95c60 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
58bff870 4f767034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
58bff8a0 4fae2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
58bff920 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 8604 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 10168.000000

- Registers -
rax=00000000000001d3 rbx=000000004fa96090 rcx=0000000000000074 rdx=000000004fa95d10 rsi=000000004fa93a10 rdi=000000004fa96090
r8=0000000000000008 r9=0000000000000040 r10=00000000000001c0 r11=000000001858010c r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000004fb307c4 rsp=0000000058cff788 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
58cff780 4fae2dc7 00000000 00000000 4fa93a10 4fa96090 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
58cffa80 4f767034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
58cffab0 4fae2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
58cffb30 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 14468 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 10168.000000

- Registers -
rax=00000000000001d3 rbx=000000004fa96910 rcx=0000000000000074 rdx=000000004fa96590 rsi=000000004fa93a10 rdi=000000004fa96910
r8=0000000058dff118 r9=0000000058dff1b9 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000004fb307c4 rsp=0000000058dff558 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
58dff550 4fae2dc7 00000000 00000000 4fa93a10 4fa96910 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
58dff850 4f767034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
58dff880 4fae2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
58dff900 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 12604 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 10378.000000

- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=0000000058fffc70 rsi=0000000000000000 rdi=0000000000000064
r8=0000000058ffed68 r9=0000000058ffed38 r10=0000000000000020 r11=0000000000000ff0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000004fb2d3f4 rsp=0000000058fffc48 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
58fffc40 4d5b962e 58fffd08 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0 
58fffce0 40e3a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0 
58fffd10 4f767034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
58fffd40 4fae2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
58fffdc0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 2212 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 10378.000000

- Registers -
rax=000000000000005b rbx=000000000000000e rcx=000000000000000e rdx=00000000590ff7a0 rsi=0000000000000000 rdi=000000000000000e
r8=00000000590ff448 r9=00000000516fbec0 r10=0000000000000000 r11=00000000590ff710 r12=0000000000000064 r13=00000000590ff7a0
r14=00000000590ff4a0 r15=0000000000000000 rip=000000004fb2d8c4 rsp=00000000590ff448 rbp=00000000516fbec0
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
590ff440 4d5bcb10 00000000 58901000 4fbfa4d0 58901000 ntdll!ZwWaitForMultipleObjects+0x0 
590ff730 4d5bca0e 4faa2ef0 004e0049 0000000e 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
590ff770 96d35be4 516fe080 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
590ff9b0 96ddd15d 00000000 516fbec0 00000000 00000000 nvcuda64!+0x0 
590ffa60 96d355b3 6100e98f 5f61d8c5 51ce19a0 00000000 nvcuda64!cuProfilerStop+0x0 
590ffa90 97064264 51ce19a0 00000000 00000000 00000000 nvcuda64!+0x0 
590ffac0 4f767034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
590ffaf0 4fae2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
590ffb70 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 9924 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 10224.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002bc rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002bc
r8=00000000591ffdc8 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=00000000516b5440 r13=0000000000000000
r14=00000000000002bc r15=0000000000000000 rip=000000004fb2cdf4 rsp=00000000591ffb48 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
591ffb40 4d591a5e 00000000 00001f80 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0 
591ffbe0 96f595ee 51ce1790 00000000 00000000 000002bc KERNELBASE!WaitForSingleObjectEx+0x0 
591ffe20 96d355b3 00000000 51ce1790 96b60000 51718130 nvcuda64!cuProfilerStop+0x0 
591ffe50 97064264 51ce1790 00000000 00000000 00000000 nvcuda64!+0x0 
591ffe80 4f767034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
591ffeb0 4fae2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
591fff30 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)