Task 8425977

Name ParityModified-1634617226-6934-1_0
Workunit 5932710
Created 26 Oct 2021, 14:42:12 UTC
Sent 29 Oct 2021, 8:48:49 UTC
Report deadline 5 Nov 2021, 8:48:49 UTC
Received 8 Nov 2021, 7:29:10 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 6145
Run time 58 min 30 sec
CPU time 57 min 24 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 1,442.88 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.54 GB
Peak swap size 3.44 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
ss: nan | val_loss: nan | Time: 2764.6 ms
[2021-11-08 00:15:08	                main:574]	:	INFO	:	Epoch 1047 | loss: nan | val_loss: nan | Time: 2761.84 ms
[2021-11-08 00:15:10	                main:574]	:	INFO	:	Epoch 1048 | loss: nan | val_loss: nan | Time: 2768.94 ms
[2021-11-08 00:15:13	                main:574]	:	INFO	:	Epoch 1049 | loss: nan | val_loss: nan | Time: 2767.71 ms
[2021-11-08 00:15:16	                main:574]	:	INFO	:	Epoch 1050 | loss: nan | val_loss: nan | Time: 2765.84 ms
[2021-11-08 00:15:19	                main:574]	:	INFO	:	Epoch 1051 | loss: nan | val_loss: nan | Time: 2771.18 ms
[2021-11-08 00:15:21	                main:574]	:	INFO	:	Epoch 1052 | loss: nan | val_loss: nan | Time: 2773.33 ms
[2021-11-08 00:15:24	                main:574]	:	INFO	:	Epoch 1053 | loss: nan | val_loss: nan | Time: 2763.79 ms
[2021-11-08 00:15:27	                main:574]	:	INFO	:	Epoch 1054 | loss: nan | val_loss: nan | Time: 2761.83 ms
[2021-11-08 00:15:30	                main:574]	:	INFO	:	Epoch 1055 | loss: nan | val_loss: nan | Time: 2764.09 ms
[2021-11-08 00:15:32	                main:574]	:	INFO	:	Epoch 1056 | loss: nan | val_loss: nan | Time: 2764.9 ms
[2021-11-08 00:15:35	                main:574]	:	INFO	:	Epoch 1057 | loss: nan | val_loss: nan | Time: 2768.26 ms
[2021-11-08 00:15:38	                main:574]	:	INFO	:	Epoch 1058 | loss: nan | val_loss: nan | Time: 2767.63 ms
[2021-11-08 00:15:41	                main:574]	:	INFO	:	Epoch 1059 | loss: nan | val_loss: nan | Time: 2767.39 ms
[2021-11-08 00:15:44	                main:574]	:	INFO	:	Epoch 1060 | loss: nan | val_loss: nan | Time: 2768.05 ms
[2021-11-08 00:15:46	                main:574]	:	INFO	:	Epoch 1061 | loss: nan | val_loss: nan | Time: 2764.35 ms
[2021-11-08 00:15:49	                main:574]	:	INFO	:	Epoch 1062 | loss: nan | val_loss: nan | Time: 2763.49 ms
[2021-11-08 00:15:52	                main:574]	:	INFO	:	Epoch 1063 | loss: nan | val_loss: nan | Time: 2767.6 ms
[2021-11-08 00:15:55	                main:574]	:	INFO	:	Epoch 1064 | loss: nan | val_loss: nan | Time: 2763.56 ms
[2021-11-08 00:15:57	                main:574]	:	INFO	:	Epoch 1065 | loss: nan | val_loss: nan | Time: 2759.91 ms
[2021-11-08 00:16:00	                main:574]	:	INFO	:	Epoch 1066 | loss: nan | val_loss: nan | Time: 2769.3 ms
[2021-11-08 00:16:03	                main:574]	:	INFO	:	Epoch 1067 | loss: nan | val_loss: nan | Time: 2763.27 ms
[2021-11-08 00:16:06	                main:574]	:	INFO	:	Epoch 1068 | loss: nan | val_loss: nan | Time: 2763.99 ms
[2021-11-08 00:16:08	                main:574]	:	INFO	:	Epoch 1069 | loss: nan | val_loss: nan | Time: 2764.55 ms
[2021-11-08 00:16:11	                main:574]	:	INFO	:	Epoch 1070 | loss: nan | val_loss: nan | Time: 2766.47 ms
[2021-11-08 00:16:14	                main:574]	:	INFO	:	Epoch 1071 | loss: nan | val_loss: nan | Time: 2768.37 ms
[2021-11-08 00:16:17	                main:574]	:	INFO	:	Epoch 1072 | loss: nan | val_loss: nan | Time: 2815.54 ms
[2021-11-08 00:16:20	                main:574]	:	INFO	:	Epoch 1073 | loss: nan | val_loss: nan | Time: 2766.99 ms
[2021-11-08 00:16:22	                main:574]	:	INFO	:	Epoch 1074 | loss: nan | val_loss: nan | Time: 2761.77 ms
[2021-11-08 00:16:25	                main:574]	:	INFO	:	Epoch 1075 | loss: nan | val_loss: nan | Time: 2774.65 ms
[2021-11-08 00:16:28	                main:574]	:	INFO	:	Epoch 1076 | loss: nan | val_loss: nan | Time: 2767.16 ms
[2021-11-08 00:16:31	                main:574]	:	INFO	:	Epoch 1077 | loss: nan | val_loss: nan | Time: 2760.43 ms
[2021-11-08 00:16:33	                main:574]	:	INFO	:	Epoch 1078 | loss: nan | val_loss: nan | Time: 2762.72 ms
[2021-11-08 00:16:36	                main:574]	:	INFO	:	Epoch 1079 | loss: nan | val_loss: nan | Time: 2768.31 ms
[2021-11-08 00:16:39	                main:574]	:	INFO	:	Epoch 1080 | loss: nan | val_loss: nan | Time: 2762.92 ms
[2021-11-08 00:16:42	                main:574]	:	INFO	:	Epoch 1081 | loss: nan | val_loss: nan | Time: 2764.9 ms
[2021-11-08 00:16:45	                main:574]	:	INFO	:	Epoch 1082 | loss: nan | val_loss: nan | Time: 2764.49 ms
[2021-11-08 00:16:47	                main:574]	:	INFO	:	Epoch 1083 | loss: nan | val_loss: nan | Time: 2770.87 ms
[2021-11-08 00:16:50	                main:574]	:	INFO	:	Epoch 1084 | loss: nan | val_loss: nan | Time: 2768.6 ms
[2021-11-08 00:16:53	                main:574]	:	INFO	:	Epoch 1085 | loss: nan | val_loss: nan | Time: 2770.91 ms
[2021-11-08 00:16:56	                main:574]	:	INFO	:	Epoch 1086 | loss: nan | val_loss: nan | Time: 2767.34 ms
[2021-11-08 00:16:58	                main:574]	:	INFO	:	Epoch 1087 | loss: nan | val_loss: nan | Time: 2777.2 ms
[2021-11-08 00:17:01	                main:574]	:	INFO	:	Epoch 1088 | loss: nan | val_loss: nan | Time: 2766.16 ms
[2021-11-08 00:17:04	                main:574]	:	INFO	:	Epoch 1089 | loss: nan | val_loss: nan | Time: 2758.69 ms
[2021-11-08 00:17:07	                main:574]	:	INFO	:	Epoch 1090 | loss: nan | val_loss: nan | Time: 2775.45 ms
[2021-11-08 00:17:09	                main:574]	:	INFO	:	Epoch 1091 | loss: nan | val_loss: nan | Time: 2758.5 ms
[2021-11-08 00:17:12	                main:574]	:	INFO	:	Epoch 1092 | loss: nan | val_loss: nan | Time: 2768.2 ms
[2021-11-08 00:17:15	                main:574]	:	INFO	:	Epoch 1093 | loss: nan | val_loss: nan | Time: 2767.33 ms
[2021-11-08 00:17:18	                main:574]	:	INFO	:	Epoch 1094 | loss: nan | val_loss: nan | Time: 2764.43 ms
[2021-11-08 00:17:21	                main:574]	:	INFO	:	Epoch 1095 | loss: nan | val_loss: nan | Time: 2771.31 ms
[2021-11-08 00:17:23	                main:574]	:	INFO	:	Epoch 1096 | loss: nan | val_loss: nan | Time: 2765.03 ms
[2021-11-08 00:17:26	                main:574]	:	INFO	:	Epoch 1097 | loss: nan | val_loss: nan | Time: 2767.93 ms
[2021-11-08 00:17:29	                main:574]	:	INFO	:	Epoch 1098 | loss: nan | val_loss: nan | Time: 2762.78 ms
[2021-11-08 00:17:32	                main:574]	:	INFO	:	Epoch 1099 | loss: nan | val_loss: nan | Time: 2767.97 ms
[2021-11-08 00:17:34	                main:574]	:	INFO	:	Epoch 1100 | loss: nan | val_loss: nan | Time: 2760.35 ms
[2021-11-08 00:17:37	                main:574]	:	INFO	:	Epoch 1101 | loss: nan | val_loss: nan | Time: 2768.27 ms
[2021-11-08 00:17:40	                main:574]	:	INFO	:	Epoch 1102 | loss: nan | val_loss: nan | Time: 2768.11 ms
[2021-11-08 00:17:43	                main:574]	:	INFO	:	Epoch 1103 | loss: nan | val_loss: nan | Time: 2767.64 ms
[2021-11-08 00:17:45	                main:574]	:	INFO	:	Epoch 1104 | loss: nan | val_loss: nan | Time: 2766.86 ms
[2021-11-08 00:17:48	                main:574]	:	INFO	:	Epoch 1105 | loss: nan | val_loss: nan | Time: 2775.62 ms
[2021-11-08 00:17:51	                main:574]	:	INFO	:	Epoch 1106 | loss: nan | val_loss: nan | Time: 2770.37 ms
[2021-11-08 00:17:54	                main:574]	:	INFO	:	Epoch 1107 | loss: nan | val_loss: nan | Time: 2773.27 ms
[2021-11-08 00:17:57	                main:574]	:	INFO	:	Epoch 1108 | loss: nan | val_loss: nan | Time: 2768.79 ms
[2021-11-08 00:17:59	                main:574]	:	INFO	:	Epoch 1109 | loss: nan | val_loss: nan | Time: 2799.7 ms
[2021-11-08 00:18:02	                main:574]	:	INFO	:	Epoch 1110 | loss: nan | val_loss: nan | Time: 2780.92 ms
[2021-11-08 00:18:05	                main:574]	:	INFO	:	Epoch 1111 | loss: nan | val_loss: nan | Time: 2766.01 ms
[2021-11-08 00:18:08	                main:574]	:	INFO	:	Epoch 1112 | loss: nan | val_loss: nan | Time: 2768.44 ms
[2021-11-08 00:18:11	                main:574]	:	INFO	:	Epoch 1113 | loss: nan | val_loss: nan | Time: 2768.34 ms
[2021-11-08 00:18:13	                main:574]	:	INFO	:	Epoch 1114 | loss: nan | val_loss: nan | Time: 2772.83 ms
[2021-11-08 00:18:16	                main:574]	:	INFO	:	Epoch 1115 | loss: nan | val_loss: nan | Time: 2762.97 ms
[2021-11-08 00:18:19	                main:574]	:	INFO	:	Epoch 1116 | loss: nan | val_loss: nan | Time: 2772.76 ms
[2021-11-08 00:18:22	                main:574]	:	INFO	:	Epoch 1117 | loss: nan | val_loss: nan | Time: 2761.99 ms
[2021-11-08 00:18:24	                main:574]	:	INFO	:	Epoch 1118 | loss: nan | val_loss: nan | Time: 2770.06 ms
[2021-11-08 00:18:27	                main:574]	:	INFO	:	Epoch 1119 | loss: nan | val_loss: nan | Time: 2763.91 ms
[2021-11-08 00:18:30	                main:574]	:	INFO	:	Epoch 1120 | loss: nan | val_loss: nan | Time: 2768.06 ms
[2021-11-08 00:18:33	                main:574]	:	INFO	:	Epoch 1121 | loss: nan | val_loss: nan | Time: 2763.22 ms
[2021-11-08 00:18:35	                main:574]	:	INFO	:	Epoch 1122 | loss: nan | val_loss: nan | Time: 2760.82 ms
[2021-11-08 00:18:38	                main:574]	:	INFO	:	Epoch 1123 | loss: nan | val_loss: nan | Time: 2764.41 ms
[2021-11-08 00:18:41	                main:574]	:	INFO	:	Epoch 1124 | loss: nan | val_loss: nan | Time: 2767.17 ms
[2021-11-08 00:18:44	                main:574]	:	INFO	:	Epoch 1125 | loss: nan | val_loss: nan | Time: 2763.18 ms
[2021-11-08 00:18:47	                main:574]	:	INFO	:	Epoch 1126 | loss: nan | val_loss: nan | Time: 2764.89 ms
[2021-11-08 00:18:49	                main:574]	:	INFO	:	Epoch 1127 | loss: nan | val_loss: nan | Time: 2766.25 ms
[2021-11-08 00:18:52	                main:574]	:	INFO	:	Epoch 1128 | loss: nan | val_loss: nan | Time: 2763.86 ms
[2021-11-08 00:18:55	                main:574]	:	INFO	:	Epoch 1129 | loss: nan | val_loss: nan | Time: 2762.19 ms
[2021-11-08 00:18:58	                main:574]	:	INFO	:	Epoch 1130 | loss: nan | val_loss: nan | Time: 2761.45 ms
[2021-11-08 00:19:00	                main:574]	:	INFO	:	Epoch 1131 | loss: nan | val_loss: nan | Time: 2767.35 ms
[2021-11-08 00:19:03	                main:574]	:	INFO	:	Epoch 1132 | loss: nan | val_loss: nan | Time: 2765.3 ms
[2021-11-08 00:19:06	                main:574]	:	INFO	:	Epoch 1133 | loss: nan | val_loss: nan | Time: 2763.7 ms
[2021-11-08 00:19:09	                main:574]	:	INFO	:	Epoch 1134 | loss: nan | val_loss: nan | Time: 2765.92 ms
[2021-11-08 00:19:11	                main:574]	:	INFO	:	Epoch 1135 | loss: nan | val_loss: nan | Time: 2758.79 ms
[2021-11-08 00:19:14	                main:574]	:	INFO	:	Epoch 1136 | loss: nan | val_loss: nan | Time: 2766.8 ms
[2021-11-08 00:19:17	                main:574]	:	INFO	:	Epoch 1137 | loss: nan | val_loss: nan | Time: 2763.93 ms
[2021-11-08 00:19:20	                main:574]	:	INFO	:	Epoch 1138 | loss: nan | val_loss: nan | Time: 2766.24 ms
[2021-11-08 00:19:23	                main:574]	:	INFO	:	Epoch 1139 | loss: nan | val_loss: nan | Time: 2766.81 ms
[2021-11-08 00:19:25	                main:574]	:	INFO	:	Epoch 1140 | loss: nan | val_loss: nan | Time: 2769.78 ms
[2021-11-08 00:19:28	                main:574]	:	INFO	:	Epoch 1141 | loss: nan | val_loss: nan | Time: 2769.09 ms
[2021-11-08 00:19:31	                main:574]	:	INFO	:	Epoch 1142 | loss: nan | val_loss: nan | Time: 2759.26 ms
[2021-11-08 00:19:34	                main:574]	:	INFO	:	Epoch 1143 | loss: nan | val_loss: nan | Time: 2769.66 ms
[2021-11-08 00:19:36	                main:574]	:	INFO	:	Epoch 1144 | loss: nan | val_loss: nan | Time: 2772.1 ms
[2021-11-08 00:19:39	                main:574]	:	INFO	:	Epoch 1145 | loss: nan | val_loss: nan | Time: 2767.64 ms
[2021-11-08 00:19:42	                main:574]	:	INFO	:	Epoch 1146 | loss: nan | val_loss: nan | Time: 2768.67 ms
[2021-11-08 00:19:45	                main:574]	:	INFO	:	Epoch 1147 | loss: nan | val_loss: nan | Time: 2768.81 ms
[2021-11-08 00:19:47	                main:574]	:	INFO	:	Epoch 1148 | loss: nan | val_loss: nan | Time: 2768.86 ms
[2021-11-08 00:19:50	                main:574]	:	INFO	:	Epoch 1149 | loss: nan | val_loss: nan | Time: 2762.32 ms
[2021-11-08 00:19:53	                main:574]	:	INFO	:	Epoch 1150 | loss: nan | val_loss: nan | Time: 2763.61 ms
[2021-11-08 00:19:56	                main:574]	:	INFO	:	Epoch 1151 | loss: nan | val_loss: nan | Time: 2762.44 ms
[2021-11-08 00:19:59	                main:574]	:	INFO	:	Epoch 1152 | loss: nan | val_loss: nan | Time: 2764.33 ms
[2021-11-08 00:20:01	                main:574]	:	INFO	:	Epoch 1153 | loss: nan | val_loss: nan | Time: 2766.05 ms
[2021-11-08 00:20:04	                main:574]	:	INFO	:	Epoch 1154 | loss: nan | val_loss: nan | Time: 2768.65 ms
[2021-11-08 00:20:07	                main:574]	:	INFO	:	Epoch 1155 | loss: nan | val_loss: nan | Time: 2766.14 ms
[2021-11-08 00:20:10	                main:574]	:	INFO	:	Epoch 1156 | loss: nan | val_loss: nan | Time: 2771.08 ms
[2021-11-08 00:20:12	                main:574]	:	INFO	:	Epoch 1157 | loss: nan | val_loss: nan | Time: 2764.75 ms
[2021-11-08 00:20:15	                main:574]	:	INFO	:	Epoch 1158 | loss: nan | val_loss: nan | Time: 2773.15 ms
[2021-11-08 00:20:18	                main:574]	:	INFO	:	Epoch 1159 | loss: nan | val_loss: nan | Time: 2765.41 ms
[2021-11-08 00:20:21	                main:574]	:	INFO	:	Epoch 1160 | loss: nan | val_loss: nan | Time: 2768.54 ms
[2021-11-08 00:20:23	                main:574]	:	INFO	:	Epoch 1161 | loss: nan | val_loss: nan | Time: 2764.27 ms
[2021-11-08 00:20:26	                main:574]	:	INFO	:	Epoch 1162 | loss: nan | val_loss: nan | Time: 2761.93 ms
[2021-11-08 00:20:29	                main:574]	:	INFO	:	Epoch 1163 | loss: nan | val_loss: nan | Time: 2763.04 ms
[2021-11-08 00:20:32	                main:574]	:	INFO	:	Epoch 1164 | loss: nan | val_loss: nan | Time: 2767.05 ms
[2021-11-08 00:20:35	                main:574]	:	INFO	:	Epoch 1165 | loss: nan | val_loss: nan | Time: 2768.41 ms
[2021-11-08 00:20:37	                main:574]	:	INFO	:	Epoch 1166 | loss: nan | val_loss: nan | Time: 2767.93 ms
[2021-11-08 00:20:40	                main:574]	:	INFO	:	Epoch 1167 | loss: nan | val_loss: nan | Time: 2765.8 ms
[2021-11-08 00:20:43	                main:574]	:	INFO	:	Epoch 1168 | loss: nan | val_loss: nan | Time: 2767.13 ms
[2021-11-08 00:20:46	                main:574]	:	INFO	:	Epoch 1169 | loss: nan | val_loss: nan | Time: 2764.08 ms
[2021-11-08 00:20:48	                main:574]	:	INFO	:	Epoch 1170 | loss: nan | val_loss: nan | Time: 2766.01 ms
[2021-11-08 00:20:51	                main:574]	:	INFO	:	Epoch 1171 | loss: nan | val_loss: nan | Time: 2759.8 ms
[2021-11-08 00:20:54	                main:574]	:	INFO	:	Epoch 1172 | loss: nan | val_loss: nan | Time: 2766.97 ms
[2021-11-08 00:20:57	                main:574]	:	INFO	:	Epoch 1173 | loss: nan | val_loss: nan | Time: 2764.44 ms
[2021-11-08 00:20:59	                main:574]	:	INFO	:	Epoch 1174 | loss: nan | val_loss: nan | Time: 2767.77 ms
[2021-11-08 00:21:02	                main:574]	:	INFO	:	Epoch 1175 | loss: nan | val_loss: nan | Time: 2767.37 ms
[2021-11-08 00:21:05	                main:574]	:	INFO	:	Epoch 1176 | loss: nan | val_loss: nan | Time: 2760.46 ms
[2021-11-08 00:21:08	                main:574]	:	INFO	:	Epoch 1177 | loss: nan | val_loss: nan | Time: 2763.16 ms
[2021-11-08 00:21:11	                main:574]	:	INFO	:	Epoch 1178 | loss: nan | val_loss: nan | Time: 2773.38 ms
[2021-11-08 00:21:13	                main:574]	:	INFO	:	Epoch 1179 | loss: nan | val_loss: nan | Time: 2764.33 ms
[2021-11-08 00:21:16	                main:574]	:	INFO	:	Epoch 1180 | loss: nan | val_loss: nan | Time: 2763.58 ms
[2021-11-08 00:21:19	                main:574]	:	INFO	:	Epoch 1181 | loss: nan | val_loss: nan | Time: 2768.23 ms
[2021-11-08 00:21:22	                main:574]	:	INFO	:	Epoch 1182 | loss: nan | val_loss: nan | Time: 2767.18 ms
[2021-11-08 00:21:24	                main:574]	:	INFO	:	Epoch 1183 | loss: nan | val_loss: nan | Time: 2770.72 ms
[2021-11-08 00:21:27	                main:574]	:	INFO	:	Epoch 1184 | loss: nan | val_loss: nan | Time: 2764.62 ms
[2021-11-08 00:21:30	                main:574]	:	INFO	:	Epoch 1185 | loss: nan | val_loss: nan | Time: 2765.6 ms
[2021-11-08 00:21:33	                main:574]	:	INFO	:	Epoch 1186 | loss: nan | val_loss: nan | Time: 2767.4 ms
[2021-11-08 00:21:35	                main:574]	:	INFO	:	Epoch 1187 | loss: nan | val_loss: nan | Time: 2767 ms
[2021-11-08 00:21:38	                main:574]	:	INFO	:	Epoch 1188 | loss: nan | val_loss: nan | Time: 2763.4 ms
[2021-11-08 00:21:41	                main:574]	:	INFO	:	Epoch 1189 | loss: nan | val_loss: nan | Time: 2759.4 ms
[2021-11-08 00:21:44	                main:574]	:	INFO	:	Epoch 1190 | loss: nan | val_loss: nan | Time: 2767.5 ms
[2021-11-08 00:21:47	                main:574]	:	INFO	:	Epoch 1191 | loss: nan | val_loss: nan | Time: 2762.48 ms
[2021-11-08 00:21:49	                main:574]	:	INFO	:	Epoch 1192 | loss: nan | val_loss: nan | Time: 2762.83 ms
[2021-11-08 00:21:52	                main:574]	:	INFO	:	Epoch 1193 | loss: nan | val_loss: nan | Time: 2767.99 ms
[2021-11-08 00:21:55	                main:574]	:	INFO	:	Epoch 1194 | loss: nan | val_loss: nan | Time: 2761.89 ms
[2021-11-08 00:21:58	                main:574]	:	INFO	:	Epoch 1195 | loss: nan | val_loss: nan | Time: 2762.3 ms
[2021-11-08 00:22:00	                main:574]	:	INFO	:	Epoch 1196 | loss: nan | val_loss: nan | Time: 2762.07 ms
[2021-11-08 00:22:03	                main:574]	:	INFO	:	Epoch 1197 | loss: nan | val_loss: nan | Time: 2766.91 ms
[2021-11-08 00:22:06	                main:574]	:	INFO	:	Epoch 1198 | loss: nan | val_loss: nan | Time: 2763.44 ms
[2021-11-08 00:22:09	                main:574]	:	INFO	:	Epoch 1199 | loss: nan | val_loss: nan | Time: 2764.18 ms
[2021-11-08 00:22:12	                main:574]	:	INFO	:	Epoch 1200 | loss: nan | val_loss: nan | Time: 3331.85 ms
[2021-11-08 00:22:15	                main:574]	:	INFO	:	Epoch 1201 | loss: nan | val_loss: nan | Time: 2760.09 ms
[2021-11-08 00:22:18	                main:574]	:	INFO	:	Epoch 1202 | loss: nan | val_loss: nan | Time: 2765.07 ms
[2021-11-08 00:22:20	                main:574]	:	INFO	:	Epoch 1203 | loss: nan | val_loss: nan | Time: 2767.54 ms
[2021-11-08 00:22:23	                main:574]	:	INFO	:	Epoch 1204 | loss: nan | val_loss: nan | Time: 2770.64 ms
[2021-11-08 00:22:26	                main:574]	:	INFO	:	Epoch 1205 | loss: nan | val_loss: nan | Time: 2765.07 ms
[2021-11-08 00:22:29	                main:574]	:	INFO	:	Epoch 1206 | loss: nan | val_loss: nan | Time: 2778.1 ms
[2021-11-08 00:22:31	                main:574]	:	INFO	:	Epoch 1207 | loss: nan | val_loss: nan | Time: 2769.57 ms
[2021-11-08 00:22:34	                main:574]	:	INFO	:	Epoch 1208 | loss: nan | val_loss: nan | Time: 2766.74 ms
[2021-11-08 00:22:37	                main:574]	:	INFO	:	Epoch 1209 | loss: nan | val_loss: nan | Time: 2766.26 ms
[2021-11-08 00:22:40	                main:574]	:	INFO	:	Epoch 1210 | loss: nan | val_loss: nan | Time: 2802.7 ms
[2021-11-08 00:22:43	                main:574]	:	INFO	:	Epoch 1211 | loss: nan | val_loss: nan | Time: 2764.44 ms
[2021-11-08 00:22:45	                main:574]	:	INFO	:	Epoch 1212 | loss: nan | val_loss: nan | Time: 2768.07 ms
[2021-11-08 00:22:48	                main:574]	:	INFO	:	Epoch 1213 | loss: nan | val_loss: nan | Time: 2781.47 ms
[2021-11-08 00:22:51	                main:574]	:	INFO	:	Epoch 1214 | loss: nan | val_loss: nan | Time: 2787.13 ms
[2021-11-08 00:22:54	                main:574]	:	INFO	:	Epoch 1215 | loss: nan | val_loss: nan | Time: 2773.06 ms
[2021-11-08 00:22:56	                main:574]	:	INFO	:	Epoch 1216 | loss: nan | val_loss: nan | Time: 2771.17 ms
[2021-11-08 00:22:59	                main:574]	:	INFO	:	Epoch 1217 | loss: nan | val_loss: nan | Time: 2764.45 ms
[2021-11-08 00:23:02	                main:574]	:	INFO	:	Epoch 1218 | loss: nan | val_loss: nan | Time: 2756.76 ms
[2021-11-08 00:23:05	                main:574]	:	INFO	:	Epoch 1219 | loss: nan | val_loss: nan | Time: 2760.05 ms
[2021-11-08 00:23:08	                main:574]	:	INFO	:	Epoch 1220 | loss: nan | val_loss: nan | Time: 2756.5 ms
[2021-11-08 00:23:10	                main:574]	:	INFO	:	Epoch 1221 | loss: nan | val_loss: nan | Time: 2762.99 ms
[2021-11-08 00:23:13	                main:574]	:	INFO	:	Epoch 1222 | loss: nan | val_loss: nan | Time: 2765.44 ms
[2021-11-08 00:23:16	                main:574]	:	INFO	:	Epoch 1223 | loss: nan | val_loss: nan | Time: 2764.31 ms
[2021-11-08 00:23:19	                main:574]	:	INFO	:	Epoch 1224 | loss: nan | val_loss: nan | Time: 2758.13 ms
[2021-11-08 00:23:21	                main:574]	:	INFO	:	Epoch 1225 | loss: nan | val_loss: nan | Time: 2761.43 ms
[2021-11-08 00:23:24	                main:574]	:	INFO	:	Epoch 1226 | loss: nan | val_loss: nan | Time: 2754.32 ms
[2021-11-08 00:23:27	                main:574]	:	INFO	:	Epoch 1227 | loss: nan | val_loss: nan | Time: 2760.28 ms
[2021-11-08 00:23:30	                main:574]	:	INFO	:	Epoch 1228 | loss: nan | val_loss: nan | Time: 2754.77 ms
[2021-11-08 00:23:32	                main:574]	:	INFO	:	Epoch 1229 | loss: nan | val_loss: nan | Time: 2762.58 ms
[2021-11-08 00:23:35	                main:574]	:	INFO	:	Epoch 1230 | loss: nan | val_loss: nan | Time: 2763.5 ms
[2021-11-08 00:23:38	                main:574]	:	INFO	:	Epoch 1231 | loss: nan | val_loss: nan | Time: 2763.22 ms
[2021-11-08 00:23:41	                main:574]	:	INFO	:	Epoch 1232 | loss: nan | val_loss: nan | Time: 2760.34 ms
[2021-11-08 00:23:43	                main:574]	:	INFO	:	Epoch 1233 | loss: nan | val_loss: nan | Time: 2758.49 ms
[2021-11-08 00:23:46	                main:574]	:	INFO	:	Epoch 1234 | loss: nan | val_loss: nan | Time: 2769.25 ms
[2021-11-08 00:23:49	                main:574]	:	INFO	:	Epoch 1235 | loss: nan | val_loss: nan | Time: 2760.84 ms
[2021-11-08 00:23:52	                main:574]	:	INFO	:	Epoch 1236 | loss: nan | val_loss: nan | Time: 2767.1 ms
[2021-11-08 00:23:55	                main:574]	:	INFO	:	Epoch 1237 | loss: nan | val_loss: nan | Time: 2759.49 ms
[2021-11-08 00:23:57	                main:574]	:	INFO	:	Epoch 1238 | loss: nan | val_loss: nan | Time: 2764.39 ms
[2021-11-08 00:24:00	                main:574]	:	INFO	:	Epoch 1239 | loss: nan | val_loss: nan | Time: 2754.36 ms
[2021-11-08 00:24:03	                main:574]	:	INFO	:	Epoch 1240 | loss: nan | val_loss: nan | Time: 2759.16 ms
[2021-11-08 00:24:06	                main:574]	:	INFO	:	Epoch 1241 | loss: nan | val_loss: nan | Time: 2766.79 ms
[2021-11-08 00:24:08	                main:574]	:	INFO	:	Epoch 1242 | loss: nan | val_loss: nan | Time: 2761.27 ms
[2021-11-08 00:24:11	                main:574]	:	INFO	:	Epoch 1243 | loss: nan | val_loss: nan | Time: 2767.78 ms
[2021-11-08 00:24:14	                main:574]	:	INFO	:	Epoch 1244 | loss: nan | val_loss: nan | Time: 2759.32 ms
[2021-11-08 00:24:17	                main:574]	:	INFO	:	Epoch 1245 | loss: nan | val_loss: nan | Time: 2765.92 ms
[2021-11-08 00:24:19	                main:574]	:	INFO	:	Epoch 1246 | loss: nan | val_loss: nan | Time: 2758.94 ms
[2021-11-08 00:24:22	                main:574]	:	INFO	:	Epoch 1247 | loss: nan | val_loss: nan | Time: 2763.66 ms
[2021-11-08 00:24:25	                main:574]	:	INFO	:	Epoch 1248 | loss: nan | val_loss: nan | Time: 2757.3 ms
[2021-11-08 00:24:28	                main:574]	:	INFO	:	Epoch 1249 | loss: nan | val_loss: nan | Time: 2761.55 ms
[2021-11-08 00:24:30	                main:574]	:	INFO	:	Epoch 1250 | loss: nan | val_loss: nan | Time: 2762.85 ms
[2021-11-08 00:24:33	                main:574]	:	INFO	:	Epoch 1251 | loss: nan | val_loss: nan | Time: 2759.07 ms
[2021-11-08 00:24:36	                main:574]	:	INFO	:	Epoch 1252 | loss: nan | val_loss: nan | Time: 2796.02 ms
[2021-11-08 00:24:39	                main:574]	:	INFO	:	Epoch 1253 | loss: nan | val_loss: nan | Time: 2759.8 ms
[2021-11-08 00:24:42	                main:574]	:	INFO	:	Epoch 1254 | loss: nan | val_loss: nan | Time: 2761.01 ms
[2021-11-08 00:24:44	                main:574]	:	INFO	:	Epoch 1255 | loss: nan | val_loss: nan | Time: 2757.06 ms
[2021-11-08 00:24:47	                main:574]	:	INFO	:	Epoch 1256 | loss: nan | val_loss: nan | Time: 2758.55 ms
[2021-11-08 00:24:50	                main:574]	:	INFO	:	Epoch 1257 | loss: nan | val_loss: nan | Time: 2754.82 ms
[2021-11-08 00:24:53	                main:574]	:	INFO	:	Epoch 1258 | loss: nan | val_loss: nan | Time: 2766.69 ms
[2021-11-08 00:24:55	                main:574]	:	INFO	:	Epoch 1259 | loss: nan | val_loss: nan | Time: 2761.48 ms
[2021-11-08 00:24:58	                main:574]	:	INFO	:	Epoch 1260 | loss: nan | val_loss: nan | Time: 2761.79 ms
[2021-11-08 00:25:01	                main:574]	:	INFO	:	Epoch 1261 | loss: nan | val_loss: nan | Time: 2757.92 ms
[2021-11-08 00:25:04	                main:574]	:	INFO	:	Epoch 1262 | loss: nan | val_loss: nan | Time: 2762.59 ms
[2021-11-08 00:25:06	                main:574]	:	INFO	:	Epoch 1263 | loss: nan | val_loss: nan | Time: 2756.11 ms
[2021-11-08 00:25:09	                main:574]	:	INFO	:	Epoch 1264 | loss: nan | val_loss: nan | Time: 2755.71 ms
[2021-11-08 00:25:12	                main:574]	:	INFO	:	Epoch 1265 | loss: nan | val_loss: nan | Time: 2758.86 ms
[2021-11-08 00:25:15	                main:574]	:	INFO	:	Epoch 1266 | loss: nan | val_loss: nan | Time: 2760.74 ms
[2021-11-08 00:25:17	                main:574]	:	INFO	:	Epoch 1267 | loss: nan | val_loss: nan | Time: 2756.84 ms
[2021-11-08 00:25:20	                main:574]	:	INFO	:	Epoch 1268 | loss: nan | val_loss: nan | Time: 2761.63 ms
[2021-11-08 00:25:23	                main:574]	:	INFO	:	Epoch 1269 | loss: nan | val_loss: nan | Time: 2762.18 ms
[2021-11-08 00:25:26	                main:574]	:	INFO	:	Epoch 1270 | loss: nan | val_loss: nan | Time: 2763.22 ms
[2021-11-08 00:25:29	                main:574]	:	INFO	:	Epoch 1271 | loss: nan | val_loss: nan | Time: 2755.32 ms
[2021-11-08 00:25:31	                main:574]	:	INFO	:	Epoch 1272 | loss: nan | val_loss: nan | Time: 2763.33 ms
[2021-11-08 00:25:34	                main:574]	:	INFO	:	Epoch 1273 | loss: nan | val_loss: nan | Time: 2755.64 ms
[2021-11-08 00:25:37	                main:574]	:	INFO	:	Epoch 1274 | loss: nan | val_loss: nan | Time: 2762.12 ms
[2021-11-08 00:25:40	                main:574]	:	INFO	:	Epoch 1275 | loss: nan | val_loss: nan | Time: 2765.05 ms
[2021-11-08 00:25:42	                main:574]	:	INFO	:	Epoch 1276 | loss: nan | val_loss: nan | Time: 2756.56 ms
[2021-11-08 00:25:45	                main:574]	:	INFO	:	Epoch 1277 | loss: nan | val_loss: nan | Time: 2758.26 ms
[2021-11-08 00:25:48	                main:574]	:	INFO	:	Epoch 1278 | loss: nan | val_loss: nan | Time: 2757.8 ms
[2021-11-08 00:25:51	                main:574]	:	INFO	:	Epoch 1279 | loss: nan | val_loss: nan | Time: 2764.03 ms
[2021-11-08 00:25:53	                main:574]	:	INFO	:	Epoch 1280 | loss: nan | val_loss: nan | Time: 2756.66 ms
[2021-11-08 00:25:56	                main:574]	:	INFO	:	Epoch 1281 | loss: nan | val_loss: nan | Time: 2757.45 ms
[2021-11-08 00:25:59	                main:574]	:	INFO	:	Epoch 1282 | loss: nan | val_loss: nan | Time: 2765.24 ms
[2021-11-08 00:26:02	                main:574]	:	INFO	:	Epoch 1283 | loss: nan | val_loss: nan | Time: 2762.73 ms
[2021-11-08 00:26:04	                main:574]	:	INFO	:	Epoch 1284 | loss: nan | val_loss: nan | Time: 2756.88 ms
[2021-11-08 00:26:07	                main:574]	:	INFO	:	Epoch 1285 | loss: nan | val_loss: nan | Time: 2757.3 ms
[2021-11-08 00:26:10	                main:574]	:	INFO	:	Epoch 1286 | loss: nan | val_loss: nan | Time: 2758.65 ms
[2021-11-08 00:26:13	                main:574]	:	INFO	:	Epoch 1287 | loss: nan | val_loss: nan | Time: 2762.06 ms
[2021-11-08 00:26:16	                main:574]	:	INFO	:	Epoch 1288 | loss: nan | val_loss: nan | Time: 2770.22 ms
[2021-11-08 00:26:18	                main:574]	:	INFO	:	Epoch 1289 | loss: nan | val_loss: nan | Time: 2779.5 ms
[2021-11-08 00:26:21	                main:574]	:	INFO	:	Epoch 1290 | loss: nan | val_loss: nan | Time: 2759.31 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: Quadro K2200)
[2021-11-08 07:27:48	                main:435]	:	INFO	:	Set logging level to 1
[2021-11-08 07:27:48	                main:441]	:	INFO	:	Running in BOINC Client mode
[2021-11-08 07:27:48	                main:444]	:	INFO	:	Resolving all filenames
[2021-11-08 07:27:48	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1)
[2021-11-08 07:27:48	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1634617226-6934-1_0_r1081200380_1 (exists = 1)
[2021-11-08 07:27:48	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1634617226-6934-1_0_r1081200380_0 (exists = 0)
[2021-11-08 07:27:48	                main:452]	:	INFO	:	Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1634617226-6934-1 (exists = 1)
[2021-11-08 07:27:48	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2021-11-08 07:27:48	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5
[2021-11-08 07:27:48	                main:474]	:	INFO	:	Configuration: 
[2021-11-08 07:27:48	                main:475]	:	INFO	:	    Model type: GRU
[2021-11-08 07:27:48	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2021-11-08 07:27:48	                main:477]	:	INFO	:	    Max Epochs: 2048
[2021-11-08 07:27:48	                main:478]	:	INFO	:	    Batch Size: 128
[2021-11-08 07:27:48	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2021-11-08 07:27:48	                main:480]	:	INFO	:	    Patience: 10
[2021-11-08 07:27:48	                main:481]	:	INFO	:	    Hidden Width: 12
[2021-11-08 07:27:48	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2021-11-08 07:27:48	                main:483]	:	INFO	:	    # Backend Layers: 4
[2021-11-08 07:27:48	                main:484]	:	INFO	:	    # Threads: 1
[2021-11-08 07:27:48	                main:486]	:	INFO	:	Preparing Dataset
[2021-11-08 07:27:48	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-08 07:27:49	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-08 07:27:51	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2021-11-08 07:27:51	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-08 07:27:51	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-08 07:27:51	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2021-11-08 07:27:51	                main:494]	:	INFO	:	Creating Model
[2021-11-08 07:27:51	                main:507]	:	INFO	:	Preparing config file
[2021-11-08 07:27:51	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2021-11-08 07:27:51	                main:512]	:	INFO	:	Loading config


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFAE9544F69

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 11/08/21 07:27:51
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\4;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 0000000002ca0000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000ebc90000 00000000001f5000 C:\Windows\SYSTEM32\ntdll.dll (6.2.19041.1288) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.19041.1023 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1023

ModLoad: 00000000ea000000 00000000000be000 C:\Windows\System32\KERNEL32.DLL (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.19041.1320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1320

ModLoad: 00000000e9510000 00000000002c8000 C:\Windows\System32\KERNELBASE.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.19041.1320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1320

ModLoad: 00000000eade0000 00000000001a1000 C:\Windows\System32\USER32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1165

ModLoad: 00000000e9870000 0000000000022000 C:\Windows\System32\win32u.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.19041.1320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1320

ModLoad: 00000000e9e90000 000000000002b000 C:\Windows\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202

ModLoad: 00000000e98d0000 000000000010b000 C:\Windows\System32\gdi32full.dll (6.2.19041.1110) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.19041.1110 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1110

ModLoad: 00000000e9c40000 000000000009d000 C:\Windows\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 00000000c7c80000 0000000000058000 C:\ProgramData\BOINC\slots\4\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000e9410000 0000000000100000 C:\Windows\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 00000000eaf90000 00000000000ac000 C:\Windows\System32\ADVAPI32.dll (6.2.19041.1052) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000ea840000 000000000009e000 C:\Windows\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.19041.546

ModLoad: 00000000e9ce0000 000000000009b000 C:\Windows\System32\sechost.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000e9ed0000 000000000012a000 C:\Windows\System32\RPCRT4.dll (6.2.19041.1288) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000e78d0000 00000000001e4000 C:\Windows\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.867

ModLoad: 00000000bcfd0000 000000000008d000 C:\Windows\SYSTEM32\MSVCP140.dll (14.29.30133.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.29.30133.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.29.30133.0

ModLoad: 00000000e2dc0000 000000000000c000 C:\Windows\SYSTEM32\VCRUNTIME140_1.dll (14.29.30133.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.29.30133.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.29.30133.0

ModLoad: 00000000e2dd0000 000000000001b000 C:\Windows\SYSTEM32\VCRUNTIME140.dll (14.29.30133.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.29.30133.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.29.30133.0

ModLoad: 00000000fa830000 0000000024b49000 C:\ProgramData\BOINC\slots\4\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000efc40000 000000000abe7000 C:\ProgramData\BOINC\slots\4\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000cb020000 0000000000045000 C:\ProgramData\BOINC\slots\4\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000ecb90000 00000000030a5000 C:\ProgramData\BOINC\slots\4\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 00000000e96d0000 00000000034b2000 C:\ProgramData\BOINC\slots\4\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000dec10000 0000000000010000 C:\ProgramData\BOINC\slots\4\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 00000000c5180000 000000000919f000 C:\ProgramData\BOINC\slots\4\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000c1420000 0000000003d5b000 C:\ProgramData\BOINC\slots\4\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000a3970000 000000000020d000 C:\ProgramData\BOINC\slots\4\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 0000000098da0000 00000000002db000 C:\ProgramData\BOINC\slots\4\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000040910000 0000000001eca000 C:\ProgramData\BOINC\slots\4\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000ce320000 000000001b3a4000 C:\ProgramData\BOINC\slots\4\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 00000000d1c10000 0000000000040000 C:\ProgramData\BOINC\slots\4\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000ea810000 0000000000030000 C:\Windows\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000e7c50000 0000000000012000 C:\Windows\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000eb7d0000 0000000000472000 C:\Windows\System32\Setupapi.dll (6.2.19041.1237) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1165

ModLoad: 00000000e99e0000 000000000004e000 C:\Windows\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 00000000e98a0000 0000000000027000 C:\Windows\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000e9150000 0000000000034000 C:\Windows\SYSTEM32\DEVOBJ.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 00000000e93b0000 0000000000060000 C:\Windows\System32\WINTRUST.dll (6.2.19041.1266) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.19041.1266 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1266

ModLoad: 00000000e9ae0000 0000000000156000 C:\Windows\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1165

ModLoad: 00000000e8f90000 0000000000012000 C:\Windows\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000ea0c0000 000000000073f000 C:\Windows\System32\Shell32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1165

ModLoad: 00000000e7140000 0000000000790000 C:\Windows\SYSTEM32\windows.storage.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1165

ModLoad: 00000000eb040000 0000000000355000 C:\Windows\System32\combase.dll (6.2.19041.1288) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.19041.1320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1320

ModLoad: 00000000e8e00000 000000000002e000 C:\Windows\SYSTEM32\Wldp.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000e9de0000 00000000000ad000 C:\Windows\System32\SHCORE.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1165

ModLoad: 00000000eb770000 0000000000055000 C:\Windows\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1165

ModLoad: 0000000091790000 00000000002cc000 C:\Windows\system32\nvcuda.dll (30.0.14.7212) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r470\r470_00\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 30.0.14.7212
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.4.136 driver
    Product Version       : 30.0.14.7212

ModLoad: 00000000e1840000 000000000000a000 C:\Windows\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000443a0000 00000000017e0000 C:\Windows\system32\DriverStore\FileRepository\nv_dispwi.inf_amd64_523125d549631851\nvcuda64.dll (30.0.14.7212) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r470\r470_00\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 30.0.14.7212
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.4.136 driver
    Product Version       : 30.0.14.7212

ModLoad: 00000000e0e00000 0000000000031000 C:\Windows\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.19041.906 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.906

ModLoad: 00000000dd970000 000000000014a000 C:\Windows\SYSTEM32\drvstore.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : drvstore.pdb
    File Version          : 10.0.19041.1320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1320

ModLoad: 00000000e8d70000 000000000000c000 C:\Windows\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000e6920000 000000000009e000 C:\Windows\system32\uxtheme.dll (6.2.19041.1266) (-exported- Symbols Loaded)
    Linked PDB Filename   : UxTheme.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1165

ModLoad: 00000000c49c0000 0000000000719000 C:\Windows\SYSTEM32\nvapi64.dll (30.0.14.7212) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r470\r470_00\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 30.0.14.7212
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 30.0.14.7212

ModLoad: 00000000eab10000 000000000012a000 C:\Windows\System32\ole32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : ole32.pdb
    File Version          : 10.0.19041.1320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1320

ModLoad: 00000000e97e0000 0000000000083000 C:\Windows\System32\bcryptPrimitives.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3620, Write: 305, Other 931

- I/O Transfers Counters -
Read: 6572139, Write: 7285, Other 32590

- Paged Pool Usage -
QuotaPagedPoolUsage: 3479072, QuotaPeakPagedPoolUsage: 3479072
QuotaNonPagedPoolUsage: 37936, QuotaPeakNonPagedPoolUsage: 37936

- Virtual Memory Usage -
VirtualSize: -1504985088, PeakVirtualSize: -1001799680

- Pagefile Usage -
PagefileUsage: -1504985088, PeakPagefileUsage: -1504919552

- Working Set Size -
WorkingSetSize: 1137516544, PeakWorkingSetSize: 1137520640, PageFaultCount: 376975

*** Dump of thread ID 1700 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 5937500.000000, User Time: 20000000.000000, Wait Time: 59002856.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFAE9544F69

- Registers -
rax=000000004f0e5ae8 rbx=0000000003004910 rcx=000000000cd82b00 rdx=00000000ebcb5b00 rsi=000000004f0e6350 rdi=0000000019930520
r8=000000004f0e5b10 r9=000000004f0e5b38 r10=0000000000000004 r11=000000004f0e5b48 r12=0000000070dc4990 r13=000000004f0e6560
r14=000000006ddf05f0 r15=0000000000000000 rip=00000000e9544f69 rsp=000000004f0e61f0 rbp=000000004f0e64e0
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
4f0e62c0 02f1a884 00000040 0000004f 70dc5100 000007ac KERNELBASE!RaiseException+0x0 
4f0e6320 02cc1ca6 00000004 3b230000 03097478 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
4f0e63d0 02cc593b 00000000 00000030 00000020 00000008 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
4f0e6520 02cc1a78 00000000 00000000 4f0e6850 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
4f0e65f0 02cc1cfc 4f0e6850 00000000 00000080 4f0e6b20 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
4f0e66b0 02ccc4dd 4f0e6b20 4f0e6b20 4f0e6b20 4f0e6b20 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
4f0e69a0 02cbb2fe 4f0e6fb8 4f0e6b20 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
4f0ff740 02efc6f8 3cec1630 00000000 00000000 3ca32f40 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
4f0ff780 ea017034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
4f0ff7b0 ebce2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
4f0ff830 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 17200 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 59002696.000000

- Registers -
rax=00000000000001d3 rbx=000000003b2380a0 rcx=0000000000000070 rdx=000000003b237d20 rsi=000000003b233a10 rdi=000000003b2380a0
r8=000000004f1ff390 r9=000000003b234014 r10=000000000000006c r11=000000004f1ff190 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000ebd307c4 rsp=000000004f1ffc28 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
4f1ffc20 ebce2dc7 00000000 00000000 3b233a10 3b2380a0 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
4f1fff20 ea017034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
4f1fff50 ebce2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
4f1fffd0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 23324 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 59002696.000000

- Registers -
rax=00000000000001d3 rbx=000000003b238cb0 rcx=0000000000000070 rdx=000000003b238930 rsi=000000003b233a10 rdi=000000003b238cb0
r8=0000000000000008 r9=0000000000000040 r10=0000000000000180 r11=0000000080000003 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000ebd307c4 rsp=000000004f2ff4c8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
4f2ff4c0 ebce2dc7 00000000 00000000 3b233a10 3b238cb0 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
4f2ff7c0 ea017034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
4f2ff7f0 ebce2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
4f2ff870 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 22200 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 59002696.000000

- Registers -
rax=00000000000001d3 rbx=000000003b239050 rcx=0000000000000070 rdx=000000003b238cd0 rsi=000000003b233a10 rdi=000000003b239050
r8=000000003b330fc0 r9=0000000000000064 r10=0000000000008000 r11=000000004f3feda0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000ebd307c4 rsp=000000004f3ff838 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
4f3ff830 ebce2dc7 00000000 00000000 3b233a10 3b239050 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
4f3ffb30 ea017034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
4f3ffb60 ebce2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
4f3ffbe0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 8660 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 59002848.000000

- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=000000004f5ffc90 rsi=0000000000000000 rdi=0000000000000064
r8=000000004f5ffc68 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000ebd2d3f4 rsp=000000004f5ffc68 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
4f5ffc60 e955962e 4f5ffd28 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0 
4f5ffd00 02cda07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0 
4f5ffd30 ea017034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
4f5ffd60 ebce2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
4f5ffde0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 20368 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 59002852.000000

- Registers -
rax=000000000000005b rbx=000000000000000a rcx=000000000000000a rdx=000000004f6ff640 rsi=0000000000000000 rdi=000000000000000a
r8=000000004f6ff2e8 r9=000000003d0c7150 r10=0000000000000000 r11=000000004f6ff5b0 r12=0000000000000064 r13=000000004f6ff640
r14=000000004f6ff340 r15=0000000000000000 rip=00000000ebd2d8c4 rsp=000000004f6ff2e8 rbp=000000003d0c7150
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
4f6ff2e0 e955cb20 00000000 4ee58000 ebdfa4d0 4ee58000 ntdll!ZwWaitForMultipleObjects+0x0 
4f6ff5d0 e955ca1e 3b243520 006e0069 0000000a 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
4f6ff610 445712c4 3d0cbcb0 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
4f6ff850 4461806d 00000000 3d0c7150 00000000 00000000 nvcuda64!+0x0 
4f6ff900 44570c93 89d0d963 889967e8 3d6ac3a0 00000000 nvcuda64!cuProfilerStop+0x0 
4f6ff930 448a6b84 3d6ac3a0 00000000 00000000 00000000 nvcuda64!+0x0 
4f6ff960 ea017034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
4f6ff990 ebce2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
4f6ffa10 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 22636 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 59002748.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002c4 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002c4
r8=000000004f7ff8d8 r9=0000000000000000 r10=0000000000000000 r11=000000004f7ff938 r12=0000000000000000 r13=0000000000000000
r14=00000000000002c4 r15=0000000000000000 rip=00000000ebd2cdf4 rsp=000000004f7ff638 rbp=000000003d090880
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
4f7ff630 e9531a5e 00000000 ebce2630 0000027f 00000000 ntdll!ZwWaitForSingleObject+0x0 
4f7ff6d0 4479e2cd 3d6ac400 00000000 00000000 000002c4 KERNELBASE!WaitForSingleObjectEx+0x0 
4f7ff930 44570c93 00000000 3d6ac400 443a0000 3d0e6b90 nvcuda64!cuProfilerStop+0x0 
4f7ff960 448a6b84 3d6ac400 00000000 00000000 00000000 nvcuda64!+0x0 
4f7ff990 ea017034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
4f7ff9c0 ebce2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
4f7ffa40 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 18952 (state: Waiting): ***

- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 59002848.000000

- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=000000003d355f90 rdx=000000004f8ff8b8 rsi=000000004f8ff820 rdi=0000000000000000
r8=0000000000000001 r9=0000000000004a08 r10=000000003d35ace0 r11=00000000dcbe7e07 r12=000000004f8ff8b8 r13=0000000000000000
r14=000000003d355f90 r15=000000003d35ace0 rip=00000000ebd30764 rsp=000000004f8ff7f8 rbp=000000004f8ff850
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
4f8ff7f0 ebcf4295 00000102 00000102 00000000 4f8ff820 ntdll!NtWaitForAlertByThreadId+0x0 
4f8ff860 e957cdd9 3d3584c0 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0 
4f8ff890 444df18c 3d3584c0 ebce07b0 3d3584c0 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0 
4f8ff8f0 44570c93 00000002 89bfeeb0 00000000 00000000 nvcuda64!+0x0 
4f8ff920 448a6b84 44f78d80 00000000 00000000 00000000 nvcuda64!+0x0 
4f8ff950 ea017034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
4f8ff980 ebce2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
4f8ffa00 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)