Task 14619485

Name ParityModified-1647045204-26078-3-0_2
Workunit 11575621
Created 13 Apr 2022, 19:13:16 UTC
Sent 13 Apr 2022, 19:13:50 UTC
Report deadline 21 Apr 2022, 19:13:50 UTC
Received 20 Apr 2022, 2:00:17 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 7171
Run time 1 hours 27 min
CPU time 1 hours 15 min 28 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 2,570.00 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.54 GB
Peak swap size 3.46 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
 loss: nan | val_loss: nan | Time: 2030.71 ms
[2022-04-15 10:57:46	                main:574]	:	INFO	:	Epoch 1056 | loss: nan | val_loss: nan | Time: 2037.66 ms
[2022-04-15 10:57:48	                main:574]	:	INFO	:	Epoch 1057 | loss: nan | val_loss: nan | Time: 2063.06 ms
[2022-04-15 10:57:50	                main:574]	:	INFO	:	Epoch 1058 | loss: nan | val_loss: nan | Time: 2021.26 ms
[2022-04-15 10:57:53	                main:574]	:	INFO	:	Epoch 1059 | loss: nan | val_loss: nan | Time: 2014.33 ms
[2022-04-15 10:57:55	                main:574]	:	INFO	:	Epoch 1060 | loss: nan | val_loss: nan | Time: 2009.17 ms
[2022-04-15 10:57:57	                main:574]	:	INFO	:	Epoch 1061 | loss: nan | val_loss: nan | Time: 2001.17 ms
[2022-04-15 10:57:59	                main:574]	:	INFO	:	Epoch 1062 | loss: nan | val_loss: nan | Time: 2015.71 ms
[2022-04-15 10:58:01	                main:574]	:	INFO	:	Epoch 1063 | loss: nan | val_loss: nan | Time: 2049.74 ms
[2022-04-15 10:58:03	                main:574]	:	INFO	:	Epoch 1064 | loss: nan | val_loss: nan | Time: 2086.22 ms
[2022-04-15 10:58:05	                main:574]	:	INFO	:	Epoch 1065 | loss: nan | val_loss: nan | Time: 2050.79 ms
[2022-04-15 10:58:07	                main:574]	:	INFO	:	Epoch 1066 | loss: nan | val_loss: nan | Time: 2059.79 ms
[2022-04-15 10:58:09	                main:574]	:	INFO	:	Epoch 1067 | loss: nan | val_loss: nan | Time: 2052.84 ms
[2022-04-15 10:58:11	                main:574]	:	INFO	:	Epoch 1068 | loss: nan | val_loss: nan | Time: 2103.55 ms
[2022-04-15 10:58:14	                main:574]	:	INFO	:	Epoch 1069 | loss: nan | val_loss: nan | Time: 2205.37 ms
[2022-04-15 10:58:16	                main:574]	:	INFO	:	Epoch 1070 | loss: nan | val_loss: nan | Time: 2082.31 ms
[2022-04-15 10:58:18	                main:574]	:	INFO	:	Epoch 1071 | loss: nan | val_loss: nan | Time: 2078.83 ms
[2022-04-15 10:58:20	                main:574]	:	INFO	:	Epoch 1072 | loss: nan | val_loss: nan | Time: 2059.53 ms
[2022-04-15 10:58:22	                main:574]	:	INFO	:	Epoch 1073 | loss: nan | val_loss: nan | Time: 2101.67 ms
[2022-04-15 10:58:24	                main:574]	:	INFO	:	Epoch 1074 | loss: nan | val_loss: nan | Time: 2034 ms
[2022-04-15 10:58:26	                main:574]	:	INFO	:	Epoch 1075 | loss: nan | val_loss: nan | Time: 2017.54 ms
[2022-04-15 10:58:28	                main:574]	:	INFO	:	Epoch 1076 | loss: nan | val_loss: nan | Time: 2028.5 ms
[2022-04-15 10:58:30	                main:574]	:	INFO	:	Epoch 1077 | loss: nan | val_loss: nan | Time: 2056.58 ms
[2022-04-15 10:58:32	                main:574]	:	INFO	:	Epoch 1078 | loss: nan | val_loss: nan | Time: 2031.52 ms
[2022-04-15 10:58:36	                main:574]	:	INFO	:	Epoch 1079 | loss: nan | val_loss: nan | Time: 3834.93 ms
[2022-04-15 10:58:40	                main:574]	:	INFO	:	Epoch 1080 | loss: nan | val_loss: nan | Time: 4425.7 ms
[2022-04-15 10:58:45	                main:574]	:	INFO	:	Epoch 1081 | loss: nan | val_loss: nan | Time: 4518.93 ms
[2022-04-15 10:58:49	                main:574]	:	INFO	:	Epoch 1082 | loss: nan | val_loss: nan | Time: 4315.81 ms
[2022-04-15 10:58:53	                main:574]	:	INFO	:	Epoch 1083 | loss: nan | val_loss: nan | Time: 3542.52 ms
[2022-04-15 10:58:55	                main:574]	:	INFO	:	Epoch 1084 | loss: nan | val_loss: nan | Time: 2581.27 ms
[2022-04-15 10:59:01	                main:574]	:	INFO	:	Epoch 1085 | loss: nan | val_loss: nan | Time: 5153.15 ms
[2022-04-15 10:59:07	                main:574]	:	INFO	:	Epoch 1086 | loss: nan | val_loss: nan | Time: 6031.36 ms
[2022-04-15 10:59:13	                main:574]	:	INFO	:	Epoch 1087 | loss: nan | val_loss: nan | Time: 6281.79 ms
[2022-04-15 10:59:19	                main:574]	:	INFO	:	Epoch 1088 | loss: nan | val_loss: nan | Time: 6135.38 ms
[2022-04-15 10:59:25	                main:574]	:	INFO	:	Epoch 1089 | loss: nan | val_loss: nan | Time: 6006 ms
[2022-04-15 10:59:28	                main:574]	:	INFO	:	Epoch 1090 | loss: nan | val_loss: nan | Time: 2632.61 ms
[2022-04-15 10:59:32	                main:574]	:	INFO	:	Epoch 1091 | loss: nan | val_loss: nan | Time: 4172.71 ms
[2022-04-15 10:59:36	                main:574]	:	INFO	:	Epoch 1092 | loss: nan | val_loss: nan | Time: 4268.29 ms
[2022-04-15 10:59:41	                main:574]	:	INFO	:	Epoch 1093 | loss: nan | val_loss: nan | Time: 4589.7 ms
[2022-04-15 10:59:45	                main:574]	:	INFO	:	Epoch 1094 | loss: nan | val_loss: nan | Time: 4274.52 ms
[2022-04-15 10:59:49	                main:574]	:	INFO	:	Epoch 1095 | loss: nan | val_loss: nan | Time: 3737.68 ms
[2022-04-15 10:59:55	                main:574]	:	INFO	:	Epoch 1096 | loss: nan | val_loss: nan | Time: 5641.8 ms
[2022-04-15 11:00:01	                main:574]	:	INFO	:	Epoch 1097 | loss: nan | val_loss: nan | Time: 5937.93 ms
[2022-04-15 11:00:05	                main:574]	:	INFO	:	Epoch 1098 | loss: nan | val_loss: nan | Time: 4756.95 ms
[2022-04-15 11:00:11	                main:574]	:	INFO	:	Epoch 1099 | loss: nan | val_loss: nan | Time: 5666.77 ms
[2022-04-15 11:00:17	                main:574]	:	INFO	:	Epoch 1100 | loss: nan | val_loss: nan | Time: 5543.06 ms
[2022-04-15 11:00:20	                main:574]	:	INFO	:	Epoch 1101 | loss: nan | val_loss: nan | Time: 2870.86 ms
[2022-04-15 11:00:24	                main:574]	:	INFO	:	Epoch 1102 | loss: nan | val_loss: nan | Time: 4099.98 ms
[2022-04-15 11:00:28	                main:574]	:	INFO	:	Epoch 1103 | loss: nan | val_loss: nan | Time: 4159.79 ms
[2022-04-15 11:00:32	                main:574]	:	INFO	:	Epoch 1104 | loss: nan | val_loss: nan | Time: 4198.54 ms
[2022-04-15 11:00:36	                main:574]	:	INFO	:	Epoch 1105 | loss: nan | val_loss: nan | Time: 4186.65 ms
[2022-04-15 11:00:40	                main:574]	:	INFO	:	Epoch 1106 | loss: nan | val_loss: nan | Time: 3822.34 ms
[2022-04-15 11:00:46	                main:574]	:	INFO	:	Epoch 1107 | loss: nan | val_loss: nan | Time: 5386.68 ms
[2022-04-15 11:00:52	                main:574]	:	INFO	:	Epoch 1108 | loss: nan | val_loss: nan | Time: 6099.39 ms
[2022-04-15 11:00:58	                main:574]	:	INFO	:	Epoch 1109 | loss: nan | val_loss: nan | Time: 5959.14 ms
[2022-04-15 11:01:04	                main:574]	:	INFO	:	Epoch 1110 | loss: nan | val_loss: nan | Time: 6059.84 ms
[2022-04-15 11:01:08	                main:574]	:	INFO	:	Epoch 1111 | loss: nan | val_loss: nan | Time: 4015.7 ms
[2022-04-15 11:01:11	                main:574]	:	INFO	:	Epoch 1112 | loss: nan | val_loss: nan | Time: 3514.95 ms
[2022-04-15 11:01:15	                main:574]	:	INFO	:	Epoch 1113 | loss: nan | val_loss: nan | Time: 4154.13 ms
[2022-04-15 11:01:20	                main:574]	:	INFO	:	Epoch 1114 | loss: nan | val_loss: nan | Time: 4240.83 ms
[2022-04-15 11:01:24	                main:574]	:	INFO	:	Epoch 1115 | loss: nan | val_loss: nan | Time: 4281.86 ms
[2022-04-15 11:01:28	                main:574]	:	INFO	:	Epoch 1116 | loss: nan | val_loss: nan | Time: 4232.11 ms
[2022-04-15 11:01:32	                main:574]	:	INFO	:	Epoch 1117 | loss: nan | val_loss: nan | Time: 3692.17 ms
[2022-04-15 11:01:37	                main:574]	:	INFO	:	Epoch 1118 | loss: nan | val_loss: nan | Time: 5338.99 ms
[2022-04-15 11:01:43	                main:574]	:	INFO	:	Epoch 1119 | loss: nan | val_loss: nan | Time: 5965.3 ms
[2022-04-15 11:01:49	                main:574]	:	INFO	:	Epoch 1120 | loss: nan | val_loss: nan | Time: 5737.8 ms
[2022-04-15 11:01:55	                main:574]	:	INFO	:	Epoch 1121 | loss: nan | val_loss: nan | Time: 5813.25 ms
[2022-04-15 11:02:00	                main:574]	:	INFO	:	Epoch 1122 | loss: nan | val_loss: nan | Time: 5368.07 ms
[2022-04-15 11:02:04	                main:574]	:	INFO	:	Epoch 1123 | loss: nan | val_loss: nan | Time: 3585.51 ms
[2022-04-15 11:02:08	                main:574]	:	INFO	:	Epoch 1124 | loss: nan | val_loss: nan | Time: 4038.93 ms
[2022-04-15 11:02:12	                main:574]	:	INFO	:	Epoch 1125 | loss: nan | val_loss: nan | Time: 4191.91 ms
[2022-04-15 11:02:17	                main:574]	:	INFO	:	Epoch 1126 | loss: nan | val_loss: nan | Time: 4404.06 ms
[2022-04-15 11:02:20	                main:574]	:	INFO	:	Epoch 1127 | loss: nan | val_loss: nan | Time: 3880.79 ms
[2022-04-15 11:02:24	                main:574]	:	INFO	:	Epoch 1128 | loss: nan | val_loss: nan | Time: 3809.77 ms
[2022-04-15 11:02:29	                main:574]	:	INFO	:	Epoch 1129 | loss: nan | val_loss: nan | Time: 5039.43 ms
[2022-04-15 11:02:35	                main:574]	:	INFO	:	Epoch 1130 | loss: nan | val_loss: nan | Time: 5218.12 ms
[2022-04-15 11:02:40	                main:574]	:	INFO	:	Epoch 1131 | loss: nan | val_loss: nan | Time: 5305.49 ms
[2022-04-15 11:02:45	                main:574]	:	INFO	:	Epoch 1132 | loss: nan | val_loss: nan | Time: 5053.16 ms
[2022-04-15 11:02:49	                main:574]	:	INFO	:	Epoch 1133 | loss: nan | val_loss: nan | Time: 3674.38 ms
[2022-04-15 11:02:51	                main:574]	:	INFO	:	Epoch 1134 | loss: nan | val_loss: nan | Time: 1928.79 ms
[2022-04-15 11:02:53	                main:574]	:	INFO	:	Epoch 1135 | loss: nan | val_loss: nan | Time: 1930.55 ms
[2022-04-15 11:02:55	                main:574]	:	INFO	:	Epoch 1136 | loss: nan | val_loss: nan | Time: 1925.69 ms
[2022-04-15 11:02:57	                main:574]	:	INFO	:	Epoch 1137 | loss: nan | val_loss: nan | Time: 1922.03 ms
[2022-04-15 11:02:59	                main:574]	:	INFO	:	Epoch 1138 | loss: nan | val_loss: nan | Time: 1915.64 ms
[2022-04-15 11:03:01	                main:574]	:	INFO	:	Epoch 1139 | loss: nan | val_loss: nan | Time: 1929.22 ms
[2022-04-15 11:03:02	                main:574]	:	INFO	:	Epoch 1140 | loss: nan | val_loss: nan | Time: 1921.75 ms
[2022-04-15 11:03:04	                main:574]	:	INFO	:	Epoch 1141 | loss: nan | val_loss: nan | Time: 1932.67 ms
[2022-04-15 11:03:06	                main:574]	:	INFO	:	Epoch 1142 | loss: nan | val_loss: nan | Time: 1921.77 ms
[2022-04-15 11:03:08	                main:574]	:	INFO	:	Epoch 1143 | loss: nan | val_loss: nan | Time: 1941.21 ms
[2022-04-15 11:03:10	                main:574]	:	INFO	:	Epoch 1144 | loss: nan | val_loss: nan | Time: 1925.63 ms
[2022-04-15 11:03:12	                main:574]	:	INFO	:	Epoch 1145 | loss: nan | val_loss: nan | Time: 1942.93 ms
[2022-04-15 11:03:14	                main:574]	:	INFO	:	Epoch 1146 | loss: nan | val_loss: nan | Time: 1950.39 ms
[2022-04-15 11:03:16	                main:574]	:	INFO	:	Epoch 1147 | loss: nan | val_loss: nan | Time: 1944.97 ms
[2022-04-15 11:03:18	                main:574]	:	INFO	:	Epoch 1148 | loss: nan | val_loss: nan | Time: 1937.23 ms
[2022-04-15 11:03:20	                main:574]	:	INFO	:	Epoch 1149 | loss: nan | val_loss: nan | Time: 1941.03 ms
[2022-04-15 11:03:22	                main:574]	:	INFO	:	Epoch 1150 | loss: nan | val_loss: nan | Time: 2044.19 ms
[2022-04-15 11:03:24	                main:574]	:	INFO	:	Epoch 1151 | loss: nan | val_loss: nan | Time: 1999.5 ms
[2022-04-15 11:03:26	                main:574]	:	INFO	:	Epoch 1152 | loss: nan | val_loss: nan | Time: 1973.62 ms
[2022-04-15 11:03:28	                main:574]	:	INFO	:	Epoch 1153 | loss: nan | val_loss: nan | Time: 1930.66 ms
[2022-04-15 11:03:30	                main:574]	:	INFO	:	Epoch 1154 | loss: nan | val_loss: nan | Time: 1953.87 ms
[2022-04-15 11:03:32	                main:574]	:	INFO	:	Epoch 1155 | loss: nan | val_loss: nan | Time: 1918.8 ms
[2022-04-15 11:03:34	                main:574]	:	INFO	:	Epoch 1156 | loss: nan | val_loss: nan | Time: 1920.81 ms
[2022-04-15 11:03:36	                main:574]	:	INFO	:	Epoch 1157 | loss: nan | val_loss: nan | Time: 1937.54 ms
[2022-04-15 11:03:38	                main:574]	:	INFO	:	Epoch 1158 | loss: nan | val_loss: nan | Time: 1937.01 ms
[2022-04-15 11:03:40	                main:574]	:	INFO	:	Epoch 1159 | loss: nan | val_loss: nan | Time: 1964.25 ms
[2022-04-15 11:03:42	                main:574]	:	INFO	:	Epoch 1160 | loss: nan | val_loss: nan | Time: 2050.82 ms
[2022-04-15 11:03:44	                main:574]	:	INFO	:	Epoch 1161 | loss: nan | val_loss: nan | Time: 2022.2 ms
[2022-04-15 11:03:46	                main:574]	:	INFO	:	Epoch 1162 | loss: nan | val_loss: nan | Time: 2059.29 ms
[2022-04-15 11:03:48	                main:574]	:	INFO	:	Epoch 1163 | loss: nan | val_loss: nan | Time: 2130.73 ms
[2022-04-15 11:03:50	                main:574]	:	INFO	:	Epoch 1164 | loss: nan | val_loss: nan | Time: 2032.59 ms
[2022-04-15 11:03:54	                main:574]	:	INFO	:	Epoch 1165 | loss: nan | val_loss: nan | Time: 4190.87 ms
[2022-04-15 11:03:58	                main:574]	:	INFO	:	Epoch 1166 | loss: nan | val_loss: nan | Time: 4372.96 ms
[2022-04-15 11:04:03	                main:574]	:	INFO	:	Epoch 1167 | loss: nan | val_loss: nan | Time: 4312.56 ms
[2022-04-15 11:04:07	                main:574]	:	INFO	:	Epoch 1168 | loss: nan | val_loss: nan | Time: 4227.9 ms
[2022-04-15 11:04:10	                main:574]	:	INFO	:	Epoch 1169 | loss: nan | val_loss: nan | Time: 2580.76 ms
[2022-04-15 11:04:13	                main:574]	:	INFO	:	Epoch 1170 | loss: nan | val_loss: nan | Time: 3791.27 ms
[2022-04-15 11:04:19	                main:574]	:	INFO	:	Epoch 1171 | loss: nan | val_loss: nan | Time: 5195.79 ms
[2022-04-15 11:04:24	                main:574]	:	INFO	:	Epoch 1172 | loss: nan | val_loss: nan | Time: 5098.98 ms
[2022-04-15 11:04:29	                main:574]	:	INFO	:	Epoch 1173 | loss: nan | val_loss: nan | Time: 4781.06 ms
[2022-04-15 11:04:34	                main:574]	:	INFO	:	Epoch 1174 | loss: nan | val_loss: nan | Time: 5628.46 ms
[2022-04-15 11:04:40	                main:574]	:	INFO	:	Epoch 1175 | loss: nan | val_loss: nan | Time: 5620.02 ms
[2022-04-15 11:04:43	                main:574]	:	INFO	:	Epoch 1176 | loss: nan | val_loss: nan | Time: 2808.44 ms
[2022-04-15 11:04:47	                main:574]	:	INFO	:	Epoch 1177 | loss: nan | val_loss: nan | Time: 4425.14 ms
[2022-04-15 11:04:52	                main:574]	:	INFO	:	Epoch 1178 | loss: nan | val_loss: nan | Time: 4391.88 ms
[2022-04-15 11:04:56	                main:574]	:	INFO	:	Epoch 1179 | loss: nan | val_loss: nan | Time: 4449.81 ms
[2022-04-15 11:05:00	                main:574]	:	INFO	:	Epoch 1180 | loss: nan | val_loss: nan | Time: 4426.41 ms
[2022-04-15 11:05:05	                main:574]	:	INFO	:	Epoch 1181 | loss: nan | val_loss: nan | Time: 4090.47 ms
[2022-04-15 11:05:10	                main:574]	:	INFO	:	Epoch 1182 | loss: nan | val_loss: nan | Time: 5409.17 ms
[2022-04-15 11:05:16	                main:574]	:	INFO	:	Epoch 1183 | loss: nan | val_loss: nan | Time: 5559.01 ms
[2022-04-15 11:05:21	                main:574]	:	INFO	:	Epoch 1184 | loss: nan | val_loss: nan | Time: 5641.61 ms
[2022-04-15 11:05:27	                main:574]	:	INFO	:	Epoch 1185 | loss: nan | val_loss: nan | Time: 5376.97 ms
[2022-04-15 11:05:31	                main:574]	:	INFO	:	Epoch 1186 | loss: nan | val_loss: nan | Time: 3813.58 ms
[2022-04-15 11:05:34	                main:574]	:	INFO	:	Epoch 1187 | loss: nan | val_loss: nan | Time: 3900.51 ms
[2022-04-15 11:05:39	                main:574]	:	INFO	:	Epoch 1188 | loss: nan | val_loss: nan | Time: 4249.99 ms
[2022-04-15 11:05:43	                main:574]	:	INFO	:	Epoch 1189 | loss: nan | val_loss: nan | Time: 4233.81 ms
[2022-04-15 11:05:47	                main:574]	:	INFO	:	Epoch 1190 | loss: nan | val_loss: nan | Time: 4267.67 ms
[2022-04-15 11:05:51	                main:574]	:	INFO	:	Epoch 1191 | loss: nan | val_loss: nan | Time: 3677.43 ms
[2022-04-15 11:05:56	                main:574]	:	INFO	:	Epoch 1192 | loss: nan | val_loss: nan | Time: 5180.21 ms
[2022-04-15 11:06:02	                main:574]	:	INFO	:	Epoch 1193 | loss: nan | val_loss: nan | Time: 5823.85 ms
[2022-04-15 11:06:08	                main:574]	:	INFO	:	Epoch 1194 | loss: nan | val_loss: nan | Time: 6290.46 ms
[2022-04-15 11:06:14	                main:574]	:	INFO	:	Epoch 1195 | loss: nan | val_loss: nan | Time: 6085.97 ms
[2022-04-15 11:06:19	                main:574]	:	INFO	:	Epoch 1196 | loss: nan | val_loss: nan | Time: 4965.47 ms
[2022-04-15 11:06:23	                main:574]	:	INFO	:	Epoch 1197 | loss: nan | val_loss: nan | Time: 3254.33 ms
[2022-04-15 11:06:27	                main:574]	:	INFO	:	Epoch 1198 | loss: nan | val_loss: nan | Time: 4573.46 ms
[2022-04-15 11:06:31	                main:574]	:	INFO	:	Epoch 1199 | loss: nan | val_loss: nan | Time: 4174.57 ms
[2022-04-15 11:06:36	                main:574]	:	INFO	:	Epoch 1200 | loss: nan | val_loss: nan | Time: 4263.27 ms
[2022-04-15 11:06:39	                main:574]	:	INFO	:	Epoch 1201 | loss: nan | val_loss: nan | Time: 3504.98 ms
[2022-04-15 11:06:44	                main:574]	:	INFO	:	Epoch 1202 | loss: nan | val_loss: nan | Time: 4970.78 ms
[2022-04-15 11:06:50	                main:574]	:	INFO	:	Epoch 1203 | loss: nan | val_loss: nan | Time: 5841.03 ms
[2022-04-15 11:06:56	                main:574]	:	INFO	:	Epoch 1204 | loss: nan | val_loss: nan | Time: 5852.21 ms
[2022-04-15 11:07:02	                main:574]	:	INFO	:	Epoch 1205 | loss: nan | val_loss: nan | Time: 5762.86 ms
[2022-04-15 11:07:07	                main:574]	:	INFO	:	Epoch 1206 | loss: nan | val_loss: nan | Time: 5565.3 ms
[2022-04-15 11:07:11	                main:574]	:	INFO	:	Epoch 1207 | loss: nan | val_loss: nan | Time: 3295.95 ms
[2022-04-15 11:07:16	                main:574]	:	INFO	:	Epoch 1208 | loss: nan | val_loss: nan | Time: 4338.38 ms
[2022-04-15 11:07:20	                main:574]	:	INFO	:	Epoch 1209 | loss: nan | val_loss: nan | Time: 4278.27 ms
[2022-04-15 11:07:25	                main:574]	:	INFO	:	Epoch 1210 | loss: nan | val_loss: nan | Time: 4273.94 ms
[2022-04-15 11:07:29	                main:574]	:	INFO	:	Epoch 1211 | loss: nan | val_loss: nan | Time: 4115.1 ms
[2022-04-15 11:07:33	                main:574]	:	INFO	:	Epoch 1212 | loss: nan | val_loss: nan | Time: 4190.43 ms
[2022-04-15 11:07:38	                main:574]	:	INFO	:	Epoch 1213 | loss: nan | val_loss: nan | Time: 5329.3 ms
[2022-04-15 11:07:44	                main:574]	:	INFO	:	Epoch 1214 | loss: nan | val_loss: nan | Time: 5760.52 ms
[2022-04-15 11:07:50	                main:574]	:	INFO	:	Epoch 1215 | loss: nan | val_loss: nan | Time: 6244.23 ms
[2022-04-15 11:07:56	                main:574]	:	INFO	:	Epoch 1216 | loss: nan | val_loss: nan | Time: 5973.24 ms
[2022-04-15 11:08:01	                main:574]	:	INFO	:	Epoch 1217 | loss: nan | val_loss: nan | Time: 4201.92 ms
[2022-04-15 11:08:03	                main:574]	:	INFO	:	Epoch 1218 | loss: nan | val_loss: nan | Time: 2189.81 ms
[2022-04-15 11:08:05	                main:574]	:	INFO	:	Epoch 1219 | loss: nan | val_loss: nan | Time: 2036.16 ms
[2022-04-15 11:08:07	                main:574]	:	INFO	:	Epoch 1220 | loss: nan | val_loss: nan | Time: 2117.69 ms
[2022-04-15 11:08:09	                main:574]	:	INFO	:	Epoch 1221 | loss: nan | val_loss: nan | Time: 2015.38 ms
[2022-04-15 11:08:11	                main:574]	:	INFO	:	Epoch 1222 | loss: nan | val_loss: nan | Time: 1996.66 ms
[2022-04-15 11:08:13	                main:574]	:	INFO	:	Epoch 1223 | loss: nan | val_loss: nan | Time: 1983.83 ms
[2022-04-15 11:08:15	                main:574]	:	INFO	:	Epoch 1224 | loss: nan | val_loss: nan | Time: 1987.81 ms
[2022-04-15 11:08:17	                main:574]	:	INFO	:	Epoch 1225 | loss: nan | val_loss: nan | Time: 2009.17 ms
[2022-04-15 11:08:19	                main:574]	:	INFO	:	Epoch 1226 | loss: nan | val_loss: nan | Time: 2015.51 ms
[2022-04-15 11:08:21	                main:574]	:	INFO	:	Epoch 1227 | loss: nan | val_loss: nan | Time: 2000.03 ms
[2022-04-15 11:08:23	                main:574]	:	INFO	:	Epoch 1228 | loss: nan | val_loss: nan | Time: 2038.01 ms
[2022-04-15 11:08:25	                main:574]	:	INFO	:	Epoch 1229 | loss: nan | val_loss: nan | Time: 2091.67 ms
[2022-04-15 11:08:27	                main:574]	:	INFO	:	Epoch 1230 | loss: nan | val_loss: nan | Time: 2106.54 ms
[2022-04-15 11:08:29	                main:574]	:	INFO	:	Epoch 1231 | loss: nan | val_loss: nan | Time: 2017.54 ms
[2022-04-15 11:08:31	                main:574]	:	INFO	:	Epoch 1232 | loss: nan | val_loss: nan | Time: 2058.28 ms
[2022-04-15 11:08:33	                main:574]	:	INFO	:	Epoch 1233 | loss: nan | val_loss: nan | Time: 2017.82 ms
[2022-04-15 11:08:35	                main:574]	:	INFO	:	Epoch 1234 | loss: nan | val_loss: nan | Time: 2017.81 ms
[2022-04-15 11:08:37	                main:574]	:	INFO	:	Epoch 1235 | loss: nan | val_loss: nan | Time: 1993.28 ms
[2022-04-15 11:08:39	                main:574]	:	INFO	:	Epoch 1236 | loss: nan | val_loss: nan | Time: 1995.01 ms
[2022-04-15 11:08:41	                main:574]	:	INFO	:	Epoch 1237 | loss: nan | val_loss: nan | Time: 2123.06 ms
[2022-04-15 11:08:43	                main:574]	:	INFO	:	Epoch 1238 | loss: nan | val_loss: nan | Time: 2031.16 ms
[2022-04-15 11:08:45	                main:574]	:	INFO	:	Epoch 1239 | loss: nan | val_loss: nan | Time: 2006.86 ms
[2022-04-15 11:08:48	                main:574]	:	INFO	:	Epoch 1240 | loss: nan | val_loss: nan | Time: 2013.22 ms
[2022-04-15 11:08:50	                main:574]	:	INFO	:	Epoch 1241 | loss: nan | val_loss: nan | Time: 2005.09 ms
[2022-04-15 11:08:52	                main:574]	:	INFO	:	Epoch 1242 | loss: nan | val_loss: nan | Time: 1994.62 ms
[2022-04-15 11:08:54	                main:574]	:	INFO	:	Epoch 1243 | loss: nan | val_loss: nan | Time: 2020.1 ms
[2022-04-15 11:08:56	                main:574]	:	INFO	:	Epoch 1244 | loss: nan | val_loss: nan | Time: 2025.73 ms
[2022-04-15 11:08:58	                main:574]	:	INFO	:	Epoch 1245 | loss: nan | val_loss: nan | Time: 2053.07 ms
[2022-04-15 11:09:00	                main:574]	:	INFO	:	Epoch 1246 | loss: nan | val_loss: nan | Time: 2045.75 ms
[2022-04-15 11:09:03	                main:574]	:	INFO	:	Epoch 1247 | loss: nan | val_loss: nan | Time: 2998.41 ms
[2022-04-15 11:09:07	                main:574]	:	INFO	:	Epoch 1248 | loss: nan | val_loss: nan | Time: 4438.48 ms
[2022-04-15 11:09:12	                main:574]	:	INFO	:	Epoch 1249 | loss: nan | val_loss: nan | Time: 4365.43 ms
[2022-04-15 11:09:16	                main:574]	:	INFO	:	Epoch 1250 | loss: nan | val_loss: nan | Time: 4264.89 ms
[2022-04-15 11:09:19	                main:574]	:	INFO	:	Epoch 1251 | loss: nan | val_loss: nan | Time: 3454.24 ms
[2022-04-15 11:09:22	                main:574]	:	INFO	:	Epoch 1252 | loss: nan | val_loss: nan | Time: 2269.54 ms
[2022-04-15 11:09:26	                main:574]	:	INFO	:	Epoch 1253 | loss: nan | val_loss: nan | Time: 4747.69 ms
[2022-04-15 11:09:32	                main:574]	:	INFO	:	Epoch 1254 | loss: nan | val_loss: nan | Time: 5524.97 ms
[2022-04-15 11:09:38	                main:574]	:	INFO	:	Epoch 1255 | loss: nan | val_loss: nan | Time: 6040.5 ms
[2022-04-15 11:09:44	                main:574]	:	INFO	:	Epoch 1256 | loss: nan | val_loss: nan | Time: 5796.03 ms
[2022-04-15 11:09:50	                main:574]	:	INFO	:	Epoch 1257 | loss: nan | val_loss: nan | Time: 6136.69 ms
[2022-04-15 11:09:54	                main:574]	:	INFO	:	Epoch 1258 | loss: nan | val_loss: nan | Time: 4281.75 ms
[2022-04-15 11:09:59	                main:574]	:	INFO	:	Epoch 1259 | loss: nan | val_loss: nan | Time: 4099.46 ms
[2022-04-15 11:10:03	                main:574]	:	INFO	:	Epoch 1260 | loss: nan | val_loss: nan | Time: 4373.84 ms
[2022-04-15 11:10:07	                main:574]	:	INFO	:	Epoch 1261 | loss: nan | val_loss: nan | Time: 4456.03 ms
[2022-04-15 11:10:11	                main:574]	:	INFO	:	Epoch 1262 | loss: nan | val_loss: nan | Time: 3110.09 ms
[2022-04-15 11:10:13	                main:574]	:	INFO	:	Epoch 1263 | loss: nan | val_loss: nan | Time: 2028.34 ms
[2022-04-15 11:10:15	                main:574]	:	INFO	:	Epoch 1264 | loss: nan | val_loss: nan | Time: 2022.82 ms
[2022-04-15 11:10:17	                main:574]	:	INFO	:	Epoch 1265 | loss: nan | val_loss: nan | Time: 1994.51 ms
[2022-04-15 11:10:19	                main:574]	:	INFO	:	Epoch 1266 | loss: nan | val_loss: nan | Time: 2012.36 ms
[2022-04-15 11:10:21	                main:574]	:	INFO	:	Epoch 1267 | loss: nan | val_loss: nan | Time: 2103.18 ms
[2022-04-15 11:10:23	                main:574]	:	INFO	:	Epoch 1268 | loss: nan | val_loss: nan | Time: 2088.8 ms
[2022-04-15 11:10:25	                main:574]	:	INFO	:	Epoch 1269 | loss: nan | val_loss: nan | Time: 2083.13 ms
[2022-04-15 11:10:27	                main:574]	:	INFO	:	Epoch 1270 | loss: nan | val_loss: nan | Time: 2060.72 ms
[2022-04-15 11:10:29	                main:574]	:	INFO	:	Epoch 1271 | loss: nan | val_loss: nan | Time: 2112.03 ms
[2022-04-15 11:10:31	                main:574]	:	INFO	:	Epoch 1272 | loss: nan | val_loss: nan | Time: 2119.97 ms
[2022-04-15 11:10:33	                main:574]	:	INFO	:	Epoch 1273 | loss: nan | val_loss: nan | Time: 2095.47 ms
[2022-04-15 11:10:35	                main:574]	:	INFO	:	Epoch 1274 | loss: nan | val_loss: nan | Time: 1995.75 ms
[2022-04-15 11:10:37	                main:574]	:	INFO	:	Epoch 1275 | loss: nan | val_loss: nan | Time: 1964.95 ms
[2022-04-15 11:10:39	                main:574]	:	INFO	:	Epoch 1276 | loss: nan | val_loss: nan | Time: 2007.4 ms
[2022-04-15 11:10:41	                main:574]	:	INFO	:	Epoch 1277 | loss: nan | val_loss: nan | Time: 1929.53 ms
[2022-04-15 11:10:43	                main:574]	:	INFO	:	Epoch 1278 | loss: nan | val_loss: nan | Time: 1929.93 ms
[2022-04-15 11:10:45	                main:574]	:	INFO	:	Epoch 1279 | loss: nan | val_loss: nan | Time: 1917.98 ms
[2022-04-15 11:10:47	                main:574]	:	INFO	:	Epoch 1280 | loss: nan | val_loss: nan | Time: 1924.33 ms
[2022-04-15 11:10:49	                main:574]	:	INFO	:	Epoch 1281 | loss: nan | val_loss: nan | Time: 1935.24 ms
[2022-04-15 11:10:51	                main:574]	:	INFO	:	Epoch 1282 | loss: nan | val_loss: nan | Time: 1947.73 ms
[2022-04-15 11:10:53	                main:574]	:	INFO	:	Epoch 1283 | loss: nan | val_loss: nan | Time: 1975.83 ms
[2022-04-15 11:10:56	                main:574]	:	INFO	:	Epoch 1284 | loss: nan | val_loss: nan | Time: 3312.9 ms
[2022-04-15 11:11:00	                main:574]	:	INFO	:	Epoch 1285 | loss: nan | val_loss: nan | Time: 3928.4 ms
[2022-04-15 11:11:04	                main:574]	:	INFO	:	Epoch 1286 | loss: nan | val_loss: nan | Time: 4014.94 ms
[2022-04-15 11:11:08	                main:574]	:	INFO	:	Epoch 1287 | loss: nan | val_loss: nan | Time: 3855.09 ms
[2022-04-15 11:11:12	                main:574]	:	INFO	:	Epoch 1288 | loss: nan | val_loss: nan | Time: 3844.85 ms
[2022-04-15 11:11:14	                main:574]	:	INFO	:	Epoch 1289 | loss: nan | val_loss: nan | Time: 2398.08 ms
[2022-04-15 11:11:18	                main:574]	:	INFO	:	Epoch 1290 | loss: nan | val_loss: nan | Time: 3448.79 ms
[2022-04-15 11:11:23	                main:574]	:	INFO	:	Epoch 1291 | loss: nan | val_loss: nan | Time: 4797.42 ms
[2022-04-15 11:11:28	                main:574]	:	INFO	:	Epoch 1292 | loss: nan | val_loss: nan | Time: 5125.37 ms
[2022-04-15 11:11:33	                main:574]	:	INFO	:	Epoch 1293 | loss: nan | val_loss: nan | Time: 5270.66 ms
[2022-04-15 11:11:38	                main:574]	:	INFO	:	Epoch 1294 | loss: nan | val_loss: nan | Time: 5209.41 ms
[2022-04-15 11:11:42	                main:574]	:	INFO	:	Epoch 1295 | loss: nan | val_loss: nan | Time: 4080.59 ms
[2022-04-15 11:11:46	                main:574]	:	INFO	:	Epoch 1296 | loss: nan | val_loss: nan | Time: 3192.22 ms
[2022-04-15 11:11:50	                main:574]	:	INFO	:	Epoch 1297 | loss: nan | val_loss: nan | Time: 3955.57 ms
[2022-04-15 11:11:54	                main:574]	:	INFO	:	Epoch 1298 | loss: nan | val_loss: nan | Time: 4100.36 ms
[2022-04-15 11:11:58	                main:574]	:	INFO	:	Epoch 1299 | loss: nan | val_loss: nan | Time: 3978.45 ms
[2022-04-15 11:12:02	                main:574]	:	INFO	:	Epoch 1300 | loss: nan | val_loss: nan | Time: 4053.04 ms
[2022-04-15 11:12:05	                main:574]	:	INFO	:	Epoch 1301 | loss: nan | val_loss: nan | Time: 3492.19 ms
[2022-04-15 11:12:09	                main:574]	:	INFO	:	Epoch 1302 | loss: nan | val_loss: nan | Time: 4094.01 ms
[2022-04-15 11:12:14	                main:574]	:	INFO	:	Epoch 1303 | loss: nan | val_loss: nan | Time: 4809.24 ms
[2022-04-15 11:12:20	                main:574]	:	INFO	:	Epoch 1304 | loss: nan | val_loss: nan | Time: 5366.23 ms
[2022-04-15 11:12:25	                main:574]	:	INFO	:	Epoch 1305 | loss: nan | val_loss: nan | Time: 5148.55 ms
[2022-04-15 11:12:30	                main:574]	:	INFO	:	Epoch 1306 | loss: nan | val_loss: nan | Time: 5352.18 ms
[2022-04-15 11:12:33	                main:574]	:	INFO	:	Epoch 1307 | loss: nan | val_loss: nan | Time: 3037.62 ms
[2022-04-15 11:12:37	                main:574]	:	INFO	:	Epoch 1308 | loss: nan | val_loss: nan | Time: 3961.85 ms
[2022-04-15 11:12:41	                main:574]	:	INFO	:	Epoch 1309 | loss: nan | val_loss: nan | Time: 4009.04 ms
[2022-04-15 11:12:45	                main:574]	:	INFO	:	Epoch 1310 | loss: nan | val_loss: nan | Time: 4056.88 ms
[2022-04-15 11:12:49	                main:574]	:	INFO	:	Epoch 1311 | loss: nan | val_loss: nan | Time: 4065.76 ms
[2022-04-15 11:12:53	                main:574]	:	INFO	:	Epoch 1312 | loss: nan | val_loss: nan | Time: 3558.22 ms
[2022-04-15 11:12:58	                main:574]	:	INFO	:	Epoch 1313 | loss: nan | val_loss: nan | Time: 4827.54 ms
[2022-04-15 11:13:03	                main:574]	:	INFO	:	Epoch 1314 | loss: nan | val_loss: nan | Time: 5286 ms
[2022-04-15 11:13:08	                main:574]	:	INFO	:	Epoch 1315 | loss: nan | val_loss: nan | Time: 5270.56 ms
[2022-04-15 11:13:14	                main:574]	:	INFO	:	Epoch 1316 | loss: nan | val_loss: nan | Time: 5113.62 ms
[2022-04-15 11:13:18	                main:574]	:	INFO	:	Epoch 1317 | loss: nan | val_loss: nan | Time: 4272.97 ms
[2022-04-15 11:13:21	                main:574]	:	INFO	:	Epoch 1318 | loss: nan | val_loss: nan | Time: 3271.94 ms
[2022-04-15 11:13:25	                main:574]	:	INFO	:	Epoch 1319 | loss: nan | val_loss: nan | Time: 4149.36 ms
[2022-04-15 11:13:30	                main:574]	:	INFO	:	Epoch 1320 | loss: nan | val_loss: nan | Time: 4536.17 ms
[2022-04-15 11:13:34	                main:574]	:	INFO	:	Epoch 1321 | loss: nan | val_loss: nan | Time: 4599.7 ms
[2022-04-15 11:13:38	                main:574]	:	INFO	:	Epoch 1322 | loss: nan | val_loss: nan | Time: 3460.93 ms
[2022-04-15 11:13:42	                main:574]	:	INFO	:	Epoch 1323 | loss: nan | val_loss: nan | Time: 4497.28 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 960)
[2022-04-20 03:59:00	                main:435]	:	INFO	:	Set logging level to 1
[2022-04-20 03:59:00	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-04-20 03:59:00	                main:444]	:	INFO	:	Resolving all filenames
[2022-04-20 03:59:00	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-20 03:59:00	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-20 03:59:00	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-20 03:59:00	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-20 03:59:00	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-20 03:59:00	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-04-20 03:59:00	                main:474]	:	INFO	:	Configuration: 
[2022-04-20 03:59:00	                main:475]	:	INFO	:	    Model type: GRU
[2022-04-20 03:59:00	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-04-20 03:59:00	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-04-20 03:59:00	                main:478]	:	INFO	:	    Batch Size: 128
[2022-04-20 03:59:00	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-04-20 03:59:00	                main:480]	:	INFO	:	    Patience: 10
[2022-04-20 03:59:00	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-04-20 03:59:00	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-04-20 03:59:00	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-04-20 03:59:00	                main:484]	:	INFO	:	    # Threads: 1
[2022-04-20 03:59:00	                main:486]	:	INFO	:	Preparing Dataset
[2022-04-20 03:59:00	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-20 03:59:01	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-20 03:59:04	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-04-20 03:59:04	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-20 03:59:04	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-20 03:59:04	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-04-20 03:59:04	                main:494]	:	INFO	:	Creating Model
[2022-04-20 03:59:04	                main:507]	:	INFO	:	Preparing config file
[2022-04-20 03:59:04	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-04-20 03:59:04	                main:512]	:	INFO	:	Loading config


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFD3A1F4F69

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 04/20/22 03:59:05
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\11;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 0000000082530000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000003c770000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.19041.1466 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1466

ModLoad: 000000003bc50000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.19041.1503 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1503

ModLoad: 000000003a1c0000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.19041.1503 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1503

ModLoad: 000000003c440000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.19041.1645 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1645

ModLoad: 000000003a490000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1526) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.19041.1526 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1526

ModLoad: 000000003c410000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202

ModLoad: 0000000039f30000 000000000010d000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.19041.1466 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1466

ModLoad: 000000003a620000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 000000003a6c0000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 000000003bef0000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.19041.1645 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1645

ModLoad: 000000003a820000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.19041.546

ModLoad: 000000003c370000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000003acc0000 0000000000125000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.19041.1645 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1645

ModLoad: 000000001dc20000 0000000000058000 C:\ProgramData\BOINC\slots\11\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000026180000 000000000008d000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.29.30135.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\4\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.29.30135.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.29.30135.0

ModLoad: 00000000398a0000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.867

ModLoad: 0000000026390000 000000000001b000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.29.30135.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\4\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.29.30135.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.29.30135.0

ModLoad: 0000000025f30000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.29.30135.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\a01\_work\4\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.29.30135.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.29.30135.0

ModLoad: 00000000a8c20000 0000000024b49000 C:\ProgramData\BOINC\slots\11\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000001eac0000 0000000000045000 C:\ProgramData\BOINC\slots\11\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000e1500000 00000000034b2000 C:\ProgramData\BOINC\slots\11\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000de450000 00000000030a5000 C:\ProgramData\BOINC\slots\11\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 0000000038090000 0000000000010000 C:\ProgramData\BOINC\slots\11\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 000000008d870000 000000001b3a4000 C:\ProgramData\BOINC\slots\11\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 0000000082c80000 000000000abe7000 C:\ProgramData\BOINC\slots\11\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000079ae0000 000000000919f000 C:\ProgramData\BOINC\slots\11\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 000000001ce60000 000000000020d000 C:\ProgramData\BOINC\slots\11\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 0000000004da0000 00000000002db000 C:\ProgramData\BOINC\slots\11\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000034790000 0000000000040000 C:\ProgramData\BOINC\slots\11\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000da6f0000 0000000003d5b000 C:\ProgramData\BOINC\slots\11\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000f1a00000 0000000001eca000 C:\ProgramData\BOINC\slots\11\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 000000003c5e0000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000380b0000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000003aed0000 0000000000472000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.19041.1645 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1645

ModLoad: 000000003a100000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 000000003a0d0000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.19041.1645 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1645

ModLoad: 0000000039c20000 0000000000034000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 000000003a150000 0000000000069000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.19041.1503 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1503

ModLoad: 000000003a4c0000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.19041.1645 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1645

ModLoad: 0000000039630000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000003b430000 0000000000744000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.19041.1645 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1645

ModLoad: 0000000037810000 0000000000794000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.19041.1645 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1645

ModLoad: 000000003c010000 0000000000355000 C:\WINDOWS\System32\combase.dll (6.2.19041.1348) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.19041.1645 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1645

ModLoad: 00000000391e0000 000000000002e000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.19041.1645 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1645

ModLoad: 000000003bb80000 00000000000ad000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1387) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.19041.1645 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1645

ModLoad: 000000003bfb0000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.19041.1645 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.19041.1645

ModLoad: 00000000f7f00000 00000000002cd000 C:\WINDOWS\system32\nvcuda.dll (30.0.15.1123) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_04\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 30.0.15.1123
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.6.58 driver
    Product Version       : 30.0.15.1123

ModLoad: 00000000f6860000 00000000016a0000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispig.inf_amd64_015fa42d67826549\nvcuda64.dll (30.0.15.1123) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_04\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 30.0.15.1123
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.6.58 driver
    Product Version       : 30.0.15.1123

ModLoad: 0000000036b10000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000032d70000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.19041.906 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.906

ModLoad: 000000002fb50000 000000000014a000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : drvstore.pdb
    File Version          : 10.0.19041.1320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1320

ModLoad: 00000000391d0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000002f3b0000 0000000000767000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.15.1123) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_04\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 30.0.15.1123
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 30.0.15.1123

ModLoad: 000000003a040000 0000000000082000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.19041.1415 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1415



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3616, Write: 307, Other 927

- I/O Transfers Counters -
Read: 6657874, Write: 6049, Other 28848

- Paged Pool Usage -
QuotaPagedPoolUsage: 3466248, QuotaPeakPagedPoolUsage: 3466248
QuotaNonPagedPoolUsage: 37120, QuotaPeakNonPagedPoolUsage: 37184

- Virtual Memory Usage -
VirtualSize: -1489379328, PeakVirtualSize: -985804800

- Pagefile Usage -
PagefileUsage: -1489379328, PeakPagefileUsage: -1489379328

- Working Set Size -
WorkingSetSize: 1138487296, PeakWorkingSetSize: 1138491392, PageFaultCount: 376822

*** Dump of thread ID 16104 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 12031250.000000, User Time: 20937500.000000, Wait Time: 934123.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFD3A1F4F69

- Registers -
rax=00000000fcdb6048 rbx=0000000082894910 rcx=00000000202ff300 rdx=000000003c795b00 rsi=00000000fcdb68b0 rdi=0000000019930520
r8=00000000fcdb6070 r9=00000000fcdb6098 r10=0000000000000004 r11=00000000fcdb60a8 r12=000000007cd1c970 r13=00000000fcdb6ac0
r14=0000000020531200 r15=0000000000000000 rip=000000003a1f4f69 rsp=00000000fcdb6750 rbp=00000000fcdb6a40
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
fcdb6820 827aa884 00000040 0000004f 7cd1bc00 00000376 KERNELBASE!RaiseException+0x0 
fcdb6880 82551ca6 00000001 4b8d0000 1b1b6970 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
fcdb6930 8255593b 00000000 00000030 00000020 00000008 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
fcdb6a80 82551a78 00000000 00000000 fcdb6db0 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
fcdb6b50 82551cfc fcdb6db0 00000000 00000080 fcdb7080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
fcdb6c10 8255c4dd fcdb7080 fcdb7080 fcdb7080 fcdb7080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
fcdb6f00 8254b2fe fcdb7518 fcdb7080 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
fcdcfca0 8278c6f8 4d47d210 00000000 00000000 4cfe8910 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
fcdcfce0 3bc67034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
fcdcfd10 3c7c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
fcdcfd90 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 232 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 933843.000000

- Registers -
rax=00000000000001d3 rbx=000000004b8d5610 rcx=0000000000000070 rdx=000000004b8d5290 rsi=000000004b8d3980 rdi=000000004b8d5610
r8=0000000000000239 r9=0000000000000239 r10=0000000000000208 r11=000000000000026b r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000003c8107c4 rsp=00000000fd0ffb78 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
fd0ffb70 3c7c2dc7 00000000 00000000 4b8d3980 4b8d5610 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
fd0ffe70 3bc67034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
fd0ffea0 3c7c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
fd0fff20 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 17148 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 933843.000000

- Registers -
rax=00000000000001d3 rbx=000000004b8d5fe0 rcx=0000000000000070 rdx=000000004b8d5c60 rsi=000000004b8d3980 rdi=000000004b8d5fe0
r8=0000000036b15008 r9=00000000fd1feee0 r10=0000000036b100f0 r11=0000000000000001 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000003c8107c4 rsp=00000000fd1ff438 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
fd1ff430 3c7c2dc7 00000000 00000000 4b8d3980 4b8d5fe0 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
fd1ff730 3bc67034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
fd1ff760 3c7c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
fd1ff7e0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 11532 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 933843.000000

- Registers -
rax=00000000000001d3 rbx=000000004b8d6410 rcx=0000000000000070 rdx=000000004b8d6090 rsi=000000004b8d3980 rdi=000000004b8d6410
r8=0000000000000008 r9=0000000000000040 r10=0000000000000100 r11=0000000070e28d45 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000003c8107c4 rsp=00000000fd2ff558 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
fd2ff550 3c7c2dc7 00000000 00000000 4b8d3980 4b8d6410 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
fd2ff850 3bc67034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
fd2ff880 3c7c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
fd2ff900 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 16000 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 934118.000000

- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000fd4ff6d0 rsi=0000000000000000 rdi=0000000000000064
r8=00000000ffffffff r9=00000000827e86e0 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000003c80d3f4 rsp=00000000fd4ff6a8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
fd4ff6a0 3a20962e fd4ff768 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0 
fd4ff740 8256a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0 
fd4ff770 3bc67034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
fd4ff7a0 3c7c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
fd4ff820 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 6152 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 934119.000000

- Registers -
rax=000000000000005b rbx=000000000000000b rcx=000000000000000b rdx=00000000fd5ff720 rsi=0000000000000000 rdi=000000000000000b
r8=00000000fd5ff3c8 r9=000000004d65ebb0 r10=0000000000000000 r11=00000000fd5ff690 r12=0000000000000064 r13=00000000fd5ff720
r14=00000000fd5ff420 r15=0000000000000000 rip=000000003c80d8c4 rsp=00000000fd5ff3c8 rbp=000000004d65ebb0
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
fd5ff3c0 3a20cb20 00000000 fcfbb000 3c8da4d0 fcfbb000 ntdll!ZwWaitForMultipleObjects+0x0 
fd5ff6b0 3a20ca1e 4b8e2fa0 004e0049 0000000b 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
fd5ff6f0 f6a3d384 4d662690 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
fd5ff930 f6ae56fd 00000000 4d65ebb0 00000000 00000000 nvcuda64!+0x0 
fd5ff9e0 f6a3cd53 fbfee1e6 f9faf620 4dc2b2d0 00000000 nvcuda64!cuProfilerStop+0x0 
fd5ffa10 f6d74064 4dc2b2d0 00000000 00000000 00000000 nvcuda64!+0x0 
fd5ffa40 3bc67034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
fd5ffa70 3c7c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
fd5ffaf0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 15816 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 933914.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002cc rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002cc
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=000000004d644f50 r13=0000000000000000
r14=00000000000002cc r15=0000000000000000 rip=000000003c80cdf4 rsp=00000000fd6ffa88 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
fd6ffa80 3a1e1a5e 00000000 00001f80 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0 
fd6ffb20 f6c6596e 4dc2bde0 00000000 00000000 000002cc KERNELBASE!WaitForSingleObjectEx+0x0 
fd6ffd60 f6a3cd53 00000000 4dc2bde0 f6860000 4d67c3c0 nvcuda64!cuProfilerStop+0x0 
fd6ffd90 f6d74064 4dc2bde0 00000000 00000000 00000000 nvcuda64!+0x0 
fd6ffdc0 3bc67034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
fd6ffdf0 3c7c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
fd6ffe70 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)