Task 11536180
| Name | ParityModified-1639959159-13652-3-0_0 |
| Workunit | 8760910 |
| Created | 13 Feb 2022, 19:19:02 UTC |
| Sent | 26 Feb 2022, 16:48:20 UTC |
| Report deadline | 6 Mar 2022, 16:48:20 UTC |
| Received | 4 Mar 2022, 16:09:10 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 197 (0x000000C5) EXIT_TIME_LIMIT_EXCEEDED |
| Computer ID | 13205 |
| Run time | 4 hours 32 min 42 sec |
| CPU time | 4 hours 30 min 55 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 17,053.64 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 2.79 GB |
| Peak swap size | 4.79 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
exceeded elapsed time limit 16361.60 (4000000.00G/244.47G)</message>
<stderr_txt>
5 | val_loss: 0.0311818 | Time: 4899.65 ms
[2022-03-04 15:47:01 main:574] : INFO : Epoch 1118 | loss: 0.0311763 | val_loss: 0.0311788 | Time: 4831.88 ms
[2022-03-04 15:47:06 main:574] : INFO : Epoch 1119 | loss: 0.0311719 | val_loss: 0.0311838 | Time: 4843.24 ms
[2022-03-04 15:47:11 main:574] : INFO : Epoch 1120 | loss: 0.0311758 | val_loss: 0.0311843 | Time: 4836.99 ms
[2022-03-04 15:47:16 main:574] : INFO : Epoch 1121 | loss: 0.031175 | val_loss: 0.0311872 | Time: 4727.82 ms
[2022-03-04 15:47:21 main:574] : INFO : Epoch 1122 | loss: 0.0311734 | val_loss: 0.0311808 | Time: 4794.53 ms
[2022-03-04 15:47:25 main:574] : INFO : Epoch 1123 | loss: 0.0311729 | val_loss: 0.0311811 | Time: 4834.64 ms
[2022-03-04 15:47:30 main:574] : INFO : Epoch 1124 | loss: 0.0311704 | val_loss: 0.0311789 | Time: 4835.12 ms
[2022-03-04 15:47:35 main:574] : INFO : Epoch 1125 | loss: 0.0311704 | val_loss: 0.0311802 | Time: 4813.41 ms
[2022-03-04 15:47:40 main:574] : INFO : Epoch 1126 | loss: 0.0311714 | val_loss: 0.0311894 | Time: 4777.7 ms
[2022-03-04 15:47:45 main:574] : INFO : Epoch 1127 | loss: 0.0311714 | val_loss: 0.0311787 | Time: 4879.56 ms
[2022-03-04 15:47:49 main:574] : INFO : Epoch 1128 | loss: 0.0311706 | val_loss: 0.0311805 | Time: 4776.67 ms
[2022-03-04 15:47:54 main:574] : INFO : Epoch 1129 | loss: 0.0311723 | val_loss: 0.0311864 | Time: 4873.08 ms
[2022-03-04 15:47:59 main:574] : INFO : Epoch 1130 | loss: 0.0311719 | val_loss: 0.03118 | Time: 4817.36 ms
[2022-03-04 15:48:04 main:574] : INFO : Epoch 1131 | loss: 0.031174 | val_loss: 0.0311943 | Time: 4784.64 ms
[2022-03-04 15:48:09 main:574] : INFO : Epoch 1132 | loss: 0.0312012 | val_loss: 0.0312067 | Time: 4818.4 ms
[2022-03-04 15:48:14 main:574] : INFO : Epoch 1133 | loss: 0.0312056 | val_loss: 0.0312068 | Time: 4799.42 ms
[2022-03-04 15:48:18 main:574] : INFO : Epoch 1134 | loss: 0.0312061 | val_loss: 0.0312087 | Time: 4825.55 ms
[2022-03-04 15:48:23 main:574] : INFO : Epoch 1135 | loss: 0.0312027 | val_loss: 0.031205 | Time: 4785.41 ms
[2022-03-04 15:48:28 main:574] : INFO : Epoch 1136 | loss: 0.0312009 | val_loss: 0.0312089 | Time: 4833.05 ms
[2022-03-04 15:48:33 main:574] : INFO : Epoch 1137 | loss: 0.0312002 | val_loss: 0.0312032 | Time: 4787.08 ms
[2022-03-04 15:48:38 main:574] : INFO : Epoch 1138 | loss: 0.031197 | val_loss: 0.0312049 | Time: 4879.44 ms
[2022-03-04 15:48:43 main:574] : INFO : Epoch 1139 | loss: 0.0311967 | val_loss: 0.0312005 | Time: 4818.61 ms
[2022-03-04 15:48:47 main:574] : INFO : Epoch 1140 | loss: 0.0311961 | val_loss: 0.031205 | Time: 4794.37 ms
[2022-03-04 15:48:52 main:574] : INFO : Epoch 1141 | loss: 0.0311992 | val_loss: 0.0312039 | Time: 4822.85 ms
[2022-03-04 15:48:57 main:574] : INFO : Epoch 1142 | loss: 0.0311962 | val_loss: 0.0312021 | Time: 4839.96 ms
[2022-03-04 15:49:02 main:574] : INFO : Epoch 1143 | loss: 0.0311946 | val_loss: 0.0312061 | Time: 4799.39 ms
[2022-03-04 15:49:07 main:574] : INFO : Epoch 1144 | loss: 0.0311941 | val_loss: 0.0312033 | Time: 4821 ms
[2022-03-04 15:49:11 main:574] : INFO : Epoch 1145 | loss: 0.031193 | val_loss: 0.0312016 | Time: 4750.58 ms
[2022-03-04 15:49:16 main:574] : INFO : Epoch 1146 | loss: 0.031193 | val_loss: 0.031202 | Time: 4832.54 ms
[2022-03-04 15:49:21 main:574] : INFO : Epoch 1147 | loss: 0.0311924 | val_loss: 0.0311991 | Time: 4798.8 ms
[2022-03-04 15:49:26 main:574] : INFO : Epoch 1148 | loss: 0.031193 | val_loss: 0.0311993 | Time: 4819.68 ms
[2022-03-04 15:49:31 main:574] : INFO : Epoch 1149 | loss: 0.0311936 | val_loss: 0.0312027 | Time: 4818.4 ms
[2022-03-04 15:49:36 main:574] : INFO : Epoch 1150 | loss: 0.0311941 | val_loss: 0.0311986 | Time: 4891.28 ms
[2022-03-04 15:49:40 main:574] : INFO : Epoch 1151 | loss: 0.0311923 | val_loss: 0.0311998 | Time: 4802.31 ms
[2022-03-04 15:49:45 main:574] : INFO : Epoch 1152 | loss: 0.0311903 | val_loss: 0.0311981 | Time: 4799.98 ms
[2022-03-04 15:49:50 main:574] : INFO : Epoch 1153 | loss: 0.0311897 | val_loss: 0.0312005 | Time: 4846.23 ms
[2022-03-04 15:49:55 main:574] : INFO : Epoch 1154 | loss: 0.0311914 | val_loss: 0.0311986 | Time: 4843.88 ms
[2022-03-04 15:50:00 main:574] : INFO : Epoch 1155 | loss: 0.0311893 | val_loss: 0.0312001 | Time: 4793.3 ms
[2022-03-04 15:50:05 main:574] : INFO : Epoch 1156 | loss: 0.0311924 | val_loss: 0.0312047 | Time: 4864.7 ms
[2022-03-04 15:50:09 main:574] : INFO : Epoch 1157 | loss: 0.0311896 | val_loss: 0.0311977 | Time: 4849.62 ms
[2022-03-04 15:50:14 main:574] : INFO : Epoch 1158 | loss: 0.0311888 | val_loss: 0.0311982 | Time: 4864.31 ms
[2022-03-04 15:50:19 main:574] : INFO : Epoch 1159 | loss: 0.0311891 | val_loss: 0.0311966 | Time: 4836.12 ms
[2022-03-04 15:50:24 main:574] : INFO : Epoch 1160 | loss: 0.0311889 | val_loss: 0.0311982 | Time: 4819.9 ms
[2022-03-04 15:50:29 main:574] : INFO : Epoch 1161 | loss: 0.0311921 | val_loss: 0.0311989 | Time: 4837.1 ms
[2022-03-04 15:50:34 main:574] : INFO : Epoch 1162 | loss: 0.0311907 | val_loss: 0.0311999 | Time: 4826.82 ms
[2022-03-04 15:50:38 main:574] : INFO : Epoch 1163 | loss: 0.0311883 | val_loss: 0.0312035 | Time: 4812.88 ms
[2022-03-04 15:50:43 main:574] : INFO : Epoch 1164 | loss: 0.0311893 | val_loss: 0.0311978 | Time: 4808.1 ms
[2022-03-04 15:50:48 main:574] : INFO : Epoch 1165 | loss: 0.0311884 | val_loss: 0.0311988 | Time: 4772.55 ms
[2022-03-04 15:50:53 main:574] : INFO : Epoch 1166 | loss: 0.0311863 | val_loss: 0.0311977 | Time: 4836.45 ms
[2022-03-04 15:50:58 main:574] : INFO : Epoch 1167 | loss: 0.0311855 | val_loss: 0.031198 | Time: 4824.62 ms
[2022-03-04 15:51:02 main:574] : INFO : Epoch 1168 | loss: 0.031189 | val_loss: 0.031198 | Time: 4812.39 ms
[2022-03-04 15:51:07 main:574] : INFO : Epoch 1169 | loss: 0.031185 | val_loss: 0.0311967 | Time: 4825.83 ms
[2022-03-04 15:51:12 main:574] : INFO : Epoch 1170 | loss: 0.0311859 | val_loss: 0.0312021 | Time: 4850.39 ms
[2022-03-04 15:51:17 main:574] : INFO : Epoch 1171 | loss: 0.0311846 | val_loss: 0.0311959 | Time: 4863.44 ms
[2022-03-04 15:51:22 main:574] : INFO : Epoch 1172 | loss: 0.0311842 | val_loss: 0.031201 | Time: 4782.88 ms
[2022-03-04 15:51:27 main:574] : INFO : Epoch 1173 | loss: 0.0311855 | val_loss: 0.0311971 | Time: 4817.64 ms
[2022-03-04 15:51:31 main:574] : INFO : Epoch 1174 | loss: 0.0311863 | val_loss: 0.0311955 | Time: 4815.98 ms
[2022-03-04 15:51:36 main:574] : INFO : Epoch 1175 | loss: 0.0311861 | val_loss: 0.0311945 | Time: 4805.56 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080 Ti)
[2022-03-04 15:58:20 main:435] : INFO : Set logging level to 1
[2022-03-04 15:58:20 main:441] : INFO : Running in BOINC Client mode
[2022-03-04 15:58:20 main:444] : INFO : Resolving all filenames
[2022-03-04 15:58:20 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-04 15:58:20 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-04 15:58:20 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-04 15:58:20 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-04 15:58:20 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-04 15:58:20 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-03-04 15:58:20 main:474] : INFO : Configuration:
[2022-03-04 15:58:20 main:475] : INFO : Model type: GRU
[2022-03-04 15:58:20 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-03-04 15:58:20 main:477] : INFO : Max Epochs: 2048
[2022-03-04 15:58:20 main:478] : INFO : Batch Size: 128
[2022-03-04 15:58:20 main:479] : INFO : Learning Rate: 0.01
[2022-03-04 15:58:20 main:480] : INFO : Patience: 10
[2022-03-04 15:58:20 main:481] : INFO : Hidden Width: 12
[2022-03-04 15:58:20 main:482] : INFO : # Recurrent Layers: 4
[2022-03-04 15:58:20 main:483] : INFO : # Backend Layers: 4
[2022-03-04 15:58:20 main:484] : INFO : # Threads: 1
[2022-03-04 15:58:20 main:486] : INFO : Preparing Dataset
[2022-03-04 15:58:20 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-04 15:58:21 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
[2022-03-04 16:26:44 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2022-03-04 16:26:44 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory
[2022-03-04 16:26:44 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory
[2022-03-04 16:26:44 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2022-03-04 16:26:44 main:494] : INFO : Creating Model
[2022-03-04 16:26:44 main:507] : INFO : Preparing config file
[2022-03-04 16:26:44 main:511] : INFO : Found checkpoint, attempting to load...
[2022-03-04 16:26:44 main:512] : INFO : Loading config
[2022-03-04 16:26:44 main:514] : INFO : Loading state
[2022-03-04 16:52:01 main:559] : INFO : Loading DataLoader into Memory
[2022-03-04 16:52:01 main:562] : INFO : Starting Training
[2022-03-04 16:54:21 main:574] : INFO : Epoch 1166 | loss: 0.0312481 | val_loss: 0.0311984 | Time: 140681 ms
[2022-03-04 16:54:26 main:574] : INFO : Epoch 1167 | loss: 0.0311922 | val_loss: 0.0311963 | Time: 4757.67 ms
[2022-03-04 16:54:31 main:574] : INFO : Epoch 1168 | loss: 0.0311886 | val_loss: 0.0311928 | Time: 4702.05 ms
[2022-03-04 16:54:36 main:574] : INFO : Epoch 1169 | loss: 0.0311863 | val_loss: 0.0311934 | Time: 4692.77 ms
[2022-03-04 16:54:40 main:574] : INFO : Epoch 1170 | loss: 0.0311864 | val_loss: 0.0311961 | Time: 4744.83 ms
[2022-03-04 16:54:45 main:574] : INFO : Epoch 1171 | loss: 0.0311879 | val_loss: 0.0311949 | Time: 4679.13 ms
[2022-03-04 16:54:50 main:574] : INFO : Epoch 1172 | loss: 0.0311866 | val_loss: 0.0311917 | Time: 4706.64 ms
[2022-03-04 16:54:54 main:574] : INFO : Epoch 1173 | loss: 0.0311845 | val_loss: 0.0311911 | Time: 4703.06 ms
[2022-03-04 16:54:59 main:574] : INFO : Epoch 1174 | loss: 0.0311849 | val_loss: 0.0311975 | Time: 4720.33 ms
[2022-03-04 16:55:04 main:574] : INFO : Epoch 1175 | loss: 0.0311877 | val_loss: 0.0311919 | Time: 4725.07 ms
[2022-03-04 16:55:09 main:574] : INFO : Epoch 1176 | loss: 0.0311851 | val_loss: 0.0311892 | Time: 4762.66 ms
[2022-03-04 16:55:13 main:574] : INFO : Epoch 1177 | loss: 0.0311859 | val_loss: 0.0311891 | Time: 4709.61 ms
[2022-03-04 16:55:18 main:574] : INFO : Epoch 1178 | loss: 0.0311835 | val_loss: 0.0311893 | Time: 4818.64 ms
[2022-03-04 16:55:23 main:574] : INFO : Epoch 1179 | loss: 0.0311832 | val_loss: 0.03119 | Time: 4758.17 ms
[2022-03-04 16:55:28 main:574] : INFO : Epoch 1180 | loss: 0.0311852 | val_loss: 0.0311869 | Time: 4731.63 ms
[2022-03-04 16:55:32 main:574] : INFO : Epoch 1181 | loss: 0.0311832 | val_loss: 0.0311859 | Time: 4719.7 ms
[2022-03-04 16:55:37 main:574] : INFO : Epoch 1182 | loss: 0.0311823 | val_loss: 0.0311865 | Time: 4723.27 ms
[2022-03-04 16:55:42 main:574] : INFO : Epoch 1183 | loss: 0.0311848 | val_loss: 0.0311887 | Time: 4727.79 ms
[2022-03-04 16:55:47 main:574] : INFO : Epoch 1184 | loss: 0.0311826 | val_loss: 0.0311847 | Time: 4752.26 ms
[2022-03-04 16:55:51 main:574] : INFO : Epoch 1185 | loss: 0.0311794 | val_loss: 0.0311848 | Time: 4689.14 ms
[2022-03-04 16:55:56 main:574] : INFO : Epoch 1186 | loss: 0.0311794 | val_loss: 0.031184 | Time: 4705.83 ms
[2022-03-04 16:56:01 main:574] : INFO : Epoch 1187 | loss: 0.0311846 | val_loss: 0.0311863 | Time: 4746.27 ms
[2022-03-04 16:56:05 main:574] : INFO : Epoch 1188 | loss: 0.0311845 | val_loss: 0.0311869 | Time: 4692.64 ms
[2022-03-04 16:56:10 main:574] : INFO : Epoch 1189 | loss: 0.0311831 | val_loss: 0.0311929 | Time: 4718.43 ms
[2022-03-04 16:56:15 main:574] : INFO : Epoch 1190 | loss: 0.031183 | val_loss: 0.0311869 | Time: 4707.64 ms
[2022-03-04 16:56:20 main:574] : INFO : Epoch 1191 | loss: 0.0311827 | val_loss: 0.0311867 | Time: 4690.9 ms
[2022-03-04 16:56:24 main:574] : INFO : Epoch 1192 | loss: 0.0311836 | val_loss: 0.0311894 | Time: 4725.05 ms
[2022-03-04 16:56:29 main:574] : INFO : Epoch 1193 | loss: 0.0311827 | val_loss: 0.0311876 | Time: 4702.8 ms
[2022-03-04 16:56:34 main:574] : INFO : Epoch 1194 | loss: 0.0311845 | val_loss: 0.0311893 | Time: 4729.15 ms
[2022-03-04 16:56:38 main:574] : INFO : Epoch 1195 | loss: 0.0311837 | val_loss: 0.0311871 | Time: 4730.59 ms
[2022-03-04 16:56:43 main:574] : INFO : Epoch 1196 | loss: 0.0311817 | val_loss: 0.0311877 | Time: 4673.52 ms
[2022-03-04 16:56:48 main:574] : INFO : Epoch 1197 | loss: 0.0311793 | val_loss: 0.0311857 | Time: 4722.25 ms
[2022-03-04 16:56:53 main:574] : INFO : Epoch 1198 | loss: 0.0311795 | val_loss: 0.0311861 | Time: 4769.65 ms
[2022-03-04 16:56:57 main:574] : INFO : Epoch 1199 | loss: 0.0311815 | val_loss: 0.0311913 | Time: 4741.74 ms
[2022-03-04 16:57:02 main:574] : INFO : Epoch 1200 | loss: 0.0311843 | val_loss: 0.0311858 | Time: 4737.47 ms
[2022-03-04 16:57:07 main:574] : INFO : Epoch 1201 | loss: 0.0311834 | val_loss: 0.0311856 | Time: 4731.28 ms
[2022-03-04 16:57:12 main:574] : INFO : Epoch 1202 | loss: 0.0311832 | val_loss: 0.0311892 | Time: 4698.87 ms
[2022-03-04 16:57:16 main:574] : INFO : Epoch 1203 | loss: 0.0311841 | val_loss: 0.0311844 | Time: 4707.82 ms
[2022-03-04 16:57:21 main:574] : INFO : Epoch 1204 | loss: 0.0311812 | val_loss: 0.0311842 | Time: 4718.73 ms
[2022-03-04 16:57:26 main:574] : INFO : Epoch 1205 | loss: 0.031179 | val_loss: 0.0311843 | Time: 4745.4 ms
[2022-03-04 16:57:30 main:574] : INFO : Epoch 1206 | loss: 0.0311783 | val_loss: 0.0311865 | Time: 4723.56 ms
[2022-03-04 16:57:35 main:574] : INFO : Epoch 1207 | loss: 0.0311778 | val_loss: 0.0311853 | Time: 4766 ms
[2022-03-04 16:57:40 main:574] : INFO : Epoch 1208 | loss: 0.0311795 | val_loss: 0.0311873 | Time: 4733.69 ms
[2022-03-04 16:57:45 main:574] : INFO : Epoch 1209 | loss: 0.0311807 | val_loss: 0.0311859 | Time: 4715.24 ms
[2022-03-04 16:57:49 main:574] : INFO : Epoch 1210 | loss: 0.0311823 | val_loss: 0.0311887 | Time: 4765.25 ms
[2022-03-04 16:57:54 main:574] : INFO : Epoch 1211 | loss: 0.0311829 | val_loss: 0.0311893 | Time: 4775.33 ms
[2022-03-04 16:57:59 main:574] : INFO : Epoch 1212 | loss: 0.0311786 | val_loss: 0.0311885 | Time: 4691.27 ms
[2022-03-04 16:58:04 main:574] : INFO : Epoch 1213 | loss: 0.0311803 | val_loss: 0.0311855 | Time: 4719.48 ms
[2022-03-04 16:58:08 main:574] : INFO : Epoch 1214 | loss: 0.0311828 | val_loss: 0.0311889 | Time: 4673.13 ms
[2022-03-04 16:58:13 main:574] : INFO : Epoch 1215 | loss: 0.0311803 | val_loss: 0.0311881 | Time: 4749.54 ms
[2022-03-04 16:58:18 main:574] : INFO : Epoch 1216 | loss: 0.0311807 | val_loss: 0.0311873 | Time: 4730.76 ms
[2022-03-04 16:58:23 main:574] : INFO : Epoch 1217 | loss: 0.0311798 | val_loss: 0.0311845 | Time: 4750.52 ms
[2022-03-04 16:58:27 main:574] : INFO : Epoch 1218 | loss: 0.0311799 | val_loss: 0.0311858 | Time: 4715.78 ms
[2022-03-04 16:58:32 main:574] : INFO : Epoch 1219 | loss: 0.0311766 | val_loss: 0.0311843 | Time: 4768.78 ms
[2022-03-04 16:58:37 main:574] : INFO : Epoch 1220 | loss: 0.031177 | val_loss: 0.0311824 | Time: 4723.73 ms
[2022-03-04 16:58:42 main:574] : INFO : Epoch 1221 | loss: 0.031174 | val_loss: 0.0311838 | Time: 4750.32 ms
[2022-03-04 16:58:46 main:574] : INFO : Epoch 1222 | loss: 0.031177 | val_loss: 0.0311837 | Time: 4737.89 ms
[2022-03-04 16:58:51 main:574] : INFO : Epoch 1223 | loss: 0.0311742 | val_loss: 0.0311815 | Time: 4733.97 ms
[2022-03-04 16:58:56 main:574] : INFO : Epoch 1224 | loss: 0.0311741 | val_loss: 0.0311811 | Time: 4683.36 ms
[2022-03-04 16:59:00 main:574] : INFO : Epoch 1225 | loss: 0.0311732 | val_loss: 0.0311815 | Time: 4757.93 ms
[2022-03-04 16:59:05 main:574] : INFO : Epoch 1226 | loss: 0.0311737 | val_loss: 0.0311859 | Time: 4721.96 ms
[2022-03-04 16:59:10 main:574] : INFO : Epoch 1227 | loss: 0.0311749 | val_loss: 0.0311841 | Time: 4714.78 ms
[2022-03-04 16:59:15 main:574] : INFO : Epoch 1228 | loss: 0.0311734 | val_loss: 0.031187 | Time: 4720.54 ms
[2022-03-04 16:59:19 main:574] : INFO : Epoch 1229 | loss: 0.031173 | val_loss: 0.0311824 | Time: 4740.34 ms
[2022-03-04 16:59:24 main:574] : INFO : Epoch 1230 | loss: 0.031173 | val_loss: 0.0311798 | Time: 4773.96 ms
[2022-03-04 16:59:29 main:574] : INFO : Epoch 1231 | loss: 0.0311725 | val_loss: 0.0311819 | Time: 4745.38 ms
[2022-03-04 16:59:34 main:574] : INFO : Epoch 1232 | loss: 0.0311736 | val_loss: 0.0311849 | Time: 4831.32 ms
[2022-03-04 16:59:38 main:574] : INFO : Epoch 1233 | loss: 0.0311724 | val_loss: 0.0311819 | Time: 4724.92 ms
[2022-03-04 16:59:43 main:574] : INFO : Epoch 1234 | loss: 0.0311753 | val_loss: 0.0311849 | Time: 4708.53 ms
[2022-03-04 16:59:48 main:574] : INFO : Epoch 1235 | loss: 0.0311736 | val_loss: 0.0311897 | Time: 4694.92 ms
[2022-03-04 16:59:53 main:574] : INFO : Epoch 1236 | loss: 0.0311732 | val_loss: 0.0311906 | Time: 4725.23 ms
[2022-03-04 16:59:57 main:574] : INFO : Epoch 1237 | loss: 0.0311752 | val_loss: 0.0311839 | Time: 4762.09 ms
[2022-03-04 17:00:02 main:574] : INFO : Epoch 1238 | loss: 0.0311718 | val_loss: 0.0311832 | Time: 4742.85 ms
[2022-03-04 17:00:07 main:574] : INFO : Epoch 1239 | loss: 0.03117 | val_loss: 0.0311805 | Time: 4723.35 ms
[2022-03-04 17:00:12 main:574] : INFO : Epoch 1240 | loss: 0.031171 | val_loss: 0.0311802 | Time: 4710.67 ms
[2022-03-04 17:00:16 main:574] : INFO : Epoch 1241 | loss: 0.0311762 | val_loss: 0.0311866 | Time: 4767.51 ms
[2022-03-04 17:00:21 main:574] : INFO : Epoch 1242 | loss: 0.0311759 | val_loss: 0.0311826 | Time: 4733.3 ms
[2022-03-04 17:00:26 main:574] : INFO : Epoch 1243 | loss: 0.0311729 | val_loss: 0.0311826 | Time: 4729.92 ms
[2022-03-04 17:00:31 main:574] : INFO : Epoch 1244 | loss: 0.031171 | val_loss: 0.0311827 | Time: 4744.02 ms
[2022-03-04 17:00:35 main:574] : INFO : Epoch 1245 | loss: 0.0311696 | val_loss: 0.0311831 | Time: 4734.62 ms
[2022-03-04 17:00:40 main:574] : INFO : Epoch 1246 | loss: 0.0311701 | val_loss: 0.0311837 | Time: 4754.59 ms
[2022-03-04 17:00:45 main:574] : INFO : Epoch 1247 | loss: 0.0311696 | val_loss: 0.0311835 | Time: 4733.97 ms
[2022-03-04 17:00:49 main:574] : INFO : Epoch 1248 | loss: 0.0311692 | val_loss: 0.0311809 | Time: 4720.68 ms
[2022-03-04 17:00:54 main:574] : INFO : Epoch 1249 | loss: 0.0311696 | val_loss: 0.0311814 | Time: 4736.73 ms
[2022-03-04 17:00:59 main:574] : INFO : Epoch 1250 | loss: 0.0311685 | val_loss: 0.0311793 | Time: 4716.73 ms
[2022-03-04 17:01:04 main:574] : INFO : Epoch 1251 | loss: 0.0311677 | val_loss: 0.0311823 | Time: 4734.61 ms
[2022-03-04 17:01:08 main:574] : INFO : Epoch 1252 | loss: 0.0311682 | val_loss: 0.0311814 | Time: 4726.06 ms
[2022-03-04 17:01:13 main:574] : INFO : Epoch 1253 | loss: 0.0311689 | val_loss: 0.0311848 | Time: 4750.46 ms
[2022-03-04 17:01:18 main:574] : INFO : Epoch 1254 | loss: 0.0311705 | val_loss: 0.0311878 | Time: 4718.6 ms
[2022-03-04 17:01:23 main:574] : INFO : Epoch 1255 | loss: 0.0311709 | val_loss: 0.0311879 | Time: 4740.76 ms
[2022-03-04 17:01:27 main:574] : INFO : Epoch 1256 | loss: 0.031169 | val_loss: 0.0311819 | Time: 4730.52 ms
[2022-03-04 17:01:32 main:574] : INFO : Epoch 1257 | loss: 0.0311723 | val_loss: 0.0311919 | Time: 4719.76 ms
[2022-03-04 17:01:37 main:574] : INFO : Epoch 1258 | loss: 0.0311716 | val_loss: 0.0311893 | Time: 4728.21 ms
[2022-03-04 17:01:42 main:574] : INFO : Epoch 1259 | loss: 0.0311727 | val_loss: 0.0311781 | Time: 4738.74 ms
[2022-03-04 17:01:46 main:574] : INFO : Epoch 1260 | loss: 0.0311677 | val_loss: 0.0311804 | Time: 4692.45 ms
[2022-03-04 17:01:51 main:574] : INFO : Epoch 1261 | loss: 0.0311669 | val_loss: 0.0311799 | Time: 4720.3 ms
[2022-03-04 17:01:56 main:574] : INFO : Epoch 1262 | loss: 0.0311677 | val_loss: 0.0311844 | Time: 4762.58 ms
[2022-03-04 17:02:00 main:574] : INFO : Epoch 1263 | loss: 0.0311715 | val_loss: 0.031177 | Time: 4727.05 ms
[2022-03-04 17:02:05 main:574] : INFO : Epoch 1264 | loss: 0.0311669 | val_loss: 0.031179 | Time: 4754.94 ms
[2022-03-04 17:02:10 main:574] : INFO : Epoch 1265 | loss: 0.0311651 | val_loss: 0.0311819 | Time: 4725.12 ms
[2022-03-04 17:02:15 main:574] : INFO : Epoch 1266 | loss: 0.0311671 | val_loss: 0.0311872 | Time: 4714.06 ms
[2022-03-04 17:02:19 main:574] : INFO : Epoch 1267 | loss: 0.0311676 | val_loss: 0.0311815 | Time: 4745.08 ms
[2022-03-04 17:02:24 main:574] : INFO : Epoch 1268 | loss: 0.0311662 | val_loss: 0.0311799 | Time: 4742.55 ms
[2022-03-04 17:02:29 main:574] : INFO : Epoch 1269 | loss: 0.0311676 | val_loss: 0.031181 | Time: 4702.79 ms
[2022-03-04 17:02:34 main:574] : INFO : Epoch 1270 | loss: 0.0311652 | val_loss: 0.0311808 | Time: 4753.24 ms
[2022-03-04 17:02:38 main:574] : INFO : Epoch 1271 | loss: 0.0311644 | val_loss: 0.0311798 | Time: 4745.29 ms
[2022-03-04 17:02:43 main:574] : INFO : Epoch 1272 | loss: 0.0311639 | val_loss: 0.0311763 | Time: 4752.5 ms
[2022-03-04 17:02:48 main:574] : INFO : Epoch 1273 | loss: 0.0311626 | val_loss: 0.031181 | Time: 4726.21 ms
[2022-03-04 17:02:53 main:574] : INFO : Epoch 1274 | loss: 0.0311649 | val_loss: 0.0311893 | Time: 4720.25 ms
[2022-03-04 17:02:57 main:574] : INFO : Epoch 1275 | loss: 0.03117 | val_loss: 0.0311821 | Time: 4718.48 ms
[2022-03-04 17:03:02 main:574] : INFO : Epoch 1276 | loss: 0.0311702 | val_loss: 0.0311784 | Time: 4781.17 ms
[2022-03-04 17:03:07 main:574] : INFO : Epoch 1277 | loss: 0.0311733 | val_loss: 0.0311771 | Time: 4719.97 ms
[2022-03-04 17:03:12 main:574] : INFO : Epoch 1278 | loss: 0.0311734 | val_loss: 0.0311741 | Time: 4734.43 ms
[2022-03-04 17:03:16 main:574] : INFO : Epoch 1279 | loss: 0.0311711 | val_loss: 0.0311765 | Time: 4720.05 ms
[2022-03-04 17:03:21 main:574] : INFO : Epoch 1280 | loss: 0.03118 | val_loss: 0.0311848 | Time: 4727.77 ms
[2022-03-04 17:03:26 main:574] : INFO : Epoch 1281 | loss: 0.0311736 | val_loss: 0.0311834 | Time: 4706.92 ms
[2022-03-04 17:03:30 main:574] : INFO : Epoch 1282 | loss: 0.0311732 | val_loss: 0.0311786 | Time: 4690.37 ms
[2022-03-04 17:03:35 main:574] : INFO : Epoch 1283 | loss: 0.031173 | val_loss: 0.0311786 | Time: 4749.87 ms
[2022-03-04 17:03:40 main:574] : INFO : Epoch 1284 | loss: 0.0311731 | val_loss: 0.0311796 | Time: 4729.91 ms
[2022-03-04 17:03:45 main:574] : INFO : Epoch 1285 | loss: 0.0311704 | val_loss: 0.0311777 | Time: 4723.12 ms
[2022-03-04 17:03:49 main:574] : INFO : Epoch 1286 | loss: 0.0311695 | val_loss: 0.0311772 | Time: 4715.41 ms
[2022-03-04 17:03:54 main:574] : INFO : Epoch 1287 | loss: 0.0311686 | val_loss: 0.0311793 | Time: 4743.7 ms
[2022-03-04 17:03:59 main:574] : INFO : Epoch 1288 | loss: 0.0311678 | val_loss: 0.0311764 | Time: 4731.38 ms
[2022-03-04 17:04:04 main:574] : INFO : Epoch 1289 | loss: 0.0311673 | val_loss: 0.0311785 | Time: 4732.83 ms
[2022-03-04 17:04:08 main:574] : INFO : Epoch 1290 | loss: 0.0311701 | val_loss: 0.0311758 | Time: 4753.79 ms
[2022-03-04 17:04:13 main:574] : INFO : Epoch 1291 | loss: 0.0311659 | val_loss: 0.0311781 | Time: 4764.19 ms
[2022-03-04 17:04:18 main:574] : INFO : Epoch 1292 | loss: 0.0311688 | val_loss: 0.0311814 | Time: 4738.45 ms
[2022-03-04 17:04:23 main:574] : INFO : Epoch 1293 | loss: 0.0311682 | val_loss: 0.0311779 | Time: 4721.16 ms
[2022-03-04 17:04:27 main:574] : INFO : Epoch 1294 | loss: 0.0311697 | val_loss: 0.0311782 | Time: 4709.56 ms
[2022-03-04 17:04:32 main:574] : INFO : Epoch 1295 | loss: 0.0311726 | val_loss: 0.0311766 | Time: 4767.83 ms
[2022-03-04 17:04:37 main:574] : INFO : Epoch 1296 | loss: 0.0311698 | val_loss: 0.0311767 | Time: 4730.62 ms
[2022-03-04 17:04:42 main:574] : INFO : Epoch 1297 | loss: 0.0311673 | val_loss: 0.0311797 | Time: 4718.37 ms
[2022-03-04 17:04:46 main:574] : INFO : Epoch 1298 | loss: 0.0311659 | val_loss: 0.0311752 | Time: 4686.41 ms
[2022-03-04 17:04:51 main:574] : INFO : Epoch 1299 | loss: 0.0311638 | val_loss: 0.0311781 | Time: 4757.56 ms
[2022-03-04 17:04:56 main:574] : INFO : Epoch 1300 | loss: 0.0311636 | val_loss: 0.0311782 | Time: 4746.99 ms
[2022-03-04 17:05:00 main:574] : INFO : Epoch 1301 | loss: 0.0311648 | val_loss: 0.0311776 | Time: 4766.43 ms
[2022-03-04 17:05:05 main:574] : INFO : Epoch 1302 | loss: 0.0311651 | val_loss: 0.0311755 | Time: 4736.73 ms
[2022-03-04 17:05:10 main:574] : INFO : Epoch 1303 | loss: 0.0311696 | val_loss: 0.0311781 | Time: 4752.16 ms
[2022-03-04 17:05:15 main:574] : INFO : Epoch 1304 | loss: 0.0311694 | val_loss: 0.0311805 | Time: 4754.3 ms
[2022-03-04 17:05:20 main:574] : INFO : Epoch 1305 | loss: 0.031169 | val_loss: 0.0311858 | Time: 4796.09 ms
[2022-03-04 17:05:24 main:574] : INFO : Epoch 1306 | loss: 0.0311693 | val_loss: 0.03118 | Time: 4714.33 ms
[2022-03-04 17:05:29 main:574] : INFO : Epoch 1307 | loss: 0.0311685 | val_loss: 0.0311765 | Time: 4749.62 ms
[2022-03-04 17:05:34 main:574] : INFO : Epoch 1308 | loss: 0.0311675 | val_loss: 0.0311788 | Time: 4734.45 ms
[2022-03-04 17:05:38 main:574] : INFO : Epoch 1309 | loss: 0.0311681 | val_loss: 0.0311792 | Time: 4733.43 ms
[2022-03-04 17:05:43 main:574] : INFO : Epoch 1310 | loss: 0.0311673 | val_loss: 0.0311731 | Time: 4732.15 ms
[2022-03-04 17:05:48 main:574] : INFO : Epoch 1311 | loss: 0.0311655 | val_loss: 0.031173 | Time: 4780.31 ms
[2022-03-04 17:05:53 main:574] : INFO : Epoch 1312 | loss: 0.031164 | val_loss: 0.0311755 | Time: 4753.97 ms
[2022-03-04 17:05:58 main:574] : INFO : Epoch 1313 | loss: 0.0311748 | val_loss: 0.0311848 | Time: 4736.39 ms
[2022-03-04 17:06:02 main:574] : INFO : Epoch 1314 | loss: 0.0311806 | val_loss: 0.031192 | Time: 4730.69 ms
[2022-03-04 17:06:07 main:574] : INFO : Epoch 1315 | loss: 0.0311778 | val_loss: 0.0311765 | Time: 4806.5 ms
[2022-03-04 17:06:12 main:574] : INFO : Epoch 1316 | loss: 0.0311712 | val_loss: 0.0311783 | Time: 4737.9 ms
[2022-03-04 17:06:17 main:574] : INFO : Epoch 1317 | loss: 0.0311714 | val_loss: 0.0311739 | Time: 4763.18 ms
[2022-03-04 17:06:21 main:574] : INFO : Epoch 1318 | loss: 0.0311699 | val_loss: 0.0311745 | Time: 4697.88 ms
[2022-03-04 17:06:26 main:574] : INFO : Epoch 1319 | loss: 0.0311673 | val_loss: 0.031176 | Time: 4707.17 ms
[2022-03-04 17:06:31 main:574] : INFO : Epoch 1320 | loss: 0.0311683 | val_loss: 0.0311741 | Time: 4752.79 ms
[2022-03-04 17:06:35 main:574] : INFO : Epoch 1321 | loss: 0.0311687 | val_loss: 0.0311772 | Time: 4742.17 ms
[2022-03-04 17:06:40 main:574] : INFO : Epoch 1322 | loss: 0.0311688 | val_loss: 0.031178 | Time: 4759.83 ms
[2022-03-04 17:06:45 main:574] : INFO : Epoch 1323 | loss: 0.0311662 | val_loss: 0.0311758 | Time: 4769.67 ms
[2022-03-04 17:06:50 main:574] : INFO : Epoch 1324 | loss: 0.0311642 | val_loss: 0.0311777 | Time: 4762.59 ms
[2022-03-04 17:06:54 main:574] : INFO : Epoch 1325 | loss: 0.03118 | val_loss: 0.0311974 | Time: 4721.88 ms
[2022-03-04 17:06:59 main:574] : INFO : Epoch 1326 | loss: 0.0312099 | val_loss: 0.0312095 | Time: 4711.33 ms
[2022-03-04 17:07:04 main:574] : INFO : Epoch 1327 | loss: 0.0312082 | val_loss: 0.0312005 | Time: 4754.65 ms
[2022-03-04 17:07:09 main:574] : INFO : Epoch 1328 | loss: 0.0312046 | val_loss: 0.0312008 | Time: 4718.09 ms
[2022-03-04 17:07:13 main:574] : INFO : Epoch 1329 | loss: 0.0312024 | val_loss: 0.0311966 | Time: 4737.65 ms
[2022-03-04 17:07:18 main:574] : INFO : Epoch 1330 | loss: 0.0311973 | val_loss: 0.0311954 | Time: 4744.2 ms
[2022-03-04 17:07:23 main:574] : INFO : Epoch 1331 | loss: 0.0311961 | val_loss: 0.0311943 | Time: 4727.76 ms
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFE1FD190F2
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 03/04/22 17:07:24
Install Directory : C:\Program Files\BOINC\
Data Directory : C:\ProgramData\BOINC
Project Symstore :
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
Loaded Library : symsrv.dll
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\5;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 0000000022120000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000220b0000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1466
ModLoad: 0000000020e80000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1503) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.1503 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1503
ModLoad: 000000001fc50000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1503) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.1503 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1503
ModLoad: 0000000020fb0000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.1526 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1526
ModLoad: 000000001f7c0000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1526) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.1526 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1526
ModLoad: 0000000020c80000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.1202 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1202
ModLoad: 000000001f7f0000 000000000010d000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.1466 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1466
ModLoad: 00000000fbaa0000 0000000000058000 C:\ProgramData\BOINC\slots\5\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000001fbb0000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 000000001ff70000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.789
ModLoad: 0000000020100000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000020de0000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.19041.546
ModLoad: 00000000212d0000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000201b0000 0000000000125000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 00000000f6040000 0000000000092000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.28.29334.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\6\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.28.29334.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.28.29334.0
ModLoad: 000000001d3e0000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.867 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.867
ModLoad: 00000000f60e0000 0000000000019000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.28.29334.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\6\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.28.29334.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.28.29334.0
ModLoad: 00000000f6030000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.28.29334.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\6\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.28.29334.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.28.29334.0
ModLoad: 0000000072020000 000000000abe7000 C:\ProgramData\BOINC\slots\5\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000acc30000 00000000002db000 C:\ProgramData\BOINC\slots\5\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000aca20000 000000000020d000 C:\ProgramData\BOINC\slots\5\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 000000000e1a0000 0000000000040000 C:\ProgramData\BOINC\slots\5\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000007cc10000 0000000024b49000 C:\ProgramData\BOINC\slots\5\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000fbb30000 0000000000045000 C:\ProgramData\BOINC\slots\5\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000006bab0000 00000000034b2000 C:\ProgramData\BOINC\slots\5\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 000000006ef70000 00000000030a5000 C:\ProgramData\BOINC\slots\5\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 000000000e030000 0000000000010000 C:\ProgramData\BOINC\slots\5\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 0000000047560000 000000000919f000 C:\ProgramData\BOINC\slots\5\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 0000000043800000 0000000003d5b000 C:\ProgramData\BOINC\slots\5\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 0000000039ee0000 0000000001eca000 C:\ProgramData\BOINC\slots\5\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 0000000050700000 000000001b3a4000 C:\ProgramData\BOINC\slots\5\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 00000000212a0000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 000000001e090000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000020770000 0000000000472000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1503) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.1526 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1526
ModLoad: 000000001ff20000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1151
ModLoad: 000000001f9b0000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 000000001f560000 0000000000034000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1151) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.1151 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1151
ModLoad: 000000001f9e0000 0000000000069000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1503) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.1503 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1503
ModLoad: 000000001fa50000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.1526 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1526
ModLoad: 000000001f3a0000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000213d0000 0000000000744000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.1526 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1526
ModLoad: 000000001d8b0000 0000000000794000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1503) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.1526 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1526
ModLoad: 0000000020410000 0000000000355000 C:\WINDOWS\System32\combase.dll (6.2.19041.1348) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.1320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1320
ModLoad: 000000001f210000 000000000002e000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1
ModLoad: 0000000021150000 00000000000ad000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1387) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.1526 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1526
ModLoad: 0000000020d70000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.1526 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1526
ModLoad: 00000000ac750000 00000000002cd000 C:\WINDOWS\system32\nvcuda.dll (30.0.15.1165) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_37\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 30.0.15.1165
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.6.99 driver
Product Version : 30.0.15.1165
ModLoad: 0000000042160000 00000000016a0000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_31a2adf8c49e7799\nvcuda64.dll (30.0.15.1165) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_37\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 30.0.15.1165
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.6.99 driver
Product Version : 30.0.15.1165
ModLoad: 0000000019840000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000188e0000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.906 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.906
ModLoad: 0000000017470000 000000000014a000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : drvstore.pdb
File Version : 10.0.19041.1320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1320
ModLoad: 000000001f160000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000015e90000 0000000000768000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.15.1165) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_37\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 30.0.15.1165
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 30.0.15.1165
ModLoad: 00000000abe90000 00000000008b3000 C:\WINDOWS\System32\DriverStore\FileRepository\nv_dispi.inf_amd64_31a2adf8c49e7799\nvptxJitCompiler64.dll (30.0.15.1165) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 30.0.15.1165
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows PTX JIT Compiler
Product Version : 30.0.15.1165
ModLoad: 000000000b280000 0000000000009000 C:\ProgramData\BOINC\slots\5\caffe2_nvrtc.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000033ac0000 0000000000fca000 C:\ProgramData\BOINC\slots\5\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6.14.11.9000
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.89 NVRTC Library
Product Version : 6.14.11.9000
ModLoad: 00000000fad00000 000000000006c000 C:\Program Files\Oculus\Support\oculus-runtime\symsrv.dll (10.0.17763.132) (-exported- Symbols Loaded)
Linked PDB Filename : symsrv.pdb
File Version : 10.0.17763.132 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.17763.132
ModLoad: 0000000020f40000 000000000006b000 C:\WINDOWS\System32\WS2_32.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : ws2_32.pdb
File Version : 10.0.19041.1081 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1081
ModLoad: 0000000020070000 0000000000082000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.1415 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.19041.1415
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 5329, Write: 4835, Other 81540
- I/O Transfers Counters -
Read: 29409512, Write: -1938292450, Other 246574
- Paged Pool Usage -
QuotaPagedPoolUsage: 3531848, QuotaPeakPagedPoolUsage: 3531848
QuotaNonPagedPoolUsage: 61672, QuotaPeakNonPagedPoolUsage: 77856
- Virtual Memory Usage -
VirtualSize: 366780416, PeakVirtualSize: 1695191040
- Pagefile Usage -
PagefileUsage: 366780416, PeakPagefileUsage: 914341888
- Working Set Size -
WorkingSetSize: 2109296640, PeakWorkingSetSize: -1288962048, PageFaultCount: 41451273
*** Dump of thread ID 8400 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 2064205.000000
- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFE1FD190F2
- Registers -
rax=0000000000000000 rbx=0000000000000001 rcx=00000000223d8c40 rdx=00000000c0efe6d0 rsi=0000000000000000 rdi=0000000000000000
r8=00000000c0efe6d0 r9=00000000223d8c30 r10=0000000000000fff r11=0000000000000ff0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000001fd190f2 rsp=00000000c0efe6a8 rbp=0000000000000000
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
c0efe6a0 22159100 00000001 c0efe6d0 c0efe6d0 223d8c30 KERNELBASE!DebugBreak+0x0
c0efeae0 22159ce4 87000000 c0efee44 00000000 00000350 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
c0effa40 2215a084 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
c0effa70 20e97034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
c0effaa0 22102651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
c0effb20 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 12200 (state: Running): ***
- Information -
Status: Base Priority: Above Normal, Priority: Highest, , Kernel Time: 2740156160.000000, User Time: 35214376960.000000, Wait Time: 2064197.000000
- Registers -
rax=0000000000000a00 rbx=0000000000000001 rcx=000000000000000c rdx=0000000000000000 rsi=000000000000035c rdi=0000000000000000
r8=0000000000000001 r9=0000000000000018 r10=0000000000000003 r11=0000000000000a00 r12=0000000000000000 r13=0000000000000080
r14=0000000000000000 r15=0000000000000024 rip=00000000514b85b0 rsp=00000000c0791060 rbp=0000000080936120
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000206
- Callstack -
ChildEBP RetAddr Args to Child
c0791110 514b8f64 0000000c c0791290 00000080 42a39800 cudnn64_7!cudnnSetDropoutDescriptor+0x0
c0791280 514fcd01 c0791ed8 c0791ed8 00000000 c0791850 cudnn64_7!cudnnSetDropoutDescriptor+0x0
c07913a0 51505e12 00000000 00000000 80936120 00000000 cudnn64_7!cudnnSetDropoutDescriptor+0x0
c0791520 51504cd9 00000000 00000000 00000000 0000000f cudnn64_7!cudnnSetDropoutDescriptor+0x0
c0791630 51504504 80936120 00000000 00000000 00000024 cudnn64_7!cudnnSetDropoutDescriptor+0x0
c0791900 5150700e 40c51000 00000000 00000024 00000000 cudnn64_7!cudnnSetDropoutDescriptor+0x0
c07919f0 514082ca 80936120 00000000 00000000 00000024 cudnn64_7!cudnnSetDropoutDescriptor+0x0
c0791ac0 514062b3 40c16800 00000024 c0791d00 000002d3 cudnn64_7!cudnnSetAttnDescriptor+0x0
c0791c10 51409536 40c16800 f8a927e0 00000000 00000000 cudnn64_7!cudnnSetAttnDescriptor+0x0
c0791d20 5141b06f 000002d4 40c51000 00000000 00000000 cudnn64_7!cudnnSetAttnDescriptor+0x0
c07921d0 5140eff1 c07944b8 f8a927e0 00000005 75f7a100 cudnn64_7!cudnnSetRNNProjectionLayers+0x0
c0792370 51417d8e 02705000 00000000 75f7a100 c0792638 cudnn64_7!cudnnSetRNNProjectionLayers+0x0
c0792510 5142dcd3 00000000 00000000 8b0d4dc0 c0792630 cudnn64_7!cudnnSetRNNProjectionLayers+0x0
c07946a0 7f9889fd 026efba0 40c00000 026efba0 f8a927e0 cudnn64_7!cudnnRNNForwardTraining+0x0
c0794b80 7f9e25ea c0794c48 00000001 c0794c48 00000001 torch_cuda!at::native::_cudnn_rnn+0x0
c0794c60 7f9f0cbf c0795350 c0796b58 c0795ca0 220db86b torch_cuda!at::native::set_storage_cuda_+0x0
c0794d40 77a6b9fc c0795350 00000000 468ab570 468ab540 torch_cuda!at::native::set_storage_cuda_+0x0
c0794ec0 77aa31a2 00000001 792167c2 c0794ef4 220db86b torch_cpu!at::native::mkldnn_sigmoid_+0x0
c07951a0 78d52613 00000000 00000000 00000003 0230fa38 torch_cpu!at::_cudnn_rnn+0x0
c07956a0 78d6080b d5449c06 95b7c9d0 c07957d0 00000004 torch_cpu!torch::autograd::NotImplemented::~NotImplemented+0x0
c0795780 77a6b9fc c0795d00 78e85878 c07958e0 42187a77 torch_cpu!torch::autograd::GraphRoot::apply+0x0
c0795900 77aa31a2 75f79e10 00000000 d5449eb6 808aa3f0 torch_cpu!at::native::mkldnn_sigmoid_+0x0
c0795be0 7f9869a1 c0790001 00000001 00000004 00000004 torch_cpu!at::_cudnn_rnn+0x0
c0795db0 7f990117 00000000 c0796b58 fbb32e0d c0795ed0 torch_cuda!at::native::_use_cudnn_ctc_loss+0x0
c0795e40 777f107b 7c941ac0 c0796160 4af42c9d 42357783 torch_cuda!at::native::_cudnn_rnn_flatten_weight+0x0
c07960b0 77823b16 00000001 c0796b58 00000080 085f8f68 torch_cpu!at::native::fbgemm_pack_quantized_matrix+0x0
c0796240 77b9ae89 c07962b8 00000001 c07962b8 00000001 torch_cpu!at::native::gru+0x0
c07962d0 78e89fa3 c07963d0 00000001 c0796550 c0796b58 torch_cpu!at::zeros_out+0x0
c0796360 77b8dd35 fbaf1ea8 b131c120 00000000 fbaf1ea8 torch_cpu!torch::autograd::GraphRoot::apply+0x0
c07963e0 77a688ec 7c9475c8 912e70a0 a9c74640 c0796600 torch_cpu!at::zeros_out+0x0
c07964e0 77adc1bb 0000000c 00000080 00000004 95b7c800 torch_cpu!at::native::mkldnn_sigmoid_+0x0
c0796560 795c7294 c0796680 912e70a0 c0796670 c0796818 torch_cpu!at::gru+0x0
c0796790 795c62ab c0796b30 779f030e c0796b30 c0796b58 torch_cpu!torch::nn::GRUImpl::forward_helper+0x0
c0796880 22132621 00000004 c0797590 00000000 fbaf1ea8 torch_cpu!torch::nn::GRUImpl::forward+0x0
c0796a80 2213705a 00000000 c0790000 c0790601 00000004 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::error+0x0
c0796f80 2213b950 c0797080 c0797080 00000000 db63b8d0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0
c07afd20 2237c6f8 b17ba0d0 00000000 00000000 b12f7d60 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
c07afd60 20e97034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
c07afd90 22102651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
c07afe10 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 16392 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 2064203.000000
- Registers -
rax=000000000000005b rbx=0000000000000006 rcx=0000000000000006 rdx=00000000c0fff8e0 rsi=0000000000000000 rdi=0000000000000006
r8=00000000c0fff588 r9=00000000b19b3ad0 r10=0000000000000000 r11=00000000c0fff850 r12=0000000000000064 r13=00000000c0fff8e0
r14=00000000c0fff5e0 r15=0000000000000000 rip=000000002214d8c4 rsp=00000000c0fff588 rbp=00000000b19b3ad0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
c0fff580 1fc9cb20 00000000 c08b0000 2221a4d0 c08b0000 ntdll!ZwWaitForMultipleObjects+0x0
c0fff870 1fc9ca1e afd24930 004e0049 00000006 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
c0fff8b0 4233d554 b19b6b90 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0
c0fffaf0 423e58cd 00000000 b19b3ad0 00000000 00000000 nvcuda64!+0x0
c0fffba0 4233cf23 18ae9a75 858f6f18 b1f39f60 00000000 nvcuda64!cuProfilerStop+0x0
c0fffbd0 426744c4 b1f39f60 00000000 00000000 00000000 nvcuda64!+0x0
c0fffc00 20e97034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
c0fffc30 22102651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
c0fffcb0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 4628 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 1511406208.000000, User Time: 1800468736.000000, Wait Time: 2064206.000000
- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=0000000082a872b8 rdx=0000000000000000 rsi=0000000000000000 rdi=0000000082a872b8
r8=0000000000000000 r9=0000000000000064 r10=0000000000008000 r11=00000000c0afb3f0 r12=0000000000000000 r13=0000000000000000
r14=00000000c0aff740 r15=0000000082a87268 rip=0000000022150764 rsp=00000000c0aff718 rbp=00000000c0aff770
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
c0aff710 22114021 6a4f09f8 f6052f97 037aa700 037aa6f0 ntdll!NtWaitForAlertByThreadId+0x0
c0aff790 1fcbce89 82a872b0 82a872a8 82a87260 00000000 ntdll!RtlSleepConditionVariableSRW+0x0
c0aff7d0 f607bf3d 037aa720 00000000 00000000 792005b4 KERNELBASE!SleepConditionVariableSRW+0x0
c0aff810 f6052798 00000000 037aa720 00000000 00000000 MSVCP140!__crtSetThreadpoolWait+0x0
c0aff840 f6052a4a 9e435389 00000000 c0affa50 82a872a8 MSVCP140!std::_Winerror_message+0x0
c0aff870 7920064b 82a87260 c0aff970 82a87260 037aa700 MSVCP140!_Cnd_wait+0x0
c0aff8b0 792025b1 6cf62bb0 ffffffff 037aa700 ffffffff torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
c0affba0 79202471 7c726d10 c0affbe0 7c726d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0
c0affbf0 791f9744 00080001 63f4aa80 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0
c0affc20 1ff91bb2 63f4aa80 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0
c0affc50 20e97034 00000000 00000000 00000000 00000000 ucrtbase!_configthreadlocale+0x0
c0affc80 22102651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
c0affd00 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)