Task 13211773

Name ParityModified-1647043398-19166-1-0_0
Workunit 10334240
Created 15 Mar 2022, 4:50:49 UTC
Sent 22 Mar 2022, 5:42:49 UTC
Report deadline 30 Mar 2022, 5:42:49 UTC
Received 23 Mar 2022, 2:36:17 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 6170
Run time 3 hours 4 min 58 sec
CPU time 2 hours 35 min 3 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 1,130.52 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.62 GB
Peak swap size 3.57 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
3 | loss: nan | val_loss: nan | Time: 9652.59 ms
[2022-03-22 01:15:58	                main:574]	:	INFO	:	Epoch 964 | loss: nan | val_loss: nan | Time: 9832.54 ms
[2022-03-22 01:16:08	                main:574]	:	INFO	:	Epoch 965 | loss: nan | val_loss: nan | Time: 10264.3 ms
[2022-03-22 01:16:18	                main:574]	:	INFO	:	Epoch 966 | loss: nan | val_loss: nan | Time: 10076.1 ms
[2022-03-22 01:16:28	                main:574]	:	INFO	:	Epoch 967 | loss: nan | val_loss: nan | Time: 10006 ms
[2022-03-22 01:16:38	                main:574]	:	INFO	:	Epoch 968 | loss: nan | val_loss: nan | Time: 10069.5 ms
[2022-03-22 01:16:44	                main:574]	:	INFO	:	Epoch 969 | loss: nan | val_loss: nan | Time: 6074.83 ms
[2022-03-22 01:16:50	                main:574]	:	INFO	:	Epoch 970 | loss: nan | val_loss: nan | Time: 6142.02 ms
[2022-03-22 01:16:57	                main:574]	:	INFO	:	Epoch 971 | loss: nan | val_loss: nan | Time: 6038.42 ms
[2022-03-22 01:17:03	                main:574]	:	INFO	:	Epoch 972 | loss: nan | val_loss: nan | Time: 6347.09 ms
[2022-03-22 01:17:09	                main:574]	:	INFO	:	Epoch 973 | loss: nan | val_loss: nan | Time: 6116.31 ms
[2022-03-22 01:17:15	                main:574]	:	INFO	:	Epoch 974 | loss: nan | val_loss: nan | Time: 6157.67 ms
[2022-03-22 01:17:22	                main:574]	:	INFO	:	Epoch 975 | loss: nan | val_loss: nan | Time: 6087.83 ms
[2022-03-22 01:17:31	                main:574]	:	INFO	:	Epoch 976 | loss: nan | val_loss: nan | Time: 9761.42 ms
[2022-03-22 01:17:38	                main:574]	:	INFO	:	Epoch 977 | loss: nan | val_loss: nan | Time: 6076.66 ms
[2022-03-22 01:17:44	                main:574]	:	INFO	:	Epoch 978 | loss: nan | val_loss: nan | Time: 6146.74 ms
[2022-03-22 01:17:50	                main:574]	:	INFO	:	Epoch 979 | loss: nan | val_loss: nan | Time: 5991.45 ms
[2022-03-22 01:18:00	                main:574]	:	INFO	:	Epoch 980 | loss: nan | val_loss: nan | Time: 9645.7 ms
[2022-03-22 01:18:06	                main:574]	:	INFO	:	Epoch 981 | loss: nan | val_loss: nan | Time: 6148.58 ms
[2022-03-22 01:18:16	                main:574]	:	INFO	:	Epoch 982 | loss: nan | val_loss: nan | Time: 10287.1 ms
[2022-03-22 01:18:26	                main:574]	:	INFO	:	Epoch 983 | loss: nan | val_loss: nan | Time: 9996.04 ms
[2022-03-22 01:18:36	                main:574]	:	INFO	:	Epoch 984 | loss: nan | val_loss: nan | Time: 10001.8 ms
[2022-03-22 01:18:46	                main:574]	:	INFO	:	Epoch 985 | loss: nan | val_loss: nan | Time: 9833 ms
[2022-03-22 01:18:56	                main:574]	:	INFO	:	Epoch 986 | loss: nan | val_loss: nan | Time: 9871.38 ms
[2022-03-22 01:19:06	                main:574]	:	INFO	:	Epoch 987 | loss: nan | val_loss: nan | Time: 9969.42 ms
[2022-03-22 01:19:16	                main:574]	:	INFO	:	Epoch 988 | loss: nan | val_loss: nan | Time: 10069.2 ms
[2022-03-22 01:19:26	                main:574]	:	INFO	:	Epoch 989 | loss: nan | val_loss: nan | Time: 10010.2 ms
[2022-03-22 01:19:36	                main:574]	:	INFO	:	Epoch 990 | loss: nan | val_loss: nan | Time: 9920.25 ms
[2022-03-22 01:19:46	                main:574]	:	INFO	:	Epoch 991 | loss: nan | val_loss: nan | Time: 9929.56 ms
[2022-03-22 01:19:57	                main:574]	:	INFO	:	Epoch 992 | loss: nan | val_loss: nan | Time: 10115.6 ms
[2022-03-22 01:20:07	                main:574]	:	INFO	:	Epoch 993 | loss: nan | val_loss: nan | Time: 9985.94 ms
[2022-03-22 01:20:16	                main:574]	:	INFO	:	Epoch 994 | loss: nan | val_loss: nan | Time: 9833.95 ms
[2022-03-22 01:20:26	                main:574]	:	INFO	:	Epoch 995 | loss: nan | val_loss: nan | Time: 9862.47 ms
[2022-03-22 01:20:36	                main:574]	:	INFO	:	Epoch 996 | loss: nan | val_loss: nan | Time: 9519.58 ms
[2022-03-22 01:20:46	                main:574]	:	INFO	:	Epoch 997 | loss: nan | val_loss: nan | Time: 10321.5 ms
[2022-03-22 01:20:56	                main:574]	:	INFO	:	Epoch 998 | loss: nan | val_loss: nan | Time: 10082 ms
[2022-03-22 01:21:06	                main:574]	:	INFO	:	Epoch 999 | loss: nan | val_loss: nan | Time: 9792.77 ms
[2022-03-22 01:21:16	                main:574]	:	INFO	:	Epoch 1000 | loss: nan | val_loss: nan | Time: 9892.46 ms
[2022-03-22 01:21:26	                main:574]	:	INFO	:	Epoch 1001 | loss: nan | val_loss: nan | Time: 10054.7 ms
[2022-03-22 01:21:36	                main:574]	:	INFO	:	Epoch 1002 | loss: nan | val_loss: nan | Time: 9924.53 ms
[2022-03-22 01:21:46	                main:574]	:	INFO	:	Epoch 1003 | loss: nan | val_loss: nan | Time: 10087.7 ms
[2022-03-22 01:21:56	                main:574]	:	INFO	:	Epoch 1004 | loss: nan | val_loss: nan | Time: 9640.62 ms
[2022-03-22 01:22:06	                main:574]	:	INFO	:	Epoch 1005 | loss: nan | val_loss: nan | Time: 10166.4 ms
[2022-03-22 01:22:16	                main:574]	:	INFO	:	Epoch 1006 | loss: nan | val_loss: nan | Time: 9989.45 ms
[2022-03-22 01:22:26	                main:574]	:	INFO	:	Epoch 1007 | loss: nan | val_loss: nan | Time: 9986.7 ms
[2022-03-22 01:22:36	                main:574]	:	INFO	:	Epoch 1008 | loss: nan | val_loss: nan | Time: 9979.81 ms
[2022-03-22 01:22:46	                main:574]	:	INFO	:	Epoch 1009 | loss: nan | val_loss: nan | Time: 9931.25 ms
[2022-03-22 01:22:57	                main:574]	:	INFO	:	Epoch 1010 | loss: nan | val_loss: nan | Time: 10058.1 ms
[2022-03-22 01:23:07	                main:574]	:	INFO	:	Epoch 1011 | loss: nan | val_loss: nan | Time: 9870.06 ms
[2022-03-22 01:23:17	                main:574]	:	INFO	:	Epoch 1012 | loss: nan | val_loss: nan | Time: 10105.2 ms
[2022-03-22 01:23:23	                main:574]	:	INFO	:	Epoch 1013 | loss: nan | val_loss: nan | Time: 5986.13 ms
[2022-03-22 01:23:33	                main:574]	:	INFO	:	Epoch 1014 | loss: nan | val_loss: nan | Time: 9954.06 ms
[2022-03-22 01:23:43	                main:574]	:	INFO	:	Epoch 1015 | loss: nan | val_loss: nan | Time: 9889.89 ms
[2022-03-22 01:23:52	                main:574]	:	INFO	:	Epoch 1016 | loss: nan | val_loss: nan | Time: 9376.21 ms
[2022-03-22 01:23:58	                main:574]	:	INFO	:	Epoch 1017 | loss: nan | val_loss: nan | Time: 6129.74 ms
[2022-03-22 01:24:09	                main:574]	:	INFO	:	Epoch 1018 | loss: nan | val_loss: nan | Time: 10193.4 ms
[2022-03-22 01:24:15	                main:574]	:	INFO	:	Epoch 1019 | loss: nan | val_loss: nan | Time: 6085.54 ms
[2022-03-22 01:24:25	                main:574]	:	INFO	:	Epoch 1020 | loss: nan | val_loss: nan | Time: 9951.97 ms
[2022-03-22 01:24:35	                main:574]	:	INFO	:	Epoch 1021 | loss: nan | val_loss: nan | Time: 9934.98 ms
[2022-03-22 01:24:44	                main:574]	:	INFO	:	Epoch 1022 | loss: nan | val_loss: nan | Time: 9366.21 ms
[2022-03-22 01:24:54	                main:574]	:	INFO	:	Epoch 1023 | loss: nan | val_loss: nan | Time: 9619.78 ms
[2022-03-22 01:25:00	                main:574]	:	INFO	:	Epoch 1024 | loss: nan | val_loss: nan | Time: 6235.66 ms
[2022-03-22 01:25:06	                main:574]	:	INFO	:	Epoch 1025 | loss: nan | val_loss: nan | Time: 6169.06 ms
[2022-03-22 01:25:17	                main:574]	:	INFO	:	Epoch 1026 | loss: nan | val_loss: nan | Time: 10301 ms
[2022-03-22 01:25:26	                main:574]	:	INFO	:	Epoch 1027 | loss: nan | val_loss: nan | Time: 9493.1 ms
[2022-03-22 01:25:37	                main:574]	:	INFO	:	Epoch 1028 | loss: nan | val_loss: nan | Time: 10375.7 ms
[2022-03-22 01:25:47	                main:574]	:	INFO	:	Epoch 1029 | loss: nan | val_loss: nan | Time: 10008.9 ms
[2022-03-22 01:25:53	                main:574]	:	INFO	:	Epoch 1030 | loss: nan | val_loss: nan | Time: 6145.55 ms
[2022-03-22 01:26:03	                main:574]	:	INFO	:	Epoch 1031 | loss: nan | val_loss: nan | Time: 9874.4 ms
[2022-03-22 01:26:13	                main:574]	:	INFO	:	Epoch 1032 | loss: nan | val_loss: nan | Time: 9816.78 ms
[2022-03-22 01:26:23	                main:574]	:	INFO	:	Epoch 1033 | loss: nan | val_loss: nan | Time: 9963.37 ms
[2022-03-22 01:26:33	                main:574]	:	INFO	:	Epoch 1034 | loss: nan | val_loss: nan | Time: 10032.8 ms
[2022-03-22 01:26:43	                main:574]	:	INFO	:	Epoch 1035 | loss: nan | val_loss: nan | Time: 9765.34 ms
[2022-03-22 01:26:53	                main:574]	:	INFO	:	Epoch 1036 | loss: nan | val_loss: nan | Time: 10033.2 ms
[2022-03-22 01:27:03	                main:574]	:	INFO	:	Epoch 1037 | loss: nan | val_loss: nan | Time: 10025.5 ms
[2022-03-22 01:27:13	                main:574]	:	INFO	:	Epoch 1038 | loss: nan | val_loss: nan | Time: 9843.37 ms
[2022-03-22 01:27:23	                main:574]	:	INFO	:	Epoch 1039 | loss: nan | val_loss: nan | Time: 9967.64 ms
[2022-03-22 01:27:33	                main:574]	:	INFO	:	Epoch 1040 | loss: nan | val_loss: nan | Time: 9914.63 ms
[2022-03-22 01:27:43	                main:574]	:	INFO	:	Epoch 1041 | loss: nan | val_loss: nan | Time: 10081.5 ms
[2022-03-22 01:27:53	                main:574]	:	INFO	:	Epoch 1042 | loss: nan | val_loss: nan | Time: 9894.2 ms
[2022-03-22 01:28:03	                main:574]	:	INFO	:	Epoch 1043 | loss: nan | val_loss: nan | Time: 10230.1 ms
[2022-03-22 01:28:13	                main:574]	:	INFO	:	Epoch 1044 | loss: nan | val_loss: nan | Time: 9863.24 ms
[2022-03-22 01:28:23	                main:574]	:	INFO	:	Epoch 1045 | loss: nan | val_loss: nan | Time: 9842.48 ms
[2022-03-22 01:28:33	                main:574]	:	INFO	:	Epoch 1046 | loss: nan | val_loss: nan | Time: 10005.9 ms
[2022-03-22 01:28:39	                main:574]	:	INFO	:	Epoch 1047 | loss: nan | val_loss: nan | Time: 6168.7 ms
[2022-03-22 01:28:45	                main:574]	:	INFO	:	Epoch 1048 | loss: nan | val_loss: nan | Time: 6017.37 ms
[2022-03-22 01:28:52	                main:574]	:	INFO	:	Epoch 1049 | loss: nan | val_loss: nan | Time: 6169.84 ms
[2022-03-22 01:28:58	                main:574]	:	INFO	:	Epoch 1050 | loss: nan | val_loss: nan | Time: 6165.38 ms
[2022-03-22 01:29:04	                main:574]	:	INFO	:	Epoch 1051 | loss: nan | val_loss: nan | Time: 6230.66 ms
[2022-03-22 01:29:10	                main:574]	:	INFO	:	Epoch 1052 | loss: nan | val_loss: nan | Time: 6073.83 ms
[2022-03-22 01:29:21	                main:574]	:	INFO	:	Epoch 1053 | loss: nan | val_loss: nan | Time: 10458.1 ms
[2022-03-22 01:29:31	                main:574]	:	INFO	:	Epoch 1054 | loss: nan | val_loss: nan | Time: 10002.6 ms
[2022-03-22 01:29:41	                main:574]	:	INFO	:	Epoch 1055 | loss: nan | val_loss: nan | Time: 9890.04 ms
[2022-03-22 01:29:51	                main:574]	:	INFO	:	Epoch 1056 | loss: nan | val_loss: nan | Time: 9929.66 ms
[2022-03-22 01:30:01	                main:574]	:	INFO	:	Epoch 1057 | loss: nan | val_loss: nan | Time: 10029.3 ms
[2022-03-22 01:30:11	                main:574]	:	INFO	:	Epoch 1058 | loss: nan | val_loss: nan | Time: 9987.07 ms
[2022-03-22 01:30:21	                main:574]	:	INFO	:	Epoch 1059 | loss: nan | val_loss: nan | Time: 9913.98 ms
[2022-03-22 01:30:31	                main:574]	:	INFO	:	Epoch 1060 | loss: nan | val_loss: nan | Time: 9949.92 ms
[2022-03-22 01:30:41	                main:574]	:	INFO	:	Epoch 1061 | loss: nan | val_loss: nan | Time: 9930.1 ms
[2022-03-22 01:30:51	                main:574]	:	INFO	:	Epoch 1062 | loss: nan | val_loss: nan | Time: 9709.27 ms
[2022-03-22 01:31:01	                main:574]	:	INFO	:	Epoch 1063 | loss: nan | val_loss: nan | Time: 10274 ms
[2022-03-22 01:31:11	                main:574]	:	INFO	:	Epoch 1064 | loss: nan | val_loss: nan | Time: 10091.8 ms
[2022-03-22 01:31:21	                main:574]	:	INFO	:	Epoch 1065 | loss: nan | val_loss: nan | Time: 9942.31 ms
[2022-03-22 01:31:31	                main:574]	:	INFO	:	Epoch 1066 | loss: nan | val_loss: nan | Time: 9941.54 ms
[2022-03-22 01:31:41	                main:574]	:	INFO	:	Epoch 1067 | loss: nan | val_loss: nan | Time: 9746.77 ms
[2022-03-22 01:31:51	                main:574]	:	INFO	:	Epoch 1068 | loss: nan | val_loss: nan | Time: 9534.54 ms
[2022-03-22 01:32:01	                main:574]	:	INFO	:	Epoch 1069 | loss: nan | val_loss: nan | Time: 10474.8 ms
[2022-03-22 01:32:11	                main:574]	:	INFO	:	Epoch 1070 | loss: nan | val_loss: nan | Time: 9877.44 ms
[2022-03-22 01:32:17	                main:574]	:	INFO	:	Epoch 1071 | loss: nan | val_loss: nan | Time: 5989.52 ms
[2022-03-22 01:32:27	                main:574]	:	INFO	:	Epoch 1072 | loss: nan | val_loss: nan | Time: 9943.17 ms
[2022-03-22 01:32:37	                main:574]	:	INFO	:	Epoch 1073 | loss: nan | val_loss: nan | Time: 10054.9 ms
[2022-03-22 01:32:44	                main:574]	:	INFO	:	Epoch 1074 | loss: nan | val_loss: nan | Time: 6119.33 ms
[2022-03-22 01:32:53	                main:574]	:	INFO	:	Epoch 1075 | loss: nan | val_loss: nan | Time: 9915.41 ms
[2022-03-22 01:33:04	                main:574]	:	INFO	:	Epoch 1076 | loss: nan | val_loss: nan | Time: 9892.9 ms
[2022-03-22 01:33:13	                main:574]	:	INFO	:	Epoch 1077 | loss: nan | val_loss: nan | Time: 9854.18 ms
[2022-03-22 01:33:23	                main:574]	:	INFO	:	Epoch 1078 | loss: nan | val_loss: nan | Time: 9787.25 ms
[2022-03-22 01:33:33	                main:574]	:	INFO	:	Epoch 1079 | loss: nan | val_loss: nan | Time: 9999.88 ms
[2022-03-22 01:33:43	                main:574]	:	INFO	:	Epoch 1080 | loss: nan | val_loss: nan | Time: 9777.82 ms
[2022-03-22 01:33:53	                main:574]	:	INFO	:	Epoch 1081 | loss: nan | val_loss: nan | Time: 9633.07 ms
[2022-03-22 01:34:03	                main:574]	:	INFO	:	Epoch 1082 | loss: nan | val_loss: nan | Time: 10433.9 ms
[2022-03-22 01:34:14	                main:574]	:	INFO	:	Epoch 1083 | loss: nan | val_loss: nan | Time: 9897.84 ms
[2022-03-22 01:34:24	                main:574]	:	INFO	:	Epoch 1084 | loss: nan | val_loss: nan | Time: 9815.35 ms
[2022-03-22 01:34:34	                main:574]	:	INFO	:	Epoch 1085 | loss: nan | val_loss: nan | Time: 9942.14 ms
[2022-03-22 01:34:43	                main:574]	:	INFO	:	Epoch 1086 | loss: nan | val_loss: nan | Time: 9349.89 ms
[2022-03-22 01:34:49	                main:574]	:	INFO	:	Epoch 1087 | loss: nan | val_loss: nan | Time: 6136.11 ms
[2022-03-22 01:34:59	                main:574]	:	INFO	:	Epoch 1088 | loss: nan | val_loss: nan | Time: 10300.7 ms
[2022-03-22 01:35:09	                main:574]	:	INFO	:	Epoch 1089 | loss: nan | val_loss: nan | Time: 9938.59 ms
[2022-03-22 01:35:20	                main:574]	:	INFO	:	Epoch 1090 | loss: nan | val_loss: nan | Time: 10059.8 ms
[2022-03-22 01:35:30	                main:574]	:	INFO	:	Epoch 1091 | loss: nan | val_loss: nan | Time: 9868.64 ms
[2022-03-22 01:35:40	                main:574]	:	INFO	:	Epoch 1092 | loss: nan | val_loss: nan | Time: 10036.5 ms
[2022-03-22 01:35:49	                main:574]	:	INFO	:	Epoch 1093 | loss: nan | val_loss: nan | Time: 9824.42 ms
[2022-03-22 01:36:00	                main:574]	:	INFO	:	Epoch 1094 | loss: nan | val_loss: nan | Time: 9986.56 ms
[2022-03-22 01:36:10	                main:574]	:	INFO	:	Epoch 1095 | loss: nan | val_loss: nan | Time: 10125.8 ms
[2022-03-22 01:36:20	                main:574]	:	INFO	:	Epoch 1096 | loss: nan | val_loss: nan | Time: 10004.4 ms
[2022-03-22 01:36:30	                main:574]	:	INFO	:	Epoch 1097 | loss: nan | val_loss: nan | Time: 9927.76 ms
[2022-03-22 01:36:40	                main:574]	:	INFO	:	Epoch 1098 | loss: nan | val_loss: nan | Time: 10120.5 ms
[2022-03-22 01:36:50	                main:574]	:	INFO	:	Epoch 1099 | loss: nan | val_loss: nan | Time: 10506.8 ms
[2022-03-22 01:36:57	                main:574]	:	INFO	:	Epoch 1100 | loss: nan | val_loss: nan | Time: 6170.71 ms
[2022-03-22 01:37:03	                main:574]	:	INFO	:	Epoch 1101 | loss: nan | val_loss: nan | Time: 6257.1 ms
[2022-03-22 01:37:09	                main:574]	:	INFO	:	Epoch 1102 | loss: nan | val_loss: nan | Time: 6034.21 ms
[2022-03-22 01:37:20	                main:574]	:	INFO	:	Epoch 1103 | loss: nan | val_loss: nan | Time: 10326.8 ms
[2022-03-22 01:37:29	                main:574]	:	INFO	:	Epoch 1104 | loss: nan | val_loss: nan | Time: 9687.76 ms
[2022-03-22 01:37:39	                main:574]	:	INFO	:	Epoch 1105 | loss: nan | val_loss: nan | Time: 9760.65 ms
[2022-03-22 01:37:49	                main:574]	:	INFO	:	Epoch 1106 | loss: nan | val_loss: nan | Time: 9818.17 ms
[2022-03-22 01:37:55	                main:574]	:	INFO	:	Epoch 1107 | loss: nan | val_loss: nan | Time: 6194.85 ms
[2022-03-22 01:38:01	                main:574]	:	INFO	:	Epoch 1108 | loss: nan | val_loss: nan | Time: 6081.19 ms
[2022-03-22 01:38:11	                main:574]	:	INFO	:	Epoch 1109 | loss: nan | val_loss: nan | Time: 9810.09 ms
[2022-03-22 01:38:18	                main:574]	:	INFO	:	Epoch 1110 | loss: nan | val_loss: nan | Time: 6108.71 ms
[2022-03-22 01:38:28	                main:574]	:	INFO	:	Epoch 1111 | loss: nan | val_loss: nan | Time: 10284 ms
[2022-03-22 01:38:38	                main:574]	:	INFO	:	Epoch 1112 | loss: nan | val_loss: nan | Time: 10033.9 ms
[2022-03-22 01:38:48	                main:574]	:	INFO	:	Epoch 1113 | loss: nan | val_loss: nan | Time: 9955.93 ms
[2022-03-22 01:38:58	                main:574]	:	INFO	:	Epoch 1114 | loss: nan | val_loss: nan | Time: 9960.85 ms
[2022-03-22 01:39:08	                main:574]	:	INFO	:	Epoch 1115 | loss: nan | val_loss: nan | Time: 9996.81 ms
[2022-03-22 01:39:18	                main:574]	:	INFO	:	Epoch 1116 | loss: nan | val_loss: nan | Time: 9864.55 ms
[2022-03-22 01:39:28	                main:574]	:	INFO	:	Epoch 1117 | loss: nan | val_loss: nan | Time: 9975.19 ms
[2022-03-22 01:39:38	                main:574]	:	INFO	:	Epoch 1118 | loss: nan | val_loss: nan | Time: 9972.71 ms
[2022-03-22 01:39:48	                main:574]	:	INFO	:	Epoch 1119 | loss: nan | val_loss: nan | Time: 9990.94 ms
[2022-03-22 01:39:58	                main:574]	:	INFO	:	Epoch 1120 | loss: nan | val_loss: nan | Time: 9876.12 ms
[2022-03-22 01:40:08	                main:574]	:	INFO	:	Epoch 1121 | loss: nan | val_loss: nan | Time: 10205.2 ms
[2022-03-22 01:40:18	                main:574]	:	INFO	:	Epoch 1122 | loss: nan | val_loss: nan | Time: 9823.7 ms
[2022-03-22 01:40:28	                main:574]	:	INFO	:	Epoch 1123 | loss: nan | val_loss: nan | Time: 9974.56 ms
[2022-03-22 01:40:38	                main:574]	:	INFO	:	Epoch 1124 | loss: nan | val_loss: nan | Time: 10157.5 ms
[2022-03-22 01:40:48	                main:574]	:	INFO	:	Epoch 1125 | loss: nan | val_loss: nan | Time: 9923.04 ms
[2022-03-22 01:40:58	                main:574]	:	INFO	:	Epoch 1126 | loss: nan | val_loss: nan | Time: 9966.8 ms
[2022-03-22 01:41:05	                main:574]	:	INFO	:	Epoch 1127 | loss: nan | val_loss: nan | Time: 6183.93 ms
[2022-03-22 01:41:11	                main:574]	:	INFO	:	Epoch 1128 | loss: nan | val_loss: nan | Time: 6163.82 ms
[2022-03-22 01:41:17	                main:574]	:	INFO	:	Epoch 1129 | loss: nan | val_loss: nan | Time: 6275.33 ms
[2022-03-22 01:41:24	                main:574]	:	INFO	:	Epoch 1130 | loss: nan | val_loss: nan | Time: 6322.19 ms
[2022-03-22 01:41:30	                main:574]	:	INFO	:	Epoch 1131 | loss: nan | val_loss: nan | Time: 6163.3 ms
[2022-03-22 01:41:40	                main:574]	:	INFO	:	Epoch 1132 | loss: nan | val_loss: nan | Time: 10173 ms
[2022-03-22 01:41:50	                main:574]	:	INFO	:	Epoch 1133 | loss: nan | val_loss: nan | Time: 9995.77 ms
[2022-03-22 01:42:00	                main:574]	:	INFO	:	Epoch 1134 | loss: nan | val_loss: nan | Time: 10056.9 ms
[2022-03-22 01:42:06	                main:574]	:	INFO	:	Epoch 1135 | loss: nan | val_loss: nan | Time: 6076.64 ms
[2022-03-22 01:42:16	                main:574]	:	INFO	:	Epoch 1136 | loss: nan | val_loss: nan | Time: 10021.6 ms
[2022-03-22 01:42:22	                main:574]	:	INFO	:	Epoch 1137 | loss: nan | val_loss: nan | Time: 6026.58 ms
[2022-03-22 01:42:32	                main:574]	:	INFO	:	Epoch 1138 | loss: nan | val_loss: nan | Time: 9745.9 ms
[2022-03-22 01:42:42	                main:574]	:	INFO	:	Epoch 1139 | loss: nan | val_loss: nan | Time: 9958.43 ms
[2022-03-22 01:42:52	                main:574]	:	INFO	:	Epoch 1140 | loss: nan | val_loss: nan | Time: 10011.4 ms
[2022-03-22 01:43:03	                main:574]	:	INFO	:	Epoch 1141 | loss: nan | val_loss: nan | Time: 10138.8 ms
[2022-03-22 01:43:12	                main:574]	:	INFO	:	Epoch 1142 | loss: nan | val_loss: nan | Time: 9822.76 ms
[2022-03-22 01:43:22	                main:574]	:	INFO	:	Epoch 1143 | loss: nan | val_loss: nan | Time: 9819.69 ms
[2022-03-22 01:43:32	                main:574]	:	INFO	:	Epoch 1144 | loss: nan | val_loss: nan | Time: 9935.24 ms
[2022-03-22 01:43:42	                main:574]	:	INFO	:	Epoch 1145 | loss: nan | val_loss: nan | Time: 9950.81 ms
[2022-03-22 01:43:52	                main:574]	:	INFO	:	Epoch 1146 | loss: nan | val_loss: nan | Time: 10009.4 ms
[2022-03-22 01:43:58	                main:574]	:	INFO	:	Epoch 1147 | loss: nan | val_loss: nan | Time: 6057 ms
[2022-03-22 01:44:08	                main:574]	:	INFO	:	Epoch 1148 | loss: nan | val_loss: nan | Time: 9946.04 ms
[2022-03-22 01:44:18	                main:574]	:	INFO	:	Epoch 1149 | loss: nan | val_loss: nan | Time: 9852.82 ms
[2022-03-22 01:44:28	                main:574]	:	INFO	:	Epoch 1150 | loss: nan | val_loss: nan | Time: 9803.27 ms
[2022-03-22 01:44:38	                main:574]	:	INFO	:	Epoch 1151 | loss: nan | val_loss: nan | Time: 9960.85 ms
[2022-03-22 01:44:48	                main:574]	:	INFO	:	Epoch 1152 | loss: nan | val_loss: nan | Time: 9929.74 ms
[2022-03-22 01:44:58	                main:574]	:	INFO	:	Epoch 1153 | loss: nan | val_loss: nan | Time: 10127 ms
[2022-03-22 01:45:08	                main:574]	:	INFO	:	Epoch 1154 | loss: nan | val_loss: nan | Time: 9965.38 ms
[2022-03-22 01:45:15	                main:574]	:	INFO	:	Epoch 1155 | loss: nan | val_loss: nan | Time: 6112.43 ms
[2022-03-22 01:45:25	                main:574]	:	INFO	:	Epoch 1156 | loss: nan | val_loss: nan | Time: 9902.53 ms
[2022-03-22 01:45:35	                main:574]	:	INFO	:	Epoch 1157 | loss: nan | val_loss: nan | Time: 9821.89 ms
[2022-03-22 01:45:44	                main:574]	:	INFO	:	Epoch 1158 | loss: nan | val_loss: nan | Time: 9836.18 ms
[2022-03-22 01:45:54	                main:574]	:	INFO	:	Epoch 1159 | loss: nan | val_loss: nan | Time: 9932.49 ms
[2022-03-22 01:46:05	                main:574]	:	INFO	:	Epoch 1160 | loss: nan | val_loss: nan | Time: 10002.4 ms
[2022-03-22 01:46:15	                main:574]	:	INFO	:	Epoch 1161 | loss: nan | val_loss: nan | Time: 10090.2 ms
[2022-03-22 01:46:21	                main:574]	:	INFO	:	Epoch 1162 | loss: nan | val_loss: nan | Time: 6122.65 ms
[2022-03-22 01:46:31	                main:574]	:	INFO	:	Epoch 1163 | loss: nan | val_loss: nan | Time: 9725.06 ms
[2022-03-22 01:46:37	                main:574]	:	INFO	:	Epoch 1164 | loss: nan | val_loss: nan | Time: 6421.62 ms
[2022-03-22 01:46:44	                main:574]	:	INFO	:	Epoch 1165 | loss: nan | val_loss: nan | Time: 6406.54 ms
[2022-03-22 01:46:50	                main:574]	:	INFO	:	Epoch 1166 | loss: nan | val_loss: nan | Time: 6160.9 ms
[2022-03-22 01:46:56	                main:574]	:	INFO	:	Epoch 1167 | loss: nan | val_loss: nan | Time: 6227.28 ms
[2022-03-22 01:47:02	                main:574]	:	INFO	:	Epoch 1168 | loss: nan | val_loss: nan | Time: 6155.95 ms
[2022-03-22 01:47:13	                main:574]	:	INFO	:	Epoch 1169 | loss: nan | val_loss: nan | Time: 10188.7 ms
[2022-03-22 01:47:23	                main:574]	:	INFO	:	Epoch 1170 | loss: nan | val_loss: nan | Time: 10160 ms
[2022-03-22 01:47:32	                main:574]	:	INFO	:	Epoch 1171 | loss: nan | val_loss: nan | Time: 9699.3 ms
[2022-03-22 01:47:43	                main:574]	:	INFO	:	Epoch 1172 | loss: nan | val_loss: nan | Time: 10073.1 ms
[2022-03-22 01:47:53	                main:574]	:	INFO	:	Epoch 1173 | loss: nan | val_loss: nan | Time: 9962.49 ms
[2022-03-22 01:48:03	                main:574]	:	INFO	:	Epoch 1174 | loss: nan | val_loss: nan | Time: 10030.4 ms
[2022-03-22 01:48:13	                main:574]	:	INFO	:	Epoch 1175 | loss: nan | val_loss: nan | Time: 10024.6 ms
[2022-03-22 01:48:23	                main:574]	:	INFO	:	Epoch 1176 | loss: nan | val_loss: nan | Time: 10036.2 ms
[2022-03-22 01:48:33	                main:574]	:	INFO	:	Epoch 1177 | loss: nan | val_loss: nan | Time: 9814.55 ms
[2022-03-22 01:48:43	                main:574]	:	INFO	:	Epoch 1178 | loss: nan | val_loss: nan | Time: 10002.5 ms
[2022-03-22 01:48:53	                main:574]	:	INFO	:	Epoch 1179 | loss: nan | val_loss: nan | Time: 9958.76 ms
[2022-03-22 01:49:03	                main:574]	:	INFO	:	Epoch 1180 | loss: nan | val_loss: nan | Time: 9791.64 ms
[2022-03-22 01:49:13	                main:574]	:	INFO	:	Epoch 1181 | loss: nan | val_loss: nan | Time: 10090.2 ms
[2022-03-22 01:49:23	                main:574]	:	INFO	:	Epoch 1182 | loss: nan | val_loss: nan | Time: 9969.95 ms
[2022-03-22 01:49:33	                main:574]	:	INFO	:	Epoch 1183 | loss: nan | val_loss: nan | Time: 9840.58 ms
[2022-03-22 01:49:43	                main:574]	:	INFO	:	Epoch 1184 | loss: nan | val_loss: nan | Time: 9981.98 ms
[2022-03-22 01:49:53	                main:574]	:	INFO	:	Epoch 1185 | loss: nan | val_loss: nan | Time: 9958.24 ms
[2022-03-22 01:50:03	                main:574]	:	INFO	:	Epoch 1186 | loss: nan | val_loss: nan | Time: 9973.43 ms
[2022-03-22 01:50:13	                main:574]	:	INFO	:	Epoch 1187 | loss: nan | val_loss: nan | Time: 9858.87 ms
[2022-03-22 01:50:23	                main:574]	:	INFO	:	Epoch 1188 | loss: nan | val_loss: nan | Time: 10030.8 ms
[2022-03-22 01:50:33	                main:574]	:	INFO	:	Epoch 1189 | loss: nan | val_loss: nan | Time: 9820.97 ms
[2022-03-22 01:50:43	                main:574]	:	INFO	:	Epoch 1190 | loss: nan | val_loss: nan | Time: 10091.4 ms
[2022-03-22 01:50:53	                main:574]	:	INFO	:	Epoch 1191 | loss: nan | val_loss: nan | Time: 10091.9 ms
[2022-03-22 01:51:03	                main:574]	:	INFO	:	Epoch 1192 | loss: nan | val_loss: nan | Time: 9870.9 ms
[2022-03-22 01:51:13	                main:574]	:	INFO	:	Epoch 1193 | loss: nan | val_loss: nan | Time: 9930.18 ms
[2022-03-22 01:51:23	                main:574]	:	INFO	:	Epoch 1194 | loss: nan | val_loss: nan | Time: 10062.7 ms
[2022-03-22 01:51:33	                main:574]	:	INFO	:	Epoch 1195 | loss: nan | val_loss: nan | Time: 9418.98 ms
[2022-03-22 01:51:43	                main:574]	:	INFO	:	Epoch 1196 | loss: nan | val_loss: nan | Time: 10242 ms
[2022-03-22 01:51:53	                main:574]	:	INFO	:	Epoch 1197 | loss: nan | val_loss: nan | Time: 9910.69 ms
[2022-03-22 01:52:03	                main:574]	:	INFO	:	Epoch 1198 | loss: nan | val_loss: nan | Time: 10080.2 ms
[2022-03-22 01:52:13	                main:574]	:	INFO	:	Epoch 1199 | loss: nan | val_loss: nan | Time: 10048.3 ms
[2022-03-22 01:52:23	                main:574]	:	INFO	:	Epoch 1200 | loss: nan | val_loss: nan | Time: 9873.59 ms
[2022-03-22 01:52:33	                main:574]	:	INFO	:	Epoch 1201 | loss: nan | val_loss: nan | Time: 10065.3 ms
[2022-03-22 01:52:43	                main:574]	:	INFO	:	Epoch 1202 | loss: nan | val_loss: nan | Time: 10004.4 ms
[2022-03-22 01:52:53	                main:574]	:	INFO	:	Epoch 1203 | loss: nan | val_loss: nan | Time: 9505.14 ms
[2022-03-22 01:53:03	                main:574]	:	INFO	:	Epoch 1204 | loss: nan | val_loss: nan | Time: 10196.8 ms
[2022-03-22 01:53:13	                main:574]	:	INFO	:	Epoch 1205 | loss: nan | val_loss: nan | Time: 9877.11 ms
[2022-03-22 01:53:23	                main:574]	:	INFO	:	Epoch 1206 | loss: nan | val_loss: nan | Time: 9701.14 ms
[2022-03-22 01:53:33	                main:574]	:	INFO	:	Epoch 1207 | loss: nan | val_loss: nan | Time: 9814.85 ms
[2022-03-22 01:53:39	                main:574]	:	INFO	:	Epoch 1208 | loss: nan | val_loss: nan | Time: 6169.34 ms
[2022-03-22 01:53:49	                main:574]	:	INFO	:	Epoch 1209 | loss: nan | val_loss: nan | Time: 10214.4 ms
[2022-03-22 01:53:59	                main:574]	:	INFO	:	Epoch 1210 | loss: nan | val_loss: nan | Time: 10142.1 ms
[2022-03-22 01:54:09	                main:574]	:	INFO	:	Epoch 1211 | loss: nan | val_loss: nan | Time: 9503.16 ms
[2022-03-22 01:54:19	                main:574]	:	INFO	:	Epoch 1212 | loss: nan | val_loss: nan | Time: 10199.4 ms
[2022-03-22 01:54:29	                main:574]	:	INFO	:	Epoch 1213 | loss: nan | val_loss: nan | Time: 10042.8 ms
[2022-03-22 01:54:39	                main:574]	:	INFO	:	Epoch 1214 | loss: nan | val_loss: nan | Time: 10143.2 ms
[2022-03-22 01:54:49	                main:574]	:	INFO	:	Epoch 1215 | loss: nan | val_loss: nan | Time: 10093.3 ms
[2022-03-22 01:54:59	                main:574]	:	INFO	:	Epoch 1216 | loss: nan | val_loss: nan | Time: 9880.1 ms
[2022-03-22 01:55:09	                main:574]	:	INFO	:	Epoch 1217 | loss: nan | val_loss: nan | Time: 9807.66 ms
[2022-03-22 01:55:19	                main:574]	:	INFO	:	Epoch 1218 | loss: nan | val_loss: nan | Time: 9903.67 ms
[2022-03-22 01:55:29	                main:574]	:	INFO	:	Epoch 1219 | loss: nan | val_loss: nan | Time: 10026.2 ms
[2022-03-22 01:55:39	                main:574]	:	INFO	:	Epoch 1220 | loss: nan | val_loss: nan | Time: 10073.5 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GT 1030)
[2022-03-22 01:58:30	                main:435]	:	INFO	:	Set logging level to 1
[2022-03-22 01:58:30	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-03-22 01:58:30	                main:444]	:	INFO	:	Resolving all filenames
[2022-03-22 01:58:30	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-22 01:58:30	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-22 01:58:30	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-22 01:58:30	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-22 01:58:30	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-22 01:58:30	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-03-22 01:58:30	                main:474]	:	INFO	:	Configuration: 
[2022-03-22 01:58:30	                main:475]	:	INFO	:	    Model type: GRU
[2022-03-22 01:58:30	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-03-22 01:58:30	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-03-22 01:58:30	                main:478]	:	INFO	:	    Batch Size: 128
[2022-03-22 01:58:30	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-03-22 01:58:30	                main:480]	:	INFO	:	    Patience: 10
[2022-03-22 01:58:30	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-03-22 01:58:30	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-03-22 01:58:30	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-03-22 01:58:31	                main:484]	:	INFO	:	    # Threads: 1
[2022-03-22 01:58:31	                main:486]	:	INFO	:	Preparing Dataset
[2022-03-22 01:58:31	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-22 01:58:32	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-03-22 01:58:38	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-03-22 01:58:38	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-03-22 01:58:38	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-03-22 01:58:38	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GT 1030)
[2022-03-22 18:34:32	                main:435]	:	INFO	:	Set logging level to 1
[2022-03-22 18:34:33	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-03-22 18:34:34	                main:444]	:	INFO	:	Resolving all filenames
[2022-03-22 18:34:34	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-03-22 18:34:34	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-03-22 18:34:34	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-03-22 18:34:35	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-03-22 18:34:36	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-03-22 18:34:36	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-03-22 18:34:36	                main:474]	:	INFO	:	Configuration: 
[2022-03-22 18:34:37	                main:475]	:	INFO	:	    Model type: GRU
[2022-03-22 18:34:37	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-03-22 18:34:37	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-03-22 18:34:37	                main:478]	:	INFO	:	    Batch Size: 128
[2022-03-22 18:34:37	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-03-22 18:34:38	                main:480]	:	INFO	:	    Patience: 10
[2022-03-22 18:34:38	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-03-22 18:34:38	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-03-22 18:34:38	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-03-22 18:34:38	                main:484]	:	INFO	:	    # Threads: 1
[2022-03-22 18:34:38	                main:486]	:	INFO	:	Preparing Dataset
[2022-03-22 18:34:38	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-03-22 18:34:40	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-03-22 18:35:06	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-03-22 18:35:07	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-03-22 18:35:08	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-03-22 18:35:08	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-03-22 18:35:09	                main:494]	:	INFO	:	Creating Model
[2022-03-22 18:35:10	                main:507]	:	INFO	:	Preparing config file
[2022-03-22 18:35:10	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-03-22 18:35:10	                main:512]	:	INFO	:	Loading config


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FF975CA4F69

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 03/22/22 18:35:10
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\1;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 000000006fad0000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000078390000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 0000000076600000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 0000000075c70000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 0000000078100000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000760f0000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1586) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.19041.1586 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1586

ModLoad: 0000000076870000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202

ModLoad: 0000000075fe0000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 0000000075f40000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 0000000075b70000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 00000000600b0000 0000000000058000 C:\ProgramData\BOINC\slots\1\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000076b00000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000076a60000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.19041.546

ModLoad: 0000000077f70000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.1586) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000768a0000 0000000000125000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000551b0000 0000000000099000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.24.28127.4) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.24.28127.4 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.24.28127.4

ModLoad: 000000006b720000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.867

ModLoad: 0000000055dd0000 0000000000017000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.24.28127.4) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.24.28127.4 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.24.28127.4

ModLoad: 000000006ed90000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.24.28127.4) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.24.28127.4 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.24.28127.4

ModLoad: 00000000e2980000 000000000abe7000 C:\ProgramData\BOINC\slots\1\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000004e140000 000000000020d000 C:\ProgramData\BOINC\slots\1\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 000000004de60000 00000000002db000 C:\ProgramData\BOINC\slots\1\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000005fa70000 0000000000040000 C:\ProgramData\BOINC\slots\1\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000ed570000 0000000024b49000 C:\ProgramData\BOINC\slots\1\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000005e190000 0000000000045000 C:\ProgramData\BOINC\slots\1\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000028ab0000 00000000034b2000 C:\ProgramData\BOINC\slots\1\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000df8d0000 00000000030a5000 C:\ProgramData\BOINC\slots\1\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 000000006eae0000 0000000000010000 C:\ProgramData\BOINC\slots\1\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 00000000c07c0000 0000000003d5b000 C:\ProgramData\BOINC\slots\1\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000b4da0000 000000000919f000 C:\ProgramData\BOINC\slots\1\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 0000000026be0000 0000000001eca000 C:\ProgramData\BOINC\slots\1\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000c4520000 000000001b3a4000 C:\ProgramData\BOINC\slots\1\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 0000000076a30000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000739e0000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000077620000 0000000000470000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000075ab0000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 0000000076120000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000075850000 0000000000033000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 0000000075b00000 0000000000068000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 00000000761e0000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000075690000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000076e40000 0000000000744000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.19041.964 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.964

ModLoad: 0000000073be0000 0000000000794000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000077a90000 0000000000354000 C:\WINDOWS\System32\combase.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.19041.1320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1320

ModLoad: 00000000754c0000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000077df0000 00000000000ad000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000076d60000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000040400000 00000000002cd000 C:\WINDOWS\system32\nvcuda.dll (30.0.15.1179) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_75\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 30.0.15.1179
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.6.110 driver
    Product Version       : 30.0.15.1179

ModLoad: 000000002d250000 00000000016a0000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_3b12ac0f95b18b9d\nvcuda64.dll (30.0.15.1179) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_75\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 30.0.15.1179
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.6.110 driver
    Product Version       : 30.0.15.1179

ModLoad: 000000006e1d0000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000006bae0000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.19041.906 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.906

ModLoad: 000000006b990000 0000000000148000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : drvstore.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 0000000075410000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000065530000 0000000000768000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.15.1179) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_75\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 30.0.15.1179
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 30.0.15.1179

ModLoad: 0000000076150000 0000000000082000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.19041.1415 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1415



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3612, Write: 307, Other 729

- I/O Transfers Counters -
Read: 6695219, Write: 6049, Other 27850

- Paged Pool Usage -
QuotaPagedPoolUsage: 3433184, QuotaPeakPagedPoolUsage: 3433184
QuotaNonPagedPoolUsage: 38144, QuotaPeakNonPagedPoolUsage: 38144

- Virtual Memory Usage -
VirtualSize: -1471016960, PeakVirtualSize: -884178944

- Pagefile Usage -
PagefileUsage: -1471016960, PeakPagefileUsage: -1471016960

- Working Set Size -
WorkingSetSize: 1153474560, PeakWorkingSetSize: 1153478656, PageFaultCount: 392454

*** Dump of thread ID 13836 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 20937500.000000, User Time: 54843752.000000, Wait Time: 61252492.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FF975CA4F69

- Registers -
rax=000000008c4e5ea8 rbx=000000006fe34910 rcx=0000000050d88800 rdx=00000000783b5b00 rsi=000000008c4e6710 rdi=0000000019930520
r8=000000008c4e5ed0 r9=000000008c4e5ef8 r10=0000000000000004 r11=000000008c4e5f08 r12=000000002ad673f0 r13=000000008c4e6920
r14=0000000054aa11f0 r15=0000000000000000 rip=0000000075ca4f69 rsp=000000008c4e65b0 rbp=000000008c4e68a0
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
8c4e6680 6fd4a884 00000040 0000004f 2ad66c00 00000632 KERNELBASE!RaiseException+0x0 
8c4e66e0 6faf1ca6 777d0000 8c4e67b9 541dc9e8 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
8c4e6790 6faf593b 00000000 00000030 00000020 00000008 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
8c4e68e0 6faf1a78 00000000 00000000 8c4e6c10 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
8c4e69b0 6faf1cfc 8c4e6c10 00000000 00000080 8c4e6ee0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
8c4e6a70 6fafc4dd 8c4e6ee0 8c4e6ee0 8c4e6ee0 8c4e6ee0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
8c4e6d60 6faeb2fe 8c4e7378 8c4e6ee0 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
8c4ffb00 6fd2c6f8 79166510 00000000 00000000 78f0c170 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
8c4ffb40 76617034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
8c4ffb70 783e2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
8c4ffbf0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 2160 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 61249948.000000

- Registers -
rax=00000000000001d3 rbx=00000000777d5f60 rcx=0000000000000074 rdx=00000000777d5be0 rsi=00000000777d3d10 rdi=00000000777d5f60
r8=0000000000000008 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000784307c4 rsp=000000008c5ff718 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
8c5ff710 783e2dc7 00010003 00000001 00000001 777d5f60 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
8c5ffa10 76617034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
8c5ffa40 783e2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
8c5ffac0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 7668 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 781250.000000, User Time: 0.000000, Wait Time: 61249948.000000

- Registers -
rax=00000000000001d3 rbx=00000000777d6390 rcx=0000000000000074 rdx=00000000777d6010 rsi=00000000777d3d10 rdi=00000000777d6390
r8=0000000000000244 r9=0000000000000244 r10=0000000000000236 r11=0000000000000243 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000784307c4 rsp=000000008c6ff978 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
8c6ff970 783e2dc7 00000000 00000000 777d3d10 777d6390 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
8c6ffc70 76617034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
8c6ffca0 783e2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
8c6ffd20 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 2356 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 156250.000000, Wait Time: 61249948.000000

- Registers -
rax=00000000000001d3 rbx=00000000777d6b30 rcx=0000000000000074 rdx=00000000777d67b0 rsi=00000000777d3d10 rdi=00000000777d6b30
r8=00000000776c7a30 r9=0000000000000031 r10=000000008c7ff3e6 r11=00000000eaec8690 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000784307c4 rsp=000000008c7ff9f8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
8c7ff9f0 783e2dc7 00000000 00000000 777d3d10 777d6b30 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
8c7ffcf0 76617034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
8c7ffd20 783e2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
8c7ffda0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 10400 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 61252492.000000

- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=000000008c9ffa50 rsi=0000000000000000 rdi=0000000000000064
r8=000000008c9ffa28 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000007842d3f4 rsp=000000008c9ffa28 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
8c9ffa20 75cb962e 8c9ffae8 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0 
8c9ffac0 6fb0a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0 
8c9ffaf0 76617034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
8c9ffb20 783e2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
8c9ffba0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 4440 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 61252492.000000

- Registers -
rax=000000000000005b rbx=0000000000000006 rcx=0000000000000006 rdx=000000008caffb40 rsi=0000000000000000 rdi=0000000000000006
r8=0000000000000001 r9=0000000079345200 r10=0000000000000000 r11=000000008caffab0 r12=0000000000000064 r13=000000008caffb40
r14=000000008caff840 r15=0000000000000000 rip=000000007842d8c4 rsp=000000008caff7e8 rbp=00000000793452e0
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
8caff7e0 75cbcb20 00000000 8c249000 784fa4d0 8c249000 ntdll!ZwWaitForMultipleObjects+0x0 
8caffad0 75cbca1e 777e37d0 004e0049 00000006 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
8caffb10 2d42d554 79347f20 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
8caffd50 2d4d58cd 00000000 793452e0 00000000 00000000 nvcuda64!+0x0 
8caffe00 2d42cf23 7a845161 674e284d 79909290 00000000 nvcuda64!cuProfilerStop+0x0 
8caffe30 2d764594 79909290 00000000 00000000 00000000 nvcuda64!+0x0 
8caffe60 76617034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
8caffe90 783e2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
8cafff10 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)