Task 11951374

Name ParityModified-1639960623-28581-3-0_0
Workunit 9146957
Created 23 Feb 2022, 16:47:45 UTC
Sent 27 Feb 2022, 11:27:06 UTC
Report deadline 7 Mar 2022, 11:27:06 UTC
Received 27 Feb 2022, 17:02:32 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 8158
Run time 2 hours 21 min 5 sec
CPU time 2 hours 13 min 58 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 13,453.09 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 2.08 GB
Peak swap size 4.41 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
	INFO	:	Epoch 961 | loss: nan | val_loss: nan | Time: 7631.76 ms
[2022-02-27 16:23:24	                main:574]	:	INFO	:	Epoch 962 | loss: nan | val_loss: nan | Time: 7539.7 ms
[2022-02-27 16:23:31	                main:574]	:	INFO	:	Epoch 963 | loss: nan | val_loss: nan | Time: 7543.69 ms
[2022-02-27 16:23:39	                main:574]	:	INFO	:	Epoch 964 | loss: nan | val_loss: nan | Time: 7432.44 ms
[2022-02-27 16:23:46	                main:574]	:	INFO	:	Epoch 965 | loss: nan | val_loss: nan | Time: 7570.86 ms
[2022-02-27 16:23:54	                main:574]	:	INFO	:	Epoch 966 | loss: nan | val_loss: nan | Time: 7606.37 ms
[2022-02-27 16:24:02	                main:574]	:	INFO	:	Epoch 967 | loss: nan | val_loss: nan | Time: 7559.51 ms
[2022-02-27 16:24:09	                main:574]	:	INFO	:	Epoch 968 | loss: nan | val_loss: nan | Time: 7702.54 ms
[2022-02-27 16:24:17	                main:574]	:	INFO	:	Epoch 969 | loss: nan | val_loss: nan | Time: 7521.26 ms
[2022-02-27 16:24:25	                main:574]	:	INFO	:	Epoch 970 | loss: nan | val_loss: nan | Time: 7631.18 ms
[2022-02-27 16:24:32	                main:574]	:	INFO	:	Epoch 971 | loss: nan | val_loss: nan | Time: 7484.82 ms
[2022-02-27 16:24:40	                main:574]	:	INFO	:	Epoch 972 | loss: nan | val_loss: nan | Time: 7434.25 ms
[2022-02-27 16:24:47	                main:574]	:	INFO	:	Epoch 973 | loss: nan | val_loss: nan | Time: 7782.3 ms
[2022-02-27 16:24:55	                main:574]	:	INFO	:	Epoch 974 | loss: nan | val_loss: nan | Time: 7710.05 ms
[2022-02-27 16:25:03	                main:574]	:	INFO	:	Epoch 975 | loss: nan | val_loss: nan | Time: 7531.17 ms
[2022-02-27 16:25:10	                main:574]	:	INFO	:	Epoch 976 | loss: nan | val_loss: nan | Time: 7617.1 ms
[2022-02-27 16:25:18	                main:574]	:	INFO	:	Epoch 977 | loss: nan | val_loss: nan | Time: 7572.05 ms
[2022-02-27 16:25:26	                main:574]	:	INFO	:	Epoch 978 | loss: nan | val_loss: nan | Time: 7674.92 ms
[2022-02-27 16:25:33	                main:574]	:	INFO	:	Epoch 979 | loss: nan | val_loss: nan | Time: 7488.58 ms
[2022-02-27 16:25:41	                main:574]	:	INFO	:	Epoch 980 | loss: nan | val_loss: nan | Time: 7603.77 ms
[2022-02-27 16:25:48	                main:574]	:	INFO	:	Epoch 981 | loss: nan | val_loss: nan | Time: 7584.58 ms
[2022-02-27 16:25:56	                main:574]	:	INFO	:	Epoch 982 | loss: nan | val_loss: nan | Time: 7615.57 ms
[2022-02-27 16:26:04	                main:574]	:	INFO	:	Epoch 983 | loss: nan | val_loss: nan | Time: 7494.96 ms
[2022-02-27 16:26:11	                main:574]	:	INFO	:	Epoch 984 | loss: nan | val_loss: nan | Time: 7609.86 ms
[2022-02-27 16:26:19	                main:574]	:	INFO	:	Epoch 985 | loss: nan | val_loss: nan | Time: 7640.69 ms
[2022-02-27 16:26:27	                main:574]	:	INFO	:	Epoch 986 | loss: nan | val_loss: nan | Time: 7667.91 ms
[2022-02-27 16:26:35	                main:574]	:	INFO	:	Epoch 987 | loss: nan | val_loss: nan | Time: 7751.93 ms
[2022-02-27 16:26:42	                main:574]	:	INFO	:	Epoch 988 | loss: nan | val_loss: nan | Time: 7482.65 ms
[2022-02-27 16:26:49	                main:574]	:	INFO	:	Epoch 989 | loss: nan | val_loss: nan | Time: 7361 ms
[2022-02-27 16:26:57	                main:574]	:	INFO	:	Epoch 990 | loss: nan | val_loss: nan | Time: 7572.23 ms
[2022-02-27 16:27:05	                main:574]	:	INFO	:	Epoch 991 | loss: nan | val_loss: nan | Time: 7552.81 ms
[2022-02-27 16:27:12	                main:574]	:	INFO	:	Epoch 992 | loss: nan | val_loss: nan | Time: 7681.96 ms
[2022-02-27 16:27:20	                main:574]	:	INFO	:	Epoch 993 | loss: nan | val_loss: nan | Time: 7627.77 ms
[2022-02-27 16:27:28	                main:574]	:	INFO	:	Epoch 994 | loss: nan | val_loss: nan | Time: 7674.09 ms
[2022-02-27 16:27:35	                main:574]	:	INFO	:	Epoch 995 | loss: nan | val_loss: nan | Time: 7662.62 ms
[2022-02-27 16:27:43	                main:574]	:	INFO	:	Epoch 996 | loss: nan | val_loss: nan | Time: 7621.77 ms
[2022-02-27 16:27:51	                main:574]	:	INFO	:	Epoch 997 | loss: nan | val_loss: nan | Time: 7604.01 ms
[2022-02-27 16:27:58	                main:574]	:	INFO	:	Epoch 998 | loss: nan | val_loss: nan | Time: 7628.14 ms
[2022-02-27 16:28:06	                main:574]	:	INFO	:	Epoch 999 | loss: nan | val_loss: nan | Time: 7452.64 ms
[2022-02-27 16:28:14	                main:574]	:	INFO	:	Epoch 1000 | loss: nan | val_loss: nan | Time: 7617.72 ms
[2022-02-27 16:28:21	                main:574]	:	INFO	:	Epoch 1001 | loss: nan | val_loss: nan | Time: 7546.58 ms
[2022-02-27 16:28:29	                main:574]	:	INFO	:	Epoch 1002 | loss: nan | val_loss: nan | Time: 7437.11 ms
[2022-02-27 16:28:36	                main:574]	:	INFO	:	Epoch 1003 | loss: nan | val_loss: nan | Time: 7726.07 ms
[2022-02-27 16:28:44	                main:574]	:	INFO	:	Epoch 1004 | loss: nan | val_loss: nan | Time: 7643.62 ms
[2022-02-27 16:28:52	                main:574]	:	INFO	:	Epoch 1005 | loss: nan | val_loss: nan | Time: 7625.46 ms
[2022-02-27 16:28:59	                main:574]	:	INFO	:	Epoch 1006 | loss: nan | val_loss: nan | Time: 7625.22 ms
[2022-02-27 16:29:07	                main:574]	:	INFO	:	Epoch 1007 | loss: nan | val_loss: nan | Time: 7578.27 ms
[2022-02-27 16:29:15	                main:574]	:	INFO	:	Epoch 1008 | loss: nan | val_loss: nan | Time: 7637.21 ms
[2022-02-27 16:29:22	                main:574]	:	INFO	:	Epoch 1009 | loss: nan | val_loss: nan | Time: 7671.56 ms
[2022-02-27 16:29:30	                main:574]	:	INFO	:	Epoch 1010 | loss: nan | val_loss: nan | Time: 7657.94 ms
[2022-02-27 16:29:38	                main:574]	:	INFO	:	Epoch 1011 | loss: nan | val_loss: nan | Time: 7510.94 ms
[2022-02-27 16:29:45	                main:574]	:	INFO	:	Epoch 1012 | loss: nan | val_loss: nan | Time: 7554.96 ms
[2022-02-27 16:29:53	                main:574]	:	INFO	:	Epoch 1013 | loss: nan | val_loss: nan | Time: 7721.27 ms
[2022-02-27 16:30:01	                main:574]	:	INFO	:	Epoch 1014 | loss: nan | val_loss: nan | Time: 7644.21 ms
[2022-02-27 16:30:08	                main:574]	:	INFO	:	Epoch 1015 | loss: nan | val_loss: nan | Time: 7342.61 ms
[2022-02-27 16:30:16	                main:574]	:	INFO	:	Epoch 1016 | loss: nan | val_loss: nan | Time: 7492.49 ms
[2022-02-27 16:30:23	                main:574]	:	INFO	:	Epoch 1017 | loss: nan | val_loss: nan | Time: 7653.83 ms
[2022-02-27 16:30:31	                main:574]	:	INFO	:	Epoch 1018 | loss: nan | val_loss: nan | Time: 7635.02 ms
[2022-02-27 16:30:39	                main:574]	:	INFO	:	Epoch 1019 | loss: nan | val_loss: nan | Time: 7689.33 ms
[2022-02-27 16:30:46	                main:574]	:	INFO	:	Epoch 1020 | loss: nan | val_loss: nan | Time: 7649.28 ms
[2022-02-27 16:30:54	                main:574]	:	INFO	:	Epoch 1021 | loss: nan | val_loss: nan | Time: 7616.84 ms
[2022-02-27 16:31:02	                main:574]	:	INFO	:	Epoch 1022 | loss: nan | val_loss: nan | Time: 7645.74 ms
[2022-02-27 16:31:09	                main:574]	:	INFO	:	Epoch 1023 | loss: nan | val_loss: nan | Time: 7515.79 ms
[2022-02-27 16:31:17	                main:574]	:	INFO	:	Epoch 1024 | loss: nan | val_loss: nan | Time: 7499.8 ms
[2022-02-27 16:31:25	                main:574]	:	INFO	:	Epoch 1025 | loss: nan | val_loss: nan | Time: 7593.81 ms
[2022-02-27 16:31:32	                main:574]	:	INFO	:	Epoch 1026 | loss: nan | val_loss: nan | Time: 7605.03 ms
[2022-02-27 16:31:40	                main:574]	:	INFO	:	Epoch 1027 | loss: nan | val_loss: nan | Time: 7572.13 ms
[2022-02-27 16:31:48	                main:574]	:	INFO	:	Epoch 1028 | loss: nan | val_loss: nan | Time: 7687.4 ms
[2022-02-27 16:31:55	                main:574]	:	INFO	:	Epoch 1029 | loss: nan | val_loss: nan | Time: 7524.69 ms
[2022-02-27 16:32:03	                main:574]	:	INFO	:	Epoch 1030 | loss: nan | val_loss: nan | Time: 7537.55 ms
[2022-02-27 16:32:10	                main:574]	:	INFO	:	Epoch 1031 | loss: nan | val_loss: nan | Time: 7681.37 ms
[2022-02-27 16:32:18	                main:574]	:	INFO	:	Epoch 1032 | loss: nan | val_loss: nan | Time: 7545.02 ms
[2022-02-27 16:32:26	                main:574]	:	INFO	:	Epoch 1033 | loss: nan | val_loss: nan | Time: 7644.32 ms
[2022-02-27 16:32:33	                main:574]	:	INFO	:	Epoch 1034 | loss: nan | val_loss: nan | Time: 7635.98 ms
[2022-02-27 16:32:41	                main:574]	:	INFO	:	Epoch 1035 | loss: nan | val_loss: nan | Time: 7662.69 ms
[2022-02-27 16:32:49	                main:574]	:	INFO	:	Epoch 1036 | loss: nan | val_loss: nan | Time: 7610.59 ms
[2022-02-27 16:32:56	                main:574]	:	INFO	:	Epoch 1037 | loss: nan | val_loss: nan | Time: 7451.61 ms
[2022-02-27 16:33:04	                main:574]	:	INFO	:	Epoch 1038 | loss: nan | val_loss: nan | Time: 7640.28 ms
[2022-02-27 16:33:11	                main:574]	:	INFO	:	Epoch 1039 | loss: nan | val_loss: nan | Time: 7153.1 ms
[2022-02-27 16:33:19	                main:574]	:	INFO	:	Epoch 1040 | loss: nan | val_loss: nan | Time: 7649.02 ms
[2022-02-27 16:33:26	                main:574]	:	INFO	:	Epoch 1041 | loss: nan | val_loss: nan | Time: 7460.51 ms
[2022-02-27 16:33:34	                main:574]	:	INFO	:	Epoch 1042 | loss: nan | val_loss: nan | Time: 7595.17 ms
[2022-02-27 16:33:41	                main:574]	:	INFO	:	Epoch 1043 | loss: nan | val_loss: nan | Time: 7553.15 ms
[2022-02-27 16:33:49	                main:574]	:	INFO	:	Epoch 1044 | loss: nan | val_loss: nan | Time: 7631.09 ms
[2022-02-27 16:33:57	                main:574]	:	INFO	:	Epoch 1045 | loss: nan | val_loss: nan | Time: 7688.55 ms
[2022-02-27 16:34:04	                main:574]	:	INFO	:	Epoch 1046 | loss: nan | val_loss: nan | Time: 7533.66 ms
[2022-02-27 16:34:12	                main:574]	:	INFO	:	Epoch 1047 | loss: nan | val_loss: nan | Time: 7287.95 ms
[2022-02-27 16:34:19	                main:574]	:	INFO	:	Epoch 1048 | loss: nan | val_loss: nan | Time: 7667.9 ms
[2022-02-27 16:34:27	                main:574]	:	INFO	:	Epoch 1049 | loss: nan | val_loss: nan | Time: 7710.35 ms
[2022-02-27 16:34:35	                main:574]	:	INFO	:	Epoch 1050 | loss: nan | val_loss: nan | Time: 7512.39 ms
[2022-02-27 16:34:42	                main:574]	:	INFO	:	Epoch 1051 | loss: nan | val_loss: nan | Time: 7503.97 ms
[2022-02-27 16:34:50	                main:574]	:	INFO	:	Epoch 1052 | loss: nan | val_loss: nan | Time: 7522.04 ms
[2022-02-27 16:34:58	                main:574]	:	INFO	:	Epoch 1053 | loss: nan | val_loss: nan | Time: 7670.67 ms
[2022-02-27 16:35:05	                main:574]	:	INFO	:	Epoch 1054 | loss: nan | val_loss: nan | Time: 7522.73 ms
[2022-02-27 16:35:13	                main:574]	:	INFO	:	Epoch 1055 | loss: nan | val_loss: nan | Time: 7731 ms
[2022-02-27 16:35:21	                main:574]	:	INFO	:	Epoch 1056 | loss: nan | val_loss: nan | Time: 7563.38 ms
[2022-02-27 16:35:28	                main:574]	:	INFO	:	Epoch 1057 | loss: nan | val_loss: nan | Time: 7659.33 ms
[2022-02-27 16:35:36	                main:574]	:	INFO	:	Epoch 1058 | loss: nan | val_loss: nan | Time: 7570.85 ms
[2022-02-27 16:35:43	                main:574]	:	INFO	:	Epoch 1059 | loss: nan | val_loss: nan | Time: 7525.7 ms
[2022-02-27 16:35:51	                main:574]	:	INFO	:	Epoch 1060 | loss: nan | val_loss: nan | Time: 7444.21 ms
[2022-02-27 16:35:59	                main:574]	:	INFO	:	Epoch 1061 | loss: nan | val_loss: nan | Time: 7599.63 ms
[2022-02-27 16:36:06	                main:574]	:	INFO	:	Epoch 1062 | loss: nan | val_loss: nan | Time: 7712.6 ms
[2022-02-27 16:36:14	                main:574]	:	INFO	:	Epoch 1063 | loss: nan | val_loss: nan | Time: 7609.2 ms
[2022-02-27 16:36:22	                main:574]	:	INFO	:	Epoch 1064 | loss: nan | val_loss: nan | Time: 7621.42 ms
[2022-02-27 16:36:29	                main:574]	:	INFO	:	Epoch 1065 | loss: nan | val_loss: nan | Time: 7662.59 ms
[2022-02-27 16:36:37	                main:574]	:	INFO	:	Epoch 1066 | loss: nan | val_loss: nan | Time: 7594.9 ms
[2022-02-27 16:36:45	                main:574]	:	INFO	:	Epoch 1067 | loss: nan | val_loss: nan | Time: 7655.23 ms
[2022-02-27 16:36:52	                main:574]	:	INFO	:	Epoch 1068 | loss: nan | val_loss: nan | Time: 7527.11 ms
[2022-02-27 16:37:00	                main:574]	:	INFO	:	Epoch 1069 | loss: nan | val_loss: nan | Time: 7648.99 ms
[2022-02-27 16:37:08	                main:574]	:	INFO	:	Epoch 1070 | loss: nan | val_loss: nan | Time: 7615.5 ms
[2022-02-27 16:37:15	                main:574]	:	INFO	:	Epoch 1071 | loss: nan | val_loss: nan | Time: 7647.44 ms
[2022-02-27 16:37:23	                main:574]	:	INFO	:	Epoch 1072 | loss: nan | val_loss: nan | Time: 7641.57 ms
[2022-02-27 16:37:31	                main:574]	:	INFO	:	Epoch 1073 | loss: nan | val_loss: nan | Time: 7554.79 ms
[2022-02-27 16:37:38	                main:574]	:	INFO	:	Epoch 1074 | loss: nan | val_loss: nan | Time: 7522.62 ms
[2022-02-27 16:37:46	                main:574]	:	INFO	:	Epoch 1075 | loss: nan | val_loss: nan | Time: 7611.55 ms
[2022-02-27 16:37:53	                main:574]	:	INFO	:	Epoch 1076 | loss: nan | val_loss: nan | Time: 7627.07 ms
[2022-02-27 16:38:01	                main:574]	:	INFO	:	Epoch 1077 | loss: nan | val_loss: nan | Time: 7613.38 ms
[2022-02-27 16:38:09	                main:574]	:	INFO	:	Epoch 1078 | loss: nan | val_loss: nan | Time: 7603.76 ms
[2022-02-27 16:38:16	                main:574]	:	INFO	:	Epoch 1079 | loss: nan | val_loss: nan | Time: 7534.57 ms
[2022-02-27 16:38:24	                main:574]	:	INFO	:	Epoch 1080 | loss: nan | val_loss: nan | Time: 7302.12 ms
[2022-02-27 16:38:31	                main:574]	:	INFO	:	Epoch 1081 | loss: nan | val_loss: nan | Time: 7486.35 ms
[2022-02-27 16:38:39	                main:574]	:	INFO	:	Epoch 1082 | loss: nan | val_loss: nan | Time: 7676.94 ms
[2022-02-27 16:38:47	                main:574]	:	INFO	:	Epoch 1083 | loss: nan | val_loss: nan | Time: 7636.67 ms
[2022-02-27 16:38:54	                main:574]	:	INFO	:	Epoch 1084 | loss: nan | val_loss: nan | Time: 7541.71 ms
[2022-02-27 16:39:02	                main:574]	:	INFO	:	Epoch 1085 | loss: nan | val_loss: nan | Time: 7590.3 ms
[2022-02-27 16:39:09	                main:574]	:	INFO	:	Epoch 1086 | loss: nan | val_loss: nan | Time: 7619.98 ms
[2022-02-27 16:39:17	                main:574]	:	INFO	:	Epoch 1087 | loss: nan | val_loss: nan | Time: 7649.25 ms
[2022-02-27 16:39:24	                main:574]	:	INFO	:	Epoch 1088 | loss: nan | val_loss: nan | Time: 7373 ms
[2022-02-27 16:39:32	                main:574]	:	INFO	:	Epoch 1089 | loss: nan | val_loss: nan | Time: 7560.85 ms
[2022-02-27 16:39:40	                main:574]	:	INFO	:	Epoch 1090 | loss: nan | val_loss: nan | Time: 7562.31 ms
[2022-02-27 16:39:47	                main:574]	:	INFO	:	Epoch 1091 | loss: nan | val_loss: nan | Time: 7675.38 ms
[2022-02-27 16:39:55	                main:574]	:	INFO	:	Epoch 1092 | loss: nan | val_loss: nan | Time: 7635.29 ms
[2022-02-27 16:40:03	                main:574]	:	INFO	:	Epoch 1093 | loss: nan | val_loss: nan | Time: 7672.6 ms
[2022-02-27 16:40:10	                main:574]	:	INFO	:	Epoch 1094 | loss: nan | val_loss: nan | Time: 7422.84 ms
[2022-02-27 16:40:18	                main:574]	:	INFO	:	Epoch 1095 | loss: nan | val_loss: nan | Time: 7700.25 ms
[2022-02-27 16:40:26	                main:574]	:	INFO	:	Epoch 1096 | loss: nan | val_loss: nan | Time: 7560.11 ms
[2022-02-27 16:40:33	                main:574]	:	INFO	:	Epoch 1097 | loss: nan | val_loss: nan | Time: 7669.14 ms
[2022-02-27 16:40:41	                main:574]	:	INFO	:	Epoch 1098 | loss: nan | val_loss: nan | Time: 7569.47 ms
[2022-02-27 16:40:49	                main:574]	:	INFO	:	Epoch 1099 | loss: nan | val_loss: nan | Time: 7688.49 ms
[2022-02-27 16:40:56	                main:574]	:	INFO	:	Epoch 1100 | loss: nan | val_loss: nan | Time: 7585.21 ms
[2022-02-27 16:41:04	                main:574]	:	INFO	:	Epoch 1101 | loss: nan | val_loss: nan | Time: 7632.3 ms
[2022-02-27 16:41:12	                main:574]	:	INFO	:	Epoch 1102 | loss: nan | val_loss: nan | Time: 7591.6 ms
[2022-02-27 16:41:19	                main:574]	:	INFO	:	Epoch 1103 | loss: nan | val_loss: nan | Time: 7625.71 ms
[2022-02-27 16:41:27	                main:574]	:	INFO	:	Epoch 1104 | loss: nan | val_loss: nan | Time: 7546 ms
[2022-02-27 16:41:35	                main:574]	:	INFO	:	Epoch 1105 | loss: nan | val_loss: nan | Time: 7633.2 ms
[2022-02-27 16:41:42	                main:574]	:	INFO	:	Epoch 1106 | loss: nan | val_loss: nan | Time: 7665.81 ms
[2022-02-27 16:41:50	                main:574]	:	INFO	:	Epoch 1107 | loss: nan | val_loss: nan | Time: 7580.26 ms
[2022-02-27 16:41:57	                main:574]	:	INFO	:	Epoch 1108 | loss: nan | val_loss: nan | Time: 7554.57 ms
[2022-02-27 16:42:05	                main:574]	:	INFO	:	Epoch 1109 | loss: nan | val_loss: nan | Time: 7662.58 ms
[2022-02-27 16:42:13	                main:574]	:	INFO	:	Epoch 1110 | loss: nan | val_loss: nan | Time: 7536.94 ms
[2022-02-27 16:42:21	                main:574]	:	INFO	:	Epoch 1111 | loss: nan | val_loss: nan | Time: 7697.1 ms
[2022-02-27 16:42:28	                main:574]	:	INFO	:	Epoch 1112 | loss: nan | val_loss: nan | Time: 7703.56 ms
[2022-02-27 16:42:36	                main:574]	:	INFO	:	Epoch 1113 | loss: nan | val_loss: nan | Time: 7749.68 ms
[2022-02-27 16:42:44	                main:574]	:	INFO	:	Epoch 1114 | loss: nan | val_loss: nan | Time: 7568.78 ms
[2022-02-27 16:42:51	                main:574]	:	INFO	:	Epoch 1115 | loss: nan | val_loss: nan | Time: 7638.19 ms
[2022-02-27 16:42:59	                main:574]	:	INFO	:	Epoch 1116 | loss: nan | val_loss: nan | Time: 7691.92 ms
[2022-02-27 16:43:07	                main:574]	:	INFO	:	Epoch 1117 | loss: nan | val_loss: nan | Time: 7659.22 ms
[2022-02-27 16:43:14	                main:574]	:	INFO	:	Epoch 1118 | loss: nan | val_loss: nan | Time: 7578.58 ms
[2022-02-27 16:43:22	                main:574]	:	INFO	:	Epoch 1119 | loss: nan | val_loss: nan | Time: 7643.17 ms
[2022-02-27 16:43:30	                main:574]	:	INFO	:	Epoch 1120 | loss: nan | val_loss: nan | Time: 7617 ms
[2022-02-27 16:43:37	                main:574]	:	INFO	:	Epoch 1121 | loss: nan | val_loss: nan | Time: 7222.91 ms
[2022-02-27 16:43:45	                main:574]	:	INFO	:	Epoch 1122 | loss: nan | val_loss: nan | Time: 7680.83 ms
[2022-02-27 16:43:52	                main:574]	:	INFO	:	Epoch 1123 | loss: nan | val_loss: nan | Time: 7616.91 ms
[2022-02-27 16:44:00	                main:574]	:	INFO	:	Epoch 1124 | loss: nan | val_loss: nan | Time: 7670.96 ms
[2022-02-27 16:44:08	                main:574]	:	INFO	:	Epoch 1125 | loss: nan | val_loss: nan | Time: 7658.95 ms
[2022-02-27 16:44:15	                main:574]	:	INFO	:	Epoch 1126 | loss: nan | val_loss: nan | Time: 7558.27 ms
[2022-02-27 16:44:23	                main:574]	:	INFO	:	Epoch 1127 | loss: nan | val_loss: nan | Time: 7573.34 ms
[2022-02-27 16:44:31	                main:574]	:	INFO	:	Epoch 1128 | loss: nan | val_loss: nan | Time: 7637 ms
[2022-02-27 16:44:38	                main:574]	:	INFO	:	Epoch 1129 | loss: nan | val_loss: nan | Time: 7632.48 ms
[2022-02-27 16:44:46	                main:574]	:	INFO	:	Epoch 1130 | loss: nan | val_loss: nan | Time: 7626.39 ms
[2022-02-27 16:44:54	                main:574]	:	INFO	:	Epoch 1131 | loss: nan | val_loss: nan | Time: 7576.69 ms
[2022-02-27 16:45:01	                main:574]	:	INFO	:	Epoch 1132 | loss: nan | val_loss: nan | Time: 7627.2 ms
[2022-02-27 16:45:09	                main:574]	:	INFO	:	Epoch 1133 | loss: nan | val_loss: nan | Time: 7627.26 ms
[2022-02-27 16:45:17	                main:574]	:	INFO	:	Epoch 1134 | loss: nan | val_loss: nan | Time: 7653.84 ms
[2022-02-27 16:45:24	                main:574]	:	INFO	:	Epoch 1135 | loss: nan | val_loss: nan | Time: 7597.28 ms
[2022-02-27 16:45:32	                main:574]	:	INFO	:	Epoch 1136 | loss: nan | val_loss: nan | Time: 7593.91 ms
[2022-02-27 16:45:40	                main:574]	:	INFO	:	Epoch 1137 | loss: nan | val_loss: nan | Time: 7655.62 ms
[2022-02-27 16:45:47	                main:574]	:	INFO	:	Epoch 1138 | loss: nan | val_loss: nan | Time: 7449.33 ms
[2022-02-27 16:45:54	                main:574]	:	INFO	:	Epoch 1139 | loss: nan | val_loss: nan | Time: 7404.09 ms
[2022-02-27 16:46:02	                main:574]	:	INFO	:	Epoch 1140 | loss: nan | val_loss: nan | Time: 7687.86 ms
[2022-02-27 16:46:10	                main:574]	:	INFO	:	Epoch 1141 | loss: nan | val_loss: nan | Time: 7579.38 ms
[2022-02-27 16:46:17	                main:574]	:	INFO	:	Epoch 1142 | loss: nan | val_loss: nan | Time: 7609.67 ms
[2022-02-27 16:46:25	                main:574]	:	INFO	:	Epoch 1143 | loss: nan | val_loss: nan | Time: 7477.53 ms
[2022-02-27 16:46:33	                main:574]	:	INFO	:	Epoch 1144 | loss: nan | val_loss: nan | Time: 7614.92 ms
[2022-02-27 16:46:40	                main:574]	:	INFO	:	Epoch 1145 | loss: nan | val_loss: nan | Time: 7518.67 ms
[2022-02-27 16:46:48	                main:574]	:	INFO	:	Epoch 1146 | loss: nan | val_loss: nan | Time: 7741.29 ms
[2022-02-27 16:46:56	                main:574]	:	INFO	:	Epoch 1147 | loss: nan | val_loss: nan | Time: 7571.57 ms
[2022-02-27 16:47:03	                main:574]	:	INFO	:	Epoch 1148 | loss: nan | val_loss: nan | Time: 7604.52 ms
[2022-02-27 16:47:11	                main:574]	:	INFO	:	Epoch 1149 | loss: nan | val_loss: nan | Time: 7644.73 ms
[2022-02-27 16:47:19	                main:574]	:	INFO	:	Epoch 1150 | loss: nan | val_loss: nan | Time: 7582.55 ms
[2022-02-27 16:47:26	                main:574]	:	INFO	:	Epoch 1151 | loss: nan | val_loss: nan | Time: 7577.33 ms
[2022-02-27 16:47:34	                main:574]	:	INFO	:	Epoch 1152 | loss: nan | val_loss: nan | Time: 7577.88 ms
[2022-02-27 16:47:41	                main:574]	:	INFO	:	Epoch 1153 | loss: nan | val_loss: nan | Time: 7474.97 ms
[2022-02-27 16:47:49	                main:574]	:	INFO	:	Epoch 1154 | loss: nan | val_loss: nan | Time: 7486.37 ms
[2022-02-27 16:47:57	                main:574]	:	INFO	:	Epoch 1155 | loss: nan | val_loss: nan | Time: 7616.22 ms
[2022-02-27 16:48:04	                main:574]	:	INFO	:	Epoch 1156 | loss: nan | val_loss: nan | Time: 7576.81 ms
[2022-02-27 16:48:12	                main:574]	:	INFO	:	Epoch 1157 | loss: nan | val_loss: nan | Time: 7561.02 ms
[2022-02-27 16:48:20	                main:574]	:	INFO	:	Epoch 1158 | loss: nan | val_loss: nan | Time: 7702.53 ms
[2022-02-27 16:48:27	                main:574]	:	INFO	:	Epoch 1159 | loss: nan | val_loss: nan | Time: 7618.42 ms
[2022-02-27 16:48:35	                main:574]	:	INFO	:	Epoch 1160 | loss: nan | val_loss: nan | Time: 7582.86 ms
[2022-02-27 16:48:42	                main:574]	:	INFO	:	Epoch 1161 | loss: nan | val_loss: nan | Time: 7608.11 ms
[2022-02-27 16:48:50	                main:574]	:	INFO	:	Epoch 1162 | loss: nan | val_loss: nan | Time: 7358.43 ms
[2022-02-27 16:48:58	                main:574]	:	INFO	:	Epoch 1163 | loss: nan | val_loss: nan | Time: 7664.86 ms
[2022-02-27 16:49:05	                main:574]	:	INFO	:	Epoch 1164 | loss: nan | val_loss: nan | Time: 7685.62 ms
[2022-02-27 16:49:13	                main:574]	:	INFO	:	Epoch 1165 | loss: nan | val_loss: nan | Time: 7653.58 ms
[2022-02-27 16:49:21	                main:574]	:	INFO	:	Epoch 1166 | loss: nan | val_loss: nan | Time: 7624.25 ms
[2022-02-27 16:49:28	                main:574]	:	INFO	:	Epoch 1167 | loss: nan | val_loss: nan | Time: 7592.83 ms
[2022-02-27 16:49:36	                main:574]	:	INFO	:	Epoch 1168 | loss: nan | val_loss: nan | Time: 7469.24 ms
[2022-02-27 16:49:44	                main:574]	:	INFO	:	Epoch 1169 | loss: nan | val_loss: nan | Time: 7755.94 ms
[2022-02-27 16:49:51	                main:574]	:	INFO	:	Epoch 1170 | loss: nan | val_loss: nan | Time: 7594.75 ms
[2022-02-27 16:49:59	                main:574]	:	INFO	:	Epoch 1171 | loss: nan | val_loss: nan | Time: 7483.6 ms
[2022-02-27 16:50:07	                main:574]	:	INFO	:	Epoch 1172 | loss: nan | val_loss: nan | Time: 7647.51 ms
[2022-02-27 16:50:14	                main:574]	:	INFO	:	Epoch 1173 | loss: nan | val_loss: nan | Time: 7529.76 ms
[2022-02-27 16:50:22	                main:574]	:	INFO	:	Epoch 1174 | loss: nan | val_loss: nan | Time: 7655.73 ms
[2022-02-27 16:50:29	                main:574]	:	INFO	:	Epoch 1175 | loss: nan | val_loss: nan | Time: 7608.42 ms
[2022-02-27 16:50:37	                main:574]	:	INFO	:	Epoch 1176 | loss: nan | val_loss: nan | Time: 7524.74 ms
[2022-02-27 16:50:45	                main:574]	:	INFO	:	Epoch 1177 | loss: nan | val_loss: nan | Time: 7551.68 ms
[2022-02-27 16:50:52	                main:574]	:	INFO	:	Epoch 1178 | loss: nan | val_loss: nan | Time: 7600.22 ms
[2022-02-27 16:51:00	                main:574]	:	INFO	:	Epoch 1179 | loss: nan | val_loss: nan | Time: 7497.81 ms
[2022-02-27 16:51:08	                main:574]	:	INFO	:	Epoch 1180 | loss: nan | val_loss: nan | Time: 7612.44 ms
[2022-02-27 16:51:15	                main:574]	:	INFO	:	Epoch 1181 | loss: nan | val_loss: nan | Time: 7615.69 ms
[2022-02-27 16:51:23	                main:574]	:	INFO	:	Epoch 1182 | loss: nan | val_loss: nan | Time: 7745.27 ms
[2022-02-27 16:51:31	                main:574]	:	INFO	:	Epoch 1183 | loss: nan | val_loss: nan | Time: 7497.75 ms
[2022-02-27 16:51:38	                main:574]	:	INFO	:	Epoch 1184 | loss: nan | val_loss: nan | Time: 7571.79 ms
[2022-02-27 16:51:46	                main:574]	:	INFO	:	Epoch 1185 | loss: nan | val_loss: nan | Time: 7607.8 ms
[2022-02-27 16:51:53	                main:574]	:	INFO	:	Epoch 1186 | loss: nan | val_loss: nan | Time: 7562.26 ms
[2022-02-27 16:52:01	                main:574]	:	INFO	:	Epoch 1187 | loss: nan | val_loss: nan | Time: 7666.2 ms
[2022-02-27 16:52:09	                main:574]	:	INFO	:	Epoch 1188 | loss: nan | val_loss: nan | Time: 7610.8 ms
[2022-02-27 16:52:17	                main:574]	:	INFO	:	Epoch 1189 | loss: nan | val_loss: nan | Time: 7631.19 ms
[2022-02-27 16:52:24	                main:574]	:	INFO	:	Epoch 1190 | loss: nan | val_loss: nan | Time: 7586.23 ms
[2022-02-27 16:52:32	                main:574]	:	INFO	:	Epoch 1191 | loss: nan | val_loss: nan | Time: 7611.25 ms
[2022-02-27 16:52:39	                main:574]	:	INFO	:	Epoch 1192 | loss: nan | val_loss: nan | Time: 7533.39 ms
[2022-02-27 16:52:47	                main:574]	:	INFO	:	Epoch 1193 | loss: nan | val_loss: nan | Time: 7598.5 ms
[2022-02-27 16:52:55	                main:574]	:	INFO	:	Epoch 1194 | loss: nan | val_loss: nan | Time: 7698.69 ms
[2022-02-27 16:53:02	                main:574]	:	INFO	:	Epoch 1195 | loss: nan | val_loss: nan | Time: 7359.92 ms
[2022-02-27 16:53:10	                main:574]	:	INFO	:	Epoch 1196 | loss: nan | val_loss: nan | Time: 7638.94 ms
[2022-02-27 16:53:17	                main:574]	:	INFO	:	Epoch 1197 | loss: nan | val_loss: nan | Time: 7548.06 ms
[2022-02-27 16:53:25	                main:574]	:	INFO	:	Epoch 1198 | loss: nan | val_loss: nan | Time: 7587.86 ms
[2022-02-27 16:53:33	                main:574]	:	INFO	:	Epoch 1199 | loss: nan | val_loss: nan | Time: 7570.14 ms
[2022-02-27 16:53:40	                main:574]	:	INFO	:	Epoch 1200 | loss: nan | val_loss: nan | Time: 7600.88 ms
[2022-02-27 16:53:48	                main:574]	:	INFO	:	Epoch 1201 | loss: nan | val_loss: nan | Time: 7707.9 ms
[2022-02-27 16:53:55	                main:574]	:	INFO	:	Epoch 1202 | loss: nan | val_loss: nan | Time: 7492.77 ms
[2022-02-27 16:54:03	                main:574]	:	INFO	:	Epoch 1203 | loss: nan | val_loss: nan | Time: 7269.17 ms
[2022-02-27 16:54:10	                main:574]	:	INFO	:	Epoch 1204 | loss: nan | val_loss: nan | Time: 7659.31 ms
[2022-02-27 16:54:18	                main:574]	:	INFO	:	Epoch 1205 | loss: nan | val_loss: nan | Time: 7558.71 ms
[2022-02-27 16:54:26	                main:574]	:	INFO	:	Epoch 1206 | loss: nan | val_loss: nan | Time: 7623.51 ms
[2022-02-27 16:54:33	                main:574]	:	INFO	:	Epoch 1207 | loss: nan | val_loss: nan | Time: 7542.09 ms
[2022-02-27 16:54:41	                main:574]	:	INFO	:	Epoch 1208 | loss: nan | val_loss: nan | Time: 7514.54 ms
[2022-02-27 16:54:49	                main:574]	:	INFO	:	Epoch 1209 | loss: nan | val_loss: nan | Time: 7567.07 ms
[2022-02-27 16:54:56	                main:574]	:	INFO	:	Epoch 1210 | loss: nan | val_loss: nan | Time: 7541.44 ms
[2022-02-27 16:55:04	                main:574]	:	INFO	:	Epoch 1211 | loss: nan | val_loss: nan | Time: 7557.62 ms
[2022-02-27 16:55:11	                main:574]	:	INFO	:	Epoch 1212 | loss: nan | val_loss: nan | Time: 7656.38 ms
[2022-02-27 16:55:19	                main:574]	:	INFO	:	Epoch 1213 | loss: nan | val_loss: nan | Time: 7423.42 ms
[2022-02-27 16:55:27	                main:574]	:	INFO	:	Epoch 1214 | loss: nan | val_loss: nan | Time: 7711.75 ms
[2022-02-27 16:55:34	                main:574]	:	INFO	:	Epoch 1215 | loss: nan | val_loss: nan | Time: 7648.42 ms
[2022-02-27 16:55:42	                main:574]	:	INFO	:	Epoch 1216 | loss: nan | val_loss: nan | Time: 7552.15 ms
[2022-02-27 16:55:49	                main:574]	:	INFO	:	Epoch 1217 | loss: nan | val_loss: nan | Time: 7479.84 ms
[2022-02-27 16:55:57	                main:574]	:	INFO	:	Epoch 1218 | loss: nan | val_loss: nan | Time: 7696.98 ms
[2022-02-27 16:56:05	                main:574]	:	INFO	:	Epoch 1219 | loss: nan | val_loss: nan | Time: 7660.79 ms
[2022-02-27 16:56:13	                main:574]	:	INFO	:	Epoch 1220 | loss: nan | val_loss: nan | Time: 7681.92 ms
[2022-02-27 16:56:20	                main:574]	:	INFO	:	Epoch 1221 | loss: nan | val_loss: nan | Time: 7557.14 ms
[2022-02-27 16:56:28	                main:574]	:	INFO	:	Epoch 1222 | loss: nan | val_loss: nan | Time: 7498.57 ms
[2022-02-27 16:56:35	                main:574]	:	INFO	:	Epoch 1223 | loss: nan | val_loss: nan | Time: 7628.44 ms
[2022-02-27 16:56:43	                main:574]	:	INFO	:	Epoch 1224 | loss: nan | val_loss: nan | Time: 7638.19 ms
[2022-02-27 16:56:51	                main:574]	:	INFO	:	Epoch 1225 | loss: nan | val_loss: nan | Time: 7581.2 ms
[2022-02-27 16:56:58	                main:574]	:	INFO	:	Epoch 1226 | loss: nan | val_loss: nan | Time: 7610.58 ms
[2022-02-27 16:57:06	                main:574]	:	INFO	:	Epoch 1227 | loss: nan | val_loss: nan | Time: 7487.75 ms
[2022-02-27 16:57:14	                main:574]	:	INFO	:	Epoch 1228 | loss: nan | val_loss: nan | Time: 7589.04 ms
[2022-02-27 16:57:21	                main:574]	:	INFO	:	Epoch 1229 | loss: nan | val_loss: nan | Time: 7651.94 ms
[2022-02-27 16:57:29	                main:574]	:	INFO	:	Epoch 1230 | loss: nan | val_loss: nan | Time: 7595.4 ms
[2022-02-27 16:57:37	                main:574]	:	INFO	:	Epoch 1231 | loss: nan | val_loss: nan | Time: 7659.55 ms
[2022-02-27 16:57:44	                main:574]	:	INFO	:	Epoch 1232 | loss: nan | val_loss: nan | Time: 7626.81 ms
[2022-02-27 16:57:52	                main:574]	:	INFO	:	Epoch 1233 | loss: nan | val_loss: nan | Time: 7662.59 ms
[2022-02-27 16:58:00	                main:574]	:	INFO	:	Epoch 1234 | loss: nan | val_loss: nan | Time: 7605.18 ms
[2022-02-27 16:58:07	                main:574]	:	INFO	:	Epoch 1235 | loss: nan | val_loss: nan | Time: 7595.02 ms
[2022-02-27 16:58:15	                main:574]	:	INFO	:	Epoch 1236 | loss: nan | val_loss: nan | Time: 7451.04 ms
[2022-02-27 16:58:22	                main:574]	:	INFO	:	Epoch 1237 | loss: nan | val_loss: nan | Time: 7612.79 ms
[2022-02-27 16:58:30	                main:574]	:	INFO	:	Epoch 1238 | loss: nan | val_loss: nan | Time: 7594.54 ms
[2022-02-27 16:58:38	                main:574]	:	INFO	:	Epoch 1239 | loss: nan | val_loss: nan | Time: 7510.85 ms
[2022-02-27 16:58:45	                main:574]	:	INFO	:	Epoch 1240 | loss: nan | val_loss: nan | Time: 7808.28 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 2080 Ti)
[2022-02-27 17:01:48	                main:435]	:	INFO	:	Set logging level to 1
[2022-02-27 17:01:48	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-02-27 17:01:48	                main:444]	:	INFO	:	Resolving all filenames
[2022-02-27 17:01:48	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-02-27 17:01:48	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-02-27 17:01:48	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-02-27 17:01:48	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-02-27 17:01:48	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-02-27 17:01:48	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-02-27 17:01:48	                main:474]	:	INFO	:	Configuration: 
[2022-02-27 17:01:48	                main:475]	:	INFO	:	    Model type: GRU
[2022-02-27 17:01:48	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-02-27 17:01:48	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-02-27 17:01:48	                main:478]	:	INFO	:	    Batch Size: 128
[2022-02-27 17:01:48	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-02-27 17:01:48	                main:480]	:	INFO	:	    Patience: 10
[2022-02-27 17:01:48	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-02-27 17:01:48	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-02-27 17:01:48	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-02-27 17:01:48	                main:484]	:	INFO	:	    # Threads: 1
[2022-02-27 17:01:48	                main:486]	:	INFO	:	Preparing Dataset
[2022-02-27 17:01:48	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-02-27 17:01:49	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-02-27 17:01:50	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-02-27 17:01:50	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-02-27 17:01:50	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-02-27 17:01:50	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-02-27 17:01:50	                main:494]	:	INFO	:	Creating Model
[2022-02-27 17:01:50	                main:507]	:	INFO	:	Preparing config file
[2022-02-27 17:01:50	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-02-27 17:01:50	                main:512]	:	INFO	:	Loading config


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFF6BB9478C

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 02/27/22 17:01:51
Install Directory : C:\Program Files\BOINC\
Data Directory    : D:\BOINC
Project Symstore  : 
LoadLibraryA( D:\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( D:\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( D:\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( D:\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: D:\BOINC\slots\1;D:\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 0000000042dc0000 00000000003df000 D:\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000006e660000 0000000000209000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.22000.469) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.22000.493 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.493

ModLoad: 000000006dbc0000 00000000000bd000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.22000.434) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.22000.493 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.493

ModLoad: 000000006bb50000 0000000000374000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.22000.434) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.22000.493 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.493

ModLoad: 000000006da10000 00000000001ac000 C:\WINDOWS\System32\USER32.dll (6.2.22000.282) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.22000.493 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.493

ModLoad: 000000006c4d0000 0000000000026000 C:\WINDOWS\System32\win32u.dll (6.2.22000.493) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.22000.493 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.493

ModLoad: 000000006d540000 0000000000029000 C:\WINDOWS\System32\GDI32.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 000000006c240000 0000000000112000 C:\WINDOWS\System32\gdi32full.dll (6.2.22000.469) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.22000.469 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.469

ModLoad: 000000006bed0000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 000000006c120000 0000000000111000 C:\WINDOWS\System32\ucrtbase.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 000000006dd30000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.22000.434) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.22000.493 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.493

ModLoad: 000000006c500000 00000000000a3000 C:\WINDOWS\System32\msvcrt.dll (7.0.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.22000.1

ModLoad: 000000006dc90000 000000000009e000 C:\WINDOWS\System32\sechost.dll (6.2.22000.434) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 000000006c5b0000 0000000000120000 C:\WINDOWS\System32\RPCRT4.dll (6.2.22000.434) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.22000.493 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.493

ModLoad: 000000005b670000 0000000000058000 D:\BOINC\slots\1\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000051400000 0000000000092000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.28.29334.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\6\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.28.29334.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.28.29334.0

ModLoad: 0000000069a90000 0000000000221000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000052020000 0000000000019000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.28.29334.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\6\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.28.29334.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.28.29334.0

ModLoad: 0000000051fa0000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.28.29334.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\6\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.28.29334.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.28.29334.0

ModLoad: 00000000c7c00000 0000000024b49000 D:\BOINC\slots\1\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000054050000 0000000000045000 D:\BOINC\slots\1\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000bd010000 000000000abe7000 D:\BOINC\slots\1\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000b9b50000 00000000034b2000 D:\BOINC\slots\1\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 0000000061d60000 0000000000010000 D:\BOINC\slots\1\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 00000000b6aa0000 00000000030a5000 D:\BOINC\slots\1\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 000000009b6f0000 000000001b3a4000 D:\BOINC\slots\1\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 0000000039780000 000000000020d000 D:\BOINC\slots\1\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 0000000017280000 00000000002db000 D:\BOINC\slots\1\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000005b5e0000 0000000000040000 D:\BOINC\slots\1\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000097990000 0000000003d5b000 D:\BOINC\slots\1\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 0000000068b50000 000000000919f000 D:\BOINC\slots\1\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000ed6b0000 0000000001eca000 D:\BOINC\slots\1\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 000000006d500000 0000000000031000 C:\WINDOWS\System32\IMM32.DLL (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 000000006ad40000 0000000000018000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.22000.71) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.22000.71 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.71

ModLoad: 00000000690b0000 0000000000038000 C:\WINDOWS\SYSTEM32\dxcore.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : DXCore.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 000000006de80000 000000000046c000 C:\WINDOWS\System32\Setupapi.dll (6.2.22000.469) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.22000.493 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.493

ModLoad: 000000006b870000 000000000002c000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 000000006b820000 000000000004c000 C:\WINDOWS\SYSTEM32\cfgmgr32.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 000000006bff0000 0000000000067000 C:\WINDOWS\System32\WINTRUST.dll (6.2.22000.469) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.22000.469 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.469

ModLoad: 000000006c360000 0000000000162000 C:\WINDOWS\System32\CRYPT32.dll (6.2.22000.348) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.22000.493 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.493

ModLoad: 000000006b410000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 000000006cc70000 00000000007ae000 C:\WINDOWS\System32\Shell32.dll (6.2.22000.469) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.22000.493 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.493

ModLoad: 0000000069cd0000 0000000000867000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.22000.469) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.22000.493 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.493

ModLoad: 000000006d690000 0000000000378000 C:\WINDOWS\System32\combase.dll (6.2.22000.282) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.22000.493 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.493

ModLoad: 0000000069920000 0000000000166000 C:\WINDOWS\SYSTEM32\wintypes.dll (6.2.22000.41) (-exported- Symbols Loaded)
    Linked PDB Filename   : WinTypes.pdb
    File Version          : 10.0.22000.493 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.493

ModLoad: 000000006c890000 00000000000ea000 C:\WINDOWS\System32\SHCORE.dll (6.2.22000.71) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.22000.493 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.493

ModLoad: 000000006cc10000 000000000005d000 C:\WINDOWS\System32\shlwapi.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.22000.493 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.493

ModLoad: 0000000016fb0000 00000000002cd000 C:\WINDOWS\system32\nvcuda.dll (30.0.15.1179) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_75\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 30.0.15.1179
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.6.110 driver
    Product Version       : 30.0.15.1179

ModLoad: 00000000f42f0000 00000000016a0000 C:\WINDOWS\system32\DriverStore\FileRepository\nvaei.inf_amd64_c89fa084d6c97dba\nvcuda64.dll (30.0.15.1179) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_75\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 30.0.15.1179
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.6.110 driver
    Product Version       : 30.0.15.1179

ModLoad: 0000000064d90000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000064900000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000062b00000 0000000000149000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.22000.120) (-exported- Symbols Loaded)
    Linked PDB Filename   : drvstore.pdb
    File Version          : 10.0.22000.120 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.120

ModLoad: 000000006b480000 000000000003d000 C:\WINDOWS\SYSTEM32\wldp.dll (6.2.22000.120) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.22000.493 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.493

ModLoad: 000000006b3b0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 000000005ea10000 0000000000768000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.15.1179) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_75\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 30.0.15.1179
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 30.0.15.1179

ModLoad: 000000006bf70000 000000000007f000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.22000.376) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.22000.376 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.376



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3613, Write: 307, Other 774

- I/O Transfers Counters -
Read: 6689712, Write: 6057, Other 30536

- Paged Pool Usage -
QuotaPagedPoolUsage: 3455432, QuotaPeakPagedPoolUsage: 3455432
QuotaNonPagedPoolUsage: 40760, QuotaPeakNonPagedPoolUsage: 40824

- Virtual Memory Usage -
VirtualSize: -1095806976, PeakVirtualSize: -502169600

- Pagefile Usage -
PagefileUsage: -1095806976, PeakPagefileUsage: -1095757824

- Working Set Size -
WorkingSetSize: 1221357568, PeakWorkingSetSize: 1221357568, PageFaultCount: 424597

*** Dump of thread ID 23060 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 5781250.000000, User Time: 14531250.000000, Wait Time: 33120044.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFF6BB9478C

- Registers -
rax=0000000000000001 rbx=0000000043124910 rcx=0000000000000000 rdx=00000000982e61d0 rsi=00000000982e6ab0 rdi=0000000019930520
r8=0000000000000000 r9=00000000cbc2e400 r10=00000000982e6210 r11=00000000982e6210 r12=00000000b73182e0 r13=00000000982e6cc0
r14=00000000d62aa730 r15=0000000000000000 rip=000000006bb9478c rsp=00000000982e6950 rbp=00000000982e6c40
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
982e6a20 4303a884 00000040 0000004f b7318300 0000026a KERNELBASE!RaiseException+0x0 
982e6a80 42de1ca6 000026a0 00000000 c56a75b8 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
982e6b30 42de593b 00000000 00000020 00000000 00000030 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
982e6c80 42de1a78 00000000 00000000 982e6fb0 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
982e6d50 42de1cfc 982e6fb0 00000000 00000080 982e7280 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
982e6e10 42dec4dd 982e7280 982e7280 982e7280 982e7280 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
982e7100 42ddb2fe 982e7718 982e7280 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
982ffea0 4301c6f8 eae1ccc0 00000000 00000000 ea752910 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
982ffee0 6dbd54e0 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
982fff10 6e66485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
982fff90 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 19200 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 33119872.000000

- Registers -
rax=00000000000001de rbx=00000000e9349e20 rcx=0000000000000074 rdx=00000000e9349aa0 rsi=00000000e9347670 rdi=00000000e9349e20
r8=0000000064d95004 r9=0000000000000000 r10=0000000064d900f0 r11=0000000000000001 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000006e707304 rsp=00000000983ff7d8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
983ff7d0 6e676c2f 00000000 00000000 e9347670 e9349e20 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
983ffac0 6dbd54e0 00000000 00000000 00000000 00000000 ntdll!EtwNotificationRegister+0x0 
983ffaf0 6e66485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
983ffb70 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 16380 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 33119872.000000

- Registers -
rax=00000000000001de rbx=00000000e934a2a0 rcx=0000000000000074 rdx=00000000e9349f20 rsi=00000000e9347670 rdi=00000000e934a2a0
r8=00000000984ff090 r9=0000000000000000 r10=00000000984ff1d6 r11=00000000984fee90 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000006e707304 rsp=00000000984ff908 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
984ff900 6e676c2f 00000000 00000000 e9347670 e934a2a0 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
984ffbf0 6dbd54e0 00000000 00000000 00000000 00000000 ntdll!EtwNotificationRegister+0x0 
984ffc20 6e66485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
984ffca0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 20716 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 33119872.000000

- Registers -
rax=00000000000001de rbx=00000000e934a640 rcx=0000000000000074 rdx=00000000e934a2c0 rsi=00000000e9347670 rdi=00000000e934a640
r8=0000000000000008 r9=0000000000000040 r10=0000000000000200 r11=000000001fdc252c r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000006e707304 rsp=00000000985ff7f8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
985ff7f0 6e676c2f 00000000 00000000 e9347670 e934a640 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
985ffae0 6dbd54e0 00000000 00000000 00000000 00000000 ntdll!EtwNotificationRegister+0x0 
985ffb10 6e66485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
985ffb90 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 17412 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 33120042.000000

- Registers -
rax=0000000000000034 rbx=00000000987ffd40 rcx=0000000000000000 rdx=00000000987ffd40 rsi=00000000980e9000 rdi=0000000000000000
r8=00000000987ff140 r9=00000000430787f0 r10=0000000000000fff r11=0000000000000ff0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000006e703dd4 rsp=00000000987ffc78 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
987ffc70 6e6bb5c3 00000000 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0 
987ffca0 6bb9b3a1 00000000 00000000 00000000 00000000 ntdll!RtlDelayExecution+0x0 
987ffd20 42dfa07f 00000000 00000000 fff0bdc0 00000000 KERNELBASE!SleepEx+0x0 
987ffd50 6dbd54e0 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
987ffd80 6e66485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
987ffe00 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 14136 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 33120044.000000

- Registers -
rax=000000000000005b rbx=0000000000000007 rcx=0000000000000007 rdx=00000000988ff8d0 rsi=0000000000000000 rdi=0000000000000007
r8=00000000988ff578 r9=0000000000000000 r10=0000000000000000 r11=00000000988ff840 r12=0000000000000064 r13=00000000988ff8d0
r14=00000000988ff5d0 r15=0000000000000000 rip=000000006e7042a4 rsp=00000000988ff578 rbp=00000000eb02d650
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
988ff570 6bb9fb10 00000000 00000000 00000000 00000000 ntdll!NtWaitForMultipleObjects+0x0 
988ff860 6bb9fa0e f483f1c8 eb1052d0 00000007 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
988ff8a0 f44cd554 eb0307d0 00000000 eb02ae30 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
988ffae0 f45758cd 00000000 eb02d650 00000000 00000000 nvcuda64!+0x0 
988ffb90 f44ccf23 ea123121 e9030010 eb600c00 00000000 nvcuda64!cuProfilerStop+0x0 
988ffbc0 f4804594 eb600c00 00000000 00000000 00000000 nvcuda64!+0x0 
988ffbf0 6dbd54e0 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
988ffc20 6e66485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
988ffca0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)