Task 14340712

Name ParityModified-1647040542-19054-3-0_1
Workunit 10900646
Created 4 Apr 2022, 6:13:55 UTC
Sent 4 Apr 2022, 7:23:43 UTC
Report deadline 12 Apr 2022, 7:23:43 UTC
Received 13 Apr 2022, 7:01:24 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 9526
Run time 2 hours 3 min 53 sec
CPU time 1 hours 19 min 33 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 1,867.07 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.62 GB
Peak swap size 3.58 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
23	                main:478]	:	INFO	:	    Batch Size: 128
[2022-04-07 13:23:23	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-04-07 13:23:23	                main:480]	:	INFO	:	    Patience: 10
[2022-04-07 13:23:23	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-04-07 13:23:23	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-04-07 13:23:23	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-04-07 13:23:23	                main:484]	:	INFO	:	    # Threads: 1
[2022-04-07 13:23:24	                main:486]	:	INFO	:	Preparing Dataset
[2022-04-07 13:23:24	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-07 13:23:24	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-07 13:23:26	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-04-07 13:23:26	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-07 13:23:26	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-07 13:23:26	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-04-07 13:23:26	                main:494]	:	INFO	:	Creating Model
[2022-04-07 13:23:26	                main:507]	:	INFO	:	Preparing config file
[2022-04-07 13:23:26	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-04-07 13:23:26	                main:512]	:	INFO	:	Loading config
[2022-04-07 13:23:27	                main:514]	:	INFO	:	Loading state
[2022-04-07 13:23:28	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2022-04-07 13:23:28	                main:562]	:	INFO	:	Starting Training
[2022-04-07 13:23:34	                main:574]	:	INFO	:	Epoch 1011 | loss: 0.0311185 | val_loss: 0.0311081 | Time: 5876.92 ms
[2022-04-07 13:23:40	                main:574]	:	INFO	:	Epoch 1012 | loss: 0.0310654 | val_loss: 0.0311059 | Time: 5672.43 ms
[2022-04-07 13:23:45	                main:574]	:	INFO	:	Epoch 1013 | loss: 0.0310606 | val_loss: 0.0311039 | Time: 5513.18 ms
[2022-04-07 13:23:51	                main:574]	:	INFO	:	Epoch 1014 | loss: 0.0310571 | val_loss: 0.0311059 | Time: 5608.45 ms
[2022-04-07 13:23:57	                main:574]	:	INFO	:	Epoch 1015 | loss: 0.0310551 | val_loss: 0.0311097 | Time: 5559.15 ms
[2022-04-07 13:24:02	                main:574]	:	INFO	:	Epoch 1016 | loss: 0.0310549 | val_loss: 0.0311028 | Time: 5167.18 ms
[2022-04-07 13:24:07	                main:574]	:	INFO	:	Epoch 1017 | loss: 0.031056 | val_loss: 0.0311064 | Time: 4595.45 ms
[2022-04-07 13:24:12	                main:574]	:	INFO	:	Epoch 1018 | loss: 0.0310561 | val_loss: 0.031117 | Time: 4605.22 ms
[2022-04-07 13:24:17	                main:574]	:	INFO	:	Epoch 1019 | loss: 0.031062 | val_loss: 0.0311086 | Time: 4914.51 ms
[2022-04-07 13:24:22	                main:574]	:	INFO	:	Epoch 1020 | loss: 0.0310635 | val_loss: 0.0311007 | Time: 5114.11 ms
[2022-04-07 13:24:28	                main:574]	:	INFO	:	Epoch 1021 | loss: 0.031061 | val_loss: 0.0311097 | Time: 5563.97 ms
[2022-04-07 13:24:34	                main:574]	:	INFO	:	Epoch 1022 | loss: 0.0310579 | val_loss: 0.0311058 | Time: 5663 ms
[2022-04-07 13:24:40	                main:574]	:	INFO	:	Epoch 1023 | loss: 0.0310574 | val_loss: 0.0311108 | Time: 5719.26 ms
[2022-04-07 13:24:45	                main:574]	:	INFO	:	Epoch 1024 | loss: 0.0310537 | val_loss: 0.031103 | Time: 5581.07 ms
[2022-04-07 13:24:51	                main:574]	:	INFO	:	Epoch 1025 | loss: 0.0310492 | val_loss: 0.0311036 | Time: 5353.28 ms
[2022-04-07 13:24:57	                main:574]	:	INFO	:	Epoch 1026 | loss: 0.0310503 | val_loss: 0.0311072 | Time: 5623.74 ms
[2022-04-07 13:25:02	                main:574]	:	INFO	:	Epoch 1027 | loss: 0.0310493 | val_loss: 0.0311121 | Time: 5287.33 ms
[2022-04-07 13:25:08	                main:574]	:	INFO	:	Epoch 1028 | loss: 0.0310537 | val_loss: 0.0311053 | Time: 5738.7 ms
[2022-04-07 13:25:13	                main:574]	:	INFO	:	Epoch 1029 | loss: 0.0310632 | val_loss: 0.0311031 | Time: 5272.29 ms
[2022-04-07 13:25:19	                main:574]	:	INFO	:	Epoch 1030 | loss: 0.0310592 | val_loss: 0.0311046 | Time: 5296.13 ms
[2022-04-07 13:25:24	                main:574]	:	INFO	:	Epoch 1031 | loss: 0.0310595 | val_loss: 0.0311134 | Time: 5534.57 ms
[2022-04-07 13:25:30	                main:574]	:	INFO	:	Epoch 1032 | loss: 0.0310579 | val_loss: 0.0311114 | Time: 5604.73 ms
[2022-04-07 13:25:36	                main:574]	:	INFO	:	Epoch 1033 | loss: 0.0310535 | val_loss: 0.031108 | Time: 5318.57 ms
[2022-04-07 13:25:41	                main:574]	:	INFO	:	Epoch 1034 | loss: 0.0310501 | val_loss: 0.0311128 | Time: 5580.31 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050)
[2022-04-08 09:07:09	                main:435]	:	INFO	:	Set logging level to 1
[2022-04-08 09:07:09	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-04-08 09:07:10	                main:444]	:	INFO	:	Resolving all filenames
[2022-04-08 09:07:10	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-08 09:07:10	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-08 09:07:10	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-08 09:07:10	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-08 09:07:10	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-08 09:07:10	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-04-08 09:07:11	                main:474]	:	INFO	:	Configuration: 
[2022-04-08 09:07:11	                main:475]	:	INFO	:	    Model type: GRU
[2022-04-08 09:07:11	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-04-08 09:07:11	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-04-08 09:07:11	                main:478]	:	INFO	:	    Batch Size: 128
[2022-04-08 09:07:11	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-04-08 09:07:12	                main:480]	:	INFO	:	    Patience: 10
[2022-04-08 09:07:12	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-04-08 09:07:12	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-04-08 09:07:12	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-04-08 09:07:12	                main:484]	:	INFO	:	    # Threads: 1
[2022-04-08 09:07:12	                main:486]	:	INFO	:	Preparing Dataset
[2022-04-08 09:07:12	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-08 09:07:13	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-08 09:07:23	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-04-08 09:07:23	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-08 09:07:24	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-08 09:07:24	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-04-08 09:07:24	                main:494]	:	INFO	:	Creating Model
[2022-04-08 09:07:25	                main:507]	:	INFO	:	Preparing config file
[2022-04-08 09:07:25	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-04-08 09:07:25	                main:512]	:	INFO	:	Loading config
[2022-04-08 09:07:25	                main:514]	:	INFO	:	Loading state
[2022-04-08 09:07:36	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2022-04-08 09:07:36	                main:562]	:	INFO	:	Starting Training
[2022-04-08 09:08:04	                main:574]	:	INFO	:	Epoch 1035 | loss: 0.0311621 | val_loss: 0.0311562 | Time: 28274.5 ms
[2022-04-08 09:08:10	                main:574]	:	INFO	:	Epoch 1036 | loss: 0.0310679 | val_loss: 0.0311082 | Time: 5627.54 ms
[2022-04-08 09:08:16	                main:574]	:	INFO	:	Epoch 1037 | loss: 0.0310583 | val_loss: 0.0311103 | Time: 5662.46 ms
[2022-04-08 09:08:22	                main:574]	:	INFO	:	Epoch 1038 | loss: 0.0310528 | val_loss: 0.0311119 | Time: 5677.37 ms
[2022-04-08 09:08:28	                main:574]	:	INFO	:	Epoch 1039 | loss: 0.0310628 | val_loss: 0.0311084 | Time: 5770.18 ms
[2022-04-08 09:08:34	                main:574]	:	INFO	:	Epoch 1040 | loss: 0.0310758 | val_loss: 0.0311129 | Time: 5568.71 ms
[2022-04-08 09:08:40	                main:574]	:	INFO	:	Epoch 1041 | loss: 0.0310764 | val_loss: 0.0311116 | Time: 5551.16 ms
[2022-04-08 09:08:45	                main:574]	:	INFO	:	Epoch 1042 | loss: 0.0310696 | val_loss: 0.0311095 | Time: 5629.87 ms
[2022-04-08 09:08:51	                main:574]	:	INFO	:	Epoch 1043 | loss: 0.031062 | val_loss: 0.0311082 | Time: 5090.67 ms
[2022-04-08 09:08:56	                main:574]	:	INFO	:	Epoch 1044 | loss: 0.0310652 | val_loss: 0.0311131 | Time: 5000.89 ms
[2022-04-08 09:09:02	                main:574]	:	INFO	:	Epoch 1045 | loss: 0.03107 | val_loss: 0.0311059 | Time: 5340.92 ms
[2022-04-08 09:09:08	                main:574]	:	INFO	:	Epoch 1046 | loss: 0.031064 | val_loss: 0.0311093 | Time: 5630.26 ms
[2022-04-08 09:09:14	                main:574]	:	INFO	:	Epoch 1047 | loss: 0.0310658 | val_loss: 0.031106 | Time: 5509.56 ms
[2022-04-08 09:09:20	                main:574]	:	INFO	:	Epoch 1048 | loss: 0.0310569 | val_loss: 0.0311017 | Time: 5610.18 ms
[2022-04-08 09:09:27	                main:574]	:	INFO	:	Epoch 1049 | loss: 0.0310552 | val_loss: 0.0311069 | Time: 7291.08 ms
[2022-04-08 09:09:33	                main:574]	:	INFO	:	Epoch 1050 | loss: 0.0310522 | val_loss: 0.0311031 | Time: 5649.93 ms
[2022-04-08 09:09:39	                main:574]	:	INFO	:	Epoch 1051 | loss: 0.0310507 | val_loss: 0.0311024 | Time: 5691.77 ms
[2022-04-08 09:09:45	                main:574]	:	INFO	:	Epoch 1052 | loss: 0.0310509 | val_loss: 0.0311071 | Time: 5782.13 ms
[2022-04-08 09:09:51	                main:574]	:	INFO	:	Epoch 1053 | loss: 0.0310511 | val_loss: 0.0311062 | Time: 5448.61 ms
[2022-04-08 09:09:57	                main:574]	:	INFO	:	Epoch 1054 | loss: 0.0310498 | val_loss: 0.0311089 | Time: 5539 ms
[2022-04-08 09:10:03	                main:574]	:	INFO	:	Epoch 1055 | loss: 0.0310502 | val_loss: 0.0311101 | Time: 5757.94 ms
[2022-04-08 09:10:09	                main:574]	:	INFO	:	Epoch 1056 | loss: 0.0310491 | val_loss: 0.0311117 | Time: 5920.1 ms
[2022-04-08 09:10:14	                main:574]	:	INFO	:	Epoch 1057 | loss: 0.0310471 | val_loss: 0.0311047 | Time: 5666.05 ms
[2022-04-08 09:10:21	                main:574]	:	INFO	:	Epoch 1058 | loss: 0.031046 | val_loss: 0.0311038 | Time: 6060.74 ms
[2022-04-08 09:10:26	                main:574]	:	INFO	:	Epoch 1059 | loss: 0.0310462 | val_loss: 0.0311086 | Time: 5758.23 ms
[2022-04-08 09:10:32	                main:574]	:	INFO	:	Epoch 1060 | loss: 0.0310459 | val_loss: 0.0311028 | Time: 5896.23 ms
[2022-04-08 09:10:38	                main:574]	:	INFO	:	Epoch 1061 | loss: 0.0310459 | val_loss: 0.0311093 | Time: 5911 ms
[2022-04-08 09:10:44	                main:574]	:	INFO	:	Epoch 1062 | loss: 0.0310483 | val_loss: 0.0311056 | Time: 6035.45 ms
[2022-04-08 09:10:50	                main:574]	:	INFO	:	Epoch 1063 | loss: 0.0310495 | val_loss: 0.0311085 | Time: 5129.65 ms
[2022-04-08 09:10:55	                main:574]	:	INFO	:	Epoch 1064 | loss: 0.0310479 | val_loss: 0.0311148 | Time: 5727.64 ms
[2022-04-08 09:11:01	                main:574]	:	INFO	:	Epoch 1065 | loss: 0.0310482 | val_loss: 0.0311079 | Time: 5637.23 ms
[2022-04-08 09:11:07	                main:574]	:	INFO	:	Epoch 1066 | loss: 0.0310454 | val_loss: 0.0311047 | Time: 5694.12 ms
[2022-04-08 09:11:13	                main:574]	:	INFO	:	Epoch 1067 | loss: 0.0310492 | val_loss: 0.0311056 | Time: 5947.1 ms
[2022-04-08 09:11:19	                main:574]	:	INFO	:	Epoch 1068 | loss: 0.0310552 | val_loss: 0.031104 | Time: 5878.73 ms
[2022-04-08 09:11:25	                main:574]	:	INFO	:	Epoch 1069 | loss: 0.0310562 | val_loss: 0.031106 | Time: 5868.39 ms
[2022-04-08 09:11:31	                main:574]	:	INFO	:	Epoch 1070 | loss: 0.0310479 | val_loss: 0.0311089 | Time: 5613.66 ms
[2022-04-08 09:11:37	                main:574]	:	INFO	:	Epoch 1071 | loss: 0.0310458 | val_loss: 0.0311036 | Time: 5655.02 ms
[2022-04-08 09:11:42	                main:574]	:	INFO	:	Epoch 1072 | loss: 0.0310528 | val_loss: 0.0311064 | Time: 5304.25 ms
[2022-04-08 09:11:49	                main:574]	:	INFO	:	Epoch 1073 | loss: 0.0310509 | val_loss: 0.0311136 | Time: 6086.45 ms
[2022-04-08 09:11:54	                main:574]	:	INFO	:	Epoch 1074 | loss: 0.031046 | val_loss: 0.0311114 | Time: 5470.78 ms
[2022-04-08 09:12:00	                main:574]	:	INFO	:	Epoch 1075 | loss: 0.0310429 | val_loss: 0.0311078 | Time: 5677.72 ms
[2022-04-08 09:12:06	                main:574]	:	INFO	:	Epoch 1076 | loss: 0.0310442 | val_loss: 0.0311079 | Time: 5909.97 ms
[2022-04-08 09:12:12	                main:574]	:	INFO	:	Epoch 1077 | loss: 0.0310588 | val_loss: 0.03111 | Time: 5870 ms
[2022-04-08 09:12:18	                main:574]	:	INFO	:	Epoch 1078 | loss: 0.0310554 | val_loss: 0.0311056 | Time: 5715.71 ms
[2022-04-08 09:12:24	                main:574]	:	INFO	:	Epoch 1079 | loss: 0.0310707 | val_loss: 0.0311161 | Time: 5907.65 ms
[2022-04-08 09:12:29	                main:574]	:	INFO	:	Epoch 1080 | loss: 0.0310879 | val_loss: 0.0311196 | Time: 5697.51 ms
[2022-04-08 09:12:35	                main:574]	:	INFO	:	Epoch 1081 | loss: 0.031091 | val_loss: 0.0311254 | Time: 5882.63 ms
[2022-04-08 09:12:42	                main:574]	:	INFO	:	Epoch 1082 | loss: 0.0310912 | val_loss: 0.0311206 | Time: 5943.89 ms
[2022-04-08 09:12:48	                main:574]	:	INFO	:	Epoch 1083 | loss: 0.0310897 | val_loss: 0.0311239 | Time: 5642.79 ms
[2022-04-08 09:12:55	                main:574]	:	INFO	:	Epoch 1084 | loss: 0.0310895 | val_loss: 0.0311238 | Time: 5658.05 ms
[2022-04-08 09:13:01	                main:574]	:	INFO	:	Epoch 1085 | loss: 0.0310904 | val_loss: 0.0311241 | Time: 5679.85 ms
[2022-04-08 09:13:08	                main:574]	:	INFO	:	Epoch 1086 | loss: 0.031091 | val_loss: 0.0311241 | Time: 5605.1 ms
[2022-04-08 09:13:14	                main:574]	:	INFO	:	Epoch 1087 | loss: 0.0310893 | val_loss: 0.0311233 | Time: 5766.15 ms
[2022-04-08 09:13:20	                main:574]	:	INFO	:	Epoch 1088 | loss: 0.0310888 | val_loss: 0.031127 | Time: 5445.4 ms
[2022-04-08 09:13:27	                main:574]	:	INFO	:	Epoch 1089 | loss: 0.0310895 | val_loss: 0.0311242 | Time: 5657.46 ms
[2022-04-08 09:13:33	                main:574]	:	INFO	:	Epoch 1090 | loss: 0.0310891 | val_loss: 0.0311251 | Time: 5827.76 ms
[2022-04-08 09:13:39	                main:574]	:	INFO	:	Epoch 1091 | loss: 0.0310894 | val_loss: 0.0311223 | Time: 5739.16 ms
[2022-04-08 09:13:45	                main:574]	:	INFO	:	Epoch 1092 | loss: 0.0310886 | val_loss: 0.0311231 | Time: 5608.34 ms
[2022-04-08 09:13:51	                main:574]	:	INFO	:	Epoch 1093 | loss: 0.0310886 | val_loss: 0.0311227 | Time: 5627.85 ms
[2022-04-08 09:13:57	                main:574]	:	INFO	:	Epoch 1094 | loss: 0.0310903 | val_loss: 0.0311277 | Time: 5845.95 ms
[2022-04-08 09:14:04	                main:574]	:	INFO	:	Epoch 1095 | loss: 0.0310897 | val_loss: 0.0311229 | Time: 6089.44 ms
[2022-04-08 09:14:10	                main:574]	:	INFO	:	Epoch 1096 | loss: 0.0310889 | val_loss: 0.0311209 | Time: 5675.77 ms
[2022-04-08 09:14:16	                main:574]	:	INFO	:	Epoch 1097 | loss: 0.0310886 | val_loss: 0.031125 | Time: 5684.43 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050)
[2022-04-11 08:31:05	                main:435]	:	INFO	:	Set logging level to 1
[2022-04-11 08:31:06	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-04-11 08:31:07	                main:444]	:	INFO	:	Resolving all filenames
[2022-04-11 08:31:08	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-11 08:31:08	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-11 08:31:08	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-11 08:31:09	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-11 08:31:09	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-11 08:31:09	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-04-11 08:31:09	                main:474]	:	INFO	:	Configuration: 
[2022-04-11 08:31:09	                main:475]	:	INFO	:	    Model type: GRU
[2022-04-11 08:31:10	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-04-11 08:31:10	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-04-11 08:31:10	                main:478]	:	INFO	:	    Batch Size: 128
[2022-04-11 08:31:10	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-04-11 08:31:10	                main:480]	:	INFO	:	    Patience: 10
[2022-04-11 08:31:10	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-04-11 08:31:10	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-04-11 08:31:11	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-04-11 08:31:11	                main:484]	:	INFO	:	    # Threads: 1
[2022-04-11 08:31:11	                main:486]	:	INFO	:	Preparing Dataset
[2022-04-11 08:31:11	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-11 08:31:11	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-11 08:32:53	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-04-11 08:32:54	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-11 08:32:56	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-11 08:32:56	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-04-11 08:32:57	                main:494]	:	INFO	:	Creating Model
[2022-04-11 08:33:02	                main:507]	:	INFO	:	Preparing config file
[2022-04-11 08:33:02	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-04-11 08:33:02	                main:512]	:	INFO	:	Loading config
[2022-04-11 08:33:03	                main:514]	:	INFO	:	Loading state
[2022-04-11 08:33:55	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2022-04-11 08:33:55	                main:562]	:	INFO	:	Starting Training
[2022-04-11 08:34:05	                main:574]	:	INFO	:	Epoch 1095 | loss: 0.0311357 | val_loss: 0.0311256 | Time: 9450.14 ms
[2022-04-11 08:34:10	                main:574]	:	INFO	:	Epoch 1096 | loss: 0.0310739 | val_loss: 0.0311098 | Time: 5380.76 ms
[2022-04-11 08:34:16	                main:574]	:	INFO	:	Epoch 1097 | loss: 0.0310631 | val_loss: 0.0311089 | Time: 4935.73 ms
[2022-04-11 08:34:21	                main:574]	:	INFO	:	Epoch 1098 | loss: 0.0310572 | val_loss: 0.0311142 | Time: 5181.42 ms
[2022-04-11 08:34:27	                main:574]	:	INFO	:	Epoch 1099 | loss: 0.0310539 | val_loss: 0.0311084 | Time: 5674.28 ms
[2022-04-11 08:34:33	                main:574]	:	INFO	:	Epoch 1100 | loss: 0.031055 | val_loss: 0.0311072 | Time: 5773.05 ms
[2022-04-11 08:34:38	                main:574]	:	INFO	:	Epoch 1101 | loss: 0.0310525 | val_loss: 0.0311119 | Time: 4598.54 ms
[2022-04-11 08:34:43	                main:574]	:	INFO	:	Epoch 1102 | loss: 0.0310502 | val_loss: 0.0311135 | Time: 4943.65 ms
[2022-04-11 08:34:49	                main:574]	:	INFO	:	Epoch 1103 | loss: 0.0310501 | val_loss: 0.0311105 | Time: 4845.57 ms
[2022-04-11 08:34:55	                main:574]	:	INFO	:	Epoch 1104 | loss: 0.0310477 | val_loss: 0.0311055 | Time: 4974.12 ms
[2022-04-11 08:35:01	                main:574]	:	INFO	:	Epoch 1105 | loss: 0.0310471 | val_loss: 0.0311118 | Time: 5920.4 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050)
[2022-04-12 18:09:10	                main:435]	:	INFO	:	Set logging level to 1
[2022-04-12 18:09:10	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-04-12 18:09:10	                main:444]	:	INFO	:	Resolving all filenames
[2022-04-12 18:09:10	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-12 18:09:10	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-12 18:09:10	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-12 18:09:10	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-12 18:09:10	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-12 18:09:10	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-04-12 18:09:10	                main:474]	:	INFO	:	Configuration: 
[2022-04-12 18:09:10	                main:475]	:	INFO	:	    Model type: GRU
[2022-04-12 18:09:11	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-04-12 18:09:11	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-04-12 18:09:11	                main:478]	:	INFO	:	    Batch Size: 128
[2022-04-12 18:09:11	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-04-12 18:09:11	                main:480]	:	INFO	:	    Patience: 10
[2022-04-12 18:09:11	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-04-12 18:09:11	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-04-12 18:09:11	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-04-12 18:09:11	                main:484]	:	INFO	:	    # Threads: 1
[2022-04-12 18:09:11	                main:486]	:	INFO	:	Preparing Dataset
[2022-04-12 18:09:11	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-12 18:09:12	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-12 18:09:14	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-04-12 18:09:14	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-12 18:09:14	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-12 18:09:14	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-04-12 18:09:14	                main:494]	:	INFO	:	Creating Model
[2022-04-12 18:09:14	                main:507]	:	INFO	:	Preparing config file
[2022-04-12 18:09:14	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-04-12 18:09:14	                main:512]	:	INFO	:	Loading config
[2022-04-12 18:09:15	                main:514]	:	INFO	:	Loading state
[2022-04-12 18:09:16	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2022-04-12 18:09:16	                main:562]	:	INFO	:	Starting Training
[2022-04-12 18:09:27	                main:574]	:	INFO	:	Epoch 1096 | loss: 0.0311532 | val_loss: 0.031136 | Time: 10830.8 ms
[2022-04-12 18:09:32	                main:574]	:	INFO	:	Epoch 1097 | loss: 0.0310795 | val_loss: 0.03111 | Time: 5536.06 ms
[2022-04-12 18:09:38	                main:574]	:	INFO	:	Epoch 1098 | loss: 0.0310608 | val_loss: 0.0311122 | Time: 5692.22 ms
[2022-04-12 18:09:44	                main:574]	:	INFO	:	Epoch 1099 | loss: 0.031057 | val_loss: 0.0311078 | Time: 5891.99 ms
[2022-04-12 18:09:49	                main:574]	:	INFO	:	Epoch 1100 | loss: 0.0310519 | val_loss: 0.0311128 | Time: 5053.54 ms
[2022-04-12 18:09:54	                main:574]	:	INFO	:	Epoch 1101 | loss: 0.0310522 | val_loss: 0.0311103 | Time: 4569.24 ms
[2022-04-12 18:09:59	                main:574]	:	INFO	:	Epoch 1102 | loss: 0.03106 | val_loss: 0.0311086 | Time: 4577.99 ms
[2022-04-12 18:10:05	                main:574]	:	INFO	:	Epoch 1103 | loss: 0.0310605 | val_loss: 0.0311129 | Time: 5456.83 ms
[2022-04-12 18:10:11	                main:574]	:	INFO	:	Epoch 1104 | loss: 0.0310577 | val_loss: 0.031104 | Time: 6088.77 ms
[2022-04-12 18:10:17	                main:574]	:	INFO	:	Epoch 1105 | loss: 0.0310573 | val_loss: 0.0311156 | Time: 5684.53 ms
[2022-04-12 18:10:24	                main:574]	:	INFO	:	Epoch 1106 | loss: 0.0310635 | val_loss: 0.0311084 | Time: 6002.7 ms
[2022-04-12 18:10:32	                main:574]	:	INFO	:	Epoch 1107 | loss: 0.03106 | val_loss: 0.031106 | Time: 6634.83 ms
[2022-04-12 18:10:39	                main:574]	:	INFO	:	Epoch 1108 | loss: 0.0310563 | val_loss: 0.031105 | Time: 6384.17 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050)
[2022-04-13 08:27:49	                main:435]	:	INFO	:	Set logging level to 1
[2022-04-13 08:27:50	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-04-13 08:27:50	                main:444]	:	INFO	:	Resolving all filenames
[2022-04-13 08:27:51	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-13 08:27:51	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-13 08:27:51	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-13 08:27:52	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-13 08:27:52	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-13 08:27:53	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-04-13 08:27:53	                main:474]	:	INFO	:	Configuration: 
[2022-04-13 08:27:53	                main:475]	:	INFO	:	    Model type: GRU
[2022-04-13 08:27:53	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-04-13 08:27:54	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-04-13 08:27:54	                main:478]	:	INFO	:	    Batch Size: 128
[2022-04-13 08:27:54	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-04-13 08:27:55	                main:480]	:	INFO	:	    Patience: 10
[2022-04-13 08:27:55	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-04-13 08:27:56	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-04-13 08:27:56	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-04-13 08:27:57	                main:484]	:	INFO	:	    # Threads: 1
[2022-04-13 08:27:57	                main:486]	:	INFO	:	Preparing Dataset
[2022-04-13 08:27:57	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-13 08:27:58	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-13 08:28:16	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-04-13 08:28:16	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-13 08:28:17	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-13 08:28:18	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-04-13 08:28:18	                main:494]	:	INFO	:	Creating Model
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050)
[2022-04-13 08:31:29	                main:435]	:	INFO	:	Set logging level to 1
[2022-04-13 08:31:29	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-04-13 08:31:29	                main:444]	:	INFO	:	Resolving all filenames
[2022-04-13 08:31:30	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-13 08:31:30	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-13 08:31:31	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-13 08:31:31	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-13 08:31:32	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-13 08:31:33	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-04-13 08:31:34	                main:474]	:	INFO	:	Configuration: 
[2022-04-13 08:31:35	                main:475]	:	INFO	:	    Model type: GRU
[2022-04-13 08:31:35	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-04-13 08:31:35	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-04-13 08:31:35	                main:478]	:	INFO	:	    Batch Size: 128
[2022-04-13 08:31:36	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-04-13 08:31:36	                main:480]	:	INFO	:	    Patience: 10
[2022-04-13 08:31:36	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-04-13 08:31:36	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-04-13 08:31:36	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-04-13 08:31:37	                main:484]	:	INFO	:	    # Threads: 1
[2022-04-13 08:31:37	                main:486]	:	INFO	:	Preparing Dataset
[2022-04-13 08:31:37	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-13 08:31:38	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-13 08:31:41	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-04-13 08:31:44	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-13 08:31:44	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-13 08:31:45	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-04-13 08:31:45	                main:494]	:	INFO	:	Creating Model
[2022-04-13 08:31:46	                main:507]	:	INFO	:	Preparing config file
[2022-04-13 08:31:47	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-04-13 08:31:48	                main:512]	:	INFO	:	Loading config
[2022-04-13 08:31:48	                main:514]	:	INFO	:	Loading state
[2022-04-13 08:32:32	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2022-04-13 08:32:33	                main:562]	:	INFO	:	Starting Training
[2022-04-13 08:33:31	                main:574]	:	INFO	:	Epoch 1106 | loss: nan | val_loss: nan | Time: 57202.7 ms
[2022-04-13 08:33:37	                main:574]	:	INFO	:	Epoch 1107 | loss: nan | val_loss: nan | Time: 5094.9 ms
[2022-04-13 08:33:42	                main:574]	:	INFO	:	Epoch 1108 | loss: nan | val_loss: nan | Time: 5110.53 ms
[2022-04-13 08:33:48	                main:574]	:	INFO	:	Epoch 1109 | loss: nan | val_loss: nan | Time: 5581.33 ms
[2022-04-13 08:33:55	                main:574]	:	INFO	:	Epoch 1110 | loss: nan | val_loss: nan | Time: 5390.81 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1050)
[2022-04-13 08:59:06	                main:435]	:	INFO	:	Set logging level to 1
[2022-04-13 08:59:07	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-04-13 08:59:07	                main:444]	:	INFO	:	Resolving all filenames
[2022-04-13 08:59:08	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-13 08:59:09	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-13 08:59:10	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-13 08:59:11	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-13 08:59:12	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-13 08:59:13	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-04-13 08:59:14	                main:474]	:	INFO	:	Configuration: 
[2022-04-13 08:59:15	                main:475]	:	INFO	:	    Model type: GRU
[2022-04-13 08:59:16	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-04-13 08:59:17	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-04-13 08:59:18	                main:478]	:	INFO	:	    Batch Size: 128
[2022-04-13 08:59:18	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-04-13 08:59:19	                main:480]	:	INFO	:	    Patience: 10
[2022-04-13 08:59:20	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-04-13 08:59:20	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-04-13 08:59:20	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-04-13 08:59:21	                main:484]	:	INFO	:	    # Threads: 1
[2022-04-13 08:59:21	                main:486]	:	INFO	:	Preparing Dataset
[2022-04-13 08:59:22	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-13 08:59:26	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-13 08:59:30	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-04-13 08:59:30	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-13 08:59:33	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-13 08:59:34	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-04-13 08:59:34	                main:494]	:	INFO	:	Creating Model
[2022-04-13 08:59:34	                main:507]	:	INFO	:	Preparing config file
[2022-04-13 08:59:35	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2022-04-13 08:59:35	                main:512]	:	INFO	:	Loading config


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FF9990B466C

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 04/13/22 08:59:35
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\6;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 00000000c8ab0000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000009bb80000 0000000000209000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.22000.527) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.22000.556 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.556

ModLoad: 000000009afc0000 00000000000bd000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.22000.434) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.22000.556 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.556

ModLoad: 0000000099070000 0000000000374000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.22000.593) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.22000.556 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.556

ModLoad: 000000009b490000 00000000001ac000 C:\WINDOWS\System32\USER32.dll (6.2.22000.282) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.22000.556 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.556

ModLoad: 0000000099760000 0000000000026000 C:\WINDOWS\System32\win32u.dll (6.2.22000.593) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.22000.593 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.593

ModLoad: 000000009bb10000 0000000000029000 C:\WINDOWS\System32\GDI32.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000099790000 0000000000112000 C:\WINDOWS\System32\gdi32full.dll (6.2.22000.527) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.22000.527 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.527

ModLoad: 0000000099510000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000993f0000 0000000000111000 C:\WINDOWS\System32\ucrtbase.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000099a20000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.22000.434) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.22000.556 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.556

ModLoad: 000000009aa10000 00000000000a3000 C:\WINDOWS\System32\msvcrt.dll (7.0.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.22000.1

ModLoad: 0000000099ad0000 000000000009e000 C:\WINDOWS\System32\sechost.dll (6.2.22000.556) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 000000009b870000 0000000000120000 C:\WINDOWS\System32\RPCRT4.dll (6.2.22000.434) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.22000.556 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.556

ModLoad: 00000000718d0000 0000000000058000 C:\ProgramData\BOINC\slots\6\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000088200000 0000000000099000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.24.28127.4) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.24.28127.4 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.24.28127.4

ModLoad: 000000008cda0000 0000000000221000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000881e0000 0000000000017000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.24.28127.4) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.24.28127.4 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.24.28127.4

ModLoad: 0000000095e70000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.24.28127.4) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.24.28127.4 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.24.28127.4

ModLoad: 0000000021eb0000 000000000abe7000 C:\ProgramData\BOINC\slots\6\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000004c610000 000000000020d000 C:\ProgramData\BOINC\slots\6\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 00000000fd360000 0000000024b49000 C:\ProgramData\BOINC\slots\6\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000fa2b0000 00000000030a5000 C:\ProgramData\BOINC\slots\6\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 00000000f6df0000 00000000034b2000 C:\ProgramData\BOINC\slots\6\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000dba40000 000000001b3a4000 C:\ProgramData\BOINC\slots\6\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 00000000953e0000 0000000000010000 C:\ProgramData\BOINC\slots\6\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 00000000d28a0000 000000000919f000 C:\ProgramData\BOINC\slots\6\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000ceb40000 0000000003d5b000 C:\ProgramData\BOINC\slots\6\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000ccc70000 0000000001eca000 C:\ProgramData\BOINC\slots\6\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 0000000065610000 0000000000045000 C:\ProgramData\BOINC\slots\6\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000003ed60000 00000000002db000 C:\ProgramData\BOINC\slots\6\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000068190000 0000000000040000 C:\ProgramData\BOINC\slots\6\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000009ae60000 0000000000031000 C:\WINDOWS\System32\IMM32.DLL (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000098170000 0000000000018000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.22000.71) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.22000.71 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.71

ModLoad: 0000000096890000 0000000000038000 C:\WINDOWS\SYSTEM32\dxcore.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : DXCore.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 000000009a5a0000 000000000046c000 C:\WINDOWS\System32\Setupapi.dll (6.2.22000.469) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.22000.556 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.556

ModLoad: 0000000098db0000 000000000002c000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000098d60000 000000000004c000 C:\WINDOWS\SYSTEM32\cfgmgr32.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000099630000 0000000000067000 C:\WINDOWS\System32\WINTRUST.dll (6.2.22000.527) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.22000.527 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.527

ModLoad: 00000000998b0000 0000000000162000 C:\WINDOWS\System32\CRYPT32.dll (6.2.22000.348) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.22000.556 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.556

ModLoad: 00000000988b0000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000099b70000 00000000007af000 C:\WINDOWS\System32\Shell32.dll (6.2.22000.593) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.22000.593 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.593

ModLoad: 00000000971a0000 0000000000868000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.22000.593) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.22000.556 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.556

ModLoad: 000000009b110000 0000000000378000 C:\WINDOWS\System32\combase.dll (6.2.22000.527) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.22000.556 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.556

ModLoad: 0000000097030000 0000000000166000 C:\WINDOWS\SYSTEM32\wintypes.dll (6.2.22000.527) (-exported- Symbols Loaded)
    Linked PDB Filename   : WinTypes.pdb
    File Version          : 10.0.22000.556 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.556

ModLoad: 000000009ad50000 00000000000ea000 C:\WINDOWS\System32\SHCORE.dll (6.2.22000.71) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.22000.556 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.556

ModLoad: 000000009b990000 000000000005d000 C:\WINDOWS\System32\shlwapi.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.22000.556 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.556

ModLoad: 000000003ce20000 00000000002cd000 C:\WINDOWS\system32\nvcuda.dll (30.0.15.1165) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_37\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 30.0.15.1165
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.6.99 driver
    Product Version       : 30.0.15.1165

ModLoad: 00000000cb5d0000 00000000016a0000 C:\WINDOWS\system32\DriverStore\FileRepository\nvhdc.inf_amd64_d11413f6fd8fe259\nvcuda64.dll (30.0.15.1165) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_37\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 30.0.15.1165
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.6.99 driver
    Product Version       : 30.0.15.1165

ModLoad: 0000000095c60000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 000000008fa20000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 00000000883d0000 0000000000149000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.22000.120) (-exported- Symbols Loaded)
    Linked PDB Filename   : drvstore.pdb
    File Version          : 10.0.22000.120 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.120

ModLoad: 0000000098930000 000000000003d000 C:\WINDOWS\SYSTEM32\wldp.dll (6.2.22000.120) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.22000.556 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Sistema operativo Microsoft&#174; Windows&#174;
    Product Version       : 10.0.22000.556

ModLoad: 0000000098870000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.22000.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.22000.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.1

ModLoad: 0000000081960000 0000000000768000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.15.1165) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_37\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 30.0.15.1165
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 30.0.15.1165

ModLoad: 00000000995b0000 000000000007f000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.22000.376) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.22000.376 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.22000.376



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3618, Write: 308, Other 771

- I/O Transfers Counters -
Read: 6723383, Write: 6051, Other 28464

- Paged Pool Usage -
QuotaPagedPoolUsage: 3444160, QuotaPeakPagedPoolUsage: 3444208
QuotaNonPagedPoolUsage: 38832, QuotaPeakNonPagedPoolUsage: 38832

- Virtual Memory Usage -
VirtualSize: -1456111616, PeakVirtualSize: -862220288

- Pagefile Usage -
PagefileUsage: -1456111616, PeakPagefileUsage: -1456111616

- Working Set Size -
WorkingSetSize: 1153191936, PeakWorkingSetSize: 1153191936, PageFaultCount: 393328

*** Dump of thread ID 788 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 11093750.000000, User Time: 18281250.000000, Wait Time: 42800512.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FF9990B466C

- Registers -
rax=0000000000000001 rbx=00000000c8e14910 rcx=0000000000000000 rdx=00000000f37d6090 rsi=00000000f37d6970 rdi=0000000019930520
r8=0000000000000000 r9=0000000094254700 r10=00000000f37d60d0 r11=00000000f37d60d0 r12=00000000fb0590a0 r13=00000000f37d6b80
r14=000000009dc02530 r15=0000000000000000 rip=00000000990b466c rsp=00000000f37d6810 rbp=00000000f37d6b00
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
f37d68e0 c8d2a884 00000040 0000004f fb058900 0000022c KERNELBASE!RaiseException+0x0 
f37d6940 c8ad1ca6 000022c0 00000000 9ad7a2a8 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
f37d69f0 c8ad593b 00000000 00000020 00000000 00000030 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
f37d6b40 c8ad1a78 00000000 00000000 f37d6e70 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
f37d6c10 c8ad1cfc f37d6e70 00000000 00000080 f37d7140 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
f37d6cd0 c8adc4dd f37d7140 f37d7140 f37d7140 f37d7140 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
f37d6fc0 c8acb2fe f37d75d8 f37d7140 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
f37efd60 c8d0c6f8 c1526970 00000000 00000000 c142fce0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
f37efda0 9afd54e0 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
f37efdd0 9bb8485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
f37efe50 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 13992 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 156250.000000, Wait Time: 42798428.000000

- Registers -
rax=00000000000001de rbx=00000000bfb09d40 rcx=0000000000000074 rdx=00000000bfb099c0 rsi=00000000bfb07540 rdi=00000000bfb09d40
r8=0000000095c65004 r9=0000000000000000 r10=0000000095c600f0 r11=0000000000000001 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000009bc27304 rsp=00000000f3aff898 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
f3aff890 9bb96c2f 00000000 00000000 bfb07540 bfb09d40 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
f3affb80 9afd54e0 00000000 00000000 00000000 00000000 ntdll!EtwNotificationRegister+0x0 
f3affbb0 9bb8485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
f3affc30 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 10596 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 625000.000000, User Time: 0.000000, Wait Time: 42798428.000000

- Registers -
rax=00000000000001de rbx=00000000bfb0a170 rcx=0000000000000074 rdx=00000000bfb09df0 rsi=00000000bfb07540 rdi=00000000bfb0a170
r8=00000000f3bff210 r9=0000000000000000 r10=00000000f3bff356 r11=00000000f3bff010 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000009bc27304 rsp=00000000f3bffa88 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
f3bffa80 9bb96c2f 00000000 00000000 bfb07540 bfb0a170 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
f3bffd70 9afd54e0 00000000 00000000 00000000 00000000 ntdll!EtwNotificationRegister+0x0 
f3bffda0 9bb8485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
f3bffe20 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 12304 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 42798428.000000

- Registers -
rax=00000000000001de rbx=00000000bfb0ad30 rcx=0000000000000074 rdx=00000000bfb0a9b0 rsi=00000000bfb07540 rdi=00000000bfb0ad30
r8=0000000000000008 r9=0000000000000040 r10=0000000000000580 r11=000000000200024e r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000009bc27304 rsp=00000000f3cffc38 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
f3cffc30 9bb96c2f 00000000 00000000 bfb07540 bfb0ad30 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
f3cfff20 9afd54e0 00000000 00000000 00000000 00000000 ntdll!EtwNotificationRegister+0x0 
f3cfff50 9bb8485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
f3cfffd0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 852 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 42800512.000000

- Registers -
rax=0000000000000034 rbx=00000000f3effc10 rcx=0000000000000000 rdx=00000000f3effc10 rsi=00000000f391d000 rdi=0000000000000000
r8=00000000f3effb48 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000009bc23dd4 rsp=00000000f3effb48 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
f3effb40 9bbdb5c3 00000000 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0 
f3effb70 990bb281 00000000 00000000 00000000 00000000 ntdll!RtlDelayExecution+0x0 
f3effbf0 c8aea07f 00000000 00000000 fff0bdc0 00000000 KERNELBASE!SleepEx+0x0 
f3effc20 9afd54e0 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
f3effc50 9bb8485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
f3effcd0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 10268 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 42800504.000000

- Registers -
rax=000000000000005b rbx=0000000000000006 rcx=0000000000000006 rdx=00000000f3fff6e0 rsi=0000000000000000 rdi=0000000000000006
r8=00000000f3fff388 r9=00000000c167bfb0 r10=0000000000000000 r11=0000000000000246 r12=0000000000000064 r13=00000000f3fff6e0
r14=00000000f3fff3e0 r15=0000000000000000 rip=000000009bc242a4 rsp=00000000f3fff388 rbp=00000000c167bfb0
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
f3fff380 990bf9f0 00000000 00000000 00000000 00000000 ntdll!NtWaitForMultipleObjects+0x0 
f3fff670 990bf8ee cbb1f1c8 c172da50 00000006 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
f3fff6b0 cb7ad554 c167e590 00000000 c1678d10 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
f3fff8f0 cb8558cd 00000000 c167bfb0 00000000 00000000 nvcuda64!+0x0 
f3fff9a0 cb7acf23 38203752 2b792850 c1c0c110 00000000 nvcuda64!cuProfilerStop+0x0 
f3fff9d0 cbae44c4 c1c0c110 00000000 00000000 00000000 nvcuda64!+0x0 
f3fffa00 9afd54e0 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
f3fffa30 9bb8485b 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
f3fffab0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)