Task 7171535

Name ParityModified-1630352981-757-3_0
Workunit 4869726
Created 6 Sep 2021, 15:14:44 UTC
Sent 6 Sep 2021, 18:02:42 UTC
Report deadline 13 Sep 2021, 18:02:42 UTC
Received 21 Nov 2021, 0:00:09 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 11931
Run time 1 hours 18 min 45 sec
CPU time 1 hours 13 min 10 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 8,880.09 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.62 GB
Peak swap size 3.65 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
-20 17:12:41	                main:574]	:	INFO	:	Epoch 700 | loss: 0.0312344 | val_loss: 0.0312226 | Time: 6940.47 ms
[2021-11-20 17:12:48	                main:574]	:	INFO	:	Epoch 701 | loss: 0.0312239 | val_loss: 0.0312689 | Time: 6684.28 ms
[2021-11-20 17:12:55	                main:574]	:	INFO	:	Epoch 702 | loss: 0.0312307 | val_loss: 0.0312216 | Time: 6906.99 ms
[2021-11-20 17:13:02	                main:574]	:	INFO	:	Epoch 703 | loss: 0.031223 | val_loss: 0.0312141 | Time: 7019.65 ms
[2021-11-20 17:13:09	                main:574]	:	INFO	:	Epoch 704 | loss: 0.0312212 | val_loss: 0.0312141 | Time: 7115.45 ms
[2021-11-20 17:13:16	                main:574]	:	INFO	:	Epoch 705 | loss: 0.0312204 | val_loss: 0.0312143 | Time: 6456.55 ms
[2021-11-20 17:13:23	                main:574]	:	INFO	:	Epoch 706 | loss: 0.0312202 | val_loss: 0.0312169 | Time: 7058.64 ms
[2021-11-20 17:13:31	                main:574]	:	INFO	:	Epoch 707 | loss: 0.0312167 | val_loss: 0.0312111 | Time: 7860.39 ms
[2021-11-20 17:13:38	                main:574]	:	INFO	:	Epoch 708 | loss: 0.0312166 | val_loss: 0.0312149 | Time: 6712.63 ms
[2021-11-20 17:13:46	                main:574]	:	INFO	:	Epoch 709 | loss: 0.0312223 | val_loss: 0.0312145 | Time: 7201.7 ms
[2021-11-20 17:13:53	                main:574]	:	INFO	:	Epoch 710 | loss: 0.0312258 | val_loss: 0.0312149 | Time: 7509.38 ms
[2021-11-20 17:14:01	                main:574]	:	INFO	:	Epoch 711 | loss: 0.0312181 | val_loss: 0.0312099 | Time: 7136.68 ms
[2021-11-20 17:14:08	                main:574]	:	INFO	:	Epoch 712 | loss: 0.0312175 | val_loss: 0.0312179 | Time: 6667.48 ms
[2021-11-20 17:14:15	                main:574]	:	INFO	:	Epoch 713 | loss: 0.0312164 | val_loss: 0.0312122 | Time: 7080.59 ms
[2021-11-20 17:14:22	                main:574]	:	INFO	:	Epoch 714 | loss: 0.0312191 | val_loss: 0.0312175 | Time: 6772 ms
[2021-11-20 17:14:30	                main:574]	:	INFO	:	Epoch 715 | loss: 0.0312199 | val_loss: 0.0312138 | Time: 7392.14 ms
[2021-11-20 17:14:38	                main:574]	:	INFO	:	Epoch 716 | loss: 0.0312152 | val_loss: 0.0312078 | Time: 7185.72 ms
[2021-11-20 17:14:45	                main:574]	:	INFO	:	Epoch 717 | loss: 0.0312162 | val_loss: 0.0312137 | Time: 6937.81 ms
[2021-11-20 17:14:53	                main:574]	:	INFO	:	Epoch 718 | loss: 0.0312206 | val_loss: 0.0312192 | Time: 7017.43 ms
[2021-11-20 17:15:00	                main:574]	:	INFO	:	Epoch 719 | loss: 0.0312182 | val_loss: 0.0312131 | Time: 7014.71 ms
[2021-11-20 17:15:08	                main:574]	:	INFO	:	Epoch 720 | loss: 0.0312198 | val_loss: 0.0312115 | Time: 6951.19 ms
[2021-11-20 17:15:16	                main:574]	:	INFO	:	Epoch 721 | loss: 0.0312174 | val_loss: 0.0312206 | Time: 7317.88 ms
[2021-11-20 17:15:23	                main:574]	:	INFO	:	Epoch 722 | loss: 0.0312236 | val_loss: 0.0312123 | Time: 6722.62 ms
[2021-11-20 17:15:30	                main:574]	:	INFO	:	Epoch 723 | loss: 0.031217 | val_loss: 0.0312221 | Time: 7154.58 ms
[2021-11-20 17:15:38	                main:574]	:	INFO	:	Epoch 724 | loss: 0.0312478 | val_loss: 0.0312488 | Time: 7727.1 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1080)
[2021-11-20 17:42:43	                main:435]	:	INFO	:	Set logging level to 1
[2021-11-20 17:42:43	                main:441]	:	INFO	:	Running in BOINC Client mode
[2021-11-20 17:42:43	                main:444]	:	INFO	:	Resolving all filenames
[2021-11-20 17:42:43	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1)
[2021-11-20 17:42:43	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1630352981-757-3_0_r664274620_1 (exists = 1)
[2021-11-20 17:42:43	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1630352981-757-3_0_r664274620_0 (exists = 0)
[2021-11-20 17:42:43	                main:452]	:	INFO	:	Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1630352981-757-3 (exists = 1)
[2021-11-20 17:42:43	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2021-11-20 17:42:43	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5
[2021-11-20 17:42:43	                main:474]	:	INFO	:	Configuration: 
[2021-11-20 17:42:43	                main:475]	:	INFO	:	    Model type: GRU
[2021-11-20 17:42:43	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2021-11-20 17:42:43	                main:477]	:	INFO	:	    Max Epochs: 2048
[2021-11-20 17:42:43	                main:478]	:	INFO	:	    Batch Size: 128
[2021-11-20 17:42:43	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2021-11-20 17:42:43	                main:480]	:	INFO	:	    Patience: 10
[2021-11-20 17:42:43	                main:481]	:	INFO	:	    Hidden Width: 12
[2021-11-20 17:42:43	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2021-11-20 17:42:43	                main:483]	:	INFO	:	    # Backend Layers: 4
[2021-11-20 17:42:43	                main:484]	:	INFO	:	    # Threads: 1
[2021-11-20 17:42:44	                main:486]	:	INFO	:	Preparing Dataset
[2021-11-20 17:42:44	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-20 17:42:44	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-20 17:42:46	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2021-11-20 17:42:46	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-20 17:42:46	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-20 17:42:46	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2021-11-20 17:42:46	                main:494]	:	INFO	:	Creating Model
[2021-11-20 17:42:46	                main:507]	:	INFO	:	Preparing config file
[2021-11-20 17:42:46	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2021-11-20 17:42:47	                main:512]	:	INFO	:	Loading config
[2021-11-20 17:42:47	                main:514]	:	INFO	:	Loading state
[2021-11-20 17:42:48	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2021-11-20 17:42:48	                main:562]	:	INFO	:	Starting Training
[2021-11-20 17:42:54	                main:574]	:	INFO	:	Epoch 716 | loss: 0.0313725 | val_loss: 0.0312528 | Time: 6711.27 ms
[2021-11-20 17:43:02	                main:574]	:	INFO	:	Epoch 717 | loss: 0.0312523 | val_loss: 0.0312439 | Time: 7031.35 ms
[2021-11-20 17:43:10	                main:574]	:	INFO	:	Epoch 718 | loss: 0.0312415 | val_loss: 0.0312381 | Time: 8622.37 ms
[2021-11-20 17:43:37	                main:574]	:	INFO	:	Epoch 719 | loss: 0.0312307 | val_loss: 0.0312204 | Time: 26929.2 ms
[2021-11-20 17:43:43	                main:574]	:	INFO	:	Epoch 720 | loss: 0.0312222 | val_loss: 0.0312242 | Time: 6233.64 ms
[2021-11-20 17:43:50	                main:574]	:	INFO	:	Epoch 721 | loss: 0.031226 | val_loss: 0.0312174 | Time: 6571.61 ms
[2021-11-20 17:43:58	                main:574]	:	INFO	:	Epoch 722 | loss: 0.0312204 | val_loss: 0.0312131 | Time: 7330.8 ms
[2021-11-20 17:44:05	                main:574]	:	INFO	:	Epoch 723 | loss: 0.031219 | val_loss: 0.0312135 | Time: 7507.01 ms
[2021-11-20 17:44:12	                main:574]	:	INFO	:	Epoch 724 | loss: 0.0312185 | val_loss: 0.0312105 | Time: 7237.41 ms
[2021-11-20 17:44:19	                main:574]	:	INFO	:	Epoch 725 | loss: 0.0312191 | val_loss: 0.0312116 | Time: 6882.25 ms
[2021-11-20 17:44:27	                main:574]	:	INFO	:	Epoch 726 | loss: 0.0312189 | val_loss: 0.0312097 | Time: 7587.21 ms
[2021-11-20 17:44:35	                main:574]	:	INFO	:	Epoch 727 | loss: 0.031214 | val_loss: 0.031207 | Time: 7612.13 ms
[2021-11-20 17:44:42	                main:574]	:	INFO	:	Epoch 728 | loss: 0.0312147 | val_loss: 0.0312141 | Time: 7358.1 ms
[2021-11-20 17:44:50	                main:574]	:	INFO	:	Epoch 729 | loss: 0.031214 | val_loss: 0.0312034 | Time: 7632.61 ms
[2021-11-20 17:44:57	                main:574]	:	INFO	:	Epoch 730 | loss: 0.0312142 | val_loss: 0.031208 | Time: 7292.58 ms
[2021-11-20 17:45:16	                main:574]	:	INFO	:	Epoch 731 | loss: 0.0312113 | val_loss: 0.0312022 | Time: 18531 ms
[2021-11-20 17:45:23	                main:574]	:	INFO	:	Epoch 732 | loss: 0.0312086 | val_loss: 0.0312014 | Time: 7006.15 ms
[2021-11-20 17:45:31	                main:574]	:	INFO	:	Epoch 733 | loss: 0.0312103 | val_loss: 0.031202 | Time: 7964.4 ms
[2021-11-20 17:45:59	                main:574]	:	INFO	:	Epoch 734 | loss: 0.031214 | val_loss: 0.0312053 | Time: 28322.9 ms
[2021-11-20 17:46:18	                main:574]	:	INFO	:	Epoch 735 | loss: 0.0312128 | val_loss: 0.0312057 | Time: 17860.9 ms
[2021-11-20 17:46:25	                main:574]	:	INFO	:	Epoch 736 | loss: 0.0312106 | val_loss: 0.031204 | Time: 7559.03 ms
[2021-11-20 17:46:43	                main:574]	:	INFO	:	Epoch 737 | loss: 0.0312084 | val_loss: 0.031202 | Time: 18032.4 ms
[2021-11-20 17:47:12	                main:574]	:	INFO	:	Epoch 738 | loss: 0.0312088 | val_loss: 0.0312003 | Time: 27369.7 ms
[2021-11-20 17:47:20	                main:574]	:	INFO	:	Epoch 739 | loss: 0.0312079 | val_loss: 0.0312012 | Time: 7902.99 ms
[2021-11-20 17:47:38	                main:574]	:	INFO	:	Epoch 740 | loss: 0.0312085 | val_loss: 0.0312019 | Time: 18064.5 ms
[2021-11-20 17:47:45	                main:574]	:	INFO	:	Epoch 741 | loss: 0.0312142 | val_loss: 0.0312124 | Time: 6583.45 ms
[2021-11-20 17:47:52	                main:574]	:	INFO	:	Epoch 742 | loss: 0.0312158 | val_loss: 0.0312095 | Time: 6919.58 ms
[2021-11-20 17:47:58	                main:574]	:	INFO	:	Epoch 743 | loss: 0.0312101 | val_loss: 0.0312043 | Time: 6548.71 ms
[2021-11-20 17:48:06	                main:574]	:	INFO	:	Epoch 744 | loss: 0.0312141 | val_loss: 0.031207 | Time: 7291.52 ms
[2021-11-20 17:48:13	                main:574]	:	INFO	:	Epoch 745 | loss: 0.0312143 | val_loss: 0.0312071 | Time: 6457.66 ms
[2021-11-20 17:48:20	                main:574]	:	INFO	:	Epoch 746 | loss: 0.031211 | val_loss: 0.0312026 | Time: 7071.25 ms
[2021-11-20 17:48:27	                main:574]	:	INFO	:	Epoch 747 | loss: 0.0312079 | val_loss: 0.0312046 | Time: 7016.74 ms
[2021-11-20 17:48:34	                main:574]	:	INFO	:	Epoch 748 | loss: 0.0312103 | val_loss: 0.0312031 | Time: 7040.78 ms
[2021-11-20 17:48:41	                main:574]	:	INFO	:	Epoch 749 | loss: 0.0312094 | val_loss: 0.0311996 | Time: 6460.75 ms
[2021-11-20 17:48:48	                main:574]	:	INFO	:	Epoch 750 | loss: 0.0312066 | val_loss: 0.0312041 | Time: 6798.64 ms
[2021-11-20 17:48:56	                main:574]	:	INFO	:	Epoch 751 | loss: 0.0312086 | val_loss: 0.0312014 | Time: 7767.58 ms
[2021-11-20 17:49:03	                main:574]	:	INFO	:	Epoch 752 | loss: 0.0312056 | val_loss: 0.0311988 | Time: 6962.54 ms
[2021-11-20 17:49:10	                main:574]	:	INFO	:	Epoch 753 | loss: 0.0312067 | val_loss: 0.0312069 | Time: 6600.6 ms
[2021-11-20 17:49:16	                main:574]	:	INFO	:	Epoch 754 | loss: 0.0312088 | val_loss: 0.0312018 | Time: 6489.98 ms
[2021-11-20 17:49:23	                main:574]	:	INFO	:	Epoch 755 | loss: 0.0312096 | val_loss: 0.0312041 | Time: 6797.91 ms
[2021-11-20 17:49:30	                main:574]	:	INFO	:	Epoch 756 | loss: 0.0312085 | val_loss: 0.0312048 | Time: 6259.61 ms
[2021-11-20 17:49:36	                main:574]	:	INFO	:	Epoch 757 | loss: 0.0312061 | val_loss: 0.0312003 | Time: 6155.59 ms
[2021-11-20 17:49:43	                main:574]	:	INFO	:	Epoch 758 | loss: 0.0312059 | val_loss: 0.0312006 | Time: 6779.79 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1080)
[2021-11-20 18:38:42	                main:435]	:	INFO	:	Set logging level to 1
[2021-11-20 18:38:42	                main:441]	:	INFO	:	Running in BOINC Client mode
[2021-11-20 18:38:42	                main:444]	:	INFO	:	Resolving all filenames
[2021-11-20 18:38:43	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1)
[2021-11-20 18:38:43	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1630352981-757-3_0_r664274620_1 (exists = 1)
[2021-11-20 18:38:43	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1630352981-757-3_0_r664274620_0 (exists = 0)
[2021-11-20 18:38:44	                main:452]	:	INFO	:	Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1630352981-757-3 (exists = 1)
[2021-11-20 18:38:44	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2021-11-20 18:38:44	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5
[2021-11-20 18:38:44	                main:474]	:	INFO	:	Configuration: 
[2021-11-20 18:38:44	                main:475]	:	INFO	:	    Model type: GRU
[2021-11-20 18:38:44	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2021-11-20 18:38:44	                main:477]	:	INFO	:	    Max Epochs: 2048
[2021-11-20 18:38:44	                main:478]	:	INFO	:	    Batch Size: 128
[2021-11-20 18:38:44	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2021-11-20 18:38:44	                main:480]	:	INFO	:	    Patience: 10
[2021-11-20 18:38:44	                main:481]	:	INFO	:	    Hidden Width: 12
[2021-11-20 18:38:44	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2021-11-20 18:38:44	                main:483]	:	INFO	:	    # Backend Layers: 4
[2021-11-20 18:38:44	                main:484]	:	INFO	:	    # Threads: 1
[2021-11-20 18:38:44	                main:486]	:	INFO	:	Preparing Dataset
[2021-11-20 18:38:45	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-20 18:38:45	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-20 18:38:56	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2021-11-20 18:38:56	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-20 18:38:56	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-20 18:38:56	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2021-11-20 18:38:56	                main:494]	:	INFO	:	Creating Model
[2021-11-20 18:38:57	                main:507]	:	INFO	:	Preparing config file
[2021-11-20 18:38:57	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2021-11-20 18:38:57	                main:512]	:	INFO	:	Loading config
[2021-11-20 18:38:57	                main:514]	:	INFO	:	Loading state
[2021-11-20 18:39:04	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2021-11-20 18:39:04	                main:562]	:	INFO	:	Starting Training
[2021-11-20 18:39:14	                main:574]	:	INFO	:	Epoch 755 | loss: 0.0313788 | val_loss: 0.0312656 | Time: 9704.1 ms
[2021-11-20 18:39:21	                main:574]	:	INFO	:	Epoch 756 | loss: 0.0312431 | val_loss: 0.0312241 | Time: 6862.05 ms
[2021-11-20 18:39:28	                main:574]	:	INFO	:	Epoch 757 | loss: 0.0312163 | val_loss: 0.0312052 | Time: 7335.17 ms
[2021-11-20 18:39:35	                main:574]	:	INFO	:	Epoch 758 | loss: 0.03121 | val_loss: 0.0312059 | Time: 6775.07 ms
[2021-11-20 18:39:42	                main:574]	:	INFO	:	Epoch 759 | loss: 0.0312101 | val_loss: 0.0312079 | Time: 7379.58 ms
[2021-11-20 18:39:50	                main:574]	:	INFO	:	Epoch 760 | loss: 0.0312093 | val_loss: 0.0312079 | Time: 7827.91 ms
[2021-11-20 18:39:58	                main:574]	:	INFO	:	Epoch 761 | loss: 0.0312066 | val_loss: 0.0312029 | Time: 8324.1 ms
[2021-11-20 18:42:58	                main:574]	:	INFO	:	Epoch 762 | loss: 0.0312041 | val_loss: 0.0311985 | Time: 179229 ms
[2021-11-20 18:43:05	                main:574]	:	INFO	:	Epoch 763 | loss: 0.031202 | val_loss: 0.0311984 | Time: 6923.44 ms
[2021-11-20 18:43:12	                main:574]	:	INFO	:	Epoch 764 | loss: 0.0312077 | val_loss: 0.031201 | Time: 7118.49 ms
[2021-11-20 18:43:19	                main:574]	:	INFO	:	Epoch 765 | loss: 0.0312013 | val_loss: 0.0311935 | Time: 7020.79 ms
[2021-11-20 18:43:26	                main:574]	:	INFO	:	Epoch 766 | loss: 0.0312005 | val_loss: 0.031196 | Time: 7087.56 ms
[2021-11-20 18:43:33	                main:574]	:	INFO	:	Epoch 767 | loss: 0.0311998 | val_loss: 0.0311905 | Time: 7183.51 ms
[2021-11-20 18:43:40	                main:574]	:	INFO	:	Epoch 768 | loss: 0.0311946 | val_loss: 0.0311889 | Time: 6985.11 ms
[2021-11-20 18:43:48	                main:574]	:	INFO	:	Epoch 769 | loss: 0.0311957 | val_loss: 0.031188 | Time: 7159.67 ms
[2021-11-20 18:43:54	                main:574]	:	INFO	:	Epoch 770 | loss: 0.0311939 | val_loss: 0.0311924 | Time: 6829.93 ms
[2021-11-20 18:44:02	                main:574]	:	INFO	:	Epoch 771 | loss: 0.0311954 | val_loss: 0.0311896 | Time: 7208.97 ms
[2021-11-20 18:44:09	                main:574]	:	INFO	:	Epoch 772 | loss: 0.0311944 | val_loss: 0.0311905 | Time: 6817.2 ms
[2021-11-20 18:44:16	                main:574]	:	INFO	:	Epoch 773 | loss: 0.0311958 | val_loss: 0.0311955 | Time: 7294.07 ms
[2021-11-20 18:44:23	                main:574]	:	INFO	:	Epoch 774 | loss: 0.0311936 | val_loss: 0.0311858 | Time: 7100.87 ms
[2021-11-20 18:44:30	                main:574]	:	INFO	:	Epoch 775 | loss: 0.0311956 | val_loss: 0.0311969 | Time: 7256.3 ms
[2021-11-20 18:44:37	                main:574]	:	INFO	:	Epoch 776 | loss: 0.0312017 | val_loss: 0.0311943 | Time: 6950.32 ms
[2021-11-20 18:44:45	                main:574]	:	INFO	:	Epoch 777 | loss: 0.0311966 | val_loss: 0.0311877 | Time: 7318.69 ms
[2021-11-20 18:44:52	                main:574]	:	INFO	:	Epoch 778 | loss: 0.0311951 | val_loss: 0.0311903 | Time: 6903.09 ms
[2021-11-20 18:44:59	                main:574]	:	INFO	:	Epoch 779 | loss: 0.0311982 | val_loss: 0.0311899 | Time: 7093.58 ms
[2021-11-20 18:45:06	                main:574]	:	INFO	:	Epoch 780 | loss: 0.0311996 | val_loss: 0.031195 | Time: 7054.08 ms
[2021-11-20 18:45:13	                main:574]	:	INFO	:	Epoch 781 | loss: 0.0311988 | val_loss: 0.0311901 | Time: 7364.32 ms
[2021-11-20 18:45:20	                main:574]	:	INFO	:	Epoch 782 | loss: 0.0311978 | val_loss: 0.0311903 | Time: 6928.47 ms
[2021-11-20 18:45:28	                main:574]	:	INFO	:	Epoch 783 | loss: 0.0312002 | val_loss: 0.0311931 | Time: 7323.37 ms
[2021-11-20 18:45:35	                main:574]	:	INFO	:	Epoch 784 | loss: 0.0311991 | val_loss: 0.0311893 | Time: 6940.05 ms
[2021-11-20 18:45:42	                main:574]	:	INFO	:	Epoch 785 | loss: 0.0312016 | val_loss: 0.0311961 | Time: 6939.28 ms
[2021-11-20 18:45:49	                main:574]	:	INFO	:	Epoch 786 | loss: 0.0311984 | val_loss: 0.0311895 | Time: 7094.03 ms
[2021-11-20 18:45:56	                main:574]	:	INFO	:	Epoch 787 | loss: 0.0311982 | val_loss: 0.0311887 | Time: 7287.03 ms
[2021-11-20 18:46:03	                main:574]	:	INFO	:	Epoch 788 | loss: 0.031201 | val_loss: 0.0311909 | Time: 7013.59 ms
[2021-11-20 18:46:10	                main:574]	:	INFO	:	Epoch 789 | loss: 0.0312003 | val_loss: 0.0311892 | Time: 7214.55 ms
[2021-11-20 18:46:17	                main:574]	:	INFO	:	Epoch 790 | loss: 0.0311991 | val_loss: 0.0311939 | Time: 7057.84 ms
[2021-11-20 18:46:24	                main:574]	:	INFO	:	Epoch 791 | loss: 0.0311995 | val_loss: 0.0311913 | Time: 6858.57 ms
[2021-11-20 18:46:31	                main:574]	:	INFO	:	Epoch 792 | loss: 0.0312009 | val_loss: 0.0311915 | Time: 6935.71 ms
[2021-11-20 18:46:38	                main:574]	:	INFO	:	Epoch 793 | loss: 0.0311991 | val_loss: 0.0311893 | Time: 6980.44 ms
[2021-11-20 18:46:46	                main:574]	:	INFO	:	Epoch 794 | loss: 0.031199 | val_loss: 0.031193 | Time: 7346.84 ms
[2021-11-20 18:46:53	                main:574]	:	INFO	:	Epoch 795 | loss: 0.0311979 | val_loss: 0.031191 | Time: 7008.73 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1080)
[2021-11-20 18:50:03	                main:435]	:	INFO	:	Set logging level to 1
[2021-11-20 18:50:03	                main:441]	:	INFO	:	Running in BOINC Client mode
[2021-11-20 18:50:03	                main:444]	:	INFO	:	Resolving all filenames
[2021-11-20 18:50:03	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1)
[2021-11-20 18:50:03	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1630352981-757-3_0_r664274620_1 (exists = 1)
[2021-11-20 18:50:03	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1630352981-757-3_0_r664274620_0 (exists = 0)
[2021-11-20 18:50:03	                main:452]	:	INFO	:	Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1630352981-757-3 (exists = 1)
[2021-11-20 18:50:03	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2021-11-20 18:50:03	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5
[2021-11-20 18:50:03	                main:474]	:	INFO	:	Configuration: 
[2021-11-20 18:50:03	                main:475]	:	INFO	:	    Model type: GRU
[2021-11-20 18:50:03	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2021-11-20 18:50:03	                main:477]	:	INFO	:	    Max Epochs: 2048
[2021-11-20 18:50:03	                main:478]	:	INFO	:	    Batch Size: 128
[2021-11-20 18:50:03	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2021-11-20 18:50:03	                main:480]	:	INFO	:	    Patience: 10
[2021-11-20 18:50:03	                main:481]	:	INFO	:	    Hidden Width: 12
[2021-11-20 18:50:03	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2021-11-20 18:50:03	                main:483]	:	INFO	:	    # Backend Layers: 4
[2021-11-20 18:50:04	                main:484]	:	INFO	:	    # Threads: 1
[2021-11-20 18:50:04	                main:486]	:	INFO	:	Preparing Dataset
[2021-11-20 18:50:04	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-20 18:50:04	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-20 18:50:07	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2021-11-20 18:50:07	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-20 18:50:07	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-20 18:50:07	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2021-11-20 18:50:07	                main:494]	:	INFO	:	Creating Model
[2021-11-20 18:50:07	                main:507]	:	INFO	:	Preparing config file
[2021-11-20 18:50:07	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2021-11-20 18:50:07	                main:512]	:	INFO	:	Loading config
[2021-11-20 18:50:07	                main:514]	:	INFO	:	Loading state
[2021-11-20 18:50:08	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2021-11-20 18:50:08	                main:562]	:	INFO	:	Starting Training
[2021-11-20 18:50:19	                main:574]	:	INFO	:	Epoch 790 | loss: nan | val_loss: nan | Time: 10419.7 ms
[2021-11-20 18:50:27	                main:574]	:	INFO	:	Epoch 791 | loss: nan | val_loss: nan | Time: 8609.58 ms
[2021-11-20 18:50:36	                main:574]	:	INFO	:	Epoch 792 | loss: nan | val_loss: nan | Time: 8135.21 ms
[2021-11-20 18:50:45	                main:574]	:	INFO	:	Epoch 793 | loss: nan | val_loss: nan | Time: 9736.29 ms
[2021-11-20 18:50:55	                main:574]	:	INFO	:	Epoch 794 | loss: nan | val_loss: nan | Time: 9505.75 ms
[2021-11-20 18:51:04	                main:574]	:	INFO	:	Epoch 795 | loss: nan | val_loss: nan | Time: 9320.56 ms
[2021-11-20 18:51:13	                main:574]	:	INFO	:	Epoch 796 | loss: nan | val_loss: nan | Time: 9119.57 ms
[2021-11-20 18:51:22	                main:574]	:	INFO	:	Epoch 797 | loss: nan | val_loss: nan | Time: 9003.09 ms
[2021-11-20 18:51:31	                main:574]	:	INFO	:	Epoch 798 | loss: nan | val_loss: nan | Time: 8946.84 ms
[2021-11-20 18:51:41	                main:574]	:	INFO	:	Epoch 799 | loss: nan | val_loss: nan | Time: 9353.17 ms
[2021-11-20 18:51:50	                main:574]	:	INFO	:	Epoch 800 | loss: nan | val_loss: nan | Time: 8784.87 ms
[2021-11-20 18:51:58	                main:574]	:	INFO	:	Epoch 801 | loss: nan | val_loss: nan | Time: 8723.18 ms
[2021-11-20 18:52:08	                main:574]	:	INFO	:	Epoch 802 | loss: nan | val_loss: nan | Time: 9172.14 ms
[2021-11-20 18:52:17	                main:574]	:	INFO	:	Epoch 803 | loss: nan | val_loss: nan | Time: 8975.61 ms
[2021-11-20 18:52:26	                main:574]	:	INFO	:	Epoch 804 | loss: nan | val_loss: nan | Time: 8903.31 ms
[2021-11-20 18:52:35	                main:574]	:	INFO	:	Epoch 805 | loss: nan | val_loss: nan | Time: 9363.18 ms
[2021-11-20 18:52:45	                main:574]	:	INFO	:	Epoch 806 | loss: nan | val_loss: nan | Time: 10290.8 ms
[2021-11-20 18:53:05	                main:574]	:	INFO	:	Epoch 807 | loss: nan | val_loss: nan | Time: 19603.9 ms
[2021-11-20 18:53:14	                main:574]	:	INFO	:	Epoch 808 | loss: nan | val_loss: nan | Time: 8977.52 ms
[2021-11-20 18:53:23	                main:574]	:	INFO	:	Epoch 809 | loss: nan | val_loss: nan | Time: 9168.7 ms
[2021-11-20 18:53:32	                main:574]	:	INFO	:	Epoch 810 | loss: nan | val_loss: nan | Time: 8937.61 ms
[2021-11-20 18:53:42	                main:574]	:	INFO	:	Epoch 811 | loss: nan | val_loss: nan | Time: 9701.52 ms
[2021-11-20 18:53:52	                main:574]	:	INFO	:	Epoch 812 | loss: nan | val_loss: nan | Time: 9603.91 ms
[2021-11-20 18:54:01	                main:574]	:	INFO	:	Epoch 813 | loss: nan | val_loss: nan | Time: 9236.92 ms
[2021-11-20 18:54:10	                main:574]	:	INFO	:	Epoch 814 | loss: nan | val_loss: nan | Time: 9521.15 ms
[2021-11-20 18:54:19	                main:574]	:	INFO	:	Epoch 815 | loss: nan | val_loss: nan | Time: 8904.88 ms
[2021-11-20 18:54:29	                main:574]	:	INFO	:	Epoch 816 | loss: nan | val_loss: nan | Time: 9518.73 ms
[2021-11-20 18:54:38	                main:574]	:	INFO	:	Epoch 817 | loss: nan | val_loss: nan | Time: 9366.2 ms
[2021-11-20 18:54:48	                main:574]	:	INFO	:	Epoch 818 | loss: nan | val_loss: nan | Time: 9548.02 ms
[2021-11-20 18:54:57	                main:574]	:	INFO	:	Epoch 819 | loss: nan | val_loss: nan | Time: 9031.92 ms
[2021-11-20 18:55:05	                main:574]	:	INFO	:	Epoch 820 | loss: nan | val_loss: nan | Time: 8150.25 ms
[2021-11-20 18:55:15	                main:574]	:	INFO	:	Epoch 821 | loss: nan | val_loss: nan | Time: 9482.57 ms
[2021-11-20 18:55:24	                main:574]	:	INFO	:	Epoch 822 | loss: nan | val_loss: nan | Time: 9399.62 ms
[2021-11-20 18:55:33	                main:574]	:	INFO	:	Epoch 823 | loss: nan | val_loss: nan | Time: 8586.2 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce GTX 1080)
[2021-11-20 18:58:42	                main:435]	:	INFO	:	Set logging level to 1
[2021-11-20 18:58:42	                main:441]	:	INFO	:	Running in BOINC Client mode
[2021-11-20 18:58:42	                main:444]	:	INFO	:	Resolving all filenames
[2021-11-20 18:58:42	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1)
[2021-11-20 18:58:42	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1630352981-757-3_0_r664274620_1 (exists = 1)
[2021-11-20 18:58:42	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1630352981-757-3_0_r664274620_0 (exists = 0)
[2021-11-20 18:58:42	                main:452]	:	INFO	:	Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1630352981-757-3 (exists = 1)
[2021-11-20 18:58:42	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2021-11-20 18:58:42	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5
[2021-11-20 18:58:42	                main:474]	:	INFO	:	Configuration: 
[2021-11-20 18:58:42	                main:475]	:	INFO	:	    Model type: GRU
[2021-11-20 18:58:42	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2021-11-20 18:58:42	                main:477]	:	INFO	:	    Max Epochs: 2048
[2021-11-20 18:58:42	                main:478]	:	INFO	:	    Batch Size: 128
[2021-11-20 18:58:42	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2021-11-20 18:58:42	                main:480]	:	INFO	:	    Patience: 10
[2021-11-20 18:58:42	                main:481]	:	INFO	:	    Hidden Width: 12
[2021-11-20 18:58:42	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2021-11-20 18:58:42	                main:483]	:	INFO	:	    # Backend Layers: 4
[2021-11-20 18:58:43	                main:484]	:	INFO	:	    # Threads: 1
[2021-11-20 18:58:43	                main:486]	:	INFO	:	Preparing Dataset
[2021-11-20 18:58:43	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-20 18:58:43	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-20 18:58:46	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2021-11-20 18:58:46	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-20 18:58:46	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-11-20 18:58:46	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2021-11-20 18:58:46	                main:494]	:	INFO	:	Creating Model
[2021-11-20 18:58:46	                main:507]	:	INFO	:	Preparing config file
[2021-11-20 18:58:46	                main:511]	:	INFO	:	Found checkpoint, attempting to load... 
[2021-11-20 18:58:46	                main:512]	:	INFO	:	Loading config


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFF1DB94ED9

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 11/20/21 18:58:46
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\0;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 00000000aa740000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000020430000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1110) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.19041.1023 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1023

ModLoad: 0000000007e10000 0000000000013000 C:\Program Files\Avast Software\Avast\aswhook.dll (21.5.6354.0) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : D:\work\616216c47067779c\idp\build\avgast\RU_NTDLL-lH-Y2A!x64_vs142\bin\Release_Unicode_NTDLL_vs142\x64\aswhook.pdb
    File Version          : 21.5.6354.0
    Company Name          : AVAST Software
    Product Name          : Avast
    Product Version       : 21.5.6354.0

ModLoad: 000000001e680000 00000000000bd000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 000000001db60000 00000000002c9000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 000000001eee0000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.19041.320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.320

ModLoad: 000000001e1c0000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 0000000020320000 000000000002a000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.19041.746 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.746

ModLoad: 000000001e350000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1110) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.19041.1110 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1110

ModLoad: 000000001de90000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 000000001e0c0000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 000000000e320000 0000000000058000 C:\ProgramData\BOINC\slots\0\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000001e490000 00000000000ac000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1052) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.19041.320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.320

ModLoad: 0000000020350000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.19041.546

ModLoad: 000000001ec90000 000000000009b000 C:\WINDOWS\System32\sechost.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.19041.320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.320

ModLoad: 000000001f080000 000000000012a000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1081) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.19041.320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.320

ModLoad: 00000000003f0000 000000000008d000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.28.29910.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\9\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.28.29910.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.28.29910.0

ModLoad: 0000000000480000 000000000001a000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.28.29910.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\9\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.28.29910.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.28.29910.0

ModLoad: 00000000a1740000 000000000abe7000 C:\ProgramData\BOINC\slots\0\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000000310000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.28.29910.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\9\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.28.29910.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.28.29910.0

ModLoad: 000000000edc0000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.867

ModLoad: 000000000aeb0000 000000000020d000 C:\ProgramData\BOINC\slots\0\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 000000007cbf0000 0000000024b49000 C:\ProgramData\BOINC\slots\0\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000000abd0000 00000000002db000 C:\ProgramData\BOINC\slots\0\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000000e200000 0000000000045000 C:\ProgramData\BOINC\slots\0\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000001b410000 0000000000010000 C:\ProgramData\BOINC\slots\0\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 00000000b0c90000 00000000030a5000 C:\ProgramData\BOINC\slots\0\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 00000000ad7d0000 00000000034b2000 C:\ProgramData\BOINC\slots\0\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 000000000e5a0000 0000000000040000 C:\ProgramData\BOINC\slots\0\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000050f70000 000000000919f000 C:\ProgramData\BOINC\slots\0\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 000000005dae0000 0000000003d5b000 C:\ProgramData\BOINC\slots\0\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 000000005bc10000 0000000001eca000 C:\ProgramData\BOINC\slots\0\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 0000000061840000 000000001b3a4000 C:\ProgramData\BOINC\slots\0\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 000000001f510000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000001ba90000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000001f540000 0000000000472000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.19041.320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.320

ModLoad: 000000001e070000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 000000001e460000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.19041.320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.320

ModLoad: 000000001d5c0000 0000000000034000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 000000001de30000 0000000000060000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 000000001e1f0000 000000000015f000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.844) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.19041.320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.320

ModLoad: 000000001d710000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000001faa0000 000000000073f000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.19041.320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.320

ModLoad: 000000001bc90000 0000000000790000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.19041.320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.320

ModLoad: 000000001f1b0000 0000000000355000 C:\WINDOWS\System32\combase.dll (6.2.19041.1081) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.19041.320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.320

ModLoad: 000000001d550000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.662) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.19041.320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.320

ModLoad: 00000000201e0000 00000000000ae000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.19041.320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.320

ModLoad: 000000001e970000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.19041.320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.320

ModLoad: 00000000ebe90000 00000000002cc000 C:\WINDOWS\system32\nvcuda.dll (30.0.14.7196) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r470\r471_90\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 30.0.14.7196
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.4.125 driver
    Product Version       : 30.0.14.7196

ModLoad: 0000000016a50000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000004d180000 00000000017d5000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_b8346c359fcd6093\nvcuda64.dll (30.0.14.7196) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r470\r471_90\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 30.0.14.7196
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.4.125 driver
    Product Version       : 30.0.14.7196

ModLoad: 0000000015280000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.19041.906 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.906

ModLoad: 0000000015130000 000000000014a000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.19041.1081) (-exported- Symbols Loaded)
    Linked PDB Filename   : drvstore.pdb
    File Version          : 10.0.19041.1081 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1081

ModLoad: 000000001d4c0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000001b5d0000 000000000009e000 C:\WINDOWS\system32\uxtheme.dll (6.2.19041.1081) (-exported- Symbols Loaded)
    Linked PDB Filename   : UxTheme.pdb
    File Version          : 10.0.19041.320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.320

ModLoad: 000000000cc00000 0000000000719000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.14.7196) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r470\r471_90\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 30.0.14.7196
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 30.0.14.7196

ModLoad: 000000001eda0000 000000000012a000 C:\WINDOWS\System32\ole32.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : ole32.pdb
    File Version          : 10.0.19041.320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.320

ModLoad: 000000001dfe0000 0000000000083000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.19041.1023 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1023



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3624, Write: 307, Other 780

- I/O Transfers Counters -
Read: 6575850, Write: 7297, Other 31034

- Paged Pool Usage -
QuotaPagedPoolUsage: 3447824, QuotaPeakPagedPoolUsage: 3447824
QuotaNonPagedPoolUsage: 39096, QuotaPeakNonPagedPoolUsage: 39096

- Virtual Memory Usage -
VirtualSize: -1379479552, PeakVirtualSize: -794345472

- Pagefile Usage -
PagefileUsage: -1379479552, PeakPagefileUsage: -1379479552

- Working Set Size -
WorkingSetSize: 1155096576, PeakWorkingSetSize: 1155100672, PageFaultCount: 393408

*** Dump of thread ID 12808 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 9375000.000000, User Time: 18437500.000000, Wait Time: 425445216.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFF1DB94ED9

- Registers -
rax=00000000716e6008 rbx=00000000aaaa4910 rcx=00000000a57f9900 rdx=0000000020455b00 rsi=00000000716e6870 rdi=0000000019930520
r8=00000000716e6030 r9=00000000716e6058 r10=0000000000000004 r11=00000000716e6068 r12=000000008c592df0 r13=00000000716e6a80
r14=00000000a63d4190 r15=0000000000000000 rip=000000001db94ed9 rsp=00000000716e6710 rbp=00000000716e6a00
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
716e67e0 aa9ba884 00000040 0000004f 8c591e00 00000259 KERNELBASE!RaiseException+0x0 
716e6840 aa761ca6 c2820000 716e6919 9f59da88 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
716e68f0 aa76593b 00000000 00000030 00000020 00000008 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
716e6a40 aa761a78 00000000 00000000 716e6d70 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
716e6b10 aa761cfc 716e6d70 00000000 00000080 716e7040 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
716e6bd0 aa76c4dd 716e7040 716e7040 716e7040 716e7040 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
716e6ec0 aa75b2fe 716e74d8 716e7040 00000000 00000080 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
716ffc60 aa99c6f8 c41685c0 00000000 00000000 c3ead610 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
716ffca0 1e697034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
716ffcd0 20482651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
716ffd50 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 592 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 425444928.000000

- Registers -
rax=00000000000001d3 rbx=00000000c2825c70 rcx=0000000000000074 rdx=00000000c28258f0 rsi=00000000c2823e60 rdi=00000000c2825c70
r8=0000000000000008 r9=0000000000000040 r10=0000000000000140 r11=000000004fa07896 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000204d0874 rsp=00000000717ffb48 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
717ffb40 20482dc7 00000000 00000000 c2823e60 c2825c70 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
717ffe40 1e697034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
717ffe70 20482651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
717ffef0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 17328 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 425444928.000000

- Registers -
rax=00000000000001d3 rbx=00000000c2826390 rcx=0000000000000074 rdx=00000000c2826010 rsi=00000000c2823e60 rdi=00000000c2826390
r8=00000000c2648438 r9=0000000000000031 r10=00000000718ff46e r11=0000000050d49008 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000204d0874 rsp=00000000718ffa88 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
718ffa80 20482dc7 00000000 00000000 c2823e60 c2826390 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
718ffd80 1e697034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
718ffdb0 20482651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
718ffe30 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 7572 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 425444928.000000

- Registers -
rax=00000000000001d3 rbx=00000000c2826b80 rcx=0000000000000074 rdx=00000000c2826800 rsi=00000000c2823e60 rdi=00000000c2826b80
r8=0000000000000565 r9=0000000000000565 r10=0000000000000564 r11=0000000000000566 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000204d0874 rsp=00000000719ff4e8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
719ff4e0 20482dc7 00000000 00000000 c2823e60 c2826b80 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
719ff7e0 1e697034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
719ff810 20482651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
719ff890 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 16016 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 425445216.000000

- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=0000000071bff980 rsi=0000000000000000 rdi=0000000000000064
r8=0000000071456000 r9=00000000aa9f87f0 r10=0000000000000fff r11=0000000000000ff0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000204cd4a4 rsp=0000000071bff958 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
71bff950 1dba95be 71bffa18 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0 
71bff9f0 aa77a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0 
71bffa20 1e697034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
71bffa50 20482651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
71bffad0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 3940 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 425445216.000000

- Registers -
rax=000000000000005b rbx=0000000000000006 rcx=0000000000000006 rdx=0000000071cff5c0 rsi=0000000000000000 rdi=0000000000000006
r8=00000000c437f190 r9=0000000000000006 r10=00000000c38a9f70 r11=00000000cdb07208 r12=0000000000000064 r13=0000000071cff5c0
r14=0000000071cff2c0 r15=0000000000000000 rip=00000000204cd974 rsp=0000000071cff268 rbp=00000000c4363cf0
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
71cff260 1dbacab0 00000000 7144b000 e8ca7468 7144b000 ntdll!ZwWaitForMultipleObjects+0x0 
71cff550 1dbac9ae c28326f0 2044693e 00000006 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
71cff590 4d3512d4 c43699f0 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
71cff7d0 4d3f7fcd 00000000 c4363cf0 00000000 00000000 nvcuda64!+0x0 
71cff880 4d350ca3 ac979777 aa4f8f37 c4d02640 00000000 nvcuda64!cuProfilerStop+0x0 
71cff8b0 4d686ac4 c4d02640 00000000 00000000 00000000 nvcuda64!+0x0 
71cff8e0 1e697034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
71cff910 20482651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
71cff990 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 8492 (state: Waiting): ***

- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 425445216.000000

- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000c45eef90 rdx=0000000071dffb88 rsi=0000000071dffaf0 rdi=0000000000000000
r8=0000000000000004 r9=0000000000000004 r10=0000000000000003 r11=0000000071dffb20 r12=0000000071dffb88 r13=0000000000000000
r14=00000000c45eef90 r15=00000000c45f3ce0 rip=00000000204d0814 rsp=0000000071dffac8 rbp=0000000071dffb20
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
71dffac0 20494295 00000102 00000102 00000000 71dffaf0 ntdll!NtWaitForAlertByThreadId+0x0 
71dffb30 1dbccd79 c45f14c0 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0 
71dffb60 4d2bf2dc c45f14c0 c45f14c0 c45f14c0 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0 
71dffbc0 4d350ca3 00000005 abc7a840 ac63db88 00000000 nvcuda64!+0x0 
71dffbf0 4d686ac4 c4d01d40 00000000 00000000 00000000 nvcuda64!+0x0 
71dffc20 1e697034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
71dffc50 20482651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
71dffcd0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)