Task 9646194

Name ParityModified-1636180256-20593-2-0_2
Workunit 6593217
Created 10 Dec 2021, 2:38:47 UTC
Sent 10 Dec 2021, 3:43:26 UTC
Report deadline 18 Dec 2021, 3:43:26 UTC
Received 11 Dec 2021, 1:03:19 UTC
Server state Over
Outcome Computation error
Client state Aborted by user
Exit status 203 (0x000000CB) EXIT_ABORTED_VIA_GUI
Computer ID 16815
Run time 46 min 30 sec
CPU time 46 min 24 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 17,972.20 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 2.82 GB
Peak swap size 4.72 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
aborted by user</message>
<stderr_txt>
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080 Ti)
[2021-12-10 15:34:05	                main:435]	:	INFO	:	Set logging level to 1
[2021-12-10 15:34:05	                main:441]	:	INFO	:	Running in BOINC Client mode
[2021-12-10 15:34:05	                main:444]	:	INFO	:	Resolving all filenames
[2021-12-10 15:34:05	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2021-12-10 15:34:05	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 0)
[2021-12-10 15:34:05	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2021-12-10 15:34:05	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2021-12-10 15:34:05	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2021-12-10 15:34:05	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2021-12-10 15:34:05	                main:474]	:	INFO	:	Configuration: 
[2021-12-10 15:34:05	                main:475]	:	INFO	:	    Model type: GRU
[2021-12-10 15:34:05	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2021-12-10 15:34:05	                main:477]	:	INFO	:	    Max Epochs: 2048
[2021-12-10 15:34:05	                main:478]	:	INFO	:	    Batch Size: 128
[2021-12-10 15:34:05	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2021-12-10 15:34:05	                main:480]	:	INFO	:	    Patience: 10
[2021-12-10 15:34:05	                main:481]	:	INFO	:	    Hidden Width: 12
[2021-12-10 15:34:05	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2021-12-10 15:34:05	                main:483]	:	INFO	:	    # Backend Layers: 4
[2021-12-10 15:34:05	                main:484]	:	INFO	:	    # Threads: 1
[2021-12-10 15:34:05	                main:486]	:	INFO	:	Preparing Dataset
[2021-12-10 15:34:05	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2021-12-10 15:34:06	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2021-12-10 15:58:46	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2021-12-10 15:58:46	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2021-12-10 15:58:46	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2021-12-10 15:58:46	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2021-12-10 15:58:46	                main:494]	:	INFO	:	Creating Model
[2021-12-10 15:58:46	                main:507]	:	INFO	:	Preparing config file
[2021-12-10 15:58:46	                main:519]	:	INFO	:	Creating new config file
[2021-12-10 15:58:46	                main:538]	:	INFO	:	This is a continuation WU, loading previous network
[2021-12-10 16:18:06	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2021-12-10 16:18:06	                main:562]	:	INFO	:	Starting Training
[2021-12-10 16:20:04	                main:574]	:	INFO	:	Epoch 1 | loss: 0.0310869 | val_loss: 0.0313029 | Time: 117966 ms
[2021-12-10 16:20:06	                main:574]	:	INFO	:	Epoch 2 | loss: 0.0310118 | val_loss: 0.0313473 | Time: 1577.54 ms
[2021-12-10 16:20:08	                main:574]	:	INFO	:	Epoch 3 | loss: 0.0309903 | val_loss: 0.0313346 | Time: 1599.47 ms
[2021-12-10 16:20:09	                main:574]	:	INFO	:	Epoch 4 | loss: 0.0309757 | val_loss: 0.0313467 | Time: 1560.8 ms
[2021-12-10 16:20:11	                main:574]	:	INFO	:	Epoch 5 | loss: 0.0309709 | val_loss: 0.0313553 | Time: 1545.97 ms
[2021-12-10 16:20:12	                main:574]	:	INFO	:	Epoch 6 | loss: 0.0309678 | val_loss: 0.0313923 | Time: 1518 ms
[2021-12-10 16:20:14	                main:574]	:	INFO	:	Epoch 7 | loss: 0.0309752 | val_loss: 0.0313116 | Time: 1550.85 ms
[2021-12-10 16:20:15	                main:574]	:	INFO	:	Epoch 8 | loss: 0.0309827 | val_loss: 0.031374 | Time: 1562.94 ms
[2021-12-10 16:20:17	                main:574]	:	INFO	:	Epoch 9 | loss: 0.0309834 | val_loss: 0.0312968 | Time: 1535.81 ms
[2021-12-10 16:20:18	                main:574]	:	INFO	:	Epoch 10 | loss: 0.0309735 | val_loss: 0.0313606 | Time: 1538.35 ms
[2021-12-10 16:20:20	                main:574]	:	INFO	:	Epoch 11 | loss: 0.0309713 | val_loss: 0.031338 | Time: 1577.55 ms
[2021-12-10 16:20:22	                main:574]	:	INFO	:	Epoch 12 | loss: 0.0309692 | val_loss: 0.0313772 | Time: 1586.96 ms
[2021-12-10 16:20:23	                main:574]	:	INFO	:	Epoch 13 | loss: 0.0309747 | val_loss: 0.0313355 | Time: 1535.58 ms
[2021-12-10 16:20:25	                main:574]	:	INFO	:	Epoch 14 | loss: 0.0309793 | val_loss: 0.0313097 | Time: 1542.64 ms
[2021-12-10 16:20:26	                main:574]	:	INFO	:	Epoch 15 | loss: 0.0309741 | val_loss: 0.0313221 | Time: 1529.27 ms
[2021-12-10 16:20:28	                main:574]	:	INFO	:	Epoch 16 | loss: 0.0309699 | val_loss: 0.0313602 | Time: 1600.53 ms
[2021-12-10 16:20:29	                main:574]	:	INFO	:	Epoch 17 | loss: 0.0309727 | val_loss: 0.0313678 | Time: 1634.37 ms
[2021-12-10 16:20:31	                main:574]	:	INFO	:	Epoch 18 | loss: 0.0309732 | val_loss: 0.0313449 | Time: 1582.1 ms
[2021-12-10 16:20:33	                main:574]	:	INFO	:	Epoch 19 | loss: 0.0309715 | val_loss: 0.0313159 | Time: 1587.67 ms
[2021-12-10 16:20:34	                main:574]	:	INFO	:	Epoch 20 | loss: 0.030976 | val_loss: 0.0313371 | Time: 1633.94 ms
[2021-12-10 16:20:36	                main:574]	:	INFO	:	Epoch 21 | loss: 0.0309808 | val_loss: 0.0313279 | Time: 1610.41 ms
[2021-12-10 16:20:37	                main:574]	:	INFO	:	Epoch 22 | loss: 0.0309805 | val_loss: 0.0313681 | Time: 1611.04 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080 Ti)
[2021-12-10 19:02:41	                main:435]	:	INFO	:	Set logging level to 1
[2021-12-10 19:02:41	                main:441]	:	INFO	:	Running in BOINC Client mode
[2021-12-10 19:02:41	                main:444]	:	INFO	:	Resolving all filenames
[2021-12-10 19:02:41	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2021-12-10 19:02:41	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 1)
[2021-12-10 19:02:41	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2021-12-10 19:02:41	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2021-12-10 19:02:41	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2021-12-10 19:02:41	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2021-12-10 19:02:41	                main:474]	:	INFO	:	Configuration: 
[2021-12-10 19:02:41	                main:475]	:	INFO	:	    Model type: GRU
[2021-12-10 19:02:41	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2021-12-10 19:02:41	                main:477]	:	INFO	:	    Max Epochs: 2048
[2021-12-10 19:02:41	                main:478]	:	INFO	:	    Batch Size: 128
[2021-12-10 19:02:41	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2021-12-10 19:02:41	                main:480]	:	INFO	:	    Patience: 10
[2021-12-10 19:02:41	                main:481]	:	INFO	:	    Hidden Width: 12
[2021-12-10 19:02:41	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2021-12-10 19:02:41	                main:483]	:	INFO	:	    # Backend Layers: 4
[2021-12-10 19:02:41	                main:484]	:	INFO	:	    # Threads: 1
[2021-12-10 19:02:41	                main:486]	:	INFO	:	Preparing Dataset
[2021-12-10 19:02:41	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2021-12-10 19:02:42	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFDA8169072

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 12/10/21 19:03:09
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\33;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 00000000ee9c0000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000aa470000 00000000001f5000 C:\Windows\SYSTEM32\ntdll.dll (6.2.19041.1288) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.19041.1023 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1023

ModLoad: 00000000a9910000 00000000000be000 C:\Windows\System32\KERNEL32.DLL (6.2.19041.1348) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.19041.1348 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1348

ModLoad: 00000000a80a0000 00000000002c8000 C:\Windows\System32\KERNELBASE.dll (6.2.19041.1387) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.19041.1348 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1348

ModLoad: 00000000a8580000 00000000001a1000 C:\Windows\System32\USER32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000a8480000 0000000000022000 C:\Windows\System32\win32u.dll (6.2.19041.1387) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.19041.1387 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1387

ModLoad: 00000000a9c40000 000000000002b000 C:\Windows\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202

ModLoad: 00000000a7b80000 000000000010d000 C:\Windows\System32\gdi32full.dll (6.2.19041.1387) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.19041.1387 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1387

ModLoad: 00000000a7c90000 000000000009d000 C:\Windows\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 00000000a7d30000 0000000000100000 C:\Windows\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 00000000a8730000 00000000000ac000 C:\Windows\System32\ADVAPI32.dll (6.2.19041.1052) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000aa130000 000000000009e000 C:\Windows\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.19041.546

ModLoad: 00000000a9ba0000 000000000009b000 C:\Windows\System32\sechost.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000a9a70000 000000000012a000 C:\Windows\System32\RPCRT4.dll (6.2.19041.1288) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000008dc00000 0000000000058000 C:\ProgramData\BOINC\slots\33\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000956c0000 0000000000092000 C:\Windows\SYSTEM32\MSVCP140.dll (14.28.29334.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\6\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.28.29334.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.28.29334.0

ModLoad: 000000009d110000 00000000001e4000 C:\Windows\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.867

ModLoad: 0000000095760000 0000000000019000 C:\Windows\SYSTEM32\VCRUNTIME140.dll (14.28.29334.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\6\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.28.29334.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.28.29334.0

ModLoad: 0000000095670000 000000000000c000 C:\Windows\SYSTEM32\VCRUNTIME140_1.dll (14.28.29334.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\6\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.28.29334.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.28.29334.0

ModLoad: 000000002fcb0000 0000000024b49000 C:\ProgramData\BOINC\slots\33\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000250c0000 000000000abe7000 C:\ProgramData\BOINC\slots\33\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000008dbb0000 0000000000045000 C:\ProgramData\BOINC\slots\33\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000005a470000 00000000034b2000 C:\ProgramData\BOINC\slots\33\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 0000000097320000 0000000000010000 C:\ProgramData\BOINC\slots\33\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 0000000022010000 00000000030a5000 C:\ProgramData\BOINC\slots\33\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 0000000006c60000 000000001b3a4000 C:\ProgramData\BOINC\slots\33\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 0000000085230000 000000000020d000 C:\ProgramData\BOINC\slots\33\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 000000006e960000 00000000002db000 C:\ProgramData\BOINC\slots\33\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000008db70000 0000000000040000 C:\ProgramData\BOINC\slots\33\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000fdac0000 000000000919f000 C:\ProgramData\BOINC\slots\33\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000f9d60000 0000000003d5b000 C:\ProgramData\BOINC\slots\33\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 000000005ed30000 0000000001eca000 C:\ProgramData\BOINC\slots\33\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000a9cd0000 0000000000030000 C:\Windows\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000a5a90000 0000000000012000 C:\Windows\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000a9060000 0000000000472000 C:\Windows\System32\Setupapi.dll (6.2.19041.1237) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000a8370000 000000000004e000 C:\Windows\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 00000000a8450000 0000000000027000 C:\Windows\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000a7920000 0000000000034000 C:\Windows\SYSTEM32\DEVOBJ.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 00000000a7e30000 0000000000060000 C:\Windows\System32\WINTRUST.dll (6.2.19041.1266) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.19041.1266 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1266

ModLoad: 00000000a7f40000 0000000000156000 C:\Windows\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000a7760000 0000000000012000 C:\Windows\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000a87e0000 0000000000744000 C:\Windows\System32\Shell32.dll (6.2.19041.1387) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.19041.964 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.964

ModLoad: 00000000a5c90000 0000000000794000 C:\Windows\SYSTEM32\windows.storage.dll (6.2.19041.1387) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000a9d00000 0000000000355000 C:\Windows\System32\combase.dll (6.2.19041.1348) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.19041.1320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1320

ModLoad: 00000000a75d0000 000000000002e000 C:\Windows\SYSTEM32\Wldp.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000a97b0000 00000000000ad000 C:\Windows\System32\SHCORE.dll (6.2.19041.1387) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000a9c70000 0000000000055000 C:\Windows\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000006e5b0000 00000000002b9000 C:\Windows\system32\nvcuda.dll (30.0.14.9709) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r495\r496_97\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 30.0.14.9709
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.5.121 driver
    Product Version       : 30.0.14.9709

ModLoad: 0000000058df0000 0000000001679000 C:\Windows\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_642e50d7b66aa2a4\nvcuda64.dll (30.0.14.9709) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r495\r496_97\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 30.0.14.9709
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.5.121 driver
    Product Version       : 30.0.14.9709

ModLoad: 00000000a25c0000 000000000000a000 C:\Windows\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000a1a70000 0000000000031000 C:\Windows\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.19041.906 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.906

ModLoad: 000000009f420000 000000000014a000 C:\Windows\SYSTEM32\drvstore.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : drvstore.pdb
    File Version          : 10.0.19041.1320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1320

ModLoad: 00000000a7540000 000000000000c000 C:\Windows\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000009bf10000 0000000000761000 C:\Windows\SYSTEM32\nvapi64.dll (30.0.14.9709) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r495\r496_97\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 30.0.14.9709
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 30.0.14.9709

ModLoad: 0000000058540000 00000000008a5000 C:\Windows\System32\DriverStore\FileRepository\nv_dispi.inf_amd64_642e50d7b66aa2a4\nvptxJitCompiler64.dll (30.0.14.9709) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 30.0.14.9709
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows PTX JIT Compiler
    Product Version       : 30.0.14.9709

ModLoad: 00000000a83c0000 0000000000083000 C:\Windows\System32\bcryptPrimitives.dll (6.2.19041.1348) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.19041.1348 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1348



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 2427, Write: 349, Other 1011

- I/O Transfers Counters -
Read: 5373143, Write: 9528309, Other 21762

- Paged Pool Usage -
QuotaPagedPoolUsage: 3422520, QuotaPeakPagedPoolUsage: 3422520
QuotaNonPagedPoolUsage: 23384, QuotaPeakNonPagedPoolUsage: 25152

- Virtual Memory Usage -
VirtualSize: -2099785728, PeakVirtualSize: -1511710720

- Pagefile Usage -
PagefileUsage: -2099785728, PeakPagefileUsage: -2060042240

- Working Set Size -
WorkingSetSize: 570277888, PeakWorkingSetSize: 570281984, PageFaultCount: 449075

*** Dump of thread ID 4844 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 192953.000000

- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFDA8169072

- Registers -
rax=0000000000000000 rbx=0000000000000001 rcx=00000000eec78c40 rdx=00000000513fe4a0 rsi=0000000000000000 rdi=0000000000000000
r8=00000000513fe4a0 r9=00000000eec78c30 r10=0000000000000fff r11=0000000000000ff0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000a8169072 rsp=00000000513fe478 rbp=0000000000000000
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
513fe470 ee9f9100 00000001 513fe4a0 513fe4a0 eec78c30 KERNELBASE!DebugBreak+0x0 
513fe8b0 ee9f9ce4 92c00000 513fec14 00000000 00000308 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
513ff810 ee9fa084 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
513ff840 a9927034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
513ff870 aa4c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
513ff8f0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 1220 (state: Running): ***

- Information -
Status: Base Priority: Above Normal, Priority: Above Normal, , Kernel Time: 5156250.000000, User Time: 270312512.000000, Wait Time: 192946.000000

- Registers -
rax=00000000000007e3 rbx=0000000043946175 rcx=00000000000007e3 rdx=000000000000075f rsi=0000000043946176 rdi=0000000058540000
r8=0000000000000009 r9=0000000000000fc6 r10=00000000439460f8 r11=0000000027b358c0 r12=0000000000000000 r13=000000002770e1d8
r14=00000000439460d0 r15=00000000ffffffff rip=0000000058aac1bb rsp=0000000050ee18e0 rbp=0000000050ee19f0
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
50ee18e0 58aa7f55 000000a5 43946176 000000a5 58ad0f4e nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0 
50ee1d80 58a97f77 0000010c 000000a7 00000216 3c2b8c78 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0 
50ee30a0 5856ec98 00000000 50ee31b0 00000000 2770e1d8 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0 
50ee3240 5854919a 27d68878 0000000c 27b600e8 58aba97e nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
50ee3290 58ab9eec 00000000 00000000 b4d5e074 58abf06c nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
50ee32c0 58543911 19fcbec8 2770e1d8 58b1faf0 00193220 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0 
50ee3640 58546c82 19fcbec8 00000005 19fcbec8 00000005 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
50ee36d0 5854fa2c 27b600e8 50ee37e0 00000000 00000005 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
50ee3890 5854281b 93929190 019a9998 a3a2a1a0 00000001 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
50ee47e0 5926706a 00000001 00000005 50ee4840 50ee4810 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
50ee4a50 59267310 19918510 193080b8 00000056 195bbb55 nvcuda64!cuProfilerStop+0x0 
50ee4c40 58f77fd1 50ee4ec0 00000000 50ee4ec0 00000002 nvcuda64!cuProfilerStop+0x0 
50ee4d00 58f783ae 195b7c20 00000000 50ee4ec0 0193816a nvcuda64!+0x0 
50ee4dc0 58f78660 50ee5040 50ee5001 50ee4ec0 50ee4ea9 nvcuda64!+0x0 
50ee4e80 58f97e32 00000000 00000001 1a7b6be0 0000007f nvcuda64!+0x0 
50ee4f70 58e96a41 00000000 547e4d20 000004c4 50ee5120 nvcuda64!+0x0 
50ee4fe0 58e96ba7 19c2fd90 547e4d20 00000000 17000017 nvcuda64!+0x0 
50ee50d0 58e97721 00000000 00000000 00000000 50ee5161 nvcuda64!+0x0 
50ee51b0 2fcb8333 00000000 00000000 547e4d20 1a7b6de8 nvcuda64!+0x0 
50ee5230 2fcbfd19 1a7a1140 1a7a49d0 00000000 2fcbfd00 torch_cuda!+0x0 
50ee5260 2fcb722b 1a7a49c8 1a7a5988 1a690101 1a74cdb0 torch_cuda!+0x0 
50ee52a0 2fcba2d9 1a77f3e8 1a77f3e8 00000000 1a77f3d0 torch_cuda!+0x0 
50ee5320 2fcb9ef1 00000001 00000001 00000001 1a7948c0 torch_cuda!+0x0 
50ee5360 2fcc03d3 00000000 1a690860 00000000 50ee5340 torch_cuda!+0x0 
50ee5390 2fcb23c4 00000000 1955b050 26ef0000 00000001 torch_cuda!+0x0 
50ee53e0 2fcb2381 1a690860 50ee54f1 00000001 2262c040 torch_cuda!+0x0 
50ee5420 2fcb5ab0 50ee54f0 a80fa65b 8dbed6d8 00000000 torch_cuda!+0x0 
50ee5540 31e1471e 00000001 00000001 50ee5b90 00000001 torch_cuda!+0x0 
50ee5750 2a7cf058 74ff305d 50ee7820 2f9e16c0 50ee5b90 torch_cuda!at::cuda::CUDAEvent::block+0x0 
50ee5950 2a7d22d2 50ee5b90 50ee5a88 50ee67c0 50ee67c0 torch_cpu!at::native::conv_tbc_backward+0x0 
50ee5eb0 2a7d1eff 00000000 50ee67c0 14000000 2a6abfac torch_cpu!at::native::copy_+0x0 
50ee5f10 2ac64a0d 2f9e0101 2f9e0640 ffffffff 2a690231 torch_cpu!at::native::copy_+0x0 
50ee6130 2c5915e6 10000000 00000000 2dbaac10 00000000 torch_cpu!at::Tensor::copy_+0x0 
50ee6570 2ac64a0d 2f9e0640 aa49b3c7 50ee65f8 2f9e0640 torch_cpu!torch::autograd::VariableType::allCUDATypes+0x0 
50ee6790 2a92a38f 50ee6950 8dc1a8c0 18c13070 50ee67c0 torch_cpu!at::Tensor::copy_+0x0 
50ee6840 2a929c19 50ee6de8 50ee7820 50ee6b50 50ee6de8 torch_cpu!at::native::to_dense_backward+0x0 
50ee6a50 2ac4e363 bb1511e0 00000000 00000002 00000002 torch_cpu!at::native::to+0x0 
50ee6a90 2beb6573 50ee0000 1955d670 50ee6ad0 0000657a torch_cpu!at::zeros_out+0x0 
50ee6ad0 2aa902f2 50ee0000 2d9024d6 74ff0f5d 50ee7820 torch_cpu!torch::autograd::GraphRoot::apply+0x0 
50ee6b10 2ac81222 50ee0000 00000000 50ee6b98 50ee6c20 torch_cpu!at::native::mkldnn_sigmoid_+0x0 
50ee6d50 ee9dcd74 50ee77b0 50ee77b0 50ee77b0 00000000 torch_cpu!at::Tensor::to+0x0 
50ee6f60 ee9daf96 50ee7840 50ee70e0 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
50effd00 eec1c6f8 1931b490 00000000 00000000 19330900 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
50effd40 a9927034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
50effd70 aa4c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
50effdf0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 4544 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 191191.000000

- Registers -
rax=00000000000001d3 rbx=0000000017805550 rcx=0000000000000070 rdx=00000000178051d0 rsi=0000000017803300 rdi=0000000017805550
r8=0000000050ffefd0 r9=0000000017803904 r10=000000000000006c r11=0000000050ffedd0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000aa5107c4 rsp=0000000050fff868 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
50fff860 aa4c2dc7 00000000 00000000 17803300 17805550 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
50fffb60 a9927034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
50fffb90 aa4c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
50fffc10 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 4520 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 312500.000000, User Time: 0.000000, Wait Time: 191191.000000

- Registers -
rax=00000000000001d3 rbx=0000000017805980 rcx=0000000000000070 rdx=0000000017805600 rsi=0000000017803300 rdi=0000000017805980
r8=00000000a25c5008 r9=00000000510ff5b0 r10=00000000a25c00f0 r11=0000000000000001 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000aa5107c4 rsp=00000000510ffb08 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
510ffb00 aa4c2dc7 00000000 00000000 17803300 17805980 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
510ffe00 a9927034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
510ffe30 aa4c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
510ffeb0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 1112 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 191191.000000

- Registers -
rax=00000000000001d3 rbx=0000000017806200 rcx=0000000000000070 rdx=0000000017805e80 rsi=0000000017803300 rdi=0000000017806200
r8=0000000000000008 r9=0000000000000040 r10=0000000000000180 r11=0000000000000200 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000aa5107c4 rsp=00000000511ff718 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
511ff710 aa4c2dc7 00000000 00000000 17803300 17806200 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
511ffa10 a9927034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
511ffa40 aa4c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
511ffac0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 6064 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 192948.000000

- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=00000000514ffa80 rsi=0000000000000000 rdi=000000000000000d
r8=0000000000000001 r9=0000000000000000 r10=0000000018a34730 r11=00000000f95dfcc5 r12=0000000000000064 r13=00000000514ffa80
r14=00000000514ff780 r15=0000000000000000 rip=00000000aa50d8c4 rsp=00000000514ff728 rbp=000000001947aa30
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
514ff720 a80ecb20 00000000 50d58000 aa5da4d0 50d58000 ntdll!ZwWaitForMultipleObjects+0x0 
514ffa10 a80eca1e 17810c90 006e0069 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
514ffa50 58fc5be4 4307e0d0 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
514ffc90 5906d15d 00000000 1947aa30 00000000 00000000 nvcuda64!+0x0 
514ffd40 58fc55b3 054c357c fc95f6df 19a84860 00000000 nvcuda64!cuProfilerStop+0x0 
514ffd70 592f4264 19a84860 00000000 00000000 00000000 nvcuda64!+0x0 
514ffda0 a9927034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
514ffdd0 aa4c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
514ffe50 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 9532 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 191237.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=0000000000000088 rdx=0000000000000000 rsi=0000000000000000 rdi=0000000000000088
r8=00000000515ffb58 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=00000000194f3d00 r13=0000000000000000
r14=0000000000000088 r15=0000000000000000 rip=00000000aa50cdf4 rsp=00000000515ff8d8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
515ff8d0 a80c1a5e 00000000 00001f80 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0 
515ff970 591e95ee 19a84b60 00000000 00000000 00000088 KERNELBASE!WaitForSingleObjectEx+0x0 
515ffbb0 58fc55b3 00000000 19a84b60 58df0000 1950a100 nvcuda64!cuProfilerStop+0x0 
515ffbe0 592f4264 19a84b60 00000000 00000000 00000000 nvcuda64!+0x0 
515ffc10 a9927034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
515ffc40 aa4c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
515ffcc0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)