Task 12196318

Name ParityModified-1645994323-29214-0_0
Workunit 9377462
Created 27 Feb 2022, 20:38:46 UTC
Sent 1 Mar 2022, 2:09:16 UTC
Report deadline 9 Mar 2022, 2:09:16 UTC
Received 1 Mar 2022, 4:33:07 UTC
Server state Over
Outcome Computation error
Client state Aborted by user
Exit status 203 (0x000000CB) EXIT_ABORTED_VIA_GUI
Computer ID 17152
Run time 8 min 36 sec
CPU time 8 min 33 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 17,668.85 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.57 GB
Peak swap size 3.09 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.14.2</core_client_version>
<![CDATA[
<message>
aborted by user</message>
<stderr_txt>
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080 Ti)
[2022-02-28 20:23:54	                main:435]	:	INFO	:	Set logging level to 1
[2022-02-28 20:23:54	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-02-28 20:23:54	                main:444]	:	INFO	:	Resolving all filenames
[2022-02-28 20:23:54	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-02-28 20:23:54	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 0)
[2022-02-28 20:23:54	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-02-28 20:23:54	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 0)
[2022-02-28 20:23:54	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2022-02-28 20:23:54	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-02-28 20:23:54	                main:474]	:	INFO	:	Configuration: 
[2022-02-28 20:23:54	                main:475]	:	INFO	:	    Model type: GRU
[2022-02-28 20:23:54	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-02-28 20:23:54	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-02-28 20:23:54	                main:478]	:	INFO	:	    Batch Size: 128
[2022-02-28 20:23:54	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-02-28 20:23:54	                main:480]	:	INFO	:	    Patience: 10
[2022-02-28 20:23:54	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-02-28 20:23:54	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-02-28 20:23:54	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-02-28 20:23:54	                main:484]	:	INFO	:	    # Threads: 1
[2022-02-28 20:23:54	                main:486]	:	INFO	:	Preparing Dataset
[2022-02-28 20:23:54	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-02-28 20:23:55	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FF92F0690F2

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 02/28/22 20:32:29
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\1;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 00000000372d0000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000315d0000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.19041.1466 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1466

ModLoad: 000000002f980000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.19041.1503 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1503

ModLoad: 000000002efa0000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.19041.1503 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1503

ModLoad: 0000000030170000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000002ed10000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1526) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.19041.1526 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1526

ModLoad: 000000002f780000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202

ModLoad: 000000002f270000 000000000010d000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.19041.1466 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1466

ModLoad: 000000002ee40000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 000000002ed40000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 000000002fcc0000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000312f0000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.19041.546

ModLoad: 00000000300d0000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000313d0000 0000000000125000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000079aa0000 0000000024b49000 C:\ProgramData\BOINC\slots\1\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000c8410000 0000000000058000 C:\ProgramData\BOINC\slots\1\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000016ed0000 0000000000045000 C:\ProgramData\BOINC\slots\1\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000765e0000 00000000034b2000 C:\ProgramData\BOINC\slots\1\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 000000006b9f0000 000000000abe7000 C:\ProgramData\BOINC\slots\1\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000002b930000 0000000000010000 C:\ProgramData\BOINC\slots\1\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 0000000068940000 00000000030a5000 C:\ProgramData\BOINC\slots\1\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 000000004d590000 000000001b3a4000 C:\ProgramData\BOINC\slots\1\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 00000000185d0000 0000000000091000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.27.29112.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.27.29112.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.27.29112.0

ModLoad: 0000000018730000 0000000000019000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.27.29112.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.27.29112.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.27.29112.0

ModLoad: 0000000018fa0000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.27.29112.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.27.29112.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.27.29112.0

ModLoad: 00000000ad6b0000 000000000020d000 C:\ProgramData\BOINC\slots\1\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 00000000236e0000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.867

ModLoad: 00000000ad3d0000 00000000002db000 C:\ProgramData\BOINC\slots\1\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000fc430000 0000000000040000 C:\ProgramData\BOINC\slots\1\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000049830000 0000000003d5b000 C:\ProgramData\BOINC\slots\1\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 0000000040690000 000000000919f000 C:\ProgramData\BOINC\slots\1\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 000000003e7c0000 0000000001eca000 C:\ProgramData\BOINC\slots\1\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 0000000031390000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000002cbf0000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000030580000 0000000000472000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000002ef50000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 000000002ece0000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000002ea80000 0000000000034000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 000000002eee0000 0000000000069000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.19041.1503 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1503

ModLoad: 000000002f4c0000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000002e8c0000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000030a00000 0000000000744000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.19041.964 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.964

ModLoad: 000000002cdf0000 0000000000794000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000002fd70000 0000000000355000 C:\WINDOWS\System32\combase.dll (6.2.19041.1348) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.19041.1320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1320

ModLoad: 000000002e730000 000000000002e000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000304d0000 00000000000ad000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1387) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000002fc60000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000aed10000 00000000002cd000 C:\WINDOWS\system32\nvcuda.dll (30.0.15.1123) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_04\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 30.0.15.1123
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.6.58 driver
    Product Version       : 30.0.15.1123

ModLoad: 000000009f5d0000 00000000016a0000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispig.inf_amd64_015fa42d67826549\nvcuda64.dll (30.0.15.1123) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_04\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 30.0.15.1123
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.6.58 driver
    Product Version       : 30.0.15.1123

ModLoad: 0000000029030000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000029170000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.19041.906 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.906

ModLoad: 0000000026d70000 000000000014a000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : drvstore.pdb
    File Version          : 10.0.19041.1320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1320

ModLoad: 000000002e6a0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000219e0000 0000000000767000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.15.1123) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_04\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 30.0.15.1123
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 30.0.15.1123

ModLoad: 00000000aa090000 00000000008b3000 C:\WINDOWS\System32\DriverStore\FileRepository\nv_dispig.inf_amd64_015fa42d67826549\nvptxJitCompiler64.dll (30.0.15.1123) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 30.0.15.1123
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows PTX JIT Compiler
    Product Version       : 30.0.15.1123

ModLoad: 000000002f430000 0000000000082000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.19041.1415 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1415



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 2619, Write: 870, Other 3652

- I/O Transfers Counters -
Read: 5780524, Write: 398319800, Other 24450

- Paged Pool Usage -
QuotaPagedPoolUsage: 3432920, QuotaPeakPagedPoolUsage: 3432920
QuotaNonPagedPoolUsage: 33856, QuotaPeakNonPagedPoolUsage: 37528

- Virtual Memory Usage -
VirtualSize: -1043939328, PeakVirtualSize: -376262656

- Pagefile Usage -
PagefileUsage: -1043939328, PeakPagefileUsage: -829202432

- Working Set Size -
WorkingSetSize: 1579724800, PeakWorkingSetSize: 1805885440, PageFaultCount: 6075883

*** Dump of thread ID 5632 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 46802408.000000

- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FF92F0690F2

- Registers -
rax=0000000000000000 rbx=0000000000000001 rcx=0000000037588c40 rdx=00000000d98fe970 rsi=0000000000000000 rdi=0000000000000000
r8=00000000d98fe970 r9=0000000037588c30 r10=0000000000000fff r11=0000000000000ff0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000002f0690f2 rsp=00000000d98fe948 rbp=0000000000000000
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
d98fe940 37309100 00000001 d98fe970 d98fe970 37588c30 KERNELBASE!DebugBreak+0x0 
d98fed80 37309ce4 00000000 d98ff0e4 00000000 00000334 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
d98ffce0 3730a084 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
d98ffd10 2f997034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
d98ffd40 31622651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
d98ffdc0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 3300 (state: Running): ***

- Information -
Status: Base Priority: Above Normal, Priority: Above Normal, , Kernel Time: 79375000.000000, User Time: 5060468736.000000, Wait Time: 46802408.000000

- Registers -
rax=0000000000000004 rbx=00000000d91c3550 rcx=00000000369512f8 rdx=00000000d91c3550 rsi=0000000000000000 rdi=00000000369274d8
r8=00000000368ed138 r9=00000000503ea59c r10=0000000081f52ce4 r11=00000000d91c32d8 r12=0000000000000003 r13=00000000d91c4960
r14=00000000aa09c920 r15=0000000036934358 rip=00000000aa09d7a0 rsp=00000000d91c31a0 rbp=0000000026311ed8
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
d91c32d0 aa09e240 ffffffff ffffffff 26311ed8 36927548 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
d91c3320 aa09d6b4 26311ed8 aa61c1e9 a3928346 d91c3550 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
d91c3360 aa09dfae 369dce88 3d04e7a8 aa09c310 aa09c920 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
d91c3390 aa61677c 00000000 3d071ff8 aa09dee0 d91c3550 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
d91c33c0 aa09ec18 3a4ada88 75181548 808f01c8 d91c4960 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0 
d91c33f0 aa094368 3a4ada88 808f01c8 3a4ada88 0000000a nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
d91c3780 aa096c92 76e0fd38 00000005 35380ee8 00000005 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
d91c3810 aa09fa60 01104d70 d91c3920 00000000 00000005 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
d91c39e0 aa09282b 00000000 00000000 00000000 00000000 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
d91c4930 9fa54afa 00000001 00000005 d91c4990 d91c4960 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
d91c4ba0 9fa54da0 00000000 59fc7968 00000056 09f3a845 nvcuda64!cuProfilerStop+0x0 
d91c4d90 9f75c791 d91c5010 00000000 d91c5010 00000002 nvcuda64!cuProfilerStop+0x0 
d91c4e50 9f75cb6e 09f36840 00000000 d91c5010 036dd47d nvcuda64!+0x0 
d91c4f10 9f75ce20 d91c5190 d91c5201 d91c5010 d91c4ff9 nvcuda64!+0x0 
d91c4fd0 9f77e6c2 00000000 00000001 0b11b520 0000007f nvcuda64!+0x0 
d91c50c0 9f677781 00000000 9e5d4fc0 00000ce4 d91c5270 nvcuda64!+0x0 
d91c5130 9f6778e7 3d7863e0 9e5d4fc0 00000000 694aab60 nvcuda64!+0x0 
d91c5220 9f678461 00000000 00000000 00000000 d91c52b1 nvcuda64!+0x0 
d91c5300 79aa8333 00000000 00000000 9e5d4fc0 0b119c10 nvcuda64!+0x0 
d91c5380 79aafd19 0b051140 0b054e40 00000000 79aafd00 torch_cuda!+0x0 
d91c53b0 79aa722b 0b054e00 0b055988 0af40101 0ae691e0 torch_cuda!+0x0 
d91c53f0 79aaa2d9 0b02f3e8 0b02f3e8 00000000 0b02f3e0 torch_cuda!+0x0 
d91c5470 79aa9ef1 00000001 00000001 00000001 0b0448c0 torch_cuda!+0x0 
d91c54b0 79ab03d3 00000000 0af40860 00000000 d91c5490 torch_cuda!+0x0 
d91c54e0 79aa23c4 00000000 09e73210 0a960000 00000001 torch_cuda!+0x0 
d91c5530 79aa2381 0af40860 d91c5641 00000001 12ec2040 torch_cuda!+0x0 
d91c5570 79aa5ab0 d91c5640 2effa65b 16f0d6d8 00000000 torch_cuda!+0x0 
d91c5690 7bc0471e 00000001 00000001 d91c5ce0 00000001 torch_cuda!+0x0 
d91c58a0 710ff058 6cc61f84 d91c7970 763116c0 d91c5ce0 torch_cuda!at::cuda::CUDAEvent::block+0x0 
d91c5aa0 711022d2 d91c5ce0 d91c5bd8 d91c6910 d91c6910 torch_cpu!at::native::conv_tbc_backward+0x0 
d91c6000 71101eff 00000000 d91c6910 14000000 70fdbfac torch_cpu!at::native::copy_+0x0 
d91c6060 71594a0d 76310101 76310640 ffffffff 70fc0231 torch_cpu!at::native::copy_+0x0 
d91c6280 72ec15e6 10000000 00000000 744dac10 00000000 torch_cpu!at::Tensor::copy_+0x0 
d91c66c0 71594a0d 76310640 315fb3c7 d91c6748 76310640 torch_cpu!torch::autograd::VariableType::allCUDATypes+0x0 
d91c68e0 7125a38f d91c6aa0 c842a8c0 09580570 d91c6910 torch_cpu!at::Tensor::copy_+0x0 
d91c6990 71259c19 d91c6f38 d91c7970 d91c6ca0 d91c6f38 torch_cpu!at::native::to_dense_backward+0x0 
d91c6ba0 7157e363 a94528a8 00000000 00000002 00000002 torch_cpu!at::native::to+0x0 
d91c6be0 727e6573 d91c0000 09e7ba50 d91c6c20 0000657a torch_cpu!at::zeros_out+0x0 
d91c6c20 713c02f2 d91c0000 742324d6 6cc62284 d91c7970 torch_cpu!torch::autograd::GraphRoot::apply+0x0 
d91c6c60 715b1222 d91c0000 00000000 d91c6ce8 d91c6d70 torch_cpu!at::native::mkldnn_sigmoid_+0x0 
d91c6ea0 372ecd74 d91c7900 d91c7900 d91c7900 00000000 torch_cpu!at::Tensor::to+0x0 
d91c70b0 372eaf96 d91c7990 d91c7230 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
d91dfe50 3752c6f8 09d6a600 00000000 00000000 09c64c30 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
d91dfe90 2f997034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
d91dfec0 31622651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
d91dff40 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 14200 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 46802400.000000

- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=00000000d99ff8c0 rsi=0000000000000000 rdi=000000000000000d
r8=0000000009f3a483 r9=000000007ffee000 r10=00000000546c6148 r11=00000000eafda49a r12=0000000000000064 r13=00000000d99ff8c0
r14=00000000d99ff5c0 r15=0000000000000000 rip=000000003166d8c4 rsp=00000000d99ff568 rbp=0000000009e3a9d0
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
d99ff560 2efecb20 00000000 d92dc000 3173a4d0 d92dc000 ntdll!ZwWaitForMultipleObjects+0x0 
d99ff850 2efeca1e 08093c60 004e0049 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
d99ff890 9f7ad384 09e3da30 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
d99ffad0 9f8556fd 00000000 09e3a9d0 00000000 00000000 nvcuda64!+0x0 
d99ffb80 9f7acd53 a9c0d8cc 7fffc517 0a856430 00000000 nvcuda64!cuProfilerStop+0x0 
d99ffbb0 9fae4064 0a856430 00000000 00000000 00000000 nvcuda64!+0x0 
d99ffbe0 2f997034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
d99ffc10 31622651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
d99ffc90 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 3180 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 46769504.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002cc rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002cc
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000009e97300 r13=0000000000000000
r14=00000000000002cc r15=0000000000000000 rip=000000003166cdf4 rsp=00000000d9affbc8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
d9affbc0 2efc1a5e 00000000 00001f80 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0 
d9affc60 9f9d596e 0a8564c0 00000000 00000000 000002cc KERNELBASE!WaitForSingleObjectEx+0x0 
d9affea0 9f7acd53 00000000 0a8564c0 9f5d0000 09d269c0 nvcuda64!cuProfilerStop+0x0 
d9affed0 9fae4064 0a8564c0 00000000 00000000 00000000 nvcuda64!+0x0 
d9afff00 2f997034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
d9afff30 31622651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
d9afffb0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)