Task 12193522

Name ParityModified-1645992892-25400-0_0
Workunit 9374698
Created 27 Feb 2022, 20:14:53 UTC
Sent 1 Mar 2022, 2:09:14 UTC
Report deadline 9 Mar 2022, 2:09:14 UTC
Received 1 Mar 2022, 6:27:52 UTC
Server state Over
Outcome Computation error
Client state Aborted by user
Exit status 203 (0x000000CB) EXIT_ABORTED_VIA_GUI
Computer ID 10156
Run time 2 hours 45 min 52 sec
CPU time 52 min 47 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 15,672.14 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 2.59 GB
Peak swap size 4.40 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.14.2</core_client_version>
<![CDATA[
<message>
aborted by user</message>
<stderr_txt>
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3080)
[2022-02-28 19:41:32	                main:435]	:	INFO	:	Set logging level to 1
[2022-02-28 19:41:32	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-02-28 19:41:32	                main:444]	:	INFO	:	Resolving all filenames
[2022-02-28 19:41:32	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-02-28 19:41:32	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 0)
[2022-02-28 19:41:32	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-02-28 19:41:32	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 0)
[2022-02-28 19:41:32	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2022-02-28 19:41:32	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-02-28 19:41:32	                main:474]	:	INFO	:	Configuration: 
[2022-02-28 19:41:32	                main:475]	:	INFO	:	    Model type: GRU
[2022-02-28 19:41:32	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-02-28 19:41:32	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-02-28 19:41:32	                main:478]	:	INFO	:	    Batch Size: 128
[2022-02-28 19:41:32	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-02-28 19:41:32	                main:480]	:	INFO	:	    Patience: 10
[2022-02-28 19:41:32	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-02-28 19:41:32	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-02-28 19:41:32	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-02-28 19:41:32	                main:484]	:	INFO	:	    # Threads: 1
[2022-02-28 19:41:32	                main:486]	:	INFO	:	Preparing Dataset
[2022-02-28 19:41:32	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-02-28 19:41:33	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-02-28 21:35:38	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-02-28 21:35:38	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-02-28 21:35:38	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-02-28 21:35:38	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-02-28 21:35:38	                main:494]	:	INFO	:	Creating Model
[2022-02-28 21:35:38	                main:507]	:	INFO	:	Preparing config file
[2022-02-28 21:35:38	                main:519]	:	INFO	:	Creating new config file


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFE251990D2

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 02/28/22 22:27:23
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\2;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 0000000016e50000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000027670000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 0000000025f60000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 00000000250d0000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 0000000027160000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000256a0000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 0000000026fc0000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202

ModLoad: 00000000254f0000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 00000000253a0000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 0000000024fd0000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 00000000266e0000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000027300000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.19041.546

ModLoad: 0000000026020000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000026460000 0000000000125000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000fe450000 0000000000058000 C:\ProgramData\BOINC\slots\2\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000000eb20000 0000000000091000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.27.29112.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.27.29112.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.27.29112.0

ModLoad: 00000000132b0000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.867

ModLoad: 000000000ebc0000 0000000000019000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.27.29112.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.27.29112.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.27.29112.0

ModLoad: 000000000eb10000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.27.29112.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.27.29112.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.27.29112.0

ModLoad: 000000002a060000 000000000abe7000 C:\ProgramData\BOINC\slots\2\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000036440000 00000000002db000 C:\ProgramData\BOINC\slots\2\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000036230000 000000000020d000 C:\ProgramData\BOINC\slots\2\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 000000000b5a0000 0000000000040000 C:\ProgramData\BOINC\slots\2\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000005510000 0000000024b49000 C:\ProgramData\BOINC\slots\2\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000f61e0000 0000000000045000 C:\ProgramData\BOINC\slots\2\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000002050000 00000000034b2000 C:\ProgramData\BOINC\slots\2\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 000000000ff10000 0000000000010000 C:\ProgramData\BOINC\slots\2\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 00000000fefa0000 00000000030a5000 C:\ProgramData\BOINC\slots\2\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 00000000f5e00000 000000000919f000 C:\ProgramData\BOINC\slots\2\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000f20a0000 0000000003d5b000 C:\ProgramData\BOINC\slots\2\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000d6cf0000 000000001b3a4000 C:\ProgramData\BOINC\slots\2\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 00000000d4e20000 0000000001eca000 C:\ProgramData\BOINC\slots\2\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000260c0000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000022cc0000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000026850000 0000000000470000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000024f80000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 0000000025670000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000024b30000 0000000000033000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 0000000025600000 0000000000068000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 0000000024d90000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000024970000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000025810000 0000000000744000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.19041.964 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.964

ModLoad: 0000000022ec0000 0000000000794000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000026100000 0000000000354000 C:\WINDOWS\System32\combase.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.19041.1320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1320

ModLoad: 00000000247f0000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000026f10000 00000000000ad000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000027100000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000beee0000 00000000002cd000 C:\WINDOWS\system32\nvcuda.dll (30.0.15.1165) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_37\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 30.0.15.1165
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.6.99 driver
    Product Version       : 30.0.15.1165

ModLoad: 00000000a22f0000 00000000016a0000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispig.inf_amd64_31a2adf8c49e7799\nvcuda64.dll (30.0.15.1165) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_37\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 30.0.15.1165
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.6.99 driver
    Product Version       : 30.0.15.1165

ModLoad: 000000001e4e0000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000001e4a0000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.19041.906 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.906

ModLoad: 000000001c0e0000 0000000000148000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.19041.1566) (-exported- Symbols Loaded)
    Linked PDB Filename   : drvstore.pdb
    File Version          : 10.0.19041.1566 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1566

ModLoad: 0000000024740000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000018040000 0000000000768000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.15.1165) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_37\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 30.0.15.1165
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 30.0.15.1165

ModLoad: 0000000036720000 00000000008b3000 C:\WINDOWS\System32\DriverStore\FileRepository\nv_dispig.inf_amd64_31a2adf8c49e7799\nvptxJitCompiler64.dll (30.0.15.1165) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 30.0.15.1165
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows PTX JIT Compiler
    Product Version       : 30.0.15.1165

ModLoad: 0000000024ef0000 0000000000082000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.19041.1415 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1415



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 4597, Write: 2561, Other 13087

- I/O Transfers Counters -
Read: 55083708, Write: 1848456688, Other 43458

- Paged Pool Usage -
QuotaPagedPoolUsage: 3478184, QuotaPeakPagedPoolUsage: 3478184
QuotaNonPagedPoolUsage: 53712, QuotaPeakNonPagedPoolUsage: 75880

- Virtual Memory Usage -
VirtualSize: -249384960, PeakVirtualSize: 942272512

- Pagefile Usage -
PagefileUsage: -249384960, PeakPagefileUsage: 479682560

- Working Set Size -
WorkingSetSize: 2096955392, PeakWorkingSetSize: -1470341120, PageFaultCount: 30067576

*** Dump of thread ID 2496 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 44863616.000000

- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFE251990D2

- Registers -
rax=0000000000000000 rbx=0000000000000001 rcx=0000000017108c40 rdx=00000000f98feb70 rsi=0000000000000000 rdi=0000000000000000
r8=00000000f98feb70 r9=0000000017108c30 r10=0000000000000fff r11=0000000000000ff0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000251990d2 rsp=00000000f98feb48 rbp=0000000000000000
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
f98feb40 16e89100 00000001 f98feb70 f98feb70 17108c30 KERNELBASE!DebugBreak+0x0 
f98fef80 16e89ce4 00000000 f98ff2e4 00000000 00000364 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
f98ffee0 16e8a084 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
f98fff10 25f77034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
f98fff40 276c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
f98fffc0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 4248 (state: Ready): ***

- Information -
Status: Base Priority: Above Normal, Priority: Above Normal, , Kernel Time: 2816250112.000000, User Time: 28852969472.000000, Wait Time: 44863616.000000

- Registers -
rax=0000000000001018 rbx=0000000000000000 rcx=0000000000001018 rdx=0000000000000000 rsi=0000000000000000 rdi=0000000042ecfd58
r8=0000000000000000 r9=0000000000000000 r10=0000000000001e10 r11=00000000f9130af8 r12=000000000000000e r13=0000000000000000
r14=0000000042a916e0 r15=00000000000010af rip=00000000367cecee rsp=00000000f9130a90 rbp=0000000036cf8010
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
f9130af0 3680ee14 42aa5188 42a94610 42a91600 00000000 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0 
f9130c60 367f0cd2 42ee4ac0 42ee4ac0 42a916e0 f9130e50 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0 
f9130d00 367f0dc3 00000010 42ee4ac0 00000010 f9130e50 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0 
f9130e00 367c7c99 00000000 42a972a8 42a916e0 f9131030 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0 
f9130ec0 36947b12 99071060 00000007 99071060 cab7a888 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0 
f9130ef0 36721ff9 99071060 c6b3ebc0 3672c310 c6b3ebc0 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0 
f9130f20 367281c1 565a4638 00000000 99071060 f9131030 nvptxJitCompiler64!+0x0 
f9131180 36724a12 da3dce18 f9131350 545041f8 545041f8 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
f9131510 36726c92 0afed668 00000005 d815a0f8 00000005 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
f91315a0 3672fa60 c6b3ebc0 f91316b0 00000000 00000005 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
f9131770 3672282b a2566dfa 00000001 00000000 00200000 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
f91326c0 a2774f5a 00000001 00000005 f9132720 f91326f0 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0 
f9132930 a2775200 fbad3910 9ab164f8 00000056 fbb17775 nvcuda64!cuProfilerStop+0x0 
f9132b20 a247c961 f9132da0 00000000 f9132da0 00000002 nvcuda64!cuProfilerStop+0x0 
f9132be0 a247cd3e fbae8190 00000000 f9132da0 00519de8 nvcuda64!+0x0 
f9132ca0 a247cff0 f9132f20 f9132f01 f9132da0 f9132d89 nvcuda64!+0x0 
f9132d60 a249e892 00000000 fa5b1ee0 fa380150 00000001 nvcuda64!+0x0 
f9132e50 a2397961 00000000 f2056720 00001098 f9133000 nvcuda64!+0x0 
f9132ec0 a2397ac7 cd7cdfa0 f2056720 00000000 22000321 nvcuda64!+0x0 
f9132fb0 a2398641 00000000 00000000 00000000 f9133041 nvcuda64!+0x0 
f9133090 d7a9a6f3 00000000 00000000 f2056720 d7a99a61 nvcuda64!+0x0 
f9133110 d7a989e9 fa4bffd0 fa4c2b90 00000000 d7a989d0 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
f9133140 d7a9962b fa4c2b88 fa4c3078 fa380101 fa34d350 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
f9133180 d7a9c449 fa454e08 fa454e08 00000000 fa454de8 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
f9133200 d7a9c061 00000001 00000001 00000001 fa4b3740 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
f9133240 d7a9ce83 00000000 fa380860 00000628 f9132f60 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
f9133270 d7a930d2 00000000 00000628 f9132f60 d7a930c5 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
f91332a0 d7a90d21 fa380860 e36d4828 00000000 fa4b3740 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
f9133370 d6cf5925 e36d47d0 00000000 00000000 00000000 cudnn64_7!cudnnSetDropoutDescriptor+0x0 
f91353f0 08352139 00000000 d7095e20 d7095e20 00000002 cudnn64_7!cudnnCreate+0x0 
f91355a0 08351aad 9af22350 00000000 00000000 000000d0 torch_cuda!at::native::TensorDescriptor::set+0x0 
f9135610 08352a27 9af22350 f9135720 9af22350 9af22330 torch_cuda!at::native::TensorDescriptor::set+0x0 
f9135870 08352557 f9c37790 f9136030 f9c37790 e1ee0f20 torch_cuda!at::native::getCudnnHandle+0x0 
f9135a20 0828d642 00000000 00000001 00000000 000003e7 torch_cuda!at::native::getCudnnHandle+0x0 
f9135ed0 082e296d f9135f58 00000001 f9135f58 f9136030 torch_cuda!at::native::_cudnn_rnn_flatten_weight+0x0 
f9135fb0 082f4124 00000000 f9df0000 f9df02ac fe46ef8f torch_cuda!at::native::set_storage_cuda_+0x0 
f9136020 2fae36ca f9136098 f9df12c0 f9df0000 f9df0000 torch_cuda!at::native::set_storage_cuda_+0x0 
f9136290 30e6ecf2 00000000 00000000 00000000 f91363a0 torch_cpu!at::_cudnn_rnn_flatten_weight+0x0 
f9136490 30e796c9 faa5cdc0 2f6ae8dd 00000004 00000009 torch_cpu!torch::autograd::GraphRoot::apply+0x0 
f9136500 2fae36ca f9136578 00000003 f9136580 f9136610 torch_cpu!torch::autograd::GraphRoot::apply+0x0 
f9136770 31605fce 00000001 00000001 f9136860 00000001 torch_cpu!at::_cudnn_rnn_flatten_weight+0x0 
f9136890 31552940 726f5462 e488f930 f9136af8 e488fa50 torch_cpu!torch::nn::detail::RNNImplBase<torch::nn::RNNImpl>::flatten_parameters+0x0 
f9136ab0 31557b3c f17b8cbb f9137280 00000001 f9136be0 torch_cpu!torch::nn::init::zeros_+0x0 
f9136ae0 16e6b741 f9136be0 00000001 00000000 00000080 torch_cpu!torch::nn::Module::to+0x0 
f914f880 170ac6f8 fb8c94e0 00000000 00000000 fb935e50 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
f914f8c0 25f77034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
f914f8f0 276c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
f914f970 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 7860 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 44863616.000000

- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=00000000f99ff530 rsi=0000000000000000 rdi=000000000000000d
r8=00000000fbb17383 r9=000000007ffea000 r10=00000000546c6148 r11=00000000e99c736c r12=0000000000000064 r13=00000000f99ff530
r14=00000000f99ff230 r15=0000000000000000 rip=000000002770d8c4 rsp=00000000f99ff1d8 rbp=00000000fb9f3380
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
f99ff1d0 2511cb20 00000000 f92db000 277da4d0 f92db000 ntdll!ZwWaitForMultipleObjects+0x0 
f99ff4c0 2511ca1e f9c343e0 004e0049 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
f99ff500 a24cd554 fb9f7640 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
f99ff740 a25758cd 00000000 fb9f3380 00000000 00000000 nvcuda64!+0x0 
f99ff7f0 a24ccf23 216a0231 05cb0703 fbfe5ba0 00000000 nvcuda64!cuProfilerStop+0x0 
f99ff820 a28044c4 fbfe5ba0 00000000 00000000 00000000 nvcuda64!+0x0 
f99ff850 25f77034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
f99ff880 276c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
f99ff900 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 13268 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 44226888.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002d0 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002d0
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=00000000fba4fb30 r13=0000000000000000
r14=00000000000002d0 r15=0000000000000000 rip=000000002770cdf4 rsp=00000000f9affa38 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
f9affa30 250f1a5e 00000000 00001f80 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0 
f9affad0 a26f5d0e fbfd6a20 00000000 00000000 000002d0 KERNELBASE!WaitForSingleObjectEx+0x0 
f9affd10 a24ccf23 00000000 fbfd6a20 a22f0000 fb8bbf60 nvcuda64!cuProfilerStop+0x0 
f9affd40 a28044c4 fbfd6a20 00000000 00000000 00000000 nvcuda64!+0x0 
f9affd70 25f77034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
f9affda0 276c2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
f9affe20 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)