Task 3775635

Name ParityModified-1608176853-31735-6_1
Workunit 1928827
Created 22 Jan 2021, 8:40:52 UTC
Sent 22 Jan 2021, 9:21:22 UTC
Report deadline 29 Jan 2021, 9:21:22 UTC
Received 22 Jan 2021, 22:11:10 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 197 (0x000000C5) EXIT_TIME_LIMIT_EXCEEDED
Computer ID 2158
Run time 8 hours 47 min 54 sec
CPU time 8 hours 37 min 39 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 8,879.79 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 251.42 MB
Peak swap size 1.42 GB
Peak disk usage 1.53 GB

Stderr output

<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
exceeded elapsed time limit 31672.95 (4000000.00G/126.29G)</message>
<stderr_txt>
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 1080)
[2021-01-22 05:21:53	                main:435]	:	INFO	:	Set logging level to 1
[2021-01-22 05:21:53	                main:441]	:	INFO	:	Running in BOINC Client mode
[2021-01-22 05:21:53	                main:444]	:	INFO	:	Resolving all filenames
[2021-01-22 05:21:53	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1)
[2021-01-22 05:21:53	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1608176853-31735-6_1_r1328787688_1 (exists = 0)
[2021-01-22 05:21:53	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1608176853-31735-6_1_r1328787688_0 (exists = 0)
[2021-01-22 05:21:53	                main:452]	:	INFO	:	Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1608176853-31735-6 (exists = 1)
[2021-01-22 05:21:53	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2021-01-22 05:21:53	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5
[2021-01-22 05:21:53	                main:474]	:	INFO	:	Configuration: 
[2021-01-22 05:21:53	                main:475]	:	INFO	:	    Model type: GRU
[2021-01-22 05:21:53	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2021-01-22 05:21:53	                main:477]	:	INFO	:	    Max Epochs: 2048
[2021-01-22 05:21:53	                main:478]	:	INFO	:	    Batch Size: 128
[2021-01-22 05:21:53	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2021-01-22 05:21:53	                main:480]	:	INFO	:	    Patience: 10
[2021-01-22 05:21:53	                main:481]	:	INFO	:	    Hidden Width: 12
[2021-01-22 05:21:53	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2021-01-22 05:21:53	                main:483]	:	INFO	:	    # Backend Layers: 4
[2021-01-22 05:21:53	                main:484]	:	INFO	:	    # Threads: 1
[2021-01-22 05:21:53	                main:486]	:	INFO	:	Preparing Dataset
[2021-01-22 05:21:53	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-01-22 05:21:53	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FF9B2A59AD2

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 01/22/21 14:09:42
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\34;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 000000009b400000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000b4eb0000 00000000001f6000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.662) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.19041.662 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.662

ModLoad: 00000000b40f0000 00000000000bd000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.662) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.19041.662 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.662

ModLoad: 00000000b2990000 00000000002c9000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.662) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.19041.662 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.662

ModLoad: 00000000b3bf0000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000b2960000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.19041.746 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.746

ModLoad: 00000000b4310000 000000000002a000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.19041.746 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.746

ModLoad: 00000000b2850000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.19041.746 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.746

ModLoad: 00000000b2e70000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000b2750000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000b4a00000 00000000000ac000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.610) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000b4830000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.19041.546

ModLoad: 00000000b48d0000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000b3eb0000 000000000012b000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000a7310000 0000000000058000 C:\ProgramData\BOINC\slots\34\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000841c0000 000000000009d000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.0.24215.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp140.amd64.pdb
    File Version          : 14.00.24215.1 built by: VCTOOLSD14ULDR
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174; 2015
    Product Version       : 14.00.24215.1

ModLoad: 00000000ac610000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.488) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.19041.488 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.488

ModLoad: 000000009ba50000 0000000000017000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.0.24215.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : vcruntime140.amd64.pdb
    File Version          : 14.00.24215.1 built by: VCTOOLSD14ULDR
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174; 2015
    Product Version       : 14.00.24215.1

ModLoad: 00000000aa0c0000 000000000000c000 C:\ProgramData\BOINC\slots\34\VCRUNTIME140_1.dll (14.27.29112.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.27.29112.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.27.29112.0

ModLoad: 0000000034850000 000000000abe7000 C:\ProgramData\BOINC\slots\34\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000079f30000 00000000002db000 C:\ProgramData\BOINC\slots\34\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000007bb10000 000000000020d000 C:\ProgramData\BOINC\slots\34\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 000000009a670000 0000000000040000 C:\ProgramData\BOINC\slots\34\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000000fd00000 0000000024b49000 C:\ProgramData\BOINC\slots\34\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000009a550000 0000000000045000 C:\ProgramData\BOINC\slots\34\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000000c840000 00000000034b2000 C:\ProgramData\BOINC\slots\34\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000a9d30000 0000000000010000 C:\ProgramData\BOINC\slots\34\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 0000000009790000 00000000030a5000 C:\ProgramData\BOINC\slots\34\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 00000000ee3e0000 000000001b3a4000 C:\ProgramData\BOINC\slots\34\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 00000000ea680000 0000000003d5b000 C:\ProgramData\BOINC\slots\34\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000be000000 000000000919f000 C:\ProgramData\BOINC\slots\34\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000e87b0000 0000000001eca000 C:\ProgramData\BOINC\slots\34\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000b4970000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000b0570000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000b43c0000 0000000000467000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000b2e20000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000b25f0000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.662) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000b2390000 000000000002c000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000b2dc0000 0000000000060000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.662) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.19041.662 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.662

ModLoad: 00000000b2c60000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000b21d0000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000b31a0000 0000000000743000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.19041.329 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.329

ModLoad: 00000000b0770000 000000000078f000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000b4ab0000 0000000000356000 C:\WINDOWS\System32\combase.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000b2050000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.662) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000b3b40000 00000000000ae000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000b49a0000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000009a140000 0000000000244000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.5167) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r450\r451_65\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 27.21.14.5167
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.0.208 driver
    Product Version       : 27.21.14.5167

ModLoad: 00000000ad1c0000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000007a5d0000 0000000001338000 C:\WINDOWS\system32\DriverStore\FileRepository\nvdd.inf_amd64_37dfa884d4a14547\nvcuda64.dll (27.21.14.5167) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r450\r451_65\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 27.21.14.5167
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.0.208 driver
    Product Version       : 27.21.14.5167

ModLoad: 00000000b4210000 000000000006b000 C:\WINDOWS\System32\WS2_32.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : ws2_32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000affd0000 000000000009e000 C:\WINDOWS\system32\uxtheme.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : UxTheme.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000098890000 0000000000554000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.5167) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r450\r451_65\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 27.21.14.5167
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 27.21.14.5167

ModLoad: 00000000b38f0000 000000000012a000 C:\WINDOWS\System32\OLE32.DLL (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : ole32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000b0f40000 00000000000f3000 C:\WINDOWS\SYSTEM32\dxgi.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : dxgi.pdb
    File Version          : 10.0.19041.746 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.746

ModLoad: 00000000b26d0000 0000000000080000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.662) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.19041.662 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.662



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 2399, Write: 273, Other 817

- I/O Transfers Counters -
Read: 5106080, Write: 5480, Other 23756

- Paged Pool Usage -
QuotaPagedPoolUsage: 3405104, QuotaPeakPagedPoolUsage: 3405328
QuotaNonPagedPoolUsage: 20936, QuotaPeakNonPagedPoolUsage: 21344

- Virtual Memory Usage -
VirtualSize: 1522909184, PeakVirtualSize: -2144731136

- Pagefile Usage -
PagefileUsage: 1522909184, PeakPagefileUsage: 1522909184

- Working Set Size -
WorkingSetSize: 225980416, PeakWorkingSetSize: 263634944, PageFaultCount: 68094

*** Dump of thread ID 12480 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 156250.000000, Wait Time: 52203504.000000

- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FF9B2A59AD2

- Registers -
rax=0000000000000000 rbx=0000000000000001 rcx=000000009b6b8c40 rdx=000000004cafeaf0 rsi=0000000000000000 rdi=0000000000000000
r8=000000004cafeaf0 r9=000000009b6b8c30 r10=0000000000000fff r11=0000000000000ff0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000b2a59ad2 rsp=000000004cafeac8 rbp=0000000000000000
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
4cafeac0 9b439100 00000001 4cafeaf0 4cafeaf0 9b6b8c30 KERNELBASE!DebugBreak+0x0 
4cafef00 9b439ce4 4c800000 4caff264 00000000 000002d4 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
4caffe60 9b43a084 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
4caffe90 b4107034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
4caffec0 b4efd0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
4cafff40 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 11940 (state: Running): ***

- Information -
Status: Base Priority: Above Normal, Priority: Above Normal, , Kernel Time: 40156248.000000, User Time: 310556884992.000000, Wait Time: 52203452.000000

- Registers -
rax=000000003b91c3d0 rbx=0000000000000008 rcx=000000004c374378 rdx=000000004c3743c0 rsi=000000003b1dced0 rdi=00000000000000fe
r8=0000000000000001 r9=0000000000000000 r10=0000000000000000 r11=000000003b8f4d88 r12=00000000000000ff r13=000000003b91c400
r14=0000000000000000 r15=0000000000000000 rip=000000007a84e04e rsp=000000004c374270 rbp=000000004c374309
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000257

- Callstack -
ChildEBP RetAddr  Args to Child
4c3742b0 7a84f086 4c374378 00000008 4c374309 3b1dced0 nvcuda64!cuProfilerStop+0x0 
4c374360 7a6458eb 00000008 00000003 6bd6077b 00000001 nvcuda64!cuProfilerStop+0x0 
4c3744c0 7a70bbfd 00000000 3af63d80 3af63d80 3ad549c0 nvcuda64!+0x0 
4c374ed0 7a7115f3 00000000 393612c0 39250e00 39360000 nvcuda64!+0x0 
4c374f00 7a5f6a83 00000090 7a76e70c 39260000 00000000 nvcuda64!+0x0 
4c374f30 7a7a1b61 4c374fb9 39250e00 3af737b0 00000000 nvcuda64!+0x0 
4c375010 9a55b83c 00000001 00000001 000003e7 00000000 nvcuda64!cuDevicePrimaryCtxRetain+0x0 
4c375040 9a55b6e3 00000001 00000000 00000000 39276b10 c10_cuda!+0x0 
4c375090 9a55b5a6 00000001 00000002 00000000 39250e00 c10_cuda!+0x0 
4c3750d0 9a55c413 00000000 39250860 00000100 14040000 c10_cuda!+0x0 
4c375100 9a55317d 00000000 00000100 14040000 9a553165 c10_cuda!+0x0 
4c375130 9a552160 3b476e90 39250860 4c3752c8 4c375310 c10_cuda!+0x0 
4c375200 9a56fe6c 3b476e90 00000000 00000000 00000000 c10_cuda!+0x0 
4c3755d0 9a57083a a2db0001 00010001 9a58b5e0 9a55fc8f c10_cuda!c10::cuda::CUDACachingAllocator::init+0x0 
4c375770 9a565099 00000000 00000000 4c375d10 00000000 c10_cuda!c10::cuda::CUDACachingAllocator::init+0x0 
4c375940 12b27cf1 3b476fe0 00000000 00000001 00000000 c10_cuda!c10::cuda::CUDAStream::unpack+0x0 
4c3759d0 121f4677 3af89c40 00000001 4c375c10 4c375ae0 torch_cuda!THCStorage_resizeBytes+0x0 
4c375bc0 129d2514 4c375f90 4c376228 4c375cf0 4c375c80 torch_cuda!at::native::replication_pad3d_out_cuda+0x0 
4c375c40 12ae8b65 4c375d10 00010000 00000000 00000001 torch_cuda!at::native::empty_strided_cuda+0x0 
4c375cb0 12ae41d9 00010001 4c375d60 4c375e10 39d96e60 torch_cuda!at::native::set_storage_cuda_+0x0 
4c375d00 3a222647 3b02c0d0 4c375d90 4c375d90 4c375e10 torch_cuda!at::native::set_storage_cuda_+0x0 
4c375f50 3a2204ce 4c376070 39e3bfac 3f170601 39e2deca torch_cpu!at::native::mkldnn_sigmoid_+0x0 
4c375fa0 3a303ade 4c376000 3f170640 ffffffff 3f170668 torch_cpu!at::native::mkldnn_sigmoid_+0x0 
4c3761f0 3b596c7d 00000000 4c3762a0 00000030 39360cc0 torch_cpu!at::empty_strided+0x0 
4c376270 3a2204ce 00000020 3f170640 39d96e60 3d0924d6 torch_cpu!torch::autograd::GraphRoot::apply+0x0 
4c3762c0 3a303ade 4c376320 3f170640 4c376350 4c3763d0 torch_cpu!at::native::mkldnn_sigmoid_+0x0 
4c376510 3a0ba37e 4c3766d0 a732a8c0 3926b6f0 4c3765a0 torch_cpu!at::empty_strided+0x0 
4c3765c0 3a0b9c19 4c376b68 4c3775a0 4c3768d0 4c376b68 torch_cpu!at::native::to_dense_backward+0x0 
4c3767d0 3a3de363 9bd9d057 00000000 00000002 00000002 torch_cpu!at::native::to+0x0 
4c376810 3b646573 4c370000 3afe9880 4c376850 0000657a torch_cpu!at::zeros_out+0x0 
4c376850 3a2202f2 4c370000 3d0924d6 9055608b 4c3775a0 torch_cpu!torch::autograd::GraphRoot::apply+0x0 
4c376890 3a411222 4c370000 00000000 4c376918 4c3769a0 torch_cpu!at::native::mkldnn_sigmoid_+0x0 
4c376ad0 9b41cd74 4c377530 4c377530 4c377530 00000000 torch_cpu!at::Tensor::to+0x0 
4c376ce0 9b41af96 4c3775c0 4c376e60 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
4c38fa80 9b65c6f8 3ad55450 00000000 00000000 3aa4fb90 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
4c38fac0 b4107034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
4c38faf0 b4efd0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
4c38fb70 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 14368 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 312500.000000, User Time: 156250.000000, Wait Time: 52203504.000000

- Registers -
rax=000000000000005b rbx=0000000000000008 rcx=0000000000000008 rdx=000000004cbff7f0 rsi=0000000000000000 rdi=0000000000000008
r8=000000003b1d7e10 r9=000000003af898e0 r10=0000000000000000 r11=000000004cbff760 r12=0000000000000064 r13=000000004cbff7f0
r14=000000004cbff4f0 r15=0000000000000000 rip=00000000b4f4cb04 rsp=000000004cbff498 rbp=000000003af898e0
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
4cbff490 b29e0d40 00000000 4c47c000 b501b4d0 4c47c000 ntdll!NtWaitForMultipleObjects+0x0 
4cbff780 b29e0c3e 39273ff0 004e0049 00000008 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
4cbff7c0 7a7821b4 3af88e60 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
4cbffa00 7a81c95d 00000000 00000004 00000000 00000000 nvcuda64!+0x0 
4cbffab0 7a781b83 276ea9c2 6bd601e3 3b4773d0 00000000 nvcuda64!cuProfilerStop+0x0 
4cbffae0 7aa6f450 3b4773d0 00000000 00000000 00000000 nvcuda64!+0x0 
4cbffb10 b4107034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
4cbffb40 b4efd0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
4cbffbc0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 11452 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 50176776.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002a8 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002a8
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=000000003af64250 r13=0000000000000000
r14=00000000000002a8 r15=0000000000000000 rip=00000000b4f4c034 rsp=000000004ccff9d8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
4ccff9d0 b29aa34e 00000000 00000000 00000000 00000000 ntdll!NtWaitForSingleObject+0x0 
4ccffa70 7a98abd8 00000000 b29b2cb5 00000000 000002a8 KERNELBASE!WaitForSingleObjectEx+0x0 
4ccffae0 7a781b83 00000001 3b7c7370 3b4778e0 00000000 nvcuda64!cuProfilerStop+0x0 
4ccffb10 7aa6f450 3b4778e0 00000000 00000000 00000000 nvcuda64!+0x0 
4ccffb40 b4107034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
4ccffb70 b4efd0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
4ccffbf0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)