Task 3753674

Name ParityModified-1611091513-4526-2_0
Workunit 1929592
Created 22 Jan 2021, 1:36:28 UTC
Sent 22 Jan 2021, 11:47:31 UTC
Report deadline 29 Jan 2021, 11:47:31 UTC
Received 22 Jan 2021, 20:41:00 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 197 (0x000000C5) EXIT_TIME_LIMIT_EXCEEDED
Computer ID 2874
Run time 7 hours 51 min 22 sec
CPU time 7 hours 50 min 52 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 8,879.54 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 250.54 MB
Peak swap size 1.42 GB
Peak disk usage 1.53 GB

Stderr output

<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
exceeded elapsed time limit 28281.67 (4000000.00G/141.17G)</message>
<stderr_txt>
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 1080)
[2021-01-22 04:48:10	                main:435]	:	INFO	:	Set logging level to 1
[2021-01-22 04:48:10	                main:441]	:	INFO	:	Running in BOINC Client mode
[2021-01-22 04:48:10	                main:444]	:	INFO	:	Resolving all filenames
[2021-01-22 04:48:10	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1)
[2021-01-22 04:48:10	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1611091513-4526-2_0_r1587281169_1 (exists = 0)
[2021-01-22 04:48:10	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1611091513-4526-2_0_r1587281169_0 (exists = 0)
[2021-01-22 04:48:10	                main:452]	:	INFO	:	Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1611091513-4526-2 (exists = 1)
[2021-01-22 04:48:10	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2021-01-22 04:48:10	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5
[2021-01-22 04:48:10	                main:474]	:	INFO	:	Configuration: 
[2021-01-22 04:48:10	                main:475]	:	INFO	:	    Model type: GRU
[2021-01-22 04:48:10	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2021-01-22 04:48:10	                main:477]	:	INFO	:	    Max Epochs: 2048
[2021-01-22 04:48:11	                main:478]	:	INFO	:	    Batch Size: 128
[2021-01-22 04:48:11	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2021-01-22 04:48:11	                main:480]	:	INFO	:	    Patience: 10
[2021-01-22 04:48:11	                main:481]	:	INFO	:	    Hidden Width: 12
[2021-01-22 04:48:11	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2021-01-22 04:48:11	                main:483]	:	INFO	:	    # Backend Layers: 4
[2021-01-22 04:48:11	                main:484]	:	INFO	:	    # Threads: 1
[2021-01-22 04:48:11	                main:486]	:	INFO	:	Preparing Dataset
[2021-01-22 04:48:11	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-01-22 04:48:11	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFD915E9AD2

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 01/22/21 12:39:31
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\34;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 00000000b4d60000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000093a70000 00000000001f6000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.662) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.19041.662 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.662

ModLoad: 0000000092430000 00000000000bd000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.662) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.19041.662 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.662

ModLoad: 0000000091520000 00000000002c9000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.662) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.19041.662 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.662

ModLoad: 0000000093580000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000911e0000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.19041.746 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.746

ModLoad: 0000000093550000 000000000002a000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.19041.746 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.746

ModLoad: 0000000091920000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.19041.746 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.746

ModLoad: 0000000091a30000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000091210000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000092980000 00000000000ac000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.610) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000924f0000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.19041.546

ModLoad: 00000000938c0000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000093420000 000000000012b000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000076860000 0000000000058000 C:\ProgramData\BOINC\slots\34\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000067580000 000000000009b000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.16.27012.6) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\agent\_work\2\s\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.16.27012.6 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174; 2017
    Product Version       : 14.16.27012.6

ModLoad: 000000008ad20000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.488) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.19041.488 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.488

ModLoad: 000000006d5a0000 0000000000015000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.16.27012.6) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\agent\_work\2\s\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.16.27012.6 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174; 2017
    Product Version       : 14.16.27012.6

ModLoad: 000000008c1d0000 000000000000c000 C:\ProgramData\BOINC\slots\34\VCRUNTIME140_1.dll (14.27.29112.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.27.29112.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.27.29112.0

ModLoad: 0000000001bf0000 000000000abe7000 C:\ProgramData\BOINC\slots\34\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000652c0000 00000000002db000 C:\ProgramData\BOINC\slots\34\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000061600000 000000000020d000 C:\ProgramData\BOINC\slots\34\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 0000000075df0000 0000000000040000 C:\ProgramData\BOINC\slots\34\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000c79c0000 0000000024b49000 C:\ProgramData\BOINC\slots\34\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000073a70000 0000000000045000 C:\ProgramData\BOINC\slots\34\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000fe730000 00000000034b2000 C:\ProgramData\BOINC\slots\34\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 000000008b650000 0000000000010000 C:\ProgramData\BOINC\slots\34\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 00000000be820000 000000000919f000 C:\ProgramData\BOINC\slots\34\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000fb680000 00000000030a5000 C:\ProgramData\BOINC\slots\34\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 00000000a3470000 000000001b3a4000 C:\ProgramData\BOINC\slots\34\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 000000007c8d0000 0000000003d5b000 C:\ProgramData\BOINC\slots\34\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 000000007aa00000 0000000001eca000 C:\ProgramData\BOINC\slots\34\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 0000000092640000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000008fab0000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000092a30000 0000000000467000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000091850000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000911b0000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.662) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000090f50000 000000000002c000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000917f0000 0000000000060000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.662) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.19041.662 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.662

ModLoad: 00000000913c0000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000090d90000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000091b30000 0000000000743000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.19041.329 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.329

ModLoad: 000000008f2e0000 000000000078f000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000092ea0000 0000000000356000 C:\WINDOWS\System32\combase.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000090c10000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.662) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000928d0000 00000000000ae000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000091ad0000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000077f40000 0000000000244000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.5167) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r450\r451_65\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 27.21.14.5167
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.0.208 driver
    Product Version       : 27.21.14.5167

ModLoad: 000000008b440000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000049a50000 0000000001338000 C:\WINDOWS\system32\DriverStore\FileRepository\nvdd.inf_amd64_37dfa884d4a14547\nvcuda64.dll (27.21.14.5167) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r450\r451_65\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 27.21.14.5167
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.0.208 driver
    Product Version       : 27.21.14.5167

ModLoad: 00000000933b0000 000000000006b000 C:\WINDOWS\System32\WS2_32.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : ws2_32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000008eb00000 000000000009e000 C:\WINDOWS\system32\uxtheme.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : UxTheme.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000762c0000 0000000000554000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.5167) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r450\r451_65\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 27.21.14.5167
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 27.21.14.5167

ModLoad: 0000000092700000 000000000012a000 C:\WINDOWS\System32\OLE32.DLL (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : ole32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000008fb00000 00000000000f3000 C:\WINDOWS\SYSTEM32\dxgi.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : dxgi.pdb
    File Version          : 10.0.19041.746 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.746

ModLoad: 00000000918a0000 0000000000080000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.662) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.19041.662 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.662



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 2399, Write: 272, Other 817

- I/O Transfers Counters -
Read: 5106048, Write: 5474, Other 23704

- Paged Pool Usage -
QuotaPagedPoolUsage: 3398544, QuotaPeakPagedPoolUsage: 3398768
QuotaNonPagedPoolUsage: 20936, QuotaPeakNonPagedPoolUsage: 21344

- Virtual Memory Usage -
VirtualSize: 1522106368, PeakVirtualSize: -2144718848

- Pagefile Usage -
PagefileUsage: 1522106368, PeakPagefileUsage: 1522106368

- Working Set Size -
WorkingSetSize: 263380992, PeakWorkingSetSize: 263385088, PageFaultCount: 67518

*** Dump of thread ID 14844 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 625000.000000, User Time: 468750.000000, Wait Time: 52063936.000000

- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFD915E9AD2

- Registers -
rax=0000000000000000 rbx=0000000000000001 rcx=00000000b5018c40 rdx=00000000dcffe970 rsi=0000000000000000 rdi=0000000000000000
r8=00000000dcffe970 r9=00000000b5018c30 r10=0000000000000fff r11=0000000000000ff0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000915e9ad2 rsp=00000000dcffe948 rbp=0000000000000000
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
dcffe940 b4d99100 00000001 dcffe970 dcffe970 b5018c30 KERNELBASE!DebugBreak+0x0 
dcffed80 b4d99ce4 2f400000 dcfff0e4 00000000 000002f0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
dcfffce0 b4d9a084 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
dcfffd10 92447034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
dcfffd40 93abd0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
dcfffdc0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 4108 (state: Running): ***

- Information -
Status: Base Priority: Above Normal, Priority: Above Normal, , Kernel Time: 19375000.000000, User Time: 282459373568.000000, Wait Time: 52063900.000000

- Registers -
rax=0000000035fb1bb0 rbx=0000000000000008 rcx=00000000dcae4290 rdx=00000000dcae4290 rsi=00000000286c9440 rdi=0000000000000000
r8=0000000000000001 r9=0000000000000000 r10=0000000000000000 r11=00000000287f8a08 r12=0000000000000001 r13=0000000035fb1b00
r14=00000000dcae4290 r15=0000000000000001 rip=0000000049cce740 rsp=00000000dcae4138 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
dcae4130 49cce0a7 00000003 dcae4290 00000001 49ccee38 nvcuda64!cuProfilerStop+0x0 
dcae4180 49ccf086 dcae4248 00000008 dcae41d9 286c9440 nvcuda64!cuProfilerStop+0x0 
dcae4230 49ac58eb 00000008 00000003 3b4004e7 00000001 nvcuda64!cuProfilerStop+0x0 
dcae4390 49b8bbfd 00000000 2843d310 2843d310 2822e300 nvcuda64!+0x0 
dcae4da0 49b915f3 00000000 268c1bc0 26790ae0 268c0000 nvcuda64!+0x0 
dcae4dd0 49a76a83 00000090 49bee70c 267c0000 00000000 nvcuda64!+0x0 
dcae4e00 49c21b61 dcae4e89 26790ae0 28474100 00000000 nvcuda64!+0x0 
dcae4ee0 73a7b83c ffffffff 00000000 000003e7 00000000 nvcuda64!cuDevicePrimaryCtxRetain+0x0 
dcae4f10 73a7b6e3 ffffffff 00000000 00000000 267d5800 c10_cuda!+0x0 
dcae4f60 73a7b5a6 00000001 00000002 00000000 26790ae0 c10_cuda!+0x0 
dcae4fa0 73a7c413 00000000 26790860 00000100 00981883 c10_cuda!+0x0 
dcae4fd0 73a7317d 00000000 00000100 00981883 73a73165 c10_cuda!+0x0 
dcae5000 73a72160 289b39d0 26790860 dcae5198 dcae51e0 c10_cuda!+0x0 
dcae50d0 73a8fe6c 289b39d0 00000000 00000000 00000000 c10_cuda!+0x0 
dcae54a0 73a9083a 00000000 00000001 73aab5d0 00000001 c10_cuda!c10::cuda::CUDACachingAllocator::init+0x0 
dcae5640 73a85099 00000000 00000000 dcae5be0 00000000 c10_cuda!c10::cuda::CUDACachingAllocator::init+0x0 
dcae5810 ca7e7cf1 289b3fa0 00000000 00004000 00000000 c10_cuda!c10::cuda::CUDAStream::unpack+0x0 
dcae58a0 c9eb4677 28455380 00000000 dcae5ae0 dcae59b0 torch_cuda!THCStorage_resizeBytes+0x0 
dcae5a90 ca692514 dcae5e60 dcae60f8 dcae5bc0 dcae5b50 torch_cuda!at::native::replication_pad3d_out_cuda+0x0 
dcae5b10 ca7a8b65 dcae5be0 00000000 00000000 00000001 torch_cuda!at::native::empty_strided_cuda+0x0 
dcae5b80 ca7a41d9 00000001 dcae5c30 dcae5ce0 2728cab0 torch_cuda!at::native::set_storage_cuda_+0x0 
dcae5bd0 075c2647 27b37df0 dcae5c60 dcae5c60 dcae5ce0 torch_cuda!at::native::set_storage_cuda_+0x0 
dcae5e20 075c04ce dcae5f40 071dbfac 0c510601 071cdeca torch_cpu!at::native::mkldnn_sigmoid_+0x0 
dcae5e70 076a3ade dcae5ed0 0c510640 ffffffff 0c510668 torch_cpu!at::native::mkldnn_sigmoid_+0x0 
dcae60c0 08936c7d 00000000 dcae6170 00000030 268c0cc0 torch_cpu!at::empty_strided+0x0 
dcae6140 075c04ce 00000020 0c510640 2728cab0 0a4324d6 torch_cpu!torch::autograd::GraphRoot::apply+0x0 
dcae6190 076a3ade dcae61f0 0c510640 dcae6220 dcae62a0 torch_cpu!at::native::mkldnn_sigmoid_+0x0 
dcae63e0 0745a37e dcae65a0 7687a8c0 27b379f0 dcae6470 torch_cpu!at::empty_strided+0x0 
dcae6490 07459c19 dcae6a38 dcae7470 dcae67a0 dcae6a38 torch_cpu!at::native::to_dense_backward+0x0 
dcae66a0 0777e363 bfeefcd8 00000000 00000002 00000002 torch_cpu!at::native::to+0x0 
dcae66e0 089e6573 dcae0000 283f8e20 dcae6720 0000657a torch_cpu!at::zeros_out+0x0 
dcae6720 075c02f2 dcae0000 0a4324d6 cadc9749 dcae7470 torch_cpu!torch::autograd::GraphRoot::apply+0x0 
dcae6760 077b1222 dcae0000 00000000 dcae67e8 dcae6870 torch_cpu!at::native::mkldnn_sigmoid_+0x0 
dcae69a0 b4d7cd74 dcae7400 dcae7400 dcae7400 00000000 torch_cpu!at::Tensor::to+0x0 
dcae6bb0 b4d7af96 dcae7490 dcae6d30 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
dcaff950 b4fbc6f8 28242860 00000000 00000000 27fe84a0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
dcaff990 92447034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
dcaff9c0 93abd0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
dcaffa40 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 17372 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 1250000.000000, User Time: 45312500.000000, Wait Time: 52063936.000000

- Registers -
rax=000000000000005b rbx=0000000000000008 rcx=0000000000000008 rdx=00000000dd0ff4b0 rsi=0000000000000000 rdi=0000000000000008
r8=00000000dd0ff158 r9=0000000028455800 r10=0000000000000000 r11=00000000dd0ff420 r12=0000000000000064 r13=00000000dd0ff4b0
r14=00000000dd0ff1b0 r15=0000000000000000 rip=0000000093b0cb04 rsp=00000000dd0ff158 rbp=0000000028455800
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
dd0ff150 91570d40 00000000 dc8a9000 93bdb4d0 dc8a9000 ntdll!NtWaitForMultipleObjects+0x0 
dd0ff440 91570c3e 267d2f70 004e0049 00000008 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
dd0ff480 49c021b4 28455920 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
dd0ff6c0 49c9c95d 00000000 00000004 00000000 00000000 nvcuda64!+0x0 
dd0ff770 49c01b83 139a4a3c 3b3fff6e 289b3d60 00000000 nvcuda64!cuProfilerStop+0x0 
dd0ff7a0 49eef450 289b3d60 00000000 00000000 00000000 nvcuda64!+0x0 
dd0ff7d0 92447034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
dd0ff800 93abd0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
dd0ff880 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 6804 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 50254024.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002b0 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002b0
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=000000002843c510 r13=0000000000000000
r14=00000000000002b0 r15=0000000000000000 rip=0000000093b0c034 rsp=00000000dd1ff9b8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
dd1ff9b0 9153a34e 00000000 00000000 00000000 00000000 ntdll!NtWaitForSingleObject+0x0 
dd1ffa50 49e0abd8 00000000 91542cb5 00000000 000002b0 KERNELBASE!WaitForSingleObjectEx+0x0 
dd1ffac0 49c01b83 00000001 28b32680 289b3a60 00000000 nvcuda64!cuProfilerStop+0x0 
dd1ffaf0 49eef450 289b3a60 00000000 00000000 00000000 nvcuda64!+0x0 
dd1ffb20 92447034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
dd1ffb50 93abd0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
dd1ffbd0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)