Task 3740395

Name ParityModified-1608763830-25131-7_0
Workunit 1921862
Created 20 Jan 2021, 3:18:48 UTC
Sent 21 Jan 2021, 18:57:49 UTC
Report deadline 28 Jan 2021, 18:57:49 UTC
Received 22 Jan 2021, 12:58:26 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 197 (0x000000C5) EXIT_TIME_LIMIT_EXCEEDED
Computer ID 2874
Run time 7 hours 44 min 59 sec
CPU time 7 hours 37 min 54 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 8,879.54 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 284.04 MB
Peak swap size 1.45 GB
Peak disk usage 1.53 GB

Stderr output

<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
exceeded elapsed time limit 27897.59 (4000000.00G/141.43G)</message>
<stderr_txt>
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 1080)
[2021-01-21 12:11:50	                main:435]	:	INFO	:	Set logging level to 1
[2021-01-21 12:11:50	                main:441]	:	INFO	:	Running in BOINC Client mode
[2021-01-21 12:11:50	                main:444]	:	INFO	:	Resolving all filenames
[2021-01-21 12:11:50	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1)
[2021-01-21 12:11:50	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1608763830-25131-7_0_r669851236_1 (exists = 0)
[2021-01-21 12:11:50	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1608763830-25131-7_0_r669851236_0 (exists = 0)
[2021-01-21 12:11:50	                main:452]	:	INFO	:	Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1608763830-25131-7 (exists = 1)
[2021-01-21 12:11:50	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2021-01-21 12:11:50	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5
[2021-01-21 12:11:50	                main:474]	:	INFO	:	Configuration: 
[2021-01-21 12:11:50	                main:475]	:	INFO	:	    Model type: GRU
[2021-01-21 12:11:50	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2021-01-21 12:11:50	                main:477]	:	INFO	:	    Max Epochs: 2048
[2021-01-21 12:11:50	                main:478]	:	INFO	:	    Batch Size: 128
[2021-01-21 12:11:50	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2021-01-21 12:11:50	                main:480]	:	INFO	:	    Patience: 10
[2021-01-21 12:11:50	                main:481]	:	INFO	:	    Hidden Width: 12
[2021-01-21 12:11:50	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2021-01-21 12:11:50	                main:483]	:	INFO	:	    # Backend Layers: 4
[2021-01-21 12:11:50	                main:484]	:	INFO	:	    # Threads: 1
[2021-01-21 12:11:50	                main:486]	:	INFO	:	Preparing Dataset
[2021-01-21 12:11:50	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-01-21 12:11:51	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 1080)
[2021-01-21 21:03:00	                main:435]	:	INFO	:	Set logging level to 1
[2021-01-21 21:03:00	                main:441]	:	INFO	:	Running in BOINC Client mode
[2021-01-21 21:03:00	                main:444]	:	INFO	:	Resolving all filenames
[2021-01-21 21:03:00	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1)
[2021-01-21 21:03:00	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1608763830-25131-7_0_r669851236_1 (exists = 0)
[2021-01-21 21:03:00	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1608763830-25131-7_0_r669851236_0 (exists = 0)
[2021-01-21 21:03:00	                main:452]	:	INFO	:	Resolved: model-input.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1608763830-25131-7 (exists = 1)
[2021-01-21 21:03:00	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2021-01-21 21:03:00	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5
[2021-01-21 21:03:00	                main:474]	:	INFO	:	Configuration: 
[2021-01-21 21:03:00	                main:475]	:	INFO	:	    Model type: GRU
[2021-01-21 21:03:00	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2021-01-21 21:03:00	                main:477]	:	INFO	:	    Max Epochs: 2048
[2021-01-21 21:03:00	                main:478]	:	INFO	:	    Batch Size: 128
[2021-01-21 21:03:00	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2021-01-21 21:03:00	                main:480]	:	INFO	:	    Patience: 10
[2021-01-21 21:03:00	                main:481]	:	INFO	:	    Hidden Width: 12
[2021-01-21 21:03:00	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2021-01-21 21:03:00	                main:483]	:	INFO	:	    # Backend Layers: 4
[2021-01-21 21:03:00	                main:484]	:	INFO	:	    # Threads: 1
[2021-01-21 21:03:00	                main:486]	:	INFO	:	Preparing Dataset
[2021-01-21 21:03:00	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-01-21 21:03:01	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFD915E9AD2

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 01/22/21 04:47:58
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\33;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 00000000b4d60000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000093a70000 00000000001f6000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.662) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.19041.662 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.662

ModLoad: 0000000092430000 00000000000bd000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.662) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.19041.662 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.662

ModLoad: 0000000091520000 00000000002c9000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.662) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.19041.662 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.662

ModLoad: 0000000093580000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000911e0000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.19041.746 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.746

ModLoad: 0000000093550000 000000000002a000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.19041.746 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.746

ModLoad: 0000000091920000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.19041.746 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.746

ModLoad: 0000000091a30000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000091210000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000073a60000 0000000000058000 C:\ProgramData\BOINC\slots\33\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000092980000 00000000000ac000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.610) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000924f0000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.19041.546

ModLoad: 00000000938c0000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000093420000 000000000012b000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000067580000 000000000009b000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.16.27012.6) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\agent\_work\2\s\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.16.27012.6 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174; 2017
    Product Version       : 14.16.27012.6

ModLoad: 000000008ad20000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.488) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.19041.488 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.488

ModLoad: 000000006d5a0000 0000000000015000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.16.27012.6) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\agent\_work\2\s\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.16.27012.6 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174; 2017
    Product Version       : 14.16.27012.6

ModLoad: 000000008abc0000 000000000000c000 C:\ProgramData\BOINC\slots\33\VCRUNTIME140_1.dll (14.27.29112.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.27.29112.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.27.29112.0

ModLoad: 0000000000ed0000 000000000abe7000 C:\ProgramData\BOINC\slots\33\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000058ac0000 00000000002db000 C:\ProgramData\BOINC\slots\33\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000058da0000 000000000020d000 C:\ProgramData\BOINC\slots\33\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 00000000746d0000 0000000000040000 C:\ProgramData\BOINC\slots\33\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000c5b60000 0000000024b49000 C:\ProgramData\BOINC\slots\33\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000738f0000 0000000000045000 C:\ProgramData\BOINC\slots\33\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000fde20000 00000000030a5000 C:\ProgramData\BOINC\slots\33\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 00000000fa960000 00000000034b2000 C:\ProgramData\BOINC\slots\33\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 0000000088630000 0000000000010000 C:\ProgramData\BOINC\slots\33\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 000000007b990000 0000000003d5b000 C:\ProgramData\BOINC\slots\33\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000a1610000 000000000919f000 C:\ProgramData\BOINC\slots\33\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 0000000079ac0000 0000000001eca000 C:\ProgramData\BOINC\slots\33\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000aa7b0000 000000001b3a4000 C:\ProgramData\BOINC\slots\33\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 0000000092640000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000008fab0000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000092a30000 0000000000467000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000091850000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000911b0000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.662) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000090f50000 000000000002c000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000917f0000 0000000000060000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.662) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.19041.662 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.662

ModLoad: 00000000913c0000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000090d90000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000091b30000 0000000000743000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.19041.329 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.329

ModLoad: 000000008f2e0000 000000000078f000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000092ea0000 0000000000356000 C:\WINDOWS\System32\combase.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000090c10000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.662) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000928d0000 00000000000ae000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000091ad0000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000077f40000 0000000000244000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.5167) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r450\r451_65\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 27.21.14.5167
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.0.208 driver
    Product Version       : 27.21.14.5167

ModLoad: 000000008b440000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000049a50000 0000000001338000 C:\WINDOWS\system32\DriverStore\FileRepository\nvdd.inf_amd64_37dfa884d4a14547\nvcuda64.dll (27.21.14.5167) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r450\r451_65\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 27.21.14.5167
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.0.208 driver
    Product Version       : 27.21.14.5167

ModLoad: 00000000933b0000 000000000006b000 C:\WINDOWS\System32\WS2_32.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : ws2_32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000008eb00000 000000000009e000 C:\WINDOWS\system32\uxtheme.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : UxTheme.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000762c0000 0000000000554000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.5167) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r450\r451_65\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 27.21.14.5167
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 27.21.14.5167

ModLoad: 0000000092700000 000000000012a000 C:\WINDOWS\System32\OLE32.DLL (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : ole32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000008fb00000 00000000000f3000 C:\WINDOWS\SYSTEM32\dxgi.dll (6.2.19041.746) (-exported- Symbols Loaded)
    Linked PDB Filename   : dxgi.pdb
    File Version          : 10.0.19041.746 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.746

ModLoad: 00000000918a0000 0000000000080000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.662) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.19041.662 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.662



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 2400, Write: 273, Other 820

- I/O Transfers Counters -
Read: 5241390, Write: 5476, Other 23852

- Paged Pool Usage -
QuotaPagedPoolUsage: 3398528, QuotaPeakPagedPoolUsage: 3398752
QuotaNonPagedPoolUsage: 20936, QuotaPeakNonPagedPoolUsage: 21344

- Virtual Memory Usage -
VirtualSize: 1522479104, PeakVirtualSize: -2144772096

- Pagefile Usage -
PagefileUsage: 1522479104, PeakPagefileUsage: 1522479104

- Working Set Size -
WorkingSetSize: 263401472, PeakWorkingSetSize: 263405568, PageFaultCount: 67663

*** Dump of thread ID 748 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 781250.000000, User Time: 312500.000000, Wait Time: 50253152.000000

- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFD915E9AD2

- Registers -
rax=0000000000000000 rbx=0000000000000001 rcx=00000000b5018c40 rdx=00000000bb3fe450 rsi=0000000000000000 rdi=0000000000000000
r8=00000000bb3fe450 r9=00000000b5018c30 r10=0000000000000fff r11=0000000000000ff0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000915e9ad2 rsp=00000000bb3fe428 rbp=0000000000000000
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
bb3fe420 b4d99100 00000001 bb3fe450 bb3fe450 b5018c30 KERNELBASE!DebugBreak+0x0 
bb3fe860 b4d99ce4 2f400000 bb3febc4 00000000 000002d8 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
bb3ff7c0 b4d9a084 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
bb3ff7f0 92447034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
bb3ff820 93abd0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
bb3ff8a0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 6756 (state: Running): ***

- Information -
Status: Base Priority: Above Normal, Priority: Above Normal, , Kernel Time: 37500000.000000, User Time: 274698600448.000000, Wait Time: 50253152.000000

- Registers -
rax=000000006b23bf40 rbx=000000006b14dac8 rcx=000000006b5cd5e8 rdx=0000000000000000 rsi=000000006b414100 rdi=0000000000000001
r8=000000000001fff0 r9=0000000000000000 r10=0000000000000000 r11=000000006b5cd5e8 r12=0000000000000001 r13=000000007910b600
r14=0000000000000001 r15=0000000049a50000 rip=0000000049ac4b86 rsp=00000000baee4608 rbp=00000000baee47a0
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000297

- Callstack -
ChildEBP RetAddr  Args to Child
baee4600 49cce7be 6b14dac8 49ccdf8d 00000001 00000001 nvcuda64!+0x0 
baee4640 49cce0a7 00000000 baee47a0 00000001 49ccee38 nvcuda64!cuProfilerStop+0x0 
baee4690 49ccf086 baee4758 00000008 baee46e9 6b414150 nvcuda64!cuProfilerStop+0x0 
baee4740 49ac58eb 00000008 00000003 3f638fda 00000001 nvcuda64!cuProfilerStop+0x0 
baee48a0 49b8bbfd 00000000 6b17c8c0 6b17c8c0 6af918f0 nvcuda64!+0x0 
baee52b0 49b915f3 00000000 69551b00 69700ae0 69550000 nvcuda64!+0x0 
baee52e0 49a76a83 00000090 49bee70c 69450000 00000000 nvcuda64!+0x0 
baee5310 49c21b61 baee5399 69700ae0 6b1b21c0 00000000 nvcuda64!+0x0 
baee53f0 738fb83c ffffffff 00000000 000003e7 00000000 nvcuda64!cuDevicePrimaryCtxRetain+0x0 
baee5420 738fb6e3 ffffffff 00000000 00000000 69464e10 c10_cuda!+0x0 
baee5470 738fb5a6 00000001 00000002 00000000 69700ae0 c10_cuda!+0x0 
baee54b0 738fc413 00000000 69700860 00000100 00000ba2 c10_cuda!+0x0 
baee54e0 738f317d 00000000 00000100 00000ba2 738f3165 c10_cuda!+0x0 
baee5510 738f2160 6b6c35b0 69700860 baee56a8 baee56f0 c10_cuda!+0x0 
baee55e0 7390fe6c 6b6c35b0 00000000 00000000 00000000 c10_cuda!+0x0 
baee59b0 7391083a 00000000 00000001 7392b5d0 00000001 c10_cuda!c10::cuda::CUDACachingAllocator::init+0x0 
baee5b50 73905099 00000000 00000000 baee60f0 00000000 c10_cuda!c10::cuda::CUDACachingAllocator::init+0x0 
baee5d20 c8987cf1 6b6c2bf0 00000000 00004000 00000000 c10_cuda!c10::cuda::CUDAStream::unpack+0x0 
baee5db0 c8054677 6b198eb0 00000000 baee5ff0 baee5ec0 torch_cuda!THCStorage_resizeBytes+0x0 
baee5fa0 c8832514 baee6370 baee6608 baee60d0 baee6060 torch_cuda!at::native::replication_pad3d_out_cuda+0x0 
baee6020 c8948b65 baee60f0 00000000 00000000 00000001 torch_cuda!at::native::empty_strided_cuda+0x0 
baee6090 c89441d9 00000001 baee6140 baee61f0 69fcba30 torch_cuda!at::native::set_storage_cuda_+0x0 
baee60e0 068a2647 694615b0 baee6170 baee6170 baee61f0 torch_cuda!at::native::set_storage_cuda_+0x0 
baee6330 068a04ce baee6450 064bbfac 0b7f0601 064adeca torch_cpu!at::native::mkldnn_sigmoid_+0x0 
baee6380 06983ade baee63e0 0b7f0640 ffffffff 0b7f0668 torch_cpu!at::native::mkldnn_sigmoid_+0x0 
baee65d0 07c16c7d 00000000 baee6680 00000030 69550cc0 torch_cpu!at::empty_strided+0x0 
baee6650 068a04ce 00000020 0b7f0640 69fcba30 097124d6 torch_cpu!torch::autograd::GraphRoot::apply+0x0 
baee66a0 06983ade baee6700 0b7f0640 baee6730 baee67b0 torch_cpu!at::native::mkldnn_sigmoid_+0x0 
baee68f0 0673a37e baee6ab0 73a7a8c0 6945b9a0 baee6980 torch_cpu!at::empty_strided+0x0 
baee69a0 06739c19 baee6f48 baee7980 baee6cb0 baee6f48 torch_cpu!at::native::to_dense_backward+0x0 
baee6bb0 06a5e363 8548f92f 00000000 00000002 00000002 torch_cpu!at::native::to+0x0 
baee6bf0 07cc6573 baee0000 6b209af0 baee6c30 0000657a torch_cpu!at::zeros_out+0x0 
baee6c30 068a02f2 baee0000 097124d6 3efda355 baee7980 torch_cpu!torch::autograd::GraphRoot::apply+0x0 
baee6c70 06a91222 baee0000 00000000 baee6cf8 baee6d80 torch_cpu!at::native::mkldnn_sigmoid_+0x0 
baee6eb0 b4d7cd74 baee7910 baee7910 baee7910 00000000 torch_cpu!at::Tensor::to+0x0 
baee70c0 b4d7af96 baee79a0 baee7240 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
baeffe60 b4fbc6f8 6afa2cd0 00000000 00000000 6b0ca1c0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
baeffea0 92447034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
baeffed0 93abd0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
baefff50 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 3808 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 1406250.000000, User Time: 1718750.000000, Wait Time: 50253152.000000

- Registers -
rax=000000000000005b rbx=0000000000000008 rcx=0000000000000008 rdx=00000000bb4ffb70 rsi=0000000000000000 rdi=0000000000000008
r8=00000000bb4ff818 r9=000000006b199b10 r10=0000000000000000 r11=0000000000000246 r12=0000000000000064 r13=00000000bb4ffb70
r14=00000000bb4ff870 r15=0000000000000000 rip=0000000093b0cb04 rsp=00000000bb4ff818 rbp=000000006b199b10
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
bb4ff810 91570d40 00000000 bada2000 93bdb4d0 bada2000 ntdll!NtWaitForMultipleObjects+0x0 
bb4ffb00 91570c3e 69464440 004e0049 00000008 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
bb4ffb40 49c021b4 6b198970 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
bb4ffd80 49c9c95d 00000000 00000004 00000000 00000000 nvcuda64!+0x0 
bb4ffe30 49c01b83 335fa3c8 3f638ab0 6b6c3610 00000000 nvcuda64!cuProfilerStop+0x0 
bb4ffe60 49eef450 6b6c3610 00000000 00000000 00000000 nvcuda64!+0x0 
bb4ffe90 92447034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
bb4ffec0 93abd0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
bb4fff40 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 7068 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 48467756.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=000000000000029c rdx=0000000000000000 rsi=0000000000000000 rdi=000000000000029c
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=000000006b17c540 r13=0000000000000000
r14=000000000000029c r15=0000000000000000 rip=0000000093b0c034 rsp=00000000bb5ffcf8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
bb5ffcf0 9153a34e 00000000 00000000 00000000 00000000 ntdll!NtWaitForSingleObject+0x0 
bb5ffd90 49e0abd8 00000000 91542cb5 00000000 0000029c KERNELBASE!WaitForSingleObjectEx+0x0 
bb5ffe00 49c01b83 00000001 6bb6b7f0 6b6c2b90 00000000 nvcuda64!cuProfilerStop+0x0 
bb5ffe30 49eef450 6b6c2b90 00000000 00000000 00000000 nvcuda64!+0x0 
bb5ffe60 92447034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
bb5ffe90 93abd0d1 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
bb5fff10 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)