Task 10624300

Name ParityModified-1638634246-5802-3-0_0
Workunit 7951298
Created 10 Jan 2022, 21:48:09 UTC
Sent 27 Jan 2022, 4:46:10 UTC
Report deadline 4 Feb 2022, 4:46:10 UTC
Received 27 Jan 2022, 5:35:56 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 3241
Run time 7 sec
CPU time 2 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 9,067.69 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 70.07 MB
Peak swap size 1.23 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code 3765269347 (0xe06d7363)</message>
<stderr_txt>
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 2070 SUPER)
[2022-01-26 20:46:19	                main:435]	:	INFO	:	Set logging level to 1
[2022-01-26 20:46:19	                main:441]	:	INFO	:	Running in BOINC Client mode
[2022-01-26 20:46:19	                main:444]	:	INFO	:	Resolving all filenames
[2022-01-26 20:46:19	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-01-26 20:46:19	                main:452]	:	INFO	:	Resolved: model.cfg => model.cfg (exists = 0)
[2022-01-26 20:46:19	                main:452]	:	INFO	:	Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-01-26 20:46:19	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-01-26 20:46:19	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2022-01-26 20:46:19	                main:472]	:	INFO	:	Dataset filename: dataset.hdf5
[2022-01-26 20:46:19	                main:474]	:	INFO	:	Configuration: 
[2022-01-26 20:46:19	                main:475]	:	INFO	:	    Model type: GRU
[2022-01-26 20:46:19	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2022-01-26 20:46:19	                main:477]	:	INFO	:	    Max Epochs: 2048
[2022-01-26 20:46:19	                main:478]	:	INFO	:	    Batch Size: 128
[2022-01-26 20:46:19	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2022-01-26 20:46:19	                main:480]	:	INFO	:	    Patience: 10
[2022-01-26 20:46:19	                main:481]	:	INFO	:	    Hidden Width: 12
[2022-01-26 20:46:19	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2022-01-26 20:46:19	                main:483]	:	INFO	:	    # Backend Layers: 4
[2022-01-26 20:46:19	                main:484]	:	INFO	:	    # Threads: 1
[2022-01-26 20:46:19	                main:486]	:	INFO	:	Preparing Dataset
[2022-01-26 20:46:19	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from dataset.hdf5 into memory
[2022-01-26 20:46:19	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from dataset.hdf5 into memory
[2022-01-26 20:46:21	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2022-01-26 20:46:21	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from dataset.hdf5 into memory
[2022-01-26 20:46:21	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from dataset.hdf5 into memory
[2022-01-26 20:46:21	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2022-01-26 20:46:21	                main:494]	:	INFO	:	Creating Model
[2022-01-26 20:46:21	                main:507]	:	INFO	:	Preparing config file
[2022-01-26 20:46:21	                main:519]	:	INFO	:	Creating new config file
[2022-01-26 20:46:21	                main:538]	:	INFO	:	This is a continuation WU, loading previous network


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFB3F114F69

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 01/26/22 20:46:22
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\11;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 00000000a3de0000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000041790000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.19041.1466 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1466

ModLoad: 0000000040f70000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.19041.1503 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1503

ModLoad: 000000003f0e0000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.19041.1503 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1503

ModLoad: 000000003fc90000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000003f670000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.19041.1466 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1466

ModLoad: 0000000040390000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202

ModLoad: 000000003f3b0000 000000000010d000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.19041.1466 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1466

ModLoad: 000000003ef40000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 000000003efe0000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 0000000040eb0000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 00000000412e0000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.19041.546

ModLoad: 0000000041160000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000041030000 0000000000125000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1466) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000001dae0000 0000000000058000 C:\ProgramData\BOINC\slots\11\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000028bb0000 000000000008d000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.29.30037.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\agent\_work\13\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.29.30037.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.29.30037.0

ModLoad: 000000002e420000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.867

ModLoad: 0000000028b50000 000000000001b000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.29.30037.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\agent\_work\13\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.29.30037.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.29.30037.0

ModLoad: 0000000028b70000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.29.30037.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\agent\_work\13\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.29.30037.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.29.30037.0

ModLoad: 00000000beb90000 000000000abe7000 C:\ProgramData\BOINC\slots\11\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000006b50000 00000000002db000 C:\ProgramData\BOINC\slots\11\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000006940000 000000000020d000 C:\ProgramData\BOINC\slots\11\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 000000002bc60000 0000000000040000 C:\ProgramData\BOINC\slots\11\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000008d8a0000 0000000024b49000 C:\ProgramData\BOINC\slots\11\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000001f440000 0000000000045000 C:\ProgramData\BOINC\slots\11\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000bb6d0000 00000000034b2000 C:\ProgramData\BOINC\slots\11\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 0000000037f30000 0000000000010000 C:\ProgramData\BOINC\slots\11\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 00000000b8620000 00000000030a5000 C:\ProgramData\BOINC\slots\11\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 00000000b4140000 0000000003d5b000 C:\ProgramData\BOINC\slots\11\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000724f0000 000000001b3a4000 C:\ProgramData\BOINC\slots\11\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 0000000069350000 000000000919f000 C:\ProgramData\BOINC\slots\11\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000e7890000 0000000001eca000 C:\ProgramData\BOINC\slots\11\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 0000000041720000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000003cdb0000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000003fe30000 0000000000472000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000003f4c0000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 000000003ef10000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000003ec40000 0000000000034000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 000000003eea0000 0000000000069000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.19041.1503 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1503

ModLoad: 000000003f510000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000003ea80000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000040550000 0000000000744000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.19041.964 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.964

ModLoad: 000000003cfb0000 0000000000794000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1503) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000003f840000 0000000000355000 C:\WINDOWS\System32\combase.dll (6.2.19041.1348) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.19041.1320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1320

ModLoad: 000000003e8f0000 000000000002e000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000041220000 00000000000ad000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1387) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 000000003f7e0000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.19041.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1

ModLoad: 0000000021ac0000 00000000002cd000 C:\WINDOWS\system32\nvcuda.dll (30.0.15.1123) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_04\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 30.0.15.1123
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.6.58 driver
    Product Version       : 30.0.15.1123

ModLoad: 0000000020420000 00000000016a0000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispig.inf_amd64_015fa42d67826549\nvcuda64.dll (30.0.15.1123) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_04\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 30.0.15.1123
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.6.58 driver
    Product Version       : 30.0.15.1123

ModLoad: 0000000039130000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 00000000390f0000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.19041.906 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.906

ModLoad: 00000000380d0000 000000000014a000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.19041.1320) (-exported- Symbols Loaded)
    Linked PDB Filename   : drvstore.pdb
    File Version          : 10.0.19041.1320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1320

ModLoad: 000000003e840000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000033ef0000 0000000000767000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.15.1123) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r511_04\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 30.0.15.1123
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 30.0.15.1123

ModLoad: 000000003f750000 0000000000082000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.19041.1415 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1415



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3619, Write: 310, Other 726

- I/O Transfers Counters -
Read: 6550691, Write: 6607, Other 29030

- Paged Pool Usage -
QuotaPagedPoolUsage: 3498208, QuotaPeakPagedPoolUsage: 3514592
QuotaNonPagedPoolUsage: 47048, QuotaPeakNonPagedPoolUsage: 47048

- Virtual Memory Usage -
VirtualSize: -962498560, PeakVirtualSize: -346001408

- Pagefile Usage -
PagefileUsage: -962498560, PeakPagefileUsage: -962310144

- Working Set Size -
WorkingSetSize: 1581744128, PeakWorkingSetSize: 1581846528, PageFaultCount: 533530

*** Dump of thread ID 13716 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 5000000.000000, User Time: 21250000.000000, Wait Time: 2693168.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x00007FFB3F114F69

- Registers -
rax=00000000417bdf4c rbx=000000009131b320 rcx=00000000490e0000 rdx=0000000045d657b9 rsi=0000000045d65e00 rdi=0000000019930520
r8=0000000000000094 r9=0000000000000000 r10=000000003d7a7430 r11=0000000000000000 r12=0000000000000004 r13=0000000000000000
r14=0000000045d663f0 r15=0000000000000009 rip=000000003f114f69 rsp=0000000045d65bf0 rbp=0000000045d65e30
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
45d65cc0 28b56480 91109350 91109328 00000030 00000000 KERNELBASE!RaiseException+0x0 
45d65d20 906e2659 910edbb8 45d664e0 45d65de0 45d664e0 VCRUNTIME140!_CxxThrowException+0x0 
45d65ed0 9061d642 00000000 00000001 00000000 000003e7 torch_cuda!at::native::getCudnnHandle+0x0 
45d66380 9067296d 45d66408 00010001 45d66408 45d664e0 torch_cuda!at::native::_cudnn_rnn_flatten_weight+0x0 
45d66460 90684124 2312b0a0 492b0000 492b02ac 1dafef8f torch_cuda!at::native::set_storage_cuda_+0x0 
45d664d0 c46136ca 45d66548 492b1440 492b0000 492b0000 torch_cuda!at::native::set_storage_cuda_+0x0 
45d66740 c599ecf2 00000000 00000000 00000000 45d66850 torch_cpu!at::_cudnn_rnn_flatten_weight+0x0 
45d66940 c59a96c9 49dac3c0 000003e7 00000004 00000009 torch_cpu!torch::autograd::GraphRoot::apply+0x0 
45d669b0 c46136ca 45d66a28 00000003 45d66a30 45d66ac0 torch_cpu!torch::autograd::GraphRoot::apply+0x0 
45d66c20 c6135fce 00000001 00010001 45d66d10 00000001 torch_cpu!at::_cudnn_rnn_flatten_weight+0x0 
45d66d40 c6082940 00000000 1d98cce0 45d66fa8 1d98ce00 torch_cpu!torch::nn::detail::RNNImplBase<torch::nn::RNNImpl>::flatten_parameters+0x0 
45d66f60 c6087b3c 00000001 00000016 0000001f 45d67090 torch_cpu!torch::nn::init::zeros_+0x0 
45d66f90 a3dfb741 45d675a8 00010001 00000000 00000080 torch_cpu!torch::nn::Module::to+0x0 
45d7fd30 a403c6f8 4ac35190 00000000 00000000 4ab8f9c0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
45d7fd70 40f87034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
45d7fda0 417e2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
45d7fe20 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 14808 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 1718750.000000, User Time: 0.000000, Wait Time: 2692759.000000

- Registers -
rax=00000000000001d3 rbx=00000000490e5650 rcx=0000000000000070 rdx=00000000490e52d0 rsi=00000000490e3400 rdi=00000000490e5650
r8=0000000039135008 r9=00000000460fef90 r10=00000000391300f0 r11=0000000000000001 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000418307c4 rsp=00000000460ff4e8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
460ff4e0 417e2dc7 00000000 00000000 490e3400 490e5650 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
460ff7e0 40f87034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
460ff810 417e2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
460ff890 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 5048 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 3281250.000000, User Time: 0.000000, Wait Time: 2692759.000000

- Registers -
rax=00000000000001d3 rbx=00000000490e5a80 rcx=0000000000000070 rdx=00000000490e5700 rsi=00000000490e3400 rdi=00000000490e5a80
r8=00000000461ff000 r9=00000000490e3a04 r10=000000000000006c r11=00000000461fee00 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000418307c4 rsp=00000000461ff898 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
461ff890 417e2dc7 00000000 00000000 490e3400 490e5a80 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
461ffb90 40f87034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
461ffbc0 417e2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
461ffc40 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 15568 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 1093750.000000, User Time: 0.000000, Wait Time: 2693157.000000

- Registers -
rax=00000000000001d3 rbx=00000000490e8ee0 rcx=0000000000000070 rdx=00000000490e8b60 rsi=00000000490e3400 rdi=00000000490e8ee0
r8=0000000000000008 r9=0000000000000040 r10=0000000000000580 r11=0000000001000000 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=00000000418307c4 rsp=00000000462ffa88 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
462ffa80 417e2dc7 00000000 00000000 490e3400 490e8ee0 ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
462ffd80 40f87034 00000000 00000000 00000000 00000000 ntdll!TpReleaseCleanupGroupMembers+0x0 
462ffdb0 417e2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
462ffe30 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 16744 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 2693165.000000

- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000464ffc80 rsi=0000000000000000 rdi=0000000000000064
r8=00000000464ffc58 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000004182d3f4 rsp=00000000464ffc58 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
464ffc50 3f12962e 464ffd18 00000000 00000000 00000000 ntdll!NtDelayExecution+0x0 
464ffcf0 a3e1a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0 
464ffd20 40f87034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
464ffd50 417e2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
464ffdd0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 17584 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 2693168.000000

- Registers -
rax=000000000000005b rbx=000000000000000b rcx=000000000000000b rdx=00000000465ff4a0 rsi=0000000000000000 rdi=000000000000000b
r8=000000004ade12e0 r9=000000000000000b r10=000000004a2dcbd0 r11=00000000f668c436 r12=0000000000000064 r13=00000000465ff4a0
r14=00000000465ff1a0 r15=0000000000000000 rip=000000004182d8c4 rsp=00000000465ff148 rbp=000000004ae12d90
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
465ff140 3f12cb20 00000000 45fb8000 418fa4d0 45fb8000 ntdll!ZwWaitForMultipleObjects+0x0 
465ff430 3f12ca1e 490f42c0 004e0049 0000000b 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
465ff470 205fd384 4ae176b0 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
465ff6b0 206a56fd 00000000 4ae12d90 00000000 00000000 nvcuda64!+0x0 
465ff760 205fcd53 fa590ba1 f916e82d 4b71ed60 00000000 nvcuda64!cuProfilerStop+0x0 
465ff790 20934064 4b71ed60 00000000 00000000 00000000 nvcuda64!+0x0 
465ff7c0 40f87034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
465ff7f0 417e2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
465ff870 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 4928 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 2693042.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=0000000000000088 rdx=0000000000000000 rsi=0000000000000000 rdi=0000000000000088
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=000000004adcde10 r13=0000000000000000
r14=0000000000000088 r15=0000000000000000 rip=000000004182cdf4 rsp=00000000466ffa98 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
466ffa90 3f101a5e 00000000 00001f80 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0 
466ffb30 2082596e 4b71f960 00000000 00000000 00000088 KERNELBASE!WaitForSingleObjectEx+0x0 
466ffd70 205fcd53 00000000 4b71f960 20420000 4ade31d0 nvcuda64!cuProfilerStop+0x0 
466ffda0 20934064 4b71f960 00000000 00000000 00000000 nvcuda64!+0x0 
466ffdd0 40f87034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
466ffe00 417e2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
466ffe80 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)