Task 7562684

Name ParityModified-1631729536-21911-0_2
Workunit 5043019
Created 24 Sep 2021, 9:49:40 UTC
Sent 24 Sep 2021, 11:08:38 UTC
Report deadline 2 Oct 2021, 11:08:38 UTC
Received 24 Sep 2021, 11:10:40 UTC
Server state Over
Outcome Computation error
Client state Aborted by user
Exit status 203 (0x000000CB) EXIT_ABORTED_VIA_GUI
Computer ID 9955
Run time 1 min 18 sec
CPU time 1 min 15 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 1,883.38 GFLOPS
Application version Machine Learning Dataset Generator (GPU) v9.75 (cuda10200)
windows_x86_64
Peak working set size 1.64 GB
Peak swap size 3.59 GB
Peak disk usage 1.53 GB

Stderr output

<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
aborted by user</message>
<stderr_txt>
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce MX350)
[2021-09-24 13:08:50	                main:435]	:	INFO	:	Set logging level to 1
[2021-09-24 13:08:50	                main:441]	:	INFO	:	Running in BOINC Client mode
[2021-09-24 13:08:50	                main:444]	:	INFO	:	Resolving all filenames
[2021-09-24 13:08:50	                main:452]	:	INFO	:	Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 (exists = 1)
[2021-09-24 13:08:50	                main:452]	:	INFO	:	Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1631729536-21911-0_2_r1591003945_1 (exists = 0)
[2021-09-24 13:08:50	                main:452]	:	INFO	:	Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityModified-1631729536-21911-0_2_r1591003945_0 (exists = 0)
[2021-09-24 13:08:50	                main:452]	:	INFO	:	Resolved: model-input.pt => model-input.pt (exists = 0)
[2021-09-24 13:08:50	                main:452]	:	INFO	:	Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2021-09-24 13:08:50	                main:472]	:	INFO	:	Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5
[2021-09-24 13:08:50	                main:474]	:	INFO	:	Configuration: 
[2021-09-24 13:08:50	                main:475]	:	INFO	:	    Model type: GRU
[2021-09-24 13:08:50	                main:476]	:	INFO	:	    Validation Loss Threshold: 0.0001
[2021-09-24 13:08:50	                main:477]	:	INFO	:	    Max Epochs: 2048
[2021-09-24 13:08:50	                main:478]	:	INFO	:	    Batch Size: 128
[2021-09-24 13:08:50	                main:479]	:	INFO	:	    Learning Rate: 0.01
[2021-09-24 13:08:50	                main:480]	:	INFO	:	    Patience: 10
[2021-09-24 13:08:50	                main:481]	:	INFO	:	    Hidden Width: 12
[2021-09-24 13:08:50	                main:482]	:	INFO	:	    # Recurrent Layers: 4
[2021-09-24 13:08:50	                main:483]	:	INFO	:	    # Backend Layers: 4
[2021-09-24 13:08:50	                main:484]	:	INFO	:	    # Threads: 1
[2021-09-24 13:08:50	                main:486]	:	INFO	:	Preparing Dataset
[2021-09-24 13:08:50	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-09-24 13:08:50	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-09-24 13:08:53	                load:106]	:	INFO	:	Successfully loaded dataset of 2048 examples into memory.
[2021-09-24 13:08:53	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-09-24 13:08:53	load_hdf5_ds_into_tensor:28]	:	INFO	:	Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityModified-train-val-dataset.hdf5 into memory
[2021-09-24 13:08:54	                load:106]	:	INFO	:	Successfully loaded dataset of 512 examples into memory.
[2021-09-24 13:08:54	                main:494]	:	INFO	:	Creating Model
[2021-09-24 13:08:54	                main:507]	:	INFO	:	Preparing config file
[2021-09-24 13:08:54	                main:519]	:	INFO	:	Creating new config file
[2021-09-24 13:08:55	                main:559]	:	INFO	:	Loading DataLoader into Memory
[2021-09-24 13:08:55	                main:562]	:	INFO	:	Starting Training
[2021-09-24 13:08:59	                main:574]	:	INFO	:	Epoch 1 | loss: 0.0354979 | val_loss: 0.0318901 | Time: 3611.6 ms
[2021-09-24 13:09:02	                main:574]	:	INFO	:	Epoch 2 | loss: 0.031458 | val_loss: 0.0312979 | Time: 3127.64 ms
[2021-09-24 13:09:05	                main:574]	:	INFO	:	Epoch 3 | loss: 0.0312795 | val_loss: 0.0312566 | Time: 3095.6 ms
[2021-09-24 13:09:08	                main:574]	:	INFO	:	Epoch 4 | loss: 0.0312565 | val_loss: 0.0312548 | Time: 3118.83 ms
[2021-09-24 13:09:11	                main:574]	:	INFO	:	Epoch 5 | loss: 0.0312532 | val_loss: 0.0312515 | Time: 3104.69 ms
[2021-09-24 13:09:14	                main:574]	:	INFO	:	Epoch 6 | loss: 0.0312523 | val_loss: 0.0312507 | Time: 3092.32 ms
[2021-09-24 13:09:17	                main:574]	:	INFO	:	Epoch 7 | loss: 0.0312527 | val_loss: 0.0312517 | Time: 3113.96 ms
[2021-09-24 13:09:20	                main:574]	:	INFO	:	Epoch 8 | loss: 0.0312525 | val_loss: 0.0312546 | Time: 3105.21 ms
[2021-09-24 13:09:24	                main:574]	:	INFO	:	Epoch 9 | loss: 0.0312519 | val_loss: 0.0312508 | Time: 3097.51 ms
[2021-09-24 13:09:27	                main:574]	:	INFO	:	Epoch 10 | loss: 0.0312502 | val_loss: 0.0312507 | Time: 3129.43 ms
[2021-09-24 13:09:30	                main:574]	:	INFO	:	Epoch 11 | loss: 0.0312504 | val_loss: 0.0312503 | Time: 3128.16 ms
[2021-09-24 13:09:33	                main:574]	:	INFO	:	Epoch 12 | loss: 0.0312522 | val_loss: 0.0312506 | Time: 3098.81 ms
[2021-09-24 13:09:36	                main:574]	:	INFO	:	Epoch 13 | loss: 0.0312516 | val_loss: 0.0312532 | Time: 3105.52 ms
[2021-09-24 13:09:39	                main:574]	:	INFO	:	Epoch 14 | loss: 0.0312514 | val_loss: 0.0312519 | Time: 3108.12 ms
[2021-09-24 13:09:42	                main:574]	:	INFO	:	Epoch 15 | loss: 0.031253 | val_loss: 0.0312506 | Time: 3121.7 ms
[2021-09-24 13:09:45	                main:574]	:	INFO	:	Epoch 16 | loss: 0.0312533 | val_loss: 0.0312574 | Time: 3124.51 ms
[2021-09-24 13:09:48	                main:574]	:	INFO	:	Epoch 17 | loss: 0.0312552 | val_loss: 0.031251 | Time: 3102.32 ms
[2021-09-24 13:09:52	                main:574]	:	INFO	:	Epoch 18 | loss: 0.0312529 | val_loss: 0.0312525 | Time: 3118.31 ms
[2021-09-24 13:09:55	                main:574]	:	INFO	:	Epoch 19 | loss: 0.0312508 | val_loss: 0.0312513 | Time: 3109.74 ms
[2021-09-24 13:09:58	                main:574]	:	INFO	:	Epoch 20 | loss: 0.0312507 | val_loss: 0.031251 | Time: 3136.98 ms
[2021-09-24 13:10:01	                main:574]	:	INFO	:	Epoch 21 | loss: 0.0312513 | val_loss: 0.0312512 | Time: 3134.42 ms
[2021-09-24 13:10:04	                main:574]	:	INFO	:	Epoch 22 | loss: 0.0312528 | val_loss: 0.0312505 | Time: 3113.72 ms


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFC5ED59B92

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 09/24/21 13:10:06
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\7;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 000000006dd90000 00000000003df000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000060fd0000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operativsystem
    Product Version       : 10.0.19041.1165

ModLoad: 000000005fb10000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operativsystem
    Product Version       : 10.0.19041.1165

ModLoad: 000000005ec90000 00000000002c9000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operativsystem
    Product Version       : 10.0.19041.1165

ModLoad: 000000005bf50000 0000000000090000 C:\WINDOWS\SYSTEM32\apphelp.dll (6.2.19041.928) (-exported- Symbols Loaded)
    Linked PDB Filename   : apphelp.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operativsystem
    Product Version       : 10.0.19041.1165

ModLoad: 000000005fd70000 00000000001a1000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operativsystem
    Product Version       : 10.0.19041.1165

ModLoad: 000000005e850000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1237) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.19041.1237 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1237

ModLoad: 000000005f920000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202

ModLoad: 000000005e9d0000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1110) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.19041.1110 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1110

ModLoad: 000000005e930000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 000000005eae0000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.19041.789 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.789

ModLoad: 000000005f860000 00000000000ac000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1052) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operativsystem
    Product Version       : 10.0.19041.1165

ModLoad: 0000000060e60000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.19041.546

ModLoad: 0000000060a80000 000000000009b000 C:\WINDOWS\System32\sechost.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.19041.320 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.320

ModLoad: 000000005f950000 000000000012a000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1081) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operativsystem
    Product Version       : 10.0.19041.1165

ModLoad: 00000000d9ba0000 0000000024b49000 C:\ProgramData\BOINC\slots\7\torch_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000002c3a0000 0000000000058000 C:\ProgramData\BOINC\slots\7\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000002ca10000 0000000000045000 C:\ProgramData\BOINC\slots\7\c10_cuda.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000002900000 00000000034b2000 C:\ProgramData\BOINC\slots\7\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA RAND Library
    Product Version       : 6,14,11,1012

ModLoad: 00000000cefb0000 000000000abe7000 C:\ProgramData\BOINC\slots\7\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000005a2d0000 0000000000010000 C:\ProgramData\BOINC\slots\7\nvToolsExt64_1.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb

ModLoad: 00000000cbf00000 00000000030a5000 C:\ProgramData\BOINC\slots\7\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1031
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA SPARSE BLAS Library
    Product Version       : 6,14,11,1031

ModLoad: 00000000b0b50000 000000001b3a4000 C:\ProgramData\BOINC\slots\7\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,10020
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.86 CUDNN Library
    Product Version       : 6,14,11,10020

ModLoad: 0000000028680000 0000000000091000 C:\ProgramData\BOINC\slots\7\MSVCP140.dll (14.27.29112.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
    File Version          : 14.27.29112.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.27.29112.0

ModLoad: 0000000050150000 0000000000019000 C:\ProgramData\BOINC\slots\7\VCRUNTIME140.dll (14.27.29112.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
    File Version          : 14.27.29112.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.27.29112.0

ModLoad: 000000005a280000 000000000000c000 C:\ProgramData\BOINC\slots\7\VCRUNTIME140_1.dll (14.27.29112.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.27.29112.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.27.29112.0

ModLoad: 000000001ea30000 000000000020d000 C:\ProgramData\BOINC\slots\7\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 000000004f980000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.19041.867 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.867

ModLoad: 000000001de90000 00000000002db000 C:\ProgramData\BOINC\slots\7\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000a79b0000 000000000919f000 C:\ProgramData\BOINC\slots\7\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1012
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA FFT Library
    Product Version       : 6,14,11,1012

ModLoad: 000000002c340000 0000000000040000 C:\ProgramData\BOINC\slots\7\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000a3c50000 0000000003d5b000 C:\ProgramData\BOINC\slots\7\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 00000000a1d80000 0000000001eca000 C:\ProgramData\BOINC\slots\7\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6,14,11,1022
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA BLAS Library
    Product Version       : 6,14,11,1022

ModLoad: 0000000060d20000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000005c5f0000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000005f020000 0000000000472000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1237) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operativsystem
    Product Version       : 10.0.19041.1165

ModLoad: 000000005ebe0000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 000000005ef60000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcrypt.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operativsystem
    Product Version       : 10.0.19041.1165

ModLoad: 000000005e4b0000 0000000000034000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1151) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 10.0.19041.1151 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1151

ModLoad: 000000005ec30000 0000000000060000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1237) (-exported- Symbols Loaded)
    Linked PDB Filename   : wintrust.pdb
    File Version          : 10.0.19041.1237 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1237

ModLoad: 000000005e6f0000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : crypt32.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operativsystem
    Product Version       : 10.0.19041.1165

ModLoad: 000000005e2d0000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : msasn1.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000060340000 000000000073f000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : shell32.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operativsystem
    Product Version       : 10.0.19041.1165

ModLoad: 000000005c7f0000 0000000000790000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : Windows.Storage.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operativsystem
    Product Version       : 10.0.19041.1165

ModLoad: 000000005ffd0000 0000000000355000 C:\WINDOWS\System32\combase.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operativsystem
    Product Version       : 10.0.19041.1202

ModLoad: 000000005e140000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.662) (-exported- Symbols Loaded)
    Linked PDB Filename   : WLDP.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operativsystem
    Product Version       : 10.0.19041.1165

ModLoad: 0000000060d50000 00000000000ae000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operativsystem
    Product Version       : 10.0.19041.1165

ModLoad: 000000005fd10000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operativsystem
    Product Version       : 10.0.19041.1165

ModLoad: 0000000026940000 0000000000267000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.5730) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
    File Version          : 27.21.14.5730
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.1.114 driver
    Product Version       : 27.21.14.5730

ModLoad: 0000000058250000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 0000000005dc0000 000000000152c000 C:\WINDOWS\system32\DriverStore\FileRepository\nvhqi.inf_amd64_6e271d4dca2c455f\nvcuda64.dll (27.21.14.5730) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
    File Version          : 27.21.14.5730
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 11.1.114 driver
    Product Version       : 27.21.14.5730

ModLoad: 0000000060f20000 000000000006b000 C:\WINDOWS\System32\WS2_32.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : ws2_32.pdb
    File Version          : 10.0.19041.1081 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operativsystem
    Product Version       : 10.0.19041.1081

ModLoad: 00000000562f0000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptnet.pdb
    File Version          : 10.0.19041.906 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.906

ModLoad: 000000005e0b0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.19041.546 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.546

ModLoad: 000000005c110000 000000000009e000 C:\WINDOWS\system32\uxtheme.dll (6.2.19041.1081) (-exported- Symbols Loaded)
    Linked PDB Filename   : UxTheme.pdb
    File Version          : 10.0.19041.1165 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operativsystem
    Product Version       : 10.0.19041.1165

ModLoad: 000000004b040000 00000000006d6000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.5730) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
    File Version          : 27.21.14.5730
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA Windows drivers
    Product Version       : 27.21.14.5730

ModLoad: 000000005f4a0000 000000000012a000 C:\WINDOWS\System32\OLE32.DLL (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : ole32.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operativsystem
    Product Version       : 10.0.19041.1202

ModLoad: 0000000056e00000 0000000000009000 C:\ProgramData\BOINC\slots\7\caffe2_nvrtc.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000001930000 0000000000fca000 C:\ProgramData\BOINC\slots\7\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
    Linked PDB Filename   : 
    File Version          : 6.14.11.9000
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA CUDA 10.2.89 NVRTC Library
    Product Version       : 6.14.11.9000

ModLoad: 000000005ef90000 0000000000083000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1202) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.19041.1202 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.19041.1202



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3625, Write: 385, Other 1466

- I/O Transfers Counters -
Read: 6459911, Write: 13334, Other 39164

- Paged Pool Usage -
QuotaPagedPoolUsage: 3505832, QuotaPeakPagedPoolUsage: 3505832
QuotaNonPagedPoolUsage: 52352, QuotaPeakNonPagedPoolUsage: 52904

- Virtual Memory Usage -
VirtualSize: -435855360, PeakVirtualSize: 189345792

- Pagefile Usage -
PagefileUsage: -435855360, PeakPagefileUsage: -435224576

- Working Set Size -
WorkingSetSize: 1758093312, PeakWorkingSetSize: 1759920128, PageFaultCount: 632247

*** Dump of thread ID 7536 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 49800672.000000

- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFC5ED59B92

- Registers -
rax=0000000000000000 rbx=0000000000000001 rcx=000000006e048c40 rdx=000000001c7fead0 rsi=0000000000000000 rdi=0000000000000000
r8=000000001c7fead0 r9=000000006e048c30 r10=0000000000000fff r11=0000000000000ff0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000005ed59b92 rsp=000000001c7feaa8 rbp=0000000000000000
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
1c7feaa0 6ddc9100 00000001 1c7fead0 1c7fead0 6e048c30 KERNELBASE!DebugBreak+0x0 
1c7feee0 6ddc9ce4 00000000 1c7ff244 00000000 00000348 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
1c7ffe40 6ddca084 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
1c7ffe70 5fb27034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
1c7ffea0 61022651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
1c7fff20 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 5860 (state: Waiting): ***

- Information -
Status: Wait Reason: Unknown, , Kernel Time: 231093744.000000, User Time: 310624992.000000, Wait Time: 49800672.000000

- Registers -
rax=0000000000000000 rbx=000000000fe1f800 rcx=00000000554a0000 rdx=0000000000000004 rsi=0000000000000024 rdi=000000001c2e1ec0
r8=000000000000000c r9=0000000000000004 r10=0000000000000000 r11=000000001c2e11c0 r12=0000000000000000 r13=000000009bfccdc0
r14=000000000000000c r15=000000008d38a010 rip=00000000b18562c5 rsp=000000001c2e1c90 rbp=000000001c2e1db0
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
1c2e1dd0 b1859536 0fe1f800 44a6cc30 9c604d60 00000000 cudnn64_7!cudnnSetAttnDescriptor+0x0 
1c2e1ee0 b186b06f 69c85de0 00000000 00000000 00000000 cudnn64_7!cudnnSetAttnDescriptor+0x0 
1c2e2390 b185eff1 1c2e4678 44a6cc30 00000005 9bfccdc0 cudnn64_7!cudnnSetRNNProjectionLayers+0x0 
1c2e2530 b1867d8e 69c94a00 00000000 9bfccdc0 1c2e27f8 cudnn64_7!cudnnSetRNNProjectionLayers+0x0 
1c2e26d0 b187dcd3 00000000 00000000 9fae00a0 1c2e27f0 cudnn64_7!cudnnSetRNNProjectionLayers+0x0 
1c2e4860 dc9189fd 9a9f32c0 0fe00000 9a9f32c0 44a6cc30 cudnn64_7!cudnnRNNForwardTraining+0x0 
1c2e4d40 dc9725ea 1c2e4e08 00000001 1c2e4e08 00000001 torch_cuda!at::native::_cudnn_rnn+0x0 
1c2e4e20 dc980cbf 1c2e5510 1c2e6d18 1c2e5e60 60ffb86b torch_cuda!at::native::set_storage_cuda_+0x0 
1c2e4f00 d49fb9fc 1c2e5510 00000000 8d559520 8d5594f0 torch_cuda!at::native::set_storage_cuda_+0x0 
1c2e5080 d4a331a2 00000001 d61a67c2 1c2e50b4 60ffb86b torch_cpu!at::native::mkldnn_sigmoid_+0x0 
1c2e5360 d5ce2613 00000000 00000000 00000003 84fd5418 torch_cpu!at::_cudnn_rnn+0x0 
1c2e5860 d5cf080b 0ed22764 9b161500 1c2e5990 00000004 torch_cpu!torch::autograd::NotImplemented::~NotImplemented+0x0 
1c2e5940 d49fb9fc 1c2e5ec0 05de5a07 1c2e5b78 1c2e59f0 torch_cpu!torch::autograd::GraphRoot::apply+0x0 
1c2e5ac0 d4a331a2 9bfcd070 00000000 0ed228d4 dd83a3f0 torch_cpu!at::native::mkldnn_sigmoid_+0x0 
1c2e5da0 dc9169a1 1c2e0001 00000001 00000004 00000004 torch_cpu!at::_cudnn_rnn+0x0 
1c2e5f70 dc920117 00000000 1c2e6d18 2ca12e0d 1c2e6090 torch_cuda!at::native::_use_cudnn_ctc_loss+0x0 
1c2e6000 d478107b d98d1ac0 1c2e6320 f5a78112 6d414db0 torch_cuda!at::native::_cudnn_rnn_flatten_weight+0x0 
1c2e6270 d47b3b16 00000001 1c2e6d18 00000080 9f637848 torch_cpu!at::native::fbgemm_pack_quantized_matrix+0x0 
1c2e6400 d4b2ae89 1c2e6478 00000001 1c2e6478 00000001 torch_cpu!at::native::gru+0x0 
1c2e6490 d5e19fa3 1c2e6590 00000001 1c2e6710 1c2e6d18 torch_cpu!at::zeros_out+0x0 
1c2e6520 d4b1dd35 2c3f1ea8 6cd62b60 00000000 2c3f1ea8 torch_cpu!torch::autograd::GraphRoot::apply+0x0 
1c2e65a0 d49f88ec d98d75c8 37b67ee0 9c604ca0 1c2e67c0 torch_cpu!at::zeros_out+0x0 
1c2e66a0 d4a6c1bb 0000000c 00000080 00000004 9b160c00 torch_cpu!at::native::mkldnn_sigmoid_+0x0 
1c2e6720 d6557294 1c2e6840 37b67ee0 1c2e6830 1c2e69d8 torch_cpu!at::gru+0x0 
1c2e6950 d65562ab 1c2e6cf0 d498030e 1c2e6cf0 1c2e6d18 torch_cpu!torch::nn::GRUImpl::forward_helper+0x0 
1c2e6a40 6dda2621 0000000f 1c2e7750 00000000 2c3f1ea8 torch_cpu!torch::nn::GRUImpl::forward+0x0 
1c2e6c40 6dda705a 00000000 1c2e0000 1c2e0601 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::error+0x0 
1c2e7140 6ddab950 1c2e7240 1c2e7240 00000000 463e4680 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0 
1c2ffee0 6dfec6f8 6d279830 00000000 00000000 6cb15a20 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
1c2fff20 5fb27034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0 
1c2fff50 61022651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
1c2fffd0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 3388 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 49800672.000000

- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=000000001c8ffa20 rsi=0000000000000000 rdi=000000000000000d
r8=0000000000000001 r9=000000006d3be900 r10=0000000000000000 r11=000000001c8ff990 r12=0000000000000064 r13=000000001c8ffa20
r14=000000001c8ff720 r15=0000000000000000 rip=000000006106d8c4 rsp=000000001c8ff6c8 rbp=000000006d3be950
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
1c8ff6c0 5ecdcb70 00000000 1c023000 6113a4d0 1c023000 ntdll!ZwWaitForMultipleObjects+0x0 
1c8ff9b0 5ecdca6e 6b784960 004e0049 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0 
1c8ff9f0 05f6bb54 6d3c2550 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0 
1c8ffc30 060009ed 00000000 00000004 00000000 00000000 nvcuda64!+0x0 
1c8ffce0 05f6b523 bd41bb33 90214839 6d9119f0 00000000 nvcuda64!cuProfilerStop+0x0 
1c8ffd10 0627a750 6d9119f0 00000000 00000000 00000000 nvcuda64!+0x0 
1c8ffd40 5fb27034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
1c8ffd70 61022651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
1c8ffdf0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 8820 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 49795840.000000

- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002e0 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002e0
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=000000006d3e3ec0 r13=0000000000000000
r14=00000000000002e0 r15=0000000000000000 rip=000000006106cdf4 rsp=000000001c9ff5d8 rbp=0000000000000000
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
1c9ff5d0 5ecb1a8e 00000000 00000000 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0 
1c9ff670 0617bf48 00000000 5ecba3c5 00000000 000002e0 KERNELBASE!WaitForSingleObjectEx+0x0 
1c9ff6e0 05f6b523 00000001 6dee46d0 6d911de0 00000000 nvcuda64!cuProfilerStop+0x0 
1c9ff710 0627a750 6d911de0 00000000 00000000 00000000 nvcuda64!+0x0 
1c9ff740 5fb27034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
1c9ff770 61022651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
1c9ff7f0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 2948 (state: Waiting): ***

- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 49800652.000000

- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=000000006d67f258 rdx=000000001caff9b8 rsi=000000001caff920 rdi=0000000000000000
r8=0000000000000001 r9=0000000000000b84 r10=000000006d6839d8 r11=00000000fd543d54 r12=000000001caff9b8 r13=0000000000000000
r14=000000006d67f258 r15=000000006d6839d8 rip=0000000061070764 rsp=000000001caff8f8 rbp=000000001caff950
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
1caff8f0 61034295 00000102 00000102 00000000 1caff920 ntdll!NtWaitForAlertByThreadId+0x0 
1caff960 5ecfce39 6d6811c0 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0 
1caff990 05ef223a 6d6811c0 610207b0 6d6811c0 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0 
1caff9f0 05f6b523 00000001 bd205a94 00000000 00000000 nvcuda64!+0x0 
1caffa20 0627a750 6d901df0 00000000 00000000 00000000 nvcuda64!+0x0 
1caffa50 5fb27034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0 
1caffa80 61022651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
1caffb00 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 7160 (state: Running): ***

- Information -
Status: Base Priority: Unknown, Priority: Unknown, , Kernel Time: 8437500.000000, User Time: 202343744.000000, Wait Time: 49800672.000000

- Registers -
rax=00000000000001d0 rbx=0000000000000000 rcx=00000000845b09c8 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000845b09c8
r8=0000000000000008 r9=0000000000000000 r10=000000009f595a70 r11=000000009fc77a80 r12=0000000000000000 r13=0000000000000000
r14=000000001cbff960 r15=00000000845b0978 rip=0000000061070764 rsp=000000001cbff938 rbp=000000001cbff990
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
1cbff930 61034021 8d904dc8 8d904dc8 1cbffa70 8d904dc8 ntdll!NtWaitForAlertByThreadId+0x0 
1cbff9b0 5ecfcee9 845b0970 845b09b8 00000000 00000000 ntdll!RtlSleepConditionVariableSRW+0x0 
1cbff9f0 286bba8d 8d5916e0 8d5916e0 8d5916e0 00000000 KERNELBASE!SleepConditionVariableSRW+0x0 
1cbffa30 28692848 9a8eb090 00000000 00000000 d61905b4 MSVCP140!__crtSetThreadpoolWait+0x0 
1cbffa60 28692710 00000000 28692f17 00000000 9a8eb090 MSVCP140!std::_Winerror_message+0x0 
1cbffad0 d619064b 9a8eb070 000001c0 845b0970 845b0970 MSVCP140!std::_Winerror_message+0x0 
1cbffb10 d61925b1 9f6b8410 ffffffff 9a8eb070 ffffffff torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0 
1cbffe00 d6192471 d96b6d10 1cbffe40 d96b6d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0 
1cbffe50 d6189744 00080001 9fc2a2f0 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0 
1cbffe80 5eb01bb2 9fc2a2f0 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0 
1cbffeb0 5fb27034 00000000 00000000 00000000 00000000 ucrtbase!_configthreadlocale+0x0 
1cbffee0 61022651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
1cbfff60 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)