Task 4604946
| Name | ParityMachine-1617245131-2857-0_1 |
| Workunit | 2590280 |
| Created | 2 Apr 2021, 23:27:50 UTC |
| Sent | 3 Apr 2021, 0:20:03 UTC |
| Report deadline | 11 Apr 2021, 0:20:03 UTC |
| Received | 3 Apr 2021, 9:55:32 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 197 (0x000000C5) EXIT_TIME_LIMIT_EXCEEDED |
| Computer ID | 16757 |
| Run time | 9 hours 27 min 4 sec |
| CPU time | 9 hours 22 min 56 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 3,941.68 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 1.64 GB |
| Peak swap size | 3.61 GB |
| Peak disk usage | 1.53 GB |
Stderr output
<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
exceeded elapsed time limit 34023.60 (4000000.00G/117.57G)</message>
<stderr_txt>
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 1060 3GB)
[2021-04-02 18:22:47 main:435] : INFO : Set logging level to 1
[2021-04-02 18:22:47 main:441] : INFO : Running in BOINC Client mode
[2021-04-02 18:22:47 main:444] : INFO : Resolving all filenames
[2021-04-02 18:22:47 main:452] : INFO : Resolved: dataset.hdf5 => ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 (exists = 1)
[2021-04-02 18:22:47 main:452] : INFO : Resolved: model.cfg => ../../projects/www.mlcathome.org_mlcathome/ParityMachine-1617245131-2857-0_1_r1486584281_1 (exists = 0)
[2021-04-02 18:22:47 main:452] : INFO : Resolved: model-final.pt => ../../projects/www.mlcathome.org_mlcathome/ParityMachine-1617245131-2857-0_1_r1486584281_0 (exists = 0)
[2021-04-02 18:22:47 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 0)
[2021-04-02 18:22:47 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2021-04-02 18:22:47 main:472] : INFO : Dataset filename: ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5
[2021-04-02 18:22:47 main:474] : INFO : Configuration:
[2021-04-02 18:22:47 main:475] : INFO : Model type: GRU
[2021-04-02 18:22:47 main:476] : INFO : Validation Loss Threshold: 0.0001
[2021-04-02 18:22:47 main:477] : INFO : Max Epochs: 2048
[2021-04-02 18:22:47 main:478] : INFO : Batch Size: 128
[2021-04-02 18:22:47 main:479] : INFO : Learning Rate: 0.01
[2021-04-02 18:22:47 main:480] : INFO : Patience: 10
[2021-04-02 18:22:47 main:481] : INFO : Hidden Width: 12
[2021-04-02 18:22:47 main:482] : INFO : # Recurrent Layers: 4
[2021-04-02 18:22:47 main:483] : INFO : # Backend Layers: 4
[2021-04-02 18:22:47 main:484] : INFO : # Threads: 1
[2021-04-02 18:22:47 main:486] : INFO : Preparing Dataset
[2021-04-02 18:22:47 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 into memory
[2021-04-02 18:22:48 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 into memory
[2021-04-02 18:22:54 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2021-04-02 18:22:54 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 into memory
[2021-04-02 18:22:54 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from ../../projects/www.mlcathome.org_mlcathome/ParityMachine-train-val-dataset.hdf5 into memory
[2021-04-02 18:22:54 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2021-04-02 18:22:54 main:494] : INFO : Creating Model
[2021-04-02 18:22:54 main:507] : INFO : Preparing config file
[2021-04-02 18:22:54 main:519] : INFO : Creating new config file
[2021-04-02 18:22:57 main:559] : INFO : Loading DataLoader into Memory
[2021-04-02 18:22:57 main:562] : INFO : Starting Training
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFF9BFB1A52
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 04/03/21 03:49:42
Install Directory : C:\Program Files\BOINC\
Data Directory : C:\Program Files\BOINC\Data
Project Symstore :
LoadLibraryA( C:\Program Files\BOINC\Data\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( C:\Program Files\BOINC\Data\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\Program Files\BOINC\Data\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\Program Files\BOINC\Data\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: C:\Program Files\BOINC\Data\slots\1;C:\Program Files\BOINC\Data\projects\www.mlcathome.org_mlcathome
ModLoad: 000000001fdb0000 00000000003df000 C:\Program Files\BOINC\Data\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000009ebc0000 00000000001f0000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.18362.1411) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.18362.1316 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1316
ModLoad: 000000009e460000 00000000000b2000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.18362.1350) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.18362.1350 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1350
ModLoad: 000000009bef0000 00000000002a5000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.18362.1411) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.18362.1350 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1350
ModLoad: 0000000099cc0000 000000000008f000 C:\WINDOWS\SYSTEM32\apphelp.dll (6.2.18362.1139) (-exported- Symbols Loaded)
Linked PDB Filename : apphelp.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 000000009de70000 0000000000194000 C:\WINDOWS\System32\USER32.dll (6.2.18362.1316) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 000000009bec0000 0000000000021000 C:\WINDOWS\System32\win32u.dll (6.2.18362.1440) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.18362.1440 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1440
ModLoad: 000000009e8d0000 0000000000026000 C:\WINDOWS\System32\GDI32.dll (6.2.18362.1316) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.18362.1316 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1316
ModLoad: 000000009bd20000 0000000000198000 C:\WINDOWS\System32\gdi32full.dll (6.2.18362.1440) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.18362.1440 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1440
ModLoad: 000000009c250000 000000000009e000 C:\WINDOWS\System32\msvcp_win.dll (6.2.18362.1110) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.18362.1110 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1110
ModLoad: 000000009c2f0000 00000000000fa000 C:\WINDOWS\System32\ucrtbase.dll (6.2.18362.1110) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.18362.1110 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1110
ModLoad: 000000009d600000 00000000000a3000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.18362.752) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 000000009ddc0000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.18362.1
ModLoad: 000000009e6a0000 0000000000097000 C:\WINDOWS\System32\sechost.dll (6.2.18362.1316) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 000000009e900000 000000000011f000 C:\WINDOWS\System32\RPCRT4.dll (6.2.18362.1316) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 000000007e2d0000 0000000000058000 C:\Program Files\BOINC\Data\slots\1\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000080cb0000 0000000000091000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.25.28508.3) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\8\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.25.28508.3 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.25.28508.3
ModLoad: 0000000094250000 00000000001f4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.18362.1440) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.18362.1440 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1440
ModLoad: 00000000811b0000 0000000000019000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.25.28508.3) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\8\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.25.28508.3 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.25.28508.3
ModLoad: 0000000080320000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.25.28508.3) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\8\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.25.28508.3 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.25.28508.3
ModLoad: 00000000fdcf0000 000000000abe7000 C:\Program Files\BOINC\Data\slots\1\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000102c0000 00000000002db000 C:\Program Files\BOINC\Data\slots\1\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000170a0000 000000000020d000 C:\Program Files\BOINC\Data\slots\1\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 000000007f7e0000 0000000000040000 C:\Program Files\BOINC\Data\slots\1\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000d91a0000 0000000024b49000 C:\Program Files\BOINC\Data\slots\1\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000075c50000 0000000000045000 C:\Program Files\BOINC\Data\slots\1\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000d5ce0000 00000000034b2000 C:\Program Files\BOINC\Data\slots\1\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 0000000083cd0000 0000000000010000 C:\Program Files\BOINC\Data\slots\1\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 00000000d2c30000 00000000030a5000 C:\Program Files\BOINC\Data\slots\1\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 00000000ceed0000 0000000003d5b000 C:\Program Files\BOINC\Data\slots\1\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000cd000000 0000000001eca000 C:\Program Files\BOINC\Data\slots\1\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000c3e60000 000000000919f000 C:\Program Files\BOINC\Data\slots\1\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 00000000a8ab0000 000000001b3a4000 C:\Program Files\BOINC\Data\slots\1\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 000000009bb30000 0000000000081000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.18362.1237) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.18362.1237 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1237
ModLoad: 000000009e240000 000000000002e000 C:\WINDOWS\System32\IMM32.DLL (6.2.18362.387) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.18362.387 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.387
ModLoad: 000000009bb10000 0000000000011000 C:\WINDOWS\System32\kernel.appcore.dll (6.2.18362.1171) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.18362.1171 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1171
ModLoad: 000000009a720000 0000000000020000 C:\WINDOWS\SYSTEM32\dxcore.dll (6.2.18362.1316) (-exported- Symbols Loaded)
Linked PDB Filename : DXCore.pdb
File Version : 10.0.18362.1316 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1316
ModLoad: 000000009c4a0000 000000000004a000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.18362.387) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.18362.387 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.387
ModLoad: 000000009d2c0000 0000000000336000 C:\WINDOWS\System32\combase.dll (6.2.18362.1411) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 000000009cd60000 0000000000470000 C:\WINDOWS\System32\Setupapi.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 000000009c220000 0000000000026000 C:\WINDOWS\System32\bcrypt.dll (6.2.18362.1237) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 000000009b850000 000000000002a000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.18362.387) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.18362.387 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.387
ModLoad: 000000009c1c0000 000000000005c000 C:\WINDOWS\System32\WINTRUST.dll (6.2.18362.1377) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.18362.1377 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1377
ModLoad: 000000009baf0000 0000000000012000 C:\WINDOWS\System32\MSASN1.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 000000009bbc0000 0000000000151000 C:\WINDOWS\System32\CRYPT32.dll (6.2.18362.1411) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 000000009d6d0000 00000000006e8000 C:\WINDOWS\System32\Shell32.dll (6.2.18362.1411) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.18362.900 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.900
ModLoad: 000000009e270000 00000000000a7000 C:\WINDOWS\System32\shcore.dll (6.2.18362.1316) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 000000009c4f0000 000000000077b000 C:\WINDOWS\System32\windows.storage.dll (6.2.18362.1411) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 000000009bad0000 000000000001e000 C:\WINDOWS\System32\profapi.dll (6.2.18362.1411) (-nosymbols- Symbols Loaded)
Linked PDB Filename : profapi.pdb
File Version : 10.0.18362.1411 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1411
ModLoad: 000000009ba80000 000000000004a000 C:\WINDOWS\System32\powrprof.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : powrprof.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 000000009ba70000 0000000000010000 C:\WINDOWS\System32\UMPDC.dll (-exported- Symbols Loaded)
Linked PDB Filename : UMPDC.pdb
ModLoad: 000000009e870000 0000000000052000 C:\WINDOWS\System32\shlwapi.dll (6.2.18362.1316) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 000000009c1a0000 0000000000017000 C:\WINDOWS\System32\cryptsp.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : cryptsp.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 0000000079a70000 000000000029d000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.6109) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r460\r460_94\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 27.21.14.6109
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.2.109 driver
Product Version : 27.21.14.6109
ModLoad: 0000000095e80000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 00000000105a0000 00000000015c2000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_3621da861144492b\nvcuda64.dll (27.21.14.6109) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r460\r460_94\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 27.21.14.6109
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.2.109 driver
Product Version : 27.21.14.6109
ModLoad: 000000009d1d0000 000000000006f000 C:\WINDOWS\System32\WS2_32.dll (6.2.18362.387) (-exported- Symbols Loaded)
Linked PDB Filename : ws2_32.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 0000000095790000 000000000002f000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 000000009b480000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 0000000099dc0000 0000000000099000 C:\WINDOWS\system32\uxtheme.dll (6.2.18362.1316) (-exported- Symbols Loaded)
Linked PDB Filename : UxTheme.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 0000000092d50000 00000000006f0000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.6109) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r460\r460_94\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 27.21.14.6109
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 27.21.14.6109
ModLoad: 000000009ea20000 0000000000157000 C:\WINDOWS\System32\OLE32.DLL (6.2.18362.1316) (-exported- Symbols Loaded)
Linked PDB Filename : ole32.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 0000000081fb0000 0000000000009000 C:\Program Files\BOINC\Data\slots\1\caffe2_nvrtc.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000000dc30000 0000000000fca000 C:\Program Files\BOINC\Data\slots\1\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6.14.11.9000
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.89 NVRTC Library
Product Version : 6.14.11.9000
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 3603, Write: 308, Other 1138
- I/O Transfers Counters -
Read: 6490309, Write: 7866, Other 33928
- Paged Pool Usage -
QuotaPagedPoolUsage: 3503496, QuotaPeakPagedPoolUsage: 3503720
QuotaNonPagedPoolUsage: 52352, QuotaPeakNonPagedPoolUsage: 52624
- Virtual Memory Usage -
VirtualSize: -414568448, PeakVirtualSize: 195944448
- Pagefile Usage -
PagefileUsage: -414568448, PeakPagefileUsage: -414568448
- Working Set Size -
WorkingSetSize: 208285696, PeakWorkingSetSize: 1768103936, PageFaultCount: 630777
*** Dump of thread ID 54508 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 12297635.000000
- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFF9BFB1A52
- Registers -
rax=0000000000000000 rbx=0000000000000001 rcx=0000000020068c40 rdx=0000000002cfe6d0 rsi=0000000000000000 rdi=0000000000000000
r8=0000000002cfe6d0 r9=0000000020068c30 r10=0000000000000fff r11=0000000000000ff0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000009bfb1a52 rsp=0000000002cfe6a8 rbp=0000000000000000
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
02cfe6a0 1fde9100 00000001 02cfe6d0 02cfe6d0 20068c30 KERNELBASE!DebugBreak+0x0
02cfeae0 1fde9ce4 88000000 02cfee44 00000000 00000384 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
02cffa40 1fdea084 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
02cffa70 9e477c24 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
02cffaa0 9ec2d721 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
02cffb20 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 54596 (state: Running): ***
- Information -
Status: Base Priority: Above Normal, Priority: Above Normal, , Kernel Time: 107500000.000000, User Time: 337660641280.000000, Wait Time: 12297636.000000
- Registers -
rax=0000000000000000 rbx=000000008c247840 rcx=000000008c247810 rdx=000000008c247810 rsi=000000008bf26600 rdi=0000000000000001
r8=0000000000000003 r9=000000007ffe3000 r10=00000000546c6148 r11=00000000f4fc665e r12=0000000000000000 r13=000000008c73b200
r14=000000008c247810 r15=00000000105a0000 rip=0000000010829905 rsp=00000000025e4600 rbp=000000008c247810
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000297
- Callstack -
ChildEBP RetAddr Args to Child
025e4630 10829217 00000000 8c247810 00000001 8bf26650 nvcuda64!cuProfilerStop+0x0
025e4680 1095e197 025e4738 025e5018 00000000 8bf26650 nvcuda64!cuProfilerStop+0x0
025e4720 10850614 00000028 00000003 62fb325f 62fd018f nvcuda64!cuProfilerStop+0x0
025e4760 10850dd1 00000000 025e4870 00000001 025e47e8 nvcuda64!cuProfilerStop+0x0
025e4f50 1071c9a8 025e4fa0 8c73b220 025e5060 8c73b220 nvcuda64!cuProfilerStop+0x0
025e5190 105dfb35 40000000 1071a7fa 025e0000 00000000 nvcuda64!+0x0
025e5240 105e012b 40000000 8bf26660 025e5448 025e5448 nvcuda64!+0x0
025e52d0 105e5ead 8bf26650 00000000 02601c00 00000000 nvcuda64!+0x0
025e5650 107aac5c 204af4e0 00000000 025e5a78 032c0231 nvcuda64!+0x0
025e5750 d91b0dc0 025e5a78 02601c00 00000004 00000000 nvcuda64!cuMemcpyDtoHAsync_v2+0x0
025e5880 d91a23ee 8cfb1140 00000000 00000004 00000002 torch_cuda!+0x0
025e58d0 d91a2381 8cda0860 025e59e1 00000002 025e5c38 torch_cuda!+0x0
025e5910 d91a5ab0 025e59e0 9bf4cb6b 75c8d6d8 00000000 torch_cuda!+0x0
025e5a30 db180793 025e5e00 00000000 025e7360 025e5e38 torch_cuda!+0x0
025e5bf0 db181e02 7e309c50 025e5e00 025e7360 025e5e90 torch_cuda!at::native::searchsorted_out_cuda+0x0
025e5dd0 db18205a 00000001 025e68d8 00000001 025e5e48 torch_cuda!at::native::searchsorted_out_cuda+0x0
025e5e10 dbf73684 025e5e90 00000001 025e5e48 00000001 torch_cuda!at::native::_local_scalar_dense_cuda+0x0
025e5e60 dbf81107 025e5f80 032dbfac 00000001 025e5e40 torch_cuda!at::native::set_storage_cuda_+0x0
025e5eb0 03776bbe 08610640 00000001 00000000 051c2f07 torch_cuda!at::native::set_storage_cuda_+0x0
025e60c0 04a23c5e 00000000 025e68d8 025e68d8 025e6470 torch_cpu!at::_local_scalar_dense+0x0
025e6100 037029c7 025e6590 032dbfac 025e6220 025e61d0 torch_cpu!torch::autograd::NotImplemented::~NotImplemented+0x0
025e6150 03776bbe 08610640 025e6548 00000000 025e7360 torch_cpu!at::native::mkldnn_sigmoid_+0x0
025e6360 0352dead 025e62e8 00000001 025e65d0 025e6470 torch_cpu!at::_local_scalar_dense+0x0
025e6520 0386d1e1 025e6558 00000001 025e65d0 025e68d8 torch_cpu!at::native::item+0x0
025e6570 04a84d4e 025e65d0 00000001 025e6550 7e321ea8 torch_cpu!at::zeros_out+0x0
025e65a0 037029c7 1fad14c0 032dbfac 1fad14d0 7e321ea8 torch_cpu!torch::autograd::GraphRoot::apply+0x0
025e65f0 0389e69e 08610640 025e6620 08610640 038b129f torch_cpu!at::native::mkldnn_sigmoid_+0x0
025e6800 0388a68e 025e6960 03574e49 025e6920 025e6960 torch_cpu!at::Tensor::item+0x0
025e6850 1fdc712b 025e6920 025e6920 025e6920 025e7360 torch_cpu!at::Tensor::item<double>+0x0
025e6d50 1fdcb950 025e6ed0 025e6ed0 00000000 e214fe90 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0
025ffaf0 2000c6f8 8bb0c250 00000000 00000000 8ba6e100 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
025ffb30 9e477c24 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
025ffb60 9ec2d721 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
025ffbe0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 45352 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 156250.000000, User Time: 156250.000000, Wait Time: 12297632.000000
- Registers -
rax=000000000000005b rbx=000000000000000a rcx=000000000000000a rdx=0000000002dff890 rsi=0000000000000000 rdi=000000000000000a
r8=000000008bf21090 r9=000000008bc9f100 r10=0000000000000000 r11=0000000002dff800 r12=0000000000000064 r13=0000000002dff890
r14=0000000002dff580 r15=0000000000000000 rip=000000009ec5d8e4 rsp=0000000002dff528 rbp=000000008bc9f190
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
02dff520 9bf42ae7 9ea43a90 9ec343f4 00000000 02711000 ntdll!NtWaitForMultipleObjects+0x0
02dff820 9bf429ce 10aa81f8 8a117a00 0000000a 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
02dff860 10756714 8bca3810 00000000 8bc9e9b0 00000000 KERNELBASE!WaitForMultipleObjects+0x0
02dffaa0 107ee55d 00000000 8bc9f190 00000000 00000000 nvcuda64!+0x0
02dffb50 107560e3 62f19269 30ebdf9b 8c25dad0 00000000 nvcuda64!cuProfilerStop+0x0
02dffb80 10a6d904 8c25dad0 00000000 00000000 00000000 nvcuda64!+0x0
02dffbb0 9e477c24 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
02dffbe0 9ec2d721 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
02dffc60 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 54172 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 10120718.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002dc rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002dc
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=0000000000000000 r13=0000000000000000
r14=00000000000002dc r15=0000000000000000 rip=000000009ec5ce14 rsp=0000000002eff648 rbp=000000008bc87540
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
02eff640 9bf31e93 00000000 00000000 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0
02eff6e0 1096cede 8c25dbc0 9bf1dd05 00000000 000002dc KERNELBASE!WaitForSingleObjectEx+0x0
02eff750 107560e3 8bc87540 99a814d0 8c25dbc0 00000000 nvcuda64!cuProfilerStop+0x0
02eff780 10a6d904 8c25dbc0 00000000 00000000 00000000 nvcuda64!+0x0
02eff7b0 9e477c24 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
02eff7e0 9ec2d721 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
02eff860 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 24652 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 12297624.000000
- Registers -
rax=00000000000001ca rbx=0000000000000000 rcx=000000008bf24298 rdx=0000000002fffcd8 rsi=0000000002fffc40 rdi=0000000000000000
r8=0000000000000003 r9=0000000000000004 r10=0000000000000003 r11=0000000002fffc70 r12=0000000002fffcd8 r13=0000000000000000
r14=000000008bf24298 r15=000000008bf28e70 rip=000000009ec606c4 rsp=0000000002fffc18 rbp=0000000002fffc70
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
02fffc10 9ec20f35 00000102 1082992e 00000000 02fffc40 ntdll!ZwWaitForAlertByThreadId+0x0
02fffc80 9bf6c849 8bf26650 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0
02fffcb0 106d4a9c 8bf26650 8bf26650 8bf26650 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0
02fffd10 107560e3 00000003 62fc4e9d 00000000 00000000 nvcuda64!+0x0
02fffd40 10a6d904 8c25d1a0 00000000 00000000 00000000 nvcuda64!+0x0
02fffd70 9e477c24 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
02fffda0 9ec2d721 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
02fffe20 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 5328 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 312500.000000, User Time: 1093750.000000, Wait Time: 10121434.000000
- Registers -
rax=00000000000001ca rbx=0000000000000000 rcx=0000000002061688 rdx=0000000000000000 rsi=0000000000000000 rdi=0000000000000000
r8=00000000e7978d30 r9=00000000030ff7b0 r10=0000000000000380 r11=00000000030ff398 r12=0000000000000003 r13=00000000000001c0
r14=0000000002061638 r15=0000000000000000 rip=000000009ec606c4 rsp=00000000030ff858 rbp=0000000002061688
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
030ff850 9ec20cb0 030ff980 1ad46e88 030ffbc0 04ed092a ntdll!ZwWaitForAlertByThreadId+0x0
030ff8c0 9bf1ec8d 02061630 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableSRW+0x0
030ff900 80cebc2d 085ad5d0 085ad5d0 085ad5d0 00000000 KERNELBASE!SleepConditionVariableSRW+0x0
030ff940 80cc28c8 1b033420 00000000 00000000 04ed05b4 MSVCP140!__crtSetThreadpoolWait+0x0
030ff970 80cc2790 00000000 80cc2f97 00000000 1b033420 MSVCP140!std::_Winerror_message+0x0
030ff9e0 04ed064b 1b033400 000001c0 02061630 02061630 MSVCP140!std::_Winerror_message+0x0
030ffa20 04ed25b1 20349500 ffffffff 1b033400 ffffffff torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
030ffd10 04ed2471 083f6d10 030ffd50 083f6d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0
030ffd60 04ec9744 00080001 206a0dc0 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0
030ffd90 9c3110b2 206a0dc0 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0
030ffdc0 9e477c24 00000000 00000000 00000000 00000000 ucrtbase!_beginthreadex+0x0
030ffdf0 9ec2d721 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
030ffe70 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)