Task 2654258

Name ParityMachine-1593921480-21321-46_1
Workunit 1196048
Created 29 Oct 2020, 4:39:30 UTC
Sent 2 Nov 2020, 23:21:30 UTC
Report deadline 6 Nov 2020, 23:21:30 UTC
Received 14 Nov 2020, 5:11:20 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 197 (0x000000C5) EXIT_TIME_LIMIT_EXCEEDED
Computer ID 4217
Run time 16 hours 32 min 5 sec
CPU time 3 hours 54 min 34 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 2.65 GFLOPS
Application version Machine Learning Dataset Generator v9.61
windows_x86_64
Peak working set size 604.55 MB
Peak swap size 596.55 MB
Peak disk usage 196.45 MB

Stderr output

<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
exceeded elapsed time limit 59524.02 (400000.00G/6.72G)</message>
<stderr_txt>


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FF89893E152

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.17.0


Dump Timestamp    : 11/14/20 05:09:31
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\213;C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome


ModLoad: 00000000342c0000 00000000003de000 C:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds_9.61_windows_x86_64.exe (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000009c290000 00000000001ed000 C:\Windows\SYSTEM32\ntdll.dll (6.2.17763.1432) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 10.0.17763.771 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.771

ModLoad: 000000009be00000 00000000000b3000 C:\Windows\System32\KERNEL32.DLL (6.2.17763.475) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 10.0.17763.1432 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1432

ModLoad: 0000000098880000 0000000000294000 C:\Windows\System32\KERNELBASE.dll (6.2.17763.1432) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 10.0.17763.1432 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1432

ModLoad: 0000000099cd0000 0000000000197000 C:\Windows\System32\USER32.dll (6.2.17763.1432) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000099460000 0000000000020000 C:\Windows\System32\win32u.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : win32u.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 000000009a520000 0000000000029000 C:\Windows\System32\GDI32.dll (6.2.17763.592) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 10.0.17763.592 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.592

ModLoad: 0000000098620000 000000000019c000 C:\Windows\System32\gdi32full.dll (6.2.17763.1457) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32full.pdb
    File Version          : 10.0.17763.1457 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1457

ModLoad: 00000000987e0000 00000000000a0000 C:\Windows\System32\msvcp_win.dll (6.2.17763.348) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.17763.348 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.348

ModLoad: 0000000098520000 00000000000fa000 C:\Windows\System32\ucrtbase.dll (6.2.17763.719) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.17763.719 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.719

ModLoad: 000000009c080000 00000000000a3000 C:\Windows\System32\ADVAPI32.dll (6.2.17763.1131) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 000000009a310000 000000000009e000 C:\Windows\System32\msvcrt.dll (7.0.17763.475) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.17763.475 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.17763.475

ModLoad: 0000000099ea0000 000000000009e000 C:\Windows\System32\sechost.dll (6.2.17763.1339) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 000000009bf50000 0000000000122000 C:\Windows\System32\RPCRT4.dll (6.2.17763.1457) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000001f10000 0000000000058000 C:\ProgramData\BOINC\slots\213\c10.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000008ff90000 00000000001ed000 C:\Windows\SYSTEM32\dbghelp.dll (6.2.17763.1432) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.17763.1432 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1432

ModLoad: 000000008a8e0000 000000000009f000 C:\Windows\SYSTEM32\MSVCP140.dll (14.11.25325.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp140.amd64.pdb
    File Version          : 14.11.25325.0 built by: VCTOOLSREL
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174; 2017
    Product Version       : 14.11.25325.0

ModLoad: 0000000093680000 0000000000016000 C:\Windows\SYSTEM32\VCRUNTIME140.dll (14.11.25325.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : vcruntime140.amd64.pdb
    File Version          : 14.11.25325.0 built by: VCTOOLSREL
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174; 2017
    Product Version       : 14.11.25325.0

ModLoad: 000000007c610000 000000000000c000 C:\ProgramData\BOINC\slots\213\VCRUNTIME140_1.dll (14.27.29016.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : d:\agent\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
    File Version          : 14.27.29016.0 built by: vcwrkspc
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Visual Studio&#174;
    Product Version       : 14.27.29016.0

ModLoad: 0000000024a50000 000000000abe7000 C:\ProgramData\BOINC\slots\213\torch_cpu.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000004e0a0000 00000000002db000 C:\ProgramData\BOINC\slots\213\fbgemm.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 000000002b4c0000 0000000000040000 C:\ProgramData\BOINC\slots\213\asmjit.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000028880000 000000000020d000 C:\ProgramData\BOINC\slots\213\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
    Linked PDB Filename   : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
    File Version          : 20200205
    Company Name          : Intel Corporation
    Product Name          : Intel(R) OpenMP* Runtime Library
    Product Version       : 5.0

ModLoad: 0000000099e70000 000000000002e000 C:\Windows\System32\IMM32.DLL (6.2.17763.719) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 10.0.17763.719 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.719

ModLoad: 0000000098290000 0000000000011000 C:\Windows\System32\kernel.appcore.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000093300000 000000000000a000 C:\Windows\SYSTEM32\version.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3693, Write: 989, Other 2352

- I/O Transfers Counters -
Read: 6536850, Write: 2441818, Other 48840

- Paged Pool Usage -
QuotaPagedPoolUsage: 464056, QuotaPeakPagedPoolUsage: 464328
QuotaNonPagedPoolUsage: 12912, QuotaPeakNonPagedPoolUsage: 14408

- Virtual Memory Usage -
VirtualSize: 529711104, PeakVirtualSize: 826359808

- Pagefile Usage -
PagefileUsage: 529711104, PeakPagefileUsage: 626016256

- Working Set Size -
WorkingSetSize: 539324416, PeakWorkingSetSize: 635039744, PageFaultCount: 147994468

*** Dump of thread ID 3824 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 937500.000000, User Time: 0.000000, Wait Time: 2364114.000000

- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FF89893E152

- Registers -
rax=0000000000000000 rbx=0000000000000001 rcx=0000000034578c70 rdx=00000000df4fe6f0 rsi=0000000000000000 rdi=0000000000000000
r8=00000000df4fe6f0 r9=0000000034578c60 r10=0000000000000fff r11=0000000000000ff0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000009893e152 rsp=00000000df4fe6c8 rbp=0000000000000000
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
df4fe6c0 342f9700 00000001 df4fe6f0 df4fe6f0 34578c60 KERNELBASE!DebugBreak+0x0 
df4feb00 342fa2e4 46e00000 df4fee64 00000000 00000124 mlds_9.61_windows_x86_64!c10::ivalue::Future::wait+0x0 
df4ffa60 342fa684 00000000 00000000 00000000 00000000 mlds_9.61_windows_x86_64!c10::ivalue::Future::wait+0x0 
df4ffa90 9be17974 00000000 00000000 00000000 00000000 mlds_9.61_windows_x86_64!c10::ivalue::Future::wait+0x0 
df4ffac0 9c2fa271 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
df4ffb40 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 12396 (state: Running): ***

- Information -
Status: Base Priority: Above Normal, Priority: Above Normal, , Kernel Time: 6701093888.000000, User Time: 74150780928.000000, Wait Time: 2364093.000000

- Registers -
rax=00000000df2fc350 rbx=0000000000000000 rcx=0000000000000001 rdx=00000000df2fc340 rsi=00000000fffff960 rdi=00000000fffff9e0
r8=00000000df2fbd40 r9=0000000072dc5aa0 r10=00000000df2fbd20 r11=0000000000000000 r12=0000000000004b00 r13=0000000072dc1a00
r14=00000000fffff980 r15=00000000fffff960 rip=000000002ab02060 rsp=00000000df2fbc20 rbp=00000000df2fbc60
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
df2fbdf0 2aaf4adc df2fc250 00000002 df2fc030 00000000 torch_cpu!torch::jit::fuser::PartitionInfo::PartitionInfo+0x0 
df2fbe30 2a2ccbd0 7c516020 01f2edca df2fc2a0 df2fc320 torch_cpu!torch::jit::fuser::PartitionInfo::PartitionInfo+0x0 
df2fbed0 2a2d2541 00000000 df2fc050 df2fbfe0 df2fbf58 torch_cpu!at::SplitUntil32Bit::iterator::operator+++0x0 
df2fc1c0 2a2cfe26 40d1ec32 5ab4fac0 df2fca88 00000600 torch_cpu!at::TensorIterator::serial_for_each+0x0 
df2fc210 2a2cfe7c df2fc9f0 df2fc2c0 df2fcd40 df2fc448 torch_cpu!at::TensorIterator::for_each+0x0 
df2fc270 2ab24824 df2fc9f0 2a01ea63 df2fcd40 9c29d997 torch_cpu!at::TensorIterator::for_each+0x0 
df2fc430 2ab48619 df2fd050 df2fc9f0 df2fc550 df2fc530 torch_cpu!torch::jit::fuser::PartitionInfo::PartitionInfo+0x0 
df2fc610 2aaf234a 40d1e8e2 df2fc9f0 df2fcbf0 2a0f239d torch_cpu!torch::jit::fuser::PartitionInfo::PartitionInfo+0x0 
df2fc790 2a12ff3a 7c3600c8 3f800000 2f371380 00000001 torch_cpu!torch::jit::fuser::PartitionInfo::PartitionInfo+0x0 
df2fc980 2a132c5d 71ace7e0 7c361d30 71ace7e0 df2fcd40 torch_cpu!at::native::triangular_solve_out+0x0 
df2fcd10 2a45d9f6 00000006 2a020231 01f49c50 01f2fe52 torch_cpu!at::native::add+0x0 
df2fcd60 2a082024 7a42cac0 2a03bfac df2fcea0 2a01ea63 torch_cpu!at::native::mkldnn_sigmoid_+0x0 
df2fcdb0 2a4ef14f df2fce00 2f370640 df2fcea0 df2fcf78 torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0 
df2fce60 2a4dfe2a df2fced9 6d5d62b0 9a4f447b 01f2a800 torch_cpu!at::bucketize_out+0x0 
df2fcec0 2b81c88e df2fcf20 00000000 df2fcf99 ffffffff torch_cpu!at::add+0x0 
df2fcff0 2a082024 00000000 2a03bfac 6b428f88 5ac29170 torch_cpu!torch::autograd::GraphRoot::apply+0x0 
df2fd040 2a4ef14f df2fd090 2f370640 6b428f88 01f2b542 torch_cpu!torch::nn::functional::BatchNormFuncOptions::~BatchNormFuncOptions+0x0 
df2fd0f0 2a5ed9da 00000000 01f2ef8f df2fd260 7c361d30 torch_cpu!at::bucketize_out+0x0 
df2fd150 2bc38362 717b7c98 df2fd180 df2fd260 7a42cab8 torch_cpu!at::Tensor::add+0x0 
df2fd2e0 2bc389aa df2fd368 ffff0000 ffff0000 df2fd408 torch_cpu!torch::autograd::wrap_outputs+0x0 
df2fd4f0 2bc2e537 6d5d6290 00000000 7b13a4a0 00000003 torch_cpu!torch::autograd::wrap_outputs+0x0 
df2fd9d0 2bc32812 00000000 df2fddd0 7b13a470 00000000 torch_cpu!torch::autograd::Engine::evaluate_function+0x0 
df2fdcc0 2bc2f15d df2fdfa0 df2fdfa0 df2fdfa0 59ef0b10 torch_cpu!torch::autograd::Engine::thread_main+0x0 
df2fdf30 2bc2eea0 733babf0 2f156d10 fffffffe 7718d540 torch_cpu!torch::autograd::Engine::execute_with_graph_task+0x0 
df2fe060 2bc256f9 71ace7f0 71ace7f0 df2fe050 df2fe158 torch_cpu!torch::autograd::Engine::execute+0x0 
df2fe580 2bc25086 00000000 df2fe9d8 df2ff300 df2fe650 torch_cpu!torch::autograd::Engine::make_anomaly_metadata+0x0 
df2fe620 2bf209be 7aa7cc90 71ace7f8 40d1c801 2d5211e0 torch_cpu!torch::autograd::backward+0x0 
df2fe700 2b951cd0 5b3c05a0 00000000 00000000 00000000 torch_cpu!torch::autograd::VariableType::allCUDATypes+0x0 
df2fe730 2a5f0a06 00000000 59ee8dd8 7cf05d90 00000000 torch_cpu!torch::autograd::GraphRoot::apply+0x0 
df2fe960 342d6e07 df2fef70 df2fea70 df2fef70 5b212a30 torch_cpu!at::Tensor::backward+0x0 
df2fee10 342db32c df2fef00 df2fef00 00000000 342de560 mlds_9.61_windows_x86_64!c10::ivalue::Future::then+0x0 
df2ff890 3451c3b8 5b3b27e0 00000000 00000000 59ee5a10 mlds_9.61_windows_x86_64!c10::ivalue::Future::wait+0x0 
df2ff8d0 9be17974 00000000 00000000 00000000 00000000 mlds_9.61_windows_x86_64!c10::ivalue::Future::wait+0x0 
df2ff900 9c2fa271 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
df2ff980 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 

*** Dump of thread ID 12372 (state: Waiting): ***

- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 47441.000000

- Registers -
rax=00000000000001c9 rbx=0000000000000000 rcx=000000005a6c0328 rdx=0000000000000000 rsi=0000000000000000 rdi=000000005a6c0318
r8=0000000000000a80 r9=0000000001400000 r10=0000000000000000 r11=0000000028a47c00 r12=0000000000000004 r13=00000000000001c0
r14=000000005a6c02d8 r15=0000000000000000 rip=000000009c333074 rsp=00000000df5ff298 rbp=000000005a6c0328
cs=0033  ss=002b  ds=0000  es=0000  fs=0000  gs=0000             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
df5ff290 9c2dfa99 00000000 00000000 00000000 9c3002e2 ntdll!ZwWaitForAlertByThreadId+0x0 
df5ff300 9889f40d 8a8f81d0 5a6c0318 00000000 00000200 ntdll!RtlSleepConditionVariableSRW+0x0 
df5ff340 8a8f81e8 8a8f81d0 00000000 5a6c0318 5a6c0318 KERNELBASE!SleepConditionVariableSRW+0x0 
df5ff370 8a8f83a0 00000000 00000000 5a6c0318 8a8f8883 MSVCP140!std::_Syserror_map+0x0 
df5ff3f0 2bc3064b 00000000 982900f8 5a6c02d0 df5ff4f0 MSVCP140!_Cnd_destroy+0x0 
df5ff430 2bc325b1 7ccaea80 00000001 9829793c 98297cb0 torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0 
df5ff720 2bc32471 2f156d10 df5ff760 2f156d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0 
df5ff770 2bc29744 00080001 7da68c20 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0 
df5ff7a0 98541ffa 7da68c20 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0 
df5ff7d0 9be17974 00000000 00000000 00000000 00000000 ucrtbase!_o_exp+0x0 
df5ff800 9c2fa271 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
df5ff880 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>


©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)