Task 11110625
| Name | ParityModified-1639965317-31094-2-0_0 |
| Workunit | 8392703 |
| Created | 27 Jan 2022, 14:21:50 UTC |
| Sent | 13 Feb 2022, 19:30:08 UTC |
| Report deadline | 21 Feb 2022, 19:30:08 UTC |
| Received | 13 Feb 2022, 20:41:51 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | -1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION |
| Computer ID | 571 |
| Run time | 4 min 12 sec |
| CPU time | 3 min 48 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 5,441.63 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 2.13 GB |
| Peak swap size | 4.34 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.14.2</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code -1073741819 (0xc0000005)</message>
<stderr_txt>
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: GeForce GTX 1660 Ti)
[2022-02-13 20:37:42 main:435] : INFO : Set logging level to 1
[2022-02-13 20:37:42 main:441] : INFO : Running in BOINC Client mode
[2022-02-13 20:37:42 main:444] : INFO : Resolving all filenames
[2022-02-13 20:37:42 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-02-13 20:37:42 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 0)
[2022-02-13 20:37:42 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-02-13 20:37:43 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-02-13 20:37:43 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2022-02-13 20:37:43 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-02-13 20:37:43 main:474] : INFO : Configuration:
[2022-02-13 20:37:43 main:475] : INFO : Model type: GRU
[2022-02-13 20:37:43 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-02-13 20:37:43 main:477] : INFO : Max Epochs: 2048
[2022-02-13 20:37:43 main:478] : INFO : Batch Size: 128
[2022-02-13 20:37:43 main:479] : INFO : Learning Rate: 0.01
[2022-02-13 20:37:43 main:480] : INFO : Patience: 10
[2022-02-13 20:37:43 main:481] : INFO : Hidden Width: 12
[2022-02-13 20:37:43 main:482] : INFO : # Recurrent Layers: 4
[2022-02-13 20:37:43 main:483] : INFO : # Backend Layers: 4
[2022-02-13 20:37:43 main:484] : INFO : # Threads: 1
[2022-02-13 20:37:44 main:486] : INFO : Preparing Dataset
[2022-02-13 20:37:44 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-02-13 20:37:44 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
[2022-02-13 20:37:47 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2022-02-13 20:37:47 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory
[2022-02-13 20:37:47 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory
[2022-02-13 20:37:47 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2022-02-13 20:37:47 main:494] : INFO : Creating Model
[2022-02-13 20:37:47 main:507] : INFO : Preparing config file
[2022-02-13 20:37:47 main:519] : INFO : Creating new config file
[2022-02-13 20:37:47 main:538] : INFO : This is a continuation WU, loading previous network
[2022-02-13 20:37:52 main:559] : INFO : Loading DataLoader into Memory
[2022-02-13 20:37:56 main:562] : INFO : Starting Training
[2022-02-13 20:37:59 main:574] : INFO : Epoch 1 | loss: 0.0314119 | val_loss: 0.0312699 | Time: 3187.71 ms
[2022-02-13 20:38:02 main:574] : INFO : Epoch 2 | loss: 0.0312646 | val_loss: 0.0312425 | Time: 2483.26 ms
[2022-02-13 20:38:05 main:574] : INFO : Epoch 3 | loss: 0.0312382 | val_loss: 0.0312309 | Time: 2909.37 ms
[2022-02-13 20:38:07 main:574] : INFO : Epoch 4 | loss: 0.0312283 | val_loss: 0.0312217 | Time: 2576.71 ms
[2022-02-13 20:38:10 main:574] : INFO : Epoch 5 | loss: 0.0312229 | val_loss: 0.0312148 | Time: 2585.22 ms
[2022-02-13 20:38:13 main:574] : INFO : Epoch 6 | loss: 0.0312177 | val_loss: 0.0312098 | Time: 2517.71 ms
[2022-02-13 20:38:15 main:574] : INFO : Epoch 7 | loss: 0.03121 | val_loss: 0.0312055 | Time: 2538.89 ms
[2022-02-13 20:38:18 main:574] : INFO : Epoch 8 | loss: 0.0312139 | val_loss: 0.0312048 | Time: 2356.13 ms
[2022-02-13 20:38:20 main:574] : INFO : Epoch 9 | loss: 0.0312098 | val_loss: 0.0312048 | Time: 2451.53 ms
[2022-02-13 20:38:22 main:574] : INFO : Epoch 10 | loss: 0.031205 | val_loss: 0.031202 | Time: 2334.06 ms
[2022-02-13 20:38:25 main:574] : INFO : Epoch 11 | loss: 0.0312039 | val_loss: 0.0312014 | Time: 2546.88 ms
[2022-02-13 20:38:28 main:574] : INFO : Epoch 12 | loss: 0.0312049 | val_loss: 0.0311999 | Time: 2652.53 ms
[2022-02-13 20:38:30 main:574] : INFO : Epoch 13 | loss: 0.0312021 | val_loss: 0.0312016 | Time: 2330.9 ms
[2022-02-13 20:38:32 main:574] : INFO : Epoch 14 | loss: 0.0312039 | val_loss: 0.0312011 | Time: 2348.22 ms
[2022-02-13 20:38:35 main:574] : INFO : Epoch 15 | loss: 0.0312033 | val_loss: 0.0312007 | Time: 2461.17 ms
[2022-02-13 20:38:38 main:574] : INFO : Epoch 16 | loss: 0.0312006 | val_loss: 0.0312008 | Time: 2624.74 ms
[2022-02-13 20:38:40 main:574] : INFO : Epoch 17 | loss: 0.031201 | val_loss: 0.0312046 | Time: 2881.54 ms
[2022-02-13 20:38:43 main:574] : INFO : Epoch 18 | loss: 0.0312043 | val_loss: 0.0312066 | Time: 2523.31 ms
[2022-02-13 20:38:45 main:574] : INFO : Epoch 19 | loss: 0.0312028 | val_loss: 0.0312017 | Time: 2435.44 ms
[2022-02-13 20:38:48 main:574] : INFO : Epoch 20 | loss: 0.031199 | val_loss: 0.031199 | Time: 2332.4 ms
[2022-02-13 20:38:51 main:574] : INFO : Epoch 21 | loss: 0.0312018 | val_loss: 0.0311993 | Time: 3205.17 ms
[2022-02-13 20:38:53 main:574] : INFO : Epoch 22 | loss: 0.0312007 | val_loss: 0.0312008 | Time: 2393.38 ms
[2022-02-13 20:38:57 main:574] : INFO : Epoch 23 | loss: 0.0311979 | val_loss: 0.0311959 | Time: 3320.21 ms
[2022-02-13 20:38:59 main:574] : INFO : Epoch 24 | loss: 0.0311985 | val_loss: 0.0311949 | Time: 2535.13 ms
[2022-02-13 20:39:02 main:574] : INFO : Epoch 25 | loss: 0.0311966 | val_loss: 0.0311963 | Time: 2369.9 ms
[2022-02-13 20:39:04 main:574] : INFO : Epoch 26 | loss: 0.0311971 | val_loss: 0.0311938 | Time: 2349.41 ms
[2022-02-13 20:39:07 main:574] : INFO : Epoch 27 | loss: 0.0311958 | val_loss: 0.0311964 | Time: 2519.47 ms
[2022-02-13 20:39:10 main:574] : INFO : Epoch 28 | loss: 0.0311936 | val_loss: 0.0311908 | Time: 3353.39 ms
[2022-02-13 20:39:12 main:574] : INFO : Epoch 29 | loss: 0.0311947 | val_loss: 0.0312006 | Time: 2355.22 ms
[2022-02-13 20:39:15 main:574] : INFO : Epoch 30 | loss: 0.0311947 | val_loss: 0.0311959 | Time: 2398.59 ms
[2022-02-13 20:39:17 main:574] : INFO : Epoch 31 | loss: 0.0311959 | val_loss: 0.0311935 | Time: 2375.99 ms
[2022-02-13 20:39:20 main:574] : INFO : Epoch 32 | loss: 0.0311925 | val_loss: 0.031194 | Time: 2295 ms
[2022-02-13 20:39:22 main:574] : INFO : Epoch 33 | loss: 0.0311907 | val_loss: 0.0311902 | Time: 2636.84 ms
[2022-02-13 20:39:25 main:574] : INFO : Epoch 34 | loss: 0.0311896 | val_loss: 0.0311917 | Time: 2688.51 ms
[2022-02-13 20:39:28 main:574] : INFO : Epoch 35 | loss: 0.031194 | val_loss: 0.0311922 | Time: 2619.39 ms
[2022-02-13 20:39:31 main:574] : INFO : Epoch 36 | loss: 0.031196 | val_loss: 0.0311967 | Time: 2821.71 ms
[2022-02-13 20:39:33 main:574] : INFO : Epoch 37 | loss: 0.0311938 | val_loss: 0.0311879 | Time: 2348.67 ms
[2022-02-13 20:39:36 main:574] : INFO : Epoch 38 | loss: 0.0311882 | val_loss: 0.0311914 | Time: 2636.18 ms
[2022-02-13 20:39:38 main:574] : INFO : Epoch 39 | loss: 0.0311895 | val_loss: 0.0311861 | Time: 2571.6 ms
[2022-02-13 20:39:41 main:574] : INFO : Epoch 40 | loss: 0.0311852 | val_loss: 0.0311885 | Time: 2326.75 ms
[2022-02-13 20:39:43 main:574] : INFO : Epoch 41 | loss: 0.031185 | val_loss: 0.0311871 | Time: 2633.52 ms
[2022-02-13 20:39:46 main:574] : INFO : Epoch 42 | loss: 0.0311844 | val_loss: 0.0311857 | Time: 2778.08 ms
[2022-02-13 20:39:48 main:574] : INFO : Epoch 43 | loss: 0.0311862 | val_loss: 0.0311835 | Time: 2330.95 ms
[2022-02-13 20:39:51 main:574] : INFO : Epoch 44 | loss: 0.0311821 | val_loss: 0.0311845 | Time: 2657.33 ms
[2022-02-13 20:39:54 main:574] : INFO : Epoch 45 | loss: 0.0311835 | val_loss: 0.0311857 | Time: 2559.72 ms
[2022-02-13 20:39:56 main:574] : INFO : Epoch 46 | loss: 0.0311817 | val_loss: 0.0311827 | Time: 2561.43 ms
[2022-02-13 20:39:59 main:574] : INFO : Epoch 47 | loss: 0.0311833 | val_loss: 0.0311882 | Time: 2626.79 ms
[2022-02-13 20:40:02 main:574] : INFO : Epoch 48 | loss: 0.0311836 | val_loss: 0.031191 | Time: 2665.04 ms
[2022-02-13 20:40:04 main:574] : INFO : Epoch 49 | loss: 0.0311865 | val_loss: 0.0311848 | Time: 2583.67 ms
[2022-02-13 20:40:07 main:574] : INFO : Epoch 50 | loss: 0.0311815 | val_loss: 0.0311851 | Time: 2355.91 ms
[2022-02-13 20:40:09 main:574] : INFO : Epoch 51 | loss: 0.0311814 | val_loss: 0.0311978 | Time: 2504.05 ms
[2022-02-13 20:40:12 main:574] : INFO : Epoch 52 | loss: 0.0311842 | val_loss: 0.0311842 | Time: 2405.46 ms
[2022-02-13 20:40:14 main:574] : INFO : Epoch 53 | loss: 0.0311795 | val_loss: 0.031184 | Time: 2440.97 ms
[2022-02-13 20:40:17 main:574] : INFO : Epoch 54 | loss: 0.0311824 | val_loss: 0.0311818 | Time: 2786.17 ms
[2022-02-13 20:40:20 main:574] : INFO : Epoch 55 | loss: 0.031179 | val_loss: 0.0311842 | Time: 2727.19 ms
[2022-02-13 20:40:22 main:574] : INFO : Epoch 56 | loss: 0.0311802 | val_loss: 0.0311894 | Time: 2545.58 ms
[2022-02-13 20:40:25 main:574] : INFO : Epoch 57 | loss: 0.0311857 | val_loss: 0.0311851 | Time: 2869.51 ms
[2022-02-13 20:40:28 main:574] : INFO : Epoch 58 | loss: 0.0311852 | val_loss: 0.0311881 | Time: 2633.77 ms
[2022-02-13 20:40:30 main:574] : INFO : Epoch 59 | loss: 0.031183 | val_loss: 0.0311852 | Time: 2526.4 ms
[2022-02-13 20:40:33 main:574] : INFO : Epoch 60 | loss: 0.0311796 | val_loss: 0.0311859 | Time: 2384.24 ms
[2022-02-13 20:40:35 main:574] : INFO : Epoch 61 | loss: 0.0311808 | val_loss: 0.0311868 | Time: 2351.74 ms
[2022-02-13 20:40:38 main:574] : INFO : Epoch 62 | loss: 0.0311806 | val_loss: 0.0311834 | Time: 2395.11 ms
[2022-02-13 20:40:40 main:574] : INFO : Epoch 63 | loss: 0.0311802 | val_loss: 0.0311842 | Time: 2693.11 ms
[2022-02-13 20:40:43 main:574] : INFO : Epoch 64 | loss: 0.0311788 | val_loss: 0.031182 | Time: 2615.83 ms
[2022-02-13 20:40:45 main:574] : INFO : Epoch 65 | loss: 0.0311799 | val_loss: 0.0311832 | Time: 2323.88 ms
[2022-02-13 20:40:48 main:574] : INFO : Epoch 66 | loss: 0.0311842 | val_loss: 0.0311841 | Time: 2447.02 ms
[2022-02-13 20:40:51 main:574] : INFO : Epoch 67 | loss: 0.0311792 | val_loss: 0.0311844 | Time: 2601.31 ms
[2022-02-13 20:40:53 main:574] : INFO : Epoch 68 | loss: 0.0311771 | val_loss: 0.0311858 | Time: 2732.1 ms
[2022-02-13 20:40:56 main:574] : INFO : Epoch 69 | loss: 0.0311763 | val_loss: 0.0311801 | Time: 3026.57 ms
[2022-02-13 20:40:59 main:574] : INFO : Epoch 70 | loss: 0.0311754 | val_loss: 0.0311826 | Time: 2566.33 ms
[2022-02-13 20:41:01 main:574] : INFO : Epoch 71 | loss: 0.0311752 | val_loss: 0.0311816 | Time: 2419.07 ms
[2022-02-13 20:41:04 main:574] : INFO : Epoch 72 | loss: 0.0311765 | val_loss: 0.0311805 | Time: 2398.34 ms
[2022-02-13 20:41:06 main:574] : INFO : Epoch 73 | loss: 0.0311827 | val_loss: 0.0311845 | Time: 2495.67 ms
[2022-02-13 20:41:10 main:574] : INFO : Epoch 74 | loss: 0.0311812 | val_loss: 0.0311802 | Time: 3132.28 ms
[2022-02-13 20:41:12 main:574] : INFO : Epoch 75 | loss: 0.0311814 | val_loss: 0.0311957 | Time: 2648.64 ms
[2022-02-13 20:41:15 main:574] : INFO : Epoch 76 | loss: 0.0311826 | val_loss: 0.0311867 | Time: 2520.2 ms
[2022-02-13 20:41:17 main:574] : INFO : Epoch 77 | loss: 0.0311807 | val_loss: 0.0311818 | Time: 2321.91 ms
[2022-02-13 20:41:20 main:574] : INFO : Epoch 78 | loss: 0.0311747 | val_loss: 0.0311762 | Time: 2372.24 ms
[2022-02-13 20:41:22 main:574] : INFO : Epoch 79 | loss: 0.031174 | val_loss: 0.0311743 | Time: 2646.81 ms
[2022-02-13 20:41:25 main:574] : INFO : Epoch 80 | loss: 0.031174 | val_loss: 0.0311773 | Time: 2643.63 ms
[2022-02-13 20:41:28 main:574] : INFO : Epoch 81 | loss: 0.0311749 | val_loss: 0.0311844 | Time: 2589.24 ms
[2022-02-13 20:41:30 main:574] : INFO : Epoch 82 | loss: 0.0311733 | val_loss: 0.0311804 | Time: 2421.32 ms
[2022-02-13 20:41:32 main:574] : INFO : Epoch 83 | loss: 0.0311715 | val_loss: 0.031174 | Time: 2383.88 ms
[2022-02-13 20:41:35 main:574] : INFO : Epoch 84 | loss: 0.0311766 | val_loss: 0.031183 | Time: 2702.68 ms
[2022-02-13 20:41:37 main:574] : INFO : Epoch 85 | loss: 0.0311764 | val_loss: 0.0311753 | Time: 2312.42 ms
[2022-02-13 20:41:40 main:574] : INFO : Epoch 86 | loss: 0.0311745 | val_loss: 0.0311867 | Time: 2327.07 ms
[2022-02-13 20:41:43 main:574] : INFO : Epoch 87 | loss: 0.0311748 | val_loss: 0.0311785 | Time: 2588.01 ms
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x00007FF9F2CEE7F5 read attempt to address 0xFFFFFFFF
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 02/13/22 20:41:43
Install Directory : H:\Program Files\BOINC\
Data Directory : H:\ProgramData\BOINC
Project Symstore :
LoadLibraryA( H:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( H:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( H:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( H:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: H:\ProgramData\BOINC\slots\130;H:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 000000006fa30000 00000000003df000 H:\ProgramData\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000342c0000 00000000001f0000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.18362.815) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 0000000032670000 00000000000b2000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.18362.959) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.18362.959 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.959
ModLoad: 0000000031d60000 00000000002a4000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.18362.959) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.18362.959 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.959
ModLoad: 00000000324b0000 0000000000194000 C:\WINDOWS\System32\USER32.dll (6.2.18362.959) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 0000000032070000 0000000000021000 C:\WINDOWS\System32\win32u.dll (6.2.18362.959) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.18362.959 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.959
ModLoad: 0000000032840000 0000000000026000 C:\WINDOWS\System32\GDI32.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 00000000320a0000 0000000000196000 C:\WINDOWS\System32\gdi32full.dll (6.2.18362.959) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.18362.959 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.959
ModLoad: 0000000031b70000 000000000009e000 C:\WINDOWS\System32\msvcp_win.dll (6.2.18362.815) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.18362.815 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.815
ModLoad: 00000000319f0000 00000000000fa000 C:\WINDOWS\System32\ucrtbase.dll (6.2.18362.815) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.18362.815 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.815
ModLoad: 0000000033b20000 00000000000a3000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.18362.752) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 0000000032740000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 7.0.18362.1
ModLoad: 0000000033be0000 0000000000097000 C:\WINDOWS\System32\sechost.dll (6.2.18362.959) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 0000000032aa0000 0000000000120000 C:\WINDOWS\System32\RPCRT4.dll (6.2.18362.628) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 00000000f7a60000 0000000000058000 H:\ProgramData\BOINC\slots\130\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000f2ab0000 0000000000091000 H:\ProgramData\BOINC\slots\130\MSVCP140.dll (14.27.29112.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.27.29112.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.27.29112.0
ModLoad: 000000001e700000 00000000001f4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 00000000f8aa0000 0000000000019000 H:\ProgramData\BOINC\slots\130\VCRUNTIME140.dll (14.27.29112.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.27.29112.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.27.29112.0
ModLoad: 000000000aed0000 000000000000c000 H:\ProgramData\BOINC\slots\130\VCRUNTIME140_1.dll (14.27.29112.0) (-exported- Symbols Loaded)
Linked PDB Filename : D:\a01\_work\2\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.27.29112.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft® Visual Studio®
Product Version : 14.27.29112.0
ModLoad: 00000000c9720000 000000000abe7000 H:\ProgramData\BOINC\slots\130\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000e8cd0000 00000000002db000 H:\ProgramData\BOINC\slots\130\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000e8ac0000 000000000020d000 H:\ProgramData\BOINC\slots\130\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 00000000f51a0000 0000000000040000 H:\ProgramData\BOINC\slots\130\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000a4bd0000 0000000024b49000 H:\ProgramData\BOINC\slots\130\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000f42d0000 0000000000045000 H:\ProgramData\BOINC\slots\130\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000e1b20000 00000000034b2000 H:\ProgramData\BOINC\slots\130\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 00000000e4fe0000 00000000030a5000 H:\ProgramData\BOINC\slots\130\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 000000000aeb0000 0000000000010000 H:\ProgramData\BOINC\slots\130\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 00000000a0e70000 0000000003d5b000 H:\ProgramData\BOINC\slots\130\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 000000009efa0000 0000000001eca000 H:\ProgramData\BOINC\slots\130\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 0000000083bf0000 000000001b3a4000 H:\ProgramData\BOINC\slots\130\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 000000002e9b0000 000000000919f000 H:\ProgramData\BOINC\slots\130\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 0000000032240000 0000000000080000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.18362.836) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.18362.836 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.836
ModLoad: 0000000033de0000 000000000002e000 C:\WINDOWS\System32\IMM32.DLL (6.2.18362.387) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.18362.387 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.387
ModLoad: 0000000031180000 0000000000011000 C:\WINDOWS\System32\kernel.appcore.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 000000002fe10000 0000000000020000 C:\WINDOWS\SYSTEM32\dxcore.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : DXCore.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 0000000031b20000 000000000004a000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.18362.387) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.18362.387 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.387
ModLoad: 00000000334b0000 0000000000335000 C:\WINDOWS\System32\combase.dll (6.2.18362.900) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 0000000033e10000 0000000000470000 C:\WINDOWS\System32\Setupapi.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 0000000031af0000 0000000000026000 C:\WINDOWS\System32\bcrypt.dll (6.2.18362.267) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 0000000030f10000 000000000002a000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.18362.387) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.18362.387 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.387
ModLoad: 0000000032010000 000000000005c000 C:\WINDOWS\System32\WINTRUST.dll (6.2.18362.387) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.18362.387 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.387
ModLoad: 00000000311a0000 0000000000012000 C:\WINDOWS\System32\MSASN1.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 0000000031c10000 0000000000149000 C:\WINDOWS\System32\CRYPT32.dll (6.2.18362.592) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 0000000032bc0000 00000000006e6000 C:\WINDOWS\System32\Shell32.dll (6.2.18362.959) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.18362.900 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.900
ModLoad: 00000000332b0000 00000000000a9000 C:\WINDOWS\System32\shcore.dll (6.2.18362.959) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 0000000031260000 0000000000782000 C:\WINDOWS\System32\windows.storage.dll (6.2.18362.959) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 00000000311c0000 0000000000023000 C:\WINDOWS\System32\profapi.dll (6.2.18362.693) (-nosymbols- Symbols Loaded)
Linked PDB Filename : profapi.pdb
File Version : 10.0.18362.693 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.693
ModLoad: 00000000311f0000 000000000004a000 C:\WINDOWS\System32\powrprof.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : powrprof.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 0000000031170000 0000000000010000 C:\WINDOWS\System32\UMPDC.dll (-exported- Symbols Loaded)
Linked PDB Filename : UMPDC.pdb
ModLoad: 00000000327e0000 0000000000052000 C:\WINDOWS\System32\shlwapi.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 0000000031240000 0000000000017000 C:\WINDOWS\System32\cryptsp.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : cryptsp.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 0000000017a30000 0000000000267000 C:\WINDOWS\system32\nvcuda.dll (27.21.14.5730) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 27.21.14.5730
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.1.114 driver
Product Version : 27.21.14.5730
ModLoad: 000000002f150000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.DLL (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 00000000f2b80000 000000000152c000 C:\WINDOWS\system32\DriverStore\FileRepository\nv_dispi.inf_amd64_5dcb5bbf5c3edcf2\nvcuda64.dll (27.21.14.5730) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 27.21.14.5730
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.1.114 driver
Product Version : 27.21.14.5730
ModLoad: 00000000338d0000 000000000006f000 C:\WINDOWS\System32\WS2_32.dll (6.2.18362.387) (-exported- Symbols Loaded)
Linked PDB Filename : ws2_32.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 000000002f120000 000000000002f000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 0000000030ab0000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.18362.1) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.18362.1 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft® Windows® Operating System
Product Version : 10.0.18362.1
ModLoad: 000000002f4a0000 0000000000099000 C:\WINDOWS\system32\uxtheme.dll (6.2.18362.449) (-exported- Symbols Loaded)
Linked PDB Filename : UxTheme.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 00000000295b0000 00000000006d6000 C:\WINDOWS\SYSTEM32\nvapi64.dll (27.21.14.5730) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r455\r457_22\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 27.21.14.5730
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 27.21.14.5730
ModLoad: 0000000033c80000 0000000000157000 C:\WINDOWS\System32\OLE32.DLL (6.2.18362.693) (-exported- Symbols Loaded)
Linked PDB Filename : ole32.pdb
File Version : 10.0.18362.530 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Betriebssystem Microsoft® Windows®
Product Version : 10.0.18362.530
ModLoad: 0000000005c70000 0000000000009000 H:\ProgramData\BOINC\slots\130\caffe2_nvrtc.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000d5a50000 0000000000fca000 H:\ProgramData\BOINC\slots\130\nvrtc64_102_0.dll (6.14.11.9000) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6.14.11.9000
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.89 NVRTC Library
Product Version : 6.14.11.9000
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 3707, Write: 660, Other 2006
- I/O Transfers Counters -
Read: 6897346, Write: 28597, Other 38900
- Paged Pool Usage -
QuotaPagedPoolUsage: 3535464, QuotaPeakPagedPoolUsage: 3535464
QuotaNonPagedPoolUsage: 59424, QuotaPeakNonPagedPoolUsage: 59896
- Virtual Memory Usage -
VirtualSize: 363442176, PeakVirtualSize: 986169344
- Pagefile Usage -
PagefileUsage: 363442176, PeakPagefileUsage: 363442176
- Working Set Size -
WorkingSetSize: -2043109376, PeakWorkingSetSize: -2039881728, PageFaultCount: 851587
*** Dump of thread ID 9968 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 46562500.000000, User Time: 890312512.000000, Wait Time: 355609600.000000
- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x00007FF9F2CEE7F5 read attempt to address 0xFFFFFFFF
- Registers -
rax=0000000000000000 rbx=000000009930b490 rcx=00000000e08f9520 rdx=000000009930b490 rsi=000000002f574a10 rdi=00000000e08f9520
r8=0000000000000080 r9=0000000000000001 r10=0000000000000018 r11=0000000000000094 r12=0000000000000001 r13=0000000000000001
r14=000000009930b490 r15=0000000000000003 rip=00000000f2cee7f5 rsp=00000000e08f93b8 rbp=00000000e08f9510
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00010246
- Callstack -
ChildEBP RetAddr Args to Child
e08f93b0 f2bb8363 9930b490 e08f9520 e08f9418 2f574a10 nvcuda64!+0x0
e08f9400 f2bb890c 2f574a20 2f574a10 9930b490 2f574a20 nvcuda64!+0x0
e08f9690 f2d81108 00008000 84b80730 00000000 84994de7 nvcuda64!+0x0
e08f9800 849929b6 00000001 00000080 00000000 84b80730 nvcuda64!cuLaunchKernel+0x0
e08f9910 8498fdf4 84b80730 2de7ffd0 9930b490 e08f9b30 cudnn64_7!cudnnSetDropoutDescriptor+0x0
e08f9a90 84b73951 84b80730 00000000 84b80730 00000000 cudnn64_7!cudnnSetDropoutDescriptor+0x0
e08f9c00 84afe604 23805310 3c9f8090 49280000 000000c0 cudnn64_7!cudnnSetDropoutDescriptor+0x0
e08f9e30 84b0f99d 00000000 85e01500 00000000 84b80730 cudnn64_7!cudnnSetDropoutDescriptor+0x0
e08f9e90 84ad703b 00000000 00000000 23805310 e08f9fa0 cudnn64_7!cudnnSetDropoutDescriptor+0x0
e08fa320 849f43bc 00000000 e08fa40c 00000000 cd0fb010 cudnn64_7!cudnnSetDropoutDescriptor+0x0
e08fa5f0 849f700e e08fa900 8499bc3c e08fa648 84994ce0 cudnn64_7!cudnnSetDropoutDescriptor+0x0
e08fa6e0 848f82ca cd0fb010 00000000 00000000 0000000c cudnn64_7!cudnnSetDropoutDescriptor+0x0
e08fa7b0 848f62b3 00000000 0000000c e08fa9f0 00000002 cudnn64_7!cudnnSetAttnDescriptor+0x0
e08fa900 848f9536 00000024 85242f70 b7d012f0 00000000 cudnn64_7!cudnnSetAttnDescriptor+0x0
e08faa10 84925f37 49280000 cbe29b50 00000000 00000000 cudnn64_7!cudnnSetAttnDescriptor+0x0
e08fb050 8491eafa 00000004 cbe29b50 00000004 00000000 cudnn64_7!cudnnRNNForwardTrainingEx+0x0
e08fb210 84939738 cbe29b50 00000400 d06e0800 85242f70 cudnn64_7!cudnnRNNForwardTrainingEx+0x0
e08fd420 a794af5a e08fea10 49280000 e08fea10 85242f70 cudnn64_7!cudnnRNNBackwardData+0x0
e08fd9b0 a7949c90 00000010 00000000 e08fe340 e08fe328 torch_cuda!at::native::_cudnn_rnn_backward+0x0
e08fdba0 a79a2808 e08fdd90 e08fea78 e08fdc80 00000004 torch_cuda!at::native::_cudnn_rnn_backward+0x0
e08fdcb0 a79b103d e08fe340 e08fe320 e08fea58 00000000 torch_cuda!at::native::set_storage_cuda_+0x0
e08fddc0 cf16c201 e08fe340 ceceea63 b85e7cb0 e08fe488 torch_cuda!at::native::set_storage_cuda_+0x0
e08fdf50 cf1bbfea e08fea10 00000000 00000007 d220f880 torch_cpu!at::native::mkldnn_sigmoid_+0x0
e08fe080 cf1a34da d4044668 e08fe2c0 e08fea78 e08fe160 torch_cpu!at::bucketize_out+0x0
e08fe170 d049e0a9 e08fe2c0 e08fea10 e08fe2b0 00000000 torch_cpu!at::_cudnn_rnn_backward+0x0
e08fe450 d04aa94d b85e79b0 d091794a 00000020 00000004 torch_cpu!torch::autograd::GraphRoot::apply+0x0
e08fe560 cf16c201 e08fea68 b85e77b0 e08fe6f0 d0913e3f torch_cpu!torch::autograd::GraphRoot::apply+0x0
e08fe6f0 cf1bbfea e08fea10 00000000 00000000 00000000 torch_cpu!at::native::mkldnn_sigmoid_+0x0
e08fe820 cf1a34da d4044668 e08feb90 e08fea78 e08fe900 torch_cpu!at::bucketize_out+0x0
e08fe910 d03a994d e08feb90 cb24ad80 e08fea50 d0677888 torch_cpu!at::_cudnn_rnn_backward+0x0
e08fedb0 d03956b1 b87b1f90 e08ff0b8 00000000 f7a63bd6 torch_cpu!torch::autograd::generated::CudnnRnnBackward::apply+0x0
e08fefc0 d08fd1ea e08ff0d0 b87b1f90 e08ff0d0 b87b1f90 torch_cpu!torch::autograd::Node::operator()+0x0
e08ff1a0 d08fdbdd 00000001 00000001 00000001 00000001 torch_cpu!torch::autograd::Engine::add_thread_pool_task+0x0
e08ff680 d0902812 00000000 00000000 b87b1f80 ffffffff torch_cpu!torch::autograd::Engine::evaluate_function+0x0
e08ff970 d0902471 d3e26d10 e08ff9b0 d3e26d10 00000001 torch_cpu!torch::autograd::Engine::thread_main+0x0
e08ff9c0 d08f9744 00080001 ccf5ff80 00000000 00000000 torch_cpu!torch::autograd::Engine::thread_init+0x0
e08ff9f0 31a10e82 ccf5ff80 00000000 00000000 00000000 torch_cpu!torch::autograd::Engine::get_base_engine+0x0
e08ffa20 32687bd4 00000000 00000000 00000000 00000000 ucrtbase!_beginthreadex+0x0
e08ffa50 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
e08ffad0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 10520 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 155000000.000000, User Time: 1188906240.000000, Wait Time: 355609600.000000
- Registers -
rax=00000000000001ca rbx=0000000000000000 rcx=00000000c78a76e8 rdx=0000000000000000 rsi=0000000000000000 rdi=0000000000000000
r8=00000000dfda4328 r9=00000000dfda4379 r10=0000000000000000 r11=0000000000000246 r12=0000000000000003 r13=00000000000001c0
r14=00000000c78a7698 r15=0000000000000000 rip=000000003435f9a4 rsp=00000000dfda55c8 rbp=00000000c78a76e8
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
dfda55c0 34320590 dfda57e0 f2d44249 00000000 2f2c5a80 ntdll!ZwWaitForAlertByThreadId+0x0
dfda5630 31d858fd c78a7690 00000000 00000000 00008000 ntdll!RtlSleepConditionVariableSRW+0x0
dfda5670 f2aeba8d dfda57e0 00000000 00008000 dfda5290 KERNELBASE!SleepConditionVariableSRW+0x0
dfda56b0 f2ac2848 00000000 dfda5290 f42d2e0d f7a82433 MSVCP140!__crtSetThreadpoolWait+0x0
dfda56e0 f2ac2710 dfda5b90 f2ac2f17 00000000 cecf0231 MSVCP140!std::_Winerror_message+0x0
dfda5750 d090064b b87b1f90 000001c0 c78a7690 c78a7690 MSVCP140!std::_Winerror_message+0x0
dfda5790 d09025b1 2d6bf300 b87b1f80 b87b1f80 00000000 torch_cpu!torch::utils::Future<std::vector<at::Tensor,std::allocator<at::Tensor> > >::markCompletedInternal+0x0
dfda5a80 d08ff15d dfda5d60 dfda5d60 dfda5d60 2d6bf300 torch_cpu!torch::autograd::Engine::thread_main+0x0
dfda5cf0 d08feea0 b0b4afb0 d3e26d10 fffffffe 00000000 torch_cpu!torch::autograd::Engine::execute_with_graph_task+0x0
dfda5e20 d08f56f9 b7d012d0 b7d012d0 dfda5e10 dfda5f18 torch_cpu!torch::autograd::Engine::execute+0x0
dfda6340 d08f5086 0d1d02b8 cf2c5dc2 00000000 dfda6410 torch_cpu!torch::autograd::Engine::make_anomaly_metadata+0x0
dfda63e0 d0bf09be b85e6bb0 b7d012d8 00000000 dfda6380 torch_cpu!torch::autograd::backward+0x0
dfda64c0 d0621cd0 2eff2e70 00000000 00000000 00000000 torch_cpu!torch::autograd::VariableType::allCUDATypes+0x0
dfda64f0 cf2c0a06 00000000 00000000 00010001 00000001 torch_cpu!torch::autograd::GraphRoot::apply+0x0
dfda6720 6fa47166 dfda67f0 dfda6830 dfda67f0 dfda6d90 torch_cpu!at::Tensor::backward+0x0
dfda6c20 6fa4b950 dfda6d20 dfda6d20 00000000 7f0d2780 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::then+0x0
dfdbf9c0 6fc8c6f8 2f094e70 00000000 00000000 2d6bb570 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
dfdbfa00 32687bd4 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
dfdbfa30 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
dfdbfab0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 24104 (state: Waiting): ***
- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 355609600.000000
- Registers -
rax=0000000000000034 rbx=0000000000000000 rcx=0000000000000000 rdx=00000000e04ffda0 rsi=0000000000000000 rdi=0000000000000064
r8=00000000e04ffd78 r9=0000000000000000 r10=0000000000000000 r11=0000000000000246 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=000000003435c6f4 rsp=00000000e04ffd78 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
e04ffd70 31da6891 e04ffe38 00000000 00000000 00000000 ntdll!ZwDelayExecution+0x0
e04ffe10 6fa6a07f 00000000 00000000 c00000bb 00000000 KERNELBASE!SleepEx+0x0
e04ffe40 32687bd4 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
e04ffe70 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
e04ffef0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 14288 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 355609600.000000
- Registers -
rax=000000000000005b rbx=000000000000000b rcx=000000000000000b rdx=00000000e05ff5a0 rsi=0000000000000000 rdi=000000000000000b
r8=0000000000000001 r9=000000002f2a9a00 r10=0000000000000000 r11=00000000e05ff510 r12=0000000000000064 r13=00000000e05ff5a0
r14=00000000e05ff290 r15=0000000000000000 rip=000000003435cbc4 rsp=00000000e05ff238 rbp=000000002f2a9a00
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
e05ff230 31db8037 33ca3880 343337d4 00000000 dff4b000 ntdll!NtWaitForMultipleObjects+0x0
e05ff530 31db7f1e f3074b48 2d6c3d50 0000000b 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
e05ff570 f2d2bb54 2f2ad7e0 00000000 2f2a77e0 00000000 KERNELBASE!WaitForMultipleObjects+0x0
e05ff7b0 f2dc09ed 00000000 00000004 00000000 00000000 nvcuda64!+0x0
e05ff860 f2d2b523 016af87c 72d46823 2f7eb6f0 00000000 nvcuda64!cuProfilerStop+0x0
e05ff890 f303a750 2f7eb6f0 00000000 00000000 00000000 nvcuda64!+0x0
e05ff8c0 32687bd4 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
e05ff8f0 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
e05ff970 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 6356 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 355594336.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002cc rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002cc
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=000000002f2905f0 r13=0000000000000000
r14=00000000000002cc r15=0000000000000000 rip=000000003435c0f4 rsp=00000000e06ffb88 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
e06ffb80 31d98b03 00000000 00000000 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0
e06ffc20 f2f3bf48 00000000 31d84975 00000000 000002cc KERNELBASE!WaitForSingleObjectEx+0x0
e06ffc90 f2d2b523 00000001 2fc29a00 2f7eb600 00000000 nvcuda64!cuProfilerStop+0x0
e06ffcc0 f303a750 2f7eb600 00000000 00000000 00000000 nvcuda64!+0x0
e06ffcf0 32687bd4 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
e06ffd20 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
e06ffda0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 8336 (state: Waiting): ***
- Information -
Status: Wait Reason: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 355609568.000000
- Registers -
rax=00000000000001ca rbx=0000000000000000 rcx=000000002f572658 rdx=00000000e07ff928 rsi=00000000e07ff890 rdi=0000000000000000
r8=0000000000000001 r9=0000000000002090 r10=000000002f577228 r11=000000006a00730f r12=00000000e07ff928 r13=0000000000000000
r14=000000002f572658 r15=000000002f577228 rip=000000003435f9a4 rsp=00000000e07ff868 rbp=00000000e07ff8c0
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
e07ff860 34320815 00000102 00000102 00000000 e07ff890 ntdll!ZwWaitForAlertByThreadId+0x0
e07ff8d0 31ddc2b9 2f574a10 00000000 00000000 00000000 ntdll!RtlSleepConditionVariableCS+0x0
e07ff900 f2cb223a 2f574a10 2f574a10 2f574a10 ffb3b4c0 KERNELBASE!SleepConditionVariableCS+0x0
e07ff960 f2d2b523 00000004 012cfb1c 012cfb1c 00000000 nvcuda64!+0x0
e07ff990 f303a750 2f7eb5a0 00000000 00000000 00000000 nvcuda64!+0x0
e07ff9c0 32687bd4 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
e07ff9f0 3432ce51 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
e07ffa70 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)