Task 14251030
| Name | ParityModified-1647047827-11166-1-0_0 |
| Workunit | 11308081 |
| Created | 2 Apr 2022, 14:04:10 UTC |
| Sent | 10 Apr 2022, 11:36:44 UTC |
| Report deadline | 18 Apr 2022, 11:36:44 UTC |
| Received | 14 Apr 2022, 10:05:29 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 197 (0x000000C5) EXIT_TIME_LIMIT_EXCEEDED |
| Computer ID | 21690 |
| Run time | 6 hours 28 min 14 sec |
| CPU time | 1 hours 13 min 57 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 11,433.61 GFLOPS |
| Application version | Machine Learning Dataset Generator (GPU) v9.75 (cuda10200) windows_x86_64 |
| Peak working set size | 2.89 GB |
| Peak swap size | 4.68 GB |
| Peak disk usage | 1.54 GB |
Stderr output
<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
exceeded elapsed time limit 23293.05 (4000000.00G/171.73G)</message>
<stderr_txt>
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3070 Ti)
[2022-04-14 09:26:43 main:435] : INFO : Set logging level to 1
[2022-04-14 09:26:44 main:441] : INFO : Running in BOINC Client mode
[2022-04-14 09:26:44 main:444] : INFO : Resolving all filenames
[2022-04-14 09:26:44 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-14 09:26:45 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 0)
[2022-04-14 09:26:46 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-14 09:26:46 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-14 09:26:47 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 0)
[2022-04-14 09:26:48 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-04-14 09:26:48 main:474] : INFO : Configuration:
[2022-04-14 09:26:48 main:475] : INFO : Model type: GRU
[2022-04-14 09:26:49 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-04-14 09:26:49 main:477] : INFO : Max Epochs: 2048
[2022-04-14 09:26:49 main:478] : INFO : Batch Size: 128
[2022-04-14 09:26:50 main:479] : INFO : Learning Rate: 0.01
[2022-04-14 09:26:51 main:480] : INFO : Patience: 10
[2022-04-14 09:26:51 main:481] : INFO : Hidden Width: 12
[2022-04-14 09:26:52 main:482] : INFO : # Recurrent Layers: 4
[2022-04-14 09:26:53 main:483] : INFO : # Backend Layers: 4
[2022-04-14 09:26:53 main:484] : INFO : # Threads: 1
[2022-04-14 09:26:54 main:486] : INFO : Preparing Dataset
[2022-04-14 09:26:54 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-14 09:26:56 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-14 11:25:13 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2022-04-14 11:25:14 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-14 11:25:14 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-14 11:25:15 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2022-04-14 11:25:16 main:494] : INFO : Creating Model
[2022-04-14 11:25:16 main:507] : INFO : Preparing config file
[2022-04-14 11:25:17 main:519] : INFO : Creating new config file
[2022-04-14 11:25:17 main:538] : INFO : This is a continuation WU, loading previous network
[2022-04-14 12:56:22 main:559] : INFO : Loading DataLoader into Memory
[2022-04-14 12:56:23 main:562] : INFO : Starting Training
[2022-04-14 13:05:15 main:574] : INFO : Epoch 1 | loss: 0.0318877 | val_loss: 0.0313027 | Time: 531995 ms
[2022-04-14 13:05:20 main:574] : INFO : Epoch 2 | loss: 0.0313126 | val_loss: 0.0312716 | Time: 4497.32 ms
[2022-04-14 13:05:26 main:574] : INFO : Epoch 3 | loss: 0.0312586 | val_loss: 0.031256 | Time: 4473.13 ms
[2022-04-14 13:05:31 main:574] : INFO : Epoch 4 | loss: 0.0312531 | val_loss: 0.0312507 | Time: 4515.79 ms
[2022-04-14 13:05:36 main:574] : INFO : Epoch 5 | loss: 0.0312507 | val_loss: 0.0312506 | Time: 4405.7 ms
[2022-04-14 13:05:42 main:574] : INFO : Epoch 6 | loss: 0.0312505 | val_loss: 0.0312502 | Time: 4555.72 ms
[2022-04-14 13:05:47 main:574] : INFO : Epoch 7 | loss: 0.0312503 | val_loss: 0.0312502 | Time: 4538.06 ms
[2022-04-14 13:05:53 main:574] : INFO : Epoch 8 | loss: 0.0312503 | val_loss: 0.0312502 | Time: 4525.61 ms
[2022-04-14 13:05:59 main:574] : INFO : Epoch 9 | loss: 0.0312502 | val_loss: 0.0312501 | Time: 4566.05 ms
[2022-04-14 13:06:04 main:574] : INFO : Epoch 10 | loss: 0.0312501 | val_loss: 0.0312501 | Time: 4687.63 ms
[2022-04-14 13:06:09 main:574] : INFO : Epoch 11 | loss: 0.0312503 | val_loss: 0.0312504 | Time: 4422.25 ms
[2022-04-14 13:06:14 main:574] : INFO : Epoch 12 | loss: 0.0312503 | val_loss: 0.0312506 | Time: 4408.46 ms
[2022-04-14 13:06:19 main:574] : INFO : Epoch 13 | loss: 0.0312503 | val_loss: 0.03125 | Time: 4464.23 ms
[2022-04-14 13:06:25 main:574] : INFO : Epoch 14 | loss: 0.0312501 | val_loss: 0.0312501 | Time: 4492.98 ms
[2022-04-14 13:06:30 main:574] : INFO : Epoch 15 | loss: 0.03125 | val_loss: 0.0312501 | Time: 4471.46 ms
[2022-04-14 13:06:35 main:574] : INFO : Epoch 16 | loss: 0.03125 | val_loss: 0.0312515 | Time: 4454.64 ms
[2022-04-14 13:06:39 main:574] : INFO : Epoch 17 | loss: 0.0312502 | val_loss: 0.03125 | Time: 4522.76 ms
[2022-04-14 13:06:45 main:574] : INFO : Epoch 18 | loss: 0.0312491 | val_loss: 0.0312492 | Time: 4561.98 ms
[2022-04-14 13:06:51 main:574] : INFO : Epoch 19 | loss: 0.0312486 | val_loss: 0.0312482 | Time: 4576.78 ms
[2022-04-14 13:06:56 main:574] : INFO : Epoch 20 | loss: 0.0312507 | val_loss: 0.0312486 | Time: 4572.96 ms
[2022-04-14 13:07:01 main:574] : INFO : Epoch 21 | loss: 0.031247 | val_loss: 0.0312463 | Time: 4523.19 ms
[2022-04-14 13:07:06 main:574] : INFO : Epoch 22 | loss: 0.0312447 | val_loss: 0.0312433 | Time: 4414.09 ms
[2022-04-14 13:07:12 main:574] : INFO : Epoch 23 | loss: 0.0312408 | val_loss: 0.0312361 | Time: 4542.82 ms
[2022-04-14 13:07:17 main:574] : INFO : Epoch 24 | loss: 0.031231 | val_loss: 0.0312222 | Time: 4531.77 ms
[2022-04-14 13:07:22 main:574] : INFO : Epoch 25 | loss: 0.0312108 | val_loss: 0.0311978 | Time: 4627.82 ms
[2022-04-14 13:07:27 main:574] : INFO : Epoch 26 | loss: 0.0311976 | val_loss: 0.0311938 | Time: 4442.41 ms
[2022-04-14 13:07:32 main:574] : INFO : Epoch 27 | loss: 0.0311908 | val_loss: 0.0311948 | Time: 4495.08 ms
[2022-04-14 13:07:37 main:574] : INFO : Epoch 28 | loss: 0.0311911 | val_loss: 0.0311835 | Time: 4431.11 ms
[2022-04-14 13:07:42 main:574] : INFO : Epoch 29 | loss: 0.0311848 | val_loss: 0.0311821 | Time: 4483.44 ms
[2022-04-14 13:07:47 main:574] : INFO : Epoch 30 | loss: 0.0311774 | val_loss: 0.031175 | Time: 4596.93 ms
[2022-04-14 13:07:53 main:574] : INFO : Epoch 31 | loss: 0.0311775 | val_loss: 0.0311728 | Time: 4806.58 ms
[2022-04-14 13:07:58 main:574] : INFO : Epoch 32 | loss: 0.0311727 | val_loss: 0.0311733 | Time: 4689.07 ms
[2022-04-14 13:08:03 main:574] : INFO : Epoch 33 | loss: 0.0311717 | val_loss: 0.0311728 | Time: 4616 ms
[2022-04-14 13:08:08 main:574] : INFO : Epoch 34 | loss: 0.0311681 | val_loss: 0.0311697 | Time: 4499.75 ms
[2022-04-14 13:08:13 main:574] : INFO : Epoch 35 | loss: 0.0311732 | val_loss: 0.0311783 | Time: 4567.21 ms
[2022-04-14 13:08:18 main:574] : INFO : Epoch 36 | loss: 0.0311702 | val_loss: 0.0311696 | Time: 4575.93 ms
[2022-04-14 13:08:23 main:574] : INFO : Epoch 37 | loss: 0.0311663 | val_loss: 0.0311697 | Time: 4594.11 ms
[2022-04-14 13:08:28 main:574] : INFO : Epoch 38 | loss: 0.0311673 | val_loss: 0.0311676 | Time: 4518.53 ms
[2022-04-14 13:08:34 main:574] : INFO : Epoch 39 | loss: 0.0311655 | val_loss: 0.0311658 | Time: 4453.37 ms
[2022-04-14 13:08:39 main:574] : INFO : Epoch 40 | loss: 0.0311634 | val_loss: 0.0311631 | Time: 4585.94 ms
[2022-04-14 13:08:43 main:574] : INFO : Epoch 41 | loss: 0.0311627 | val_loss: 0.0311649 | Time: 4481.25 ms
[2022-04-14 13:08:48 main:574] : INFO : Epoch 42 | loss: 0.0311629 | val_loss: 0.0311676 | Time: 4444.55 ms
[2022-04-14 13:08:53 main:574] : INFO : Epoch 43 | loss: 0.0311629 | val_loss: 0.0311683 | Time: 4524.39 ms
[2022-04-14 13:08:58 main:574] : INFO : Epoch 44 | loss: 0.031162 | val_loss: 0.0311646 | Time: 4543.24 ms
[2022-04-14 13:09:04 main:574] : INFO : Epoch 45 | loss: 0.03116 | val_loss: 0.0311623 | Time: 4495.17 ms
[2022-04-14 13:09:09 main:574] : INFO : Epoch 46 | loss: 0.031159 | val_loss: 0.031163 | Time: 4458.15 ms
[2022-04-14 13:09:13 main:574] : INFO : Epoch 47 | loss: 0.0311613 | val_loss: 0.0311618 | Time: 4606.05 ms
[2022-04-14 13:09:19 main:574] : INFO : Epoch 48 | loss: 0.0311586 | val_loss: 0.0311629 | Time: 4717.43 ms
[2022-04-14 13:09:24 main:574] : INFO : Epoch 49 | loss: 0.031157 | val_loss: 0.0311642 | Time: 4499.15 ms
[2022-04-14 13:09:29 main:574] : INFO : Epoch 50 | loss: 0.0311577 | val_loss: 0.0311646 | Time: 4508.42 ms
[2022-04-14 13:09:34 main:574] : INFO : Epoch 51 | loss: 0.0311579 | val_loss: 0.0311634 | Time: 4473.03 ms
[2022-04-14 13:09:39 main:574] : INFO : Epoch 52 | loss: 0.031163 | val_loss: 0.031161 | Time: 4432.25 ms
[2022-04-14 13:09:44 main:574] : INFO : Epoch 53 | loss: 0.0311582 | val_loss: 0.031162 | Time: 4357.29 ms
[2022-04-14 13:09:49 main:574] : INFO : Epoch 54 | loss: 0.0311619 | val_loss: 0.031163 | Time: 4398.61 ms
[2022-04-14 13:09:54 main:574] : INFO : Epoch 55 | loss: 0.0311573 | val_loss: 0.0311661 | Time: 4546.45 ms
[2022-04-14 13:09:59 main:574] : INFO : Epoch 56 | loss: 0.0311557 | val_loss: 0.0311633 | Time: 4388.87 ms
[2022-04-14 13:10:04 main:574] : INFO : Epoch 57 | loss: 0.031154 | val_loss: 0.0311628 | Time: 4496.56 ms
[2022-04-14 13:10:09 main:574] : INFO : Epoch 58 | loss: 0.0311527 | val_loss: 0.03116 | Time: 4546.63 ms
[2022-04-14 13:10:15 main:574] : INFO : Epoch 59 | loss: 0.0311523 | val_loss: 0.0311589 | Time: 4426.2 ms
[2022-04-14 13:10:20 main:574] : INFO : Epoch 60 | loss: 0.0311507 | val_loss: 0.0311568 | Time: 4476.71 ms
[2022-04-14 13:10:25 main:574] : INFO : Epoch 61 | loss: 0.0311523 | val_loss: 0.0311589 | Time: 4696.52 ms
[2022-04-14 13:10:30 main:574] : INFO : Epoch 62 | loss: 0.0311528 | val_loss: 0.031161 | Time: 4488.23 ms
[2022-04-14 13:10:35 main:574] : INFO : Epoch 63 | loss: 0.0311528 | val_loss: 0.0311622 | Time: 4461.24 ms
[2022-04-14 13:10:40 main:574] : INFO : Epoch 64 | loss: 0.031153 | val_loss: 0.0311605 | Time: 4535.51 ms
[2022-04-14 13:10:45 main:574] : INFO : Epoch 65 | loss: 0.0311498 | val_loss: 0.0311559 | Time: 4474.76 ms
[2022-04-14 13:10:50 main:574] : INFO : Epoch 66 | loss: 0.031148 | val_loss: 0.0311591 | Time: 4486.96 ms
[2022-04-14 13:10:55 main:574] : INFO : Epoch 67 | loss: 0.031152 | val_loss: 0.0311588 | Time: 4666.41 ms
[2022-04-14 13:11:01 main:574] : INFO : Epoch 68 | loss: 0.0311506 | val_loss: 0.0311571 | Time: 4562.14 ms
[2022-04-14 13:11:06 main:574] : INFO : Epoch 69 | loss: 0.0311555 | val_loss: 0.0311591 | Time: 4447.68 ms
[2022-04-14 13:11:11 main:574] : INFO : Epoch 70 | loss: 0.0311547 | val_loss: 0.0311643 | Time: 4441.53 ms
[2022-04-14 13:11:16 main:574] : INFO : Epoch 71 | loss: 0.0311509 | val_loss: 0.0311568 | Time: 4558.81 ms
[2022-04-14 13:11:22 main:574] : INFO : Epoch 72 | loss: 0.0311484 | val_loss: 0.0311625 | Time: 4548.25 ms
[2022-04-14 13:11:27 main:574] : INFO : Epoch 73 | loss: 0.0311487 | val_loss: 0.0311583 | Time: 4413.57 ms
[2022-04-14 13:11:32 main:574] : INFO : Epoch 74 | loss: 0.0311484 | val_loss: 0.0311559 | Time: 4547.14 ms
[2022-04-14 13:11:37 main:574] : INFO : Epoch 75 | loss: 0.0311476 | val_loss: 0.0311564 | Time: 4398.28 ms
[2022-04-14 13:11:42 main:574] : INFO : Epoch 76 | loss: 0.0311454 | val_loss: 0.031156 | Time: 4452.83 ms
[2022-04-14 13:11:47 main:574] : INFO : Epoch 77 | loss: 0.0311445 | val_loss: 0.0311641 | Time: 4449.82 ms
[2022-04-14 13:11:52 main:574] : INFO : Epoch 78 | loss: 0.0311488 | val_loss: 0.0311638 | Time: 4536.4 ms
[2022-04-14 13:11:57 main:574] : INFO : Epoch 79 | loss: 0.0311457 | val_loss: 0.0311611 | Time: 4534.21 ms
[2022-04-14 13:12:02 main:574] : INFO : Epoch 80 | loss: 0.0311418 | val_loss: 0.0311568 | Time: 4580 ms
[2022-04-14 13:12:07 main:574] : INFO : Epoch 81 | loss: 0.0311426 | val_loss: 0.031157 | Time: 4552.62 ms
[2022-04-14 13:12:12 main:574] : INFO : Epoch 82 | loss: 0.0311421 | val_loss: 0.0311604 | Time: 4457.09 ms
[2022-04-14 13:12:17 main:574] : INFO : Epoch 83 | loss: 0.0311427 | val_loss: 0.0311601 | Time: 4495.47 ms
[2022-04-14 13:12:23 main:574] : INFO : Epoch 84 | loss: 0.0311452 | val_loss: 0.0311677 | Time: 4556.29 ms
[2022-04-14 13:12:28 main:574] : INFO : Epoch 85 | loss: 0.031149 | val_loss: 0.0311612 | Time: 4543.09 ms
[2022-04-14 13:12:33 main:574] : INFO : Epoch 86 | loss: 0.0311479 | val_loss: 0.0311578 | Time: 4425.73 ms
Machine Learning Dataset Generator v9.75 (Windows/x64) (libTorch: release/1.6 GPU: NVIDIA GeForce RTX 3070 Ti)
[2022-04-14 15:21:09 main:435] : INFO : Set logging level to 1
[2022-04-14 15:21:10 main:441] : INFO : Running in BOINC Client mode
[2022-04-14 15:21:10 main:444] : INFO : Resolving all filenames
[2022-04-14 15:21:11 main:452] : INFO : Resolved: dataset.hdf5 => dataset.hdf5 (exists = 1)
[2022-04-14 15:21:11 main:452] : INFO : Resolved: model.cfg => model.cfg (exists = 1)
[2022-04-14 15:21:12 main:452] : INFO : Resolved: model-final.pt => model-final.pt (exists = 0)
[2022-04-14 15:21:13 main:452] : INFO : Resolved: model-input.pt => model-input.pt (exists = 1)
[2022-04-14 15:21:13 main:452] : INFO : Resolved: snapshot.pt => snapshot.pt (exists = 1)
[2022-04-14 15:21:14 main:472] : INFO : Dataset filename: dataset.hdf5
[2022-04-14 15:21:14 main:474] : INFO : Configuration:
[2022-04-14 15:21:15 main:475] : INFO : Model type: GRU
[2022-04-14 15:21:15 main:476] : INFO : Validation Loss Threshold: 0.0001
[2022-04-14 15:21:16 main:477] : INFO : Max Epochs: 2048
[2022-04-14 15:21:17 main:478] : INFO : Batch Size: 128
[2022-04-14 15:21:17 main:479] : INFO : Learning Rate: 0.01
[2022-04-14 15:21:18 main:480] : INFO : Patience: 10
[2022-04-14 15:21:18 main:481] : INFO : Hidden Width: 12
[2022-04-14 15:21:18 main:482] : INFO : # Recurrent Layers: 4
[2022-04-14 15:21:19 main:483] : INFO : # Backend Layers: 4
[2022-04-14 15:21:19 main:484] : INFO : # Threads: 1
[2022-04-14 15:21:20 main:486] : INFO : Preparing Dataset
[2022-04-14 15:21:20 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xt from dataset.hdf5 into memory
[2022-04-14 15:21:22 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yt from dataset.hdf5 into memory
[2022-04-14 17:19:25 load:106] : INFO : Successfully loaded dataset of 2048 examples into memory.
[2022-04-14 17:19:25 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Xv from dataset.hdf5 into memory
[2022-04-14 17:19:26 load_hdf5_ds_into_tensor:28] : INFO : Loading Dataset /Yv from dataset.hdf5 into memory
[2022-04-14 17:19:27 load:106] : INFO : Successfully loaded dataset of 512 examples into memory.
[2022-04-14 17:19:27 main:494] : INFO : Creating Model
[2022-04-14 17:19:28 main:507] : INFO : Preparing config file
[2022-04-14 17:19:28 main:511] : INFO : Found checkpoint, attempting to load...
[2022-04-14 17:19:29 main:512] : INFO : Loading config
[2022-04-14 17:19:29 main:514] : INFO : Loading state
Unhandled Exception Detected...
- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFF64C990A2
Engaging BOINC Windows Runtime Debugger...
********************
BOINC Windows Runtime Debugger Version 7.17.0
Dump Timestamp : 04/14/22 18:03:41
Install Directory : D:\BOINC\
Data Directory : E:\BOINC
Project Symstore :
LoadLibraryA( E:\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( E:\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( E:\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( E:\BOINC\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: E:\BOINC\slots\4;E:\BOINC\projects\www.mlcathome.org_mlcathome
ModLoad: 00000000e25b0000 00000000003df000 E:\BOINC\projects\www.mlcathome.org_mlcathome\mlds-gpu_9.75_windows-x86_64__cuda10200.exe (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000066e70000 00000000001f5000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : ntdll.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 00000000658b0000 00000000000be000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.19041.1645) (-exported- Symbols Loaded)
Linked PDB Filename : kernel32.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 0000000064bd0000 00000000002c8000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.19041.1645) (-exported- Symbols Loaded)
Linked PDB Filename : kernelbase.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 0000000065d50000 00000000001a0000 C:\WINDOWS\System32\USER32.dll (6.2.19041.1503) (-exported- Symbols Loaded)
Linked PDB Filename : user32.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 00000000646f0000 0000000000022000 C:\WINDOWS\System32\win32u.dll (6.2.19041.1645) (-exported- Symbols Loaded)
Linked PDB Filename : win32u.pdb
File Version : 10.0.19041.1645 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1645
ModLoad: 0000000065ac0000 000000000002a000 C:\WINDOWS\System32\GDI32.dll (6.2.19041.1620) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32.pdb
File Version : 10.0.19041.1620 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1620
ModLoad: 0000000064770000 000000000010b000 C:\WINDOWS\System32\gdi32full.dll (6.2.19041.1620) (-exported- Symbols Loaded)
Linked PDB Filename : gdi32full.pdb
File Version : 10.0.19041.1620 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1620
ModLoad: 0000000064930000 000000000009d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.789
ModLoad: 0000000064a40000 0000000000100000 C:\WINDOWS\System32\ucrtbase.dll (6.2.19041.789) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.19041.789 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.789
ModLoad: 00000000657c0000 00000000000ae000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.19041.1466) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 0000000065ef0000 000000000009e000 C:\WINDOWS\System32\msvcrt.dll (7.0.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 7.0.19041.546
ModLoad: 0000000065b70000 000000000009c000 C:\WINDOWS\System32\sechost.dll (6.2.19041.1586) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.19041.320 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.320
ModLoad: 00000000662c0000 0000000000125000 C:\WINDOWS\System32\RPCRT4.dll (6.2.19041.1645) (-exported- Symbols Loaded)
Linked PDB Filename : rpcrt4.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 00000000537a0000 0000000000058000 E:\BOINC\slots\4\c10.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 0000000052c80000 000000000008d000 C:\WINDOWS\SYSTEM32\MSVCP140.dll (14.29.29917.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\msvcp140.amd64.pdb
File Version : 14.29.29917.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft? Visual Studio?
Product Version : 14.29.29917.0
ModLoad: 000000005e650000 00000000001e4000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.19041.867) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.19041.867 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.867
ModLoad: 0000000052d10000 000000000001a000 C:\WINDOWS\SYSTEM32\VCRUNTIME140.dll (14.29.29917.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\vcruntime140.amd64.pdb
File Version : 14.29.29917.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft? Visual Studio?
Product Version : 14.29.29917.0
ModLoad: 0000000051b20000 000000000000c000 C:\WINDOWS\SYSTEM32\VCRUNTIME140_1.dll (14.29.29917.0) (-exported- Symbols Loaded)
Linked PDB Filename : d:\agent\_work\1\s\\binaries\amd64ret\bin\amd64\\vcruntime140_1.amd64.pdb
File Version : 14.29.29917.0 built by: vcwrkspc
Company Name : Microsoft Corporation
Product Name : Microsoft? Visual Studio?
Product Version : 14.29.29917.0
ModLoad: 00000000d52f0000 000000000abe7000 E:\BOINC\slots\4\torch_cpu.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000534c0000 000000000020d000 E:\BOINC\slots\4\libiomp5md.dll (5.0.2020.205) (-exported- Symbols Loaded)
Linked PDB Filename : O:\promo\20200205\tmp\win_32e-rtl_int_5_nor_dyn.rel.c0.s0.t1..h1.w1-FXILAB103\libiomp5md.pdb
File Version : 20200205
Company Name : Intel Corporation
Product Name : Intel(R) OpenMP* Runtime Library
Product Version : 5.0
ModLoad: 000000003e6a0000 00000000002db000 E:\BOINC\slots\4\fbgemm.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 000000005bbb0000 0000000000040000 E:\BOINC\slots\4\asmjit.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000dfee0000 0000000024b49000 E:\BOINC\slots\4\torch_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000d2240000 00000000030a5000 E:\BOINC\slots\4\cusparse64_10.dll (6.14.11.1031) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1031
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA SPARSE BLAS Library
Product Version : 6,14,11,1031
ModLoad: 00000000ced80000 00000000034b2000 E:\BOINC\slots\4\curand64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA RAND Library
Product Version : 6,14,11,1012
ModLoad: 000000005f940000 0000000000010000 E:\BOINC\slots\4\nvToolsExt64_1.dll (-exported- Symbols Loaded)
Linked PDB Filename : D:\bld\lib\nvtx\v1\_bin\win32_x64_release\nvToolsExt64_1.pdb
ModLoad: 00000000aa830000 000000000919f000 E:\BOINC\slots\4\cufft64_10.dll (6.14.11.1012) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1012
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA FFT Library
Product Version : 6,14,11,1012
ModLoad: 0000000053470000 0000000000045000 E:\BOINC\slots\4\c10_cuda.dll (-exported- Symbols Loaded)
Linked PDB Filename :
ModLoad: 00000000a6ad0000 0000000003d5b000 E:\BOINC\slots\4\cublas64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 0000000005d20000 0000000001eca000 E:\BOINC\slots\4\cublasLt64_10.dll (6.14.11.1022) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,1022
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA BLAS Library
Product Version : 6,14,11,1022
ModLoad: 00000000b39d0000 000000001b3a4000 E:\BOINC\slots\4\cudnn64_7.dll (6.14.11.10020) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 6,14,11,10020
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 10.2.86 CUDNN Library
Product Version : 6,14,11,10020
ModLoad: 0000000065870000 0000000000030000 C:\WINDOWS\System32\IMM32.DLL (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : imm32.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000624d0000 0000000000012000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : Kernel.Appcore.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.546
ModLoad: 0000000065350000 000000000046a000 C:\WINDOWS\System32\Setupapi.dll (6.2.19041.1620) (-exported- Symbols Loaded)
Linked PDB Filename : setupapi.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 0000000064720000 000000000004e000 C:\WINDOWS\System32\cfgmgr32.dll (6.2.19041.1620) (-exported- Symbols Loaded)
Linked PDB Filename : cfgmgr32.pdb
File Version : 10.0.19041.1620 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1620
ModLoad: 0000000064ea0000 0000000000027000 C:\WINDOWS\System32\bcrypt.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : bcrypt.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 0000000064340000 000000000002c000 C:\WINDOWS\SYSTEM32\DEVOBJ.dll (6.2.19041.1620) (-exported- Symbols Loaded)
Linked PDB Filename : devobj.pdb
File Version : 10.0.19041.1620 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1620
ModLoad: 00000000649d0000 0000000000068000 C:\WINDOWS\System32\WINTRUST.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : wintrust.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1566
ModLoad: 0000000064590000 0000000000156000 C:\WINDOWS\System32\CRYPT32.dll (6.2.19041.1320) (-exported- Symbols Loaded)
Linked PDB Filename : crypt32.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 0000000064180000 0000000000012000 C:\WINDOWS\SYSTEM32\MSASN1.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : msasn1.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.546
ModLoad: 00000000666e0000 0000000000744000 C:\WINDOWS\System32\Shell32.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : shell32.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 00000000626d0000 0000000000794000 C:\WINDOWS\SYSTEM32\windows.storage.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : Windows.Storage.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 0000000064ed0000 0000000000354000 C:\WINDOWS\System32\combase.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 0000000064000000 000000000002c000 C:\WINDOWS\SYSTEM32\Wldp.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : WLDP.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 0000000066210000 00000000000ad000 C:\WINDOWS\System32\SHCORE.dll (6.2.19041.1645) (-exported- Symbols Loaded)
Linked PDB Filename : shcore.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 00000000661b0000 0000000000055000 C:\WINDOWS\System32\shlwapi.dll (6.2.19041.1023) (-exported- Symbols Loaded)
Linked PDB Filename : shlwapi.pdb
File Version : 10.0.19041.1586 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1586
ModLoad: 000000003e3d0000 00000000002cd000 C:\WINDOWS\system32\nvcuda.dll (30.0.15.1215) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r512_08\drivers\gpgpu\cuda\loader\_out\wddm2_amd64_release\nvcuda_loader.pdb
File Version : 30.0.15.1215
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.6.127 driver
Product Version : 30.0.15.1215
ModLoad: 000000000e4f0000 000000000169f000 C:\WINDOWS\system32\DriverStore\FileRepository\nvmdi.inf_amd64_2b01a28ee7b06750\nvcuda64.dll (30.0.15.1215) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r512_08\drivers\gpgpu\_out\wddm2_amd64_release\nvcuda.pdb
File Version : 30.0.15.1215
Company Name : NVIDIA Corporation
Product Name : NVIDIA CUDA 11.6.127 driver
Product Version : 30.0.15.1215
ModLoad: 000000005ef10000 000000000000a000 C:\WINDOWS\SYSTEM32\VERSION.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.546
ModLoad: 000000005ee50000 0000000000031000 C:\WINDOWS\SYSTEM32\cryptnet.dll (6.2.19041.906) (-exported- Symbols Loaded)
Linked PDB Filename : cryptnet.pdb
File Version : 10.0.19041.906 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.906
ModLoad: 000000005ed00000 0000000000148000 C:\WINDOWS\SYSTEM32\drvstore.dll (6.2.19041.1566) (-exported- Symbols Loaded)
Linked PDB Filename : drvstore.pdb
File Version : 10.0.19041.1566 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1566
ModLoad: 0000000063f50000 000000000000c000 C:\WINDOWS\SYSTEM32\cryptbase.dll (6.2.19041.546) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.19041.546 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.546
ModLoad: 000000005c600000 0000000000768000 C:\WINDOWS\SYSTEM32\nvapi64.dll (30.0.15.1215) (-exported- Symbols Loaded)
Linked PDB Filename : C:\dvs\p4\build\sw\rel\gpu_drv\r510\r512_08\drivers\nvapi\gpu\_out\wddm2_amd64_release\nvapi64.pdb
File Version : 30.0.15.1215
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows drivers
Product Version : 30.0.15.1215
ModLoad: 0000000010a10000 00000000008b3000 C:\WINDOWS\System32\DriverStore\FileRepository\nvmdi.inf_amd64_2b01a28ee7b06750\nvptxJitCompiler64.dll (30.0.15.1215) (-exported- Symbols Loaded)
Linked PDB Filename :
File Version : 30.0.15.1215
Company Name : NVIDIA Corporation
Product Name : NVIDIA Windows PTX JIT Compiler
Product Version : 30.0.15.1215
ModLoad: 0000000064b40000 0000000000082000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.19041.1415) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.19041.1415 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 10.0.19041.1415
*** Dump of the Process Statistics: ***
- I/O Operations Counters -
Read: 4517, Write: 2619, Other 47835
- I/O Transfers Counters -
Read: 11109097, Write: 1786323878, Other 197700
- Paged Pool Usage -
QuotaPagedPoolUsage: 3478328, QuotaPeakPagedPoolUsage: 3478328
QuotaNonPagedPoolUsage: 52896, QuotaPeakNonPagedPoolUsage: 71664
- Virtual Memory Usage -
VirtualSize: -313622528, PeakVirtualSize: 825335808
- Pagefile Usage -
PagefileUsage: -313622528, PeakPagefileUsage: 319361024
- Working Set Size -
WorkingSetSize: 2127962112, PeakWorkingSetSize: -1543233536, PageFaultCount: 29446058
*** Dump of thread ID 5132 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 3546113.000000
- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x00007FFF64C990A2
- Registers -
rax=0000000000000000 rbx=0000000000000001 rcx=00000000e2868c40 rdx=0000000030bfe860 rsi=0000000000000000 rdi=0000000000000000
r8=0000000030bfe860 r9=00000000e2868c30 r10=0000000000000fff r11=0000000000000ff0 r12=0000000000000000 r13=0000000000000000
r14=0000000000000000 r15=0000000000000000 rip=0000000064c990a2 rsp=0000000030bfe838 rbp=0000000000000000
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
30bfe830 e25e9100 00000001 30bfe860 30bfe860 e2868c30 KERNELBASE!DebugBreak+0x0
30bfec70 e25e9ce4 99400000 30bfefd4 00000000 000003c4 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
30bffbd0 e25ea084 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
30bffc00 658c7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
30bffc30 66ec2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
30bffcb0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 3704 (state: Ready): ***
- Information -
Status: Base Priority: Above Normal, Priority: Above Normal, , Kernel Time: 208437504.000000, User Time: 18146250752.000000, Wait Time: 3546110.000000
- Registers -
rax=0000000000000002 rbx=000000003c9f17e0 rcx=00000000ffffff97 rdx=0000000000000066 rsi=0000000000000001 rdi=000000003c9fcdd8
r8=0000000000000001 r9=0000000000000002 r10=000000003c9f4170 r11=0000000000000000 r12=000000003fa70970 r13=0000000000000001
r14=0000000000000000 r15=000000003cb96c28 rip=0000000010b08684 rsp=00000000306e0ec0 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000206
- Callstack -
ChildEBP RetAddr Args to Child
306e0f20 10af7222 3fa70970 3cb96c28 00000000 00000000 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0
306e0f60 10af27f0 00000001 00000235 00000001 3c9f1de8 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0
306e1020 10b0cbe0 3fa84100 306e1050 3c9f1700 306e10a0 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0
306e1090 10c541cf 3c9fcf01 00000001 3c9f17e0 00000000 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0
306e12b0 10ae0cd2 3cb9ed00 10fe8100 3c9f17e0 00000000 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0
306e1350 10ae0dc3 0000003c 3cb9ed10 00000034 306e14a0 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0
306e1450 10ab7c99 00000000 3c9f73a8 3c9f17e0 306e1680 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0
306e1510 10c37df2 36417060 00000007 36417060 f8cbd898 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0
306e1540 10a11ff9 36417060 14492d70 10a1c310 14492d70 nvptxJitCompiler64!nvLinkerGetLinkedCubinSize+0x0
306e1570 10a181c1 4db7f2f8 00000000 36417060 306e1680 nvptxJitCompiler64!+0x0
306e17d0 10a14a12 0be3ba88 306e19a0 4f7c21d8 4f7c21d8 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0
306e1b60 10a16c92 fd281d88 00000005 f6f575e8 00000005 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0
306e1bf0 10a1fa60 14492d70 306e1d00 00000000 00000005 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0
306e1dc0 10a1282b 0e766dfa 00000001 00000000 00200000 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0
306e2d10 0e974c7a 00000001 00000005 306e2d70 306e2d40 nvptxJitCompiler64!__cuda_CallJitEntryPoint+0x0
306e2f80 0e974f20 93961d00 0bf2aaa8 00000056 d09dcff5 nvcuda64!cuProfilerStop+0x0
306e3170 0e67c961 306e33f0 00000000 306e33f0 00000002 nvcuda64!cuProfilerStop+0x0
306e3230 0e67cd3e d0b9d090 00000000 306e33f0 00f062fd nvcuda64!+0x0
306e32f0 0e67cff0 306e3570 306e3601 306e33f0 306e33d9 nvcuda64!+0x0
306e33b0 0e69e892 0000007f 0000007f cf3e13a0 0bf2aaa8 nvcuda64!+0x0
306e34a0 0e597961 00000000 ced36378 00000e78 306e3650 nvcuda64!+0x0
306e3510 0e597ac7 a2d948f0 ced36378 00000000 000000d1 nvcuda64!+0x0
306e3600 0e598641 00000000 00000000 00000000 306e3691 nvcuda64!+0x0
306e36e0 b477a6f3 00000000 00000000 ced36378 b4779f43 nvcuda64!+0x0
306e3760 b47789e9 cf30ffd0 cf312a78 00000000 b47789d0 cudnn64_7!cudnnSetDropoutDescriptor+0x0
306e3790 b477962b cf312a70 cf313078 cecc0100 cf2694e0 cudnn64_7!cudnnSetDropoutDescriptor+0x0
306e37d0 b477c449 cf2a4e08 cf2a4e08 00000000 cf2a4df8 cudnn64_7!cudnnSetDropoutDescriptor+0x0
306e3850 b477c061 00000001 00000001 00000001 cf303740 cudnn64_7!cudnnSetDropoutDescriptor+0x0
306e3890 b477ce83 00000000 cecc0860 00000628 306e35b0 cudnn64_7!cudnnSetDropoutDescriptor+0x0
306e38c0 b47730d2 00000000 00000628 306e35b0 b47730c5 cudnn64_7!cudnnSetDropoutDescriptor+0x0
306e38f0 b4770d21 cecc0860 fe1838c8 00000000 cf303740 cudnn64_7!cudnnSetDropoutDescriptor+0x0
306e39c0 b39d5925 fe183870 00000000 00000000 00000000 cudnn64_7!cudnnSetDropoutDescriptor+0x0
306e5a40 e2d22139 00000000 2da91a10 2da91a10 00000002 cudnn64_7!cudnnCreate+0x0
306e5bf0 e2d21aad fa1a9aa0 00000000 00000000 000000d0 torch_cuda!at::native::TensorDescriptor::set+0x0
306e5c60 e2d22a27 fa1a9aa0 306e5d70 fa1a9aa0 fa1a9a80 torch_cuda!at::native::TensorDescriptor::set+0x0
306e5ec0 e2d22557 ce878530 306e6680 ce878530 99685a50 torch_cuda!at::native::getCudnnHandle+0x0
306e6070 e2c5d642 00000000 00000001 00000000 000003e7 torch_cuda!at::native::getCudnnHandle+0x0
306e6520 e2cb296d 306e65a8 00000001 306e65a8 306e6680 torch_cuda!at::native::_cudnn_rnn_flatten_weight+0x0
306e6600 e2cc4124 ad11be40 ce960000 ce9602ac 537bef8f torch_cuda!at::native::set_storage_cuda_+0x0
306e6670 dad736ca 306e66e8 ce961bc0 ce960000 ce960000 torch_cuda!at::native::set_storage_cuda_+0x0
306e68e0 dc0fecf2 00000000 00000000 00000000 306e69f0 torch_cpu!at::_cudnn_rnn_flatten_weight+0x0
306e6ae0 dc1096c9 cf91f8a0 da93e8dd 00000004 00000009 torch_cpu!torch::autograd::GraphRoot::apply+0x0
306e6b50 dad736ca 306e6bc8 00000003 306e6bd0 306e6c60 torch_cpu!torch::autograd::GraphRoot::apply+0x0
306e6dc0 dc895fce 00000001 00000001 306e6eb0 00000001 torch_cpu!at::_cudnn_rnn_flatten_weight+0x0
306e6ee0 dc7e2940 00000000 2ca34d10 306e7148 2ca34e30 torch_cpu!torch::nn::detail::RNNImplBase<torch::nn::RNNImpl>::flatten_parameters+0x0
306e7100 dc7e7b3c 00000001 0000001b 0000001f 306e7330 torch_cpu!torch::nn::init::zeros_+0x0
306e7130 e25cb741 306e7748 00000001 00000000 00000080 torch_cpu!torch::nn::Module::to+0x0
306ffed0 e280c6f8 d072ca20 00000000 00000000 d076d9f0 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
306fff10 658c7034 00000000 00000000 00000000 00000000 mlds-gpu_9.75_windows-x86_64__c!c10::ivalue::Future::wait+0x0
306fff40 66ec2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
306fffc0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 6828 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 3546110.000000
- Registers -
rax=000000000000005b rbx=000000000000000d rcx=000000000000000d rdx=0000000030cffbc0 rsi=0000000000000000 rdi=000000000000000d
r8=00000000d09dcbc0 r9=00000000d094be00 r10=0000000000000000 r11=0000000030cffb30 r12=0000000000000064 r13=0000000030cffbc0
r14=0000000030cff8c0 r15=0000000000000000 rip=0000000066f0d8c4 rsp=0000000030cff868 rbp=00000000d094be30
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
30cff860 64c1cb10 00000000 304af000 66fda4d0 304af000 ntdll!ZwWaitForMultipleObjects+0x0
30cffb50 64c1ca0e ce873df0 004e0049 0000000d 00000000 KERNELBASE!WaitForMultipleObjectsEx+0x0
30cffb90 0e6cd554 d094e170 00000000 00000000 00000000 KERNELBASE!WaitForMultipleObjects+0x0
30cffdd0 0e7758cd 00000000 d094be30 00000000 00000000 nvcuda64!+0x0
30cffe80 0e6ccf23 02164582 602decae d0f1bd80 00000000 nvcuda64!cuProfilerStop+0x0
30cffeb0 0ea041e4 d0f1bd80 00000000 00000000 00000000 nvcuda64!+0x0
30cffee0 658c7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
30cfff10 66ec2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
30cfff90 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Dump of thread ID 3796 (state: Waiting): ***
- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 2922962.000000
- Registers -
rax=0000000000000004 rbx=0000000000000000 rcx=00000000000002b0 rdx=0000000000000000 rsi=0000000000000000 rdi=00000000000002b0
r8=0000000000000000 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000 r12=00000000d0922060 r13=0000000000000000
r14=00000000000002b0 r15=0000000000000000 rip=0000000066f0cdf4 rsp=0000000030dff8e8 rbp=0000000000000000
cs=0033 ss=002b ds=0000 es=0000 fs=0000 gs=0000 efl=00000246
- Callstack -
ChildEBP RetAddr Args to Child
30dff8e0 64bf1a5e 00000000 00001f80 00000000 00000000 ntdll!ZwWaitForSingleObject+0x0
30dff980 0e8f596e d0f1bde0 00000000 00000000 000002b0 KERNELBASE!WaitForSingleObjectEx+0x0
30dffbc0 0e6ccf23 00000000 d0f1bde0 0e4f0000 d09382d0 nvcuda64!cuProfilerStop+0x0
30dffbf0 0ea041e4 d0f1bde0 00000000 00000000 00000000 nvcuda64!+0x0
30dffc20 658c7034 00000000 00000000 00000000 00000000 nvcuda64!cuProfilerStop+0x0
30dffc50 66ec2651 00000000 00000000 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
30dffcd0 00000000 00000000 00000000 00000000 00000000 ntdll!RtlUserThreadStart+0x0
*** Debug Message Dump ****
*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0
Exiting...
</stderr_txt>
]]>
©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)