GPU taks are freezing up

Questions and Answers : Issue Discussion : GPU taks are freezing up
Message board moderation

To post messages, you must log in.

AuthorMessage
Dfirebug

Send message
Joined: 7 Nov 21
Posts: 2
Credit: 91,520
RAC: 0
Message 1411 - Posted: 8 Nov 2021, 2:07:57 UTC
Last modified: 8 Nov 2021, 2:10:02 UTC

my GPU tasks have started to freeze they are still technically running but my GPU is at less than 5% usage and that percentage completed is barely increasing at all I have an RTX 2080 super with a Ryzen 5 5600X on windows 11 it seems that in some periods in the work unit the GPU is being used but it goes though phases of 0-5% usage with random spikes
ID: 1411 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
pianoman [MLC@Home Admin]
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 30 Jun 20
Posts: 462
Credit: 21,406,548
RAC: 0
Message 1412 - Posted: 8 Nov 2021, 4:31:32 UTC - in response to Message 1411.  

We're aware of some issues with Windows 11 performance when using nvidia GPUs.

We don't have any windows 11 systems to test against at the moment, and given the known issues with the windows 11 scheduler and Ryzen (MS really screwed it up), and the extremely complex nature of nvidia cuda and how it interacts with the host operating system, I'm inclined to wait until NVidia and AMD get some time to clean up MS's mess first, before we start looking at things we can do on our side, since there's really not much we do other than make calls for pytorch to use the GPU instead of the CPU (this is not hand-tuned cuda).

I know it's not a satisfying answer, but given that we haven't even released an updated v0.90 GPU client for windows yet (It's coming, was trying to get the linux version out first, but that's giving me more issues than planned), figuring out windows 11 performance issues are low on the priority list.
ID: 1412 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dfirebug

Send message
Joined: 7 Nov 21
Posts: 2
Credit: 91,520
RAC: 0
Message 1413 - Posted: 8 Nov 2021, 13:19:15 UTC - in response to Message 1412.  

would it be better if I ran it on linux instead of windows 11?
ID: 1413 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
bozz4science

Send message
Joined: 9 Jul 20
Posts: 142
Credit: 11,536,204
RAC: 3
Message 1414 - Posted: 8 Nov 2021, 16:18:46 UTC - in response to Message 1413.  

I’d say that’s definitely a better choice than win11 atm
ID: 1414 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
kotenok2000

Send message
Joined: 17 Jul 20
Posts: 12
Credit: 7,473,347
RAC: 65
Message 1415 - Posted: 8 Nov 2021, 17:34:56 UTC - in response to Message 1411.  

Try to ibn increase mlds-gpu_9.75_windows-x86_64__cuda10200.exe priority to realtime with process hacker.
ID: 1415 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote

Questions and Answers : Issue Discussion : GPU taks are freezing up

©2022 MLC@Home Team
A project of the Cognition, Robotics, and Learning (CORAL) Lab at the University of Maryland, Baltimore County (UMBC)