4090 Power capped
Hi, I was testing an inference job on a 4090 pod. I noticed it was running very slowly. When I checked the nvidia logs, I noticed a "sw power cap" message when it got to about 1/3 of the Power (450W). How do we get full performance of our 4090 GPU?
4 Replies
Try a different datacenter
Are you using community cloud? Can you share the pod id here?
It happened on 2 different pods. One was an L40. I had to terminate these instances as I could not run my tests with these instances. I am not using community cloud. I have to use the same datacenter
I started a new 4090 and it is working now. But we don't want to run into this issue on any other instances
feel free to report pod id here if you see any power capped machine.