Yash
RRunPod
•Created by Yash on 6/20/2024 in #⚡｜serverless
0% GPU utilization and 100% CPU utilization on Faster Whisper quick deploy endpoint
Thank you for your help!
9 replies
RRunPod
•Created by Yash on 6/20/2024 in #⚡｜serverless
0% GPU utilization and 100% CPU utilization on Faster Whisper quick deploy endpoint
So I guess the graph is wrong then
9 replies
RRunPod
•Created by Yash on 6/20/2024 in #⚡｜serverless
0% GPU utilization and 100% CPU utilization on Faster Whisper quick deploy endpoint
Ok I think you're right, I tried it on a 32 cpu instance and got a bunch of
nvidia-smi: not found logs plus it took longer than 200 seconds9 replies
RRunPod
•Created by Yash on 6/20/2024 in #⚡｜serverless
0% GPU utilization and 100% CPU utilization on Faster Whisper quick deploy endpoint
Does that mean that it's actually using the GPU?
9 replies
RRunPod
•Created by Yash on 6/20/2024 in #⚡｜serverless
0% GPU utilization and 100% CPU utilization on Faster Whisper quick deploy endpoint
I am getting back "device": "cuda" in my output: https://github.com/runpod-workers/worker-faster_whisper/blob/main/src/predict.py#L120
9 replies