R
RunPod•3mo ago
salbakraa

What is the CUDA version of the A6000 48GB endpoint?

I keep running into the following error randomly when I get requests where the worker is stuck in an infinite loop. 
2024-05-01T12:46:54Z error starting container: Error response from daemon: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: error running hook #0: error running hook: exit status 1, stdout: , stderr: Auto-detected mode as 'legacy'
nvidia-container-cli: requirement error: unsatisfied condition: cuda>=12.2, please update your driver to a newer version, or use an earlier cuda container: unknown
2024-05-01T12:46:54Z error starting container: Error response from daemon: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: error running hook #0: error running hook: exit status 1, stdout: , stderr: Auto-detected mode as 'legacy'
nvidia-container-cli: requirement error: unsatisfied condition: cuda>=12.2, please update your driver to a newer version, or use an earlier cuda container: unknown
1 Reply
Madiator2011
Madiator2011•3mo ago
you can set cuda version you want to use on advance settings of endpoint
No description
Want results from more Discord servers?
Add your server
More Posts
Efficient way to load the modelI'm migrating my service to RunPod and I need some advice on the best way to handle a 200MB model. Can we run aphrodite-engine on Serverless?aphrodite-engine is a fork from vLLM and also supports exl2 format, which gives it a huge advantage.Template pytorch-1.13.1 lists cuda 11.7.1 version but is actually cuda 11.8?I tried running a model that requires pytorch-1.13.1 and 11.7 but it said the cuda version doesn't mIdle timeout not workingHi team. I'm setting my serverless endpoint with a Idle timeout for 180 seconds, but it's idleing o