What is the CUDA version of the A6000 48GB endpoint?

I keep running into the following error randomly when I get requests where the worker is stuck in an infinite loop.
2024-05-01T12:46:54Z error starting container: Error response from daemon: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: error running hook #0: error running hook: exit status 1, stdout: , stderr: Auto-detected mode as 'legacy'
nvidia-container-cli: requirement error: unsatisfied condition: cuda>=12.2, please update your driver to a newer version, or use an earlier cuda container: unknown
2024-05-01T12:46:54Z error starting container: Error response from daemon: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: error running hook #0: error running hook: exit status 1, stdout: , stderr: Auto-detected mode as 'legacy'
nvidia-container-cli: requirement error: unsatisfied condition: cuda>=12.2, please update your driver to a newer version, or use an earlier cuda container: unknown
1 Reply
Madiator2011
Madiator20117mo ago
you can set cuda version you want to use on advance settings of endpoint
No description
Want results from more Discord servers?
Add your server