Abu Bokor Siddick π§π©
RRunPod
β’Created by Abu Bokor Siddick π§π© on 1/20/2025 in #β‘ο½serverless
--trust-remote-code
I tried to install deepseek v3 on serverless vllm showing this
"Uncaught exception | <class 'RuntimeError'>; Failed to load the model config. If the model is a custom model not yet available in the HuggingFace transformers library, consider setting
trust_remote_code=True in LLM or using the --trust-remote-code flag in the CLI.; <traceback object at 0x7fecd5a12700>;"1 replies