SGLANG load LLM Model
I am trying to load LLM model using Pods by using sglang template.
Here is my config:
When I start the pod, it did not loading the model instead the container log keep showing cuda things(license,version). May I know what is the reason?
1 Reply
FYI: these are the container log and system log. It seems like keep starting the container.
