Port forwarding understanding
Greetings, I have been a user of vast ai, and there they have a list of ports alreadt assigned to it and they map to exactly same one on your machine. But in runpod they map to a different one. I have to run a miner and I need to tell two of my ports to it, now should I be telling it my external or internal ports and how would they map to internal ones?
I am also attaching picture of vast ports and yours as well...
SGLANG load LLM Model
I am trying to load LLM model using Pods by using sglang template.
Here is my config:
When I start the pod, it did not loading the model instead the container log keep showing cuda things(license,version). May I know what is the reason?...
