Skypilot & expose-ports
Hi,
I'm using Skypilot to create and deploy Vllm on POD.
If I'm correct, currently, the template
runpod/base:0.0.2 is used when a POD is created through Skypilot. Ports 8266,6380 are exposed by this template for Ray (I guess).
So far, Skypilot doesn't support template selection for Runpod (issue here: https://github.com/skypilot-org/skypilot/issues/3007)
So, I wonder if opening a port through Skypilot will be available at some point (I guess it's mainly on your side, right^^) ?
https://github.com/skypilot-org/skypilot/blob/904aa5cb6b59a550d39ae87a2bbfe32e4c53b8b4/sky/clouds/runpod.py#L33-L35GitHub
Issues · skypilot-org/skypilot
SkyPilot: Run LLMs, AI, and Batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed execution—all with a simple interface. - Issues · skypilot-org/skypilot
GitHub
skypilot/sky/clouds/runpod.py at 904aa5cb6b59a550d39ae87a2bbfe32e4c...
SkyPilot: Run LLMs, AI, and Batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed execution—all with a simple interface. - skypilot-org/skypilot
2 Replies
