rien19ma
Skypilot & expose-ports
Hi,
I'm using Skypilot to create and deploy Vllm on POD.
If I'm correct, currently, the template
runpod/base:0.0.2 is used when a POD is created through Skypilot. Ports 8266,6380 are exposed by this template for Ray (I guess).
So far, Skypilot doesn't support template selection for Runpod (issue here: https://github.com/skypilot-org/skypilot/issues/3007)
So, I wonder if opening a port through Skypilot will be available at some point (I guess it's mainly on your side, right^^) ?
https://github.com/skypilot-org/skypilot/blob/904aa5cb6b59a550d39ae87a2bbfe32e4c53b8b4/sky/clouds/runpod.py#L33-L354 replies