Using SSH to debug serverless endpoints
Hello! I had a quick question I was hoping someone could help with.
In the RunPod documentation Overview section for Serverless, it states:
Metrics and Debugging: Transparency is vital in debugging. RunPod provides access to GPU, CPU, Memory, and other metrics to help users understand their computational workloads. Full debugging capabilities for workers through logs and SSH are also available, with a web terminal for even easier access.
How can we actually SSH into these instances? I see no instructions for how to open the necessary port for direct SSH connections like we can for custom pods, and I see no way to just connect via the web interface.
I see references online indicating that it was once possible, but was disabled. Is this just no longer offered and the documentation just hasn't been updated, or am I missing something?
Anyone know?
8 Replies
You can only access it while its active, and can use web terminal.
Hi, thanks for the response. I have used the web terminal many times with standard pods, but I don't see any way at all when looking at the serverless endpoints to connect with web terminal.
Nevermind. I'm just blind apparently... thanks for the help 😆
Edit pod
Expose 22 tcp
Solution
Oh on serverless you just connect with the connect button when it's active
Yep, I saw references to direct connections, but I think that was removed. I just missed the button somehow.
haha great you found it!
yep. Appreciate the help!
Your welcome