tkpop777
Explore posts from serversCDCloudflare Developers
•Created by tkpop777 on 7/27/2024 in #general-help
Does it make sense to use workers to host a chat endpoint?
Since workers are a server-less platform an instance needs to boot up every time you make a request to the endpoint, from a latency POV this is fine because its super fast, but I just don't know if it makes sense for a chat endpoint. Is it wasteful to use it for an app where you are constantly talking back and forth with a chatbot and for every message you send a new instance is being spun up and closed right after?
P.S. this isn't for a peer to peer chat, but with an ai powered chatbot so no need to keep an open connection (e.g. sockets) or is there?
4 replies
RRunPod
•Created by tkpop777 on 5/8/2024 in #⚡｜serverless
Is it possible to SSH into a serverless endpoint?
I can SSH into the box when I deploy docker images to regular pods. But is it possible to SSH into them when deploying them to serverless endpoints? I want to be able to troubleshoot and inspect the built image but I'm unsure how to ssh into it. for the regular pods I just click the "Connect" button and there I can see the IP address and command to ssh. How to do it with serverless?
2 replies