ashleyk
Exposed Port 8888
Might be useful if you didn't make incorrect assumptions. If you want to use an IP and external port then expose it as TCP and not HTTP, but then you need to ensure that your pod has a public IP and you also need to use the external port mapping. HTTP and TCP ports always work like this, so this is on you and nobody else for making incorrect assumptions.
10 replies
RRunPod
•Created by streamize on 3/26/2024 in #⚡|serverless
how to prevent restart serverless instance
Why is there an error in your code anyway? I would try and fix the error.
4 replies
RRunPod
•Created by Oryza sativa on 3/25/2024 in #⚡|serverless
How to Run Text Generation Inference on Serverless?
@Alpay Ariyak may be able to advise.
11 replies
RRunPod
•Created by Oryza sativa on 3/25/2024 in #⚡|serverless
How to Run Text Generation Inference on Serverless?
What response do you get when calling your endpoint?
11 replies