3WaD
RRunPod
•Created by 3WaD on 10/11/2024 in #⚡｜serverless
OpenAI Serverless Endpoint Docs
Hello. From what I could find in the support threads here, you should be able to make a standard openAI request not wrapped in the "input" param if you hit your endpoint at https://api.runpod.ai/v2/<ENDPOINT ID>/openai/...
The handler should then receive two new params, "openai_route" and "openai_input," but it's been a couple of months since the threads, and I can't find any official docs about this or the ability to test this locally with the RunPod lib. Can someone please confirm that this works in custom images too? If so, what is the structure of the parameters received? Does "input" in
handler(input) contain "openai_input" and "openai_route" params directly? Is there any way I can develop this locally?47 replies