Severless confusion
hi, where does the openai compatible end point option on the severless confing? i just now using severless and i unable to connect it with my front end because they need OpenAI Compatible
1 Reply
its automatically supported as long as you use something like vllm, check our docs on how to use it