Does RunPod serverless handler support FastAPI?
I am trying to migrate an already existing FastAPI application running ML model to RunPod serverless. Does the serverless handler, that needs to be dockerized, support FastAPI?
4 Replies
You shouldn't use FastAPI in serverless, its already an API, just create a handler function.
Thanks. So, a handler function that routes to multiple endpoints?
No, you have to use RunPod API routes like /run, /runsync etc, you can't add custom ones
Got it.