Can u run fastapi gpu project on serverless runpod?
I have a fastapi project that was hosted on sagemaker. Now i plan to move it to runpod.
Can someone guide how to do it?
2 Replies
yes
oh, youre asking for a guide on how to do it
you can follow https://github.com/runpod-workers/worker-a1111/blob/main/Dockerfile
but in the start.sh (https://github.com/runpod-workers/worker-a1111/blob/main/src/start.sh#L6), instead of starting
/stable-diffusion-webui/webui.py , you run your fastapi command
you'll also neeed to change the Dockerfile to scrap all the a111 changes and replace with just the fastapi requirments.
under the hood, a111 is a fastapi server alreadyGitHub
worker-a1111/Dockerfile at main · runpod-workers/worker-a1111
Automatic1111 serverless worker. . Contribute to runpod-workers/worker-a1111 development by creating an account on GitHub.
GitHub
worker-a1111/src/start.sh at main · runpod-workers/worker-a1111
Automatic1111 serverless worker. . Contribute to runpod-workers/worker-a1111 development by creating an account on GitHub.