ohno
RRunPod
•Created by ohno on 8/31/2024 in #⚡|serverless
FastAPI RunPod serverless request format
Tried just that - found this one, which looks very similar to my use case https://github.com/dannysemi/runpod-serverless-proxy/tree/main
And I can't find anything they do that I don't. Starting to think I may be a little dense.
22 replies
RRunPod
•Created by ohno on 8/31/2024 in #⚡|serverless
FastAPI RunPod serverless request format
Exactly
22 replies
RRunPod
•Created by ohno on 8/31/2024 in #⚡|serverless
FastAPI RunPod serverless request format
Yeah I know for no Docker-in-Docker, I'm just launching the base image used to make the template just like RunPod would with any pre-built image.
Stuck scratching my head at the moment - I've been following the docs to the letter, and I am having the same problem with a normal Pod rather than serverless. Deploying the same image to a Pod and running the same request gives:
22 replies
RRunPod
•Created by ohno on 8/31/2024 in #⚡|serverless
FastAPI RunPod serverless request format
22 replies
RRunPod
•Created by ohno on 8/30/2024 in #⚡|serverless
Mounting network volume into serverless Docker container
Symlink worked - thanks for your help!
6 replies
RRunPod
•Created by ohno on 8/30/2024 in #⚡|serverless
Mounting network volume into serverless Docker container
That was my original thought, but turns out I need about 200 GO of data at a minimum, so downloading it everytime the worker boots really isn't ideal
6 replies