Serverless Docker tutorial or sample
Hi, where can I get a dockerfile deployment tutorial?
I'm interested of deploying a custom docker image on a serverless
1 Reply
Developing a container image for RunPod isn't that much different. You can follow Docker tutorials: https://docs.docker.com/get-started/docker-concepts/building-images/writing-a-dockerfile/
Then read through https://docs.runpod.io/serverless/overview and see how endpoints, workers and handlers work.
In short: Make sure to use RunPod SDK and have a handler function as an entry point into your Python code.
You can also get inspired by already existing templates. Here are the official ones from the RunPod: https://github.com/runpod-workers
Docker Documentation
Writing a Dockerfile
This concept page will teach you how to create image using Dockerfile.
Overview | RunPod Documentation
Scale machine learning workloads with RunPod Serverless, offering flexible GPU computing for AI inference, training, and general compute, with pay-per-second pricing and fast deployment options for custom endpoints and handler functions.
GitHub
RunPod | Endpoints | Workers
Offical collection of worker repositories for serverless endpoints on RunPod. - RunPod | Endpoints | Workers