marko.333
marko.333
Explore posts from servers
RRunPod
Created by marko.333 on 9/1/2024 in #⛅|pods
How do i deploy a Worker with a Pod?
I have deployed a worker with a Serverless deployment, now i expected to be able to deploy the exact same image to a Pod and be able to have an endpoint URL to make a similar Worker request, but i'm not having success? I am currently using the following as the initial entrypoint for handler.py...
runpod.serverless.start({"handler": handler})
runpod.serverless.start({"handler": handler})
Is there any doc that discusses how to get a Serverless Worker deployed to a Pod? thx.
16 replies
RRunPod
Created by marko.333 on 8/29/2024 in #⛅|pods
Should i able to launch a pod using nvidia/cuda docker images?
I am trying to start a pod using nvidia/cuda:12.6.0-cudnn-runtime-ubuntu24.04 (to get both cuda and cudnn). I'm not an a docker expert, but should that work? The pod appears to start, but the licensing message keeps looping in the logs, and i can't SSH into the pod? Any ideas? thx.
5 replies