JohnDoe
RRunPod
•Created by JohnDoe on 2/12/2025 in #⚡｜serverless
Pulling from the wrong cache when multiple Dockerfiles in same GitHub repo
@flash-singh @PRB Whatever you have done it seems to have fixed the issue. Thank you
24 replies
RRunPod
•Created by JohnDoe on 2/12/2025 in #⚡｜serverless
Pulling from the wrong cache when multiple Dockerfiles in same GitHub repo
What I think is happening is that the newest build for a given repo is overwriting any existing images/this is being pulled through from the container registry. This is the case even if the Dockerfiles are different
24 replies
RRunPod
•Created by JohnDoe on 2/12/2025 in #⚡｜serverless
Pulling from the wrong cache when multiple Dockerfiles in same GitHub repo
What happens is I create the endpoint, the image builds and it seems to be building the correct image. However when it pulls the image it pulls another image from the same repo
24 replies
RRunPod
•Created by JohnDoe on 2/12/2025 in #⚡｜serverless
Pulling from the wrong cache when multiple Dockerfiles in same GitHub repo
One of the Build IDs is this e78ce3ae-7f8e-4333-92aa-d8c90d44a026
24 replies
RRunPod
•Created by JohnDoe on 2/12/2025 in #⚡｜serverless
Pulling from the wrong cache when multiple Dockerfiles in same GitHub repo
Hopefully just a fixable bug on Runpod's end
24 replies
RRunPod
•Created by JohnDoe on 2/12/2025 in #⚡｜serverless
Pulling from the wrong cache when multiple Dockerfiles in same GitHub repo
It's weird as when the endpoint first initiates it uses the correct image but after that it then pulls the other image
24 replies
RRunPod
•Created by JohnDoe on 2/12/2025 in #⚡｜serverless
Pulling from the wrong cache when multiple Dockerfiles in same GitHub repo
Yep specified the Dockerfile location and the main branch which seems to be correct
24 replies
RRunPod
•Created by JohnDoe on 2/12/2025 in #⚡｜serverless
Pulling from the wrong cache when multiple Dockerfiles in same GitHub repo
It looks like it's pulling another Dockerfile from that repo weirdly
24 replies
RRunPod
•Created by JohnDoe on 2/12/2025 in #⚡｜serverless
Pulling from the wrong cache when multiple Dockerfiles in same GitHub repo
I've reported to Runpod to see if there's a solution. My Dockerfiles are different for each tool but sit in the same repo
24 replies
RRunPod
•Created by JohnDoe on 2/12/2025 in #⚡｜serverless
Pulling from the wrong cache when multiple Dockerfiles in same GitHub repo
Have I misunderstood that you can have multiple Docker images of the same repo?
24 replies
RRunPod
•Created by JohnDoe on 2/12/2025 in #⚡｜serverless
Pulling from the wrong cache when multiple Dockerfiles in same GitHub repo
The cache of another Dockerfile within that repo
24 replies
RRunPod
•Created by JohnDoe on 10/3/2024 in #⚡｜serverless
Flux.1 Schnell Serverless Speeds
I currently have a diffusers only pipeline so that would work. However, how do I load it on start up? Do I load it before it hits the inference function? As it seems to .to('cuda') part is where I'm coming unstuck
4 replies
RRunPod
•Created by JohnDoe on 5/22/2024 in #⚡｜serverless
Mixed Delay Times
How does flashboot work?
11 replies
RRunPod
•Created by JohnDoe on 5/22/2024 in #⚡｜serverless
Mixed Delay Times
I don't think workers are an issue
11 replies
RRunPod
•Created by JohnDoe on 5/22/2024 in #⚡｜serverless
Mixed Delay Times
I'm guessing I can't control the cold start time?
11 replies