li.haoyu
li.haoyu
RRunPod
Created by li.haoyu on 6/13/2024 in #⚡|serverless
Backup plan for serverless network outage
Is this network outage affecting both serverless and on-demand pods? If these two services' outages don't occur simultaneously, can we use pods to mitigate the serverless network outage? What we need is a stable and reliable service.
15 replies
RRunPod
Created by li.haoyu on 3/6/2024 in #⚡|serverless
What is the caching mechanism of RUNPOD docker image?
our Docker image is stored in AWS ECR. We've noticed that every time we update the Docker template on the runpod, our ECR costs increase rapidly. We've identified that this is due to using 80 runpod instances, and these runpod instances concurrently pull the image. We would like to inquire about the image caching mechanism of runpod. If we let one runpod instance pull the Docker image completely first before starting other instances, will the other instances pull the image from your cache instead of AWS ECR?
10 replies