Why serverless endpoints try to repull from container when doing inference?
We using ECR so there a 12 hour token expiration hard to deal with this because somethings no ones there to deal with refreshing the tokens. I find it surprising at the middle of the day endpoints would repull from the container then it will error obviously because the token already expired from the ECR hence the endpoint will not work anymore.
1 Reply
You can try to setup a cron job, call our graphql api to update registry credentials