About Queueing
For the jobs that stay in the queue for whatever reason (all pods already running a job probably),
- do those jobs stay in the queue for a limited time or is it unlimited.
- Is there any limit for number of items in the queue or is it unlimited.
If there are limits what are they and can it be changed in any way?
Solution:Jump to solution
jobs stay in queue as defined by ttl policy, you can change it, by default its 24 hours
9 Replies
Queue size is limited to max workers * 100, not sure how long they remain in the queue for. Maybe @flash-singh can answer that.
Your jobs don't only get queued when all your workers are running, but also when they are all throttled.
Solution
jobs stay in queue as defined by ttl policy, you can change it, by default its 24 hours
Oh yes, thanks
How do we define the ttl policy again?
Sorry it slipped my mind
don't think its documented either
check for policy docs, @Justin Merrell didnt we add it?
checking
policy: { ttl: 1000 } its in ms
max allowed is a week
Looks like it is in the backlog, just escalated the priority to get it done tomorrow.
https://docs.runpod.io/serverless/endpoints/send-requests#--execution-policy
those descriptions are off, lets sync mon and make it better
@flash-singh let’s meet Monday to improve the quality of those strings. Want to make sure it’s as accurate as possible. I’ll put some time on your calendar to review.