flash-singh Comments - Answer Overflow

cold start times shouldnt be impacted by any registery since workers arent idle until fully initialized, it will impact your releases and cause rolling releases to be slow

2 replies

RRunPod

•Created by José Urbina on 1/15/2025 in #⚡｜serverless

using compression encoding for serverless requests

all endpoints use https so data is already compressed during transit, if you compress input then its upto you to decode in your worker, dont compress the json payload, it will throw errors

3 replies

RRunPod

•Created by jim on 1/15/2025 in #⚡｜serverless

Serverless H200?

its already in the works, i would say in 1-2 weeks

3 replies

RRunPod

•Created by Milad on 1/14/2025 in #⚡｜serverless

Do Webhook Request Responses have a retry mechanism?

yes, waits 5s for retry, then 15s for last retry

4 replies

RRunPod

•Created by marcdemers on 12/9/2024 in #⛅｜pods

Network Volumes on CPU pods

we have already released the new cpu pod deployments, its all happening in the background, until we move all the workload to use the new architecture, we wont enable network volumes, our target was end of this month, it might slip if there are users still using the old way and we have to ping them to move over, from development everything is ready and all is left is getting users to move and create new pods

7 replies

RRunPod

•Created by testymctestface on 12/27/2024 in #⚡｜serverless

Running worker automatically once docker image has been pulled

we already have this planned its labeled as "active flashboot" which will be charged, it will likely be closed beta for many months

51 replies

RRunPod

•Created by xeith_ on 1/8/2025 in #⚡｜serverless

Linking runpod-volume subfolder doesn't work

yes that will be slower, local disk is much faster

7 replies

RRunPod

•Created by xeith_ on 1/8/2025 in #⚡｜serverless

Linking runpod-volume subfolder doesn't work

we can plan to support this through config, symlinks have limitation maybe this is one of them with network storage

7 replies

RRunPod

•Created by testymctestface on 12/27/2024 in #⚡｜serverless

Running worker automatically once docker image has been pulled

yes thats about right, we can't freeze worker for flashboot if capacity is needed for an active workload

51 replies

RRunPod

•Created by orelb on 1/5/2025 in #⚡｜serverless

When a worker is idle, do I pay for it?

from serverless, when the worker status is running, you get charged, that mainly covers cold-start, your code and modal loading onto container/vram, your actual run, and your idle timeout setting

9 replies

RRunPod

•Created by orelb on 1/5/2025 in #⚡｜serverless

When a worker is idle, do I pay for it?

not sure what you mean, can you elaborate

9 replies

RRunPod

•Created by PhysSci on 12/16/2024 in #⛅｜pods

50/50 success with running a standart vllm template

@yhlong00000 are you able to check? see if we log it also in pod logs when they oom

9 replies

RRunPod