Sven
RRunPod
•Created by Sven on 1/30/2025 in #⚡｜serverless
Whitelist IP Addresses
A good tool would be a whitelist for IP Adresses, to have more control of inbound and outbound traffic.
As far as i can see, this feature is not present? (sth like a reverse proxy)
1 replies
RRunPod
•Created by Sven on 1/23/2025 in #⚡｜serverless
Kicked Worker
Is there a webhhok for the event that a worker is kicked? Or is there only the /health call, where we need to track the change of reqeusts since the last /health call (tracking the change of failed request)
5 replies
RRunPod
•Created by Sven on 10/2/2024 in #⚡｜serverless
Serverless vllm - lora
Is there a way to set the lora-modules (for the vllm docker container --lora-modules lora_adapter1=abc/efg) in the Template, or do i need to use the "standard" vllm container for it?
12 replies