ArtyomKosakyan
RRunPod
•Created by ArtyomKosakyan on 7/1/2024 in #⚡｜serverless
Connection timeout to host https://api.runpod.ai/v2
Whenever I'm sending a lot of async requests (approximately 100), my worker getting timeout exceptions (see in the attached log file). How can we fix this issue ?
28 replies
RRunPod
•Created by ArtyomKosakyan on 5/24/2024 in #⚡｜serverless
Lora modules with basic vLLM serverless
Is it possible to use lora modules with default vLLM endpoint ? If not, how is it possible to do it quickly ?
3 replies