MattArgentina
RRunPod
•Created by MattArgentina on 8/16/2024 in #⚡｜serverless
Ashley Kleynhan's Github repository for ComfyUI serverless no longer available
Does anyone have a copy?
4 replies
RRunPod
•Created by MattArgentina on 6/12/2024 in #⚡｜serverless
Very slow cold start times
Does anyone know why I would get such variable cold start times, anything from half a second to 90 seconds? I'm using the standard vLLM Serverless template
3 replies
RRunPod
•Created by MattArgentina on 6/11/2024 in #⚡｜serverless
vLLM Serverless error
When using the vLLM Serverless template I get the following error when trying to use the model - cognitivecomputations/dolphin-2.9-llama3-8b:
HFValidationError: Repo id must use alphanumeric chars or '-', '_', '.', '--' and '..' are forbidden, '-' and '.' cannot start or end the name
9 replies