Ruslan Piloian
RRunPod
•Created by Ruslan Piloian on 10/8/2024 in #⚡｜serverless
Microsoft Florence-2 model in serverless container doesn't work
I'm trying to use Florence 2 models in ComfyUI workflow with serverless container and it returns with error:
raise RuntimeError(f'{node_type}: {exception_message}')\nRuntimeError: DownloadAndLoadFlorence2Model: Using `low_cpu_mem_usage=True` or a `device_map` requires Accelerate: `pip install accelerate
Accelerate library already installed in venv in network storage where comfyui runs, also I installed it in docker container. Maybe anyone know how to solve this problem? Thanks in advance13 replies
RRunPod
•Created by Ruslan Piloian on 6/10/2024 in #⚡｜serverless
Requests remain in status "IN QUEUE" and nothing happens
I deployed custom docker image, run in serverless pod, all workers running without errors, in logs no errors too, what should i do to fix it?
41 replies