Ruslan Piloian
Ruslan Piloian
PostsComments
RRunPod
Created by Ruslan Piloian on 10/8/2024 in #⚡｜serverless
Microsoft Florence-2 model in serverless container doesn't work
How to solve this problem?
13 replies
RRunPod
Created by Ruslan Piloian on 10/8/2024 in #⚡｜serverless
Microsoft Florence-2 model in serverless container doesn't work
No description
13 replies
RRunPod
Created by Ruslan Piloian on 10/8/2024 in #⚡｜serverless
Microsoft Florence-2 model in serverless container doesn't work
It didn't help, i guess because error raised in transformers.py in core of ComfyUI, but I'm sure that accelerator is installed in all possible environments. And another interesting thing is if i deploy a Pod (not serverless) using the same network volume as in serverless - Florence 2 model would works without any problems
13 replies
RRunPod
Created by Ruslan Piloian on 10/8/2024 in #⚡｜serverless
Microsoft Florence-2 model in serverless container doesn't work
accelerate lib imported in transformers.py in ComfyUi core
13 replies
RRunPod
Created by Ruslan Piloian on 10/8/2024 in #⚡｜serverless
Microsoft Florence-2 model in serverless container doesn't work
I added accelerate to requirements.txt, rebuild image and create endpoint and got the same result: { "delayTime": 5722, "error": "Traceback (most recent call last):\n File "/rp_handler.py", line 317, in handler\n raise RuntimeError(f'{node_type}: {exception_message}')\nRuntimeError: DownloadAndLoadFlorence2Model: Using low_cpu_mem_usage=True or a device_map requires Accelerate: pip install accelerate\n", "executionTime": 34016, "id": "df70ffee-8bf7-4304-9cdd-f6ef9349139c-u1", "status": "FAILED", "workerId": "7l3v5ol024c0kb" }
13 replies
RRunPod
Created by Ruslan Piloian on 6/10/2024 in #⚡｜serverless
Requests remain in status "IN QUEUE" and nothing happens
Yeah!! Now it works! Thank you so much!
41 replies
RRunPod
Created by Ruslan Piloian on 6/10/2024 in #⚡｜serverless
Requests remain in status "IN QUEUE" and nothing happens
No description
41 replies
RRunPod
Created by Ruslan Piloian on 6/10/2024 in #⚡｜serverless
Requests remain in status "IN QUEUE" and nothing happens
No, seems like problem with handler, i can't find in logs message that handler is started, but in shell script i wrote echo " running handler"
41 replies
RRunPod
Created by Ruslan Piloian on 6/10/2024 in #⚡｜serverless
Requests remain in status "IN QUEUE" and nothing happens
No description
41 replies
RRunPod
Created by Ruslan Piloian on 6/10/2024 in #⚡｜serverless
Requests remain in status "IN QUEUE" and nothing happens
thank you so much!
41 replies
RRunPod
Created by Ruslan Piloian on 6/10/2024 in #⚡｜serverless
Requests remain in status "IN QUEUE" and nothing happens
I'll check the launch of the handler
41 replies
RRunPod
Created by Ruslan Piloian on 6/10/2024 in #⚡｜serverless
Requests remain in status "IN QUEUE" and nothing happens
Oh, looks like i got it
41 replies
RRunPod
Created by Ruslan Piloian on 6/10/2024 in #⚡｜serverless
Requests remain in status "IN QUEUE" and nothing happens
the first attempts worked, but after a while they not
41 replies
RRunPod
Created by Ruslan Piloian on 6/10/2024 in #⚡｜serverless
Requests remain in status "IN QUEUE" and nothing happens
i just little bit modified this instructions for my purposes https://github.com/blib-la/runpod-worker-comfy
41 replies
RRunPod
Created by Ruslan Piloian on 6/10/2024 in #⚡｜serverless
Requests remain in status "IN QUEUE" and nothing happens
41 replies
RRunPod
Created by Ruslan Piloian on 6/10/2024 in #⚡｜serverless
Requests remain in status "IN QUEUE" and nothing happens
Please, take a look at worker logs
41 replies