jax
RRunPod
•Created by jax on 11/20/2024 in #⚡｜serverless
Wish to split model files with docker, but it slows down significantly when using storage
I want to split model files with docker.
The model files are getting bloated, I tried to store the model files to storage but found that the inference time grows a lot, is there a way around this?
1 replies
RRunPod
•Created by jax on 10/20/2024 in #⚡｜serverless
job timed out after 1 retries
The problem has arisen by chance
4 replies
RRunPod
•Created by jax on 6/25/2024 in #⚡｜serverless
worker no execute
this worker "ir6fwdhb34ujm7" run but no execute, why????
19 replies
RRunPod
•Created by jax on 6/17/2024 in #⚡｜serverless
When servless is used, does the machine reboot if it is executed consecutively? Currently seeing iss
When servless is used, does the machine reboot if it is executed consecutively? Currently seeing issues with last execution affecting the next
116 replies
RRunPod
•Created by jax on 5/27/2024 in #⚡｜serverless
CUDA env error
error log:
2024-05-27T14:08:55.663521063Z RuntimeError: CUDA unknown error - this may be due to an incorrectly set up environment, e.g. changing env variable CUDA_VISIBLE_DEVICES after program start. Setting the available devices to be zero.
2024-05-27T14:08:55.902287850Z --- Starting Serverless Worker | Version 1.5.0 ---
I'm using comfyui , so I'll start the comfyui service before runpod.serverless.start, and the problem occurs occasionally, here is my code
echo "runpod-worker-comfy: Starting ComfyUI"
python /ComfyUI/main.py --output-directory /ComfyUI/tmp/outputs --input-directory /tmp/inputs --disable-auto-launch --disable-metadata &
echo "runpod-worker-comfy: Starting RunPod Handler"
python -u /ComfyUI/rp_handler.py
rp_handler.py inneholder runpod.serverless.start-koden, men det ser ut som om den starter comfyui for tidlig
9 replies
RRunPod
•Created by jax on 3/15/2024 in #⚡｜serverless
ComfyUI Connection refused error
When using comfyUI, the 127.0.0.1:8188 service is started, but when requesting the service, it keeps reporting the error urlopen error [Errno 111] Connection refused, but in other environments, the code works fine.
12 replies
RRunPod
•Created by jax on 2/27/2024 in #⚡｜serverless
out of memory error
out of memory error GPU
15 replies
RRunPod
•Created by jax on 12/25/2023 in #⚡｜serverless
serverless webhook support secret?
serverless webhook get status should set secret, otherwise anyone can change my db.
8 replies