deepblhe
deepblhe
RRunPod
Created by deepblhe on 11/7/2024 in #⚡|serverless
(Flux) Serverless inference crashes without logs.
Updating the SDK worked, thank you!
10 replies
RRunPod
Created by deepblhe on 11/7/2024 in #⚡|serverless
(Flux) Serverless inference crashes without logs.
Which is better than nothing but still not very informative
10 replies
RRunPod
Created by deepblhe on 11/7/2024 in #⚡|serverless
(Flux) Serverless inference crashes without logs.
Hey I just see worker exited with exit code 0
10 replies
RRunPod
Created by deepblhe on 11/7/2024 in #⚡|serverless
(Flux) Serverless inference crashes without logs.
Bumping it up to 1.7.4 which appers to be latest
10 replies
RRunPod
Created by deepblhe on 11/7/2024 in #⚡|serverless
(Flux) Serverless inference crashes without logs.
1.7.0
10 replies
RRunPod
Created by deepblhe on 11/7/2024 in #⚡|serverless
(Flux) Serverless inference crashes without logs.
You mean which version of the runpods SDK I have in the docker image?
10 replies
RRunPod
Created by deepblhe on 10/16/2024 in #⚡|serverless
RunPods Serverless - Testing Endpoint in Local with Docker and GPU
Have the test_input.json in your local folder and this will just start the endpoint, run the test and terminate
11 replies
RRunPod
Created by deepblhe on 10/16/2024 in #⚡|serverless
RunPods Serverless - Testing Endpoint in Local with Docker and GPU
docker run --gpus all -p 8080:8080 -v "$(pwd)/test_input.json:/test_input.json" ${IMAGE_REPO}
docker run --gpus all -p 8080:8080 -v "$(pwd)/test_input.json:/test_input.json" ${IMAGE_REPO}
11 replies
RRunPod
Created by deepblhe on 10/16/2024 in #⚡|serverless
RunPods Serverless - Testing Endpoint in Local with Docker and GPU
Hi all! I have a solution for this in case you are looking
11 replies
RRunPod
Created by deepblhe on 10/16/2024 in #⚡|serverless
RunPods Serverless - Testing Endpoint in Local with Docker and GPU
11 replies