fireice
RRunPod
•Created by fireice on 11/14/2024 in #⚡｜serverless
How to Get the Progress of the Processing job in serverless ?
10 replies
RRunPod
•Created by fireice on 11/13/2024 in #⚡｜serverless
May I deploy template ComfyUI with Flux.1 dev one-click to serverless ?emplate
3 replies
RRunPod
•Created by fireice on 7/23/2024 in #⚡｜serverless
Why "CUDA out of memory" Today ? Same image to generate portrait, yesterday is ok , today in not.
"delayTime": 133684,
"error": "CUDA out of memory. Tried to allocate 1.50 GiB (GPU 0; 23.68 GiB total capacity; 18.84 GiB already allocated; 1.47 GiB free; 20.46 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF",
"executionTime": 45263,
"id": "ae1e4066-e2b7-43c1-8f37-3525bda03893-e1",
47 replies
RRunPod
•Created by fireice on 7/4/2024 in #⚡｜serverless
Can I select the GPU type based on the base model in python script ?
Some base models can run on a 24G GPU, while others require a 48G GPU.
9 replies
RRunPod
•Created by fireice on 6/13/2024 in #⚡｜serverless
Why no gpu in canada data center today?
25 replies
RRunPod
•Created by fireice on 6/5/2024 in #⚡｜serverless
runpodctl project dev , auto intall all dependices on dev venv, but runpodctl project deploy not
1 replies
RRunPod
•Created by fireice on 5/24/2024 in #⚡｜serverless
runpod js-sdk endpoint.run(inputPayload, timeout); timeout not work
when I set itmeout 360000, it always return error "timeout of 3000ms exceeded".
Even I open index.ts file in runpod-js-sdk,and set async run(timeout: number = 360000),
it sometimes works, sometimes it doesn't , return error "timeout of 3000ms exceeded".
I have install ramda in dependencies and @types/ramda in devDependencies.
(Before installation,it always return error "timeout of 3000ms exceeded" )
Python sdk never had this issue.
I have summit a issue on runpod js-sdk github repo.
6 replies
RRunPod
•Created by fireice on 5/22/2024 in #⚡｜serverless
timeout in javascript sdk not work
const runRequest = await endpoint.run(inputPayload, 600000);
An error occurred: AxiosError: timeout of 3000ms exceeded.
It seems that the timeout setting is not taking effect.
this is the run function in js sdk.
async run(
request: EndpointInputPayload,
timeout: number = 3000
): Promise<EndpointIncompleteOutput> {
return run(this.baseUrl, this.apiKey, this.endpointId, request, timeout)
}
16 replies
RRunPod
•Created by fireice on 5/7/2024 in #⚡｜serverless
When update handler.py using "runpodctl project deploy", Old worker does not auto update handler
4 replies