fireice
RRunPod
•Created by fireice on 7/4/2024 in #⚡｜serverless
Can I select the GPU type based on the base model in python script ?
Some base models can run on a 24G GPU, while others require a 48G GPU.
9 replies
RRunPod
•Created by fireice on 6/13/2024 in #⚡｜serverless
Why no gpu in canada data center today?
25 replies
RRunPod
•Created by fireice on 6/5/2024 in #⚡｜serverless
runpodctl project dev , auto intall all dependices on dev venv, but runpodctl project deploy not
1 replies
RRunPod
•Created by fireice on 5/24/2024 in #⚡｜serverless
runpod js-sdk endpoint.run(inputPayload, timeout); timeout not work
when I set itmeout 360000, it always return error "timeout of 3000ms exceeded".
Even I open index.ts file in runpod-js-sdk,and set async run(timeout: number = 360000),
it sometimes works, sometimes it doesn't , return error "timeout of 3000ms exceeded".
I have install ramda in dependencies and @types/ramda in devDependencies.
(Before installation,it always return error "timeout of 3000ms exceeded" )
Python sdk never had this issue.
I have summit a issue on runpod js-sdk github repo.
6 replies
RRunPod
•Created by fireice on 5/22/2024 in #⚡｜serverless
timeout in javascript sdk not work
const runRequest = await endpoint.run(inputPayload, 600000);
An error occurred: AxiosError: timeout of 3000ms exceeded.
It seems that the timeout setting is not taking effect.
this is the run function in js sdk.
async run(
request: EndpointInputPayload,
timeout: number = 3000
): Promise<EndpointIncompleteOutput> {
return run(this.baseUrl, this.apiKey, this.endpointId, request, timeout)
}
16 replies
RRunPod
•Created by fireice on 5/7/2024 in #⚡｜serverless
When update handler.py using "runpodctl project deploy", Old worker does not auto update handler
4 replies