Flashboot principles
Thinking of using RunPod
Issues with network volume access
Is there any way to set retries to 0
how can we configure scale type using runpod sdk
Tensor
``js
console.log('Starting initial processing with RunPod API...');
const initialProcessingResponse = await retryWithBackoff(async () => {
return await axios.post(
${process.env.RUNPOD_RUNSYNC_ENDPOINT}`,...Migrated from RO to IS
Depoying a model which is quantised with bitsandbytes(model config).
Anyone has a fork of ashleykza/runpod-worker-a1111:3.0.0?
API to remove worker from endpoint - please!
Batch processing of chats
Pod crashing due to 100 percent cpu usage
Service not ready yet. Retrying...
Asynchronous serverless endpoint failing with 400 Bad Request
What environment variables are available in a serverless worker?
Worker keeps running after finishing job, burning money?
Who to message to increase 80GB serverless endpoint to 3 GPUs/worker instead of 2?
RunPods Serverless - Testing Endpoint in Local with Docker and GPU