jim
RRunPod
•Created by jim on 2/19/2025 in #⚡｜serverless
Feb 20 - Serverless Issues Mega-Thread
Many people seem to be running into the following issue:
Workers are "running" but they're not working on any requests, and requests just sit there for 10m+ queued up without anything happening.
I think there is an issue with how the requests are getting assigned to the workers: there a number of idling workers, and there are a number of queued requests, and they both stay in that state for many minutes without any requests getting picked up by workers!
It's not my settings (eg. idle timeout, queue delay), because they've been constant and I haven't touched them at all. The issue has started to happen a few days ago.
55 replies
RRunPod
•Created by jim on 1/15/2025 in #⚡｜serverless
Serverless H200?
Hi when can we expect H200s to become available on serverless? My application could use the higher gpu memory
5 replies
RRunPod
•Created by jim on 12/12/2024 in #⚡｜serverless
Github integration
@haris Trying the new github integration. It says it gives "Read and write access to code" permissions. Why does the github integration require WRITE access to code?
9 replies