smoke
Explore posts from serversRRunPod
•Created by smoke on 6/28/2024 in #⚡｜serverless
Kohya-ss on serverless
Awesome thank you!
5 replies
RRunPod
•Created by smoke on 6/28/2024 in #⚡｜serverless
Kohya-ss on serverless
Anyone that could help me out with this? I was thinking of creating it myself and basically running the ‘train command’ (for Kohya) inside the RunPod serverless handler function but how would queueing work? Or is that all handled by RunPod? I don’t think Kohya supports multiple training jobs or something
5 replies
RRunPod
•Created by Jidovenok on 2/24/2024 in #⚡｜serverless
Webhook problem
I was wondering if you still experience issues with webhooks, since I am also planning on implementing those
18 replies
RRunPod
•Created by salgótarján kapitány on 3/6/2024 in #⚡｜serverless
Postman returns either 401 Unauthorized, or when the request can be sent it returns as Failed, error
That means most likely that you're not using an API key at all, make sure the correct header is set as:
Bearer [API_KEY_HERE]20 replies
RRunPod
•Created by Jidovenok on 2/24/2024 in #⚡｜serverless
Webhook problem
I also want to implement webhooks that my app will depend on, but it looks like there are still some issues with them.. hope that these issues can get solved soon before I also implement them in my app for production.
18 replies
RRunPod
•Created by smoke on 3/1/2024 in #⚡｜serverless
Docker image cache
Hmm yeah exactly. Is there some calculator of how much it would cost me? Since it is 40% cheaper but I think it will still be a lot every month, which is a big thing for me.
123 replies
RRunPod
•Created by smoke on 3/1/2024 in #⚡｜serverless
Docker image cache
But the throttling stuff ruins my benchmarks haha, doesn't seem that reliable if I want to use it in production, if they can be throttled without doing anything
123 replies
RRunPod
•Created by smoke on 3/1/2024 in #⚡｜serverless
Docker image cache
For the GPU tier, I'm not sure. I was running each GPU tier as a benchmark to see how long each GPU would take and how much it would cost.
123 replies
RRunPod
•Created by smoke on 3/1/2024 in #⚡｜serverless
Docker image cache
Yeah I see. I was also thinking of active workers but I think that will be a very high monthly bill haha, I don't think I am able to afford that just yet
123 replies
RRunPod
•Created by smoke on 3/1/2024 in #⚡｜serverless
Docker image cache
But my delay time was not that high before
123 replies
RRunPod
•Created by smoke on 3/1/2024 in #⚡｜serverless
Docker image cache
The execution time is normal, I measured that before aswell
123 replies
RRunPod
•Created by smoke on 3/1/2024 in #⚡｜serverless
Docker image cache
Even though I sent the request once it was 'Ready'
123 replies
RRunPod
•Created by smoke on 3/1/2024 in #⚡｜serverless
Docker image cache
I see but my delay time is still quite high..
123 replies
RRunPod
•Created by smoke on 3/1/2024 in #⚡｜serverless
Docker image cache
And it sounds like I am just 'unlucky' because my workers were apparently throttled.
123 replies
RRunPod
•Created by smoke on 3/1/2024 in #⚡｜serverless
Docker image cache
I get what you mean but I don't really understand. Because that results into a higher credit consumption for me :/
123 replies
RRunPod
•Created by smoke on 3/1/2024 in #⚡｜serverless
Docker image cache
Hmm I am not quite sure. I don't think any of my workers were throttled, since I just re-created the endpoint as new basically
123 replies
RRunPod
•Created by smoke on 3/1/2024 in #⚡｜serverless
Docker image cache
(This is a different GPU though but still took quite long, the delay time)
123 replies
