Reason
RRunPod
•Created by Jack on 1/14/2024 in #⚡｜serverless
Do you get charged whilst your request is waiting on throttled workers?
You should only be getting charged if your workers are Active (green on the dashboard). If they're throttled then someone else is using the GPU and you shouldn't be getting charged.
7 replies
RRunPod
•Created by Reason on 1/10/2024 in #⚡｜serverless
Should I be getting billed during initialization?
Fair enough, from a user perspective my expected behaviour would be that if a new image is released on a tag, that an active worker finishe its job and goes back to initialising. It feels like right now there is just a step missing where the worker forgets to mark itself unavailable when it goes to pull a new image.
For the moment though I'm happy to work with specific release tags or sha hashes.
17 replies
RRunPod
•Created by Reason on 1/10/2024 in #⚡｜serverless
Worker log says remove container, remove network?
Thanks, good to know. I've spent so much time divining error messages I'm starting to see ghosts 😂
5 replies
RRunPod
•Created by Reason on 1/10/2024 in #⚡｜serverless
Should I be getting billed during initialization?
Thanks @flash-singh . Is this something you might be looking at changing? I imagine pulling from a common tag is going to be a common trap a lot of users fall into. Plus it makes it difficult to continuously deploy images without adding a step in the workflow to alter the template over the API for example.
17 replies
RRunPod
•Created by Reason on 1/10/2024 in #⚡｜serverless
Should I be getting billed during initialization?
Ah, so I should avoid having a
dev tag and pushing a new package while an endpoint has workers then?17 replies
RRunPod
•Created by Reason on 1/10/2024 in #⚡｜serverless
Should I be getting billed during initialization?
I've left the endpoint up with 0 max workers so if they want to take a look they can.
17 replies
RRunPod
•Created by Reason on 1/10/2024 in #⚡｜serverless
Should I be getting billed during initialization?
Yeah, unfortunately the mobile site crops the log and it jump around with every newline. The worker was marked as running in the UI and my account balance has definitely gone down.
The stage it was in there was extracting the docker image, I am certain it was that and not the model file due to the filesize.
17 replies