DannyB
RRunPod
•Created by DannyB on 12/9/2024 in #⚡｜serverless
Structure of "job" JSON
it's ok I mainly wanted to know if that's indeed the case
thanks !
10 replies
RRunPod
•Created by DannyB on 12/9/2024 in #⚡｜serverless
Structure of "job" JSON
The thing is it is not model metadata, it is endpoint metadata.
I prefer to keep the 2 separate because my model is not deployed only on RunPod.
For example I am interested in passing to the endpoint the
source of where the request came from. This has nothing to do with the input validation of the actual model, but it changes how the handler will process the results — Choose a different CDN to upload the images, or aggregate metrics for me.10 replies
RRunPod
•Created by DannyB on 12/9/2024 in #⚡｜serverless
Structure of "job" JSON
Also worth to note that in local tests (
python rp_handler.py --test_input "$INPUT") adding extra fields work. It is only when deployed on RunPod endpoints that it seems to not work.10 replies
RRunPod
•Created by DannyB on 11/18/2024 in #⚡｜serverless
Unable to fetch docker images
I think it might be a bug in fast boot
10 replies
RRunPod
•Created by DannyB on 11/18/2024 in #⚡｜serverless
Unable to fetch docker images
This happening again now, and it can’t be because of restrictions on my account since I upgraded to Pro on DockerHub
10 replies
RRunPod
•Created by DannyB on 11/18/2024 in #⚡｜serverless
Unable to fetch docker images
2024-11-18T18:59:54Z error pulling image: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit
I got rate-limited because of all the worker throttling today :/10 replies
RRunPod
•Created by DannyB on 11/11/2024 in #⚡｜serverless
🚨 All 30 H100 workers are throttled
This is completely service breaking
4 replies
RRunPod
•Created by Keffisor21 on 10/3/2024 in #⚡｜serverless
Job timeout constantly (bug?)
Same issue with 1.7.3
23 replies
RRunPod
•Created by Mihály on 10/17/2024 in #⚡｜serverless
Worker keeps running after finishing job, burning money?
This also happened to me
5 replies
RRunPod
•Created by 1AndOnlyPika on 10/6/2024 in #⚡｜serverless
Reporting/blacklisting poorly performing workers
I am also experiencing this issue
24 replies