Marcus
RRunPod
•Created by Andy on 8/7/2024 in #⚡|serverless
Optimizing Docker Image Loading Times on RunPod Serverless – Persistent Storage Options?
Workers cache the image up-front in serverless so this should be a non-issue.
6 replies
Pod unreachable
This is normal if your request takes more than 100 seconds to complete. The proxy URLs use Cloudflare and the Cloudflare timeout is 100 seconds. So if you have requests that take more than 100 seconds to complete, you should change the port from HTTP to TCP.
3 replies
RRunPod
•Created by annasuhstuff on 8/5/2024 in #⚡|serverless
HF_TOKEN question
Don't know how someone like you becomes a community leader with such a bad attitude
26 replies
RRunPod
•Created by annasuhstuff on 8/5/2024 in #⚡|serverless
HF_TOKEN question
Your "cmon" attitude is highly unacceptable
26 replies
RRunPod
•Created by annasuhstuff on 8/5/2024 in #⚡|serverless
HF_TOKEN question
Well it doesn't work for them, does not matter that it works for you
26 replies
RRunPod
•Created by annasuhstuff on 8/5/2024 in #⚡|serverless
HF_TOKEN question
And you literally repeated my message.
26 replies
RRunPod
•Created by annasuhstuff on 8/5/2024 in #⚡|serverless
HF_TOKEN question
Well you're telling them to check their token when they already said the same token works fine for other things etc, which is not useful.
26 replies
RRunPod
•Created by annasuhstuff on 8/5/2024 in #⚡|serverless
HF_TOKEN question
He said it has, hence why I said to log a Github issue, not sure why you must always add messages to threads that add no value when someone has already answered the person.
26 replies
RRunPod
•Created by annasuhstuff on 8/5/2024 in #⚡|serverless
HF_TOKEN question
It has access to it, people run it with docker run -e HF_TOKEN=.... which is the same as @annasuhstuff was doing by adding it to the pod.
26 replies
RRunPod
•Created by annasuhstuff on 8/5/2024 in #⚡|serverless
HF_TOKEN question
I suggest logging a Github issue since its a huggingface image and not a RunPod one:
https://github.com/huggingface/text-generation-inference
26 replies