Hashset
Hashset
RRunPod
Created by Hashset on 4/24/2024 in #⛅|pods
Why can't I create a pod? The 'deploy' button is not clickable:
No description
8 replies
RRunPod
Created by Hashset on 3/6/2024 in #⚡|serverless
Text-generation-inference on serverless endpoints
Hi, I don't have much experience neither with llms nor with python, so I always just use this image 'ghcr.io/huggingface/text-generation-inference:latest' and run my models on Pods. Now, I wanna try serverless endpoints, but I don't know how to launch text-generation-inference on serverless endpoints, can someone give some tips or maybe there are some docs which could help me.
13 replies