Hashset

PostsComments

RRunPod

•Created by Hashset on 4/24/2024 in #⛅｜pods

Why can't I create a pod? The 'deploy' button is not clickable:

8 replies

RRunPod

•Created by Hashset on 3/6/2024 in #⚡｜serverless

Text-generation-inference on serverless endpoints

Hi, I don't have much experience neither with llms nor with python, so I always just use this image 'ghcr.io/huggingface/text-generation-inference:latest' and run my models on Pods. Now, I wanna try serverless endpoints, but I don't know how to launch text-generation-inference on serverless endpoints, can someone give some tips or maybe there are some docs which could help me.

13 replies