danlas

PostsComments

RRunPod

•Created by danlas on 2/8/2024 in #⚡｜serverless

Api to Text Generation Web UI

Thanks man!

70 replies

RRunPod

•Created by danlas on 2/8/2024 in #⚡｜serverless

Api to Text Generation Web UI

As long as the api can specify context and chat history then I’ll be good!

70 replies

RRunPod

•Created by danlas on 2/8/2024 in #⚡｜serverless

Api to Text Generation Web UI

I’m trying to make a site like https://candy.ai and their model is really good, GPT4 is very censored and doesn’t work ,

70 replies

RRunPod

•Created by danlas on 2/8/2024 in #⚡｜serverless

Api to Text Generation Web UI

Saves me from having to run my own

70 replies

RRunPod

•Created by danlas on 2/8/2024 in #⚡｜serverless

Api to Text Generation Web UI

That looks like a good site maybe I can just use the api

70 replies

RRunPod

•Created by danlas on 2/8/2024 in #⚡｜serverless

Api to Text Generation Web UI

But I’ll take a look at the docs you sent tomorrow

70 replies

RRunPod

•Created by danlas on 2/8/2024 in #⚡｜serverless

Api to Text Generation Web UI

My main thing was like how can my current backend app hit this new LLM I’m hosting and pass in context/history. Currently using GPT4 and Langchain for it

70 replies

RRunPod

•Created by danlas on 2/8/2024 in #⚡｜serverless

Api to Text Generation Web UI

Yeah I was going toward the serverless to save on costs

70 replies

RRunPod

•Created by danlas on 2/8/2024 in #⚡｜serverless

Api to Text Generation Web UI

Awesome thanks

70 replies

RRunPod

•Created by danlas on 2/8/2024 in #⚡｜serverless

Api to Text Generation Web UI

Ok thanks! I’ll take a peep at it tomorrow. Maybe I gotta create my own api endpoint inside the pod then use my backend code to hit it (my guess)

70 replies

RRunPod

•Created by danlas on 2/8/2024 in #⚡｜serverless

Api to Text Generation Web UI

I never hosted a LLM before so this all new to me

70 replies

RRunPod

•Created by danlas on 2/8/2024 in #⚡｜serverless

Api to Text Generation Web UI

Is there a certain type of template I should use for runpod? @justin

70 replies

RRunPod

•Created by danlas on 2/8/2024 in #⚡｜serverless

Api to Text Generation Web UI

I have a model I want to use, on my phone right now but it’s TheBloke 2.5, I think the latest one. Right now I am using the web ui to load it up, and I created characters to use them with. My end goal is to just host the LLM and invoke it with chat history + a certain context (character)

70 replies