Trouble with Pod HTTP Service Port
First time user of runpod.io.
Went through the steps of creating a Pod, used TheBloke Local LLMs One-Click UI
When I click on "Connect" I am not able to connect to the HTTP Service Port. It reads "Not Ready".
How do I solve this issue? Thanks!
6 Replies
I think the template is unmaintaned
Try other templates or ui's
What TheBloke Local LLMs would be supported? Is their a list somewhere?
None, he doesn't maintain it anymore so they are all broken
You can try this one instead
OK, I will give this Template a try.
Most of the videos / tutorials i've watched have shown loading a model through the Interface.
Is their any good beginner tutorial you would recommend for loading models / parameters using the recommended template?
Thanks,
You can load the model in the interface, it also uses oobabooga text generation webui, same as TheBloke template