How do I install a model with kobold ai?
I am having trouble. It is stuck at this for awhile when I been using my pod. It downloaded 64 gb model without issues, but once it started loading model tensors it stopped at 330/664.
What can I do to fix this? I am lost. The loading bar is still occuring.
3 Replies
@Henky!! Hey buddy this is one of yours, unless this is our connectivity being terrible.
Okay, I just figured that I used up way too much memory lol
Downloaded an nsfw 8 gb model for Kobold AI and that seems to have gotten rid of the issue
I highly recommend transitioning to the KoboldCpp template. The original KoboldAI is very old. https://koboldai.org/runpodcpp
The default model I just link will be miles beyond whatever one you chose will be