scampbell70
the bloke and llm not working
I was using secured cloud. I had 10gig for the container and 1000gig for the volume. Could that have been part of the problem ? I would like to find a model I can use to create fantasy stories for a dnd world I’m building and want to flesh out. Build character profiles and back stories and generate 2000-3000 word stories based on this world. ChatGPT just didn’t do what I wanted so I’m looking for a good uncensored model. I was leaning toward falcon, mistral or Goliath120b. I can’t run it locally my pc just doesn’t have the power so I’m looking for a good online solution. I don’t mind paying for something that works. I got mixtral running today but it took almost 20 minutes to download and another 20 minutes or more to actually get the model to load. Even on the 80gig A100 it was so slow.
16 replies