scampbell70
the bloke and llm not working
I am brand new to runpod. I just opened an account yesterday and put $25 on it. I used an 80g A100 and installed the bloke and then falcon 40b and mixtral. I have wasted $10 already trying to get this to work. Every time I try to load a model it takes 5+ minutes and fails or simply doesn’t even try to load. In the day and a half I been messing with this I only got mixtral to load once time and actually work. Please help me find a solution to this.
16 replies