Jupyter Notebook is not showing the output of any code
I have my model but when I run the .safetensors and ask a question the cells do not respond to anything and I have already tried restarting it.
20 Replies
There isn't any useful information provided. This is not Jupyter, it's some application that you are running inside Jupyter, and you have not specified the name of the application, where you got it from etc etc. You need to provide details if you want assistance.
I'm running Mixtral 8x7b on the Notebook generated by Runpod with a NVIDIA H100, trying to run a Mixtral .safetensors using Hugging Face which returns the model response, but it doesn't respond to any cells. I use
transformers
. full code
i click this play button
looks like first cell might still be running. [*] means that cell is in que to be run. You know that cell finished running after it will be replaced by number.
eres español?
el "que" del corrector te delató
I do not speak spanish
okay no problem
I thought that * doesn't mean anything
thank you
H100s are useless on Runpod until they make it possible to run CUDA 11.8 on a host machine. 12.0-12.2 is incredibly buggy for me.
It is Jupyter.
What made you think it’s not?
And how can I execute Mixtral?
And train it
Using Runpod
Use A100
Do you know about MoEs? Idk about how many A100 I need
To run a 8 experts MoE
(Mixtral)
I read that I need 1 A100 for each expert
And other sources says otherwise
I never trained this particular LLM, so I can’t tell you.
Why not try yourself?
I have a limited budget and I don't want to spend it training it too much by testing one by one, so I try to be as efficient as possible.
So I'm looking into it, although I'll probably end up trying it myself.
Tysm
Jupyter is working fine, the application he is using is not, people can't just say "this doesn't work" without saying WHAT. We are not mind readers. Don't know why you are asking me such dumb shit, I thought you were smart.
I thought you were smart enough to know that it’s Jupyter and not to insult others.
Jupyter is Jupyter, he said his app was not producing output, clearly you are the dumbest person on the planet
Oh come on lets not start another fight