Fabbernat
Problems with NVIDIA driver
I really need to test some language models
So are these my only options?
- use CPU and wait for hours for a single prompt
- cloud GPU from Google Colab
- purchase and install a dedicated NVIDIA GPU that supports CUDA
- use optimized libraries like transformers and quantize models
9 replies