C
C#2w ago
Fabbernat

Problems with NVIDIA driver

Hi! Have you ever used a local generative language model? What is the best way to use gemma-2-2b-it or any language model locally? Is there a C# tool to do that easily or do I better stick to Python? I downloaded and installed Gemma-2-2b-it to my local computer (Asus VivoBook 17, 8GB ROM, intel code i3 processor) I followed this tutorial: https://youtu.be/7PbUaMdLGaA?si=uMpV_MSlM_8Ql7gs. I followed along the video tutorial, I copied testGemma.py in PyCharm and started the program, but it never gives an error, saying Found no NVIDIA driver on your system even though I have installed CUDA Toolkit 12.8 for WIN11, latest stable release. The program does not give me the answer. Any idea why? The pictures show the downloaded files and what I see in the IDE.
Aleksandar Haber PhD
YouTube
Install and Run Google's Gemma 2 (2B) small LLM in Python and Windo...
#gemma #google #machinelearning #ai #meta #llm #llama #llama31 #lamma3 #ai #machinelearning #largelanguagemodels It takes a significant amount of time and energy to create these free video tutorials. You can support my efforts in this way: - Buy me a Coffee: https://www.buymeacoffee.com/AleksandarHaber - PayPal: https://www.paypal.me/Aleksandar...
No description
No description
No description
6 Replies
canton7
canton72w ago
Which laptop model exactly? Most of the Asus VivoBook 17 variants seem to only have Intel graphics. While it seems to be possible to get one with an NVIDIA GPU, I wouldn't have expected that to be paired with an i3
canton7
canton72w ago
According to https://www.asus.com/uk/laptops/all-products?Spec=262000,264888, there's only 1 Vivobook 17 with 8GB RAM, and that comes with an i5, not an i3 (and has Intel graphics)
ASUS United Kingdom
All series|Laptops |ASUS United Kingdom
you can select Laptops which is most suitable for you according to the product features, specifications or price, and view detailed product information.Then also compare different products or add favorite item to your personal list in Laptops product list of ASUS "All series"
Lex Li
Lex Li2w ago
Alternatively, you can write your own wrapper over Ollama REST API (simplest) or switch to Semantic Kernel (more complex). All depends on your actual application to develop
Fabbernat
FabbernatOP2w ago
# About my pc
Device name DESKTOP-NLG43U7
Processor 11th Gen Intel(R) Core(TM) i3-1115G4 @ 3.00GHz 3.00 GHz
Installed RAM 8,00 GB (7,70 GB usable)
Device ID 3D02FD3D-DCD2-426A-8719-18867014E285
Product ID 00330-80000-00000-AA998
System type 64-bit operating system, x64-based processor
Pen and touch No pen or touch input is available for this display

Edition Windows 11 Pro
Version 24H2
Installed on ‎2025. ‎03. ‎23.
OS build 26100.3476
Experience Windows Feature Experience Pack 1000.26100.54.0
# About my pc
Device name DESKTOP-NLG43U7
Processor 11th Gen Intel(R) Core(TM) i3-1115G4 @ 3.00GHz 3.00 GHz
Installed RAM 8,00 GB (7,70 GB usable)
Device ID 3D02FD3D-DCD2-426A-8719-18867014E285
Product ID 00330-80000-00000-AA998
System type 64-bit operating system, x64-based processor
Pen and touch No pen or touch input is available for this display

Edition Windows 11 Pro
Version 24H2
Installed on ‎2025. ‎03. ‎23.
OS build 26100.3476
Experience Windows Feature Experience Pack 1000.26100.54.0
ú
No description
Fabbernat
FabbernatOP2w ago
I really need to test some language models So are these my only options? - use CPU and wait for hours for a single prompt - cloud GPU from Google Colab - purchase and install a dedicated NVIDIA GPU that supports CUDA - use optimized libraries like transformers and quantize models
canton7
canton72w ago
https://www.asus.com/laptops/for-home/vivobook/vivobook-17-x712-11th-gen-intel/techspec/ The X712EA has Intel graphics, not an NVIDIA card I doubt you'll be able to install a new GPU in that laptop, either So using a cloud GPU is probably your best bet I reckon?

Did you find this page helpful?