Deepseek R1 in a Raspberrypi 5

After the releasing of Deepseek r1 model the world of AI changed a bit for how well optimized it is for that reason many tech enthusiasts wanted to test it how it works on a small computer like raspberry pi. Additionally, it is really interesting to run a AI model like Deepseek r1 locally but due to the resource limitation it was always not that impressive to run on a pi but due to the optimization of deepseek r1 it runs quite well. here I tried it with 8b parameters because 14b one requires more that 10GB ram which is not present in my device I am using a Raspberry pi 8GB model if you are also interested the you can follow these steps 1. Make sure that your pi's system is up to date 2. Install ollama in your pi
bash
curl -fsSL https://ollama.com/install.sh | sh
bash
curl -fsSL https://ollama.com/install.sh | sh
3. run Deeepseek R1 with 8b parameters
ollama run deepseek-r1:8b
ollama run deepseek-r1:8b
now wait a few minutes (speed may vary according to your internet speed). Also make sure you have a good cooling system for your pi since it will push your pi to it's limit while having a conversation.
No description
No description
0 Replies
No replies yetBe the first to reply to this messageJoin

Did you find this page helpful?