tom
BBlueBuild
•Created by tom on 12/10/2024 in #questions
Recipe.yml not refreshing after upgrade to bluebuild 1.8
10 replies
BBlueBuild
•Created by tom on 11/29/2024 in #questions
Ollama tips?
There are several ways to install ollama for local LLM use. Here is my experience so far:
1) Using brew
Pros: Brew module keeps packages up to date, and since ollama gets updated quite frequently it makes using it a breeze
Cons:
- need to set up systemd services manually
- for some reason it runs SIGNIFICANTLY slower on my device compared to other methods
2) Using alpaca flatpak as recommended by bluefin docs https://docs.projectbluefin.io/ai
Pros:
- easy install
flatpak install flathub com.jeffser.Alpaca
- Much faster than brew package!
- also maintains ollama version to
Cons:
- Can only interact with the models from their simplistic (but powerful) GUI, not possible through CLI
- This is not desirable for my use cases!
3) Using official install instructions: curl -fsSL https://ollama.com/install.sh | sh
Pros:
- Official method which supposedly also sets up systemd services
- Enables CLI use
Cons:
- Install does not work on Fedora Atomic running from CLI
Question HERE! Any thoughts on how to install ollama through this method? Perhaps from the Bluebuild side?4) Inside a docker container: Pros: N/A Cons: Extremely clunky to set up and maintain... Any thoughts on how to make #3 work? How are other users using LLMs locally? Thanks
20 replies
BBlueBuild
•Created by tom on 11/19/2024 in #questions
Build failing after upgrade to f41?
Hi all,
Since upgrading to f41 I get a failure to build at the rpm module. Error logs are usually really informative but infortunately not in this case..
Full log attached, full recipe here: https://github.com/mecattaf/zen/blob/main/recipes/recipe.yml
I know for a fact that it's the
rpm-ostree module that's not working but no idea why..11 replies
