Has ollama been removed from just in bazzite?
has it been removed or is it advised to install it and open-webui through other commands now?
29 Replies
It looks like it was removed from Bazzite on 2 May, because the feature was supposed to get upstreamed by Bluefin. Let me check if it's include in the central ujust repo
I checked, it's not in ublue/config, but the recipe is in the bluefin repo https://raw.githubusercontent.com/ublue-os/bluefin/f699d82c880eb5719b0bcdc1db9117fb8b42e695/just/bluefin-tools.just if you want to try and install it. No idea if it will work as is, I don't have a powerful enough GPU to test it
cool, how's best to invoke that? is there a ujust command to run against a .just file?
I saved that file to my home directory. And I could invoke it with
just --justfile bluefin-tools.just ollama and it started installing.awesome thanks, that's having a go now...
If you get stuck with it, it might make sense asking on the bluefin channel.
@j0rge are we still adding this to config?
perfect, that all worked, spun up the ollama and open-web ui containers by manually invoking those just commands, thanks very much
also, using my 3060ti just fine!
If it works perfectly, then there is probably no reason not to upsteam the just scripts to ublue/config. But that's just my 2 cents
yep, just had to follow the guide and run a brew install, but works as documented
also, the invokeai worked perfectly too
yeah both
ollama and ollama-web can be moved, they're documented on the forums tooCool, I'll do that soon then
we're probably due for another justfile cleanup/consolidation at some point?
just my two cents, but i'd love to also be able to run the -dx on bazzite, this is a multi-purpose desktop, i've got it running qemu, bluefin-cli, a bit of AI, but it's also a primary gaming rig. Top work fellas btw!
@Kyle Gospo if you've got the cycles to do wire up the bluefin-cli/brew/host stuff lmk.
looks like there is already a git issue logged for the consolidation https://github.com/ublue-os/config/issues/259
GitHub
Merge Bluefin and Bazzite ujust commands into this repo · Issue #25...
Both images have ujust commands which users of the other image could benefit from. Each command should be considered to be placed in this repo instead. For example, Bluefin has install-jetbrains-to...
not sure if here is the place to post that, but i've spotted the open-webui systemd unit file doesn't seem to set a persistent volume for /app/data/backend, meaning a container restart trashes the config in the container (meaning you have to sign-up again) and the ollama container sets it's persistent volume to $HOME/.ollama - to keep everything a bit consistent, should they be redirected to something like $HOME/.config/containers/<someplace> ?
GitHub
open-webui/docker-compose.yaml at main · open-webui/open-webui
User-friendly WebUI for LLMs (Formerly Ollama WebUI) - open-webui/open-webui
that'd be awesome to link up in the PR
so we can land it fixed
actually, the way invokeai does it is quite elegant (Volume=invokeai.volume:/var/lib/invokeai)
would be good to have "Volume=open-webui:/app/backend/data" in the ollama-web.container file generated by the just
or even cleaner, have it named "open-webui.container" as they did a rename of that project recently
that way persistent data will land in a sane place for the immutability : .local/share/containers/storage/volumes
Sorry for replying to an old comment, but this helped me. Thank you.
Just wondering how to set the environment variable before it starts to the below for the GFX override.
This works on other distros, and I can add it to the ollama.service when using systemd. I'm not sure how to do that here.
```
export HSA_OVERRIDE_GFX_VERSION=10.3.0
You should be able to just edit the service. Is it in the /etc/systemd folder? As that part of the file system is editable
hey i had a quick question, does ollama only work with nvidia gpus ? i cant seem to get my amd one working
no it works on everything
it seems to be using my cpu instead of my gpu, im checking the resources to see my usage when running deepseek's newest model
afaik your gpu is technically not supported (in linux) youll need the hsa override env var
Oh I see, thank you 🙏🏻