Has ollama been removed from just in bazzite?

has it been removed or is it advised to install it and open-webui through other commands now?
24 Replies
wolfyreload
wolfyreload6mo ago
It looks like it was removed from Bazzite on 2 May, because the feature was supposed to get upstreamed by Bluefin. Let me check if it's include in the central ujust repo
No description
wolfyreload
wolfyreload6mo ago
I checked, it's not in ublue/config, but the recipe is in the bluefin repo https://raw.githubusercontent.com/ublue-os/bluefin/f699d82c880eb5719b0bcdc1db9117fb8b42e695/just/bluefin-tools.just if you want to try and install it. No idea if it will work as is, I don't have a powerful enough GPU to test it
muddyfeather
muddyfeatherOP6mo ago
cool, how's best to invoke that? is there a ujust command to run against a .just file?
wolfyreload
wolfyreload6mo ago
I saved that file to my home directory. And I could invoke it with just --justfile bluefin-tools.just ollama and it started installing.
muddyfeather
muddyfeatherOP6mo ago
awesome thanks, that's having a go now...
wolfyreload
wolfyreload6mo ago
If you get stuck with it, it might make sense asking on the bluefin channel.
Kyle Gospo
Kyle Gospo6mo ago
@j0rge are we still adding this to config?
muddyfeather
muddyfeatherOP6mo ago
perfect, that all worked, spun up the ollama and open-web ui containers by manually invoking those just commands, thanks very much
muddyfeather
muddyfeatherOP6mo ago
No description
muddyfeather
muddyfeatherOP6mo ago
also, using my 3060ti just fine!
wolfyreload
wolfyreload6mo ago
If it works perfectly, then there is probably no reason not to upsteam the just scripts to ublue/config. But that's just my 2 cents
muddyfeather
muddyfeatherOP6mo ago
yep, just had to follow the guide and run a brew install, but works as documented also, the invokeai worked perfectly too
j0rge
j0rge6mo ago
yeah both ollama and ollama-web can be moved, they're documented on the forums too
Kyle Gospo
Kyle Gospo6mo ago
Cool, I'll do that soon then
j0rge
j0rge6mo ago
we're probably due for another justfile cleanup/consolidation at some point?
muddyfeather
muddyfeatherOP6mo ago
just my two cents, but i'd love to also be able to run the -dx on bazzite, this is a multi-purpose desktop, i've got it running qemu, bluefin-cli, a bit of AI, but it's also a primary gaming rig. Top work fellas btw!
j0rge
j0rge6mo ago
@Kyle Gospo if you've got the cycles to do wire up the bluefin-cli/brew/host stuff lmk.
wolfyreload
wolfyreload6mo ago
looks like there is already a git issue logged for the consolidation https://github.com/ublue-os/config/issues/259
GitHub
Merge Bluefin and Bazzite ujust commands into this repo · Issue #25...
Both images have ujust commands which users of the other image could benefit from. Each command should be considered to be placed in this repo instead. For example, Bluefin has install-jetbrains-to...
muddyfeather
muddyfeatherOP6mo ago
not sure if here is the place to post that, but i've spotted the open-webui systemd unit file doesn't seem to set a persistent volume for /app/data/backend, meaning a container restart trashes the config in the container (meaning you have to sign-up again) and the ollama container sets it's persistent volume to $HOME/.ollama - to keep everything a bit consistent, should they be redirected to something like $HOME/.config/containers/<someplace> ?
j0rge
j0rge6mo ago
that'd be awesome to link up in the PR so we can land it fixed
muddyfeather
muddyfeatherOP6mo ago
actually, the way invokeai does it is quite elegant (Volume=invokeai.volume:/var/lib/invokeai) would be good to have "Volume=open-webui:/app/backend/data" in the ollama-web.container file generated by the just or even cleaner, have it named "open-webui.container" as they did a rename of that project recently that way persistent data will land in a sane place for the immutability : .local/share/containers/storage/volumes
Corey
Corey6mo ago
Sorry for replying to an old comment, but this helped me. Thank you. Just wondering how to set the environment variable before it starts to the below for the GFX override. This works on other distros, and I can add it to the ollama.service when using systemd. I'm not sure how to do that here. ``` export HSA_OVERRIDE_GFX_VERSION=10.3.0
wolfyreload
wolfyreload6mo ago
You should be able to just edit the service. Is it in the /etc/systemd folder? As that part of the file system is editable
Want results from more Discord servers?
Add your server