Virt-io
Virt-io
PostsComments
BBlueBuild
Created by tom on 11/29/2024 in #questions
Ollama tips?
Here is my podman quadlet for ollama maybe this helps? llm.pod 
[Pod]
Network=bridge
NetworkAlias=llm_network
PodName=llm_pod

# ollama
PublishPort=127.0.0.1:11434:11434

# open-webui
PublishPort=127.0.0.1:3000:8080
[Pod]
Network=bridge
NetworkAlias=llm_network
PodName=llm_pod

# ollama
PublishPort=127.0.0.1:11434:11434

# open-webui
PublishPort=127.0.0.1:3000:8080
ollama-app.container 
[Unit]
Description=Ollama

[Container]
Label=app=ollama
ContainerName=ollama
Pod=llm.pod
Image=docker.io/ollama/ollama:latest
AddDevice=nvidia.com/gpu=all
SecurityLabelDisable=true
Environment=OLLAMA_FLASH_ATTENTION=1
Environment=OLLAMA_NOHISTORY=1
Volume=/home/username/Documents/Containers/Ollama:/root/.ollama:Z

[Install]
WantedBy=multi-user.target default.target
[Unit]
Description=Ollama

[Container]
Label=app=ollama
ContainerName=ollama
Pod=llm.pod
Image=docker.io/ollama/ollama:latest
AddDevice=nvidia.com/gpu=all
SecurityLabelDisable=true
Environment=OLLAMA_FLASH_ATTENTION=1
Environment=OLLAMA_NOHISTORY=1
Volume=/home/username/Documents/Containers/Ollama:/root/.ollama:Z

[Install]
WantedBy=multi-user.target default.target
openwebui-app.container 
[Unit]
Description=Open-WebUI

[Container]
Label=app=open-webui
ContainerName=open-webui
Pod=llm.pod
Image=ghcr.io/open-webui/open-webui:main
Environment=OLLAMA_BASE_URL=http://127.0.0.1:11434
Volume=/home/username/Documents/Containers/Open-webui:/app/backend/data:Z

[Install]
WantedBy=multi-user.target default.target
[Unit]
Description=Open-WebUI

[Container]
Label=app=open-webui
ContainerName=open-webui
Pod=llm.pod
Image=ghcr.io/open-webui/open-webui:main
Environment=OLLAMA_BASE_URL=http://127.0.0.1:11434
Volume=/home/username/Documents/Containers/Open-webui:/app/backend/data:Z

[Install]
WantedBy=multi-user.target default.target
20 replies
UBUniversal Blue
Created by Bazogueur tobal on 10/19/2024 in #🛟bazzite-help
concern flatpacks bazzite nvidia gnome
Not the same error, but try this: 
# uninstall all mesa flatpak versions
# select 'All of the above'

flatpak uninstall org.freedesktop.Platform.GL.default

# install an old version 22.08
# version 23.08 might work, but I haven't tried it

flatpak install runtime/org.freedesktop.Platform.GL.default/x86_64/22.08 runtime/org.freedesktop.Platform.GL.default/x86_64/22.08-extra
# uninstall all mesa flatpak versions
# select 'All of the above'

flatpak uninstall org.freedesktop.Platform.GL.default

# install an old version 22.08
# version 23.08 might work, but I haven't tried it

flatpak install runtime/org.freedesktop.Platform.GL.default/x86_64/22.08 runtime/org.freedesktop.Platform.GL.default/x86_64/22.08-extra
The new mesa flatpak is broken or something. I spent all day trying to fix my custom image, but this fixed it.
23 replies
BBlueBuild
Created by Virt-io on 10/19/2024 in #questions
rpm-ostree replace
I made the issue https://github.com/blue-build/modules/issues/350
8 replies
BBlueBuild
Created by Virt-io on 10/2/2024 in #questions
Custom Kernel with NVIDIA drivers
I have given up on the cachyos kernel, but I did move my recipe to use the akmods module. Works well. https://github.com/virt-10/blublu/blob/main/recipes/main/fsync-nvidia-open.yml
8 replies
BBlueBuild
Created by Virt-io on 10/2/2024 in #questions
Custom Kernel with NVIDIA drivers
I want to use fsync kernel, last time I check they didn't have fsync with nvidia preinstalled.
8 replies