Using Bazzite for AI LLM development. Need a package from nvidia repo
Hey all, long time fedora user and looking to use Bazzite for LLM model development. I need a package from a repo (https://developer.download.nvidia.com/compute/cuda/repos/fedora39/x86_64/cuda-fedora39.repo) but not sure how to do this as I new to ostree. I added the repo to /etc/yum.repos.d and then tried the following:
$ sudo dnf install cuda-toolkit-12-4
The output I get is:
...
rpm-md repo 'updates-archive' (cached); generated: 2024-04-16T02:49:58Z solvables: 42008
Resolving dependencies... done
Installing 81 packages:
copy-jdk-configs-4.1-3.fc39.noarch (fedora)
....
and finally the error of
....
Resolving dependencies... done
Checking out packages... done
error: Checkout cuda-cudart-12-4-12.4.127-1.x86_64: opendir(local): No such file or directory
....
Not sure what I am missing here and could use some help.
4 Replies
Try distrobox for this
distrobox create --name llm --image ghcr.io/ublue-os/fedora-distrobox:40 --nvidia
then you can install whatever you need in thereok, I see this bug report now in coreos that may be related? https://github.com/coreos/rpm-ostree/issues/4903
GitHub
Fails to install cuda with error: opendir(local): No such file or ...
Describe the bug Unable to install cuda: rpm-ostree install cuda Checking out tree 84c4912... done Enabled rpm-md repositories: rpmfusion-free-updates-testing copr:copr.fedorainfracloud.org:ublue-o...
This solved my issue. Thank you
$ sudo dnf install cuda-toolkit-12-4You should use
rpm-ostree install instead of dnf install due to the atomic version of bazzite vs normal fedora...