RunPod•9mo ago

how to get kernel 5.5.0?

trying to get newer kernel to fine-tune llm. thanks

3 Replies

ashleyk•9mo ago

There is no filter for kernel version unfortunately.

Madiator2011•9mo ago

You can’t cause pods use host kernel

cognitivetechOP•9mo ago

the answer is use earlier version of torch

!pip install "unsloth[cu118-ampere] @ git+https://github.com/unslothai/unsloth.git"
!pip install torch==2.1.0+cu118 --extra-index-url https://download.pytorch.org/whl/cu118 --force-reinstall --no-cache-dir
!pip install torchvision torchaudio
!pip install --no-deps packaging ninja einops flash-attn xformers trl peft accelerate bitsandbytes 
!pip install "fsspec[http]>=2023.1.0,<=2024.2.0" --force-reinstall --no-cache-dir

!pip install "unsloth[cu118-ampere] @ git+https://github.com/unslothai/unsloth.git"
!pip install torch==2.1.0+cu118 --extra-index-url https://download.pytorch.org/whl/cu118 --force-reinstall --no-cache-dir
!pip install torchvision torchaudio
!pip install --no-deps packaging ninja einops flash-attn xformers trl peft accelerate bitsandbytes 
!pip install "fsspec[http]>=2023.1.0,<=2024.2.0" --force-reinstall --no-cache-dir

then no complaint about old kernel

Gaming

Programming

how to get kernel 5.5.0?