R
RunPod•12mo ago
cognitivetech

how to get kernel 5.5.0?

trying to get newer kernel to fine-tune llm. thanks
4 Replies
ashleyk
ashleyk•12mo ago
There is no filter for kernel version unfortunately.
Madiator2011
Madiator2011•12mo ago
You can’t cause pods use host kernel
cognitivetech
cognitivetechOP•12mo ago
the answer is use earlier version of torch 
!pip install "unsloth[cu118-ampere] @ git+https://github.com/unslothai/unsloth.git"
!pip install torch==2.1.0+cu118 --extra-index-url https://download.pytorch.org/whl/cu118 --force-reinstall --no-cache-dir
!pip install torchvision torchaudio
!pip install --no-deps packaging ninja einops flash-attn xformers trl peft accelerate bitsandbytes 
!pip install "fsspec[http]>=2023.1.0,<=2024.2.0" --force-reinstall --no-cache-dir
!pip install "unsloth[cu118-ampere] @ git+https://github.com/unslothai/unsloth.git"
!pip install torch==2.1.0+cu118 --extra-index-url https://download.pytorch.org/whl/cu118 --force-reinstall --no-cache-dir
!pip install torchvision torchaudio
!pip install --no-deps packaging ninja einops flash-attn xformers trl peft accelerate bitsandbytes 
!pip install "fsspec[http]>=2023.1.0,<=2024.2.0" --force-reinstall --no-cache-dir
then no complaint about old kernel
pazanchick
pazanchick•2mo ago
HF accelerate issue regarding kernel https://github.com/huggingface/accelerate/issues/1929https://github.com/huggingface/accelerate/issues/1929 Hi, so if my usage requires specific torch version and i can't go to earlier one i'm out of luck? @Elder Papa Madiator

Did you find this page helpful?