Volko

PostsComments

RRunPod

•Created by Volko on 4/17/2024 in #⚡｜serverless

Why is my endpoint running ? I don't have any questions and the time idle is set to 1 sec

3 replies

RRunPod

•Created by Volko on 4/17/2024 in #⛅｜pods

is AWQ faster than GGUF ?

In which order is the fastest inference speed between AWQ, GGUF, GPTQ, QAT, EXL2 ?

10 replies

RRunPod

•Created by Volko on 4/11/2024 in #⛅｜pods

Do 2 GPUs will fine tune 2 times faster than 1 GPU on axolotl ?

Do 2 GPUs will fine tune 2 times faster than 1 GPU on axolotl ?

23 replies

RRunPod

•Created by Volko on 4/10/2024 in #⛅｜pods

No module named 'axolotl.cli

3 replies

RRunPod

•Created by Volko on 4/10/2024 in #⛅｜pods

Download Mixtral from HuggingFace

15 replies