Liringlas
RRunPod
•Created by Liringlas on 11/3/2024 in #⚡｜serverless
Issue with KoboldCPP - official template
Thanks a lot for your kind help, both of you!
24 replies
RRunPod
•Created by Liringlas on 11/3/2024 in #⚡｜serverless
Issue with KoboldCPP - official template
I might work in IT myself but in the end even for us, the issue is most of the time located between the chair and the keyboard 😄
24 replies
RRunPod
•Created by Liringlas on 11/3/2024 in #⚡｜serverless
Issue with KoboldCPP - official template
I think this might be where I did a mistake the first time 🙂
24 replies
RRunPod
•Created by Liringlas on 11/3/2024 in #⚡｜serverless
Issue with KoboldCPP - official template
Thanks a lot for your help, it did work in the last try where i used the same way of writing 🙂
24 replies
RRunPod
•Created by Liringlas on 11/3/2024 in #⚡｜serverless
Issue with KoboldCPP - official template
Thank you, I tried again following someone's instruction that I found on another discord. The KCCP_MODEL env variable is written a bit differently: https://huggingface.co/bartowski/Behemoth-123B-v1.1-GGUF/resolve/main/Behemoth-123B-v1.1-Q4_K_M/Behemoth-123B-v1.1-Q4_K_M-00001-of-00002.gguf?download=true,https://huggingface.co/bartowski/Behemoth-123B-v1.1-GGUF/resolve/main/Behemoth-123B-v1.1-Q4_K_M/Behemoth-123B-v1.1-Q4_K_M-00002-of-00002.gguf?download=true, with no space after comma and "?download=true" at the end of both links, which I did not use the first time. This time it worked 🙂 Not sure what was the issue the first time. Is it the formatting of the variable?
24 replies
RRunPod
•Created by Liringlas on 11/3/2024 in #⚡｜serverless
Issue with KoboldCPP - official template
https://discord.com/channels/912829806415085598/1118945694863065230/1300828220907851806 There was a similar post but with no reply except for the guide which I followed in the first place 🙂
24 replies