Sinlore Kain

PostsComments

RRunPod

•Created by Sinlore Kain on 2/8/2025 in #⛅｜pods

Kobold.cpp - Remote tunnel loads before the model, causing confusion (possible off-product issue)

Joined, ty.

16 replies

RRunPod

•Created by Sinlore Kain on 2/8/2025 in #⛅｜pods

Kobold.cpp - Remote tunnel loads before the model, causing confusion (possible off-product issue)

Knew it! Moving those to async, tho, is really good.

16 replies

RRunPod

•Created by Sinlore Kain on 2/8/2025 in #⛅｜pods

Kobold.cpp - Remote tunnel loads before the model, causing confusion (possible off-product issue)

Fixed, no longer reproducible, thank you.

16 replies

RRunPod

•Created by enfys on 10/28/2024 in #⛅｜pods

A40 availability

I assume that L40/L40s are not desirable? We sometimes have to resort to using those, though it's twice as expensive.

43 replies

RRunPod

•Created by enfys on 10/28/2024 in #⛅｜pods

A40 availability

7 am GMT is when I, personally, usually start On-Demand these cards, as it's worktime for us here. Our team finds these cards very cost-efficient. Depending on a scale of what you're doing, it might seem that we hoard them. But this stuff is FCFS, so if you really really really need these specific cards - you can use savings plans.

43 replies