Mark
TTCTheo's Typesafe Cult
•Created by devve2kcc on 4/3/2025 in #questions
Looking for AI models for my SAAS
I don’t think you need to fine tune anything tbh
15 replies
TTCTheo's Typesafe Cult
•Created by devve2kcc on 4/3/2025 in #questions
Looking for AI models for my SAAS
And then I would also try and check how e.g. Craft is doing it. I bet there are also Obsidian plugins to use models (I remember something called copilot).
15 replies
TTCTheo's Typesafe Cult
•Created by devve2kcc on 4/3/2025 in #questions
Looking for AI models for my SAAS
Then besides for the embedding, try some local 1B models and see if they are enough for you. And if people don’t want local models you can still offer e.g. Gemma via API.
After all, as you’re looking for a budget friendly version, this is probably your best bet as it’s … free 😄
15 replies
TTCTheo's Typesafe Cult
•Created by devve2kcc on 4/3/2025 in #questions
Looking for AI models for my SAAS
I don’t know your exact usecase but you can also check way smaller models (like R1 1.5B, llama 3.2 1B or as you linked Gemma, but you can try 1B). Could even include in your app as craft is doing it.
15 replies