alternative to openai
If I have an alternative "open AI compatible" API endpoint can I configure mage to use that instead?
is all you need a completion endpoint?
function calling too i assume
1 Reply
Currently we actually don't use function calling yet (but we might want to in the future). So yeah, at the moment it is only a completion endpoint. But Mage is currently hardcoded for OpenAI, and I don't think we are ready to invest time into making it more agnostic, we don't really have the manpower to maintain more agnostic logic I am afraid.