c11network
CDCloudflare Developers
•Created by c11network on 1/6/2025 in #general-help
CF OT + OLLAMA API
Hey there,
We're trying to set up a local AI )OLLAMA) with CF Tunnels via docker and was wondering how one might go about securing OLLAMA API with an auth token?
There is a basic auth header but where should that go?
How we imagined things working is:
URL: ai.example.tld (We could have CF direct users to the path: v1/chat/completions)
Currently if someone hits ai.example.tld it says OLLAMA is running just by sending them to the local service: ollama:11434
Isn't that a security risk because there is no authentication?
Can we have it where you hit ai.example.tld, authenticate with CF Access application or maybe a Service auth token so that you can just hit ai.example.tld with the token to authenticate against?
Sorry for going all over the place...
5 replies