Cloudflare Developers

CD

Cloudflare Developers

Welcome to the official Cloudflare Developers server. Here you can ask for help and stay updated with the latest news

Join

workers-help

pages-help

general-help

durable-objects

workers-discussions

pages-discussions

wrangler

coding-help

kv

🦀rust-on-workers

miniflare

stream

general-discussions

functions

zaraz

⚡instant-logs

email-routing

r2

pubsub-beta

analytics-engine

d1-database

queues

workers-for-platforms

workerd

web3

🤖turnstile

radar

web-research

logs-engine

cloudflare-go

terraform-provider-cloudflare

workers-ai

browser-rendering-api

analytics

next-on-pages

cloudflare-ai

build-caching-beta

hyperdrive

vectorize

ai-gateway

python-workers-beta

vitest-integration-beta

workers-observability

workflows-beta

Kathy
Kathy
View on Discord
11/25/2024

i can raise it to anthropic - it would

i can raise it to anthropic - it would also help if you can raise it from your end too. what is your account id by the way? so we can verify the issue...
LordQ
LordQ
View on Discord
9/24/2024

Do you know why I cannot create new

Do you know why I cannot create new gateway? I can create it with my dev account, but cannot create it with pr account. any ideas pls?
nicolasmnl
nicolasmnl
View on Discord
8/15/2024

Hi, guys! I'm trying to use Ai Gateway

Hi, guys! I'm trying to use Ai Gateway to cache requests for Gemini using Google Ai Studio but maybe i am doing something wrong :/ I am getting some errors regarding the system_instruction and generationConfig parameters The same request works by using the direct endpoint on google https://generativelanguage.googleapis.com/v1beta/models/...
Bash
Bash
View on Discord
8/5/2024

that's exactly right, but actually just

that's exactly right, but actually just trying it again, I can't replicate this. I've tried a bunch of different things and FINALLY narrowed it down. The problem is in the messages array, when passing an array to content instead of a string, it doesn't work. Here's my code as an example:...
scotto
scotto
View on Discord
7/27/2024

Azure costs analisis

Question regarding cost for azure open ai
Blandon
Blandon
View on Discord
7/18/2024

any idea?

any idea?
LordQ
LordQ
View on Discord
7/18/2024

May I ask if there is a gateway amount

May I ask if there is a gateway amount limit for each account? thank you
dave
dave
View on Discord
6/28/2024

When using AI Gateway with Vertex AI (

When using AI Gateway with Vertex AI (Gemini 1.5 Pro), it seems like streaming is broken. It buffers everything.
Kathy
Kathy
View on Discord
6/20/2024

Hey, trying to understand

Hey, trying to understand - you're using multiple azure openai models, so that's likely setting a different cache key each time - you'd like to get the same response each time though, because it's the same prompt, even though it's using different models is that correct?...
benank
benank
View on Discord
5/17/2024

I'm using Perplexity AI with the

I'm using Perplexity AI with the universal endpoint on AI Gateway. I have already set up groq and workers AI with the universal endpoint. However, when sending a request to perplexity through the universal endpoint, I am getting this error: 
At body: Input should be a dictionary or an instance of ApiChatCompletionsRequest
At body: Input should be a dictionary or an instance of ApiChatCompletionsRequest
...
Cameron Aaron
Cameron Aaron
View on Discord
4/23/2024

Anthropic on universal Gateway

``` import requests import json def test_anthropic_api():...
ben_makes_stuff
ben_makes_stuff
View on Discord
4/20/2024

Groq support & cases for Custom base URL

Any plans to support Groq? https://console.groq.com/docs/openai Groq's API is implemented the same as the OpenAI API spec, so I would think it'd be relatively straightforward to add them as a provider I want to use them as their cost per million tokens is very competitive, but I'll need a fallback provider (OpenAI or something else) if they fail, which is where I'm hoping AI gateway can come in 🙏...
Elektra
Elektra
View on Discord
4/2/2024

What headers come back?

I have one question. If I use Azure and I move to ai gateway will I still be able to receive the headers from Azure? I tend to use simple fecth and since it's a fetch I was wondering if the original headers are also provided. Thank you.
luna
luna
View on Discord
3/7/2024

any chance we'll see something like this

any chance we'll see something like this for the models cloudflare uses?
Pedro
Pedro
View on Discord
2/8/2024

Also on the roadmap is the possibility

Also on the roadmap is the possibility to create Gateways via API, so that should also help for your use case, no?
sergey
sergey
View on Discord
1/25/2024

Trying to use replicate via Ai Gateway

Trying to use replicate via Ai Gateway with universal endpoint, but can't get it work. Sending the example payload ``` { "version": "5fe0a3d7ac2852264a25279d1dfb798acbc4d49711d126646594e212cb821749",...
alex | zellic.io
alex | zellic.io
View on Discord
11/7/2023

I'm also interested in having the AI

I'm also interested in having the AI gateway store API keys and protect that with cloudflare zero trust. I'm currently doing that with a worker but I'm curious if there are plans to support secrets management natively