Jordy Comments - Answer Overflow

Got a response back, they fixed it! See behaviour on reproduction: https://chat.jordyvandenaardweg.nl/ , the response now comes streaming in again. Also enabled Cloudflare Proxy on my production app, and all works again

53 replies

CDCloudflare Developers

•Created by someguy on 10/15/2023 in #general-help

Next.js/Vercel AI/Streaming Issue

I'll keep you guys updated on the support ticket

53 replies

CDCloudflare Developers

•Created by someguy on 10/15/2023 in #general-help

Next.js/Vercel AI/Streaming Issue

Yeah same, current work around is disabling Cloudflare Proxy completely. Also tried to disable almost everything using Page Rules, but that did not work. The only way to get it working is the off switch in the DNS settings for Cloudflare Proxy

53 replies

CDCloudflare Developers

•Created by someguy on 10/15/2023 in #general-help

Next.js/Vercel AI/Streaming Issue

I've created a support ticket with the above reproduction info

53 replies

CDCloudflare Developers

•Created by someguy on 10/15/2023 in #general-help

Next.js/Vercel AI/Streaming Issue

Messages I could find with the same issue: https://github.com/vercel/ai/issues/633 https://community.cloudflare.com/t/buffering-of-responses-did-not-used-to-be-a-problem-now-is/567306 https://community.cloudflare.com/t/streaming-edge-function-hosted-in-vercel-is-buffered-by-cloudflare-proxy/567635 https://github.com/vercel/ai/issues/239#issuecomment-1756185750 https://twitter.com/baptisteArno/status/1710282829483888786 https://twitter.com/thetrungvu/status/1712861296549409017

53 replies

CDCloudflare Developers

•Created by someguy on 10/15/2023 in #general-help

Next.js/Vercel AI/Streaming Issue

Just to clarify: I had streaming working on Vercel behind Cloudflare Proxy for months. But stopped working recently. According to messages I can find online from others with the same issue, it stopped working about 2 weeks ago.

53 replies

CDCloudflare Developers

•Created by someguy on 10/15/2023 in #general-help

Next.js/Vercel AI/Streaming Issue

This is the API route that handles the incoming OpenAI stream: https://github.com/jvandenaardweg/nextjs-chat-cloudflare/blob/main/app/api/chat/route.ts

53 replies

CDCloudflare Developers

•Created by someguy on 10/15/2023 in #general-help

Next.js/Vercel AI/Streaming Issue

The code is here, it used a Vercel AI Chatbot template, where I only removed the Auth/Github login and updated all the depedencies to their latest version: https://github.com/jvandenaardweg/nextjs-chat-cloudflare

53 replies

CDCloudflare Developers

•Created by someguy on 10/15/2023 in #general-help

Next.js/Vercel AI/Streaming Issue

Please do not share these URLs, as i'm using a OpenAI key and each requests will add to my usage there. But feel free to use it for debugging.

53 replies

CDCloudflare Developers

•Created by someguy on 10/15/2023 in #general-help

Next.js/Vercel AI/Streaming Issue

@ack I have made a temporary reproduction here: Cloudflare Proxy on: https://chat.jordyvandenaardweg.nl/ Cloudflare Proxy off: https://chat-proxy-off.jordyvandenaardweg.nl/ Not behind Cloudflare: https://nextjs-chat-cloudflare.vercel.app/ All URL's point to the same deployment. Try it out with the prompt: what is ai? That prompt gives a reasonable response length you can use to debug it You'll notice the one behind the proxy is not streaming the responses, token by token, but just shows the response when it's done. So that takes a few seconds. The one's NOT behind Cloudflare Proxy shows that streaming DOES work.

53 replies

CDCloudflare Developers

•Created by someguy on 10/15/2023 in #general-help

Next.js/Vercel AI/Streaming Issue

I have the same issue when using a Vercel CNAME within my Cloudflare DNS settings. So we can probably rule that out. My project is also on a subdomain, like app.somewebsite.com

53 replies

CDCloudflare Developers

•Created by someguy on 10/15/2023 in #general-help

Next.js/Vercel AI/Streaming Issue

Just here to say I have the exact same issue. Issue goes away when I disable the Cloudflare Proxy within Cloudflare. Any progress @ack ?

53 replies

DTDrizzle Team

•Created by dandyDandelion31156 on 6/27/2023 in #help

Support for unsigned integers

- Compatibility with current databases (that want to use Drizzle). Introspecting and then pushing changes results in Integer columns not being unsigned anymore - Just having double the amount of integers to store. - No need to support negative values on a Int column if you never going to store that anyway. - Because it’s one of the data types available in a database. Just to name a few I can think of ✌️ Would love to see out of the box support for it in Drizzle

13 replies

Gaming

Programming