Dify Block: streaming?
Hi, @Abdullah
I'm super happy with the new Dify block.
Any plans to make it work with response_mode: streaming instead of blocking?
My users are very impatient to read the great contents generated by Dify bots!
Thanks for creating the block!
11 Replies
Glad it’s coming to use for people
Currently I am waiting on baptiste to include support for streaming for self hosting users using PostgreSQL as their database
Currently streaming is only supported if you use PlanetScale as your database (which is a cloud database not a self host/opensource option)
Once PostgreSQL streaming support is available, I will be implementing the streaming part for the block as well 😄
We need this to be done, I'm actively working on it: https://github.com/baptisteArno/typebot.io/issues/1154
GitHub
Migrate chat API to a standalone server · Issue #1154 · baptisteArn...
Serverless environment is not suitable for Typebot's chat API as it can execute long running processes (AI stuff mostly). There is for example an issue with the WhatsApp webhook retrying the re...
Hi @Baptiste !
I've seen in GitHub you are working this week on this ticket. Super Happy!!
Being able to use Dify's RAG with Streaming in Typebot will be a great feature and I'm pretty sure that it will open many possibilities to Typebot users working with LLMs.
Any news on possible deployment time? (no stress, please!).
Actively working on it. It will be soon merged 🙏
@Baptiste I saw the GitHub was merged and closed but still not getting streaming in my Dify integration. Does it depend on @Abdullah ?
This is the relevant issue to keep track of: https://github.com/baptisteArno/typebot.io/issues/1281
It should be fairly simple to implement. I'll do it in the next couple of days 🙏
Sorry, I enjoyed so much Dify streaming in Typebot that I forgot to say thanks. So thank you very much! 👏
how can we get the streaming when accessing dify via a regular http block?
You can't!
I see. thats unfortunate, as we can only call Dify Agents using the streaming method. Thanks for answering