Discrepancy in Bot Responses: Missing Initial Characters When Transitioning from Dify to Typebot
I'm using the Dify block to call gpt-3.5-turbo in part of my conversation flow.
The attached images illustrate the problem. Basically, a few letters go missing somewhere in between Dify and Typebot. It seems to me that this only happens to the first couple of words.
At first I thought the llm was making a mistake, but after inspecting the messages in Dify, I noticed that they were actually correct.
Then I thought it could have something to do with the OpenAI moderation API, but after a few tests, I've ruled out that hypothesis.
Thanks in advance for any help. Cheers! š¤ š
Edit: I had to delete the screenshots from the original post and repost them below
13 Replies
Hmmm
Iāll need a way to reproduce it
do you have a clear procedure for me to follow to have that issue ?
Hey Baptiste, how are you? I could duplicate my Typebot flow, edit out the client specific content, export the json file and send you privately along with details from my Dify config. Would that help?
I had to delete the screenshots from the original post and repost them. Here they are
I should point out that this behavior is a bit erratic. It doesn't always happen, but it's pretty frequent
What's your Typebot instance version?
You can see it in the Settings & Members modal
Is it a Basic Assistant or Agent Assistant that you've plugged here?
Can you provide more examples if you stumble upon any other?
- Typebot Version: 2.23.0
- It's an Agent Assistant
- I've come across other examples, but they all contain client info that I can't post.
But now that you've mentioned the type of agent, I went and tested running the same flow with the basic assistant and it worked fine. Nice guess š
Ok but still I wonder why it fails to stream some part of the text with the agent assistant mode š¤
Hello, @Baptiste . Unfortunately, it seems that the Basic Assistant faces the same issue. Here's an example I came across today. I used asterisks to omit sensitive info.
Dify
"O ** foi fundado em de ** de 2011 por 181 cidadĆ£os de diversas profissƵes e estados brasileiros insatisfeitos com..."
Typebot
"O ** foi fundado em de ** de 201 por 181 cidadĆ£os de diversas profissƵes e estados brasileiros insatisfeitos com..."
I'd need that for debugging purpose
As of now, I can't guess what goes wrong here
I have shared the details over the email. Can u try to fix asap...
Thank you, it helped a lot and I think I fixed it
Should be deployed in ~10 minutes
Let me know š
Its fixed. Thank U!
Awesome! Thank you so much! š