❔ Kafka Producer Timeouts And How To Detect Undelivered Messages

I am using confluent-kafka package for my producer, recently we run load test to kafka connector via our web api. Noticed after a while in total we send 10m requests but only 8.5m messages received by kafka broker. How can I detect why those messages are not produced ? I am suspecting about timeout configuration on producer
2 Replies
atakancracker
atakancracker2y ago
request.timeout.ms is the timeout configured on the client side. It says that the client is going to wait this much time for the server to respond to a request. If request.timeout.ms set to 30 seconds and kafka broker not respond to producer within 30 seconds. That message is lost and not delivered to leader. Am I correct ?
Accord
Accord2y ago
Looks like nothing has happened here. I will mark this as stale and this post will be archived until there is new activity.