Kafka producer callback Exception

Question

When we produce messages we can define a callback, this callback can expect an exception:

kafkaProducer.send(produce         


        

Answer 1

You may get BufferExhaustedException or TimeoutException

Just bring your Kafka down after the producer has produced one record. And then continue producing records. After sometime, you should be seeing exceptions in the callback.

This is because, when you sent the first record, the metadata is fetched, after that, the records will be batched and buffered and they expire eventually after some timeout during which you may see these exceptions.

I suppose that the timeout is delivery.timeout.ms which when expired give you a TimeoutException exception there.