Kafka producer callback Exception

Question

When we produce messages we can define a callback, this callback can expect an exception:

kafkaProducer.send(produce         


        

Answer 1

Trying to add more info to @Mike's answer, I think only a few Exceptions are enum in Callback Interface.

Here you can see the whole list: kafka.common.errors

And here, you can see which ones are retriables and which ones are not: kafka protocol guide

And the code could be sht like this:

producer.send(record, callback)

def callback: Callback = new Callback {
    override def onCompletion(recordMetadata: RecordMetadata, e: Exception): Unit = {
      if(null != e) {
         if (e == RecordTooLargeException || e == UnknownServerException || ..) {
            log.error("Winter is comming") //it's non-retriable
            writeDiscardRecordsToSomewhereElse
         } else {
            log.warn("It's no that cold") //it's retriable
         }
      } else {
        log.debug("It's summer. Everything is fine")
      }
    }
}