spring-kafka

I have a Kafka consumer which retry 5 time and I am using Spring Kafka with retry template . Now if all retry are failed then how to does acknowledge work in that case . Also if i have set acknowledge mode to manually then how to acknowledge those message Consumer @Bean("kafkaListenerContainerFactory") public ConcurrentKafkaListenerContainerFactory<String, String> kafkaListenerContainerFactory(RetryTemplate retryTemplate) { ConcurrentKafkaListenerContainerFactory<String, String> factory = new ConcurrentKafkaListenerContainerFactory<>(); factory.setConsumerFactory(consumerFactory()); factory

Hy, I'm using spring-kafka 1.3.0.RELEASE to create a transactional producer. When the bootstrap server is down, the DefaultKafkaProducerFactory waits endlessly until the bootstrap server is up. What am I doing wrong ? Can I set a timeout and/or other similar properties ? This is an example of my code to reproduce the scenario: public static void main(String[] args) { final DefaultKafkaProducerFactory<Object, Object> producerFactory = new DefaultKafkaProducerFactory<>(producerConfigs()); producerFactory.setTransactionIdPrefix("transactionIdPrefix"); final Producer<Object, Object> producer =

I use spring-kafka for springboot 2.0.4.RELEASE. And use KafkaListener for get message Now I want to reset the offset for my group But i do not how to get the consumer for the group @KafkaListener(id="test",topics={"test"},groupId="group",containerFactory="batchContainerFactory") public String listenTopic33(List<ConsumerRecord<Integer, String>> record, Acknowledgment ack){ // do something } @Autowired KafkaListenerEndpointRegistry kafkaListenerEndpointRegistry; public void test() { MessageListenerContainer test3 = kafkaListenerEndpointRegistry.getListenerContainer("test3"); } If you want to

We have an issue with one of our Kafka topics which is consumed by the DefaultKafkaConsumerFactory & ConcurrentMessageListenerContainer combination described here with a JsonDeserializer used by the Factory. Unfortunately someone got a little enthusiastic and published some invalid messages onto the topic. It appears that spring-kafka silently fails to process past the first of these messages. Is it possible to have spring-kafka log an error and continue? Looking at the error messages which are logged it seems that perhaps the Apache kafka-clients library should deal with the case that when

I'm having a hard time to understand how this could be solved so I'm asking it here in the hope someone else already faced the same problems. We are running our @KafkaListener with manual ack mode and a dead letter recoverer with a retry limit of 3. Manual ack mode is needed due to the business logic that we dont ack a message and pause consuming for 5 minutes when certain circumstances are given (external dependencies). Also we do need the dead letter queue for messages we cannot process for some reason. Now the problem in manual ack mode is that our listener/consumer does not acknowledge the