Is there a way to delete all the data from a topic or delete the topic before every run?
Can I modify the KafkaConfig.scala file to change the logRetentionHour
log.retention.hours and add log.retention.ms=1000. It would keep the record on Kafka Topic for only one second. log.retention.hours to your desired figure.