Synchronising transactions between database and Kafka producer

Question

We have a micro-services architecture, with Kafka used as the communication mechanism between the services. Some of the services have their own databases. Say the user mak

Answer 1

All the approach described above are the best way to approach the problem and are well defined pattern. You can explore these in the links provided below.

Pattern: Transactional outbox

Publish an event or message as part of a database transaction by saving it in an OUTBOX in the database. http://microservices.io/patterns/data/transactional-outbox.html

Pattern: Polling publisher

Publish messages by polling the outbox in the database. http://microservices.io/patterns/data/polling-publisher.html

Pattern: Transaction log tailing

Publish changes made to the database by tailing the transaction log. http://microservices.io/patterns/data/transaction-log-tailing.html