Is there a way to join databases of two different data sources(ie. Mysql and Postgres SQL) using logstash and indexing it to elastic search?

拜拜、爱过 提交于 2019-12-24 23:24:24

问题


I am very new to ELK and want to know if there is a way around to join two databases from different sources (ie. MYSQL and Postgres) and indexing it to a single index in elasticsearch using logstash.

As I am able to achieve the same with the help of pyspark. But I want to achieve the same thing using log stash if it's possible!

Also, suggest some other feasible ways to achieve the same apart from the spark and logstash.

Thanks in Advance!


回答1:


You can definitely achieve this by sourcing data from one database using a jdbc input and then joining it with data coming from another database that is sourced with either the jdbc_static (if the data doesn't change too often) or jdbc_streaming (if the data changes more often) filters.



来源:https://stackoverflow.com/questions/58831012/is-there-a-way-to-join-databases-of-two-different-data-sourcesie-mysql-and-pos

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!