elasticsearch-jdbc-river

elasticsearch dynamic query - Add another field to each document returned

谁都会走 提交于 2021-02-06 09:26:07
问题 What I need is very simple, but I am unable to find how to do it in Elasticsearch, possibly because of the complexity of what is required to be done. Input (two sample JSON documents) { "car" : 150, "bike" : 300 } { "car" : 100, "bike" : 200} What I want in return is that when I fire a search query it returns me the documents with an extra field inventory which is defined as the sum of number of cars and bikes. And in the sorted order. Sample Output: hits: [ { "car" : 150, "bike" : 300,

What is the Best way to sync data from mysql to elastic search

只谈情不闲聊 提交于 2020-06-13 05:36:10
问题 I have ES 2.2 and installed JDBC importer for Elasticsearch elasticsearch-jdbc-2.2.0.0 and have been able to insert data, but not being to update ES with a change in mysql, ie. syncing of mysql with ES. How do i do the sync? I executed the following shell script once, data got inserted properly but the scheduler dint work. It is not executing every minute to capture any changes in mysql(schemes table). Is there something wrong in my script? or any workaround available? DIR="$( cd "$( dirname

failed to send join request to master

天涯浪子 提交于 2020-01-14 14:10:09
问题 I am using elasticsearch version 1.3.0 . After restarting data node its unable to detect master node. I am getting error failed to send join request to master In Error log :- [[app101][dGRBqTFTQfae76IFCjsMmQ][app101][inet[/127.0.0.2:9300]]{master=true, river=_none_}], reason [org.elasticsearch.transport.RemoteTransportException: [app101][inet[/127.0.0.2:9300]][discovery/zen/join]; org.elasticsearch.transport.RemoteTransportException: [app102][inet[/127.0.0.1:9300]][discovery/zen/join/validate

failed to send join request to master

拥有回忆 提交于 2020-01-14 14:09:09
问题 I am using elasticsearch version 1.3.0 . After restarting data node its unable to detect master node. I am getting error failed to send join request to master In Error log :- [[app101][dGRBqTFTQfae76IFCjsMmQ][app101][inet[/127.0.0.2:9300]]{master=true, river=_none_}], reason [org.elasticsearch.transport.RemoteTransportException: [app101][inet[/127.0.0.2:9300]][discovery/zen/join]; org.elasticsearch.transport.RemoteTransportException: [app102][inet[/127.0.0.1:9300]][discovery/zen/join/validate

Setting up mapping for a JDBC elasticsearch river

*爱你&永不变心* 提交于 2020-01-02 15:38:32
问题 I'm using ES 0.20.6 with the elasticsearch-river-jdbc plugin. I created a river that works using : SQL="SELECT ..." curl -XPUT 'localhost:9200/_river/myindex_river/_meta' -d '{ "type" : "jdbc", "jdbc" : { "driver" : "org.postgresql.Driver", "url" : "jdbc:postgresql://localhost:5432/mydb_db", "user" : "myuser", "password" : "mypassword", "sql" : "'"$SQL"'" }, "index" : { "index" : "myindex", "type" : "mytype", "type_mapping" : null } }' Now what i want is to add type mappings as the option is

JDBC, Elasticsearch and Postgresql Json data type

谁说我不能喝 提交于 2019-12-21 21:20:44
问题 Postgresql : 9.3.2 Elasticsearch : 0.90 jprante/elasticsearch-river-jdbc : 2.2.2 postgresql JDBC : 9.3-1100 JDBC 41 I'm trying to get a postgresql Json data type column into elasticsearch, using the elasticsearch river. Here the created river curl -XPUT 'localhost:9200/_river/business_river/_meta' -d '{ "type" : "jdbc", "jdbc" : { "driver" : "org.postgresql.Driver", "url" : "jdbc:postgresql://localhost:5432/business", "user" : "postgres", "password" : "", "sql" : "select id, active, companies

ElasticSearch Error: MapperParsingException failed to parse

a 夏天 提交于 2019-12-20 01:53:05
问题 I am trying to integrate MYSQL in ElasticSearch On windows 7 from this link I have completed the following steps: 1: Download & Unzip in C Directory https://download.elasticsearch.org/elasticsearch/elasticsearch/elasticsearch-1.3.4.zip 2: Run this command on CMD ./bin/plugin --install jdbc --url http://xbib.org/repository/org/xbib/elasticsearch/plugin/elasticsearch-river-jdbc/1.3.4.4/elasticsearch-river-jdbc-1.3.4.4-plugin.zip 3: Download MYSQL Connector mysql-connector-java-5.1.33.zip from

elasticsearch JDBC -RIVER java.lang.OutOfMemoryError: unable to create new native thread

纵然是瞬间 提交于 2019-12-13 02:53:02
问题 I am using elasticsearch "1.4.2" with river plugin on an aws instance with 8GB ram.Everything was working fine for a week but after a week the river plugin[plugin=org.xbib.elasticsearch.plugin.jdbc.river.JDBCRiverPlugin version=1.4.0.4] stopped working also I was not able to do a ssh login to the server.After server restart ssh login worked fine ,when I checked the logs of elastic search I could find this error. [2015-01-29 09:00:59,001][WARN ][river.jdbc.SimpleRiverFlow] no river mouth [2015

Avoid rebuilding index through jdbc-river on elasticsearch

让人想犯罪 __ 提交于 2019-12-11 13:39:29
问题 I am using the following: ElasticSearch – v0.90.9 JDBC connector for MySQL – v5.1.28 ElasticSearch River – v2.3.1 I am able to build and query the indexed data using ElasticSearch. The above mentioned versions are installed on Ubuntu 12.04 LTS virtual machine and ElasticSearch runs as a service which starts automatically after a system reboot. Let us say that when there are no indices and I use ElasticSearch River to build a new index and issue a PUT command to build index, the index is built

elasticsearch : object mapping and getting data from database

∥☆過路亽.° 提交于 2019-12-11 13:09:20
问题 I use elasticsearch and oracle for the database. Database : I create a view with all the data I need to index. I have 1-N relations between my "occurences" table and "determinations" table and between "occurrences" table and "multimedias" table so one occurrence have multiples determinations and multimedias. Elasticsearch : I create a mapping and the river to get data from the database view. the problem is I need an array of object for multimedias and determinations instead of an array for