elastic-stack

HTTPBeat installation on windows 8.1 issue

不羁岁月 提交于 2019-12-11 19:26:16
问题 I'm trying to pump a spring-boot app metrics to elasticsearch using Httpbeat ,I'm following this https://aboullaite.me/spring-boot-elastic-kibana/ ,I'm struggling to install httpbeat into my windows machine I installed Go ,but I'm stuck at the glide installation, is there any alternative that I can use rather than HTTPbeat ,And if you know a clear method rather than the official documentation please help me, I have a demo the next Monday and I'm fully stuck 回答1: Try docker install for

The data is getting lost whenever I restart the docker/elk image

懵懂的女人 提交于 2019-12-11 18:47:07
问题 I'm using docker/elk image to display my data in kibana dashboard (Version 6.6.0) and It works pretty good. I started the service like using below command. Docker Image git repo : https://github.com/caas/docker-elk Command: sudo docker-compose up --detach Expecting that it will run background, and did as expected. After two days the server up and running the and third day the kibana alone getting stopped. and Used below command to make it up and running. sudo docker run -d <Docer_image_name>

Error: mongodb.jdbc.MongoDriver not loaded. Are you sure you've included the correct jdbc driver in :jdbc_driver_library?

倾然丶 夕夏残阳落幕 提交于 2019-12-11 17:53:57
问题 Am trying to load mogodb database to elastic search using logstash. I have written below logstash config file and executing it. While running the config file am getting the below error : Error: mongodb.jdbc.MongoDriver not loaded. Are you sure you've included the correct jdbc driver in :jdbc_driver_library? Exception: LogStash::ConfigurationError Am using mongo-java-driver-3.1.0.jar driver. Please find my logstash config code below. input { jdbc { jdbc_driver_library => "D:\1SearchEngine\data

ElasticSearch JavaAPI RestClient not giving response

时光总嘲笑我的痴心妄想 提交于 2019-12-11 17:49:15
问题 Am using RestClient JavaAPI to fetch documents from elastic search. But am not getting response for my request. Am forming my request using QueryBuilder . Please find my java code which am using to fetch documents from elastic search private final static String ATTACHMENT = "document_attachment"; private final static String TYPE = "doc"; static long BUFFER_SIZE = 520 * 1024 * 1024; // <---- set buffer to 120MB instead of 100MB public static void main(String args[]) { RestClient restClient =

Unable to create visualization using curl command in elaticearch

与世无争的帅哥 提交于 2019-12-11 16:59:17
问题 I am trying to create visualization using curl command. I am using elasticsearch 6.2.3. I am able to create the same in elasticsearch 5.6.8. I am using this command curl -XPUT http://localhost:9200/.kibana/visualization/vis1 -H 'Content-Type: application/json' -d @vis1.json It is showing this error : {"error":{"root_cause":[{"type":"illegal_argument_exception","reason":"Rejecting mapping update to [.kibana] as the final mapping would have more than 1 type: [visualization, doc]"}],"type":

Logstash grok filter config for php monolog multi-line(stacktrace) logs

﹥>﹥吖頭↗ 提交于 2019-12-11 11:57:45
问题 [2018-02-12 09:15:43] development.WARNING: home page [2018-02-12 09:15:43] development.INFO: home page [2018-02-12 10:22:50] development.WARNING: home page [2018-02-12 10:22:50] development.INFO: home page [2018-02-12 10:22:50] development.ERROR: Call to undefined function vie() {"exception":"[object](Symfony\\Component\\Debug\\Exception\\FatalThrowableError(code: 0): Call to undefined function vie() at /var/www/html/routes/web.php:16 [stacktrace] #0 /var/www/html/vendor/laravel/framework/src

ELK - Kibana doesn't recognize geo_point field

南笙酒味 提交于 2019-12-11 11:34:13
问题 I'm trying to create a Tile map on Kibana, with GEO location points. For some reason, When I'm trying to create the map, I get the following message on Kibana: No Compatible Fields: The "logs" index pattern does not contain any of the following field types: geo_point My settings: Logstash (version 2.3.1): filter { grok { match => { "message" => "MY PATTERN" } } geoip { source => "ip" target => "geoip" add_field => [ "location", "%{[geoip][latitude]}, %{[geoip][longitude]}" ] #added this extra

Docker swarm cluster and elasticsearch, using constraints to bind a service to a specific node

≯℡__Kan透↙ 提交于 2019-12-11 09:50:00
问题 i was hoping someone here might be able to give me some input with a problem i'm having. I have a Docker swarm cluster with 3 nodes and want to run the ELK stack but i am not sure how to store my data. version: '3' services: master01: image: elasticsearch:5.2.2 ports: - 9200:9200 - 9300:9300 networks: - es volumes: - /es/data:/usr/share/elasticsearch/data command: > elasticsearch -E network.host=_eth0_ -E node.master=true -E discovery.zen.ping.unicast.hosts=es_master01,es_master02,es_master03

Logstash is not reading from Kafka

百般思念 提交于 2019-12-11 06:15:23
问题 I am testing a simple pipeline - Filebeat > Fafka > Logstash > File. Logstash is not reading from Kafka, but I see Kafka has messages when i use this command - bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic MyTopic --from-beginning My file beat configuration - filebeat.prospectors: - input_type: log paths: - /root/LogData/input.log output.kafka: hosts: ["10.247.186.14:9092"] topic: MyTopic partition.round_robin: reachable_only: false required_acks: 1 compression: none

logstash splits event field values and assign to @metadata field

不羁的心 提交于 2019-12-11 05:16:34
问题 I have a logstash event , which has the following field { "_index": "logstash-2016.08.09", "_type": "log", "_id": "AVZvz2ix", "_score": null, "_source": { "message": "function_name~execute||line_no~128||debug_message~id was not found", "@version": "1", "@timestamp": "2016-08-09T14:57:00.147Z", "beat": { "hostname": "coredev", "name": "coredev" }, "count": 1, "fields": null, "input_type": "log", "offset": 22299196, "source": "/project_root/project_1/log/core.log", "type": "log", "host":