pyes

How to reindex ElasticSearch quickly?

由 本秂侑毒 提交于 2019-12-21 12:39:11
问题 I have an ElasticSearch index with around 200M documents, total index size of 90Gb. I changed mapping, so I would like ElasticSearch to re-index all the documents. I wrote a script that creates a new index (with the new mapping), then goes over all the documents in the old index and puts then into the new one. It seems to work, but the problem is that it works extremely slowly. It started with 300 documents / minute two days ago, and now the speed is 150 documents/minute. The script runs on a

Elastic Search No server available, list index out of range

由 浪尽此生 提交于 2019-12-13 19:07:45
问题 I'm trying to get a simple example working with elastic search using pyes, but I'm having trouble getting the starting examples working. I'm following the documentation found here: http://pyes.readthedocs.org/en/latest/manual/usage.html and just trying to run the following function, but It's not quite working. def index_transcripts(): conn = ES('127.0.0.1:9200') conn.indices.create_index("test-index") index_transcripts() Which in my mind should be very straightforward, but instead I get the

elastic search performance using pyes

由 淺唱寂寞╮ 提交于 2019-12-13 04:06:13
问题 Sorry for cross posting.The following question is also posted on Elastic Search's google group. In short I am trying to find out why I am not able to get optimal performance while doing searches on a ES index which contains about 1.5 millon records. Currently I am able to get about 500-1000 searches in 2 seconds. I would think that this should be orders of magnitudes faster. Also currently I am not using thrift. Here is how I am checking the performance. Using 0.19.1 version of pyes (tried

Unable to redirect python script result to a text file in windows

由 自作多情 提交于 2019-12-11 17:57:57
问题 Here is my python code.I'm trying to do elastic search in python. from pyes import * from pyes.mappings import * conn = ES('http://search.twitter.com/search.json?q=poplio') conn.indices.create_index("test-index") I'm trying this tutorial pyes The issue is when i try to run this python script in windows i get a detailed message on msdos prompt which i don't know if its an error or any thing else. So i tried to redirect that message to a text file but i don't see any thing in that file. Here is

How to reindex ElasticSearch quickly?

由 血红的双手。 提交于 2019-12-04 05:48:25
I have an ElasticSearch index with around 200M documents, total index size of 90Gb. I changed mapping, so I would like ElasticSearch to re-index all the documents. I wrote a script that creates a new index (with the new mapping), then goes over all the documents in the old index and puts then into the new one. It seems to work, but the problem is that it works extremely slowly. It started with 300 documents / minute two days ago, and now the speed is 150 documents/minute. The script runs on a machine within the same network the elastic search machines in. With such speed it will require a
订阅 pyes