Optimizing Lucene performance

社会主义新天地 提交于 2019-11-28 04:10:05

Quick tips:

  • Keep the size of the index small. Eliminate norms, Term vectors when not needed. Set Store flag for a field only if it a must.
  • Obvious, but oft-repeated mistake. Create only one instance of Searcher and reuse.
  • Keep in the index on fast disks. RAM, if you are paranoid.

Cheat. Use RAMDirectory to load the entire index into the ram. Afterwards, everything is blazing fast. :)

Lots of dead links in here.

These (somewhat official) resources are where I would start:

http://wiki.apache.org/lucene-java/ImproveIndexingSpeed

http://wiki.apache.org/lucene-java/ImproveSearchingSpeed

I have found that the best answer to a performance question is to profile it. Guidelines are great, but there is so many variables that can impact performance such as the size of your dataset, the types of queries you are doing, datatypes, etc.

Get the Netbeans profiler or something similar and try it out different ways. Use the articles linked to by Mitch, but make sure you actually test what helps and what (often surprisingly) hurts.

There is also a good chance that any performance differences you can get from Lucene will be minor compared to performance improvements in your code. The profiler will point that out as well.

Shailendra

For 64 bit machines use MMapDirectory instead of RAMDirectory as very well explained here by one of the core Lucene committers.

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!