how to tune the parallelism hint in storm

后端 未结 3 1270
没有蜡笔的小新
没有蜡笔的小新 2020-12-28 18:07

\"parallelism hint\" is used in storm to parallelise a running storm topology. I know there are concepts like worker process, executor and tasks. Would it make sense to make

3条回答
  •  我在风中等你
    2020-12-28 18:44

    How to find the perfect parallelism hint number? I would say your best bet is try different numbers to find your suitable configuration. Each topology is different.

    For example, your topology might interacting with a REST API, RDBMS, Solr, ElasticSearch or whatever and one of those might be your bottle neck. If you increased the parallelism hint, you might bring one of them to its knees and start throwing exceptions or whatever.

    Your best bet is try different configuration and tune to find your best parallelism hint.

提交回复
热议问题