how to tune the parallelism hint in storm

后端 未结 3 1272
没有蜡笔的小新
没有蜡笔的小新 2020-12-28 18:07

\"parallelism hint\" is used in storm to parallelise a running storm topology. I know there are concepts like worker process, executor and tasks. Would it make sense to make

3条回答
  •  清歌不尽
    2020-12-28 18:43

    A good tip to analyse the need for paralelism in your Storm topology is use the metrics from Storm UI:

    The Storm UI has also been made significantly more useful. There are new stats "#executed", "execute latency", and "capacity" tracked for all bolts. The "capacity" metric is very useful and tells you what % of the time in the last 10 minutes the bolt spent executing tuples. If this value is close to 1, then the bolt is "at capacity" and is a bottleneck in your topology. The solution to at-capacity bolts is to increase the parallelism of that bolt. (...)

    Source: https://storm.incubator.apache.org/2013/01/11/storm082-released.html

提交回复
热议问题