Rebalancing executors in Apache Storm

南笙酒味 提交于 2019-12-02 17:41:48

问题


I am trying to rebalance the number of executors for a bolt in a running Apache Storm (0.9.5) topology. When I execute the command to the Nimbus node ./storm rebalance MyTopology -n 2 -e GreenBolt=4 it accepts the command line input but the number of executors is not changed when I view in the Storm UI.

Is there a limitation that I'm not aware of like a rebalance can not increase the total number of executors and only move them from one bolt to another?


回答1:


You always need to have more (or equal number of) tasks than executors. As the number of tasks is fixed, you need to set a larger initial number than initial executors in order to be able to scale up the number of executors during runtime. You can see the number of tasks, as maximum number of executors:

#executors <= #numTasks

See here for details: https://storm.apache.org/documentation/Understanding-the-parallelism-of-a-Storm-topology.html



来源:https://stackoverflow.com/questions/31932573/rebalancing-executors-in-apache-storm

标签
易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!