How to programmatically kill a storm topology?

廉价感情. 提交于 2019-11-27 16:33:50

问题


I am using a java class to submit a topology to the storm cluster and I also plan to use java class to kill the topology. But as per storm documentation, the following command is used to kill a topology and there is no Java method (and this has valid reasons)

storm kill {stormname}

So is it fine to call a shell script from java class to kill the topology? What are the other ways to kill topology?

Also, how to get the status of running topologies in storm cluster?


回答1:


For killing topology you can try this

import backtype.storm.generated.KillOptions
import backtype.storm.generated.Nimbus.Client;
import backtype.storm.utils.NimbusClient
import backtype.storm.utils.Utils

Map conf = Utils.readStormConfig();
Client client = NimbusClient.getConfiguredClient(conf).getClient();
KillOptions killOpts = new KillOptions();
//killOpts.set_wait_secs(waitSeconds); // time to wait before killing
client.killTopologyWithOpts(topology_name, killOpts); //provide topology name

To get the status of topology running

Client client = NimbusClient.getConfiguredClient(conf).getClient();
List<TopologySummary> topologyList = client.getClusterInfo.get_topologies();
// loop through the list and check if the required topology name is present in the list
// if not it's not running



回答2:


As of Storm 1.0.0, killing a topology from within a spout or bolt needs you to specify the nimbus host location via nimbus.seeds (or if you aren't doing it through code, you need to specify the nimbus.seeds in the storm.yaml file):

import org.apache.storm.utils.NimbusClient;
import org.apache.storm.utils.Utils;

void somewhereInASpoutOrBolt() {
Map conf = Utils.readStormConfig();
conf.put("nimbus.seeds", "localhost");

NimbusClient cc = NimbusClient.getConfiguredClient(conf);

Nimbus.Client client = cc.getClient();
client.killTopology("MyStormTopologyName");
}

Do note that doing so will end your program too.



来源:https://stackoverflow.com/questions/20799178/how-to-programmatically-kill-a-storm-topology

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!