Deploying Storm-Starter topologies on Storm-YARN

In this section, we will see how to deploy Storm-Starter topologies on Storm-YARN. Storm-Starter is a set of example topologies that comes with Storm. Perform the following steps to run the topologies on Storm-YARN:

  1. Clone the Storm-Starter project with the following commands:
    git clone https://github.com/nathanmarz/storm-starter
cd storm-starter
  2. Package the topologies with the following mvn command:
    mvn package –DskipTests
  3. Deploy WordCountTopology on Storm-YARN with the following command:
    storm jar target/storm-starter-0.0.1-SNAPSHOT.jar storm.starter.WordCountTopology word-count-topology

    The following information is displayed:

    545  [main] INFO  backtype.storm.StormSubmitter - Jar not uploaded to master yet. Submitting jar...
558  [main] INFO  backtype.storm.StormSubmitter - Uploading topology jar target/storm-starter-0.0.1-SNAPSHOT.jar to assigned location: storm-local/nimbus/inbox/stormjar-9ab704ff-29f3-4b9d-b0ac-e9e41d4399dd.jar
609  [main] INFO  backtype.storm.StormSubmitter - Successfully uploaded topology jar to assigned location: storm-local/nimbus/inbox/stormjar-9ab704ff-29f3-4b9d-b0ac-e9e41d4399dd.jar
609  [main] INFO  backtype.storm.StormSubmitter - Submitting topology word-cout-topology in distributed mode with conf {"topology.workers":3,"topology.debug":true}
937  [main] INFO  backtype.storm.StormSubmitter - Finished submitting topology: word-cout-topology
  4. Now, we can see the deployed topology on the Nimbus Web UI at http://localhost:7070/, as shown in the following screenshot:
    Deploying Storm-Starter topologies on Storm-YARN

    The Nimbus Web UI showing the word-count topology on YARN

  5. To see how you can interact with topologies running on Storm-YARN, run the following command:
    storm-yarn help

    It will list all the options for interacting with various Storm processes and starting new supervisors. The following operations are supported:

    • launch
    • shutdown
    • addSupervisors
    • startSupervisors
    • stopSupervisors
    • startNimbus
    • stopNimbus
    • getStormConfig
    • setStormConfig
    • startUI
    • stopUI

In this section, we built a Storm-Started topology and ran it over Storm-YARN.

..................Content has been hidden....................

You can't read the all page of ebook, please click here login for view all page.
Reset
18.191.202.177