Rebalancing a Hadoop cluster from Cloudera Manager

The Balancer tool available in Hadoop is used to balance the data blocks across all the datanodes when a new datanode is added or when an existing datanode reaches full capacity.

Adding the Balancer service to the cluster

Before you can rebalance a cluster, we need to add the balancer service. The following are the steps to add the Balancer service:

  1. Navigate to the Clusters menu and select HDFS.
  2. Click on the Instances tab and select Add to bring up the Customize Role Assignments screen as shown in the following screenshot:
    Adding the Balancer service to the cluster
  3. Click on Select a host for the Balancer section to bring up the host selection screen as shown in the following screenshot. Select a host and click on OK. Here I have selected node4.
    Adding the Balancer service to the cluster
  4. In the next screen, click on Continue. You should now see the Balancer service added, as shown in the following screenshot:
    Adding the Balancer service to the cluster

Rebalancing the cluster

Once the Balancer service is installed successfully, you can perform the rebalancing operation. The following are the steps to perform the rebalancing operation from Cloudera Manager:

  1. Navigate to the Clusters menu and select HDFS.
  2. Navigate to the Instances tab and click on the Balancer service from the list of services to navigate to the balancer screen as shown in the following screenshot:
    Rebalancing the cluster
  3. Click on the Actions button and click on Rebalance as shown in the following screenshot:
    Rebalancing the cluster
  4. You will be asked to confirm the action as shown in the following screenshot:
    Rebalancing the cluster
  5. Click on Rebalance to start the rebalancing operation. On successful completion, the data blocks should be balanced across the datanodes on the cluster and you should see a message like the one shown in the following screenshot:
    Rebalancing the cluster
..................Content has been hidden....................

You can't read the all page of ebook, please click here login for view all page.
Reset
52.15.148.187