We know to configure HDFS HA manually using the different commands we learned in Chapter 4, Exploring HDFS Federation and Its High Availability. In this section, we will use Cloudera Manager to configure HDFS HA and see how quickly we can set it up just with a few clicks, making the entire process more efficient.
The following are the steps to configure HDFS HA using Cloudera Manager:
- Log in to Cloudera Manager, navigate to the Clusters menu, and select the HDFS service from the Services section.
- Next, click on the Instances tab. The screen should look like the one shown in the following screenshot:
- Click on the Enable High Availability button to bring up the four step wizard to configure high availability as shown in the following screenshot:
Select the node that will host the standby namenode and the nodes that will host the Journal Node daemons. In the following screenshot, you will see that we have selected
node2.hclusterto be the standby namenode andnode2.hcluster,node3.hcluster, andnode4.hclusterto host the Journal Node daemons. After selecting the nodes, click on Continue. - The next screen provides the option to define the nameservice name as shown in the following screenshot:
- In the Review Changes screen, you will need to update the values for the JournalNode Edits Directory option for all the machines that host the Journal Node daemon. As you can see in the following screenshot, I have set this property to be
/tmp/jndatafor nodes:node2.hcluster,node3.hcluster, andnode4.hcluster. After setting these values, click on Continue. - In the final step, all the services that require a restart are restarted and the new configuration for clients of the services in the cluster are deployed on the cluster. The following screenshot is a partial screenshot of the successful final step:
We have successfully configured HDFS HA in six easy steps using Cloudera Manager. This is the real power of Cloudera Manager, which in turn helps the administrator carry out tasks efficiently.