Skip to content

hdinsight-changing-configs-via-ambari.md

Latest commit

 

History

History
63 lines (39 loc) · 3.78 KB

hdinsight-changing-configs-via-ambari.md

File metadata and controls

63 lines (39 loc) · 3.78 KB
title Optimize clusters with Apache Ambari in Azure HDInsight
description Use the Apache Ambari web UI to configure and optimize Azure HDInsight clusters.
ms.service azure-hdinsight
ms.topic how-to
ms.custom hdinsightactive, devx-track-extended-java
author apurbasroy
ms.author apsinhar
ms.reviewer sairamyeturi
ms.date 01/02/2025

Optimize clusters with Apache Ambari in Azure HDInsight

HDInsight provides Apache Hadoop clusters for large-scale data processing applications. Managing, monitoring, and optimizing these complex multi-node clusters can be challenging. Apache Ambari is a web interface to manage and monitor HDInsight Linux clusters.

For an introduction to using the Ambari Web UI, see Manage HDInsight clusters by using the Apache Ambari Web UI

Log in to Ambari at https://CLUSTERNAME.azurehdidnsight.net with your cluster credentials. The initial screen displays an overview dashboard.

:::image type="content" source="./media/hdinsight-changing-configs-via-ambari/apache-ambari-dashboard.png" alt-text="Apache Ambari user dashboard displayed.":::

The Ambari web UI is used to manage hosts, services, alerts, configurations, and views. Ambari can't be used to create an HDInsight cluster, or upgrade services. Also can't manage stacks and versions, decommission or recommission hosts, or add services to the cluster.

Manage your cluster's configuration

Configuration settings help tune a particular service. To modify a service's configuration settings, select the service from the Services sidebar (on the left). Then navigate to the Configs tab in the service detail page.

:::image type="content" source="./media/hdinsight-changing-configs-via-ambari/ambari-services-sidebar.png" alt-text="Apache Ambari Services sidebar.":::

Modify NameNode Java heap size

The NameNode Java heap size depends on many factors such as the load on the cluster. Also, the numbers of files, and the numbers of blocks. The default size of 1 GB works well with most clusters, although some workloads can require more or less memory.

To modify the NameNode Java heap size:

  1. Select HDFS from the Services sidebar and navigate to the Configs tab.

    :::image type="content" source="./media/hdinsight-changing-configs-via-ambari/ambari-apache-hdfs-config.png" alt-text="Apache Ambari HDFS configuration.":::

  2. Find the setting NameNode Java heap size. You can also use the filter text box to type and find a particular setting. Select the pen icon beside the setting name.

    :::image type="content" source="./media/hdinsight-changing-configs-via-ambari/ambari-java-heap-size.png" alt-text="Apache Ambari NameNode Java heap size.":::

  3. Type the new value in the text box, and then press Enter to save the change.

    :::image type="content" source="./media/hdinsight-changing-configs-via-ambari/java-heap-size-edit1.png" alt-text="Ambari Edit NameNode Java heap size1.":::

  4. The NameNode Java heap size is changed to 1 GB from 2 GB.

    :::image type="content" source="./media/hdinsight-changing-configs-via-ambari/java-heap-size-edited.png" alt-text="Edited NameNode Java heap size2.":::

  5. Save your changes by clicking on the green Save button on the top of the configuration screen.

    :::image type="content" source="./media/hdinsight-changing-configs-via-ambari/ambari-save-changes1.png" alt-text="Apache Ambari save configurations.":::

Next steps