Category Archives: Hadoop Cluster Administration

Hadoop Cluster : Run Command on ALL Nodes

Its usually tough to run a command on all nodes of a hadoop cluster. Here is a script to do that.. run_command !/bin/bash TPUT=’tput -T xterm-color’ txtund=$(${TPUT} sgr 0 1) # Underline txtbld=$(${TPUT} bold) # Bold txtrst=$(${TPUT} sgr0) # Reset … Continue reading

Posted in Hadoop Cluster Administration, Hadoop Cluster Installation, Uncategorized, Unix | Leave a comment

Customize email alerts in ambari

Add the xml file – alert-templates-custom.xml ¬†under¬† /var/lib/ambari-server/resources/ Edit ambari.properties file under /etc/ambari-server/conf/ and add the following property alerts.template.file=/var/lib/ambari-server/resources/alert-templates-custom.xml. Restart the ambari-server. alert-templates-custom.xml :   <?xml version=”1.0″ encoding=”UTF-8″?> <alert-templates> <alert-template type=”EMAIL”> <subject> <![CDATA[Alert Summary: OK[$summary.getOkCount()], Warning[$summary.getWarningCount()], Critical[$summary.getCriticalCount()], Unknown[$summary.getUnknownCount()]]]> </subject> <body> … Continue reading

Posted in Hadoop Cluster Administration | Leave a comment

A Hadoop Cluster @Home : UnInstalling a Hadoop Cluster

Stop all Hadoop services (before uninstalling the Cloudera Manager Server and Agents) [For each Cloudera Management Service entry, click Actions and click Stop…. Click Stop in the confirmation screen] Deactivate and remove Parcels ( if used for CDH installation.) CM … Continue reading

Posted in Hadoop Cluster Administration | Tagged , , | Leave a comment

A Hadoop Cluster @Home : Adding a New Host to the Cluster

Prerequisites : SSH key pair should be generated and shared Firewall should be turned OFF Steps involved in the process would be : Select Repository Provide SSH Login Credentials Installation : (Jdk, CM Agent, Hadoop, Hive ………) Inspect host for … Continue reading

Posted in Hadoop Cluster Administration | Tagged | Leave a comment