• To install CDH 5 on a RHEL system, download packages with yum or use a web browser.
• To install CDH 5 on a SLES system, download packages with zypper or YaST or use a web browser.
• To install CDH 5 on an Ubuntu or Debian system, download packages with apt or use a web browser.

On RHEL-compatible Systems

Use one of the following methods to install CDH 5 on RHEL-compatible systems.

• Download and install the CDH 5 "1-click Install" package OR
• Add the CDH 5 repository OR
• Build a Yum Repository

Do this on all the systems in the cluster.

To download and install the CDH 5 "1-click Install" package:

1. Download the CDH 5 "1-click Install" package (or RPM).

   Click the appropriate RPM and Save File to a directory with write access (for example, your home directory).

   OS Version	Link to CDH 5 RPM
   RHEL/CentOS/Oracle 5	RHEL/CentOS/Oracle 5 link
   RHEL/CentOS/Oracle 6	RHEL/CentOS/Oracle 6 link
   RHEL/CentOS/Oracle 7	RHEL/CentOS/Oracle 7 link

2. Install the RPM for all RHEL versions:

   $ sudo yum --nogpgcheck localinstall cloudera-cdh-5-0.x86_64.rpm 

Continue with Step 2: Optionally Add a Repository Key. Then choose Step 3: Install CDH 5 with YARN, or Step 4: Install CDH 5 with MRv1; or do both steps to install both implementations.

  Note: Clean repository cache.

Before proceeding, clean cached packages and headers to ensure your system repos are up-to-date:

sudo yum clean all

OR: To add the CDH 5 repository:

Download the repo file. Click the link for your RHEL or CentOS system in the table, find the appropriate repo file, and save in /etc/yum.repos.d/.

For OS Version	Link to CDH 5 Repository
RHEL/CentOS/Oracle 5	RHEL/CentOS/Oracle 5 link
RHEL/CentOS/Oracle 6	RHEL/CentOS/Oracle 6 link
RHEL/CentOS/Oracle 7	RHEL/CentOS/Oracle 7 link

Continue with Step 2: Optionally Add a Repository Key. Then choose Step 3: Install CDH 5 with YARN, or Step 4: Install CDH 5 with MRv1; or do both steps to install both implementations.

  Note: Clean repository cache.

Before proceeding, clean cached packages and headers to ensure your system repos are up-to-date:

sudo yum clean all

OR: To build a Yum repository:

Follow the instructions at Creating a Local Yum Repository to create your own yum repository:

• Download the appropriate repo file
• Create the repo
• Distribute the repo and set up a web server.

Continue with Step 2: Optionally Add a Repository Key. Then choose Step 3: Install CDH 5 with YARN, or Step 4: Install CDH 5 with MRv1; or do both steps to install both implementations.

  Note: Clean repository cache.

Before proceeding, clean cached packages and headers to ensure your system repos are up-to-date:

sudo yum clean all

On SLES Systems

Use one of the following methods to download the CDH 5 repository or package on SLES systems.

• Download and install the CDH 5 "1-click Install" Package OR
• Add the CDH 5 repository OR
• Build a SLES Repository

To download and install the CDH 5 "1-click Install" package:

1. Download the CDH 5 "1-click Install" package.

   Download the rpm file, choose Save File, and save it to a directory to which you have write access (for example, your home directory).

2. Install the RPM:

   $ sudo rpm -i cloudera-cdh-5-0.x86_64.rpm

3. Update your system package index by running:

   $ sudo zypper refresh

Continue with Step 2: Optionally Add a Repository Key. Then choose Step 3: Install CDH 5 with YARN, or Step 4: Install CDH 5 with MRv1; or do both steps to install both implementations.

OR: To add the CDH 5 repository:

1. Run the following command:

   $ sudo zypper addrepo -f https://archive.cloudera.com/cdh5/sles/11/x86_64/cdh/cloudera-cdh5.repo

2. Update your system package index by running:

   $ sudo zypper refresh

Continue with Step 2: Optionally Add a Repository Key. Then choose Step 3: Install CDH 5 with YARN, or Step 4: Install CDH 5 with MRv1; or do both steps to install both implementations.

  Note: Clean repository cache.

Before proceeding, clean cached packages and headers to ensure your system repos are up-to-date:

sudo zypper clean --all

OR: To build a SLES repository:

If you want to create your own SLES repository, create a mirror of the CDH SLES directory by following these instructions that explain how to create a SLES repository from the mirror.

Continue with Step 2: Optionally Add a Repository Key. Then choose Step 3: Install CDH 5 with YARN, or Step 4: Install CDH 5 with MRv1; or do both steps to install both implementations.

  Note: Clean repository cache.

Before proceeding, clean cached packages and headers to ensure your system repos are up-to-date:

sudo zypper clean --all

On Ubuntu or Debian Systems

Use one of the following methods to download the CDH 5 repository or package.

• Download and install the CDH 5 "1-click Install" Package OR
• Add the CDH 5 repository OR
• Build a Debian Repository

To download and install the CDH 5 "1-click Install" package:

1. Download the CDH 5 "1-click Install" package:

   OS Version	Package Link
   Jessie	Jessie package
   Wheezy	Wheezy package
   Precise	Precise package
   Trusty	Trusty package

2. Install the package by doing one of the following:
   • Choose Open with in the download window to use the package manager.
   • Choose Save File, save the package to a directory to which you have write access (for example, your home directory), and install it from the command line. For example:

     sudo dpkg -i cdh5-repository_1.0_all.deb

  Note: Clean repository cache.

Before proceeding, clean cached packages and headers to ensure your system repos are up-to-date:

sudo apt-get update

Continue with Step 2: Optionally Add a Repository Key. Then choose Step 3: Install CDH 5 with YARN, or Step 4: Install CDH 5 with MRv1; or do both steps to install both implementations.

OR: To add the CDH 5 repository:

• Download the appropriate cloudera.list file by issuing one of the following commands. You can use another HTTP client if wget is not available, but the syntax may be different.
    Important: Ubuntu 14.04 (Trusty)

  For Ubuntu Trusty systems, you must perform an extra step after adding the repository. See "Additional Step for Trusty Ubuntu Trusty and Debian Jessie" below.

  OS Version	Command
  Debian Jessie	$ sudo wget 'https://archive.cloudera.com/cdh5/debian/jessie/amd64/cdh/cloudera.list' \ -O /etc/apt/sources.list.d/cloudera.list
  Debian Wheezy	$ sudo wget 'https://archive.cloudera.com/cdh5/debian/wheezy/amd64/cdh/cloudera.list' \ -O /etc/apt/sources.list.d/cloudera.list
  Ubuntu Precise	$ sudo wget 'https://archive.cloudera.com/cdh5/ubuntu/precise/amd64/cdh/cloudera.list' \ -O /etc/apt/sources.list.d/cloudera.list
  Ubuntu Lucid	$ sudo wget 'https://archive.cloudera.com/cdh5/ubuntu/lucid/amd64/cdh/cloudera.list' \ -O /etc/apt/sources.list.d/cloudera.list
  Ubuntu Trusty	$ sudo wget 'https://archive.cloudera.com/cdh5/ubuntu/trusty/amd64/cdh/cloudera.list' \ -O /etc/apt/sources.list.d/cloudera.list

  Note: Clean repository cache.

Before proceeding, clean cached packages and headers to ensure your system repos are up-to-date:

sudo apt-get update

Additional step for Ubuntu Trusty and Debian Jessie

This step ensures that you get the right ZooKeeper package for the current CDH release. You need to prioritize the Cloudera repository you have just added, such that you install the CDH version of ZooKeeper rather than the version that is bundled with Ubuntu Trusty or Debian Jessie.

To do this, create a file at /etc/apt/preferences.d/cloudera.pref with the following contents:

Package: *
Pin: release o=Cloudera, l=Cloudera
Pin-Priority: 501

  Note: You do not need to run apt-get update after creating this file.

Continue with Step 2: Optionally Add a Repository Key. Then choose Step 3: Install CDH 5 with YARN, or Step 4: Install CDH 5 with MRv1; or do both steps to install both implementations.

OR: To build a Debian repository:

If you want to create your own apt repository, create a mirror of the CDH Debian directory and then create an apt repository from the mirror.

Continue with Step 2: Optionally Add a Repository Key. Then choose Step 3: Install CDH 5 with YARN, or Step 4: Install CDH 5 with MRv1; or do both steps to install both implementations.

Before installing YARN or MRv1: (Optionally) add a repository key on each system in the cluster. Add the Cloudera Public GPG Key to your repository by executing one of the following commands:

• For RHEL/CentOS/Oracle 5 systems:

  $ sudo rpm --import https://archive.cloudera.com/cdh5/redhat/5/x86_64/cdh/RPM-GPG-KEY-cloudera
  

• For RHEL/CentOS/Oracle 6 systems:

  $ sudo rpm --import https://archive.cloudera.com/cdh5/redhat/6/x86_64/cdh/RPM-GPG-KEY-cloudera
  

• For RHEL/CentOS/Oracle 7 systems:

  $ sudo rpm --import https://archive.cloudera.com/cdh5/redhat/7/x86_64/cdh/RPM-GPG-KEY-cloudera
  

• For all SLES systems:

  $ sudo rpm --import https://archive.cloudera.com/cdh5/sles/11/x86_64/cdh/RPM-GPG-KEY-cloudera
  

• For Ubuntu or Debian systems:

  OS Version	Command
  Debian Jessie	$ wget https://archive.cloudera.com/cdh5/debian/jessie/amd64/cdh/archive.key -O archive.key $ sudo apt-key add archive.key
  Debian Wheezy	$ wget https://archive.cloudera.com/cdh5/debian/wheezy/amd64/cdh/archive.key -O archive.key $ sudo apt-key add archive.key
  Ubuntu Precise	$ wget https://archive.cloudera.com/cdh5/ubuntu/precise/amd64/cdh/archive.key -O archive.key $ sudo apt-key add archive.key
  Ubuntu Lucid	$ wget https://archive.cloudera.com/cdh5/ubuntu/lucid/amd64/cdh/archive.key -O archive.key $ sudo apt-key add archive.key
  Ubuntu Trusty	$ wget https://archive.cloudera.com/cdh5/ubuntu/trusty/amd64/cdh/archive.key -O archive.key $ sudo apt-key add archive.key

This key enables you to verify that you are downloading genuine packages.

  Note: Skip this step if you intend to use only MRv1. Directions for installing MRv1 are in Step 4.

To install CDH 5 with YARN:

  Note: When configuring HA for the NameNode, do not install hadoop-hdfs-secondarynamenode. After completing the HA software configuration, follow the installation instructions under Deploying HDFS High Availability.

1. Install and deploy ZooKeeper.
     Important: Cloudera recommends that you install (or update) and start a ZooKeeper cluster before proceeding. This is a requirement if you are deploying high availability (HA) for the NameNode.

   Follow instructions under ZooKeeper Installation.

2. Install each type of daemon package on the appropriate systems(s), as follows.

   Where to install	Install commands
   Resource Manager host (analogous to MRv1 JobTracker) running:
   RHEL/CentOS compatible	sudo yum clean all; sudo yum install hadoop-yarn-resourcemanager
   SLES	sudo zypper clean --all; sudo zypper install hadoop-yarn-resourcemanager
   Ubuntu or Debian	sudo apt-get update; sudo apt-get install hadoop-yarn-resourcemanager
   NameNode host running:
   RHEL/CentOS compatible	sudo yum clean all; sudo yum install hadoop-hdfs-namenode
   SLES	sudo zypper clean --all; sudo zypper install hadoop-hdfs-namenode
   Ubuntu or Debian	sudo apt-get install hadoop-hdfs-namenode
   Secondary NameNode host (if used) running:
   RHEL/CentOS compatible	sudo yum clean all; sudo yum install hadoop-hdfs-secondarynamenode
   SLES	sudo zypper clean --all; sudo zypper install hadoop-hdfs-secondarynamenode
   Ubuntu or Debian	sudo apt-get install hadoop-hdfs-secondarynamenode
   All cluster hosts except the Resource Manager running:
   RHEL/CentOS compatible	sudo yum clean all; sudo yum install hadoop-yarn-nodemanager hadoop-hdfs-datanode hadoop-mapreduce
   SLES	sudo zypper clean --all; sudo zypper install hadoop-yarn-nodemanager hadoop-hdfs-datanode hadoop-mapreduce
   Ubuntu or Debian	sudo apt-get install hadoop-yarn-nodemanager hadoop-hdfs-datanode hadoop-mapreduce
   One host in the cluster running:
   RHEL/CentOS compatible	sudo yum clean all; sudo yum install hadoop-mapreduce-historyserver hadoop-yarn-proxyserver
   SLES	sudo zypper clean --all; sudo zypper install hadoop-mapreduce-historyserver hadoop-yarn-proxyserver
   Ubuntu or Debian	sudo apt-get install hadoop-mapreduce-historyserver hadoop-yarn-proxyserver
   All client hosts running:
   RHEL/CentOS compatible	sudo yum clean all; sudo yum install hadoop-client
   SLES	sudo zypper clean --all; sudo zypper install hadoop-client
   Ubuntu or Debian	sudo apt-get install hadoop-client

  Note: The hadoop-yarn and hadoop-hdfs packages are installed on each system automatically as dependencies of the other packages.

  Note: If installing both MRv1 and YARN, do not install packages that you already installed in Step 3: Install CDH 5 with YARN. If installing YARN only, skip this step and go to Step 3: Install CDH 5 with YARN.

  Important: Before proceeding, you need to decide:

• Whether to configure High Availability (HA) for the NameNode or JobTracker; see the High Availability for more information and instructions.
• Where to deploy the NameNode, Secondary NameNode, and JobTracker daemons. As a general rule:
  • The NameNode and JobTracker run on the same "master" host unless the cluster is large (more than a few tens of nodes), and the master host (or hosts) should not run the Secondary NameNode (if used), DataNode or TaskTracker services.
  • In a large cluster, it is especially important that the Secondary NameNode (if used) runs on a separate machine from the NameNode.
  • Each node in the cluster except the master host(s) should run the DataNode and TaskTracker services.

If you decide to configure HA for the NameNode, do not install hadoop-hdfs-secondarynamenode. After completing the HA software configuration, follow the installation instructions under Deploying HDFS High Availability.

First, install and deploy ZooKeeper.

  Important: Cloudera recommends that you install (or update) and start a ZooKeeper cluster before proceeding. This is a requirement if you are deploying high availability (HA) for the NameNode or JobTracker.

Follow instructions under ZooKeeper Installation. Make sure you create the myid file in the data directory, as instructed, if you are starting a ZooKeeper ensemble after a fresh install.

Next, install packages.

Install each type of daemon package on the appropriate systems(s), as follows.

  Note: Ubuntu systems may try to start the service immediately after you install it. This should fail harmlessly, but you can find information at askubuntu on how to prevent this.

Where to install	Install commands
JobTracker host running:
RHEL/CentOS compatible	sudo yum clean all; sudo yum install hadoop-0.20-mapreduce-jobtracker
SLES	sudo zypper clean --all; sudo zypper install hadoop-0.20-mapreduce-jobtracker
Ubuntu or Debian	sudo apt-get update; sudo apt-get install hadoop-0.20-mapreduce-jobtracker
NameNode host running:
RHEL/CentOS compatible	sudo yum clean all; sudo yum install hadoop-hdfs-namenode
SLES	sudo zypper clean --all; sudo zypper install hadoop-hdfs-namenode
Ubuntu or Debian	sudo apt-get install hadoop-hdfs-namenode
Secondary NameNode host (if used) running:
RHEL/CentOS compatible	sudo yum clean all; sudo yum install hadoop-hdfs-secondarynamenode
SLES	sudo zypper clean --all; sudo zypper install hadoop-hdfs-secondarynamenode
Ubuntu or Debian	sudo apt-get install hadoop-hdfs-secondarynamenode
All cluster hosts except the JobTracker, NameNode, and Secondary (or Standby) NameNode hosts running:
RHEL/CentOS compatible	sudo yum clean all; sudo yum install hadoop-0.20-mapreduce-tasktracker hadoop-hdfs-datanode
SLES	sudo zypper clean --all; sudo zypper install hadoop-0.20-mapreduce-tasktracker hadoop-hdfs-datanode
Ubuntu or Debian	sudo apt-get install hadoop-0.20-mapreduce-tasktracker hadoop-hdfs-datanode
All client hosts running:
RHEL/CentOS compatible	sudo yum clean all; sudo yum install hadoop-client
SLES	sudo zypper clean --all; sudo zypper install hadoop-client
Ubuntu or Debian	sudo apt-get install hadoop-client

This section explains how to install LZO ( Lempel–Ziv–Oberhumer) compression. For more information, see Choosing and Configuring Data Compression

  Note: If upgrading (rather than installing for the first time), remove the old LZO version first. For example, on a RHEL system:

yum remove hadoop-lzo

1. Add the repository on each host in the cluster. Follow the instructions for your OS version:

   For OS Version	Do this
   RHEL/CentOS/Oracle 5	Go to this link and save the file in the /etc/yum.repos.d/ directory.
   RHEL/CentOS/Oracle 6	Go to this link and save the file in the /etc/yum.repos.d/ directory.
   RHEL/CentOS/Oracle 7	Go to this link and save the file in the /etc/yum.repos.d/ directory.
   SLES	Run the following command: $ sudo zypper addrepo -f https://archive.cloudera.com/gplextras5/sles/11/x86_64/gplextras/ cloudera-gplextras5.repo Update your system package index by running: $ sudo zypper refresh
   Ubuntu or Debian	Go to this link and save the file as /etc/apt/sources.list.d/gplextras.list.   Important: Make sure you do not let the file name default to cloudera.list, as that will overwrite your existing cloudera.list.

2. Install the package on each host as follows:

   For OS version	Install commands
   RHEL/CentOS compatible	sudo yum install hadoop-lzo
   SLES	sudo zypper install hadoop-lzo
   Ubuntu or Debian	sudo apt-get install hadoop-lzo

3. Continue with installing and deploying CDH. As part of the deployment, you will need to do some additional configuration for LZO, as shown under Configuring LZO.
     Important: Be sure to do this configuration after you have copied the default configuration files to a custom location and set alternatives to point to it.

Proceed with:

• deploying CDH 5
• installing components.