(Optional) Manually Install CDH and Managed Service Packages
The procedures in this topic are an optional part of the Path B Installation instructions. Begin with the steps in Installation Path B - Installation Using Cloudera Manager Parcels or Packages before following the steps in this topic. For an overview of the installation process, see Installation Overview.
The CDH and Managed Service Packages contain all of the CDH software. You can choose to manually install CDH and the Managed Service Packages, or you can choose to let Cloudera Manager perform this installation in a later step. Otherwise, follow the steps in this topic to manually install CDH and Managed Service packages and then continue the installation with Start the Cloudera Manager Server.
Install CDH 5 and Managed Service Packages
Install the packages on all cluster hosts using the following steps:
- Red Hat
- Download and install the "1-click Install" package.
- Download the CDH 5 "1-click Install" package (or RPM).
Click the appropriate RPM and Save File to a directory with write access (for example, your home directory).
OS Version Link to CDH 5 RPM RHEL/CentOS/Oracle 5 RHEL/CentOS/Oracle 5 link RHEL/CentOS/Oracle 6 RHEL/CentOS/Oracle 6 link RHEL/CentOS/Oracle 7 RHEL/CentOS/Oracle 7 link - Install the RPM for all RHEL versions:
$ sudo yum --nogpgcheck localinstall cloudera-cdh-5-0.x86_64.rpm
- Download the CDH 5 "1-click Install" package (or RPM).
- (Optionally) add a repository key:
- Red Hat/CentOS/Oracle 5
$ sudo rpm --import https://archive.cloudera.com/cdh5/redhat/5/x86_64/cdh/RPM-GPG-KEY-cloudera
- Red Hat/CentOS/Oracle 6
$ sudo rpm --import https://archive.cloudera.com/cdh5/redhat/6/x86_64/cdh/RPM-GPG-KEY-cloudera
- Red Hat/CentOS/Oracle 5
- Install the CDH packages:
$ sudo yum clean all $ sudo yum install avro-tools crunch flume-ng hadoop-hdfs-fuse hadoop-hdfs-nfs3 hadoop-httpfs hadoop-kms hbase-solr hive-hbase hive-webhcat hue-beeswax hue-hbase hue-impala hue-pig hue-plugins hue-rdbms hue-search hue-spark hue-sqoop hue-zookeeper impala impala-shell kite llama mahout oozie pig pig-udf-datafu search sentry solr-mapreduce spark-core spark-master spark-worker spark-history-server spark-python sqoop sqoop2 whirr
Note: Installing these packages also installs all the other CDH packages required for a full CDH 5 installation.
- Download and install the "1-click Install" package.
- SLES
- Download and install the "1-click Install" package.
- Download the CDH 5 "1-click Install" package.
Download the rpm file, choose Save File, and save it to a directory to which you have write access (for example, your home directory).
- Install the RPM:
$ sudo rpm -i cloudera-cdh-5-0.x86_64.rpm
- Update your system package index by running:
$ sudo zypper refresh
- Download the CDH 5 "1-click Install" package.
- (Optionally) add a repository key:
$ sudo rpm --import https://archive.cloudera.com/cdh5/sles/11/x86_64/cdh/RPM-GPG-KEY-cloudera
- Install the CDH packages:
$ sudo zypper clean --all $ sudo zypper install avro-tools crunch flume-ng hadoop-hdfs-fuse hadoop-hdfs-nfs3 hadoop-httpfs hadoop-kms hbase-solr hive-hbase hive-webhcat hue-beeswax hue-hbase hue-impala hue-pig hue-plugins hue-rdbms hue-search hue-spark hue-sqoop hue-zookeeper impala impala-shell kite llama mahout oozie pig pig-udf-datafu search sentry solr-mapreduce spark-core spark-master spark-worker spark-history-server spark-python sqoop sqoop2 whirr
Note: Installing these packages also installs all the other CDH packages required for a full CDH 5 installation.
- Download and install the "1-click Install" package.
- Ubuntu and Debian
- Download and install the "1-click Install" package
- Download the CDH 5 "1-click Install" package:
OS Version Package Link Jessie Jessie package Wheezy Wheezy package Precise Precise package Trusty Trusty package - Install the package by doing one of the following:
- Choose Open with in the download window to use the package manager.
- Choose Save File, save the package to a directory to which you have write access (for example, your home directory), and install it from the command line.
For example:
sudo dpkg -i cdh5-repository_1.0_all.deb
- Download the CDH 5 "1-click Install" package:
- Optionally add a repository key:
- Debian Wheezy
$ curl -s https://archive.cloudera.com/cdh5/debian/wheezy/amd64/cdh/archive.key | sudo apt-key add -
- Ubuntu Precise
$ curl -s https://archive.cloudera.com/cdh5/ubuntu/precise/amd64/cdh/archive.key | sudo apt-key add -
- Debian Wheezy
- Install the CDH packages:
$ sudo apt-get update $ sudo apt-get install avro-tools crunch flume-ng hadoop-hdfs-fuse hadoop-hdfs-nfs3 hadoop-httpfs hadoop-kms hbase-solr hive-hbase hive-webhcat hue-beeswax hue-hbase hue-impala hue-pig hue-plugins hue-rdbms hue-search hue-spark hue-sqoop hue-zookeeper impala impala-shell kite llama mahout oozie pig pig-udf-datafu search sentry solr-mapreduce spark-core spark-master spark-worker spark-history-server spark-python sqoop sqoop2 whirr
Note: Installing these packages also installs all the other CDH packages required for a full CDH 5 installation.
- Download and install the "1-click Install" package
Install CDH 4, Impala, and Solr Managed Service Packages
Install the packages on all cluster hosts using the following steps:
- RHEL-compatible
- Click the entry in the table at CDH Download Information that matches your RHEL or CentOS system.
- Go to the repo file (cloudera-cdh4.repo) for your system and save it in the /etc/yum.repos.d/ directory.
- Optionally add a repository key:
- RHEL/CentOS/Oracle 5
$ sudo rpm --import https://archive.cloudera.com/cdh4/redhat/5/x86_64/cdh/RPM-GPG-KEY-cloudera
- RHEL/CentOS 6
$ sudo rpm --import https://archive.cloudera.com/cdh4/redhat/6/x86_64/cdh/RPM-GPG-KEY-cloudera
- RHEL/CentOS/Oracle 5
- Install packages on every host in your cluster:
- Install CDH 4 packages:
$ sudo yum -y install bigtop-utils bigtop-jsvc bigtop-tomcat hadoop hadoop-hdfs hadoop-httpfs hadoop-mapreduce hadoop-yarn hadoop-client hadoop-0.20-mapreduce hue-plugins hbase hive oozie oozie-client pig zookeeper
- To install the hue-common package and all Hue applications on the Hue host, install the hue meta-package:
$ sudo yum install hue
- Install CDH 4 packages:
- (Requires CDH 4.2 and higher) Install Impala
- In the table at Cloudera Impala Version and Download Information, click the entry that matches your RHEL or CentOS system.
- Go to the repo file for your system and save it in the /etc/yum.repos.d/ directory.
- Install Impala and the Impala Shell on Impala machines:
$ sudo yum -y install impala impala-shell
- (Requires CDH 4.3 and higher) Install Search
- In the table at Cloudera Search Version and Download Information, click the entry that matches your RHEL or CentOS system.
- Go to the repo file for your system and save it in the /etc/yum.repos.d/ directory.
- Install the Solr Server on machines where you want Cloudera Search.
$ sudo yum -y install solr-server
- SLES
- Run the following command:
$ sudo zypper addrepo -f https://archive.cloudera.com/cdh4/sles/11/x86_64/cdh/cloudera-cdh4.repo
- Update your system package index by running:
$ sudo zypper refresh
- Optionally add a repository key:
$ sudo rpm --import https://archive.cloudera.com/cdh4/sles/11/x86_64/cdh/RPM-GPG-KEY-cloudera
- Install packages on every host in your cluster:
- Install CDH 4 packages:
$ sudo zypper install bigtop-utils bigtop-jsvc bigtop-tomcat hadoop hadoop-hdfs hadoop-httpfs hadoop-mapreduce hadoop-yarn hadoop-client hadoop-0.20-mapreduce hue-plugins hbase hive oozie oozie-client pig zookeeper
- To install the hue-common package and all Hue applications on the Hue host, install the hue meta-package:
$ sudo zypper install hue
- (Requires CDH 4.2 and higher) Install Impala
- Run the following command:
$ sudo zypper addrepo -f https://archive.cloudera.com/impala/sles/11/x86_64/impala/cloudera-impala.repo
- Install Impala and the Impala Shell on Impala machines:
$ sudo zypper install impala impala-shell
- Run the following command:
- (Requires CDH 4.3 and higher) Install Search
- Run the following command:
$ sudo zypper addrepo -f https://archive.cloudera.com/search/sles/11/x86_64/search/cloudera-search.repo
- Install the Solr Server on machines where you want Cloudera Search.
$ sudo zypper install solr-server
- Run the following command:
- Install CDH 4 packages:
- Run the following command:
- Ubuntu or Debian
- In the table at CDH Version and Packaging Information, click the entry that matches your Ubuntu or Debian system.
- Go to the list file (cloudera.list) for your system and save it in the /etc/apt/sources.list.d/ directory. For
example, to install CDH 4 for 64-bit Ubuntu Lucid, your cloudera.list file should look like:
deb [arch=amd64] https://archive.cloudera.com/cdh4/ubuntu/lucid/amd64/cdh lucid-cdh4 contrib deb-src https://archive.cloudera.com/cdh4/ubuntu/lucid/amd64/cdh lucid-cdh4 contrib
- Optionally add a repository key:
- Ubuntu Lucid
$ curl -s https://archive.cloudera.com/cdh4/ubuntu/lucid/amd64/cdh/archive.key | sudo apt-key add -
- Ubuntu Precise
$ curl -s https://archive.cloudera.com/cdh4/ubuntu/precise/amd64/cdh/archive.key | sudo apt-key add -
- Debian Squeeze
$ curl -s https://archive.cloudera.com/cdh4/debian/squeeze/amd64/cdh/archive.key | sudo apt-key add -
- Ubuntu Lucid
- Install packages on every host in your cluster:
- Install CDH 4 packages:
$ sudo apt-get install bigtop-utils bigtop-jsvc bigtop-tomcat hadoop hadoop-hdfs hadoop-httpfs hadoop-mapreduce hadoop-yarn hadoop-client hadoop-0.20-mapreduce hue-plugins hbase hive oozie oozie-client pig zookeeper
- To install the hue-common package and all Hue applications on the Hue host, install the hue meta-package:
$ sudo apt-get install hue
- (Requires CDH 4.2 and higher) Install Impala
- In the table at Cloudera Impala Version and Download Information, click the entry that matches your Ubuntu or Debian system.
- Go to the list file for your system and save it in the /etc/apt/sources.list.d/ directory.
- Install Impala and the Impala Shell on Impala machines:
$ sudo apt-get install impala impala-shell
- (Requires CDH 4.3 and higher) Install Search
- In the table at Cloudera Search Version and Download Information, click the entry that matches your Ubuntu or Debian system.
- Install Solr Server on machines where you want Cloudera Search:
$ sudo apt-get install solr-server
- Install CDH 4 packages:
Continue the installation with Start the Cloudera Manager Server.