cloudera hadoop

阅读更多

install jdk with java

1. wget -O  jdk-6u13-linux-i586-rpm.bin http://cds.sun.com/is-bin/INTERSHOP.enfinity/WFS/CDS-CDS_Developer-Site/en_US/-/USD/VerifyItem-Start/jdk-6u13-linux-i586-rpm.bin?BundledLineItemUUID=BgxIBe.nDowAAAEgJxhuTup0&OrderID=OEdIBe.n_M0AAAEgGhhuTup0&ProductID=RGtIBe.ou1AAAAEfpVYcydOO&FileName=/jdk-6u13-linux-i586-rpm.bin

2. chmod +x  jdk-6u13-linux-i586-rpm.bin

3. ./jdk-6u13-linux-i586-rpm.bin

Configuring Yum

Adding the Cloudera Repository
1. vi /etc/yum.repos.d/cloudera.repo

###add
[cloudera]
name=Cloudera
baseurl=http://cloudera-yum.s3.amazonaws.com/
gpgcheck=0
enabled=1

2. yum repolist | grep cloudera

3. yum search hadoop


Installing Hadoop (Standalone Mode)

1. yum install hadoop -y

2. yum install hadoop-conf-pseudo -y

3.  /sbin/service hadoop-namenode start
4.  /sbin/service hadoop-secondarynamenode start
5. /sbin/service hadoop-datanode start
6. /sbin/service hadoop-jobtracker start
7. /sbin/service hadoop-tasktracker start

8 .
# /sbin/chkconfig hadoop-namenode on
# /sbin/chkconfig hadoop-secondarynamenode on
# /sbin/chkconfig hadoop-datanode on
# /sbin/chkconfig hadoop-jobtracker on
# /sbin/chkconfig hadoop-tasktracker on
9. /sbin/chkconfig --list | grep hadoop



10 .yum install hadoop-pig -y

11. yum install hadoop-hive -y

Running an example Hadoop job



Make and Install hypertable on server

1. install hypertable dependcy library

2. make and install hypertable

3. cp /usr/lib/hadoop/hadoop-0.18.3-core.jar .



##############Source Page

http://www.cloudera.com/hadoop-rpm#other_hadoop_rpms

### 09 09 28 Update

If you are running on a Redhat-based system, you can easily download our software using yum. You can also just download the RPMs directory from http://archive.cloudera.com/redhat/cdh.

Setting up Yum access

   1. Add the Yum repository of your choice. Download the [url=http://archive.cloudera.com/redhat/cdh/cloudera-stable.repo]
cloudera-stable.repo
[/url]
or
[url=http://archive.cloudera.com/redhat/cdh/cloudera-testing.repo]
cloudera-testing.repo
[/url]
file and drop it ito your /etc/yum.repos.d/ directory.
   2.

      Update the Yum package index. Simple run:

      sudo yum update yum

   3.

      Find and install packages. For example:

      yum search hadoop
      yum install hadoop-0.20