Install hue 3.5 with tarball realese

EVN:  ubuntu 12.04/13.01   hadoop2.x.0   hue3.5.0    pig0.12.0  hive0.12.0  sqoop1.99.3 

         oozie4.0.0  hbase0.98.0

 

-

• Prepare evn

-----------------

#sudo apt-get update

#sudo apt-get install libxml2-dev

#sudo apt-get install libxslt-dev

#sudo apt-get install libsasl2-dev

#sudo apt-get install libsasl2-modules-gssapi-mit

#sudo apt-get install libmysqlclient-dev

#sudo apt-get install python-dev

#sudo apt-get install python-setuptools

#sudo apt-get install python-simplejson

#sudo apt-get install libsqlite3-dev

 

the remaining packages can't be installed (uable to locate package)

cyrus-sasl-devel  cyrus-sasl-gssapi  krb5-devel  libtidy  openldap-devel

 

but the similar packages can be installed correctly.

        libsasl2-dev libsasl2-modules-gssapi-mit  libtidy-0.99-0     libkrb5-dev   libldap2-dev 

The dependency relations are wrong in the official site. Using the dependencies listed in the left column in

http://cloudera.github.io/hue/docs-3.5.0/manual.html

------------------

• Install

#tar -xzvf hue-3.5.0.tar.gz

#cd hue-3.5.0

 

#PREFIX=/usr/share make install

produce errors, can't install sucessfully.

 

 

solution:

32位
sudo ln -fs /usr/lib/python2.7/plat-i386-linux-gnu/_sysconfigdata_nd.py /usr/lib/python2.7/
64位
sudo ln -fs /usr/lib/python2.7/plat-x86_64-linux-gnu/_sysconfigdata_nd.py /usr/lib/python2.7/

similar errors:

http://www.marshut.com/irrnwm/hue-make-error.html#irtpyi

 https://issues.cloudera.org/browse/HUE-1672

https://github.com/pypa/virtualenv/issues/410

 

but there still has an error:

 

 solution:

#PREFIX=/home/zhj make install

 

------------------

• Configuration

Listing all Configuration Options

$ /path/to/hue/build/env/bin/hue config_help | less

Hue configuration fie dir is:    /path/to/hue/desktop/conf

 

hue.ini  log4j.properties  log.conf

 

-------------------------- hue conf  hue.ini ------------------------------

# Configuration for HDFS NameNode

fs_defaultfs=hdfs://192.168.122.1:2014

logical_name=hdfs://192.168.122.1:2014

webhdfs_url=http://192.168.122.1:50070/webhdfs/v1

 

# Configuration for YARN (MR2)

resourcemanager_host=192.168.122.1

resourcemanager_port=2015

resourcemanager_api_url=http://192.168.122.1:2019

history_server_api_url=http://192.168.122.1:10020  // => mapreduce.jobhistory.address (mapred-site.xml)

 

# Settings to configure Sqoop

server_url=http://192.168.122.1:12000/sqoop

 

# Settings to configure Pig
local_sample_dir=/home/zhaohj/hadoop/pig-0.12.0/contrib/piggybank/java

remote_data_dir=/user/hue/pig/piggybank

 

# Settings to configure Beeswax with Hive

hive_server_host=192.168.122.1

hive_server_port=10000
hive_conf_dir=/home/zhaohj/hadoop/hive-0.12.0-bin/conf

hive_home_dir=/home/zhaohj/hadoop/hive-0.12.0-bin

hive_server_bin=/home/zhaohj/hadoop/hive-0.12.0-bin/bin/hiveserver2

 

# Settings for the User Admin application
default_user_group=supergroup

 

# Settings to configure the Zookeeper application.

host_ports=host.dataminer:2181,f1.zhj:2181,f2.zhj:2181

rest_url=http://host.dataminer:9998

 

 

---------------- hadoop conf hdfs-site.xml -------------

<property>
  <name>dfs.webhdfs.enabled</name>
  <value>true</value>
</property>

 

---------------- hadoop conf core-site.xml -------------

<property>
  <name>hadoop.proxyuser.hue.hosts</name>
  <value>*</value>
</property>
<property>
  <name>hadoop.proxyuser.hue.groups</name>
  <value>*</value>
</property>

 

If you place your Hue Server outside the Hadoop cluster, you can run an HttpFS server to provide Hue access to HDFS. The HttpFS service requires only one port to be opened to the cluster.

---------------- hadoop conf httpfs-site.xml -------------

<property>
  <name>httpfs.proxyuser.hue.hosts</name>
  <value>*</value>
</property>
<property>
  <name>httpfs.proxyuser.hue.groups</name>
  <value>*</value>
</property>

 

 

• Set Path and Start Hue

append the following two lines to the end of ~/.bashrc

export HUE_HOME=/home/zhaohj/hadoop/hue

export PATH=$HUE_HOME/build/env/bin:$PATH

#source ~/.bashrc

 

You maybe need to install sqoop, pig, hive, hbase,spark,impala,zookeeper,ooize or others related software

#sqoop.sh server start

#hiveserver2

 

-------

start Hue by command:

#supervisor 

 

You can now access Hue by the url

http://localhost:8888/

 

 ---------------------------------------------------------------------------------------------------------

The above steps succues on ubuntu12.04 but faild on Centos 6

some dependencies han't installed.

 

 

# yum install cyrus-sasl-plain

 

 

http://grokbase.com/p/cloudera/hue-user/13aq9ntmg8/hiveserver2-configuration-for-hue-3-0

 

 

references:

http://cloudera.github.io/hue/docs-3.5.0/manual.html

http://doc.mapr.com/display/MapR/Installing+Hue

https://help.ubuntu.com/10.04/serverguide/kerberos.html

http://archive.cloudera.com/cdh/3/hue/manual.html