以下记录为启动HDFS和YARN环境时的过程中的中间过程输出,节点注册 和 HDFS文件系统的数据变化日志等。
(1)执行HDFS文件系统格式化
[bruce@iRobot hadoop]$ $HADOOP_PREFIX/bin/hdfs namenode -format
15/11/19 13:55:39 INFO namenode.NameNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG: host = iRobot/192.168.100.200
STARTUP_MSG: args = [-format]
STARTUP_MSG: version = 2.0.0-cdh4.5.0
STARTUP_MSG: classpath = /home/bruce/hadoop-install/hadoop/etc/hadoop:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-digester-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.6.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jackson-mapper-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/slf4j-api-1.6.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-logging-1.1.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jackson-jaxrs-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/activation-1.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/zookeeper-3.4.5-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jsr305-1.3.9.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-el-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/protobuf-java-2.4.0a.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/xmlenc-0.52.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jersey-core-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jasper-runtime-5.5.23.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-io-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jersey-json-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jettison-1.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/kfs-0.3.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jetty-util-6.1.26.cloudera.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jetty-6.1.26.cloudera.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/junit-4.8.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/mockito-all-1.8.5.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jsch-0.1.42.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jsp-api-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/guava-11.0.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jline-0.9.94.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-collections-3.2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jets3t-0.6.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/log4j-1.2.17.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-httpclient-3.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-net-3.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jackson-core-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/xz-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/hadoop-auth-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-cli-1.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-lang-2.5.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/cloudera-jets3t-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-compress-1.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/asm-3.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-codec-1.4.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/stax-api-1.0.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/servlet-api-2.5.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jackson-xc-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/paranamer-2.3.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/hadoop-annotations-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jersey-server-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-configuration-1.6.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-math-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jasper-compiler-5.5.23.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/avro-1.7.4.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/hadoop-common-2.0.0-cdh4.5.0-tests.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/hadoop-common-2.0.0-cdh4.5.0-sources.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/hadoop-common-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/hadoop-common-2.0.0-cdh4.5.0-test-sources.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jackson-mapper-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-logging-1.1.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/zookeeper-3.4.5-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jsr305-1.3.9.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-el-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/protobuf-java-2.4.0a.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jersey-core-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jasper-runtime-5.5.23.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-io-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jetty-util-6.1.26.cloudera.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jetty-6.1.26.cloudera.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jsp-api-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/guava-11.0.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jline-0.9.94.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jackson-core-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-lang-2.5.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/asm-3.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-daemon-1.0.3.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jersey-server-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.0.0-cdh4.5.0-tests.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.0.0-cdh4.5.0-sources.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.0.0-cdh4.5.0-test-sources.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jackson-mapper-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/guice-3.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/aopalliance-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/protobuf-java-2.4.0a.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jersey-core-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/commons-io-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/log4j-1.2.17.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jackson-core-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/xz-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jersey-guice-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/asm-3.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/netty-3.2.4.Final.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/javax.inject-1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/paranamer-2.3.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/snappy-java-1.0.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/hadoop-annotations-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jersey-server-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/avro-1.7.4.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-2.0.0-cdh4.5.0-tests.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-client-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-site-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-common-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-api-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/guice-3.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/protobuf-java-2.4.0a.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/jersey-core-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/commons-io-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/jackson-core-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/xz-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/jersey-guice-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/asm-3.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/netty-3.2.4.Final.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/javax.inject-1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/hadoop-annotations-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/jersey-server-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.0.0-cdh4.5.0-tests.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/contrib/capacity-scheduler/*.jar
STARTUP_MSG: build = file:///var/lib/jenkins/workspace/CDH4.5.0-Packaging-Hadoop/build/cdh4/hadoop/2.0.0-cdh4.5.0/source/hadoop-common-project/hadoop-common -r 30821ec616ee7a21ee8447949b7c6208a8f1e7d8; compiled by 'jenkins' on Wed Nov 20 14:35:49 PST 2013
STARTUP_MSG: java = 1.6.0_21
************************************************************/
15/11/19 13:55:39 INFO namenode.NameNode: registered UNIX signal handlers for [TERM, HUP, INT]
15/11/19 13:55:39 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: CID-4fb81ac3-7e61-42c2-a707-46f2af89a6e2
15/11/19 13:55:39 INFO blockmanagement.HeartbeatManager: Setting heartbeat recheck interval to 30000 since dfs.namenode.stale.datanode.interval is less than dfs.namenode.heartbeat.recheck-interval
15/11/19 13:55:39 INFO namenode.HostFileManager: read includes:
HostSet(
)
15/11/19 13:55:39 INFO namenode.HostFileManager: read excludes:
HostSet(
)
15/11/19 13:55:39 INFO blockmanagement.DatanodeManager: dfs.block.invalidate.limit=1000
15/11/19 13:55:39 INFO blockmanagement.BlockManager: dfs.block.access.token.enable=false
15/11/19 13:55:39 INFO blockmanagement.BlockManager: defaultReplication = 1
15/11/19 13:55:39 INFO blockmanagement.BlockManager: maxReplication = 512
15/11/19 13:55:39 INFO blockmanagement.BlockManager: minReplication = 1
15/11/19 13:55:39 INFO blockmanagement.BlockManager: maxReplicationStreams = 2
15/11/19 13:55:39 INFO blockmanagement.BlockManager: shouldCheckForEnoughRacks = false
15/11/19 13:55:39 INFO blockmanagement.BlockManager: replicationRecheckInterval = 3000
15/11/19 13:55:39 INFO blockmanagement.BlockManager: encryptDataTransfer = false
15/11/19 13:55:39 INFO blockmanagement.BlockManager: maxNumBlocksToLog = 1000
15/11/19 13:55:39 INFO namenode.FSNamesystem: fsOwner = bruce (auth:SIMPLE)
15/11/19 13:55:39 INFO namenode.FSNamesystem: supergroup = oinstall
15/11/19 13:55:39 INFO namenode.FSNamesystem: isPermissionEnabled = false
15/11/19 13:55:39 INFO namenode.FSNamesystem: HA Enabled: false
15/11/19 13:55:39 INFO namenode.FSNamesystem: Append Enabled: true
15/11/19 13:55:40 INFO namenode.NameNode: Caching file names occuring more than 10 times
15/11/19 13:55:40 INFO namenode.FSNamesystem: dfs.namenode.safemode.threshold-pct = 0.9990000128746033
15/11/19 13:55:40 INFO namenode.FSNamesystem: dfs.namenode.safemode.min.datanodes = 0
15/11/19 13:55:40 INFO namenode.FSNamesystem: dfs.namenode.safemode.extension = 30000
15/11/19 13:55:40 INFO namenode.NNStorage: Storage directory /u01/hadoopdata/hadoop-bruce/dfs/name has been successfully formatted.
15/11/19 13:55:40 INFO namenode.FSImage: Saving image file /u01/hadoopdata/hadoop-bruce/dfs/name/current/fsimage.ckpt_0000000000000000000 using no compression
15/11/19 13:55:40 INFO namenode.FSImage: Image file of size 116 saved in 0 seconds.
15/11/19 13:55:40 INFO namenode.NNStorageRetentionManager: Going to retain 1 images with txid >= 0
15/11/19 13:55:40 INFO util.ExitUtil: Exiting with status 0
15/11/19 13:55:40 INFO namenode.NameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at iRobot/192.168.100.200
************************************************************/
[bruce@iRobot hadoop]$
(2)执行HDFS文件系统格式化后,相应的HDFS下的naemode fsimage产生
[bruce@iRobot hadoop]$ ls -al /u01/hadoopdata/hadoop-bruce/dfs/name/current/
总用量 24
drwxr-xr-x 2 bruce oinstall 4096 11月 19 13:55 .
drwxr-xr-x 3 bruce oinstall 4096 11月 19 13:55 ..
-rw-r--r-- 1 bruce oinstall 116 11月 19 13:55 fsimage_0000000000000000000
-rw-r--r-- 1 bruce oinstall 62 11月 19 13:55 fsimage_0000000000000000000.md5
-rw-r--r-- 1 bruce oinstall 2 11月 19 13:55 seen_txid
-rw-r--r-- 1 bruce oinstall 206 11月 19 13:55 VERSION
[bruce@iRobot hadoop]$ cat /u01/hadoopdata/hadoop-bruce/dfs/name/current/VERSION
#Thu Nov 19 13:55:40 CST 2015
namespaceID=337807999
clusterID=CID-4fb81ac3-7e61-42c2-a707-46f2af89a6e2
cTime=0
storageType=NAME_NODE
blockpoolID=BP-981411196-192.168.100.200-1447912540337
layoutVersion=-40
[bruce@iRobot hadoop]$ cat /u01/hadoopdata/hadoop-bruce/dfs/name/current/seen_txid
0
[bruce@iRobot hadoop]$
[bruce@iRobot hadoop]$
[bruce@iRobot hadoop]$ cat /u01/hadoopdata/hadoop-bruce/dfs/name/current/fsimage_0000000000000000000.md5
2014cc5c2a85e352064adb7bc4555fe7 *fsimage_0000000000000000000
[bruce@iRobot hadoop]$
(3)启动NameNode: 产生hadoop-bruce-namenode-iRobot.log, hadoop-bruce-namenode-iRobot.out 和 SecurityAuth-bruce.audit
[bruce@iRobot hadoop]$ $HADOOP_PREFIX/sbin/hadoop-daemon.sh --config $HADOOP_CONF_DIR --script hdfs start namenode
starting namenode, logging to /home/bruce/hadoop-install/hadoop/logs/hadoop-bruce-namenode-iRobot.out
[bruce@iRobot hadoop]$ jps
22880 Bootstrap
24986 Main
6251 Jps
5355 Launcher
5748 Main
6158 NameNode
[bruce@iRobot hadoop]$ ls logs
hadoop-bruce-namenode-iRobot.log hadoop-bruce-namenode-iRobot.out SecurityAuth-bruce.audit
[bruce@iRobot hadoop]$ cat logs/hadoop-bruce-namenode-iRobot.log
2015-11-19 14:02:21,206 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG: host = iRobot/192.168.100.200
STARTUP_MSG: args = []
STARTUP_MSG: version = 2.0.0-cdh4.5.0
STARTUP_MSG: classpath = /home/bruce/hadoop-install/hadoop/etc/hadoop:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-digester-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.6.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jackson-mapper-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/slf4j-api-1.6.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-logging-1.1.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jackson-jaxrs-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/activation-1.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/zookeeper-3.4.5-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jsr305-1.3.9.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-el-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/protobuf-java-2.4.0a.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/xmlenc-0.52.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jersey-core-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jasper-runtime-5.5.23.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-io-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jersey-json-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jettison-1.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/kfs-0.3.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jetty-util-6.1.26.cloudera.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jetty-6.1.26.cloudera.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/junit-4.8.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/mockito-all-1.8.5.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jsch-0.1.42.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jsp-api-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/guava-11.0.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jline-0.9.94.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-collections-3.2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jets3t-0.6.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/log4j-1.2.17.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-httpclient-3.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-net-3.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jackson-core-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/xz-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/hadoop-auth-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-cli-1.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-lang-2.5.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/cloudera-jets3t-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-compress-1.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/asm-3.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-codec-1.4.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/stax-api-1.0.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/servlet-api-2.5.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jackson-xc-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/paranamer-2.3.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/hadoop-annotations-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jersey-server-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-configuration-1.6.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-math-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jasper-compiler-5.5.23.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/avro-1.7.4.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/hadoop-common-2.0.0-cdh4.5.0-tests.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/hadoop-common-2.0.0-cdh4.5.0-sources.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/hadoop-common-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/hadoop-common-2.0.0-cdh4.5.0-test-sources.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jackson-mapper-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-logging-1.1.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/zookeeper-3.4.5-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jsr305-1.3.9.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-el-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/protobuf-java-2.4.0a.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jersey-core-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jasper-runtime-5.5.23.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-io-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jetty-util-6.1.26.cloudera.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jetty-6.1.26.cloudera.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jsp-api-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/guava-11.0.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jline-0.9.94.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jackson-core-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-lang-2.5.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/asm-3.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-daemon-1.0.3.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jersey-server-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.0.0-cdh4.5.0-tests.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.0.0-cdh4.5.0-sources.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.0.0-cdh4.5.0-test-sources.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jackson-mapper-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/guice-3.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/aopalliance-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/protobuf-java-2.4.0a.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jersey-core-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/commons-io-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/log4j-1.2.17.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jackson-core-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/xz-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jersey-guice-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/asm-3.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/netty-3.2.4.Final.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/javax.inject-1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/paranamer-2.3.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/snappy-java-1.0.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/hadoop-annotations-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jersey-server-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/avro-1.7.4.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-2.0.0-cdh4.5.0-tests.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-client-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-site-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-common-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-api-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/guice-3.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/protobuf-java-2.4.0a.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/jersey-core-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/commons-io-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/jackson-core-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/xz-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/jersey-guice-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/asm-3.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/netty-3.2.4.Final.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/javax.inject-1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/hadoop-annotations-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/jersey-server-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.0.0-cdh4.5.0-tests.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/contrib/capacity-scheduler/*.jar:/home/bruce/hadoop-install/hadoop/contrib/capacity-scheduler/*.jar:/home/bruce/hadoop-install/hadoop/contrib/capacity-scheduler/*.jar
STARTUP_MSG: build = file:///var/lib/jenkins/workspace/CDH4.5.0-Packaging-Hadoop/build/cdh4/hadoop/2.0.0-cdh4.5.0/source/hadoop-common-project/hadoop-common -r 30821ec616ee7a21ee8447949b7c6208a8f1e7d8; compiled by 'jenkins' on Wed Nov 20 14:35:49 PST 2013
STARTUP_MSG: java = 1.6.0_21
************************************************************/
2015-11-19 14:02:21,211 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: registered UNIX signal handlers for [TERM, HUP, INT]
2015-11-19 14:02:21,464 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
2015-11-19 14:02:21,543 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
2015-11-19 14:02:21,543 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NameNode metrics system started
2015-11-19 14:02:21,559 WARN org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-11-19 14:02:21,907 WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Only one image storage directory (dfs.namenode.name.dir) configured. Beware of dataloss due to lack of redundant storage directories!
2015-11-19 14:02:21,907 WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Only one namespace edits storage directory (dfs.namenode.edits.dir) configured. Beware of dataloss due to lack of redundant storage directories!
2015-11-19 14:02:21,982 INFO org.apache.hadoop.hdfs.server.blockmanagement.HeartbeatManager: Setting heartbeat recheck interval to 30000 since dfs.namenode.stale.datanode.interval is less than dfs.namenode.heartbeat.recheck-interval
2015-11-19 14:02:21,983 INFO org.apache.hadoop.hdfs.server.namenode.HostFileManager: read includes:
HostSet(
)
2015-11-19 14:02:21,983 INFO org.apache.hadoop.hdfs.server.namenode.HostFileManager: read excludes:
HostSet(
)
2015-11-19 14:02:21,986 INFO org.apache.hadoop.hdfs.server.blockmanagement.DatanodeManager: dfs.block.invalidate.limit=1000
2015-11-19 14:02:21,998 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: dfs.block.access.token.enable=false
2015-11-19 14:02:21,998 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: defaultReplication = 1
2015-11-19 14:02:21,998 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: maxReplication = 512
2015-11-19 14:02:21,998 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: minReplication = 1
2015-11-19 14:02:21,998 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: maxReplicationStreams = 2
2015-11-19 14:02:21,998 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: shouldCheckForEnoughRacks = false
2015-11-19 14:02:21,998 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: replicationRecheckInterval = 3000
2015-11-19 14:02:21,999 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: encryptDataTransfer = false
2015-11-19 14:02:21,999 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: maxNumBlocksToLog = 1000
2015-11-19 14:02:22,004 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: fsOwner = bruce (auth:SIMPLE)
2015-11-19 14:02:22,004 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: supergroup = oinstall
2015-11-19 14:02:22,004 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: isPermissionEnabled = false
2015-11-19 14:02:22,004 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: HA Enabled: false
2015-11-19 14:02:22,008 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Append Enabled: true
2015-11-19 14:02:22,406 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: Caching file names occuring more than 10 times
2015-11-19 14:02:22,408 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: dfs.namenode.safemode.threshold-pct = 0.9990000128746033
2015-11-19 14:02:22,408 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: dfs.namenode.safemode.min.datanodes = 0
2015-11-19 14:02:22,408 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: dfs.namenode.safemode.extension = 30000
2015-11-19 14:02:22,436 INFO org.apache.hadoop.hdfs.server.common.Storage: Lock on /u01/hadoopdata/hadoop-bruce/dfs/name/in_use.lock acquired by nodename 6158@iRobot
2015-11-19 14:02:22,513 INFO org.apache.hadoop.hdfs.server.namenode.FileJournalManager: Recovering unfinalized segments in /u01/hadoopdata/hadoop-bruce/dfs/name/current
2015-11-19 14:02:22,516 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: No edit log streams selected.
2015-11-19 14:02:22,522 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Loading image file /u01/hadoopdata/hadoop-bruce/dfs/name/current/fsimage_0000000000000000000 using no compression
2015-11-19 14:02:22,522 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Number of files = 1
2015-11-19 14:02:22,523 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Number of files under construction = 0
2015-11-19 14:02:22,523 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Image file of size 116 loaded in 0 seconds.
2015-11-19 14:02:22,524 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Loaded image for txid 0 from /u01/hadoopdata/hadoop-bruce/dfs/name/current/fsimage_0000000000000000000
2015-11-19 14:02:22,528 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Starting log segment at 1
2015-11-19 14:02:22,640 INFO org.apache.hadoop.hdfs.server.namenode.NameCache: initialized with 0 entries 0 lookups
2015-11-19 14:02:22,641 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Finished loading FSImage in 231 msecs
2015-11-19 14:02:22,796 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 9000
2015-11-19 14:02:22,821 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Registered FSNamesystemState MBean
2015-11-19 14:02:22,838 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Number of blocks under construction: 0
2015-11-19 14:02:22,839 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: initializing replication queues
2015-11-19 14:02:22,853 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: Total number of blocks = 0
2015-11-19 14:02:22,853 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: Number of invalid blocks = 0
2015-11-19 14:02:22,853 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: Number of under-replicated blocks = 0
2015-11-19 14:02:22,853 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: Number of over-replicated blocks = 0
2015-11-19 14:02:22,853 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: Number of blocks being written = 0
2015-11-19 14:02:22,853 INFO org.apache.hadoop.hdfs.StateChange: STATE* Replication Queue initialization scan for invalid, over- and under-replicated blocks completed in 14 msec
2015-11-19 14:02:22,853 INFO org.apache.hadoop.hdfs.StateChange: STATE* Leaving safe mode after 0 secs
2015-11-19 14:02:22,854 INFO org.apache.hadoop.hdfs.StateChange: STATE* Network topology has 0 racks and 0 datanodes
2015-11-19 14:02:22,854 INFO org.apache.hadoop.hdfs.StateChange: STATE* UnderReplicatedBlocks has 0 blocks
2015-11-19 14:02:22,915 INFO org.apache.hadoop.http.HttpServer: SSL is enabled on HttpServer at http://0.0.0.0:-1/ - not live
2015-11-19 14:02:22,920 INFO org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2015-11-19 14:02:22,979 INFO org.apache.hadoop.http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-11-19 14:02:22,982 INFO org.apache.hadoop.http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context hdfs
2015-11-19 14:02:22,982 INFO org.apache.hadoop.http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-11-19 14:02:22,982 INFO org.apache.hadoop.http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-11-19 14:02:22,994 INFO org.apache.hadoop.http.HttpServer: dfs.webhdfs.enabled = true
2015-11-19 14:02:22,995 INFO org.apache.hadoop.http.HttpServer: Added filter 'SPNEGO' (class=org.apache.hadoop.hdfs.web.AuthFilter)
2015-11-19 14:02:22,997 INFO org.apache.hadoop.http.HttpServer: addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.namenode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
2015-11-19 14:02:23,010 INFO org.apache.hadoop.http.HttpServer: Jetty bound to port 50070
2015-11-19 14:02:23,010 INFO org.mortbay.log: jetty-6.1.26.cloudera.2
2015-11-19 14:02:23,159 WARN org.apache.hadoop.security.authentication.server.AuthenticationFilter: 'signature.secret' configuration not set, using a random value as secret
2015-11-19 14:02:23,200 INFO org.mortbay.log: Started [email protected]:50070
2015-11-19 14:02:23,200 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: Web-server up at: 0.0.0.0:50070
2015-11-19 14:02:23,201 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2015-11-19 14:02:23,201 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 9000: starting
2015-11-19 14:02:23,205 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: NameNode up at: iRobot/192.168.100.200:9000
2015-11-19 14:02:23,205 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Starting services required for active state
[bruce@iRobot hadoop]$ cat logs/hadoop-bruce-namenode-iRobot.out
ulimit -a for user bruce
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 62702
max locked memory (kbytes, -l) 64
max memory size (kbytes, -m) unlimited
open files (-n) 1024
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 10240
cpu time (seconds, -t) unlimited
max user processes (-u) 1024
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
(4)启动DataNode:
[bruce@iRobot hadoop]$ $HADOOP_PREFIX/sbin/hadoop-daemons.sh --config $HADOOP_CONF_DIR --script hdfs start datanode
iRobot: starting datanode, logging to /home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/logs/hadoop-bruce-datanode-iRobot.out
[bruce@iRobot hadoop]$ jps
22880 Bootstrap
6328 DataNode
24986 Main
6408 Jps
5355 Launcher
5748 Main
6158 NameNode
[bruce@iRobot hadoop]$ ls logs
hadoop-bruce-datanode-iRobot.log hadoop-bruce-datanode-iRobot.out hadoop-bruce-namenode-iRobot.log hadoop-bruce-namenode-iRobot.out SecurityAuth-bruce.audit
[bruce@iRobot hadoop]$
[bruce@iRobot hadoop]$ cat logs/hadoop-bruce-datanode-iRobot.log
2015-11-19 14:06:19,201 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting DataNode
STARTUP_MSG: host = iRobot/192.168.100.200
STARTUP_MSG: args = []
STARTUP_MSG: version = 2.0.0-cdh4.5.0
STARTUP_MSG: classpath = /home/bruce/hadoop-install/hadoop/etc/hadoop:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/commons-digester-1.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/slf4j-log4j12-1.6.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jackson-mapper-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/slf4j-api-1.6.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/commons-logging-1.1.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jackson-jaxrs-1.8.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/activation-1.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/zookeeper-3.4.5-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jsr305-1.3.9.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/commons-el-1.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/protobuf-java-2.4.0a.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/xmlenc-0.52.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jersey-core-1.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jasper-runtime-5.5.23.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/commons-io-2.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jersey-json-1.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jettison-1.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/kfs-0.3.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jetty-util-6.1.26.cloudera.2.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jetty-6.1.26.cloudera.2.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/junit-4.8.2.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/mockito-all-1.8.5.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jsch-0.1.42.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jsp-api-2.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/guava-11.0.2.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jline-0.9.94.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/commons-collections-3.2.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jets3t-0.6.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/log4j-1.2.17.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/commons-httpclient-3.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/commons-net-3.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jackson-core-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/xz-1.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/hadoop-auth-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/commons-cli-1.2.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/commons-lang-2.5.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/cloudera-jets3t-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/commons-compress-1.4.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/asm-3.2.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/commons-codec-1.4.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/stax-api-1.0.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/servlet-api-2.5.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jackson-xc-1.8.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/paranamer-2.3.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/hadoop-annotations-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jersey-server-1.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/commons-configuration-1.6.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/commons-math-2.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jasper-compiler-5.5.23.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/avro-1.7.4.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/hadoop-common-2.0.0-cdh4.5.0-tests.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/hadoop-common-2.0.0-cdh4.5.0-sources.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/hadoop-common-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/hadoop-common-2.0.0-cdh4.5.0-test-sources.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/jackson-mapper-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/commons-logging-1.1.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/zookeeper-3.4.5-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/jsr305-1.3.9.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/commons-el-1.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/protobuf-java-2.4.0a.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/jersey-core-1.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/jasper-runtime-5.5.23.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/commons-io-2.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/jetty-util-6.1.26.cloudera.2.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/jetty-6.1.26.cloudera.2.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/jsp-api-2.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/guava-11.0.2.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/jline-0.9.94.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/jackson-core-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/commons-lang-2.5.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/asm-3.2.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/commons-daemon-1.0.3.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/jersey-server-1.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/hadoop-hdfs-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/hadoop-hdfs-2.0.0-cdh4.5.0-tests.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/hadoop-hdfs-2.0.0-cdh4.5.0-sources.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/hadoop-hdfs-2.0.0-cdh4.5.0-test-sources.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/jackson-mapper-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/guice-3.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/aopalliance-1.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/protobuf-java-2.4.0a.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/jersey-core-1.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/commons-io-2.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/log4j-1.2.17.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/jackson-core-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/xz-1.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/jersey-guice-1.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/asm-3.2.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/netty-3.2.4.Final.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/javax.inject-1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/paranamer-2.3.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/snappy-java-1.0.4.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/hadoop-annotations-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/jersey-server-1.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/avro-1.7.4.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/hadoop-yarn-server-tests-2.0.0-cdh4.5.0-tests.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/hadoop-yarn-client-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/hadoop-yarn-common-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/hadoop-yarn-site-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/hadoop-yarn-server-common-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/hadoop-yarn-server-tests-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/hadoop-yarn-api-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/guice-3.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/protobuf-java-2.4.0a.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/jersey-core-1.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/commons-io-2.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/jackson-core-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/xz-1.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/jersey-guice-1.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/asm-3.2.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/netty-3.2.4.Final.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/javax.inject-1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/hadoop-annotations-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/jersey-server-1.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.0.0-cdh4.5.0-tests.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.0.0-cdh4.5.0.jar:/contrib/capacity-scheduler/*.jar:/contrib/capacity-scheduler/*.jar:/contrib/capacity-scheduler/*.jar
STARTUP_MSG: build = file:///var/lib/jenkins/workspace/CDH4.5.0-Packaging-Hadoop/build/cdh4/hadoop/2.0.0-cdh4.5.0/source/hadoop-common-project/hadoop-common -r 30821ec616ee7a21ee8447949b7c6208a8f1e7d8; compiled by 'jenkins' on Wed Nov 20 14:35:49 PST 2013
STARTUP_MSG: java = 1.6.0_21
************************************************************/
2015-11-19 14:06:19,206 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: registered UNIX signal handlers for [TERM, HUP, INT]
2015-11-19 14:06:19,432 WARN org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-11-19 14:06:19,906 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
2015-11-19 14:06:19,961 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
2015-11-19 14:06:19,961 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system started
2015-11-19 14:06:19,964 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Configured hostname is iRobot
2015-11-19 14:06:19,998 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Opened streaming server at /192.168.100.200:50010
2015-11-19 14:06:20,001 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Balancing bandwith is 1048576 bytes/s
2015-11-19 14:06:20,037 INFO org.apache.hadoop.http.HttpServer: SSL is enabled on HttpServer at http://0.0.0.0:-1/ - not live
2015-11-19 14:06:20,042 INFO org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2015-11-19 14:06:20,094 INFO org.apache.hadoop.http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-11-19 14:06:20,096 INFO org.apache.hadoop.http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2015-11-19 14:06:20,096 INFO org.apache.hadoop.http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-11-19 14:06:20,096 INFO org.apache.hadoop.http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-11-19 14:06:20,100 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Opened info server at 0.0.0.0:50075
2015-11-19 14:06:20,103 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: dfs.webhdfs.enabled = true
2015-11-19 14:06:20,104 INFO org.apache.hadoop.http.HttpServer: addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.datanode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/*
2015-11-19 14:06:20,108 INFO org.apache.hadoop.http.HttpServer: Jetty bound to port 50075
2015-11-19 14:06:20,108 INFO org.mortbay.log: jetty-6.1.26.cloudera.2
2015-11-19 14:06:20,300 INFO org.mortbay.log: Started [email protected]:50075
2015-11-19 14:06:20,677 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 50020
2015-11-19 14:06:20,700 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Opened IPC server at /0.0.0.0:50020
2015-11-19 14:06:20,711 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Refresh request received for nameservices: null
2015-11-19 14:06:20,732 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Starting BPOfferServices for nameservices:
2015-11-19 14:06:20,740 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Block pool (storage id unknown) service to iRobot/192.168.100.200:9000 starting to offer service
2015-11-19 14:06:20,745 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2015-11-19 14:06:20,745 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 50020: starting
2015-11-19 14:06:21,306 INFO org.apache.hadoop.hdfs.server.common.Storage: Lock on /u01/hadoopdata/hadoop-bruce/dfs/data/in_use.lock acquired by nodename 6328@iRobot
2015-11-19 14:06:21,308 INFO org.apache.hadoop.hdfs.server.common.Storage: Storage directory /u01/hadoopdata/hadoop-bruce/dfs/data is not formatted
2015-11-19 14:06:21,308 INFO org.apache.hadoop.hdfs.server.common.Storage: Formatting ...
2015-11-19 14:06:21,420 INFO org.apache.hadoop.hdfs.server.common.Storage: Locking is disabled
2015-11-19 14:06:21,422 INFO org.apache.hadoop.hdfs.server.common.Storage: Storage directory /u01/hadoopdata/hadoop-bruce/dfs/data/current/BP-981411196-192.168.100.200-1447912540337 is not formatted.
2015-11-19 14:06:21,422 INFO org.apache.hadoop.hdfs.server.common.Storage: Formatting ...
2015-11-19 14:06:21,422 INFO org.apache.hadoop.hdfs.server.common.Storage: Formatting block pool BP-981411196-192.168.100.200-1447912540337 directory /u01/hadoopdata/hadoop-bruce/dfs/data/current/BP-981411196-192.168.100.200-1447912540337/current
2015-11-19 14:06:21,446 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Setting up storage: nsid=337807999;bpid=BP-981411196-192.168.100.200-1447912540337;lv=-40;nsInfo=lv=-40;cid=CID-4fb81ac3-7e61-42c2-a707-46f2af89a6e2;nsid=337807999;c=0;bpid=BP-981411196-192.168.100.200-1447912540337
2015-11-19 14:06:21,460 INFO org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl: Added volume - /u01/hadoopdata/hadoop-bruce/dfs/data/current
2015-11-19 14:06:21,465 INFO org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl: Registered FSDatasetState MBean
2015-11-19 14:06:21,472 INFO org.apache.hadoop.hdfs.server.datanode.DirectoryScanner: Periodic Directory Tree Verification scan starting at 1447923872472 with interval 21600000
2015-11-19 14:06:21,473 INFO org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl: Adding block pool BP-981411196-192.168.100.200-1447912540337
2015-11-19 14:06:21,491 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Block pool BP-981411196-192.168.100.200-1447912540337 (storage id DS-1689463280-192.168.100.200-50010-1447913181338) service to iRobot/192.168.100.200:9000 beginning handshake with NN
2015-11-19 14:06:21,510 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Block pool Block pool BP-981411196-192.168.100.200-1447912540337 (storage id DS-1689463280-192.168.100.200-50010-1447913181338) service to iRobot/192.168.100.200:9000 successfully registered with NN
2015-11-19 14:06:21,512 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: For namenode iRobot/192.168.100.200:9000 using DELETEREPORT_INTERVAL of 300000 msec BLOCKREPORT_INTERVAL of 21600000msec Initial delay: 0msec; heartBeatInterval=3000
2015-11-19 14:06:21,564 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Namenode Block pool BP-981411196-192.168.100.200-1447912540337 (storage id DS-1689463280-192.168.100.200-50010-1447913181338) service to iRobot/192.168.100.200:9000 trying to claim ACTIVE state with txid=1
2015-11-19 14:06:21,564 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Acknowledging ACTIVE Namenode Block pool BP-981411196-192.168.100.200-1447912540337 (storage id DS-1689463280-192.168.100.200-50010-1447913181338) service to iRobot/192.168.100.200:9000
2015-11-19 14:06:21,602 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: BlockReport of 0 blocks took 1 msec to generate and 37 msecs for RPC and NN processing
2015-11-19 14:06:21,602 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: sent block report, processed command:org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@4e4b12d9
2015-11-19 14:06:21,609 INFO org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner: Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-981411196-192.168.100.200-1447912540337
2015-11-19 14:06:21,614 INFO org.apache.hadoop.hdfs.server.datanode.DataBlockScanner: Added bpid=BP-981411196-192.168.100.200-1447912540337 to blockPoolScannerMap, new size=1
[bruce@iRobot hadoop]$ cat logs/hadoop-bruce-datanode-iRobot.out
ulimit -a for user bruce
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 62702
max locked memory (kbytes, -l) 64
max memory size (kbytes, -m) unlimited
open files (-n) 1024
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 10240
cpu time (seconds, -t) unlimited
max user processes (-u) 1024
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
[bruce@iRobot hadoop]$
[bruce@iRobot hadoop]$ tail -f logs/*namenode*.log
2015-11-19 14:02:23,200 INFO org.mortbay.log: Started [email protected]:50070
2015-11-19 14:02:23,200 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: Web-server up at: 0.0.0.0:50070
2015-11-19 14:02:23,201 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2015-11-19 14:02:23,201 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 9000: starting
2015-11-19 14:02:23,205 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: NameNode up at: iRobot/192.168.100.200:9000
2015-11-19 14:02:23,205 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Starting services required for active state
2015-11-19 14:06:21,500 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* registerDatanode: from DatanodeRegistration(192.168.100.200, storageID=DS-1689463280-192.168.100.200-50010-1447913181338, infoPort=50075, ipcPort=50020, storageInfo=lv=-40;cid=CID-4fb81ac3-7e61-42c2-a707-46f2af89a6e2;nsid=337807999;c=0) storage DS-1689463280-192.168.100.200-50010-1447913181338
2015-11-19 14:06:21,503 INFO org.apache.hadoop.net.NetworkTopology: Adding a new node: /default-rack/192.168.100.200:50010
2015-11-19 14:06:21,580 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: BLOCK* processReport: Received first block report from 192.168.100.200:50010 after starting up or becoming active. Its block contents are no longer considered stale
2015-11-19 14:06:21,580 INFO BlockStateChange: BLOCK* processReport: from DatanodeRegistration(192.168.100.200, storageID=DS-1689463280-192.168.100.200-50010-1447913181338, infoPort=50075, ipcPort=50020, storageInfo=lv=-40;cid=CID-4fb81ac3-7e61-42c2-a707-46f2af89a6e2;nsid=337807999;c=0), blocks: 0, processing time: 3 msecs
(5)启动SecondaryNameNode
[bruce@iRobot hadoop]$ $HADOOP_PREFIX/sbin/hadoop-daemons.sh --config $HADOOP_CONF_DIR --script hdfs start secondarynamenode
iRobot: starting secondarynamenode, logging to /home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/logs/hadoop-bruce-secondarynamenode-iRobot.out
[bruce@iRobot hadoop]$ ls logs/
hadoop-bruce-datanode-iRobot.log hadoop-bruce-datanode-iRobot.out hadoop-bruce-namenode-iRobot.log hadoop-bruce-namenode-iRobot.out hadoop-bruce-secondarynamenode-iRobot.log hadoop-bruce-secondarynamenode-iRobot.out SecurityAuth-bruce.audit
[bruce@iRobot hadoop]$
[bruce@iRobot hadoop]$ cat logs/hadoop-bruce-secondarynamenode-iRobot.log
2015-11-19 14:16:14,978 INFO org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting SecondaryNameNode
STARTUP_MSG: host = iRobot/192.168.100.200
STARTUP_MSG: args = []
STARTUP_MSG: version = 2.0.0-cdh4.5.0
STARTUP_MSG: classpath = /home/bruce/hadoop-install/hadoop/etc/hadoop:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/commons-digester-1.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/slf4j-log4j12-1.6.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jackson-mapper-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/slf4j-api-1.6.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/commons-logging-1.1.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jackson-jaxrs-1.8.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/activation-1.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/zookeeper-3.4.5-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jsr305-1.3.9.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/commons-el-1.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/protobuf-java-2.4.0a.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/xmlenc-0.52.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jersey-core-1.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jasper-runtime-5.5.23.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/commons-io-2.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jersey-json-1.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jettison-1.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/kfs-0.3.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jetty-util-6.1.26.cloudera.2.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jetty-6.1.26.cloudera.2.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/junit-4.8.2.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/mockito-all-1.8.5.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jsch-0.1.42.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jsp-api-2.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/guava-11.0.2.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jline-0.9.94.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/commons-collections-3.2.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jets3t-0.6.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/log4j-1.2.17.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/commons-httpclient-3.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/commons-net-3.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jackson-core-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/xz-1.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/hadoop-auth-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/commons-cli-1.2.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/commons-lang-2.5.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/cloudera-jets3t-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/commons-compress-1.4.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/asm-3.2.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/commons-codec-1.4.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/stax-api-1.0.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/servlet-api-2.5.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jackson-xc-1.8.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/paranamer-2.3.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/hadoop-annotations-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jersey-server-1.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/commons-configuration-1.6.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/commons-math-2.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/jasper-compiler-5.5.23.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/lib/avro-1.7.4.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/hadoop-common-2.0.0-cdh4.5.0-tests.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/hadoop-common-2.0.0-cdh4.5.0-sources.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/hadoop-common-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/common/hadoop-common-2.0.0-cdh4.5.0-test-sources.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/jackson-mapper-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/commons-logging-1.1.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/zookeeper-3.4.5-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/jsr305-1.3.9.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/commons-el-1.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/protobuf-java-2.4.0a.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/jersey-core-1.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/jasper-runtime-5.5.23.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/commons-io-2.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/jetty-util-6.1.26.cloudera.2.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/jetty-6.1.26.cloudera.2.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/jsp-api-2.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/guava-11.0.2.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/jline-0.9.94.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/jackson-core-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/commons-lang-2.5.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/asm-3.2.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/commons-daemon-1.0.3.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/lib/jersey-server-1.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/hadoop-hdfs-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/hadoop-hdfs-2.0.0-cdh4.5.0-tests.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/hadoop-hdfs-2.0.0-cdh4.5.0-sources.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/hdfs/hadoop-hdfs-2.0.0-cdh4.5.0-test-sources.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/jackson-mapper-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/guice-3.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/aopalliance-1.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/protobuf-java-2.4.0a.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/jersey-core-1.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/commons-io-2.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/log4j-1.2.17.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/jackson-core-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/xz-1.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/jersey-guice-1.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/asm-3.2.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/netty-3.2.4.Final.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/javax.inject-1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/paranamer-2.3.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/snappy-java-1.0.4.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/hadoop-annotations-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/jersey-server-1.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/lib/avro-1.7.4.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/hadoop-yarn-server-tests-2.0.0-cdh4.5.0-tests.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/hadoop-yarn-client-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/hadoop-yarn-common-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/hadoop-yarn-site-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/hadoop-yarn-server-common-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/hadoop-yarn-server-tests-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/hadoop-yarn-api-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/guice-3.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/protobuf-java-2.4.0a.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/jersey-core-1.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/commons-io-2.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/jackson-core-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/xz-1.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/jersey-guice-1.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/asm-3.2.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/netty-3.2.4.Final.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/javax.inject-1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/hadoop-annotations-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/jersey-server-1.8.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.0.0-cdh4.5.0-tests.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.0.0-cdh4.5.0.jar:/contrib/capacity-scheduler/*.jar:/contrib/capacity-scheduler/*.jar:/contrib/capacity-scheduler/*.jar
STARTUP_MSG: build = file:///var/lib/jenkins/workspace/CDH4.5.0-Packaging-Hadoop/build/cdh4/hadoop/2.0.0-cdh4.5.0/source/hadoop-common-project/hadoop-common -r 30821ec616ee7a21ee8447949b7c6208a8f1e7d8; compiled by 'jenkins' on Wed Nov 20 14:35:49 PST 2013
STARTUP_MSG: java = 1.6.0_21
************************************************************/
2015-11-19 14:16:14,983 INFO org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode: registered UNIX signal handlers for [TERM, HUP, INT]
2015-11-19 14:16:15,371 WARN org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-11-19 14:16:15,551 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
2015-11-19 14:16:15,609 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
2015-11-19 14:16:15,609 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: SecondaryNameNode metrics system started
2015-11-19 14:16:15,827 INFO org.apache.hadoop.hdfs.server.common.Storage: Lock on /u01/hadoopdata/hadoop-bruce/dfs/namesecondary/in_use.lock acquired by nodename 6664@iRobot
2015-11-19 14:16:15,865 INFO org.apache.hadoop.hdfs.server.blockmanagement.HeartbeatManager: Setting heartbeat recheck interval to 30000 since dfs.namenode.stale.datanode.interval is less than dfs.namenode.heartbeat.recheck-interval
2015-11-19 14:16:15,865 INFO org.apache.hadoop.hdfs.server.namenode.HostFileManager: read includes:
HostSet(
)
2015-11-19 14:16:15,865 INFO org.apache.hadoop.hdfs.server.namenode.HostFileManager: read excludes:
HostSet(
)
2015-11-19 14:16:15,868 INFO org.apache.hadoop.hdfs.server.blockmanagement.DatanodeManager: dfs.block.invalidate.limit=1000
2015-11-19 14:16:15,880 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: dfs.block.access.token.enable=false
2015-11-19 14:16:15,881 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: defaultReplication = 1
2015-11-19 14:16:15,881 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: maxReplication = 512
2015-11-19 14:16:15,881 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: minReplication = 1
2015-11-19 14:16:15,881 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: maxReplicationStreams = 2
2015-11-19 14:16:15,881 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: shouldCheckForEnoughRacks = false
2015-11-19 14:16:15,881 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: replicationRecheckInterval = 3000
2015-11-19 14:16:15,881 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: encryptDataTransfer = false
2015-11-19 14:16:15,881 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: maxNumBlocksToLog = 1000
2015-11-19 14:16:15,881 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: fsOwner = bruce (auth:SIMPLE)
2015-11-19 14:16:15,881 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: supergroup = oinstall
2015-11-19 14:16:15,881 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: isPermissionEnabled = false
2015-11-19 14:16:15,882 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: HA Enabled: false
2015-11-19 14:16:15,886 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Append Enabled: true
2015-11-19 14:16:16,287 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: Caching file names occuring more than 10 times
2015-11-19 14:16:16,289 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: dfs.namenode.safemode.threshold-pct = 0.9990000128746033
2015-11-19 14:16:16,289 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: dfs.namenode.safemode.min.datanodes = 0
2015-11-19 14:16:16,289 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: dfs.namenode.safemode.extension = 30000
2015-11-19 14:16:16,329 INFO org.apache.hadoop.http.HttpServer: SSL is enabled on HttpServer at http://iRobot:-1/ - not live
2015-11-19 14:16:16,334 INFO org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2015-11-19 14:16:16,384 INFO org.apache.hadoop.http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-11-19 14:16:16,387 INFO org.apache.hadoop.http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context secondary
2015-11-19 14:16:16,387 INFO org.apache.hadoop.http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-11-19 14:16:16,387 INFO org.apache.hadoop.http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-11-19 14:16:16,396 INFO org.apache.hadoop.http.HttpServer: Jetty bound to port 50090
2015-11-19 14:16:16,396 INFO org.mortbay.log: jetty-6.1.26.cloudera.2
2015-11-19 14:16:16,578 INFO org.mortbay.log: Started SelectChannelConnector@iRobot:50090
2015-11-19 14:16:16,578 INFO org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode: Web server init done
2015-11-19 14:16:16,579 INFO org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode: Secondary Web-server up at: iRobot:50090
2015-11-19 14:16:16,579 INFO org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode: Checkpoint Period :3600 secs (60 min)
2015-11-19 14:16:16,579 INFO org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode: Log Size Trigger :1000000 txns
[bruce@iRobot hadoop]$ cat logs/hadoop-bruce-secondarynamenode-iRobot.out
ulimit -a for user bruce
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 62702
max locked memory (kbytes, -l) 64
max memory size (kbytes, -m) unlimited
open files (-n) 1024
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 10240
cpu time (seconds, -t) unlimited
max user processes (-u) 1024
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
[bruce@iRobot hadoop]$
[bruce@iRobot hadoop]$ tail -f logs/*namenode*.log
2015-11-19 14:02:23,200 INFO org.mortbay.log: Started [email protected]:50070
2015-11-19 14:02:23,200 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: Web-server up at: 0.0.0.0:50070
2015-11-19 14:02:23,201 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2015-11-19 14:02:23,201 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 9000: starting
2015-11-19 14:02:23,205 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: NameNode up at: iRobot/192.168.100.200:9000
2015-11-19 14:02:23,205 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Starting services required for active state
2015-11-19 14:06:21,500 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* registerDatanode: from DatanodeRegistration(192.168.100.200, storageID=DS-1689463280-192.168.100.200-50010-1447913181338, infoPort=50075, ipcPort=50020, storageInfo=lv=-40;cid=CID-4fb81ac3-7e61-42c2-a707-46f2af89a6e2;nsid=337807999;c=0) storage DS-1689463280-192.168.100.200-50010-1447913181338
2015-11-19 14:06:21,503 INFO org.apache.hadoop.net.NetworkTopology: Adding a new node: /default-rack/192.168.100.200:50010
2015-11-19 14:06:21,580 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: BLOCK* processReport: Received first block report from 192.168.100.200:50010 after starting up or becoming active. Its block contents are no longer considered stale
2015-11-19 14:06:21,580 INFO BlockStateChange: BLOCK* processReport: from DatanodeRegistration(192.168.100.200, storageID=DS-1689463280-192.168.100.200-50010-1447913181338, infoPort=50075, ipcPort=50020, storageInfo=lv=-40;cid=CID-4fb81ac3-7e61-42c2-a707-46f2af89a6e2;nsid=337807999;c=0), blocks: 0, processing time: 3 msecs
2015-11-19 14:17:16,719 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Roll Edit Log from 192.168.100.200
2015-11-19 14:17:16,719 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Rolling edit logs
2015-11-19 14:17:16,719 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Ending log segment 1
2015-11-19 14:17:16,720 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Number of transactions: 2 Total time for transactions(ms): 0Number of transactions batched in Syncs: 0 Number of syncs: 2 SyncTimes(ms): 37
2015-11-19 14:17:16,726 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Number of transactions: 2 Total time for transactions(ms): 0Number of transactions batched in Syncs: 0 Number of syncs: 3 SyncTimes(ms): 43
2015-11-19 14:17:16,728 INFO org.apache.hadoop.hdfs.server.namenode.FileJournalManager: Finalizing edits file /u01/hadoopdata/hadoop-bruce/dfs/name/current/edits_inprogress_0000000000000000001 -> /u01/hadoopdata/hadoop-bruce/dfs/name/current/edits_0000000000000000001-0000000000000000002
2015-11-19 14:17:16,728 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Starting log segment at 3
2015-11-19 14:17:17,267 INFO org.apache.hadoop.hdfs.server.namenode.TransferFsImage: Opening connection to http://iRobot:50090/getimage?getimage=1&txid=2&storageInfo=-40:337807999:0:CID-4fb81ac3-7e61-42c2-a707-46f2af89a6e2
2015-11-19 14:17:17,434 INFO org.apache.hadoop.hdfs.server.namenode.TransferFsImage: Transfer took 0.16s at 0.00 KB/s
2015-11-19 14:17:17,434 INFO org.apache.hadoop.hdfs.server.namenode.TransferFsImage: Downloaded file fsimage.ckpt_0000000000000000002 size 116 bytes.
2015-11-19 14:17:17,451 INFO org.apache.hadoop.hdfs.server.namenode.NNStorageRetentionManager: Going to retain 2 images with txid >= 0
---------------------------------------------------------------------------
[bruce@iRobot hadoop]$ ls /u01/hadoopdata/hadoop-bruce/dfs/ -lrt
总用量 12
drwxr-xr-x 3 bruce oinstall 4096 11月 19 14:02 name
drwx------ 3 bruce oinstall 4096 11月 19 14:06 data
drwxr-xr-x 3 bruce oinstall 4096 11月 19 14:17 namesecondary
[bruce@iRobot hadoop]$ ls /u01/hadoopdata/hadoop-bruce/dfs/data/
current in_use.lock
[bruce@iRobot hadoop]$ ls /u01/hadoopdata/hadoop-bruce/dfs/name/
current in_use.lock
[bruce@iRobot hadoop]$ ls /u01/hadoopdata/hadoop-bruce/dfs/namesecondary/
current in_use.lock
[bruce@iRobot hadoop]$
[bruce@iRobot hadoop]$ ls /u01/hadoopdata/hadoop-bruce/dfs/name/
current in_use.lock
[bruce@iRobot hadoop]$ ls /u01/hadoopdata/hadoop-bruce/dfs/name/current/
edits_0000000000000000001-0000000000000000002 edits_inprogress_0000000000000000003 fsimage_0000000000000000000 fsimage_0000000000000000000.md5 fsimage_0000000000000000002 fsimage_0000000000000000002.md5 seen_txid VERSION
[bruce@iRobot hadoop]$ ls -lrt /u01/hadoopdata/hadoop-bruce/dfs/name/current/
总用量 1052
-rw-r--r-- 1 bruce oinstall 206 11月 19 13:55 VERSION
-rw-r--r-- 1 bruce oinstall 116 11月 19 13:55 fsimage_0000000000000000000
-rw-r--r-- 1 bruce oinstall 62 11月 19 13:55 fsimage_0000000000000000000.md5
-rw-r--r-- 1 bruce oinstall 30 11月 19 14:17 edits_0000000000000000001-0000000000000000002
-rw-r--r-- 1 bruce oinstall 1048576 11月 19 14:17 edits_inprogress_0000000000000000003
-rw-r--r-- 1 bruce oinstall 2 11月 19 14:17 seen_txid
-rw-r--r-- 1 bruce oinstall 116 11月 19 14:17 fsimage_0000000000000000002
-rw-r--r-- 1 bruce oinstall 62 11月 19 14:17 fsimage_0000000000000000002.md5
[bruce@iRobot hadoop]$ ls /u01/hadoopdata/hadoop-bruce/dfs/name/in_use.lock
/u01/hadoopdata/hadoop-bruce/dfs/name/in_use.lock
[bruce@iRobot hadoop]$
[bruce@iRobot hadoop]$ cat /u01/hadoopdata/hadoop-bruce/dfs/name/in_use.lock
6158@iRobot
[bruce@iRobot hadoop]$
[bruce@iRobot hadoop]$ cat /u01/hadoopdata/hadoop-bruce/dfs/name/current/seen_txid
3
------------------------------------------------------------------------------
[bruce@iRobot hadoop]$ ls /u01/hadoopdata/hadoop-bruce/dfs/data/
current in_use.lock
[bruce@iRobot hadoop]$ cat /u01/hadoopdata/hadoop-bruce/dfs/data/in_use.lock
6328@iRobot
[bruce@iRobot hadoop]$
[bruce@iRobot hadoop]$
[bruce@iRobot hadoop]$ ls /u01/hadoopdata/hadoop-bruce/dfs/data/current/
BP-981411196-192.168.100.200-1447912540337 VERSION
[bruce@iRobot hadoop]$ ls -lrt /u01/hadoopdata/hadoop-bruce/dfs/data/current/
总用量 8
-rw-r--r-- 1 bruce oinstall 189 11月 19 14:06 VERSION
drwx------ 4 bruce oinstall 4096 11月 19 14:06 BP-981411196-192.168.100.200-1447912540337
[bruce@iRobot hadoop]$ ls -lrt /u01/hadoopdata/hadoop-bruce/dfs/data/current/BP-981411196-192.168.100.200-1447912540337/
总用量 8
drwxr-xr-x 2 bruce oinstall 4096 11月 19 14:06 tmp
drwxr-xr-x 4 bruce oinstall 4096 11月 19 14:06 current
-rw-r--r-- 1 bruce oinstall 0 11月 19 14:06 dncp_block_verification.log.curr
[bruce@iRobot hadoop]$ ls /u01/hadoopdata/hadoop-bruce/dfs/data/current/BP-981411196-192.168.100.200-1447912540337/
current dncp_block_verification.log.curr tmp
[bruce@iRobot hadoop]$ ls /u01/hadoopdata/hadoop-bruce/dfs/data/current/BP-981411196-192.168.100.200-1447912540337/current/
finalized rbw VERSION
[bruce@iRobot hadoop]$ ls /u01/hadoopdata/hadoop-bruce/dfs/data/current/BP-981411196-192.168.100.200-1447912540337/current/rbw/
[bruce@iRobot hadoop]$ ls /u01/hadoopdata/hadoop-bruce/dfs/data/current/BP-981411196-192.168.100.200-1447912540337/current/finalized/
[bruce@iRobot hadoop]$ cat /u01/hadoopdata/hadoop-bruce/dfs/data/current/BP-981411196-192.168.100.200-1447912540337/current/VERSION
#Thu Nov 19 14:06:21 CST 2015
namespaceID=337807999
cTime=0
blockpoolID=BP-981411196-192.168.100.200-1447912540337
layoutVersion=-40
[bruce@iRobot hadoop]$ ls /u01/hadoopdata/hadoop-bruce/dfs/data/current/BP-981411196-192.168.100.200-1447912540337/tmp/
[bruce@iRobot hadoop]$
------------------------------------------------------------------------------
[bruce@iRobot hadoop]$ ls /u01/hadoopdata/hadoop-bruce/dfs/namesecondary/
current in_use.lock
[bruce@iRobot hadoop]$ cat /u01/hadoopdata/hadoop-bruce/dfs/namesecondary/in_use.lock
6664@iRobot[bruce@iRobot hadoop]$
[bruce@iRobot hadoop]$ ls /u01/hadoopdata/hadoop-bruce/dfs/namesecondary/current/
edits_0000000000000000001-0000000000000000002 fsimage_0000000000000000000 fsimage_0000000000000000000.md5 fsimage_0000000000000000002 fsimage_0000000000000000002.md5 VERSION
[bruce@iRobot hadoop]$ cat /u01/hadoopdata/hadoop-bruce/dfs/namesecondary/current/VERSION
#Thu Nov 19 14:17:17 CST 2015
namespaceID=337807999
clusterID=CID-4fb81ac3-7e61-42c2-a707-46f2af89a6e2
cTime=0
storageType=NAME_NODE
blockpoolID=BP-981411196-192.168.100.200-1447912540337
layoutVersion=-40
[bruce@iRobot hadoop]$ ls -lrt /u01/hadoopdata/hadoop-bruce/dfs/namesecondary/current/
总用量 24
-rw-r--r-- 1 bruce oinstall 116 11月 19 14:17 fsimage_0000000000000000000
-rw-r--r-- 1 bruce oinstall 62 11月 19 14:17 fsimage_0000000000000000000.md5
-rw-r--r-- 1 bruce oinstall 30 11月 19 14:17 edits_0000000000000000001-0000000000000000002
-rw-r--r-- 1 bruce oinstall 116 11月 19 14:17 fsimage_0000000000000000002
-rw-r--r-- 1 bruce oinstall 62 11月 19 14:17 fsimage_0000000000000000002.md5
-rw-r--r-- 1 bruce oinstall 206 11月 19 14:17 VERSION
[bruce@iRobot hadoop]$
(6)启动YARN resourcemanager
[bruce@iRobot hadoop]$ $HADOOP_YARN_HOME/sbin/yarn-daemon.sh --config $HADOOP_CONF_DIR start resourcemanager
starting resourcemanager, logging to /home/bruce/hadoop-install/hadoop/logs/yarn-bruce-resourcemanager-iRobot.out
[bruce@iRobot hadoop]$ ls logs/
hadoop-bruce-datanode-iRobot.log hadoop-bruce-namenode-iRobot.log hadoop-bruce-secondarynamenode-iRobot.log SecurityAuth-bruce.audit yarn-bruce-resourcemanager-iRobot.out
hadoop-bruce-datanode-iRobot.out hadoop-bruce-namenode-iRobot.out hadoop-bruce-secondarynamenode-iRobot.out yarn-bruce-resourcemanager-iRobot.log
[bruce@iRobot hadoop]$ cat logs/yarn-bruce-resourcemanager-iRobot.log
2015-11-19 14:20:55,087 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting ResourceManager
STARTUP_MSG: host = iRobot/192.168.100.200
STARTUP_MSG: args = []
STARTUP_MSG: version = 2.0.0-cdh4.5.0
STARTUP_MSG: classpath = /home/bruce/hadoop-install/hadoop/etc/hadoop:/home/bruce/hadoop-install/hadoop/etc/hadoop:/home/bruce/hadoop-install/hadoop/etc/hadoop:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-digester-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.6.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jackson-mapper-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/slf4j-api-1.6.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-logging-1.1.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jackson-jaxrs-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/activation-1.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/zookeeper-3.4.5-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jsr305-1.3.9.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-el-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/protobuf-java-2.4.0a.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/xmlenc-0.52.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jersey-core-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jasper-runtime-5.5.23.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-io-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jersey-json-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jettison-1.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/kfs-0.3.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jetty-util-6.1.26.cloudera.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jetty-6.1.26.cloudera.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/junit-4.8.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/mockito-all-1.8.5.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jsch-0.1.42.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jsp-api-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/guava-11.0.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jline-0.9.94.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-collections-3.2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jets3t-0.6.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/log4j-1.2.17.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-httpclient-3.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-net-3.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jackson-core-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/xz-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/hadoop-auth-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-cli-1.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-lang-2.5.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/cloudera-jets3t-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-compress-1.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/asm-3.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-codec-1.4.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/stax-api-1.0.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/servlet-api-2.5.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jackson-xc-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/paranamer-2.3.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/hadoop-annotations-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jersey-server-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-configuration-1.6.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-math-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jasper-compiler-5.5.23.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/avro-1.7.4.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/hadoop-common-2.0.0-cdh4.5.0-tests.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/hadoop-common-2.0.0-cdh4.5.0-sources.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/hadoop-common-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/hadoop-common-2.0.0-cdh4.5.0-test-sources.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jackson-mapper-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-logging-1.1.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/zookeeper-3.4.5-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jsr305-1.3.9.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-el-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/protobuf-java-2.4.0a.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jersey-core-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jasper-runtime-5.5.23.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-io-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jetty-util-6.1.26.cloudera.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jetty-6.1.26.cloudera.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jsp-api-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/guava-11.0.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jline-0.9.94.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jackson-core-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-lang-2.5.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/asm-3.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-daemon-1.0.3.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jersey-server-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.0.0-cdh4.5.0-tests.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.0.0-cdh4.5.0-sources.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.0.0-cdh4.5.0-test-sources.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jackson-mapper-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/guice-3.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/aopalliance-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/protobuf-java-2.4.0a.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jersey-core-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/commons-io-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/log4j-1.2.17.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jackson-core-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/xz-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jersey-guice-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/asm-3.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/netty-3.2.4.Final.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/javax.inject-1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/paranamer-2.3.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/snappy-java-1.0.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/hadoop-annotations-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jersey-server-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/avro-1.7.4.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-2.0.0-cdh4.5.0-tests.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-client-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-site-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-common-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-api-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/guice-3.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/protobuf-java-2.4.0a.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/jersey-core-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/commons-io-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/jackson-core-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/xz-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/jersey-guice-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/asm-3.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/netty-3.2.4.Final.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/javax.inject-1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/hadoop-annotations-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/jersey-server-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.0.0-cdh4.5.0-tests.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/contrib/capacity-scheduler/*.jar:/home/bruce/hadoop-install/hadoop/contrib/capacity-scheduler/*.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-2.0.0-cdh4.5.0-tests.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-client-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-site-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-common-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-api-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jackson-mapper-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/guice-3.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/aopalliance-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/protobuf-java-2.4.0a.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jersey-core-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/commons-io-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/log4j-1.2.17.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jackson-core-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/xz-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jersey-guice-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/asm-3.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/netty-3.2.4.Final.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/javax.inject-1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/paranamer-2.3.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/snappy-java-1.0.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/hadoop-annotations-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jersey-server-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/avro-1.7.4.jar:/home/bruce/hadoop-install/hadoop/etc/hadoop/rm-config/log4j.properties
STARTUP_MSG: build = file:///var/lib/jenkins/workspace/CDH4.5.0-Packaging-Hadoop/build/cdh4/hadoop/2.0.0-cdh4.5.0/source/hadoop-common-project/hadoop-common -r 30821ec616ee7a21ee8447949b7c6208a8f1e7d8; compiled by 'jenkins' on Wed Nov 20 14:35:49 PST 2013
STARTUP_MSG: java = 1.6.0_21
************************************************************/
2015-11-19 14:20:55,093 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: registered UNIX signal handlers for [TERM, HUP, INT]
2015-11-19 14:20:55,632 INFO org.apache.hadoop.yarn.server.resourcemanager.security.ApplicationTokenSecretManager: Rolling master-key for application-tokens
2015-11-19 14:20:55,645 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager: ContainerTokenKeyRollingInterval: 86400000ms and ContainerTokenKeyActivationDelay: 900000ms
2015-11-19 14:20:55,646 INFO org.apache.hadoop.yarn.service.AbstractService: Service:Dispatcher is inited.
2015-11-19 14:20:55,647 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStoreEventType for class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore$ForwardingEventHandler
2015-11-19 14:20:55,648 INFO org.apache.hadoop.yarn.service.AbstractService: Service:Dispatcher is started.
2015-11-19 14:20:55,652 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.NodesListManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.NodesListManager
2015-11-19 14:20:55,652 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Using Scheduler: org.apache.hadoop.yarn.server.resourcemanager.scheduler.fifo.FifoScheduler
2015-11-19 14:20:55,771 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.scheduler.event.SchedulerEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher
2015-11-19 14:20:55,772 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationEventDispatcher
2015-11-19 14:20:55,773 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher
2015-11-19 14:20:55,774 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$NodeEventDispatcher
2015-11-19 14:20:55,967 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
2015-11-19 14:20:56,036 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
2015-11-19 14:20:56,036 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: ResourceManager metrics system started
2015-11-19 14:20:56,173 WARN org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-11-19 14:20:56,229 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.RMAppManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.RMAppManager
2015-11-19 14:20:56,243 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncherEventType for class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher
2015-11-19 14:20:56,245 INFO org.apache.hadoop.yarn.server.resourcemanager.RMNMInfo: Registered RMNMInfo MBean
2015-11-19 14:20:56,245 INFO org.apache.hadoop.yarn.service.AbstractService: Service:Dispatcher is inited.
2015-11-19 14:20:56,245 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.ContainerAllocationExpirer is inited.
2015-11-19 14:20:56,245 INFO org.apache.hadoop.yarn.service.AbstractService: Service:AMLivelinessMonitor is inited.
2015-11-19 14:20:56,245 INFO org.apache.hadoop.yarn.service.AbstractService: Service:AMLivelinessMonitor is inited.
2015-11-19 14:20:56,245 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.resourcemanager.security.DelegationTokenRenewer is inited.
2015-11-19 14:20:56,246 INFO org.apache.hadoop.util.HostsFileReader: Refreshing hosts (include/exclude) list
2015-11-19 14:20:56,246 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.resourcemanager.NodesListManager is inited.
2015-11-19 14:20:56,246 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher is inited.
2015-11-19 14:20:56,246 INFO org.apache.hadoop.yarn.service.AbstractService: Service:NMLivelinessMonitor is inited.
2015-11-19 14:20:56,323 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService is inited.
2015-11-19 14:20:56,323 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService is inited.
2015-11-19 14:20:56,323 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.resourcemanager.ClientRMService is inited.
2015-11-19 14:20:56,323 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.resourcemanager.AdminService is inited.
2015-11-19 14:20:56,324 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher is inited.
2015-11-19 14:20:56,324 INFO org.apache.hadoop.yarn.service.AbstractService: Service:ResourceManager is inited.
2015-11-19 14:20:56,324 INFO org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager: Rolling master-key for container-tokens
2015-11-19 14:20:56,324 INFO org.apache.hadoop.yarn.server.resourcemanager.security.ApplicationTokenSecretManager: Rolling master-key for application-tokens
2015-11-19 14:20:56,417 INFO org.apache.hadoop.http.HttpServer: SSL is enabled on HttpServer at http://192.168.100.200:-1/ - not live
2015-11-19 14:20:56,422 INFO org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2015-11-19 14:20:56,474 INFO org.apache.hadoop.http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-11-19 14:20:56,476 INFO org.apache.hadoop.http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context cluster
2015-11-19 14:20:56,476 INFO org.apache.hadoop.http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-11-19 14:20:56,477 INFO org.apache.hadoop.http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-11-19 14:20:56,480 INFO org.apache.hadoop.http.HttpServer: adding path spec: /cluster
2015-11-19 14:20:56,480 INFO org.apache.hadoop.http.HttpServer: adding path spec: /cluster/*
2015-11-19 14:20:56,480 INFO org.apache.hadoop.http.HttpServer: adding path spec: /ws
2015-11-19 14:20:56,480 INFO org.apache.hadoop.http.HttpServer: adding path spec: /ws/*
2015-11-19 14:20:56,481 INFO org.apache.hadoop.http.HttpServer: Added global filter 'guice' (class=com.google.inject.servlet.GuiceFilter)
2015-11-19 14:20:56,488 INFO org.apache.hadoop.http.HttpServer: Jetty bound to port 8088
2015-11-19 14:20:56,488 INFO org.mortbay.log: jetty-6.1.26.cloudera.2
2015-11-19 14:20:56,513 INFO org.mortbay.log: Extract jar:file:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/hadoop-yarn-common-2.0.0-cdh4.5.0.jar!/webapps/cluster to /tmp/Jetty_192_168_110_233_8088_cluster____.eoxqk2/webapp
2015-11-19 14:20:56,731 INFO org.mortbay.log: Started [email protected]:8088
2015-11-19 14:20:56,731 INFO org.apache.hadoop.yarn.webapp.WebApps: Web app /cluster started at 8088
2015-11-19 14:20:57,103 INFO org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules
2015-11-19 14:20:57,105 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens
2015-11-19 14:20:57,106 INFO org.apache.hadoop.yarn.service.AbstractService: Service:Dispatcher is started.
2015-11-19 14:20:57,106 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
2015-11-19 14:20:57,107 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens
2015-11-19 14:20:57,107 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.ContainerAllocationExpirer is started.
2015-11-19 14:20:57,108 INFO org.apache.hadoop.yarn.service.AbstractService: Service:AMLivelinessMonitor is started.
2015-11-19 14:20:57,108 INFO org.apache.hadoop.yarn.service.AbstractService: Service:AMLivelinessMonitor is started.
2015-11-19 14:20:57,108 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.resourcemanager.security.DelegationTokenRenewer is started.
2015-11-19 14:20:57,109 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.resourcemanager.NodesListManager is started.
2015-11-19 14:20:57,109 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher is started.
2015-11-19 14:20:57,109 INFO org.apache.hadoop.yarn.service.AbstractService: Service:NMLivelinessMonitor is started.
2015-11-19 14:20:57,110 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService is started.
2015-11-19 14:20:57,141 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 8031
2015-11-19 14:20:57,159 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.server.api.ResourceTrackerPB to the server
2015-11-19 14:20:57,159 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2015-11-19 14:20:57,159 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 8031: starting
2015-11-19 14:20:57,177 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 8030
2015-11-19 14:20:57,179 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.api.AMRMProtocolPB to the server
2015-11-19 14:20:57,180 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2015-11-19 14:20:57,180 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 8030: starting
2015-11-19 14:20:57,194 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService is started.
2015-11-19 14:20:57,216 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 8032
2015-11-19 14:20:57,219 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.api.ClientRMProtocolPB to the server
2015-11-19 14:20:57,219 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2015-11-19 14:20:57,220 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 8032: starting
2015-11-19 14:20:57,227 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.resourcemanager.ClientRMService is started.
2015-11-19 14:20:57,244 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 8033
2015-11-19 14:20:57,246 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.api.RMAdminProtocolPB to the server
2015-11-19 14:20:57,247 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2015-11-19 14:20:57,247 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 8033: starting
2015-11-19 14:20:57,247 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.resourcemanager.AdminService is started.
2015-11-19 14:20:57,247 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher is started.
2015-11-19 14:20:57,247 INFO org.apache.hadoop.yarn.service.AbstractService: Service:ResourceManager is started.
[bruce@iRobot hadoop]$
[bruce@iRobot hadoop]$
[bruce@iRobot hadoop]$ cat logs/yarn-bruce-resourcemanager-iRobot.out
ulimit -a
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 62702
max locked memory (kbytes, -l) 64
max memory size (kbytes, -m) unlimited
open files (-n) 1024
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 10240
cpu time (seconds, -t) unlimited
max user processes (-u) 1024
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
[bruce@iRobot hadoop]$
(7)启动NodeManager
[bruce@iRobot hadoop]$ $HADOOP_YARN_HOME/sbin/yarn-daemon.sh --config $HADOOP_CONF_DIR start nodemanager
starting nodemanager, logging to /home/bruce/hadoop-install/hadoop/logs/yarn-bruce-nodemanager-iRobot.out
[bruce@iRobot hadoop]$ jps
7889 jar
8057 Jps
22880 Bootstrap
6328 DataNode
6793 ResourceManager
24986 Main
7943 NodeManager
6664 SecondaryNameNode
5748 Main
6158 NameNode
[bruce@iRobot hadoop]$ ls logs
hadoop-bruce-datanode-iRobot.log hadoop-bruce-namenode-iRobot.log hadoop-bruce-secondarynamenode-iRobot.log SecurityAuth-bruce.audit yarn-bruce-nodemanager-iRobot.out yarn-bruce-resourcemanager-iRobot.out
hadoop-bruce-datanode-iRobot.out hadoop-bruce-namenode-iRobot.out hadoop-bruce-secondarynamenode-iRobot.out yarn-bruce-nodemanager-iRobot.log yarn-bruce-resourcemanager-iRobot.log
[bruce@iRobot hadoop]$ tail -f logs/*resourcemanager*.log
2015-11-19 14:43:28,762 INFO org.apache.hadoop.yarn.util.RackResolver: Resolved iRobot to /default-rack
2015-11-19 14:43:28,766 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService: NodeManager from node iRobot(cmPort: 11000 httpPort: 8042) registered with capability: , assigned nodeId iRobot:11000
2015-11-19 14:43:28,775 INFO org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeImpl: iRobot:11000 Node Transitioned from NEW to RUNNING
[bruce@iRobot hadoop]$ cat logs/*nodemanager*.log
2015-11-19 14:43:26,105 INFO org.apache.hadoop.yarn.server.nodemanager.NodeManager: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NodeManager
STARTUP_MSG: host = iRobot/192.168.100.200
STARTUP_MSG: args = []
STARTUP_MSG: version = 2.0.0-cdh4.5.0
STARTUP_MSG: classpath = /home/bruce/hadoop-install/hadoop/etc/hadoop:/home/bruce/hadoop-install/hadoop/etc/hadoop:/home/bruce/hadoop-install/hadoop/etc/hadoop:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-digester-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.6.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jackson-mapper-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/slf4j-api-1.6.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-logging-1.1.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jackson-jaxrs-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/activation-1.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/zookeeper-3.4.5-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jsr305-1.3.9.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-el-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/protobuf-java-2.4.0a.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/xmlenc-0.52.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jersey-core-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jasper-runtime-5.5.23.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-io-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jersey-json-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jettison-1.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/kfs-0.3.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jetty-util-6.1.26.cloudera.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jetty-6.1.26.cloudera.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/junit-4.8.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/mockito-all-1.8.5.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jsch-0.1.42.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jsp-api-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/guava-11.0.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jline-0.9.94.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-collections-3.2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jets3t-0.6.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/log4j-1.2.17.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-httpclient-3.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-net-3.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jackson-core-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/xz-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/hadoop-auth-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-cli-1.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-lang-2.5.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/cloudera-jets3t-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-compress-1.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/asm-3.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-codec-1.4.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/stax-api-1.0.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/servlet-api-2.5.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jackson-xc-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/paranamer-2.3.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/hadoop-annotations-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jersey-server-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-configuration-1.6.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-math-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jasper-compiler-5.5.23.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/avro-1.7.4.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/hadoop-common-2.0.0-cdh4.5.0-tests.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/hadoop-common-2.0.0-cdh4.5.0-sources.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/hadoop-common-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/hadoop-common-2.0.0-cdh4.5.0-test-sources.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jackson-mapper-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-logging-1.1.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/zookeeper-3.4.5-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jsr305-1.3.9.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-el-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/protobuf-java-2.4.0a.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jersey-core-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jasper-runtime-5.5.23.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-io-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jetty-util-6.1.26.cloudera.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jetty-6.1.26.cloudera.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jsp-api-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/guava-11.0.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jline-0.9.94.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jackson-core-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-lang-2.5.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/asm-3.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-daemon-1.0.3.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jersey-server-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.0.0-cdh4.5.0-tests.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.0.0-cdh4.5.0-sources.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.0.0-cdh4.5.0-test-sources.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jackson-mapper-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/guice-3.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/aopalliance-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/protobuf-java-2.4.0a.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jersey-core-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/commons-io-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/log4j-1.2.17.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jackson-core-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/xz-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jersey-guice-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/asm-3.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/netty-3.2.4.Final.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/javax.inject-1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/paranamer-2.3.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/snappy-java-1.0.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/hadoop-annotations-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jersey-server-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/avro-1.7.4.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-2.0.0-cdh4.5.0-tests.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-client-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-site-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-common-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-api-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/guice-3.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/protobuf-java-2.4.0a.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/jersey-core-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/commons-io-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/jackson-core-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/xz-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/jersey-guice-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/asm-3.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/netty-3.2.4.Final.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/javax.inject-1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/hadoop-annotations-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/jersey-server-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.0.0-cdh4.5.0-tests.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/contrib/capacity-scheduler/*.jar:/home/bruce/hadoop-install/hadoop/contrib/capacity-scheduler/*.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-2.0.0-cdh4.5.0-tests.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-client-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-site-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-common-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-api-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jackson-mapper-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/guice-3.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/aopalliance-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/protobuf-java-2.4.0a.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jersey-core-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/commons-io-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/log4j-1.2.17.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jackson-core-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/xz-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jersey-guice-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/asm-3.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/netty-3.2.4.Final.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/javax.inject-1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/paranamer-2.3.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/snappy-java-1.0.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/hadoop-annotations-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jersey-server-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/avro-1.7.4.jar:/home/bruce/hadoop-install/hadoop/etc/hadoop/nm-config/log4j.properties
STARTUP_MSG: build = file:///var/lib/jenkins/workspace/CDH4.5.0-Packaging-Hadoop/build/cdh4/hadoop/2.0.0-cdh4.5.0/source/hadoop-common-project/hadoop-common -r 30821ec616ee7a21ee8447949b7c6208a8f1e7d8; compiled by 'jenkins' on Wed Nov 20 14:35:49 PST 2013
STARTUP_MSG: java = 1.6.0_21
************************************************************/
2015-11-19 14:43:26,111 INFO org.apache.hadoop.yarn.server.nodemanager.NodeManager: registered UNIX signal handlers for [TERM, HUP, INT]
2015-11-19 14:43:26,414 WARN org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-11-19 14:43:26,689 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: setsid exited with exit code 0
2015-11-19 14:43:26,847 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2015-11-19 14:43:26,848 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2015-11-19 14:43:26,849 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2015-11-19 14:43:26,849 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2015-11-19 14:43:26,850 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2015-11-19 14:43:26,850 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2015-11-19 14:43:26,875 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2015-11-19 14:43:26,941 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
2015-11-19 14:43:26,994 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
2015-11-19 14:43:26,997 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics system started
2015-11-19 14:43:27,002 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.nodemanager.DeletionService is inited.
2015-11-19 14:43:27,007 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService is inited.
2015-11-19 14:43:27,033 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.nodemanager.NodeHealthCheckerService is inited.
2015-11-19 14:43:27,033 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.nodemanager.NodeResourceMonitorImpl is inited.
2015-11-19 14:43:27,036 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2015-11-19 14:43:27,145 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2015-11-19 14:43:27,145 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker is inited.
2015-11-19 14:43:27,145 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService is inited.
2015-11-19 14:43:27,145 INFO org.apache.hadoop.yarn.service.AbstractService: Service:containers-launcher is inited.
2015-11-19 14:43:27,524 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: The Auxilurary Service named 'mapreduce.shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-11-19 14:43:27,524 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Adding auxiliary service httpshuffle, "mapreduce.shuffle"
2015-11-19 14:43:27,547 INFO org.apache.hadoop.yarn.service.AbstractService: Service:httpshuffle is inited.
2015-11-19 14:43:27,548 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices is inited.
2015-11-19 14:43:27,561 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@1f0dc656
2015-11-19 14:43:27,562 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Using ResourceCalculatorProcessTree : null
2015-11-19 14:43:27,562 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Physical memory check enabled: true
2015-11-19 14:43:27,562 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Virtual memory check enabled: true
2015-11-19 14:43:27,564 INFO org.apache.hadoop.yarn.service.AbstractService: Service:containers-monitor is inited.
2015-11-19 14:43:27,564 INFO org.apache.hadoop.yarn.service.AbstractService: Service:Dispatcher is inited.
2015-11-19 14:43:27,565 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler is inited.
2015-11-19 14:43:27,565 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl is inited.
2015-11-19 14:43:27,565 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer is inited.
2015-11-19 14:43:27,565 INFO org.apache.hadoop.yarn.service.AbstractService: Service:Dispatcher is inited.
2015-11-19 14:43:27,570 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 virtual-cores=8
2015-11-19 14:43:27,571 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl is inited.
2015-11-19 14:43:27,571 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.nodemanager.NodeManager is inited.
2015-11-19 14:43:27,571 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.nodemanager.DeletionService is started.
2015-11-19 14:43:27,572 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService is started.
2015-11-19 14:43:27,572 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.nodemanager.NodeHealthCheckerService is started.
2015-11-19 14:43:27,572 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.nodemanager.NodeResourceMonitorImpl is started.
2015-11-19 14:43:27,612 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 11000
2015-11-19 14:43:27,632 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.api.ContainerManagerPB to the server
2015-11-19 14:43:27,632 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2015-11-19 14:43:27,632 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 11000: starting
2015-11-19 14:43:27,637 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: ContainerManager started at iRobot/192.168.100.200:11000
2015-11-19 14:43:27,655 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 8040
2015-11-19 14:43:27,661 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2015-11-19 14:43:27,661 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2015-11-19 14:43:27,661 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 8040: starting
2015-11-19 14:43:27,662 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Localizer started on port 8040
2015-11-19 14:43:27,662 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker is started.
2015-11-19 14:43:27,662 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService is started.
2015-11-19 14:43:27,663 INFO org.apache.hadoop.yarn.service.AbstractService: Service:containers-launcher is started.
2015-11-19 14:43:27,675 INFO org.apache.hadoop.mapred.IndexCache: IndexCache created with max memory = 10485760
2015-11-19 14:43:27,708 INFO org.apache.hadoop.mapred.ShuffleHandler: httpshuffle listening on port 13562
2015-11-19 14:43:27,708 INFO org.apache.hadoop.yarn.service.AbstractService: Service:httpshuffle is started.
2015-11-19 14:43:27,709 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices is started.
2015-11-19 14:43:27,710 INFO org.apache.hadoop.yarn.service.AbstractService: Service:containers-monitor is started.
2015-11-19 14:43:27,710 INFO org.apache.hadoop.yarn.service.AbstractService: Service:Dispatcher is started.
2015-11-19 14:43:27,711 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler is started.
2015-11-19 14:43:27,711 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl is started.
2015-11-19 14:43:27,711 INFO org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer: Instantiating NMWebApp at 0.0.0.0:8042
2015-11-19 14:43:27,741 INFO org.apache.hadoop.http.HttpServer: SSL is enabled on HttpServer at http://0.0.0.0:-1/ - not live
2015-11-19 14:43:27,746 INFO org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2015-11-19 14:43:27,797 INFO org.apache.hadoop.http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-11-19 14:43:27,799 INFO org.apache.hadoop.http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2015-11-19 14:43:27,799 INFO org.apache.hadoop.http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-11-19 14:43:27,799 INFO org.apache.hadoop.http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-11-19 14:43:27,803 INFO org.apache.hadoop.http.HttpServer: adding path spec: /node
2015-11-19 14:43:27,803 INFO org.apache.hadoop.http.HttpServer: adding path spec: /node/*
2015-11-19 14:43:27,803 INFO org.apache.hadoop.http.HttpServer: adding path spec: /ws
2015-11-19 14:43:27,803 INFO org.apache.hadoop.http.HttpServer: adding path spec: /ws/*
2015-11-19 14:43:27,804 INFO org.apache.hadoop.http.HttpServer: Added global filter 'guice' (class=com.google.inject.servlet.GuiceFilter)
2015-11-19 14:43:27,805 INFO org.apache.hadoop.http.HttpServer: Jetty bound to port 8042
2015-11-19 14:43:27,805 INFO org.mortbay.log: jetty-6.1.26.cloudera.2
2015-11-19 14:43:27,831 INFO org.mortbay.log: Extract jar:file:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/hadoop-yarn-common-2.0.0-cdh4.5.0.jar!/webapps/node to /tmp/Jetty_0_0_0_0_8042_node____19tj0x/webapp
2015-11-19 14:43:28,052 INFO org.mortbay.log: Started [email protected]:8042
2015-11-19 14:43:28,052 INFO org.apache.hadoop.yarn.webapp.WebApps: Web app /node started at 8042
2015-11-19 14:43:28,427 INFO org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules
2015-11-19 14:43:28,428 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer is started.
2015-11-19 14:43:28,428 INFO org.apache.hadoop.yarn.service.AbstractService: Service:Dispatcher is started.
2015-11-19 14:43:28,456 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Connecting to ResourceManager at /192.168.100.200:8031
2015-11-19 14:43:28,797 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Registered with ResourceManager as iRobot:11000 with total resource of
2015-11-19 14:43:28,797 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl is started.
2015-11-19 14:43:28,798 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.nodemanager.NodeManager is started.
[bruce@iRobot hadoop]$ cat logs/*nodemanager*.out
ulimit -a
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 62702
max locked memory (kbytes, -l) 64
max memory size (kbytes, -m) unlimited
open files (-n) 1024
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 10240
cpu time (seconds, -t) unlimited
max user processes (-u) 1024
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
[bruce@iRobot hadoop]$
[bruce@iRobot hadoop]$ ls /u01/hadoopdata/hadoop-bruce/
dfs/ yarn/
[bruce@iRobot hadoop]$ ls /u01/hadoopdata/hadoop-bruce/ -lrt
总用量 8
drwxr-xr-x 5 bruce oinstall 4096 11月 19 14:16 dfs
drwxr-xr-x 4 bruce oinstall 4096 11月 19 14:43 yarn
[bruce@iRobot hadoop]$ ls /u01/hadoopdata/hadoop-bruce/yarn/
nmlocal userlogs
[bruce@iRobot hadoop]$ ls /u01/hadoopdata/hadoop-bruce/yarn/nmlocal/
filecache nmPrivate usercache
[bruce@iRobot hadoop]$ ls /u01/hadoopdata/hadoop-bruce/yarn/nmlocal/filecache/
[bruce@iRobot hadoop]$ ls /u01/hadoopdata/hadoop-bruce/yarn/nmlocal/nmPrivate/
[bruce@iRobot hadoop]$ ls /u01/hadoopdata/hadoop-bruce/yarn/nmlocal/usercache/
[bruce@iRobot hadoop]$ ls /u01/hadoopdata/hadoop-bruce/yarn/userlogs/
[bruce@iRobot hadoop]$
(8)启动proxyserver
[bruce@iRobot hadoop]$ $HADOOP_YARN_HOME/sbin/yarn-daemon.sh --config $HADOOP_CONF_DIR start proxyserver
starting proxyserver, logging to /home/bruce/hadoop-install/hadoop/logs/yarn-bruce-proxyserver-iRobot.out
[bruce@iRobot hadoop]$ jps
22880 Bootstrap
8602 WebAppProxyServer
6328 DataNode
6793 ResourceManager
24986 Main
8166 jar
7943 NodeManager
8644 Jps
6664 SecondaryNameNode
5748 Main
6158 NameNode
[bruce@iRobot hadoop]$ ls logs
hadoop-bruce-datanode-iRobot.log hadoop-bruce-namenode-iRobot.log hadoop-bruce-secondarynamenode-iRobot.log SecurityAuth-bruce.audit yarn-bruce-nodemanager-iRobot.out yarn-bruce-proxyserver-iRobot.out yarn-bruce-resourcemanager-iRobot.out
hadoop-bruce-datanode-iRobot.out hadoop-bruce-namenode-iRobot.out hadoop-bruce-secondarynamenode-iRobot.out yarn-bruce-nodemanager-iRobot.log yarn-bruce-proxyserver-iRobot.log yarn-bruce-resourcemanager-iRobot.log
[bruce@iRobot hadoop]$ cat logs/yarn-bruce-proxyserver-iRobot.out
ulimit -a
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 62702
max locked memory (kbytes, -l) 64
max memory size (kbytes, -m) unlimited
open files (-n) 1024
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 10240
cpu time (seconds, -t) unlimited
max user processes (-u) 1024
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
[bruce@iRobot hadoop]$ cat logs/yarn-bruce-proxyserver-iRobot.log
2015-11-19 14:49:34,324 INFO org.apache.hadoop.yarn.server.webproxy.WebAppProxyServer: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting WebAppProxyServer
STARTUP_MSG: host = iRobot/192.168.100.200
STARTUP_MSG: args = []
STARTUP_MSG: version = 2.0.0-cdh4.5.0
STARTUP_MSG: classpath = /home/bruce/hadoop-install/hadoop/etc/hadoop:/home/bruce/hadoop-install/hadoop/etc/hadoop:/home/bruce/hadoop-install/hadoop/etc/hadoop:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-digester-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.6.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jackson-mapper-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/slf4j-api-1.6.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-logging-1.1.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jackson-jaxrs-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/activation-1.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/zookeeper-3.4.5-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jsr305-1.3.9.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-el-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/protobuf-java-2.4.0a.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/xmlenc-0.52.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jersey-core-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jasper-runtime-5.5.23.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-io-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jersey-json-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jettison-1.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/kfs-0.3.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jetty-util-6.1.26.cloudera.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jetty-6.1.26.cloudera.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/junit-4.8.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/mockito-all-1.8.5.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jsch-0.1.42.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jsp-api-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/guava-11.0.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jline-0.9.94.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-collections-3.2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jets3t-0.6.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/log4j-1.2.17.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-httpclient-3.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-net-3.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jackson-core-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/xz-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/hadoop-auth-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-cli-1.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-lang-2.5.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/cloudera-jets3t-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-compress-1.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/asm-3.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-codec-1.4.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/stax-api-1.0.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/servlet-api-2.5.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jackson-xc-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/paranamer-2.3.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/hadoop-annotations-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jersey-server-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-configuration-1.6.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-math-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/jasper-compiler-5.5.23.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/lib/avro-1.7.4.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/hadoop-common-2.0.0-cdh4.5.0-tests.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/hadoop-common-2.0.0-cdh4.5.0-sources.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/hadoop-common-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/common/hadoop-common-2.0.0-cdh4.5.0-test-sources.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jackson-mapper-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-logging-1.1.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/zookeeper-3.4.5-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jsr305-1.3.9.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-el-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/protobuf-java-2.4.0a.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jersey-core-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jasper-runtime-5.5.23.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-io-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jetty-util-6.1.26.cloudera.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jetty-6.1.26.cloudera.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jsp-api-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/guava-11.0.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jline-0.9.94.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jackson-core-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-lang-2.5.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/asm-3.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/commons-daemon-1.0.3.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/lib/jersey-server-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.0.0-cdh4.5.0-tests.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.0.0-cdh4.5.0-sources.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/hdfs/hadoop-hdfs-2.0.0-cdh4.5.0-test-sources.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jackson-mapper-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/guice-3.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/aopalliance-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/protobuf-java-2.4.0a.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jersey-core-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/commons-io-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/log4j-1.2.17.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jackson-core-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/xz-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jersey-guice-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/asm-3.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/netty-3.2.4.Final.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/javax.inject-1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/paranamer-2.3.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/snappy-java-1.0.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/hadoop-annotations-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jersey-server-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/avro-1.7.4.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-2.0.0-cdh4.5.0-tests.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-client-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-site-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-common-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-api-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/guice-3.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/protobuf-java-2.4.0a.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/jersey-core-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/commons-io-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/jackson-core-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/xz-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/jersey-guice-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/asm-3.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/netty-3.2.4.Final.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/javax.inject-1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/hadoop-annotations-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/jersey-server-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.0.0-cdh4.5.0-tests.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/contrib/capacity-scheduler/*.jar:/home/bruce/hadoop-install/hadoop/contrib/capacity-scheduler/*.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-2.0.0-cdh4.5.0-tests.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-client-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-site-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-common-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-tests-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-api-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jackson-mapper-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/guice-3.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/aopalliance-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/protobuf-java-2.4.0a.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jersey-core-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/commons-io-2.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/log4j-1.2.17.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jackson-core-asl-1.8.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/xz-1.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jersey-guice-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/asm-3.2.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/netty-3.2.4.Final.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/javax.inject-1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/paranamer-2.3.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/snappy-java-1.0.4.1.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/hadoop-annotations-2.0.0-cdh4.5.0.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/jersey-server-1.8.jar:/home/bruce/hadoop-install/hadoop/share/hadoop/yarn/lib/avro-1.7.4.jar
STARTUP_MSG: build = file:///var/lib/jenkins/workspace/CDH4.5.0-Packaging-Hadoop/build/cdh4/hadoop/2.0.0-cdh4.5.0/source/hadoop-common-project/hadoop-common -r 30821ec616ee7a21ee8447949b7c6208a8f1e7d8; compiled by 'jenkins' on Wed Nov 20 14:35:49 PST 2013
STARTUP_MSG: java = 1.6.0_21
************************************************************/
2015-11-19 14:49:34,329 INFO org.apache.hadoop.yarn.server.webproxy.WebAppProxyServer: registered UNIX signal handlers for [TERM, HUP, INT]
2015-11-19 14:49:34,684 WARN org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-11-19 14:49:34,877 INFO org.apache.hadoop.yarn.server.webproxy.AppReportFetcher: Connecting to ResourceManager at /192.168.100.200:8032
2015-11-19 14:49:34,993 INFO org.apache.hadoop.yarn.server.webproxy.AppReportFetcher: Connected to ResourceManager at /192.168.100.200:8032
2015-11-19 14:49:34,993 INFO org.apache.hadoop.yarn.server.webproxy.WebAppProxy: Instantiating Proxy at 192.168.100.200:54315
2015-11-19 14:49:34,997 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.webproxy.WebAppProxy is inited.
2015-11-19 14:49:34,997 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.webproxy.WebAppProxyServer is inited.
2015-11-19 14:49:35,024 INFO org.apache.hadoop.http.HttpServer: SSL is enabled on HttpServer at http://192.168.100.200:-1/ - not live
2015-11-19 14:49:35,029 INFO org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2015-11-19 14:49:35,081 INFO org.apache.hadoop.http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-11-19 14:49:35,083 INFO org.apache.hadoop.http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context proxy
2015-11-19 14:49:35,084 INFO org.apache.hadoop.http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-11-19 14:49:35,084 INFO org.apache.hadoop.http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-11-19 14:49:35,108 INFO org.apache.hadoop.http.HttpServer: Jetty bound to port 54315
2015-11-19 14:49:35,108 INFO org.mortbay.log: jetty-6.1.26.cloudera.2
2015-11-19 14:49:35,135 INFO org.mortbay.log: Extract jar:file:/home/bruce/hadoop-install/hadoop-2.0.0-cdh4.5.0/share/hadoop/yarn/hadoop-yarn-common-2.0.0-cdh4.5.0.jar!/webapps/proxy to /tmp/Jetty_192_168_110_233_54315_proxy____.cp1dhm/webapp
2015-11-19 14:49:35,372 INFO org.mortbay.log: Started [email protected]:54315
2015-11-19 14:49:35,372 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.webproxy.WebAppProxy is started.
2015-11-19 14:49:35,372 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.webproxy.WebAppProxyServer is started.
[bruce@iRobot hadoop]$