安装CDH集群时界面一直停留在获取安装锁
2014-09-23 16:36:32,108 INFO [reader:connection.ConnectionImpl@84] Forgetting `session` channel (#28)
2014-09-23 16:36:32,108 INFO [NodeConfiguratorThread-7-1:node.NodeConfiguratorProgress@534] hadoop1: Transitioning from CHMOD (PT0.005S) to EXECUTE_SCRIPT
2014-09-23 16:36:32,108 INFO [NodeConfiguratorThread-7-1:connection.ConnectionImpl@68] Attaching `session` channel (#29)
2014-09-23 16:36:32,148 INFO [reader:direct.SessionChannel@125] Initialized - < session channel: id=29, recipient=1, localWin=[winSize=2097152], remoteWin=[winSize=0] >
2014-09-23 16:36:32,148 INFO [NodeConfiguratorThread-7-1:direct.SessionChannel@372] Sending channel request for `pty-req`
2014-09-23 16:36:32,149 INFO [NodeConfiguratorThread-7-1:node.NodeConfigurator@618] Executing bash -c '/tmp/scm_prepare_node.dIY21371/scm_prepare_node.sh --server_version 5.1.2 --server_build 116 --packages /tmp/scm_prepare_node.dIY21371/packages.scm --always /tmp/scm_prepare_node.dIY21371/always_install.scm --x86_64 /tmp/scm_prepare_node.dIY21371/x86_64_packages.scm --skipImpala true --skipSolr true --unlimitedJCE false | tee /tmp/scm_prepare_node.dIY21371/scm_prepare_node.log; exit ${PIPESTATUS[0]}' on hadoop1
2014-09-23 16:36:32,149 INFO [NodeConfiguratorThread-7-1:direct.SessionChannel@120] Will request to exec `bash -c '/tmp/scm_prepare_node.dIY21371/scm_prepare_node.sh --server_version 5.1.2 --server_build 116 --packages /tmp/scm_prepare_node.dIY21371/packages.scm --always /tmp/scm_prepare_node.dIY21371/always_install.scm --x86_64 /tmp/scm_prepare_node.dIY21371/x86_64_packages.scm --skipImpala true --skipSolr true --unlimitedJCE false | tee /tmp/scm_prepare_node.dIY21371/scm_prepare_node.log; exit ${PIPESTATUS[0]}'`
2014-09-23 16:36:32,149 INFO [NodeConfiguratorThread-7-1:direct.SessionChannel@372] Sending channel request for `exec`
2014-09-23 16:36:32,150 INFO [reader:direct.SessionChannel@326] Received window adjustment for 2097152 bytes
2014-09-23 16:36:33,000 INFO [NodeConfiguratorThread-7-0:node.NodeConfiguratorProgress@534] hadoop2: Transitioning from EXECUTE_SCRIPT (PT1.047S) to SCRIPT_START
2014-09-23 16:36:33,000 INFO [NodeConfiguratorThread-7-0:node.NodeConfiguratorProgress@534] hadoop2: Transitioning from SCRIPT_START (PT0S) to TAKE_LOCK
2014-09-23 16:36:33,152 INFO [NodeConfiguratorThread-7-1:node.NodeConfiguratorProgress@534] hadoop1: Transitioning from EXECUTE_SCRIPT (PT1.044S) to SCRIPT_START
2014-09-23 16:36:33,152 INFO [NodeConfiguratorThread-7-1:node.NodeConfiguratorProgress@534] hadoop1: Transitioning from SCRIPT_START (PT0S) to TAKE_LOCK
2014-09-23 16:38:10,572 INFO [ParcelUpdateService:components.LocalParcelManagerImpl@97] Found files CDH-5.1.2-1.cdh5.1.2.p0.3-el5.parcel under /opt/cloudera/parcel-repo
[root@hadoop1 parcel-repo]# tail -f /var/log/cloudera-scm-server/cloudera-scm-server.log
2014-09-23 16:36:32,148 INFO [NodeConfiguratorThread-7-1:direct.SessionChannel@372] Sending channel request for `pty-req`
2014-09-23 16:36:32,149 INFO [NodeConfiguratorThread-7-1:node.NodeConfigurator@618] Executing bash -c '/tmp/scm_prepare_node.dIY21371/scm_prepare_node.sh --server_version 5.1.2 --server_build 116 --packages /tmp/scm_prepare_node.dIY21371/packages.scm --always /tmp/scm_prepare_node.dIY21371/always_install.scm --x86_64 /tmp/scm_prepare_node.dIY21371/x86_64_packages.scm --skipImpala true --skipSolr true --unlimitedJCE false | tee /tmp/scm_prepare_node.dIY21371/scm_prepare_node.log; exit ${PIPESTATUS[0]}' on hadoop1
2014-09-23 16:36:32,149 INFO [NodeConfiguratorThread-7-1:direct.SessionChannel@120] Will request to exec `bash -c '/tmp/scm_prepare_node.dIY21371/scm_prepare_node.sh --server_version 5.1.2 --server_build 116 --packages /tmp/scm_prepare_node.dIY21371/packages.scm --always /tmp/scm_prepare_node.dIY21371/always_install.scm --x86_64 /tmp/scm_prepare_node.dIY21371/x86_64_packages.scm --skipImpala true --skipSolr true --unlimitedJCE false | tee /tmp/scm_prepare_node.dIY21371/scm_prepare_node.log; exit ${PIPESTATUS[0]}'`
2014-09-23 16:36:32,149 INFO [NodeConfiguratorThread-7-1:direct.SessionChannel@372] Sending channel request for `exec`
2014-09-23 16:36:32,150 INFO [reader:direct.SessionChannel@326] Received window adjustment for 2097152 bytes
2014-09-23 16:36:33,000 INFO [NodeConfiguratorThread-7-0:node.NodeConfiguratorProgress@534] hadoop2: Transitioning from EXECUTE_SCRIPT (PT1.047S) to SCRIPT_START
2014-09-23 16:36:33,000 INFO [NodeConfiguratorThread-7-0:node.NodeConfiguratorProgress@534] hadoop2: Transitioning from SCRIPT_START (PT0S) to TAKE_LOCK
2014-09-23 16:36:33,152 INFO [NodeConfiguratorThread-7-1:node.NodeConfiguratorProgress@534] hadoop1: Transitioning from EXECUTE_SCRIPT (PT1.044S) to SCRIPT_START
2014-09-23 16:36:33,152 INFO [NodeConfiguratorThread-7-1:node.NodeConfiguratorProgress@534] hadoop1: Transitioning from SCRIPT_START (PT0S) to TAKE_LOCK
2014-09-23 16:38:10,572 INFO [ParcelUpdateService:components.LocalParcelManagerImpl@97] Found files CDH-5.1.2-1.cdh5.1.2.p0.3-el5.parcel under /opt/cloudera/parcel-repo
2014-09-23 16:38:56,811 INFO [NodeConfiguratorThread-3-1:direct.SessionChannel@287] Sending close
2014-09-23 16:38:56,813 INFO [reader:direct.SessionChannel@314] Got chan request for `exit-signal`
2014-09-23 16:38:56,813 INFO [reader:direct.SessionChannel@223] Got close
2014-09-23 16:38:56,813 INFO [reader:connection.ConnectionImpl@84] Forgetting `session` channel (#36)
2014-09-23 16:38:56,814 WARN [NodeConfiguratorThread-3-1:node.NodeConfigurator@659] Could not execute bash -c '/tmp/scm_prepare_node.mOi13673/scm_prepare_node.sh --server_version 5.1.2 --server_build 116 --packages /tmp/scm_prepare_node.mOi13673/packages.scm --always /tmp/scm_prepare_node.mOi13673/always_install.scm --x86_64 /tmp/scm_prepare_node.mOi13673/x86_64_packages.scm --skipImpala false --skipSolr false --unlimitedJCE false | tee /tmp/scm_prepare_node.mOi13673/scm_prepare_node.log; exit ${PIPESTATUS[0]}' on hadoop1
net.schmizz.sshj.connection.ConnectionException: Timeout expired
at net.schmizz.sshj.connection.ConnectionException$1.chain(ConnectionException.java:32)
at net.schmizz.sshj.connection.ConnectionException$1.chain(ConnectionException.java:26)
at net.schmizz.concurrent.Promise.retrieve(Promise.java:139)
at net.schmizz.concurrent.Event.await(Event.java:103)
at net.schmizz.sshj.connection.channel.AbstractChannel.join(AbstractChannel.java:280)
at com.cloudera.server.cmf.node.NodeConfigurator.execute(NodeConfigurator.java:634)
at com.cloudera.server.cmf.node.NodeConfigurator.executeScript(NodeConfigurator.java:691)
at com.cloudera.server.cmf.node.NodeConfigurator.configure(NodeConfigurator.java:816)
at com.cloudera.server.cmf.node.NodeConfigurator.run(NodeConfigurator.java:850)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.util.concurrent.TimeoutException: Timeout expired
... 12 more
2014-09-23 16:38:57,599 INFO [NodeConfiguratorThread-3-0:direct.SessionChannel@287] Sending close
2014-09-23 16:38:57,600 INFO [reader:direct.SessionChannel@314] Got chan request for `exit-signal`
2014-09-23 16:38:57,601 INFO [reader:direct.SessionChannel@223] Got close
2014-09-23 16:38:57,602 INFO [reader:connection.ConnectionImpl@84] Forgetting `session` channel (#36)
2014-09-23 16:38:57,602 WARN [NodeConfiguratorThread-3-0:node.NodeConfigurator@659] Could not execute bash -c '/tmp/scm_prepare_node.JnQ12779/scm_prepare_node.sh --server_version 5.1.2 --server_build 116 --packages /tmp/scm_prepare_node.JnQ12779/packages.scm --always /tmp/scm_prepare_node.JnQ12779/always_install.scm --x86_64 /tmp/scm_prepare_node.JnQ12779/x86_64_packages.scm --skipImpala false --skipSolr false --unlimitedJCE false | tee /tmp/scm_prepare_node.JnQ12779/scm_prepare_node.log; exit ${PIPESTATUS[0]}' on hadoop2
net.schmizz.sshj.connection.ConnectionException: Timeout expired
at net.schmizz.sshj.connection.ConnectionException$1.chain(ConnectionException.java:32)
at net.schmizz.sshj.connection.ConnectionException$1.chain(ConnectionException.java:26)
at net.schmizz.concurrent.Promise.retrieve(Promise.java:139)
at net.schmizz.concurrent.Event.await(Event.java:103)
at net.schmizz.sshj.connection.channel.AbstractChannel.join(AbstractChannel.java:280)
at com.cloudera.server.cmf.node.NodeConfigurator.execute(NodeConfigurator.java:634)
at com.cloudera.server.cmf.node.NodeConfigurator.executeScript(NodeConfigurator.java:691)
at com.cloudera.server.cmf.node.NodeConfigurator.configure(NodeConfigurator.java:816)
at com.cloudera.server.cmf.node.NodeConfigurator.run(NodeConfigurator.java:850)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.util.concurrent.TimeoutException: Timeout expired
... 12 more
2014-09-23 16:41:10,603 INFO [ParcelUpdateService:components.LocalParcelManagerImpl@97] Found files CDH-5.1.2-1.cdh5.1.2.p0.3-el5.parcel under /opt/cloudera/parcel-repo
2014-09-23 16:41:54,089 INFO [StaleEntityEviction:model.HeartbeatStore@107] Reaped 0 process heartbeats and 0 host heartbeats.
2014-09-23 16:41:54,102 INFO [StaleEntityEviction:cmf.StaleEntityEvictionThread@238] Found no commands older than 2012-09-23T08:41:54.100Z to reap.
2014-09-23 16:41:54,103 INFO [StaleEntityEviction:cmf.StaleEntityEvictionThread@269] Wizard is active, not reaping scanners or configurators
[root@hadoop1 parcel-repo]# rm -fr /tmp/*
[root@hadoop1 parcel-repo]# tail -f /var/log/cloudera-scm-server/cloudera-scm-server.log
2014-09-23 16:44:27,813 INFO [reader:direct.SessionChannel@125] Initialized - < session channel: id=29, recipient=1, localWin=[winSize=2097152], remoteWin=[winSize=0] >
2014-09-23 16:44:27,813 INFO [NodeConfiguratorThread-7-3:direct.SessionChannel@372] Sending channel request for `pty-req`
2014-09-23 16:44:27,814 INFO [NodeConfiguratorThread-7-3:node.NodeConfigurator@618] Executing bash -c '/tmp/scm_prepare_node.iGR22482/scm_prepare_node.sh --server_version 5.1.2 --server_build 116 --packages /tmp/scm_prepare_node.iGR22482/packages.scm --always /tmp/scm_prepare_node.iGR22482/always_install.scm --x86_64 /tmp/scm_prepare_node.iGR22482/x86_64_packages.scm --skipImpala true --skipSolr true --unlimitedJCE false | tee /tmp/scm_prepare_node.iGR22482/scm_prepare_node.log; exit ${PIPESTATUS[0]}' on hadoop1
2014-09-23 16:44:27,815 INFO [NodeConfiguratorThread-7-3:direct.SessionChannel@120] Will request to exec `bash -c '/tmp/scm_prepare_node.iGR22482/scm_prepare_node.sh --server_version 5.1.2 --server_build 116 --packages /tmp/scm_prepare_node.iGR22482/packages.scm --always /tmp/scm_prepare_node.iGR22482/always_install.scm --x86_64 /tmp/scm_prepare_node.iGR22482/x86_64_packages.scm --skipImpala true --skipSolr true --unlimitedJCE false | tee /tmp/scm_prepare_node.iGR22482/scm_prepare_node.log; exit ${PIPESTATUS[0]}'`
2014-09-23 16:44:27,815 INFO [NodeConfiguratorThread-7-3:direct.SessionChannel@372] Sending channel request for `exec`
2014-09-23 16:44:27,817 INFO [reader:direct.SessionChannel@326] Received window adjustment for 2097152 bytes
2014-09-23 16:44:28,544 INFO [NodeConfiguratorThread-7-2:node.NodeConfiguratorProgress@534] hadoop2: Transitioning from EXECUTE_SCRIPT (PT1.047S) to SCRIPT_START
2014-09-23 16:44:28,544 INFO [NodeConfiguratorThread-7-2:node.NodeConfiguratorProgress@534] hadoop2: Transitioning from SCRIPT_START (PT0S) to TAKE_LOCK
2014-09-23 16:44:28,821 INFO [NodeConfiguratorThread-7-3:node.NodeConfiguratorProgress@534] hadoop1: Transitioning from EXECUTE_SCRIPT (PT1.048S) to SCRIPT_START
2014-09-23 16:44:28,821 INFO [NodeConfiguratorThread-7-3:node.NodeConfiguratorProgress@534] hadoop1: Transitioning from SCRIPT_START (PT0S) to TAKE_LOCK
2014-09-23 16:47:10,660 INFO [ParcelUpdateService:components.LocalParcelManagerImpl@97] Found files CDH-5.1.2-1.cdh5.1.2.p0.3-el5.parcel under /opt/cloudera/parcel-repo
2014-09-23 16:50:10,692 INFO [ParcelUpdateService:components.LocalParcelManagerImpl@97] Found files CDH-5.1.2-1.cdh5.1.2.p0.3-el5.parcel under /opt/cloudera/parcel-repo
2014-09-23 16:51:54,200 INFO [StaleEntityEviction:model.HeartbeatStore@107] Reaped 0 process heartbeats and 0 host heartbeats.
2014-09-23 16:51:54,211 INFO [StaleEntityEviction:cmf.StaleEntityEvictionThread@238] Found no commands older than 2012-09-23T08:51:54.208Z to reap.
2014-09-23 16:51:54,212 INFO [StaleEntityEviction:cmf.StaleEntityEvictionThread@269] Wizard is active, not reaping scanners or configurators
2014-09-23 16:53:10,720 INFO [ParcelUpdateService:components.LocalParcelManagerImpl@97] Found files CDH-5.1.2-1.cdh5.1.2.p0.3-el5.parcel under /opt/cloudera/parcel-repo
2014-09-23 16:56:10,749 INFO [ParcelUpdateService:components.LocalParcelManagerImpl@97] Found files CDH-5.1.2-1.cdh5.1.2.p0.3-el5.parcel under /opt/cloudera/parcel-repo
2014-09-23 16:59:10,779 INFO [ParcelUpdateService:components.LocalParcelManagerImpl@97] Found files CDH-5.1.2-1.cdh5.1.2.p0.3-el5.parcel under /opt/cloudera/parcel-repo
2014-09-23 17:00:00,014 INFO [com.cloudera.cmf.scheduler-1_Worker-1:service.ServiceHandlerRegistry@674] Executing command GlobalPoolsRefresh BasicCmdArgs{scheduleId=1, scheduledTime=2014-09-23T09:00:00.000Z}.
2014-09-23 17:00:00,015 INFO [com.cloudera.cmf.scheduler-1_Worker-1:scheduler.CommandDispatcherJob@191] Skipping scheduled command 'GlobalPoolsRefresh' since it is a noop.
2014-09-23 17:01:54,307 INFO [StaleEntityEviction:model.HeartbeatStore@107] Reaped 0 process heartbeats and 0 host heartbeats.
2014-09-23 17:01:54,322 INFO [StaleEntityEviction:cmf.StaleEntityEvictionThread@238] Found no commands older than 2012-09-23T09:01:54.320Z to reap.
2014-09-23 17:01:54,323 INFO [StaleEntityEviction:cmf.StaleEntityEvictionThread@269] Wizard is active, not reaping scanners or configurators
2014-09-23 17:02:10,811 INFO [ParcelUpdateService:components.LocalParcelManagerImpl@97] Found files CDH-5.1.2-1.cdh5.1.2.p0.3-el5.parcel under /opt/cloudera/parcel-repo
2014-09-23 17:05:10,840 INFO [ParcelUpdateService:components.LocalParcelManagerImpl@97] Found files CDH-5.1.2-1.cdh5.1.2.p0.3-el5.parcel under /opt/cloudera/parcel-repo
2014-09-23 17:06:08,046 INFO [NodeConfiguratorThread-3-3:direct.SessionChannel@287] Sending close
2014-09-23 17:06:08,048 INFO [reader:direct.SessionChannel@314] Got chan request for `exit-signal`
2014-09-23 17:06:08,048 INFO [reader:direct.SessionChannel@223] Got close
2014-09-23 17:06:08,048 INFO [reader:connection.ConnectionImpl@84] Forgetting `session` channel (#36)
2014-09-23 17:06:08,048 WARN [NodeConfiguratorThread-3-3:node.NodeConfigurator@659] Could not execute bash -c '/tmp/scm_prepare_node.rNY16756/scm_prepare_node.sh --server_version 5.1.2 --server_build 116 --packages /tmp/scm_prepare_node.rNY16756/packages.scm --always /tmp/scm_prepare_node.rNY16756/always_install.scm --x86_64 /tmp/scm_prepare_node.rNY16756/x86_64_packages.scm --skipImpala false --skipSolr false --unlimitedJCE false | tee /tmp/scm_prepare_node.rNY16756/scm_prepare_node.log; exit ${PIPESTATUS[0]}' on hadoop1
net.schmizz.sshj.connection.ConnectionException: Timeout expired
at net.schmizz.sshj.connection.ConnectionException$1.chain(ConnectionException.java:32)
at net.schmizz.sshj.connection.ConnectionException$1.chain(ConnectionException.java:26)
at net.schmizz.concurrent.Promise.retrieve(Promise.java:139)
at net.schmizz.concurrent.Event.await(Event.java:103)
at net.schmizz.sshj.connection.channel.AbstractChannel.join(AbstractChannel.java:280)
at com.cloudera.server.cmf.node.NodeConfigurator.execute(NodeConfigurator.java:634)
at com.cloudera.server.cmf.node.NodeConfigurator.executeScript(NodeConfigurator.java:691)
at com.cloudera.server.cmf.node.NodeConfigurator.configure(NodeConfigurator.java:816)
at com.cloudera.server.cmf.node.NodeConfigurator.run(NodeConfigurator.java:850)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.util.concurrent.TimeoutException: Timeout expired
... 12 more
2014-09-23 17:06:08,177 INFO [NodeConfiguratorThread-3-2:direct.SessionChannel@287] Sending close
2014-09-23 17:06:08,181 INFO [reader:direct.SessionChannel@314] Got chan request for `exit-signal`
2014-09-23 17:06:08,183 INFO [reader:direct.SessionChannel@223] Got close
2014-09-23 17:06:08,183 INFO [reader:connection.ConnectionImpl@84] Forgetting `session` channel (#36)
2014-09-23 17:06:08,183 WARN [NodeConfiguratorThread-3-2:node.NodeConfigurator@659] Could not execute bash -c '/tmp/scm_prepare_node.Yvo15729/scm_prepare_node.sh --server_version 5.1.2 --server_build 116 --packages /tmp/scm_prepare_node.Yvo15729/packages.scm --always /tmp/scm_prepare_node.Yvo15729/always_install.scm --x86_64 /tmp/scm_prepare_node.Yvo15729/x86_64_packages.scm --skipImpala false --skipSolr false --unlimitedJCE false | tee /tmp/scm_prepare_node.Yvo15729/scm_prepare_node.log; exit ${PIPESTATUS[0]}' on hadoop2
net.schmizz.sshj.connection.ConnectionException: Timeout expired
at net.schmizz.sshj.connection.ConnectionException$1.chain(ConnectionException.java:32)
at net.schmizz.sshj.connection.ConnectionException$1.chain(ConnectionException.java:26)
at net.schmizz.concurrent.Promise.retrieve(Promise.java:139)
at net.schmizz.concurrent.Event.await(Event.java:103)
at net.schmizz.sshj.connection.channel.AbstractChannel.join(AbstractChannel.java:280)
at com.cloudera.server.cmf.node.NodeConfigurator.execute(NodeConfigurator.java:634)
at com.cloudera.server.cmf.node.NodeConfigurator.executeScript(NodeConfigurator.java:691)
at com.cloudera.server.cmf.node.NodeConfigurator.configure(NodeConfigurator.java:816)
at com.cloudera.server.cmf.node.NodeConfigurator.run(NodeConfigurator.java:850)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.util.concurrent.TimeoutException: Timeout expired
... 12 more
2014-09-23 17:08:10,869 INFO [ParcelUpdateService:components.LocalParcelManagerImpl@97] Found files CDH-5.1.2-1.cdh5.1.2.p0.3-el5.parcel under /opt/cloudera/parcel-repo
2014-09-23 17:11:10,899 INFO [ParcelUpdateService:components.LocalParcelManagerImpl@97] Found files CDH-5.1.2-1.cdh5.1.2.p0.3-el5.parcel under /opt/cloudera/parcel-repo
2014-09-23 17:11:54,419 INFO [StaleEntityEviction:model.HeartbeatStore@107] Reaped 0 process heartbeats and 0 host heartbeats.
2014-09-23 17:11:54,432 INFO [StaleEntityEviction:cmf.StaleEntityEvictionThread@238] Found no commands older than 2012-09-23T09:11:54.429Z to reap.
2014-09-23 16:36:32,108 INFO [NodeConfiguratorThread-7-1:node.NodeConfiguratorProgress@534] hadoop1: Transitioning from CHMOD (PT0.005S) to EXECUTE_SCRIPT
2014-09-23 16:36:32,108 INFO [NodeConfiguratorThread-7-1:connection.ConnectionImpl@68] Attaching `session` channel (#29)
2014-09-23 16:36:32,148 INFO [reader:direct.SessionChannel@125] Initialized - < session channel: id=29, recipient=1, localWin=[winSize=2097152], remoteWin=[winSize=0] >
2014-09-23 16:36:32,148 INFO [NodeConfiguratorThread-7-1:direct.SessionChannel@372] Sending channel request for `pty-req`
2014-09-23 16:36:32,149 INFO [NodeConfiguratorThread-7-1:node.NodeConfigurator@618] Executing bash -c '/tmp/scm_prepare_node.dIY21371/scm_prepare_node.sh --server_version 5.1.2 --server_build 116 --packages /tmp/scm_prepare_node.dIY21371/packages.scm --always /tmp/scm_prepare_node.dIY21371/always_install.scm --x86_64 /tmp/scm_prepare_node.dIY21371/x86_64_packages.scm --skipImpala true --skipSolr true --unlimitedJCE false | tee /tmp/scm_prepare_node.dIY21371/scm_prepare_node.log; exit ${PIPESTATUS[0]}' on hadoop1
2014-09-23 16:36:32,149 INFO [NodeConfiguratorThread-7-1:direct.SessionChannel@120] Will request to exec `bash -c '/tmp/scm_prepare_node.dIY21371/scm_prepare_node.sh --server_version 5.1.2 --server_build 116 --packages /tmp/scm_prepare_node.dIY21371/packages.scm --always /tmp/scm_prepare_node.dIY21371/always_install.scm --x86_64 /tmp/scm_prepare_node.dIY21371/x86_64_packages.scm --skipImpala true --skipSolr true --unlimitedJCE false | tee /tmp/scm_prepare_node.dIY21371/scm_prepare_node.log; exit ${PIPESTATUS[0]}'`
2014-09-23 16:36:32,149 INFO [NodeConfiguratorThread-7-1:direct.SessionChannel@372] Sending channel request for `exec`
2014-09-23 16:36:32,150 INFO [reader:direct.SessionChannel@326] Received window adjustment for 2097152 bytes
2014-09-23 16:36:33,000 INFO [NodeConfiguratorThread-7-0:node.NodeConfiguratorProgress@534] hadoop2: Transitioning from EXECUTE_SCRIPT (PT1.047S) to SCRIPT_START
2014-09-23 16:36:33,000 INFO [NodeConfiguratorThread-7-0:node.NodeConfiguratorProgress@534] hadoop2: Transitioning from SCRIPT_START (PT0S) to TAKE_LOCK
2014-09-23 16:36:33,152 INFO [NodeConfiguratorThread-7-1:node.NodeConfiguratorProgress@534] hadoop1: Transitioning from EXECUTE_SCRIPT (PT1.044S) to SCRIPT_START
2014-09-23 16:36:33,152 INFO [NodeConfiguratorThread-7-1:node.NodeConfiguratorProgress@534] hadoop1: Transitioning from SCRIPT_START (PT0S) to TAKE_LOCK
2014-09-23 16:38:10,572 INFO [ParcelUpdateService:components.LocalParcelManagerImpl@97] Found files CDH-5.1.2-1.cdh5.1.2.p0.3-el5.parcel under /opt/cloudera/parcel-repo
[root@hadoop1 parcel-repo]# tail -f /var/log/cloudera-scm-server/cloudera-scm-server.log
2014-09-23 16:36:32,148 INFO [NodeConfiguratorThread-7-1:direct.SessionChannel@372] Sending channel request for `pty-req`
2014-09-23 16:36:32,149 INFO [NodeConfiguratorThread-7-1:node.NodeConfigurator@618] Executing bash -c '/tmp/scm_prepare_node.dIY21371/scm_prepare_node.sh --server_version 5.1.2 --server_build 116 --packages /tmp/scm_prepare_node.dIY21371/packages.scm --always /tmp/scm_prepare_node.dIY21371/always_install.scm --x86_64 /tmp/scm_prepare_node.dIY21371/x86_64_packages.scm --skipImpala true --skipSolr true --unlimitedJCE false | tee /tmp/scm_prepare_node.dIY21371/scm_prepare_node.log; exit ${PIPESTATUS[0]}' on hadoop1
2014-09-23 16:36:32,149 INFO [NodeConfiguratorThread-7-1:direct.SessionChannel@120] Will request to exec `bash -c '/tmp/scm_prepare_node.dIY21371/scm_prepare_node.sh --server_version 5.1.2 --server_build 116 --packages /tmp/scm_prepare_node.dIY21371/packages.scm --always /tmp/scm_prepare_node.dIY21371/always_install.scm --x86_64 /tmp/scm_prepare_node.dIY21371/x86_64_packages.scm --skipImpala true --skipSolr true --unlimitedJCE false | tee /tmp/scm_prepare_node.dIY21371/scm_prepare_node.log; exit ${PIPESTATUS[0]}'`
2014-09-23 16:36:32,149 INFO [NodeConfiguratorThread-7-1:direct.SessionChannel@372] Sending channel request for `exec`
2014-09-23 16:36:32,150 INFO [reader:direct.SessionChannel@326] Received window adjustment for 2097152 bytes
2014-09-23 16:36:33,000 INFO [NodeConfiguratorThread-7-0:node.NodeConfiguratorProgress@534] hadoop2: Transitioning from EXECUTE_SCRIPT (PT1.047S) to SCRIPT_START
2014-09-23 16:36:33,000 INFO [NodeConfiguratorThread-7-0:node.NodeConfiguratorProgress@534] hadoop2: Transitioning from SCRIPT_START (PT0S) to TAKE_LOCK
2014-09-23 16:36:33,152 INFO [NodeConfiguratorThread-7-1:node.NodeConfiguratorProgress@534] hadoop1: Transitioning from EXECUTE_SCRIPT (PT1.044S) to SCRIPT_START
2014-09-23 16:36:33,152 INFO [NodeConfiguratorThread-7-1:node.NodeConfiguratorProgress@534] hadoop1: Transitioning from SCRIPT_START (PT0S) to TAKE_LOCK
2014-09-23 16:38:10,572 INFO [ParcelUpdateService:components.LocalParcelManagerImpl@97] Found files CDH-5.1.2-1.cdh5.1.2.p0.3-el5.parcel under /opt/cloudera/parcel-repo
2014-09-23 16:38:56,811 INFO [NodeConfiguratorThread-3-1:direct.SessionChannel@287] Sending close
2014-09-23 16:38:56,813 INFO [reader:direct.SessionChannel@314] Got chan request for `exit-signal`
2014-09-23 16:38:56,813 INFO [reader:direct.SessionChannel@223] Got close
2014-09-23 16:38:56,813 INFO [reader:connection.ConnectionImpl@84] Forgetting `session` channel (#36)
2014-09-23 16:38:56,814 WARN [NodeConfiguratorThread-3-1:node.NodeConfigurator@659] Could not execute bash -c '/tmp/scm_prepare_node.mOi13673/scm_prepare_node.sh --server_version 5.1.2 --server_build 116 --packages /tmp/scm_prepare_node.mOi13673/packages.scm --always /tmp/scm_prepare_node.mOi13673/always_install.scm --x86_64 /tmp/scm_prepare_node.mOi13673/x86_64_packages.scm --skipImpala false --skipSolr false --unlimitedJCE false | tee /tmp/scm_prepare_node.mOi13673/scm_prepare_node.log; exit ${PIPESTATUS[0]}' on hadoop1
net.schmizz.sshj.connection.ConnectionException: Timeout expired
at net.schmizz.sshj.connection.ConnectionException$1.chain(ConnectionException.java:32)
at net.schmizz.sshj.connection.ConnectionException$1.chain(ConnectionException.java:26)
at net.schmizz.concurrent.Promise.retrieve(Promise.java:139)
at net.schmizz.concurrent.Event.await(Event.java:103)
at net.schmizz.sshj.connection.channel.AbstractChannel.join(AbstractChannel.java:280)
at com.cloudera.server.cmf.node.NodeConfigurator.execute(NodeConfigurator.java:634)
at com.cloudera.server.cmf.node.NodeConfigurator.executeScript(NodeConfigurator.java:691)
at com.cloudera.server.cmf.node.NodeConfigurator.configure(NodeConfigurator.java:816)
at com.cloudera.server.cmf.node.NodeConfigurator.run(NodeConfigurator.java:850)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.util.concurrent.TimeoutException: Timeout expired
... 12 more
2014-09-23 16:38:57,599 INFO [NodeConfiguratorThread-3-0:direct.SessionChannel@287] Sending close
2014-09-23 16:38:57,600 INFO [reader:direct.SessionChannel@314] Got chan request for `exit-signal`
2014-09-23 16:38:57,601 INFO [reader:direct.SessionChannel@223] Got close
2014-09-23 16:38:57,602 INFO [reader:connection.ConnectionImpl@84] Forgetting `session` channel (#36)
2014-09-23 16:38:57,602 WARN [NodeConfiguratorThread-3-0:node.NodeConfigurator@659] Could not execute bash -c '/tmp/scm_prepare_node.JnQ12779/scm_prepare_node.sh --server_version 5.1.2 --server_build 116 --packages /tmp/scm_prepare_node.JnQ12779/packages.scm --always /tmp/scm_prepare_node.JnQ12779/always_install.scm --x86_64 /tmp/scm_prepare_node.JnQ12779/x86_64_packages.scm --skipImpala false --skipSolr false --unlimitedJCE false | tee /tmp/scm_prepare_node.JnQ12779/scm_prepare_node.log; exit ${PIPESTATUS[0]}' on hadoop2
net.schmizz.sshj.connection.ConnectionException: Timeout expired
at net.schmizz.sshj.connection.ConnectionException$1.chain(ConnectionException.java:32)
at net.schmizz.sshj.connection.ConnectionException$1.chain(ConnectionException.java:26)
at net.schmizz.concurrent.Promise.retrieve(Promise.java:139)
at net.schmizz.concurrent.Event.await(Event.java:103)
at net.schmizz.sshj.connection.channel.AbstractChannel.join(AbstractChannel.java:280)
at com.cloudera.server.cmf.node.NodeConfigurator.execute(NodeConfigurator.java:634)
at com.cloudera.server.cmf.node.NodeConfigurator.executeScript(NodeConfigurator.java:691)
at com.cloudera.server.cmf.node.NodeConfigurator.configure(NodeConfigurator.java:816)
at com.cloudera.server.cmf.node.NodeConfigurator.run(NodeConfigurator.java:850)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.util.concurrent.TimeoutException: Timeout expired
... 12 more
2014-09-23 16:41:10,603 INFO [ParcelUpdateService:components.LocalParcelManagerImpl@97] Found files CDH-5.1.2-1.cdh5.1.2.p0.3-el5.parcel under /opt/cloudera/parcel-repo
2014-09-23 16:41:54,089 INFO [StaleEntityEviction:model.HeartbeatStore@107] Reaped 0 process heartbeats and 0 host heartbeats.
2014-09-23 16:41:54,102 INFO [StaleEntityEviction:cmf.StaleEntityEvictionThread@238] Found no commands older than 2012-09-23T08:41:54.100Z to reap.
2014-09-23 16:41:54,103 INFO [StaleEntityEviction:cmf.StaleEntityEvictionThread@269] Wizard is active, not reaping scanners or configurators
[root@hadoop1 parcel-repo]# rm -fr /tmp/*
[root@hadoop1 parcel-repo]# tail -f /var/log/cloudera-scm-server/cloudera-scm-server.log
2014-09-23 16:44:27,813 INFO [reader:direct.SessionChannel@125] Initialized - < session channel: id=29, recipient=1, localWin=[winSize=2097152], remoteWin=[winSize=0] >
2014-09-23 16:44:27,813 INFO [NodeConfiguratorThread-7-3:direct.SessionChannel@372] Sending channel request for `pty-req`
2014-09-23 16:44:27,814 INFO [NodeConfiguratorThread-7-3:node.NodeConfigurator@618] Executing bash -c '/tmp/scm_prepare_node.iGR22482/scm_prepare_node.sh --server_version 5.1.2 --server_build 116 --packages /tmp/scm_prepare_node.iGR22482/packages.scm --always /tmp/scm_prepare_node.iGR22482/always_install.scm --x86_64 /tmp/scm_prepare_node.iGR22482/x86_64_packages.scm --skipImpala true --skipSolr true --unlimitedJCE false | tee /tmp/scm_prepare_node.iGR22482/scm_prepare_node.log; exit ${PIPESTATUS[0]}' on hadoop1
2014-09-23 16:44:27,815 INFO [NodeConfiguratorThread-7-3:direct.SessionChannel@120] Will request to exec `bash -c '/tmp/scm_prepare_node.iGR22482/scm_prepare_node.sh --server_version 5.1.2 --server_build 116 --packages /tmp/scm_prepare_node.iGR22482/packages.scm --always /tmp/scm_prepare_node.iGR22482/always_install.scm --x86_64 /tmp/scm_prepare_node.iGR22482/x86_64_packages.scm --skipImpala true --skipSolr true --unlimitedJCE false | tee /tmp/scm_prepare_node.iGR22482/scm_prepare_node.log; exit ${PIPESTATUS[0]}'`
2014-09-23 16:44:27,815 INFO [NodeConfiguratorThread-7-3:direct.SessionChannel@372] Sending channel request for `exec`
2014-09-23 16:44:27,817 INFO [reader:direct.SessionChannel@326] Received window adjustment for 2097152 bytes
2014-09-23 16:44:28,544 INFO [NodeConfiguratorThread-7-2:node.NodeConfiguratorProgress@534] hadoop2: Transitioning from EXECUTE_SCRIPT (PT1.047S) to SCRIPT_START
2014-09-23 16:44:28,544 INFO [NodeConfiguratorThread-7-2:node.NodeConfiguratorProgress@534] hadoop2: Transitioning from SCRIPT_START (PT0S) to TAKE_LOCK
2014-09-23 16:44:28,821 INFO [NodeConfiguratorThread-7-3:node.NodeConfiguratorProgress@534] hadoop1: Transitioning from EXECUTE_SCRIPT (PT1.048S) to SCRIPT_START
2014-09-23 16:44:28,821 INFO [NodeConfiguratorThread-7-3:node.NodeConfiguratorProgress@534] hadoop1: Transitioning from SCRIPT_START (PT0S) to TAKE_LOCK
2014-09-23 16:47:10,660 INFO [ParcelUpdateService:components.LocalParcelManagerImpl@97] Found files CDH-5.1.2-1.cdh5.1.2.p0.3-el5.parcel under /opt/cloudera/parcel-repo
2014-09-23 16:50:10,692 INFO [ParcelUpdateService:components.LocalParcelManagerImpl@97] Found files CDH-5.1.2-1.cdh5.1.2.p0.3-el5.parcel under /opt/cloudera/parcel-repo
2014-09-23 16:51:54,200 INFO [StaleEntityEviction:model.HeartbeatStore@107] Reaped 0 process heartbeats and 0 host heartbeats.
2014-09-23 16:51:54,211 INFO [StaleEntityEviction:cmf.StaleEntityEvictionThread@238] Found no commands older than 2012-09-23T08:51:54.208Z to reap.
2014-09-23 16:51:54,212 INFO [StaleEntityEviction:cmf.StaleEntityEvictionThread@269] Wizard is active, not reaping scanners or configurators
2014-09-23 16:53:10,720 INFO [ParcelUpdateService:components.LocalParcelManagerImpl@97] Found files CDH-5.1.2-1.cdh5.1.2.p0.3-el5.parcel under /opt/cloudera/parcel-repo
2014-09-23 16:56:10,749 INFO [ParcelUpdateService:components.LocalParcelManagerImpl@97] Found files CDH-5.1.2-1.cdh5.1.2.p0.3-el5.parcel under /opt/cloudera/parcel-repo
2014-09-23 16:59:10,779 INFO [ParcelUpdateService:components.LocalParcelManagerImpl@97] Found files CDH-5.1.2-1.cdh5.1.2.p0.3-el5.parcel under /opt/cloudera/parcel-repo
2014-09-23 17:00:00,014 INFO [com.cloudera.cmf.scheduler-1_Worker-1:service.ServiceHandlerRegistry@674] Executing command GlobalPoolsRefresh BasicCmdArgs{scheduleId=1, scheduledTime=2014-09-23T09:00:00.000Z}.
2014-09-23 17:00:00,015 INFO [com.cloudera.cmf.scheduler-1_Worker-1:scheduler.CommandDispatcherJob@191] Skipping scheduled command 'GlobalPoolsRefresh' since it is a noop.
2014-09-23 17:01:54,307 INFO [StaleEntityEviction:model.HeartbeatStore@107] Reaped 0 process heartbeats and 0 host heartbeats.
2014-09-23 17:01:54,322 INFO [StaleEntityEviction:cmf.StaleEntityEvictionThread@238] Found no commands older than 2012-09-23T09:01:54.320Z to reap.
2014-09-23 17:01:54,323 INFO [StaleEntityEviction:cmf.StaleEntityEvictionThread@269] Wizard is active, not reaping scanners or configurators
2014-09-23 17:02:10,811 INFO [ParcelUpdateService:components.LocalParcelManagerImpl@97] Found files CDH-5.1.2-1.cdh5.1.2.p0.3-el5.parcel under /opt/cloudera/parcel-repo
2014-09-23 17:05:10,840 INFO [ParcelUpdateService:components.LocalParcelManagerImpl@97] Found files CDH-5.1.2-1.cdh5.1.2.p0.3-el5.parcel under /opt/cloudera/parcel-repo
2014-09-23 17:06:08,046 INFO [NodeConfiguratorThread-3-3:direct.SessionChannel@287] Sending close
2014-09-23 17:06:08,048 INFO [reader:direct.SessionChannel@314] Got chan request for `exit-signal`
2014-09-23 17:06:08,048 INFO [reader:direct.SessionChannel@223] Got close
2014-09-23 17:06:08,048 INFO [reader:connection.ConnectionImpl@84] Forgetting `session` channel (#36)
2014-09-23 17:06:08,048 WARN [NodeConfiguratorThread-3-3:node.NodeConfigurator@659] Could not execute bash -c '/tmp/scm_prepare_node.rNY16756/scm_prepare_node.sh --server_version 5.1.2 --server_build 116 --packages /tmp/scm_prepare_node.rNY16756/packages.scm --always /tmp/scm_prepare_node.rNY16756/always_install.scm --x86_64 /tmp/scm_prepare_node.rNY16756/x86_64_packages.scm --skipImpala false --skipSolr false --unlimitedJCE false | tee /tmp/scm_prepare_node.rNY16756/scm_prepare_node.log; exit ${PIPESTATUS[0]}' on hadoop1
net.schmizz.sshj.connection.ConnectionException: Timeout expired
at net.schmizz.sshj.connection.ConnectionException$1.chain(ConnectionException.java:32)
at net.schmizz.sshj.connection.ConnectionException$1.chain(ConnectionException.java:26)
at net.schmizz.concurrent.Promise.retrieve(Promise.java:139)
at net.schmizz.concurrent.Event.await(Event.java:103)
at net.schmizz.sshj.connection.channel.AbstractChannel.join(AbstractChannel.java:280)
at com.cloudera.server.cmf.node.NodeConfigurator.execute(NodeConfigurator.java:634)
at com.cloudera.server.cmf.node.NodeConfigurator.executeScript(NodeConfigurator.java:691)
at com.cloudera.server.cmf.node.NodeConfigurator.configure(NodeConfigurator.java:816)
at com.cloudera.server.cmf.node.NodeConfigurator.run(NodeConfigurator.java:850)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.util.concurrent.TimeoutException: Timeout expired
... 12 more
2014-09-23 17:06:08,177 INFO [NodeConfiguratorThread-3-2:direct.SessionChannel@287] Sending close
2014-09-23 17:06:08,181 INFO [reader:direct.SessionChannel@314] Got chan request for `exit-signal`
2014-09-23 17:06:08,183 INFO [reader:direct.SessionChannel@223] Got close
2014-09-23 17:06:08,183 INFO [reader:connection.ConnectionImpl@84] Forgetting `session` channel (#36)
2014-09-23 17:06:08,183 WARN [NodeConfiguratorThread-3-2:node.NodeConfigurator@659] Could not execute bash -c '/tmp/scm_prepare_node.Yvo15729/scm_prepare_node.sh --server_version 5.1.2 --server_build 116 --packages /tmp/scm_prepare_node.Yvo15729/packages.scm --always /tmp/scm_prepare_node.Yvo15729/always_install.scm --x86_64 /tmp/scm_prepare_node.Yvo15729/x86_64_packages.scm --skipImpala false --skipSolr false --unlimitedJCE false | tee /tmp/scm_prepare_node.Yvo15729/scm_prepare_node.log; exit ${PIPESTATUS[0]}' on hadoop2
net.schmizz.sshj.connection.ConnectionException: Timeout expired
at net.schmizz.sshj.connection.ConnectionException$1.chain(ConnectionException.java:32)
at net.schmizz.sshj.connection.ConnectionException$1.chain(ConnectionException.java:26)
at net.schmizz.concurrent.Promise.retrieve(Promise.java:139)
at net.schmizz.concurrent.Event.await(Event.java:103)
at net.schmizz.sshj.connection.channel.AbstractChannel.join(AbstractChannel.java:280)
at com.cloudera.server.cmf.node.NodeConfigurator.execute(NodeConfigurator.java:634)
at com.cloudera.server.cmf.node.NodeConfigurator.executeScript(NodeConfigurator.java:691)
at com.cloudera.server.cmf.node.NodeConfigurator.configure(NodeConfigurator.java:816)
at com.cloudera.server.cmf.node.NodeConfigurator.run(NodeConfigurator.java:850)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.util.concurrent.TimeoutException: Timeout expired
... 12 more
2014-09-23 17:08:10,869 INFO [ParcelUpdateService:components.LocalParcelManagerImpl@97] Found files CDH-5.1.2-1.cdh5.1.2.p0.3-el5.parcel under /opt/cloudera/parcel-repo
2014-09-23 17:11:10,899 INFO [ParcelUpdateService:components.LocalParcelManagerImpl@97] Found files CDH-5.1.2-1.cdh5.1.2.p0.3-el5.parcel under /opt/cloudera/parcel-repo
2014-09-23 17:11:54,419 INFO [StaleEntityEviction:model.HeartbeatStore@107] Reaped 0 process heartbeats and 0 host heartbeats.
2014-09-23 17:11:54,432 INFO [StaleEntityEviction:cmf.StaleEntityEvictionThread@238] Found no commands older than 2012-09-23T09:11:54.429Z to reap.
2014-09-23 17:11:54,433 INFO [StaleEntityEviction:cmf.StaleEntityEvictionThread@269] Wizard is active, not reaping scanners or configurators
经过摸索，原来是ssh的信任配置没有配置好，汗。