Hadoop Exceptions

Exceptions汇总

常见异常
http://wenku.baidu.com/link?url=25uwa7pitqR6685zRtnayUzRfLh6durBXjkCdIGV5stXg5oRMMT5WlqhbGw3y1GcZhiHlF3c1pDQuvqTLQAf6_cVVQjXWtbCaJezOnDvNG_

• 2016-03-02 01:44:05,044 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /yarn/nm/usercache/hadoop/appcache/application_1454573000928_0113/container_1454573000928_0113_01_000011/default_container_executor.sh]
  problems in
  16/03/02 02:12:27 WARN pipeline.PipelineBus: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): Access denied for user yarn. Superuser privilege is required

• Get the exit status for the container. （这个是正常的）
  Note: This is valid only for completed containers i.e. containers with state ContainerState.COMPLETE. Otherwise, it returns an ContainerExitStatus.INVALID.

ContainerId: container_1458616050498_0100_01_000004, State: RUNNING, Diagnostics: , ExitStatus: -1000,(Invalid Stutus)

• Yarn:
  1.localhost:地址 不行，改成 hostname ok？？？

Yarn Applciation Diagnosis 一般步骤

1. Application Master 是否已经启动，Application的状态是否是Accept

如果application未被accept，根据yarn client得到的diagnotic信息，查看原因：

16/02/22 22:06:07 INFO yarn.Client:
client token: N/A
diagnostics: N/A
ApplicationMaster host: N/A
ApplicationMaster RPC port: -1
queue: q01
start time: 1456207569767
final status: UNDEFINED
tracking URL: http://vm-slaver1:8088/proxy/application_1456207530505_0001/
user: hadoop