linux安装hadoop2.7.2nodemanager启动停止

在datanode节点查看日志:

vim logs/yarn-root-nodemanager-node2.log
ERROR org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Unexpected error starting NodeStatusUpdater
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN signal from Resourcemanager ,Registration of NodeManager failed, Message from ResourceManager: NodeManager from  node2 doesn't satisfy minimum allocations, Sending SHUTDOWN signal to the NodeManager.

不满足要求的最小分配需求。
查看咱们配置的yarn-site.xml

...

        yarn.nodemanager.resource.memory-mb
        768

...

应该修改为至少大于等于1024。

...

        yarn.nodemanager.resource.memory-mb
        1024

...

为啥呢?(我这也是自己想出来的,未必完全正确,仅供参考。)
yarn-site.xml中有默认这样一条配置:

name value description
yarn.scheduler.minimum-allocation-mb 1024 The minimum allocation for every container request at the RM, in MBs. Memory requests lower than this will throw a InvalidResourceRequestException.

咱们配置的内容:

name value description
yarn.nodemanager.resource.memory-mb 768 Amount of physical memory, in MB, that can be allocated for containers.

yarn.scheduler.minimum-allocation-mb它是说,rm分配给container的最小内存。
yarn.nodemanager.resource.memory-mb它是说,本节点可分配的内存有多少。

没错,可分配的比最小要求的小,所以报错了。


container是yarn中对资源的抽象(了解更多还是查资料吧)。但是肯定的是container肯定是小于等于datanode的资源的。


不对的,希望留言帮忙指正!3q

你可能感兴趣的:(安装)