Yarn 队列设置

image.png

设置：yarn.resourcemanager.scheduler.class

org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler

Capacity Scheduler，定义flink、default两个队列，各自50%

capacity-scheduler=null
yarn.scheduler.capacity.default.minimum-user-limit-percent=100
yarn.scheduler.capacity.maximum-am-resource-percent=0.35
yarn.scheduler.capacity.maximum-applications=10000
yarn.scheduler.capacity.node-locality-delay=40
yarn.scheduler.capacity.root.accessible-node-labels=*
yarn.scheduler.capacity.root.acl_administer_queue=*
yarn.scheduler.capacity.root.capacity=100
yarn.scheduler.capacity.root.default.acl_administer_jobs=*
yarn.scheduler.capacity.root.default.acl_submit_applications=*
yarn.scheduler.capacity.root.default.capacity=50
yarn.scheduler.capacity.root.default.maximum-capacity=50
yarn.scheduler.capacity.root.default.state=RUNNING
yarn.scheduler.capacity.root.default.user-limit-factor=1
yarn.scheduler.capacity.root.queues=default,flink
yarn.scheduler.capacity.root.flink.acl_administer_jobs=*
yarn.scheduler.capacity.root.flink.acl_submit_applications=*
yarn.scheduler.capacity.root.flink.capacity=50
yarn.scheduler.capacity.root.flink.maximum-capacity=50
yarn.scheduler.capacity.root.flink.minimum-user-limit-percent=100
yarn.scheduler.capacity.root.flink.state=RUNNING
yarn.scheduler.capacity.root.flink.user-limit-factor=1