queue ide is not exists in YARN

报错内容:

2023-08-17 17:30:31.342 [ERROR] [BaseTaskScheduler-Thread-7              ] o.a.l.o.s.a.AsyncExecTaskRunnerImpl (79) [run] - Failed to execute task astJob_1_codeExec_1 org.apache.linkis.orchestrator.ecm.exception.ECMPluginErrorException: errCode: 12003 ,desc: hadoop0004:9101_1 Failed  to async get EngineNode MatchError: LinkisException{errCode=11006, desc='Failed to request external resourceRMWarnException: errCode: 11006 ,desc: queue ide is not exists in YARN. ,ip: hadoop0004 ,port: 9101 ,serviceKind: linkis-cg-linkismanager', ip='hadoop0004', port=9101, serviceKind='linkis-cg-linkismanager'} (of class org.apache.linkis.manager.common.exception.RMErrorException) ,ip: hadoop0004 ,port: 9104 ,serviceKind: linkis-cg-entrance

这个问题比较好解决

linkis官方有说明 Linkis 部署排障 | Apache Linkis

异常信息:desc: queue ide is not exists in YARN. 表明配置的yarn队列不存在,需要进行调整

修改方式:linkis管理台/参数配置>全局设置>yarn队列名[wds.linkis.rm.yarnqueue],修改一个可以使用的yarn队列,可以使用的yarn 队列可以在 rmWebAddress:http://xx.xx.xx.xx:8088/cluster/scheduler 上查看到

我看到的队列是这样的

queue ide is not exists in YARN_第1张图片

队列名应该是default, 不过我眼拙, 写上root, 仍然报错, 后又改成default, 还是报root, 可能有缓存?

queue ide is not exists in YARN_第2张图片

然后报错内存不足,这个好理解, 应该是内存配置的问题

2023-08-17 17:53:01.660 [WARN ] [BaseTaskScheduler-Thread-30             ] o.a.l.o.e.ComputationEngineConnManager (50) [warn] - mark_5 Failed to askEngineAskRequest time taken (115), errCode: 12003 ,desc: hadoop0004:9101_19 Failed  to async get EngineNode LinkisRetryException: errCode: 30002 ,desc: not engough resource: : errCode: 12010 ,desc: Insufficient cluster queue memory ,ip: hadoop0004 ,port: 9101 ,serviceKind: linkis-cg-linkismanager ,ip: hadoop0004 ,port: 9101 ,serviceKind: linkis-cg-linkismanager ,ip: hadoop0004 ,port: 9104 ,serviceKind: linkis-cg-entrance

资源太小最小是1G

queue ide is not exists in YARN_第3张图片

你可能感兴趣的:(DataSphere,linkis)