Mapreduce提交job到队列,报错Failed to submit application
其他
2018-07-26 22:05:47
阅读次数: 0
需求:提交job到集群中的某个队列,此时我们把default 队列改为Flow ,order,然后会报下述的错:
Exception in thread "main"
java.io.IOException: org.apache.hadoop.yarn.exceptions.YarnException: Failed to submit application_1532225489052_0002 to YARN : Application application_1532225489052_0002 submitted by user 10988 to unknown queue: default
at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:306)
有两个原因:
1. 原因:提交job,没有指定要提交的job放到哪个队列当中
解决:conf.set("mapred.job.queue.name", "Flow"); //指定要提交的应用到Flow队列中
2.原因:mapred-site.xml中还需要设置一个参数项,因为你改默认队列default修改了之后,
除了在capacity-scheduler.xml中
<property>
<name>yarn.scheduler.capacity.root.queues</name>
<value>Flow,order</value>
<property>
还需要在mapred-site.xml中声明:
<property>
<name>mapreduce.job.queuename</name>
<value>Flow,order</value>
<property>
接下来就大功告成了!!!
转载自blog.csdn.net/xiaozelulu/article/details/81153344