【yarn】job日志查看

一、shell命令查看

#用户要和提交任务的用户一致

yarn application -list -appStates ALL

yarn logs -applicationId application_1605576784861_0041

二、web UI查看

yarn-site.xml添加属性

<property>
    <name>yarn.log-aggregation-enable</name>
    <value>true</value>
</property>
<!-- resourceManager  保存最大的任务完成个数 -->
<property>
        <name>yarn.resourcemanager.max-completed-applications</name>
        <value>1000</value>
</property>
<property>
        <name>yarn.log.server.url</name>
        <value>http://agent:19888/jobhistory/logs</value>
</property>

重启yarn

stop-yarn.sh

start-yarn.sh

开启jobhistory

mr-jobhistory-daemon.sh start historyserver

查看日志

进去yarn web页面  IP:8088

 Em...看一个失败的任务

扫描二维码关注公众号,回复: 12601315 查看本文章

猜你喜欢

转载自blog.csdn.net/qq_44065303/article/details/109512616