cm:
http://152.32.141.11:7180/cmf/login
登陆manager节点:
sudo su hdfs
yarn application -list
#查flink session的application id
#打开flink的web管理
http://manager.algorithm.opayride.com:8088/proxy/application_1572516566413_0919/#/job
#算法启动session:
/data/flink/bin/yarn-session.sh -n 20 -m 4 -qu flink -jm 1024 -tm 8192 -s 2 -d
#在session上run job
cd /var/lib/hadoop-hdfs/src/oride-research/flink/flink-ufile
flink run -p 4 -c com.opay.research.hadoop.UfileJob target/flink-ufile-1.0.jar --prod
重启session:
1/ 在web管理界面上退出:
点running jobs,点运行的session job进去,把它cancel掉
2/ 用
也可在启动时得到它的web地址
# 启动yarn-session模式,不用启动flink集群
[root@oldboy-node101 conf]# yarn-session.sh
2019-08-03 21:57:59,585 WARN org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Flink JobManager is now running on oldboy-node103:35244 with leader id 00000000-0000-0000-0000-000000000000.
JobManager Web Interface: http://oldboy-node103:35244