Standalone
./bin/start-cluster.sh
# jps
65425 Jps
51572 TaskManagerRunner
51142 StandaloneSessionClusterEntrypoint
StandaloneSessionClusterEntrypoint 代表的是 Job Manager 进程
TaskManagerRunner 代表的是 Task Manager 进程
可在flink-conf.yaml配置集群:
masters
slaves
增加一个 Task Manager:
bin/taskmanager.sh start|start-foreground|stop|stop-all
增加一个 Job Manager:(Standalone 下最多只能运行一个 Job Manager)
bin/jobmanager.sh ((start|start-foreground) [host] [webui-port])|stop|stop-all
Yarn
Mesos
- jobmanager-service.yaml
apiVersion: v1
kind: Service
metadata:
name: flink-jobmanager
spec:
ports:
- name: rpc
port: 6123
- name: blob
port: 6124
- name: query
port: 6125
- name: ui
port: 8081
selector:
app: flink
component: jobmanager
- jobmanager-deployment.yaml
apiVersion: extensions/v1beta1
kind: Deployment
metadata:
name: flink-jobmanager
spec:
replicas: 1
template:
metadata:
labels:
app: flink
component: jobmanager
spec:
containers:
- name: jobmanager
image: flink:latest
args:
- jobmanager
ports:
- containerPort: 6123
name: rpc
- containerPort: 6124
name: blob
- containerPort: 6125
name: query
- containerPort: 8081
name: ui
env:
- name: JOB_MANAGER_RPC_ADDRESS
value: flink-jobmanager
- taskmanager-deployment.yaml
apiVersion: extensions/v1beta1
kind: Deployment
metadata:
name: flink-taskmanager
spec:
replicas: 2
template:
metadata:
labels:
app: flink
component: taskmanager
spec:
containers:
- name: taskmanager
image: flink:latest
args:
- taskmanager
ports:
- containerPort: 6121
name: data
- containerPort: 6122
name: rpc
- containerPort: 6125
name: query
env:
- name: JOB_MANAGER_RPC_ADDRESS
value: flink-jobmanager
kubectl create -f jobmanager-service.yaml
kubectl create -f jobmanager-deployment.yaml
kubectl create -f taskmanager-deployment.yaml
看 Flink 自带的 UI:kubectl port-forward service/flink-jobmanager 8081:8081
提交Job./bin/flink run -d -m localhost:8081 ~/word-count.jar