K8s事件监控kube-eventer
一 背景
目前k8s监控可以分为：资源监控，性能监控，安全健康等，但是在K8s中，如何表示一个资源对象的状态及一些列的资源状态转换，需要对k8s的events事件监控来表示，目前阿里有开源的K8s事件监控项目kube-eventer， 其将事件分为两种，一种是Warning事件，表示产生这个事件的状态转换是在非预期的状态之间产生的；另外一种是Normal事件，表示期望到达的状态，和目前达到的状态是一致的。

2.部署
使用阿里的开源k8s事件监控项目，可以收集k8s的事件日志，来自定义等级告警
项目地址：https://github.com/AliyunContainerService/kube-eventer/tree/master
本例将k8s event 写入了elk集群并配置了钉钉告警
deploy内容如下：

apiVersion: apps/v1
kind: Deployment
metadata:
  labels:
    name: kube-eventer
  name: kube-eventer
  namespace: kube-system
spec:
  replicas: 1
  selector:
    matchLabels:
      app: kube-eventer
  template:
    metadata:
      labels:
        app: kube-eventer
      annotations:	
        scheduler.alpha.kubernetes.io/critical-pod: ''
    spec:
      dnsPolicy: ClusterFirstWithHostNet
      serviceAccount: kube-eventer
      containers:
        - image: registry.aliyuncs.com/acs/kube-eventer-amd64:v1.1.0-c93a835-aliyun
          name: kube-eventer
          command:
            - "/kube-eventer"
            - "--source=kubernetes:https://172.16.123.166:8443"
            ## .e.g,dingtalk sink demo
            - --sink=dingtalk:https://oapi.dingtalk.com/robot/send?access_token=66673d5ed76f44823740df319fa164772aafb21075e266d584d01ac1199a97b4e&label=k8s_event_warning&level=Warning
            - --sink=elasticsearch:http://172.16.123.160:9200?sniff=false&ver=6&index=k8sevent
          env:
          # If TZ is assigned, set the TZ value as the time zone
          - name: TZ
            value: "Asia/Shanghai" 
          volumeMounts:
            - name: localtime
              mountPath: /etc/localtime
              readOnly: true
            - name: zoneinfo
              mountPath: /usr/share/zoneinfo
              readOnly: true
          resources:
            requests:
              cpu: 100m
              memory: 100Mi
            limits:
              cpu: 500m
              memory: 250Mi
      volumes:
        - name: localtime
          hostPath:
            path: /etc/localtime
        - name: zoneinfo
          hostPath:
            path: /usr/share/zoneinfo
---
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRole
metadata:
  name: kube-eventer
rules:
  - apiGroups:
      - ""
    resources:
      - events
    verbs:
      - get
      - list
      - watch
---
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRoleBinding
metadata:
  name: kube-eventer
roleRef:
  apiGroup: rbac.authorization.k8s.io
  kind: ClusterRole
  name: kube-eventer
subjects:
  - kind: ServiceAccount
    name: kube-eventer
    namespace: kube-system
---
apiVersion: v1
kind: ServiceAccount
metadata:
  name: kube-eventer
  namespace: kube-system

说明:k8s api-server、elastsearch 、钉钉告警机器人地址根据自己实际情况修改。
3.将以上内容保存为yaml文件kubectl apply 即可部署成功，然后在kibana创建索引k8sevent即可