目录
环境准备
解压安装kafka最新版、启动zookeeper单机/完全分布式
kafka 单节点单broker(1-1)
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
# 修改配置文件 $KAFKA_HOME/config/server.properties
# server1_1
broker.id=01
listeners=PLAINTEXT://:9092
host.name=master
log.dirs=/app/kafka/tmp0/kafka-logs
zookeeper.connect=master:2181
--------------------------# 启动kafka #-------------------------------------------------
kafka-server-start.sh -daemon $KAFKA_HOME/config/server1_1
--------------------------# jps #-------------------------------------------------------
3495 QuorumPeerMain
3866 Kafka
3931 Jps
--------------------------# 停止 #-------------------------------------------------------
kafka-server-stop.sh
--------------------------# 创建topic: zk #----------------------------------------------
# 副本 1,分区 1
kafka-topics.sh --create --zookeeper master:2181 --replication-factor 1 --partitions 1 --topic hello_topic
--------------------------# 查看所有topic #-----------------------------------------------
kafka-topics.sh --list --zookeeper master:2181
#查看所有topic的详细信息:
kafka-topics.sh --describe --zookeeper master:2181
#查看指定topic的详细信息:
kafka-topics.sh --describe --zookeeper master:2181 --topic hello_topic
--------------------------# 删除主题topic #-----------------------------------------------
# 注意:server.properties配置delete.topic.enable=true才是真正的删除,否则把topic标记为:marked for deletion)
kafka-topics.sh --delete --zookeeper master:2181 --topic hello_topic
--------------------------# 发送消息: broker #--------------------------------------------
kafka-console-producer.sh --broker-list master:9092 --topic hello_topic
--------------------------# 消费消息: zk #------------------------------------------------
# --from-beginning
kafka-console-consumer.sh --zookeeper master:2181 --topic hello_topic --from-beginning
# 如果上一句出现问题是老版本的已过时,则使用下面这一句的新版本的
kafka-console-consumer.sh --bootstrap-server master:9092 --topic hello_topic --from-beginning
-----------------------------------------------------------------------------------------
kafka 单节点多broker(1-3)
?????????????????有问题-无法消费--暂时没解决
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
# 修改配置文件 $KAFKA_HOME/config/server-1.properties
# server3_1
broker.id=01
listeners=PLAINTEXT://:9093
host.name=master
log.dirs=/app/kafka/tmp0/kafka-logs-1
zookeeper.connect=master:2181
-------------------------------------------------------------------------------------------
# 修改配置文件 $KAFKA_HOME/config/server-2.properties
# server3_2
broker.id=02
listeners=PLAINTEXT://:9094
host.name=master
log.dirs=/app/kafka/tmp0/kafka-logs-2
zookeeper.connect=master:2181
-------------------------------------------------------------------------------------------
# 修改配置文件 $KAFKA_HOME/config/server-3.properties
# server3_3
broker.id=03
listeners=PLAINTEXT://:9095
host.name=master
log.dirs=/app/kafka/tmp0/kafka-logs-3
zookeeper.connect=master:2181
--------------------------# 启动kafka #--------------------------------------------------
kafka-server-start.sh -daemon $KAFKA_HOME/config/server3_1 &
kafka-server-start.sh -daemon $KAFKA_HOME/config/server3_2 &
kafka-server-start.sh -daemon $KAFKA_HOME/config/server3_3 &
jps
--------------------------# 创建topic: zk #----------------------------------------------
kafka-topics.sh --create --zookeeper master:2181 --replication-factor 3 --partitions 1 --topic my-replicated-topic
--------------------------# 发送消息: broker #--------------------------------------------
kafka-console-producer.sh --broker-list master:9093,master:9094,master:9095 --topic my-replicated-topic
--------------------------# 消费消息: zk #------------------------------------------------
kafka-console-consumer.sh --zookeeper master:2181 --topic my-replicated-topic --from-beginning
上面一句出现问题-已过时,使用下面的最新版Kafka
kafka-console-consumer.sh --bootstrap-server master:9093,master:9094,master:9095 --topic my-replicated-topic --from-beginning
--------------------------# 描述主题 #------------------------------------------------
kafka-topics.sh --list --zookeeper master:2181
kafka-topics.sh --describe --zookeeper master:2181 --topic my-replicated-topic
-----------------------------------------------------------------------------------------
kafka 多节点多broker(3-3)
暂时先不弄,跟单节点多broker差不多
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
=======================================================================