Kafka命令

启动Kafka:
/export/servers/zookeeper/bin/zkServer.sh start
nohup /usr/local/kafka/bin/kafka-server-start.sh /usr/local/kafka/config/server.properties &

停用Kafka:
/export/servers/bin/zookeeper-server-stop.sh
/usr/local/kafka/bin/kafka-server-stop.sh

查看当前服务器中的所有topic
/usr/local/kafka/bin/kafka-topics.sh --list --zookeeper node01:2181

创建topic
/usr/local/kafka/bin/kafka-topics.sh --create --zookeeper node01:2181 --replication-factor 1 --partitions 1 --topic test

删除topic
/usr/local/kafka/bin/kafka-topics.sh --delete --zookeeper node01:2181 --topic test
需要server.properties中设置delete.topic.enable=true否则只是标记删除或者直接重启。

通过shell命令发送消息
/usr/local/kafka/bin/kafka-console-producer.sh --broker-list node01:9092 --topic test1

通过shell消费消息
/usr/local/kafka/bin/kafka-console-consumer.sh --zookeeper node01:2181 --from-beginning --topic test1

查看消费位置
/usr/local/kafka/bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --zookeeper node01:2181 --group testGroup

查看某个Topic的详情
/usr/local/kafka/bin/kafka-topics.sh --topic test --describe --zookeeper node01:2181

对分区数进行修改
/usr/local/kafka/bin/kafka-topics.sh --zookeeper node01 --alter --partitions 15 --topic utopic

注:

如果--zookeeper node01访问出错,换成--bootstrap-server node01:9092


---------------------------------------------------


启动集群
依次在hadoop102、hadoop103、hadoop104节点上启动kafka
[atguigu@hadoop102 kafka]$ bin/kafka-server-start.sh -daemon config/server.properties
[atguigu@hadoop103 kafka]$ bin/kafka-server-start.sh -daemon config/server.properties
[atguigu@hadoop104 kafka]$ bin/kafka-server-start.sh -daemon config/server.properties
9)关闭集群
[atguigu@hadoop102 kafka]$ bin/kafka-server-stop.sh stop
[atguigu@hadoop103 kafka]$ bin/kafka-server-stop.sh stop
[atguigu@hadoop104 kafka]$ bin/kafka-server-stop.sh stop
10)kafka群起脚本
for i in `cat /opt/module/hadoop-2.7.2/etc/hadoop/slaves`
do
echo "========== $i =========="
ssh $i 'source /etc/profile&&/opt/module/kafka_2.11-0.11.0.2/bin/kafka-server-start.sh -daemon /opt/module/kafka_2.11-0.11.0.2/config/server.properties'
echo $?
done


3,查看consumer group列表,使用–list参数

查看consumer group列表有新、旧两种命令,分别查看新版(信息保存在broker中)consumer列表和老版(信息保存在zookeeper中)consumer列表,因而需要区分指定bootstrap–server和zookeeper参数:

bin/kafka-consumer-groups.sh --new-consumer --bootstrap-server 127.0.0.1:9292 --list

参考:https://blog.csdn.net/lkforce/article/details/77776684

原文地址:https://www.cnblogs.com/-courage/p/14646925.html