测试带有Kerberos认证的kafka环境是否可用

kafkaEagel工具安装

1，上传jar包到服务器并解压

tar -zxvf kafka-eagle-web-2.0.3-bin.tar.gz 

2，mysql中创建数据库用于存放数据

讯享网登陆 mysql mysql -u root -p 

1.创建一个新用户 keadmin 密码为  CREATE USER 'keadmin'@'localhost' IDENTIFIED BY ''; 2.创建数据库 keadmin create database keadmin; 3.授予用户“keadmin ”通过外网IP对于该数据库“keadmin ”中表的创建、修改、删除权限,以及表数据的增删查改权限 grant create,alter,drop,select,insert,update,delete on keadmin.* to keadmin@'localhost'; 

3.修改 system-config.properties配置文件
目录：
kafka-eagle-web-2.0.3/conf/system-config.properties

讯享网# 配置zk地址 kafka.eagle.zk.cluster.alias=cluster1 cluster1.zk.list=tdn1:2181,tdn2:2181,tdn3:2181 

kafka.eagle.sasl.enable=true kafka.eagle.sasl.protocol=SASL_PLAINTEXT kafka.eagle.sasl.mechanism=GSSAPI cluster1.kafka.eagle.sasl.jaas.config=com.sun.security.auth.module.Krb5LoginModule required useKeyTab=true storeKey=true serviceName=kafka keyTab="/opt/soft/user001/user001.keytab" principal="user001"; 

讯享网

讯享网 # kafka mysql jdbc driver address kafka.eagle.driver=com.mysql.jdbc.Driver kafka.eagle.url=jdbc:mysql://127.0.0.1:3306/keadmin?useUnicode=true&characterEncoding=UTF-8&zeroDateTimeBehavior=convertToNull kafka.eagle.username=keadmin kafka.eagle.password= 

注意：kafka_client_jaas.conf文件中配置的serviceName=kafka参数，在Kerberos环境下访问Kafka时需要获取serviceName，之前Fayson是在代码里面指定“sasl.kerberos.service.name”与jaas.conf文件中指定效果一致。如下是KafkaClient加载Kerberos配置时获取serviceName代码片段

export KE_HOME=/opt/cloudera/kafka-eagle/kafka-eagle-web-2.0.3 export PATH=$PATH:$KE_HOME/bin 

source /etc/profile

5.在bin目录下启动：

讯享网配置好jdk，kafkaEngel环境变量 启动：ke.sh start 重启：ke.sh restart 

启动成功：
有时候会遇到一些bug：
问题1:
DataTables warning: table id=kafka_tab - Requested unknown parameter ‘ip’ for row 0, column 1. For more information about this error, please see http://datatables.net/tn/4
原因： 配置文件错误，检查配置文件

划重点： cluster1.kafka.eagle.sasl.enable=true 

问题2:
ERROR - Get kafka os memory from jmx has error, msg is java.io.IOException cannot be cast to javax.management.remote.JMXConnector

讯享网 [2021-05-31 15:50:00] KafkaServiceImpl.Thread-52 - ERROR - Get kafka broker used cpu value has error, msg is java.lang.ClassCastException: java.io.IOException cannot be cast to javax.management.remote.JMXConnector at org.smartloli.kafka.eagle.common.util.JMXFactoryUtils.connectWithTimeout(JMXFactoryUtils.java:100) at org.smartloli.kafka.eagle.core.factory.KafkaServiceImpl.getUsedCpuValue(KafkaServiceImpl.java:1679) at org.smartloli.kafka.eagle.web.quartz.MBeanSubTask$KafkaClusterSubThread.kafkaAssembly(MBeanSubTask.java:211) at org.smartloli.kafka.eagle.web.quartz.MBeanSubTask$KafkaClusterSubThread.kafkaCluster(MBeanSubTask.java:118) at org.smartloli.kafka.eagle.web.quartz.MBeanSubTask$KafkaClusterSubThread.run(MBeanSubTask.java:101) [2021-05-31 15:50:00] KafkaServiceImpl.Thread-52 - ERROR - Get kafka broker used cpu value has error, msg is java.lang.ClassCastException: java.io.IOException cannot be cast to javax.management.remote.JMXConnector at org.smartloli.kafka.eagle.common.util.JMXFactoryUtils.connectWithTimeout(JMXFactoryUtils.java:100) at org.smartloli.kafka.eagle.core.factory.KafkaServiceImpl.getUsedCpuValue(KafkaServiceImpl.java:1679) at org.smartloli.kafka.eagle.web.quartz.MBeanSubTask$KafkaClusterSubThread.kafkaAssembly(MBeanSubTask.java:211) at org.smartloli.kafka.eagle.web.quartz.MBeanSubTask$KafkaClusterSubThread.kafkaCluster(MBeanSubTask.java:118) at org.smartloli.kafka.eagle.web.quartz.MBeanSubTask$KafkaClusterSubThread.run(MBeanSubTask.java:101) [2021-05-31 15:50:00] KafkaServiceImpl.Thread-52 - ERROR - Get kafka broker used cpu value has error, msg is java.lang.ClassCastException: java.io.IOException cannot be cast to javax.management.remote.JMXConnector at org.smartloli.kafka.eagle.common.util.JMXFactoryUtils.connectWithTimeout(JMXFactoryUtils.java:100) at org.smartloli.kafka.eagle.core.factory.KafkaServiceImpl.getUsedCpuValue(KafkaServiceImpl.java:1679) at org.smartloli.kafka.eagle.web.quartz.MBeanSubTask$KafkaClusterSubThread.kafkaAssembly(MBeanSubTask.java:211) at org.smartloli.kafka.eagle.web.quartz.MBeanSubTask$KafkaClusterSubThread.kafkaCluster(MBeanSubTask.java:118) at org.smartloli.kafka.eagle.web.quartz.MBeanSubTask$KafkaClusterSubThread.run(MBeanSubTask.java:101) 

原因：这个配置文件，关掉就好了

 # kafka metrics, 15 days by default  kafka.eagle.metrics.charts=false kafka.eagle.metrics.retain=15