运行程序的时候报错如下:
Caused by: java.lang.NoSuchMethodError: org.apache.kafka.clients.consumer.KafkaConsumer.assign(Ljava/util/List;)V
错误的原因:Flink接受的kafka数据的Consumer的版本和kafka-client的版本不一致导致
正确的配置如下:
pom:
<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-connector-kafka-0.10_2.11</artifactId>
<version>${flink.version}</version>
</dependency>
<dependency>
<groupId>org.apache.kafka</groupId>
<artifactId>kafka-clients</artifactId>
<version>${kafka.version}</version>
</dependency>
code:
val kafka09 =new FlinkKafkaConsumer09[String](topics,new SimpleStringSchema(),properties)
//对应的kafka.version=0.9.0.1
val kafka010=new FlinkKafkaConsumer010[String](topics,new SimpleStringSchema(),properties)
//对应的kakfa.version=1.0.0