Topic xxx not present in metadata after 60000 ms

完整异常堆栈信息：

org.springframework.kafka.KafkaException: Send failed; nested exception is org.apache.kafka.common.errors.TimeoutException: Topic test not present in metadata after 60000 ms.

　　at org.springframework.kafka.core.KafkaTemplate.doSend(KafkaTemplate.java:574)
　　at org.springframework.kafka.core.KafkaTemplate.send(KafkaTemplate.java:389)
　　at com.yang.custom.kafka.kafka.ProducerDemo.send(ProducerDemo.java:37)
　　at com.yang.custom.kafka.CustomKafkaApplicationTests.contextLoads(CustomKafkaApplicationTests.java:23)
　　at java.util.ArrayList.forEach(ArrayList.java:1255)
　　at java.util.ArrayList.forEach(ArrayList.java:1255)
Caused by: org.apache.kafka.common.errors.TimeoutException: Topic test not present in metadata after 60000 ms.

 

问题出现：

向kafka broker 中发送消息

    @Autowired
    private KafkaTemplate kafkaTemplate;


    public void send() {
        // 构造方法：ProducerRecord(String topic, Integer partition, Long timestamp, K key, V value, Iterable<Header> headers)
        ProducerRecord<Integer, String> producerRecord = new ProducerRecord(
                "test", // topic
                null,         // 不指定partition
                System.currentTimeMillis(), // 发送消息的事件戳
                null,               // key不指定
                "这是一条带headers的消息",  // msg
                new RecordHeaders().add(new RecordHeader("ttl", "20".getBytes(StandardCharsets.UTF_8)))
        );
        kafkaTemplate.send(producerRecord);
    }

原因：

　　Jackson包版本冲突导致

项目Springboot：2.4.2

引入spring-kafka版本：2.6.5

spring-kafka依赖的Jackson版本为 2.11.3

    <dependency>
      <groupId>com.fasterxml.jackson.core</groupId>
      <artifactId>jackson-core</artifactId>
      <version>2.11.3</version>
      <scope>compile</scope>
      <optional>true</optional>
    </dependency>
    <dependency>
      <groupId>com.fasterxml.jackson.core</groupId>
      <artifactId>jackson-databind</artifactId>
      <version>2.11.3</version>
      <scope>compile</scope>
      <optional>true</optional>
    </dependency>

springboot自带依赖的Jackson版本：2.11.4

 

导致 spring-kafka 依赖的 Jackson 2.11.3版本失效，实际依赖的是2.11.4版本。

解决方案：

在项目中添加Jackson依赖，覆盖springboot和spring-kafka的Jackson依赖

　　　<dependency>
            <groupId>com.fasterxml.jackson.core</groupId>
            <artifactId>jackson-databind</artifactId>
            <version>2.11.3</version>
        </dependency>
        <dependency>
            <groupId>com.fasterxml.jackson.core</groupId>
            <artifactId>jackson-annotations</artifactId>
            <version>2.11.3</version>
        </dependency>
        <dependency>
            <groupId>com.fasterxml.jackson.core</groupId>
            <artifactId>jackson-core</artifactId>
            <version>2.11.3</version>
        </dependency>

END.