原生ApacheKafka和zookeeper,具有合流组件?

fzwojiic  于 2021-06-07  发布在  Kafka
关注(0)|答案(1)|浏览(282)

你能告诉我apachekafka和zookeeper(本地apachedistributuins)与一些confluent组件的兼容性吗。我已经在我的环境中安装了kafka和zookeeper作为多节点集群。但现在我需要添加模式注册表,kafka connect。
所以我实际上试着从他们的docker官方图片中部署合流模式注册表。我登录并成功地在端口9093上telnet kafka broker

root@schema-0:/usr/bin# telnet kafka-0.kafka-hs 9093
Trying 10.244.3.47...
Connected to kafka-0.kafka-hs.log-platform.svc.cluster.local.
Escape character is '^]'.

在我试着做了一些测试之后:


# /usr/bin/kafka-avro-console-producer \

  --broker-list localhost:9093 --topic bar \
  --property value.schema='{"type":"record","name":"myrecord","fields" \
  [{"name":"f1","type":"string"}]}'

添加一些值:

{"f1": "value1"}

但运气不好:(。出现下一个错误:

value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer
 (org.apache.kafka.clients.producer.ProducerConfig)

[2018-01-28 11:23:23,561] INFO Kafka version : 1.0.0-cp1 (org.apache.kafka.common.utils.AppInfoParser)

[2018-01-28 11:23:23,561] INFO Kafka commitId : ec61c5e93da662df (org.apache.kafka.common.utils.AppInfoParser){"f1": "value1"}

[2018-01-28 11:23:36,233] WARN [Producer clientId=console-producer] Connection to node -1 could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)

[2018-01-28 11:23:36,335] WARN [Producer clientId=console-producer] Connection to node -1 could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
[2018-01-28 11:23:36,486] WARN [Producer clientId=console-producer] Connection to node -1 could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)

整个系统都在kubernetes上旋转

bqucvtff

bqucvtff1#

confluent平台是ApacheKafka,但附带了附加组件(如SchemaRegistry)。
您遇到的错误与网络配置有关。您需要确保您的代理对其他节点可用,包括schema registry。在您指定的模式注册表配置中 broker-list localhost:9093 但这应该是你的Kafka经纪人。此外,正如dmitryminkovsky提到的,确保您已经在代理中设置了广告侦听器。这篇文章可能会有所帮助。

相关问题