汇合模式注册表数据丢失

yfwxisqw  于 2021-06-04  发布在  Kafka
关注(0)|答案(0)|浏览(232)

问题

curl -s https://schema-registry.example.com/subjects/inventory.inventory.customers-key/id/33
curl -s https://schema-registry.example.com/subjects/inventory.inventory.customers-value/id/33

在大约一天之后(现在),schema registry开始为这些端点提供404。

是我做的

pod信息:模式注册表pod在最近12-15小时内运行。还没有轮班

$ k get pods | grep schema-registry
v5.5.0-cp-schema-registry-669ffbbfb-6v7t7   2/2     Running   0          12h
v5.5.0-cp-schema-registry-669ffbbfb-cb6sh   2/2     Running   0          12h
v5.5.0-cp-schema-registry-669ffbbfb-xvgxk   2/2     Running   0          15h

topic info:topic的默认复制因子为3,策略也是紧凑的。没有数据丢失的原因

sh-4.2$ ./bin/kafka-topics.sh --describe --topic _schemas --bootstrap-server example.com
Topic: _schemas PartitionCount: 1   ReplicationFactor: 3    Configs: cleanup.policy=compact,message.format.version=2.5-IV0
    Topic: _schemas Partition: 0    Leader: 1   Replicas: 1,0,2 Isr: 1,2,0

Kafka经纪人

$ k get pods | grep kafka
k8s-kafka-0                                 2/2     Running   0          46m
k8s-kafka-1                                 2/2     Running   0          40h
k8s-kafka-2                                 2/2     Running   0          10h

Kafka配置信息

Kafka:
    Config:
      log.message.format.version:                2.5
      log.retention.hours:                              240
      offsets.topic.replication.factor:           3
      transaction.state.log.min.isr:               2
      transaction.state.log.replication.factor:  3

kakfa存储是使用aws ebs卷持久化的

Storage:
      Class:  gp2
      Type:   jbod
      Volumes:
        Delete Claim:  false
        Id:            0
        Size:          300Gi
        Type:          persistent-claim
        Delete Claim:  false
        Id:            1
        Size:          300Gi
        Type:          persistent-claim

系统信息

运行kubernetes 1.15.5https://github.com/confluentinc/cp-helm-charts 架构注册表版本:5.5.0
还打开了一个问题:https://github.com/confluentinc/schema-registry/issues/1628
请帮我找出这个问题的原因。

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题