初始同步后debezium停止

xurqigkl  于 2021-06-04  发布在  Kafka
关注(0)|答案(0)|浏览(268)

初始同步按预期工作,但是连接器只是停止,不关心进一步的表更改。没有抛出错误,连接器仍标记为活动且正在运行。
数据库:amazon postgres v10.7
debezium配置:

"name": "postgres_cdc",
  "config": {
    "connector.class": "io.debezium.connector.postgresql.PostgresConnector",
    "database.hostname": "...",
    "database.port": "5432",
    "database.user": "...",
    "database.password": "...",
    "database.dbname": "...",
    "database.server.name": "...",
    "table.whitelist": "public.table1,public.table2,public.table3",
    "plugin.name": "pgoutput",
    "key.converter": "org.apache.kafka.connect.storage.StringConverter",
    "value.converter": "org.apache.kafka.connect.json.JsonConverter",
    "value.converter.schemas.enable": "false",
    "transforms": "unwrap, route, extractId",
    "transforms.unwrap.type": "io.debezium.transforms.ExtractNewRecordState",
    "transforms.unwrap.drop.tombstones": false,
    "transforms.route.type": "org.apache.kafka.connect.transforms.RegexRouter",
    "transforms.route.regex": "[^.]+\\.[^.]+\\.(.+)",
    "transforms.route.replacement": "postgres_$1",
    "transforms.extractId.type": "org.apache.kafka.connect.transforms.ExtractField$Key",
    "transforms.extractId.field": "id"
  }
}

有没有想过会有什么问题?
编辑:
日志错误:

ERROR WorkerSourceTask{id=postgres_cdc-0} Failed to flush, timed out while waiting for producer to flush outstanding 75687 messages (org.apache.kafka.connect.runtime.WorkerSourceTask)
ERROR WorkerSourceTask{id=postgres_cdc-0} Failed to commit offsets (org.apache.kafka.connect.runtime.SourceTaskOffsetCommitter)

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题