Skip to content

debezium/dbz#313 Demo: Keep *all* change events in a downstream database [DBZ-2101] #402

Open
SaidiBTW wants to merge 2 commits intodebezium:mainfrom
SaidiBTW:dbz-313
Open

debezium/dbz#313 Demo: Keep *all* change events in a downstream database [DBZ-2101] #402
SaidiBTW wants to merge 2 commits intodebezium:mainfrom
SaidiBTW:dbz-313

Conversation

@SaidiBTW
Copy link

Description

  • Modifies the docker-compose.yml to CONNECT_VALUE_CONVERTER_SCHEMAS_ENABLE=true to true to ensure our JSON Schema is generated when we first pass messages to Kafka topics
  • Changes the ChangeEventEnricher and the TopologyProducer to make them compatible with schema-enforced JSON
  • Changes the ChangeEventEnricher to manually add the audit schema to the message schema and forward the message to the dbserver1.inventory.vegetable.enriched topic.
  • Adds the jdbc-connector-config.json to configure the Debezium JDBC Connector to the Postgres Sink.
  • Adds a new Postgres-sink database to the docker compose that is to be the destination of the Debezium JDBC Sink Connector.
  • Updates the README.md project file to show the additional steps required to configure Kafka Connect and the test the Postgres Sink.
  • Modifies the docker-compose.yml volumes to map the host plugin directory to the Kafka Connect plugin directory.
  • The init.sql file contains the CREATE TABLE sql query required to create table in the Postgres sink the connector does not automatically create it.

Checklist

  • If the changes include a new example, I added it to the list of examples in the README.md file

…2101] + Use of JDBC Sink Connector

Signed-off-by: Ian Sawala <iansawalasaidi@gmail.com>
…2101] + Modyfying README.md and connector configuration for .add.fields.prefix

Signed-off-by: Ian Sawala <iansawalasaidi@gmail.com>
@Naros
Copy link
Member

Naros commented Mar 24, 2026

Hi @SaidiBTW would it be too much to ask to update this specific demo to Debezium 3.4? That might be a good first pass in a separate PR, then once merged, rebase these changes on that work?

@SaidiBTW
Copy link
Author

Okay. I'll get to it

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants