We are using the Debezium MySQL connector to connect to this source. For more information, read Debezium connector for MySQL.
Prerequisites
supports the following MySQL configurations:- Database versions
8.0and above. Check your MySQL version withmysql -V. - Database driver version
8.0.29
Source setup
Refer to this section when you create a streaming pipeline.The server address of your MySQL database.
The port number used to access your MySQL database. The default is
3306.The name of your MySQL database.
Set to true ✅ if the source database is an always-on, read-only replica database.
The username used to log in to the specified database.
Choose the service you use to manage secrets.
The name of the secret in your secret manager service that references your MySQL password.
Specify any parameter:value pairs as part of an advanced connection. Click Save to finish adding parameters.Click Connect to establish the connection to your source database.
Configure new tables
When adding tables to a pipeline, they must be correctly configured to allow the on-demand snapshot to take place and to ensure change data capture will stream future changes on those tables. Read Configure your MySQL database for a more comprehensive outline of these requirements.Grant permissions to the streaming user
To enable on-demand snapshots and streaming on new tables, the user configured for streaming must have the expected permissions. These permissions should be applied by the root user. Use the following SQL statement:<streaming_user> with the name of the user configured for streaming.
By following these steps, you ensure that new tables added to the pipeline will be properly configured for on-demand snapshots and streaming, allowing historical data to be captured without losing synchronization with the target. If on-demand snapshots are disabled, new tables will only capture changes from the point of addition and the pipeline will have a STREAMING status immediately.
