- Starter
- Business
- Enterprise
- On-Premise
- Add-on
Overview
Change Data Capture (CDC) is a data integration technique that identifies, captures, and delivers only the changes (INSERTs, UPDATEs, and DELETEs) made to data in a source database. These changes are extracted from the database transaction log (also known as the redo log).
Etlworks supports native, log-based CDC for the following databases:
-
PostgreSQL
-
Microsoft SQL Server
-
MySQL
-
Oracle
-
DB2
-
AS400 (IBM i platforms)
-
MongoDB
Once captured, CDC events can be streamed in real time to a variety of destinations, including relational databases, data warehouses, message queues, NoSQL databases, Web Services, and cloud or on-prem file storage.
Etlworks also supports several other change replication techniques.
Available CDC Flow Types
|
Destination Type |
Recommended Flow Type(s) |
|
File Storage (CSV, JSON) |
|
|
Message Queue (Kafka, etc.) |
|
|
NoSQL database (MongoDB, etc.) |
|
|
Relation database |
|
|
Snowflake |
|
|
Amazon Redshift |
|
|
Google BigQuery |
|
|
Azure Synapse Analytics and Azure Fabric Warehouse |
Stream CDC events into Synapse Analytics of Fabric Warehouse |
|
Vertica |
|
|
Greenplum |
|
|
Web Service (API) |