Working with databases
Tutorials for building ETL/CDC pipelines for relational databases with advanced SQL support, transactions, and custom queries.
- Get started with databases
- ETL with relational databases
- Create pipeline to CDC data into relational database
- SQL actions: INSERT, UPDATE, DELETE, MERGE, IFEXIST, CUSTOM
- Transaction management
- Open database connection when needed
- Automatically create or alter a destination table
- ELT with databases
- Automatically create staging tables from any data source
- Overriding Data Types When Creating or Altering Tables
- Override CREATE and ALTER TABLE SQL
- Expose a database object or SQL query as an API endpoint
- Read records from a database and execute the Flow for each record
- Execute any SQL outside of regular source-to-destination transformation
- Execute SQL from JavaScript to updates status or save rejected records into the errors table
- Automatic Partitioning
- Tips and tricks when working with databases