How to ETL data from and to relational databases

Overview

This Flow extracts data from one database and loads it into another database (or schema within the same database).

Process

In Connections

Access Connections here.

Step 1. Create a source Connection for the relational database and test it.

Step 2. Create a destination Connection for the relational database and test it.

In Flows

Access Flows here.

Step 3. Create a new Database to database Flow.

Step 4. Add a new transformation and select FROM Connection and table and TO Connection and table.

Step 5. Click MAPPING and configure a Source SQL if needed.

Step 6. Add per-field Mapping if needed.

Step 7. Test the transformation.

Step 8. Configure MERGE (UPSERT) if needed.

Step 9. Configure Change Replication if needed.

Step 10. Add as many pairs of source-to-destination transformations as needed.

Step 11. Save the Flow and execute it manually.

In Schedules

Access Schedules here.

Step 12. Schedule the Flow to be executed periodically.

Learn how to move tables matching a wildcard name from one schema or database to another.