Overview
Extract-Load-Transform (ELT) is a technique, in which the transformation step is moved to the end of the workflow, and data is immediately loaded to a destination upon extraction.
Etlworks supports executing complex ELT scripts directly in the target database, which greatly improves the performance and reliability of the data ingestion.
ELT using Before and After SQL
Step 1. Create a Flow to migrate data from one database to another.
If the staging table does not exist, the Flow will automatically create it.
Step 2. When configuring a transformation, use fields Before SQL
and After SQL
to execute complex SQL scripts in the target database.
You can execute multiple DML statements by separating them with ;
.
Optionally, you can configure the Flow to ignore errors when executing Before and After SQL.
Step 3. Schedule the Flow to be executed periodically.
ELT using SQL Flow
As an alternative to Before and After SQL, you can use SQL Flow as explained below.
Create SQL Flow to update the dimensions from the staging tables.
You can execute multiple DML statements by separating them with ;
.
Combine load Flow and SQL Flow into a single nested Flow.
Comments
0 comments
Please sign in to leave a comment.