Mapping a source to a destination

Overview

To map a source to a destination, select or enter the name of the source object (FROM) and the name of the destination object (TO). If either the source or the destination (or both) are linked to a live Connection, Etlworks can automatically populate object names by reading metadata (table names, files names, API endpoints, etc.) directly from the data source.

If the object name is not available in the drop-down, click Clear Cache at the bottom of the screen. Etlworks will reconnect to the data object and attempt to reread the metadata. You can always manually enter the object name in this field.

Select source and destination objects from the list

If the source and/or destination is connected to the live Connection, the system will automatically populate available objects (tables, files, endpoints) from the specific Connection. Use a metadata selector to select an object from the list.

Source query

A source query is an SQL query that extracts data from the source object. If the source is an SQL database, simply enter the SQL query using the SQL dialect supported by that particular database. In addition to SQL databases, Etlworks supports running SQL queries against almost any data object. Read how to execute SQL queries against files and API endpoints.

Destination query

When loading data into a database, Etlworks will either automatically generate and execute an SQL DML statement (INSERT, UPDATE, DELETE, or MERGE) or execute a user-created SQL.

When the destination is a relational database, the user has two options:

• Use the TO field to select or enter the database object name (table, view, synonym).
• or enter an actual Destination query.

Read more about destination queries.

This field is available only if the destination is an SQL database.