Etlworks ships dedicated connectors for a small set of popular APIs — Google Analytics, Google Sheets, Google Ads, Facebook, Twitter. These are called well-known APIs. Unlike generic HTTP or database connectors, each well-known connector has its own connection type and works only as a source.
This tutorial walks through extracting data from a well-known API and loading it into a relational database.
How do I set this up?
- In Connections, create a connection for the well-known API — Google Analytics, Google Sheets, Facebook, Twitter, and so on. Each connector has its own connection type. Follow the inline instructions or the linked guide for that connector to configure authentication.
- Create a connection for the destination relational database and test it.
- In Flows, create a new Well-known API to database flow.
- Add a transformation. Set FROM to the well-known API connection and endpoint; set TO to the destination connection and table.
- Optional: click Configure and set per-field mapping when source and destination schemas differ.
- Click Test transformation to verify the output.
- Optional: enable MERGE (UPSERT) to update existing records.
Note: Enable Predict Lookup Fields to let the flow pick keys automatically, or set them manually as fully qualified table=fields pairs in Lookup Fields:
- Optional: to fully refresh destination tables on every run, add this to Before SQL:
truncate table {TABLE} - Add as many source-to-destination transformations as you need.
- Save the flow and execute it manually.
- Schedule the flow: go to Schedules and create a schedule to run it periodically.