Overview
Etlworks includes dedicated connectors for a small group of popular APIs, including Google Analytics, Google Sheets, Google Ads, Facebook, and Twitter. These are referred to as well-known APIs and differ from other connectors in that they are not generic or database-based—they use their own specialized connection type and work only as sources.
Use this flow to extract data from a well-known API and load it into a relational database.
Step-by-Step Instructions
Step 1. Go to Connections and create a connection for a well-known API (e.g., Google Analytics, Google Sheets, Facebook, or Twitter).
-
Each well-known connector has its own connection type.
-
Follow the inline instructions or linked guides to configure the connection, including any required authentication.
Step 2. Create a connection for the destination relational database. Test the connection.
Step 3. Go to Flows and create a new Well-known API to database flow.
Step 4. Add a new transformation. Select the FROM connection (well-known API) and endpoint, and the TO connection and table.
Step 5. (Optional) click Configure end set per-field mapping if the source and destination schemas differ.
Step 6. Click Test transformation to verify the output.
Step 7. (Optional) Enable MERGE (UPSERT) if you want to update existing records.
Note: Enabling Predict Lookup Fields allows flow to automatically select keys for MERGE. Alternatively you can manually specify them using fully qualified table names and semicolon-separated pairs in the Lookup Fields:
Step 8. (Optional): To fully refresh destination tables, add the following SQL to the Before SQL field:
truncate table {TABLE}
Step 9. Add as many pairs of source-to-destination transformations as needed.
Step 10. Save the Flow and execute it manually.
Step 11. Schedule the flow
-
Go to Schedules
-
Create a schedule to run the flow periodically
Comments
0 comments
Please sign in to leave a comment.