Create Connections and Flows to run in the Integration Agent

• Starter
• Business
• Enterprise
• On-Premise
• Add-on

Overview

Etlworks instance running in a public cloud cannot access the data behind the company's firewall, and therefore you need the remote Integration Agent to run the flows. This process outlines how to create Flows to run in the remote agent.

Create and Test Connections and Formats

Create all required Connections and Formats using Etlworks Web UI. If you are connecting to the database or app running on-premise behind the firewall, use Connection parameters, such as URLs that point to the local resources.

To test the connection on a specific agent click Agent icon in the bottom of the connection screen, next to Test Connection button, then select the Agent from the dropdown. 

The Remote Integration Agent does not support Listeners.

Create Flows

Similar to Connections and Formats, create Flows using Etlworks Web UI.

Agent Context

When creating a flow set the Agent Context by selecting the Agent in the dropdown at the bottom of the Flow Builder screen.

The Agent Context is used in Mapping and Test Transformation. It is ignored when running the flow from the Flows window. You can run flows on a designated Agent from the Agent page. Read more.

Etlworks remembers the Agent Context for a specific user, so next time when you navigate to the Flow Builder screen the context is already set. You can disable the Agent Context caching in Preferences.

Mapping and Test transformation

When the Agent context is selected the Flow Builder is able to access the local resources so you will be able to perform the drag and drop mapping by selecting objects and fields from the dropdown and test the transformation.

The Flow Builder uses the selected agent for all connections in the flow, even if the resource is directly accessible by the cloud instance. 

Schedule and Run Flows in the Integration Agent

• Add and schedule flows.
• Run Flows manually.
• Stop the running Flows.