About parametrization

About parameterization

Parameterization is a way to dynamically configure Connections and transformations based on input parameters. The input parameters can be Global Variables or Flow variables.

Global Variables

Global variables are the key-value pairs that can either be set by JavaScript code or automatically when executing data integration Flows.

Set global variables

Variables set programmatically or using configuration:

• Set global variables using script
• Database loop parameters
• File loop parameters
• Flow variables set at the flow level
• URL parameters in call-flow-by-name API
• URL parameters is user-defined API

These global variables are automatically set when executing flows (no scripting or configuration require):

• Source filename
• Destination filename
• Tenant and user name

Reference Global Variables

To reference a global variable, use the following syntax: {variable name}.

The value of the variable must not be empty. When the Etlworks Integrator replaces the {variable name} with an actual value, it ignores null and empty values.

Examples:

Input: http://host.com?startDate={stateDate}
Variable-value: startDate-null
Output: http://host.com?startDate={stateDate}

Input: http://host.com?startDate={stateDate}
Variable-value: startDate-""
Output: http://host.com?startDate={stateDate}

Input: http://host.com?startDate={stateDate}
Variable-value: startDate-today
Output: http://host.com?startDate=today

Flow Variables

• Flow variables are passed as URL parameters or URL variables to the user-created API endpoints.
• Flow variables are passed as URL parameters to the run Flow by name API.
• Flow variables can also be defined when creating nested Flows.
• Flow variables can be set and accessed programmatically.

Types of parametrization

• Parameterization of the Connections 
• Parameterization of transformations 
• Parameterization of file operations
• Parameterization of the source and destination queries 

Convert Flow variables to global variables

The Flow variables can be used in source and destination queries or accessed programmatically.

They cannot be used to customize the Connections or transformations.

Read how to convert the Flow variables to the global variables and when doing so make sense.