Limit maximum number of threads when running extract and load in parallel

Overview

It is possible to execute multiple source-to-destination transformations (extract-load) in parallel threads.

By default, Etlworks limits the number of threads to 5 but you can change this limit.

Process

Here are the steps to limit the maximum number of threads:

Step 1. Create a Flow with parallel transformations.

Step 2. Create a nested Flow and add a Flow you created in step 1.

Step 3. Set the parameter Maximum Number of Parallel Threads to the positive integer > 1. 

Alternatively, the max number of threads can be set for the flow with multiple source-to-destination transformations: