Monitor currently executed scripts and tasks

Overview

When Etlworks executes SQL scripts, JavaScript, and Python programs, extracts and loads data, performs transformations and operations with files, we record the essential parameters of the running tasks. This involves the start time, the duration, the script that is being executed, etc.

All currently running tasks can be monitored in real-time. Note that it is different from the Flow's log:

• You can see the actual script that is being executed.
• It is easier to navigate than the Flow's log because (unlike entries in the log) the tasks are ordered by the start time and duration. 

Excluded tasks 

We do not monitor inline transformations (filtering and validation) and field functions configured in Mapping.

Monitor tasks and scrips for a specific Flow

To monitor currently executed tasks for a specific Flow, navigate to the Flow dashboard and click View Running Tasks. 

You can optionally enable Auto-refresh.

Monitor tasks and scrips for all currently running Flows

To monitor all currently running tasks for the main account or specific tenant, navigate to the Statistics window and expand Running flow tasks.