Use filter transformation
It is possible to filter out certain rows of the source dataset using simple expression.
Filter
is available under Mappings
/ Additional Transformations
/ Filter
.
A JavaScript Filter
must return true
(include record) or false
(exclude record).
The field values can be referenced from JavaScript code, using the "field name"
.
SQL-like syntax for filter
If Use SQL like syntax for Filter
is selected, you can use operands available in SQL, for example, <>
, and
, or
, etc. Otherwise, only JavaScript operands, for example, !=
, &&
, and ||
are allowed.
An example of an SQL-like filter expression:
"Importer Name" <> null and "Importer Name".contains("test");
An example of JavaScript-like filter expression:
"Importer Name" != null && "Importer Name".contains("test");
Available variables
The following variables can be referenced by name from JavaScript and Python code:
Name | Class name / JavaDoc | Package |
---|---|---|
dataSet | com.toolsverse.etl.common.DataSet | com.toolsverse.etl.common |
currentRow | com.toolsverse.etl.common.DataSetRecord | com.toolsverse.etl.common |
etlConfig | com.toolsverse.etl.core.config.EtlConfig | com.toolsverse.etl.core.config |
scenario | com.toolsverse.etl.core.engine.Scenario | com.toolsverse.etl.core.engine |
row | current 0-based row number |
Comments
0 comments
Please sign in to leave a comment.