Use filter transformation
It is possible to filter out certain rows of the source dataset using simple expression.
Filter
is available under Mappings
/ Additional Transformations
/ Filter
.
A JavaScript Filter
must return true
(include record) or false
(exclude record).
The field values can be referenced from JavaScript code, using the "field name"
.
SQL-like syntax for filter
If Use SQL like syntax for Filter
is selected, you can use operands available in SQL, for example, <>
, and
, or
, etc. Otherwise, only JavaScript operands, for example, !=
, &&
, and ||
are allowed.
An example of an SQL-like filter expression:
"Importer Name" <> null and "Importer Name".contains("test");
An example of JavaScript-like filter expression:
"Importer Name" != null && "Importer Name".contains("test");
Available objects
Object name | Class name / JavaDoc | Import |
---|---|---|
dataSet | com.toolsverse.etl.common.DataSet | importPackage(com.toolsverse.etl.common); |
currentRow | com.toolsverse.etl.common.DataSetRecord | importPackage(com.toolsverse.etl.common); |
etlConfig | com.toolsverse.etl.core.config.EtlConfig | importPackage(com.toolsverse.etl.core.config); |
scenario | com.toolsverse.etl.core.engine.Scenario | importPackage(com.toolsverse.etl.core.engine); |
row | current 0-based row number |
Comments
0 comments
Please sign in to leave a comment.