In the source-to-destination transformation, the first step is extracting data from the source. The Etlworks Integrator reads the source file or a response from the web service in memory before parsing and converting it to the internal data structure.
In many cases, it makes sense to modify the source document before transforming it, for example:
- When the source is empty or null.
- When the source is misformatted and requires preprocessing before the Etlworks Integrator can read it as standard XML, JSON, or CSV.
- When the source would need to be modified to add extra information, for example, metadata.
Read how to use a preprocessor to transform the source document, such as a file or a response from the web service.