Preserve the exact data types when extracting data from a database and creating the CSV files

Overview

In Etlworks, you can preserve the exact data types when extracting data from a database and creating the CSV files.

Example

When Etlworks Flow creates a CSV file, by default, the information about the column's data types in the source database is getting lost. So if another Flow reads the same file, it assigns the data types to the columns by sampling the data, which is not always 100% accurate. 

Process 

If you want to preserve the exact data types, enable the option Save Metadata for the source and the destination CSV Formats. If this option is enabled, the system will store column names and data types in the XML file with the same name and in the same location as the original CSV file.

When to enable this option

Generally speaking, it makes sense to enable this option if the CSV file is created by Etlworks Flow that extracts data from a database and then used by another Etlworks Flow to load data into a different database.