Overview
In Etlworks, you can preserve the exact data types when extracting data from a database and creating the CSV files.
Example
When Etlworks Flow creates a CSV file, by default, the information about the column's data types in the source database is getting lost. So if another Flow reads the same file, it assigns the data types to the columns by sampling the data, which is not always 100% accurate.
Process
If you want to preserve the exact data types, enable the option Save Metadata
for the source and the destination CSV Formats. If this option is enabled, the system will store column names and data types in the XML file with the same name and in the same location as the original CSV file.
When to enable this option
Generally speaking, it makes sense to enable this option if the CSV file is created by Etlworks Flow that extracts data from a database and then used by another Etlworks Flow to load data into a different database.
Comments
0 comments
Please sign in to leave a comment.