In the Etlworks Integrator, you can preserve the exact data types when extracting data from a database and creating the CSV files.
When the Etlworks Integrator Flow creates a CSV file, by default, the information about the column's data types in the source database is getting lost. So if another Flow reads the same file, it assigns the data types to the columns by sampling the data, which is not always 100% accurate.
If you want to preserve the exact data types, enable the option
Save Metadata for the source and the destination CSV Formats. If this option is enabled, the system will store column names and data types in the XML file with the same name and in the same location as the original CSV file.
When to enable this option
Generally speaking, it makes sense to enable this option if the CSV file is created by the Etlworks Integrator Flow that extracts data from a database and then used by another Etlworks Integrator Flow to load data into a different database.
Please sign in to leave a comment.