Added option to escape double-quotes in CSV files
Affected areas: creating CSV files.
In this updated, we added the ability to escape double-quotes in CSV files. If this option is enabled and double-quotes are used to enclose fields, then a double-quote appearing inside a field will be escaped by preceding it with another double quote
To keep backward compatibility with the previous releases this option is disabled by default.
Improvements for Snowflake and Amazon Redshift flows running in parallel
Before this update, the files to load generated by the system all had their names derived from the destination table name. It was causing a race condition issue when the system was trying to load data into the same table from multiple parallel threads.
In this update, we changed how the system generates the files to load into the Snowflake and Redshift. Now all files have the unique per-thread suffix, which quantities that there will be no race condition situation under the parallel load scenario.