Flows Executions Dashboard
Previously, to check the flows execution stats users had to open the Flow window, search for the flow, and click the status link.
In this update, we introduced the Flows Executions dashboard which can be used to view the stats for all flows executed on a given day, including "today". The "today" dashboard is getting updated in real time.
Limiting memory footprint with JDBC Fetch Size.
Many database drivers (for example MySQL, Redshift, and others), don't set the upper limit on the number of records which can be retrieved in one database call. When extracting data from larger datasets it could cause OutOfMemory error and therefore prevent the system from extracting and loading data.
In this update we introduced the user-configurable Fetch Size that can be used to set the maximum number of records which will be retrieved in one database call, thus limiting the memory consumption within the JVM. You can set the Fetch Size at the connection level, or override it at the transformation level.
New parameter for CSV formats: Value for null
Previously, when the system was creating a CSV file and the value of the field was null it was just adding the field delimiter:
In this update, we introduced the user-configurable Value for null, which, if configured, will be used instead of null values. For example, if the Value for null is set to
A typical usage example is setting Value for null to
\N: so the Redshift COPY command can differentiate between an empty string and a NULL value.