CLOB Format

Overview

The entire content of the nested document (such as JSON or XML) is stored as-is in a single text column without parsing or transformation.

When to use this Format

The CLOB Format is used to load the entire content of the file into a single column in a data set.

It can be extremely useful when you just want to make a few changes in the source document without applying a full-fledged source-to-destination transformation. 

Process

To create a new CLOB Format, go to Connections, select the Formats tab, click Add Format, and type in clob in the Search field. 

The following parameters are available when configuring the Format:

• Column Name: the value of this property will be used as a column name when loading the content of the file into a single column in a data set.  The default column name is content.
• Default Extension: the default extension is used when the file name doesn't have an extension. If not entered, txt is the default extension.
• Preprocessor: this is code written in JavaScript, which is used to change the entire document. Read more about the preprocessor. 
• Output Template: if not empty, the {tokens} in the output template will be merged with global variables to produce the output. 
• Encoding: character encoding when reading and writing a file. No encoding means there will be no additional encoding.