How to convert any file to any Format

This tutorial walks through extracting data from a file in one format, transforming it, and writing it out as a file in another format — for example, JSON to CSV or XML to JSON.

How do I set this up?

Set up the connections

See Creating and managing connections for background.

1. Create a source connection for the file storage and test it. Etlworks supports a wide range of storage connectors:
   • Amazon S3
   • Google Cloud Storage
   • Microsoft Azure Storage
   • Server Storage
   • FTP
   • FTPS
   • SFTP
   • Box
   • Dropbox
   • Google Drive
   • OneDrive for Business
   • SharePoint
   • WebDAV
   • Inbound email
   • Outbound email
2. Create the destination file-storage connection and test it.
3. Create a format for the source file — for example, CSV.

   

4. Create a format for the destination file.

Optional: test the source in Explorer

You can preview the source data in the Etlworks Explorer. For nested source or destination files, see how to work with nested datasets.

Create the flow

5. Create a new File to file flow.

   

6. Add a transformation. Set FROM to the source connection, format, and filename, and TO to the destination connection, format, and filename.

   

7. Click MAPPING and configure Source SQL if needed.
8. Test the transformation.

   

9. Add per-field mapping if needed.

   

10. If FROM is a wildcard filename, enable processing of all files that match the wildcard.

    

11. Save the flow and execute it manually.

    

12. Schedule the flow to run periodically.