Handling exceptions in the flows and in the transformations

Ignoring Exceptions

In some cases it makes sense to ignore all or specific exceptions when performing a transformation or executing a flow. For example, if you are running a flow that reads the files in a loop and some of the files do not exist anymore, in a typical scenario the flow would throw an exception. In order to avoid such an error, you can configure the transformation to ignore the file not found exception.

To configure the transformation to ignore an exception, click the mapping button for that transformation, select the On Exception tab, and select Ignore for the On Exception field.

Optionally, enter part of the exception string, which matches with an actual exception, for example: file not found.

you can enter multiple semicolon (;) separated exception strings, for example, file not found;file is a directory.

Capturing the Last Exception

The last exception is available from the JavaScript using etlConfig.getLastException(). The returned value, if not null, is a subclass of the Java Exception class. 

The code fragment below demonstrates how to access the exception and save it in the status table in the database:

importPackage(java.lang);
importPackage(java.util);
importPackage(com.toolsverse.config);
importPackage(com.toolsverse.util);
importPackage(com.toolsverse.etl.sql.util);

// get the last exception
var ex = etlConfig.getLastException();

// reset the last exception
etlConfig.setLastException(null);

if (ex != null) {
 // get the exception string 
 var message = ex.getMessage();

 if (Utils.isNothing(message)) {
     message = Utils.getStackTraceAsString(ex);
 }
 
 // get the thread-safe global variables
 var props = SystemConfig.instance().getContextProperties();
 
 // get the connection to the statu database
 var connection = etlConfig.getConnectionFactory().getConnection("your name");
 
 var sql = "insert into feeds_status (error, finished) values (?,?)";

 // execute sql with two variables: message and current timestamp
 SqlUtils.executeSql(connection, sql, 1, null, message, new java.util.Date());
}