Marketo connector

Overview

Etlworks Marketo connector allows fast, real-time access to Marketo data. The connector supports most of the objects available through the Marketo API and works just like any other database connector.

Etlworks partnered with CData to provide access to the Marketo API using industry-standard JDBC protocol. Read about CData Marketo JDBC connector.

When to use Marketo connector

Use this connector to create flows that work with data in Marketo. 

Prerequisites

1. Enable Marketo connector for your Etlworks account. Contact support@etlworks.com to enable connector.
2. Obtain the OAuthClientId and OAuthClientSecret Values. To obtain the OAuthClientId and OAuthClientSecret, navigate to the LaunchPoint option on the Admin area. Click the View Details link for the desired service. A window containing the authentication credentials will be displayed.
3. Obtaining the REST Endpoint URL. The RESTEndpoint can be found on your Marketo Admin area on the Integration -> Web Services option in the REST API section. Note the Identity Endpoint will not be needed.

Creating a connection

Step 1. In the Connections window click the + button, type in marketo.

Step 2. Enter connection parameters

• URL - the JDBC connection string. Typically you only need to replace <instance> with the Marketo instance name, for example, 177-FXY-123
• Client ID - the OAuth2 client ID.
• Client Secret - the OAuth2 secret. Read about Marketo API client ID and client secret.
• Other Parameters - optional parameters as key=value pairs. 

Use Other parameters to specify the connection string options. Read about available connection string options.

Marketo data model

Read about the Marketo REST API data model. Specifically, read about the filters that are required to retrieve data from some of the objects.

Stored procedures

Stored Procedures are available to complement the data available from the REST Data Model. Sometimes it is necessary to update the data available from a view using a stored procedure because the data does not provide direct, table-like, two-way updates. In these situations, the retrieval of the data is done using the appropriate view or table, while the update is done by calling a stored procedure. Stored procedures take a list of parameters and return back a dataset that contains the collection of tuples that constitute the response.

Read about available stored procedures. 

To call stored procure from the SQL flow or from Before/After SQL, use EXEC sp_name params=value syntax. Example:

EXEC SelectEntries ObjectName = 'Account' 

Working with data in Marketo

Extracting data from Marketo

extracting data from Marketo is similar to extracting data from the relational database.

Step 1. Create Marketo connection that will be used as a source (FROM). 

Step 2. Create a destination connection, for example, a connection to the relational database, and if needed a format (format is not needed if the destination is a database or well-known API).

Step 3. Create a flow where the source is a database and the destination is a connection created in step 2, for example, a relational database.

Step 4. Add new source-to-destination transformation.

Step 5. Select Marketo connection created in step 1 as a source connection and select the Marketo object you are extracting data from:

Step 6. Select TO connection, format (if needed) and object (for example database table) to load data into.

 

Step 7. Click MAPPING and optionally enter Source Query (you don't need a query if you are extracting data from the Marketo object unconditionally).

Step 8. Optionally define the per-field mapping.

Step 9. Add more transformations if needed.

Loading data in Marketo

loading data in Marketo is similar to loading data into relational database.

Step 1. Create a source connection and a format (if needed).

Step 2. Create destination Marketo connection.

Step 3. Create a flow where the destination is a database.

Step 4. Add new source-to-destination transformation.

Step 5. Select FROM and TO connections and objects (also a FROM format if needed).

Step 6. Optionally define the per-field mapping.

Step 7. Add more transformations if needed.

Managing Marketo API quote

By default, Marketo allows 50K API calls per day, with a rate per instance limited to 100 calls per 20 seconds (https://developers.marketo.com/rest-api/). Contact Marketo support to request a permanent or temporary increase.

Here are some tips on how to stay within the permitted limits:

• Avoid running select * from on any Marketo table. In order to return the count, Marketo connector will have to traverse all the records in the "table" which can easily cause exceeding the API quote (50K/day). 
• Avoid running transformations in parallel. Running transformations in parallel can cause exceeding the permitted rate of the API calls (100 calls per 20 seconds).

Browsing data in Marketo

You must have a Marketo connection to browse objects and run SQL queries.

Use Explorer to browse data and metadata in Marketo as well as execute DML and SELECT queries against Marketo connection.