- Starter
- Business
- Enterprise
- On-Premise
- Add-on
Overview
This article outlines how to install, configure and monitor the remote Integration Agent.
Add new Integration Agent
Step 1. Open Agents
window. Click Add
button.
Step 2. Enter the Agent name, click Save
.
Download and install the Integration Agent
Install the Integration Agent on Windows
Step 1. In Agents
window select previously created Integration Agent.
Step 2. Click Download
at the bottom of the screen.
Step 3. Select Windows
tab. Click Agent
button.
Step 4. Run the downloaded installer.
Step 5. Enter your Etlworks Integrator User ID (or email) and the Etlworks Integrator cloud instance URL.
Install the Integration Agent on Linux
You must have Java 8 installed on a Linux box. Once you are done installing Java 8, proceed to the following:
Step 1. In Agents
window select previously created Integration Agent.
Step 2. Click Download
at the bottom of the screen.
Step 3. Select Linux
tab.
Step 4. Click Agent
button.
Step 5. Create a folder for the agent in the hard drive, for example, /opt/agent
.
Step 6. Extract the archive file into this folder.
Install a license
The Windows and Linux installers require an online license.
To obtain and install the license:
Step 1. Open Agents
window. Select the Agent to download the license for.
Step 2. Click Download
at the bottom of the screen.
Step 3. Click License
in the first tab. The licenses for Windows and Linux are the same.
Step 4. Check if Agent is running:
Step 5. If Integration Agent is running stop Agent service:
Step 6. Copy the license file into the AGENT_HOME/license
.
Step 7. Start Agent service:
Configure the Integration Agent to run as a Windows Service
By default, the Windows installer already installs the Integration Agent as a Windows Service so this step is optional.
If you will ever need to re-install Integration Agent as a Windows Service here are the steps:
- Open elevated Command Prompt (Admin).
cd
into the directory where you have installed the agent, for example,cd c:\integration-agent
.- Execute
install.cmd
. - Verify that service is installed by opening the Services desktop app. There must be a service with the name
IntegrationAgent
and descriptionEtlworks LLC. Integration Agent
.
Remove the Windows Service
Here's how you can do this:
- Open elevated Command Prompt (Admin).
cd
into the directory where you have installed the agent, for example,cd c:\agent
.- Execute
remove.cmd
. - Verify that service is no longer in the list of the available Windows Services.
Start and stop the Windows Service
Stop agent using Etlworks Integrator
1. Check if the Agent is running.
2. If it is running click the Online
link, then click the Stop
button.
3. The text in the STATUS
column should change to Offline
.
Start/stop agent using the command line
Here's how to start:
- Open elevated Command Prompt (Admin).
cd
into the directory where you installed the agent, for examplecd c:\integration-agent
.- Execute
start.cmd
.
Here's how to stop:
- Open elevated Command Prompt (Admin).
cd
into the directory where you installed the agent, for examplecd c:\integration-agent
.- Execute
stop.cmd
.
Start/stop agent using the Windows Services desktop app
Here's how to start:
- Open the Services desktop app.
- Locate
IntegrationAgent
. - Choose the service name and click
Start
.
Here's how to stop:
- Open the Services desktop app.
- Locate
IntegrationAgent
. - Choose the service name and click
Start
.
Change JRE and JVM memory parameters in Windows
The Agent (Windows versions) is bundled with the JRE (Java Runtime Environment). JRE and JVM memory parameters are configured in AGENT_HOME/install.cmd
.
set JAVA_HOME=%PR_PATH%\jre
set PR_JVM=%JAVA_HOME%\bin\server\jvm.dll
set PR_JVMOPTIONS=-Xmx3000m
You can change the JRE to any valid JRE installed in the machine (must be Java 8). Similarly, you can also change the maximum memory that JVM can allocate. The default is 3000 MB which might not be enough if you are going to processing large datasets.
Change the JRE or JVM memory parameters
Here's how you can do this:
Configure the Integration Agent to run as a Linux Service
Amazon Linux on AWS and CentOS
Here's how you can do this:
- Install jsvc:
sudo yum install jsvc
. - Copy provided
integrationagent
file into the/etc/init.d
folder. - If needed, modify
/etc/init.d/integrationagent
file using commands specific to your Linux distro. To edit the file, you can use the following command:sudo sed -i -e 's/\r//g' /etc/init.d/integrationagent
For example, you might need to modify theJAVA_HOME
variable or JVM parameters. - Make sure that
integrationagent
is executable:chmod +x /etc/init.d/integrationagent
.
Ubuntu
Here's how you can do this:
- Install jsvc:
sudo apt-get install jsvc
. - Copy provided
integrationagent
file into the/etc/init.d
folder. - Modify
/etc/init.d/integrationagent
:## Source function library for Amazon Linux.
You might also need to modify the
#. /etc/rc.d/init.d/functions <- comment out this line
## Source function library for Ubuntu Linux.
. /lib/lsb/init-functions <- uncomment this lineJAVA_HOME
variable or JVM parameters. - Make sure that
integrationagent
is executable:chmod +x /etc/init.d/integrationagent
.
Start and stop Linux Service
Here's how to start:
- Open the terminal.
sudo service integrationagent start
.
Here's how to stop:
- Open the terminal.
sudo service integrationagent stop
.
Change JRE and JVM memory parameters in Linux
Here's how you can do this:
- Open
/etc/init.d/integrationagent
in any editor.
For example:sudo sed -i -e 's/\r//g' /etc/init.d/integrationagent
- Modify
JAVA_HOME
and/orJAVA_OPTS
. - Click
Save
. sudo service integrationagent stop
.sudo service integrationagent start
.
Run the Integration Agent as a standalone app
Typically the Integration Agent runs as a Windows or Linux service. It is however possible to run as a standalone application.
Windows
- Open elevated Command Prompt (Admin).
cd
into the directory where you installed the agent, for examplecd c:\integration-agent
.- Execute
integrationagent.exe standalone
.
Cross-platform (Linux, OS/X, Windows)
Make sure that the default Java version is Java 1.8. To confirm run java -version
in the terminal. The output should be Java(TM) SE Runtime
Environment (build 1.8.0_build)
.
- Open terminal.
cd
into the directory where you installed the agent.- Execute
java -jar integrationagent.jar standalone
.
Configure the Integration Agent
After installing the Integration Agent as a service, it is fully functional and ready to go.
Later you can configure notifications, monitoring, and other parameters.
To configure the Integrator Agent (note the Agent can be running):
Step 1. In Agents
window select previously created Integration Agent.
Step 2. Select the Parameters
tab.
Step 3. Modify parameters and click the Save
button. If the Agent is running it will reconfigure itself at runtime. If the Agent is not running it will apply configuration changes on the next restart.
Configuration parameters
This group of parameters is used to configure the SMTP sender which sends email notifications on the specific events.
SMTP Host
: SMTP Hostname that should be used to send emails from the agent.SMTP Port
: SMTP Port that should be used to send emails from the agent.SMTP User
: SMTP User that should be used to send emails from the agent.SMTP Password
: SMTP Password that should be used to send emails from the agent.FROM
: the email address that will be used to send emails from.TO
: the comma-separated list of email addresses that should receive notifications.CC
: the comma-separated list of email addresses that should be added to CC.BCC
: the comma-separated list of email addresses that should be added to BCC.TLS Enabled
: switch the connection to a TLS-protected.
Notifications
Use this group of parameters to enable email notifications for specific events.
The SMTP sender must be configured.
On Success
: if this parameter is enabled and the SMTP sender is configured the agent will send email notification on each successful flow execution.On Fail
: if this parameter is enabled and the SMTP sender is configured the agent will send an email notification on each failed flow execution.On Shutdown
: if this parameter is enabled and the SMTP sender is configured the agent will send email notification on shutdown.On License Issue
: if this parameter is enabled and the SMTP sender is configured the agent will send an email notification on any issue related to the license verification.On Status Change
: if this parameter is enabled and the SMTP sender is configured the agent will send email notification on any status change, including reaching and clearing dangerous thresholds.
Web Server
This group of parameters is used to configure the Web Server embedded into the Integration Agent. The Web Server is used to display the Integration Agent dashboard when running the Agent on-premise.
Web Server Enabled
: enable or disable the embedded webserver.Host
: the webserver hostname or IP address.Port
: the webserver port number.
Monitoring
This group of parameters is used to set warning and critical thresholds (in %) for the health status of the agent.
Memory Utilization High Threshold (%)
: once memory utilization reaches configured in this field threshold the agent's status will be changed towarning
. The default is80%
.Memory Utilization Critical Threshold (%)
: once memory utilization reaches configured in this field threshold the agent's status will be changed tocritical
. The default is90%
.Error Ratio High Threshold (%)
: once the number of errors compared to successful executions reaches configured in this field threshold the agent's status will be changed towarning
. The default is10%
.Error Ratio Critical Threshold (%)
: once the number of errors compared to successful executions reaches configured in this field threshold the agent's status will be changed tocritical
. The default is25%
.
Logging
This group of parameters is used to configure how the Integration Agent uploads logs to the cloud Etlworks Integrator.
Upload console log files
: if this parameter is enabled the Agent uploads each Flow executing log to the cloud Etlworks Integrator. The parameter is disabled by default. The console logs can be viewed in the Flow Statistics dashboard.Maximum log file size to upload (MB)
: log files with size over a specified amount in MB will not be uploaded. Note that this configuration can be limited by outside factors, such as the file upload limit set on the network proxy side.
Miscellaneous
This group of parameters is used to configure time-outs.
Shutdown time out (ms)
: the shutdown time out is how long the Integration Agent waits for the running flows to finish before it initiates the shutdown sequence. Encreasing the timeout will give running flows more time to finish but will increase the agent's shutdown time. Note that prior to shutting down the Agent will attempt to cancel currently running flows. Most flows will stop almost immediately but if the flow is busy it can take minutes. The default value for this parameter is300000
ms which is 5 minutes.Agent Ping Delay (seconds)
: the amount of delay in seconds between consecutive calls from the Agent to the Etlworks Integrator instance to get the latest configurations and report status. Decreasing the value of this parameter will make the Integration Agent more responsive but will increase the chatter between the Agent and the Etlworks Integrator instance. The default value for this parameter is1
minute.
Upgrade the Integration Agent to the latest version
To upgrade the Integration Agent to the latest version:
Step 1. Open Agents
window.
Step 2. Select any Agent and click Download
at the bottom of the screen.
Step 3. Select Windows
or Linux
tab.
Step 4. Click Agent update
.
Step 2. If the Integration Agent is running Stop Agent service:
Step 3. Delete content of the lib
folder and copy content lib
folder in the zip file into AGENT_HOME/lib
.
Step 4. Start Agent service:
Monitor the Integration Agent
Agent's status
Each running Integration Agent reports status to the host Etlworks Integrator once a minute. Use Agent Ping Delay
to change the frequency.
The status of the specific Integration Agent is displayed in the grid under the STATUS column.
Available statuses
Offline
: the Agent is offline (not running)Online
: the Agent is online (running and the scheduler is enabled).Online (suspended)
: the Agent is online but the scheduler is suspended, hence no Flows can be executed automatically by the Agent. It is still possible to execute Flows manually.
Agent's Dashboard
The Agent's Dashboard displays information about various statuses, scheduler, JVM, and running flows.
To open the Agent's Dashboard click status
link in the Agents
window.
The status of the Agent recorded during the latest communication session will be displayed in the popup window.
Email notifications
Notifications can be sent by the Agent or by the Etlworks instance.
Configure Agent to send email notifications
You can configure the following email notifications. To receive notifications the SMPT email sender must be configured.
On Success
: if this parameter is enabled and the SMTP sender is configured the agent will send email notification on each successful flow execution.On Fail
: if this parameter is enabled and the SMTP sender is configured the agent will send an email notification on each failed flow execution.On Shutdown
: if this parameter is enabled and the SMTP sender is configured the agent will send email notification on shutdown.On License Issue
: if this parameter is enabled and the SMTP sender is configured the agent will send an email notification on any issue related to the license verification.On Status Change
: if this parameter is enabled and the SMTP sender is configured the agent will send email notification on any status change, including reaching and clearing dangerous thresholds.
Configure Etlworks instance to send email notifications
Step 1. Make sure the SMTP sender is configured under Configuration
->Email
.
Step 2. Click Configure flow notifications
.
Step 3. Enable notifications and enter the email address(s) to receive notifications.
Stop the Integration Agent
To request Integration Agent to stop open the Agent's Dashboard by clicking status
link in the Agents
window, then click the Stop
button. Note that is not possible to request a stop for the Agent which has been already stopped or requested to stop.
Confirm that you really wish to stop the Agent.
Suspend the Integration Agent
The Integration Agent can be suspended. In this mode, the Agent is running but no Flow can be executed automatically by the scheduler. Note that in this mode it is still possible to execute Flows manually. Use this mode to debug issues with the Agent.
To suspend the Agent:
Step 1. In Agents
window select previously created Integration Agent.
Step 2. Enable Suspended
at the bottom of the screen. Click Save
button.
Actions Queue
When the user triggers any action, such as Run Flow, Stop Flow, Stop Agent the action is added to the queue. The actions in a queue are executed in order on the next communication session between the Agent and the Etlworks Integrator.
View Actions
If there are actions in a queue the View Actions
button becomes green.
Click the button the see the actions.
From there you can:
- Remove the action from the queue.
- Check the estimated time when the top action in a queue will be executed.
Comments
0 comments
Please sign in to leave a comment.