About Amazon SQS
Amazon Simple Queue Service (SQS) is a fully managed message queuing service that enables you to decouple and scale microservices, distributed systems, and serverless applications. Read more about Amazon SQS.
When to use this connector
- to read messages from and write messages to a given SQS queue.
- to implement a log-based CDC with a message queue.
Create a Connection
Step 1. In the
Connections window, click
+, and type in
Step 2. Select
Step 3. Enter the Connection parameters.
AWS Region: the AWS cloud region.
Queue name: the optional SQS queue name.
Access Key or IAM Role: the AWS access key or IAM role name.
Secret Access Key: the AWS secret access key. The secret access key must be empty if authenticating with the IAM role.
Max number of records to read: the total maximum number of records to read from the queue. Set it to a reasonable number to allow the system to process records in micro-batches. If nothing is entered the system will read records from the queue until there are no more records.
Number of retries before stop polling: the number of retries before stop polling if poll returns no records. If no records are returned, that means no data records are currently available from the current shard. The connector will continue reading from the next available shard.
Retry N minutes before stop pollingDelay between retries: the number of minutes to retry before stop polling if the poll returns no records. If no records are returned, that means no data records are currently available from the current shard. The connector will continue reading from the next available shard.
Delay between retries (ms): the delay between retries. Set it to avoid exceeding the limit on frequency.
Queue Type: the type of the queue created by the connector. SQS offers two types of message queues.
Standardqueues offer maximum throughput, best-effort ordering, and at-least-once delivery.
FIFOqueues are designed to guarantee that messages are processed exactly once, in the exact order that they are sent.