Talend Big Data 6.4.1
I'm using the tSQSInput component to retrieve messages from an SQS queue.
I iterate and perform actions on the data until the queue is empty. Although, with the "Max number of message to return per request" set to 10, I only ever see a maximum of 3 being processed (and in flight on AWS console). Is this expected behavior from this component?
Thanks for any assistance.
@vapukov I tried increasing custom wait time to the max of 20 and the component still only reads 3 messages at a time.
In the image below, parallel iteration is set to 10 but there are only ever 3 executions running.
Talend named a Leader.
Kickstart your first data integration and ETL projects.
Learn how to make your data more available, reduce costs and cut your build time
Read about OTTO's experiences with Big Data and Personalized Experiences
Take a look at this video about Talend Integration with Databricks