The tKafkaInput component in my job does not stop after the specified number of messages in the "Stop after receiving a maximum number of messages" setting.
I have 180 messages in the queue, and I want to stop after getting the first 10, but it always gets all 180 no matter what number I choose.
Have I used this setting incorrectly? Any thoughts?
From your screenshot, we don't find any incorrect setting. Could you please clarify in which Talend version/edition you are? We will make a testing on it to see if it is a bug.
Could you please try to download talend open studio for bigdata product 7.1.1 to see if this issue repro?
Yes, and I can confirm this is still a problem in Talend Open Studio for Big Data 7.1.1.
Could you please try one of the message batches option (stop after a max total duration, stop after receiving a maximum number of messages, stop after max time between messages) in Talend Open Studio for Big Data 7.1.1.?
We are using Talend Open Studio for Big Data version 7.2.1 and we just encountered similar problem.
Are you still taking care of this thread? if you are, we will provide more information here.
Talend named a Leader.
Kickstart your first data integration and ETL projects.
Watch the recorded webinar!
Learn how to make your data more available, reduce costs and cut your build time
Read about OTTO's experiences with Big Data and Personalized Experiences
Take a look at this video about Talend Integration with Databricks