How can we get offset id while consuming kafka messages in Big Data Streaming job

Six Stars

How can we get offset id while consuming kafka messages in Big Data Streaming job

Hi All,

 

How can we get offset id while consuming kafka messages in Big Data Streaming job?

 

There is no option to get offset id. 

2017-12-28_13-18-32.png

Moderator

Re: How can we get offset id while consuming kafka messages in Big Data Streaming job

Hello,

Could you please have a look at this new feature:https://jira.talendforge.org/browse/TBD-3321 to see if it is what you are looking for?

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Six Stars

Re: How can we get offset id while consuming kafka messages in Big Data Streaming job

Hi,

 

Not exactly. We are looking to capture offset id along with the message.

Moderator

Re: How can we get offset id while consuming kafka messages in Big Data Streaming job

Hello,

Please create a new feature jira issue on talend bug tracker.

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Five Stars

Re: How can we get offset id while consuming kafka messages in Big Data Streaming job

Hello @mysti,

 

I'm encountering the same problem.

Have you create the Jira as was recommended ?

 

Regards.

What’s New for Talend Spring ’19

Watch the recorded webinar!

Watch Now

Tutorial

Introduction to Talend Open Studio for Data Integration.

Watch

Downloads and Trials

Test drive Talend's enterprise products.

Downloads

Definitive Guide to Data Integration

Practical steps to developing your data integration strategy.

Download