Incremental Import from HBASE to pipe delimiter text file

Five Stars

Incremental Import from HBASE to pipe delimiter text file

Hi I already have historical data loaded on talend big data platform. From hbase/XML to pipe delimited text.  Want to conduct Incremental import from  HBASE/XML TO pipe delimited text file.

 

Q1: How do I design incremental import based on HBase date column in it. ? If yes, please brief on it.

 

Q2 What are the alternatives to conducting Incremental load in HBASE. 

 

Any help appreciated on it?

 

 

 

Please advise on it 

Moderator

Re: Incremental Import from HBASE to pipe delimiter text file

Hi,

You can use a tHBaseInput component to read the data from the Hbase table.TalendHelpCenter:tHBaseInput

Is there a timestamp field in your table?

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Five Stars

Re: Incremental Import from HBASE to pipe delimiter text file

Yes, we have timestamp column for it.
can you please let us know how to use a timestamp in HBase INPUT
Component. please guide?

Do we need to conduct any setting for doing incremental read before to
going for talend job configuration?

What’s New for Talend Spring ’19

Watch the recorded webinar!

Watch Now

Agile Data lakes & Analytics

Accelerate your data lake projects with an agile approach

Watch

Definitive Guide to Data Quality

Create systems and workflow to manage clean data ingestion and data transformation.

Download

Tutorial

Introduction to Talend Open Studio for Data Integration.

Watch