Best Practice for Extraction from Couchbase

Highlighted
One Star

Best Practice for Extraction from Couchbase

Hi,
I new to Talend and going through the setup and configuration. I am going the opposite way most people are moving data in the examples. I am extracting data from Couchbase and putting it in to Mysql for a operational data store for reporting. Currently, I have created a view in Couchbase and I am able to extract the data I want to a "log file" in table format. Furthermore, I can extract data from a text file and put it in Mysql. But have not extracted from Couchbase and inserted into Mysql. I had some questions on how to do that. It seems that when Talend extracts data from Couchbase it returns a "id", "key", "value" and "Json" fields. The "Value" field has my view data strung together in one string field, and also the "Json" field has the fields and data as well, even though I didn't ask for them. So I have a couple of questions.
1. What is the best practice to parse out the fields of the "value" field?
2. Should I parse out fields from the "Value" field or is there a better way that will give me individual fields without all that work?
3. How does Talend figure the delta of the data coming from Couchbase on a ongoing basis?
4. Is there documentation that someone can point me to that will help with these questions?
Thank you
David
Community Manager

Re: Best Practice for Extraction from Couchbase

H David
Use a tExtractJsonField component to exact the fields from the value string, about tExtractJsonField component, please refer to the user manual:
https://help.talend.com/search/all?query=tExtractJSONFields&content-lang=en
Best regards
Shong
----------------------------------------------------------
Talend | Data Agility for Modern Business

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Put Massive Amounts of Data to Work

Learn how to make your data more available, reduce costs and cut your build time

Watch Now

How OTTO Utilizes Big Data to Deliver Personalized Experiences

Read about OTTO's experiences with Big Data and Personalized Experiences

Blog

Talend Integration with Databricks

Take a look at this video about Talend Integration with Databricks

Watch Now