Merging data with rules.

Four Stars bk
Four Stars

Merging data with rules.


Hello,

 

I would like to merge data from multiple sources with intention to create one 'golden record'.

I'm looking for some advice how to achive workflow solution that will automatically select and pass fields based on rules.

 

Example data to merge:

Data Source: 01.xml

Node ID: 001

Node Description: Lorem ipsum dolor sit amet

Node Photos: 001.jpg, 002.jpg

 

Data Source: 02.xml

Node ID: 001

Node Description: Lorem ipsum dolor sit amet, consectetur adipiscing elit

Node Photos: abc.jpg

 

Rule for Node Description field: select longest string

Rule for Node Photos: select source with more values (photos)

 

So after all my 'golden record' should be:

Node ID: 001

Node Description: Lorem ipsum dolor sit amet, consectetur adipiscing elit

Node Photos: 001.jpg, 002.jpg

 

I'm on Open Studio.

 

Regards,

Bart

Twelve Stars

Re: Merging data with rules.

my question is how many rules and do they change?

Francois Denis

Tag as "solved" for others! Kudos to thanks!

Highlighted
Twelve Stars

Re: Merging data with rules.

you can do it with tmap.
first select all possible ids
then use ids as main input with lookup on sources.
add var values for calculation and use inline if (condition)?true:false into output.

Francois Denis

Tag as "solved" for others! Kudos to thanks!

15TH OCTOBER, COUNTY HALL, LONDON

Join us at the Community Lounge.

Register Now

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

How OTTO Utilizes Big Data to Deliver Personalized Experiences

Read about OTTO's experiences with Big Data and Personalized Experiences

Blog

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

Talend Integration with Databricks

Take a look at this video about Talend Integration with Databricks

Watch Now