Merging data with rules.

Four Stars bk
Four Stars

Merging data with rules.



I would like to merge data from multiple sources with intention to create one 'golden record'.

I'm looking for some advice how to achive workflow solution that will automatically select and pass fields based on rules.


Example data to merge:

Data Source: 01.xml

 Node ID: 001

 Node Description: Lorem ipsum dolor sit amet

 Node Photos: 001.jpg, 002.jpg


Data Source: 02.xml

 Node ID: 001

 Node Description: Lorem ipsum dolor sit amet, consectetur adipiscing elit

 Node Photos: abc.jpg


Rule for Node Description field: select longest string

Rule for Node Photos: select source with more values (photos)


So after all my 'golden record' should be:

 Node ID: 001

 Node Description: Lorem ipsum dolor sit amet, consectetur adipiscing elit

 Node Photos: 001.jpg, 002.jpg


 I'm on Open Studio.





Re: Merging data with rules.


From your description, we have designed a demo job for you.

Let us know if it is OK with you.

Please have a look at my screenshots for details.



Best regards


Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Put Massive Amounts of Data to Work

Learn how to make your data more available, reduce costs and cut your build time

Watch Now

How OTTO Utilizes Big Data to Deliver Personalized Experiences

Read about OTTO's experiences with Big Data and Personalized Experiences


Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables


Talend Integration with Databricks

Take a look at this video about Talend Integration with Databricks

Watch Now