Merging data with rules.

Highlighted
Four Stars
Four Stars

Merging data with rules.

Hello,

 

I would like to merge data from multiple sources with intention to create one 'golden record'.

I'm looking for some advice how to achive workflow solution that will automatically select and pass fields based on rules.

 

Example data to merge:

Data Source: 01.xml

 Node ID: 001

 Node Description: Lorem ipsum dolor sit amet

 Node Photos: 001.jpg, 002.jpg

 

Data Source: 02.xml

 Node ID: 001

 Node Description: Lorem ipsum dolor sit amet, consectetur adipiscing elit

 Node Photos: abc.jpg

 

Rule for Node Description field: select longest string

Rule for Node Photos: select source with more values (photos)

 

So after all my 'golden record' should be:

 Node ID: 001

 Node Description: Lorem ipsum dolor sit amet, consectetur adipiscing elit

 Node Photos: 001.jpg, 002.jpg

 

 I'm on Open Studio.

 

Regards,

Bart

Highlighted
Moderator

Re: Merging data with rules.

Hello,

From your description, we have designed a demo job for you.

Let us know if it is OK with you.

Please have a look at my screenshots for details.

1.png2.png3.png4.png

 

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.

2019 GARTNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

Best Practices for Using Context Variables with Talend – Part 2

Part 2 of a series on Context Variables

Blog

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog