Customer MDM - How to handle new customer without processing all the database ?

Five Stars

Customer MDM - How to handle new customer without processing all the database ?

Hello,

 

I have a job with a tMatchGroup which matches customers together from various source systems by using name and adress, with levenshtein algorithm.

It works fine.

 

When a new customer is created in source system, i currently need to reload the job and the whole data are processed by the tMatchGroup.

If i have 10 000 customers, the job will process these 10 000 records together. But it is useless, I only need to match the new customer with the others.

 

Do i have to use another component ? Because It seems tMatchGroup use the whole table in input. (like a cartesian join)

Besides, I would like to keep the GID from the first launch, if i process the entire data, i will lost the GID, they will be replaced by new ones.

 

Or maybe I do not use the appropriate method...

 

Thanks for your help.


Accepted Solutions
Six Stars

Re: Customer MDM - How to handle new customer without processing all the database ?

Hi Vdubois,

Tmatchgroup is to match with in the incoming data, use trecordmatching which will use the data the existing data to match against the incoming data.

Thanks
Ashok

View solution in original post


All Replies
Six Stars

Re: Customer MDM - How to handle new customer without processing all the database ?

Hi Vdubois,

Tmatchgroup is to match with in the incoming data, use trecordmatching which will use the data the existing data to match against the incoming data.

Thanks
Ashok

View solution in original post

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Have you checked out Talend’s 2019 Summer release yet?

Find out about Talend's 2019 Summer release

Blog

Talend Summer 2019 – What’s New?

Talend continues to revolutionize how businesses leverage speed and manage scale

Watch Now

6 Ways to Start Utilizing Machine Learning with Amazon We Services and Talend

Look at6 ways to start utilizing Machine Learning with Amazon We Services and Talend

Blog