[resolved] How to delete all the data from an MDM entity as quick as possible

One Star

[resolved] How to delete all the data from an MDM entity as quick as possible

Hi
I currently have +- 300k records for an entity in MDM. I want to delete all these records but the process is going really slow (around 20records/s).
My setup is:    tMDMInput ---> tMDMDelete
Is there anyway to speed up the process?
Kind Regards
Dries

Accepted Solutions
Employee

Re: [resolved] How to delete all the data from an MDM entity as quick as possible

Hi,
Did you look in the tMDMDelete documentation here? Since 5.4, tMDMDelete includes a way to delete all instances matching some criteria you can define in tMDMDelete.
Regards,
François.

View solution in original post


All Replies
Employee

Re: [resolved] How to delete all the data from an MDM entity as quick as possible

Hi,
Did you look in the tMDMDelete documentation here? Since 5.4, tMDMDelete includes a way to delete all instances matching some criteria you can define in tMDMDelete.
Regards,
François.

View solution in original post

One Star

Re: [resolved] How to delete all the data from an MDM entity as quick as possible

Hi
Thank you for your fast reply. I overlooked that option!
Kind regards
Dries
One Star

Re: [resolved] How to delete all the data from an MDM entity as quick as possible

Goto advanced setting in tMDMInput component and increase  Batch size.

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Have you checked out Talend’s 2019 Summer release yet?

Find out about Talend's 2019 Summer release

Blog

Talend Summer 2019 – What’s New?

Talend continues to revolutionize how businesses leverage speed and manage scale

Watch Now

6 Ways to Start Utilizing Machine Learning with Amazon We Services and Talend

Look at6 ways to start utilizing Machine Learning with Amazon We Services and Talend

Blog