How to reject duplicate entries for key primary and allow to insert other records?

Highlighted
Six Stars

How to reject duplicate entries for key primary and allow to insert other records?

Hello,

I'm trying to load from multiple .CSV files into a MySQL source database. Below I'm attaching a sample snip of the data consisting of 7 columns:

data_snip.png

 

Each record represents either a completed Job or Service order. I have four columns combined to be one primary key i.e 'JobID '+ 'Type' + 'Franchisee' + 'RoyaltyPostDate'.

 

When I'm trying to execute the job it hangs in the middle as duplicate entries are available. If seen in the screenshot 4th,5th and 6th row is the same job repeated thrice as they have different 'Installdate'. \

 

So, when I'm executing I'd like to load only one rows(i.e 4th record) and reject 5th,6th record and resume loading data again from 7th record. 

 

Is there any possible way to do this. Any help would be appreciated.

 

Thank you.

 

 

 

 


Accepted Solutions
Highlighted
Six Stars

Re: How to reject duplicate entries for key primary and allow to insert other records?

using tUinqRow has solved my problem.

Thanks

View solution in original post


All Replies
Highlighted
Six Stars

Re: How to reject duplicate entries for key primary and allow to insert other records?

using tUinqRow has solved my problem.

Thanks

View solution in original post

2019 GARTNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

6 Ways to Start Utilizing Machine Learning with Amazon We Services and Talend

Look at6 ways to start utilizing Machine Learning with Amazon We Services and Talend

Blog

Downloads and Trials

Test drive Talend's enterprise products.

Downloads