Abort job on duplicates and not update output file

Four Stars

Abort job on duplicates and not update output file


I have the below logic to be built in talend.

I have a file that is updated on monthly basics. There are 4 fields that need to be unique. if a duplicate entry is found for these 4 fields, the load to output file should not occur.and it should throw an error.

I tried to do this by using below logic.pic.png

so once the input file is loaded, the tsortrow and the tuniquerow will check for unique values. if there are duplicates the job will throw error(which it does).but the uniquevalue csv output file should not be updated in case of any error. It should only get updated, if there is no error (or duplicate record). 

How should i do it? i tried to on component ok, but it doesnt give me that option.


Re: Abort job on duplicates and not update output file


Please your job requirement description, the "RunIf" trigger would be helpful for you. It can trigger a subjob or component in case the condition defined is met.

To make it clear, I have designed a demo job for you. Hope it helps.


Best regards


Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.

Re: Abort job on duplicates and not update output file



     I believe this is a duplicate post of the same scenario mentioned in your another post (link below)




     Could you please mark both topics as resolved since solution has been provided for both of them? It will help to enrich the Talend community and if another community member is getting similar issue, he/she can easily go to a post which has a solution available.


     Happy programming in Talend :-)


Warm Regards,


Nikhil Thampi

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables


How Media Organizations Achieved Success with Data Integration

Learn how media organizations have achieved success with Data Integration


APIs for Dummies

View this on-demand webinar about APIs....

Watch Now