Highlighted
One Star

Phase and checkpoint in Talend?

In Talend, can we put the job flow in different phases or use checkpoint just like Ab Initio does? or similiar usage.
You help is much appreciated.
7 REPLIES
Employee

Re: Phase and checkpoint in Talend?

Are you talking about checkpoint for doing some kind of "Error Recovery" ?
One Star

Re: Phase and checkpoint in Talend?

In Ab Initio, what it can do is
1) In the same subjob, you have row1, row2, row3, row4, you can specify row1 and row2 as phase 1, row3 and row4 as phase2, when it is executed, row1 and row2 will run first, once it is finished, row3 and row4 will start. This can avoid too many thread runing at the same time.
2) For the checkpoint, if the job failed at the 1000th record, when you restart the job, it will start from 1001th record
Employee

Re: Phase and checkpoint in Talend?

Ok I see for phases Talend does not have such feature natively but you can "simulate" that behaviour using trigger link and buffer components (workaround)
Concerning the checkpoint we have this but this is not at row level. You can set it on "Onsubjobok" link and restart a job from a particular subjob.
One Star

Re: Phase and checkpoint in Talend?

Thanks camsellem for your information.
How to use buffer components do workaround? Could you explain more?
One Star

Re: Phase and checkpoint in Talend?

we have group of subjobs(depenedency) if any job failed in between .i need to rerun the job where the subjob failed onwards

Thanks in Advance
Kiran
Moderator

Re: Phase and checkpoint in Talend?

Hi A.kiran,
A group of subjobs(depenedency)? Do you mean tRunJob? Would you mind posting your job design screenshots into forum so that we can get your job situation more precisely to give an optimistic solution.
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Community Manager

Re: Phase and checkpoint in Talend?

we have group of subjobs(depenedency) if any job failed in between .i need to rerun the job where the subjob failed onwards

Thanks in Advance
Kiran

Then you need to use the checkpoint so that you can resume your job from the last checkpoint. Check out https://help.talend.com/search/all?query=What+are+recovery+checkpoints&content-lang=en
and
https://help.talend.com/search/all?query=Recovering+job+execution&content-lang=en
and
https://help.talend.com/search/all?query=How+to+recover+Job+execution+in+case+of+failure&content-lan...
Note this is only available in the commercial versions of Talend not in Talend Open Studio for Data Integration.