Running the same job in multi thread under the parent job

Five Stars rm
Five Stars

Running the same job in multi thread under the parent job

I have a scenario, where i'm designing a job using "dynamic schema" and calling that child job in multi threads under the parent job in enterprise edition.

 

To be more clear, parent Job has two trun components, where same child job is  called in multi threads. Child job fetch the data from different tables and writes to a file.

 

I'm stuck with few issues. Kindly help me.

 

a)Is it best approach to call same job in multi-instance? Or do we have any other best solution?

b)My desired date format in ouput should be "yyyy-MM-dd". So, in dynamic schema, selected date format as "yyyy-MM-dd".  But while running the job in multi-instance, i end up seeing the files created with timestamp(yyyy-MM-dd hh24.MM.ss). However, without multi-threads(sequentially), file is created with proper date format(yyyy-MM-dd).

 

Thanks

 

Moderator

Re: Running the same job in multi thread under the parent job

Hi,

Could you please post your current job setting screenshots on forum which will be helpful for us to understand your work flow?

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Five Stars rm
Five Stars

Re: Running the same job in multi thread under the parent job

 Parent job where single child job is called with different parameters.

 

parent.JPG

Child job: This job will read the sql file with the help of dynamic schema.

child.JPG

 

Thanks

Highlighted
Moderator

Re: Running the same job in multi thread under the parent job

Hi,

Have you already checked the option "Multi thread execution" option?

Best regards

SabrinaMultithread.PNG

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.

15TH OCTOBER, COUNTY HALL, LONDON

Join us at the Community Lounge.

Register Now

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

How Media Organizations Achieved Success with Data Integration

Learn how media organizations have achieved success with Data Integration

Read

6 Ways to Start Utilizing Machine Learning with Amazon We Services and Talend

Look at6 ways to start utilizing Machine Learning with Amazon We Services and Talend

Blog