How to avoid starting of lookup file execution at the beginning of the job

Seven Stars

How to avoid starting of lookup file execution at the beginning of the job

Hi,

 

I am trying to create a job like below.

tFileExcelInput_1--->tFilterRow--->tFileExcelOutput_2--->tUniqueRow--->tMap--->tFileExcelOutput_3--main->tmap

                                                                                                                                   tFileExcelInput2--->lookup-->

 

tFileExcelOutput_3 is the main and tFileExcelInput2 is lookup file. tFileExcelInput2 is the tFileExcelOutput_2. 

But, when I do lookup, lookup file is executing first which should not happen because it is dependent on the data of tFileExcelOutput_2. 

 

I changed tMap lookup model as Load at each row, this is working, but taking lot of time for large data. Do we have any other alternative to handle this situation.

 

 

Thanks in advance,

Meghana.

 

 


Accepted Solutions
Highlighted
Twelve Stars

Re: How to avoid starting of lookup file execution at the beginning of the job

you cannot read the file you are writing in the same sub-job.
so you can split your job or use file or tHashMap to store temp data.
good luck

Francois Denis

Tag as "solved" for others! Kudos to thanks!


All Replies
Highlighted
Twelve Stars

Re: How to avoid starting of lookup file execution at the beginning of the job

you cannot read the file you are writing in the same sub-job.
so you can split your job or use file or tHashMap to store temp data.
good luck

Francois Denis

Tag as "solved" for others! Kudos to thanks!

Seven Stars

Re: How to avoid starting of lookup file execution at the beginning of the job

I have split the job and it is working

 

Thanks,

Meghana.

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

An API-First Approach to Modernizing Applications

Learn how to use an API-First Approach to Modernize your Applications

Watch Now

Talend API Designer – Technical Overview

Take a look at this technical overview video of Talend API Designer

Watch Now

Getting Started with APIs

Find out how to get started with APIs

Read