Loading problem in talend:

Six Stars

Loading problem in talend:

 

I have 233 records and i am loading into the excel.

a.PNG


But it is loading only 43 records and after that it is stuck.

If i remove the onsubjobOK and run separately it is running fine

Ten Stars

Re: Loading problem in talend:

This design looks horrible hahahah, I suggest creating subJobs... beside that,
there's a onComponentOk in your design... dummy ->OnComponentOk -> tFileExcelWorkbookOpen ->
Six Stars

Re: Loading problem in talend:

@Dijke @manodwhb @TRF

 

Still i dont understand. can you explain me.

How to load all the data

Ten Stars

Re: Loading problem in talend:

@Darmesh,
You load data into excel... but after 43 it's stuck... do you get an error?
There's a checkbox in Excel component stop to read on empty rows?
Beside the checkbox it works without onSubjobOk, clearly that's not the problem?


DB Table -> 233 records -> Excel1
OnSubjobOk -> Excel1 -> only 43 records -> processing data and -> ExcelFinal
Your picture of your jobflow is kinda hard to understand.

 

 

 

Six Stars

Re: Loading problem in talend:

consider this flow :

1st : from table to excel

2nd : From the excel sheet loading to the default template

This 2 process is happening in my flow.

So the problem is, If the 1st and 2nd process put together in single job OR connected using 2 sub jobs --- Not working it gets stuck till 45 records

If i run the second flow alone separately it is running fine

Ten Stars

Re: Loading problem in talend:

Why not creating multiple outputs:
in tMap -> out1 (order1) -> MySQLOut
-> out2 (order2) -> ExcelOutFile -> continue the row to -> treplace -> tmap_40 -> tFlowtoIterate -> ExcelOutFinal

This is how you should do it

Six Stars

Re: Loading problem in talend:

Here is what i am doing

1.PNGJob Design2.PNGreport input file3.PNG4.PNG5.PNG6.PNG7.PNGreplacing negative values with ()8.PNGcreating multiple excel sheets9.PNG10.PNGoutput template

Ten Stars

Re: Loading problem in talend:

No idea buddy on what's going on in your job.
Are you sure the file is closed before opening context.report_excel (this file is generated in previous dbload), so this is the file with 250+ records? And only reads 43?
Or
its only able to write 43 to tFileExcelWorkbookopen_5 ?
Or
You sure it reads the correct file context.report_excel? I suggest generating files using a global var or something like "<datetime>_out_<processid>.xls"

YOu could place tLogRow directly after the xls context.report_excel and make sure all records
are processed before tmaps, replace etc?

Why not creating a subjob which is run after the previous steps are finished? Im not a big fan of creating big flows... break it down and using a subjobok as indicator to create a subjob is a very nice indicator, also for joblogging and restarting a part of a jobchain.
Because you dont need to query the db for solving this file issue, you just creating the same file over and over again...

Tutorial

Introduction to Talend Open Studio for Data Integration.

Definitive Guide to Data Integration

Practical steps to developing your data integration strategy.

Definitive Guide to Data Quality

Create systems and workflow to manage clean data ingestion and data transformation.