Perfomance while loading csv into table

Six Stars

Perfomance while loading csv into table

I am trying to load csv file into table , but performance is very very very slow , File is comma delimited with 6 million rows , lookup table is feed generated ID and it inserts into table 

 

help me the changes to loaded faster for 6 million rows ...  

 

12sd.PNG

 

 

In tmap i have below 

 1112.PNG

Six Stars

Re: Perfomance while loading csv into table

I tried below approach . first load into file and use that file and load into table 

 

still slow

 

3123.PNG

Moderator

Re: Perfomance while loading csv into table

Hello,

What's your target DB? Have you tried to set "Use Batch Size" option to activate the batch mode for data processing?

Best regards

Sabrina

 
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Sixteen Stars

Re: Perfomance while loading csv into table

The problem is clearly caused by your DB. In order for us to help we will need to know....

1) What the DB is?

2) Is it on-premise or remote?

3) What are your connection settings?

4) What are your t{DB}Output settings (both Basic and Advanced)