One Star

Insert large amount of data (97,000,000)

Hi,
I have a source table with nearly 97,000,000 rows which I want to insert into a destination table.
I am using Microsoft SQL Server in my job I use tMSSqlInput to get the source which is wired directly to a tMSSqlOutput to output to the destination table. The job takes ages but the SSIS job which I am replacing runs in around a minute.
I there a more efficient way of doing this?
Thank,
Dave.
4 REPLIES
Moderator

Re: Insert large amount of data (97,000,000)

Hi,
If your DB Microsoft SQL Server support for bulk, talend also provide bulk components to deal with large amount of data.
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: Insert large amount of data (97,000,000)

Hi Sabrina,
What components would I use from the palette?
Thanks for your help,
Dave.
Moderator

Re: Insert large amount of data (97,000,000)

Hi,
You can see the component references tMSSqlBulkExec and tMSSqlOutputBulk with related scenarios.
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: Insert large amount of data (97,000,000)

Thanks Sabrina I overlooked these. The intellisense says "Loads efficiently data from file" I took it literally.
Thanks again Smiley Happy