scd type 2 table does not load more that 10 k rows at a time

Eight Stars

scd type 2 table does not load more that 10 k rows at a time

hello everyone,

In my scenario i want to create a type 2 table by using manual update/insert code, source is input mysq l, target is also mysql db,

when i m loading 1 lakh data at a time, it can load only 10K rows, then the process are not increase .

 

 

Please suggest as to how I can go about this?

 

Thanks,

Manish

tempsnip.pngSDD.PNG

Community Manager

Re: scd type 2 table does not load more that 10 k rows at a time

Are you getting error? If so, what? If not, does it carry on if you leave it for a long time? If that is the case, you might want to try indexing

2019 GARTNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

Best Practices for Using Context Variables with Talend – Part 2

Part 2 of a series on Context Variables

Blog

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog