From Thursday, July, 9, 3:00 PM Pacific,
our Community site will be in
read-only mode
through Sunday, July 12th.
Thank you for your patience.

Loop through Different databases and load data into tables

Highlighted
Seven Stars

Loop through Different databases and load data into tables

Hello,

Can someone tell me how i can loop through different databases in MYSQL server and load data into respective tables. All the tables have the same exact structure?

Can someone show me a sample layout?

 

Thanks in advance.

 

 

Highlighted
Forteen Stars

Re: Loop through Different databases and load data into tables

Hi,

 

if all tables have the same structure, it is not very complicate

Screen Shot 2019-05-05 at 12.29.50 PM.png

 

  • read connection information from anywhere (csv file in example)
  • Iterate - store row by row to variable
  • use this variable in the next subjob in tDBConnnection component connected by OnComponentOk trigger
  • do the rest

tJavaFlex - just a dummy component for split job into 2 separate parts

-----------

2019 GARTNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

Best Practices for Using Context Variables with Talend – Part 2

Part 2 of a series on Context Variables

Blog

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog