Metadata driven ETL - a future "Talend ETL Architect" tool

One Star

Metadata driven ETL - a future "Talend ETL Architect" tool

I believe that meta-data driven ETL is the next wave. Products that embrace it will thrive.
I love Talend's flexibility, but feel that a meta-data definition, configuration management (connections to physical elements), business rules and a transformation repository, is needed. This is all part of meta-data mangement that an architect would do, NOT an ETL developer. These structures would be defined in a higher layer - I.E. an "Talend ETL Architect" (new product, hint hint). This layer resolves all configuration, and physical connections to databases, files, flat files, etc, inside it. Now, the development layer is decoupled from the physical layer (read that again).
Once done, the actual ETL developer does not need to know about the underlying physical layer - that is done by the architect at that higher level. Now, the developer can use the eclipse visual development, and draw on components that connect to the higher level meta-data elements ONLY. This decoupling of the "Architect" layer from the "Developer" layer will lead to much higher level developer productivity, and the ability for the architect to work with a business analyst at a higher level to define the meta-data layer in a "Talend ETL Architect tool".
This could be huge for Talend, in my opinion - I hope you consider it.
Dave

Calling Talend Open Studio Users

The first 100 community members completing the Open Studio survey win a $10 gift voucher.

Start the survey

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

How Media Organizations Achieved Success with Data Integration

Learn how media organizations have achieved success with Data Integration

Read

Why Companies Move to the Cloud: 7 Success Stories

Learn how and why companies are moving to the Cloud

Read Now