Dynamic schema

One Star

Dynamic schema

Hi,
i have a 3 feed file which has 5 columns(name,age,sex,phno,dept) with 100 rows.The columns names are not sequentially arranged in all the feed file.
Now while reading i only want to read 3 columns ( name,age ,dept) but not using TMap.
As the columns names are not sequentially arranged , i want to read the rows by reading the column names.
how I can achieve that ?
regards,
romi
Moderator

Re: Dynamic schema

Hi,
It seems you are looking for dynamic schema feature in talend which allows you to design schema with an unknown column structure (unknown name and number of columns), however, dynamic schema feature is only available in Talend Enterprise Subcription Version.
Please have a look at the KB artcile TalendHelpCenter:How to process changing data structure?.
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Seventeen Stars

Re: Dynamic schema

You could use the component tFileInputTextFlat from Talend Exchange to do that. This component provides a method to set the position of a column by its header line (also find the column by regex expressions).
http://www.talendforge.org/exchange/index.php?eid=745&product=tos&action=view&nav=1,1,1
You will find here a documentation and a link to the install description from Talend for User Components.

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

How Media Organizations Achieved Success with Data Integration

Learn how media organizations have achieved success with Data Integration

Read

Downloads and Trials

Test drive Talend's enterprise products.

Downloads