Four Stars

File processing using Dynamic Schema

Currently using Talend Data Integration Version: 6.4.1 Build id: 20170623_1246 (aka Enterprise)

 

Problem:

We are receiving clinical text csv files with differing numbers of columns in the files.

There is a core set of columns we want to retrieve from all of the files.  There is also 

a set of columns that will be listed multiple times which we want to concatenate

together and continue to pass along in the flow.

 

So how to I retrieve the "dynamic schema" column information and the value of the column coming from a  component?

 

Thank you

Peter

1 REPLY
Moderator

Re: File processing using Dynamic Schema

Hello,


pdiazdeleon wrote:

There is a core set of columns we want to retrieve from all of the files.  There is also 

a set of columns that will be listed multiple times which we want to concatenate

together and continue to pass along in the flow.

 

 

 



With your job requirement, could you please elaborate your case with an example with input and expected output values?

Here is an article that introduces the dynamic schema feature:https://community.talend.com/t5/Design-and-Development/How-to-process-changing-data-structure/ta-p/2...

Hope it helps.

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.