One Star

Dynamically add columns to table based on new rows in data source

New to Talend...
Is there a way to dynamically generate additional rows in a target table based on fields that were added to an input step (flat file)?
Thanks Much!!
3 REPLIES
Moderator

Re: Dynamically add columns to table based on new rows in data source

Hi,
Are you looking for incremental load?
Could you please elaborate your case with an example with input and expected output values?

Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: Dynamically add columns to table based on new rows in data source

Lets say I have a simple csv input that reads the file and loads it into a table. 
What we want the ETL to do is look at the input file to see if any additional fields have been added to the input stream then through the ETL automatically add the new input fields as rows in the output DB table then populate all fields in the table including the new ones. Just wonder if it is possible in Talend ETL. Is so then what might be the recommended transform objects to use.
Thanks!
Moderator

Re: Dynamically add columns to table based on new rows in data source

Hi,
Could you please look at Talend CDC(changed data capture) feature to see if it is satisfying your needs?
TalendHelpCenter:CDC architectural overview
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.