I have a Talend job that is responsible for reading varied input files/layouts and loading tables in SQL Server.
The challenge I am facing is you don't have the "Use existing dynamic" option in tFileInputDelimited, only in tFileInputPositional.
This creates a problem when the header record column names don't match to the expected naming convention that I am storing in the DB as I use the metadata from the first job into the next job and so on.
Is there a workaround for this?
Is there a way to substitute a new header based on my input metadata that I keep in the DB?
It could be a new feature.
To work with tSetDynamicSchema, components should have the option of "Use existing dynamic" and currently only 2 of our components are supported tfileinputpositional and tfileoutputpositional.
Here exists a new feature jira issue:https://jira.talendforge.org/browse/TDI-29723
Watch the recorded webinar!
Accelerate your data lake projects with an agile approach
Create systems and workflow to manage clean data ingestion and data transformation.
Introduction to Talend Open Studio for Data Integration.