I am new to talend and want to understand how to process multiple files in same job with different column names.
I have thousands file like given above and I have to implement same business logic for every file only challenge is column names are different in every file. So please let me know how dynamically we can process these files in talend.
thanks in advance
Column names don't matter as soon as the number of column and their signification are the same for all the files.
It will be better if you can tell , what exactly you want. Expalin better so that we can help you better.
ok thanks for your reply. Let me give you one example.
I have thousands of file all the files have different names and different column names. I want to apply business logic such as if any column is null then assigned 'Y' value to new variable or assigned 'N'. I don 't want to create again and again schema for any new file or for column names. I want to create a job which can read any file with any column name convention and also create new variable as per their assigned value.
The Dynamic schema feature in talend allows you to design schema with an unknown column structure (unknown name and number of columns).
Please refer to this KB article about:https://community.talend.com/t5/Design-and-Development/How-to-process-changing-data-structure/ta-p/2...
Let us know if it is OK with you.
Talend named a Leader.
Kickstart your first data integration and ETL projects.
Part 2 of a series on Context Variables
Learn how to do cool things with Context Variables
Find out how to migrate from one database to another using the Dynamic schema