I have a requirement where i need to process multiple files from a folder using some specific pattern , but we cant use tfilelist component as its not available in big data platform. can anyone suggest a solution to how can i process.
I tried with context variable in tfileinputdelimeter component but its not processing.
for ex: the context which i used is "context.varname + "<partoffilename>*.dat"
Am using talend Big Data Platform 6.3.1. and we are designing jobs in big data batch. and the files are in Azure.
Please anyone can suggest some solution
Thanks in advance,
We can write a java routine where we can get the list of filenames.
you may try the below desgin
Introduction to Talend Open Studio for Data Integration.
Practical steps to developing your data integration strategy.
Create systems and workflow to manage clean data ingestion and data transformation.