We are planning to migrate our shell scripts based ingestion process to talend jobs.
The shell scripts include ,while loops which move files from local file system to hdfs based on some logic.
Could you please advice will it be better to use component like tsystem to call unix commands which are already part of the scripts and thus easier to implement in talend job or its better to use other components with similar functionality present in talend.
For example moving file to hdfs we can call hdfs put command from tsystem or use hdfs put component in talend.
Kindly advice,any help will be much appreciated.
Talend named a Leader.
Kickstart your first data integration and ETL projects.
Watch the recorded webinar!
Part 2 of a series on Context Variables
Learn how to do cool things with Context Variables
Find out how to migrate from one database to another using the Dynamic schema