We are planning to migrate our shell scripts based ingestion process to talend jobs.
The shell scripts include ,while loops which move files from local file system to hdfs based on some logic.
Could you please advice will it be better to use component like tsystem to call unix commands which are already part of the scripts and thus easier to implement in talend job or its better to use other components with similar functionality present in talend.
For example moving file to hdfs we can call hdfs put command from tsystem or use hdfs put component in talend.
Kindly advice,any help will be much appreciated.
Talend named a Leader.
Kickstart your first data integration and ETL projects.
Read about OTTO's experiences with Big Data and Personalized Experiences
Pick up some tips and tricks with Context Variables
Take a look at this video about Talend Integration with Databricks