From Thursday, July, 9, 3:00 PM Pacific,
our Community site will be in
read-only mode
through Sunday, July 12th.
Thank you for your patience.

Which one is better tsystem or similar talend components

Highlighted
Six Stars

Which one is better tsystem or similar talend components

Hi ,

 

We are planning to migrate our shell scripts based ingestion process to talend jobs.

The shell scripts include ,while loops which move files from local file system to hdfs based on some logic.

 

Could you please advice will it be better to use component like tsystem to call unix commands which are already part of the scripts and thus easier to implement in talend job or its better to use other components with similar functionality present in talend.

 

For example moving file to hdfs we can call hdfs put command from tsystem or use hdfs put component in talend.

 

Kindly advice,any help will be much appreciated.

 

Best Regards,

OJ

 

Highlighted
Sixteen Stars
Sixteen Stars

Re: Which one is better tsystem or similar talend components

Hi,
Using dedicated components will be more flexible and faster than calling external scripts shell or maybe system command (IMHO).

TRF

2019 GARTNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

How OTTO Utilizes Big Data to Deliver Personalized Experiences

Read about OTTO's experiences with Big Data and Personalized Experiences

Blog

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

Talend Integration with Databricks

Take a look at this video about Talend Integration with Databricks

Watch Now