Best way to move multi HDFS files

Four Stars

Best way to move multi HDFS files

Hi,

 

I am trying to achieve the same functionality of  "hdfs dfs -mv /source/*.done /target/"  in Talend.

I tried tHDFSCopy, which seems not support wildcard in file name.
I am using Talend Open Studio 6.3.1, Big Data Edition. Please advise.

 

Four Stars

Re: Best way to move multi HDFS files

I am currently using 2 components: tHDFSList -> tHDFSCopy to achieve it, which ideally should be handled by one component.

Employee

Re: Best way to move multi HDFS files

I have not tried it, but maybe you can try tSystem and just put the command in it.

 

Tutorial

Introduction to Talend Open Studio for Data Integration.

Definitive Guide to Data Integration

Practical steps to developing your data integration strategy.

Definitive Guide to Data Quality

Create systems and workflow to manage clean data ingestion and data transformation.