Four Stars

Best way to move multi HDFS files

Hi,

 

I am trying to achieve the same functionality of  "hdfs dfs -mv /source/*.done /target/"  in Talend.

I tried tHDFSCopy, which seems not support wildcard in file name.
I am using Talend Open Studio 6.3.1, Big Data Edition. Please advise.

 

2 REPLIES
Four Stars

Re: Best way to move multi HDFS files

I am currently using 2 components: tHDFSList -> tHDFSCopy to achieve it, which ideally should be handled by one component.

Employee

Re: Best way to move multi HDFS files

I have not tried it, but maybe you can try tSystem and just put the command in it.