[resolved] List all the directory for a given HDFS path

Highlighted
One Star

[resolved] List all the directory for a given HDFS path

Hi,
I need your help!!!.
I want to list all the directory/folder for the given HDFS path. So I used the following job


Afte I run the job I got only below log. 
connecting to socket on port 4067
connected
: org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
disconnected
Job Read_HDFS_file ended at 20:25 02/04/2017.

I expected the list of folder in the tlogrow output, but got nothing. please see the above log. Please let me know If I miss something here..

Accepted Solutions
One Star

Re: [resolved] List all the directory for a given HDFS path

Hi, 
I resolved it myself. I removed "*.*" from filemask and then it worked well. 

All Replies
One Star

Re: [resolved] List all the directory for a given HDFS path

Can you post tHDFSList properties ?
One Star

Re: [resolved] List all the directory for a given HDFS path

Can you post tHDFSList properties ?

Here is the tHDFSList screen shot.. 
Under "data/stage/retail" path, I have folders (example datafolder1, datafolder2..etc). I want to print these folder names only in tlogrow. To understand it better, I have simplified the requirement.  

FYI, I tried to list the names from unix box using similar approach and it worked well.
One Star

Re: [resolved] List all the directory for a given HDFS path

Hi, 
I resolved it myself. I removed "*.*" from filemask and then it worked well. 

Cloud Free Trial

Try Talend Cloud free for 30 days.

Tutorial

Introduction to Talend Open Studio for Data Integration.

Definitive Guide to Data Integration

Practical steps to developing your data integration strategy.

Definitive Guide to Data Quality

Create systems and workflow to manage clean data ingestion and data transformation.