[resolved] List all the directory for a given HDFS path

Highlighted
One Star

[resolved] List all the directory for a given HDFS path

Hi,
I need your help!!!.
I want to list all the directory/folder for the given HDFS path. So I used the following job


Afte I run the job I got only below log. 
connecting to socket on port 4067
connected
: org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
disconnected
Job Read_HDFS_file ended at 20:25 02/04/2017.

I expected the list of folder in the tlogrow output, but got nothing. please see the above log. Please let me know If I miss something here..

Accepted Solutions
One Star

Re: [resolved] List all the directory for a given HDFS path

Hi, 
I resolved it myself. I removed "*.*" from filemask and then it worked well. 

All Replies
One Star

Re: [resolved] List all the directory for a given HDFS path

Can you post tHDFSList properties ?
One Star

Re: [resolved] List all the directory for a given HDFS path

Can you post tHDFSList properties ?

Here is the tHDFSList screen shot.. 
Under "data/stage/retail" path, I have folders (example datafolder1, datafolder2..etc). I want to print these folder names only in tlogrow. To understand it better, I have simplified the requirement.  

FYI, I tried to list the names from unix box using similar approach and it worked well.
One Star

Re: [resolved] List all the directory for a given HDFS path

Hi, 
I resolved it myself. I removed "*.*" from filemask and then it worked well. 

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Put Massive Amounts of Data to Work

Learn how to make your data more available, reduce costs and cut your build time

Watch Now

How OTTO Utilizes Big Data to Deliver Personalized Experiences

Read about OTTO's experiences with Big Data and Personalized Experiences

Blog

Talend Integration with Databricks

Take a look at this video about Talend Integration with Databricks

Watch Now