One Star

Split kafka consumer flow and write to HDFS file

I need write data periodically from a tKafkaInput component to a HDFS file.i'm connecting tKafkaInput  with tHDFSOutput but am unable to write data into hdfs file,but i could see the change in the date if the file with current  date when i run the job and HDFS file is empty.
When I try to do the same with tLogRow instead of tHDFSOutput i could see the streaming data in Console.Pls help
2 REPLIES
Community Manager

Re: Split kafka consumer flow and write to HDFS file

Hi 
Are you able to write other data to HDFS file? It might be a permission issue, please check if the user you are using in talend is able to write data to HDFS. 
Regards
Shong
----------------------------------------------------------
Talend | Data Agility for Modern Business
One Star

Re: Split kafka consumer flow and write to HDFS file

Hi Shong,
Am able to write other data to HDFS file and user has full permission to read and write to HDFS