Four Stars

Issue on JSON files copy on Hadoop

Hi I am trying to extract JSON files from one HDFS location to another HDFS location. I Have followed the proper component and properties set up but yet not see it is functioning although job runs fine. I don't see the put component putting files to destination folder. Can somebody please help me on this?jsonissue.JPG

1 REPLY
Moderator

Re: Issue on JSON files copy on Hadoop

Hello,

Are your HDFS cluster running with or without kerberos authentication? If your HDFS cluster running without kerberos authentication, you can extract JSON files from one HDFS location to another HDFS location.

In tHDFSPut component, you have to define local directory where are stored the files to be loaded in to HDFS.

The workflow looks like:tHDFSConnection-->tHDFSList-->tHDFSGet(load your json files into local)-->tHDFSPut(copies files from an user-defined directory, pastes them into a given Hadoop distributed file system)

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.