Four Stars

Calling Hadoop Java code in MapReduce Job

HI Team,


I have a custom java code which was written using MapReduce libraries. I was able to run the jar file successfully on Hadoop cluster. But, while I am running the same jar in "Big Data Batch Job" with tLibraryLoad, I am getting Error like, could not be able to load main class.Could any one help me, what am I missing.


Note: command to run the Jar in cluster

hadoop jar <jarName> <className> <arg1> <arg2>


Run  Arguments in Talend Job:





Re: Calling Hadoop Java code in MapReduce Job


Are you using tJava or tJavaRow components to write custom java code in your spark batch job?

Best regards



Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.