Four Stars

Calling Hadoop Java code in MapReduce Job

HI Team,

 

I have a custom java code which was written using MapReduce libraries. I was able to run the jar file successfully on Hadoop cluster. But, while I am running the same jar in "Big Data Batch Job" with tLibraryLoad, I am getting Error like, could not be able to load main class.Could any one help me, what am I missing.

 

Note: command to run the Jar in cluster

hadoop jar <jarName> <className> <arg1> <arg2>

 

Run  Arguments in Talend Job:

<className>

<arg1>

<arg2>

1 REPLY
Moderator

Re: Calling Hadoop Java code in MapReduce Job

Hello,

Are you using tJava or tJavaRow components to write custom java code in your spark batch job?

Best regards

Sabrina

 

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.