Four Stars

Talend X Hadoop HortonWorks 2.6 - Issues to run Jobs

Hello Everyone,

 

I am trying to do any operation using a Hadoop cluster and always when I try to run a job, the same message is presented:

 

Starting job HDFStoHbase at 16:14 28/02/2018.

[statistics] connecting to socket on port 3450
[statistics] connected
[WARN ]: org.apache.hadoop.util.Shell - Did not find winutils.exe: java.io.FileNotFoundException: java.io.FileNotFoundException: HADOOP_HOME and hadoop.home.dir are unset. -see https://wiki.apache.org/hadoop/WindowsProblems
[WARN ]: org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[WARN ]: org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory - The short-circuit local reads feature cannot be used because UNIX Domain sockets are not available on Windows.
[statistics] disconnected
Job HDFStoHbase ended at 16:14 28/02/2018. [exit code=0]

 

I think is missing something to make Talend communicate 100% to Hadoop, because connection to the cluster I can with success.

 

I tried to do what this links says, but no success: https://wiki.apache.org/hadoop/WindowsProblems

 

Please, help me!

Thanks!

Amauri

 

 

3 REPLIES
Moderator

Re: Talend X Hadoop HortonWorks 2.6 - Issues to run Jobs

Hello,

Could you please indicate on which talend build version you got this issue?

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Four Stars

Re: Talend X Hadoop HortonWorks 2.6 - Issues to run Jobs

Hello,

My Talend version is 6.5.1
Seven Stars

Re: Talend X Hadoop HortonWorks 2.6 - Issues to run Jobs

Check thread below and solution

 

HADOOP_HOME and winutils.exe from Horton

https://community.talend.com/t5/Design-and-Development/Apache-Hadoop-2-7-5-distribution-Client-verio...