Talend X Hadoop HortonWorks 2.6 - Issues to run Jobs

Four Stars

Talend X Hadoop HortonWorks 2.6 - Issues to run Jobs

Hello Everyone,

 

I am trying to do any operation using a Hadoop cluster and always when I try to run a job, the same message is presented:

 

Starting job HDFStoHbase at 16:14 28/02/2018.

[statistics] connecting to socket on port 3450
[statistics] connected
[WARN ]: org.apache.hadoop.util.Shell - Did not find winutils.exe: java.io.FileNotFoundException: java.io.FileNotFoundException: HADOOP_HOME and hadoop.home.dir are unset. -see https://wiki.apache.org/hadoop/WindowsProblems
[WARN ]: org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[WARN ]: org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory - The short-circuit local reads feature cannot be used because UNIX Domain sockets are not available on Windows.
[statistics] disconnected
Job HDFStoHbase ended at 16:14 28/02/2018. [exit code=0]

 

I think is missing something to make Talend communicate 100% to Hadoop, because connection to the cluster I can with success.

 

I tried to do what this links says, but no success: https://wiki.apache.org/hadoop/WindowsProblems

 

Please, help me!

Thanks!

Amauri

 

 

Moderator

Re: Talend X Hadoop HortonWorks 2.6 - Issues to run Jobs

Hello,

Could you please indicate on which talend build version you got this issue?

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Four Stars

Re: Talend X Hadoop HortonWorks 2.6 - Issues to run Jobs

Hello,

My Talend version is 6.5.1
Ten Stars

Re: Talend X Hadoop HortonWorks 2.6 - Issues to run Jobs

Check thread below and solution

 

HADOOP_HOME and winutils.exe from Horton

https://community.talend.com/t5/Design-and-Development/Apache-Hadoop-2-7-5-distribution-Client-verio...

What’s New for Talend Spring ’19

Watch the recorded webinar!

Watch Now

Definitive Guide to Data Quality

Create systems and workflow to manage clean data ingestion and data transformation.

Download

Tutorial

Introduction to Talend Open Studio for Data Integration.

Watch

Downloads and Trials

Test drive Talend's enterprise products.

Downloads