Talend X Hadoop HortonWorks 2.6 - Issues to run Jobs

Four Stars

Talend X Hadoop HortonWorks 2.6 - Issues to run Jobs

Hello Everyone,

 

I am trying to do any operation using a Hadoop cluster and always when I try to run a job, the same message is presented:

 

Starting job HDFStoHbase at 16:14 28/02/2018.

[statistics] connecting to socket on port 3450
[statistics] connected
[WARN ]: org.apache.hadoop.util.Shell - Did not find winutils.exe: java.io.FileNotFoundException: java.io.FileNotFoundException: HADOOP_HOME and hadoop.home.dir are unset. -see https://wiki.apache.org/hadoop/WindowsProblems
[WARN ]: org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[WARN ]: org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory - The short-circuit local reads feature cannot be used because UNIX Domain sockets are not available on Windows.
[statistics] disconnected
Job HDFStoHbase ended at 16:14 28/02/2018. [exit code=0]

 

I think is missing something to make Talend communicate 100% to Hadoop, because connection to the cluster I can with success.

 

I tried to do what this links says, but no success: https://wiki.apache.org/hadoop/WindowsProblems

 

Please, help me!

Thanks!

Amauri

 

 

Moderator

Re: Talend X Hadoop HortonWorks 2.6 - Issues to run Jobs

Hello,

Could you please indicate on which talend build version you got this issue?

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Four Stars

Re: Talend X Hadoop HortonWorks 2.6 - Issues to run Jobs

Hello,

My Talend version is 6.5.1
Ten Stars

Re: Talend X Hadoop HortonWorks 2.6 - Issues to run Jobs

Check thread below and solution

 

HADOOP_HOME and winutils.exe from Horton

https://community.talend.com/t5/Design-and-Development/Apache-Hadoop-2-7-5-distribution-Client-verio...

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Put Massive Amounts of Data to Work

Learn how to make your data more available, reduce costs and cut your build time

Watch Now

How OTTO Utilizes Big Data to Deliver Personalized Experiences

Read about OTTO's experiences with Big Data and Personalized Experiences

Blog

Talend Integration with Databricks

Take a look at this video about Talend Integration with Databricks

Watch Now