Exception in component tHDFSOutput_1

Seven Stars

Exception in component tHDFSOutput_1

Hi,

I got this error : could only be replicated to 0 nodes instead of minReplication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.

errer.PNG

Is there anyone who can explain to me what does mean this error and what is the solution !

 

Thanks in advance.

Moderator

Re: Exception in component tHDFSOutput_1

Hi,

Could you please take a look at this topic:https://stackoverflow.com/questions/15571584/writing-to-hdfs-could-only-be-replicated-to-0-nodes-ins...?

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Seven Stars

Re: Exception in component tHDFSOutput_1

My problem is not resolved and in addition I try a simple example: import a file on HDFS and use the component tHdfsInput to read the file but I get an error as in the attached link :

https://www.talendforge.org/forum/viewtopic.php?id=46459 

 

Moderator

Re: Exception in component tHDFSOutput_1

Hello,

Is your hadoop cluster connection OK with you? Are you able to connect toyour  host in the command line of windows by using ping?

Best regards

Sabrina

 

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Seven Stars

Re: Exception in component tHDFSOutput_1

Yes the connection is well established and I add the address of the sandbox machine in the file etc\host.

 

e1.PNGe2.PNG

Moderator

Re: Exception in component tHDFSOutput_1

Hi,

Could you please indicate on which talend build version you got this issue?

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Seven Stars

Re: Exception in component tHDFSOutput_1

Last version of talend open studio for big Data (talend_6.4.1)

 

Best regards.

Moderator

Re: Exception in component tHDFSOutput_1

Hi,


@INESBK wrote:

My problem is not resolved and in addition I try a simple example: import a file on HDFS and use the component tHdfsInput to read the file but I get an error as in the attached link :

https://www.talendforge.org/forum/viewtopic.php?id=46459 

 

Exception in component tHDFSInput_1
org.apache.hadoop.hdfs.BlockMissingException: Could not obtain block

 


Could you please  browse the namenode in order to notice if this block is missing?

 

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Highlighted
Seven Stars

Re: Exception in component tHDFSOutput_1

image1.PNGimage2.PNG

 

Best regards

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Put Massive Amounts of Data to Work

Learn how to make your data more available, reduce costs and cut your build time

Watch Now

How OTTO Utilizes Big Data to Deliver Personalized Experiences

Read about OTTO's experiences with Big Data and Personalized Experiences

Blog

Talend Integration with Databricks

Take a look at this video about Talend Integration with Databricks

Watch Now