Exception in component tHDFSOutput_1

Seven Stars

Exception in component tHDFSOutput_1

Hi,

I got this error : could only be replicated to 0 nodes instead of minReplication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.

errer.PNG

Is there anyone who can explain to me what does mean this error and what is the solution !

 

Thanks in advance.

Moderator

Re: Exception in component tHDFSOutput_1

Hi,

Could you please take a look at this topic:https://stackoverflow.com/questions/15571584/writing-to-hdfs-could-only-be-replicated-to-0-nodes-ins...?

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Seven Stars

Re: Exception in component tHDFSOutput_1

My problem is not resolved and in addition I try a simple example: import a file on HDFS and use the component tHdfsInput to read the file but I get an error as in the attached link :

https://www.talendforge.org/forum/viewtopic.php?id=46459 

 

Moderator

Re: Exception in component tHDFSOutput_1

Hello,

Is your hadoop cluster connection OK with you? Are you able to connect toyour  host in the command line of windows by using ping?

Best regards

Sabrina

 

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Seven Stars

Re: Exception in component tHDFSOutput_1

Yes the connection is well established and I add the address of the sandbox machine in the file etc\host.

 

e1.PNGe2.PNG

Highlighted
Moderator

Re: Exception in component tHDFSOutput_1

Hi,

Could you please indicate on which talend build version you got this issue?

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Seven Stars

Re: Exception in component tHDFSOutput_1

Last version of talend open studio for big Data (talend_6.4.1)

 

Best regards.

Moderator

Re: Exception in component tHDFSOutput_1

Hi,


@INESBK wrote:

My problem is not resolved and in addition I try a simple example: import a file on HDFS and use the component tHdfsInput to read the file but I get an error as in the attached link :

https://www.talendforge.org/forum/viewtopic.php?id=46459 

 

Exception in component tHDFSInput_1
org.apache.hadoop.hdfs.BlockMissingException: Could not obtain block

 


Could you please  browse the namenode in order to notice if this block is missing?

 

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Seven Stars

Re: Exception in component tHDFSOutput_1

image1.PNGimage2.PNG

 

Best regards

What’s New for Talend Spring ’19

Join us live for a sneak peek!

Sign up now

Agile Data lakes & Analytics

Accelerate your data lake projects with an agile approach

Watch

Definitive Guide to Data Quality

Create systems and workflow to manage clean data ingestion and data transformation.

Download

Tutorial

Introduction to Talend Open Studio for Data Integration.

Watch