I need help.
I would like make a simple job, for checked my configuration.
I have a sandbox Hortonworks 2.6.1 and TOS Big Data 6.4.1.
My job is a tHdfs that send information into a tLogRow.
I have declare, in Metadata, a hadoop connection cluster and i have check it, all is ok.
I declare an HDFS connection and I check it also, this copnnection is successful.
When I start my job, I have 3 warnings an some errors, like :
- Connection timed out: no further information
- Exception in component tHDFSInput_2 (OnBoard_hdfs)
org.apache.hadoop.hdfs.BlockMissingException: Could not obtain block
Have you an idea ?
Behind I put all log :
It looks like connectivity issue. Is it Ok when you change to a different id?
Do you have permission issue on the cluster? Please check if the user you are using in talend is able to write/ read data into hdfs.
I try to use my work with the user "admin", and another user like raj_ops. For these two users, I have exactly the same problem. In the screenshot, I highlighted the file (books.csv), in red, that I use for my work. Look at the permissions for this file.
To check the permissions of the 2 users, I put a file in the system hdfs, with mastic, and it works well without error / warning message (highlighted in blue).
Do you have any other proposal ?
Could you please show us the full stack trace?
Have you tried to browse the namenode in order to notice if this block is missing?
Talend named a Leader.
Kickstart your first data integration and ETL projects.
Watch the recorded webinar!
Learn how to make your data more available, reduce costs and cut your build time
Read about OTTO's experiences with Big Data and Personalized Experiences
Take a look at this video about Talend Integration with Databricks