[resolved] Talend Open Studio and Hadoop Sandbox from Hortonworks

One Star

[resolved] Talend Open Studio and Hadoop Sandbox from Hortonworks

Hi
I have downloaded Talend Open studio and installed it on windows 7 64 bit. I have also installed the hadoop sandbox from hortonworks.
Created a Hadoop cluster pointing to Hadoop sandbox successfully, but when i create a job and exceute i get errors. I am able to browse hadoop files from the sanbox into talend open studio
Below is the error message
Starting job Pig_Test at 17:35 15/08/2016.
connecting to socket on port 3663
connected
: org.apache.hadoop.util.Shell - Failed to locate the winutils binary in the hadoop binary path
java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.
at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:367)
at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:382)
at org.apache.hadoop.util.Shell.<clinit>(Shell.java:375)
at org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:79)
at org.apache.hadoop.security.SecurityUtil.getAuthenticationMethod(SecurityUtil.java:639)
at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:272)
at org.apache.hadoop.security.UserGroupInformation.setConfiguration(UserGroupInformation.java:311)
at bd_demo.pig_test_0_1.Pig_Test.tHDFSInput_1Process(Pig_Test.java:551)
at bd_demo.pig_test_0_1.Pig_Test.runJobInTOS(Pig_Test.java:1027)
at bd_demo.pig_test_0_1.Pig_Test.main(Pig_Test.java:884)
: org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Exception in component tHDFSInput_1
java.nio.channels.UnresolvedAddressException
at sun.nio.ch.Net.checkAddress(Net.java:101)
at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:622)
at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:192)
at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:531)
at org.apache.hadoop.hdfs.DFSClient.newConnectedPeer(DFSClient.java:3454)
at org.apache.hadoop.hdfs.BlockReaderFactory.nextTcpPeer(BlockReaderFactory.java:777)
at org.apache.hadoop.hdfs.BlockReaderFactory.getRemoteBlockReaderFromTcp(BlockReaderFactory.java:694)
at org.apache.hadoop.hdfs.BlockReaderFactory.build(BlockReaderFactory.java:355)
at org.apache.hadoop.hdfs.DFSInputStream.blockSeekTo(DFSInputStream.java:618)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:844)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:896)
at java.io.DataInputStream.read(DataInputStream.java:149)
at java.io.FilterInputStream.read(FilterInputStream.java:133)
disconnected
at java.io.PushbackInputStream.read(PushbackInputStream.java:186)
at org.talend.fileprocess.UnicodeReader.<init>(UnicodeReader.java:25)
at org.talend.fileprocess.TOSDelimitedReader.<init>(TOSDelimitedReader.java:77)
at org.talend.fileprocess.FileInputDelimited.<init>(FileInputDelimited.java:93)
at bd_demo.pig_test_0_1.Pig_Test.tHDFSInput_1Process(Pig_Test.java:659)
at bd_demo.pig_test_0_1.Pig_Test.runJobInTOS(Pig_Test.java:1027)
at bd_demo.pig_test_0_1.Pig_Test.main(Pig_Test.java:884)
Job Pig_Test ended at 17:36 15/08/2016.
Moderator

Re: [resolved] Talend Open Studio and Hadoop Sandbox from Hortonworks

Hi,
We see this topic has been marked as resolved. I think you have resolved the issue, feel free to reopen it if you still have any troubles. 
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Five Stars

Re: [resolved] Talend Open Studio and Hadoop Sandbox from Hortonworks

Hi xdshi,
I'm not sure how this is makred as resolved. But I'm still facing the issue.
It would be great if you could help me out with this.
Regards.
Mitul Vyas
Moderator

Re: [resolved] Talend Open Studio and Hadoop Sandbox from Hortonworks

Hi Mitul Vyas,
Could not locate executable null\bin\winutils.exe in the Hadoop binaries.

For this issue, could you please take a look at KB article about:TalendHelpCenter:MapR: “NoClassDefFoundError” error when running a MapReduce job on a MapR cluster u... to see if this resolution is Ok with you?
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.