One Star tt1
One Star

IPC Version mismatch - Hortonworks Hadoop2 & Talend 5.4.0

I am using the latest Hortonworks Hadoop2 and Talend 5.4. I receive the following error when using tHDFSPut

Any thoughts appreciated.



Oct 28, 2013 1:21:27 PM org.apache.hadoop.security.UserGroupInformation doAs
SEVERE: PriviledgedActionException as:root causeSmiley Surprisedrg.apache.hadoop.ipc.RemoteException: Server IPC version 9 cannot communicate with client version 4
Exception in component tHDFSPut_1
org.apache.hadoop.ipc.RemoteException: Server IPC version 9 cannot communicate with client version 4
at org.apache.hadoop.ipc.Client.call(Client.java:1066)
at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225)
at $Proxy1.getProtocolVersion(Unknown Source)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:396)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:379)
at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:119)
at org.apache.hadoop.hdfs.DFSClient.(DFSClient.java:238)
at org.apache.hadoop.hdfs.DFSClient.(DFSClient.java:203)
at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:89)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1386)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
disconnected
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1404)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254)
at org.apache.hadoop.fs.FileSystem$1.run(FileSystem.java:117)
at org.apache.hadoop.fs.FileSystem$1.run(FileSystem.java:115)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Unknown Source)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1083)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:115)
at s3_test.hdfs_put_0_1.hdfs_put.tHDFSPut_1Process(hdfs_put.java:282)
at s3_test.hdfs_put_0_1.hdfs_put.runJobInTOS(hdfs_put.java:626)
at s3_test.hdfs_put_0_1.hdfs_put.main(hdfs_put.java:491)

21 REPLIES
Employee

Re: IPC Version mismatch - Hortonworks Hadoop2 & Talend 5.4.0

Hello TT1,
You job only contains a tHDFSPut or another components? Which version of Talend do you use (5.4.0 GA or a release candidate) ?
Thanks,
Rémy.
One Star tt1
One Star

Re: IPC Version mismatch - Hortonworks Hadoop2 & Talend 5.4.0

Thanks for answering guys.

The job contains one component tHDFSPut. I am using 5.4.0 RC1_r108625.
Employee

Re: IPC Version mismatch - Hortonworks Hadoop2 & Talend 5.4.0

OK.
And I guess you are using HDP 2.0 GA.
Actually, the dependencies used in our RC1 was the HDP 2.0 Beta libraries, since the GA was not released yet.
Between HDP 2.0 Beta and HDP 2.0 GA, Hortonworks has made a major upgrade of the hadoop projects. That means there is a mismatch between our jars in the RC1 and their HDP 2.0 GA.
Nevertheless, you can use the 5.4.0 GA, released yesterday, in order to work with HDP 2.0 GA. We have lately upgraded the jars in our GA version.
HTH,
Rémy.
One Star tt1
One Star

Re: IPC Version mismatch - Hortonworks Hadoop2 & Talend 5.4.0

Remy, thanks.

I have just taken down version 5.4.0.r110020.

i have the same problem still.

Starting job tHDFSPut at 14:42 29/10/2013.


connecting to socket on port 3539
connected
Exception in component tHDFSPut_1
org.apache.hadoop.ipc.RemoteException: Server IPC version 9 cannot communicate with client version 4
at org.apache.hadoop.ipc.Client.call(Client.java:1066)
at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225)
at $Proxy1.getProtocolVersion(Unknown Source)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:396)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:379)
at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:119)
at org.apache.hadoop.hdfs.DFSClient.(DFSClient.java:238)
at org.apache.hadoop.hdfs.DFSClient.(DFSClient.java:203)
at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:89)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1386)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1404)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254)
at org.apache.hadoop.fs.FileSystem$1.run(FileSystem.java:117)
: org.apache.hadoop.security.UserGroupInformation - PriviledgedActionException as:root causeSmiley Surprisedrg.apache.hadoop.ipc.RemoteException: Server IPC version 9 cannot communicate with client version 4
disconnected
at org.apache.hadoop.fs.FileSystem$1.run(FileSystem.java:115)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Unknown Source)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1083)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:115)
at test.thdfsput_0_1.tHDFSPut.tHDFSPut_1Process(tHDFSPut.java:292)
at test.thdfsput_0_1.tHDFSPut.runJobInTOS(tHDFSPut.java:639)
at test.thdfsput_0_1.tHDFSPut.main(tHDFSPut.java:504)
Job tHDFSPut ended at 14:42 29/10/2013.
Employee

Re: IPC Version mismatch - Hortonworks Hadoop2 & Talend 5.4.0

Hello,
I have tried but I can't reproduce. I just reproduce when I select the wrong hadoop version in the drop down list. Please be sure to select Hortonworks Data Platform v2.0.0(BigWheel).
Cheers,
One Star tt1
One Star

Re: IPC Version mismatch - Hortonworks Hadoop2 & Talend 5.4.0

Remy,

You are right, the drop down list does contain v2.0.

Fantastic, I no longer have the error ( I have a different error now, but that's another story I imagine).

Many thanks.
Employee

Re: IPC Version mismatch - Hortonworks Hadoop2 & Talend 5.4.0

Hi,
Maybe you have an error telling you that the binary winutils is not found. (Depends on the OS you are running your studio on).
There is a known issue on Hortonworks 2.0 side. If your client is on windows, then you have to install your hadoop cluster on Windows. If your client is on Linux, then your cluster must be installed on Linux.
If you are running your studio on windows and you cluster on linux, you won't have problem for HDFS but you will meet some for Pig, Hive, Sqoop.
One Star tt1
One Star

Re: IPC Version mismatch - Hortonworks Hadoop2 & Talend 5.4.0

Remy, now you are predicting my problems before i tell you what they are .. I'm impressed!

You are right, the problem does menation winutils, and yes the cluster is on Linux with the studio on Windows. I will chase this up with Hortonworks.
Employee

Re: IPC Version mismatch - Hortonworks Hadoop2 & Talend 5.4.0

Hi,
Hortonworks is aware of this problem and they are working to fix that in the next release of HDP.
Cheers,
Rémy.
One Star tt1
One Star

Re: IPC Version mismatch - Hortonworks Hadoop2 & Talend 5.4.0

Hortonworks have suggested there is not a problem, and that Talend are using out of date libraries. I have forwarded the details to my Talend contacts, but if you are able to follow up at that end I would be grateful.
Employee

Re: IPC Version mismatch - Hortonworks Hadoop2 & Talend 5.4.0

The error you are talking about has been fixed in the 5.4.0 GA.
One Star

Re: IPC Version mismatch - Hortonworks Hadoop2 & Talend 5.4.0

Hello all,
I am using Hortonworks Sandbox 2.0 (hadoop 2.2.0 installed in it) and the
Talend Open Studio for Big Data
Version: 5.4.1
Build id: r111943-20131212-1141 using in Windows 7 32 bit machine.
As per the previous answer, that the Winutils issue ( Failed to locate the winutils binary in the hadoop binary path) had been fixed in the release 5.4.0 GA . But I still facing the issue.. U have only one tHDFSPut_1 component . Nothing else. Guide me through this.
Full Stack trace is down below:

: org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
: org.apache.hadoop.util.Shell - Failed to locate the winutils binary in the hadoop binary path
java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.
at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:278)
at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:300)
at org.apache.hadoop.util.Shell.(Shell.java:293)
at org.apache.hadoop.util.StringUtils.(StringUtils.java:76)
at org.apache.hadoop.conf.Configuration.getTrimmedStrings(Configuration.java:1546)
at org.apache.hadoop.hdfs.DFSClient.(DFSClient.java:519)
at org.apache.hadoop.hdfs.DFSClient.(DFSClient.java:453)
at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:136)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2433)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:88)
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2467)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2449)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:367)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:166)
at hadoopdemo.hadoopfileload_0_1.HadoopFileLoad.tHDFSPut_1Process(HadoopFileLoad.java:310)
at hadoopdemo.hadoopfileload_0_1.HadoopFileLoad.runJobInTOS(HadoopFileLoad.java:672)
at hadoopdemo.hadoopfileload_0_1.HadoopFileLoad.main(HadoopFileLoad.java:537)
disconnected

Thanks in advance,
Cheers,
-AP.
One Star tt1
One Star

Re: IPC Version mismatch - Hortonworks Hadoop2 & Talend 5.4.0

Hi,

If it helps, my issues arise from a compatibility issue between Open Studio on a Windows machine, and Hortonworks Hadoop running on a Linux cluster. The only solution for me is to use a Linux version of Open Studio running in a VM tool, which I am reluctant to do.

Talend are working on a solution now I believe.

Frustratingly the problem does not exist in the Enterprise version.

Regards.
Employee

Re: IPC Version mismatch - Hortonworks Hadoop2 & Talend 5.4.0

Hi,
The ERROR you can see above is an ERROR coming from the HDP libraries but you anway should find your file on HDFS. It shoudn't block you.
The Apache community will work on a solution for this issue: https://issues.apache.org/jira/browse/YARN-1298
One Star

Re: IPC Version mismatch - Hortonworks Hadoop2 & Talend 5.4.0

Yes I'm getting this problem also.
One Star

Re: IPC Version mismatch - Hortonworks Hadoop2 & Talend 5.4.0

I'm also getting the same problem;
One Star

Re: IPC Version mismatch - Hortonworks Hadoop2 & Talend 5.4.0

Hi! I'm getting the same problem... does anyone fixed it? Thanks in advance!
One Star

Re: IPC Version mismatch - Hortonworks Hadoop2 & Talend 5.4.0

And I am also getting this error, but in my case the issue is expected - I was trying to use the latest Talend (5.4.1) against Cloudera 5.x. There is no 5.x version in the Hadoop version dropdown. This is quite unfortunate as we decided to use this version and I was evaluating Talend to see if it can be used in our environment.
One Star

Re: IPC Version mismatch - Hortonworks Hadoop2 & Talend 5.4.0

Hi All
Same issue on WIN7, x64, Talend Open Studio 5.6.0 with Sandbox Hortonworks 2.1
Please let me know how to proceed woth running Hadoop samples.
Thanks
Vibhor
One Star

Re: IPC Version mismatch - Hortonworks Hadoop2 & Talend 5.4.0

Hi All
This was fixed by changing the HDFS data connection to 2.0.0 (BigWheel)
One Star

Re: IPC Version mismatch - Hortonworks Hadoop2 & Talend 5.4.0

Hi ,
I am getting below error while conneciting to HDFS of apache hadoop 2 from talend open studio for big data6.1.1(windows).
Please help.
Starting job hdfs_integration at 13:36 03/02/2016.
connecting to socket on port 3797
connected
Exception in component tHDFSPut_2
org.apache.hadoop.ipc.RemoteException: Server IPC version 9 cannot communicate with client version 4
at org.apache.hadoop.ipc.Client.call(Client.java:1113)
at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:229)
at com.sun.proxy.$Proxy1.getProtocolVersion(Unknown Source)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:85)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:62)
at com.sun.proxy.$Proxy1.getProtocolVersion(Unknown Source)
at org.apache.hadoop.ipc.RPC.checkVersion(RPC.java:422)
at org.apache.hadoop.hdfs.DFSClient.createNamenode(DFSClient.java:183)
at org.apache.hadoop.hdfs.DFSClient.(DFSClient.java:281)
at org.apache.hadoop.hdfs.DFSClient.(DFSClient.java:245)
: org.apache.hadoop.security.UserGroupInformation - PriviledgedActionException as:root causeSmiley Surprisedrg.apache.hadoop.ipc.RemoteException: Server IPC version 9 cannot communicate with client version 4
at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:100)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1446)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:67)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1464)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:263)
at org.apache.hadoop.fs.FileSystem$1.run(FileSystem.java:118)
at org.apache.hadoop.fs.FileSystem$1.run(FileSystem.java:116)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Unknown Source)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:116)
at local_project.hdfs_integration_0_1.hdfs_integration.tHDFSPut_2Process(hdfs_integration.java:443)
at local_project.hdfs_integration_0_1.hdfs_integration.tHDFSConnection_1Process(hdfs_integration.java:363)
at local_project.hdfs_integration_0_1.hdfs_integration.runJobInTOS(hdfs_integration.java:814)
at local_project.hdfs_integration_0_1.hdfs_integration.main(hdfs_integration.java:671)
disconnected
Job hdfs_integration ended at 13:36 03/02/2016.