Four Stars

Hive , Impala HDFS , connection stopped working. GSS initiate failed

Hello Everyone, 

Could you please help us out and let us know if you had similar issue ? 

Our hive impala and hdfs connection not working anymore and giving us kerberos issue. We tried connecting to HIVE using beeline in command prompt and it works just fine . 

Here is the error from hive connection  (server name/domain is masked as "server" )  : 
Thank you in advanced !!! 

[statistics] connecting to socket on port 3534
[statistics] connected

[FATAL]: dev_local.date_parse_test_0_1.date_parse_test - tHiveConnection_1 Could not open client transport with JDBC Uri: jdbc:hive2://server.net:10000/default;principal=hive/_HOST@server.NET: GSS initiate failed
java.sql.SQLException: Could not open client transport with JDBC Uri: jdbc:hive2://server.net:10000/default;principal=hive/_HOST@server.NET: GSS initiate failed
at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:230)
at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:167)
at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105)
at java.sql.DriverManager.getConnection(DriverManager.java:664)
at java.sql.DriverManager.getConnection(DriverManager.java:270)
at dev_local.date_parse_test_0_1.date_parse_test.tHiveConnection_1Process(date_parse_test.java:416)
at dev_local.date_parse_test_0_1.date_parse_test.runJobInTOS(date_parse_test.java:784)
at dev_local.date_parse_test_0_1.date_parse_test.main(date_parse_test.java:615)
Caused by: org.apache.thrift.transport.TTransportException: GSS initiate failed
at org.apache.thrift.transport.TSaslTransport.sendAndThrowMessage(TSaslTransport.java:232)
at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:316)
at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:52)
at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:49)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1920)
at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport.open(TUGIAssumingTransport.java:49)
at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:202)
... 7 more
[statistics] disconnected
Exception in component tHiveConnection_1 (date_parse_test)
java.sql.SQLException: Could not open client transport with JDBC Uri: jdbc:hive2://server.net:10000/default;principal=hive/_HOST@server.NET: GSS initiate failed
at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:230)
at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:167)
at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105)
at java.sql.DriverManager.getConnection(DriverManager.java:664)
at java.sql.DriverManager.getConnection(DriverManager.java:270)
at dev_local.date_parse_test_0_1.date_parse_test.tHiveConnection_1Process(date_parse_test.java:416)
at dev_local.date_parse_test_0_1.date_parse_test.runJobInTOS(date_parse_test.java:784)
at dev_local.date_parse_test_0_1.date_parse_test.main(date_parse_test.java:615)
Caused by: org.apache.thrift.transport.TTransportException: GSS initiate failed
at org.apache.thrift.transport.TSaslTransport.sendAndThrowMessage(TSaslTransport.java:232)
at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:316)
at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:52)
at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:49)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1920)
at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport.open(TUGIAssumingTransport.java:49)
at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:202)
... 7 more
Job date_parse_test ended at 14:36 16/04/2018. [exit code=1]

Tigran N ,
Data Engineer
1 ACCEPTED SOLUTION

Accepted Solutions
Four Stars

Re: Hive , Impala HDFS , connection stopped working. GSS initiate failed

Thank you ,  we found solution we had misconfiguration on the cluster. 

Tigran N ,
Data Engineer
2 REPLIES
Moderator

Re: Hive , Impala HDFS , connection stopped working. GSS initiate failed

Hello,

Could you please let us know if this solution in https://community.talend.com/t5/Migration-Configuration-and/Hive-Connection-to-Kerberized-cluster/ta... works for you?

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Four Stars

Re: Hive , Impala HDFS , connection stopped working. GSS initiate failed

Thank you ,  we found solution we had misconfiguration on the cluster. 

Tigran N ,
Data Engineer