Hive , Impala HDFS , connection stopped working. GSS initiate failed

Highlighted
Five Stars

Hive , Impala HDFS , connection stopped working. GSS initiate failed

Hello Everyone, 

Could you please help us out and let us know if you had similar issue ? 

Our hive impala and hdfs connection not working anymore and giving us kerberos issue. We tried connecting to HIVE using beeline in command prompt and it works just fine . 

Here is the error from hive connection  (server name/domain is masked as "server" )  : 
Thank you in advanced !!! 

[statistics] connecting to socket on port 3534
[statistics] connected

[FATAL]: dev_local.date_parse_test_0_1.date_parse_test - tHiveConnection_1 Could not open client transport with JDBC Uri: jdbc:hive2://server.net:10000/default;principal=hive/_HOST@server.NET: GSS initiate failed
java.sql.SQLException: Could not open client transport with JDBC Uri: jdbc:hive2://server.net:10000/default;principal=hive/_HOST@server.NET: GSS initiate failed
at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:230)
at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:167)
at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105)
at java.sql.DriverManager.getConnection(DriverManager.java:664)
at java.sql.DriverManager.getConnection(DriverManager.java:270)
at dev_local.date_parse_test_0_1.date_parse_test.tHiveConnection_1Process(date_parse_test.java:416)
at dev_local.date_parse_test_0_1.date_parse_test.runJobInTOS(date_parse_test.java:784)
at dev_local.date_parse_test_0_1.date_parse_test.main(date_parse_test.java:615)
Caused by: org.apache.thrift.transport.TTransportException: GSS initiate failed
at org.apache.thrift.transport.TSaslTransport.sendAndThrowMessage(TSaslTransport.java:232)
at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:316)
at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:52)
at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:49)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1920)
at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport.open(TUGIAssumingTransport.java:49)
at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:202)
... 7 more
[statistics] disconnected
Exception in component tHiveConnection_1 (date_parse_test)
java.sql.SQLException: Could not open client transport with JDBC Uri: jdbc:hive2://server.net:10000/default;principal=hive/_HOST@server.NET: GSS initiate failed
at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:230)
at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:167)
at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105)
at java.sql.DriverManager.getConnection(DriverManager.java:664)
at java.sql.DriverManager.getConnection(DriverManager.java:270)
at dev_local.date_parse_test_0_1.date_parse_test.tHiveConnection_1Process(date_parse_test.java:416)
at dev_local.date_parse_test_0_1.date_parse_test.runJobInTOS(date_parse_test.java:784)
at dev_local.date_parse_test_0_1.date_parse_test.main(date_parse_test.java:615)
Caused by: org.apache.thrift.transport.TTransportException: GSS initiate failed
at org.apache.thrift.transport.TSaslTransport.sendAndThrowMessage(TSaslTransport.java:232)
at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:316)
at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:52)
at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:49)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1920)
at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport.open(TUGIAssumingTransport.java:49)
at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:202)
... 7 more
Job date_parse_test ended at 14:36 16/04/2018. [exit code=1]

Tigran N ,
Data Engineer

Accepted Solutions
Five Stars

Re: Hive , Impala HDFS , connection stopped working. GSS initiate failed

Thank you ,  we found solution we had misconfiguration on the cluster. 

Tigran N ,
Data Engineer

All Replies
Moderator

Re: Hive , Impala HDFS , connection stopped working. GSS initiate failed

Hello,

Could you please let us know if this solution in https://community.talend.com/t5/Migration-Configuration-and/Hive-Connection-to-Kerberized-cluster/ta... works for you?

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Five Stars

Re: Hive , Impala HDFS , connection stopped working. GSS initiate failed

Thank you ,  we found solution we had misconfiguration on the cluster. 

Tigran N ,
Data Engineer

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

How OTTO Utilizes Big Data to Deliver Personalized Experiences

Read about OTTO's experiences with Big Data and Personalized Experiences

Blog

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

Talend Integration with Databricks

Take a look at this video about Talend Integration with Databricks

Watch Now