Talend Connect
Virtual Summit
JOIN US!
And visit the Customer
& Community Lounge.
May 27-28, wherever you are.

Hive , Impala HDFS , connection stopped working. GSS initiate failed

Highlighted
Five Stars

Hive , Impala HDFS , connection stopped working. GSS initiate failed

Hello Everyone, 

Could you please help us out and let us know if you had similar issue ? 

Our hive impala and hdfs connection not working anymore and giving us kerberos issue. We tried connecting to HIVE using beeline in command prompt and it works just fine . 

Here is the error from hive connection  (server name/domain is masked as "server" )  : 
Thank you in advanced !!! 

[statistics] connecting to socket on port 3534
[statistics] connected

[FATAL]: dev_local.date_parse_test_0_1.date_parse_test - tHiveConnection_1 Could not open client transport with JDBC Uri: jdbc:hive2://server.net:10000/default;principal=hive/_HOST@server.NET: GSS initiate failed
java.sql.SQLException: Could not open client transport with JDBC Uri: jdbc:hive2://server.net:10000/default;principal=hive/_HOST@server.NET: GSS initiate failed
at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:230)
at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:167)
at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105)
at java.sql.DriverManager.getConnection(DriverManager.java:664)
at java.sql.DriverManager.getConnection(DriverManager.java:270)
at dev_local.date_parse_test_0_1.date_parse_test.tHiveConnection_1Process(date_parse_test.java:416)
at dev_local.date_parse_test_0_1.date_parse_test.runJobInTOS(date_parse_test.java:784)
at dev_local.date_parse_test_0_1.date_parse_test.main(date_parse_test.java:615)
Caused by: org.apache.thrift.transport.TTransportException: GSS initiate failed
at org.apache.thrift.transport.TSaslTransport.sendAndThrowMessage(TSaslTransport.java:232)
at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:316)
at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:52)
at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:49)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1920)
at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport.open(TUGIAssumingTransport.java:49)
at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:202)
... 7 more
[statistics] disconnected
Exception in component tHiveConnection_1 (date_parse_test)
java.sql.SQLException: Could not open client transport with JDBC Uri: jdbc:hive2://server.net:10000/default;principal=hive/_HOST@server.NET: GSS initiate failed
at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:230)
at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:167)
at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105)
at java.sql.DriverManager.getConnection(DriverManager.java:664)
at java.sql.DriverManager.getConnection(DriverManager.java:270)
at dev_local.date_parse_test_0_1.date_parse_test.tHiveConnection_1Process(date_parse_test.java:416)
at dev_local.date_parse_test_0_1.date_parse_test.runJobInTOS(date_parse_test.java:784)
at dev_local.date_parse_test_0_1.date_parse_test.main(date_parse_test.java:615)
Caused by: org.apache.thrift.transport.TTransportException: GSS initiate failed
at org.apache.thrift.transport.TSaslTransport.sendAndThrowMessage(TSaslTransport.java:232)
at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:316)
at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:52)
at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:49)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1920)
at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport.open(TUGIAssumingTransport.java:49)
at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:202)
... 7 more
Job date_parse_test ended at 14:36 16/04/2018. [exit code=1]

Tigran N ,
Data Engineer

Accepted Solutions
Highlighted
Five Stars

Re: Hive , Impala HDFS , connection stopped working. GSS initiate failed

Thank you ,  we found solution we had misconfiguration on the cluster. 

Tigran N ,
Data Engineer

View solution in original post


All Replies
Highlighted
Moderator

Re: Hive , Impala HDFS , connection stopped working. GSS initiate failed

Hello,

Could you please let us know if this solution in https://community.talend.com/t5/Migration-Configuration-and/Hive-Connection-to-Kerberized-cluster/ta... works for you?

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Highlighted
Five Stars

Re: Hive , Impala HDFS , connection stopped working. GSS initiate failed

Thank you ,  we found solution we had misconfiguration on the cluster. 

Tigran N ,
Data Engineer

View solution in original post

2019 GARTNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog

Put Massive Amounts of Data to Work

Learn how to make your data more available, reduce costs and cut your build time

Watch Now