Error while trying to connect Hive using thiveconnection component

Four Stars

Error while trying to connect Hive using thiveconnection component

Hi,

 

Can anyone help me in trying to fix the below issue.

I have created a job to connect hive server and fetch a hive table

thiveConnection->thiveInput->tmap(performing data validation chk)->:tlogrow

While compiling itself im facing issue in thive connection.

There is no error msg displayed in run prompt

when i open the code , i could see

"url_thiveConnection_2 cannot be resolved to a variable"

 

Can anyone plz help me as i am new to talend.

 

thanks,

Aarthi T

Moderator

Re: Error while trying to connect Hive using thiveconnection component

Hello,

Is there any double quote missing around your connection parameter? Screenshots of your job setting will be helpful for us to address your issue quickly.

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Four Stars

Re: Error while trying to connect Hive using thiveconnection component

Hi Sabrina,

 

Please find the screenshot of hiveconnection component.As I am new to Big Data and hive, i am not able to figure it out where the exact problem is. The error which i have mentioned in the below mail chain raised when i kept the connection mode as "Embedded"  

 

When i changed the connection mode to "Standard" , i got different error.

Please find below,

[statistics] connecting to socket on port 3363
[statistics] connected
[ERROR]: org.apache.hadoop.util.Shell - Failed to locate the winutils binary in the hadoop binary path
java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.
at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:379)
at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:394)
at org.apache.hadoop.util.Shell.<clinit>(Shell.java:387)
at org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:80)
at org.apache.hadoop.security.SecurityUtil.getAuthenticationMethod(SecurityUtil.java:611)
at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:273)
at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:261)
at org.apache.hadoop.security.UserGroupInformation.isAuthenticationMethodEnabled(UserGroupInformation.java:338)
at org.apache.hadoop.security.UserGroupInformation.isSecurityEnabled(UserGroupInformation.java:332)
at local_project.job_hdfs_to_hive_0_1.job_hdfs_to_hive.tHiveConnection_1Process(job_hdfs_to_hive.java:602)
at local_project.job_hdfs_to_hive_0_1.job_hdfs_to_hive.runJobInTOS(job_hdfs_to_hive.java:2876)
at local_project.job_hdfs_to_hive_0_1.job_hdfs_to_hive.main(job_hdfs_to_hive.java:2707)
[WARN ]: org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Exception in component tHiveConnection_1 (job_hdfs_to_hive)
java.sql.SQLException: Could not open client transport with JDBC Uri: jdbc:hive2://ip-10-0-4-221.bayerpoc.com:10002/CYRUS;: java.net.UnknownHostException: ip-10-0-4-221.bayerpoc.com
at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:224)
at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:107)
at java.sql.DriverManager.getConnection(Unknown Source)
at java.sql.DriverManager.getConnection(Unknown Source)
at local_project.job_hdfs_to_hive_0_1.job_hdfs_to_hive.tHiveConnection_1Process(job_hdfs_to_hive.java:656)
at local_project.job_hdfs_to_hive_0_1.job_hdfs_to_hive.runJobInTOS(job_hdfs_to_hive.java:2876)
at local_project.job_hdfs_to_hive_0_1.job_hdfs_to_hive.main(job_hdfs_to_hive.java:2707)
Caused by: org.apache.thrift.transport.TTransportException: java.net.UnknownHostException: ip-10-0-4-221.bayerpoc.com
at org.apache.thrift.transport.TSocket.open(TSocket.java:226)
at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:266)
at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:311)
at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:196)
... 6 more
Caused by: java.net.UnknownHostException: ip-10-0-4-221.bayerpoc.com
at java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.net.PlainSocketImpl.connect(Unknown Source)
at java.net.SocksSocketImpl.connect(Unknown Source)
at java.net.Socket.connect(Unknown Source)
at org.apache.thrift.transport.TSocket.open(TSocket.java:221)
... 10 more
[WARN ]: org.apache.hive.jdbc.HiveConnection - Failed to connect to ip-10-0-4-221.bayerpoc.com:10002
[statistics] disconnected

 

Suggest which connection mode i need to set.

 

Thanks,

Aarthi 

 

 

Thirteen Stars

Re: Error while trying to connect Hive using thiveconnection component