Where clause causes error in tHiveInput component

Highlighted
Seven Stars

Where clause causes error in tHiveInput component

Hi,

 

I am getting error while using any condition/aggregation in SQL query in tHiveInput component. It is perfectly working when we use query without having any condition.

Is there any parameter or setup required from Talend specific or Hive specific . Please let me know.

 

Talend:   Talend Open studio for Big Data v7.0.1

Hive:       Cloudera CDH5.10

 

 

Working query:

"SELECT
 productCatalogDesc

 FROM ProductCatalog limit 10 "

 

Not Working queries:

"SELECT
 productCatalogDesc

 FROM ProductCatalog where productCatalogDesc is not null limit 10 "

 

"SELECT
 count(1)

 FROM ProductCatalog "

 

Exception in component tHiveInput_3 (adh_connection_test)
java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:284)
at org.apache.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:380)
at mec_sfdc_integration.adh_connection_test_0_1.adh_connection_test.tHiveInput_3Process(adh_connection_test.java:1902)
at mec_sfdc_integration.adh_connection_test_0_1.adh_connection_test.tHiveInput_1Process(adh_connection_test.java:1478)
at mec_sfdc_integration.adh_connection_test_0_1.adh_connection_test.tHiveConnection_2Process(adh_connection_test.java:815)
at mec_sfdc_integration.adh_connection_test_0_1.adh_connection_test.tHiveConnection_1Process(adh_connection_test.java:570)
at mec_sfdc_integration.adh_connection_test_0_1.adh_connection_test.runJobInTOS(adh_connection_test.java:2344)
at mec_sfdc_integration.adh_connection_test_0_1.adh_connection_test.main(adh_connection_test.java:2193)
[statistics] disconnected


Accepted Solutions
Seven Stars

Re: Where clause causes error in tHiveInput component

Hi All,

 

The issue got resolved and it was due to the permission for hadoop user. Actually the user which I am using didn't have permission for conditional/join query, so hadoop admin team resolved this issue.

@xdshi @akumar2301 Thanks for your time to respond my query.

 

Regards,

Vibin CT.

View solution in original post


All Replies
Eleven Stars

Re: Where clause causes error in tHiveInput component

Seven Stars

Re: Where clause causes error in tHiveInput component

Hi @akumar2301 ,

 

Error showing from the URL and my error has slight difference, anyway I used the same config as jdbc parameter, still no luck yet.

 

My error:            Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask

Error from URL: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask

 

Capture.JPG

Moderator

Re: Where clause causes error in tHiveInput component

Hello,

Could you please run the same query on the Hive Query Editor successfully?

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Seven Stars

Re: Where clause causes error in tHiveInput component

Hi @xdshi ,

 

I am connecting hive remotely and don't have Hue Terminal access to run the query. Is there any way to run this query (apart from Talend and Hue terminal) in windows?

Seven Stars

Re: Where clause causes error in tHiveInput component

Hi All,

 

The issue got resolved and it was due to the permission for hadoop user. Actually the user which I am using didn't have permission for conditional/join query, so hadoop admin team resolved this issue.

@xdshi @akumar2301 Thanks for your time to respond my query.

 

Regards,

Vibin CT.

View solution in original post

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Talend Cloud Developer Series - Introduction

The Talend Cloud Developer Series was created to give you a solid foundational understanding of Talend’s Cloud Integration Platform

Watch Now

Talend Cloud Available on Microsoft Azure

An integration platform-as-a-serviceto help enterprises collect, govern, transform, and share data from any data sources

Watch Now

Self-service Talend Migration: Moving from On-Premises to the Cloud

Move from On-Premises to the Cloud by following the advice of experts

Read Now