Four Stars

Hive SQl not working in Talend Spark Job

Hi, We are facing issue while executing Hive sql using tHIveInput component in talend spark job. Issue: We are successfully execute below hive sql in hue but when we tried to execute the same query in tHiveInput in spark job,job executes successfully but results are not generating. Sample query(working in hue but not in spark job): select * from Table1 A Inner JOIN Table2 B ON A.col1=B.col1 The same sql is working when we use trim function in equating conditions of join tables in talend spark job. Working query(working in hue and talend spark job): select * from Table1 A Inner JOIN Table2 B ON trim(A.col1)=trim(B.col1) In all the cases,we cant use trim for the each joining conditions in complex hive sql. Could you please provide the solution to execute the sql in talend spark job. Thanks, Prasanthi

  • Big Data
3 REPLIES
Moderator

Re: Hive SQl not working in Talend Spark Job

Hi,

On which talend build version you got this issue?

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Four Stars

Re: Hive SQl not working in Talend Spark Job

Hi, We are using Talend Real-time Big Data Platform 6.2.1 version Thanks, Prasanthi B.
Moderator

Re: Hive SQl not working in Talend Spark Job

Hi,

With your subscription solution Talend Real-time Big Data Platform 6.2.1, would you mind creating a case on talend support portal so that we can give you a remote assistance on your issue to see if it is a bug through support cycle with priority?

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.