tHiveRow not working to update Hive table

One Star

tHiveRow not working to update Hive table

Hi,
We have given below query in tHiveRow -
"set hive.support.concurrency=true;
set hive.enforce.bucketing=true ;
set hive.exec.dynamic.partition.mode=nonstrict;
set ive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager;
set hive.compactor.initiator.on=true;
set hive.compactor.worker.threads=10;
update hiveupdate set salary = 75000 where employeeid=10";
Job is not throwing any error but record is not actually updated in DB - where as same is working finer from Hive CLI. Please help.
Regards,
Kiran G.
Moderator

Re: tHiveRow not working to update Hive table

Hi,
What's the hive version you are using? Have you tried to check "Die on error" option in component tHiveRow to see if there is any error message printed on console?
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: tHiveRow not working to update Hive table

Hi,
It is Hive 1.1.0 on Cloudera CDH5.4 YARN.
Yes - Die On Error selected and error message displayed.
Regards,
Kiran G.
Moderator

Re: tHiveRow not working to update Hive table

Hi,
What does the error message look like?
Could you please post the whole error message into forum which will be helpful for us to locate this issue?
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: tHiveRow not working to update Hive table

Hi,
No error message from tHiveRow and job for Update query is successfully completed - but when we go and the Database the record is not actually updated.
Below code is used in tHiveRow:
"set hive.support.concurrency=true;
set hive.enforce.bucketing=true ;
set hive.exec.dynamic.partition.mode=nonstrict;
set ive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager;
set hive.compactor.initiator.on=true;
set hive.compactor.worker.threads=10;
update hiveupdate set salary = 75000 where employeeid=10";
Even we removed ; for set statements and ran - but still no Luck.
Above same code - when copy pasted (with out set parameters too) at Hive CLI - it is working fine.
We have set up all above Set parameters in hive-site.xml and that's how Hive CLI working fine.
Not sure - why talend is unable to do this update transaction. Please help.
Regards,
Kiran G.
Moderator

Re: tHiveRow not working to update Hive table

Hi,
On which build version you got this issue? open source or subscription version?
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: tHiveRow not working to update Hive table

Hi,
It is Open Source (TOS BD 6.1.1).
Regards,
Kiran G.
One Star

Re: tHiveRow not working to update Hive table

You resolve this problem ?
I have also in talend this problem
Bruno
One Star

Re: tHiveRow not working to update Hive table

I haven't seen this problem, but try to split the query in 2 tHiverow.

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Put Massive Amounts of Data to Work

Learn how to make your data more available, reduce costs and cut your build time

Watch Now

How OTTO Utilizes Big Data to Deliver Personalized Experiences

Read about OTTO's experiences with Big Data and Personalized Experiences

Blog

Talend Integration with Databricks

Take a look at this video about Talend Integration with Databricks

Watch Now