One Star

Run impala "invalidate metadat" command using talend open studio

Hi ,
I am using TOS bigdata 5.6.
I want to write Imapala query from talend studio.
Now the problem is, I have updated the data in Hive metastore. So for Impala to anticipate the changes we need to run "INVALIDATE MATADATA".
Now my question is, "How can i run this command from Talend open studio" ?
3 REPLIES
Moderator

Re: Run impala "invalidate metadat" command using talend open studio

Hi,
So for Impala to anticipate the changes we need to run "INVALIDATE MATADATA".


Do you want DB connection for  Impala in "metadata" or you are looking for tImpala component in Talend Open Studio for bigdata?
Please take a look at: https://jira.talendforge.org/browse/TBD-928

Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: Run impala "invalidate metadat" command using talend open studio

Hi,

I am running queries on data from impala. Now, Impala refers to Hive metastore for data. Now if the metastore data changes, Impala daemons should also be updated with that change. For that we need to run "invalidate metadata" command from impala shell.
Is there any way we can run this command from Talend using any component ?

Thanks,
Tapan
One Star

Re: Run impala "invalidate metadat" command using talend open studio

Likely already figured out but adding this because I'll likely be searching for this the next time I forget...

tImpalaRow --- (On Component OK) --> tImpalaInput


In the tImpalaRow simply run "INVALIDATE METADATA" and all will be well. Be sure to NOT include the semi-colon at the end of the statement or you will get all sorts of odd errors.