Dynamic Partition for Hive with TOS

Five Stars

Dynamic Partition for Hive with TOS

Hello Experts,


As per the requirement i have to load the data in Hive partition table, Talend works fine static partition and however I'm facing issue for Dynamic partition.


For EX:

I Created a table with 5 columns like id, name , occupation,zip code and gender(Partition column) , while loading the data if i use gender = 'M' or 'F' in tHiveLoad / thiverow component its working fine, if i'm not passing any value to gender column then i'm getting the error.


I am getting the below error, to resolve this i tried with  "hive.exec.dynamic.partition.mode=nonstrict" and "hive.exec.dynamic.partition = true" , but no luck


However i'm able to achieve Dynamic partitioning in Hive scripting with out passing any value to partition column, but not in Talend


Error while compiling statement: FAILED: SemanticException [Error 10096]: Dynamic partition strict mode requires at least one static partition column. To turn this off set hive.exec.dynamic.partition.mode=nonstrict


Your help is highly appreciate!!






Five Stars

Re: Dynamic Partition for Hive with TOS

Hello Talend Folks,


Can anyone please help me on this Dynamic partition?





Re: Dynamic Partition for Hive with TOS


On which build version you got this issue?

Have you tried to put

hiveContext.setConf("hive.exec.dynamic.partition", "true")
hiveContext.setConf("hive.exec.dynamic.partition.mode", "nonstrict")?

Best regards


Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.