We are in the process of migrating from hdfs/hive to GCS/Bigquery infrastructer and using Talend v6.3 bigdata edition for ETL logic.Most of the hive tables are being partitioned and while loading we are using 'INSERT OVERWRITE' syntax in hiverow component while inserting data into a perticular partion.
Now we need to replace hive with bigquery table with same metadata and partition details.I dont see option INSERTOverwrite in Bigquery!
Could someone help me on how do i implement similar 'InsertOverwrite Logiv' in Bigquery which is currently we are doing in Hive?
Thanks in advance and much appreciated any suggestion.
no features in Talend component for this, but as a variant, you could use command line client for this:
Watch the recorded webinar!
Introduction to Talend Open Studio for Data Integration.
Test drive Talend's enterprise products.
Practical steps to developing your data integration strategy.