We are in the process of migrating from hdfs/hive to GCS/Bigquery infrastructer and using Talend v6.3 bigdata edition for ETL logic.Most of the hive tables are being partitioned and while loading we are using 'INSERT OVERWRITE' syntax in hiverow component while inserting data into a perticular partion.
Now we need to replace hive with bigquery table with same metadata and partition details.I dont see option INSERTOverwrite in Bigquery!
Could someone help me on how do i implement similar 'InsertOverwrite Logiv' in Bigquery which is currently we are doing in Hive?
Thanks in advance and much appreciated any suggestion.
no features in Talend component for this, but as a variant, you could use command line client for this:
Talend named a Leader.
Kickstart your first data integration and ETL projects.
Watch the recorded webinar!
Learn how to make your data more available, reduce costs and cut your build time
Read about OTTO's experiences with Big Data and Personalized Experiences
Take a look at this video about Talend Integration with Databricks