How can I use InsertId to avoid duplicates in BigQuery ?

Four Stars

How can I use InsertId to avoid duplicates in BigQuery ?

Hi there, 

I found this on Google Cloud : Google Cloud - Ensuring data consistency

It says that "BigQuery uses the insertId property to de-duplicate your data on a best effort basis".

 

Within Talend, how can I use this property to avoid duplicates when I insert my data into bigquery ?

 

Thanks,

Caroline.

Moderator

Re: How can I use InsertId to avoid duplicates in BigQuery ?

Hello,

Could you please create a new feature jira issue on talend bug tracker?

https://jira.talendforge.org/secure/Dashboard.jspa

Best regards

Sabrina

 

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.

What’s New for Talend Spring ’19

Watch the recorded webinar!

Watch Now

Agile Data lakes & Analytics

Accelerate your data lake projects with an agile approach

Watch

Definitive Guide to Data Quality

Create systems and workflow to manage clean data ingestion and data transformation.

Download

Tutorial

Introduction to Talend Open Studio for Data Integration.

Watch