Talend Connect
Virtual Summit
JOIN US!
And visit the Customer
& Community Lounge.
May 27-28, wherever you are.

Snowflake upsert issue

Highlighted
Four Stars

Snowflake upsert issue

Looks like snowflake upsert is not supported on multiple columns and currently it allows only one column. Is there any alternate?

Highlighted
Moderator

Re: Snowflake upsert issue

Hello,

The Upsert operation allows you to merge data in a Snowflake table based on the data that is incoming to tSnowflakeOutput. After selecting Upsert, select the column to be used as the join key of this operation.

Best regards

Sabrina

 
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Highlighted
Four Stars

Re: Snowflake upsert issue

Thank you.   It does not support multiple keys (multiple columns) to join.  It just allows to pick only one key, how do I multi select the join columns.

Highlighted
Five Stars

Re: Snowflake upsert issue

I created a Hashkey from the unique column index. Like  (OrderNumber + OrderDate + PO_NUmber). I then insert this as my Key Column, it is only used for Upserts, not for referential integrity.

 

I also wrote a Hashing Routine Using either a SHA-1 Hash or a SHA256 to prevent collisions. I am still in testing but it seems to be working.

 

Good luck.

Carolus Holman
Highlighted
One Star

Re: Snowflake upsert issue

The Issue is while I am trying to do Upsert based on the date column. It is taking the same time that is needed for the whole table to run.

 

Also, Please help me out with the table action, I am using None.

2019 GARTNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

Best Practices for Using Context Variables with Talend – Part 2

Part 2 of a series on Context Variables

Blog

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog