snowflake copy command with purge option issue

Six Stars

snowflake copy command with purge option issue

I am using tdbinput component  to do snowflake copy command . I am using AWS access key to copy the data from S3 to snowflake and all works good . But when i use PURGE=TRUE option it supposed to purge the files after successful copy. The access key have full access and i can delete the file using the credentials manually. So why this purge option not working and still files sitting there. 

Employee

Re: snowflake copy command with purge option issue

Hi,

 

     Could you please advise the version and flavour of Talend you are using for development purpose? It would be great if you could share the screenshots of the job flow and the the component so that we will can help you better way.

 

Warm Regards,

 

Nikhil Thampi

Highlighted
Six Stars

Re: snowflake copy command with purge option issue

We found the issue is we need snowflake external drive to map to our S3. I will test and let if that works




2019 GARTNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog