snowflake copy command with purge option issue

Highlighted
Six Stars

snowflake copy command with purge option issue

I am using tdbinput component  to do snowflake copy command . I am using AWS access key to copy the data from S3 to snowflake and all works good . But when i use PURGE=TRUE option it supposed to purge the files after successful copy. The access key have full access and i can delete the file using the credentials manually. So why this purge option not working and still files sitting there. 

Employee

Re: snowflake copy command with purge option issue

Hi,

 

     Could you please advise the version and flavour of Talend you are using for development purpose? It would be great if you could share the screenshots of the job flow and the the component so that we will can help you better way.

 

Warm Regards,

 

Nikhil Thampi

Six Stars

Re: snowflake copy command with purge option issue

We found the issue is we need snowflake external drive to map to our S3. I will test and let if that works




2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

How Media Organizations Achieved Success with Data Integration

Learn how media organizations have achieved success with Data Integration

Read

6 Ways to Start Utilizing Machine Learning with Amazon We Services and Talend

Look at6 ways to start utilizing Machine Learning with Amazon We Services and Talend

Blog