snowflake copy command with purge option issue

Highlighted
Six Stars

snowflake copy command with purge option issue

I am using tdbinput component  to do snowflake copy command . I am using AWS access key to copy the data from S3 to snowflake and all works good . But when i use PURGE=TRUE option it supposed to purge the files after successful copy. The access key have full access and i can delete the file using the credentials manually. So why this purge option not working and still files sitting there. 

Employee

Re: snowflake copy command with purge option issue

Hi,

 

     Could you please advise the version and flavour of Talend you are using for development purpose? It would be great if you could share the screenshots of the job flow and the the component so that we will can help you better way.

 

Warm Regards,

 

Nikhil Thampi


Warm Regards,
Nikhil Thampi
Please appreciate our members by giving Kudos for spending their time for your query. If your query is answered, please mark the topic as resolved :-)
Six Stars

Re: snowflake copy command with purge option issue

We found the issue is we need snowflake external drive to map to our S3. I will test and let if that works




Tutorial

Introduction to Talend Open Studio for Data Integration.

Definitive Guide to Data Integration

Practical steps to developing your data integration strategy.

Definitive Guide to Data Quality

Create systems and workflow to manage clean data ingestion and data transformation.