Connecting Talend on Amazon Athena

Highlighted
Four Stars

Connecting Talend on Amazon Athena

Hi, I'm using AWS Athena services but I can't connect on Talend. I't seems I need a s3_staging_dir property to be set on Talend. But, how can I do this?

 

The connection tutorial on amazon is this following link: https://docs.aws.amazon.com/athena/latest/ug/connect-with-jdbc.html

 

The error screen is attached.

 

Thanks a lot,

 

Andre Sevilha

 


Accepted Solutions
Five Stars

Re: Connecting Talend on Amazon Athena

Found a solution that worked for me:

As part of the JDBC URL, we need to add the s3_staging_Dir as shown in blue below (not the "?" needs to be prefixed before the s3_staging_dir):

 

"jdbc:awsathena://athena.us-east-1.amazonaws.com:443?s3_staging_dir=s3://aws-athena-query-results-xxxxxx-us-east-1/"


All Replies
Five Stars

Re: Connecting Talend on Amazon Athena

Andre, Were you able to find a solution for this ? I am getting the same error and I see there is no advanced properties or connection properties to enter the s3_staging_dir and the corresponding s3 bucket name.

 

 

[FATAL]: sr_reservation_client_pull_0_1.SR_Reservation_Client_Pull - tJDBCInput_1 property s3_staging_dir must be set
Exception in component tJDBCInput_1
java.sql.SQLException: property s3_staging_dir must be set

Five Stars

Re: Connecting Talend on Amazon Athena

Found a solution that worked for me:

As part of the JDBC URL, we need to add the s3_staging_Dir as shown in blue below (not the "?" needs to be prefixed before the s3_staging_dir):

 

"jdbc:awsathena://athena.us-east-1.amazonaws.com:443?s3_staging_dir=s3://aws-athena-query-results-xxxxxx-us-east-1/"

Four Stars

Re: Connecting Talend on Amazon Athena

Thanks a Lot!!! It worked!!!

 

Smiley Very Happy

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

How Media Organizations Achieved Success with Data Integration

Learn how media organizations have achieved success with Data Integration

Read

Definitive Guide to Data Quality

Create systems and workflow to manage clean data ingestion and data transformation.

Download