Connecting Talend on Amazon Athena

Four Stars

Connecting Talend on Amazon Athena

Hi, I'm using AWS Athena services but I can't connect on Talend. I't seems I need a s3_staging_dir property to be set on Talend. But, how can I do this?

 

The connection tutorial on amazon is this following link: https://docs.aws.amazon.com/athena/latest/ug/connect-with-jdbc.html

 

The error screen is attached.

 

Thanks a lot,

 

Andre Sevilha

 


Accepted Solutions
Five Stars

Re: Connecting Talend on Amazon Athena

Found a solution that worked for me:

As part of the JDBC URL, we need to add the s3_staging_Dir as shown in blue below (not the "?" needs to be prefixed before the s3_staging_dir):

 

"jdbc:awsathena://athena.us-east-1.amazonaws.com:443?s3_staging_dir=s3://aws-athena-query-results-xxxxxx-us-east-1/"

View solution in original post


All Replies
Five Stars

Re: Connecting Talend on Amazon Athena

Andre, Were you able to find a solution for this ? I am getting the same error and I see there is no advanced properties or connection properties to enter the s3_staging_dir and the corresponding s3 bucket name.

 

 

[FATAL]: sr_reservation_client_pull_0_1.SR_Reservation_Client_Pull - tJDBCInput_1 property s3_staging_dir must be set
Exception in component tJDBCInput_1
java.sql.SQLException: property s3_staging_dir must be set

Five Stars

Re: Connecting Talend on Amazon Athena

Found a solution that worked for me:

As part of the JDBC URL, we need to add the s3_staging_Dir as shown in blue below (not the "?" needs to be prefixed before the s3_staging_dir):

 

"jdbc:awsathena://athena.us-east-1.amazonaws.com:443?s3_staging_dir=s3://aws-athena-query-results-xxxxxx-us-east-1/"

View solution in original post

Four Stars

Re: Connecting Talend on Amazon Athena

Thanks a Lot!!! It worked!!!

 

Smiley Very Happy

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 2

Part 2 of a series on Context Variables

Blog

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog