Talend data integration with Amazon web services

One Star

Talend data integration with Amazon web services

We are currently in the process of migration our Oracle servers from Skyscape to AWS.
IN our talend jobs we are opening a TCP connection to Oracle using tOracleConnection and that remains open during the execution of the job and then we finally close the connection after exiting talend.
Now when we are trying to run the jobs in new AWS environment, they are failing after 10 minutes because AWS load balancer is killing the idle connection after 10 mins.
We have jobs running for 4-5 hours so we can not change the setting to keep connections open for 4-5 hours.
Any suggestions to run the job in talend would be appreciated.
Forteen Stars

Re: Talend data integration with Amazon web services

Hi Ruchit,
first of all - AWS environment is very flexible term :-), what exactly?
Then - how Your Job designed? Could You attach screenshots?
And last if no other choices - unload data to the csv locally -> transfer to S3 bitbucket -> and sure "AWS environment" have command load data from S3 (most of them have it). 

What’s New for Talend Spring ’19

Watch the recorded webinar!

Watch Now

Agile Data lakes & Analytics

Accelerate your data lake projects with an agile approach


Definitive Guide to Data Quality

Create systems and workflow to manage clean data ingestion and data transformation.



Introduction to Talend Open Studio for Data Integration.