Talend data integration with Amazon web services

One Star

Talend data integration with Amazon web services

Hi, 
We are currently in the process of migration our Oracle servers from Skyscape to AWS.
IN our talend jobs we are opening a TCP connection to Oracle using tOracleConnection and that remains open during the execution of the job and then we finally close the connection after exiting talend.
Now when we are trying to run the jobs in new AWS environment, they are failing after 10 minutes because AWS load balancer is killing the idle connection after 10 mins.
We have jobs running for 4-5 hours so we can not change the setting to keep connections open for 4-5 hours.
Any suggestions to run the job in talend would be appreciated.
Regards,
Ruchit
Forteen Stars

Re: Talend data integration with Amazon web services

Hi Ruchit,
first of all - AWS environment is very flexible term :-), what exactly?
Then - how Your Job designed? Could You attach screenshots?
And last if no other choices - unload data to the csv locally -> transfer to S3 bitbucket -> and sure "AWS environment" have command load data from S3 (most of them have it). 
-----------

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

How Media Organizations Achieved Success with Data Integration

Learn how media organizations have achieved success with Data Integration

Read

Definitive Guide to Data Quality

Create systems and workflow to manage clean data ingestion and data transformation.

Download