One Star

How to connect to RDS MYSQL DB using a VPN in Talend INtegration Cloud

We had made a project in Talend Open Studio 6.2 which uses a Amazon RDS MySQL Database as a source. Our local system on which Talend Open Studio was installed was connected with RDS via VPN.
Now we have purchased TCI and have published that job to TCI but the job gives an error as TCI is not connected with VPN, hence SOURCE.
I want to know that is there any way we can connect with our RDS using a VPN as without VPN connection RDS refuses connection.

  • Talend Integration Cloud
5 REPLIES
Employee

Re: How to connect to RDS MYSQL DB using a VPN in Talend INtegration Cloud

Hi,
you can use a remote engine deployed to your local system, which has the VPN established. This way there is no change to your current setup.
Do you want to switch to cloud engines?
Thomas
One Star

Re: How to connect to RDS MYSQL DB using a VPN in Talend INtegration Cloud

Yes I have installed the VPN on my local system on which Talend is being installed. When I run batch on Local system it works fine as its connected with that VPN. The PROBLEM is, when I publish that project into the cloud, the cloud cant connect to the source as cloud is not connected via VPN.
So is there any way around?
Employee

Re: How to connect to RDS MYSQL DB using a VPN in Talend INtegration Cloud

I understand the problem. I was wondering though if you were using the Cloud environment in Go Live or if you have created a Remote Engine and deployed it locally into your VPN.
One Star

Re: How to connect to RDS MYSQL DB using a VPN in Talend INtegration Cloud

Hi,
(Advanced Sorry for long reply)
I have manged to connect to my source. Just straightened my concepts about TIC by concentrating on your previous reply.
Previously I thought that the Job will run in Cloud and in Talend's Platform i.e PaaS so I was worried that how will it find its source. After carefully reading about Remote Engine I have managed to solve this issue by Just connecting that Remote Engine (installed on local machine or EC2) to the source via VPN!
After solving this I was wondering that we purchased the Talend cloud because our previous batch's processing was very slow (read from RDS MysQL Source) which was on Talend Open Studio - installed on a EC2 machine, so we bought TIC to remove EC2 machines barrier.
Now that Remote Engine is running the Job on-premises (EC2), I wonder that there will be any speed difference.
Sorry if I am wrong somewhere
Four Stars

Re: How to connect to RDS MYSQL DB using a VPN in Talend INtegration Cloud

Hi,

It is unclear to me how you have achieved it. I am on a similar scenario and would need help.

 

I have a mysql db over VPN connection. This will serve as a source, how can i achieve to connect to this database from TALEND. For job execution we are using unix servers. I am using the Enterprise edition in talend 5.6.1

Edit 1: Outside Talend and manual connection is explained as below.

We usually connect with "Global Protect" to establish the VPN connection and using sql server we set up the db connection and query the source records.

In Global protect, we use details of the "Portal, Username and Password". A registered mobile number using the duo mobile app that receives a notification to authenticate the login (This requires to open the app and press allow). I guess this is a 2 FA (Two Factor Authentication).

I guess we should try and create a tunnel connection to reach the source in Talend's unix box (job/execution server) but unclear of the exact steps. Would appreciate inputs from anyone who had any similar efforts put in earlier.