How to Configure SLL in Talend Open Studio

Seven Stars skh
Seven Stars

How to Configure SLL in Talend Open Studio

Hi Guys,

 

I am facing connection Reset , java.security.ProviderException, fatal Error Exceptions while executing the ETL Job in Production Environment.But its working fine in my local System.

 

I have used tJava Components as per my business logic where I will connect to the Particular Website and scrap the contents of the website.For few websites am getting the above mentioned alerts. How to get rid of those Errors while scrapping the website. As per my knowledge I think the Server is not allowing the SSL - certifications, Kindly guide me how to configure the SSL - Certificate inside the Talend Design.

 

 

Thanks,

Hameed

 

 


Accepted Solutions
Seven Stars skh
Seven Stars

Re: How to Configure SLL in Talend Open Studio

Thanks for your reply,

I am using Talend Open Studio for Data Integration (6.3.0).

 

I designed an ETL Job whose functionality is to check the availability of some urls in provided list of websites.

For this I am creating HTTP Connections to open the website and then checking the availability of my urls. When I tried to run it in the server its returning Connection Reset , java.security.ProviderException, handshake Exceptions for few Govt website Urls.

Sample Code :

 

try
{
                URL url = new URL(((String)globalMap.get("row1.url")));
                System.out.println("***********************************");
                System.out.println("Checking for State URL Connection Status: ");
                System.setProperty("https.protocols", "TLSv1.2");
                HttpURLConnection con = (HttpURLConnection) url.openConnection();
                con.connect();
                Flag = con.getResponseCode();
                System.out.println(url+" : Current Status : "+Flag);

 

//* get redirect url from "location" header field
                rUrl = con.getHeaderField("Location");
                System.out.println("Redirect to URL : " + rUrl);
                Thread.sleep(10000);
                con.disconnect();
}
catch (Exception e)
{
        System.out.println("Exception Occured while Checking State URL...");
}

Thanks In Advance,

Hameed.


All Replies
Four Stars

Re: How to Configure SLL in Talend Open Studio

Try executing the ETL job again without SSL this time and see if the error still persist.

Arjun Dixit
Showbox Mobdro Tutuapp
Seven Stars skh
Seven Stars

Re: How to Configure SLL in Talend Open Studio

Thanks for your reply,

In my case I am creating HttpConnection for each website before parsing the contents which requires SSL/TLS get validated.

After setting the "https.protocols" to "TLSv1.2", I get rid of Connection reset Errors. But still there are few more Errors "java.security.ProviderException" & sun.security.validator Errors are occuring.

 

Any Idea on these above will be helpful. Can we set more than on protocols like "TLSv1","TLSv1.1" & "TLSv1.2" will it accept this.

Which Property I need to set for to get rid of the above 2-mentioned Errors in Talend.

 

Thanks,

Hameed

Seven Stars skh
Seven Stars

Re: How to Configure SLL in Talend Open Studio

Folks,

Any help on this will be appreciable. Updating the Java from jdk1.7 to jdk 1.8 will solve this problem?

Updating the OpenSSL to latest version will help on this..?

 

Thanks,

Hameed

 

Moderator

Re: How to Configure SLL in Talend Open Studio

Hello,

Are you using talend open studio for data integration or ESB? Usually, we use tSetKeyStore component to achieve SSL transport mechanism.

Could you please give us more information about your current situation?

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Seven Stars skh
Seven Stars

Re: How to Configure SLL in Talend Open Studio

Thanks for your reply,

I am using Talend Open Studio for Data Integration (6.3.0).

 

I designed an ETL Job whose functionality is to check the availability of some urls in provided list of websites.

For this I am creating HTTP Connections to open the website and then checking the availability of my urls. When I tried to run it in the server its returning Connection Reset , java.security.ProviderException, handshake Exceptions for few Govt website Urls.

Sample Code :

 

try
{
                URL url = new URL(((String)globalMap.get("row1.url")));
                System.out.println("***********************************");
                System.out.println("Checking for State URL Connection Status: ");
                System.setProperty("https.protocols", "TLSv1.2");
                HttpURLConnection con = (HttpURLConnection) url.openConnection();
                con.connect();
                Flag = con.getResponseCode();
                System.out.println(url+" : Current Status : "+Flag);

 

//* get redirect url from "location" header field
                rUrl = con.getHeaderField("Location");
                System.out.println("Redirect to URL : " + rUrl);
                Thread.sleep(10000);
                con.disconnect();
}
catch (Exception e)
{
        System.out.println("Exception Occured while Checking State URL...");
}

Thanks In Advance,

Hameed.

One Star

Re: How to Configure SLL in Talend Open Studio

Hey hi Thanks !

Have a go at executing the ETL work again without SSL this time and check whether the blunder still hold on.

 

One Star

Re: How to Configure SLL in Talend Open Studio

People,

Any assistance on this will be calculable. Refreshing the Java from jdk1.7 to jdk 1.8 will tackle this issue?

Refreshing the OpenSSL to most recent form will help on this..?

 

Regards,

peterhean

 

 

Seven Stars skh
Seven Stars

Re: How to Configure SLL in Talend Open Studio

 peterhean,

 

The issue is with the protocol used by the different websites for few websites are using 1.1, 1.2 or 1.3. So I have configured the settings in my java code to allow them according to these protocol versions.

 

Thanks,

Hameed

 

One Star

Re: How to Configure SLL in Talend Open Studio

very impressive information dear. love your article. 

I love your Website.

kindly go here for tvtap is one of the best streaming application.

Tvtap pro Mactvtap pro iPad

Two Stars

Re: How to Configure SLL in Talend Open Studio

This is a very helpful article. It was very useful to me. Good job Smiley Happy



________________________

Thorstienx

Show-box

One Star

Re: How to Configure SLL in Talend Open Studio

If you really, want to know about SSL certificates then you should go to youtube and if you really, want to know about all login worldwide then you should first study about login to khan academy

One Star

Re: How to Configure SLL in Talend Open Studio

Thank you very much for providing such amazing information but I am going to tell something new that will really, help you.workspacelogin email

One Star

Re: How to Configure SLL in Talend Open Studio

For a few websites am getting the above-mentioned alerts. How to get rid of those Errors while scrapping the website. Thanks for sharing the useful information provided here.

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

How Media Organizations Achieved Success with Data Integration

Learn how media organizations have achieved success with Data Integration

Read

6 Ways to Start Utilizing Machine Learning with Amazon We Services and Talend

Look at6 ways to start utilizing Machine Learning with Amazon We Services and Talend

Blog