Five Stars

tFtp or tscp with http proxy

Hi,

I am using Talend for Big data 6.4 and I want to get files from ftp. However as I am behind proxy, I need to set http proxy to get the files. 

 

I have tested this with winscp and it works with http proxy. 

 

winscp.png

However, when I tried with tScp with tSetProxy, it fails. 

proxy01.png

[statistics] connecting to socket on port 3740
[statistics] connected
Exception in component tSCPConnection_1 (ftpLanding)
java.io.IOException: There was a problem while connecting to 134.178.253.145:21
at ch.ethz.ssh2.Connection.connect(Connection.java:805)
at ch.ethz.ssh2.Connection.connect(Connection.java:595)
at first.ftplanding_0_1.ftpLanding.tSCPConnection_1Process(ftpLanding.java:379)
at firstftplanding_0_1.ftpLanding.tSetProxy_1Process(ftpLanding.java:592)
at firstftplanding_0_1.ftpLanding.runJobInTOS(ftpLanding.java:848)
at firstftplanding_0_1.ftpLanding.main(ftpLanding.java:674)
Caused by: java.net.ConnectException: Connection timed out: connect
at java.net.DualStackPlainSocketImpl.connect0(Native Method)
at java.net.DualStackPlainSocketImpl.socketConnect(Unknown Source)
at java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.net.PlainSocketImpl.connect(Unknown Source)
at java.net.SocksSocketImpl.connect(Unknown Source)
[FATAL]: ftplanding_0_1.ftpLanding - tSCPConnection_1 There was a problem while connecting to 134.178.253.145:21

 

I have also tried with tFtpget, however that was not suitable as it does not have http proxy. It only has socks proxy, which did not work for me as well. 

ftp_socks.png

 

How can I solve this?

 

1 ACCEPTED SOLUTION

Accepted Solutions
Moderator

Re: tFtp or tscp with http proxy

Hello,

So far, we don't have any update for this jira issue:https://jira.talendforge.org/browse/TDI-39093

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
3 REPLIES
Moderator

Re: tFtp or tscp with http proxy

Hello,

So far, we don't have any update for this jira issue:https://jira.talendforge.org/browse/TDI-39093

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Five Stars

Re: tFtp or tscp with http proxy

Thank you for that. We also raised a support ticket and they asked to look at using custom code for tFtp. 

- use tJava component and write your own java code to go through the proxy and get the file:
https://commons.apache.org/net/examples/ftp/FTPClientExample.java or https://www.example-code.com/java/ftp_http_tunnel.asp

-Or use the tSystem/tSSH to connect and run command

 

I tried the ssh, which did not work. Have not got to adding the ftp tunnelling yet. 

Moderator

Re: tFtp or tscp with http proxy

Hello,

Thank for sharing your update with us and feel free to let us know if there is any further help we can give.

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.