One Star

[resolved] Proxy support for Hadoop connections?

It appears that Hadoop components don't support any proxy interaction.  There's no specific configuration for it anywhere within the components themselves, the Preferences -> General -> Network Connections doesn't affect the job or the metadata Hadoop Cluster configuration, and tSetProxy doesn't affect it either.
Is there another route?  This makes using AWS EMR very difficult. 
1 ACCEPTED SOLUTION

Accepted Solutions
One Star

Re: [resolved] Proxy support for Hadoop connections?

I'm just a dummy, I found that if you set it via hadoop properties it works.
I used these properties:

hadoop.socks.server=SOCKS_PROXY_IP:8080
hadoop.rpc.socket.factory.class.default=org.apache.hadoop.net.SocksSocketFactory
1 REPLY
One Star

Re: [resolved] Proxy support for Hadoop connections?

I'm just a dummy, I found that if you set it via hadoop properties it works.
I used these properties:

hadoop.socks.server=SOCKS_PROXY_IP:8080
hadoop.rpc.socket.factory.class.default=org.apache.hadoop.net.SocksSocketFactory