Deploying Dev jobs with tHDFSoutput target on Azure HDInsight to On-prem Production HDP cluster

Highlighted
One Star

Deploying Dev jobs with tHDFSoutput target on Azure HDInsight to On-prem Production HDP cluster

Background:

We are trying to figure out an option to move our Development and QA Target environments, (currently HDP cluster) to "Azure HD Insight" cluster. The production environment remains On-premise on HDP cluster. Currently all jobs use "tHDFSoutput" to push transformed files to on-premise HDP cluster.

 

Questions:

1. As Dev & QA verified jobs can't be modified to change the "Distribution" Type which is "Microsoft HD Insight" in "tHDFSoutput" component - is there a way to pass this option as parameter through configuration file?

2. Can all the other connection parameters (on-premise & Azure HD Insight) be supplied through a config file?

3. Do we have to buy additional license for "Distribution" Type "Microsoft HD Insight" to be available as option in "tHDFSoutput" component?

 

Moderator

Re: Deploying Dev jobs with tHDFSoutput target on Azure HDInsight to On-prem Production HDP cluster

Hello,

Could you please take a look at this online document about:https://help.talend.com/reader/XhkoFAh1W9vQIuvD3g1EBw/_ysQiCK7C0Wu1H7fLuHnAQ

We have supported for Microsoft HD Insights Platform since 5.6.

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Put Massive Amounts of Data to Work

Learn how to make your data more available, reduce costs and cut your build time

Watch Now

How OTTO Utilizes Big Data to Deliver Personalized Experiences

Read about OTTO's experiences with Big Data and Personalized Experiences

Blog

Talend Integration with Databricks

Take a look at this video about Talend Integration with Databricks

Watch Now