Five Stars

connect talend to azure data lake store

Dear community,

I notice there is a section on the talend website to connect to azure data lake store. I want to do a simple test and see if I connect to azure data lake store and upload some date. I am following the steps in https://help.talend.com/reader/Sm466hmdh~Y~2GehtIo6xw/6tEZDas0IOzvyMUDEfx0HQ .

In "Configuring the HDFS components to work with Azure Data Lake Store" , step 7, one is asked to select the version in tHDFSoutput . I do not see something like "azure data lake " there (only cloudera, hortonworks, apache,...) . What should one pick there?

If like in the tutorial we add a library "hadoop-azure-datalake-2.6.0-cdh5.12.1.jar", I assume this means we should pick cloudera CDH5.12?

 

3 REPLIES
Five Stars

Re: connect talend to azure data lake store

I fixed this myself... 

For me it was possible to either use the cloudera or hortonworks version.  I did have one new question regarding the steps described in https://help.talend.com/reader/Sm466hmdh~Y~2GehtIo6xw/GF904L29UmSgV4kB~xCuAQ . In "Configuring the HDFS components to work with Azure Data Lake Store" step 8 it is mentioned to use adl://my_app.azuredatalakestore.net for the namenode URI. I got unknown host errors when I did this and it worked when I used the full name of my azure data lake store. Is this possibly an error in the documentation??

 

Thanks for feedback!

Moderator

Re: connect talend to azure data lake store

Hello,

Thanks for posting this issue here.

We have reported your issue to our documentation team and will keep you posted.

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Moderator

Re: connect talend to azure data lake store

Hello,

We have created a DOCT jira issue on talend bug track about your issue and it will be fixed as soon as we can.

Thanks for reporting this issue.

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.