Five Stars

TOS V6.4.1 - Hadoop MapReduce

Hi.

 

I am now studying about the MR option in TOS BD. I want to know what components in TOS BD can actually use the computing power of the Hadoop MapReduce.

I think all the tPig and tHive and tSqoop components are powered by MR, right?

How about tMap or tJavaRow or tSetGlobalVariable when running on Hadoop?

Also, when designing a MR job, should I just create the job as usual (just right click and select "Create job") or do I need to create a MR job with other special methods?

 

Thank you and have a nice day.

5 REPLIES
Seven Stars

Re: TOS V6.4.1 - Hadoop MapReduce

You need to create a "Big Data Batch" job instead of a "Standard" job. When you do, the Palette will show you the available components.
Five Stars

Re: TOS V6.4.1 - Hadoop MapReduce

Thanks for the reply. So where can I create the "Big Data Batch" job in TOS BD? I cannot find such option by right clicking "Job Designs"...

Seven Stars

Re: TOS V6.4.1 - Hadoop MapReduce

Here's a screenshot of my Talend Studio. It's right under "Standard".

Five Stars

Re: TOS V6.4.1 - Hadoop MapReduce

Sorry, which version of Talend Open Studio are you using?

 

Thanks.

Moderator

Re: TOS V6.4.1 - Hadoop MapReduce

Hello,

Talend big data batch job will be available in talend subscription solution not open source.

Please have a look at online bigdata product matrix page:https://www.talend.com/products/big-data/big-data-compare-all/?_ga=2.261728269.1883876491.1520819993...

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.