One Star

Map Reduce Programing using Talend Open Studio for Big Data

Hi,
I am currently using Talend Open Studio for Big Data version 5.3.1 , I want to write some map reduce programs and not pig jobs. Is there any drag and drop component available for map reduce
Regards,
Bhagwant Bhobe
4 REPLIES
Moderator

Re: Map Reduce Programing using Talend Open Studio for Big Data

Hi,
Would you mind referring the related forum Forum 28659 MapReduce example(especially by rdubois)
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Employee

Re: Map Reduce Programing using Talend Open Studio for Big Data

Hi,
Developing native M/R job is possible using our Enterprise product but the functionnality is not available in Talend Open Studio for Big Data.
In Talend Open Studio for Big Data, you can use Pig, Hive or Sqoop to match your requirements.
Regards,
Rémy.
One Star

Re: Map Reduce Programing using Talend Open Studio for Big Data

hi rdubois,
Can you please share entire list of components available in BigData enterprise edition.
Regards,
Bhagwant Bhobe
Community Manager

Re: Map Reduce Programing using Talend Open Studio for Big Data

Hi
Here is the list of components that are available as M/R in v5.3.1:
tAggregateRow
tConvertType
tDenormalize
tFilterColumns
tFilterRow
tHBaseInput
tHBaseOutput
tHDFSInput
tHDFSOutput
tJDBCInput
tJDBCOutput
tMap
tNormalize
tReplace
tReplicate
tSchemaComplianceCheck
tSortRow
tUniqRow
tStandardizeRow
There will be more for 5.4. We will try to have this list available more easily in our KB.
HTH