Design MapReduce on Windows... run it on hadoop

Seven Stars

Design MapReduce on Windows... run it on hadoop

ok... here is an interesting question.
I'm using Talend platform for BIG data 5.3 beta version. for some reason, I'm more comfortable in designing my jobs on Windows platform. Is is possible to design MapReduce job on Windows platform and run the job on Hadoop cluster from studio itself?
please let me know if further details are required.
Thanks,
Nishad Joshi.
Seven Stars

Re: Design MapReduce on Windows... run it on hadoop

ok, got answer for my first question -
You can browse hdfs(on Linux) from Talend Open studio running on Windows.
Working on next step now... will share details soon Smiley Happy
Seven Stars

Re: Design MapReduce on Windows... run it on hadoop

I've designed a simple MapReduce job using Talend 5.3 beta version on Windows. Now trying to execute on hadoop cluster. But looks like it needs some Oozie settings. Name node end point, Job tracker end point & Oozie end point are parameters I need to set. This is in Oozie settings tab. Can anyone please help me understand what this is?

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 2

Part 2 of a series on Context Variables

Blog

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog