Design MapReduce on Windows... run it on hadoop

Highlighted
Seven Stars

Design MapReduce on Windows... run it on hadoop

ok... here is an interesting question.
I'm using Talend platform for BIG data 5.3 beta version. for some reason, I'm more comfortable in designing my jobs on Windows platform. Is is possible to design MapReduce job on Windows platform and run the job on Hadoop cluster from studio itself?
please let me know if further details are required.
Thanks,
Nishad Joshi.
Highlighted
Seven Stars

Re: Design MapReduce on Windows... run it on hadoop

ok, got answer for my first question -
You can browse hdfs(on Linux) from Talend Open studio running on Windows.
Working on next step now... will share details soon Smiley Happy
Highlighted
Seven Stars

Re: Design MapReduce on Windows... run it on hadoop

I've designed a simple MapReduce job using Talend 5.3 beta version on Windows. Now trying to execute on hadoop cluster. But looks like it needs some Oozie settings. Name node end point, Job tracker end point & Oozie end point are parameters I need to set. This is in Oozie settings tab. Can anyone please help me understand what this is?

2019 GARTNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog