Five Stars

talend spark

hi,
i am planning to do POC for spark with Talend. which Talend version has to install .is there any links or material for how to install spark and integration of  Talend and spark 
1 REPLY
Seven Stars

Re: talend spark

Talend version - At minimum, you'll need Talend Open Studio for Big Data.  I'd suggest getting Talend 6.3 or 6.2.  You can see more details about versioning here: https://help.talend.com?content-lang=en?_ga=1.266165839.1394013088.1477338163
Leverage Spark in Talend - 
In Talend Studio, create a Big Data Batch job and select 'Spark' as your framework.  Ensure you have the libraries needed for the version of Spark you are going to be developing.  In Talend Studio click navigate to 'Help' -> 'Installation Details' -> 'Plug-ins' and ensure all Spark plugins are installed.  You can run Spark jobs locally, but ensure you set up winutils.exe: https://help.talend.com/search/all?query=The+missing+winutils.exe+program+in+the+Big+Data+Jobs&conte...