spark connectors - generated code

One Star

spark connectors - generated code

Hi,
Can anyone tell in what language do the "native" connectors for spark generate the code to be executed in Spark ?
Couldn't find any answer in Talend documentation. Always speaking about "spark code".
Do the spark connectors generate Java ? Scala ? Python ? ...
Thx for your answers.
Mathieu
Employee

Re: spark connectors - generated code

Hi Mathieu
Talend generates Java.
Seven Stars

Re: spark connectors - generated code

In tJava you can worked with rdds via Java code too.  I've yet to test if you can leverage dataframes within tJava.