printing a value inside a big data spark job

Highlighted
Seven Stars

printing a value inside a big data spark job

Hi,

 

I am running a spark job in hadoop cluster.

 

I have tRowgenerator and tJavarow and tfileoutputdelimited.

 

I want to pass all the rows to delimited file as well as print the values of all fields of each row in tJavarow.

 

I want to see the values which are printed in  log of Spark application(job)

 

Is this possible in big data spark job using tJavarow.

 

I am not able to print.

 

PS: I know this is possible in standard jobs

 

Thanks


Accepted Solutions
Seven Stars

Re: printing a value inside a big data spark job

I replied to your other subject which is the same but a little more detailed. Let me know if that answer helps:

https://community.talend.com/t5/Design-and-Development/Using-Custom-Code-in-tJavarow/m-p/27518#M5443


All Replies
Seven Stars

Re: printing a value inside a big data spark job

I replied to your other subject which is the same but a little more detailed. Let me know if that answer helps:

https://community.talend.com/t5/Design-and-Development/Using-Custom-Code-in-tJavarow/m-p/27518#M5443

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Put Massive Amounts of Data to Work

Learn how to make your data more available, reduce costs and cut your build time

Watch Now

How OTTO Utilizes Big Data to Deliver Personalized Experiences

Read about OTTO's experiences with Big Data and Personalized Experiences

Blog

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog