A common question I get when working on client sites is, "How can we save the output from the console without having to copy and paste it?". The console (from Talend DI v6) is shown below.
Unfortunately there isn't a "built-in" way of doing this, but it is very simple to implement this functionality. All you need to do is start your job with a tJava component and add the code below to it.....
|java.io.File outputFile = new java.io.File("e:/output.txt");
System.setOut(new java.io.PrintStream(new java.io.FileOutputStream(outputFile, true), true));
This code redirects the console output to a file called "output.txt" on the e: drive. Change the file location as required.
Using this trick will ensure that all logging output is sent to the file, but you will no longer see it in the console.
All errors will be shown in the console though.
NOTE: I received a question from @gslokoski about whether the output could be split so that it remains in the console as well as being added to a file. I suggested trying a solution I had found on Google. @gslokoski came back with this solution which I have subsequently tried. It's pretty nice, so I thought I would add it here. All credit to @gslokoski.
|java.io.File outputFile = new java.io.File("c:/temp/output.txt");
java.io.FileOutputStream fos = new java.io.FileOutputStream(outputFile);
//we will want to print in standard "System.out" and in "file"
org.apache.commons.io.output.TeeOutputStream myOut=new org.apache.commons.io.output.TeeOutputStream(System.out, fos);
java.io.PrintStream ps = new java.io.PrintStream(myOut, true); //true - auto-flush after println
You will need to add the commons-io-2.4.jar which comes with Talend. You can do this with a tLibraryLoad component.
This is Nice and Brilliant! I use tJava to print it in the standard output and use tWarn with (info) and tLogCatcher and tFileOutputDelimited to write the same information in a file. This is simple and sleek. I will try this for sure!!!
What don't you understand? The code can be used "as is" so long as the path to your log file is acceptable. Otherwise, just change that path.
@apentyala there is no job, you simply copy the code I have given into a tJava. It is that simple, honestly :-)
Where is the tJava component in your job? It should either be at the beginning (a start component) or connected to the tPreJob component.
Watch the recorded webinar!
Accelerate your data lake projects with an agile approach
Create systems and workflow to manage clean data ingestion and data transformation.
Introduction to Talend Open Studio for Data Integration.