The Definitive Guide to Data Quality
It is a great component that helps us to monitor the memory usage of a running job. It will be better if the component can output the memory information to a log file.
Monitor the memory usage of your running Job, with tMemoryMonitor
Information on the used, total and maximum (see -Xmx) memory of the Java runtime, are written to standard output or, if a warning threshold is reached, to standard error.
Options include ‘Enabled’, ‘Interval’ (milliseconds) and ‘Warning Threshold Percent %’.
Used in conjunction with your own diagnostic messages, this component will help you to identify where memory is being used within your Job an help you to avoid Out of Memory (OOM) Exceptions.
As well as ensuring that your Job has enough memory, you’ll also want to make sure that you do not waste system memory. The Talend Job defaults are -Xms256MB and -Xmx1024MB. As well as some of your Jobs requiring more that 1024MB, some will require less that 256MB. This utility will allow you to observe the peak memory usage and to tune accordingly.
For more information on Java Runtime memory reporting, read http://docs.oracle.com/javase/7/docs/api/java/lang/Runtime.html.
Used memory is totalMemory - freeMemory. Percentages are based on used memory vs. maxMemory.
Watch the recorded webinar!
Pick up some tips and tricks with Context Variables
Learn how media organizations have achieved success with Data Integration
Look at6 ways to start utilizing Machine Learning with Amazon We Services and Talend