The Definitive Guide to Data Quality
It is a great component that helps us to monitor the memory usage of a running job. It will be better if the component can output the memory information to a log file.
Monitor the memory usage of your running Job, with tMemoryMonitor
Information on the used, total and maximum (see -Xmx) memory of the Java runtime, are written to standard output or, if a warning threshold is reached, to standard error.
Options include ‘Enabled’, ‘Interval’ (milliseconds) and ‘Warning Threshold Percent %’.
Used in conjunction with your own diagnostic messages, this component will help you to identify where memory is being used within your Job an help you to avoid Out of Memory (OOM) Exceptions.
As well as ensuring that your Job has enough memory, you’ll also want to make sure that you do not waste system memory. The Talend Job defaults are -Xms256MB and -Xmx1024MB. As well as some of your Jobs requiring more that 1024MB, some will require less that 256MB. This utility will allow you to observe the peak memory usage and to tune accordingly.
For more information on Java Runtime memory reporting, read http://docs.oracle.com/javase/7/docs/api/java/lang/Runtime.html.
Used memory is totalMemory - freeMemory. Percentages are based on used memory vs. maxMemory.
Talend named a Leader.
Kickstart your first data integration and ETL projects.
Part 2 of a series on Context Variables
Learn how to do cool things with Context Variables
Find out how to migrate from one database to another using the Dynamic schema