Monitoring for Talend processes?

Four Stars

Monitoring for Talend processes?

Hi,

 

We are planning to setup monitoring for Talend servers and would like to know the list of standard and monitoring processes that are required for each of the following servers.

 

1. Data Preparation

2. Execution Servers

3. TAC

 

Thanks & Regards,

Srivignesh KN

Forteen Stars

Re: Monitoring for Talend processes?

sorry,

 

are You have already running Talend Server?

if yes,

what You want monitor in addition to build in? what is the unresolved problem? 

I do not try to tell You - all fine :-) but still need start from the problem.

 

-----------
Four Stars

Re: Monitoring for Talend processes?

Hi vapukov, 

 

Thanks for the reply.

 

Yes, i am running Talend server and trying to setup monitoring on this server in case of accidental restarts I want the Talend processes to start up automatically instead of manual interventions.

 

Appreciate your help.

Forteen Stars

Re: Monitoring for Talend processes?

it is old article, but from this time - not a lot of changes - https://dzone.com/articles/apache-camel-and-talend-esb

 

with subscription version - all more or less fine.

TAC - really self contained and include most of what You need for execute, manage and monitor Jobs

For monitor TAC it self (TomCat) we use ManageEngine


In case of restart Talend Server (what type of failures You mean?) - Talend continue normal work, if it not start automatically for any reasons - it mean 200% manual investigation, what happens?

 

 

the questions start when need monitor Community version, there need more works 


In my environments (and because many projects done on community version):
- Scheduler notify if Job finish with error

- Job send email for not important parts , Slack for something more operative, OpsGenie for extremely important jobs

- Also few live ping mechanisms realised:
      - routes send regular (not for each processed message) message to ActiveMQ topic

      - Jobs store some timestamp information in database (we use this information in other places)

and separate independent Job - regular check topic and database and compare delay, if delay more than expected - send alarm

 

Best regards.

-----------

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Definitive Guide to Data Quality

Create systems and workflow to manage clean data ingestion and data transformation.

Download

Tutorial

Introduction to Talend Open Studio for Data Integration.

Watch

Downloads and Trials

Test drive Talend's enterprise products.

Downloads