Remote Engine Cluster - what is the benefits?

Four Stars

Remote Engine Cluster - what is the benefits?

It is mentioned that:

"Currently it is not possible to configure failover and load balacing relationships between Remote Engines."

 

https://help.talend.com/reader/KURIhO59_QJaiOB3xHeUJw/fhew8t_ZQKQPtsLbnVIxaw

 

So, then what is the main purpose of using cluster? is it only for grouping remote engines?


Accepted Solutions
Six Stars

Re: Remote Engine Cluster - what is the benefits?

The task will run in the first Remote Engine avaiable. It's used for failover and a litle bit "loadbalancing".

 

For exemple if you had 3 remote engine & two task

 

We have a queue of Remote

  1. Remote 1
  2. Remote 2
  3. Remote 3

 

First Task : Assign to the first Remote --> The queue order change to promote Remote Engine not used

 

  1. Remote 2
  2. Remote 3
  3. Remote 1 : Task 1 runing

The second task will execute in Remote 2 and then the queue order change for next task

 

  1. Remote 3
  2. Remote 1  : Task 1 runing
  3. Remote 2  : Task 2 runing

View solution in original post


All Replies
Six Stars

Re: Remote Engine Cluster - what is the benefits?

Hey Farid,

 

you can create a Cluster with Talend Remote Engine

 

Image 1564.png

Four Stars

Re: Remote Engine Cluster - what is the benefits?

Hi Pierre,

 

thanks for your reply. But what will be the benefit of using "Remote Engine Cluster"? Will they do the same task twice? or will there be load balancing? of active-passive engines?

Six Stars

Re: Remote Engine Cluster - what is the benefits?

The task will run in the first Remote Engine avaiable. It's used for failover and a litle bit "loadbalancing".

 

For exemple if you had 3 remote engine & two task

 

We have a queue of Remote

  1. Remote 1
  2. Remote 2
  3. Remote 3

 

First Task : Assign to the first Remote --> The queue order change to promote Remote Engine not used

 

  1. Remote 2
  2. Remote 3
  3. Remote 1 : Task 1 runing

The second task will execute in Remote 2 and then the queue order change for next task

 

  1. Remote 3
  2. Remote 1  : Task 1 runing
  3. Remote 2  : Task 2 runing

View solution in original post

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Talend Cloud Developer Series – Defining Metadata

This video focuses on different methods of adding metadata to a job in Talend Cloud

Watch Now

Talend Cloud Developer Series – Updating Context Variables

This video will show you how to add context parameters to a job in Talend Cloud

Watch Now

Talend Cloud Developer Series – Deploying First Job to Cloud

This video will show you how to run a job in Studio and then publish that job to Talend Cloud

Watch Now