Equivalent to "globalMap" in the new component kit

Highlighted
Six Stars

Equivalent to "globalMap" in the new component kit

Hi, i m new to  developing  Talend components using the new component kit.

There is an equivalent to "globalMap" in the new component kit.that helps mainly to access connection,keystore and components into another component.

 

regards.


Accepted Solutions
Employee

Re: Equivalent to "globalMap" in the new component kit

Hello @Bilel.Charradi ,

 

Not currently for two main reasons:

 

1. In a big data execution you wouldn't know which components are colocated or not so this information can be misleading

2. We try to ensure component are interoperable so they shouldn't assume what is after or before them

 

However you can always compensate this information either by some state in a service or (better) by some additional advanced configuration in each component.

 

Romain

Romain
Talend Component Kit Documentation: https://talend.github.io/component-runtime/

All Replies
Employee

Re: Equivalent to "globalMap" in the new component kit

Hi @Bilel.Charradi ,

 

There is not such a concept because the kit enables to deploy component into the Studio and Big Data cluster where the computation is distributed so any "local" storage wouldn't work.

 

If you want to share between components of the same family some data, you can use a @Service bean which will act as a local storage (don't forget to either use some reference counting pattern or eviction timeout to not keep data forever). If you really want to share data between any component, you must store it elsewhere and read it from there (like an external storage or in memory data grid/cache).

Romain
Talend Component Kit Documentation: https://talend.github.io/component-runtime/
Six Stars

Re: Equivalent to "globalMap" in the new component kit

hi @rmannibucau 

 

thank you for your help, there is a way to be used in the service bean to get the list of actual components used in the actual job.

 

Employee

Re: Equivalent to "globalMap" in the new component kit

Hello @Bilel.Charradi ,

 

Not currently for two main reasons:

 

1. In a big data execution you wouldn't know which components are colocated or not so this information can be misleading

2. We try to ensure component are interoperable so they shouldn't assume what is after or before them

 

However you can always compensate this information either by some state in a service or (better) by some additional advanced configuration in each component.

 

Romain

Romain
Talend Component Kit Documentation: https://talend.github.io/component-runtime/

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Have you checked out Talend’s 2019 Summer release yet?

Find out about Talend's 2019 Summer release

Blog

Talend Summer 2019 – What’s New?

Talend continues to revolutionize how businesses leverage speed and manage scale

Watch Now

6 Ways to Start Utilizing Machine Learning with Amazon We Services and Talend

Look at6 ways to start utilizing Machine Learning with Amazon We Services and Talend

Blog