How to replicate then unite

Employee

How to replicate then unite

Hi Talend community,
We are often asked "how to split a data flow and then merge it again?". For example, you can read:
- 5389
- 5717
The tip I'm describing right now works only with Perl (as mhirt confirmed it was not working for Java in his note on 5717).
You have to activate tArray/tArrayIn in menubar button "Project settings", Palette settings. The trick is to use the same array name in tArray_1 and tArray_2. I've created this example with Talend Open Studio 3.0.1.
Highlighted
One Star

Re: How to replicate then unite

Hi,
Does the tArray component store data in FileSystem to avoid memory problems? Can we use instead tHash components?
Regards,
Youssef
Employee

Re: How to replicate then unite

Does the tArray component store data in FileSystem to avoid memory problems?

No. If you want to use filesystem to avoid memory issues, use tFileOutput* :-)
Can we use instead tHash components?

Currently, there is no tHash for users with Perl (tHash, tAvancedHash are purely internal components, used by other component, tMap in particular).
One Star

Re: How to replicate then unite

What is the resolution for this in a 3.1 Java Job. Should we use mulitple tBufferOutputs and 1 tBufferInput to read it within the same job.
Thanks for your help.
Community Manager

Re: How to replicate then unite

Hello
What is the resolution for this in a 3.1 Java Job. Should we use mulitple tBufferOutputs and 1 tBufferInput to read it within the same job.

Yes, you do that. You can download the tuj in 5389 and import it to your project.
Best regards

shong
----------------------------------------------------------
Talend | Data Agility for Modern Business

Calling Talend Open Studio Users

The first 100 community members completing the Open Studio survey win a $10 gift voucher.

Start the survey

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

How Media Organizations Achieved Success with Data Integration

Learn how media organizations have achieved success with Data Integration

Read

Definitive Guide to Data Quality

Create systems and workflow to manage clean data ingestion and data transformation.

Download