Using tReplicate with tUnite

Six Stars

Using tReplicate with tUnite

Hi,

I need to split a dataset using tReplicate and then rejoin them using tUnite. I've seen that Talend doesn't allow this in  a SubJob so I thought I could try separating them by using the tReplicate in one Subjob & then using tUnite in another Subjob.

I can get them to connect but I wondered why this job isn't running?

The below snapshot of my Job shows the components starting at the 2 tMaps that split address types, then the duplicates are removed, I then wanted to end the Subjobs there before I use the tBufferInput components and then append the data using the tUnite component.

The error I get at the second tBufferInput (After the OnComponentOk) is "A component that is not a subprocess start can not have any link on component ok / on component error in input".

I think this refers to the same issue but I'm not sure.

My question is, can I use a second subjob to allow the rejoining of my 2 datasets using this method, or is there another way?

Thanks 

  

  Loop.GIF


Accepted Solutions
Sixteen Stars TRF
Sixteen Stars

Re: Using tReplicate with tUnite

You can't join 2 flows which have been separated in the same flow and you cannot have mode than 1 starting component for the same subjob. 

Consider the following design instead of yours:

capture.png


TRF

View solution in original post

Sixteen Stars TRF
Sixteen Stars

Re: Using tReplicate with tUnite

tHashOutput allow you to have records in memory and tHashInput are used to read these records.

A tHashInput is linked to the tHashOutput of your choice.

You just have to copy manually the schema from the tHashOutput to the tHashInput and that's all.

In your case tHashOutput components must be placed after tUniq components.

The right part of your job must be redesigned as proposed in my example.


TRF

View solution in original post


All Replies
Sixteen Stars TRF
Sixteen Stars

Re: Using tReplicate with tUnite

You can't join 2 flows which have been separated in the same flow and you cannot have mode than 1 starting component for the same subjob. 

Consider the following design instead of yours:

capture.png


TRF

View solution in original post

Six Stars

Re: Using tReplicate with tUnite

Thanks TRF,

Could you explain the steps you've taken in order so I can follow your Job?

I haven't used HashInput yet & I don't get how they work in a Job.

Thanks  

Sixteen Stars TRF
Sixteen Stars

Re: Using tReplicate with tUnite

tHashOutput allow you to have records in memory and tHashInput are used to read these records.

A tHashInput is linked to the tHashOutput of your choice.

You just have to copy manually the schema from the tHashOutput to the tHashInput and that's all.

In your case tHashOutput components must be placed after tUniq components.

The right part of your job must be redesigned as proposed in my example.


TRF

View solution in original post

Six Stars

Re: Using tReplicate with tUnite

Thanks TRF,

I'll give it a go.

Cheers

2019 GARTNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog

Put Massive Amounts of Data to Work

Learn how to make your data more available, reduce costs and cut your build time

Watch Now

How OTTO Utilizes Big Data to Deliver Personalized Experiences

Read about OTTO's experiences with Big Data and Personalized Experiences

Blog