[Data integration] Compare data from two tDBinput

Four Stars

[Data integration] Compare data from two tDBinput

Hi,

 

Sorry if I don't post in the right place but I'm new with Talend. 

 

For my problem, I have two tDBinput which return an identifiant, an act and the date of the act. (Each input are for different databases)

I have to compare the result of my Inputs but I don't know how to do that.

Indeed, for an exemple of data I have :

 

Input A :

Identifiant : 1

Act : Y - 01/01/2018

        Z - 02/01/2018

 

Input B :

Identifiant : 1

Act : Y - 01/01/2018

        Y - 01/01/2018

        Z - 02/01/2018

        K - 05/05/2018

 

The filter that I should create have to return : Y - 01/01/2018 (Cause I have 2 in input B but only one in input A) and K-05/05/2018 because it exist in input B but not in Input A.

 

I don't find how to do that, I don't know if it is possible

 

Can you help me please ? 

 

Regards,

 

(Sorry for my english level)

 

Ten Stars

Re: [Data integration] Compare data from two tDBinput

You have to place a step before the actual matching:
Aggregate first and count:
Input A:
Act : Y - 01/01/2018 - 1
Z - 02/01/2018 - 1
Input B:
Act : Y - 01/01/2018 - 2
Z - 02/01/2018 - 1
K - 05/05/2018 - 1

Assuming in your given example Input B contains all of the data. Perform a left/right join and catch non matching records. Use the tMap component and read the documentation too Smiley Wink)
Pretty easy I think.
Four Stars

Re: [Data integration] Compare data from two tDBinput

Thanks for you answer, I'm ok now with the tmap but I have a problem with the agregate and count my acte.

Indeed, insteead of have result like :

Act :

Y - 01/01/2018 - 1|| Identifiant
Z - 02/01/2018 - 1|| Identifiant
Input B:
Act : Y - 01/01/2018 - 2 || Identifiant
Z - 02/01/2018 - 1|| Identifiant
K - 05/05/2018 - 1|| Identifiant

 

I have something like 

Input B:
Act : Y - 01/01/2018 || Identifiant || Identifiant
Z - 02/01/2018 || Identifiant
K - 05/05/2018 || Identifiant

 

When I try to list. And count function give me an error cause of the format of input... 

 

I have something like that in my taggregateRow : (IEP is the identifiant)

 

and my data are :

act : YYYY60001-04/03/2018

ident : 214229241

 

Did I miss something ?

 

 

Four Stars

Re: [Data integration] Compare data from two tDBinput

Hi,

 

I resolve my problem and now I have row1's data like :

A|ZCQJ00101-02/08/2018x1
A|JKHD00101-02/08/2018x1
A|ZCQM00101-02/08/2018x1 

where Ais my ident.

 

For row2 I have this :

A|ZCQJ00101-02/08/2018x1
A|JKHD00101-02/08/2018x1
A|ZCQM00101-02/08/2018x1

 

So tmap should return me : A|JQQM01001-06/08/2018x1

 

 

Row1 is the main output with all my data and Row2 is my lookup.

 

On the tmap, I set as inner join, and I set "Catch output inner join" as yes for the output. 

After that, take the "rejet" output in a tlogrow. 

Instead of have only one row, this return me all the rows from my row1tmap.PNG

Four Stars

Re: [Data integration] Compare data from two tDBinput

Hi,

 

I resolve my problem and now I have row1's data like :

A|ZCQJ00101-02/08/2018x1
A|JKHD00101-02/08/2018x1
A|ZCQM00101-02/08/2018x1 

where A is my identifiant.

 

For row2 I have this :

A|ZCQJ00101-02/08/2018x1
A|JKHD00101-02/08/2018x1
A|ZCQM00101-02/08/2018x1

 

So tmap should return me : A|JQQM01001-06/08/2018x1

 

 

Row1 is the main output with all my data and Row2 is my lookup.

 

On the tmap, I set as inner join, and I set "Catch output inner join" as yes for the output. 

After that, take the "rejet" output in a tlogrow. 

Instead of have only one row, this return me all the rows from my row1tmap.PNG