[Data integration] Compare data from two tDBinput

Four Stars

[Data integration] Compare data from two tDBinput

Hi,

 

Sorry if I don't post in the right place but I'm new with Talend. 

 

For my problem, I have two tDBinput which return an identifiant, an act and the date of the act. (Each input are for different databases)

I have to compare the result of my Inputs but I don't know how to do that.

Indeed, for an exemple of data I have :

 

Input A :

Identifiant : 1

Act : Y - 01/01/2018

        Z - 02/01/2018

 

Input B :

Identifiant : 1

Act : Y - 01/01/2018

        Y - 01/01/2018

        Z - 02/01/2018

        K - 05/05/2018

 

The filter that I should create have to return : Y - 01/01/2018 (Cause I have 2 in input B but only one in input A) and K-05/05/2018 because it exist in input B but not in Input A.

 

I don't find how to do that, I don't know if it is possible

 

Can you help me please ? 

 

Regards,

 

(Sorry for my english level)

 

Ten Stars

Re: [Data integration] Compare data from two tDBinput

You have to place a step before the actual matching:
Aggregate first and count:
Input A:
Act : Y - 01/01/2018 - 1
Z - 02/01/2018 - 1
Input B:
Act : Y - 01/01/2018 - 2
Z - 02/01/2018 - 1
K - 05/05/2018 - 1

Assuming in your given example Input B contains all of the data. Perform a left/right join and catch non matching records. Use the tMap component and read the documentation too Smiley Wink)
Pretty easy I think.
Four Stars

Re: [Data integration] Compare data from two tDBinput

Thanks for you answer, I'm ok now with the tmap but I have a problem with the agregate and count my acte.

Indeed, insteead of have result like :

Act :

Y - 01/01/2018 - 1|| Identifiant
Z - 02/01/2018 - 1|| Identifiant
Input B:
Act : Y - 01/01/2018 - 2 || Identifiant
Z - 02/01/2018 - 1|| Identifiant
K - 05/05/2018 - 1|| Identifiant

 

I have something like 

Input B:
Act : Y - 01/01/2018 || Identifiant || Identifiant
Z - 02/01/2018 || Identifiant
K - 05/05/2018 || Identifiant

 

When I try to list. And count function give me an error cause of the format of input... 

 

I have something like that in my taggregateRow : (IEP is the identifiant)

 

and my data are :

act : YYYY60001-04/03/2018

ident : 214229241

 

Did I miss something ?

 

 

Four Stars

Re: [Data integration] Compare data from two tDBinput

Hi,

 

I resolve my problem and now I have row1's data like :

A|ZCQJ00101-02/08/2018x1
A|JKHD00101-02/08/2018x1
A|ZCQM00101-02/08/2018x1 

where Ais my ident.

 

For row2 I have this :

A|ZCQJ00101-02/08/2018x1
A|JKHD00101-02/08/2018x1
A|ZCQM00101-02/08/2018x1

 

So tmap should return me : A|JQQM01001-06/08/2018x1

 

 

Row1 is the main output with all my data and Row2 is my lookup.

 

On the tmap, I set as inner join, and I set "Catch output inner join" as yes for the output. 

After that, take the "rejet" output in a tlogrow. 

Instead of have only one row, this return me all the rows from my row1tmap.PNG

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 2

Part 2 of a series on Context Variables

Blog

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog