Combine two flows with out a key

Four Stars

Combine two flows with out a key

Hi,

I want to join two files with out a key , few columns from a one flow and few columns another flow and make one flow as output with all these selected columns. Instead of giving sequence to these flows and join on the sequence , is there any best approach in Talend?

Ex:
File1;
Column1,column2

File2;
Column3

Output;
Column1,column3
Employee

Re: Combine two flows with out a key

Hi,

 

    A quick query is whether you are trying to do Cartesian product of input data?

 

    If the answer is no, then you will need some keys to join between two data flows. If you are trying to join based on record number, then sequence itself is the best method.

 

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved

Four Stars

Re: Combine two flows with out a key

HI Nikhil,

i had split the flow into two for transformations on one flow and trying to
combine the two flows again, so i would not expect Cartesian product of the
records. I'm from Abinitio ETL tool background where i use Fuse component
to do such join with out a key. Is there any component in Talend or work
around to achieve this?

Thanks
Employee

Re: Combine two flows with out a key

Hi,

 

    The best way in this situation is to add a key identifier column during data split area. In the next subjob when you are joining them again, you can use this key identifier to get the matching records. I personally use numeric sequence if there are no business keys available from the source.

 

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog