Talend Connect
Virtual Summit
JOIN US!
And visit the Customer
& Community Lounge.
May 27-28, wherever you are.

Concatenating Rows and Columns (Unions & Joins)

Highlighted
One Star

Concatenating Rows and Columns (Unions & Joins)

Hi,
In addition to the existing processing nodes two more for joining columns (supporting all SQL JOIN types) and functionality for concatenating rows creating UNION like functionality for loading data from multiple sources and merging the datasets for further processing would be helpful.
Is there anything like this that I have missed? By the way your ELT functionality for MySQL and Oracle is very interesting. Are any more ELT processing components on the way for these databases?
Best Regards,
Jay
Highlighted
One Star

Re: Concatenating Rows and Columns (Unions & Joins)

Hi,
I know that I can do inner and (unchecked inner) for left outer joins? I have used those successfully. Are any other joins supported?
Is there a way to concatenate multiple tables or files together? Is tUniqueRow the best way to check for an remove duplicates?
Thanks,
Jay
Highlighted
Employee

Re: Concatenating Rows and Columns (Unions & Joins)

I know that I can do inner and (unchecked inner) for left outer joins? I have used those successfully. Are any other joins supported?

Not yet outside of ELT components.
Is there a way to concatenate multiple tables or files together?

Not yet but see 425 and related 944, work is currently in progress. We should distribute a solution in TOS 2.1.0 (july 2007).
Is tUniqueRow the best way to check for an remove duplicates?

tUniqueRow doesn't "check", it only "skip" duplicates. In the near future, you'll be able to link an output component to tUniqueRow reject flow. See 1071.
Highlighted
One Star

Re: Concatenating Rows and Columns (Unions & Joins)

I know this is an old message but I think Jay is trying to do the same as I want to. I have two CSV log files from two different days (ie they have the same column names) and I just want to combine them together. Is that possible yet?
Highlighted
Seven Stars

Re: Concatenating Rows and Columns (Unions & Joins)

When schemas are identical, use tUnite to merge 2 flows.

Josh
Highlighted
One Star

Re: Concatenating Rows and Columns (Unions & Joins)

Brilliant thanks... is there a way to do that if you have many files ... I've got about 50.
Highlighted
Community Manager

Re: Concatenating Rows and Columns (Unions & Joins)

Hello
Brilliant thanks... is there a way to do that if you have many files ... I've got about 50.

Using tFileList to iterate each file and merge them with tUnite, for exampe:
tFileList--iterate--tFileInputDelimited--tUnite--tMysqlOutout.
Best regards
Shong
----------------------------------------------------------
Talend | Data Agility for Modern Business
Highlighted
One Star

Re: Concatenating Rows and Columns (Unions & Joins)

great thanks!
Highlighted
One Star

Re: Concatenating Rows and Columns (Unions & Joins)

Hello! I am new to Talend. Could any one give me some help about the following problem?
From table A:
111 red
111 blue
111 grey
222 yellow
222 blue
I want to get table B:
111 red,blue,grey
222 yellow, blue
Highlighted
Four Stars

Re: Concatenating Rows and Columns (Unions & Joins)

Hi
We can achieve this with tDenormalize. Please see the below snippet. Use Sort if you need the results to be sorted.
Highlighted
One Star

Re: Concatenating Rows and Columns (Unions & Joins)

You posted a very helpful information. I could finally fix my challenge. Great work guysSmiley Happy
Highlighted
One Star

Re: Concatenating Rows and Columns (Unions & Joins)

Thanks!
Very helpful post.

2019 GARTNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

Best Practices for Using Context Variables with Talend – Part 2

Part 2 of a series on Context Variables

Blog

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog