unite more row fromfiles with differents schema in one unique txt file

Not applicable

unite more row fromfiles with differents schema in one unique txt file

hi to everyone
i have a problem with my job in talend:
every input file(txt file) have a different schema
tFileInputDelimited1
tFileInputDelimited2
tFileInputDelimited3
tFileInputDelimited4
tFileInputDelimited5
-------------------------
tFileOutputDelimited1
in output i want an output file that have rows with different number of columns
if i use tUnite but it's based on a common schema!!
are there some components that i can use?
help!
thanx
One Star

Re: unite more row fromfiles with differents schema in one unique txt file

Hi,
you can use tMap to join the datastreams.
If this will not help ypu: Can you give us more information / one example?
Bye
Volker
One Star

Re: unite more row fromfiles with differents schema in one unique txt file

Maybe the best way is to use a tmap to modify your schema by selecting/renaming fields . After when you have exactly the same schema for each one, you can use a tUnite.
Not applicable

Re: unite more row fromfiles with differents schema in one unique txt file

yes, but i think that i can't use a tMap because i want to take that schema for each file, for example the largest row have 50 columns, and then the second have 30...and then 4column..ecc
if i change the schema of each file, in output for a file that have 4 columns i'll have the first 4 columns and then all the remaining rows until 50 it'll be empty like ;;;;;;;;;;; --but i don't want this
example:
FirstFile.txt
A;talend;20080101;0;
SecondFile.txt
B;3;20070428;talend;myExample;
ThirdFile.txt
C;29929992;tom;jerry;20080104;9939939939;talend;44433222;0;004;john;
FourthFile.txt
D;24;
FifthFile.txt
E;24;
MyOutputFile.txt
A;talend;20080101;0;
B;3;20070428;talend;myExample;
C;29929992;tom;jerry;20080104;9939939939;talend;44433222;0;004;john;
D;24;
E;24;

thank y very much
PS: i was thinking about this way, with the tUnite i can try to tell to talend that the separator is "|" but if i use this ";" like separator symbol ,Talend it will read all the rows of each file like one row because it can't find the separator and so the job is done!!!
i tried to do this but the tUnite it doesn't permit me to link to himself more than one tFileInputDelimited,maybe because i didn't fix a common schema?!!!
One Star

Re: unite more row fromfiles with differents schema in one unique txt file

For me it looks like you have not dependencies in your data(?)
If so, I would suggest you handle each file with one job and join them on line level (tFileInputRegex with "^(.*)$").
Bye
Volker

Calling Talend Open Studio Users

The first 100 community members completing the Open Studio survey win a $10 gift voucher.

Start the survey

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

How Media Organizations Achieved Success with Data Integration

Learn how media organizations have achieved success with Data Integration

Read

Tutorial

Introduction to Talend Open Studio for Data Integration.

Watch