One Star

multiple inputs for components tAggregateRow, tSortRow and tUniqRow

Hi,
can wa have multiple inputs for the tAggregateRow, tSortRow and tUniqRow?
For example if I need to aggregate/sort/remove duplicates data from various input files. Must they be concatenated in one file before doing these operations?
3 REPLIES
Employee

Re: multiple inputs for components tAggregateRow, tSortRow and tUniqRow

Hi,
can wa have multiple inputs for the tAggregateRow, tSortRow and tUniqRow?
For example if I need to aggregate/sort/remove duplicates data from various input files. Must they be concatenated in one file before doing these operations?

To make the answer clear: currently (TOS branch 1.1), only the tMap component handles mutliple inputs.
In the (near, I hope) future, we'll have a tUnion (or tMerge) to make this kind of operation.
For now, you indeed have to have to merge content in a single file a read.
One Star

Re: multiple inputs for components tAggregateRow, tSortRow and tUniqRow

Ok to merge the content in a single file. Is there any issue having different outputs writing to the same file within the same job?
Is it wiser creating as much jobs apendind to one file?
Employee

Re: multiple inputs for components tAggregateRow, tSortRow and tUniqRow

My advise is to use sub-jobs with "Run Before" link between them. In the post associated screenshot, tFOD1 and tFOD2 have the "Append" property enabled.