Best way to combine tMap and tUnite?

One Star

Best way to combine tMap and tUnite?

Hi,
I have different formatted data coming from separate files that need to have column names changed / reordered and eventually joined into a similar schema.
Right now I have separate file inputs each going to their own tMap and then to a tUnite.
The problem here is that when I make changes to the final table schema, I need to go back and fix it in each tMap (there are a lot of them).
I am looking for a way to map all of the incoming files in the same step. This way they all use the same output table and changes only need to be made in one place. Is this possible?
I briefly thought of doing the tUnite first, which would then result in a lot of empty fields, and then creating a function to pick out the non-null input fields to be mapped to the output field, but this would probably not be great for performance.
Any ideas?
Thanks,
Steven
Moderator

Re: Best way to combine tMap and tUnite?

Hi,
The problem here is that when I make changes to the final table schema, I need to go back and fix it in each tMap (there are a lot of them).
I am looking for a way to map all of the incoming files in the same step. This way they all use the same output table and changes only need to be made in one place. Is this possible?
I briefly thought of doing the tUnite first, which would then result in a lot of empty fields, and then creating a function to pick out the non-null input fields to be mapped to the output field, but this would probably not be great for performance.

Could you please show us your current job design screenshots so that we can get your situation more precisely.
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: Best way to combine tMap and tUnite?


But I am not particular to this arrangement. What is key is that data needs to come from separate files with separate formats but joined into a common table schema. Right now it's going to excel but it will eventually go to a database.
Moderator

Re: Best way to combine tMap and tUnite?

Hi,
The function of tUnite is merging data from various sources, based on a common schema. If you need data from separate files with separate format but joined into a common table schema, Why don't you use another tMap to "Unite" them?
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: Best way to combine tMap and tUnite?

I was hoping to get this all accomplished with a single step (eg. a single tMap) so there would be one single place I need to go to make changes. Is that possible here given what I need?
Thanks.
One Star

Re: Best way to combine tMap and tUnite?

Hi,
I want to do PAN Card number validation ? This should be 10 characters in size and should have atleast 1 character and 1 number. My input file is Details.xls and output will be two file ,validePancard.xls containting valid no and other is invalid.xls file having wrong no.
Will you please suggest me which component should i use and how to do that?
Thank you in advance.
Moderator

Re: Best way to combine tMap and tUnite?

Hi,
Please give us your current tMap editor screenshots I have little confusion about your "change" (I need to go back and fix it in each tMap).
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: Best way to combine tMap and tUnite?

Thanks - I think I am okay for now.