The Definitive Guide to Data Quality
The problem here is that when I make changes to the final table schema, I need to go back and fix it in each tMap (there are a lot of them).
I am looking for a way to map all of the incoming files in the same step. This way they all use the same output table and changes only need to be made in one place. Is this possible?
I briefly thought of doing the tUnite first, which would then result in a lot of empty fields, and then creating a function to pick out the non-null input fields to be mapped to the output field, but this would probably not be great for performance.