The Definitive Guide to Data Quality
What I would like to know is if it is possible to do a flat file to database table comparison using Talend DI. I want to be able to compare the flat file and the db table row by row and would like it to point out any difference in any row/column
What i wanted to confirm with you is that if i want any differences between flat file and db table to be caught, i need to link each of the 40 columns in the main and lookup right? If any of the columns are not linked then the data differences between them wont be captured in the reject. Correct? Please clarify.
Also, is there a way in DI where in i can generate a comparison report whih says how much % of data between 2 tables match? I did a bit of research and found out that i can do this in DQ. But, I wasnt able to find a way to import this job from DI in to DQ or create a new job in DQ for comparing flat file to table comparison and then generate a report out of it