We are using Talend for data processing. At the moment we are at the stage of reading input csv files.
We need to check the design for data quality: does the system capable of identifying typos in the files: wrong headers, missed commas etc? How to create a test case, which will confirm that the system can catch wrong inputs?
Default unit testing in Talend can only allow comparing an output of the job (https://help.talend.com/reader/Z6nEoVnqAU2j~MFxYHYeOg/Vjz9SwNFz0TcEIkvQeNX2Q), but we have the error message as the desired output, where can I find the design for this kind of test?
Actually the test case only need a tAssert with a condition on it, which fetches the execution status information from repository, Job execution and based on its pre-defined schema
As long as you can catch the error, and set a variable to false.. you should be able to set the value in the tAssert later.
Let us know if it is what you are looking for.
Talend named a Leader.
Kickstart your first data integration and ETL projects.
Learn how to enable Data Governance
Take a peek at the definitive guide to Government Data Quality