I have several million EDI records that I'm mapping to flat files, and I'm having trouble getting the data validation in the Hierarchical Mapper to work. We are only interested in records that have the RecordType segment = P (Production), so I created a rule in the Validate tab of the Mapper saying that RecordType must equal 30. When I run the job, it flags any invalid records, but it still processes them and includes them in the output, which isn't what I want. I've tried using the ValidateGroup and ValidationReport functions, but the documentation on them isn't clear, and my job either didn't compile, or it didn't make any difference. How can I exclude invalid records so that the Mapper doesn't include them in its output? Thanks.
Solved! Go to Solution.
Talend named a Leader.
Kickstart your first data integration and ETL projects.
Learn how to do cool things with Context Variables
Find out how to migrate from one database to another using the Dynamic schema
Pick up some tips and tricks with Context Variables