How to apply rules on certain fields for multiple jobs in Talend

Highlighted
Seven Stars

How to apply rules on certain fields for multiple jobs in Talend

Hi,

 

I have some validations like date format, string length and alphanumeric check that I need to apply on certain fields in multiple jobs. I don't want to use tMap filter expression for that because that will not provide me the exact reason due to which the record is rejected.

 

I there any way to achieve this in Talend ?

 

Best Regards,

 

Abhishek Kumar

Highlighted
Sixteen Stars
Sixteen Stars

Re: How to apply rules on certain fields for multiple jobs in Talend

Hi,

tFilterRow (with basic or advanced settings) may help for that in most cases.

You may also use tJavaRow.

In this case consider to add a field in the output flow in which you'll indicate the reject code if any. 

Then you'll be able to filter (tFilterRow again) rows to be rejected.

Also, if you want to centralize the validation code, consider to use routines.

Hope this helps.


TRF

2019 GARTNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog