Four Stars

Validate data and export errror

Hi everyone,

I have a data row with thounsand columns, I 'm checking if each column have right data by tSchemaComplianceCheck (check length and data type).

Now I want to export if any column have error data. Some informations i want to export are:
+ value of key column

+ the name of error column

+ the error data

+ the error message, if a column have more than one error(invalid length and datatype), the error messages are sepatated with comma.

Each error column is exported to one row.

Can you give me some solution ?

Thank all.

  • Data Integration
2 REPLIES
Five Stars

Re: Validate data and export errror

hey, 

 

what is the source you are getting the data from? DB , csv etc

Four Stars

Re: Validate data and export errror

I'm getting data from DB Redshift and export error to CSV file