DBOutput Components: how to log errors without force it to fail

Highlighted
Seven Stars

DBOutput Components: how to log errors without force it to fail

Hello,

I have a tPostgresqlOutput that perform some insert statements. 

Sometime it fails because of different reasons (related to constraint violations), and I wouldn't previously filter rows that are not good to be inserted.

I have set the tPostgresqlOutput component NOT to fail on error, and I would now be able to catch all bad rows (to log them, at least). 

Is it possible and how?

 

Regards,

Lorenzo 


Accepted Solutions
Highlighted
Moderator

Re: DBOutput Components: how to log errors without force it to fail

Hello,

The "Rejects" row will be available when you uncheck "Use Batch Size" option in advanced settings of tPostgresqlOutput component.

1.png

Best regards

Sabrina

 

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.

View solution in original post


All Replies
Highlighted
Six Stars

Re: DBOutput Components: how to log errors without force it to fail

I know that we can catch tMap errors without having the job to fail.
https://www.rilhia.com/quicktips/quick-tip-how-debug-tmap-errors
See if this link can help.
~ ````Please don't forget to give "kudos" when a reply is helpful and click "Accept the solution" when you think you're good with it. Thanks! ~
Highlighted
Moderator

Re: DBOutput Components: how to log errors without force it to fail

Hi,


@Lorenzo wrote:

Hello,

I have a tPostgresqlOutput that perform some insert statements. 

Sometime it fails because of different reasons (related to constraint violations), and I wouldn't previously filter rows that are not good to be inserted.

I have set the tPostgresqlOutput component NOT to fail on error, and I would now be able to catch all bad rows (to log them, at least). 

Is it possible and how?

 

Regards,

Lorenzo 


Are you looking for "Rejects" row from tPostgresqlOutput?

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Highlighted
Seven Stars

Re: DBOutput Components: how to log errors without force it to fail

Hi @xdshi

 

YES! I'm looking for something like "row rejected". I don't find it in the tPostgresqlOutput Component.

Where is it?

 

Regards,

Lorenzo

Highlighted
Moderator

Re: DBOutput Components: how to log errors without force it to fail

Hello,

The "Rejects" row will be available when you uncheck "Use Batch Size" option in advanced settings of tPostgresqlOutput component.

1.png

Best regards

Sabrina

 

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.

View solution in original post

2019 GARTNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

Best Practices for Using Context Variables with Talend – Part 2

Part 2 of a series on Context Variables

Blog

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog