Database output writes all null records

Highlighted
Five Stars

Database output writes all null records

Hello All,

 

I have a job that reads from PostgreSQL and writes to Netezza.

But all the records are NULL.

The connection option has been set to AutoCommit = ON

The DB output object is set to Die On Error = On

I get no errors.  Unless I add a tLogRow object.  Then every time I run it I get a the same error, but the column is different every time.

The error with the tLogRow object is: 

{random_field_name} cannot be resolved or is not a field.

My questions are:
1) Why aren't the records getting written with any data?

2) Why do I get that error when I attach a tLogRow, but the error goes away when I remove it?

I am still very much a n00b so any pointers you can give me would be appreciated!  :-)

 

Highlighted
Five Stars

Re: Database output writes all null records

Hi ,

Could you please try disabling the die on error option and collect the rejected records to a file and see whats the issue?

 

Thanks,

Kiran

Highlighted
Five Stars

Re: Database output writes all null records

Hi Kiran,

 

How do I collect rejected records?

 

Thanks.

Highlighted
Five Stars

Re: Database output writes all null records

Hello,

 

I looked up the instructions on how to do that and made sure that "Die on error" was not checked.

However, I can't find an option for Run=>Reject when I right click on the object.

Any ideas where I may be going wrong?

 

Thanks.

Highlighted
Five Stars

Re: Database output writes all null records

On the tdboutput component go to advanced settings and disbale batch size
as well ..then right click on output component and u will find link called
rejects
Highlighted
Five Stars

Re: Database output writes all null records

Hi Kiran,

 

Thanks, that worked.  But I am getting the attached error.

It is a different column nearly every time I run it.

 

Thanks.

Highlighted
Five Stars

Re: Database output writes all null records

Hi All,

 

Anyone have any thoughts as to what I am doing wrong that would cause this error?

 

Thanks.

Highlighted
Moderator

Re: Database output writes all null records

Hello,

Could you please check your "Code" tab in your job to see if there will be your compile error highlighted in red line? What's JDK version are you using?

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.

2019 GARTNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

Best Practices for Using Context Variables with Talend – Part 2

Part 2 of a series on Context Variables

Blog

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog