Logging Exceptions along with Error Record Details during Data fetch.

One Star

Logging Exceptions along with Error Record Details during Data fetch.

Hi Team,
We are using Talend Open Studio for Big data V6.1.0 to move data from MongoDB to oracle. We need to catch the exceptions/ errors while data fetch (tMongoDBInput) along with the error record. We tried using tLogCatcher/tFlowMeterCatcher, it is providing only the error details and not the error record details. The rejected records along with the error message is available only during tOracleOutput (Row-->Rejects). Please help us if there is any way to log both the error details (mostly java exception) and error record details during data fetch itself.
Regards,
Jebas
Moderator

Re: Logging Exceptions along with Error Record Details during Data fetch.

Hi,
Is the error record details of "rejects" row from tOracleOutput not satisfying your needs? Have you already checked the option "Die on error" on tOracleOutput to catch the exception?
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: Logging Exceptions along with Error Record Details during Data fetch.

Hi Sabrina,
Thanks for your reply...
Rejects rows doesn't suffice our need, why because if a java exception is thrown during data fetch itself, that record is not getting processed and not getting flown to other components, hence there won't be any rejects during oracle insert. Only in logCatcher it is getting catch as java exception.
we haven't enabled dieOnError, as because we need to run the job even in case of any error and also if dieOnError is enabled, we won't get Rejects in OracleOutput rt?
Regards,
Jebas
One Star

Re: Logging Exceptions along with Error Record Details during Data fetch.

Hi Team,
please let us know, if there is any work around to capture error details along with error record during data fetch itself?
Regards,
Kingsly J
Moderator

Re: Logging Exceptions along with Error Record Details during Data fetch.

Hi Kingsly J,
So far, there is no "Rejects" row from tOracleInput.
Here is a global variable((String)globalMap.get("tOracleInput_1_ERROR_MESSAGE")) which is generated by the component when an error occurs.
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: Logging Exceptions along with Error Record Details during Data fetch.

Hi Sabrina,
Thanks for your update. Can you people please consider this option(logging error record details during fetch also) in your future builds?
Regards,
Jebas
Moderator

Re: Logging Exceptions along with Error Record Details during Data fetch.

Hi,
Feel free to create a new feature/work item jira issue on Talend Bug Tracker.
https://jira.talendforge.org/secure/Dashboard.jspa
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: Logging Exceptions along with Error Record Details during Data fetch.

Thank you Sabrina. Raised a jira ticket for the same.