Row Level Errors with "File Delimited" and "TMap"

One Star

Row Level Errors with "File Delimited" and "TMap"

Hi, I am working on a proof of concept and am a new to Talend. I am working with 3.0.0.RC1_r17904 and Java mode.
I have been making steady progress and feel really good about Talend in general and I am working the learning curve.

I am doing a simple load from a pipe | delimited filed into a database table. Mostly a straight move and it is working fine until I hit some badly formated records in the file. My output now looks like this
[statistics] connected
Exception in component tMSSqlOutput_1
java.lang.IllegalArgumentException: Illegal group reference
at java.util.regex.Matcher.appendReplacement(Unknown Source)
at java.util.regex.Matcher.replaceFirst(Unknown Source)
at java.lang.String.replaceFirst(Unknown Source)
at ar.loadcust_0_1.LoadCust.tFileList_3Process(LoadCust.java:11190)
at ar.loadcust_0_1.LoadCust.tMSSqlRow_1Process(LoadCust.java:273)
at ar.loadcust_0_1.LoadCust.runJobInTOS(LoadCust.java:13822)
at ar.loadcust_0_1.LoadCust.main(LoadCust.java:13731)
[statistics] disconnected
Job LoadCust ended at 09:53 04/11/2008. [exit code=1]

I have attempted to add a second output to tMap for records with a format error, however they are apparently not getting trapped. Then the defective record causes the tMSSQlRow process to puke.

Do I need to do something with the expression filter for the output record?

Any ideas or suggestions would be most appreciated?
One Star

Re: Row Level Errors with "File Delimited" and "TMap"

Did you ever find a solution to this? I cannot get TOS to handle Oracle CLOBs--I keep getting "Illegal group reference". I believe it has to do with not handling embedded Carriage Return/Line Feeds in the source data (MySQL Text fields)....
Community Manager

Re: Row Level Errors with "File Delimited" and "TMap"

vjromeo wrote:
Did you ever find a solution to this? I cannot get TOS to handle Oracle CLOBs--I keep getting "Illegal group reference". I believe it has to do with not handling embedded Carriage Return/Line Feeds in the source data (MySQL Text fields)....

Hello
This issue have fixed in [Bug] 7556.

Best regards

shong
----------------------------------------------------------
Talend | Data Agility for Modern Business
One Star

Re: Row Level Errors with "File Delimited" and "TMap"

Are you sure that bug addresses the same problem? There's no mention of CLOB in bug 7556, and the error I'm getting in Talend is different from what is described there.

Calling Talend Open Studio Users

The first 100 community members completing the Open Studio survey win a $10 gift voucher.

Start the survey

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Agile Data lakes & Analytics

Accelerate your data lake projects with an agile approach

Watch

Definitive Guide to Data Quality

Create systems and workflow to manage clean data ingestion and data transformation.

Download

Tutorial

Introduction to Talend Open Studio for Data Integration.

Watch