Séparator check

Highlighted
Six Stars

Séparator check

Hello,

I want to do a separator check in an incoming CSV file, for example, if I have a separator other than";" I reject the file, otherwise I continue my processing.

 

Big Thanks

Tags (1)
Employee

Re: Séparator check

Hi,

 

    You will have to count the ";" separator if you would like to validate whether the record is matching the schema. But this means you will have to read the file twice one as full row and another in delimited format. So I would not suggest this method for big volumes.

 

      Another interesting method is to read the data and pass it to tFileComplianceCheck  component. This is a better idea since you can segregate the good and bad records separately. I would suggest you to create a sample job and test your use case.

 

If the answer has helped you, could you please mark the topic as resolved? Kudos are also welcome :-)

 

Warm Regards,

 

Nikhil Thampi

2019 GARTNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

Have you checked out Talend’s 2019 Summer release yet?

Find out about Talend's 2019 Summer release

Blog

Talend Summer 2019 – What’s New?

Talend continues to revolutionize how businesses leverage speed and manage scale

Watch Now

6 Ways to Start Utilizing Machine Learning with Amazon We Services and Talend

Look at6 ways to start utilizing Machine Learning with Amazon We Services and Talend

Blog