Issue with special character in tFileOutputDelimeted component

Highlighted
Seven Stars

Issue with special character in tFileOutputDelimeted component

Hi, 

 

I am extracting a query result to tFileOutputDelimeted component(.csv file).

 

String has to be "can't" but, it is saving in .csv file as "can?t". Why am I getting this?

 

Can anyone help me out?

Thanks in advance,

Meghana.


Accepted Solutions
Seven Stars

Re: Issue with special character in tFileOutputDelimeted component

The issue has been solved. Changed encoding to UTF-16 and it is working. Thanks for the reply.

 

Thanks,

Meghana.


All Replies
Eight Stars

Re: Issue with special character in tFileOutputDelimeted component

Hi @MeghanaKottala,

Can you pls share a sample input data and also can you also share the job screenshot with result such that Community can look into the issue you are facing?

Pls do get back to Community,if necessary.

Thanks,

Ankit.

Seven Stars

Re: Issue with special character in tFileOutputDelimeted component

Here is the screenshot.

 

The query results in one string column which has result like this "youíve" and when I run this job, I am getting the result as "you?ve".

 

Am I clear

Eleven Stars

Re: Issue with special character in tFileOutputDelimeted component

Try to change the encoding to ISO-8859-15
Regards
Abhishek KUMAR
Seven Stars

Re: Issue with special character in tFileOutputDelimeted component

I am using the same

 

Thanks,

Meghana

Seven Stars

Re: Issue with special character in tFileOutputDelimeted component

When you say it is "saving as can?t", what do you mean? Is it literally a question mark in the output file, or is the reading method converting a character that it doesn't understand into a question mark? How are you viewing the output?

 

I suspect that your input isn't "can't", I bet it is "can’t" (which has a typographical apostrophe, rather than the plain ASCII apostrophe). ISO8859-15 does not have typographical or “directional” quotes, so it can't be written using that encoding.

 

Using a larger font, ' is ASCII, but  is not, and is not supported by ISO8859 character sets.

https://practicaltypography.com/straight-and-curly-quotes.html

Seven Stars

Re: Issue with special character in tFileOutputDelimeted component

The issue has been solved. Changed encoding to UTF-16 and it is working. Thanks for the reply.

 

Thanks,

Meghana.

What’s New for Talend Spring ’19

Watch the recorded webinar!

Watch Now

Agile Data lakes & Analytics

Accelerate your data lake projects with an agile approach

Watch

Definitive Guide to Data Quality

Create systems and workflow to manage clean data ingestion and data transformation.

Download

Tutorial

Introduction to Talend Open Studio for Data Integration.

Watch