Issue with special character in tFileOutputDelimeted component

Seven Stars

Issue with special character in tFileOutputDelimeted component

Hi, 

 

I am extracting a query result to tFileOutputDelimeted component(.csv file).

 

String has to be "can't" but, it is saving in .csv file as "can?t". Why am I getting this?

 

Can anyone help me out?

Thanks in advance,

Meghana.


Accepted Solutions
Seven Stars

Re: Issue with special character in tFileOutputDelimeted component

The issue has been solved. Changed encoding to UTF-16 and it is working. Thanks for the reply.

 

Thanks,

Meghana.


All Replies
Nine Stars

Re: Issue with special character in tFileOutputDelimeted component

Hi @MeghanaKottala,

Can you pls share a sample input data and also can you also share the job screenshot with result such that Community can look into the issue you are facing?

Pls do get back to Community,if necessary.

Thanks,

Ankit.

Seven Stars

Re: Issue with special character in tFileOutputDelimeted component

Here is the screenshot.

 

The query results in one string column which has result like this "youíve" and when I run this job, I am getting the result as "you?ve".

 

Am I clear

Eleven Stars

Re: Issue with special character in tFileOutputDelimeted component

Try to change the encoding to ISO-8859-15
Regards
Abhishek KUMAR
Seven Stars

Re: Issue with special character in tFileOutputDelimeted component

I am using the same

 

Thanks,

Meghana

Seven Stars

Re: Issue with special character in tFileOutputDelimeted component

When you say it is "saving as can?t", what do you mean? Is it literally a question mark in the output file, or is the reading method converting a character that it doesn't understand into a question mark? How are you viewing the output?

 

I suspect that your input isn't "can't", I bet it is "can’t" (which has a typographical apostrophe, rather than the plain ASCII apostrophe). ISO8859-15 does not have typographical or “directional” quotes, so it can't be written using that encoding.

 

Using a larger font, ' is ASCII, but  is not, and is not supported by ISO8859 character sets.

https://practicaltypography.com/straight-and-curly-quotes.html

Seven Stars

Re: Issue with special character in tFileOutputDelimeted component

The issue has been solved. Changed encoding to UTF-16 and it is working. Thanks for the reply.

 

Thanks,

Meghana.

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

How Media Organizations Achieved Success with Data Integration

Learn how media organizations have achieved success with Data Integration

Read

Definitive Guide to Data Quality

Create systems and workflow to manage clean data ingestion and data transformation.

Download