Five Stars

special character in ANSI windows file fomat

Hi

 

I'm using Talend 6.01 Enterprise version with Talend data mapper.

I have input file having format ANSI windows and in that file we are getting special character within a string like this "ABCD ALL» 100"

 

So when I read a file by setting ISO  encoding option in tfileinputraw and Talend data mapper encoding set at platform default, We get an output with loss of data and missing all special characters.

 

But when I convert my input file to utf-8 and then process through TDM, it give me all data in output but special character comes within a data comes like this "ABCD ALL» 100". 

 

We need same characters in output as coming in put. Please guide us how to do it....!!  Thanks

  • Data Integration
4 REPLIES
Seven Stars

Re: special character in ANSI windows file fomat

Hi,

 

How do you write your file ? With tFileOutputRaw ? If yes, what is the encoding on this component ?

 

Eric

Five Stars

Re: special character in ANSI windows file fomat

Hi eric,

 

 

Yes using tfileoutputraw I generate output with encoding type UTF-8.

 

 

Tags (1)
Seven Stars

Re: special character in ANSI windows file fomat

Hi,

 

Could you upload your test data ?

 

Eric

Seven Stars

Re: special character in ANSI windows file fomat

Hi,

 

I did a test:
-My Talend version is 6.2.1
-In input file, I have:
A»B
-My input file is UTF-8
-tInputFileRaw encoding is UTF-8
-tOutputFileRaw encoding is UTF-8
-Character encoding is "Platform default" for input and output structures of my TDM map
-In Output File, I get the same as in my input file:
A»B

 

Regards.

 

Eric