I have a Delimited file with an UTF-8 encodage, but I have few characters as "é", "à"... wich are a black diamond with the character ? inside.
And a can't choose this case as condition in a tFilterRow.
Do you have an idea to resolve this issue ? Can you help me, please?
Solved! Go to Solution.
Are you sure the source file is UTF-8 encoded?
When do see the "black diamond with the character ? inside"?
Can you share an extract of the input file?
This is my job :
directory : "D:/SPC/FichienSensibilite"
files : "*.dat"
flow's name :
Freq Vide Vaut "Fréquence=1000Hz"
Run IF :
((Integer)globalMap.get("tFilterRow_1_NB_LINE_OK")) > 0
file's name :
directory : "D:/SPC/test"
For my tFileInputDelimited_1 component, I use a metadata delimited file wich is form :
Colonne0 is a String type.
I want to search "Fréquence=1000Hz" and "Temps=50µs" in the tFilterRow_1 component, but "é" and "µ" are change by black diamonds with the character ? inside in my metadata preview.
My encode is UTF-8.
PS : My job is in French
Once again, are you sure of the file encoding?
Can you open the file using Notepad++ then, menu Encode and you should have something like that:
I just made the test with a CSV file with this encoding, the preview is OK.
If I change the file encoding to ANSI (using Notepad++) and save the file, preview is not OK as you can see here:
Hope this helps.
It's good for my metatdata, it was encode in ANSI so I changed its. Now I'm a new issue, it's that all input files are encode in ANSI, so what exit a solution to change all files in UTF-8 encode with an automatic process?
Watch the recorded webinar!
Pick up some tips and tricks with Context Variables
Learn how media organizations have achieved success with Data Integration
Create systems and workflow to manage clean data ingestion and data transformation.