[resolved] Foreign language special characters handling.

One Star

[resolved] Foreign language special characters handling.

I am expiriencing a problem with loading foreign language data (Mexican) from Excel into MySQL.
My original file has this string: ' MEGA CHEDRAUI ACAPULCO Calzada Pié de la cuesta No 239 Col.'
I created Excel metadata in UTF-8 format, however it seems that is not handling characters properly. When I at the data in Preview mode, I see that string is corrupted: ' MEGA CHEDRAUI ACAPULCO Calzada Pi de la cuesta No 239 Col.'
Direct insert into a table works fine - I get expected results. MySQL table is created with UTF8 charset.
Please explain how to handle international data properly.

Accepted Solutions
Highlighted
Employee

Re: [resolved] Foreign language special characters handling.

Did you try to use another encoding like "ISO-8859-15" in your EXCEL input component and use the UTF-8 on your MYSQLOUTPUT.
Normally JAVA will handle the conversion between the source and the target.
It might be interesting to test it.
Best regards.

View solution in original post


All Replies
Highlighted
Employee

Re: [resolved] Foreign language special characters handling.

Did you try to use another encoding like "ISO-8859-15" in your EXCEL input component and use the UTF-8 on your MYSQLOUTPUT.
Normally JAVA will handle the conversion between the source and the target.
It might be interesting to test it.
Best regards.

View solution in original post

Highlighted

Re: [resolved] Foreign language special characters handling.

Highlighted
One Star

Re: [resolved] Foreign language special characters handling.

@cantoine
I tried your suggestion - it worked. But it is so counterintuitive!? Smiley Happy
I made sure every setting to be set to UTF8 and it turns out there is no need to do that. Weird... Seems like usability bug.
Anyways, thank you!
@John.
Thank you for pointing to this topic. It didn't resolve this issue but helped me to reveal and fix another one - my server level encoding was not UTF8.
Peter.
Highlighted
One Star

Re: [resolved] Foreign language special characters handling.

Hello, friends!
If you strive to master several foreign languages at once, this source is indispensable to visit, follow and find out awesome effective techniques to learn languages and achieve quick results

2019 GARTNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

Best Practices for Using Context Variables with Talend – Part 2

Part 2 of a series on Context Variables

Blog

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog