From Thursday, July, 9, 3:00 PM Pacific,
our Community site will be in
read-only mode
through Sunday, July 12th.
Thank you for your patience.

Encoding UTF-8 and ISO-8859

Highlighted
Six Stars

Encoding UTF-8 and ISO-8859

Hello, 

 

I would like to encode in Encoding UTF-8 and ISO-8859 because all characters in data with accent (é ; à ; è ; etc.) = "?"

I saw that we can change in  advanced settings but i don't have...

Someone can help me ?

Thank you.

Version of Talend :Talend Open Studio for Data IntegrationVersion: 6.3.1

Capture.PNG

Tags (1)
Highlighted
Sixteen Stars
Sixteen Stars

Re: Encoding UTF-8 and ISO-8859

Encoding is for files, not for db components.

TRF
Highlighted
Six Stars

Re: Encoding UTF-8 and ISO-8859

Thanks TRF for your answer.
Can I force encoding in the database connectors ?
I use 2 databases connectors : firebird and General JDBC (Microsoft Azure).

Tags (1)
Highlighted
Sixteen Stars
Sixteen Stars

Re: Encoding UTF-8 and ISO-8859

No (I don't think so).

Depending on the engine, the charset is choosen when the database is created.

 


TRF
Highlighted
Community Manager

Re: Encoding UTF-8 and ISO-8859

If you are having trouble with charsets, you can try fixing this using a bit of Java.

 

String broken_nordic = "Här är några merkkejä";
byte[] bytes = broken_nordic.getBytes("ISO-8859-1");  
String fixed_nordic = new String(bytes,"UTF-8"); 

This *should* produce the following text .....

"Här är några merkkejä"

Test it and if that works you can create a reusable routine to make it easier to use

Highlighted
Six Stars

Re: Encoding UTF-8 and ISO-8859

The SQL Server uses SQL_Latin1_General_CP1_CI_AS charset but I don't understand when I insert directly rows it takes into account special characters ...

 

I think the unique solution is to create a new database with adequate charset.

Highlighted
Six Stars

Re: Encoding UTF-8 and ISO-8859

Thanks rhall_2_0 for your answer but i'm a newbie lol.
It's a little bit complicated for me .

2019 GARTNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog