I have been trying for days to insert data such smileys, data from all languages into mysql through talend.
The source is sql server and target mysql.
If I use the 'Set Names utf8mb4' in mysql and run my insert statements, the data is successfully inserted. (Ex - ハウス, is inserted correctly)
However, if I set the 'Set Names utf8mb4' in additional parameters, it just does not work (ハウス is inserted as ???)
As of now, its tmssqlinput - tmysqlbulkoutputexec
Any idea on how to solve this?
I am not sure if I am correct, but By default in Talend is used UTF-8 not UTF-8MB4. I think. you need to convert the text to UTF8MB4.
See e.g. this thread:
Hope it helps.
I'm using tmssqlinput. How do I convert the string here to utf8mb4. In the additional parameters of tmssqlinput I have included character encoding = utf8mb4
And, also in tmysqlputput I have included in the additional parameters set names utf8mb4
But, these don't work when the incoming string has a emoji
I gave you a link to an example how to convert strings from one encoding to another in Talend in my first post. Sorry, I can't help you more.
I have gone through the link you have sent me in your previous posts lojdr. But, I couldn't find any solution there
Anyways, thank you for posting your thoughts
The problem was with MySQL version. The tmysqlbulkoutputexec works for mysql 5.6 but not the same with 5.7
I guess the handling of utf8 in tmysqlbulkoutputexec is different for mysql 5.6 and 5.7