How to remove 4 byte utf-8 characters in Ruby?

自古美人都是妖i 提交于 2019-12-03 07:10:00

问题


Since MySQL's utf8 doesn't support 4 byte characters, I'm looking for a way to detect and eliminate any 4 byte utf8 characters from a string in Ruby. I understand that I can update my table to use utf8m4 but for a couple reasons that's not possible or the desired solution.

Simply encoding the string to ASCII will remove these characters but will also remove all other non-ASCII characters, which is not good.


回答1:


The following seems to work for me in Ruby 1.9.3:

input.each_char.select{|c| c.bytes.count < 4 }.join('')

For example:

input = "hello \xF0\xA9\xB6\x98 world"                  # includes U+29D98
input.each_char.select{|c| c.bytes.count < 4 }.join('') # 'hello  world'


来源:https://stackoverflow.com/questions/16487697/how-to-remove-4-byte-utf-8-characters-in-ruby

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!