How to handle multibyte string in Python

和自甴很熟 提交于 2019-12-19 08:07:25

问题


There are multibyte string functions in PHP to handle multibyte string (e.g:CJK script). For example, I want to count how many letters in a multi bytes string by using len function in python, but it return an inaccurate result (i.e number of bytes in this string)

japanese = "桜の花びらたち"
print japanese
print len(japanese)#return 21 instead of 7

Is there any package or function like mb_strlen in PHP?


回答1:


Use Unicode strings:

# Encoding: UTF-8

japanese = u"桜の花びらたち"
print japanese
print len(japanese)

Note the u in front of the string.

To convert a bytestring into Unicode, use decode: "桜の花びらたち".decode('utf-8')




回答2:


Try converting it to unicode first:

print len(japanese.decode("utf-8"))

gives 7. You are working on the utf-8 encoded string, which indeed has 21 bytes.



来源:https://stackoverflow.com/questions/8346608/how-to-handle-multibyte-string-in-python

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!