How to write unicode strings into a file? [duplicate]

Answer 1

The codecs.open() function in 2.6 is very similar to the built-in open() function in python3.x (which makes sense since Py3k strings are always Unicode). For future proofing your code in case it is used under Py3k you could do the following.

import sys

if sys.version_info[0] < 3:
    import codecs
    _open_func_bak = open # Make a back up, just in case
    open = codecs.open

with open('myfile', 'w', encoding='utf-8') as f:
    f.write(u'\u5E73\u621015')

Now your code should work the same in both 2.x and 3.3+.

Answer 2

As an alternative, you can use the codecs module:

import codecs
s = u'\u5E73\u621015'
with codecs.open("yop", "w", encoding="utf-8") as f:
    f.write(s)

Answer 3

Inserting this at the beginning of my script tends to solve unicode problems.

import sys
reload(sys)
sys.setdefaultencoding('utf8')

Answer 4

you're going to have to 'encode' the unicode string.

s = u'\u5E73\u621015'
with open("yop", "wb") as f:
   f.write(s.encode("UTF-8"))

try this out for a bit of a friendly look at unicode and python: http://farmdev.com/talks/unicode/