Reading non-ASCII characters from a text file

Question

I\'m using python 2.7. I\'ve tried many things like codecs but didn\'t work. How can I fix this.

myfile.txt

wörd

My code

Answer 1

1. First of all - detect the file's encoding

  from chardet import detect
  encoding = lambda x: detect(x)['encoding']
  print encoding(line)

2. then - convert it to unicode or your default encoding str:

  n_line=unicode(line,encoding(line),errors='ignore')
  print n_line
  print n_line.encode('utf8')