Safe decoding in python (instead of the '?' Character)

Question

Safe decoding in python (instead of the '?' Character)

I have a code:

encoding = guess_encoding()    
text = unicode(text, encoding)

when the wrong character appears in the text. UnicodeDecode exception thrown. How can I silently skip the exception by replacing the wrong character with "?"

+3

python

kilonet Mar 07 '11 at 19:14

source share

1 answer

Sven marnach · Accepted Answer · 2011-03-07T19:18:47+0000

Try

text = unicode(text, encoding, "replace")

From the documentation :

'replace' causes Unicode characters, U + FFFD to be replaced, to replace input characters that cannot be decoded.

If you want to use "?"Unicode replacements instead of the official character, you can do

text = text.replace(u"\uFFFD", "?")

after converting to Unicode.

Safe decoding in python (instead of the '?' Character)

More articles: