Check if the file contains a multibyte character

Question

I have subtitle files in UTF-8. Sometimes there are several sporadic multibyte characters in these files that cause problems in some applications.

How to check linux (and the ability to find them) if a specific file contains any multibyte character.

+3

Masroor Apr 29 '12 at 15:14

2 answers

You can use the fileor command chardet.

+2

kev Apr 29 '12 at 15:16

chalet16 · Accepted Answer · 2012-04-29T15:18:09+0000

You can use the file command

chalet16$ echo test > a.txt
chalet16$ echo testก >  b.txt #One of Thai characters
chalet16$ file *.txt
a.txt: ASCII text
b.txt: UTF-8 Unicode text