The next stream of bytes identified as UTF-8, it contains the Hebrew sentence דירות לשותפים בתל אביב - הומלס. I am trying to understand the encoding.
ubuntu@ip-10-126-21-104:~$ od -t x1 homeless-title-fromwireshark_followed_by_hexdump.txt
0000000 0a 09 d7 93 d7 99 d7 a8 d7 95 d7 aa 20 d7 9c d7
0000020 a9 d7 95 d7 aa d7 a4 d7 99 d7 9d 20 20 d7 91 d7
0000040 aa d7 9c 20 d7 90 d7 91 d7 99 d7 91 20 2d 20 d7
0000060 94 d7 95 d7 9e d7 9c d7 a1 0a
0000072
ubuntu@ip-10-126-21-104:~$ file -i homeless-title-fromwireshark_followed_by_hexdump.txt
homeless-title-fromwireshark_followed_by_hexdump.txt: text/plain; charset=utf-8
UTF-8 file, I checked this by opening Notepad (Windows 7), entering the Hebrew symbol ד, and then saving the file. The result of which gives the following:
ubuntu@ip-10-126-21-104:~$ od -t x1 test_from_notepad_utf8_daled.txt
0000000 ef bb bf d7 93
0000005
ubuntu@ip-10-126-21-104:~$ file -i test_from_notepad_utf8_daled.txt
test_from_notepad_utf8_daled.txt: text/plain; charset=utf-8
Where ef bb bfis the specification encoded in utf-8 form, and d7 93is exactly the sequence of bytes that appears in the original stream after 0a 09(new line, tab in ascii).
The problem here is that on Unicode code pages דshould be encoded how 05 D3, so why and how did utf-8 encoding work d7 93?
d7 93 11010111 10010011,
05 D3 00000101 11010011
, , ( ) , "HEBREW LETTER DALET"
,
.