Ignore:
Timestamp:
Dec 22, 2010, 12:04:39 PM (9 years ago)
Author:
cameron
Message:

Reorder u8u16 defs for 2/3/4 byte optimization

File:
1 edited

Legend:

Unmodified
Added
Removed
  • proto/charsetcompiler/inputs/input_UTF8_defs

    r609 r848  
    55u8.prefix4 = [\xF0-\xFF]
    66u8.suffix = [\x80-\xBF]
    7 u8.badprefix = [\xC0-\xC1\xF5-\xFF]
     7# For 2 byte-sequence validation
     8u8.badprefix2 = [\xC0-\xC1]
     9# For 3 byte-sequence validation
    810u8.xE0 = [\xE0]
    911u8.xED = [\xED]
     12u8.xA0_xBF = [\xA0-\xBF]
     13u8.x80_x9F = [\x80-\x9F]
     14# 4 byte sequence validation
     15u8.badprefix4 = [\xF5-\xFF]
    1016u8.xF0 = [\xF0]
    1117u8.xF4 = [\xF4]
    12 u8.xA0_xBF = [\xA0-\xBF]
    13 u8.x80_x9F = [\x80-\x9F]
    1418u8.x90_xBF = [\x90-\xBF]
    1519u8.x80_x8F = [\x80-\x8F]
     20
Note: See TracChangeset for help on using the changeset viewer.