Ignore:
Timestamp:
Jul 5, 2010, 6:13:32 PM (9 years ago)
Author:
cameron
Message:

Add shift 1 optimization

File:
1 edited

Legend:

Unmodified
Added
Removed
  • proto/parabix2/parabix2.py

    r438 r441  
    621621        # Classify bytes for UTF-8 processing, whitespace and control
    622622        # processing and XML lexical analysis.
    623         (u8, control, lex) = byteclass.classify_bytes(bit)
     623        #(u8, control, lex) = byteclass.classify_bytes(bit)
     624        (u8, control, lex) = byteclass.classify_bytes_with_shift1opt(bit)
    624625
    625626        # Validate UTF-8 multibyte sequences and determine the UTF-8 scope streams.
Note: See TracChangeset for help on using the changeset viewer.