This class is a scanner generated by
JFlex 1.4.3
on 2/16/13 6:26 PM from the specification file
/builddir/build/BUILD/opengrok-0.9-src/src/org/opensolaris/opengrok/analysis/java/JavaSymbolTokenizer.lex
This class is a scanner generated by
JFlex 1.4.3
on 2/16/13 6:26 PM from the specification file
/builddir/build/BUILD/opengrok-0.9-src/src/org/opensolaris/opengrok/analysis/java/JavaXref.lex
this class was created because of lucene 2.4.1 update which introduced char[] in Tokens instead of String
lucene 3.0.0 uses AttributeSource instead of Tokens to make things even easier :-D
Generally this is a "template" for all new Tokenizers, so be carefull when changing it,
it will impact almost ALL symbol tokenizers in OpenGrok ...