- addToContent
Adds the given Char to the content (and the source) but not to the trigger
- addToTrigger
Adds the given Char to the trigger (and the source) but not to the content
- create
Creates a new token with the given type, using the given position as location
info.
- getContents
Returns the effective content of this token
- getSource
Returns the complete source string consumed while parsing this token
- getTrigger
Returns the string or character which further specifies this token.
- is
Determines if the token has the given type
- isEnd
Determines if this is an end of input token
- isIdentifier
Determines if this token is an identifier. If a list of values is given, this method checks that the
- isNumber
Determines if this token is an integer or decimal number.
- isSymbol
Determines if this token is a symbol. If a list of symbols is given, this method checks that the tri
- <init>