- createExternalName
Create an external name from the given name. If the given name contains
character which are not vali
- <init>
Constructs a new tokenizer for the given text source.
- getToken
Gets the current token wich was read in due to the lastnext() call.
- getType
Returns the current token type.
- next
Reads the next token from the text source passed to the constructor of this
tokenizer. The value ret
- eat
Appends n characters to the current token and increments the current source
position by n.
- eatHexNumber
Appends all subsequential characters belonging to a hexadecimal number constant
to the current token
- eatName
Appends all subsequential characters belonging to a name to the current token
and increments the cur
- eatNumber
Appends all subsequent characters belonging to a number constant to the current
token and increments
- eatString
Appends all subsequential characters belonging to a string constant to the
current token and increme
- eatWhite
Appends all subsequential white space characters to the current token and
increments the current sou
- getColumn
Gets the current source column number.