An implementation of interface CharStream, where the stream is assumed to
contain only ASCII characters (without unicode processing).
available
(package private) int available
bufcolumn
private int[] bufcolumn
buffer
private char[] buffer
bufline
private int[] bufline
bufsize
(package private) int bufsize
inputStream
private java.io.Reader inputStream
maxNextCharInd
private int maxNextCharInd
prevCharIsCR
private boolean prevCharIsCR
prevCharIsLF
private boolean prevCharIsLF
staticFlag
public static final boolean staticFlag
tokenBegin
(package private) int tokenBegin
VelocityCharStream
public VelocityCharStream(java.io.InputStream dstream,
int startline,
int startcolumn)
VelocityCharStream
public VelocityCharStream(java.io.InputStream dstream,
int startline,
int startcolumn,
int buffersize)
VelocityCharStream
public VelocityCharStream(java.io.Reader dstream,
int startline,
int startcolumn)
VelocityCharStream
public VelocityCharStream(java.io.Reader dstream,
int startline,
int startcolumn,
int buffersize)
BeginToken
public final char BeginToken()
throws java.io.IOException
Returns the next character that marks the beginning of the next token.
All characters must remain in the buffer between two successive calls
to this method to implement backup correctly.
- BeginToken in interface CharStream
Done
public void Done()
The lexer calls this function to indicate that it is done with the stream
and hence implementations can free any resources held by this class.
Again, the body of this function can be just empty and it will not
affect the lexer's operation.
- Done in interface CharStream
ExpandBuff
private final void ExpandBuff(boolean wrapAround)
FillBuff
private final void FillBuff()
throws java.io.IOException
GetImage
public final String GetImage()
Returns a string made up of characters from the marked token beginning
to the current buffer position. Implementations have the choice of returning
anything that they want to. For example, for efficiency, one might decide
to just return null, which is a valid implementation.
- GetImage in interface CharStream
GetSuffix
public final char[] GetSuffix(int len)
Returns an array of characters that make up the suffix of length 'len' for
the currently matched token. This is used to build up the matched string
for use in actions in the case of MORE. A simple and inefficient
implementation of this is as follows :
{
String t = GetImage();
return t.substring(t.length() - len, t.length()).toCharArray();
}
- GetSuffix in interface CharStream
ReInit
public void ReInit(java.io.InputStream dstream,
int startline,
int startcolumn)
ReInit
public void ReInit(java.io.InputStream dstream,
int startline,
int startcolumn,
int buffersize)
ReInit
public void ReInit(java.io.Reader dstream,
int startline,
int startcolumn)
ReInit
public void ReInit(java.io.Reader dstream,
int startline,
int startcolumn,
int buffersize)
UpdateLineColumn
private final void UpdateLineColumn(char c)
adjustBeginLineColumn
public void adjustBeginLineColumn(int newLine,
int newCol)
Method to adjust line and column numbers for the start of a token.
backup
public final void backup(int amount)
Backs up the input stream by amount steps. Lexer calls this method if it
had already read some characters, but could not use them to match a
(longer) token. So, they will be used again as the prefix of the next
token and it is the implemetation's responsibility to do this right.
- backup in interface CharStream
getBeginColumn
public final int getBeginColumn()
Returns the column number of the first character for current token (being
matched after the last call to BeginTOken).
- getBeginColumn in interface CharStream
getBeginLine
public final int getBeginLine()
Returns the line number of the first character for current token (being
matched after the last call to BeginTOken).
- getBeginLine in interface CharStream
getEndColumn
public final int getEndColumn()
Returns the column number of the last character for current token (being
matched after the last call to BeginTOken).
- getEndColumn in interface CharStream
getEndLine
public final int getEndLine()
Returns the line number of the last character for current token (being
matched after the last call to BeginTOken).
- getEndLine in interface CharStream
readChar
public final char readChar()
throws java.io.IOException
Returns the next character from the selected input. The method
of selecting the input is the responsibility of the class
implementing this interface. Can throw any java.io.IOException.
- readChar in interface CharStream