Package net.sf.saxon.expr.parser

Class Token.ComplexToken

java.lang.Object

net.sf.saxon.expr.parser.Token

net.sf.saxon.expr.parser.Token.ComplexToken

Direct Known Subclasses:

Token.DirectElementConstructor, Token.StringConstructor, Token.StringTemplate

Enclosing class:

Token

public abstract static class Token.ComplexToken
extends Token

A "complex token" is used to represent constructs like element constructors and string templates that contain embedded expressions within arbitrary character content..

When a complex token is encountered (during lookAhead processing) it is not read to completion, it is saved for later processing. When the parser retrieves a complex token it must parse it by reading individual characters.

The complex token provides methods to read and unread characters and to process embedded expressions. When the parser has finished reading the token, it should call the close() method, which resets the tokenizer so that parsing can continue normally.

Nested Class Summary

Nested classes/interfaces inherited from class net.sf.saxon.expr.parser.Token

Token.ComplexToken, Token.DirectCommentConstructor, Token.DirectElementConstructor, Token.DirectProcessingInstructionConstructor, Token.NameToken, Token.NumericLiteral, Token.Pragma, Token.StringConstructor, Token.StringLiteral, Token.StringTemplate, Token.Wildcard

Field Summary

Fields

Modifier and Type	Field	Description
protected int	startOffset
protected final Tokenizer	tokenizer
protected String	tokenType

Fields inherited from class net.sf.saxon.expr.parser.Token

AT, BANG, COLON, COLON_COLON, COLON_EQUALS, COMMA, CONCAT, DOLLAR, DOT, DOT_DOT, EOF, EQUALS, FAT_ARROW, FOLLOWS, GE, GT, HASH, LCURLY, LE, LPAREN, LSQB, LT, MAPPING_ARROW, MATH_DIVIDE, MATH_MULT, METHOD_CALL, MINUS, NE, PERCENT, PLUS, PRECEDES, QMARK, QMARK_LSQB, RCURLY, RPAREN, RSQB, SEMICOLON, SLASH, SLASH_SLASH, STAR, THIN_ARROW, TILDE, UNKNOWN, VBAR

Constructor Summary

Constructors

Constructor	Description
ComplexToken(Tokenizer tokenizer, String input, int startOffset)

Method Summary

Modifier and Type	Method	Description
void	close()
int	getStartOffset()

Methods inherited from class net.sf.saxon.expr.parser.Token

getOperatorSymbol, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Details

tokenizer

protected final Tokenizer tokenizer

startOffset

protected int startOffset

tokenType

protected String tokenType

Constructor Details

ComplexToken

public ComplexToken(Tokenizer tokenizer,
 String input,
 int startOffset)

Method Details

close

public void close()
           throws XPathException

Throws:

XPathException

getStartOffset

public int getStartOffset()