This class is used to represent a token that has been tokenised using a Lexer. (e.g. the JavascriptLexer) These tokens are used to create various ParserItems, by passing them to an Analyser (e.g. the JavascriptAnalyser)
Search documentation
class Token
- File: /processor/token.php
- Namespace: processor
Class structure
As a function return value
findTokenBackwards from class Analyser
Finds a token looking backwards from the current position. Searching starts before the current token. The token must be of the type specified
From /processor/analyser.php
findTokenForwards from class Analyser
Finds a token looking forward from the current position. Searching starts after the current token. The token must be of the type specified
From /processor/analyser.php
