Uses of Interface
antlr.TokenStream
-
Packages that use TokenStream Package Description antlr antlr.actions.cpp antlr.actions.csharp antlr.actions.java antlr.actions.python antlr.ASdebug antlr.debug antlr.preprocessor -
-
Uses of TokenStream in antlr
Classes in antlr that implement TokenStream Modifier and Type Class Description class
ANTLRLexer
class
ANTLRTokdefLexer
class
CharScanner
class
TokenStreamBasicFilter
This object is a TokenStream that passes through all tokens except for those that you tell it to discard.class
TokenStreamHiddenTokenFilter
This object filters a token stream coming from a lexer or another TokenStream so that only certain token channels get transmitted to the parser.class
TokenStreamRewriteEngine
This token stream tracks the *entire* token stream coming from a lexer, but does not pass on the whitespace (or whatever else you want to discard) to the parser.class
TokenStreamSelector
A token stream MUX (multiplexor) knows about n token streams and can multiplex them onto the same channel for use by token stream consumer like a parser.Fields in antlr declared as TokenStream Modifier and Type Field Description protected TokenStream
TokenBuffer. input
protected TokenStream
TokenStreamBasicFilter. input
The input streamprotected TokenStream
TokenStreamSelector. input
The currently-selected token stream inputprotected TokenStream
TokenStreamRewriteEngine. stream
Who do we suck tokens from?Methods in antlr that return TokenStream Modifier and Type Method Description TokenStream
TokenStreamSelector. getCurrentStream()
Return the stream from tokens are being pulled at the moment.TokenStream
TokenBuffer. getInput()
return the Tokenizer (needed by ParseView)TokenStream
TokenStreamSelector. getStream(java.lang.String sname)
TokenStream
TokenStreamSelector. pop()
Methods in antlr with parameters of type TokenStream Modifier and Type Method Description void
TokenStreamSelector. addInputStream(TokenStream stream, java.lang.String key)
protected void
Parser. defaultDebuggingSetup(TokenStream lexer, TokenBuffer tokBuf)
void
TokenStreamSelector. push(TokenStream stream)
void
TokenStreamSelector. select(TokenStream stream)
Set the stream without pushing old streamConstructors in antlr with parameters of type TokenStream Constructor Description ANTLRParser(TokenStream lexer)
ANTLRParser(TokenStream lexer, int k)
ANTLRTokdefParser(TokenStream lexer)
ANTLRTokdefParser(TokenStream lexer, int k)
LLkParser(TokenStream lexer, int k_)
TokenBuffer(TokenStream input_)
Create a token bufferTokenStreamBasicFilter(TokenStream input)
TokenStreamHiddenTokenFilter(TokenStream input)
TokenStreamRewriteEngine(TokenStream upstream)
TokenStreamRewriteEngine(TokenStream upstream, int initialSize)
-
Uses of TokenStream in antlr.actions.cpp
Classes in antlr.actions.cpp that implement TokenStream Modifier and Type Class Description class
ActionLexer
Perform the following translations: AST related translations ## -> currentRule_AST #(x,y,z) -> codeGenerator.getASTCreateString(vector-of(x,y,z)) #[x] -> codeGenerator.getASTCreateString(x) #x -> codeGenerator.mapTreeId(x) Inside context of #(...), you can ref (x,y,z), [x], and x as shortcuts. -
Uses of TokenStream in antlr.actions.csharp
Classes in antlr.actions.csharp that implement TokenStream Modifier and Type Class Description class
ActionLexer
Perform the following translations: AST related translations ## -> currentRule_AST #(x,y,z) -> codeGenerator.getASTCreateString(vector-of(x,y,z)) #[x] -> codeGenerator.getASTCreateString(x) #x -> codeGenerator.mapTreeId(x) Inside context of #(...), you can ref (x,y,z), [x], and x as shortcuts. -
Uses of TokenStream in antlr.actions.java
Classes in antlr.actions.java that implement TokenStream Modifier and Type Class Description class
ActionLexer
Perform the following translations: AST related translations ## -> currentRule_AST #(x,y,z) -> codeGenerator.getASTCreateString(vector-of(x,y,z)) #[x] -> codeGenerator.getASTCreateString(x) #x -> codeGenerator.mapTreeId(x) Inside context of #(...), you can ref (x,y,z), [x], and x as shortcuts. -
Uses of TokenStream in antlr.actions.python
Classes in antlr.actions.python that implement TokenStream Modifier and Type Class Description class
ActionLexer
Perform the following translations: AST related translations ## -> currentRule_AST #(x,y,z) -> codeGenerator.getASTCreateString(vector-of(x,y,z)) #[x] -> codeGenerator.getASTCreateString(x) #x -> codeGenerator.mapTreeId(x) Inside context of #(...), you can ref (x,y,z), [x], and x as shortcuts.class
CodeLexer
-
Uses of TokenStream in antlr.ASdebug
Methods in antlr.ASdebug with parameters of type TokenStream Modifier and Type Method Description static java.lang.String
ASDebugStream. getEntireText(TokenStream stream)
static TokenOffsetInfo
ASDebugStream. getOffsetInfo(TokenStream stream, Token token)
-
Uses of TokenStream in antlr.debug
Classes in antlr.debug that implement TokenStream Modifier and Type Class Description class
DebuggingCharScanner
Methods in antlr.debug with parameters of type TokenStream Modifier and Type Method Description void
LLkDebuggingParser. setupDebugging(TokenStream lexer)
protected void
LLkDebuggingParser. setupDebugging(TokenStream lexer, TokenBuffer tokenBuf)
User can override to do their own debuggingConstructors in antlr.debug with parameters of type TokenStream Constructor Description LLkDebuggingParser(TokenStream lexer, int k_)
ParseTreeDebugParser(TokenStream lexer, int k_)
-
Uses of TokenStream in antlr.preprocessor
Classes in antlr.preprocessor that implement TokenStream Modifier and Type Class Description class
PreprocessorLexer
Constructors in antlr.preprocessor with parameters of type TokenStream Constructor Description Preprocessor(TokenStream lexer)
Preprocessor(TokenStream lexer, int k)
-