parsley.errors.tokenextractors
Members list
Type members
Classlikes
This extractor mixin provides an implementation for
ErrorBuilder.unexpectedToken
when mixed into
an error builder: it will try and parse the residual input to identify a valid lexical token
to report.
This extractor mixin provides an implementation for
ErrorBuilder.unexpectedToken
when mixed into
an error builder: it will try and parse the residual input to identify a valid lexical token
to report.
When parsing a grammar that as a dedicated lexical distinction, it is nice to be able to report problematic tokens relevant to that grammar as opposed to generic input lifted straight from the input stream. The easiest way of doing this would be having a pre-lexing pass and parsing based on tokens, but this is deliberately not how Parsley is designed. Instead, this extractor can try and parse the remaining input to try and identify a token on demand.
If the lexicalError
flag of the unexpectedToken
method is not set, which would indicate a
problem within a token reported by a classical lexer and not the parser, the extractor will
try to parse each of the provided tokens
in turn: whichever is the longest matched of these
tokens will be reported as the problematic one (this can be changed by overriding selectToken
).
For best effect, these tokens should not consume
whitespace (which would otherwise be included at the end of the token!): this means that, if
using the Lexer
class, the functionality in nonlexeme
should be used. If one of the
givens tokens cannot be parsed, the input until the next valid parsable token (or end of input)
is returned as a Token.Raw
.
Currently, if lexicalError
is true, this extractor will just return the next character
as the problematic item (this may be changed by overriding the extractItem
method).
Attributes
- Since:
4.0.0
- Companion:
- object
- Source:
- LexToken.scala
- Graph
- Supertypes
- Self type
- ErrorBuilder[_]
This object contains helper functions useful for interacting with LexToken
.
This object contains helper functions useful for interacting with LexToken
.
Attributes
- Since:
4.0.0
- Companion:
- trait
- Source:
- LexToken.scala
- Graph
- Supertypes
- Self type
- LexToken.type
This extractor mixin provides an implementation for
ErrorBuilder.unexpectedToken
when mixed into
an error builder: it will make a token as wide as the amount of input the parser tried to
consume when it failed.
This extractor mixin provides an implementation for
ErrorBuilder.unexpectedToken
when mixed into
an error builder: it will make a token as wide as the amount of input the parser tried to
consume when it failed.
Attributes
- Since:
4.0.0
- Note:
In the case of unprintable characters or whitespace, this extractor will favour reporting a more meaningful name.
- Companion:
- object
- Source:
- MatchParserDemand.scala
- Graph
- Supertypes
- Self type
- ErrorBuilder[_]
Contains the functionality of MatchParserDemand
as a function.
Contains the functionality of MatchParserDemand
as a function.
Attributes
- Since:
4.0.0
- Companion:
- trait
- Source:
- MatchParserDemand.scala
- Graph
- Supertypes
- Self type
- MatchParserDemand.type
This extractor mixin provides an implementation for
ErrorBuilder.unexpectedToken
when mixed into
an error builder: it will unconditionally report the first character in the remaining input
as the problematic token.
This extractor mixin provides an implementation for
ErrorBuilder.unexpectedToken
when mixed into
an error builder: it will unconditionally report the first character in the remaining input
as the problematic token.
Attributes
- Since:
4.0.0
- Note:
In the case of unprintable characters or whitespace, this extractor will favour reporting a more meaningful name.
- Companion:
- object
- Source:
- SingleChar.scala
- Graph
- Supertypes
- Self type
- ErrorBuilder[_]
Contains the functionality of SingleChar
as a function.
Contains the functionality of SingleChar
as a function.
Attributes
- Since:
4.0.0
- Companion:
- trait
- Source:
- SingleChar.scala
- Graph
- Supertypes
- Self type
- SingleChar.type
This extractor mixin provides an implementation for
ErrorBuilder.unexpectedToken
when mixed into
an error builder: it will construct a token that extends to the next available whitespace
in the remaining input.
This extractor mixin provides an implementation for
ErrorBuilder.unexpectedToken
when mixed into
an error builder: it will construct a token that extends to the next available whitespace
in the remaining input. It can be configured to constrict this token to the minimum of the
next whitespace or whatever the parser demanded (see MatchParserDemand
).
Attributes
- Since:
4.0.0
- Note:
In the case of unprintable characters or whitespace, this extractor will favour reporting a more meaningful name.
- Companion:
- object
- Source:
- TillNextWhitespace.scala
- Graph
- Supertypes
- Self type
- ErrorBuilder[_]
Contains the functionality of TillNextWhitespace
as a function.
Contains the functionality of TillNextWhitespace
as a function.
Attributes
- Since:
4.0.0
- Companion:
- trait
- Source:
- TillNextWhitespace.scala
- Graph
- Supertypes
- Self type
- TillNextWhitespace.type