diff options
| author | Miikka Salminen <miikka.salminen@gmail.com> | 2016-02-06 22:01:49 +0200 |
|---|---|---|
| committer | Miikka Salminen <miikka.salminen@gmail.com> | 2016-02-06 22:01:49 +0200 |
| commit | c48f13eec64f066766b95751c8033e5127964560 (patch) | |
| tree | 8503f0509fd792353e051f2dba7fd4df20e62275 /doc | |
| parent | e79c9a4b8b79ae8e4271b3a3779aa4286d85ee9c (diff) | |
| download | pygments-git-c48f13eec64f066766b95751c8033e5127964560.tar.gz | |
Add tokens for string affixes and heredoc delimiters. Add lexing for them in C/C++, Perl, PHP, Python and Ruby. Update my old style Lovelace accordingly.
Diffstat (limited to 'doc')
| -rw-r--r-- | doc/docs/tokens.rst | 8 |
1 files changed, 8 insertions, 0 deletions
diff --git a/doc/docs/tokens.rst b/doc/docs/tokens.rst index 96a6d003..801fc638 100644 --- a/doc/docs/tokens.rst +++ b/doc/docs/tokens.rst @@ -223,12 +223,20 @@ Literals `String` For any string literal. +`String.Affix` + Token type for affixes that further specify the type of the string they're + attached to (e.g. the prefixes ``r`` and ``u8`` in ``r"foo"`` and ``u8"foo"``). + `String.Backtick` Token type for strings enclosed in backticks. `String.Char` Token type for single characters (e.g. Java, C). +`String.Delimiter` + Token type for delimiting identifiers in "heredoc", raw and other similar + strings (e.g. the word ``END`` in Perl code ``print <<'END';``). + `String.Doc` Token type for documentation strings (for example Python). |