76 lines
4.6 KiB
Plaintext
76 lines
4.6 KiB
Plaintext
|
Ë
|
|||
|
|
dÀj ã ó: — d Z ddlZ G d„ de« Z G d„ d« Zy)a
|
|||
|
|
pygments.scanner
|
|||
|
|
~~~~~~~~~~~~~~~~
|
|||
|
|
|
|||
|
|
This library implements a regex based scanner. Some languages
|
|||
|
|
like Pascal are easy to parse but have some keywords that
|
|||
|
|
depend on the context. Because of this it's impossible to lex
|
|||
|
|
that just by using a regular expression lexer like the
|
|||
|
|
`RegexLexer`.
|
|||
|
|
|
|||
|
|
Have a look at the `DelphiLexer` to get an idea of how to use
|
|||
|
|
this scanner.
|
|||
|
|
|
|||
|
|
:copyright: Copyright 2006-present by the Pygments team, see AUTHORS.
|
|||
|
|
:license: BSD, see LICENSE for details.
|
|||
|
|
é Nc ó — e Zd ZdZy)Ú EndOfTextzZ
|
|||
|
|
Raise if end of text is reached and the user
|
|||
|
|
tried to call a match function.
|
|||
|
|
N)Ú__name__Ú
|
|||
|
|
__module__Ú __qualname__Ú__doc__© ó úS/home/antigravity/intellecton/venv/lib/python3.12/site-packages/pygments/scanner.pyr r s „ òr
|
|||
|
|
r c ób — e Zd ZdZd
|
|||
|
|
d„Zd„ Z eeej « Zd„ Zd„ Zd„ Z d„ Z
|
|||
|
|
d„ Z y ) ÚScannerzp
|
|||
|
|
Simple scanner
|
|||
|
|
|
|||
|
|
All method patterns are regular expression strings (not
|
|||
|
|
compiled expressions!)
|
|||
|
|
c ó† — || _ t |« | _ d| _ d| _ || _ d| _ d| _ i | _ y)z{
|
|||
|
|
:param text: The text which should be scanned
|
|||
|
|
:param flags: default regular expression flags
|
|||
|
|
r N) ÚdataÚlenÚ data_lengthÚ start_posÚposÚflagsÚlastÚmatchÚ _re_cache)ÚselfÚtextr s r Ú__init__zScanner.__init__# sA € ð
|
|||
|
|
ˆŒ Ü ˜t›9ˆÔ؈ŒØˆŒØˆŒ
|
|||
|
|
؈Œ ؈Œ
|
|||
|
|
؈�r
|
|||
|
|
c ó4 — | j | j k\ S )z.`True` if the scanner reached the end of text.)r r ©r s r Úeosz Scanner.eos1 s € à�x‰x˜4×+Ñ+Ñ+Ð+r
|
|||
|
|
c ó
|
|||
|
|
— | j r
|
|||
|
|
t « ‚|| j vr-t j || j
|
|||
|
|
« | j |< | j | j
|
|||
|
|
| j | j « S )z“
|
|||
|
|
Apply `pattern` on the current position and return
|
|||
|
|
the match object. (Doesn't touch pos). Use this for
|
|||
|
|
lookahead.
|
|||
|
|
) r r r ÚreÚcompiler r r r ©r Úpatterns r Úcheckz
|
|||
|
|
Scanner.check6 s` € ð �8Š8Ü“+Ð Ø ˜$Ÿ.™.Ñ (Ü&(§j¡j°¸$¿*¹*Ó&EˆD�N‰N˜7Ñ #Ø�~‰~˜gÑ&×,Ñ,¨T¯Y©Y¸¿¹ÓAÐAr
|
|||
|
|
c ó( — | j |« duS )zdApply a pattern on the current position and check
|
|||
|
|
if it patches. Doesn't touch pos.
|
|||
|
|
N)r# r! s r Útestz Scanner.testB s € ð �z‰z˜'Ó"¨$Ð.Ð.r
|
|||
|
|
c ó² — | j r
|
|||
|
|
t « ‚|| j vr-t j || j
|
|||
|
|
« | j |< | j | _ | j | j
|
|||
|
|
| j | j « }|€y|j « | _ |j « | _ |j « | _ y)a�
|
|||
|
|
Scan the text for the given pattern and update pos/match
|
|||
|
|
and related fields. The return value is a boolean that
|
|||
|
|
indicates if the pattern matched. The matched value is
|
|||
|
|
stored on the instance as ``match``, the last value is
|
|||
|
|
stored as ``last``. ``start_pos`` is the position of the
|
|||
|
|
pointer before the pattern was matched, ``pos`` is the
|
|||
|
|
end position.
|
|||
|
|
FT)r r r r r r r r r r Ústartr ÚendÚgroup)r r" Úms r Úscanz Scanner.scanH sœ € ð �8Š8Ü“+Ð Ø ˜$Ÿ.™.Ñ (Ü&(§j¡j°¸$¿*¹*Ó&EˆD�N‰N˜7Ñ #Ø—J‘JˆŒ Ø �N‰N˜7Ñ #× )Ñ )¨$¯)©)°T·X±XÓ >ˆØ ˆ9ØØŸ™›ˆŒØ—5‘5“7ˆŒØ—W‘W“YˆŒ
|
|||
|
|
Ør
|
|||
|
|
c ó& — | j d« y)zScan exactly one char.ú.N)r+ r s r Úget_charzScanner.get_char_ s
|
|||
|
|
€ à � ‰ �#�r
|
|||
|
|
c ób — d| j j | j | j fz S )Nz
|
|||
|
|
<%s %d/%d>)Ú __class__r r r r s r Ú__repr__zScanner.__repr__c s1 € ØØ �N‰N× #Ñ #Ø �H‰HØ × Ñ ð
|
|||
|
|
ñ
|
|||
|
|
ð
|
|||
|
|
r
|
|||
|
|
N)r ) r r r r r r Úpropertyr# r% r+ r. r1 r r
|
|||
|
|
r r
|
|||
|
|
r
|
|||
|
|
s= „ ñó ò ,ñ �3˜Ÿ ™ Ó
|
|||
|
|
$€Cò
|
|||
|
|
Bò/ò ò.ó
|
|||
|
|
r
|