mirror of
https://github.com/python/cpython
synced 2024-09-05 08:17:45 +00:00
![]() The function PyTokenizer_FromUTF8 from Parser/tokenizer.c had a comment: /* XXX: constify members. */ This patch addresses that. In the tok_state struct: * end and start were non-const but could be made const * str and input were const but should have been non-const Changes to support this include: * decode_str() now returns a char * since it is allocated. * PyTokenizer_FromString() and PyTokenizer_FromUTF8() each creates a new char * for an allocate string instead of reusing the input const char *. * PyTokenizer_Get() and tok_get() now take const char ** arguments. * Various local vars are const or non-const accordingly. I was able to remove five casts that cast away constness. |
||
---|---|---|
.. | ||
pgen | ||
acceler.c | ||
asdl.py | ||
asdl_c.py | ||
grammar1.c | ||
listnode.c | ||
myreadline.c | ||
node.c | ||
parser.c | ||
parser.h | ||
parsetok.c | ||
Python.asdl | ||
token.c | ||
tokenizer.c | ||
tokenizer.h |