1
0
mirror of https://github.com/python/cpython synced 2024-07-03 07:19:51 +00:00
cpython/Parser
Lysandros Nikolaou d87b015106
gh-119118: Fix performance regression in tokenize module (#119615)
* gh-119118: Fix performance regression in tokenize module

- Cache line object to avoid creating a Unicode object
  for all of the tokens in the same line.
- Speed up byte offset to column offset conversion by using the
  smallest buffer possible to measure the difference.

Co-authored-by: Pablo Galindo <pablogsal@gmail.com>
2024-05-28 19:17:49 +00:00
..
lexer
tokenizer
action_helpers.c
asdl_c.py gh-118851: Default ctx arguments to AST constructors to Load() (#118854) 2024-05-09 15:30:14 -07:00
asdl.py
myreadline.c
parser.c gh-118090: Improve error message for empty type param brackets (GH-118091) 2024-05-07 14:01:06 +02:00
peg_api.c
pegen_errors.c
pegen.c gh-119118: Fix performance regression in tokenize module (#119615) 2024-05-28 19:17:49 +00:00
pegen.h gh-119118: Fix performance regression in tokenize module (#119615) 2024-05-28 19:17:49 +00:00
Python.asdl gh-116126: Implement PEP 696 (#116129) 2024-05-03 06:17:32 -07:00
string_parser.c
string_parser.h
token.c