languages/cpython
languages/cpython
1
0
Fork 0
mirror of https://github.com/python/cpython synced 2024-10-14 09:43:55 +00:00
Code Issues Packages Projects Releases Wiki Activity
cpython/Parser
History
Miss Islington (bot) 4a0af0cfdc
[3.12] gh-119118: Fix performance regression in tokenize module (GH-119615) (#119683) 
- Cache line object to avoid creating a Unicode object
  for all of the tokens in the same line.
- Speed up byte offset to column offset conversion by using the
  smallest buffer possible to measure the difference.

(cherry picked from commit d87b015106)

Co-authored-by: Lysandros Nikolaou <lisandrosnik@gmail.com>
Co-authored-by: Pablo Galindo <pablogsal@gmail.com>
2024-05-28 22:49:02 +02:00
..
action_helpers.c [3.12] gh-106396: Special-case empty format spec to gen empty JoinedStr node (GH-106401) (#106416) 2023-07-04 13:00:47 +00:00
asdl.py
asdl_c.py [3.12] GH-112215: Backport C recursion changes (GH-115083) 2024-02-13 10:45:59 +01:00
myreadline.c [3.12] GH-104668: Don't call PyOS_* hooks in subinterpreters (GH-104760) 2023-05-23 09:24:28 +00:00
parser.c [3.12] gh-109120: Fix syntax error in handlinh of incorrect star expressions… (#117465) 2024-04-04 11:22:43 -04:00
peg_api.c
pegen.c [3.12] gh-119118: Fix performance regression in tokenize module (GH-119615) (#119683) 2024-05-28 22:49:02 +02:00
pegen.h [3.12] gh-119118: Fix performance regression in tokenize module (GH-119615) (#119683) 2024-05-28 22:49:02 +02:00
pegen_errors.c [3.12] gh-115823: Calculate correctly error locations when dealing with implicit encodings (GH-115824) (#115949) 2024-02-26 13:18:06 +00:00
Python.asdl [3.12] gh-106145: Make end_{lineno,col_offset} required on type_param nodes (GH-106224) (#106295) 2023-07-01 00:15:18 +00:00
string_parser.c [3.12] gh-111380: Show SyntaxWarnings only once when parsing if invalid syntax is encouintered (GH-111381) (#111382) 2023-10-27 04:02:17 +00:00
string_parser.h gh-102856: Initial implementation of PEP 701 (#102855) 2023-04-19 11:18:16 -05:00
token.c gh-102856: Python tokenizer implementation for PEP 701 (#104323) 2023-05-21 01:03:02 +01:00
tokenizer.c [3.12] gh-113703: Correctly identify incomplete f-strings in the codeop module (GH-113709) (#113733) 2024-01-05 13:23:40 +00:00
tokenizer.h [3.12] gh-106989: Remove tok report warnings (GH-106993) (#107013) 2023-07-22 13:01:36 +00:00