bpo-25643: Refactor the C tokenizer#25050

Merged

pablogsal merged 6 commits intopython:masterfrom

pablogsal:better_token

Mar 28, 2021

Commits on Mar 28, 2021

bpo-25643: Refactor the C tokenizer
pablogsal
committed
Apply suggestions from code review

pablogsal
and
Erlend Egeberg Aasland
authored
Apply suggestions from code review

pablogsal
and
Erlend Egeberg Aasland
authored
Reorg the error paths
pablogsal
committed
Add missing PyMem_Free in tok_concatenate_interactive_new_line
pablogsal
committed
Update Parser/tokenizer.c

pablogsal
and
Erlend Egeberg Aasland
authored