Wrapper for Python's stdlib `tokenize` supporting roundtrips
The stdlib tokenize module does not properly roundtrip. This wrapper around the stdlib provides two additional tokens ESCAPED_NL and UNIMPORTANT_WS, and a Token data type. Use src_to_tokens and tokens_to_src to roundtrip. This library is useful if you are writing a refactoring tool based on the python tokenization.
Release | Stable | Testing |
---|---|---|
Fedora Rawhide | 6.1.0-1.fc42 | - |
Fedora 41 | 6.0.0-1.fc41 | - |
Fedora 40 | 6.1.0-1.fc40 | - |
You can contact the maintainers of this package via email at
python-tokenize-rt dash maintainers at fedoraproject dot org
.