untokenize transforms tokens into source code. Unlike the standard library’s tokenize.untokenize(), it preserves the original whitespace between tokens.
Usage
import untokenize
source_code = untokenize.untokenize(tokens)Tests
To run the unit tests:
$ ./test_untokenize.py
There is also an acid test. It tokenizes Python code and confirms that the code generated by untokenize exactly matches the original source code from before tokenization:
$ ./test_acid.py
1 maintainer
Release files for untokenize 0.1.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| untokenize-0.1.1.tar.gz | 3.1 kB | Details |
Release files / untokenize-0.1.1.tar.gz
| Download URL | untokenize-0.1.1.tar.gz |
|---|---|
| Size | 3.1 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
3865dbbbb8efb4bb5eaa72f1be7f3e0be00ea8b7f125c69cbd1f5fda926f37a2
|
|
BLAKE2b-256 checksum How to use checksums |
f746e7cea8159199096e1df52da20a57a6665da80c37fb8aeb848a3e47442c32
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
