Transforms tokens into original source code (while preserving whitespace).
Project description
untokenize transforms tokens into source code. Unlike the standard library’s tokenize.untokenize(), it preserves the original whitespace between tokens.
Usage
import untokenize source_code = untokenize.untokenize(tokens)
Tests
To run the unit tests:
$ ./test_untokenize.py
There is also an acid test. It tokenizes Python code and confirms that the code generated by untokenize exactly matches the original source code from before tokenization:
$ ./test_acid.py
Release history Release notifications
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
| Filename, size | File type | Python version | Upload date | Hashes |
|---|---|---|---|---|
| Filename, size untokenize-0.1.1.tar.gz (3.1 kB) | File type Source | Python version None | Upload date | Hashes View hashes |
