Project description

plrs

The multi-tool of lexical analysis and tokenization.

Install

pip install plrs

Build

maturin build

Examples

zipfs-law

API

Global variables

EOF_TOKEN

Classes

Tokens
Settings
Token
  - part
  - token
  - set_part
  - set_token
  - __str__
  - __repr__

Lexer
  - new
  - char_forward
  - skip_over_char_set
  - next

Functions

is_char_symbol
is_char_operator
is_char_whitespace
is_char_numeric
is_single_quote
is_double_quote
ends_token
is_part_numeric
tokenize

Project details

These details have not been verified by PyPI

Project links

Source Code

GitHub Statistics

View statistics for this project via Libraries.io, or by using our public dataset on Google BigQuery

Release history Release notifications | RSS feed

This version

0.1.5

Sep 11, 2021

0.1.4

Sep 10, 2021

0.1.3

Sep 10, 2021

0.1.2

Aug 12, 2021

0.1.1

Aug 3, 2021

0.1.0

Aug 3, 2021

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

plrs-0.1.5.tar.gz (6.5 kB view hashes)

Uploaded Sep 11, 2021 Source

Built Distribution

plrs-0.1.5-cp38-cp38-manylinux_2_24_x86_64.whl (186.1 kB view hashes)

Uploaded Sep 11, 2021 CPython 3.8 manylinux: glibc 2.24+ x86-64

Hashes for plrs-0.1.5.tar.gz

Hashes for plrs-0.1.5.tar.gz
Algorithm	Hash digest
SHA256	`26094319382fc6d2857a4eda84b183313975355fa7fe4d80da80160d381cbf5c`
MD5	`13097a2993066da88e14ef4c038958df`
BLAKE2b-256	`df4d7569fe5c06dd0c7a6326b27e3551287fd9c7db263ecc1c4e514cb262e885`

Hashes for plrs-0.1.5-cp38-cp38-manylinux_2_24_x86_64.whl

Hashes for plrs-0.1.5-cp38-cp38-manylinux_2_24_x86_64.whl
Algorithm	Hash digest
SHA256	`cc6137e60d644867c07b86b4d1d5e331cbdb03bf9ed87f559db45ee0ec569f19`
MD5	`0952367ecb3034c5c1429bd8794b483b`
BLAKE2b-256	`7929a4b0c78292df205bc8fbda1ee9c84199e713c699c62cff5bd612b769d5dd`