Skip to main content

This package provides a simple language-agnostic tokenizer.

Copyright ® 2016, Luís Gomes <luismsgomes@gmail.com>.

This library is free software; you can redistribute it and/or modify it under the terms of the GNU Lesser General Public License as published by the Free Software Foundation; either version 2.1 of the License, or (at your option) any later version.

This library is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU Lesser General Public License for more details.

You should have received a copy of the GNU Lesser General Public License along with this library; if not, write to the Free Software Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

overtokenizer-0.2.0.tar.gz (4.3 kB view details)

Uploaded Source

File details

Details for the file overtokenizer-0.2.0.tar.gz.

File metadata

  • Download URL: overtokenizer-0.2.0.tar.gz
  • Upload date:
  • Size: 4.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for overtokenizer-0.2.0.tar.gz
Algorithm Hash digest
SHA256 bb9fdc1eb81576702446c5dbfbe2562406929977ab04504b71f68bf85624ebf2
MD5 555b7c56a54c64ae5ff9d1a48e0a3da8
BLAKE2b-256 da5ba6188032e9cd6260e41c32359bb447dbba8ca0734959d35f30e9016f8368

See more details on using hashes here.

Release history Release notifications | RSS feed

This release

0.2.0 This release

1 file

0.1.0

2 files

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page