Unicode-based language-agnostic (over-) tokenizer.
This package provides a simple language-agnostic tokenizer.
Copyright ® 2016, Luís Gomes <firstname.lastname@example.org>.
This library is free software; you can redistribute it and/or modify it under the terms of the GNU Lesser General Public License as published by the Free Software Foundation; either version 2.1 of the License, or (at your option) any later version.
This library is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU Lesser General Public License for more details.
You should have received a copy of the GNU Lesser General Public License along with this library; if not, write to the Free Software Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
|File Name & Checksum SHA256 Checksum Help||Version||File Type||Upload Date|
|overtokenizer-0.1.0-py3-none-any.whl (5.3 kB) Copy SHA256 Checksum SHA256||py3||Wheel||Sep 8, 2016|
|overtokenizer-0.1.0.tar.gz (3.5 kB) Copy SHA256 Checksum SHA256||–||Source||Sep 8, 2016|