Skip to main content
Join the official 2020 Python Developers SurveyStart the survey!

Sentence splitting & tokenization

Project description

Obeliks - sentence splitting & tokenization


Install from PyPI:

pip install obeliks


Command line:

obeliks -h

Command line parameters:

-if <name*> read input from one or more files
-sif        read input from list of files, specified via stdin
-o <name>   write output to file <name>
-tei        produce XML-TEI output
-c		    produce CoNLL-U output
-d		    pass "newdoc id" to output (implies -c)

Usage examples:

obeliks "To je stavek." "Tudi to je stavek."
echo -e "To je stavek.\nTudi to je stavek." | obeliks
obeliks "To je stavek." "Tudi to je stavek." -o output.txt
echo -e "To je stavek.\nTudi to je stavek." | obeliks > output.txt
obeliks -if text*.txt
cat text*.txt | obeliks

As a Python module:

import obeliks

text = 'Hello, world!'

# Store results to string
output =, conllu=True)

# Write result to file, out_file='tei.txt', tei=True)

# Write to stdout, to_stdout=True, conllu=True)

# Read input from file(s)
output ='in.txt', conllu=True)
output =['in1.txt', 'in2.txt'], tei=True)

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for obeliks, version 1.0.2
Filename, size File type Python version Upload date Hashes
Filename, size obeliks-1.0.2-py3-none-any.whl (15.7 kB) File type Wheel Python version py3 Upload date Hashes View
Filename, size obeliks-1.0.2.tar.gz (12.4 kB) File type Source Python version None Upload date Hashes View

Supported by

Pingdom Pingdom Monitoring Google Google Object Storage and Download Analytics Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page