Overview
Nidaba is the central controller for the entire OGL OCR pipeline. It oversees and automates the process of converting raw images into citable collections of digitized texts.
It offers the following functionality:
Grayscale Conversion
Binarization utilizing Sauvola adaptive thresholding, Otsu, or ocropus’s nlbin algorithm
Deskewing
Dewarping
Page segmentation from the aforementioned OCR packages
Various postprocessing utilities like spell-checking, merging of multiple results, and ground truth comparison.
As it is designed to use a common storage medium on network attached storage and the celery distributed task queue it scales nicely to multi-machine clusters.
Build
To easiest way to install the latest stable(-ish) nidaba is from PyPi:
$ pip install nidaba
or run:
$ pip install .
in the git repository for the bleeding edge development version.
Some useful tasks have external dependencies. A good start is:
# apt-get install libtesseract3 tesseract-ocr-eng libleptonica-dev liblept
Tests
Per default no dictionaries and OCR models necessary to runs the tests are installed. To download the necessary files run:
$ python setup.py download
$ python setup.py nosetests
Tests for modules that call external programs, at the time only tesseract, ocropus, and kraken, will be skipped if these aren’t installed.
Running
First edit (the installed) nidaba.yaml and celery.yaml to fit your needs. Have a look at the docs if you haven’t set up a celery-based application before.
Then start up the celery daemon with something like:
$ celery -A nidaba worker
Next jobs can be added to the pipeline using the nidaba executable:
$ nidaba batch -b otsu -l tesseract -o tesseract:eng -- ./input.tiff Preparing filestore [✓] Building batch [✓] 951c57e5-f8a0-432d-8d77-8a2e27fff53c
Using the return code the current state of the job can be retrieved:
$ nidaba status 25d79a54-9d4a-4939-acb6-8e168d6dbc7c PENDING
When the job has been processed the status command will return a list of paths containing the final output:
$ nidaba status 951c57e5-f8a0-432d-8d77-8a2e27fff53c SUCCESS 14.tif → .../input_img.rgb_to_gray_binarize.otsu_ocr.tesseract_grc.tif.hocr
Documentation
Want to learn more? Read the Docs
1 maintainer
Metadata
1 maintainer
Release files for nidaba 2.0.4
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| nidaba-2.0.4.tar.gz | 1.5 MB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| nidaba-2.0.4-py2-none-any.whl | Python 2 | none | any | Details |
Total release size: 3.0 MB
Release files / nidaba-2.0.4.tar.gz
| Download URL | nidaba-2.0.4.tar.gz |
|---|---|
| Size | 1.5 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
f5df3827852734371604d8aa6cd370f38fa515807f1513e954188341025b7afa
|
|
BLAKE2b-256 checksum How to use checksums |
bb68a524ba980896eb85fe8d2d9943feaeb4dfff922e9796c4575a15bca8b62e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
Release files / nidaba-2.0.4-py2-none-any.whl
| Download URL | nidaba-2.0.4-py2-none-any.whl |
|---|---|
| Size | 1.5 MB |
| Tags | Python 2 |
|
SHA-256 checksum How to use checksums |
54ef04715183c65fb10a4625987e5faa40f79627734b149cb8da29ce091b1156
|
|
BLAKE2b-256 checksum How to use checksums |
35dc8027248f7c71febec5840dc8ddfd717737060c9c3f0b463919768a6fe6da
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
