Skip to main content

High-speed, high-accuracy, local OCR for Japanese video games.

Project description

meikiocr

license: apache 2.0 hugging face space detection model recognition model

high-speed, high-accuracy, local ocr for japanese video games.

meikiocr is a python-based ocr pipeline that combines state-of-the-art detection and recognition models to provide an unparalleled open-source solution for extracting japanese text from video games and similar rendered content.

original image ocr result
input input_ocrresult
ナルホド
こ、こんなにドキドキするの、
小学校の学級裁判のとき以来です。

live demo

the easiest way to see meikiocr in action is to try the live demo hosted on hugging face spaces. no installation required!

try the meikiocr live demo here


core features

  • high accuracy: purpose-built and trained on japanese video game text, meikiocr significantly outperforms general-purpose ocr tools like paddleocr or easyocr on this specific domain.
  • high speed: the architecture is pareto-optimal, delivering exceptional performance on both cpu and gpu.
  • fully local & private: unlike cloud-based services, meikiocr runs entirely on your machine, ensuring privacy and eliminating api costs or rate limits.
  • cross-platform: it works wherever onnx runtime runs, providing a much-needed local ocr solution for linux users.
  • open & free: both the code and the underlying models are freely available under permissive licenses.

performance & benchmarks

meikiocr is built from two highly efficient models that establish a new pareto front for japanese text recognition. this means they offer a better accuracy/latency tradeoff than any other known open-weight model.

detection (cpu) detection (gpu)
accuracy_vs_cpu_latency accuracy_vs_gpu_latency
recognition (cpu) recognition (gpu)
accuracy_vs_cpu_latency accuracy_vs_gpu_latency

installation

pip install meikiocr

for nvidia gpu users (recommended)

for a massive performance boost, you can install the gpu-enabled version of the onnx runtime. this will be detected automatically by the script.

pip install meikiocr
pip uninstall onnxruntime
pip install onnxruntime-gpu

usage - cli

after installation, you can use the meikiocr tool directly from your terminal.

meikiocr image.png

options

  • save visualization: draw bounding boxes and save the result to a file.
    meikiocr image.png --output result.jpg
    
  • json output: get detailed results (coordinates, confidence scores) for integration with other scripts.
    meikiocr image.png --json
    
  • adjust thresholds: fine-tune detection and recognition sensitivity.
    meikiocr image.png --det-threshold 0.6 --rec-threshold 0.2
    

run meikiocr --help for a full list of available options.

usage - python

this is how meikiocr can be called. you can also run demo.py for additional visual output.

import cv2
import numpy as np
from urllib.request import urlopen
from meikiocr import MeikiOCR

IMAGE_URL = "https://huggingface.co/spaces/rtr46/meikiocr/resolve/main/example.jpg"

with urlopen(IMAGE_URL) as resp:
    image = cv2.imdecode(np.asarray(bytearray(resp.read()), dtype="uint8"), cv2.IMREAD_COLOR)

ocr = MeikiOCR() # Initialize the OCR pipeline
results = ocr.run_ocr(image) # Run the full OCR pipeline
print('\n'.join([line['text'] for line in results if line['text']]))

adjusting thresholds

you can adjust the confidence thresholds for both the text line detection and the character recognition models. lowering the thresholds results in more detected text lines and characters, while higher values prevent false positives.

MeikiOCR().run_ocr(self, image, det_threshold=0.8, rec_threshold=0.2) # less, but more confident text boxes and characters returned

running dedicated detection

if you only care about the position of the text and not the content you can run the detection by itself, which is faster than running the whole ocr pipeline:

MeikiOCR().run_detection(self, image, det_threshold=0.8, rec_threshold=0.2) # only returns text line coordinates (for horizontal and vertical text lines)

in the same way you can also run_recognition by itself on images of precropped (horizontal) text lines.

how it works

meikiocr is a two-stage pipeline:

  1. text detection: the meiki.text.detect.v0 model first identifies the bounding boxes of all horizontal text lines in the image.
  2. text recognition: each detected text line is then cropped and processed in a batch by the meiki.text.recognition.v0 model, which recognizes the individual characters within it.

limitations

while meikiocr is state-of-the-art for its niche, it's important to understand its design constraints:

  • domain specific: it is highly optimized for rendered text from video games and may not perform well on handwritten or complex real-world scene text.
  • horizontal text only: it does not currently support vertical text.
  • architectural limits: the detection model is capped at finding 64 text boxes, and the recognition model can process up to 48 characters per line. these limits are sufficient for over 99% of video game scenarios but may be a constraint for other use cases.

advanced usage & potential

the meiki_ocr.py script provides a straightforward implementation of a post-processing pipeline that selects the most confident prediction for each character. however, the raw output from the recognition model is richer and can be used for more advanced applications. for example, one could build a language-aware post-processing step using n-grams to correct ocr mistakes by considering alternative character predictions.

this opens the door for meikiocr to be integrated into a variety of projects.

license

this project is licensed under the apache 2.0 license. see the license file for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

meikiocr-0.3.1.tar.gz (18.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

meikiocr-0.3.1-py3-none-any.whl (24.4 kB view details)

Uploaded Python 3

File details

Details for the file meikiocr-0.3.1.tar.gz.

File metadata

  • Download URL: meikiocr-0.3.1.tar.gz
  • Upload date:
  • Size: 18.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.5

File hashes

Hashes for meikiocr-0.3.1.tar.gz
Algorithm Hash digest
SHA256 6755b87dca4b3fe64d4cc8bd628deae3185cd8f5f76c03ab40fbbc12d013b480
MD5 1d9ec706f5814a8c03bac1576ad703fd
BLAKE2b-256 b9fef74c0180c424225212387251d8b6f12e583e4a2f7455fe5495a98b3bb1cd

See more details on using hashes here.

File details

Details for the file meikiocr-0.3.1-py3-none-any.whl.

File metadata

  • Download URL: meikiocr-0.3.1-py3-none-any.whl
  • Upload date:
  • Size: 24.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.5

File hashes

Hashes for meikiocr-0.3.1-py3-none-any.whl
Algorithm Hash digest
SHA256 3c7634032e7c399a9d1a2654ffa788740c42b51f37403ae11e82ed4b013a7e0c
MD5 8392e6b927b6bde600b3c3204911563d
BLAKE2b-256 748a2d89cc61f10474b9c487b23eda9909681610cee30d8be8c469ca1e7b3334

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page