manga-ocr-abang 0.2.0

OCR for Japanese manga

Manga OCR

Optical character recognition for Japanese text, with the main focus being Japanese manga. It uses a custom end-to-end model built with Transformers' Vision Encoder Decoder framework.

Manga OCR can be used as a general purpose printed Japanese OCR, but its main goal was to provide a high quality text recognition, robust against various scenarios specific to manga:

• both vertical and horizontal text
• text with furigana
• text overlaid on images
• wide variety of fonts and font styles
• low quality images

Unlike many OCR models, Manga OCR supports recognizing multi-line text in a single forward pass, so that text bubbles found in manga can be processed at once, without splitting them into lines.

See also:

• Poricom, a GUI reader, which uses manga-ocr
• mokuro, a tool, which uses manga-ocr to generate an HTML overlay for manga
• Xelieu's guide, a comprehensive guide on setting up a reading and mining workflow with manga-ocr/mokuro (and many other useful tips)
• Development code, including code for training and synthetic data generation: link
• Description of synthetic data generation pipeline + examples of generated images: link