django-ocr_translate 0.7.3

Django app for OCR and translation

OCR_translate

This is a Django app for creating back-end server aimed at performing OCR and translation of images received via a POST request.

The OCR and translation is performed using freely available machine learning models and packages (see below for what is currently implemented).

The server is designed to be used together with this browser extension, acting as a front-end providing the images and controlling the languages, models and plugins being used.

For more information, please consult the Full Documentation

Running the server

See the documentation for more information.

TLDR: If you are on windows you will need to:

• install python (3.10 <= SUPPORTED_VERSIONS <= 3.13) with the check on Add python.exe to PATH
• download>unzip the release file
• run the run-user.[bat/sh] file (bat for windows, sh for linux)

Why do I need to install python

Before version v0.6.0 the server was distributed by including all possible plugins and their dependencies.
This made the distribution file (both the github release and docker image) quite large and the release process cumbersome.
Furthermore, not every user might be interested in every plugin and might end up downloading GB of files that they will never use.

For this reason a plugin_manager has been added to the project that will download/install the plugins and their dependencies on demand.
Installing python packages requires pip to be available (which is included with python on the windows installer).
Unfortunately I have not found a way to include pip reliably in the frozen install produced for the release file.
The alternative would've been to add a 2nd installer just to get pip before running the server, but why reinvent the wheel.

The check on Add python.exe to PATH is needed so that pip can be run without having to make any assumption on the installation path.

Also since I am now asking people to install python, I decided to go all the way and use an approach similar to what automatic1111's webui.bat does for stable diffusion.
This batch script will create/reuse a virtual environment in a folder venv in the same directory as the script and install the required packages in it.

Upgrading from a previous version

• Download the desired release files.
• Stop the server if it is running
• Run the new server files. Make sure to use the same environment variables in run-user.[bat/sh] as before if you had set any
• Since v0.6.0 you could also replace the existing server files with the new ones, or point the new ones to reuse the same virtual environment (if you really want to save 100~200MB)

Since v0.6.1 you can also use the OCT_VERSION and OCT_AUTOUPDATE environment variables to have the server update itself automatically to the latest or a specific version. It is still recommended to download the new release files as improvements/bug-fixes/new-features can also be added to the launch and settings scripts.

What happens to my installation and database in an upgrade

• The database will be automatically migrated to the new version if needed. Any existing data will be preserved.
• The plugins and their dependencies will be left unchanged or upgraded as needed.
• Models will be reused

NOTE: Attempting to reuse the plugins if switching between different python versions will likely cause problems. If you plan to use different python versions, it is recommended to point to a different OCT_BASE_DIR or move/delete your current plugin installations.

Can I downgrade to a previous version

It depends... downgrading to a previous version is in general not supported. In particular if there have been changes to the database schema, downgrading them is not automated in this project. In that case, you would need to either start from a new database or use a backed up from the target version (or a previous one as upgrading is supported). Check the labeled PRs for which releases contains database migrations (label might be missing before v0.4.0).

Contributing

• Suggestions/Ideas are always welcome and can be posted as discussions.
  You can also just propose a new model to be tested/added to the ones available by default.
• Bugs can be reported as issues
• Code contributions as pull requests. Check the documentation for more information.

Plugins

The server is designed to only offer the basic functionalities, while the models that can be used and how they are used are defined by plugins.

See the documentation for a list of available plugins

Notes

• When switching the server between CPU/CUDA mode for the first time, run the installation of the plugins again to make sure the scope-specific dependencies are installed.

• Different plugins will make different types of models available:

  • BOX Model: EasyOcr, PaddleOCR
  • OCR Model: PaddleOCR, Tesseract, HuggingFace
  • Translation Model: HuggingFace, GoogleTranslate, Ollama

• Also some plugins might requires additional tools to be installed on the server and possibly some environment variable configured. Refer to the plugin documentation and the information the the tooltip shown by hovering the question mark next to the plugin name.

Troubleshooting

• Related to https://github.com/Crivella/ocr_extension/issues/5 If a plugins fails to install, either via an error message you see in the server window or by not having the models available, try the following:
  • Uninstall the plugin in question by deselecting it in the popup menu and clicking submit.
  • Nuke the entire plugin installation by:
    • Stopping the server
    • Delete the plugins directory and the plugins.json file under $OCT_BASE_DIR (default to $HOME/.ocr_translate on Linux and %userprofile%\.ocr_translate on Windows)
    • Restart the server

If all else fails, please open an issue on the backend server possibly attaching the DEBUG log of the server (run the server by setting the environment variable DJANGO_LOG_LEVEL=DEBUG in your run-user.[sh/bat] script).

Possible problems

• Issue 25 Using uBlock origin (or possibly other extension capable of blocking content) could stop the extension from sending requests to the server. This can be recognized if the popup for setting the language and models works fine but then the translations fails without producing any new log in the server windows. (WIP long term fix in the extension)

• Issue 27 Having non latin characters in the model's path can cause HuggingFace transformers to fail loading them