Skip to main content

No project description provided

Project description

django-q-mt

Multi-threaded django-q2 worker.

Install

pip install django-q-mt

Usage

Add django_q_mt to INSTALLED_APPS.

./manage.py django_q_mt

Supports standard django-q2 configuration like Q_CLUSTER, workers, timeout.

Limitations

recycle isn't supported at the moment. If memory leaks are a concern, you can use MemoryMax= in systemd or an equivalent.

Timeouts

Timeout handling is more finicky and unreliable in multi-threaded setups. django-q-mt forces timeouts in the following stages:

  • A TimeoutError is injected with PyThreadState_SetAsyncExc. The thread must run the Python interpreter in order for this to work.

  • If the thread is still alive after 30 seconds, django-q-mt uses ptrace to force-stop a blocking syscall, eg. an infinite read from a socket.

  • If it fails, after 30 second the entire process with all threads is recycled. It should be a rare case, as at this point the timing out thread is either running a tight C loop or is deadlocked.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

django_q_mt-0.2.tar.gz (5.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

django_q_mt-0.2-py3-none-any.whl (6.2 kB view details)

Uploaded Python 3

File details

Details for the file django_q_mt-0.2.tar.gz.

File metadata

  • Download URL: django_q_mt-0.2.tar.gz
  • Upload date:
  • Size: 5.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for django_q_mt-0.2.tar.gz
Algorithm Hash digest
SHA256 af0dea8b16a3d19bdac27a813210de6a79d28f138f2346d6e3c61d4b98a34d56
MD5 03a44b197c59402f3886e01f962453b8
BLAKE2b-256 104fda4dd48580b76512326f3109ea3a748c9f4d7838665eef92f9a3eae97c92

See more details on using hashes here.

Provenance

The following attestation bundles were made for django_q_mt-0.2.tar.gz:

Publisher: publish.yml on mbachry/django-q-mt

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file django_q_mt-0.2-py3-none-any.whl.

File metadata

  • Download URL: django_q_mt-0.2-py3-none-any.whl
  • Upload date:
  • Size: 6.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for django_q_mt-0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 97da244e7067a749808fb09ee6c35fb702d2af1deaf8144ffa52767503b05949
MD5 7140bf68cd9e04b54167d343f006d4b3
BLAKE2b-256 f613e6f0e4e36b73cd5eaa015220ab39d5adc980a9858d7798debfac539777e5

See more details on using hashes here.

Provenance

The following attestation bundles were made for django_q_mt-0.2-py3-none-any.whl:

Publisher: publish.yml on mbachry/django-q-mt

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page