Skip to main content

Software Heritage Scheduler

Project description

swh-scheduler

Job scheduler for the Software Heritage project.

Task manager for asynchronous/delayed tasks, used for both recurrent (e.g., listing a forge, loading new stuff from a Git repository) and one-off activities (e.g., loading a specific version of a source package).

Tests

Running test manually

Test data

To be able to run (unit) tests, you need to have the [[https://forge.softwareheritage.org/source/swh-storage-testdata.git|swh-storage-testdata]] in the parent directory. If you have set your environment following the [[ https://docs.softwareheritage.org/devel/getting-started.html#getting-started|Getting started]] document everything should be set up just fine.

Otherwise:

~/.../swh-scheduler$ git clone https://forge.softwareheritage.org/source/swh-storage-testdata.git ../swh-storage-testdata

Required services

Unit tests that require a running celery broker uses an in memory broker/result backend by default, but you can choose to use a true broker by setting CELERY_BROKER_URL and CELERY_RESULT_BACKEND environment variables up.

For example:

$ CELERY_BROKER_URL=amqp://localhost pifpaf run postgresql nosetests

.....................................
----------------------------------------------------------------------
Ran 37 tests in 15.578s

OK

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

swh.scheduler-0.0.36.tar.gz (43.3 kB view hashes)

Uploaded Source

Built Distribution

swh.scheduler-0.0.36-py3-none-any.whl (76.3 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page