Software Heritage core utilities
Project description
swh-core
core library for swh's modules:
- config parser
- hash computations
- serialization
- logging mechanism
Defines also a celery application to run concurrency tasks
Celery use
configuration file
worker.ini file which looks like:
[main]
task_broker = amqp://guest@localhost//
task_modules = swh.loader.dir.tasks, swh.loader.tar.tasks, swh.loader.git.tasks
task_queues = swh_loader_tar, swh_loader_git, swh_loader_dir
task_soft_time_limit = 0
This file can be set in the following location:
- ~/.swh
- ~/.config/swh
- /etc/softwareheritage
run celery worker
Sample command:
celery worker --app=swh.core.worker \
--pool=prefork \
--autoscale=2,2 \
-Ofair \
--loglevel=info 2>&1 | tee -a swh-core-worker.log
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
swh.core-0.0.45.tar.gz
(22.1 kB
view hashes)
Built Distribution
swh.core-0.0.45-py3-none-any.whl
(41.8 kB
view hashes)
Close
Hashes for swh.core-0.0.45-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 659823e956d0826eaf5ed71e744f9356720d8a5082d9d158430081f9e0970a9e |
|
MD5 | 426eb6ea13ee0f0ce32d5afeaea45c00 |
|
BLAKE2b-256 | 7c249f92a7661e6289823e33b2e2e625ae3f6aff0d503f8e91b0ab3fb07866ef |