Software Heritage core utilities
Project description
swh-core
core library for swh's modules:
- config parser
- hash computations
- serialization
- logging mechanism
Defines also a celery application to run concurrency tasks
Celery use
configuration file
worker.ini file which looks like:
[main]
task_broker = amqp://guest@localhost//
task_modules = swh.loader.dir.tasks, swh.loader.tar.tasks, swh.loader.git.tasks
task_queues = swh_loader_tar, swh_loader_git, swh_loader_dir
task_soft_time_limit = 0
This file can be set in the following location:
- ~/.swh
- ~/.config/swh
- /etc/softwareheritage
run celery worker
Sample command:
celery worker --app=swh.core.worker \
--pool=prefork \
--autoscale=2,2 \
-Ofair \
--loglevel=info 2>&1 | tee -a swh-core-worker.log
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
swh.core-0.0.43.tar.gz
(36.1 kB
view hashes)
Built Distribution
swh.core-0.0.43-py3-none-any.whl
(39.0 kB
view hashes)
Close
Hashes for swh.core-0.0.43-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2a14da00d8880f79f89f3bd1840f2b1b18ddd7c9effd8722fd1fd0744bca2b26 |
|
MD5 | bc8b460a6e8fdba61be9ca6f0d82c100 |
|
BLAKE2b-256 | f7621f757786428de47423448714b7685071c86af5bb57632aa35c41a80de8cf |