invenio-feeds
Celery-based feed processing extension for InvenioRDM, powering the Rogue Scholar science blog archive.
invenio-feeds replaces the former Flask/REST API with Celery workers that periodically fetch blog feeds, normalise posts, and upsert them as InvenioRDM records and communities. It follows the standard invenio-base extension pattern and integrates into any InvenioRDM instance.
Installation
Requires Python 3.14. Uses uv for dependency management.
uv sync
Running
Celery worker
celery -A invenio_feeds.tasks worker --loglevel=info
Celery beat scheduler (periodic tasks)
celery -A invenio_feeds.tasks beat --loglevel=info
Trigger a feed import manually
celery -A invenio_feeds.tasks call invenio_feeds.process_blog_feed --args='["<blog-slug>"]'
Scheduled tasks
| Task | Schedule | Description |
|---|---|---|
invenio_feeds.process_all_feeds |
every 30 min | Fan-out: one process_blog_feed per active blog |
invenio_feeds.process_blog_feed |
on-demand | Fetch and upsert all new posts for one blog |
invenio_feeds.classify_all_blogs |
daily 03:00 UTC | Fan-out: classify untagged posts per blog |
Development
We use pytest for testing:
uv run pytest
Follow along via Codeberg Issues. Please open an issue if you encounter a bug or have a feature request.
Note on Patches/Pull Requests
- Fork the project
- Write tests for your new feature or a test that reproduces a bug
- Implement your feature or make a bug fix
- Do not mess with Rakefile, version or history
- Commit, push and make a pull request. Bonus points for topical branches.
Documentation
Documentation (work in progress) for using Rogue Scholar is available at the Rogue Scholar Documentation website.
Meta
Please note that this project is released with a Contributor Code of Conduct. By participating in this project you agree to abide by its terms.
License: MIT
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file invenio_feeds-0.3.7.tar.gz.
File metadata
- Download URL: invenio_feeds-0.3.7.tar.gz
- Upload date:
- Size: 175.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
uv/0.11.25 {"installer":{"name":"uv","version":"0.11.25","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
fad1ce3d2323bd1c7be39d0fda17a9279a58029f5a301350a6478a75ca5e5d08
|
|
| MD5 |
56456b933434d4ee494fcefdf511797b
|
|
| BLAKE2b-256 |
b981201bbba17e681e8c71ffc072ef537db36f97a8beba09748596c169f37109
|
File details
Details for the file invenio_feeds-0.3.7-py3-none-any.whl.
File metadata
- Download URL: invenio_feeds-0.3.7-py3-none-any.whl
- Upload date:
- Size: 187.9 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
uv/0.11.25 {"installer":{"name":"uv","version":"0.11.25","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
5b37a67f39ce46eaa807b79c55c13e87c4569f83ff7b0abdc37958bf75671949
|
|
| MD5 |
343b125ae7d946923888c32850094e23
|
|
| BLAKE2b-256 |
e7529168ef0286d53eb86e0c8a218a58a33c9d7b51583b12b5cd93ba3db21fb9
|
