invenio-feeds
Celery-based feed processing extension for InvenioRDM, powering the Rogue Scholar science blog archive.
invenio-feeds replaces the former Flask/REST API with Celery workers that periodically fetch blog feeds, normalise posts, and upsert them as InvenioRDM records and communities. It follows the standard invenio-base extension pattern and integrates into any InvenioRDM instance.
Installation
Requires Python 3.14. Uses uv for dependency management.
uv sync
Running
Celery worker
celery -A invenio_feeds.tasks worker --loglevel=info
Celery beat scheduler (periodic tasks)
celery -A invenio_feeds.tasks beat --loglevel=info
Trigger a feed import manually
celery -A invenio_feeds.tasks call invenio_feeds.process_blog_feed --args='["<blog-slug>"]'
Scheduled tasks
| Task | Schedule | Description |
|---|---|---|
invenio_feeds.process_all_feeds |
every 30 min | Fan-out: one process_blog_feed per active blog |
invenio_feeds.process_blog_feed |
on-demand | Fetch and upsert all new posts for one blog |
invenio_feeds.classify_all_blogs |
daily 03:00 UTC | Fan-out: classify untagged posts per blog |
Development
We use pytest for testing:
uv run pytest
Follow along via Codeberg Issues. Please open an issue if you encounter a bug or have a feature request.
Note on Patches/Pull Requests
- Fork the project
- Write tests for your new feature or a test that reproduces a bug
- Implement your feature or make a bug fix
- Do not mess with Rakefile, version or history
- Commit, push and make a pull request. Bonus points for topical branches.
Documentation
Documentation (work in progress) for using Rogue Scholar is available at the Rogue Scholar Documentation website.
Meta
Please note that this project is released with a Contributor Code of Conduct. By participating in this project you agree to abide by its terms.
License: MIT
1 maintainer
Metadata
1 maintainer
Release files for invenio-feeds 0.3.25
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| invenio_feeds-0.3.25.tar.gz | 187.0 kB | Without provenance | Details for invenio_feeds-0.3.25.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| invenio_feeds-0.3.25-py3-none-any.whl | Python 3 | none | any | Details for invenio_feeds-0.3.25-py3-none-any.whl |
Total release size: 387.4 kB
Release files / invenio_feeds-0.3.25.tar.gz
| Download URL | invenio_feeds-0.3.25.tar.gz |
|---|---|
| Size | 187.0 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
5411d2d471744dc24b6a238d770aeaed7c7eb9cdfa7c5b29598f3087e63453a2
|
|
BLAKE2b-256 checksum How to use checksums |
12ececc0de74833d3fda51e6dd33cab5cd834d28b259f17489d8e9b265a60f1b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.25 {"installer":{"name":"uv","version":"0.11.25","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
|
Release files / invenio_feeds-0.3.25-py3-none-any.whl
| Download URL | invenio_feeds-0.3.25-py3-none-any.whl |
|---|---|
| Size | 200.4 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
f9ea21fd941c3e6c64a5218de13031caa470c1f950c2eba2806cbb30b952752c
|
|
BLAKE2b-256 checksum How to use checksums |
055ef78d13fc9d6f8f38c9e4624def0125641aa7069cd4c2dfc7fe78d8eca595
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.25 {"installer":{"name":"uv","version":"0.11.25","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
|
Security for invenio-feeds 0.3.25
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.
