invenio-feeds 0.1.2

Celery-based feed processing extension for InvenioRDM.

invenio-feeds

Celery-based feed processing extension for InvenioRDM, powering the Rogue Scholar science blog archive.

invenio-feeds replaces the former Flask/REST API with Celery workers that periodically fetch blog feeds, normalise posts, and upsert them as InvenioRDM records and communities. It follows the standard invenio-base extension pattern and integrates into any InvenioRDM instance.

Installation

Requires Python 3.14. Uses uv for dependency management.

uv sync

Environment variables

# InvenioRDM instance to read/write
FLASK_INVENIORDM_API=https://rogue-scholar.org   # default
FLASK_INVENIORDM_TOKEN=<bearer-token>

Running

Celery worker

celery -A invenio_feeds.tasks worker --loglevel=info

Celery beat scheduler (periodic tasks)

celery -A invenio_feeds.tasks beat --loglevel=info

Trigger a feed import manually

celery -A invenio_feeds.tasks call invenio_feeds.process_blog_feed --args='["<blog-slug>"]'

Scheduled tasks

Task	Schedule	Description
invenio_feeds.process_all_feeds	every 30 min	Fan-out: one process_blog_feed per active blog
invenio_feeds.process_blog_feed	on-demand	Fetch and upsert all new posts for one blog
invenio_feeds.classify_all_blogs	daily 03:00 UTC	Fan-out: classify untagged posts per blog

Development

We use pytest for testing:

uv run pytest

Follow along via Codeberg Issues. Please open an issue if you encounter a bug or have a feature request.

Note on Patches/Pull Requests

• Fork the project
• Write tests for your new feature or a test that reproduces a bug
• Implement your feature or make a bug fix
• Do not mess with Rakefile, version or history
• Commit, push and make a pull request. Bonus points for topical branches.

Documentation

Documentation (work in progress) for using Rogue Scholar is available at the Rogue Scholar Documentation website.

Meta

Please note that this project is released with a Contributor Code of Conduct. By participating in this project you agree to abide by its terms.

License: MIT