Skip to main content

A Python package for retrieving arXiv papers and filter them out with respect to some specific regex pattern.

Project description

CI Coverage License: MIT PyPI version Python versions

pyrxiv

pyrxiv is a Python package for retrieving arXiv papers, storing their metadata in pydantic-like classes, and optionally filtering some of them out based on the specific content of the papers (matching a regex pattern).

While originally developed for the Strongly Correlated Electron Systems community in Condensed Matter Physics (cond-mat.str-el), it's designed to be flexible and applicable to any arXiv category.

Install the core package:

pip install pyrxiv

Objective

pyrxiv main objective is to provide an easy command line interface (CLI) to search and download arXiv papers which contain a specific content string matched against a regex pattern. You can use the CLI and print the options after installing the package using:

pyrxiv --help

or directly:

pyrxiv search_and_download --help

For example:

pyrxiv search_and_download --category cond-mat.str-el --regex-pattern "DMFT|Hubbard" --n-papers 5 --download-pdfs True

Development

To contribute to pyrxiv or run it locally, follow these steps:

Clone the Repository

git clone https://github.com/JosePizarro3/pyrxiv.git
cd pyrxiv

Set Up a Virtual Environment

We recommend Python ≥ 3.10:

python3 -m venv .venv
source .venv/bin/activate

Install Dependencies

Use uv (faster than pip) to install the package in editable mode with dev extras:

pip install --upgrade pip
pip install uv
uv pip install -e .[dev]

Run tests

Use pytest with verbosity to run all tests:

python -m pytest -sv tests

To check code coverage:

python -m pytest --cov=pyrxiv tests

Code formatting and linting

We use Ruff for formatting and linting (configured via pyproject.toml).

Check linting issues:

ruff check .

Auto-format code:

ruff format .

Manually fix anything Ruff cannot handle automatically.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pyrxiv-0.4.0.tar.gz (13.3 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

pyrxiv-0.4.0-py3-none-any.whl (13.3 MB view details)

Uploaded Python 3

File details

Details for the file pyrxiv-0.4.0.tar.gz.

File metadata

  • Download URL: pyrxiv-0.4.0.tar.gz
  • Upload date:
  • Size: 13.3 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for pyrxiv-0.4.0.tar.gz
Algorithm Hash digest
SHA256 5dc5ff4d544e90315bb7cbeea5ded4c6e57782bb34a728fb4b22199147128fae
MD5 b42f9ca071684c9952b4b47c43fb65d9
BLAKE2b-256 4e17fb57e4fcd266915d396d4abd148d98abec3319ec668d308c10306bdbd2a5

See more details on using hashes here.

File details

Details for the file pyrxiv-0.4.0-py3-none-any.whl.

File metadata

  • Download URL: pyrxiv-0.4.0-py3-none-any.whl
  • Upload date:
  • Size: 13.3 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for pyrxiv-0.4.0-py3-none-any.whl
Algorithm Hash digest
SHA256 d00f0874828c9902311d6b3a51e476d69d4abe0f1122513762c0572f1de4d6f5
MD5 2813bd9f0b8c52d43d35e925d97df18e
BLAKE2b-256 cf2452a6be4f691d017e8b580f0f323df8e1cd2e7bf287fb3e42d3cabdc6ac12

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page