Information Retrieval for experimaestro
Information Retrieval module for experimaestro
The full documentation can be read at IR@experimaestro.
You can find experiments built on top of XPMIR on the xpmir github workspace.
Finally, you can find the roadmap.
Install
Base experimaestro-IR can be installed with pip install xpmir.
Functionalities can be added by installing optional dependencies:
pip install xpmir[neural]to install neural-IR packages (torch, etc.)pip install xpmir[anserini]to install Anserini related packages
For the development version, you can:
- If you just want the development version: install with
pip install git+https://github.com/experimaestro/experimaestro-ir.git - If you want to edit the code: clone and then do a
pip install -e .within the directory
What's inside?
- Collection management (using datamaestro)
- Interface for the IR datasets library
- Splitting IR datasets
- Shuffling training triplets
- Representation
- Word Embeddings
- HuggingFace transformers
- Indices
- dense: FAISS interface
- sparse: xpmir-rust library
- Standard Indexing and Retrieval
- Anserini
- Learning to Rank
- Pointwise
- Pairwise
- Distillation
- Neural IR
- Cross-Encoder
- Splade
- DRMM
- ColBERT
- Paper reproduction:
- MonoBERT (Passage Re-ranking with BERT. Rodrigo Nogueira and Kyunghyun Cho. 2019)
- (alpha) DuoBERT (Multi-Stage Document Ranking with BERT. Rodrigo Nogueira, Wei Yang, Kyunghyun Cho, Jimmy Lin. 2019)
- (beta) Splade v2 (SPLADE v2: Sparse Lexical and Expansion Model for Information Retrieval, Thibault Formal, Carlos Lassance, Benjamin Piwowarski, and Stéphane Clinchant. SIGIR 2021)
- (planned) ANCE
- Pre-trained models
- HuggingFace integration (direct, through the Sentence Transformers library)
Thanks
Some parts of the code have been adapted from OpenNIR
1 maintainer
Metadata
1 maintainer
Release files for experimaestro-ir 1.4.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | |
|---|---|---|---|---|
| experimaestro_ir-1.4.0.tar.gz | 166.0 kB | Without provenance | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| experimaestro_ir-1.4.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 362.5 kB
Release files / experimaestro_ir-1.4.0.tar.gz
| Download URL | experimaestro_ir-1.4.0.tar.gz |
|---|---|
| Size | 166.0 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
d34538a5a0d12ee54f0581c71a7eda91ccd50f26a2b76cf08184d0bfd88bc36d
|
|
BLAKE2b-256 checksum How to use checksums |
538551e6334a2d6e7ecd7451da4ed19fd24744cbde1b19cbc5103a56620cdcf3
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.5
|
Release files / experimaestro_ir-1.4.0-py3-none-any.whl
| Download URL | experimaestro_ir-1.4.0-py3-none-any.whl |
|---|---|
| Size | 196.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
e7210553dbfec17fc4760b2dc6be99aeb220c871e436fc851032013525d789bd
|
|
BLAKE2b-256 checksum How to use checksums |
cddf5412ef711796fd10c52dcf3e5499e2d8ce03c1dd279f24ae28b56088d1b2
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.5
|
Security for experimaestro-ir 1.4.0
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
