pyterrier-ciff 0.2.1

PyTerrier integrations with CIFF

CIFF + PyTerrier

The Common Index File Format (CIFF) represents an attempt to build a binary data exchange format for open-source search engines to interoperate by sharing index structures.

-- CIFF Project

pyterrier-ciff gives access to CIFF files. It provides the following core functionality:

• Build CIFF indexes from built indexes. example
• Build CIFF indexes from learned sparse retrieval models.
• Parse CIFF files to get the postings and document records. example
• Share and load CIFF files to/from HuggingFace datasets. example
• Load files from the CIFF Hub. example

Quick Start

You can install pyterrier-ciff with pip:

pip install pyterrier-ciff

Documentation

Full documentation can be found in the PyTerrier Docs.