Skip to main content
Yanked

This release has been yanked by its maintainers, and will be ignored by installers, except when explicitly specified.
Consider using release 0.28.1 instead.

pyarrowspace

Python bindings for arrowspace-rs.

arrowspace is a graph-based analytics library for vector spaces, supported by a graph representation and a key-value store. The main use-cases targeted are: AI search capabilities as advanced vector similarity, graph characterisation analysis and search, indexing of high-dimensional vectors. Design principles described in this article.

For labs and tests please see tests/

Installation

Core library

The core library ships as a compiled Rust extension. It only requires numpy, pyarrow, pandas, and scikit-learn:

pip install arrowspace

Optional extras

Additional capabilities are available as optional extras:

Extra Packages included Use case
embeddings datasets, sentence-transformers, transformers[torch]<5.0, tsdae Generating embeddings from text via HuggingFace models; required for test_1_quora_questions.py and all tests above
benchmarks beir, nltk Running BEIR/MS-MARCO benchmark suites and NLP preprocessing
viz matplotlib, seaborn, tqdm Plotting results and progress bars in test scripts
full all of the above Full development and research environment

Install with one or more extras:

# Required to run test_1_quora_questions.py and above
pip install arrowspace[embeddings]

# Benchmarking + visualisation
pip install arrowspace[benchmarks,viz]

# Everything (for running the full test suite)
pip install arrowspace[full]

Note: tests/test_0_*.py only require the core install. All tests numbered test_1 and above require at minimum arrowspace[embeddings].

Build from source

If you have Cargo installed, you can compile and install locally using maturin:

pip install maturin[patchelf]
# quick development build
maturin develop
# optimised release build (recommended for large datasets)
maturin develop --release

Tests

test_0_*.py scripts only require the core install:

python tests/test_0_0.py

test_1 and above require the embeddings extra (pip install arrowspace[embeddings]):

python tests/test_1_quora_questions.py

Higher-numbered tests (test_3 and above) additionally require benchmarks and viz:

pip install arrowspace[full]
python tests/test_3_beir.py

Some tests require downloading a dataset separately or fine-tuning embeddings on a given dataset.

Simplest Example

from arrowspace import ArrowSpaceBuilder
import numpy as np

items: np.array = np.array(
    [[0.1, 0.2, 0.3], [0.0, 0.5, 0.1], [0.9, 0.1, 0.0]],
    dtype = np.float64
)

graph_params: dict = {
    "eps": 1.0,
    "k": 6,
    "topk": 3,
    "p": 2.0,
    "sigma": 1.0,
}

# Create an ArrowSpace instance, returning the computed
# signal graph and lambdas
aspace, gl = ArrowSpaceBuilder().build(graph_params, items)

# Search comparable items
# defaults: k = nitems, alpha = 0.9, beta = 0.1
query: np.array = np.array(
    [0.05, 0.2, 0.25],
    dtype = np.float64
)

tau: float = 1.0
hits: list = aspace.search(query, gl, tau)

# Search returns a list of `(index, score`) tuples, where
# expected value from the code above show the first index
# having the top score, i.e., being nearest.

print(hits)
# [ (0, 0.989743318610787), (1, 0.7565344158360029), (2, 0.22151940739207396) ]

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

arrowspace-0.27.0.tar.gz (17.7 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

arrowspace-0.27.0-cp313-cp313-macosx_11_0_arm64.whl (3.3 MB view details)

Uploaded CPython 3.13macOS 11.0+ ARM64

File details

Details for the file arrowspace-0.27.0.tar.gz.

File metadata

  • Download URL: arrowspace-0.27.0.tar.gz
  • Upload date:
  • Size: 17.7 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.12.7 {"installer":{"name":"uv","version":"0.12.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for arrowspace-0.27.0.tar.gz
Algorithm Hash digest
SHA256 256f58a125ef289721248ff8b222ea8bf14b36bca825a86bab8c79b0f41de5ba
MD5 32756afca6220b4c04b0c1b89247e24d
BLAKE2b-256 97f655f3b5bc624025eb228a076920f2ee79f0473d0684ba17afe30cc22bb61f

See more details on using hashes here.

File details

Details for the file arrowspace-0.27.0-cp313-cp313-macosx_11_0_arm64.whl.

File metadata

  • Download URL: arrowspace-0.27.0-cp313-cp313-macosx_11_0_arm64.whl
  • Upload date:
  • Size: 3.3 MB
  • Tags: CPython 3.13, macOS 11.0+ ARM64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.12.7 {"installer":{"name":"uv","version":"0.12.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for arrowspace-0.27.0-cp313-cp313-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 e74c6ebc1aaa0ad5b0fc48ac608f1b1d5b85217f04830049574b2c24ef924566
MD5 4bce1c6bdbfb0544723b7c3d0adb99fd
BLAKE2b-256 939c607f6c3bd04b2bc84a26c6a883a3ba0656d25ecb46a7eee7a22bd7ec4d41

See more details on using hashes here.

Release history Release notifications | RSS feed

0.28.1

2 files

0.28.0

3 files

0.27.3

2 files

0.27.2

2 files

This release

0.27.0 This release

2 files

0.26.14

2 files

0.26.13

2 files

0.26.12

2 files

0.26.11

2 files

0.26.7

2 files

0.26.6

2 files

0.26.5

3 files

0.26.4

10 files

0.26.3

3 files

0.26.2

2 files

0.26.0

1 file

0.25.14

6 files

0.25.12

11 files

0.25.11

6 files

0.25.5

2 files

0.25.4

2 files

0.25.3

2 files

0.25.0

6 files

0.24.14

19 files

0.24.12

19 files

0.24.11

17 files

0.24.10

6 files

0.24.9

6 files

0.24.8

11 files

0.24.6

2 files

0.24.5

6 files

0.24.0

11 files

0.23.0

17 files

0.22.0

6 files

0.21.0

32 files

0.16.0

2 files

0.15.0

4 files

0.13.3

30 files

0.13.2

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page