Skip to main content

DaiSy: A Library for Scalable Data Series Similarity Search

Project description

DaiSy: A Library for Scalable Data Series Similarity Search

DaiSy (DAta series sImilarity sSearch librarY) is a unified library for exact data series similarity search that integrates multiple state-of-the-art algorithms within a single, coherent framework, developed at LIPADE, Université Paris Cit'e. It supports a wide range approaches tailored for different execution environments, including disk-based, in-memory, GPU-accelerated, and distributed scalable similarity search. DaiSy is implemented in C++, while it also offers a convenient Python interface for ease of use and integration with data science workflows.

Supported State-of-the-Art algorithms

We currently support several algorithms for exact similarity search, each optimized for specific use cases and environments. The following table summarizes the key features of each algorithm:

Algorithm Description
Bruteforce Naive parallel similarity search implementation
Lower Bound Bruteforce Optimized bruteforce with lower bounding for the distance calculations
MESSI In-memory parallel similarity search
PARIS Disk-based parallel similarity search
SING GPU-accelerated in-memory parallel similarity search
Odyssey Distributed and parallel in-memory similarity search

Quickstart

Dependencies

  • Operating System: Linux, macOS, or Windows
  • C++ Compiler: C++14 or higher (GCC 6+, Clang 3.4+, MSVC 2015+)
  • CMake: Version 3.15 or higher

Optionally,

  • Python: 3.10-3.12
  • MPI: Required for Odyssey distributed computing algorithm
  • CUDA: Required for SING GPU acceleration algorithm

Installation

To download DaiSy, use:

git clone https://github.com/MChatzakis/daisy.git

cd daisy
git submodule update --init --recursive

Based on the available hardware, you can specify the below arguments to enable/disable features.

Flag Description Default Dependencies
BUILD_PYTHON Enable Python bindings ON Python 3.10+
BUILD_BENCHMARK Build benchmarking tools ON GoogleBenchmark
BUILD_TESTS Build test suite ON GoogleTest
BUILD_DEMO Build demonstration applications ON Core library
ODYSSEY_MPI Enable MPI for distributed computing ON OpenMPI/MPICH
SING_CUDA Enable CUDA for GPU acceleration ON CUDA Toolkit
DEBUG_MSG Enable debug output OFF None

To compile:

mkdir build && cd build

cmake ..
make

Enable Python

python3.12 -m venv DaiSy_env

source DaiSy_env/bin/activate 
pip install -r requirements_DaiSy.txt

Example Usage

We provide several usage examples in both C++ and Python under demos/, demonstrating how to utilize the library for various similarity search tasks.

About

DaiSy is developed by the diNo research group at LIPADE, Université Paris Cité. It is provided with no warranty, and we encourage contributions from the community to enhance its capabilities and performance. For questions, issues, or contributions, please open an issue or submit a pull request on GitHub. DaiSy licensed under the MIT License.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

daisy_exact_search-1.0.0.tar.gz (979.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

daisy_exact_search-1.0.0-cp312-cp312-manylinux_2_34_x86_64.whl (4.4 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.34+ x86-64

File details

Details for the file daisy_exact_search-1.0.0.tar.gz.

File metadata

  • Download URL: daisy_exact_search-1.0.0.tar.gz
  • Upload date:
  • Size: 979.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.7

File hashes

Hashes for daisy_exact_search-1.0.0.tar.gz
Algorithm Hash digest
SHA256 933773b2a8d92671c68ff8e87b74be9339843c36cbde014d502adc7ddbc053bd
MD5 64899afbd750e73fc0b4ede0ce96de44
BLAKE2b-256 367c9c150903d42bdc6c19d54b5d70a0e431099ff9adbc897f0afe92867e6d33

See more details on using hashes here.

File details

Details for the file daisy_exact_search-1.0.0-cp312-cp312-manylinux_2_34_x86_64.whl.

File metadata

File hashes

Hashes for daisy_exact_search-1.0.0-cp312-cp312-manylinux_2_34_x86_64.whl
Algorithm Hash digest
SHA256 883e478a09546babd3532c921059798c7b4433944f869a0cea182881f82709e8
MD5 437bc80f74a0b3053f5495894efb3cd5
BLAKE2b-256 05e8d33003c7ec02b9e36b85aba2c814fa5ec194c3e3192088c72c388869f0f4

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page