tpu_index is a package for fast similarity search over large collections of high dimension vectors on TPUs
Project description
TPU Index
TPU Index is a package for fast similarity search over large collections of high dimension vectors on TPUs. This package was built to support our project that we developed for https://tfworld.devpost.com/.
Link to our project: https://devpost.com/software/naturallanguagerecommendations
Installation
!pip install tpu_index
Basic usage
from TPUIndex.index import TPUIndex
index = TPUIndex(num_tpu_cores=8)
index.create_index(<vectors>) # vectors.shape == [None, None]
...
D, I = index.search(xq, distance_metric='cosine', top_k=5)
ToDo:
- Add more distance metrics
- Optional GPU support
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
tpu_index-0.0.2.tar.gz
(2.5 kB
view hashes)
Built Distribution
Close
Hashes for tpu_index-0.0.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 466f042f409005a9860d6e8a310bb0975712cbe13fe8199fd6b70b1b1d7d4746 |
|
MD5 | 864dbe0f3bf55340375d39f3fffb87b5 |
|
BLAKE2b-256 | 4d5aedc15811084fc8e06deb556336d49c8fcf334652796619c87ee621a26061 |