TPU index is a package for fast similarity search over large collections of high dimension vectors on Google Cloud TPUs
Project description
TPU Index
TPU Index is a package for fast similarity search over large collections of high dimension vectors on TPUs. This package was built to support our project that we developed for https://tfworld.devpost.com/.
Link to our project: https://devpost.com/software/naturallanguagerecommendations
Installation
!pip install tpu-index
Basic usage
from tpu_index import TPUIndex
index = TPUIndex(num_tpu_cores=8)
index.create_index(vectors) # vectors = numpy array, shape == [None, None]
...
D, I = index.search(xq, distance_metric='cosine', top_k=5)
ToDo:
- Add more distance metrics
- Optional GPU support
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
tpu_index-0.0.6.tar.gz
(2.9 kB
view hashes)
Built Distribution
Close
Hashes for tpu_index-0.0.6-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ed6544c8a7995946959acbe6c398ecf782c48b241d41db42708699841aa02a66 |
|
MD5 | dff41af8a5afa76c356df9aec8661f03 |
|
BLAKE2b-256 | da82c2ea118622e638b215362a74dbcf246c9c83d4a1784e2f3a32c34e02cf71 |