TPU index is a package for fast similarity search over large collections of high dimension vectors on Google Cloud TPUs
Project description
TPU Index
TPU Index is a package for fast similarity search over large collections of high dimension vectors on TPUs. This package was built to support our project that we developed for https://tfworld.devpost.com/.
Link to our project: https://devpost.com/software/naturallanguagerecommendations
Installation
!pip install tpu-index
Basic usage
from tpu_index import TPUIndex
index = TPUIndex(num_tpu_cores=8)
index.create_index(vectors) # vectors = numpy array, shape == [None, None]
...
D, I = index.search(xq, distance_metric='cosine', top_k=5)
ToDo:
- [ ] Add more distance metrics
- [ ] Optional GPU support
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
| Filename, size | File type | Python version | Upload date | Hashes |
|---|---|---|---|---|
| Filename, size tpu_index-0.0.6-py3-none-any.whl (3.2 kB) | File type Wheel | Python version py3 | Upload date | Hashes View |
| Filename, size tpu_index-0.0.6.tar.gz (2.9 kB) | File type Source | Python version None | Upload date | Hashes View |
Close
Hashes for tpu_index-0.0.6-py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | ed6544c8a7995946959acbe6c398ecf782c48b241d41db42708699841aa02a66 |
|
| MD5 | dff41af8a5afa76c356df9aec8661f03 |
|
| BLAKE2-256 | da82c2ea118622e638b215362a74dbcf246c9c83d4a1784e2f3a32c34e02cf71 |
