TPU index is a package for fast similarity search over large collections of high dimension vectors on Google Cloud TPUs
Project description
TPU Index
TPU Index is a package for fast similarity search over large collections of high dimension vectors on TPUs. This package was built to support our project that we developed for https://tfworld.devpost.com/.
Link to our project: https://devpost.com/software/naturallanguagerecommendations
Installation
!pip install tpu-index
Basic usage
from tpu_index import TPUIndex
index = TPUIndex(num_tpu_cores=8)
index.create_index(vectors) # vectors = numpy array, shape == [None, None]
...
D, I = index.search(xq, distance_metric='cosine', top_k=5)
ToDo:
- Add more distance metrics
- Optional GPU support
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
tpu_index-0.0.6.tar.gz
(2.9 kB
view details)
Built Distribution
File details
Details for the file tpu_index-0.0.6.tar.gz.
File metadata
- Download URL: tpu_index-0.0.6.tar.gz
- Upload date:
- Size: 2.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/47.1.0 requests-toolbelt/0.9.1 tqdm/4.48.0 CPython/3.8.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
0e9430dbad89995ea44efe87129cb1b85343e402286d7927da837ab1820f7d77
|
|
| MD5 |
2a319ac8fc948e3dae74ce5523b0b341
|
|
| BLAKE2b-256 |
be0d02fb26a33f57ee1c5971da562185259aa8180cf047020cab5852c2bb3ed7
|
File details
Details for the file tpu_index-0.0.6-py3-none-any.whl.
File metadata
- Download URL: tpu_index-0.0.6-py3-none-any.whl
- Upload date:
- Size: 3.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/47.1.0 requests-toolbelt/0.9.1 tqdm/4.48.0 CPython/3.8.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
ed6544c8a7995946959acbe6c398ecf782c48b241d41db42708699841aa02a66
|
|
| MD5 |
dff41af8a5afa76c356df9aec8661f03
|
|
| BLAKE2b-256 |
da82c2ea118622e638b215362a74dbcf246c9c83d4a1784e2f3a32c34e02cf71
|
