SQLite based queryable python indexes for dicts and lists
Project description
LiteIndex
Embedded, thread and process safe, disk backed, easy to use, query-able, fast Index implementations
pip install --upgrade liteindex
DefinedIndex
- Documentation | Detailed example | Benchmarks
- fixed schema index i.e: schema has to be defined before hand
number
,boolean
,datetime
,string
,compressed_string
,blob
,json
,normalized_embedding
, andother
types are supported andcan be queried upon
- can store any python objects with varying levels of query-ability
Query language is subset of mongodb's
. All queries are documented- seamless, very fast nearest neighbor search with filtering. a practical wrapper of faiss + sqlite. Approximate nearest neighbor search is not supported. Intended for few million vector search
- works across threads, processes seamlessly
- handy features like search and update in single query, batch operation support for update, search, del, pop etc ..
- in-place math operations support wherever applicable i.e: += etc can be done in single query optimally
- compression is supported natively and optional custom compression dictionaries can be built automatically
KVIndex
- Documentation | Detailed example | Benchmarks
- simple key value store, can store any python objects, can be queried for equality, sorting, max, min etc wherever applicable
- in-place math operations support wherever applicable i.e: += etc can be done in single query optimally
- has a python dict like interface
- batch operation support for update, search, del, pop etc ..
- ultra fast, works across threads, processes seamlessly
- Eviction policies supported:
LRU
,LFU
,any
and age based invalidation and size, count based eviction
function_cache
- Documentation | Detailed example | Benchmarks
- based on KVIndex, can be used to cache function calls of any type
- batch inference caching friendly
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
liteindex-0.0.2.dev51.tar.gz
(23.1 kB
view hashes)
Built Distribution
Close
Hashes for liteindex-0.0.2.dev51-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8c2ff3fecfd4abac6cf12a071f865bebbafb7b6576e8c45637dfbf8888dd8aaa |
|
MD5 | c83622171cbd10301dcd8804add3ec42 |
|
BLAKE2b-256 | 46a723cafe7f1e9b7ac612852097aaaedf0225a123d217a0c1bc7daed862743e |