The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense embedding, sparse embedding, tensor and full-text
Document | Benchmark | Twitter | Discord
Infinity is a cutting-edge AI-native database that provides a wide range of search capabilities for rich data types such as dense vector, sparse vector, tensor, full-text, and structured data. It provides robust support for various LLM applications, including search, recommenders, question-answering, conversational AI, copilot, content generation, and many more RAG (Retrieval-augmented Generation) applications.
⚡️ Performance
🌟 Key Features
Infinity comes with high performance, flexibility, ease-of-use, and many features designed to address the challenges facing the next-generation AI applications:
🚀 Incredibly fast
- Achieves 0.1 milliseconds query latency and 15K+ QPS on million-scale vector datasets.
- Achieves 1 millisecond latency and 12K+ QPS in full-text search on 33M documents.
See the Benchmark report for more information.
🔮 Powerful search
- Supports a hybrid search of dense embedding, sparse embedding, tensor, and full text, in addition to filtering.
- Supports several types of rerankers including RRF, weighted sum and ColBERT.
🍔 Rich data types
Supports a wide range of data types including strings, numerics, vectors, and more.
🎁 Ease-of-use
- Intuitive Python API. See the Python API
- A single-binary architecture with no dependencies, making deployment a breeze.
- Embedded in Python as a module and friendly to AI developers.
🎮 Get Started
Infinity supports two working modes, embedded mode and client-server mode. The following shows how to operate in client-server mode:
-
Deploy Infinity in client-server mode. check the Deploy infinity server guide.
-
Install the
infinity-sdkpackage:pip install infinity-sdk==0.7.2
-
Use Infinity to conduct a dense vector search:
import infinity # Connect to infinity # Change the following IP address and port to your server's IP address and port infinity_object = infinity.connect(infinity.NetworkAddress("127.0.0.1", 23817)) # Retrieve a database object named default_db db_object = infinity_object.get_database("default_db") # Create a table with an integer column, a varchar column, and a dense vector column table_object = db_object.create_table("my_table", {"num": {"type": "integer"}, "body": {"type": "varchar"}, "vec": {"type": "vector, 4, float"}}) # Insert two rows into the table table_object.insert([{"num": 1, "body": "unnecessary and harmful", "vec": [1.0, 1.2, 0.8, 0.9]}]) table_object.insert([{"num": 2, "body": "Office for Harmful Blooms", "vec": [4.0, 4.2, 4.3, 4.5]}]) # Conduct a dense vector search res = table_object.output(["*"]) .match_dense("vec", [3.0, 2.8, 2.7, 3.1], "float", "ip", 2) .to_pl() print(res)
💡 For more information about Infinity's Python API, see the Python API Reference.
📚 Document
📜 Roadmap
See the Infinity Roadmap 2024
🙌 Community
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file infinity_sdk-0.7.2.tar.gz.
File metadata
- Download URL: infinity_sdk-0.7.2.tar.gz
- Upload date:
- Size: 29.5 MB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
uv/0.11.28 {"installer":{"name":"uv","version":"0.11.28","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
48da8380cab3fcaa891dac19ccaa89497804f5aa596f050b2bc76e4e3dbef471
|
|
| MD5 |
972f111c6fe433eecdd4f0a660622374
|
|
| BLAKE2b-256 |
fba26b45aeb782d189db10cc2cbe8a6db8108bd33deb5925a6be81422230937d
|
File details
Details for the file infinity_sdk-0.7.2-py3-none-any.whl.
File metadata
- Download URL: infinity_sdk-0.7.2-py3-none-any.whl
- Upload date:
- Size: 29.7 MB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
uv/0.11.28 {"installer":{"name":"uv","version":"0.11.28","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
68350ffb003a84d9b8a3de8370b9929d453a3f6b400a9c87a9f4d76f25b68093
|
|
| MD5 |
5f3def5c62269b46a4321f876fd0c6f5
|
|
| BLAKE2b-256 |
b084f2f38f000ba5d7313bb1e5113db4bdac7358562079a36bd68ab63b897856
|
