Geneva - Multimodal Data Platform
Geneva is a petabyte-scale multimodal feature engineering and data management platform built on LanceDB.
What lives in this repo
src/- Geneva client library and core runtimesrc/tests/- unit test suitessrc/integ_tests/- integration test suitessrc/stress_tests/- stress and load testsdocs/- mkdocs configuration and API docs (source for autogenerated public facing api documentation page)e2e/- end-to-end test suites and UDF manifestsnotebook/- quickstart notebooks (TODO replace with link to colab demo notebook)internal_docs/- internal design and operational notestools/- helper scripts for local clusters and cleanup
User facing documentation should be submitted here.
Quickstart (local development)
uv sync --all-groups --all-extras --locked
import geneva
import pyarrow as pa
@geneva.udf(data_type=pa.int32())
def double(x: int) -> int:
return x * 2
conn = geneva.connect("./db")
table = conn.create_table("numbers", [{"x": i} for i in range(10)])
table.add_columns({"doubled": double})
with conn.local_ray_context():
table.backfill("doubled")
result = table.search().select(["doubled"]).to_arrow()
Development
See Development for details.
Configuration
Geneva supports specifying configuration in a few different ways. Refer to CONFIGURATION.md for more details.
Release files for geneva 0.17.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| geneva-0.17.0.tar.gz | 5.2 MB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| geneva-0.17.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 6.0 MB
Release files / geneva-0.17.0.tar.gz
| Download URL | geneva-0.17.0.tar.gz |
|---|---|
| Size | 5.2 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
e9ef762684e7b0730dcd25835b15130fdfb15bfdcf87fb65cbe501e97ad2b950
|
|
BLAKE2b-256 checksum How to use checksums |
d5fb5f00991d47dd7bb721e2a650288ce546b8c7827c94c4f6fe4e3218343e84
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
uv/0.12.15 {"installer":{"name":"uv","version":"0.12.15","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / geneva-0.17.0-py3-none-any.whl
| Download URL | geneva-0.17.0-py3-none-any.whl |
|---|---|
| Size | 740.6 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
e340e7ef97bdb64a8a1fabd582c7d21c4e0c500add9fc0d672002b0944fb9aae
|
|
BLAKE2b-256 checksum How to use checksums |
84c624f96ca66dee00f672ae9e1bf47888b4a88941c16e00b979322399c58b48
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
uv/0.12.15 {"installer":{"name":"uv","version":"0.12.15","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
