Geneva - Multimodal Data Platform
Geneva is a petabyte-scale multimodal feature engineering and data management platform built on LanceDB.
What lives in this repo
src/- Geneva client library and core runtimesrc/tests/- unit test suitessrc/integ_tests/- integration test suitessrc/stress_tests/- stress and load testsdocs/- mkdocs configuration and API docs (source for autogenerated public facing api documentation page)e2e/- end-to-end test suites and UDF manifestsnotebook/- quickstart notebooks (TODO replace with link to colab demo notebook)internal_docs/- internal design and operational notestools/- helper scripts for local clusters and cleanup
User facing documentation should be submitted here.
Quickstart (local development)
uv sync --all-groups --all-extras --locked
import geneva
import pyarrow as pa
@geneva.udf(data_type=pa.int32())
def double(x: int) -> int:
return x * 2
conn = geneva.connect("./db")
table = conn.create_table("numbers", [{"x": i} for i in range(10)])
table.add_columns({"doubled": double})
with conn.local_ray_context():
table.backfill("doubled")
result = table.search().select(["doubled"]).to_arrow()
Development
See Development for details.
Configuration
Geneva supports specifying configuration in a few different ways. Refer to CONFIGURATION.md for more details.
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
geneva-0.15.0.tar.gz
(5.1 MB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
geneva-0.15.0-py3-none-any.whl
(694.8 kB
view details)
File details
Details for the file geneva-0.15.0.tar.gz.
File metadata
- Download URL: geneva-0.15.0.tar.gz
- Upload date:
- Size: 5.1 MB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
uv/0.12.5 {"installer":{"name":"uv","version":"0.12.5","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
0b950264d858984358e8511de61e3e001cff867548aaf8a1863636c1e557bd3a
|
|
| MD5 |
75f3536d6841cb27c467ec4a91998616
|
|
| BLAKE2b-256 |
e997097e3a4f6bb1247167a93acf23a8411fd6cdef253bee08dc5374d800b446
|
File details
Details for the file geneva-0.15.0-py3-none-any.whl.
File metadata
- Download URL: geneva-0.15.0-py3-none-any.whl
- Upload date:
- Size: 694.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
uv/0.12.5 {"installer":{"name":"uv","version":"0.12.5","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
aaa0affda8efe6a3d724b969e91a12a32d806d19c233226e5ca9f78e77563498
|
|
| MD5 |
55e60abd522a13752665dcf751b0cae1
|
|
| BLAKE2b-256 |
ab84998b5744ccbf9d3f0e0066b261ba34cf06b849bc50cb4e9e747f52d4f7b8
|
