8 projects
arrowmetal
Apache Arrow columnar data on Apple silicon GPUs (Metal), from Python
pankhllm-server
The LLM gateway that learns to skip the LLM: trains its own tiny decision model on your agent's traffic and answers repeat decisions in 0.2 ms with no LLM call. OpenAI-compatible, one Rust binary. The server binary for pip users: pankhllm serve
pankhllm
Client for pankhllm, the LLM gateway that learns to skip the LLM.
sqljev
Ask your SQL rows questions in plain English: jev(), jev_prob(), jev_choice(), jev_score() for SQL Server, PostgreSQL, MySQL, Snowflake, Databricks, BigQuery, Redshift and DuckDB, answered by Laya (open weights, fine-tunable) or TypeSafe Jev.
duckdb-gpudb
Plain DuckDB SQL on the GPU: a drop-in gpudb.connect() that answers statements on the device when that is faster, and lets DuckDB run everything else
adbcbridge
adbcBridge: the ADBC (Apache Arrow) driver for any ODBC data source, with the driver library bundled
grit-datatype
Check what a quantized tensor actually means: GRIT descriptors carry the numeric contract, and `grit scan` audits safetensors/GGUF files you already have
samkhya
A provable join-cardinality ceiling and portable statistics sketches, for query planning
