opteryx 0.0.0a12

Distributed SQL Engine

Opteryx is a embedable distributed SQL query engine.

Opteryx has no server component, Opteryx just runs when you need it making it ideal for deployments to platforms like Kubernetes, GCP Cloud Run, AWS Fargate and Knative.

• Bug Reports GitHub Issues
• Feature Requests GitHub Issues
• Source Code GitHub
• Discussions GitHub Discussions

How Can I Contribute?

All contributions, bug reports, bug fixes, documentation improvements, enhancements, and ideas are welcome.

If you have a suggestion for an improvement or a bug, raise a ticket or start a discussion.

Want to help build mabel? See the contribution guidance.

What Opteryx is

Why not use SQLite or DuckDB

Opteryx is solving a different problem in the same space as these solutions. Opteryx avoids loading the dataset into memory unless there is no other option, as such it can query petabytes of data on a single, modest sized node.

This also means that queries are not as fast as solutions like SQLite or DuckDB.

Why not use MySQL or BigQuery

Opteryx is an ad hoc database, if it can read the files, it can be used to query the contents of them. This means it can leverage data files used by other systems.

Opteryx is read-only, you can't update or delete data, and it also doesn't have or enforce indexes in your data.

Security

See the project security policy for information about reporting vulnerabilities.

License

• sqloxide https://github.com/wseaton/sqloxide
• cython
• numpy
• zstandard
• orjson
• pysimdjson
• cityhash
• pyarrow

https://github.dev/mabel-dev/opteryx