opteryx 0.0.0b2

Distributed SQL Engine

Query your data, no database required

Documentation | Examples | Contributing

NOTE
Opteryx is an beta product. Beta means different things to different people, to us, being beta means:

• Functionality is stable and any updates should be to address bugs and performance
• Core functionality has test cases to ensure stability
• Some edge cases may have undetected bugs
• Performance tuning may be incomplete

What is Opteryx

Opteryx is a distributed SQL Engine designed for cloud-native environments.

Scalable

Designed to run in Knative and similar environments like Google Cloud Run, Opteryx can scale down to zero, or scale up to respond to thousands of concurrent queries within seconds.

High Availability

Each query can run in a separate container instance, meaning it's nearly impossible for a rogue query to affect any other users.

No matter if a cluster, region or datacentre goes down, Opteryx can keep responding to queries.
(inflight queries may not be recovered)

Bring your own Files

Opteryx supports many popular data formats, including Parquet and JSONL, stored on local disk or on Cloud Storage. You can mix and match formats, one dataset can be Parquet and another JSONL, and Opteryx will be able to JOIN across these datasets.

Consumption-Based Billing

Opteryx is designed for deployments to environments which are pay-as-you-use, like Google Cloud Run. Great for situations where you low-volume usage, or many environments, where the costs of a traditional database deployment would quickly compound.

Python Native

Opteryx is an Open Source Python library, it quickly and easily integrates into Python code, you can start querying your data within a few minutes.

Time Travel

Designed for data analytics in environments where decisions need to be replayable, Opteryx allows you to query data as at a point in time in the past to replay decision algorithms against facts as they were known in the past.
(data must be structured to enable temporal queries)

How Can I Contribute?

All contributions, bug reports, bug fixes, documentation improvements, enhancements, and ideas are welcome.

If you have a suggestion for an improvement or a bug, raise a ticket or start a discussion.

Want to help build Opteryx? See the Contribution Guide.

Security

See the project security policy for information about reporting vulnerabilities.

License