DataFrame API with SQL pushdown execution and real SQL CRUD - the missing layer for SQL in Python
Project description
Moltres
The Missing DataFrame Layer for SQL in Python
MOLTRES: Modern Operations Layer for Transformations, Relational Execution, and SQL
Moltres combines a DataFrame API (like Pandas/Polars), SQL pushdown execution (no data loading into memory), and real SQL CRUD operations (INSERT, UPDATE, DELETE) in one unified interface.
Transform millions of rows using familiar DataFrame operations—all executed directly in SQL without materializing data.
✨ Key Features
- 🚀 PySpark-Style DataFrame API - Primary API with 98% PySpark compatibility
- 🗄️ SQL Pushdown Execution - All operations compile to SQL and run on your database
- ✏️ Real SQL CRUD - INSERT, UPDATE, DELETE with DataFrame-style syntax
- 🐼 Pandas & Polars Interfaces - Optional pandas/polars-style APIs
- ⚡ Async Support - Full async/await support for all operations
- 🔒 Security First - Built-in SQL injection prevention
- 🎯 Framework Integrations - FastAPI, Django, Streamlit, SQLModel, Pydantic
📦 Installation
pip install moltres
# Optional extras
pip install moltres[async-postgresql] # Async PostgreSQL
pip install moltres[pandas,polars] # Pandas/Polars result formats
pip install moltres[sqlmodel] # SQLModel/Pydantic integration
pip install moltres[streamlit] # Streamlit integration
🚀 Quick Start
from moltres import col, connect
from moltres.expressions import functions as F
# Connect to your database
db = connect("sqlite:///example.db")
# DataFrame operations with SQL pushdown (no data loading into memory)
df = (
db.table("orders")
.select()
.join(db.table("customers").select(), on=[col("orders.customer_id") == col("customers.id")])
.where(col("active") == True)
.group_by("country")
.agg(F.sum(col("amount")).alias("total_amount"))
)
# Execute and get results
results = df.collect() # Returns list of dicts by default
CRUD Operations
from moltres.io.records import Records
# Insert rows
Records.from_list([
{"id": 1, "name": "Alice", "email": "alice@example.com"},
{"id": 2, "name": "Bob", "email": "bob@example.com"},
], database=db).insert_into("users")
# Update rows
db.update("users", where=col("active") == 0, set={"active": 1})
# Delete rows
db.delete("users", where=col("email").is_null())
📖 Documentation
- Getting Started Guide - Step-by-step introduction
- Examples Directory - 29 comprehensive examples
- User Guides - Complete guides for all features
- API Reference - Complete API documentation
Framework Integrations
- FastAPI Integration - Error handling, dependency injection
- Django Integration - Middleware, template tags, management commands
- Streamlit Integration - Components, caching, query visualization
- SQLModel & Pydantic - Type-safe models
🛠️ Supported Operations
DataFrame Operations: select(), where(), join(), group_by(), agg(), order_by(), limit(), distinct(), pivot(), and more
130+ Functions: Mathematical, string, date/time, aggregate, window, array, JSON, and utility functions
SQL Dialects: SQLite, PostgreSQL, MySQL, DuckDB, and any SQLAlchemy-supported database
🧪 Development
# Install in development mode
pip install -e ".[dev]"
# Run tests
pytest
# Code quality
ruff check . && ruff format . && mypy src
🤝 Contributing
Contributions are welcome! See CONTRIBUTING.md for guidelines.
📄 License
MIT License - see LICENSE file for details.
Made with ❤️ for the Python data community
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file moltres-0.19.6.tar.gz.
File metadata
- Download URL: moltres-0.19.6.tar.gz
- Upload date:
- Size: 355.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.11.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
4c240682e207b06b069270bb89a616f9188781a3c9f89ed126bc91d451ffd1d1
|
|
| MD5 |
65de6ae5de7a29aae860eaadf07fb111
|
|
| BLAKE2b-256 |
c7b121205a955870c8c35e18a189641e300098e6144d053b35dabcf10274bca9
|
File details
Details for the file moltres-0.19.6-py3-none-any.whl.
File metadata
- Download URL: moltres-0.19.6-py3-none-any.whl
- Upload date:
- Size: 442.7 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.11.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
b96a09a5fc65df7c3cc2a3fb4440f0df150d00ad323ae514943b41eac0ceb920
|
|
| MD5 |
98deb61b63d3dc7a4341b06ee9af1106
|
|
| BLAKE2b-256 |
b4461e220edc7535d0dc0f19b9efe99202e104e886dcd8077e8920953593362c
|