Skip to main content

DataFrame API with SQL pushdown execution and real SQL CRUD - the missing layer for SQL in Python

Project description

Moltres

CI Python 3.9+ License: MIT Documentation Status

The Missing DataFrame Layer for SQL in Python

MOLTRES: Modern Operations Layer for Transformations, Relational Execution, and SQL


Moltres combines a DataFrame API (like Pandas/Polars), SQL pushdown execution (no data loading into memory), and real SQL CRUD operations (INSERT, UPDATE, DELETE) in one unified interface.

Transform millions of rows using familiar DataFrame operations—all executed directly in SQL without materializing data.

✨ Key Features

  • 🚀 PySpark-Style DataFrame API - Primary API with 98% PySpark compatibility
  • 🗄️ SQL Pushdown Execution - All operations compile to SQL and run on your database
  • ✏️ Real SQL CRUD - INSERT, UPDATE, DELETE with DataFrame-style syntax
  • 🐼 Pandas & Polars Interfaces - Optional pandas/polars-style APIs
  • Async Support - Full async/await support for all operations
  • 🔒 Security First - Built-in SQL injection prevention
  • 🎯 Framework Integrations - FastAPI, Django, Streamlit, SQLModel, Pydantic

📦 Installation

pip install moltres

# Optional extras
pip install moltres[async-postgresql]  # Async PostgreSQL
pip install moltres[pandas,polars]     # Pandas/Polars result formats
pip install moltres[sqlmodel]          # SQLModel/Pydantic integration
pip install moltres[streamlit]        # Streamlit integration

🚀 Quick Start

from moltres import col, connect
from moltres.expressions import functions as F

# Connect to your database
db = connect("sqlite:///example.db")

# DataFrame operations with SQL pushdown (no data loading into memory)
df = (
    db.table("orders")
    .select()
    .join(db.table("customers").select(), on=[col("orders.customer_id") == col("customers.id")])
    .where(col("active") == True)
    .group_by("country")
    .agg(F.sum(col("amount")).alias("total_amount"))
)

# Execute and get results
results = df.collect()  # Returns list of dicts by default

CRUD Operations

from moltres.io.records import Records

# Insert rows
Records.from_list([
    {"id": 1, "name": "Alice", "email": "alice@example.com"},
    {"id": 2, "name": "Bob", "email": "bob@example.com"},
], database=db).insert_into("users")

# Update rows
db.update("users", where=col("active") == 0, set={"active": 1})

# Delete rows
db.delete("users", where=col("email").is_null())

📖 Documentation

Framework Integrations

🛠️ Supported Operations

DataFrame Operations: select(), where(), join(), group_by(), agg(), order_by(), limit(), distinct(), pivot(), and more

130+ Functions: Mathematical, string, date/time, aggregate, window, array, JSON, and utility functions

SQL Dialects: SQLite, PostgreSQL, MySQL, DuckDB, and any SQLAlchemy-supported database

🧪 Development

# Install in development mode
pip install -e ".[dev]"

# Run tests
pytest

# Code quality
ruff check . && ruff format . && mypy src

🤝 Contributing

Contributions are welcome! See CONTRIBUTING.md for guidelines.

📄 License

MIT License - see LICENSE file for details.


Made with ❤️ for the Python data community

⬆ Back to Top

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

moltres-0.19.4.tar.gz (345.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

moltres-0.19.4-py3-none-any.whl (416.7 kB view details)

Uploaded Python 3

File details

Details for the file moltres-0.19.4.tar.gz.

File metadata

  • Download URL: moltres-0.19.4.tar.gz
  • Upload date:
  • Size: 345.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.13

File hashes

Hashes for moltres-0.19.4.tar.gz
Algorithm Hash digest
SHA256 d743010920ae9eadda1f0684d581f82fa6b9454fb22cd9f7bc45c971af6d1baf
MD5 2370392fb7d42dd02ae354cc49c9a607
BLAKE2b-256 217c0a3c8aac35c98cc9c59a95e5fbff493abdb59e2b93b0caea317b42acce31

See more details on using hashes here.

File details

Details for the file moltres-0.19.4-py3-none-any.whl.

File metadata

  • Download URL: moltres-0.19.4-py3-none-any.whl
  • Upload date:
  • Size: 416.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.13

File hashes

Hashes for moltres-0.19.4-py3-none-any.whl
Algorithm Hash digest
SHA256 235187e6c1771cb81791a1fa4943bcebcf7fda10d5ff8c10edee5546eda26425
MD5 a2943dfee931cfb718c943fd3a0bd705
BLAKE2b-256 b889392b9b70a17b70ff5dc1d44d7ce26c938a22270e1c3da61ad81c0783ad20

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page