An ultimately fast, zero-dependency declarative filter and introspection library for Python, compiled using JIT.
Project description
Fast-Filter
Your declarative filters in Python are 10x slower than they should be. Fast-Filter compiles them into optimized, native Python bytecode on the fly, making them 10x-15x faster with zero external dependencies.
Why Fast-Filter?
Many modern Python frameworks and libraries rely heavily on declarative query filters (e.g., magic-filter). While beautiful and readable, magic-filter acts as an AST interpreter, walking through object structures and evaluating attributes on every single incoming event.
For high-load bots and applications processing thousands of messages per second, this constant interpretation becomes a major CPU bottleneck.
Fast-Filter solves this.
It keeps the exact same, intuitive F syntax but acts as a Lazy JIT Compiler. The first time a filter is resolved, it dynamically compiles the filter's syntax tree into a native, single-line Python lambda function, which is then reused for subsequent events.
Quickstart
Get up and running in less than 30 seconds.
1. Install
pip install fast-filter
2. Copy & Run
from fast_filter import F
# 1. Define your filter (exact same F-syntax)
my_filter = (F.from_user.role == "admin") & (F.text.startswith("/alert"))
# 2. Resolve immediately against any object/dict
class Message:
def __init__(self, text, role):
self.text = text
self.from_user = type("User", (), {"role": role})()
msg = Message("/alert high CPU usage", "admin")
# The first call JIT-compiles the lambda; subsequent calls run at native speed
assert my_filter.resolve(msg) is True
Measured Performance
Benchmarks run with 100,000 iterations comparing fast-filter against magic-filter:
- Simple Attribute Access (
F.from_user.id == 1): ~6.1x faster. - Logic & Methods (
role == 'admin' & text.startswith): ~6.0x faster. - Mapping & Aggregators (
tags[...].len() > 0): ~20.6x faster.
[!TIP] Try running the benchmarks locally to see the speedup on your machine:
python benchmarks/final_report.py
Sane Defaults & Fixes
Fast-Filter is not just faster; it fixes several behavioral quirks of magic-filter:
- RegExp Everywhere: Magic-filter uses
re.match(matching only the beginning of a string). Fast-filter usesre.search(matching anywhere), which is the behavior most developers expect. - Sane None Logic: Comparing a missing attribute in magic-filter (e.g.,
F.missing == None) resolves toNone. In Fast-Filter, this evaluates toTrue, consistent with standard Python logic. - Exception-Free Compilation: Fast-Filter compiles code with built-in safety guards, ensuring that missing attributes or type conflicts do not raise uncaught exceptions but safely return
NoneorFalse.
What to Read Next?
- GUIDE: Explore advanced features like value capturing with
.as_()&.extract(), slicing, and bitwise operations. - COMPARISON: Detailed feature-by-feature matrix comparing Fast-Filter and Magic-Filter.
Contribution
If you find this library useful, please give it a star on GitHub! Feel free to open issues and pull requests to help improve the project.
License
This project is licensed under the Mozilla Public License 2.0 (MPL 2.0). See the LICENSE file for details.
Copyright (c) 2025-2026 Dmitrii Gagarin aka madgagarin.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file fast_magic_filter-1.0.0.post1.tar.gz.
File metadata
- Download URL: fast_magic_filter-1.0.0.post1.tar.gz
- Upload date:
- Size: 23.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.14.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
17be68fdf9296453b1189e87f6aabfa27ac70abf205e37d7cc6fc2ea84ce7ca4
|
|
| MD5 |
2ed4b43960087eeb7cebe864835d07c2
|
|
| BLAKE2b-256 |
db8c11aa2a2bbc2bdad93318d353fb881c31f4ad4d228626cb0ba98ebabee5cc
|
File details
Details for the file fast_magic_filter-1.0.0.post1-py3-none-any.whl.
File metadata
- Download URL: fast_magic_filter-1.0.0.post1-py3-none-any.whl
- Upload date:
- Size: 13.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.14.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
375aed4bc275d327d73a476838e0dbc07d352c9dd9ec3106884cb563e2b8fc8f
|
|
| MD5 |
267473b00b31923bdffdeb917bcc72b5
|
|
| BLAKE2b-256 |
e40e756226b03e8f51f43006e7adcd5e773984d2b81ada9264c4627b45aa1b8e
|