Python client for MygramDB - high-performance in-memory full-text search engine with MySQL replication support
Project description
python-mygramdb-client
Python client library for MygramDB — a high-performance in-memory full-text search engine with MySQL replication support.
Compatible with MygramDB v1.6 (fuzzy search, highlight, facets, BM25).
Overview
MygramDB provides 25-200x faster full-text search than MySQL FULLTEXT. This client communicates via MygramDB's TCP text protocol (memcached-style) with zero external dependencies.
| MySQL FULLTEXT | MygramDB | |
|---|---|---|
| Search Speed | Baseline | 25-200x faster |
| Storage | On-disk | In-memory |
| Replication | — | MySQL binlog |
| Protocol | MySQL | TCP (memcached-style) |
Features
- Zero Dependencies — Standard library only
- Async/Await API — Modern asyncio-based interface with context manager support
- Search Expression Parser — Web-style search syntax (+required, -excluded, "phrase", OR, grouping)
- Full Protocol Support — All MygramDB commands (SEARCH, COUNT, GET, INFO, CACHE, DUMP, OPTIMIZE, etc.)
- Type Safety — Full type hints with dataclasses
- Input Validation — Built-in protection against control character injection
Installation
pip install mygramdb-client
From source
git clone https://github.com/libraz/python-mygramdb-client.git
cd python-mygramdb-client
rye sync
Quick Start
import asyncio
from mygramdb_client import MygramClient, ClientConfig, SearchOptions
async def main():
async with MygramClient(ClientConfig(host='localhost', port=11016)) as client:
# Search
results = await client.search('articles', 'hello', SearchOptions(limit=100))
print(f"Found {results.total_count} results")
# Count
count = await client.count('articles', 'technology')
print(f"Count: {count.count}")
# Get document by ID
doc = await client.get('articles', '12345')
print(f"Doc: {doc.primary_key} {doc.fields}")
asyncio.run(main())
Search Expressions
Parse web-style search queries into structured search parameters:
from mygramdb_client import simplify_search_expression
# Space = AND, - = NOT, "" = phrase, OR = OR, () = grouping
expr = simplify_search_expression('hello world -spam')
# expr = SimplifiedExpression(main_term='hello', and_terms=['world'], not_terms=['spam'])
results = await client.search('articles', expr.main_term, SearchOptions(
and_terms=expr.and_terms,
not_terms=expr.not_terms,
limit=100,
offset=50,
filters={'status': 'published', 'lang': 'en'},
sort_column='created_at',
sort_desc=True,
))
MygramDB v1.6 Features
from mygramdb_client import HighlightOptions, FacetOptions, SearchOptions
# BM25 relevance scoring
result = await client.search('articles', 'python',
SearchOptions(sort_column='_score', sort_desc=True))
# Fuzzy search (Levenshtein distance 1 or 2)
result = await client.search('articles', 'helo',
SearchOptions(fuzzy=1))
# Highlighted snippets
result = await client.search('articles', 'python',
SearchOptions(highlight=HighlightOptions(
open_tag='<mark>', close_tag='</mark>',
snippet_len=150, max_fragments=3,
)))
for r in result.results:
print(r.primary_key, r.snippet)
# Facet aggregation
facets = await client.facet('articles', 'category',
FacetOptions(query='python', limit=10))
for v in facets.results:
print(f'{v.value}: {v.count}')
MygramDB v1.7 Features
Multi-database (qualified table identity)
A v1.7+ instance can index tables from more than one database. Reference a
table as database.table; bare names still work on single-database servers.
from mygramdb_client import qualify_table_identity, parse_table_identity
await client.search('app_db.articles', 'hello')
qualify_table_identity('articles', 'app_db') # 'app_db.articles'
parse_table_identity('app_db.articles') # ('app_db', 'articles')
Boolean search
search() sends the query as a single (auto-quoted) token. For boolean
AND/OR/NOT/grouping, build the expression and pass it to search_raw():
from mygramdb_client import convert_search_expression, SearchRawOptions
raw = convert_search_expression('python OR (ruby AND rails)')
res = await client.search_raw('articles', raw, SearchRawOptions(limit=50))
# searchWithHighlights / searchRawWithHighlights enable the HIGHLIGHT clause:
res = await client.search_with_highlights('articles', 'python')
Runtime variables and on-demand sync
await client.set_variable('logging.level', 'info')
print(await client.show_variables('logging%'))
await client.sync('app_db.articles')
print(await client.sync_status())
await client.sync_stop('app_db.articles')
Type Hints
Full type definitions are included:
from mygramdb_client import (
ClientConfig,
SearchResponse,
CountResponse,
Document,
ServerInfo,
SearchOptions,
DumpStatus,
CacheStats,
)
Development
rye sync # Install dependencies
rye run pytest # Run tests
rye run pytest -v # Run tests (verbose)
rye run flake8 src tests # Lint
License
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file mygramdb_client-1.2.0.tar.gz.
File metadata
- Download URL: mygramdb_client-1.2.0.tar.gz
- Upload date:
- Size: 74.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
1dd139cbf7d0b67683d8092f70561576969ed329c17eb70c59c0e0663a936fd3
|
|
| MD5 |
aac43d88e0232137dfac556eaefc7b00
|
|
| BLAKE2b-256 |
18dd6de90169e2fe540645d685c1c0c8c8edcc3a6fc624d40ea7fb9a6585fa77
|
Provenance
The following attestation bundles were made for mygramdb_client-1.2.0.tar.gz:
Publisher:
publish.yml on libraz/python-mygramdb-client
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
mygramdb_client-1.2.0.tar.gz -
Subject digest:
1dd139cbf7d0b67683d8092f70561576969ed329c17eb70c59c0e0663a936fd3 - Sigstore transparency entry: 1822400460
- Sigstore integration time:
-
Permalink:
libraz/python-mygramdb-client@50706bcc71ffb1b17d514148f52208f2b8846fd9 -
Branch / Tag:
refs/tags/v1.2.0 - Owner: https://github.com/libraz
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish.yml@50706bcc71ffb1b17d514148f52208f2b8846fd9 -
Trigger Event:
push
-
Statement type:
File details
Details for the file mygramdb_client-1.2.0-py3-none-any.whl.
File metadata
- Download URL: mygramdb_client-1.2.0-py3-none-any.whl
- Upload date:
- Size: 25.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
aaaf2c63848e6f4e453270927ed0c555865fb0b70824fd69ccea9a990412ccf0
|
|
| MD5 |
24fe5ef52e3df79b5cec52bf7323c668
|
|
| BLAKE2b-256 |
dbe3424bb617e44f2ecb8a3a3ad6536eb49f90747fd34163ccf8e6daf2482328
|
Provenance
The following attestation bundles were made for mygramdb_client-1.2.0-py3-none-any.whl:
Publisher:
publish.yml on libraz/python-mygramdb-client
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
mygramdb_client-1.2.0-py3-none-any.whl -
Subject digest:
aaaf2c63848e6f4e453270927ed0c555865fb0b70824fd69ccea9a990412ccf0 - Sigstore transparency entry: 1822400465
- Sigstore integration time:
-
Permalink:
libraz/python-mygramdb-client@50706bcc71ffb1b17d514148f52208f2b8846fd9 -
Branch / Tag:
refs/tags/v1.2.0 - Owner: https://github.com/libraz
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish.yml@50706bcc71ffb1b17d514148f52208f2b8846fd9 -
Trigger Event:
push
-
Statement type: