Sqlite3Client — Modern SQLite Helper for Python

A lightweight, opinionated wrapper around sqlite3 with built-in support for:

• Connection pooling (minconn / maxconn)
• Query dictionary management
• Conditional SQL (#if / #elif / #endif)
• Bilingual column aliases (en|ko)
• Simple transaction handling via context manager
• Safe parameter binding (:param syntax)
• Streaming CSV export support

Successor-friendly alternative to raw sqlite3 with better developer experience.

Installation

pip install sqlite3-client

Note: sqlite3-client is a custom helper class. See full source in repository.

Quick Start

1. Define Queries

qry_dic: dict[str, str] = {}

qry_dic.update(
    {
        "read_user_id_all": """
SELECT  user_id
FROM    t_user
"""
    }
)

qry_dic.update(
    {
        "upsert_user": """
INSERT INTO t_user
    (
        user_id, user_name, user_rank
    )
VALUES
    (
        :user_id, :user_name, :user_rank
    )
ON CONFLICT (user_id)
DO UPDATE
SET     user_name = :user_name,
        user_rank = :user_rank,
        update_time = CURRENT_TIMESTAMP
RETURNING user_name, user_rank;
"""
    }
)

2. Configure Database Connection

from sqlite3_client.settings import Settings

db_settings = Settings(
    database="test.db",
    minconn=3,
    maxconn=10,
    connect_timeout=5,
    use_en_ko_column_alias=True,
    use_conditional=True,
    all_query=qry_dic,
    before_read_execute=lambda qry_key, params, qry_str, qry_with_value: print(
        f'READ_ROWS_START, QRY_KEY: "{qry_key}", QRY_WITH_VALUE: {qry_with_value}'
    ),
    after_read_execute=lambda qry_key, duration: print(
        f'READ_ROWS_END, QRY_KEY: "{qry_key}", DURATION: {duration}'
    ),
    before_update_execute=lambda qry_key, params, params_out, qry_str, qry_with_value: (
        print(f'UPDATES_START, QRY_KEY: "{qry_key}", QRY_WITH_VALUE: {qry_with_value}')
    ),
    after_update_execute=lambda qry_key, row_count, params_out, duration: print(
        f'UPDATES_END, QRY_KEY: "{qry_key}", DURATION: {duration}'
    ),
)

3. Basic Usage

from sqlite3_client.client import Client

db = Client(db_settings=db_settings)

# Read single row
row = db.read_row("read_user_id_all", {})
print(row)  # {'user_id': 'gildong.hong'}

# Read all rows
rows = db.read_rows("read_user_id_all", {})
print(rows[:2])

Create / Update / Delete Operations

update() — Single CUD Statement

Returns affected row count:

affected = db.update(
    "upsert_user", {"user_id": "gildong.hong", "user_name": "홍길동", "user_rank": 1}
)
print("Affected rows:", affected)  # 1

Capture Output Parameters

params_out = {"user_name": "", "user_rank": 0}
db.update(
    "upsert_user",
    {"user_id": "gildong.hong", "user_name": "홍길동", "user_rank": 1},
    params_out=params_out,
)
print("Returned name:", params_out["user_name"], params_out["user_rank"])  # 홍길동 1

updates() — Batch Execution

batch = [
    ("upsert_user", {"user_id": "sunja.kim", "user_name": "김순자", "user_rank": 2}),
    ("upsert_user", {"user_id": "malja.kim", "user_name": "김말자", "user_rank": 3}),
]

results = db.updates(batch)
print("Batch results:", results)  # [1, 1]

Transaction Support with with

Automatically commits on success, rolls back on exception:

with Client(db_settings=db_settings) as db:
    new_id = "youngja.lee"
    db.update("upsert_user", {"user_id": new_id, "user_name": "이영자", "user_rank": 4})
    db.update("delete_user", {"user_id": new_id})  # Oops! Will rollback entire block
    print("This won't print if error occurs")

Partially return CSV

Read rows partially and return immediately to client to show progress in client:

# Flask
@app.route("/read-csv-partial")
def read_csv_partial():
    """read csv partial"""

    db_client = Client(db_settings=db_settings)
    filename = f"{datetime.now().strftime('%Y%m%d%H%M%S')}.csv"

    return Response(
        db_client.read_csv_partial("read_csv_partial", {}),
        mimetype="text/csv",
        headers={
            # if FE and BE are on different origins,
            # server must expose the Content-Disposition header
            "Access-Control-Expose-Headers": "Content-Disposition",
            "Content-Disposition": f'attachment; filename="{filename}"',
            # Very important for progressive saving in many browsers
            "Cache-Control": "no-cache, no-store, must-revalidate",
            "Pragma": "no-cache",
            "Expires": "0",
            "X-Accel-Buffering": "no",  # Important if using nginx
            "Transfer-Encoding": "chunked",
        },
    )


# Fast API
@router.get("/read-csv-partial-async")
async def read_csv_partial_async():
    """read csv partial async"""

    db_client = Client(db_settings=db_settings)
    filename = f"{datetime.now().strftime('%Y%m%d%H%M%S')}.csv"

    return StreamingResponse(
        content=db_client.read_csv_partial_async("read_csv_partial", {}),
        media_type="text/csv",
        headers={
            # if FE and BE are on different origins,
            # server must expose the Content-Disposition header
            "Access-Control-Expose-Headers": "Content-Disposition",
            "Content-Disposition": f'attachment; filename="{filename}"',
            # Very important for progressive saving in many browsers
            "Cache-Control": "no-cache, no-store, must-revalidate",
            "Pragma": "no-cache",
            "Expires": "0",
            "X-Accel-Buffering": "no",  # Important if using nginx
            "Transfer-Encoding": "chunked",
        },
    )

Bilingual Column Aliases (English ↔ Korean)

Enabled when use_en_ko_column_alias=True and en not omitted:

qry_dic.update(
    {
        "read_user_alias": """
SELECT  user_id "Id|아이디", user_name "Name|이름", user_rank "Rank|순위"
FROM    t_user
WHERE   user_id = :user_id
"""
    }
)

English mode (en=True)

rows = db.read_rows("read_user_alias", {"user_id": "gildong.hong"}, en=True)
print(rows[0])
# {'Id': 'gildong.hong', 'Name': '홍길동'}

Korean mode (en=False)

rows = db.read_rows("read_user_alias", {"user_id": "gildong.hong"}, en=False)
print(rows[0])
# {'아이디': 'gildong.hong', '이름': '홍길동'}

Conditional SQL (#if, #elif, #endif)

Enabled when use_conditional=True:

qry_dic.update(
    {
        "read_user_search": """
SELECT  user_id, user_name, user_rank, insert_time, update_time
FROM    t_user
WHERE   1 = 1
#if ${user_id}
        AND user_id = :user_id
#elif ${user_name}
        AND user_name LIKE :user_name
#elif ${user_rank}
        AND user_rank <= :user_rank
#endif
"""
    }
)

Example: Search by user_id

rows = db.read_rows(
    "read_user_search", {"user_id": "gildong.hong", "user_name": "", "user_rank": 0}
)
print([r["user_name"] for r in rows])
# ['홍길동']

Example: Search by user_name (partial match)

rows = db.read_rows(
    "read_user_search", {"user_id": "", "user_name": "%김%", "user_rank": 0}
)
print([r["user_name"] for r in rows])
# ['김순자', '김말자']

Example: Search by user_rank (partial match)

rows = db.read_rows(
    "read_user_search", {"user_id": "", "user_name": "", "user_rank": 3}
)
print([r["user_name"] for r in rows])
# ['홍길동', '김순자', '김말자']

Include Query Snippet (#include)

Include reusable query fragments or sub-queries. Line-based only (no inline #include), and can be used inside #if blocks.

• #include name: When the target query's value is a string (no sub-keys).
• #include name(key): When the target query's value is a dictionary (parent of sub-keys).

- name: _filter_by_key
  value:
    user_id: "            AND user_id = :user_id"
    user_name: "            AND user_name LIKE :user_name"
    user_rank: "            AND user_rank <= :user_rank"

- name: read_user_by_key
  value: |
    SELECT  user_id
    FROM    t_user
    WHERE   1 = 1
    #if ${user_id}
    #include _filter_by_key(user_id)
    #elif ${user_name}
    #include _filter_by_key(user_name)
    #elif ${user_rank}
    #include _filter_by_key(user_rank)
    #endif

If a parameter is passed and no matching sub-key exists, an error is raised.

Template Variable (${param})

Support MyBatis-style template variable substitution (e.g. dynamic table names, column names). Substituted directly into the SQL text before execution:

- name: delete_data_by_version
  value: |
    DELETE
    FROM    ${table}
    WHERE   version = :version

db.update("delete_data_by_version", {"table": "data_menu", "version": "1.0.0"})

If a referenced ${param} does not exist in params, a KeyError is raised. If its value is None, a ValueError is raised.

Logging support

• before_read_execute called before execute query for read
• after_read_execute called after execute query for read
• before_update_execute called before execute query for CUD
• after_update_execute called after execute query for CUD

Can be replaced print with logger:

Example: Use logger to write debug info

import logging


def get_sql_logger(name="sql"):
    logger = logging.getLogger(name)
    if not logger.handlers:
        logging.basicConfig(
            filename="sql.log",
            level=logging.DEBUG,
            format="%(asctime)s [%(levelname)7s] %(message)s",
            encoding="utf-8",
        )
    return logger


logger = get_sql_logger()
db_settings.before_read_execute = lambda qry_key, params, qry_str, qry_with_value: (
    logger.debug(
        f'READ_ROWS_START, QRY_KEY: "{qry_key}", QRY_WITH_VALUE: {qry_with_value}'
    )
)

Safety & Security

Q: Is conditional SQL safe from injection?

A: Yes — completely safe.

The #if preprocessor only allows:

• Parameter variables using ${param} (e.g. ${user_id})
• String literals ('active', "pending")
• Numbers and basic operators
• Whitespace and comments

Raw variable names without ${...} or any attempt to inject raw SQL will raise a parsing error before execution.

# This will RAISE an exception "ValueError: Raw variable or invalid syntax..." (not execute!)
"#if ${user_id}; DROP TABLE t_user; --"

Features Summary

License

MIT (or as defined in your project)

Made with ❤️ for cleaner, safer SQLite code in Python.