Skip to main content

一个用于简化PostgreSQL数据库操作的Python工具包

Project description

PgSQL Utils

一个用于简化 PostgreSQL 数据库操作的 Python 工具包。

功能特点

  • 单例模式数据库连接管理
  • 支持多种配置方式(环境变量、配置文件、直接传参、模块设置)
  • 自动序列重置功能,避免主键冲突
  • 支持字典类型数据自动转换为 JSON 字符串
  • 提供多种便捷的数据操作方法:
    • find: 查询数据
    • add: 插入单条数据
    • add_batch: 批量插入数据
    • add_smart: 智能插入(冲突时更新)
    • update: 更新数据
    • delete: 删除数据
    • execute: 执行 SQL 语句
    • execute_query: 执行查询语句
    • execute_update: 执行更新语句
    • reset_table_sequence: 重置表主键序列
    • disconnect: 关闭数据库连接

安装

pip install pgsql-utils

如果安装失败,可以尝试使用以下方式安装

pip install --index-url https://pypi.org/simple pgsql-utils -U

使用方法

  1. 基本使用

    from pgsql_utils import PostgreSQLUtils
    
    # 方式1: 直接传参
    db = PostgreSQLUtils("localhost", "mydb", "user", "password", 5432)
    
    # 方式2: 从环境变量读取配置
    # 需要设置环境变量: PGSQL_IP, PGSQL_DB, PGSQL_USER_NAME, PGSQL_USER_PASS, PGSQL_PORT
    db = PostgreSQLUtils()
    
    # 方式3: 从配置文件读取
    db = PostgreSQLUtils.from_config_file("config.json")
    
    # 方式4: 从设置模块读取
    import your_setting_module
    db = PostgreSQLUtils.from_settings(your_setting_module)
    
    # 方式5: 直接使用预定义的全局实例(需先配置环境变量或配置文件)
    from pgsql_utils import db
    
  2. 查询数据

    # 查询数据并以字典形式返回
    results = db.find("SELECT * FROM news_table WHERE category_id = %s", True, 1)
    for result in results:
        print(result)
    
  3. 插入数据

    # 插入单条数据
    data = {
        "title": "新闻标题",
        "content": "新闻内容",
        "publish_time": "2023-01-01 12:00:00",
    }
    db.add("news_table", data)
    
    # 批量插入数据
    data_list = [
        {"title": "新闻1", "content": "内容1"},
        {"title": "新闻2", "content": "内容2"},
    ]
    db.add_batch("news_table", data_list)
    
    # 批量 upsert(冲突时更新)
    db.add_batch("news_table", data_list, conflict_key="title")
    
  4. 智能插入(重复则更新)

    唯一索引是主键 id(默认)

    data = {"id": 1, "title": "更新的标题", "content": "更新的内容"}
    db.add_smart("news_table", data)
    

    唯一索引不是 id,是单个值(如:"title_id")

    data = {"id": 1, "title": "更新的标题", "content": "更新的内容", "title_id": "248237"}
    db.add_smart("news_table", data, conflict_key="title_id")
    

    唯一索引不是 id,是多个值(如:"event_id", "data_source", "locale" )

    data = {
        "event_id": 248237,
        "event_time": "2025-07-30 21:45:00",
        "country": "CAD",
        "importance": 0,
        "event_content": "BoC货币政策报告",
        "data_source": "mql5",
        "locale": "zh_CN",
    }
    conflict_key = ["event_id", "data_source", "locale"]
    db.add_smart("event_table", data, conflict_key=conflict_key)
    
  5. 更新和删除数据

    # 更新数据
    db.update("news_table", {"title": "新标题"}, "id = %s", (1,))
    
    # 删除数据
    db.delete("news_table", "id = %s", (1,))
    
  6. 重置表主键序列

    # 重置表的主键序列(如有自增主键,建议在手动插入/删除后调用)
    db.reset_table_sequence("news_table")
    # 指定主键名
    db.reset_table_sequence("news_table", primary_key="custom_id")
    
  7. 关闭数据库连接

    db.disconnect()
    

配置

  • 环境变量配置

    export PGSQL_IP=localhost
    export PGSQL_DB=your_database 
    export PGSQL_USER_NAME=your_username
    export PGSQL_USER_PASS=your_password
    export PGSQL_PORT=5432
    
  • JSON配置文件示例

    {
        "host": "localhost",
        "database": "your_database",
        "user": "your_username",
        "password": "your_password",
        "port": 5432
    }
    
  • 设置模块文件示例

    # PostgreSQL
    PGSQL_IP = "host"
    PGSQL_PORT = 5432
    PGSQL_DB = "your_database"
    PGSQL_USER_NAME = "your_username"
    PGSQL_USER_PASS = "your_password"
    

依赖

  • psycopg2>=2.9.10
  • colorPrintConsole>=1.0.7

许可证

Apache-2.0 License

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pgsql_utils-1.0.2.tar.gz (14.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

pgsql_utils-1.0.2-py3-none-any.whl (13.3 kB view details)

Uploaded Python 3

File details

Details for the file pgsql_utils-1.0.2.tar.gz.

File metadata

  • Download URL: pgsql_utils-1.0.2.tar.gz
  • Upload date:
  • Size: 14.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.11

File hashes

Hashes for pgsql_utils-1.0.2.tar.gz
Algorithm Hash digest
SHA256 57a1d99d7a12a43171798300c8f2c6f7f62fef3d33819956c408cd92e68ab1f1
MD5 c0900b1b6b976680693d9aa9e0389429
BLAKE2b-256 efebaecf5202ac5895debe1da6965c32a07428474d2e6d2bbf7657b9f2430135

See more details on using hashes here.

File details

Details for the file pgsql_utils-1.0.2-py3-none-any.whl.

File metadata

  • Download URL: pgsql_utils-1.0.2-py3-none-any.whl
  • Upload date:
  • Size: 13.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.11

File hashes

Hashes for pgsql_utils-1.0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 5002dd70d4c9e788750b1482106ea4c99f9e5d440678b15d70fec1e1f8bed121
MD5 b80f48f0b4ef6760ecaf687c462a3029
BLAKE2b-256 b7d150dda036b643c8b445af66445d65045c58158ce78ea63a1e417335c57ab4

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page