一个支持阿里云OSS和MinIO的对象存储抽象包
Project description
FiuAI S3
一个支持阿里云OSS和MinIO的对象存储抽象包,提供了统一的接口来操作不同的对象存储服务。
特性
- 支持阿里云OSS和MinIO存储服务
- 统一的接口设计
- 工厂模式实现,易于扩展
- 完整的类型提示
- 详细的日志记录
- 异常处理机制
安装
pip install fiuai-s3
快速开始
初始化存储
# file: utils/s3.py
from fiuai_s3 import ObjectStorageFactory
from config.app_config import get_settings
ObjectStorageFactory.initialize(
# 初始化对象存储
provider=get_settings().object_storage_config.provider,
bucket_name=get_settings().object_storage_config.bucket_name,
endpoint=get_settings().object_storage_config.endpoint,
access_key=get_settings().object_storage_config.access_key,
secret_key=get_settings().object_storage_config.secret_key,
temp_dir=get_settings().object_storage_config.s3_temp_dir,
use_https=get_settings().object_storage_config.s3_use_https
)
S3_Client = ObjectStorageFactory.get_instance()
使用存储实例
# file: app.py
from utils.s3 import S3_Client
# 上传文件
S3_Client.upload_file("test.txt", b"Hello World")
# 下载文件
data = S3_Client.download_file("test.txt")
# 删除文件
S3_Client.delete_file("test.txt")
# 列出文件
files = S3_Client.list_files(prefix="test/")
单据文件管理(推荐业务用法)
支持业务身份(auth_tenant_id, auth_company_id, doc_id)在实例初始化时注入(可为空),各操作方法参数可选,若不传则使用实例属性,若传则覆盖。
初始化带业务身份
from fiuai_s3 import ObjectStorageFactory
from fiuai_s3.object_storage import StorageConfig
config = StorageConfig(
provider="minio",
bucket_name="dev",
endpoint="http://127.0.0.1:19000",
access_key="devdevdev",
secret_key="devdevdev"
)
# 业务身份可选
S3_Client = ObjectStorageFactory.create_storage(
config,
auth_tenant_id="t1",
auth_company_id="c1",
doc_id="d1"
)
上传单据文件
# 方法参数可选,优先级高于实例属性
S3_Client.upload_doc_file(
filename="发票.pdf",
data=b"...文件内容...",
tags={"业务类型": "发票", "年份": "2024"}
# auth_tenant_id、auth_company_id、doc_id 可不传,使用实例属性
)
下载单据文件
data = S3_Client.download_doc_file(
filename="发票.pdf"
# auth_tenant_id、auth_company_id、doc_id 可不传,使用实例属性
)
列出单据下所有文件
files = S3_Client.list_doc_files()
- 存储路径自动为:
bucketname/auth_tenant_id/auth_company_id/doc_id/filename - tags会自动打到对象存储(Alicloud用OSS Tagging,Minio用metadata)
- 支持实例初始化时设置默认auth_tenant_id、auth_company_id、doc_id,调用时可覆盖
- 缺失必要参数会抛出异常
配置参数
| 参数 | 类型 | 必填 | 默认值 | 说明 |
|---|---|---|---|---|
| provider | str | 是 | - | 存储提供商,支持 "alicloud" 或 "minio" |
| bucket_name | str | 是 | - | 存储桶名称 |
| endpoint | str | 是 | - | 存储服务端点 |
| access_key | str | 是 | - | 访问密钥 |
| secret_key | str | 是 | - | 密钥 |
| temp_dir | str | 否 | "temp/" | 临时目录 |
| use_https | bool | 否 | False | 是否使用HTTPS |
开发
安装开发依赖
uv pip install .
运行测试
python -m pytest tests/
许可证
MIT License
作者
- liming (lmlala@aliyun.com)
贡献
欢迎提交 Issue 和 Pull Request!
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
fiuai_s3-0.3.0.tar.gz
(13.4 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
fiuai_s3-0.3.0-py3-none-any.whl
(18.8 kB
view details)
File details
Details for the file fiuai_s3-0.3.0.tar.gz.
File metadata
- Download URL: fiuai_s3-0.3.0.tar.gz
- Upload date:
- Size: 13.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.7.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
095484c98a67c4e4d29e92bb703a427625d0f65303c74894f04f94d2293330a6
|
|
| MD5 |
584dcdfcd9f35943862c40bbc22b1ab9
|
|
| BLAKE2b-256 |
1913b13f6b8f2951a62c917f5837b1e4817fd291328acc1c45f20a1975b1c231
|
File details
Details for the file fiuai_s3-0.3.0-py3-none-any.whl.
File metadata
- Download URL: fiuai_s3-0.3.0-py3-none-any.whl
- Upload date:
- Size: 18.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.7.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
fd78dceee6370e2a5973f9f7a705cbf8cdfe2e421bb4eb7fd4fe756f39b54c40
|
|
| MD5 |
bbdf561c8d2e8b8888eefd4202f1adec
|
|
| BLAKE2b-256 |
09eaa5d888574eebb0c0de42623b6fe4e7b147b679d4cff8dfa4c8259cba4876
|