Skip to main content

A TUS-based file transfer tool with chunked upload/download support

Project description

ETransfer

面向大文件场景的高性能传输工具,基于 TUS 协议。支持断点续传、切片上传下载、流式中继(上传未完成即可下载)、阅后即焚,适用于 AI 训练数据集、模型权重等大文件的可靠分发。

特性

  • 基于 TUS 协议的断点续传,网络中断自动恢复
  • 切片上传/下载,支持部分下载(流式中继)
  • 阅后即焚 / TTL 过期 / 永久保存三种文件策略
  • 存储配额管理,超限自动等待并恢复
  • 多 IP 负载均衡,自动选择最优节点
  • OIDC 用户系统,基于角色/群组的配额控制
  • CLI + GUI + Python API

安装

pip install etransfer

如需部署服务端(含 SQLAlchemy async 依赖):

pip install "etransfer[server]" --only-binary greenlet

--only-binary greenlet 确保只安装预编译 wheel,避免 Windows 等平台上的 C 编译问题。

快速开始

# 配置服务器地址
etransfer setup your-server

# 登录(如果服务器启用了 OIDC)
etransfer login

# 上传
etransfer upload ./model-weights.bin

# 阅后即焚上传
etransfer upload ./dataset.tar.gz --retention download_once

# 下载
etransfer download <file_id> -o ./output/

# 文件列表
etransfer list

# 服务器信息
etransfer info

进阶使用(Python API)

from etransfer.client.tus_client import EasyTransferClient
from etransfer.client.downloader import ChunkDownloader

# 上传
with EasyTransferClient("http://your-server:8765", token="your-token") as client:
    uploader = client.create_uploader("./large-model.bin", retention="download_once")
    uploader.upload(wait_on_quota=True)
    file_id = uploader.url.split("/")[-1]

# 下载
downloader = ChunkDownloader("http://your-server:8765", token="your-token")
downloader.download_file(file_id, "./output/large-model.bin")

文档

文档 说明
私有化部署 服务端安装、配置、Docker 部署
通信设计 API 端点与协议说明

License

Apache-2.0

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

etransfer-0.1.16.tar.gz (124.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

etransfer-0.1.16-py3-none-any.whl (127.0 kB view details)

Uploaded Python 3

File details

Details for the file etransfer-0.1.16.tar.gz.

File metadata

  • Download URL: etransfer-0.1.16.tar.gz
  • Upload date:
  • Size: 124.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for etransfer-0.1.16.tar.gz
Algorithm Hash digest
SHA256 4547511b4c27060853dbec90789b30e07f2c18ebf080bdb826f343d6791b3caa
MD5 e3deb3919cb7ded8513c347f77a4f71b
BLAKE2b-256 4ae523c6acb6f5c11e8806f870aa2f4087f0c2a8d43803ce6a5eed10081cca93

See more details on using hashes here.

Provenance

The following attestation bundles were made for etransfer-0.1.16.tar.gz:

Publisher: publish.yml on ZGCA-Forge/ETransfer

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file etransfer-0.1.16-py3-none-any.whl.

File metadata

  • Download URL: etransfer-0.1.16-py3-none-any.whl
  • Upload date:
  • Size: 127.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for etransfer-0.1.16-py3-none-any.whl
Algorithm Hash digest
SHA256 be77bf329739e6a56323a1d71cc3be0a9fa98d2b9a3971aaea31c7e4a744df98
MD5 a0d3c775113a94cae04bb7fe082c8c59
BLAKE2b-256 154b0f0892376fbe00599ad6bef9b398654e75b7f56d27b84e6c2cc67b3d80d2

See more details on using hashes here.

Provenance

The following attestation bundles were made for etransfer-0.1.16-py3-none-any.whl:

Publisher: publish.yml on ZGCA-Forge/ETransfer

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page