Skip to main content

A TUS-based file transfer tool with chunked upload/download support

Project description

ETransfer

面向大文件场景的高性能传输工具,基于 TUS 协议。支持断点续传、切片上传下载、流式中继(上传未完成即可下载)、阅后即焚,适用于 AI 训练数据集、模型权重等大文件的可靠分发。

特性

  • 基于 TUS 协议的断点续传,网络中断自动恢复
  • 切片上传/下载,支持部分下载(流式中继)
  • 阅后即焚 / TTL 过期 / 永久保存三种文件策略
  • 存储配额管理,超限自动等待并恢复
  • 多 IP 负载均衡,自动选择最优节点
  • OIDC 用户系统,基于角色/群组的配额控制
  • CLI + GUI + Python API

安装

pip install etransfer

如需部署服务端(含 SQLAlchemy async 依赖):

pip install "etransfer[server]" --only-binary greenlet

--only-binary greenlet 确保只安装预编译 wheel,避免 Windows 等平台上的 C 编译问题。

快速开始

# 配置服务器地址
etransfer setup your-server

# 登录(如果服务器启用了 OIDC)
etransfer login

# 上传
etransfer upload ./model-weights.bin

# 阅后即焚上传
etransfer upload ./dataset.tar.gz --retention download_once

# 下载
etransfer download <file_id> -o ./output/

# 文件列表
etransfer list

# 服务器信息
etransfer info

进阶使用(Python API)

from etransfer.client.tus_client import EasyTransferClient
from etransfer.client.downloader import ChunkDownloader

# 上传
with EasyTransferClient("http://your-server:8765", token="your-token") as client:
    uploader = client.create_uploader("./large-model.bin", retention="download_once")
    uploader.upload(wait_on_quota=True)
    file_id = uploader.url.split("/")[-1]

# 下载
downloader = ChunkDownloader("http://your-server:8765", token="your-token")
downloader.download_file(file_id, "./output/large-model.bin")

文档

文档 说明
私有化部署 服务端安装、配置、Docker 部署
通信设计 API 端点与协议说明

License

Apache-2.0

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

etransfer-0.1.13.tar.gz (120.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

etransfer-0.1.13-py3-none-any.whl (121.4 kB view details)

Uploaded Python 3

File details

Details for the file etransfer-0.1.13.tar.gz.

File metadata

  • Download URL: etransfer-0.1.13.tar.gz
  • Upload date:
  • Size: 120.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for etransfer-0.1.13.tar.gz
Algorithm Hash digest
SHA256 f45472ae5e13f1a73a26e9b731c200c32f0fccc9e3779375799c2b58b0012f12
MD5 0c3ed3b5ddb6a0f60271579eba0b69d5
BLAKE2b-256 a17606481dbccda8634c2417cae0fccc6761c2820053321a3e91a6a60dd8bfd0

See more details on using hashes here.

Provenance

The following attestation bundles were made for etransfer-0.1.13.tar.gz:

Publisher: publish.yml on ZGCA-Forge/ETransfer

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file etransfer-0.1.13-py3-none-any.whl.

File metadata

  • Download URL: etransfer-0.1.13-py3-none-any.whl
  • Upload date:
  • Size: 121.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for etransfer-0.1.13-py3-none-any.whl
Algorithm Hash digest
SHA256 5d3752b711e0b07edbc8b958560869221e74f6170be7885bbb33466a438ec29a
MD5 24b3fefe9140373fd7a6d47a3c2e5d02
BLAKE2b-256 059530e33ece9a9a4fb6966f6a36bac716f0249990a5ce55e78fde91a6f1335a

See more details on using hashes here.

Provenance

The following attestation bundles were made for etransfer-0.1.13-py3-none-any.whl:

Publisher: publish.yml on ZGCA-Forge/ETransfer

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page