Skip to main content

Build Status Build status codecov PyPI

blobxfer

blobxfer is an advanced data movement tool and library for Azure Storage Blob and Files. With blobxfer you can copy your files into or out of Azure Storage with the CLI or integrate the blobxfer data movement library into your own Python scripts.

Major Features

  • Command-line interface (CLI) providing data movement capability to and from Azure Blob and File Storage
  • Standalone library for integration with scripts or other Python packages
  • High-performance design with asynchronous transfers and disk I/O
  • Supports ingress, egress and synchronization of entire directories, containers and file shares
  • YAML configuration driven execution support
  • Fine-grained resume support including resuming a broken operation within a file or object
  • Vectored IO support
    • stripe mode allows striping a single file across multiple blobs (even to multiple storage accounts) to break through single blob or fileshare throughput limits
    • replica mode allows replication of a file across multiple destinations including to multiple storage accounts
  • Synchronous copy with cross-mode (object transform) replication support
    • Leverages server-side copies by default
    • Arbitrary URL copy support
  • Client-side encryption support
  • Support all Azure Blob types and Azure Files for both upload and download
  • Advanced skip options for rsync-like operations
  • Store/restore POSIX filemode and uid/gid
  • Support reading/pipe from stdin including to page blob destinations
  • Support reading from blob and file share snapshots for downloading and synchronous copy
  • Support for setting access tier on objects for uploading and synchronous copy
  • Configurable one-shot block upload support
  • Configurable chunk size for both upload and download
  • Automatic block size selection for block blob uploading
  • Automatic uploading of VHD/VHDX files as page blobs
  • Include and exclude filtering support
  • Rsync-like delete support
  • No clobber support in either direction
  • Automatic content type tagging
  • Support for setting the Cache Control property of blobs and files
  • File logging support
  • Support for HTTP proxies

Installation

There are three ways to install blobxfer:

Please refer to the installation guide for more information on how to install blobxfer.

Documentation

Please refer to the blobxfer documentation for more details and usage information.

Change Log

Please see the Change Log for project history.

Support

This project is community supported and not officially supported by Microsoft. There is no defined SLA for addressing features, issues, and bugs which are exclusively serviced via GitHub issues. For tools officially supported by Microsoft please refer to this documentation.


Please see this project's Code of Conduct and Contributing guidelines.

Metadata

Release files for blobxfer 1.11.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for blobxfer 1.11.0
File Size Uploaded
blobxfer-1.11.0.tar.gz 90.8 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for blobxfer 1.11.0
File Interpreter ABI Platform
blobxfer-1.11.0-py2.py3-none-any.whl Python 3, Python 2 none any Details

Total release size: 209.6 kB

Release files / blobxfer-1.11.0.tar.gz

Download URL blobxfer-1.11.0.tar.gz
Size 90.8 kB
Tags Source
SHA-256 checksum
How to use checksums
1ad17de09fa49f35214044c1522105aa41525004213fade3039a23dc5dfee485
BLAKE2b-256 checksum
How to use checksums
9a3ead415c858f8bb3010b761274c95cb9be7e87c397b9e73b6734006d080885
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.7

Release files / blobxfer-1.11.0-py2.py3-none-any.whl

Download URL blobxfer-1.11.0-py2.py3-none-any.whl
Size 118.8 kB
Tags Python 2 Python 3
SHA-256 checksum
How to use checksums
b5c95197ad39b4559471ff8274f222cc6b5dc6510b567b763a2f84849d7013a3
BLAKE2b-256 checksum
How to use checksums
31700b6657e46a5de604c41a623091a396bc2493d612f6a0a1d857c8fe4eafe3
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.7

Release history Release notifications | RSS feed

This release

1.11.0 This release

2 release files

1.10.0

2 release files

1.9.4

2 release files

1.9.3

2 release files

1.9.2

2 release files

1.9.1

2 release files

1.9.0

2 release files

1.8.0

2 release files

1.7.1

2 release files

1.7.0

2 release files

1.6.0

2 release files

1.5.5

2 release files

1.5.4

2 release files

1.5.3

2 release files

1.5.0

2 release files

1.4.0

2 release files

1.3.1

2 release files

1.3.0

2 release files

1.2.1

2 release files

1.2.0

2 release files

1.1.1

2 release files

1.1.0

2 release files

1.0.0

2 release files

0.12.0

2 release files

0.11.4

2 release files

0.11.2

2 release files

0.11.0

2 release files

0.10.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page