blobxfer
blobxfer is an advanced data movement tool and library for Azure Storage
Blob and Files. With blobxfer you can copy your files into or out of Azure
Storage with the CLI or integrate the blobxfer data movement library into
your own Python scripts.
Major Features
- Command-line interface (CLI) providing data movement capability to and from Azure Blob and File Storage
- Standalone library for integration with scripts or other Python packages
- High-performance design with asynchronous transfers and disk I/O
- Supports ingress, egress and synchronization of entire directories, containers and file shares
- YAML configuration driven execution support
- Fine-grained resume support including resuming a broken operation within a file or object
- Vectored IO support
stripemode allows striping a single file across multiple blobs (even to multiple storage accounts) to break through single blob or fileshare throughput limitsreplicamode allows replication of a file across multiple destinations including to multiple storage accounts
- Synchronous copy with cross-mode (object transform) replication support
- Leverages server-side copies by default
- Arbitrary URL copy support
- Client-side encryption support
- Support all Azure Blob types and Azure Files for both upload and download
- Advanced skip options for rsync-like operations
- Store/restore POSIX filemode and uid/gid
- Support reading/pipe from
stdinincluding to page blob destinations - Support reading from blob and file share snapshots for downloading and synchronous copy
- Support for setting access tier on objects for uploading and synchronous copy
- Configurable one-shot block upload support
- Configurable chunk size for both upload and download
- Automatic block size selection for block blob uploading
- Automatic uploading of VHD/VHDX files as page blobs
- Include and exclude filtering support
- Rsync-like delete support
- No clobber support in either direction
- Automatic content type tagging
- Support for setting the Cache Control property of blobs and files
- File logging support
- Support for HTTP proxies
Installation
There are three ways to install blobxfer:
blobxferPython package from PyPI- Pre-built binaries available under Releases
- Docker images are available for both Linux and Windows platforms on the Microsoft Container Registry
Please refer to the
installation guide
for more information on how to install blobxfer.
Documentation
Please refer to the blobxfer documentation
for more details and usage information.
Change Log
Please see the Change Log for project history.
Support
This project is community supported and not officially supported by Microsoft. There is no defined SLA for addressing features, issues, and bugs which are exclusively serviced via GitHub issues. For tools officially supported by Microsoft please refer to this documentation.
Please see this project's Code of Conduct and Contributing guidelines.
Metadata
Release files for blobxfer 1.11.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| blobxfer-1.11.0.tar.gz | 90.8 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| blobxfer-1.11.0-py2.py3-none-any.whl | Python 3, Python 2 | none | any | Details |
Total release size: 209.6 kB
Release files / blobxfer-1.11.0.tar.gz
| Download URL | blobxfer-1.11.0.tar.gz |
|---|---|
| Size | 90.8 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
1ad17de09fa49f35214044c1522105aa41525004213fade3039a23dc5dfee485
|
|
BLAKE2b-256 checksum How to use checksums |
9a3ead415c858f8bb3010b761274c95cb9be7e87c397b9e73b6734006d080885
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.7
|
Release files / blobxfer-1.11.0-py2.py3-none-any.whl
| Download URL | blobxfer-1.11.0-py2.py3-none-any.whl |
|---|---|
| Size | 118.8 kB |
| Tags | Python 2 Python 3 |
|
SHA-256 checksum How to use checksums |
b5c95197ad39b4559471ff8274f222cc6b5dc6510b567b763a2f84849d7013a3
|
|
BLAKE2b-256 checksum How to use checksums |
31700b6657e46a5de604c41a623091a396bc2493d612f6a0a1d857c8fe4eafe3
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.7
|