Azure storage transfer tool and library
Project description
|Build Status| |Build status| |Coverage Status| |PyPI| |PyPI| |Docker
Pulls| |Image Layers|
blobxfer
========
``blobxfer`` is an advanced data movement tool and library for Azure
Storage Blob and Files. With ``blobxfer`` you can copy your files into
or out of Azure Storage with the CLI or integrate the ``blobxfer`` data
movement library into your own Python scripts.
Major Features
--------------
- Command-line interface (CLI) providing data movement capability to
and from Azure Blob and File Storage
- Standalone library for integration with scripts or other Python
packages
- High-performance design with asynchronous transfers and disk I/O
- YAML configuration driven execution support
- Resume support
- Vectored IO support
- ``stripe`` mode allows striping a single file across multiple blobs
(even to multiple storage accounts) to break through single blob or
fileshare throughput limits
- ``replica`` mode allows replication of a file across multiple
destinations including to multiple storage accounts
- Synchronous copy with cross-mode replication support (including
block-level copies for Block blobs)
- Client-side encryption support
- Support all Azure Blob types and Azure Files for both upload and
download
- Advanced skip options for rsync-like operations
- Store/restore POSIX filemode and uid/gid
- Support reading/pipe from ``stdin`` including page blob destinations
- Support reading from blob snapshots for downloading and synchronous
copy
- Configurable one-shot block upload support
- Configurable chunk size for both upload and download
- Automatic block size selection for block blob uploading
- Automatic uploading of VHD/VHDX files as page blobs
- Include and exclude filtering support
- Rsync-like delete support
- No clobber support in either direction
- Automatic content type tagging
- File logging support
Installation
------------
There are three ways to install ``blobxfer``: \* ``blobxfer`` Python
package from `PyPI <https://pypi.python.org/pypi/blobxfer>`__ \*
Pre-built binaries available under
`Releases <https://github.com/Azure/blobxfer/releases>`__ \* Docker
images are available for both Linux and Windows platforms on `Docker
Hub <https://hub.docker.com/r/alfpark/blobxfer/>`__
Please refer to the `installation
guide <https://github.com/Azure/blobxfer/blob/master/docs/01-installation.md>`__
for more information on how to install ``blobxfer``.
Documentation
-------------
Please refer to the ```blobxfer``
documentation <https://github.com/Azure/blobxfer/blob/master/docs>`__
for more details and usage information.
Change Log
----------
For recent changes, please refer to the
`CHANGELOG.md <https://github.com/Azure/blobxfer/blob/master/CHANGELOG.md>`__
file.
--------------
Please see this project's `Code of Conduct <CODE_OF_CONDUCT.md>`__ and
`Contributing <CONTRIBUTING.md>`__ guidelines.
.. |Build Status| image:: https://travis-ci.org/Azure/blobxfer.svg?branch=master
:target: https://travis-ci.org/Azure/blobxfer
.. |Build status| image:: https://ci.appveyor.com/api/projects/status/qgth9p7jlessgp5i/branch/master?svg=true
:target: https://ci.appveyor.com/project/alfpark/blobxfer
.. |Coverage Status| image:: https://coveralls.io/repos/github/Azure/blobxfer/badge.svg?branch=master
:target: https://coveralls.io/github/Azure/blobxfer?branch=master
.. |PyPI| image:: https://img.shields.io/pypi/v/blobxfer.svg
:target: https://pypi.python.org/pypi/blobxfer
.. |PyPI| image:: https://img.shields.io/pypi/pyversions/blobxfer.svg
:target: https://pypi.python.org/pypi/blobxfer
.. |Docker Pulls| image:: https://img.shields.io/docker/pulls/alfpark/blobxfer.svg
:target: https://hub.docker.com/r/alfpark/blobxfer
.. |Image Layers| image:: https://images.microbadger.com/badges/image/alfpark/blobxfer:latest.svg
:target: http://microbadger.com/images/alfpark/blobxfer
Pulls| |Image Layers|
blobxfer
========
``blobxfer`` is an advanced data movement tool and library for Azure
Storage Blob and Files. With ``blobxfer`` you can copy your files into
or out of Azure Storage with the CLI or integrate the ``blobxfer`` data
movement library into your own Python scripts.
Major Features
--------------
- Command-line interface (CLI) providing data movement capability to
and from Azure Blob and File Storage
- Standalone library for integration with scripts or other Python
packages
- High-performance design with asynchronous transfers and disk I/O
- YAML configuration driven execution support
- Resume support
- Vectored IO support
- ``stripe`` mode allows striping a single file across multiple blobs
(even to multiple storage accounts) to break through single blob or
fileshare throughput limits
- ``replica`` mode allows replication of a file across multiple
destinations including to multiple storage accounts
- Synchronous copy with cross-mode replication support (including
block-level copies for Block blobs)
- Client-side encryption support
- Support all Azure Blob types and Azure Files for both upload and
download
- Advanced skip options for rsync-like operations
- Store/restore POSIX filemode and uid/gid
- Support reading/pipe from ``stdin`` including page blob destinations
- Support reading from blob snapshots for downloading and synchronous
copy
- Configurable one-shot block upload support
- Configurable chunk size for both upload and download
- Automatic block size selection for block blob uploading
- Automatic uploading of VHD/VHDX files as page blobs
- Include and exclude filtering support
- Rsync-like delete support
- No clobber support in either direction
- Automatic content type tagging
- File logging support
Installation
------------
There are three ways to install ``blobxfer``: \* ``blobxfer`` Python
package from `PyPI <https://pypi.python.org/pypi/blobxfer>`__ \*
Pre-built binaries available under
`Releases <https://github.com/Azure/blobxfer/releases>`__ \* Docker
images are available for both Linux and Windows platforms on `Docker
Hub <https://hub.docker.com/r/alfpark/blobxfer/>`__
Please refer to the `installation
guide <https://github.com/Azure/blobxfer/blob/master/docs/01-installation.md>`__
for more information on how to install ``blobxfer``.
Documentation
-------------
Please refer to the ```blobxfer``
documentation <https://github.com/Azure/blobxfer/blob/master/docs>`__
for more details and usage information.
Change Log
----------
For recent changes, please refer to the
`CHANGELOG.md <https://github.com/Azure/blobxfer/blob/master/CHANGELOG.md>`__
file.
--------------
Please see this project's `Code of Conduct <CODE_OF_CONDUCT.md>`__ and
`Contributing <CONTRIBUTING.md>`__ guidelines.
.. |Build Status| image:: https://travis-ci.org/Azure/blobxfer.svg?branch=master
:target: https://travis-ci.org/Azure/blobxfer
.. |Build status| image:: https://ci.appveyor.com/api/projects/status/qgth9p7jlessgp5i/branch/master?svg=true
:target: https://ci.appveyor.com/project/alfpark/blobxfer
.. |Coverage Status| image:: https://coveralls.io/repos/github/Azure/blobxfer/badge.svg?branch=master
:target: https://coveralls.io/github/Azure/blobxfer?branch=master
.. |PyPI| image:: https://img.shields.io/pypi/v/blobxfer.svg
:target: https://pypi.python.org/pypi/blobxfer
.. |PyPI| image:: https://img.shields.io/pypi/pyversions/blobxfer.svg
:target: https://pypi.python.org/pypi/blobxfer
.. |Docker Pulls| image:: https://img.shields.io/docker/pulls/alfpark/blobxfer.svg
:target: https://hub.docker.com/r/alfpark/blobxfer
.. |Image Layers| image:: https://images.microbadger.com/badges/image/alfpark/blobxfer:latest.svg
:target: http://microbadger.com/images/alfpark/blobxfer
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
blobxfer-1.0.0b2.tar.gz
(76.3 kB
view hashes)
Built Distribution
blobxfer-1.0.0b2-py2.py3-none-any.whl
(111.9 kB
view hashes)
Close
Hashes for blobxfer-1.0.0b2-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 55ff0fe27fe061f17cc9f8de4919e50b7191dcf9a24d9d62e8f4f9b546715cf9 |
|
MD5 | 824511a0ab6d4dd0a71b150555f92014 |
|
BLAKE2b-256 | b4c2b0168933a0a7e5410a4c0376c6467fef40c8d20b3f6d3d5cfec9e064e817 |