django-storages-redux 1.3.3

Support for many storages (S3, MogileFS, etc) in Django.

This library has been designated as the official successor of django-storages (as of February 2016). Please update your requirements files to point to django-storages.

All development now happens at https://github.com/jschneier/django-storages

django-storages

Installation

Installing from PyPI is as easy as doing:

pip install django-storages-redux

If you’d prefer to install from source (maybe there is a bugfix in master that hasn’t been released yet) then the magic incantation you are looking for is:

pip install -e 'git+https://github.com/jschneier/django-storages.git#egg=django-storages'

Once that is done add storages to your INSTALLED_APPS and set DEFAULT_FILE_STORAGE to the backend of your choice. If, for example, you want to use the s3boto backend you would set:

DEFAULT_FILE_STORAGE = 'storages.backends.s3boto.S3BotoStorage'

There are also a number of settings available to control how each storage backend functions, please consult the documentation for a comprehensive list.

About

django-storages was (is) a project to provide a variety of storage backends in a single library. This is its maintained, Python 3 compatible fork. The reasons for the fork are given in the next section.

At the moment the only tested Python 3 compatible backend is the S3 Boto one but some of them should work without issue (hashpath, symlink, overwrite).

This library is compatible with Django >= 1.7. It should also works with 1.6.2+ but no guarantees are made.

Why Fork?

The BitBucket repo of the original django-storages has seen no commit applied since March 2014 (it is currently December 2014) and no PyPi release since March 2013 despite a wealth of bugfixes that were applied in that year-long gap. There is plenty of community support for the django-storages project (especially the S3BotoStorage piece) and I have a personal need for a Python3 compatible version.

All of the Python3 compatible forks that currently exist (and there are a few) are lacking in some way. This can be anything from the fact that they don’t release to PyPi, have no ongoing testing, didn’t apply many important bugfixes that have occurred on the Bitbucket repo since forking or don’t support older versions of Python and Django (vital to finding bugs and keeping a large community). For this fork I’ve done the small bit of work necessary to get a tox + travis ci matrix going for all of the supported Python + Django versions. In many cases the various forks are lacking in a few of the above ways.

Found a Bug? Something Unsupported?

I suspect that a few of the storage engines in backends/ have been unsupported for quite a long time. I personally only really need the S3Storage backend but welcome bug reports (and especially) patches and tests for some of the other backends.

Issues are tracked via GitHub issues at the project issue page.

Documentation

The original documentation for django-storages is located at http://django-storages.readthedocs.org/. Stay tuned for forthcoming documentation updates.

Contributing

1. Check for open issues at the project issue page or open a new issue to start a discussion about a feature or bug.

2. Fork the django-storages repository on GitHub to start making changes.

3. Add a test case to show that the bug is fixed or the feature is implemented correctly.

4. Bug me until I can merge your pull request. Also, don’t forget to add yourself to AUTHORS.

django-storages change log

1.3.3 (2017-06-27)

• Show a warning indicating the new namespace and update the README to point at the new package.

1.3.2 (2016-01-26)

• Fix memory leak from not closing underlying temp file in s3boto backend (#106) thanks @kmmbvnr

• Allow easily specifying a custom expiry time when generating a url for S3BotoStorage (#96) thanks @mattbriancon

• Check for bucket existence when the empty path (‘’) is passed to storage.exists in S3BotoStorage - this prevents a crash when running collecstatic -c on Django 1.9.1 (#112) fixed in #116 thanks @xblitz

1.3.1 (2016-01-12)

• A few Azure Storage fixes [pass the content-type to Azure, handle chunked content, fix url] (#45) thanks @erlingbo

• Add support for a Dropbox (dropbox) storage backend, thanks @ZuluPro (#76)

• Various fixes to the apache_libcloud backend [return the number of bytes asked for by .read, make .name non-private, don’t initialize to an empty BytesIO object] thanks @kaedroho (#55)

• Fix multi-part uploads in s3boto backend not respecting AWS_S3_ENCRYPTION (#94) thanks @andersontep

• Automatically gzip svg files thanks @comandrei (#100)

1.3 (2015-08-14)

• Drop Support for Django 1.5 and Python2.6

• Remove previously deprecated mongodb backend

• Remove previously deprecated parse_ts_extended from s3boto storage

• Add support for Django 1.8+ (#36)

• Add AWS_S3_PROXY_HOST and AWS_S3_PROXY_PORT settings for s3boto backend (#41)

• Fix Python3K compat issue in apache_libcloud (#52)

• Fix Google Storage backend not respecting GS_IS_GZIPPED setting (#51, #60) thanks @stmos

• Rename FTP _name attribute to name which is what the Django File api is expecting (#70)

• Put StorageMixin first in inheritance to maintain backwards compat with older versions of Django (#63)

1.2.3 (2015-03-14)

• Variety of FTP backend fixes (fix exists, add modified_time, remove call to non-existent function) (#26)

• Apparently the year changed to 2015

1.2.2 (2015-01-28)

• Remove always show all warnings filter (#21)

• Release package as a wheel

• Avoid resource warning during install (#20)

• Made S3BotoStorage deconstructible (previously only S3BotoStorageFile was deconstructible) (#19)

1.2.1 (2014-12-31)

• Fix storage.modified_time crashing on new files when AWS_PRELOAD_METADATA=True (#11, #12, #14)

• Deprecate and issue warning about parse_ts_extended

• Deprecate mongodb backend - django-mongodb-engine now ships its own storage backend

1.2 (2014-12-14)

• Add text/javascript mimetype to S3BotoStorage gzip allowed defaults

• Add support for Django 1.7 migrations in S3BotoStorage and ApacheLibCloudStorage (#5, #8)

• Python3K (3.3+) now available for S3Boto backend (#4)

• Remove legacy S3 storage (#1)

• Remove mosso files backend (#2)

NOTE: Version 1.1.9 is the first release of django-storages after the fork. It represents the current (2014-12-08) state of the original django-storages in master with no additional changes. This is the first release of the code base since March 2013.

1.1.9 (2014-12-08)

• Fix syntax for Python3 with pull-request #91

• Support pushing content type from File object to GridFS with pull-request #90

• Support passing a region to the libcloud driver with pull-request #86

• Handle trailing slash paths fixes #188 fixed by pull-request #85

• Use a SpooledTemporaryFile to conserve memory in S3BotoFile pull-request #69

• Guess content-type for S3BotoStorageFile the same way that _save() in S3BotoStorage does

• Pass headers and response_headers through from url to generate_url in S3BotoStorage pull-request #65

• Added AWS_S3_HOST, AWS_S3_PORT and AWS_S3_USE_SSL settings to specify host, port and is_secure in pull-request #66

Everything Below Here Was Previously Released on PyPi under django-storages

1.1.8 (2013-03-31)

• Fixes #156 regarding date parsing, ValueError when running collectstatic

• Proper handling of boto dev version parsing

• Made SFTP URLs accessible, now uses settings.MEDIA_URL instead of sftp://

1.1.7 (2013-03-20)

• Listing of huge buckets on S3 is now prevented by using the prefix argument to boto’s list() method

• Initial support for Windows Azure Storage

• Switched to useing boto’s parse_ts date parser getting last modified info when using S3boto backend

• Fixed key handling in S3boto and Google Storage backends

• Account for lack of multipart upload in Google Storage backend

• Fixed seek() issue when using AWS_IS_GZIPPED by darkness51 with pull-request #50

• Improvements to S3BotoStorage and GSBotoStorage

1.1.6 (2013-01-06)

• Merged many changes from Jannis Leidel (mostly regarding gzipping)

• Fixed tests by Ian Lewis

• Added support for Google Cloud Storage backend by Jannis Leidel

• Updated license file by Dan Loewenherz, fixes #133 with pull-request #44

• Set Content-Type header for use in upload_part_from_file by Gerardo Curiel

• Pass the rewind parameter to Boto’s set_contents_from_file method by Jannis Leidel with pull-request #45

• Fix for FTPStorageFile close() method by Mathieu Comandon with pull-request #43

• Minor refactoring by Oktay Sancak with pull-request #48

• Ungzip on download based on Content-Encoding by Gavin Wahl with pull-request #46

• Add support for S3 server-side encryption by Tobias McNulty with pull-request #17

• Add an optional setting to the boto storage to produce protocol-relative URLs, fixes #105

1.1.5 (2012-07-18)

• Merged pull request #36 from freakboy3742 Keith-Magee, improvements to Apache Libcloud backend and docs

• Merged pull request #35 from atodorov, allows more granular S3 access settings

• Add support for SSL in Rackspace Cloudfiles backend

• Fixed the listdir() method in s3boto backend, fixes #57

• Added base url tests for safe_join in s3boto backend

• Merged pull request #20 from alanjds, fixed SuspiciousOperation warning if AWS_LOCATION ends with ‘/’

• Added FILE_BUFFER_SIZE setting to s3boto backend

• Merged pull request #30 from pendletongp, resolves #108, #109 and #110

• Updated the modified_time() method so that it doesn’t require dateutil. fixes #111

• Merged pull request #16 from chamal, adds Apache Libcloud backend

• When preloading the S3 metadata make sure we reset the files key during saving to prevent stale metadata

• Merged pull request #24 from tobias.mcnulty, fixes bug where s3boto backend returns modified_time in wrong time zone

• Fixed HashPathStorage.location to no longer use settings.MEDIA_ROOT

• Remove download_url from setup file so PyPI dist is used

1.1.4 (2012-01-06)

• Added PendingDeprecationWarning for mosso backend

• Merged pull request #13 from marcoala, adds SFTP_KNOWN_HOST_FILE setting to SFTP storage backend

• Merged pull request #12 from ryankask, fixes HashPathStorage tests that delete remote media

• Merged pull request #10 from key, adds support for django-mongodb-engine 0.4.0 or later, fixes GridFS file deletion bug

• Fixed S3BotoStorage performance problem calling modified_time()

• Added deprecation warning for s3 backend, refs #40

• Fixed CLOUDFILES_CONNECTION_KWARGS import error, fixes #78

• Switched to sphinx documentation, set official docs up on http://django-storages.rtfd.org/

• HashPathStorage uses self.exists now, fixes #83

1.1.3 (2011-08-15)

• Created this lovely change log

• Fixed #89: broken StringIO import in CloudFiles backend

• Merged pull request #5: HashPathStorage path bug