Skip to main content
Help us improve PyPI by participating in user testing. All experience levels needed!

Django storage module implementation for Google Cloud Storage

Project description

Django storage module implementation for Google Cloud Storage using the google-cloud python module by Google.

Notice: alpha release

Please keep in mind that this version is not yet used in any production application (as far as I know of) and thus is an alpha release, even though fully tested! Any kind of feedback is greatly appreciated.

Installation

Install django-gcloud-storage:

pip install django-gcloud-storage

Create a GCS service account JSON keyfile and a bucket for your application. Check the documentation of google-cloud-python and Google Cloud Platform for more details:

https://googlecloudplatform.github.io/google-cloud-python/stable/google-cloud-auth.html

https://cloud.google.com/storage/docs/authentication#generating-a-private-key

Update your Django settings and use it like any other Django storage module:

DEFAULT_FILE_STORAGE = 'django_gcloud_storage.DjangoGCloudStorage'

GCS_PROJECT = "django-gcloud-storage"
GCS_BUCKET = "django-gcloud-storage-bucket"
GCS_CREDENTIALS_FILE_PATH = "/path/to/gcs-credentials.json"

Features

  • Fully tested on Python 2.7, 3.3 - 3.6 and PyPy with Django 1.8, 1.9 and 1.10
  • Files are locally downloaded as SpooledTemporaryFile objects to avoid memory abuse
  • Changed files will automatically be reuploaded to GCS when closed

Caveats

  • Files must be fully downloaded to be accessed and fully uploaded when changed
  • Everytime a file is opened via the storage module, it will be downloaded again
  • (development) Most tests need access to Google Cloud Storage

Unsigned URLS

The module generates signed urls by default. This requires calls to storage API which might take some time if you need to return several images at a time. You can generate unsigned urls using the following setting:

GCS_USE_UNSIGNED_URLS = True

Keep in mind you might need to set the default object permission to public for the unsigned urls to work.

Contributing

Contributions are welcome, and they are greatly appreciated! Every little bit helps, and credit will always be given.

Report Bugs

Report bugs at https://github.com/strayer/django-gcloud-storage/issues.

If you are reporting a bug, please include:

  • Your operating system name and version.
  • Any details about your local setup that might be helpful in troubleshooting.
  • Detailed steps to reproduce the bug.

Fix Bugs

Look through the GitHub issues for bugs. Anything tagged with “bug” is open to whoever wants to implement it.

Implement Features

Look through the GitHub issues for features. Anything tagged with “feature” is open to whoever wants to implement it.

Write Documentation

django-gcloud-storage could always use more documentation, whether as part of the official django-gcloud-storage docs, in docstrings, or even on the web in blog posts, articles, and such.

Pull Request Guidelines

Before you submit a pull request, check that it meets these guidelines:

  1. The pull request should include tests.
  2. The pull request should work for all supported Python and Django versions (see above). Make sure that the tests pass.

Running Tests

Warning: Most of the tests require a GCS project and will do API requests that may end up costing you money!

You can run the test suite either in a virtualenv with py.test or with tox - both require a valid service account JSON keyfile called test-credentials.json in the project root. The GCS project name will be provided via a command argument.

The tests will create and (hopefully) remove buckets on their own. To be safe, check if there are any leftover buckets in your GCS project after running the tests!

source <YOURVIRTUALENV>/bin/activate
(myenv) $ pip install -r requirements-test.txt
(myenv) $ pip install -e .
(myenv) $ py.test --gcs-project-name="project-name"

or

$ tox -- --gcs-project-name="project-name"

Credits

Inspired by:

Tools (partly) used in rendering this package:

History

0.2.1 (2017-06-23)

  • Use google-cloud package instead of gcloud (package was renamed by Google)
  • Added test support for Django 1.10 and 1.11
  • Deprecated Django 1.7 (should still work, no support guaranteed)
  • Added test support for Python 3.6
  • Added setting for unsigned URLs support
  • Added get_modified_time() for Django 1.11+ support
  • storage.open() will now create new blobs if no existing blob has been found

0.1.0 (2016-02-01)

  • First release on PyPI.
  • Development of this release was kindly sponsored by Craft AG.

Project details


Release history Release notifications

This version
History Node

0.2.1

History Node

0.2.0

History Node

0.1.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, size & hash SHA256 hash help File type Python version Upload date
django_gcloud_storage-0.2.1-py2.py3-none-any.whl (9.5 kB) Copy SHA256 hash SHA256 Wheel py2.py3 Jun 23, 2017
django-gcloud-storage-0.2.1.tar.gz (13.7 kB) Copy SHA256 hash SHA256 Source None Jun 23, 2017

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging CloudAMQP CloudAMQP RabbitMQ AWS AWS Cloud computing Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page