Skip to main content

Upload large files to Django in multiple chunks, with the ability to resume if the upload is interrupted.

Project description

This simple django app enables users to upload large files to Django in multiple chunks, with the ability to resume if the upload is interrupted.

The most of the code base belongs to django-chunked-upload of juliomalegria and I would like to thank him for this awesome package.

This app is intented to work with JQuery-File-Upload by Sebastian Tschan (documentation).

License: MIT-Zero.

Demo

If you want to see a very simple Django demo project using this module, please take a look at django-chunk-upload-demo.

Installation

Install via pip:

pip install django-chunk-upload

And then add it to your Django INSTALLED_APPS:

INSTALLED_APPS = (
    # ...
    'django_chunk_upload',
)

Typical usage

  1. An initial POST request is sent to the url linked to ChunkUploadView (or any subclass) with the first chunk of the file. The name of the chunk file can be overriden in the view (class attribute field_name). Example:
{"my_file": <File>}
  1. In return, server with response with the upload_id, the current offset and the when will the upload expire (expires). Example:
{
    "upload_id": "5230ec1f59d1485d9d7974b853802e31",
    "offset": 10000,
    "expires": "2013-07-18T17:56:22.186Z"
}
  1. Repeatedly POST subsequent chunks using the upload_id to identify the upload to the url linked to ChunkUploadView (or any subclass). Example:
{
    "upload_id": "5230ec1f59d1485d9d7974b853802e31",
    "my_file": <File>
}
  1. Server will continue responding with the upload_id, the current offset and the expiration date (expires).
  2. Finally, when upload is completed, a POST request is sent to the url linked to ChunkUploadCompleteView (or any subclass). This request must include the upload_id and the md5 checksum (hex). Example:
{
    "upload_id": "5230ec1f59d1485d9d7974b853802e31",
    "md5": "fc3ff98e8c6a0d3087d515c0473f8677"
}
  1. If everything is OK, server will response with status code 200 and the data returned in the method get_response_data (if any).

Possible error responses:

  • User is not authenticated. Server responds 403 (Forbidden).
  • Upload has expired. Server responds 410 (Gone).
  • upload_id does not match any upload. Server responds 404 (Not found).
  • No chunk file is found in the indicated key. Server responds 400 (Bad request).
  • Request does not contain Content-Range header. Server responds 400 (Bad request).
  • Size of file exceeds limit (if specified). Server responds 400 (Bad request).
  • Offsets does not match. Server responds 400 (Bad request).
  • md5 checksums does not match. Server responds 400 (Bad request).

Settings

Add any of these variables into your project settings to override them.

DJANGO_CHUNK_UPLOAD_EXPIRATION_DELTA

  • How long after creation the upload will expire.
  • Default: datetime.timedelta(days=1)

DJANGO_CHUNK_UPLOAD_PATH

  • Path where uploading files will be stored until completion.
  • Default: 'chunk_uploads/%Y/%m/%d'

DJANGO_CHUNK_UPLOAD_TO

  • upload_to to be used in the Model’s FileField.
  • Default: DJANGO_CHUNK_UPLOAD_PATH + '/{{ instance.upload_id }}.part'

DJANGO_CHUNK_UPLOAD_STORAGE_CLASS

  • Storage system (should be a class).
  • Default: None (use default storage system)

DJANGO_CHUNK_UPLOAD_ABSTRACT_MODEL

DJANGO_CHUNK_UPLOAD_NULL_USER

  • Boolean that defines whether the “user” field of ChunkUpload model can be NULL or not
  • Default: True

DJANGO_CHUNK_UPLOAD_ENCODER

  • Function used to encode response data. Receives a dict and returns a string.
  • Default: DjangoJSONEncoder().encode

DJANGO_CHUNK_UPLOAD_CONTENT_TYPE

  • Content-Type for the response data.
  • Default: 'application/json'

DJANGO_CHUNK_UPLOAD_MAX_BYTES

  • Max amount of data (in bytes) that can be uploaded. None means no limit.
  • Default: None

Support

If you find any bug or you want to propose a new feature, please use the issues tracker. I’ll be happy to help you! :-)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for django-chunk-upload, version 2.0.0
Filename, size File type Python version Upload date Hashes
Filename, size django_chunk_upload-2.0.0-py3-none-any.whl (11.3 kB) File type Wheel Python version py3 Upload date Hashes View
Filename, size django-chunk-upload-2.0.0.tar.gz (10.4 kB) File type Source Python version None Upload date Hashes View

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Huawei Huawei PSF Sponsor Microsoft Microsoft PSF Sponsor NVIDIA NVIDIA PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page