Module for use hadoop file system (hdfs) as django storage
Project description
Django hadoop storage provide python classes/functions to use hadoop file system (hdfs) with django storage.
Based on libhdfs official hadoop python connector and pyarrow library.
Requirements
Install java-1.8.0-openjdk-devel, In centos 7
sudo yum install -y java-1.8.0-openjdk-devel
In Ubuntu
sudo apt-get install openjdk-8-jdk
Settings
For use hdfs as django storage set:
HADOOP_HOST = 'localhost' # set your own host
HADOOP_PORT = 8020 # set your own port
HADOOP_USER = 'hadoop' # set your own user
HADOOP_HOME = '/usr/lib/hadoop/' # set your own path
MEDIA_ROOT = '/media/'
DEFAULT_FILE_STORAGE = 'hadoop_storage.HadoopStorage'
Storage
Use hadoop file storage with same methods and properties that django File Storage
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for django-hadoop-storage-0.1.3.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5f75ddec158002dbe61c41c0800555e2a5d5ac8b282dc762abd4ff251e2736d8 |
|
MD5 | 6c755bd96520744a8872975e25567866 |
|
BLAKE2b-256 | 17525e73beb1102706056a0a48fd751c367f7fb8053f88e5152682c1c3a690b0 |
Close
Hashes for django_hadoop_storage-0.1.3-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bcc93268d6f671b33a90cbbf92ef8781d3d024cf88669a2ce6aef01867719e26 |
|
MD5 | 89de6f083e67b02435d2dc697ba5f25a |
|
BLAKE2b-256 | c3f515d0f10521c704d25a44f2a70691b2f16e60907b63273a9df3789518d1ae |