Jupyter content manager that uses the HDFS filesystem
Project description
===========================================
HDFS Contents Manager for Jupyter Notebooks
===========================================
A contents manager for Jupyter that stores files in Hadoop File System (HDFS)
Install
-------
1) Install HDFS3_.
2) Clone this repository then pip install .
Run
----
You can use command line arguments to set HDFS related configurations
::
jupyter-notebook --NotebookApp.contents_manager_class='hdfscontents.hdfsmanager.HDFSContentsManager' \
--HDFSContentsManager.hdfs_namenode_host='localhost' \
--HDFSContentsManager.hdfs_namenode_port=9000 \
--HDFSContentsManager.root_dir='/user/centos/'
.. code: bash
Alternatively, first run:
::
jupyter-notebook --generate-config
to generate a default config file. Edit and add the HDFS related configurations in the generated file. Then start the notebook server.
::
jupyter-notebook
.. _HDFS3: https://hdfs3.readthedocs.io/en/latest/install.html
HDFS Contents Manager for Jupyter Notebooks
===========================================
A contents manager for Jupyter that stores files in Hadoop File System (HDFS)
Install
-------
1) Install HDFS3_.
2) Clone this repository then pip install .
Run
----
You can use command line arguments to set HDFS related configurations
::
jupyter-notebook --NotebookApp.contents_manager_class='hdfscontents.hdfsmanager.HDFSContentsManager' \
--HDFSContentsManager.hdfs_namenode_host='localhost' \
--HDFSContentsManager.hdfs_namenode_port=9000 \
--HDFSContentsManager.root_dir='/user/centos/'
.. code: bash
Alternatively, first run:
::
jupyter-notebook --generate-config
to generate a default config file. Edit and add the HDFS related configurations in the generated file. Then start the notebook server.
::
jupyter-notebook
.. _HDFS3: https://hdfs3.readthedocs.io/en/latest/install.html
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.