Jupyter S3

Jupyter Notebook Contents Manager for AWS S3.

Installation

pip install wayanjupyters3

Configuration

To configure Jupyter Notebook to use JupyterS3, you can add the following to your notebook config file.

from wayanjupyters3 import JupyterS3, JupyterS3SecretAccessKeyAuthentication
c = get_config()
c.NotebookApp.contents_manager_class = JupyterS3

and must also set the following settings on c.JupyterS3 in your config file.

You must also, either, authenticate using a secret key, in which case you must have the following configuration

from wayanjupyters3 import JupyterS3SecretAccessKeyAuthentication
c.JupyterS3.authentication_class = JupyterS3SecretAccessKeyAuthentication

and the following settings on c.JupyterS3SecretAccessKeyAuthentication

or authenticate using a role in an ECS container, in which case you must have the following configuration

from wayanjupyters3 import JupyterS3ECSRoleAuthentication
c.JupyterS3.authentication_class = JupyterS3ECSRoleAuthentication

or authenticate using a role in an EC2 container, in which case you must have the following configuration

from wayanjupyters3 import JupyterS3EC2RoleAuthentication
c.JupyterS3.authentication_class = JupyterS3EC2RoleAuthentication

and the following settings on c.JupyterS3EC2RoleAuthentication

Differences from S3Contents

• There are no extra dependencies over those already required for Jupyter Notebook. Specifically, there is no virtual filesystem library such as S3FS used, boto3 is not used, and Tornado is used as the HTTP client.

• Checkpoints are also saved to S3, under the key <file_name>/.checkpoints/.

• Multiple checkpoints are saved.

• The event loop is mostly not blocked during requests to S3. There are some exceptions due to Jupyter Notebook expecting certain requests to block.

• Uploading arbitrary files, such as JPEGs, and viewing them in Jupyter or downloading them, works.

• Copying and renaming files don't download or re-upload object data from or to S3. "PUT Object - Copy" is used instead.

• Folders are created using a 0 byte object with key suffix / (forward slash). A single forward slash suffix is consistent with both the AWS Console and AWS AppStream.