Skip to main content

Intelligent Python Checkpointing

Project description

Intelligent checkpointing framework for Python-based machine learning and scientific computing. Under development as part of a research project at the University of Illinois at Urbana-Champaign.

Installation

Run the following command in a virtual environment.

python setup.py install

Jupyter Integration

Run Jupyter after installing kishu. In your notebook, you can enable kishu with the following command.

Basic Usage

from kishu import init_kishu
init_kishu()

Then, all the cell executions are recorded, and the result of each cell execution is checkpointed.

Working with Kishu

init_kishu() adds a new variable _kishu (of type KishuJupyterExecHistory) to Jupyter's namespace. The special variable can be used for kishu-related operations, as follows.

Browse the execution log.

_kishu.log()

See the database file.

_kishu.checkpoint_file()

Restore a state.

_kishu.checkout(commit_id)

Checkpoint Backend

Deploy a restful server.

flask --app kishu/backend run

Deployment

The following command will upload this project to pypi (https://pypi.org/project/kishu/).

bash upload2pypi.sh

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

kishu-0.2.0.tar.gz (2.5 MB view details)

Uploaded Source

Built Distribution

kishu-0.2.0-cp38-cp38-macosx_12_0_arm64.whl (80.7 kB view details)

Uploaded CPython 3.8 macOS 12.0+ ARM64

File details

Details for the file kishu-0.2.0.tar.gz.

File metadata

  • Download URL: kishu-0.2.0.tar.gz
  • Upload date:
  • Size: 2.5 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.8.16

File hashes

Hashes for kishu-0.2.0.tar.gz
Algorithm Hash digest
SHA256 451a5f515174bbe34f86c9439e233702eb7dabea7e07bdc578f5fe68df16d29f
MD5 1c6bd9537185301c770e2c7e5809e509
BLAKE2b-256 d935a37c57aa00bb997eb7efdd737c2001f82916a06d61e1696f4cee67d940aa

See more details on using hashes here.

File details

Details for the file kishu-0.2.0-cp38-cp38-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for kishu-0.2.0-cp38-cp38-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 deccf865fd2810e3da35ff438e760ef95c6b6b9d30f968eadf0bfd1128ad1793
MD5 ee28a815ec086490f19335c423b4d0bc
BLAKE2b-256 448061909ad62599b7b1b9941476c4ce17909807682817bd60ff1c8ad25be13c

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page