Skip to main content

ElasticNotebookのライブラリ版

Project description

elastic-notebook-slim

元レポジトリ

https://github.com/illinoisdata/ElasticNotebook

インストール方法

カレントディレクトリにダウンロードせずライブラリとして使う方法(一般ユーザ向け)

pip install elastic-notebook-slim

ソースコードをローカルにダウンロードして使う方法(開発者向け)

git clone https://github.com/MRyutaro/elastic_notebook_slim.git
pip install ./elastic_notebook_slim

c

Project Structure

elastic-notebook
│   ElasticNotebook.py                     ## top-level cell magic
│───algorithm
│   │───baseline.py                        ##  Migrate/recompute all baselines
│   │───optimizer_exact.py                 ##  Replication plan generation via min-cut reduction (Section 5.3)
│   └───selector.py                        ##  Optimizer base class
└───core
    │───common
    │   │───checkpoint_file.py             ## Struct of ElasticNotebook's checkpoint file
    │   │───profile_graph_size.py          ## Size estimator for ElasticNotebook's Application History Graph
    │   │───profile_migration_speed.py     ## Profiler for network bandwidth
    │   └───profile_variable_size.py       ## Profiler for variable size
    │───graph
    │   │───cell_execution.py              ## Data structure for Cell Executions
    │   │───graph.py                       ## ElasticNotebook's Application History Graph (Section 4.1)
    │   └───variable_snapshot.py           ## Data strcutre for Variable Snapshots
    │───io
    │   │───adapter.py                     ## File writer base class
    │   │───filesystem_adapter.py          ## Writer for writing checkpoint file to NFS
    │   │───migrate.py                     ## Helper for creating checkpoint file
    │   │───pickle.py                      ## Helper for variable serializability detection
    │   └───recover.py                     ## Helper for unpacking checkpoint file
    │───mutation
    │   │───fingerprint.py                 ## Helper for detecting variable modifications via ID graph and object hash
    │   │───id_graph.py                    ## ID graph construction and comparison (Section 4.2)
    │   └───object_hash.py                 ## Object hash construction and comparison (Section 4.2)
    └───notebook
        │───checkpoint.py                  ## Line magic for checkpointing notebook session (Section 3.2)
        │───find_input_vars.py             ## AST analysis module for finding input variables
        │───find_output_vars.py            ## Helper for finding created/deleted variables via namespace difference
        │───restore_notebook.py            ## Line magic for restoring notebook session (Section 3.2)
        └───update_graph.py                ## Helper for updating Application History Graph

PyPi へのアップロード方法

自動でアップロードする方法

uv pip install -e .  # 初回のみ実行する
bump2version {hogehoge}  # コマンドは以下のいずれかから選択する
git push --follow-tags  # コミットとタグの両方をプッシュする
コマンド 説明 バージョン変更例
bump2version patch パッチバージョンを上げる 0.0.1 → 0.0.2
bump2version minor マイナーバージョンを上げる 0.1.0 → 0.2.0
bump2version major メジャーバージョンを上げる 1.0.0 → 2.0.0

手動でアップロードする方法

uv pip install twine build
python -m build
python -m twine upload dist/*

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

elastic_notebook_slim-0.0.11.tar.gz (27.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

elastic_notebook_slim-0.0.11-py3-none-any.whl (35.3 kB view details)

Uploaded Python 3

File details

Details for the file elastic_notebook_slim-0.0.11.tar.gz.

File metadata

  • Download URL: elastic_notebook_slim-0.0.11.tar.gz
  • Upload date:
  • Size: 27.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.3

File hashes

Hashes for elastic_notebook_slim-0.0.11.tar.gz
Algorithm Hash digest
SHA256 cf380bfc23ba8dd2e3b05f8b0881f1eaa1f3a7df84046ab61f11cd79870b0ab8
MD5 eeeaccbb166310c841482bb344402665
BLAKE2b-256 8daff614d8f8c371f0fcbd8651ca13af63e2da604dff1bbdd658c9764c7db451

See more details on using hashes here.

File details

Details for the file elastic_notebook_slim-0.0.11-py3-none-any.whl.

File metadata

File hashes

Hashes for elastic_notebook_slim-0.0.11-py3-none-any.whl
Algorithm Hash digest
SHA256 69e90956edc491796ad3625b21074ceb9f7d464272d878015e0df65176148d4b
MD5 3e21e1e584efb0d7a92f783951cf0438
BLAKE2b-256 5ce22dea3d00895712f87d5c9c6cb380cb339dfc9d6389ceb23bbaf2c6a85d40

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page