A lightweight experimentation toolkit for data scientists.
Project description
Stratosphere
A lightweight experimentation toolkit for data scientists.
Designed to be accessibile, fast and robust. stratosphere
lets you:
- Define programmatically your experiments
- Execute them in parallel with different backends
- Track their real-time metrics and final results
- Store them as serialized objects and tabular data in your database(s)
- Query them with the best-suited interface: SQL, Pandas and Python
How is it possible?
- Fast and light: Try it now with JupyterLite, it runs entirely in the browser
- Built on top of solid components: SQLAlchemy, SQLite, Pandas, Joblib and Dask
- Designed for data accessibility: Use it where you need it. For example, you can experiment in-memory, persist locally, replicate tables on render.com, and publish results on preset.io (all free tiers!)
Installation
On Python >= 3.8.0
:
- With PyPI:
pip install "stratosphere[complete]" --upgrade
# Install everything - With Poetry:
poetry add stratosphere@latest --extras complete
# Install everything
On Python 3.7.13-15
with Google Colab or
Binder, execute the following at the beginning of the notebook:
# Install dependencies
!pip install pandas joblib sqlalchemy sqlalchemy-utils ulid-py cloudpickle colorama tqdm --upgrade
# Install [complete] extras, required to run the tutorial
!pip install tabulate scikit-learn dask[complete] --upgrade
# Install the latest stratosphere version, ignoring the python version and dependencies
!pip install stratosphere --upgrade --ignore-requires-python --no-dependencies
# Resolve ContextualVersionConflict errors, due to broken dependencies
import importlib
import pkg_resources
importlib.reload(pkg_resources)
You can also install only the stratosphere
library (dropping the [complete]
extras).
Modules like stratosphere.utils.dask
, stratosphere.utils.metrics
, and stratosphere.utils.widgets
won't work until you also install dask[complete]
, scikit-learn
, and ipywidgets
, respectively.
These extras are required to run some of the tutorial notebooks.
Documentation
- In the intro notebook, you'll be exposed to the key concepts. It runs entirely in the browser.
- In the tutorial notebooks, you'll cover the advanced topics. Working locally, on Colab and on Binder.
Project pages
License
This project is licensed under the terms of the BSD 3-Clause License.
Development
See the development page.
Contributing
Work in progress!
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for stratosphere-0.1.50-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 68f5ae9fdae273f9b191f6cf4ed9528c3e94bf9758cf05234c3032168b781ab7 |
|
MD5 | f1031463ece85adcd511bf8533a2fa14 |
|
BLAKE2b-256 | 6dc6356453b32e4de8325acd664c76c32574f13cf5c5c0fb75880f19621528fb |