Skip to main content

A lightweight experimentation toolkit for data scientists.

Project description

Stratosphere

A lightweight experimentation toolkit for data scientists.

PyPI - Python Version PyPI - License PyPI - Version PyPI - Wheel PyPI - Installs Black - Code style Open in Colab Open in Binder

Designed to be accessibile, fast and robust. stratosphere lets you:

  1. Define programmatically your experiments
  2. Execute them in parallel with different backends
  3. Track their real-time metrics and final results
  4. Store them as serialized objects and tabular data in your database(s)
  5. Query them with the best-suited interface: SQL, Pandas and Python

How is it possible?

Stratosphere

Installation

On Python >= 3.8.0:

  • With PyPI: pip install "stratosphere[complete]" --upgrade # Install everything
  • With Poetry: poetry add stratosphere@latest --extras complete # Install everything

On Python 3.7.13-15 with Google Colab or Binder, execute the following at the beginning of the notebook:

# Install dependencies
!pip install pandas joblib sqlalchemy sqlalchemy-utils ulid-py cloudpickle colorama tqdm --upgrade

# Install [complete] extras, required to run the tutorial
!pip install tabulate scikit-learn dask[complete] --upgrade

# Install the latest stratosphere version, ignoring the python version and dependencies
!pip install stratosphere --upgrade --ignore-requires-python --no-dependencies

# Resolve ContextualVersionConflict errors, due to broken dependencies
import importlib
import pkg_resources
importlib.reload(pkg_resources)

You can also install only the stratosphere library (dropping the [complete] extras). Modules like stratosphere.utils.dask, stratosphere.utils.metrics, and stratosphere.utils.widgets won't work until you also install dask[complete], scikit-learn, and ipywidgets, respectively. These extras are required to run some of the tutorial notebooks.

Documentation

  • In the intro notebook, you'll be exposed to the key concepts. It runs entirely in the browser.
  • In the tutorial notebooks, you'll cover the advanced topics. Working locally, on Colab and on Binder.

Project pages

License

This project is licensed under the terms of the BSD 3-Clause License.

Development

See the development page.

Contributing

Work in progress!

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

stratosphere-0.1.59.tar.gz (25.5 kB view hashes)

Uploaded source

Built Distribution

stratosphere-0.1.59-py3-none-any.whl (30.8 kB view hashes)

Uploaded py3

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Huawei Huawei PSF Sponsor Microsoft Microsoft PSF Sponsor NVIDIA NVIDIA PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page