Skip to main content

ML experiment tracking and data storage

Project description

Dreamlake

A simple and flexible SDK for ML experiment tracking and data storage.

Features

  • Three Usage Styles: Decorator, context manager, or direct instantiation
  • Dual Operation Modes: Remote (API server) or local (filesystem)
  • Auto-creation: Automatically creates namespace, workspace, and folder hierarchy
  • Upsert Behavior: Updates existing sessions or creates new ones
  • Simple API: Minimal configuration, maximum flexibility

Installation

Using uv (recommended) Using pip
uv add dreamlake
pip install dreamlake

Quick Start

Remote Mode (with API Server)

from dreamlake import Session

with Session(
    name="my-experiment",
    workspace="my-workspace",
    remote="https://cu3thurmv3.us-east-1.awsapprunner.com",
    api_key="your-jwt-token"
) as session:
    print(f"Session ID: {session.id}")

Local Mode (Filesystem)

from dreamlake import Session

with Session(
    name="my-experiment",
    workspace="my-workspace",
    local_path=".dreamlake"
) as session:
    pass  # Your code here

See examples/ for more complete examples.

Development Setup

Installing Dev Dependencies

To contribute to Dreamlake or run tests, install the development dependencies:

Using uv (recommended) Using pip
uv sync --extra dev
pip install -e ".[dev]"

This installs:

  • pytest>=8.0.0 - Testing framework
  • pytest-asyncio>=0.23.0 - Async test support
  • sphinx>=7.2.0 - Documentation builder
  • sphinx-rtd-theme>=2.0.0 - Read the Docs theme
  • sphinx-autobuild>=2024.0.0 - Live preview for documentation
  • myst-parser>=2.0.0 - Markdown support for Sphinx
  • ruff>=0.3.0 - Linter and formatter
  • mypy>=1.9.0 - Type checker

Running Tests

Using uv Using pytest directly
uv run pytest
pytest

Building Documentation

Documentation is built using Sphinx with Read the Docs theme.

Build docs Live preview Clean build
uv run python -m sphinx -b html docs docs/_build/html
uv run sphinx-autobuild docs docs/_build/html
rm -rf docs/_build

The live preview command starts a local server and automatically rebuilds when files change.

Alternatively, you can use the Makefile from within the docs directory:

cd docs
make html          # Build HTML documentation
make clean         # Clean build files

For maintainers, to build and publish a new release: uv build && uv publish

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dreamlake-0.3.2.tar.gz (30.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dreamlake-0.3.2-py3-none-any.whl (40.3 kB view details)

Uploaded Python 3

File details

Details for the file dreamlake-0.3.2.tar.gz.

File metadata

  • Download URL: dreamlake-0.3.2.tar.gz
  • Upload date:
  • Size: 30.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.10.4 {"installer":{"name":"uv","version":"0.10.4","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for dreamlake-0.3.2.tar.gz
Algorithm Hash digest
SHA256 ea746ef7c5c88ac30d4b945ab11cc0d573037c9882b52112f413a7d95175b278
MD5 5dccca7135395259188ecf9f0a005bd5
BLAKE2b-256 2e1fbfb8139fcdf98c287fb140bd391e415866b876d76fc382f1b1d6db85f613

See more details on using hashes here.

File details

Details for the file dreamlake-0.3.2-py3-none-any.whl.

File metadata

  • Download URL: dreamlake-0.3.2-py3-none-any.whl
  • Upload date:
  • Size: 40.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.10.4 {"installer":{"name":"uv","version":"0.10.4","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for dreamlake-0.3.2-py3-none-any.whl
Algorithm Hash digest
SHA256 52c22679be4e33aa441296cd5a4cb9497b8f78ba0eaa5bac2ca4925c50c86677
MD5 51ce56b16f1a2ce11128d2081fa591fd
BLAKE2b-256 9748c0d16df4df51ac4b6b5e8684ac01a442c5b0129e3e08e076f9255e00da30

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page