Skip to main content

Seamless umbrella distribution (all components by default)

Project description

Seamless

Seamless: define your computation once — cache it, scale it, share it.

Most computational pipelines are already reproducible — the same inputs produce the same outputs. Wrap your code as a step with declared inputs and outputs, and Seamless gives you caching (never recompute what you've already computed) and remote deployment (run on a cluster without changing your code). Remote execution also acts as a reproducibility test: if your wrapped code runs on a clean worker and produces the same result, it is reproducible. If not, Seamless has helped you find the problem — whether it's a missing input, an undeclared dependency, or a sensitivity to platform or library versions.

Seamless wraps both Python and command-line code. In Python, direct runs a function immediately; delayed records the function for deferred or remote execution. From the shell, seamless-run wraps any command as a Seamless transformation — no Python required. In both cases, the transformation is identified by the checksum of its code and inputs: identical work always produces the same identity.

Sharing works at two levels. The lightweight path is to exchange checksums: if two researchers have computed the same transformation, they already have the same result — no data transfer needed. The concrete path is to share the seamless.db file, a portable SQLite database that maps transformation checksums to result checksums. Copy it to a colleague, a cluster, or a publication archive, and every cached result travels with it. Combined, these two paths let a lab build up a shared computation cache that grows over time and never recomputes what anyone has already computed.

What about interactivity?

This is Seamless 1.x, running on a new code architecture. Seamless 0.x offered an interactive, notebook-first workflow experience with reactive cells, Jupyter widget integration, filesystem mounting, and collaborative web interfaces. These features are being ported to the new architecture. If your work is primarily interactive/exploratory, you can use the legacy version today, or watch this space for updates.

Installation

pip install seamless-suite

This installs all standard Seamless components. For a minimal install, the core user-facing packages are:

Package Import Provides
seamless-core import seamless Checksum, Buffer, cell types, buffer cache
seamless-transformer from seamless.transformer import direct, delayed, parallel direct, delayed, parallel, parallel_async, TransformationList, seamless-run, seamless-upload, seamless-download
seamless-config import seamless.config seamless.config.init(), seamless.config.set_nparallel(), seamless-init

Source code

All source code is on GitHub: seamless-core, seamless-transformer, seamless-config, seamless-remote, seamless-jobserver, seamless-dask

Quick Examples

Python: direct

from seamless.transformer import direct

@direct
def add(a, b):
    return a + b

add(2, 3)   # runs the function, returns 5
add(2, 3)   # cache hit — returns 5 instantly

Command line: seamless-run

export SEAMLESS_CACHE=~/.seamless/cache     # global persistent caching

seamless-run 'seq 1 10 | tac && sleep 5'    # runs, caches result
seamless-run 'seq 1 10 | tac && sleep 5'    # cache hit — instant

Seamless mode

Automatically wrap the bash commands you type

seamless-mode demo

Documentation

Full documentation — including getting-started guides, cluster setup, remote execution, and reference API — is at:

https://sjdv1982.github.io/seamless/

Agent Skill

Seamless includes an agent skill (seamless-adoption) for AI coding assistants. It guides assessment of codebase fit and planning/executing ports — covering both the Python face (direct/delayed) and the Unix face (seamless-run). See skills/seamless-adoption/SKILL.md.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

seamless_suite-1.3.3.tar.gz (4.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

seamless_suite-1.3.3-py3-none-any.whl (4.3 kB view details)

Uploaded Python 3

File details

Details for the file seamless_suite-1.3.3.tar.gz.

File metadata

  • Download URL: seamless_suite-1.3.3.tar.gz
  • Upload date:
  • Size: 4.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.12

File hashes

Hashes for seamless_suite-1.3.3.tar.gz
Algorithm Hash digest
SHA256 aeed95e1dd4cec7297b35459fc479af5349eb5f2af363ef3be92090bcdcf6210
MD5 bdf3416b0a8fcba830d40132cce53480
BLAKE2b-256 e7e4083d6790b4d1448066fe9c7640c82c04992d63060524ebd2395df44a3283

See more details on using hashes here.

File details

Details for the file seamless_suite-1.3.3-py3-none-any.whl.

File metadata

  • Download URL: seamless_suite-1.3.3-py3-none-any.whl
  • Upload date:
  • Size: 4.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.12

File hashes

Hashes for seamless_suite-1.3.3-py3-none-any.whl
Algorithm Hash digest
SHA256 a5b72507f424237625425df7a83718d50970ae627058bb6ef91a645a4d2c7196
MD5 ea36a163f36c0de27d28cc3d035bb0e4
BLAKE2b-256 8504c3de72972d8a94c3681455d3d87773984ae788e73e64a6011a94e0e53809

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page