Skip to main content

Seamless umbrella distribution (all components by default)

Project description

Seamless

Seamless: define your computation once — cache it, scale it, share it.

Most computational pipelines are already reproducible — the same inputs produce the same outputs. Wrap your code as a step with declared inputs and outputs, and Seamless gives you caching (never recompute what you've already computed) and remote deployment (run on a cluster without changing your code). Remote execution also acts as a reproducibility test: if your wrapped code runs on a clean worker and produces the same result, it is reproducible. If not, Seamless has helped you find the problem — whether it's a missing input, an undeclared dependency, or a sensitivity to platform or library versions.

Seamless wraps both Python and command-line code. In Python, direct runs a function immediately; delayed records the function for deferred or remote execution. From the shell, seamless-run wraps any command as a Seamless transformation — no Python required. In both cases, the transformation is identified by the checksum of its code and inputs: identical work always produces the same identity.

Sharing works at two levels. The lightweight path is to exchange checksums: if two researchers have computed the same transformation, they already have the same result — no data transfer needed. The concrete path is to share the seamless.db file, a portable SQLite database that maps transformation checksums to result checksums. Copy it to a colleague, a cluster, or a publication archive, and every cached result travels with it. Combined, these two paths let a lab build up a shared computation cache that grows over time and never recomputes what anyone has already computed.

What about interactivity?

This is Seamless 1.x, running on a new code architecture. Seamless 0.x offered an interactive, notebook-first workflow experience with reactive cells, Jupyter widget integration, filesystem mounting, and collaborative web interfaces. These features are being ported to the new architecture. If your work is primarily interactive/exploratory, you can use the legacy version today, or watch this space for updates.

Installation

pip install seamless-suite

This installs all standard Seamless components. For a minimal install, the core user-facing packages are:

Package Import Provides
seamless-core import seamless Checksum, Buffer, cell types, buffer cache
seamless-transformer from seamless.transformer import direct, delayed direct, delayed, seamless-run, seamless-upload, seamless-download
seamless-config import seamless.config seamless.config.init(), seamless-init

Documentation

Full documentation — including getting-started guides, cluster setup, remote execution, and reference API — is at:

https://sjdv1982.github.io/seamless/

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

seamless_suite-0.1.0.tar.gz (3.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

seamless_suite-0.1.0-py3-none-any.whl (3.7 kB view details)

Uploaded Python 3

File details

Details for the file seamless_suite-0.1.0.tar.gz.

File metadata

  • Download URL: seamless_suite-0.1.0.tar.gz
  • Upload date:
  • Size: 3.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.9.23

File hashes

Hashes for seamless_suite-0.1.0.tar.gz
Algorithm Hash digest
SHA256 ddc4eeca67fcc56cc57fefc2d63618a9055e93f35e9879d889cfde83565cc957
MD5 9a41a272373960c4f4c452d68023c70d
BLAKE2b-256 7b7c4641cbbcb0c52edf37ca49a88a8f9b517b461fbf061759f085bd58cce991

See more details on using hashes here.

File details

Details for the file seamless_suite-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: seamless_suite-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 3.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.9.23

File hashes

Hashes for seamless_suite-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 ccd639e39a15a9d0252f8b87f7db2736b15da211e75908dc07a29d2fe44162ef
MD5 4709a184265b46dd34153ae1560f36ef
BLAKE2b-256 2428b2780b1f727c787f0e6c54193a62ab59efaf738c5cdeced5273eccd5d65b

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page