Skip to main content

Transfer mass spectrometry files (mzML/MSZ) between endpoints using mscompress

Project description

mstransfer

Tests codecov

Transfer mass spectrometry files (mzML / MSZ) between machines over HTTP. Files are always transported in compressed MSZ format using mscompress — mzML sources are compressed on-the-fly without temp files, and the receiving end can optionally decompress back to mzML.

Install

# Recommended — installs as an isolated CLI tool
uv tool install mstransfer

# Or with pipx
pipx install mstransfer

# Or as a project dependency
uv pip install mstransfer
pip install mstransfer

Quick start

Start a server on the receiving machine:

mstransfer serve --port 1319 --store-as msz

Upload files from the source machine:

mstransfer upload /data/experiment1.mzML /data/batch/ remote-host:1319

Usage

mstransfer serve

Start the receiver server.

mstransfer serve [--host 0.0.0.0] [--port 1319] [--output-dir ./received] [--store-as msz|mzml]
Flag Default Description
--host 0.0.0.0 Bind address
--port 1319 Listen port
--output-dir ./received Where received files are written
--store-as msz Store as msz (compressed) or mzml (decompress on arrival)

mstransfer upload

Upload files to a server. Accepts any mix of files and directories. The last positional argument is the target.

mstransfer upload <paths...> <host[:port]> [--recursive] [--parallel 4]
Flag Default Description
--recursive, -r off Recurse into directories
--parallel, -p 4 Number of concurrent uploads

Supported file types: .mzML, .msz, .mszx.

  • mzML files are compressed to MSZ on-the-fly via compress_stream() and streamed directly into the HTTP request — no temp files on the sender.
  • MSZ / MSZX files are streamed as-is.

Programmatic access

You can use mstransfer as a library to send files from your own Python code:

from pathlib import Path
from mstransfer.client import send_file, send_batch

# Send a single file (Path)
result = send_file(Path("experiment.mzML"), "http://remote-host:1319")

# Send an already-opened mscompress object
from mscompress import MZMLFile, MSZFile
from mscompress.mszx import MSZXFile

mzml = MZMLFile(b"/data/experiment.mzML")
send_file(mzml, "http://remote-host:1319")

msz = MSZFile(b"/data/experiment.msz")
send_file(msz, "http://remote-host:1319")

mszx = MSZXFile.open("/data/experiment.mszx")
send_file(mszx, "http://remote-host:1319")

# Send multiple files in parallel
send_batch(
    [Path("a.mzML"), Path("b.msz"), mszx],
    "http://remote-host:1319",
    parallel=4,
)

send_file and send_batch accept any mix of Path, MZMLFile, MSZFile, and MSZXFile inputs.

API

The server exposes a REST API under /v1/:

Endpoint Method Description
/v1/health GET Server status, version, storage mode
/v1/upload POST Upload a file (streamed MSZ body)
/v1/transfer/{id}/status GET Poll transfer state

Embedding in another app

The server is built as a FastAPI app factory:

from mstransfer import create_app

# Standalone
app = create_app(output_dir="/data/ms", store_as="mzml")

# Mount in an existing FastAPI app
from fastapi import FastAPI
main_app = FastAPI()
main_app.mount("/transfer", create_app())

How it works

flowchart LR
    subgraph Sender
        mzML[".mzML"] --> compress["compress_stream()"]
        msz[".msz / .mszx"] --> read["read file"]
    end

    compress --> upload["POST /v1/upload\n(MSZ bytes)"]
    read --> upload

    subgraph Server
        upload --> mode{store-as?}
        mode -- msz --> write["write to disk"]
        mode -- mzml --> temp["write temp .msz"]
        temp --> decompress["decompress"]
        decompress --> cleanup["cleanup temp"]
    end

Development

uv sync --dev
uv run pytest
uv run ruff check src/ tests/

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mstransfer-0.1.0.tar.gz (2.0 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

mstransfer-0.1.0-py3-none-any.whl (14.8 kB view details)

Uploaded Python 3

File details

Details for the file mstransfer-0.1.0.tar.gz.

File metadata

  • Download URL: mstransfer-0.1.0.tar.gz
  • Upload date:
  • Size: 2.0 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for mstransfer-0.1.0.tar.gz
Algorithm Hash digest
SHA256 0e7fdea12a0118902e4b89831bf03b5a649c00e2e6ab0ea577cf5998b3f8e9b3
MD5 e9990ee83afbab9e3ac2ba7178a382ae
BLAKE2b-256 b074aeca7465c781dd958d2abefc8791289fb4757b9f20a62082d565382d82ed

See more details on using hashes here.

Provenance

The following attestation bundles were made for mstransfer-0.1.0.tar.gz:

Publisher: publish.yml on chrisagrams/mstransfer

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file mstransfer-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: mstransfer-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 14.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for mstransfer-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 5d7dd47fbf733eb18f3d49ffaab153287130c6716ec81c97e98d810ec8cf38fd
MD5 25bb8aa50b42102705b00568535b2d39
BLAKE2b-256 f350955f4ab28615fd94f7a11ad3e445983611434dc23b8315ed7e5714961a13

See more details on using hashes here.

Provenance

The following attestation bundles were made for mstransfer-0.1.0-py3-none-any.whl:

Publisher: publish.yml on chrisagrams/mstransfer

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page