mostlyright-data
Browse datasets built by our community or create your own with agents that find the sources and configure the pipeline. Mostly Right treats a successful run as one readable dataset version; publishing that version does not by itself prove that catch-up or scheduled refresh is running.
mostlyright-data is the command-line client. It probes sources, registers one recipe document,
starts and follows hosted dataset runs, reads what they delivered, and downloads the datasets after
they finish.
Requirements
Use CPython 3.13 or newer. The retired local execution lane ([local,scientific] extras) still needs 3.13.
Install
python -m pip install mostlyright-data
That is the whole install. There is no second profile and no lane to choose: every mr-data
command sends its work to the backend, and it works on Linux, macOS, and Windows.
It also carries the mr-data-build agent skill, which Claude Code and Codex read to author a
recipe without rediscovering the contract a run at a time. The first mr-data command you run
places it in your agent's skill directory; there is nothing to install by hand. A skill you have
edited yourself is never replaced, and MOSTLYRIGHT_SKILL_AUTOINSTALL=0 switches the placement
off.
Sign in
mr-data login
mr-data whoami
login stores a device key on the current machine. whoami checks that key.
Check the installation
mr-data --version
mr-data --help
Build a dataset
Create the dataset, choose its primary category from the fixed vocabulary, then register a recipe document with the sources, table schema, transformations and checks. Use the created dataset ID in the recipe:
mr-data dataset create --name "Dataset title" --json
mr-data dataset categories --json
mr-data dataset set DATASET_ID --category climate-environment
mr-data recipe recipe.json --json
mr-data run --recipe RECIPE_ID --digest RECIPE_DIGEST --full
mr-data status RUN_ID
mr-data checks RUN_ID
mr-data download RUN_ID --output ./out
Use the identifiers returned by registration and run submission. mr-data dataset create
creates a dataset page before a recipe is ready. mr-data watch RUN_ID follows a submitted run.
The hosted engine executes sample, full and refresh runs. A refresh uses each source's declared update behavior: bounded source windows merge with retained history; snapshot sources are revalidated or acquired again. The table's transformations and checks run over the resulting source relations. URL windows may use declared query parameters or path placeholders; a fixed date URL does not advance automatically. Configure a correction lookback where the publisher can revise earlier observations.
A source exposing only its current snapshot cannot supply a historical delta. It remains a supported source, with snapshot comparison and recomputation rather than a claim that only new rows were fetched. Recorded streams use their registered capture and continuation semantics.
See Recipe documents for source-window and bootstrap contracts.
A table's first succeeded run goes live on its own, whatever mode it was; mr-data promote TABLE_ID records how often it refreshes and why, and puts back a table that was withdrawn. Claim
a table is live and current only when Studio returns that evidence.
There is no local execution
There used to be. A second product lane built datasets on your own machine, and mr-data carried
about fifty commands for making, running, serving, indexing, checking and signing a build here.
That lane is gone: the engine it ran now ships only inside the backend's worker images.
mr-data --help lists every command this product has. A name that is not on it is not a command
and says so. The distribution still publishes a [local] extra — that is the engine's dependency
closure, which the backend's worker image installs — and installing it makes no command run that
does not run without it.
Documentation
Use mr-data --help for the full command list and options. Commands that support
--json write one JSON object.
--output may use a relative path.
Behavior and limits
- Weather Reader versions 1 and 2 accept one extracted GRIB2 record and refuse a multi-record GFS or HRRR file. Version 3 reads a bounded collection and selects exactly one sealed record.
- A single-address credential-free public HTTPS source uses the reviewed hosted route. Bounded collections have no route at all; the retired local lane was their only route.
- A recipe supports up to 256 declared sources. Source count is separate from bounded request concurrency and resource limits. Existing source adapters and Readers retain their own format, pagination, byte, row and credential contracts; a URL collection is not an implicit permission to crawl arbitrary links.
- A keyed stream venue is named by a credential reference the backend holds, never by a value. No command flag takes a secret as an argument. Venues reached over an actual WebSocket are covered; a venue whose credential comes from an interactive human login, or that is not WebSocket at all, is not.
Verification
make test-fast
make test-fast is non-authoritative and is useful while editing. make verify is required
before review or merge.
Development
uv sync --locked --extra dev --extra local-search-neural
The test suite drives the execution engine in-process, and requires Linux for the worker-boundary tests. The client itself is tested on Linux, macOS, and Windows.
1 maintainer
Release files for mostlyright-data 0.18.3
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| mostlyright_data-0.18.3.tar.gz | 33.3 MB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| mostlyright_data-0.18.3-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 67.0 MB
Release files / mostlyright_data-0.18.3.tar.gz
| Download URL | mostlyright_data-0.18.3.tar.gz |
|---|---|
| Size | 33.3 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
325d2e2214e939937a705a0c9c882b0be9cabaf5b94b9952135d944e8b0bf59e
|
|
BLAKE2b-256 checksum How to use checksums |
0e340fb01a735fbe653ba5dcbbf404cd7a081e3c3c1a5bf1cba72c722b89e23b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Sep 11, 2026.
Transparency logRelease files / mostlyright_data-0.18.3-py3-none-any.whl
| Download URL | mostlyright_data-0.18.3-py3-none-any.whl |
|---|---|
| Size | 33.7 MB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
c5f26661a36ff16de1e33fda1f993fc4f337c9fe3a7e138bcbb857f7a75836f9
|
|
BLAKE2b-256 checksum How to use checksums |
e18c9762a9a714de8804112557df4288faca50eb305b7fefb591a44cd1a9e328
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Sep 11, 2026.
Transparency log
