Skip to main content

MSB — Mega-Super-Base

Python Version License Version Dependencies

A domain layer for Python, with no dependencies. The model, the rules it must obey and the operations over it live in MSB, independent of any interface, storage or transport. Everything reaches them through one entry point, by sending a request that is data:

{"operation": "configure", "obj": part, "attributes": {"set": {"params": {"price": 4.5}}}}

A window, a command line, a test and an HTTP handler are then adapters that send the same dictionary. Nothing in the domain knows which one did.

What that buys:

  • One domain, several faces. The same rules and operations serve a GUI, a script and a remote caller, with no second copy of the logic in any of them.
  • Rules enforced where the data is. Types, constraints on values, and invariants across fields and across a whole collection are checked when an object is built, when it is restored and after every write. A refused change is undone, not half-applied.
  • A session you can record and replay. The journal keeps each request as data, with the object's address in the model rather than a reference to it, so the same session runs again against another project or in another process and lands on the objects it meant.
  • Answers derived from the code. Which operations exist, what each handler needs and accepts, which type holds which, and what a change reaches are read back from the classes, so a menu, a command line or a diagram built on them cannot go stale.
  • Cross-cutting concerns kept out. Metrics, auditing, authorisation and rate limiting hang on one hook that sees every request; the domain knows nothing about them.

In use behind pAstroCORE, which plans radio astronomy observations through a desktop interface and a command line over one model.

Where MSB sits

In domain-driven design and ports-and-adapters terms:

Concept In MSB
Entities BaseEntity — typed, validated fields; named within its owner, and addressable in the model
Rules on values Annotated[float, Positive()], Range, Predicate — enforced on build, write and restore
Aggregates and their consistency BaseContainer, Project — an @invariant on the whole, checked after every change to what it holds, the change undone when refused
Domain services Super — an operation with a handler per type, resolved through inheritance
The port Manipulator — the single entry point every adapter talks to
Commands and queries Requests as data. The built-in configure writes and stops at the first failure; inspect only reads -- get, get_*, has_*, is_* -- and reports every outcome
Adapters Whatever sends a request — a GUI, a CLI, a test, an HTTP handler. None of them live in MSB
Cross-cutting concerns Interceptors
Persistence save and load — a replaceable JSON default, with schema versions and migrations
Command log RequestJournal — every request as data, replayable against another model

Not provided, on purpose: domain events, repositories and a unit of work, immutable value objects, and event sourcing. The journal records requests, not domain events. Those belong to the application, or to a library built for them. The reasoning is in architecture.

Plug it into anything

The domain never imports an adapter, so adapters are small and interchangeable:

Put MSB behind How
HTTP — FastAPI, Flask, Django A view turns JSON into a request; objects travel as addresses and come back through locate
A command line Flags built from the catalogue: a handler's parameters are derived from its code, so no list to keep in sync
A GUI The same requests; forms and menus derived the same way
SQL, a document store, an API Register your own save and load; the built-in JSON ones are defaults, not a law
@app.post("/request")
def handle(body: dict):
    target = service.locate(body["path"]) if body.get("path") else None
    return dict(service.process_request({"operation": body["operation"], "obj": target,
                                         "attributes": body.get("attributes", {})}))

That is a complete CRUD endpoint: create, read, update and delete are requests like any other, and the invariants guard every one of them. Moving from JSON files to a database, or from a desktop tool to a web service, replaces an adapter and leaves the domain and its tests untouched. Worked through in examples.

Features

  • Typed entities. Attributes validated against their annotations, nested to any depth, including List, Dict, Tuple, Set, Union, Literal, Callable and Type[X]. A value written after the annotation is what the field starts as, and a declared list or dict belongs to the object rather than to the class.
  • Constraints on values, not just types. price: Annotated[float, Positive()] is enforced on construction, on assignment and on restore, with no __init__ of your own.
  • Rules about the whole object. @invariant("end must be after start") guards what no per-field rule can — the relation between several. Checked at the same three points, and a refused change is undone rather than half-applied.
  • Containers for collections. Named, queryable, serializable, with bulk operations.
  • One entry point. A Manipulator registers operations and processes requests; a facade per operation means you rarely write a request dictionary by hand.
  • Reading and writing come free. inspect, configure, save, load and catalogue are registered for you, so an application that only reads and writes its model needs no operation layer at all.
  • Operations that write themselves. A handler is usually one call to _apply_methods, which applies everything a request names and reports each outcome.
  • Pipelines. Several requests that feed each other, given as data in one call. The order, what may run at once, and what to skip when a step fails all follow from the edges.
  • Serialization that round-trips. json.loads(json.dumps(obj.to_dict())) restores an equal object, through lists, dicts, sets and tuples, nested to any depth. Cycles are detected rather than followed, and data carries the schema version of the class that wrote it.
  • Derived answers instead of hand-written ones. What operations exist, what handlers they have, which handler needs which, which type holds which, and what a change reaches — all read back from the code, so a menu or a diagram cannot go stale.
  • One place to hang metrics, auditing, rate limiting and authorisation. An interceptor sees a request before it runs and its response after, and may refuse or rewrite it. Request metrics and a replayable journal ship using nothing more than that hook.
  • A session that replays somewhere else. The journal records each request as plain data, with the object's address in the model rather than a reference to it, so json.dumps(journal.entries) on one side and manipulator.replay(json.loads(...)) on the other run the same session against another project, in another process -- landing on the objects it meant. address and locate are the same addressing on its own, for a request that has to cross a wire.
  • Asynchronous when you need it. await manipulator.ainspect(...) moves the work off the event loop, and every synchronous signature is untouched.
  • Exceptions you can catch precisely. Everything derives from MSBError, and also from the built-in it replaces, so except TypeError keeps working while except DuplicateNameError becomes possible.
  • No external dependencies. Python >= 3.12 and nothing else.

Installation

pip install msb_arch

Quick start

Describe the data, describe the operations, drive both through the orchestrator.

from msb_arch import BaseContainer, BaseEntity, Manipulator

# 1. the data
class Part(BaseEntity):
    price: float

    def get_price(self) -> float:
        return self.price

    def set_price(self, value: float) -> bool:
        self.price = value
        return True

class Parts(BaseContainer[Part]):
    pass

# 2. the entry point
class Workshop(Manipulator):
    pass

manipulator = Workshop(base_classes=[Part, Parts])

box = Parts(name="box")
box.add(Part(name="bolt", price=4.5))
bolt = box.get("bolt")

assert manipulator.inspect(bolt, get_price=None) == 4.5
manipulator.configure(bolt, set_price=5.0)
assert manipulator.inspect(bolt, get_price=None) == 5.0

assert box.to_dict()["items"]["bolt"]["price"] == 5.0

There is no operation layer to write: inspect and configure follow from the request model itself. You write a Super when an operation carries logic of your own:

from msb_arch import Super

class Pricing(Super):
    OPERATION = "price"

    def _price_parts(self, obj, attributes):
        return sum(part.price for part in obj.get_items())

manipulator.register_operation(Pricing(manipulator))
assert manipulator.price(box) == 5.0

A handler is short because _apply_methods owns the loop, and the orchestrator dispatches by operation and by the type of the object, so adding an entity adds no code at all.

Ask for several things at once and every outcome comes back:

answer = manipulator.inspect(bolt, get_price=None, get=["name", "isactive"])
assert answer["get_price"]["result"] == 5.0
assert answer["get"]["result"] == {"name": "bolt", "isactive": True}

Run several requests as one batch:

manipulator.batch([
    {"operation": "configure", "obj": bolt, "attributes": {"set_price": 6.0}},
    {"operation": "inspect", "obj": bolt, "attributes": {"get_price": None}},
])
assert bolt.price == 6.0

Or as a pipeline, when the steps feed each other:

outcome = manipulator.pipeline({
    "written": {"operation": "save", "obj": box, "path": "box.json"},
    "read":    {"operation": "load", "obj": box, "path": "box.json", "after": ["written"]},
    "total":   {"operation": "price", "obj": "@read"},
})
assert outcome.output == 6.0

Architecture

Three layers, plus what they share.

Layer Module What lives there
Base — the data serializable.py, baseentity.py, basecontainer.py Validation, serialization, caching, ownership
Super — the operations super.py, builtins.py, project.py Handlers, method resolution, the built-in operations
Mega — the entry point manipulator.py Operation registry, request processing, facades, batches, pipelines
Derivation catalogue.py, model.py, scaffold.py What is registered, what holds what, generated stubs
Shared interceptors.py, results.py, utils/ Metrics and journal, result types, logging, validation

Main classes:

  • Serializable — what an entity and a container have in common: annotated fields and their validation, name and isactive, to_dict, the cache, revision and fingerprint.
  • BaseEntity — an object addressed by its attributes.
  • BaseContainer[T] — a named collection addressed by its items. A sibling of BaseEntity, not a subclass: the two mean different things by get, set and clear.
  • Super — an operation. Subclass it, name the operation, and write handlers as _<operation>_<type>, or _<operation> for the fallback.
  • Project — a named collection of entities with a factory for creating them: the thing an application saves as a whole. A Serializable like the other two, addressed by its items.
  • Manipulator — the entry point. Registers operations, processes requests and pipelines, and answers what it knows about itself and the model.
  • MethodResults — what an operation reports: every method it ran, mapped to its outcome.

Documentation

Testing

Unit, integration, performance and concurrency suites, run with pytest.

The tests import msb_arch rather than the source tree, so they exercise whatever is installed. Install the package first:

pip install -e .

Then run them:

pytest tests/

CI builds the wheel, installs it, checks that msb_arch resolves inside site-packages, and runs the same suites against it, so the distribution that ships is the one that was tested.

Projects using MSB

  • pAstroCORE — radio astronomy observation planning.

License

Apache License 2.0. Use it for anything, including commercially, in open or closed source: keep the licence and the NOTICE with the code, state what you changed, and the patent grant protects you as long as you do not sue over it.

Releases up to and including 1.10.0 went out under the earlier MSB Software License and stay under it; 2.0.0 and later are Apache-2.0.

Available for collaboration, contract work and support — almax1024@gmail.com.

Contacts

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

msb_arch-3.0.0.tar.gz (293.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

msb_arch-3.0.0-py3-none-any.whl (126.7 kB view details)

Uploaded Python 3

File details

Details for the file msb_arch-3.0.0.tar.gz.

File metadata

  • Download URL: msb_arch-3.0.0.tar.gz
  • Upload date:
  • Size: 293.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for msb_arch-3.0.0.tar.gz
Algorithm Hash digest
SHA256 2ce51d35fab376ae4b0b2106c86b26dfffc61406880d89d8be667c0fb41976c1
MD5 0aa5657cadee661d5a763f4b03571a84
BLAKE2b-256 30e878c5ec9ef9ad0f792c7ec74eaaf250e05bcc7d028ad2631aed00d413d57b

See more details on using hashes here.

File details

Details for the file msb_arch-3.0.0-py3-none-any.whl.

File metadata

  • Download URL: msb_arch-3.0.0-py3-none-any.whl
  • Upload date:
  • Size: 126.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for msb_arch-3.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 a30212d3b8d26e8a9286889eaac76352bf502516b2361f837bedee2d83bb8a70
MD5 e5586519b6d5d0c4bf1f531ac228467d
BLAKE2b-256 875a5e35842b372bcf23776385f5baccddd0c78b560921dde7eac1c03592704f

See more details on using hashes here.

Release history Release notifications | RSS feed

This release

3.0.0 This release

2 files

2.0.2

2 files

2.0.1

2 files

2.0.0

2 files

1.10.0

2 files

1.9.2

2 files

1.9.1

2 files

1.9.0

2 files

1.8.0

2 files

1.7.0

2 files

1.6.0

2 files

1.5.0

2 files

1.4.0

2 files

1.3.0

2 files

1.2.0

2 files

1.1.2

2 files

1.1.1

2 files

1.1.0

2 files

1.0.1

2 files

1.0.0

2 files

0.8.0

2 files

0.7.0

2 files

0.6.0

2 files

0.5.0

2 files

0.4.0

2 files

0.3.2

2 files

0.3.1

2 files

0.3.0

2 files

0.2.0

2 files

0.1.3

2 files

0.1.2

2 files

0.1.0

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page