Skip to main content

The Modular Autonomous Discovery for Science (MADSci) Resource Manager.

Project description

MADSci Resource Manager

The MADSci Resource Manager provides tooling for tracking and managing the full lifecycle of all the resources (including assets, consumables, samples, containers, and any other physical object) used in an automated/autonomous laboratory.

Notable Features

  • Provides a robust Resource Type library and hierarchy for different "archetypes" of resource.
  • Complete history for every tracked resource, and support for restoring deleted/removed resources
  • Supports querying both active resources and history
  • Provides a REST-based API compatible with the MADSci Resource Client (see MADSci Clients).
  • Enforces logical constraints on resources based on their properties, helping to catch errors like accidental virtual duplication of physical objects or nonsensical outcomes like negative quantities or overflows.

Core Concepts

Resource Types and the Type Hierarchy

MADSci Resource Manager supports various resource types, including:

  • Resource: Base class for all resources.
  • Asset: Tracked resources that aren't consumed (e.g., samples, labware).
  • Consumable: Resources that are consumed (e.g., reagents, pipette tips).
  • Container: Resources that can hold other resources (e.g., racks, plates).
  • Collection: Containers that support random access.
  • Row: Single-dimensional containers.
  • Grid: Two-dimensional containers.
  • VoxelGrid: Three-dimensional containers.
  • Stack: Single-dimensional containers supporting LIFO access.
  • Queue: Single-dimensional containers supporting FIFO access.
  • Pool: Containers for holding consumables that are mixed or collocated.

Usage

Manager

To create and run a new MADSci Resource Manager, do the following in your MADSci lab directory:

  • If you're not using docker compose, provision and configure an SQL database (we recommend and test against PostgreSQL, but other flavors may work).
  • If you're using docker compose, create or add something like the following to your Lab's compose.yaml, defining your docker compose services for the ResourceManager and a PostgreSQL database to store your resources.
name: madsci_example_lab
services:
  postgres:
    container_name: postgres
    image: postgres:17
    environment:
      - POSTGRES_USER=...
      - POSTGRES_PASSWORD=...
      - POSTGRES_DB=resources
    ports:
      - 5432:5432
  resource_manager:
    container_name: resource_manager
    image: madsci:latest
    build:
      context: ..
      dockerfile: Dockerfile
    environment:
      - USER_ID=1000
      - GROUP_ID=1000
    network_mode: host
    volumes:
      - /path/to/your/lab/directory:/home/madsci/lab/
      - .madsci:/home/madsci/.madsci/
    command: python -m madsci.resource_manager.resource_server
    depends_on:
      - postgres
# Create a new Resource Manager Definition
madsci manager add -t resource_manager
# Start the database and Resource Manager's REST Server
docker compose up
# OR
python -m madsci.resource_manager.resource_server

You should see a REST server started on the configured host and port. Navigate in your browser to the URL you configured (default: http://localhost:8003/) to see if it's working.

You can see up-to-date documentation on the endpoints provided by your resource manager, and try them out, via the swagger page served at http://your-server-url-here/docs.

Client

Ensure you have access to the Resource Manager API and initialize the client:

from madsci.client.resource_client import ResourceClient

url = "http://localhost:8003"
client = ResourceClient(url=url)

Adding a Resource

from madsci.common.types.resource_types import Resource

resource = Resource(
    resource_name="Sample Resource",
    resource_type="sample",
)
added_resource = client.add_resource(resource)
print(added_resource)

Updating a Resource

resource.resource_name = "Updated Sample Resource"
updated_resource = client.update_resource(resource)
print(updated_resource)

Getting a Resource

fetched_resource = client.get_resource(resource_id=added_resource.resource_id)
print(fetched_resource)

Querying Resources

resources = client.query_resource(resource_type="sample", multiple=True)
for resource in resources:
    print(resource)

Removing a Resource

removed_resource = client.remove_resource(resource_id=added_resource.resource_id)
print(removed_resource)

Querying Resource History

history = client.query_history(resource_id=added_resource.resource_id)
print(history)

import datetime

history = client.query_history(start_date=datetime.now(), change_type="Updated")
print(history)

Restoring a Deleted Resource

restored_resource = client.restore_deleted_resource(resource_id=added_resource.resource_id)
print(restored_resource)

Pushing a Resource to a Stack or Queue

from madsci.common.types.resource_types import Stack

stack = Stack(resource_name="Sample Stack")
added_stack = client.add_resource(stack)
pushed_resource = client.push(resource=added_stack, child=added_resource)
print(pushed_resource)

Popping a Resource from a Stack or Queue

popped_resource, updated_stack = client.pop(resource=added_stack)
print(popped_resource, updated_stack)

Setting a Child Resource in a Container

from madsci.common.types.resource_types import Grid

grid = Grid(resource_name="Sample Grid", row_dimension=8, column_dimension=12)
added_grid = client.add_resource(grid)
set_child_resource = client.set_child(resource=added_grid, key=(0, 0), child=added_resource)
print(set_child_resource)

Removing a Child Resource from a Container

removed_child_resource = client.remove_child(resource=added_grid, key=(0, 0))
print(removed_child_resource)

Setting the Quantity of a Consumable

from madsci.common.types.resource_types import Consumable

consumable = Consumable(resource_name="Sample Consumable", quantity=10)
added_consumable = client.add_resource(consumable)
updated_consumable = client.set_quantity(resource=added_consumable, quantity=20)
print(updated_consumable)

Changing the Quantity of a Consumable

changed_consumable = client.change_quantity_by(resource=added_consumable, amount=5)
print(changed_consumable)

Increasing the Quantity of a Consumable

increased_consumable = client.increase_quantity(resource=added_consumable, amount=5)
print(increased_consumable)

Decreasing the Quantity of a Consumable

decreased_consumable = client.decrease_quantity(resource=added_consumable, amount=5)
print(decreased_consumable)

Setting the Capacity of a Resource

updated_capacity_resource = client.set_capacity(resource=added_consumable, capacity=50)
print(updated_capacity_resource)

Removing the Capacity Limit of a Resource

removed_capacity_resource = client.remove_capacity_limit(resource=added_consumable)
print(removed_capacity_resource)

Emptying a Resource

emptied_resource = client.empty(resource=added_consumable)
print(emptied_resource)

Filling a Resource

filled_resource = client.fill(resource=added_consumable)
print(filled_resource)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

madsci_resource_manager-0.0.4.tar.gz (23.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

madsci_resource_manager-0.0.4-py3-none-any.whl (14.3 kB view details)

Uploaded Python 3

File details

Details for the file madsci_resource_manager-0.0.4.tar.gz.

File metadata

  • Download URL: madsci_resource_manager-0.0.4.tar.gz
  • Upload date:
  • Size: 23.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: pdm/2.22.3 CPython/3.9.21 Linux/6.8.0-1021-azure

File hashes

Hashes for madsci_resource_manager-0.0.4.tar.gz
Algorithm Hash digest
SHA256 78768e80492f91135afc96ce679e52a699cb7ffba0947884f0880a66d4a97b5e
MD5 73ab7a57ccf45eb19f2f274fd47ab1a0
BLAKE2b-256 e9b815a5253eaa89c8e2c69cfbf3097ac76171472d0ebddd9f37f4c7a03458a4

See more details on using hashes here.

File details

Details for the file madsci_resource_manager-0.0.4-py3-none-any.whl.

File metadata

File hashes

Hashes for madsci_resource_manager-0.0.4-py3-none-any.whl
Algorithm Hash digest
SHA256 089f91ed38c62b680b3f71f853da24cfacabd50fe842a4f5a5a70076e3934902
MD5 40a3ae4370cc543b34afa05c26d45b32
BLAKE2b-256 d332db4364a7366720845e4b1a3765cd4f01c7b63d315150400334981134dee3

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page