Skip to main content

The Modular Autonomous Discovery for Science (MADSci) Event and Logging Manager.

Project description

MADSci Event Manager

Handles distributed logging and events throughout a MADSci-powered Lab.

MADSci Event Manager Architecture Diagram

Notable Features

  • Collects logs from distributed components of the lab and centralizes them
  • Allows for querying of events
  • Can accept arbitrary event data
  • Enforces a standard Event schema, allowing for structured querying and filtering of logs.
  • Supports python logging-style log levels.

Installation

The MADSci event manager is available via the Python Package Index, and can be installed via:

pip install madsci.event_manager

This python package is also included as part of the madsci Docker image. You can see an example docker image in this example compose file.

Note that you will also need a MongoDB database (included in the example compose file)

Usage

Manager

To create and run a new MADSci Event Manager, do the following in your MADSci lab directory:

  • If you're not using docker compose, provision and configure a MongoDB instance.
  • If you're using docker compose, define your event manager and mongodb services based on the example compose file.
# Create an Event Manager Definition
madsci manager add -t event_manager
# Start the database and Event Manager Server
docker compose up
# OR
python -m madsci.event_manager.event_server

You should see a REST server started on the configured host and port. Navigate in your browser to the URL you configured (default: http://localhost:8001/) to see if it's working.

You can see up-to-date documentation on the endpoints provided by your event manager, and try them out, via the OpenAPI docs served by your manager at the event server's /docs page.

Client

You can use MADSci's EventClient (madsci.client.event_client.EventClient) in your python code to log new events to the event manager, or fetch/query existing events.

from madsci.client.event_client import EventClient
from madsci.common.types.event_types import Event, EventLogLevel, EventType

event_client = EventClient(
    event_server="https://127.0.0.1:8001", # Update with the host/port you configured for your EventManager server
)

event_client.log_info("This logs a simple string at the INFO level, with event_type LOG_INFO")
event = Event(
    event_type="NODE_CREATE",
    log_level=EventLogLevel.DEBUG,
    event_data="This logs a NODE_CREATE event at the DEBUG level. The event_data field should contain relevant data about the event (in this case, something like the NodeDefinition, for instance)"
)
event_client.log(event)
event_client.log_warning(event) # Log the same event, but override the log level.

# Get the 50 most recent events
event_client.get_events(number=50)
# Get all events from a specific node
event_client.query_events({"source": {"node_id": "01JJ4S0WNGEF5FQAZG5KDGJRBV"}})

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

madsci_event_manager-0.2.1.tar.gz (4.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

madsci_event_manager-0.2.1-py3-none-any.whl (3.8 kB view details)

Uploaded Python 3

File details

Details for the file madsci_event_manager-0.2.1.tar.gz.

File metadata

  • Download URL: madsci_event_manager-0.2.1.tar.gz
  • Upload date:
  • Size: 4.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: pdm/2.24.1 CPython/3.9.22 Linux/6.11.0-1012-azure

File hashes

Hashes for madsci_event_manager-0.2.1.tar.gz
Algorithm Hash digest
SHA256 072230ebcf79055679f26c9febdb3a0c9223b59218a53e655c28767ec87c973f
MD5 2ded4907b6d455b13ebb22dc234735ff
BLAKE2b-256 f68bf252b47bb5d6dde6728f060582148891be9599a5fa165ede0c3999906c80

See more details on using hashes here.

File details

Details for the file madsci_event_manager-0.2.1-py3-none-any.whl.

File metadata

  • Download URL: madsci_event_manager-0.2.1-py3-none-any.whl
  • Upload date:
  • Size: 3.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: pdm/2.24.1 CPython/3.9.22 Linux/6.11.0-1012-azure

File hashes

Hashes for madsci_event_manager-0.2.1-py3-none-any.whl
Algorithm Hash digest
SHA256 c25b996346733c53bc5eb857bf5f90bab8a624faa771606e63a283f89ae5b7dc
MD5 d05902c82ea3777efcaede2179ea2327
BLAKE2b-256 da5147fa648469003000c6dd0569be8cbe5d611046d62cfc3f93b5b5570ee94a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page