Skip to main content

CLI extension for AEA framework benchmarking.

Project description

AEA CLI Benchmark Plug-in

CLI extension for benchmarking the AEA framework. Adds an aea benchmark command group that runs performance benchmark cases covering agent construction, message throughput, memory usage, decision maker, ACN, and related scenarios.

Installation and usage

Make sure you have aea installed.

Then, install the plug-in:

pip install open-aea-cli-benchmark

The tx-generate case spins up a dockerised fetchai ledger node and is therefore an optional extra. Install it with:

pip install "open-aea-cli-benchmark[tx-generate]"

Without the [tx-generate] extra the tx-generate command is not registered and the rest of the benchmark commands work as normal.

Now you should be able to run aea benchmark:

Usage: aea benchmark [OPTIONS] COMMAND [ARGS]...

  Run one of the performance benchmarks.

Options:
  --help  Show this message and exit.

Commands:
  acn-communication             ACN end-to-end message throughput
  acn-startup                   ACN node startup time
  agent-construction-time       Time to construct an AEA instance
  decision-maker                Decision maker throughput
  dialogues-memory-usage        Memory footprint of dialogue state
  mem-usage                     Agent memory usage under load
  messages-memory-usage         Memory footprint of messages
  multiagent                    Multi-agent throughput
  multiagent-http-dialogues     Multi-agent HTTP dialogue throughput
  proactive                     Proactive skill behaviour benchmark
  reactive                      Reactive skill handler benchmark
  tx-generate                   Transaction generation throughput (requires the [tx-generate] extra)

Run any command with --help for per-case options.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

open_aea_cli_benchmark-2.2.1.tar.gz (37.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

open_aea_cli_benchmark-2.2.1-py3-none-any.whl (74.6 kB view details)

Uploaded Python 3

File details

Details for the file open_aea_cli_benchmark-2.2.1.tar.gz.

File metadata

  • Download URL: open_aea_cli_benchmark-2.2.1.tar.gz
  • Upload date:
  • Size: 37.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for open_aea_cli_benchmark-2.2.1.tar.gz
Algorithm Hash digest
SHA256 8bb869eca623cac6abd03079cabc32c597a03a166195b74af8785e457c13c208
MD5 cbc7cc9fb0aa8caa45d6bd3db8a9aa43
BLAKE2b-256 a6bd7c81fe5066d4213b1550da4ee42e014822849d92c8ab657a853a959491c3

See more details on using hashes here.

File details

Details for the file open_aea_cli_benchmark-2.2.1-py3-none-any.whl.

File metadata

File hashes

Hashes for open_aea_cli_benchmark-2.2.1-py3-none-any.whl
Algorithm Hash digest
SHA256 273c34e0abeff4eceac4f090943d850fe1ae945e08ec50460b262fb18f9be2ff
MD5 7083125d959ae263890b5578b4ed0fad
BLAKE2b-256 afb97b9981a47b9986afcb4c88d4acc0d0a82a1501a4ccde14e210a65fae0f54

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page