SAGE Agentic Tool Use Benchmark
Configuration-driven experiment framework for evaluating tool selection and use capabilities.
Features
- Tool Selection Evaluation: Tool retrieval and ranking benchmarks
- Planning Evaluation: Multi-step planning with tool composition
- Timing Detection: Timing judgment for tool invocation decisions
Quick Start
# Install
pip install isage-agentic-tooluse-benchmark
# Run tool selection experiment
sage-agentic-tooluse-bench tool-selection --config config/tool_selection_exp.yaml
# Run planning experiment
sage-agentic-tooluse-bench planning --config config/planning_exp.yaml
Documentation
See benchmark_agent/README.md for detailed documentation.
Development
# Clone
git clone https://github.com/intellistream/sage-agentic-tooluse-benchmark.git
cd sage-agentic-tooluse-benchmark
# Setup virtual environment
python -m venv .venv
source .venv/bin/activate # On Windows: .venv\Scripts\activate
# Install in development mode
pip install -e ".[dev]"
# Run tests
pytest
License
MIT License - see LICENSE for details.
Metadata
Release files for isage-agentic-tooluse-benchmark 0.1.7
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| isage_agentic_tooluse_benchmark-0.1.7.tar.gz | 124.7 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| isage_agentic_tooluse_benchmark-0.1.7-py2.py3-none-any.whl | Python 3, Python 2 | none | any | Details |
Total release size: 269.1 kB
Release files / isage_agentic_tooluse_benchmark-0.1.7.tar.gz
| Download URL | isage_agentic_tooluse_benchmark-0.1.7.tar.gz |
|---|---|
| Size | 124.7 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
64d98becc419e196c57a4d889bbcbce1bc396f1d9589a77b510e549d2e13d0dc
|
|
BLAKE2b-256 checksum How to use checksums |
5a562ed38f2eb1e02e80a09606f52661b05f862a11c67efc726838983bb528f1
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.11.14
|
Release files / isage_agentic_tooluse_benchmark-0.1.7-py2.py3-none-any.whl
| Download URL | isage_agentic_tooluse_benchmark-0.1.7-py2.py3-none-any.whl |
|---|---|
| Size | 144.4 kB |
| Tags | Python 2 Python 3 |
|
SHA-256 checksum How to use checksums |
f2d6cf6878cf64e1b0316f427dd3141f30becf1bcc716f31a7b4e6f5331e230f
|
|
BLAKE2b-256 checksum How to use checksums |
9e2265ed3f8cb6cfa3fddefa2af04c044ad2b17a090986a666adbe19823dcec0
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.11.14
|
