Skip to main content

AI Maintainer Agent Harness for our benchmarking and Marketplace API and platform

Project description

coder_evals

https://img.shields.io/pypi/v/coder_evals.svg

AI Maintainer Coder-Evals for benchmarking your coding agent

Documentation: https://docs.ai-maintainer.com/

See our reference implementation with this harness here:

https://github.com/ai-maintainer-inc/aider

History

0.1.0 (2023-08-13)

  • First release on PyPI.

0.1.1 (2023-09-13)

  • Open source preparation

  • Fixing a variety of branding and packaging problems

0.1.3 (2023-09-18)

  • Fixes a bug that prevented benchmarking multiple agents

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

coder_evals-0.1.3.tar.gz (9.4 kB view details)

Uploaded Source

Built Distribution

coder_evals-0.1.3-py2.py3-none-any.whl (8.5 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file coder_evals-0.1.3.tar.gz.

File metadata

  • Download URL: coder_evals-0.1.3.tar.gz
  • Upload date:
  • Size: 9.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.11.5

File hashes

Hashes for coder_evals-0.1.3.tar.gz
Algorithm Hash digest
SHA256 32479d039245fb9eee6b295e49ab5ff7d2a73f58ec54eb7852572ba58dfa0293
MD5 98318c01a352ca7e0ac908c629fb5ea8
BLAKE2b-256 a86136c59a3ce2dccdb9ae31416036a8e3bb815c125b5bf07a4e54a1ed2e5b9f

See more details on using hashes here.

File details

Details for the file coder_evals-0.1.3-py2.py3-none-any.whl.

File metadata

File hashes

Hashes for coder_evals-0.1.3-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 f99ce402757fab4ddbbec35fe6269c9afea704c397d6976e82559058614f1323
MD5 5a2308a039cc74ebe93804fb97524f79
BLAKE2b-256 42af0ca6da659ec520d2974fe1d11f4912bce542c47e1e5c624454491d60f7e3

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page