Auto-GPT Benchmark

A repo built for the purpose of benchmarking the performance of agents far and wide, regardless of how they are set up and how they work

Scores:

Radio chart for each agent coming soon !

:warning: These results are constantly evolving at the moment. We will publish an official benchmark result very soon.

Interface

Task	Auto-GPT	gpt-engineer	mini-agi	smol-developer
Write File	:x:	:white_check_mark:	tbd	:white_check_mark:
Read File	:x:	:x:	tbd	:x:
Search File	:x:	:x:	tbd	:x:

Code

Task	Auto-GPT	gpt-engineer	mini-agi	smol-developer
Debug Simple Typo With Guidance	:x:	:x:	tbd	:x:
Debug Simple Typo Without Guidance	:x:	:x:	tbd	:x:
Basic Code Generation	:x:	:white_check_mark:	tbd	:white_check_mark:
Create Simple Web Server	:x:	:x:	tbd	:x:

Memory

Task	Auto-GPT
Basic Memory	:x:
Remember Multiple Ids	:x:
Remember Multiple Ids With Noise	:x:
Remember Multiple Phrases With Noise	:x:

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

agbenchmark-0.0.2.tar.gz (31.2 kB view details)

Uploaded Jul 24, 2023 Source

If you're not sure about the file name format, learn more about wheel file names.

The dropdown lists show the available interpreters, ABIs, and platforms. Enable javascript to be able to filter the list of wheel files.

Uploaded Jul 24, 2023 Python 3

Details for the file agbenchmark-0.0.2.tar.gz.

Hashes for agbenchmark-0.0.2.tar.gz
Algorithm	Hash digest
SHA256	`da9291db298ff0ebdd18b818545e84c932d724c3c5c9010b363cc496ceb5e7df`
MD5	`e0ea98cddcc75971a7caeb3a6c89a654`
BLAKE2b-256	`d6a59417ee6454a4eeb27abe301a01c22ea12763fd2764c3146d4d682c291b10`

Details for the file agbenchmark-0.0.2-py3-none-any.whl.

Hashes for agbenchmark-0.0.2-py3-none-any.whl
Algorithm	Hash digest
SHA256	`87959e1e364d77fe325b1f3967232c1cac1f71c909b0af60578fe8a2445dd76f`
MD5	`4ace191a32846db0b909c4bc8928eb48`
BLAKE2b-256	`3c8d6e1e38aaa1a14eba74bf4c7b9c174f0ca9a7203b08c428c1a47b42bd4bd3`

0.0.10

Sep 17, 2023

0.0.9 yanked

Aug 17, 2023