A package for generating LLM based agent trajectories for software engineering
Project description
SWE-smith is a toolkit for training software engineering (SWE) agents. With SWE-smith, you can:
- Create an unlimited number of SWE-bench style task instances (bug reports with solution validation) for any Python repository.
- Generate trajectories of SWE-agent (running on top of an LM like GPT-4o or Claude 3.7) solving those task instances.
- Train local LMs on these trajectories to improve their performance on software engineering tasks (resulting in models like SWE-agent-LM-32B)
🚀 Get Started
Check out the documentation for a complete guide on how to use SWE-smith, including
- How to install the repository locally or as a PyPI package.
- Create Task Instances for any Python repository with SWE-smith.
- Use your task instance to train your own SWE-agents
💿 Resources
In addition to this toolkit, we've also provided several artifacts on the SWE-bench HuggingFace, including:
- 50k Python Task Instances, created using SWE-smith.
- SWE-agent-LM-32B, trained using SWE-smith. Achieves 40.2% pass@1 on SWE-bench Verified!
- 5k Trajectories that SWE-agent-LM-32B was trained on.
And there's more coming!
💫 Contributions
Excited about SWE-smith? We're actively working on several follow ups, and love meaningful collaborations! What we're thinking about...
- Make SWE-smith work for non-Python languages
- New bug generation techniques
- Train SWE-agents with more
Contact Person: John Yang, Kilian Lieret, Carlos E. Jimenez (Email: johnby@stanford.edu)
🪪 License
MIT. Check LICENSE for more information.
✍️ Citation
@misc{yang2025swesmith,
title={SWE-smith: Scaling Data for Software Engineering Agents},
author={John Yang and Kilian Lieret and Carlos E. Jimenez and Alexander Wettig and Kabir Khandpur and Yanzhe Zhang and Binyuan Hui and Ofir Press and Ludwig Schmidt and Diyi Yang},
year={2025},
archivePrefix={arXiv},
primaryClass={cs.SE},
}
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file swesmith-0.0.0.tar.gz.
File metadata
- Download URL: swesmith-0.0.0.tar.gz
- Upload date:
- Size: 23.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.10.16
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
09496ab8d6b568463db9b58e1ed0b6985b81c87f13ac4c0ebca3104618357ab9
|
|
| MD5 |
7886513e36f3e72ff21707f7c0f9d060
|
|
| BLAKE2b-256 |
aac8170a5d575c5734f87a06503e28f98cfae90d9fa9bcdbb5edf8dadae3836d
|
File details
Details for the file swesmith-0.0.0-py3-none-any.whl.
File metadata
- Download URL: swesmith-0.0.0-py3-none-any.whl
- Upload date:
- Size: 22.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.10.16
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
fcb5c38f6943ae90ce9499addf9e2a44b11913659f8db6a3f72ba3a1d1fd4871
|
|
| MD5 |
fa99da65657fb817284b3b5b91359cfd
|
|
| BLAKE2b-256 |
6a3c18a8b30db4d8d7e19cfc12ce2ed045711097e902b264546657091ecc542e
|