Skip to main content

Build an LLM agent, equipped with MCP, from scratch.

Project description

LLM Agents From Scratch

Linting Unit Testing and Upload Coverage codecov DOI GitHub License Ask DeepWiki Open In Studio

The companion library for Build a Multi-Agent System — With MCP and A2A (Manning). Learn how LLM agents work by building one yourself, from first principles, step by step.

Available now through Manning's Early Access Program (MEAP) — buy today and get each chapter as it's completed. Buy the Book →


About

Multi-agent systems and the LLM agents that power them are among the most discussed topics in AI today. There are already many capable frameworks out there — the goal of this book isn't to replace them, but to help you deeply understand how they work by having you build one yourself, from scratch.

All the code lives in the book's own hand-rolled agent framework, primarily designed for educational purposes rather than production deployment. It will give you the foundation to work more confidently with any other LLM agent framework of your choosing, or even to build your own specialised solutions.


From the Book

Each chapter builds on the last, progressively deepening your understanding from core concepts to full multi-agent systems.

Part 1 — Build Your First LLM Agent

Ch Title Notebook
1 What Are LLM Agents and Multi-Agent Systems?
2 Working with Tools Ch 2
3 Working with LLMs Ch 3
4 The LLM Agent Class Ch 4

Part 2 — Enhance Your LLM Agent

Ch Title Notebook
5 MCP Tools Ch 5
6 Skills Ch 6
7 Memory Ch 7
8 Human in the Loop Ch 8

Part 3 — Building Multi-Agent Systems

Ch Title Notebook
9 Multi-Agent Systems with Agent2Agent

Capstone Projects

Capstones are larger, end-to-end projects that pull together what you have built in the book and apply it to something closer to a real-world system.

Capstone Description Notebook
Monte Carlo Estimation of Pi Orchestrate parallel tool calls to estimate π using the Monte Carlo method. Open
Deep Research Agent Coming soon.
OpenClaw Personal Assistant Coming soon.

Running the Notebooks

The chapter notebooks use Qwen3:14B as the default model via Ollama. Minimum hardware: ~16 GB RAM with a discrete GPU, or any machine with a dedicated GPU that can comfortably run a 14B model. You can swap in a smaller model (e.g. qwen3:4b), but note that smaller models may not follow tool-use instructions reliably — especially in later chapters.

Option A — Run locally

Install Ollama and pull the model:

ollama pull qwen3:14b

Then launch Jupyter from the project root:

uv run --with jupyter jupyter lab

Option B — Lightning AI (recommended if you don't have a GPU)

Lightning AI offers a free tier with ~22 GPU compute hours/month — enough for several sessions on an L4 GPU.

  1. Create a free Lightning AI account if you don't have one
  2. Visit the book template: lightning.ai/nerdai/templates/build-a-multi-agent-system-from-scratch
  3. Click Clone to copy it to your account
  4. Make sure you have the latest version of the template
  5. Launch the Studio with an L4 GPU
  6. Open the chapter notebook you want to run and execute the cells — Ollama and the required model are already set up in the template

Getting Started

Prerequisites

  • Python 3.10+
  • Ollama running locally (used as the default LLM backend)
  • uv for dependency management

Installation

Clone the repository:

# SSH
git clone git@github.com:nerdai/llm-agents-from-scratch.git

# HTTPS
git clone https://github.com/nerdai/llm-agents-from-scratch.git

cd llm-agents-from-scratch

Install dependencies:

uv sync --all-extras --dev

Quick Start

from llm_agents_from_scratch.llms import OllamaLLM
from llm_agents_from_scratch.agent import LLMAgentBuilder
from llm_agents_from_scratch.tools import SimpleFunctionTool

def add(a: int, b: int) -> int:
    return a + b

llm = OllamaLLM(model="llama3.2")
tool = SimpleFunctionTool(fn=add)

agent = (
    LLMAgentBuilder()
    .with_llm(llm)
    .with_tools([tool])
    .build()
)

result = await agent.run("What is 3 + 5?")
print(result)

Development

# Run all tests
make test

# Lint and format
make lint
make format

# Coverage report
make coverage-report

See CLAUDE.md for full development guidance.


Contributing

Bug reports, feature requests, and community project submissions are welcome. See CONTRIBUTING.md for details.


License

Apache 2.0 — see LICENSE for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

llm_agents_from_scratch-0.0.21.tar.gz (1.8 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

llm_agents_from_scratch-0.0.21-py3-none-any.whl (77.2 kB view details)

Uploaded Python 3

File details

Details for the file llm_agents_from_scratch-0.0.21.tar.gz.

File metadata

  • Download URL: llm_agents_from_scratch-0.0.21.tar.gz
  • Upload date:
  • Size: 1.8 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.14

File hashes

Hashes for llm_agents_from_scratch-0.0.21.tar.gz
Algorithm Hash digest
SHA256 5da91debc6ef28556defc53a25ef5bdc562f3be96f882f642bcf04fb191439a9
MD5 27674e63034cb7dbe9c846adc0691612
BLAKE2b-256 358f1007803c39fc7b64c95d3f424f1f65eff19af5552f7263dad5f5d2a23440

See more details on using hashes here.

File details

Details for the file llm_agents_from_scratch-0.0.21-py3-none-any.whl.

File metadata

File hashes

Hashes for llm_agents_from_scratch-0.0.21-py3-none-any.whl
Algorithm Hash digest
SHA256 759886fe724eb80926b796b10540d6cf70e1a4bf3431cd9507f4efc222b24e22
MD5 2803ed87eaabbb5bdded4275ae382b4b
BLAKE2b-256 0bcc36edf87c85abb168678e848e9ade4c187352e10f5a777fae32efd5f6c315

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page