Skip to main content

Build an LLM agent, equipped with MCP, from scratch.

Project description

LLM Agents From Scratch

Linting Unit Testing and Upload Coverage codecov DOI GitHub License Ask DeepWiki Open In Studio

The companion library for Build a Multi-Agent System — With MCP and A2A (Manning). Learn how LLM agents work by building one yourself, from first principles, step by step.

Available now through Manning's Early Access Program (MEAP) — buy today and get each chapter as it's completed. Buy the Book →


About

Multi-agent systems and the LLM agents that power them are among the most discussed topics in AI today. There are already many capable frameworks out there — the goal of this book isn't to replace them, but to help you deeply understand how they work by having you build one yourself, from scratch.

All the code lives in the book's own hand-rolled agent framework, primarily designed for educational purposes rather than production deployment. It will give you the foundation to work more confidently with any other LLM agent framework of your choosing, or even to build your own specialised solutions.


From the Book

Each chapter builds on the last, progressively deepening your understanding from core concepts to full multi-agent systems.

Part 1 — Build Your First LLM Agent

Ch Title Notebook
1 What Are LLM Agents and Multi-Agent Systems?
2 Working with Tools Ch 2
3 Working with LLMs Ch 3
4 The LLM Agent Class Ch 4

Part 2 — Enhance Your LLM Agent

Ch Title Notebook
5 MCP Tools Ch 5
6 Skills Ch 6
7 Memory
8 Human in the Loop

Part 3 — Building Multi-Agent Systems

Ch Title Notebook
9 Multi-Agent Systems with Agent2Agent

Capstone Projects

Capstones are larger, end-to-end projects that pull together what you have built in the book and apply it to something closer to a real-world system.

Capstone Description Notebook
Monte Carlo Estimation of Pi Orchestrate parallel tool calls to estimate π using the Monte Carlo method. Open
Deep Research Agent Coming soon.
OpenClaw Personal Assistant Coming soon.

Running the Notebooks

The chapter notebooks use Qwen3:14B as the default model via Ollama. Minimum hardware: ~16 GB RAM with a discrete GPU, or any machine with a dedicated GPU that can comfortably run a 14B model. You can swap in a smaller model (e.g. qwen3:4b), but note that smaller models may not follow tool-use instructions reliably — especially in later chapters.

Option A — Run locally

Install Ollama and pull the model:

ollama pull qwen3:14b

Then launch Jupyter from the project root:

uv run --with jupyter jupyter lab

Option B — Lightning AI (recommended if you don't have a GPU)

Lightning AI offers a free tier with ~22 GPU compute hours/month — enough for several sessions on an L4 GPU.

  1. Create a free Lightning AI account if you don't have one
  2. Visit the book template: lightning.ai/nerdai/templates/build-a-multi-agent-system-from-scratch
  3. Click Clone to copy it to your account
  4. Make sure you have the latest version of the template
  5. Launch the Studio with an L4 GPU
  6. Open the chapter notebook you want to run and execute the cells — Ollama and the required model are already set up in the template

Getting Started

Prerequisites

  • Python 3.10+
  • Ollama running locally (used as the default LLM backend)
  • uv for dependency management

Installation

Clone the repository:

# SSH
git clone git@github.com:nerdai/llm-agents-from-scratch.git

# HTTPS
git clone https://github.com/nerdai/llm-agents-from-scratch.git

cd llm-agents-from-scratch

Install dependencies:

uv sync --all-extras --dev

Quick Start

from llm_agents_from_scratch.llms import OllamaLLM
from llm_agents_from_scratch.agent import LLMAgentBuilder
from llm_agents_from_scratch.tools import SimpleFunctionTool

def add(a: int, b: int) -> int:
    return a + b

llm = OllamaLLM(model="llama3.2")
tool = SimpleFunctionTool(fn=add)

agent = (
    LLMAgentBuilder()
    .with_llm(llm)
    .with_tools([tool])
    .build()
)

result = await agent.run("What is 3 + 5?")
print(result)

Development

# Run all tests
make test

# Lint and format
make lint
make format

# Coverage report
make coverage-report

See CLAUDE.md for full development guidance.


Contributing

Bug reports, feature requests, and community project submissions are welcome. See CONTRIBUTING.md for details.


License

Apache 2.0 — see LICENSE for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

llm_agents_from_scratch-0.0.17.tar.gz (1.7 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

llm_agents_from_scratch-0.0.17-py3-none-any.whl (68.6 kB view details)

Uploaded Python 3

File details

Details for the file llm_agents_from_scratch-0.0.17.tar.gz.

File metadata

  • Download URL: llm_agents_from_scratch-0.0.17.tar.gz
  • Upload date:
  • Size: 1.7 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.13

File hashes

Hashes for llm_agents_from_scratch-0.0.17.tar.gz
Algorithm Hash digest
SHA256 f28d5e3cf73da41b695efb10ec52b73f265b1da64e36edb2b123f8655fe97c79
MD5 599f877b19cca64dca5809be061b0edc
BLAKE2b-256 f659484e63ae5d1fab66290bb34b92300d6d80e2c5a11c32e5bd6e0f46ffd5d3

See more details on using hashes here.

File details

Details for the file llm_agents_from_scratch-0.0.17-py3-none-any.whl.

File metadata

File hashes

Hashes for llm_agents_from_scratch-0.0.17-py3-none-any.whl
Algorithm Hash digest
SHA256 0ede72b8cb835502df0dd9d62de1de5e64e59039f8b3d26d59f00c8bcfeb21dc
MD5 e5f1e812df54a43f67baebc2735a2855
BLAKE2b-256 d45074ea2b74facb2353cb9516fcad2acccd427746037d5430fd1a92badc9d59

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page