Skip to main content

Build an LLM agent, equipped with MCP, from scratch.

Project description

LLM Agents From Scratch

Linting Unit Testing and Upload Coverage codecov DOI GitHub License Ask DeepWiki Open In Studio

The companion library for Build a Multi-Agent System — With MCP and A2A (Manning). Learn how LLM agents work by building one yourself, from first principles, step by step.

Available now through Manning's Early Access Program (MEAP) — buy today and get each chapter as it's completed. Buy the Book →


About

Multi-agent systems and the LLM agents that power them are among the most discussed topics in AI today. There are already many capable frameworks out there — the goal of this book isn't to replace them, but to help you deeply understand how they work by having you build one yourself, from scratch.

All the code lives in the book's own hand-rolled agent framework, primarily designed for educational purposes rather than production deployment. It will give you the foundation to work more confidently with any other LLM agent framework of your choosing, or even to build your own specialised solutions.


From the Book

Each chapter builds on the last, progressively deepening your understanding from core concepts to full multi-agent systems.

Part 1 — Build Your First LLM Agent

Ch Title Notebook
1 What Are LLM Agents and Multi-Agent Systems?
2 Working with Tools Ch 2
3 Working with LLMs Ch 3
4 The LLM Agent Class Ch 4

Part 2 — Enhance Your LLM Agent

Ch Title Notebook
5 MCP Tools Ch 5
6 Skills Ch 6
7 Memory
8 Human in the Loop

Part 3 — Building Multi-Agent Systems

Ch Title Notebook
9 Multi-Agent Systems with Agent2Agent

Capstone Projects

Capstones are larger, end-to-end projects that pull together what you have built in the book and apply it to something closer to a real-world system.

Capstone Description Notebook
Monte Carlo Estimation of Pi Orchestrate parallel tool calls to estimate π using the Monte Carlo method. Open
Deep Research Agent Coming soon.
OpenClaw Personal Assistant Coming soon.

Running the Notebooks

The chapter notebooks use Qwen3:14B as the default model via Ollama. Minimum hardware: ~16 GB RAM with a discrete GPU, or any machine with a dedicated GPU that can comfortably run a 14B model. You can swap in a smaller model (e.g. qwen3:4b), but note that smaller models may not follow tool-use instructions reliably — especially in later chapters.

Option A — Run locally

Install Ollama and pull the model:

ollama pull qwen3:14b

Then launch Jupyter from the project root:

uv run --with jupyter jupyter lab

Option B — Lightning AI (recommended if you don't have a GPU)

Lightning AI offers a free tier with ~22 GPU compute hours/month — enough for several sessions on an L4 GPU.

  1. Create a free Lightning AI account if you don't have one
  2. Visit the book template: lightning.ai/nerdai/templates/build-a-multi-agent-system-from-scratch
  3. Click Clone to copy it to your account
  4. Make sure you have the latest version of the template
  5. Launch the Studio with an L4 GPU
  6. Open the chapter notebook you want to run and execute the cells — Ollama and the required model are already set up in the template

Getting Started

Prerequisites

  • Python 3.10+
  • Ollama running locally (used as the default LLM backend)
  • uv for dependency management

Installation

Clone the repository:

# SSH
git clone git@github.com:nerdai/llm-agents-from-scratch.git

# HTTPS
git clone https://github.com/nerdai/llm-agents-from-scratch.git

cd llm-agents-from-scratch

Install dependencies:

uv sync --all-extras --dev

Quick Start

from llm_agents_from_scratch.llms import OllamaLLM
from llm_agents_from_scratch.agent import LLMAgentBuilder
from llm_agents_from_scratch.tools import SimpleFunctionTool

def add(a: int, b: int) -> int:
    return a + b

llm = OllamaLLM(model="llama3.2")
tool = SimpleFunctionTool(fn=add)

agent = (
    LLMAgentBuilder()
    .with_llm(llm)
    .with_tools([tool])
    .build()
)

result = await agent.run("What is 3 + 5?")
print(result)

Development

# Run all tests
make test

# Lint and format
make lint
make format

# Coverage report
make coverage-report

See CLAUDE.md for full development guidance.


Contributing

Bug reports, feature requests, and community project submissions are welcome. See CONTRIBUTING.md for details.


License

Apache 2.0 — see LICENSE for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

llm_agents_from_scratch-0.0.18.tar.gz (1.7 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

llm_agents_from_scratch-0.0.18-py3-none-any.whl (70.0 kB view details)

Uploaded Python 3

File details

Details for the file llm_agents_from_scratch-0.0.18.tar.gz.

File metadata

File hashes

Hashes for llm_agents_from_scratch-0.0.18.tar.gz
Algorithm Hash digest
SHA256 950eb9b7c87e089bd934c76a0b3ac475e6fa5b50f8ed7dc8f10658ba232c283e
MD5 db7f1f035c4a4aee58f00c7d0c4cd3c9
BLAKE2b-256 14e648fd6d25316bcd5c4a6c7317a6d4629e0020b2a64206535adfc8b2211607

See more details on using hashes here.

File details

Details for the file llm_agents_from_scratch-0.0.18-py3-none-any.whl.

File metadata

File hashes

Hashes for llm_agents_from_scratch-0.0.18-py3-none-any.whl
Algorithm Hash digest
SHA256 924bf265b196c8fb0fa6cf24786d309e6ffbfe90adad05adc7ed69e50aa95216
MD5 e10059667024e10e5b86ccac764e9f21
BLAKE2b-256 89909fd48f0d51e53055031ecdeaf6eea859a725b915470003f6dfe2a4874133

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page