Skip to main content

Extract and analyze git commit history with support for filtering by trailers, date ranges, and AI-powered summarization for changelogs

Project description

Release Notes Downloads GitHub CI Status License: MIT

Extract Git History in an LLM Friendly Way

A tool to extract and filter git commit history, making it easy to pipe to AI tools for changelog generation and summaries.

Features

  • Extract git commits with metadata (SHA, date, files, message)
  • Filter commits by time range or starting commit
  • Extract and filter git trailers (e.g., Co-authored-by, User-Facing)
  • Output in simple text or JSON format
  • Pipe output to AI tools (OpenAI, Gemini, Claude) for automated summarization

Installation

Using uv (Recommended)

No installation needed! The tool can be run directly:

uv run git-history-extraction --help

Install as Package

pip install git-history-extraction

Usage

Basic Examples

Extract commits from the last 24 hours (default):

git-history-extraction

Extract commits from the last 7 days:

git-history-extraction --since "7 days ago"

Extract commits from a specific repository:

git-history-extraction --repo /path/to/repo --since "1 week ago"

Output Formats

Simple text format (default):

git-history-extraction --since "1 day ago"

JSON format for piping to other tools:

git-history-extraction --since "1 day ago" --format json

TOON format (compact, LLM-optimized):

git-history-extraction --since "1 day ago" --format toon

Commit Range Selection

By time range:

git-history-extraction --since "2024-01-01"

From a specific commit to HEAD:

git-history-extraction --since-commit abc1234

Git Trailers

Extract specific trailers only (case-insensitive):

git-history-extraction --since "1 week ago" --trailers "co-authored-by,reviewed-by"

Piping to AI Tools for Summarization

This tool extracts and formats git history, making it easy to pipe to AI tools for summarization. The tool itself does not perform AI summarization—it prepares the data so you can use your preferred AI tool.

The tool enables you to extract targeted slices of git history for different audiences. For example, use git trailers like User-Facing: to mark end-user changes, then extract and pipe them to AI for changelogs or internal notifications.

Creating Structured Git Trailers with AI

Combine with aiautocommit to automatically generate git trailers during commits. This creates a structured history that can be easily filtered and summarized for different audiences.

Example custom commit prompt for aiautocommit:

# IMPORTANT: Your Instructions

You are an expert software developer. Generate a commit message from the `git diff` output below using these rules:

## 1. Subject Line

- Use a conventional commit prefix:
  - `feat`: New features
  - `fix`: Bug fixes, including user-visible design or style fixes.
  - `docs`: Changes only to internal documentation (e.g., `.md`, `.rst`) or code comments.
  - `style`: Formatting, linting, or code style changes in code files.
  - `refactor`: Code structure improvements (no behavior changes).
  - `build`: Updates to build scripts or configs (e.g., `Makefile`, `Justfile`, `Dockerfile`, `package.json`).
  - `deploy`: Deployment script or IAC updates.
  - `test`: Changes to tests
- Add optional scope in parentheses when changes affect a specific module (e.g., `feat(auth): add login`)
- Limit to 50 characters after the prefix and scope.
- Use imperative mood (e.g., "improve layout").
- Describe the intent or outcome (e.g., "prevent text overflow" not "add break-all").
- Be specific about the change ("validate email format" not "improve validation").

## 2. Extended Commit Message

- Include only if changes have non-obvious implications, fix complex bugs, or introduce breaking changes.
- Separate from subject with one blank line.
- Use markdown bullets focusing on **why** the change was needed and **what impact** it has.
- Mention side effects, user impact, or important trade-offs.

## 3. User-facing Changes

If the change is something that a end-user (not internal admin!) would see, include a `User-facing:` git trailer with a sentence
or two explaining, to the user, what they would see differently because of this change.

## 4. General Guidelines

- Prioritize the purpose of changes over listing tools or properties used.
- Keep concise; avoid obvious or verbose details.
- Always generate a message based on the diff, even with limited context.

## 5. Scopes

Optional scopes (e.g., `feat(api):`):

- `match`: frontend or backend changes tied
- `site`: content, additional pages, etc for the static site content
- `internal-admin`: internal admin changes (including CMS)

With this setup, commits automatically get User-facing: trailers. You can then extract and summarize them:

# Extract only user-facing changes from the last sprint
git-history-extraction --since "last monday" --trailers "User-facing" | \
  gemini -i "Create a user-friendly changelog from these changes"

Using with Gemini CLI

Extract user-facing changes and generate a non-technical summary:

git-history-extraction --repo . --since "last monday" \
  --trailers "User-Facing" | \
  gemini -i "This is a compressed git history identifying user-facing changes. \
Can you write a 1-2 sentence overview of the changes, with a list of bullets \
identifying changes. This is for a non-technical internal audience, letting \
them know what the development team has done. Separate into 'new' and 'fixed' \
sections. Include a 'Updates Since' with the date of the first commit in the \
history. Remove fluff, keep it concise and information dense."

Using the OpenAI Playground Script (Optional)

An optional playground script is included that demonstrates OpenAI integration:

# Generate summary with OpenAI
git-history-extraction --since "1 week ago" --format json | \
  uv run playground/summarize_commits.py

# Preview the prompt without calling OpenAI
git-history-extraction --since "1 week ago" --format json | \
  uv run playground/summarize_commits.py --dump-prompt

Requirements:

  • OPENAI_API_KEY environment variable
  • The script uses GPT-4o-mini by default

This is just an example—you can pipe to any AI tool you prefer. See playground/README.md for more details.

Output Format

Simple Format

Each commit is displayed with:

  • Commit: SHA hash
  • Date: ISO 8601 timestamp
  • Files: Comma-separated list of changed files
  • Message: Commit body with trailers removed

JSON Format

Array of commit objects:

[
  {
    "sha": "abc123...",
    "date": "2024-10-31T08:00:00-06:00",
    "body": "commit message with trailers",
    "files": ["file1.py", "file2.md"]
  }
]

TOON Format

TOON (Token-Oriented Object Notation) is a compact, human-readable format designed for LLM contexts. It achieves 30-60% fewer tokens than equivalent JSON while maintaining readability:

sha: abc123...
date: "2024-10-31T08:00:00-06:00"
body: "commit message with trailers"
files[2]: file1.py,file2.md

TOON format is particularly useful when piping git history to AI tools, as it reduces token usage and associated costs.

Options

Option Description Default
--since TEXT ISO date/time or relative time "24 hours ago"
--since-commit TEXT Start from specific commit (overrides --since) None
--since-last-tag Extract commits since the Nth most recent tag (Tag[N]..Tag[N-1]). 0 = LatestTag..HEAD False
--repo DIRECTORY Path to git repository . (current directory)
--trailers TEXT Comma-separated trailer keys to extract None (show all)
--format [simple|json|toon] Output format simple

How It Works

  • Uses git log with custom formatting for efficient single-pass extraction
  • Parses commit metadata, body, and file changes in one command
  • Intelligently extracts git trailers from commit messages
  • No per-commit subprocess calls for optimal performance

Limitations

  • Large commit ranges may generate significant output; consider narrowing the time range
  • This tool extracts and formats data only—AI summarization requires external tools
  • Git must be available in PATH

This project was created from iloveitaly/python-package-template

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

git_history_extraction-0.7.3.tar.gz (9.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

git_history_extraction-0.7.3-py3-none-any.whl (9.6 kB view details)

Uploaded Python 3

File details

Details for the file git_history_extraction-0.7.3.tar.gz.

File metadata

  • Download URL: git_history_extraction-0.7.3.tar.gz
  • Upload date:
  • Size: 9.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.10.10 {"installer":{"name":"uv","version":"0.10.10","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for git_history_extraction-0.7.3.tar.gz
Algorithm Hash digest
SHA256 5f037e4a2cf31d88266ab970790ebc5cb41c0c082f45fe4ae278d1eba86da9c2
MD5 1267899a83736c00ba007182950f7dc1
BLAKE2b-256 d436790223dbb83610653e0085482ddfd2985f145838649e7cd36db6317cf88a

See more details on using hashes here.

File details

Details for the file git_history_extraction-0.7.3-py3-none-any.whl.

File metadata

  • Download URL: git_history_extraction-0.7.3-py3-none-any.whl
  • Upload date:
  • Size: 9.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.10.10 {"installer":{"name":"uv","version":"0.10.10","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for git_history_extraction-0.7.3-py3-none-any.whl
Algorithm Hash digest
SHA256 db284167e4ebb34521c1ba8747d9e880fcd362de97f696ad41198451e841321a
MD5 62d203a7f5bfb7473e522b9198e58b37
BLAKE2b-256 5138572a1bd08b390bf2276b817823328b570f7c77d0054224d043e10bc1a258

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page