Skip to main content

Developer-focused logging library for Python with OpenSearch integration.

Project description

devlogs

A developer-focused logging library for Python based on OpenSearch.

Step 1: Get OpenSearch running

If you don't have OpenSearch running and you want to stand one up:

  1. Install Docker (and Docker Compose) for your OS.
  2. Copy docker-compose.example.yaml to docker-compose.yaml.
  3. Change the OpenSearch password in the copied file.
  4. Start OpenSearch:
    docker compose up -d
    

Step 2: Copy/paste these instructions into your coding agent

Please do the following in this project:

  1. Install devlogs as a dev dependency (pip install devlogs or add it to requirements-dev.txt/pyproject.toml optional dependencies).
  2. Add DEVLOGS_OPENSEARCH_HOST, DEVLOGS_OPENSEARCH_PORT, DEVLOGS_OPENSEARCH_USER, DEVLOGS_OPENSEARCH_PASS, and DEVLOGS_INDEX to the project .env file (or equivalent config). Defaults are localhost, 9200, admin, and devlogs-<projectname>.
  3. Add devlogs hooks at the beginning of the application (main entrypoint/startup module), wrapped in an environment check so it only runs in development:
    import os
    if os.getenv("ENVIRONMENT") != "production":
        from devlogs.handler import OpenSearchHandler
        handler = OpenSearchHandler(level=logging.INFO)
        logging.getLogger().addHandler(handler)
        logging.getLogger().setLevel(logging.INFO)
    
  4. Run devlogs init (inside the virtualenv if one is set up) and verify the index is healthy.
  5. Ask the user if they want MCP set up; if yes, state which agent you are (copilot, claude, or codex) and run devlogs initmcp <agent>.

Step 3: Use devlogs

  1. Run devlogs initmcp <agent> to set up the MCP server.
  2. Then run devlogs tail to see the last logs, or devlogs tail -f to follow along
  3. Finally, ask your agent to query devlogs for errors. Watch it solve problems on its own!

If you want to install it by hand

  1. Install devlogs:

    pip install devlogs
    
  2. Start OpenSearch:

    docker-compose up -d opensearch
    

    Or point DEVLOGS_OPENSEARCH_* at an existing cluster.

  3. Initialize indices/templates:

    devlogs init
    
  4. Use in Python code (development only):

    import os
    import logging
    
    # Only enable devlogs in development
    if os.getenv("ENVIRONMENT") != "production":
        from devlogs.handler import OpenSearchHandler
        logging.getLogger().addHandler(OpenSearchHandler(level=logging.DEBUG))
    
    logging.getLogger().setLevel(logging.DEBUG)
    logging.info("Hello from devlogs!")
    
  5. Tail logs from CLI:

    devlogs tail --area web --follow
    
  6. Search logs from CLI:

    devlogs search --q "error" --area web
    
  7. Run the web UI:

    uvicorn devlogs.web.server:app --port 8088
    # Then open http://localhost:8088/ui/
    

MCP Agent Setup

If you want MCP set up, identify your agent type and run the matching command from your project root:

devlogs initmcp copilot
devlogs initmcp claude
devlogs initmcp codex
devlogs initmcp all

This writes MCP config files in the standard locations:

  • Claude: .mcp.json
  • Copilot (VS Code): .vscode/mcp.json
  • Codex: ~/.codex/config.toml

Features

  • Standard logging.Handler for OpenSearch
  • Context manager for operation_id/area
  • Structured feature pairs on log entries (extra={"features": {...}})
  • CLI and Linux shell wrapper
  • Minimal embeddable web UI
  • Robust tests (pytest)

Jenkins Integration

Stream Jenkins build logs to OpenSearch using a standalone binary:

pipeline {
    agent any
    environment {
        DEVLOGS_OPENSEARCH_URL = credentials('devlogs-opensearch-url')
        DEVLOGS_BINARY_URL = credentials('devlogs-binary-url')
    }
    stages {
        stage('Build') {
            steps {
                sh 'curl -sL $DEVLOGS_BINARY_URL -o /tmp/devlogs && chmod +x /tmp/devlogs'
                sh '/tmp/devlogs jenkins attach --background'
                sh 'make build'
            }
        }
    }
    post {
        always { sh '/tmp/devlogs jenkins stop || true' }
    }
}

Build the binary with ./build-standalone.sh and host it somewhere accessible. See HOWTO-JENKINS.md for setup details.

Configuration

Environment Variables

  • OpenSearch connection: DEVLOGS_OPENSEARCH_HOST, DEVLOGS_OPENSEARCH_PORT, DEVLOGS_OPENSEARCH_USER, DEVLOGS_OPENSEARCH_PASS
  • OpenSearch URL shortcut: DEVLOGS_OPENSEARCH_URL (e.g., https://user:pass@host:9200/index)
  • SSL/TLS: DEVLOGS_OPENSEARCH_VERIFY_CERTS, DEVLOGS_OPENSEARCH_CA_CERT
  • Index: DEVLOGS_INDEX
  • Retention (supports duration strings like 24h, 7d): DEVLOGS_RETENTION_DEBUG, DEVLOGS_RETENTION_INFO, DEVLOGS_RETENTION_WARNING

See .env.example for a complete configuration template.

CLI Options

Use --url to specify connection details without a .env file:

devlogs --url 'https://admin:pass@host:9200/myindex' tail

Use --env to load from a specific .env file:

devlogs --env /path/to/.env diagnose

URL Builder

Use devlogs mkurl to interactively create a properly URL-encoded connection string:

devlogs mkurl
# Outputs the URL in three formats:
# 1. Bare URL (for --url flag)
# 2. Single DEVLOGS_OPENSEARCH_URL variable
# 3. Individual .env variables

This is especially useful for passwords containing special characters like !, @, #, which must be URL-encoded.

See HOWTO-CLI.md for complete CLI reference.

Production Deployment

Devlogs is a development tool. The examples above show how to conditionally enable it using an environment check. You can also make it an optional dependency:

# pyproject.toml
[project.optional-dependencies]
dev = ["devlogs>=1.1.0"]

Install with pip install ".[dev]" in development, pip install . in production.

Project Structure

  • src/devlogs/ - Python library, CLI, MCP server, and web UI
  • browser/ - Browser/npm package for frontend logging
  • devlogs - Shell wrapper for local development
  • tests/ - Pytest-based tests
  • dist/ - Built packages and standalone binary

Publishing

# Release to all platforms (PyPI, npm, GitHub)
./publish/release.sh

# Bump version and release
./publish/release.sh --bump-patch

# Preview release
./publish/release.sh --dry-run

See publish/RELEASING.md for detailed publishing instructions.

See Also

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

devlogs-1.1.3.tar.gz (74.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

devlogs-1.1.3-py3-none-any.whl (55.1 kB view details)

Uploaded Python 3

File details

Details for the file devlogs-1.1.3.tar.gz.

File metadata

  • Download URL: devlogs-1.1.3.tar.gz
  • Upload date:
  • Size: 74.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for devlogs-1.1.3.tar.gz
Algorithm Hash digest
SHA256 b05a91475a9afbc21b782ba833a315cf57f1d088fdeb1dfbbdacf308ac840746
MD5 24ef1552f79697e03ff6951851a58114
BLAKE2b-256 38d79a1868114e32f9632dde9863da6161bf25f003a5ba8307df93a3d171156a

See more details on using hashes here.

File details

Details for the file devlogs-1.1.3-py3-none-any.whl.

File metadata

  • Download URL: devlogs-1.1.3-py3-none-any.whl
  • Upload date:
  • Size: 55.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for devlogs-1.1.3-py3-none-any.whl
Algorithm Hash digest
SHA256 cf138d18f9e39ee7b5f4ef1f80b1902942ea2d5375f6220acd276cee66ad3783
MD5 a027b68db2eb4b1d31f1ef8faade8b94
BLAKE2b-256 b9f0958baa7c23323b6e513c26eee9bda77a5fca00cd648e175a8f9fb2a6cb72

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page