webcap 0.1.10

No project description provided

WebCap is an extremely lightweight headless browser tool capable of web screenshots and more. It doesn't require Selenium, Playwright, Puppeteer, or any other browser automation framework; all it needs is a working Chrome installation.

pipx install webcap

WebCap's most unique feature is its ability to capture not only the fully-rendered DOM, but also every snippet of parsed Javascript (regardless of inline or external), and the full response body of every HTTP request. For convenience, it outputs directly to JSON:

Fully-rendered DOM

Javascript Capture

Requests + Responses

All features:

• Blazing fast screenshots
• JSON output
• Full DOM extraction
• Javascript extraction (inline + external)
• Javascript extraction (environment dump)
• Full network logs (incl. request/response bodies)
• Status code
• Title
• Fuzzy hashing
• Technology detection
• OCR text extraction
• Full network logs

Example Usage - CLI

webcap -u http://example.com urls.txt -o ./my_screenshots

Example Usage - Python

import base64
from webcap import Browser

async def main():
    # create a browser instance
    browser = Browser()
    # start the browser
    await browser.start()
    # take a screenshot
    webscreenshot = await browser.screenshot("http://example.com")
    # save the screenshot to a file
    with open("screenshot.png", "wb") as f:
        f.write(webscreenshot.blob)
    # stop the browser
    await browser.stop()

if __name__ == "__main__":
    import asyncio
    asyncio.run(main())

CLI Usage (--help)

usage: webcap [-h] [-u URLS [URLS ...]] [-o OUTPUT] [-r RESOLUTION] [-f] [-t THREADS]
              [--delay DELAY] [-U USER_AGENT] [-H HEADERS [HEADERS ...]] [-p PROXY]
              [-b] [-j] [-d] [-Rs] [-Rq] [-J] [-s] [--debug] [--no-color] [-c CHROME]

options:
  -h, --help            show this help message and exit
  -u URLS [URLS ...], --urls URLS [URLS ...]
                        URL(s) to capture, or file(s) containing URLs

Output:
  -o OUTPUT, --output OUTPUT
                        Output directory
  -r RESOLUTION, --resolution RESOLUTION
                        Resolution to capture
  -f, --full-page       Capture the full page (larger resolution images)

Performance:
  -t THREADS, --threads THREADS
                        Number of threads to use
  --delay DELAY         Delay before capturing (default: 3.0 seconds)

HTTP:
  -U USER_AGENT, --user-agent USER_AGENT
                        User agent to use
  -H HEADERS [HEADERS ...], --headers HEADERS [HEADERS ...]
                        Additional headers to send in format: 'Header-Name: Header-
                        Value' (multiple supported)
  -p PROXY, --proxy PROXY
                        HTTP proxy to use

JSON Output:
  -b, --base64          Output each screenshot as base64
  -j, --json            Output JSON
  -d, --dom             Capture the fully-rendered DOM
  -Rs, --responses      Capture the full body of each HTTP response (including API
                        calls etc.)
  -Rq, --requests       Capture the full body of each HTTP request (including API
                        calls etc.)
  -J, --javascript      Capture every snippet of Javascript (inline + external)

Misc:
  -s, --silent          Silent mode
  --debug               Enable debugging
  --no-color            Disable color output
  -c CHROME, --chrome CHROME
                        Path to Chrome executable