Skip to main content

CLI for Anakin.io web scraping, search, and research API

Project description

Anakin CLI

PyPI version Python License: MIT

Command-line interface for Anakin.io's web scraping, search, and research API.

Requirements

Install

pip install anakin-cli

Quick Start

# Authenticate
anakin login --api-key "ak-your-key-here"

# Verify
anakin status

# Search the web
anakin search "python async best practices"

# Scrape a page to markdown
anakin scrape "https://example.com" -o page.md

# Extract structured data (AI-powered)
anakin scrape "https://example.com/product" --format json -o product.json

# Batch scrape multiple URLs
anakin scrape-batch "https://a.com" "https://b.com" -o batch.json

# Deep research (1-5 minutes)
anakin research "comparison of web frameworks 2025" -o report.json

Commands

Command Description
search AI-powered web search (instant)
scrape Scrape a single URL — markdown, JSON, or raw
scrape-batch Scrape up to 10 URLs at once
research Deep agentic research (1-5 min)
login Save your API key
status Check version and auth status

Scrape Formats

The scrape command supports three output formats via --format:

# Default — clean page text
anakin scrape "https://example.com"

# AI-extracted structured data
anakin scrape "https://example.com/product" --format json -o data.json

# Full API response (for debugging)
anakin scrape "https://example.com" --format raw -o debug.json
Format What you get Size
markdown (default) Clean readable page text Small
json AI-extracted structured data only Small
raw Full API response (html, metadata, everything) Large

Other scrape options

--browser          # Use headless browser (for JS-heavy sites)
--country CC       # Country code (default: us)
--session-id ID    # Session ID for authenticated scraping
--timeout SECS     # Polling timeout in seconds (default: 120)
-o, --output FILE  # Save output to file

Authentication

Get your API key at anakin.io/dashboard.

Option A — Login command (recommended):

anakin login --api-key "ak-your-key-here"

Option B — Environment variable:

export ANAKIN_API_KEY="ak-your-key-here"

If no key is configured, the CLI will prompt you to enter one interactively.

Error Handling

The CLI provides clear error messages for common issues:

Error Cause Fix
Authentication failed (401) Invalid or missing API key Run anakin login --api-key "ak-xxx"
Plan upgrade required (402) Feature not available on your plan Visit anakin.io/pricing
Rate limit exceeded (429) Too many requests Wait a few seconds and retry
Job did not complete within Xs Scrape/research timed out Increase with --timeout 300
Job failed Server could not process the URL Check if the URL is accessible

All errors exit with code 1. Success exits with code 0.

Tips

  • Always quote URLs that contain ?, &, or # — shells like zsh interpret these as special characters:
    # Wrong — zsh will fail with "no matches found"
    anakin scrape https://example.com/page?id=123
    
    # Correct
    anakin scrape "https://example.com/page?id=123"
    
  • Use --browser for JavaScript-heavy sites (SPAs, dynamic content).
  • Use -o to save output to a file. Without it, output goes to stdout.
  • All progress/status messages go to stderr, so piping works cleanly:
    anakin scrape "https://example.com" | jq '.title'
    

Documentation

Support

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

anakin_cli-0.1.0.tar.gz (9.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

anakin_cli-0.1.0-py3-none-any.whl (11.8 kB view details)

Uploaded Python 3

File details

Details for the file anakin_cli-0.1.0.tar.gz.

File metadata

  • Download URL: anakin_cli-0.1.0.tar.gz
  • Upload date:
  • Size: 9.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.0

File hashes

Hashes for anakin_cli-0.1.0.tar.gz
Algorithm Hash digest
SHA256 92d58895ec8bfdc84d76226ccf77946c0389e73066187dd3cdde5ea059e30427
MD5 c94e9004b891cf9872816a7117958d33
BLAKE2b-256 fb3b6c6b09fac83c83f4d22e7109bbdac9b4beb036ed9b066764325f93adfaf1

See more details on using hashes here.

File details

Details for the file anakin_cli-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: anakin_cli-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 11.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.0

File hashes

Hashes for anakin_cli-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 198f2829d64f7297d472a7a4dcb39b948ebb1a1e98778f83111ab40e709fe5d3
MD5 f174ca094d0588a2ce1fcb78b7ff997f
BLAKE2b-256 60b7575b6f86e1e454417f1c38dee6969bf989cfc9c12b044b502e3d0598f889

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page