Skip to main content

Read paywalled articles in your terminal

Project description

freeread 📰

Read paywalled articles directly in your terminal. No browser. No ads. No friction.

freeread https://www.nytimes.com/some-article

How it works

freeread tries multiple bypass methods in order until one works:

  • ph archive.ph (public cache)
  • 12ft 12ft.io proxy
  • ref Google Referer header trick
  • cookie cookie-clearing (metered paywalls)
  • http Scrapling HTTP fetch (curl_cffi impersonation)
  • bot Googlebot user-agent spoof
  • stealth Scrapling headless browser plus Cloudflare bypass
  • dynamic Scrapling Playwright render (JS-heavy)
  • wb Wayback Machine (slowest)

Scrapling methods are optional. Install with pip install freeread[scrapling].

Install

Requirements: Python 3.10+

pipx (recommended for most users)

Installs freeread as an isolated CLI tool. No virtualenv setup, no conflicts.

pipx install freeread

# With Scrapling-powered methods
pipx install "freeread[scrapling]"

Install pipx first if needed: pip install pipx or brew install pipx

uv (recommended for developers)

uv is a fast Rust-based Python package manager.

# Install uv (one-time)
curl -LsSf https://astral.sh/uv/install.sh | sh

# Install freeread
uv pip install freeread

# With Scrapling-powered methods
uv pip install "freeread[scrapling]"

# Or run directly without installing
uv run freeread <url>

pip (classic)

pip install freeread

# With Scrapling-powered methods
pip install "freeread[scrapling]"

If you hit externally-managed-environment on Ubuntu/Debian, add --break-system-packages or use pipx/uv instead.

Run from source

git clone https://github.com/GHesericsu/freeread
cd freeread
pip install -e .
freeread <url>

Update

# pipx
pipx upgrade freeread

# uv
uv pip install --upgrade freeread

# pip
pip install --upgrade freeread

Usage

# Read any article
freeread https://www.wsj.com/some-article

# Clean markdown output (good for piping to an LLM)
freeread https://www.theatlantic.com/... --md > article.md

# Force a specific method
freeread https://ft.com/article --method ph
freeread https://ft.com/article --method cookie
freeread https://ft.com/article --method stealth

# Use a proxy (optional)
freeread https://ft.com/article --proxy "$DECODO_MOBILE_PROXY"

# Use your own session cookies (for hard paywalls like WSJ Live)
freeread https://wsj.com/... --cookies ./wsj-cookies.txt

# Raw text output (no rich formatting, good for piping)
freeread https://nytimes.com/article --raw

# List available methods
freeread --list-methods

# Top headlines from multiple sources (default)
freeread news

# Pick a single source
freeread news --source bbc
freeread news --source hn
freeread news -s aljazeera --raw

# Available sources: mix (default), google, bbc, aljazeera, npr, hn, reddit

Limitations

  • Hard server-side paywalls (FT, WSJ 2024+) may not work if no archive exists
  • Some sites actively block archive services
  • Brand new articles may not have an archive yet — try --method bot first

Notes

This tool only accesses publicly cached or archived versions of articles. It does not circumvent authentication or access content that was never publicly available.

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

freeread-0.3.1.tar.gz (10.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

freeread-0.3.1-py3-none-any.whl (10.9 kB view details)

Uploaded Python 3

File details

Details for the file freeread-0.3.1.tar.gz.

File metadata

  • Download URL: freeread-0.3.1.tar.gz
  • Upload date:
  • Size: 10.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for freeread-0.3.1.tar.gz
Algorithm Hash digest
SHA256 f0f56eb1ae53328b5482e75fe2fb0d6b70197aa0cfdb90dcba34c327b30befd4
MD5 1ad4e22d42f93ae1eba37685068c88f8
BLAKE2b-256 25fccdae2df45ac2a5f9da7ed548136654d81baaf19f7219ee26e5d8be5a05c4

See more details on using hashes here.

File details

Details for the file freeread-0.3.1-py3-none-any.whl.

File metadata

  • Download URL: freeread-0.3.1-py3-none-any.whl
  • Upload date:
  • Size: 10.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for freeread-0.3.1-py3-none-any.whl
Algorithm Hash digest
SHA256 6ca1eca579bcc7033a36150b9040cb048e8981ce2dd91897a3dbbad4640604a0
MD5 3f973b5d674a77ba961c5a0b518108e7
BLAKE2b-256 f817be6daa55035444b0ed6d02d59d9c5214b35ed030468a39f8b1168499c710

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page