Skip to main content

Extract article content from web platforms and return it as clean Markdown.

Project description

mdfetch

A Python library that extracts article content from web platforms and returns it as clean Markdown.

Install

pip install mdfetch

Usage

from mdfetch import extract

# Works with any supported platform — just pass the URL
markdown = extract("https://medium.com/some-publication/article-slug-abc123")
markdown = extract("https://dev.to/username/article-slug")
print(markdown)

Error handling

from mdfetch import (
    extract,
    InvalidURLError,
    UnsupportedPlatformError,
    UnsupportedContentTypeError,
    FetchError,
    HTTPStatusError,
    EmptyContentError,
)

url = "https://medium.com/some-publication/article-slug-abc123"

try:
    markdown = extract(url)
except InvalidURLError as e:
    print(f"Bad URL: {e.message}")
except UnsupportedPlatformError as e:
    print(f"Platform not supported: {e.message}")
except UnsupportedContentTypeError as e:
    print(f"Not an article page: {e.message}")
except HTTPStatusError as e:
    print(f"HTTP {e.status_code}: {e.message}")
except FetchError as e:
    print(f"Network error: {e.message}")
except EmptyContentError as e:
    print(f"No content: {e.message}")

Supported platforms

Platform Domains
Medium medium.com, *.medium.com
dev.to dev.to

Development

Requires uv.

make setup        # install dependencies
make test         # run unit tests
make integration  # run integration tests (requires network access)
make lint         # ruff check
make format       # ruff format
make build        # build wheel + sdist
make upgrade-deps # upgrade all dependencies
make clean        # remove build artifacts

Requirements

  • Python 3.12+

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mdfetch-0.2.1.tar.gz (267.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

mdfetch-0.2.1-py3-none-any.whl (10.3 kB view details)

Uploaded Python 3

File details

Details for the file mdfetch-0.2.1.tar.gz.

File metadata

  • Download URL: mdfetch-0.2.1.tar.gz
  • Upload date:
  • Size: 267.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for mdfetch-0.2.1.tar.gz
Algorithm Hash digest
SHA256 f6056be193ca28205aa2bfeb202863ce49698c8c15629817ae03d621b265044e
MD5 734aac66a7ce2fbd8fb3e42143f026cb
BLAKE2b-256 f9d436bf0f015939e320d3c1c1acb47881459b5f15d52ee27bb4637897fc2bd1

See more details on using hashes here.

Provenance

The following attestation bundles were made for mdfetch-0.2.1.tar.gz:

Publisher: publish.yml on stn1slv/md-fetch

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file mdfetch-0.2.1-py3-none-any.whl.

File metadata

  • Download URL: mdfetch-0.2.1-py3-none-any.whl
  • Upload date:
  • Size: 10.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for mdfetch-0.2.1-py3-none-any.whl
Algorithm Hash digest
SHA256 9fd2160eb9d6ce1d639ed6d0b8bdc650841ba4edcbc2629c74821e7140b89a29
MD5 0408e682f565605cb2e511ec3837f149
BLAKE2b-256 3b65b8684d57a5f9cfbd083385518e2419cde6940ba83933962bbdbdecf69a14

See more details on using hashes here.

Provenance

The following attestation bundles were made for mdfetch-0.2.1-py3-none-any.whl:

Publisher: publish.yml on stn1slv/md-fetch

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page