markdown-this
Extract the readable content of a URL and convert it to Markdown. The package also handles GitHub repositories and Markdown files through the GitHub API, and arXiv abstract pages through their HTML representation.
Installation
uv add markdown-this
Usage
from markdown_this import extract_main_content
title, markdown, fallback_text, intro = extract_main_content(
"https://example.com/article"
)
The source can also be a local HTML file (Path or path string) or raw HTML:
from pathlib import Path
from markdown_this import extract_main_content
title, markdown, fallback_text, intro = extract_main_content(Path("article.html"))
title, markdown, fallback_text, intro = extract_main_content("<html><p>...</p></html>")
extract_main_content returns the title, extracted Markdown, plain-text
fallback, and a short introduction suitable for a notification or preview.
The Markdown value starts with YAML front matter containing the metadata that
was found, such as title, author, url, date, and the declared page
type (article, website, home, and so on).
For example:
---
title: An article
author: An author
url: https://example.com/article
date: 2026-08-06
---
Article content.
The package also installs a markdown-this command:
markdown-this https://example.com/article
markdown-this article.html
cat article.html | markdown-this -
The command writes the extracted Markdown to stdout. Its input may be a URL, an existing HTML path, or HTML read from stdin.
The lower-level fetchers and normalization helpers are available from the package modules when an application needs more control over the pipeline.
Development
uv run pytest packages/markdown-this/tests
uv run ruff check packages/markdown-this
License
MIT
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file markdown_this-0.1.6.tar.gz.
File metadata
- Download URL: markdown_this-0.1.6.tar.gz
- Upload date:
- Size: 8.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
uv/0.12.2 {"installer":{"name":"uv","version":"0.12.2","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e65884135f46aace9b68c77ac8e47a206f777035ff086ca9e7bcd02e849999f8
|
|
| MD5 |
380a5f8e3a6fe0816c6bac6ee40640ed
|
|
| BLAKE2b-256 |
07f64c306bb7190937a3adb1dfefc5731e69ea53aeb7bfa39910b6976bcdeefb
|
File details
Details for the file markdown_this-0.1.6-py3-none-any.whl.
File metadata
- Download URL: markdown_this-0.1.6-py3-none-any.whl
- Upload date:
- Size: 12.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
uv/0.12.2 {"installer":{"name":"uv","version":"0.12.2","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
c939c6e9e335c481ff2488072a75b49517dc62975b227cd0641fac90ad4481ac
|
|
| MD5 |
2bee57cbcac428bf2596d694a89b4cf2
|
|
| BLAKE2b-256 |
f957ffe995d894f8dc63d48246d30714eee4e4c8f331b36d30def1d88f6135bc
|
