Skip to main content

WSWS Markdown

CI Publish to PyPI

A tool to convert articles from the World Socialist Web Site to Markdown format.

Why not a generic URL-to-Markdown tool?

Generic converters guess at the main content block, so they often leak WSWS site chrome (share icons, newsletter widgets, "Read more" blocks) into the output or strip real content by mistake. This tool targets WSWS's actual markup (itemprop="articleBody", /en/authors/ links, <time datetime>) for exact extraction and frontmatter, at the cost of being tied to WSWS's current template.

Install

pip install wsws-md

Usage

wswsmd "https://www.wsws.org/en/articles/2026/07/03/coeq-j03.html"

Prints the article as Markdown (with YAML frontmatter containing title, author, date, description and source URL) to stdout. Use -o FILE / --output FILE to write to a file instead:

wswsmd "https://www.wsws.org/en/articles/2026/07/03/coeq-j03.html" -o article.md

Use --no-frontmatter to omit the YAML header and print just the title, byline and body:

wswsmd "https://www.wsws.org/en/articles/2026/07/03/coeq-j03.html" --no-frontmatter

Claude Skill

This repo also ships a Claude Skill that wraps the CLI so Claude can convert WSWS articles to Markdown directly. Download the packaged wsws-md-skill-*.zip from the Releases page and upload it as a Skill in Claude.ai.

Development

pip install -e ".[test]"
pytest

Pull request titles must follow Conventional Commits — see CONTRIBUTING.md. Releases are automated with release-please.

Metadata

Release files for wsws-md 0.2.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for wsws-md 0.2.0
File Size Uploaded Provenance Actions
wsws_md-0.2.0.tar.gz 8.7 kB With provenance Details for wsws_md-0.2.0.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for wsws-md 0.2.0
File Interpreter ABI Platform Actions
wsws_md-0.2.0-py3-none-any.whl Python 3 none any Details for wsws_md-0.2.0-py3-none-any.whl

Total release size: 15.5 kB

Release files / wsws_md-0.2.0.tar.gz

Download URL wsws_md-0.2.0.tar.gz
Size 8.7 kB
Tags Source
SHA-256 checksum
How to use checksums
e907b5e904f908f4f6f47475d7b1ba9c26aaf23c8f06769e40577f063f2f8c60
BLAKE2b-256 checksum
How to use checksums
fb21baa6d8dbb9b5c92caab8af2a677f8c463cc92d1782873e663f11bf4e8e00
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Aug 16, 2026.

Transparency log

Release files / wsws_md-0.2.0-py3-none-any.whl

Download URL wsws_md-0.2.0-py3-none-any.whl
Size 6.8 kB
Tags Python 3
SHA-256 checksum
How to use checksums
25de367581913875f27de8b3296e39c710f05edde0adeff95c8fbe59962b2f4f
BLAKE2b-256 checksum
How to use checksums
b1e9851c0bf627bb2af32dc8444318acf0ff8af80fb4d7790fa6cb6f4c7a6960
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Aug 16, 2026.

Transparency log

Security for wsws-md 0.2.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

All 2 files in this release have been uploaded with provenance metadata.

Select from 2 files

Attestation for wsws_md-0.2.0.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Aug 16, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page