Check links for Markdown-based site
Project description
Linkchecker for Markdown-based static generated sites
Blazing-fast Python asyncio / aiohttp based simple check of links in Markdown .md files only. This tool is very helpful for large Markdown-based Jekyll and Hugo sites. It is very fast and simple--it's what we use to check https://www.scivision.dev
Install
for latest release:
python -m pip install linkcheckmd
or for latest development version.
git clone https://github.com/scivision/linkchecker-markdown
pip install -e linkchecker-markdown
Usage
The static site generator does NOT have to be running for these tests--it looks at the .md files directly. Assuming your webpage Markdown files have top-level directory ~/web:
-
Jekyll
linkcheckMarkdown ~/web/_posts
-
Hugo
linkcheckMarkdown ~/web/content
The -v
--verbose
options prints the URLs as they are checked.
Observe that URLs from different markdown files are interleaved, showing the asynchronous nature of this program.
Benchmark
For benchmarking and reference, we include a synchronous Requests-based method. For a website with 100+ pages, compare times of:
Git precommit
See ./examples/pre-commit script for a Git hook pre-commit Python script.
Alternatives
Strict anti-leeching methods can cause false positives with this and other link checking programs.
Alternative solutions include:
- asyncio-based web browser interface like Arsenic
- Go-based htmltest.
- GitHub Action for checking links in Markdown files.
- Netlify link-check plugin
- LinkChecker.py: too many false positives/negatives, very slow and only works with HTML.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file linkcheckmd-1.2.0.tar.gz
.
File metadata
- Download URL: linkcheckmd-1.2.0.tar.gz
- Upload date:
- Size: 8.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.24.0 setuptools/47.3.1.post20200622 requests-toolbelt/0.9.1 tqdm/4.47.0 CPython/3.8.3
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 48a9d6690694a761189c9d3c6aecb1ff72e094d1274bac983d6900cfbbb3f437 |
|
MD5 | 3891c955b346582d60b1fd1f41f1f177 |
|
BLAKE2b-256 | 26a786055ac5a98fad4af6089c7c7bb853fd5e51bbbcbb947df4f3decc04d444 |