A tool for detecting 404 errors during website migrations by checking URLs from sitemap.xml files
Project description
No URL Left Behind (nulb)
A tool for detecting 404 errors during website migrations by checking URLs from sitemap.xml files against a new domain.
Installation
pip install nulb
Usage
nulb <sitemap_url> <old_root> <new_domain>
Examples
Basic check:
nulb https://oldsite.com/sitemap.xml https://oldsite.com https://newsite.com
With custom delay and output file:
nulb https://example.com/sitemap.xml https://example.com https://new-example.com --delay 0.5 --output report.txt
Check only for 404s (skip meta comparison):
nulb https://mysite.com/sitemap.xml https://mysite.com https://newsite.com --skip-meta
Fast check with output file:
nulb https://blog.com/sitemap.xml https://blog.com https://newblog.com --delay 0 --output migration-check.txt
Options
--delay SECONDS- Delay between requests (default: 0.1)--output FILE- Save report to file--skip-meta- Check 404s only, skip meta comparison
Requirements
- Python 3.7+
License
MIT
Author
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
nulb-1.0.0.tar.gz
(11.4 kB
view details)
File details
Details for the file nulb-1.0.0.tar.gz.
File metadata
- Download URL: nulb-1.0.0.tar.gz
- Upload date:
- Size: 11.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.9.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e836e7e8eb53a56c5634c0e7d34d7531c5bf17fdf9bd72072a103c75dde1a910
|
|
| MD5 |
a89c5f9bf461ffe745dfdc8157357cb5
|
|
| BLAKE2b-256 |
34d5b647d95f7e82da053275ff744d8b11041dba9dfb0bac05200ca24007828a
|