Skip to main content

A tool for detecting 404 errors during website migrations by checking URLs from sitemap.xml files

Project description

No URL Left Behind (nulb)

A tool for detecting 404 errors during website migrations by checking URLs from sitemap.xml files against a new domain.

Installation

pip install nulb

Usage

nulb <sitemap_url> <old_root> <new_domain>

Examples

Basic check:

nulb https://oldsite.com/sitemap.xml https://oldsite.com https://newsite.com

With custom delay and output file:

nulb https://example.com/sitemap.xml https://example.com https://new-example.com --delay 0.5 --output report.txt

Check only for 404s (skip meta comparison):

nulb https://mysite.com/sitemap.xml https://mysite.com https://newsite.com --skip-meta

Fast check with output file:

nulb https://blog.com/sitemap.xml https://blog.com https://newblog.com --delay 0 --output migration-check.txt

Options

  • --delay SECONDS - Delay between requests (default: 0.1)
  • --output FILE - Save report to file
  • --skip-meta - Check 404s only, skip meta comparison

Requirements

  • Python 3.7+

License

MIT

Author

James Shakespeare (j@jshakespeare.com)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nulb-1.0.0.tar.gz (11.4 kB view details)

Uploaded Source

File details

Details for the file nulb-1.0.0.tar.gz.

File metadata

  • Download URL: nulb-1.0.0.tar.gz
  • Upload date:
  • Size: 11.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.9.6

File hashes

Hashes for nulb-1.0.0.tar.gz
Algorithm Hash digest
SHA256 e836e7e8eb53a56c5634c0e7d34d7531c5bf17fdf9bd72072a103c75dde1a910
MD5 a89c5f9bf461ffe745dfdc8157357cb5
BLAKE2b-256 34d5b647d95f7e82da053275ff744d8b11041dba9dfb0bac05200ca24007828a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page