Skip to main content

A tool for detecting 404 errors during website migrations by checking URLs from sitemap.xml files

Project description

No URL Left Behind (nulb)

A tool for detecting 404 errors during website migrations by checking URLs from sitemap.xml files against a new domain.

Installation

pip install nulb

Usage

nulb <sitemap_url> <old_root> <new_domain>

Examples

Basic check:

nulb https://oldsite.com/sitemap.xml https://oldsite.com https://newsite.com

With custom delay and output file:

nulb https://example.com/sitemap.xml https://example.com https://new-example.com --delay 0.5 --output report.txt

Check only for 404s (skip meta comparison):

nulb https://mysite.com/sitemap.xml https://mysite.com https://newsite.com --skip-meta

Fast check with output file:

nulb https://blog.com/sitemap.xml https://blog.com https://newblog.com --delay 0 --output migration-check.txt

Options

  • --delay SECONDS - Delay between requests (default: 0.1)
  • --output FILE - Save report to file
  • --skip-meta - Check 404s only, skip meta comparison

Requirements

  • Python 3.7+

License

MIT

Author

James Shakespeare (j@jshakespeare.com)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nulb-1.0.1.tar.gz (11.6 kB view details)

Uploaded Source

File details

Details for the file nulb-1.0.1.tar.gz.

File metadata

  • Download URL: nulb-1.0.1.tar.gz
  • Upload date:
  • Size: 11.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.9.6

File hashes

Hashes for nulb-1.0.1.tar.gz
Algorithm Hash digest
SHA256 e0e35061bcaedc7a7382891229bad9f368a754090cbb9b3bd854b903bc136328
MD5 0a307cd5cca7007d5bb5ceae7aa76d30
BLAKE2b-256 d7329b5d41245fd0b09932477329d092b6cb17e3f9c3105f65d11d489e999d89

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page