🗺️ Sitemap Harvester
🚀 A blazingly fast Python tool to harvest URLs and metadata from website sitemaps like a digital archaeologist!
🚀 Quick Start
Installation
pip install sitemap-harvester
Basic Usage
# Harvest a website's sitemap
sitemap-harvester --url https://example.com
# Custom output file and timeout
sitemap-harvester --url https://example.com --output my_data.csv --timeout 15
🎯 What Gets Extracted?
- 📝 Page Title - The main title of each page
- 📄 Meta Description - SEO descriptions
- 🏷️ Keywords - Meta keywords (if present)
- 👤 Author - Page author information
- 🔗 Canonical URL - Canonical link references
- 🖼️ Open Graph Data - Social media metadata
- 🌐 Custom Meta Tags - Any additional meta information
💡 Pro Tips
- Use
--timeoutfor slower websites or large sitemaps - The tool automatically deduplicates URLs for you
- Check the console output for real-time progress updates
- Large sitemaps? Grab a coffee ☕ and let it work its magic!
🤝 Contributing
Found a bug? Have a feature request? Contributions are welcome! Feel free to open an issue or submit a pull request.
📜 License
This project is licensed under the Apache License 2.0 - see the LICENSE file for details.
Happy harvesting! 🌾
1 maintainer
Metadata
1 maintainer
Release files for sitemap-harvester 1.0.5
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| sitemap_harvester-1.0.5.tar.gz | 8.8 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| sitemap_harvester-1.0.5-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 18.7 kB
Release files / sitemap_harvester-1.0.5.tar.gz
| Download URL | sitemap_harvester-1.0.5.tar.gz |
|---|---|
| Size | 8.8 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
4fcb6d608fe23cce1f95dac0a59d4f39ed31c0df58bb843d7755bb6501bb7118
|
|
BLAKE2b-256 checksum How to use checksums |
1f556cc82742714299a2fe2a41a141cba172679f23b82dfa5069207d27981ae3
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Oct 29, 2025.
Transparency logRelease files / sitemap_harvester-1.0.5-py3-none-any.whl
| Download URL | sitemap_harvester-1.0.5-py3-none-any.whl |
|---|---|
| Size | 9.8 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
d581cef48e6c7bc237bc4660066a2e9236df600daa5ce6d4444020b45e0ff216
|
|
BLAKE2b-256 checksum How to use checksums |
4d135e222dabea40ae2e5545277d07756d47246bd27822dde12737391e327b9b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Oct 29, 2025.
Transparency log
