getsitemap
.. image:: https://readthedocs.org/projects/getsitemap/badge/?version=latest :target: https://getsitemap.readthedocs.io/en/latest/?badge=latest :alt: Documentation Status
.. image:: https://badge.fury.io/py/getsitemap.svg :target: https://badge.fury.io/py/getsitemap
.. image:: https://img.shields.io/pypi/dm/getsitemap :target: https://pypistats.org/packages/getsitemap
.. image:: https://img.shields.io/pypi/l/getsitemap :target: https://github.com/capjamesg/getsitemap/blob/main/LICENSE
.. image:: https://img.shields.io/pypi/pyversions/getsitemap :target: https://badge.fury.io/py/getsitemap |
getsitemap is a Python library that retrieves all of the URLs that are found in all of the sitemaps on a website.
This project may be useful if you are building a search crawler or sitemap URL status code validators.
You can read the documentation for this project on Read the Docs <https://getsitemap.readthedocs.io/en/latest/>_.
Installation 💻
To get started, pip install getsitemap:
::
pip install getsitemap
Quickstart ⚡
get all URLs recursively in all sitemaps
.. code-block:: python
import getsitemap
urls = getsitemap.get_individual_sitemap("https://jamesg.blog/sitemap.xml")
print(urls)
get all URLs in a single sitemap
.. code-block:: python
import getsitemap
all_urls = getsitemap.retrieve_sitemap_urls("https://sitemap")
print(all_urls)
Code Quality
This library uses tox, pytest, and flake8 to assure code quality.
To run code quality checks, run the following command:
.. code-block:: bash
tox
License 👩⚖️
This project is licensed under an MIT License <LICENSE>_.
Contributing 🛠️
We would love to have your help in improving getsitemap. Have an idea for a new feature or a bug to fix? Leave information in a GitHub Issue to start a discussion!
If you have
Contributors 💻
- capjamesg
Metadata
Release files for getsitemap 0.1.5
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| getsitemap-0.1.5.tar.gz | 5.6 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| getsitemap-0.1.5-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 11.0 kB
Release files / getsitemap-0.1.5.tar.gz
| Download URL | getsitemap-0.1.5.tar.gz |
|---|---|
| Size | 5.6 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
ecfdd3fe514c71412bb6493815c4342794cfd524e73ece566be87bb506b2f2a2
|
|
BLAKE2b-256 checksum How to use checksums |
e58d8ee0d916b3533a5fc79591b1f4948529eb62b2eeb08ee64fde0e5ae92b14
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.9.12
|
Release files / getsitemap-0.1.5-py3-none-any.whl
| Download URL | getsitemap-0.1.5-py3-none-any.whl |
|---|---|
| Size | 5.4 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
e94abfba4f9c0fa6be0c0592e3af8c9ca4c24806b5ea0aca105c298339e31db9
|
|
BLAKE2b-256 checksum How to use checksums |
d5a9f02f609f964bd97a70461e3e38753b92e110f0d87512341c41c49af99c1c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.9.12
|