Find-Sitemap 0.1.4

A set of data tools in Python

Find-Sitemap

Find Sitemap is a simple SEO tool to help you find the sitemap.

>>> from Find_Sitemap import FindSitemap
>>> main = FindSitemap('google.com')
>>> main.crawl()
...
...
check 13801/13804: https://google.com/xmap.php
check 13802/13804: https://google.com/xmap.jsp
check 13803/13804: https://google.com/xmap.asp
check 13804/13804: https://google.com/xmap.html
--------------------
Find sitemap urls len: 1
Find sitemap urls list: ['https://www.google.com/sitemap.xml']

Getting Started

Installing Requests on PyPI:

$ pip install Find-Sitemap

Prerequisites

• Python
• requests

Usage

1. Show the subdomains, slugs_L1, slugs_L2, filetypes parameters.

   >>> from Find_Sitemap import FindSitemap
   >>> main = FindSitemap('google.com')
   >>> main.subdomains
   {'www.'}
   
   >>> main.slugs_L1
   {'/default', '/sitemap', '/feeds', '/api', '/contents' ...}
   
   >>> main.slugs_L2
   {'/sitemap', '/stock', '/sitemap1', '/sitemap0', ...}
   
   >>> main.filetypes
   {'txt', 'xml', 'xml.gz', 'jsp', 'html', ...}
   

2. Add the subdomains, slugs_L1, slugs_L2, filetypes parameters.

   >>> from Find_Sitemap import FindSitemap
   >>> main = FindSitemap('google.com')
   >>> main.subdomains.add("shop.")
   >>> main.slugs_L1.add("/node")
   >>> main.slugs_L2.add("/site")
   >>> main.filetypes.add("xml")
   

3. Remove the subdomains, slugs_L1, slugs_L2, filetypes parameters.

   >>> from Find_Sitemap import FindSitemap
   >>> main = FindSitemap('google.com')
   >>> main.subdomains.remove("shop.")
   >>> main.slugs_L1.remove("/node")
   >>> main.slugs_L2.remove("/site")
   >>> main.filetypes.remove("xml")
   

4. Run the crawler.

   >>> from Find_Sitemap import FindSitemap
   >>> main = FindSitemap('google.com')
   >>> main.crawl()
   ...
   ...
   check 13801/13804: https://google.com/xmap.php
   check 13802/13804: https://google.com/xmap.jsp
   check 13803/13804: https://google.com/xmap.asp
   check 13804/13804: https://google.com/xmap.html
   --------------------
   Find sitemap urls len: 1
   Find sitemap urls list: ['https://www.google.com/sitemap.xml']
   

Contributing

• See Contributing

Authors

• Email: [e-mail]
• Website: Max 行銷誌