Skip to main content

SEO Web Crawler and Analysis Tool

Project description

Greenflare SEO Web Crawler

Greenflare SEO Web Crawler Logo

Greenflare is a lightweight free and open-source SEO web crawler for Linux, Mac, and Windows, and is dedicated to delivering high quality SEO insights and analysis solutions to the world.

Features

  • Cross-platform (Linux, Mac, and Windows)
  • Low hardware requirements
  • Scalable (tested against sites with 4M+ URLs)
  • Reports on on-page SEO elements (i.e. page title, meta robots, canonical tag)
  • Analysis of HTTP header responses (i.e. X-Robots-Tag, Canonical HTTP Header)
  • Status code reporting (i.e. 301, 404, 503 etc.)
  • robots.txt parser (implemented against the suggested REP standard by Google)
  • Custom extraction through XPath or CSS
  • Custom exclusion of URLs through various patterns
  • Quick filtering and sorting of crawl data
  • View broken internal links (3xx, 4xx, 5xx)
  • Greenflare databases (.gflaredb) are sqlite tables
  • Export any view to CSV

Getting Started

The quickest way to get started using Greenflare is to download one of our pre-built installers. Choose the version for your OS from our Download page:

https://greenflare.io/download

Developers

Are you interested in becoming more involved in the development of Greenflare? Please email beb7 if you want to help to build new amazing features or to fix nasty bugs!

Report a bug

Please report bugs by creating a new issue directly on GitHub:

https://github.com/beb7/gflare-tk/issues

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

greenflare-0.96.tar.gz (56.6 kB view hashes)

Uploaded Source

Built Distribution

greenflare-0.96-py3-none-any.whl (87.3 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page