Skip to main content

SEO Web Crawler and Analysis Tool

Project description

Greenflare SEO Web Crawler

PyPI version Supported Python Versions Downloads License: GPL v3

Greenflare is a lightweight free and open-source SEO web crawler for Linux, Mac, and Windows, and is dedicated to delivering high quality SEO insights and analysis solutions to the world.

Features

  • Cross-platform (Linux, Mac, and Windows)
  • Low hardware requirements
  • Scalable (tested against sites with 4M+ URLs)
  • Reports on on-page SEO elements (i.e. page title, meta robots, canonical tag)
  • Analysis of HTTP header responses (i.e. X-Robots-Tag, Canonical HTTP Header)
  • Status code reporting (i.e. 301, 404, 503 etc.)
  • robots.txt parser (implemented against the suggested REP standard by Google)
  • Custom extraction through XPath or CSS
  • Custom exclusion of URLs through various patterns
  • Quick filtering and sorting of crawl data
  • View broken internal links (3xx, 4xx, 5xx)
  • Greenflare databases (.gflaredb) are sqlite tables
  • Export any view to CSV

Getting Started

The quickest way to get started using Greenflare is to download one of our pre-built installers. Choose the version for your OS from our Download page:

https://greenflare.io/download

Python Package

Greenflare is also available as a pypi package:

pip install greenflare

The use of a virtual environment (venv) is recommended. Linux users may chose to install ttkthemes for an improved visual experience.

Developers

Are you interested in becoming more involved in the development of Greenflare? Please submit a pull request if you want to help to build new amazing features or to fix nasty bugs! Alternatively, please email ben at greenflare dot io

Report a bug

Please report bugs by creating a new issue directly on GitHub:

https://github.com/beb7/gflare-tk/issues

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

greenflare-0.98.1.tar.gz (61.6 kB view details)

Uploaded Source

Built Distribution

greenflare-0.98.1-py3-none-any.whl (95.3 kB view details)

Uploaded Python 3

File details

Details for the file greenflare-0.98.1.tar.gz.

File metadata

  • Download URL: greenflare-0.98.1.tar.gz
  • Upload date:
  • Size: 61.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.25.0 setuptools/49.1.3 requests-toolbelt/0.9.1 tqdm/4.54.0 CPython/3.9.1

File hashes

Hashes for greenflare-0.98.1.tar.gz
Algorithm Hash digest
SHA256 94e1887d18bd448117f545bfd7161cb88bb3b6e7c1dfacec300fd6eda5f985e7
MD5 204fee104f9ab9de4bafc354a2e0763a
BLAKE2b-256 3644fe1d512ace0d3a7edfc9bd0bd5f73ecf3ded43fb0a500172d284871c41e2

See more details on using hashes here.

File details

Details for the file greenflare-0.98.1-py3-none-any.whl.

File metadata

  • Download URL: greenflare-0.98.1-py3-none-any.whl
  • Upload date:
  • Size: 95.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.25.0 setuptools/49.1.3 requests-toolbelt/0.9.1 tqdm/4.54.0 CPython/3.9.1

File hashes

Hashes for greenflare-0.98.1-py3-none-any.whl
Algorithm Hash digest
SHA256 453f21ec965d397ec233625f8095afa0cf9ad943faaa9673b39132fa7ec19c9a
MD5 34432c0fd0ae43ea0a4eafa117129c35
BLAKE2b-256 72a0c40e308af47e57d6881932392efdaaecce29a88a93857e9b0ebe47101523

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page