Skip to main content

Eek, a [web] spider.

Project description

Eek is a web crawler that outputs metadata about a website in CSV format.


$ pip install eek


usage: eek [-h] [–graph] [–delay SECONDS] [–grep PATTERN] [-i] URL

eek recursively crawls a website, outputing metadata about each page in CSV format.

positional arguments:
  URL                The base URL to start the crawl

optional arguments:
  -h, --help         show this help message and exit
  --graph            output a graphviz digraph of links instead of CSV
  --delay SECONDS    Time, in seconds, to wait in between fetches. Defaults to
  --grep PATTERN     Print urls containing PATTERN (a python regular
  -i, --ignore-case  Ignore case. Only valid with --grep



To save output to a file, use redirection

eek > ~/some_file.csv

To slow down crawling, use --delay=[seconds]

Project details

Release history Release notifications

This version
History Node


History Node


History Node


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, size & hash SHA256 hash help File type Python version Upload date
eek-1.0.2.tar.gz (7.4 kB) Copy SHA256 hash SHA256 Source None Jul 11, 2014

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging CloudAMQP CloudAMQP RabbitMQ AWS AWS Cloud computing Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page